Sets out quality controls as an evidence-led approach to large-scale open online learning, covering responsibility, outcome evidence and sustained effect.
The rapid expansion of open online courses in 2012 provides the immediate context for large-scale open online learning. A disciplined improvement process separates immediate containment from corrective action directed at the underlying cause.
Implementation of corrective action should be organised around a decision that can be tested. For large-scale open online learning, a complete improvement record should define the baseline, affected scope, causal hypothesis, responsible owner, resources, milestones and measures of effectiveness. The implementation record should link purpose, authority, resources, operation and reported result.
Improvement objective and baseline
When examining large-scale open online learning, this analysis is informed by rapid expansion of open online courses in 2012. Its relevance to large-scale open online learning should be assessed against the affected jurisdiction, learner population and form of provision.
For the matter, the public interest is not confined to institutional compliance. When examining large-scale open online learning, a change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Learner protection requires intelligible information and a timely means of reviewing consequential mistakes or unfair decisions.
- Maintain continuity and supplier exit controls before it informs a consequential decision.
- Define the educational purpose of the technology before it is relied on for a decision with material effect.
- Support staff and learners.
- Test access before requiring use.
- Provide alternative routes for material barriers before it informs a consequential decision.
Controls and accountable action
The analysis of large-scale open online learning should make its decision rule explicit. An improvement plan should connect a verified problem with a specific intervention, accountable ownership, resources, milestones and a measure of effect. Broad intentions should be converted into decisions capable of review. This supports consistent review and reduces the risk of redefining the basis of judgement after an adverse result appears.
The principal risks in relation to corrective action are technology access determining educational access, assessment methods that do not support valid judgements, supplier dependency without continuity controls, and inaccessible content or interaction. As regards large-scale open online learning, the control environment should be assessed as a connected system rather than as unrelated individual risks.
As regards large-scale open online learning, the evidential record should be limited to material that can answer the question under review. For the relevant practice, the most relevant material is likely to include delivery-mode design and approval records, learner access and participation information, accessibility and usability testing, and teacher capability and workload information. Within the scope under review, confidence is strengthened by corroboration, not by the volume of records drawn from the same underlying source.
- Does each action address a stated cause?
- What measure will establish success?
- Are dependencies and resources identified?
- Who confirms sustained effectiveness?
- Is the problem defined by evidence?
Evidence of effect
Improvement work on corrective action should begin with a verified problem, defined baseline and measurable outcome. For large-scale open online learning, completion should depend on evidence of effect rather than completion of planned activity. Amend the plan where evidence does not support the original causal assumption. Averages should be tested against adverse cases that may indicate unequal effect or incomplete operation.
A decision to close improvement work on large-scale open online learning should be made by a person with authority and sufficient independence from implementation.
Interpretation of the intended improvement should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. The relevant practice, digital participation data should not be treated as a direct measure of learning. In the context of large-scale open online learning, log-ins, connection time and activity counts require interpretation alongside assessment and learner experience. A short-term increase in activity may not represent sustained improvement. Measures should remain in place long enough to detect recurrence and unintended effects.
Governance of the relevant practice requires a clear allocation of authority, information and follow-through. As regards large-scale open online learning, the responsible body should receive matters requiring resources, policy change or formal risk acceptance. Earlier conclusions should remain traceable if they affected a learner, provider or public decision.
Public reporting on the relevant practice should distinguish established fact, analytical judgement and planned action. For decisions concerning large-scale open online learning, revision history should remain available where users have relied on the earlier conclusion. A revised conclusion should distinguish a change in the underlying condition from a change in method, coverage or evidence.
As regards large-scale open online learning, complete assurance concerning the intended improvement cannot rest on a single indicator or isolated control. The final judgement on large-scale open online learning should connect the applicable expectation to implementation and outcomes while identifying unresolved risk.