Completion data: a documented improvement approach

The early leaving and progression evidence provides the immediate reference point for consideration of completion data in 2012. Oversight of the corrective programme should reflect the principle that a disciplined improvement process separates immediate containment from corrective action directed at the underlying cause. Attention is directed to decisions with material consequences for learners, institutional responsibility and educational resources. The appropriate administrative form will depend on the jurisdiction and the allocation of lawful responsibility.

The stated reference is Early leaving and progression evidence. The level of inference should not extend beyond the level at which the source data are valid. A conclusion on the improvement priority should extend no further than the available evidence permits. Missing populations, inconsistent records and unresolved exceptions should be reported with the finding. The comparability record should identify material variation in coverage, period and classification.

The present position

The required public outcome should be stated in operational terms. For completion data, education systems should examine not only who enters education, but who can participate effectively, progress and complete with the intended learning outcomes. Inputs and formal commitments should be distinguished from demonstrated operation and outcome. The operating record should enable responsible bodies to detect unintended effects and act where outcomes are unequal.

Corrective action concerning the affected practice should address the identified cause, assign responsibility and set a review period. Residual risk should remain open until sustained improvement is demonstrated. Corrective action concerning the matter under review should address the identified cause, assign responsibility and set a review period. A review should test the interfaces between functions, not assume that sound component controls ensure a sound end-to-end process. Any indicator used in relation to the affected practice should distinguish description from causal explanation. Material variation and uncertainty should be reported together with any restriction on wider application.

Improvement work on the improvement priority should begin with a verified problem, defined baseline and measurable outcome. Completion should depend on evidence of effect rather than completion of planned activity. Improvement work on the intervention should begin with a verified problem, defined baseline and measurable outcome. Responsibility for the corrective programme should be identifiable at each consequential decision point. Delegating operational work does not transfer accountability for its effect on learners.

Assurance of the intervention should draw on more than one form of evidence. Useful records include evaluation of interventions, disaggregated participation and outcome data, progression and early-warning information, learner feedback and complaints, and records of barriers and support. Documentary conformity alone is insufficient where operation or learner experience indicates a material difference. Improvement work on the affected practice should begin with a verified problem, defined baseline and measurable outcome.

• Review policies that create avoidable exclusion and retain evidence sufficient for independent review.
• Monitor progression at useful intervals, including material exceptions and unequal effects.
• Evaluate differential outcomes and retain evidence sufficient for independent review.
• Identify groups not represented in aggregate results before using it to determine a learner or provider outcome.
• Target support transparently and retain evidence sufficient for independent review.

Operational significance

A narrow control over completion data may create false assurance. In the present context, support allocated without evidence of need, completion measures detached from learning and aggregate gains concealing excluded groups may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. Examination of the matter should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event.

The review method for the improvement priority should be reproducible. Risk assessment for the matter under review should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material. A case-by-case response is insufficient when evidence shows recurrence or a population beyond the cases already identified. Documentation should be sufficient to reconstruct the judgement without relying on unrecorded explanation.

Each test should record the starting condition, change introduced, population affected and result. Wider adoption should follow evidence of benefit and acceptable unintended effects. Corrective action concerning the improvement priority should address the identified cause, assign responsibility and set a review period.

The principal risks associated with the matter under review should be assessed as connected conditions. A failed safeguard may conceal another weakness or prevent timely correction. For the affected practice, equal treatment does not necessarily produce equitable access or outcomes. Intervention in the improvement priority should be proportionate to the identified condition and tested where risk permits. Wider implementation should follow evidence of benefit and acceptable unintended effects. Improvement work on the corrective programme should begin with a verified problem, defined baseline and measurable outcome.

The evidential trail should allow an affected decision to be identified, examined and corrected. For the affected practice, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. Intervention in the affected practice should be proportionate to the identified condition and tested where risk permits.

The principal risks associated with the corrective programme should be assessed as connected conditions. Responsibility and timing should be settled when the action is approved, not after delay occurs. The matter should remain open until the intended effect is demonstrated across the relevant scope.

Authorities and providers should use the current development to test whether the matter under review connects public commitment with effective operation and evidence of result. Governance of the improvement priority requires a clear allocation of authority, information and follow-through. Material matters should be referred to the body authorised to act or accept residual risk.