Risk-based improvement planning for learning-adjusted years of schooling

Analysis of learning-adjusted years of schooling should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning. Intervention in the improvement priority should be proportionate to the identified condition and tested where risk permits. Wider implementation should follow evidence of benefit and acceptable unintended effects. Risk assessment for the improvement priority should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.

The present position

Data used for learning-adjusted years of schooling should be interpreted against stable definitions and an identifiable population. Reporting should identify a break in comparability before describing movement over time. The result should be accompanied by distributional information, uncertainty and limits on transfer to another setting. Decision-makers should state which matters are evidenced, which express policy and which require authorised judgement. Intervention in the corrective programme should be proportionate to the identified condition and tested where risk permits.

The position on the improvement priority should be established through proportionate evidence and should remain open to correction when material new information becomes available. The public-interest assessment of the matter under review should consider access, learning, fair treatment and the reliability of information on which learners make consequential decisions.

Corrective action concerning the matter under review should address the identified cause, assign responsibility and set a review period. Residual risk should remain open until sustained improvement is demonstrated. Review of the intervention should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event. Frequency is relevant, but a rare event may still be material where the effect is serious or irreversible. The method should prevent an unfavourable result from being dismissed through an unrecorded change in interpretation.

Governance of the matter under review requires a clear allocation of authority, information and follow-through. Escalation should place material evidence before the authority capable of an effective response. The principal risks associated with the improvement priority should be assessed as connected conditions. A failed safeguard may conceal another weakness or prevent timely correction. Operational definitions should be precise enough to support consistent consequential decisions and explain justified variation.

A narrow control over the corrective programme may create false assurance. Public information on the affected practice should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction. The principal risks associated with the intervention should be assessed as connected conditions.

Useful records include approval and change-control records, moderation and exception records, appeal and correction records, marking criteria and calibrated judgement, and assessment maps to learning outcomes. Corrective action concerning the affected practice should address the identified cause, assign responsibility and set a review period. A selected successful case does not establish effectiveness across the system.

Implications for assessment and learning-outcome assurance

Risk assessment for learning-adjusted years of schooling should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material. Examination of the matter should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event. Reassess materiality when new evidence changes the likely scope or consequence. Adverse cases and unresolved contradictions should be retained because they may reveal limitations concealed by an average result.

Analysis of the improvement priority should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Changes in method, definition or series should remain separate from changes in the underlying result. Corrective action concerning the improvement priority should address the identified cause, assign responsibility and set a review period. Unfinished work and remaining exposure should be reported rather than absorbed into a general statement of progress.

Findings on the corrective programme should preserve material uncertainty and limits on application. Validity without adequate consistency may expose learners to unequal judgement. Material limitations should be stated with the finding presented to decision-makers and affected learners.

Reporting on the corrective programme should distinguish established fact, analytical judgement and planned action. Material revisions should retain their reason and effective date. The correction record should state what the new evidence changes and which earlier conclusions or decisions require review. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.

Governance of the corrective programme requires a clear allocation of authority, information and follow-through. Oversight is effective only if the responsible body receives the evidence and records its decision on resources, policy and residual risk. Material matters should be referred to the body authorised to act or accept residual risk.

Data used for the corrective programme should be interpreted against stable definitions and an identifiable population. The relevant measure is demonstrated public benefit, including detection and correction of material variation.