Considers what the available data can establish about education participation and transition and identifies the limitations that should accompany any public conclusion.
In 2012, consideration of education participation and transition must take account of Education at a Glance 2012 and the responsibilities it places before education systems. The analysis of the evidence under review proceeds on the basis that the value of the present data lies in the questions it can answer reliably and in the limits it makes visible. The assessment addresses decisions capable of affecting learners, institutions or the proper use of entrusted educational resources. Application should respect material differences in law, system design and institutional responsibility.
Scope of this analysis
The central objective should not be obscured by the form of the administrative response. The analysis of education participation and transition proceeds on the basis that education systems should examine not only who enters education, but who can participate effectively, progress and complete with the intended learning outcomes. Inputs and formal commitments should be distinguished from demonstrated operation and outcome. The operating record should enable responsible bodies to detect unintended effects and act where outcomes are unequal.
- Report limitations in available data and retain evidence sufficient for independent review.
- Target support transparently before it informs a consequential decision.
- Monitor progression at useful intervals and retain evidence sufficient for independent review.
- Identify groups not represented in aggregate results before it informs a consequential decision.
- Evaluate differential outcomes within a defined period and review the result.
Operational significance
The historical reference basis is Education at a Glance 2012. Its relevance to education participation and transition should be assessed against the affected jurisdiction, learner population and form of provision. International developments provide context; decisions affecting learners require evidence that is current and representative of the setting concerned.
A focused examination of the analytical question requires a clear analytical discipline. Oversight of the reported measure should reflect the principle that implementation requires more than dissemination. Responsible actors must understand the change, receive the authority and resources to apply it, and be able to identify cases that require advice, exception or escalation. An imprecise scope or measure may produce a credible-looking record that does not answer the relevant decision question.
Evidence and assurance
A proper review of education participation and transition should establish the intended outcome before selecting controls or indicators. A decision concerning the evidence under review should recognise that a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. The record should explain why the approach suits the affected context, how material departures are authorised and when review will occur.
A narrow control over the reported measure may create false assurance. In the present context, completion measures detached from learning, attrition detected too late and support allocated without evidence of need may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. Testing should include exceptions and adverse cases, not only routine or successful operation.
- Have affected users received clear information?
- What do early cases show?
- Are responsibilities and resources in place?
- What operational decision changes?
- Where is implementation inconsistent?
Proportionality and exceptions
The evidential record for education participation and transition should permit a reviewer to trace the matter from decision to outcome. This may require resource allocation by need, progression and early-warning information, records of barriers and support, and disaggregated participation and outcome data, supported by learner feedback and complaints and evaluation of interventions. Conflicting records, absent populations and uncertain follow-through require additional testing.
The review method for the evidence under review should be reproducible. Review of the analytical question should translate the policy objective into controlled procedures and decision criteria, prepare affected staff and learners, test readiness, monitor early cases and correct ambiguity promptly. Review whether implementation differs across sites or delivery partners. Working papers should allow another competent reviewer to understand the evidence, judgement and treatment of material exceptions.
Accountability for implementation
Decision-makers using evidence on education participation and transition should be told what the data cannot establish as clearly as what it can. Users should be able to distinguish descriptive, comparative and evaluative findings and understand their proper level of application. Use in a different context requires an independent judgement that the settings are materially comparable.
Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. A decision concerning the reported measure should recognise that equal treatment does not necessarily produce equitable access or outcomes. Different support may be justified where it addresses a documented barrier without changing the required educational outcome. In reviewing the matter examined, a single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners. Each exception should record its basis, authorisation, duration and review date.
Records relating to the evidence under review should preserve both the conclusion and its limits. A changed evidential position should be applied to the affected scope, including prior decisions that may no longer be reliable. This is material where learners, authorities or institutions relied on information that cannot be corrected by replacing the current text alone.
Public reporting on the matter examined should distinguish established fact, analytical judgement and planned action. Material revisions should be traceable to their reason and effective date. If definitions, coverage or evidence alter an earlier conclusion, the reason should be stated so that revision is not mistaken for changed performance.
The measure of progress on the comparison is not the amount of policy or documentation produced. The relevant measure is demonstrated public benefit, including detection and correction of material variation.