Examines progress against the proposed post-2015 education goal, addressing regional variation, source definitions, coverage, comparability, uncertainty and limits on inference.
Current consideration of progress against the proposed post-2015 education goal is informed by the Muscat Agreement adopted in May 2014, with consequences for governance, evidence and the treatment of affected learners. The available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison.
Evidence and method
The formal status of the Muscat Agreement adopted in May 2014 should be preserved in any public account. For progress against the proposed post-2015 education goal, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary.
Implementation of the measure should be organised around a decision that can be tested. For comparative analysis, where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. For progress against the proposed post-2015 education goal, oversight requires a traceable line from the approved objective through responsible action to evidence of outcome.
The principal risks in relation to the analysis are variation across sites or programmes, policy detached from practice, corrective action closed on activity rather than effect, and learner experience omitted from review. In the context of progress against the proposed post-2015 education goal, a weakness in one part of the control environment may obscure a related failure elsewhere.
The analysis proceeds on the basis that an average may improve while a material group experiences no improvement or a worse outcome. As regards progress against the proposed post-2015 education goal, disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals. An imprecise scope or measure may produce a credible-looking record that does not answer the relevant decision question.
Relevant evidence for the analysis will normally include approved objectives and responsibilities, representative outcome information, exception and complaint records, implementation and monitoring records, and verified corrective action. For decisions concerning progress against the proposed post-2015 education goal, the conclusion should rely on evidence whose date, source and coverage are sufficient for the decision. The record for progress against the proposed post-2015 education goal should retain disagreement between sources until its cause and effect are understood.
Patterns requiring examination
The analysis of progress against the proposed post-2015 education goal should remain within the limits of the evidence. International comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another. In this case, quality cannot be inferred from reputation, intention or documentation alone. Assurance requires evidence of actual operation together with its material effects. Within the scope under review, if uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.
The assurance record for progress against the proposed post-2015 education goal should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. This enables later review to separate substantive change from correction, reclassification or expanded coverage. A superseded conclusion should be retained where it formed the basis of a material decision.
- Act on adverse findings.
- Review whether improvement is sustained, identifying the accountable function and affected scope.
- Identify the affected scope before it is relied on for a decision with material effect.
- Define the intended outcome.
- Collect proportionate evidence.
Implications for decision-makers
Implementation of progress against the proposed post-2015 education goal can be tested without imposing unnecessary reporting. In this case, the reviewer should examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. Existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance conclusion.
The analytical record for progress against the proposed post-2015 education goal should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.
- Which groups are concealed by the aggregate?
- Which disparity requires action first?
- Could missing data be unequal?
- Are sample sizes adequate?
- Are group definitions stable?
Limits of inference
For progress against the proposed post-2015 education goal, where responsibilities for delivery are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements governing progress against the proposed post-2015 education goal should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Multiple delivery partners do not justify fragmented accountability or remedy.
For the available evidence, the public interest is not confined to institutional compliance. Within the scope under review, quality assurance should connect stated educational purposes with implemented controls, reliable evidence and action where outcomes fall below expectation.
For progress against the proposed post-2015 education goal, no individual measure is sufficient to establish effective operation of the measure across the affected scope. A conclusion concerning progress against the proposed post-2015 education goal should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk.