Consistency in the assessment of institutional implementation of Sustainable Development Goal 4

In 2016, consideration of consistency in the assessment of institutional implementation of Sustainable Development Goal 4 must take account of the Education 2030 implementation during 2016 and the responsibilities it places before education systems. For the control, consistent application requires a clear distinction between the required result, recommended methods and examples that may assist implementation. The materiality of the issue depends on its consequences for learners, responsible institutions and educational resources. Application should respect material differences in law, system design and institutional responsibility.

The 2030 Agenda, adopted on 25 September 2015, includes Sustainable Development Goal 4: ensure inclusive and equitable quality education and promote lifelong learning opportunities for all. The goal combines access, completion, learning, skills, equality, facilities, scholarships and teachers. Monitoring should preserve the distinction between each target and indicator and should not treat progress on one dimension as evidence that the complete goal has been achieved.

Responsibility for the stated expectation should be visible at the point where consequential decisions are made. For the control, evidence is sufficient when it is current, attributable, representative of the relevant scope and capable of being reconciled with other available records. A decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.

The present position

The historical reference basis is the Education 2030 implementation during 2016. Its relevance to consistency in the assessment of institutional implementation of Sustainable Development Goal 4 should be assessed against the affected jurisdiction, learner population and form of provision. Any consequential application should rest on evidence suited to the affected scope, not on the existence of an international development alone.

The system and institutional dimensions of the relevant requirement should be considered together. The analysis of the relevant requirement proceeds on the basis that assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control. Neither public oversight nor provider control removes the responsibilities assigned to the other level.

• Define the decision each assessment must support and retain evidence sufficient for independent review.
• Align tasks and criteria with learning outcomes before it informs a consequential decision.
• Calibrate assessors and retain evidence sufficient for independent review.
• Control changes, and retain the basis, responsible function and affected scope.
• Review differential and anomalous results, with responsibility, scope and timing recorded.

Implications for assessment and learning-outcome assurance

A focused examination of consistency in the assessment of institutional implementation of Sustainable Development Goal 4 requires a clear analytical discipline. The analysis of the assurance matter proceeds on the basis that consistency does not require identical decisions regardless of context. It requires comparable matters to be treated on the same principles, with material differences explained by relevant evidence and recorded criteria. The decision question, affected scope and measure should align; otherwise the conclusion may be unsupported despite substantial documentation.

A narrow control applied to the relevant process may create false assurance. In the present context, reasonable adjustment altering the assessed outcome, inconsistent judgement between markers or locations and results used beyond the evidence they support may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. Adverse cases should form part of the sample wherever they may reveal a material control weakness.

The evidential record should be limited to material that can answer the question under review. For the matter under review, the most relevant material is likely to include authorship and identity controls proportionate to risk, analysis of results and differential outcomes, marking criteria and calibrated judgement, and moderation and exception records. No source should carry more weight than its coverage and reliability permit, and unresolved uncertainty should remain visible.

• Where are outcomes materially different?
• Is the reason relevant and documented?
• Have decision-makers been calibrated?
• Are common criteria in use?
• Does review correct inconsistent treatment?

Information required for oversight

A proportionate method is available for consistency in the assessment of institutional implementation of Sustainable Development Goal 4. For the stated expectation, the reviewer should use common definitions and decision criteria, calibrate responsible staff, review outliers and compare outcomes across locations and groups. Where variation is justified, retain the reason and verify that it is applied without arbitrary disadvantage. The review record should preserve exceptions capable of showing a weakness in design, implementation or coverage.

Assurance concerning the control should be expressed at the level established by the evidence. A sample may support a conclusion about the sampled process, but not automatically about every location or programme. Where reliance is placed on central controls, testing should confirm that local operation and exceptions are reported accurately to the centre.

Interpretation of the matter under review should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. In reviewing the relevant requirement, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. A decision concerning the relevant requirement should recognise that an isolated example cannot establish consistent operation, and an isolated failure should be evaluated for materiality, recurrence and systemic effect.

Records relating to the stated expectation should preserve both the conclusion and its limits. New evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.

For the assurance matter, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Responsibility and timing should be settled when the action is approved, not after delay occurs. Closure requires evidence that the condition has changed; completion of planned activity is not sufficient.

Governance of the stated expectation requires a clear allocation of authority, information and follow-through. Escalation should place material evidence before the authority capable of an effective response. Improvement should be supported by evidence and an accountable decision record capable of public scrutiny.