Explains consistency assessment in relation to institutional implementation of Sustainable Development Goal 4, covering scope, evidence, decision authority.
In 2016, consideration of consistency in the assessment of institutional implementation of Sustainable Development Goal 4 must take account of the Education 2030 implementation during 2016 and the responsibilities it places before education systems. For the control, consistent application requires a clear distinction between the required result, recommended methods and examples that may assist implementation. The materiality of the issue depends on its consequences for learners, responsible institutions and educational resources.
For institutional implementation of Sustainable Development Goal 4, the 2030 Agenda, adopted on 25 September 2015, includes Sustainable Development Goal 4: ensure inclusive and equitable quality education and promote lifelong learning opportunities for all. The goal combines access, completion, learning, skills, equality, facilities, scholarships and teachers. Monitoring should preserve the distinction between each target and indicator and should not treat progress on one dimension as evidence that the complete goal has been achieved.
In the context of institutional implementation of Sustainable Development Goal 4, responsibility should be identifiable at the point where consequential decisions are made. For the control, evidence is sufficient when it is current, attributable, representative of the relevant scope and capable of being reconciled with other available records. A decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.
Applicable scope
The relevant context is provided by Education 2030 implementation during 2016. Its relevance to consistency in the assessment of institutional implementation of Sustainable Development Goal 4 should be assessed against the affected jurisdiction, learner population and form of provision. Any consequential application should rest on evidence suited to the affected scope, not on the existence of an international development alone.
The system and institutional dimensions of the applicable requirement should be considered together. Assessment of institutional implementation of Sustainable Development Goal 4 should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control. Neither public oversight nor provider control removes the responsibilities assigned to the other level.
- Define the decision each assessment must support.
- Align tasks and criteria with learning outcomes before it informs a consequential decision.
- Calibrate assessors.
- Control changes.
- Review differential and anomalous results, with responsibility, scope and timing recorded.
Implementation and evidence
Within the scope under review, consistency does not require identical decisions regardless of context. For institutional implementation of Sustainable Development Goal 4, it requires comparable matters to be treated on the same principles, with material differences explained by relevant evidence and recorded criteria. The decision question, affected scope and measure should align; otherwise the conclusion may be unsupported despite substantial documentation.
A narrow control applied to the relevant process may create false assurance. In the present context, reasonable adjustment altering the assessed outcome, inconsistent judgement between markers or locations and results used beyond the evidence they support may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. For institutional implementation of Sustainable Development Goal 4, adverse cases should form part of the sample wherever they may reveal a material control weakness.
In the context of institutional implementation of Sustainable Development Goal 4, the evidential record should be limited to material that can answer the question under review. For the matter, the most relevant material is likely to include authorship and identity controls proportionate to risk, analysis of results and differential outcomes, marking criteria and calibrated judgement, and moderation and exception records.
- Where are outcomes materially different?
- Is the reason relevant and documented?
- Have decision-makers been calibrated?
- Are common criteria in use?
- Does review correct inconsistent treatment?
Assessment of conformity
For the applicable expectation, the reviewer should use common definitions and decision criteria, calibrate responsible staff, review outliers and compare outcomes across locations and groups. For decisions concerning institutional implementation of Sustainable Development Goal 4, where variation is justified, retain the reason and verify that it is applied without arbitrary disadvantage. The review record should preserve exceptions capable of showing a weakness in design, implementation or coverage.
Assurance concerning institutional implementation of Sustainable Development Goal 4 should be expressed at the level established by the evidence.
Interpretation of the matter should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. When examining institutional implementation of Sustainable Development Goal 4, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. An isolated example cannot establish consistent operation, and an isolated failure should be evaluated for materiality, recurrence and systemic effect.
Within the scope under review, records relating to the applicable expectation should preserve both the conclusion and its limits. For institutional implementation of Sustainable Development Goal 4, new evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.
For the assurance conclusion, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. In the context of institutional implementation of Sustainable Development Goal 4, closure requires evidence that the condition has changed; completion of planned activity is not sufficient.
Governance of the applicable expectation requires a clear allocation of authority, information and follow-through. For institutional implementation of Sustainable Development Goal 4, escalation should place material evidence before the authority capable of an effective response. Improvement of institutional implementation of Sustainable Development Goal 4 should be supported by evidence and an accountable decision record capable of public scrutiny.