Review of consistency in the assessment of institutional implementation sets out the evidence, authority and controls needed to reach and maintain a defensible conclusion.
For the control, consistent application requires a clear distinction between the required result, recommended methods and examples that may assist implementation. The materiality of the issue depends on its consequences for learners, responsible institutions and educational resources.
For institutional implementation of Sustainable Development Goal 4, the 2030 Agenda, adopted on 25 September 2015, includes Sustainable Development Goal 4: ensure inclusive and equitable quality education and promote lifelong learning opportunities for all. The goal combines access, completion, learning, skills, equality, facilities, scholarships and teachers. Monitoring should preserve the distinction between each target and indicator and should not treat progress on one dimension as evidence that the complete goal has been achieved.
In the context of institutional implementation of Sustainable Development Goal 4, responsibility should be identifiable at the point where consequential decisions are made. For the control, evidence is sufficient when it is current, attributable, representative of the relevant scope and capable of being reconciled with other available records.
Application and scope
Review of the applicable requirement should address both system-level conditions and institutional practice. Assessment of institutional implementation of Sustainable Development Goal 4 should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result.
- Define the decision each assessment must support.
- Align tasks and criteria with learning outcomes before it informs a consequential decision.
- Calibrate assessors.
- Control changes.
- Review differential and anomalous results, with responsibility, scope and timing recorded.
Relevant controls
Across the defined scope, consistency does not require identical decisions regardless of context. For institutional implementation of Sustainable Development Goal 4, it requires comparable matters to be treated on the same principles, with material differences explained by relevant evidence and recorded criteria.
A narrow control applied to the relevant process may create false assurance. In the present context, reasonable adjustment altering the assessed outcome, inconsistent judgement between markers or locations and results used beyond the evidence they support may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. For institutional implementation of Sustainable Development Goal 4, adverse cases should form part of the sample wherever they may reveal a material control weakness.
In the context of institutional implementation of Sustainable Development Goal 4, the evidential record should be limited to material that can answer the question under review. For the matter, the most relevant material is likely to include authorship and identity controls proportionate to risk, analysis of results and differential outcomes, marking criteria and calibrated judgement, and moderation and exception records.
- Where are outcomes materially different?
- Is the reason relevant and documented?
- Have decision-makers been calibrated?
- Are common criteria in use?
- Does review correct inconsistent treatment?
Review criteria
For the applicable expectation, the reviewer should use common definitions and decision criteria, calibrate responsible staff, review outliers and compare outcomes across locations and groups. For decisions concerning institutional implementation of Sustainable Development Goal 4, where variation is justified, retain the reason and verify that it is applied without arbitrary disadvantage.
Assurance concerning institutional implementation of Sustainable Development Goal 4 should be expressed at the level established by the evidence.
Interpretation of the matter should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. When examining institutional implementation of Sustainable Development Goal 4, reliability without validity produces consistent but potentially irrelevant results.
Across the defined scope, records relating to the applicable expectation should preserve both the conclusion and its limits. For institutional implementation of Sustainable Development Goal 4, new evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion.
For the conclusion, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. In the context of institutional implementation of Sustainable Development Goal 4, closure requires evidence that the condition has changed; completion of planned activity is not sufficient.
Governance of the applicable expectation requires a clear allocation of authority, information and follow-through. For institutional implementation of Sustainable Development Goal 4, escalation should place material evidence before the authority capable of an effective response. Improvement of institutional implementation of Sustainable Development Goal 4 should be supported by evidence and an accountable decision record capable of public scrutiny.