Assesses the evidence concerning assessment moderation, including comparability, uncertainty and limits on interpretation.
Analysis of assessment moderation should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning. Analysis of the reported measure should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.
Public-interest context
The historical reference basis is the cross-system comparability and academic standards. Data used for assessment moderation should be interpreted against stable definitions and an identifiable population. Apparent movement caused by revision should not be attributed to educational performance. Analysis of the analytical question should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.
The central objective should not be obscured by the form of the administrative response. Analysis of the evidence under review should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Reliability depends on preserving the material distinctions between the matters compared. Assurance should not stop at adoption, resourcing or completion of administrative tasks. Data used for the evidence under review should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result.
In practical terms, the matter examined should be reviewed against a stated method rather than general assurance. Data used for the matter examined should be interpreted against stable definitions and an identifiable population. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision.
Responsibility for the analytical question should be visible at the point where consequential decisions are made. A decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.
Risk assessment for the matter examined should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.
The evidential record for the evidence under review should permit a reviewer to trace the matter from decision to outcome. Material variation and uncertainty should be reported together with any restriction on wider application. Further cases should be examined when the initial sample does not represent the affected scope or confirm sustained correction.
Operational significance
Data used for the analytical question should be interpreted against stable definitions and an identifiable population. Interpretation should retain uncertainty, distributional differences and limits on generalisation. Escalate discrepancies that could alter a published conclusion or individual outcome. Public information on the evidence under review should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction.
The assurance record for the analytical question should permit another competent reviewer to understand the evidence, method, judgement and treatment of material exceptions. The evidential basis for the analytical question should identify source, period, coverage and material limitations. Corroboration is required where a single record cannot support the decision.
A revision or break in series should not be reported as a change in performance. In reviewing the comparison, missing or delayed information may be patterned rather than random. Conclusions should account for the possibility that excluded learners or providers differ from those observed. For the reported measure, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. If uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.
Decisions concerning the comparison should remain traceable to the information available for the stated reference period. The reason for revision should be explicit, including whether it arises from new evidence, a methodological change or a different interpretation. A break in method or coverage must not be presented as if it demonstrated a change in educational performance.
Records concerning the comparison should remain traceable from source evidence to decision and follow-up. Superseded conclusions should be retained where they informed a material outcome. Any indicator used in relation to assessment moderation should distinguish description from causal explanation. If definitions, coverage or evidence alter an earlier conclusion, the reason should be stated so that revision is not mistaken for changed performance.
Any indicator used in relation to the analytical question should distinguish description from causal explanation.
A conclusion on the matter under review should extend no further than the available evidence permits.
Records concerning the matter under review should remain traceable from source evidence to decision and follow-up. Assurance concerning the matter under review should state the scope examined, evidence relied upon and any condition preventing a complete conclusion.
Missing populations, inconsistent records and unresolved exceptions should be reported with the finding.
Public information on the matter under review should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction. Unsupported elements should remain open.
Evidence concerning the matter under review should be current, attributable and representative of the affected scope.