Review of timeliness and completeness of data on assessment moderation addresses the unit of analysis, source definitions, missing data and transfer beyond the reported setting.
Analysis of assessment moderation should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.
Application of the evidence to timeliness and completeness of data on assessment moderation
Data used for assessment moderation should be interpreted against stable definitions and an identifiable population.
When examining assessment moderation, the central objective should not be obscured by the form of the administrative response. Data used for the available evidence should be interpreted against stable definitions and an identifiable population.
The review should be based on a stated method rather than general assurance. For assessment moderation, data used for the issue should be interpreted against stable definitions and an identifiable population. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision.
Across the defined scope, responsibility should be identifiable at the point where consequential decisions are made. For assessment moderation, a decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.
Risk assessment for the issue should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.
The evidential record for the available evidence should permit a reviewer to trace the matter from decision to outcome. When examining assessment moderation, material variation and uncertainty should be reported together with any restriction on wider application. Further cases should be examined when the initial sample does not represent the affected scope or confirm sustained correction.
Controls relevant to timeliness and completeness of data on assessment moderation
Data used for the analysis should be interpreted against stable definitions and an identifiable population. For assessment moderation, interpretation should retain uncertainty, distributional differences and limits on generalisation. Escalate discrepancies that could alter a published conclusion or individual outcome. Public information on the available evidence should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction.
The assurance record for the analysis should permit another competent reviewer to understand the evidence, method, judgement and treatment of material exceptions. The evidential basis for the analysis should identify source, period, coverage and material limitations. For assessment moderation, corroboration is required where a single record cannot support the decision.
For assessment moderation, a revision or break in series should not be reported as a change in performance. For the measure, reliability without validity produces consistent but potentially irrelevant results.
For assessment moderation, decisions concerning the comparison should remain traceable to the information available for the stated reference period.
Records concerning the comparison should remain traceable from source evidence to decision and follow-up. For assessment moderation, superseded conclusions should be retained where they informed a material outcome. Any indicator used in relation to assessment moderation should distinguish description from causal explanation. Across the defined scope, if definitions, coverage or evidence alter an earlier conclusion, the reason should be stated so that revision is not mistaken for changed performance.
For assessment moderation, any indicator used in relation to the analysis should distinguish description from causal explanation.
A conclusion concerning assessment moderation on the matter should extend no further than the available evidence permits.
Records concerning the matter should remain traceable from source evidence to decision and follow-up. Assurance concerning the matter should state the scope examined, evidence relied upon and any condition preventing a complete conclusion.
In the context of assessment moderation, missing populations, inconsistent records and unresolved exceptions should be reported with the finding.
Public information on the matter should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction. Unsupported elements should remain open.
When examining assessment moderation, evidence concerning the matter should be current, attributable and representative of the affected scope.