Evidence concerning assessment moderation is reviewed for source definitions, coverage, comparability, uncertainty and limits on inference.
The principal risks in relation to the available evidence are inconsistent judgement between markers or locations, weak assurance of authorship or performance, reasonable adjustment altering the assessed outcome, and uncontrolled changes to assessment. When examining assessment moderation, the control environment should be assessed as a connected system rather than as unrelated individual risks.
Application to assessment moderation
In examining assessment moderation: an international evidence note, its relevance to the comparison should be assessed against the affected jurisdiction, learner population and form of provision.
For decisions concerning assessment moderation, in this case, comparison requires more than the use of a common label. Definitions, reference periods, population coverage, institutional boundaries and collection practices must be sufficiently aligned for the observed difference to have a stable meaning.
- Control changes.
- Define the decision each assessment must support before it informs a consequential decision.
- Moderate material variation.
- Calibrate assessors.
- Align tasks and criteria with learning outcomes.
Controls for assessment moderation
Relevant evidence for the comparison will normally include marking criteria and calibrated judgement, authorship and identity controls proportionate to risk, approval and change-control records, analysis of results and differential outcomes, and appeal and correction records. Across the defined scope, currency, provenance and representativeness should be established before evidence is used for assurance. For assessment moderation, conflicting records require reconciliation before a complete assurance conclusion is reached.
For assessment moderation, decisions concerning the available evidence should remain traceable to the information available for the stated reference period.
Review of assessment moderation
A competent review of the available evidence should prepare a comparability table before analysing results. In the context of assessment moderation, record common elements, material differences, breaks in series and the direction in which each limitation may affect the conclusion; do not rank systems where those limitations remain material.
For assessment moderation, decision-makers using evidence on the analysis should be told what the data cannot establish as clearly as what it can.
- Has a classification changed?
- Are the populations defined on the same basis?
- Is the remaining difference educationally material?
- Do the reference periods align?
- Are exclusions and missing records comparable?
Implications for assessment moderation
For assessment moderation, the intended substantive result should remain the starting point for review. Assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Across the defined scope, the existence of an approved measure or completed activity is not evidence of educational effect.
When examining assessment moderation, progress should not be assessed by the amount of policy or documentation produced.