This practice note explains how assessment security should be scoped, implemented and verified, with closure dependent on demonstrated effect.
Improvement of assessment security should begin with a defined problem, a credible account of its causes and a measure capable of showing whether the response has worked.
Application to assessment security
For assessment security, the circumstances described by the continuity and integrity during disruption are developing and may differ materially between locations.
Implementation of the corrective action should be organised around a decision that can be tested. For corrective action, a complete improvement record should define the baseline, affected scope, causal hypothesis, responsible owner, resources, milestones and measures of effectiveness. When examining assessment security, resources and activity should be reconciled with the operating evidence and result for which the responsible function is accountable.
A narrow control over corrective action may create false assurance. In the present context, uncontrolled changes to assessment, inconsistent judgement between markers or locations and reasonable adjustment altering the assessed outcome may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. For decisions concerning assessment security, a sample confined to compliant cases cannot establish the reliability of the control.
Review of the intended improvement should follow a stated and reproducible method. For assessment security, effectiveness is the demonstrated change in the condition the action was intended to address. Across the defined scope, those required to act should be able to understand the method and its material limitations.
The evidential record for the intended improvement should permit a reviewer to trace the matter from decision to outcome. This may require assessment maps to learning outcomes, authorship and identity controls proportionate to risk, moderation and exception records, and approval and change-control records, supported by analysis of results and differential outcomes and appeal and correction records. For assessment security, conflicting records, absent populations and uncertain follow-through require additional testing.
Controls for assessment security
For assessment security, reliability without validity produces consistent but potentially irrelevant results. For the corrective action, methods should be proportionate to the significance and recurrence of the problem; low-risk local issues and systemic learner-protection failures require different levels of control.
The assurance record for the matter should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. When examining assessment security, this enables later review to separate substantive change from correction, reclassification or expanded coverage.
- Retain evidence sufficient for review.
- Define the decision each assessment must support before it informs a consequential decision.
- Moderate material variation.
- Calibrate assessors.
- Align tasks and criteria with learning outcomes before it informs a consequential decision.
Review of assessment security
In examining from review findings to sustained improvement in assessment security, responsible bodies should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects.
- Has the improvement been sustained?
- What was the baseline?
- What condition should change?
- Did the effect reach the intended group?
- When should an effect be visible?
Implications for assessment security
Review of the matter should address both system-level conditions and institutional practice. For corrective action, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. For assessment security, authorities and providers hold different responsibilities, both of which must be discharged for the arrangement to operate reliably.
Any response to the present development should test the evidential connection between the intended improvement, its implementation and the outcome claimed.