The article examines public-interest oversight of online assessment, distinguishing binding duties, policy commitments and the controls needed for accountable implementation.
Evidence relevant to public-interest oversight of online assessment
Application to online assessment depends on evidence from the relevant jurisdiction or institution.
In the context of online assessment, the applicable expectation should be capable of consistent application.
For online assessment, readily available material should not define the enquiry if it cannot answer the relevant decision question. In this case, the most relevant material is likely to include moderation and exception records, assessment maps to learning outcomes, authorship and identity controls proportionate to risk, and approval and change-control records. Across the defined scope, independent records should be reconciled, with disagreement and uncertainty reported alongside the finding.
Application to public-interest oversight of online assessment
Online assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result.
Material concerns include reasonable adjustment altering the assessed outcome, results used beyond the evidence they support, uncontrolled changes to assessment, and weak assurance of authorship or performance. For online assessment, an exception should be assessed by effect, duration, recurrence and reach, including possible exposure beyond the initial sample.
- Define the decision each assessment must support.
- Control changes, with responsibility, scope and timing recorded.
- Align tasks and criteria with learning outcomes, with responsibility, scope and timing recorded.
- Calibrate assessors.
- Review differential and anomalous results.
Controls for public-interest oversight of online assessment
A competent review of the measure should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. For online assessment, the review record should preserve exceptions capable of showing a weakness in design, implementation or coverage.
Oversight of online assessment should be based on an implementation map linking the public objective to domestic measures, provider controls and learner remedies.
Any conclusion on the policy position should remain within the scope supported by the evidence. For online assessment, reliability without validity produces consistent but potentially irrelevant results.
The assurance record for the arrangements should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. For online assessment, this enables later review to separate substantive change from correction, reclassification or expanded coverage. Across the defined scope, the evidential history should preserve conclusions that were operative when a material decision was made.
Review of public-interest oversight of online assessment
In examining public-interest oversight of online assessment, accountability for online assessment should follow decision-making authority.
In examining public-interest oversight of online assessment, in the context of online assessment, progress should not be assessed by the amount of policy or documentation produced.