Governance and public reporting in relation to online assessment authenticity

The present attention to governance and public reporting in relation to online assessment authenticity follows the expansion of large-scale online learning and requires a careful distinction between public commitment, institutional practice and demonstrated result. In this case, this matter should be read as a question of public administration and learner protection, not as a statement that one institutional model is suitable in every jurisdiction.

Risk assessment of the arrangements should give particular attention to weak assurance of authorship or performance, reasonable adjustment altering the assessed outcome, and inconsistent judgement between markers or locations. A provider should also consider results used beyond the evidence they support and tasks that do not assess the stated outcome.

Status and scope

A proper review of governance and public reporting in relation to online assessment authenticity should establish the intended outcome before selecting controls or indicators. A credible response should identify the applicable jurisdiction, the affected learners and providers, the authority responsible for implementation, and the evidence by which performance will be judged. A chosen approach should be justified against its context, with departures and review points under documented control.

The relevant context is provided by expansion of large-scale online learning. Its relevance to implementation should be assessed against the affected jurisdiction, learner population and form of provision.

When examining online assessment authenticity, public information should be accurate, current, complete in relation to material matters and presented before a learner is required to make a consequential commitment. Qualifications and limitations should receive comparable prominence to the principal claim. A formally complete record is not reliable if its scope or measure does not correspond to the decision being made.

• Review differential and anomalous results, with responsibility, scope and timing recorded.
• Control changes.
• Calibrate assessors.
• Align tasks and criteria with learning outcomes.
• Define the decision each assessment must support before using it to determine a learner or provider outcome.

Public-interest implications

Interpretation of governance and public reporting in relation to online assessment authenticity should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. Reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. The existence of an international commitment does not remove the need for jurisdiction-specific interpretation, consultation and proportionate transition arrangements.

The evidential record for the issue should permit a reviewer to trace the matter from decision to outcome. This may require authorship and identity controls proportionate to risk, assessment maps to learning outcomes, moderation and exception records, and approval and change-control records, supported by appeal and correction records and analysis of results and differential outcomes. Within the scope under review, further cases should be examined when the initial sample does not represent the affected scope or confirm sustained correction.

Records relating to the arrangements should preserve both the conclusion and its limits. For online assessment authenticity, the correction record should state what the new evidence changes and which earlier conclusions or decisions require review. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.

Institutional responsibilities

Implementation of governance and public reporting in relation to online assessment authenticity can be tested without imposing unnecessary reporting. The method for implementation is to identify material information across the learner journey, assign source ownership, reconcile public statements with controlled records and retain corrections. Test whether a reasonable user can understand status, cost, obligations, support and routes for redress. The assurance record may draw on existing sources, provided their limitations and fitness for the current purpose are examined.

Oversight of online assessment authenticity should be based on an implementation map linking the public objective to domestic measures, provider controls and learner remedies.

• Are corrections prompt and traceable?
• Does it identify material conditions and limitations?
• Is the information available before commitment?
• Can it be reconciled with the controlled source?
• Who approves changes?

Continuing review

For decisions concerning online assessment authenticity, the relevant outcome should be capable of direct and consistent explanation. Assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. The existence of an approved measure or completed activity is not evidence of educational effect. Assurance should address actual effect and provide a means of correcting disadvantage that the arrangement did not intend.

Public reporting on online assessment authenticity should distinguish established fact, analytical judgement and planned action. A revised conclusion should distinguish a change in the underlying condition from a change in method, coverage or evidence.

For online assessment authenticity, assessment of the measure should reconcile more than one source of evidence and control. A reasoned conclusion should reconcile the governing requirement, evidence of operation, learner outcomes and residual risk, and remain open to better evidence.