Quality improvement method

Testing whether improvements in online assessment authenticity are sustained

Quality Improvement Methods

Testing whether improvements in online assessment authenticity are sustained — baseline, accountable action, outcome evidence, verification and sustained follow-up.

In examining testing whether improvements in online assessment authenticity are sustained, a proportionate arrangement protects educational outcomes and fair treatment without creating avoidable barriers.

A reasoned conclusion on the intended improvement should reconcile the governing expectation, evidence of operation, learner outcomes and unresolved risk. A selected successful case is not sufficient. For online assessment authenticity, decision-makers should state which matters are evidenced, which express policy and which require authorised judgement.

Review of the corrective action should address both system-level conditions and institutional practice. For decisions concerning online assessment authenticity, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result.

Application of the evidence to whether improvements in online assessment authenticity are sustained

The criteria applied to online assessment authenticity should be settled and recorded before the evidence is assessed. Effectiveness is the demonstrated change in the condition the action was intended to address.

For whether improvements in online assessment authenticity are sustained, a complete improvement record should define the baseline, affected scope, causal hypothesis, responsible owner, resources, milestones and measures of effectiveness.

Controls relevant to whether improvements in online assessment authenticity are sustained

Risk assessment of online assessment authenticity should give particular attention to tasks that do not assess the stated outcome, reasonable adjustment altering the assessed outcome, and results used beyond the evidence they support. A provider should also consider weak assurance of authorship or performance and inconsistent judgement between markers or locations.

  • Review differential and anomalous results.
  • Align tasks and criteria with learning outcomes.
  • Calibrate assessors.
  • Moderate material variation.
  • Define the decision each assessment must support before it informs a consequential decision.

Review criteria for whether improvements in online assessment authenticity are sustained

Assurance of online assessment authenticity should draw on more than one form of evidence. Useful records include authorship and identity controls proportionate to risk, assessment maps to learning outcomes, approval and change-control records, appeal and correction records, and moderation and exception records. Across the defined scope, policy and records should be tested against actual practice, including evidence from learners where appropriate.

For online assessment authenticity, responsible bodies should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects.

The improvement record for corrective action should contain the verified problem, affected scope, immediate containment, causal analysis, selected intervention, accountable owner, resources, milestones and effectiveness measure.

Implications for whether improvements in online assessment authenticity are sustained

The analysis of online assessment authenticity should remain within the limits of the evidence.

Across the defined scope, decisions concerning the corrective action should remain traceable to the information available for the stated reference period. For online assessment authenticity, the reason for revision should be explicit, including whether it arises from new evidence, a methodological change or a different interpretation.

Public reporting on the intended improvement should distinguish established fact, analytical judgement and planned action. In the context of online assessment authenticity, revision history should remain available where users have relied on the earlier conclusion.

When examining online assessment authenticity, progress should not be assessed by the amount of policy or documentation produced. Performance in relation to online assessment authenticity should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity.