A staged improvement plan for online assessment

In examining a staged improvement plan for online assessment, for corrective action, improvement should begin with a defined problem, a credible account of its causes and a measure capable of showing whether the response has worked.

Application to online assessment

Its wider significance does not replace evidence of how online assessment operates in the affected setting.

Controls for online assessment

In examining a staged improvement plan for online assessment, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result.

Analysis should make its decision rule explicit. When examining online assessment, transfer points should be tested because responsibility and information may be lost between otherwise sound functions.

• What outcome is intended?
• Which evidence establishes operation?
• Who controls each stage?
• What action is required by the finding?
• Where do exceptions occur?

Review of online assessment

Risk assessment of the intended improvement should give particular attention to tasks that do not assess the stated outcome, weak assurance of authorship or performance, and inconsistent judgement between markers or locations. A provider should also consider results used beyond the evidence they support and uncontrolled changes to assessment. For online assessment, the control response should reflect whether an affected learner can identify the error and obtain an effective remedy in time.

Implications for online assessment

Evidence concerning online assessment should be selected against a clearly defined question. The most relevant material is likely to include approval and change-control records, moderation and exception records, marking criteria and calibrated judgement, and analysis of results and differential outcomes. Across the defined scope, independent records should be reconciled, with disagreement and uncertainty reported alongside the finding.

For operational examination of the matter, authorities and providers should proceed in a defined sequence. A competent review of online assessment should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions.

The improvement record for the intended improvement should contain the verified problem, affected scope, immediate containment, causal analysis, selected intervention, accountable owner, resources, milestones and effectiveness measure.

Evidence relevant to online assessment

In the context of online assessment, accountability and effective correction both depend on a record that can be followed from evidence to decision. For the matter, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed.

Accountability for the intended improvement should follow decision-making authority. For decisions concerning online assessment, where work is delegated, the record should continue to identify who is accountable for material consequences to learners.

For online assessment, any response to the present development should test the evidential connection between the matter, its implementation and the outcome claimed. Institutional improvement and public confidence both depend on transparent responsibility and credible evidence.