Controls for consistency in the assessment of digital transformation are examined from initial evidence through exceptions, decision authority and continuing assurance.
Evidence considered for consistency in the assessment of digital transformation
Its wider significance does not replace evidence of how consistency in the assessment of digital transformation operates in the affected setting.
In examining consistency in the assessment of digital transformation, for digital transformation, the Transforming Education Summit in September 2022 brings together commitments on inclusive and equitable education, teachers, digital learning, finance and recovery. The action tracks are connected: technology or curriculum measures cannot compensate for insufficient teachers, unsafe provision or exclusion. Commitments should be translated into costed responsibilities, implementation milestones and evidence capable of showing effects on learning and participation.
In the context of digital transformation, responsibility should be identifiable at the point where consequential decisions are made.
Failure in relation to the applicable expectation may arise even where the stated policy is reasonable. Material concerns include results used beyond the evidence they support, tasks that do not assess the stated outcome, reasonable adjustment altering the assessed outcome, and uncontrolled changes to assessment. For decisions concerning digital transformation, an exception should be assessed by effect, duration, recurrence and reach, including possible exposure beyond the initial sample.
For digital transformation, consistency does not require identical decisions regardless of context. It requires comparable matters to be treated on the same principles, with material differences explained by relevant evidence and recorded criteria.
Relevant evidence for the applicable requirement will normally include analysis of results and differential outcomes, appeal and correction records, moderation and exception records, authorship and identity controls proportionate to risk, and marking criteria and calibrated judgement. For digital transformation, currency, provenance and representativeness should be established before evidence is used for assurance. The record for digital transformation should retain disagreement between sources until its cause and effect are understood.
Application of the evidence to consistency in the assessment of digital transformation
The assurance record for the applicable expectation should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. In the context of digital transformation, the evidential history should preserve conclusions that were operative when a material decision was made.
- Calibrate assessors.
- Align tasks and criteria with learning outcomes.
- Moderate material variation.
- Review differential and anomalous results.
- Control changes.
Controls relevant to consistency in the assessment of digital transformation
In examining consistency in the assessment of digital transformation, responsible bodies should use common definitions and decision criteria, calibrate responsible staff, review outliers and compare outcomes across locations and groups. Where variation is justified, retain the reason and verify that it is applied without arbitrary disadvantage.
Assurance concerning digital transformation should be expressed at the level established by the evidence.
- Where are outcomes materially different?
- Have decision-makers been calibrated?
- Does review correct inconsistent treatment?
- Are common criteria in use?
- Is the reason relevant and documented?
Review criteria for consistency in the assessment of digital transformation
For digital transformation, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result.
Where evidence concerning digital transformation cannot support assurance, the limitation should be reported and corrective work should remain open.