Digital education: methodological considerations

Evidence relevant to digital education

Assurance of the available evidence should draw on more than one form of evidence. Useful records include learner access and participation information, service availability and incident records, assessment validity and integrity reviews, accessibility and usability testing, and supplier performance and exit arrangements. For digital education, system-wide assurance cannot be inferred from a favourable case chosen after the event.

Application to digital education

For digital education, the relevant outcome should be capable of direct and consistent explanation. A change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Across the defined scope, assurance should not stop at adoption, resourcing or completion of administrative tasks.

Failure in relation to the analysis may arise even where the stated policy is reasonable. Material concerns include unclear identity and participation records, technology access determining educational access, supplier dependency without continuity controls, and inaccessible content or interaction. For digital education, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.

• Define the educational purpose of the technology.
• Test access before requiring use.
• Assure assessment validity.
• Provide alternative routes for material barriers.
• Maintain continuity and supplier exit controls.

Controls for digital education

The method for the measure is to map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions.

Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. For digital education, digital participation data should not be treated as a direct measure of learning.

For digital education, accountability and effective correction both depend on a record that can be followed from evidence to decision. Across the defined scope, material changes require a traceable effective date and explanation so that prior reliance can be reviewed fairly.

Review of digital education

A complete conclusion on the measure requires evidence extending beyond an individual measure or safeguard.

In examining digital education: methodological considerations, the chosen response should address the risk without weakening access, educational quality or fair treatment.

Assurance should not overlook failures arising at the boundary between otherwise adequate controls.

Evidence concerning digital education should inform action without implying a level of precision, coverage or causal certainty that the underlying data cannot support.