Examines digital education, addressing methodological considerations, source definitions, coverage, comparability, uncertainty and limits on inference.
In 2016, consideration of digital education must take account of the expansion of technology-supported learning and the responsibilities it places before education systems. Evidence concerning digital education should inform action without implying a level of precision, coverage or causal certainty that the underlying data cannot support. The chosen response should address the risk without weakening access, educational quality or fair treatment.
Analytical scope
The relevant context is provided by expansion of technology-supported learning. Its relevance to digital education should be assessed against the affected jurisdiction, learner population and form of provision. The international development warrants attention, but a consequential conclusion still requires current, attributable and representative evidence for the affected scope.
In the context of digital education, responsibility should be identifiable at the point where consequential decisions are made. Trend claims require comparable observations over time and a documented account of revisions, breaks in series and changes in coverage.
When examining digital education, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Assurance should not overlook failures arising at the boundary between otherwise adequate controls. The judgement should state its supporting evidence and any condition limiting application to the declared scope.
Assurance of the available evidence should draw on more than one form of evidence. Useful records include learner access and participation information, service availability and incident records, assessment validity and integrity reviews, accessibility and usability testing, and supplier performance and exit arrangements. In work concerning digital education, system-wide assurance cannot be inferred from a favourable case chosen after the event.
Definitions and data coverage
As regards digital education, the relevant outcome should be capable of direct and consistent explanation. A change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Within the scope under review, assurance should not stop at adoption, resourcing or completion of administrative tasks. Authorities and providers require evidence of operation and effect, with a route to identify and correct unequal or unintended consequences.
Failure in relation to the analysis may arise even where the stated policy is reasonable. Material concerns include unclear identity and participation records, technology access determining educational access, supplier dependency without continuity controls, and inaccessible content or interaction. For digital education, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.
- Define the educational purpose of the technology.
- Test access before requiring use.
- Assure assessment validity.
- Provide alternative routes for material barriers.
- Maintain continuity and supplier exit controls.
Use of the findings
Authorities and providers reviewing digital education should proceed in a defined sequence. The method for the measure is to map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions.
Publication of findings on digital education should distinguish observed values, estimates and interpretation.
Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. In work concerning digital education, digital participation data should not be treated as a direct measure of learning. Log-ins, connection time and activity counts require interpretation alongside assessment and learner experience. A single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners. Each exception should record its basis, authorisation, duration and review date.
As regards digital education, accountability and effective correction both depend on a record that can be followed from evidence to decision. In this case, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. Within the scope under review, material changes require a traceable effective date and explanation so that prior reliance can be reviewed fairly.
Uncertainty and safeguards
For digital education, where responsibilities for delivery are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. The division of responsibilities should cover records, communication, escalation and the power to require correction. Division of delivery responsibilities must not create gaps in learner protection.
A complete conclusion on the measure requires evidence extending beyond an individual measure or safeguard. A conclusion concerning digital education should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk.