Evidence boundaries in the evaluation of digital education

Current consideration of digital education is informed by the expansion of technology-supported learning, with consequences for governance, evidence and the treatment of affected learners. Consistent application requires a clear distinction between the required result, recommended methods and examples that may assist implementation.

The principal risks in relation to the matter are technology access determining educational access, reduced opportunities for timely support, unclear identity and participation records, and inaccessible content or interaction. For digital education, a weakness in one part of the control environment may obscure a related failure elsewhere.

Meaning in practice

In the context of digital education, the applicable expectation should be capable of consistent application. Evidence is sufficient when it is current, attributable, representative of the relevant scope and capable of being reconciled with other available records. Definitions should provide a stable basis for decisions while allowing relevant differences to be identified and justified.

Expansion of technology-supported learning provides the reference point for this analysis. Its relevance to the applicable requirement should be assessed against the affected jurisdiction, learner population and form of provision.

For decisions concerning digital education, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Material failure may occur at the transfer of responsibility or information even where separate functions appear adequate. A formally complete record is not reliable if its scope or measure does not correspond to the decision being made.

• Test access before requiring use.
• Define the educational purpose of the technology.
• Support staff and learners.
• Maintain continuity and supplier exit controls.
• Provide alternative routes for material barriers before it is relied on for a decision with material effect.

Responsibilities and material risks

The analysis of digital education should remain within the limits of the evidence. Interpretive guidance should not create an obligation that is absent from the governing instrument or applicable law. Digital participation data should not be treated as a direct measure of learning. Log-ins, connection time and activity counts require interpretation alongside assessment and learner experience. Within the scope under review, if uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.

For digital education, assurance of the matter should draw on more than one form of evidence. Useful records include service availability and incident records, supplier performance and exit arrangements, assessment validity and integrity reviews, teacher capability and workload information, and delivery-mode design and approval records. A positive example may illustrate operation, but it cannot demonstrate coverage or consistency.

For digital education, accountability and effective correction both depend on a record that can be followed from evidence to decision. For the matter, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. Historical decisions concerning digital education should be assessed against the information then available, with later amendments separately dated and explained.

Basis for a reliable conclusion

Implementation of digital education can be tested without imposing unnecessary reporting. Responsible bodies should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Where evidence indicates a shared cause or broader reach, the response should extend beyond the initial case. Existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance conclusion.

In work concerning digital education, the final record on the applicable expectation should identify the applicable expectation, the relevant scope, the evidence examined, the sampling basis, material exceptions and the reason for the conclusion. Departure from an illustrative method may be justified where equivalent outcome and evidence are established. No complete conclusion should be recorded while a material evidential limitation remains.

• What action is required by the finding?
• Which evidence establishes operation?
• Who controls each stage?
• Where do exceptions occur?
• What outcome is intended?

Maintaining effective oversight

The system and institutional dimensions of digital education should be considered together. A change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control.

For digital education, where responsibilities for delivery are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements governing digital education should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Learner safeguards associated with digital education should remain continuous where provision is delivered by several bodies.

For digital education, for the matter, the implementation record should distinguish binding duties, policy expectations and institutional choices, including any transition or jurisdictional limitation. Improvement of digital education should be supported by evidence and an accountable decision record capable of public scrutiny.