{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-e6525f49a07fb703","slug":"2016-03-28-evidence-boundaries-in-the-evaluation-of-digital-education","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2016-03-28","last_modified_date":"2016-03-28","title":"Evidence boundaries in the evaluation of digital education","summary":"Clarifies the practical meaning of evidence boundaries in the evaluation of digital education and the evidence required to support a reliable assurance conclusion.","category":{"code":"STANDARDS_INTERPRETATION","label":"Standards Interpretation"},"article_type":"Standards interpretation","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Expansion of technology-supported learning","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of digital education is informed by the expansion of technology-supported learning, with consequences for governance, evidence and the treatment of affected learners. In reviewing the issue under review, consistent application requires a clear distinction between the required result, recommended methods and examples that may assist implementation.","The principal risks in relation to the issue under review are technology access determining educational access, reduced opportunities for timely support, unclear identity and participation records, and inaccessible content or interaction. In relation to evidence boundaries in the evaluation of digital education, a weakness in one part of the control environment may obscure a related failure elsewhere."]},{"heading":"Meaning in practice","paragraphs":["The governing expectation for digital education should be capable of consistent application. A decision concerning the issue under review should recognise that evidence is sufficient when it is current, attributable, representative of the relevant scope and capable of being reconciled with other available records. Definitions should provide a stable basis for decisions while allowing relevant differences to be identified and justified.","The historical reference basis is the expansion of technology-supported learning. Its relevance to the relevant requirement should be assessed against the affected jurisdiction, learner population and form of provision.","A focused examination of the control requires a clear analytical discipline. The analysis of the relevant requirement proceeds on the basis that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Material failure may occur at the transfer of responsibility or information even where separate functions appear adequate. A formally complete record is not reliable if its scope or measure does not correspond to the decision being made."],"bullets":["Test access before requiring use.","Define the educational purpose of the technology.","Support staff and learners.","Maintain continuity and supplier exit controls.","Provide alternative routes for material barriers before it is relied on for a decision with material effect."]},{"heading":"Responsibilities and material risks","paragraphs":["The analysis of digital education should remain within the limits of the evidence. Oversight of the relevant requirement should reflect the principle that interpretive guidance should not create an obligation that is absent from the governing instrument or applicable law. A decision concerning the control should recognise that digital participation data should not be treated as a direct measure of learning. Log-ins, connection time and activity counts require interpretation alongside assessment and learner experience. If uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.","Assurance of the matter should draw on more than one form of evidence. Useful records include service availability and incident records, supplier performance and exit arrangements, assessment validity and integrity reviews, teacher capability and workload information, and delivery-mode design and approval records. A positive example may illustrate operation, but it cannot demonstrate coverage or consistency.","Accountability and effective correction both depend on a record that can be followed from evidence to decision. For the issue under review, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. In relation to evidence boundaries in the evaluation of digital education, historical decisions should be assessed against the information then available, with later amendments separately dated and explained."]},{"heading":"Basis for a reliable conclusion","paragraphs":["Implementation of digital education can be tested without imposing unnecessary reporting. In reviewing the issue under review, responsible bodies should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Where evidence indicates a shared cause or broader reach, the response should extend beyond the initial case. Existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance question.","The final record on the stated expectation should identify the applicable expectation, the relevant scope, the evidence examined, the sampling basis, material exceptions and the reason for the conclusion. Departure from an illustrative method may be justified where equivalent outcome and evidence are established. No complete conclusion should be recorded while a material evidential limitation remains."],"bullets":["What action is required by the finding?","Which evidence establishes operation?","Who controls each stage?","Where do exceptions occur?","What outcome is intended?"]},{"heading":"Maintaining effective oversight","paragraphs":["The system and institutional dimensions of digital education should be considered together. Oversight of evidence boundaries in the evaluation of digital education should reflect the principle that a change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control.","Where the relevant requirement involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Learner safeguards should remain continuous where provision is delivered by several bodies.","For the issue under review, the implementation record should distinguish binding duties, policy expectations and institutional choices, including any transition or jurisdictional limitation. Improvement should be supported by evidence and an accountable decision record capable of public scrutiny."]}],"word_count":838,"content_hash":"sha256-5bf5fc5c2db237920a5cc9425adfc95ce4dd5aa2451cc77b97e5c06f2127f31b","seo_keywords":["evidence boundaries in the evaluation of digital education","education quality standards","education quality","ICEQC"],"schema_type":"TechArticle"}