{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-49ba2eb0dbe79736","slug":"2019-08-20-digital-learning-policy-what-current-evidence-shows","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2019-08-20","last_modified_date":"2019-08-20","title":"Digital learning policy: what current evidence shows","summary":"Examines digital learning policy: what current evidence shows, defining the evidence base, coverage and limits that should govern comparison and use of the findings.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"International policy attention to AI and digital education","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of digital learning policy is informed by the international policy attention to AI and digital education, with consequences for governance, evidence and the treatment of affected learners. A decision concerning the analysis should recognise that the value of the present data lies in the questions it can answer reliably and in the limits it makes visible."]},{"heading":"Evidence base for digital learning policy","paragraphs":["In relation to digital learning policy, the relevant outcome should be capable of direct and consistent explanation. For digital learning policy, technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. The existence of an approved measure or completed activity is not evidence of educational effect."],"bullets":["Review incidents and supplier changes.","Classify uses by effect on learners.","Prohibit uses for which evidence or authority is insufficient, with responsibility, scope and timing recorded.","Retain accountable human decision-makers.","Control personal and confidential information, with responsibility, scope and timing recorded."]},{"heading":"Coverage and comparability","paragraphs":["The reference point is the international policy attention to AI and digital education. Its wider significance does not replace evidence of how digital learning policy operates in the affected setting. Reporting should preserve the different status of facts, public expectations and choices made by institutions.","A focused examination of the analysis requires a clear analytical discipline. Oversight of the measure should reflect the principle that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. A failure at an interface may have greater learner impact than a weakness confined to one function. An imprecise scope or measure may produce a credible-looking record that does not answer the relevant decision question."]},{"heading":"Responsible interpretation","paragraphs":["Responsibility for digital learning policy should be visible at the point where consequential decisions are made. A decision concerning the issue should recognise that a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice.","Failure in relation to the comparison may arise even where the stated policy is reasonable. Material concerns include unverified outputs entering teaching or assessment, unclear responsibility between providers and suppliers, opaque use of personal or inferred data, and unequal performance across learner groups. Review should consider whether an exception is prolonged, recurring or capable of affecting learners outside the cases examined."],"bullets":["Which evidence establishes operation?","What action is required by the finding?","What outcome is intended?","Who controls each stage?","Where do exceptions occur?"]},{"heading":"Limitations and reporting","paragraphs":["Evidence collection should be designed around the decision question rather than administrative convenience. For digital learning policy, the most relevant material is likely to include data provenance and access controls, records of human review and overrides, pre-deployment and periodic performance testing, and learner information and accessible challenge routes.","The review method for the issue should be reproducible. For the analysis, the reviewer should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Review should determine whether correction can remain case-specific or must extend across the system. In relation to digital learning policy, working papers should allow another competent reviewer to understand the evidence, judgement and treatment of material exceptions."]},{"heading":"Limitations and reporting","paragraphs":["Publication of findings on digital learning policy should distinguish observed values, estimates and interpretation.","The analysis of the available evidence should remain within the limits of the evidence. The analysis of the measure proceeds on the basis that a single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners. Oversight of the comparison should reflect the principle that a technical capability is not evidence that a use is educationally justified. Accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. Decision-makers should not extend assurance beyond the point supported by the available evidence.","Records relating to the available evidence should preserve both the conclusion and its limits. The correction record should state what the new evidence changes and which earlier conclusions or decisions require review. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.","Accountability for the available evidence should follow decision-making authority. Evidence of material risk should be placed before the body with authority to act, together with a traceable decision. Where work is delegated, the record should continue to identify who is accountable for material consequences to learners.","The appropriate response to the available evidence is therefore one of controlled implementation and review. A clear objective, proportionate evidential basis and account of affected learners are required. Where evidence cannot support assurance, the limitation should be reported and corrective work should remain open."]}],"word_count":775,"content_hash":"sha256-c7368c7c53a549cf37a51dbc02fd07f7d322611b1cdc6ca320598d5ff3fe7604","seo_keywords":["digital learning policy","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}