{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-2151172930ac3874","slug":"2025-06-16-reporting-learner-agency-coverage-and-revision-risk","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2025-06-16","last_modified_date":"2025-06-16","title":"Reporting learner agency: coverage and revision risk","summary":"Assesses evidence on reporting learner agency: coverage and revision risk, with particular attention to definitions, population coverage, comparability and uncertainty.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Automation and human-centred education policy","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Against the background of the automation and human-centred education policy, education authorities and providers should review how learner agency is defined, implemented and evidenced. The analysis of the available evidence proceeds on the basis that the available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison. Learner protection and reliable information should remain central when the scale of the response is determined."]},{"heading":"Evidence base for reporting learner agency","paragraphs":["For learner agency, the public interest is not confined to institutional compliance. For the measure, technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. In relation to reporting learner agency, where learners rely on published information or support decisions, errors should be identifiable and capable of prompt, fair correction."],"bullets":["Notify users of material limitations.","Prohibit uses for which evidence or authority is insufficient.","Review incidents and supplier changes.","Retain accountable human decision-makers before it informs a consequential decision.","Test performance across relevant groups, with responsibility, scope and timing recorded."]},{"heading":"Coverage and comparability","paragraphs":["The historical reference basis is the automation and human-centred education policy. Its relevance to learner agency should be assessed against the affected jurisdiction, learner population and form of provision.","The analysis of the available evidence should make its decision rule explicit. Oversight of the analysis should reflect the principle that data quality comprises accuracy, completeness, timeliness, consistency and traceability. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. This supports consistent review and reduces the risk of redefining the basis of judgement after an adverse result appears."]},{"heading":"Responsible interpretation","paragraphs":["Implementation of learner agency should be organised around a decision that can be tested. For the analysis, where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. Oversight requires a traceable line from the approved objective through responsible action to evidence of outcome.","The principal risks in relation to the available evidence are unclear responsibility between providers and suppliers, unequal performance across learner groups, automation bias in consequential decisions, and loss of meaningful human review. In relation to reporting learner agency, the relationship between the risks is material: one failed safeguard may remove the evidence needed to activate another."],"bullets":["Are validation rules operating?","Can reported values be traced to source?","Who may amend a record?","What proportion is missing or late?","Are revisions carried through to public reports?"]},{"heading":"Limitations and reporting","paragraphs":["The evidential record for learner agency should permit a reviewer to trace the matter from decision to outcome. This may require learner information and accessible challenge routes, an inventory of systems and their intended uses, pre-deployment and periodic performance testing, and documented authority for each consequential use, supported by records of human review and overrides and supplier change and incident records. Sampling remains insufficient where it excludes a material group or cannot resolve contradictory evidence or recurrence.","A proportionate method is available for the available evidence. In reviewing the measure, responsible bodies should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. Escalate discrepancies that could alter a published conclusion or individual outcome. Adverse cases and unresolved contradictions should be retained because they may reveal limitations concealed by an average result."]},{"heading":"Limitations and reporting","paragraphs":["Decision-makers using evidence on learner agency should be told what the data cannot establish as clearly as what it can. The nature of the result and its applicable unit—system, institution, programme or learner group—should be explicit. Use in a different context requires an independent judgement that the settings are materially comparable.","Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. Oversight of the measure should reflect the principle that a technical capability is not evidence that a use is educationally justified. Accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. In reviewing the comparison, association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. No exception should continue without a documented basis, accountable approval and scheduled review.","Decisions concerning the analysis should remain traceable to the information available for the stated reference period. Changes in condition, evidence, method and interpretation should be recorded separately when a conclusion is revised.","Accountability for the comparison should follow decision-making authority. Operational tasks may be delegated, but accountability for material effects on learners must remain identifiable.","Evidence concerning the available evidence should be current, attributable and representative of the affected scope. Material gaps or contradictions should remain visible in the conclusion."]}],"word_count":781,"content_hash":"sha256-f428cb321ffe48e8bd2c9bc3a91d2f0a4dad1d2368c800bec52094a1899f24d0","seo_keywords":["reporting learner agency","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle","related_resources":[{"label":"Research and technical publications","path":"/publications"}]}