{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-af5c5e5754f9522b","slug":"2022-07-26-data-quality-in-reporting-foundational-learning","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2022-07-26","last_modified_date":"2022-07-26","title":"Data quality in reporting foundational learning","summary":"Assesses evidence on data quality in reporting foundational learning, with particular attention to definitions, population coverage, comparability and uncertainty.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"2022 learning poverty evidence","reference_authority":"World Bank","sections":[{"heading":null,"paragraphs":["The present attention to foundational learning follows the 2022 learning poverty evidence and requires a careful distinction between public commitment, institutional practice and demonstrated result. Oversight of the issue should reflect the principle that the value of the present data lies in the questions it can answer reliably and in the limits it makes visible. The control response should be sufficient to protect learners while avoiding burdens not justified by the evidence.","Responsibility for the available evidence should be visible at the point where consequential decisions are made. For the measure, reported averages should be accompanied by sufficient distributional information to identify material differences between learner groups, locations and forms of provision. In relation to data quality in reporting foundational learning, a decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved."]},{"heading":"Analytical scope","paragraphs":["The reference basis—the 2022 learning poverty evidence—is evidential rather than self-executing. Patterns in the material may justify enquiry, although they do not by themselves determine legal position or cause. In applying it to foundational learning, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.","The 2022 learning poverty update examines the proportion of children unable to read and understand a simple text by the end of primary-school age and the additional effects of pandemic disruption. The measure combines schooling and learning information to indicate a serious system-level problem. It is not a complete measure of education quality and should be interpreted alongside access, grade progression, language, assessment coverage and distributional evidence.","A focused examination of the analysis requires a clear analytical discipline. The analysis of the measure proceeds on the basis that data quality comprises accuracy, completeness, timeliness, consistency and traceability. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. The decision question, affected scope and measure should align; otherwise the conclusion may be unsupported despite substantial documentation.","Risk assessment of the available evidence should give particular attention to small differences overstated, incomplete coverage, and changes in definition presented as changes in performance. A provider should also consider proxy measures treated as direct outcomes and averages concealing distribution. Stronger controls are required where learners may not detect an error or where later correction cannot restore the lost opportunity.","Evidence should be selected against a clearly defined question. For the analysis, the most relevant material is likely to include revision and comparability records, triangulation with administrative and qualitative evidence, indicator definitions and metadata, and population and sampling information. In relation to data quality in reporting foundational learning, confidence is strengthened by corroboration, not by the volume of records drawn from the same underlying source."]},{"heading":"Definitions and data coverage","paragraphs":["For operational review of foundational learning, authorities and providers should proceed in a defined sequence. A competent review of the comparison should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. Escalate discrepancies that could alter a published conclusion or individual outcome.","The assurance record for the issue should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. This enables later review to separate substantive change from correction, reclassification or expanded coverage. Revision should not remove an earlier conclusion from the record where reliance has occurred."],"bullets":["Are revisions carried through to public reports?","Who may amend a record?","Can reported values be traced to source?","Are validation rules operating?","What proportion is missing or late?"]},{"heading":"Use of the findings","paragraphs":["Where foundational learning involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Governance between participating bodies should make information duties and corrective authority explicit. Protection should operate across the complete service, irrespective of how delivery is divided.","The analytical record for the issue should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations."],"bullets":["Disaggregate material results before using it to determine a learner or provider outcome.","Analyse missing information.","Avoid causal claims unsupported by the design.","Define the decision the indicator will inform.","Report uncertainty and revisions."]},{"heading":"Uncertainty and safeguards","paragraphs":["For foundational learning, the public interest is not confined to institutional compliance. Oversight of the comparison should reflect the principle that education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation. Learners should understand arrangements that materially affect them and have access to timely correction of inaccurate or unfair information, support or decisions.","Interpretation of the measure should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. For the available evidence, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. Oversight of the measure should reflect the principle that international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another.","Assurance concerning the issue requires corroborating evidence across the material scope. The final judgement should connect the applicable expectation to implementation and outcomes while identifying unresolved risk."]}],"word_count":885,"content_hash":"sha256-b9ffe48f5b2708ad2d62bcfff5e9b0126c12df8044b249efdb7e1538506325b2","seo_keywords":["data quality in reporting foundational learning","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}