Data quality in reporting foundational learning

For the measure, reported averages should be accompanied by sufficient distributional information to identify material differences between learner groups, locations and forms of provision.

Application to data quality in reporting foundational learning

Patterns in the material may justify enquiry, although they do not by themselves determine legal position or cause. In applying it to foundational learning, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.

When examining foundational learning, the 2022 learning poverty update examines the proportion of children unable to read and understand a simple text by the end of primary-school age and the additional effects of pandemic disruption. The measure combines schooling and learning information to indicate a serious system-level problem. It is not a complete measure of education quality and should be interpreted alongside access, grade progression, language, assessment coverage and distributional evidence.

Data quality comprises accuracy, completeness, timeliness, consistency and traceability. For foundational learning, strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision.

Risk assessment of the available evidence should give particular attention to small differences overstated, incomplete coverage, and changes in definition presented as changes in performance. A provider should also consider proxy measures treated as direct outcomes and averages concealing distribution. In reviewing foundational learning, stronger controls are required where learners may not detect an error or where later correction cannot restore the lost opportunity.

Evidence concerning foundational learning should be selected against a clearly defined question. For the analysis, the most relevant material is likely to include revision and comparability records, triangulation with administrative and qualitative evidence, indicator definitions and metadata, and population and sampling information.

Controls for data quality in reporting foundational learning

Authorities and providers reviewing foundational learning should proceed in a defined sequence. A competent review of the comparison should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. Escalate discrepancies that could alter a published conclusion or individual outcome.

In examining data quality in reporting foundational learning, the assurance record for foundational learning should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied.

• Are revisions carried through to public reports?
• Who may amend a record?
• Can reported values be traced to source?
• Are validation rules operating?
• What proportion is missing or late?

Review of data quality in reporting foundational learning

The analytical record for foundational learning should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.

• Disaggregate material results before using it to determine a learner or provider outcome.
• Analyse missing information.
• Avoid causal claims unsupported by the design.
• Define the decision the indicator will inform.
• Report uncertainty and revisions.

Implications for data quality in reporting foundational learning

For foundational learning, the public interest is not confined to institutional compliance.

Interpretation of the measure should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. For the available evidence, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. For foundational learning, international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another.

Across the defined scope, assurance concerning the issue requires corroborating evidence across the material scope. The final judgement on foundational learning should connect the applicable expectation to implementation and outcomes while identifying unresolved risk.