Data and research analysis

Establishing a baseline for foundational learning

Data Research

Assesses the evidence concerning foundational learning, including comparability, uncertainty and limits on interpretation.

In 2022, consideration of foundational learning must take account of the 2022 learning poverty evidence and the responsibilities it places before education systems. For the analytical question, the principal analytical task is to separate an observed difference from a conclusion about its cause. A reliable review extends beyond the central process to material variation across programmes, sites, delivery arrangements and learner groups. Evidence of formal policy should not be treated as evidence of uniform implementation.

Scope of this analysis

The stated reference is 2022 learning poverty evidence. Use of the findings should remain within the population and analytical level of collection. A national or international pattern may justify closer review of foundational learning, but provider-level action requires evidence relating to the affected provision. Variation in population coverage, reference period or classification should accompany the reported comparison.

The 2022 learning poverty update examines the proportion of children unable to read and understand a simple text by the end of primary-school age and the additional effects of pandemic disruption. The measure combines schooling and learning information to indicate a serious system-level problem. It is not a complete measure of education quality and should be interpreted alongside access, grade progression, language, assessment coverage and distributional evidence.

The governing expectation for the matter examined should be capable of consistent application. A decision concerning the comparison should recognise that a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. Criteria affecting learners should not permit materially different interpretation without an evidenced reason.

Failure in relation to the reported measure may arise even where the stated policy is reasonable. Material concerns include proxy measures treated as direct outcomes, data revisions not carried through to published conclusions, changes in definition presented as changes in performance, and averages concealing distribution. Review should consider whether an exception is prolonged, recurring or capable of affecting learners outside the cases examined.

In practical terms, the analytical question should be reviewed against a stated method rather than general assurance. The analysis of the analytical question proceeds on the basis that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Handovers between responsible functions require examination because material control gaps may otherwise remain concealed. A technically sound method remains inadequate if its limits are not clear to the body using the result.

The evidential record for the evidence under review should permit a reviewer to trace the matter from decision to outcome. This may require coverage and missingness analysis, population and sampling information, disaggregated results, and triangulation with administrative and qualitative evidence, supported by indicator definitions and metadata and revision and comparability records. Further cases should be examined when the initial sample does not represent the affected scope or confirm sustained correction.

The substantive quality question

Interpretation of foundational learning should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. For the matter examined, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. The analysis of the evidence under review proceeds on the basis that a single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners.

Decisions concerning the reported measure should remain traceable to the information available for the stated reference period. Any revised finding should identify precisely what has changed and why the earlier conclusion no longer applies. Transparent treatment of reporting changes prevents artificial movement from being read as substantive progress or decline.

  • Report uncertainty and revisions, including material exceptions and unequal effects.
  • Analyse missing information, including material exceptions and unequal effects.
  • Define the decision the indicator will inform, identifying the accountable function and affected scope.
  • Avoid causal claims unsupported by the design, with responsibility, scope and timing recorded.
  • Disaggregate material results and retain evidence sufficient for independent review.

What should be examined

For operational review of foundational learning, authorities and providers should proceed in a defined sequence. The method for the evidence under review is to map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Recurrence, common cause or wider exposure requires systemic action in addition to correction of individual cases. Observations may inform further enquiry, but only supported findings should determine conformity or effectiveness.

Publication of findings on the comparison should distinguish observed values, estimates and interpretation. Revisions, breaks in series and changes in classification should be visible. Where disaggregation creates small or unstable groups, confidentiality and uncertainty should be managed without concealing a material disparity that requires further investigation.

  • Which evidence establishes operation?
  • Where do exceptions occur?
  • What outcome is intended?
  • Who controls each stage?
  • What action is required by the finding?

Proportionality and exceptions

Where foundational learning involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Learner safeguards should remain continuous where provision is delivered by several bodies.

The quality significance of the evidence under review follows from a basic distinction between availability and effective provision. Oversight of the reported measure should reflect the principle that education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation. Assurance should follow the learner journey and test more than a single access point or aggregate result.

The current development provides a basis for examining whether the reported measure is supported by responsible action and demonstrable result. Clear accountability and reliable evidence support improvement while maintaining public confidence in education.