Data and research analysis

Data gaps by wealth and location: an international evidence note

Data Research

The reliability of evidence on data gaps by wealth and location is examined together with the limits that apply when findings inform consequential decisions.

A national or international pattern may justify closer review of the comparison, but provider-level action requires evidence relating to the affected provision. For data gaps by wealth and location, the comparability record should identify material variation in coverage, period and classification.

For data gaps by wealth and location, the required public outcome should be stated in operational terms.

Application to data gaps by wealth and location

In the context of data gaps by wealth and location, definitions, reference periods, population coverage, institutional boundaries and collection practices must be sufficiently aligned for the observed difference to have a stable meaning.

In this case, a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. For decisions concerning data gaps by wealth and location, resources and activity should be reconciled with the operating evidence and result for which the responsible function is accountable.

Controls for data gaps by wealth and location

Risk assessment of data gaps by wealth and location should give particular attention to changes in definition presented as changes in performance, data revisions not carried through to published conclusions, and small differences overstated. A provider should also consider proxy measures treated as direct outcomes and incomplete coverage.

For comparative analysis, the most relevant material is likely to include population and sampling information, uncertainty estimates where relevant, coverage and missingness analysis, and revision and comparability records. For data gaps by wealth and location, independent records should be reconciled, with disagreement and uncertainty reported alongside the finding.

The method for the available evidence is to prepare a comparability table before analysing results. For data gaps by wealth and location, record common elements, material differences, breaks in series and the direction in which each limitation may affect the conclusion; do not rank systems where those limitations remain material.

Review of data gaps by wealth and location

Decision-makers using evidence on data gaps by wealth and location should be told what the data cannot establish as clearly as what it can. The finding should identify its analytical character and the system, institution, programme or learner population to which it applies. The basis for applying the result elsewhere should be established rather than assumed.

Proportionality in relation to the measure does not mean reduced protection for learners exposed to greater risk. For data gaps by wealth and location, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. Across the defined scope, quantitative evidence should be considered with implementation records and the experience of affected learners.

The assurance record for the available evidence should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. For data gaps by wealth and location, traceable source and version information allow genuine improvement to be distinguished from administrative revision.

In reviewing data gaps by wealth and location, where responsibilities for delivery are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service.