Data quality in reporting refugee and displaced learner access

The large-scale displacement and regional education pressure provides the immediate context for refugee and displaced learner access. In this case, comparable indicators can support public decision-making, but they do not remove the need to examine variation within systems and institutions.

Evidence and method

In this case, education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation.

• Disaggregate material results before it informs a consequential decision.
• Test comparability before it informs a consequential decision.
• Document numerator and denominator.
• Report uncertainty and revisions before it is relied on for a decision with material effect.
• Analyse missing information.

Patterns requiring examination

For refugee and displaced learner access, the conditions described by the large-scale displacement and regional education pressure create an exceptional operating context for refugee and displaced learner access. Evidence may be incomplete and normal controls may be unavailable, but uncertainty should be stated rather than converted into unsupported assurance. Authorities and providers should record the basis, duration and affected scope of temporary decisions and should reassess them when access, public-health, security or delivery conditions change.

Review of the analysis should be based on a stated method rather than general assurance. Data quality comprises accuracy, completeness, timeliness, consistency and traceability. In work concerning refugee and displaced learner access, strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. Those required to act should be able to understand the method and its material limitations.

Implications for decision-makers

In work concerning refugee and displaced learner access, the applicable expectation should be capable of consistent application. Reported averages should be accompanied by sufficient distributional information to identify material differences between learner groups, locations and forms of provision. Criteria affecting learners should not permit materially different interpretation without an evidenced reason.

A narrow control over the measure may create false assurance. In the present context, small differences overstated, changes in definition presented as changes in performance and data revisions not carried through to published conclusions may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. Within the scope under review, a sample confined to compliant cases cannot establish the reliability of the control.

• What proportion is missing or late?
• Are revisions carried through to public reports?
• Who may amend a record?
• Are validation rules operating?
• Can reported values be traced to source?

Limits of inference

Assurance of refugee and displaced learner access should draw on more than one form of evidence. Useful records include revision and comparability records, disaggregated results, population and sampling information, uncertainty estimates where relevant, and triangulation with administrative and qualitative evidence. System-wide assurance cannot be inferred from a favourable case chosen after the event.

Authorities and providers reviewing the analysis should proceed in a defined sequence. The review should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. In reviewing refugee and displaced learner access, escalate discrepancies that could alter a published conclusion or individual outcome.

Limits of inference

The analytical record for refugee and displaced learner access should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.

Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. The analysis proceeds on the basis that measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. In this case, international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another.

Records relating to the analysis should preserve both the conclusion and its limits. In the context of refugee and displaced learner access, new evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion. The correction process should identify prior users and decisions where published information has had material effect.

Public reporting on refugee and displaced learner access should distinguish established fact, analytical judgement and planned action. Material revisions should be traceable to their reason and effective date.

Neither one indicator nor one control can establish the complete position on the comparison. A conclusion concerning refugee and displaced learner access should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk.