Provides a disciplined basis for interpreting evidence on Education at a Glance 2022, including material variation, missing information and revision risk.
Consideration of Education at a Glance 2022 should retain the date and status of Education at a Glance 2022. Later developments should not be read into the position available at publication. Its status should be distinguished from the jurisdiction-specific evidence required for implementation. Any indicator used in relation to the reported measure should distinguish description from causal explanation. Material variation and uncertainty should be reported together with any restriction on wider application. Any indicator used in relation to the evidence under review should distinguish description from causal explanation. Administrative form may differ between systems, provided the required outcome and accountability are maintained.
Scope of this analysis
At the publication date, Education at a Glance 2022 provides the relevant international context for Education at a Glance 2022. Any consequential application still requires evidence from the affected jurisdiction or institution. Any indicator used in relation to Education at a Glance 2022 should distinguish description from causal explanation. Interpretation should retain uncertainty, distributional differences and limits on generalisation. Later review should not obscure whether the earlier position rested on fact, policy or judgement.
Analysis of the evidence under review should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Reliability depends on preserving the material distinctions between the matters compared. Data used for the evidence under review should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result. The record for the reported measure should identify the responsible function, decision authority and escalation route. Gaps between public oversight and provider control should not remain implicit. Governance of the evidence under review requires a clear allocation of authority, information and follow-through. The responsible body should receive matters requiring resources, policy change or formal risk acceptance.
The review method for the evidence under review should connect the question under examination to suitable evidence and a conclusion no broader than the tested scope. A reported result should state how outcomes are distributed and where transfer beyond the observed setting is not supported. Particular attention should be given to interfaces where responsibility or records pass from one function to another. Any indicator used in relation to the matter examined should distinguish description from causal explanation.
Analysis of the analytical question should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Reporting on the analytical question should distinguish established fact, analytical judgement and planned action. Material revisions should retain their reason and effective date.
Failure in relation to the reported measure may arise even where the stated policy is reasonable. Analysis of Education at a Glance 2022 should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning.
Data used for Education at a Glance 2022 should be interpreted against stable definitions and an identifiable population. Reporting should identify a break in comparability before describing movement over time. Analysis of the reported measure should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Confidence is strengthened by corroboration, not by the volume of records drawn from the same underlying source.
Operational significance
The contemporaneous reference point for Education at a Glance 2022 is Education at a Glance 2022. Data used for the comparison should be interpreted against stable definitions and an identifiable population. Recurrence, common cause or wider exposure requires systemic action in addition to correction of individual cases. Analysis of the comparison should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.
Decision-makers using evidence on the reported measure should be told what the data cannot establish as clearly as what it can.
Any indicator used in relation to the analytical question should distinguish description from causal explanation.
Decisions concerning the comparison should remain traceable to the information available for the stated reference period. Improvement work on Education at a Glance 2022 should begin with a verified problem, defined baseline and measurable outcome. Completion should depend on evidence of effect rather than completion of planned activity.
Accountability for the analytical question should follow decision-making authority. Analysis of the matter examined should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. The record for the comparison should identify the responsible function, decision authority and escalation route.
Any indicator used in relation to the comparison should distinguish description from causal explanation. Public information on the matter examined should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction.
A conclusion on the matter under review should extend no further than the available evidence permits.
Missing populations, inconsistent records and unresolved exceptions should be reported with the finding.