Data and research analysis

Education at a Glance 2016: using attainment and expenditure indicators with due regard to context

Data Research

Review of education at a Glance 2016 addresses the unit of analysis, source definitions, missing data and transfer beyond the reported setting.

The relevant concern is the effect of consequential decisions on learners, institutions and resources entrusted for education.

Application to education at a Glance 2016

For Education at a Glance 2016, the public interest is not confined to institutional compliance.

  • Review whether savings transfer costs to learners.
  • Link expenditure to an intended result.
  • Assess distributional effects before reallocating funds before it informs a consequential decision.
  • Report limitations in expenditure comparisons.
  • Protect essential learning and safeguarding functions.

Controls for education at a Glance 2016

The position at publication is informed by Education at a Glance 2016; evidence from the affected setting remains necessary before reaching a conclusion on the analysis.

The analysis should make its decision rule explicit. In this case, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. For Education at a Glance 2016, transfer points should be tested because responsibility and information may be lost between otherwise sound functions.

Review of education at a Glance 2016

Material concerns include unclear cross-subsidy between activities, reporting expenditure without evidence of effect, across-the-board reductions with unequal consequences, and short-term savings that weaken completion or safety. Across the defined scope, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.

  • Who controls each stage?
  • Where do exceptions occur?
  • What action is required by the finding?
  • What outcome is intended?
  • Which evidence establishes operation?

Implications for education at a Glance 2016

Relevant evidence for Education at a Glance 2016 will normally include documented decisions on material reallocations, controls over restricted or public funds, service and outcome measures, distributional analysis across learner groups and locations, and unit-cost and workload information. Currency, provenance and representativeness should be established before evidence is used for assurance.

A competent review of the comparison should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. For Education at a Glance 2016, recurrence, common cause or wider exposure requires systemic action in addition to correction of individual cases.

Evidence relevant to education at a Glance 2016

The analytical record for Education at a Glance 2016 should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.

Proportionality in relation to the issue does not mean reduced protection for learners exposed to greater risk. When examining Education at a Glance 2016, higher expenditure is not, by itself, evidence of higher quality, and lower unit cost is not evidence of efficiency where access, learning or completion has deteriorated.

The assurance record for Education at a Glance 2016 should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. Across the defined scope, the evidential history should preserve conclusions that were operative when a material decision was made.

Public reporting on the analysis should distinguish established fact, analytical judgement and planned action. For Education at a Glance 2016, revision history should remain available where users have relied on the earlier conclusion.

In the context of Education at a Glance 2016, progress should not be assessed by the amount of policy or documentation produced. Performance in relation to Education at a Glance 2016 should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity.