Disaggregated education data: an interpretation of institutional obligations

The equity monitoring and data gaps provides the immediate context for disaggregated education data. For the applicable requirement, the requirement should be read as an assurance obligation: the provider must be able to explain the control, show its operation and account for material exceptions.

The stated reference is Equity monitoring and data gaps. For decisions concerning disaggregated education data, interpretation should preserve the unit and population represented in the data collection. A national or international pattern may justify closer review of the applicable expectation, but provider-level action requires evidence relating to the affected provision. Variation in population coverage, reference period or classification should accompany the reported comparison.

Applicable scope

For the assurance conclusion, education systems should examine not only who enters education, but who can participate effectively, progress and complete with the intended learning outcomes. Reporting on the applicable expectation should distinguish established fact, analytical judgement and planned action. For disaggregated education data, material revisions should retain their reason and effective date.

Review of the assurance conclusion should follow a stated and reproducible method, including the decision rule, sampling basis, treatment of exceptions and threshold for escalation. An average may improve while a material group experiences no improvement or a worse outcome. For decisions concerning disaggregated education data, disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals.

Data used to assess disaggregated education data should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result. Records concerning the applicable expectation should remain traceable from source evidence to decision and follow-up. Superseded conclusions should be retained where they informed a material outcome. A chosen approach should be justified against its context, with departures and review points under documented control.

Any indicator used in relation to the matter should distinguish description from causal explanation. For disaggregated education data, a reported result should state how outcomes are distributed and where transfer beyond the observed setting is not supported. Evidence outside the relevant period or scope should be identified and given no more weight than its limitations permit. Conflicting records require reconciliation before a complete assurance conclusion is reached.

• Review policies that create avoidable exclusion.
• Identify groups not represented in aggregate results.
• Monitor progression at useful intervals.
• Analyse barriers across the learner journey.
• Report limitations in available data.

Implementation and evidence

Failure in relation to disaggregated education data may arise even where the stated policy is reasonable. Material concerns include financial or geographic barriers, support allocated without evidence of need, attrition detected too late, and aggregate gains concealing excluded groups. The principal risks associated with the matter should be assessed as connected conditions.

In work concerning disaggregated education data, analysis should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning. The result should be accompanied by distributional information, uncertainty and limits on transfer to another setting. Within the scope under review, reuse of existing information is appropriate only where its purpose, scope and reliability correspond to the decision under review.

The final record on the control should identify the applicable expectation, the relevant scope, the evidence examined, the sampling basis, material exceptions and the reason for the conclusion. As regards disaggregated education data, departure from an illustrative method may be justified where equivalent outcome and evidence are established. The affected scope should remain open where a material limitation prevents assurance.

The assurance record for the applicable expectation should permit another competent reviewer to understand the evidence, method, judgement and treatment of material exceptions. For the control, a prescribed method should not be treated as the only acceptable method where another approach establishes the same outcome with equivalent evidence. For decisions concerning disaggregated education data, equal treatment does not necessarily produce equitable access or outcomes. Different support may be justified where it addresses a documented barrier without changing the required educational outcome. Decision-makers should not extend assurance beyond the point supported by the available evidence.

In the context of disaggregated education data, a traceable record enables responsibility to be established and errors to be corrected fairly. For the matter, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. Material changes require a traceable effective date and explanation so that prior reliance can be reviewed fairly.

The principal risks associated with the applicable requirement should be assessed as connected conditions. For decisions concerning disaggregated education data, management should assign each material action to an accountable owner and completion date.

A formal commitment concerning the applicable requirement does not establish effective operation. Review should test how the measure is applied, how exceptions are handled and what remedy is available. The public-interest assessment of the assurance conclusion should consider access, learning, fair treatment and the reliability of information on which learners make consequential decisions. The decision record for disaggregated education data should state the unsupported element and the further work required.