Using administrative data to examine participation in lifelong learning

In 2015, consideration of administrative data to examine participation in lifelong learning must take account of the Education 2030 policy framework and the responsibilities it places before education systems. The analysis of the evidence under review proceeds on the basis that evidence should inform action without implying a level of precision, coverage or causal certainty that the underlying data cannot support. Review should cover the complete affected scope and preserve material differences between locations, programmes, delivery modes and learner groups. Central policy alone does not establish consistent operation across the declared scope.

Failure in relation to the matter examined may arise even where the stated policy is reasonable. Material concerns include limited routes for progression, fragmented learner records, barriers created by time, cost or location, and short programmes making unsupported outcome claims. Materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.

Scope of this analysis

Implementation of administrative data to examine participation in lifelong learning should be organised around a decision that can be tested. A decision concerning the reported measure should recognise that a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. Oversight requires a traceable line from the approved objective through responsible action to evidence of outcome.

The formal status of the Education 2030 policy framework should be preserved in any public account. Adoption records an agreed instrument or policy position; it does not necessarily make every provision directly enforceable in every jurisdiction. For the comparison, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary. Domestic law and authorised guidance continue to determine specific legal duties.

The Education 2030 Framework for Action sets out implementation approaches for Sustainable Development Goal 4. It emphasises inclusion and equity, quality and learning outcomes, lifelong learning, coordinated governance, finance and monitoring. National and provider-level use should identify the particular target being addressed, the responsible authority and the evidence of effect; broad alignment statements are not sufficient for accountability.

A focused examination of the matter examined requires a clear analytical discipline. The analysis of the reported measure proceeds on the basis that a proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. A formally complete record is not reliable if its scope or measure does not correspond to the decision being made.

• Review claims against evidence, including material exceptions and unequal effects.
• Remove avoidable participation barriers, including material exceptions and unequal effects.
• Monitor completion and progression, recording who is responsible and which provision or learners are affected.
• Assess the stated competence, including material exceptions and unequal effects.
• Recognise prior learning against published criteria, identifying the accountable function and affected scope.

Implications for adult, vocational and lifelong learning

Care is required in drawing conclusions about administrative data to examine participation in lifelong learning. For the analytical question, employment outcomes are affected by economic and labour-market conditions as well as education. They should not be attributed to a programme without an appropriate design and comparison. In reviewing the comparison, association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. Material limitations should be stated with the finding presented to decision-makers and affected learners.

Relevant evidence for the matter examined will normally include admission and prior-learning decisions, secure records of achieved learning, assessment in relevant contexts, transparent fees and recognition information, and completion and progression data. Evidence should be current for the reference period, attributable and representative of the conclusion's stated scope. Contradictory evidence should be investigated and resolved, not omitted from the record.

Decisions concerning the comparison should remain traceable to the information available for the stated reference period. A revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. Without this distinction, a reporting change may be mistaken for improvement or deterioration in educational practice.

Evidence and assurance

For operational review of administrative data to examine participation in lifelong learning, authorities and providers should proceed in a defined sequence. In reviewing the analytical question, responsible bodies should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. The record should distinguish a finding that requires action from an observation that supports no formal conclusion.

Publication of findings on the comparison should distinguish observed values, estimates and interpretation. Revisions, breaks in series and changes in classification should be visible. Where disaggregation creates small or unstable groups, confidentiality and uncertainty should be managed without concealing a material disparity that requires further investigation.

• For which groups may it fail?
• What evidence supports the relationship?
• Is direct evidence available?
• Would the decision change if the proxy were inaccurate?
• What outcome does the proxy represent?

Matters requiring continuing review

The relevant outcome should be capable of direct and consistent explanation. For administrative data to examine participation in lifelong learning, flexible learning should remain transparent about entry requirements, learning outcomes, assessment, progression and the uses for which a qualification or record is intended. Formal adoption, expenditure and activity do not in themselves establish the intended result. Authorities and providers require evidence of operation and effect, with a route to identify and correct unequal or unintended consequences.

Public reporting on the matter examined should distinguish established fact, analytical judgement and planned action. Revision history should remain available where users have relied on the earlier conclusion. If definitions, coverage or evidence alter an earlier conclusion, the reason should be stated so that revision is not mistaken for changed performance.

Assurance concerning the comparison requires corroborating evidence across the material scope. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk.