Current indicators for technical and vocational education and training

The contemporaneous reference point for technical and vocational education and training is International recommendation adopted in November 2015. Its status should be distinguished from the jurisdiction-specific evidence required for implementation. Oversight of the matter examined should reflect the principle that evidence should inform action without implying a level of precision, coverage or causal certainty that the underlying data cannot support. Analysis of the evidence under review should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. A comparison is reliable only if material differences remain visible. The conclusion remains incomplete unless central requirements are reconciled with evidence of local practice.

The instrument identified by the international recommendation adopted in November 2015 provides a formal policy reference for the reported measure. Material differences in population, setting or method should remain explicit in any comparison. Analysis of the matter examined should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning.

Scope of this analysis

Analysis of technical and vocational education and training should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Analysis of the reported measure should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Review of the comparison should include the experience of affected learners, particularly where aggregate reporting may conceal exclusion, delay or unequal treatment.

In practical terms, the reported measure should be reviewed against a stated method rather than general assurance. Any indicator used in relation to the matter examined should distinguish description from causal explanation. Material variation and uncertainty should be reported together with any restriction on wider application. A change in policy, coverage or recording practice can create an apparent movement that is not a change in the underlying educational condition.

Data used for the comparison should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result. A decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.

Evidence should be selected against a clearly defined question. Data used for the matter examined should be interpreted against stable definitions and an identifiable population. Reporting should identify a break in comparability before describing movement over time. Analysis of the analytical question should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.

• Recognise prior learning against published criteria within a defined period and review the result.
• Remove avoidable participation barriers before using it to determine a learner or provider outcome.
• Assess the stated competence before using it to determine a learner or provider outcome.
• Monitor completion and progression and retain evidence sufficient for independent review.
• State the purpose and limits of the learning offer and retain evidence sufficient for independent review.

The substantive quality question

Any indicator used in relation to technical and vocational education and training should distinguish description from causal explanation. Any indicator used in relation to the analytical question should distinguish description from causal explanation. The result should be accompanied by distributional information, uncertainty and limits on transfer to another setting.

A proportionate examination of the matter examined should test routine operation together with adverse and exceptional cases across the relevant delivery settings. Where comparability is interrupted, begin a new series or present the break clearly rather than joining unlike observations. Risk assessment for the comparison should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.

Decision-makers using evidence on the evidence under review should be told what the data cannot establish as clearly as what it can. The conclusion should state whether the result is descriptive, comparative or evaluative, the reported measure whether it applies to a system, institution, programme or learner group.

Any indicator used in relation to the evidence under review should distinguish description from causal explanation. Data used for the reported measure should be interpreted against stable definitions and an identifiable population. A decision concerning current indicators for the analytical question should identify its basis, affected scope and responsible authority, together with any limitation requiring further review. In reviewing the reported measure, missing or delayed information may be patterned rather than random. Review of the reported measure should include the experience of affected learners, particularly where aggregate reporting may conceal exclusion, delay or unequal treatment.

Reporting on the matter examined should distinguish established fact, analytical judgement and planned action. Material revisions should retain their reason and effective date. A revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. A break in method or coverage must not be presented as if it demonstrated a change in educational performance.

Where the reported measure involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Any indicator used in relation to the reported measure should distinguish description from causal explanation. Learner safeguards should remain continuous where provision is delivered by several bodies.

For the matter examined, the implementation record should distinguish binding duties, policy expectations and institutional choices, including any transition or jurisdictional limitation.