Measuring youth skills and employability across education systems — evidence provenance, coverage, comparability, uncertainty and limits on inference.
Consideration of youth skills and employability should retain the date and status of 2012 Education for All monitoring focus. Any indicator used in relation to the measure should distinguish description from causal explanation. Any indicator used in relation to the comparison should distinguish description from causal explanation.
At the publication date, 2012 Education for All monitoring focus provides the relevant international context for the measure. For youth skills and employability, any consequential application still requires evidence from the affected jurisdiction or institution. Any indicator used in relation to the available evidence should distinguish description from causal explanation.
Application of the evidence to measuring youth skills and employability across education systems
Data used for youth skills and employability should be interpreted against stable definitions and an identifiable population.
Any indicator used in relation to the issue should distinguish description from causal explanation. For youth skills and employability, the result should be accompanied by distributional information, uncertainty and limits on transfer to another setting. Delegating operational work does not transfer accountability for its effect on learners.
Review of the comparison should follow a stated and reproducible method. Data used for the analysis should be interpreted against stable definitions and an identifiable population.
When examining youth skills and employability, responsibility should be identifiable at the point where consequential decisions are made. Data used for the issue should be interpreted against stable definitions and an identifiable population.
When examining youth skills and employability, apparent movement caused by revision should not be attributed to educational performance.
For decisions concerning youth skills and employability, further cases should be examined when the initial sample does not represent the affected scope or confirm sustained correction.
Controls relevant to measuring youth skills and employability across education systems
Evidence concerning youth skills and employability should be current, attributable and representative of the affected scope. Material gaps or contradictions should remain visible in the conclusion.
Decision-makers using evidence on the measure should be told what the data cannot establish as clearly as what it can. The conclusion should state whether the result is descriptive, comparative or evaluative, the available evidence whether it applies to a system, institution, programme or learner group.
Proportionality in relation to the available evidence does not mean reduced protection for learners exposed to greater risk. Data used for the measure should be interpreted against stable definitions and an identifiable population. Consideration of the measure should remain focused on demonstrable operation, material effects and the action required where the intended outcome is not achieved. In the context of youth skills and employability, a single indicator rarely provides an adequate account of quality. Data used for the available evidence should be interpreted against stable definitions and an identifiable population.
Decisions concerning the comparison should remain traceable to the information available for the stated reference period. For youth skills and employability, analysis should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Across the defined scope, transparent treatment of reporting changes prevents artificial movement from being read as substantive progress or decline.
Public information on the issue should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction. For youth skills and employability, changes to definitions or evidence should be recorded separately from changes in educational performance.
For youth skills and employability, no individual measure is sufficient to establish effective operation of the measure across the affected scope.