ICEQC-R-2012-05 — Strengthening Programme Review through Graduate Transition Evidence cover

Informe de Investigación Temática

ICEQC-R-2012-05 — Strengthening Programme Review through Graduate Transition Evidence

A global quality-improvement study of cohorts, transition outcomes, contribution and verified programme change

Fecha de publicación
Categoría de investigación
Métodos de mejora de la calidad
Informe arquetipo
Estudio de mejora de la calidad
Ámbito geográfico
Global
Fecha límite para la presentación de pruebas
Organismo responsable
Dirección de Investigación y Políticas de ICEQC
ICEQC-R-2012-05 — Strengthening Programme Review through Graduate Transition Evidence cover

Publication record

This is the controlled English edition. Evidence and institutional status are stated as at the evidence cut-off date.

Executive summary

Graduate transition evidence can strengthen programme review when it is used to test an educational claim, identify a correctable barrier and verify the effect of an authorised change. It is weakened when one employment percentage is treated as a ranking, a marketing result or proof that the programme caused every later destination. Transition depends on learning, credential recognition, career support, labour demand, regulation, geography, household resources and graduate choice. A responsible study distinguishes the programme’s contribution from conditions it does not control while still acting where its own curriculum or support is inadequate.

Transition is a pathway, not one status. Completion may be followed by search, further learning, employment, enterprise, unpaid activity, repeated movement, inactivity or return to education. Early entry can be unstable; delayed entry can lead to a strong later route. Review should use observation dates justified by programme purpose and should examine change between them. Employment status, job quality, occupational relevance, skill use, progression and further learning are separate propositions and should not be compressed into a single success category.

The study begins with a defined cohort. Completers, partial achievers, early leavers and recipients of different awards should not be mixed without explanation. The contact frame should show coverage and permitted contact routes. Response and item missingness should be reported by known learner characteristics because graduates who move, earn irregularly or experience a weak transition can be harder to reach. Weighting does not cure unknown bias unless its assumptions are defensible.

Programme review should include equity. Women and men, disabled graduates, migrants, low-income learners and people in remote regions can encounter different opportunity, cost, recognition and accessibility. Small groups should not disappear because a public cell is unsafe or unstable; protected qualitative inquiry can inform a bounded finding. The aim is to identify an institutional barrier and response, not to collect sensitive personal information without defined value.

Interpretation requires context and causal restraint. A recession can reduce employment across programmes; rapid expansion in one occupation can raise entry without proving strong learning. Benchmarks should compare similar fields, levels, learners, regions and periods and should remain inquiry triggers rather than automatic quality judgements. A credible contribution account links programme outcomes, teaching, assessment, support and credential to the measured transition and tests competing explanations.

The improvement decision should be proportionate. Evidence of unused skills may call for curriculum revision, but it may instead reflect weak job design, recognition, information or demand. Evidence of delayed entry may call for guidance, transport, placement or employer outreach. Each action should have an owner, resource, timetable, implementation evidence, later outcome test and fallback. Approval of a change is not evidence that graduates benefited from it.

Sustainable-development attention in this report is bounded to material available before the conference, including the preparatory draft then under consideration. It does not use or imply a later conference outcome. Graduate transition evidence may consider resource, environmental and social consequences where they form part of the programme’s approved purpose, but later global commitments cannot be attributed to the cutoff period.

Key findings

  • Graduate evidence should test defined programme claims and decisions, not create a simple ranking.
  • Completion, further learning, employment entry, stability, relevance and progression are distinct outcomes.
  • A fixed cohort and transparent denominator are prerequisites for interpretation.
  • Response rate should be accompanied by coverage, missingness and nonresponse analysis.
  • Employment quality and involuntary underemployment matter alongside status.
  • Programme contribution should be distinguished from economic and regional conditions.
  • Equity analysis should identify correctable institutional barriers without unsafe disclosure.
  • Benchmarks require comparable field, level, population, geography and period.
  • Mismatch evidence needs more than comparison between job title and qualification title.
  • Public claims should state definitions, cohort, period, response and limitations.
  • Improvement actions need authority, resources, dates and learner-facing verification.
  • Later cohorts should be used to test intended and unintended effects of change.

Scope and method

This quality-improvement study applies to vocational, technical, higher and other programmes making claims about further learning, work, occupational capability or social participation. It addresses authorities, awarding bodies, providers, quality units, career services, statistical bodies, employers and graduate representatives. It does not define employment as the sole purpose of education or promise that programme revision can overcome all labour-market constraints.

The evidence base comprises UNESCO and ILO education and training guidance, European qualification and quality instruments, official employment and social reports, youth evidence and comparative vocational studies available by the cutoff. Policy sources establish aims; statistical studies establish bounded patterns under their definitions; graduate and youth perspectives inform mechanisms but do not establish prevalence by themselves.

The method defines the review claim, cohort, observation dates, measures, context, disaggregation and decision. It tests coverage, missingness, comparability, contribution and adverse distribution. Commitment, delivery, graduate use and later consequence are kept separate. The review closes only when an authorised change is implemented and its intended effect is tested.

All evidence and institutional status are stated as at 20 April 2012. No later conference outcome, publication, target or retrospective interpretation is used.

Part I

Purpose and limits of graduate transition evidence

1

Transition evidence within programme review

Graduate evidence should test whether learners progress into further learning, decent work or other intended destinations. This is the improvement proposition for transition evidence within programme review. The evidence for transition evidence within programme review therefore requires that the review should identify the programme claim, graduate population and decision for which the evidence is needed. For graduates included in transition evidence within programme review, a measure collected because it is customary is not sufficient justification. Within the authority responsible for transition evidence within programme review, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-66] [REF-70] [REF-73]

The principal evidence risk is that providers may collect destination percentages as promotional proof without examining programme design or external conditions. For transition evidence within programme review, definitions and missing cases can alter both the value and the explanation. For graduates included in transition evidence within programme review, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for transition evidence within programme review, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-66] [REF-70] [REF-73]

The design rule is to link each transition question to an approved programme outcome, learner-support duty or public claim. For graduates included in transition evidence within programme review, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for transition evidence within programme review, measures should permit mixed and changing transitions and preserve a category for unknown status. For transition evidence within programme review, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-66] [REF-70] [REF-73]

Validation of transition evidence within programme review should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Within the authority responsible for transition evidence within programme review, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. For transition evidence within programme review, contradictions should be investigated rather than averaged. In reviewing transition evidence within programme review, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-66] [REF-70] [REF-73]

The decision rule is to require a finding to identify a plausible programme contribution and a decision within institutional authority. For transition evidence within programme review, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing transition evidence within programme review, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to transition evidence within programme review, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-66] [REF-70] [REF-73]

Follow-up for transition evidence within programme review should specify the action owner, resource, completion evidence and later graduate measure. In reviewing transition evidence within programme review, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to transition evidence within programme review, public reporting should preserve the earlier baseline and explain a material revision. The evidence for transition evidence within programme review therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-66] [REF-70] [REF-73]

A further review test for transition evidence within programme review should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for transition evidence within programme review should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for transition evidence within programme review should state which institutional change is justified and which remaining condition lies beyond provider authority.

2

The transition pathway

Transition is a sequence from completion through search, entry, stability, progression and possible return to learning. This is the improvement proposition for the transition pathway. For graduates included in the transition pathway, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Within the authority responsible for the transition pathway, a measure collected because it is customary is not sufficient justification. For the transition pathway, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-78] [REF-79] [REF-80] [REF-82]

The design rule is to define stages and observe them at intervals proportionate to the programme and labour market. For graduates included in the transition pathway, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for the transition pathway, measures should permit mixed and changing transitions and preserve a category for unknown status. For the transition pathway, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-78] [REF-79] [REF-80] [REF-82]

The principal evidence risk is that one status at one date conceals delay, repeated movement, involuntary inactivity and unstable work. For the transition pathway, definitions and missing cases can alter both the value and the explanation. For the transition pathway, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing the transition pathway, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-78] [REF-79] [REF-80] [REF-82]

Validation of the transition pathway should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For the transition pathway, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing the transition pathway, contradictions should be investigated rather than averaged. Applied to the transition pathway, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-78] [REF-79] [REF-80] [REF-82]

Follow-up for the transition pathway should specify the action owner, resource, completion evidence and later graduate measure. In reviewing the transition pathway, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to the transition pathway, public reporting should preserve the earlier baseline and explain a material revision. The evidence for the transition pathway therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-78] [REF-79] [REF-80] [REF-82]

A further review test for the transition pathway should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for the transition pathway should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for the transition pathway should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to locate where graduates diverge and select a programme response relevant to that stage. Applied to the transition pathway, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for the transition pathway therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in the transition pathway, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-78] [REF-79] [REF-80] [REF-82]

3

Programme contribution and external context

Programme quality can influence transition while demand, recession, regulation, geography and household conditions also matter. This is the improvement proposition for programme contribution and external context. Within the authority responsible for programme contribution and external context, the review should identify the programme claim, graduate population and decision for which the evidence is needed. For programme contribution and external context, a measure collected because it is customary is not sufficient justification. In reviewing programme contribution and external context, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-72] [REF-77] [REF-78] [REF-84]

The principal evidence risk is that an employment change may be attributed wholly to curriculum or excused wholly by the economy. For programme contribution and external context, definitions and missing cases can alter both the value and the explanation. For programme contribution and external context, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing programme contribution and external context, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-72] [REF-77] [REF-78] [REF-84]

Validation of programme contribution and external context should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For programme contribution and external context, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing programme contribution and external context, contradictions should be investigated rather than averaged. Applied to programme contribution and external context, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-72] [REF-77] [REF-78] [REF-84]

The design rule is to state an expected contribution pathway and examine timing, comparison, graduate evidence and competing explanations. In reviewing programme contribution and external context, data collection should use the minimum information required for the decision and accessible contact routes. Applied to programme contribution and external context, measures should permit mixed and changing transitions and preserve a category for unknown status. The evidence for programme contribution and external context therefore requires that sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-72] [REF-77] [REF-78] [REF-84]

The decision rule is to use cautious contribution language and act where programme evidence is sufficient even if full causation is not established. Applied to programme contribution and external context, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for programme contribution and external context therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in programme contribution and external context, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-72] [REF-77] [REF-78] [REF-84]

Follow-up for programme contribution and external context should specify the action owner, resource, completion evidence and later graduate measure. The evidence for programme contribution and external context therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in programme contribution and external context, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for programme contribution and external context, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-72] [REF-77] [REF-78] [REF-84]

A further review test for programme contribution and external context should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for programme contribution and external context should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for programme contribution and external context should state which institutional change is justified and which remaining condition lies beyond provider authority.

4

Claims, expectations and public meaning

Transition evidence should be matched to what the programme actually promises and what the award signifies. This is the improvement proposition for claims, expectations and public meaning. For claims, expectations and public meaning, the review should identify the programme claim, graduate population and decision for which the evidence is needed. In reviewing claims, expectations and public meaning, a measure collected because it is customary is not sufficient justification. Applied to claims, expectations and public meaning, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-64] [REF-65] [REF-81]

Validation of claims, expectations and public meaning should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For claims, expectations and public meaning, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing claims, expectations and public meaning, contradictions should be investigated rather than averaged. Applied to claims, expectations and public meaning, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-64] [REF-65] [REF-81]

The principal evidence risk is that broad employability language can imply guaranteed employment or occupational authority beyond institutional control. For claims, expectations and public meaning, definitions and missing cases can alter both the value and the explanation. Applied to claims, expectations and public meaning, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for claims, expectations and public meaning therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-64] [REF-65] [REF-81]

The design rule is to define the intended capabilities, progression routes and limitations in accessible learner information. Applied to claims, expectations and public meaning, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for claims, expectations and public meaning therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in claims, expectations and public meaning, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-64] [REF-65] [REF-81]

Follow-up for claims, expectations and public meaning should specify the action owner, resource, completion evidence and later graduate measure. The evidence for claims, expectations and public meaning therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in claims, expectations and public meaning, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for claims, expectations and public meaning, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-64] [REF-65] [REF-81]

A further review test for claims, expectations and public meaning should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for claims, expectations and public meaning should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for claims, expectations and public meaning should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to correct public claims when measured evidence, recognition or regulatory status does not support them. For graduates included in claims, expectations and public meaning, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for claims, expectations and public meaning, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For claims, expectations and public meaning, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-64] [REF-65] [REF-81]

5

Time horizons

Different outcomes become visible at different times and early status can be temporary. This is the improvement proposition for time horizons. In reviewing time horizons, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Applied to time horizons, a measure collected because it is customary is not sufficient justification. The evidence for time horizons therefore requires that the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-79] [REF-80] [REF-82] [REF-84]

The principal evidence risk is that a short follow-up rewards rapid entry while missing later stability, progression, further study or delayed recognition. For time horizons, definitions and missing cases can alter both the value and the explanation. Applied to time horizons, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for time horizons therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-79] [REF-80] [REF-82] [REF-84]

The design rule is to use an early contact and one or more later observations justified by programme purpose and graduate population. Applied to time horizons, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for time horizons therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in time horizons, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-79] [REF-80] [REF-82] [REF-84]

Validation of time horizons should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. The evidence for time horizons therefore requires that reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. For graduates included in time horizons, contradictions should be investigated rather than averaged. Within the authority responsible for time horizons, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-79] [REF-80] [REF-82] [REF-84]

The decision rule is to interpret change between observations and retain the cohort rather than replacing nonrespondents silently. For graduates included in time horizons, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for time horizons, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For time horizons, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-79] [REF-80] [REF-82] [REF-84]

Follow-up for time horizons should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for time horizons, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For time horizons, public reporting should preserve the earlier baseline and explain a material revision. In reviewing time horizons, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-79] [REF-80] [REF-82] [REF-84]

A further review test for time horizons should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for time horizons should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for time horizons should state which institutional change is justified and which remaining condition lies beyond provider authority.

6

Ethical boundary and proportionality

Graduate follow-up should serve defined improvement and public-accountability purposes without creating indefinite surveillance. This is the improvement proposition for ethical boundary and proportionality. Applied to ethical boundary and proportionality, the review should identify the programme claim, graduate population and decision for which the evidence is needed. The evidence for ethical boundary and proportionality therefore requires that a measure collected because it is customary is not sufficient justification. For graduates included in ethical boundary and proportionality, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-12] [REF-66] [REF-86]

The design rule is to specify lawful purpose, minimum fields, access, retention, consent or other authority and withdrawal consequences. Applied to ethical boundary and proportionality, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for ethical boundary and proportionality therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in ethical boundary and proportionality, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-12] [REF-66] [REF-86]

The principal evidence risk is that institutions can collect sensitive income, health, migration or employer information because it may be useful someday. For ethical boundary and proportionality, definitions and missing cases can alter both the value and the explanation. For graduates included in ethical boundary and proportionality, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for ethical boundary and proportionality, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-12] [REF-66] [REF-86]

Validation of ethical boundary and proportionality should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in ethical boundary and proportionality, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for ethical boundary and proportionality, contradictions should be investigated rather than averaged. For ethical boundary and proportionality, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-12] [REF-66] [REF-86]

Follow-up for ethical boundary and proportionality should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for ethical boundary and proportionality, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For ethical boundary and proportionality, public reporting should preserve the earlier baseline and explain a material revision. In reviewing ethical boundary and proportionality, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-12] [REF-66] [REF-86]

A further review test for ethical boundary and proportionality should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for ethical boundary and proportionality should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for ethical boundary and proportionality should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to exclude data whose likely improvement value does not justify burden or risk and report limitations honestly. For ethical boundary and proportionality, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing ethical boundary and proportionality, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to ethical boundary and proportionality, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-12] [REF-66] [REF-86]

Part II

Transition outcome domains

7

Further learning and vertical progression

Entry into further recognised learning can be an intended and valuable transition. This is the improvement proposition for further learning and vertical progression. The evidence for further learning and vertical progression therefore requires that the review should identify the programme claim, graduate population and decision for which the evidence is needed. For graduates included in further learning and vertical progression, a measure collected because it is customary is not sufficient justification. Within the authority responsible for further learning and vertical progression, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-63] [REF-64] [REF-65] [REF-67]

The principal evidence risk is that employment-only reporting treats continued study as non-employment or ignores blocked progression routes. For further learning and vertical progression, definitions and missing cases can alter both the value and the explanation. For graduates included in further learning and vertical progression, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for further learning and vertical progression, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-63] [REF-64] [REF-65] [REF-67]

Validation of further learning and vertical progression should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in further learning and vertical progression, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for further learning and vertical progression, contradictions should be investigated rather than averaged. For further learning and vertical progression, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-63] [REF-64] [REF-65] [REF-67]

The design rule is to record application, admission, credit recognition, attendance and continuation in relevant further learning. Within the authority responsible for further learning and vertical progression, data collection should use the minimum information required for the decision and accessible contact routes. For further learning and vertical progression, measures should permit mixed and changing transitions and preserve a category for unknown status. In reviewing further learning and vertical progression, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-63] [REF-64] [REF-65] [REF-67]

The decision rule is to review curriculum prerequisites and recognition barriers where eligible graduates cannot progress. For further learning and vertical progression, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing further learning and vertical progression, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to further learning and vertical progression, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-63] [REF-64] [REF-65] [REF-67]

Follow-up for further learning and vertical progression should specify the action owner, resource, completion evidence and later graduate measure. In reviewing further learning and vertical progression, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to further learning and vertical progression, public reporting should preserve the earlier baseline and explain a material revision. The evidence for further learning and vertical progression therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-63] [REF-64] [REF-65] [REF-67]

A further review test for further learning and vertical progression should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for further learning and vertical progression should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for further learning and vertical progression should state which institutional change is justified and which remaining condition lies beyond provider authority.

8

Entry into employment

Employment entry should be measured with status, timing and search information rather than a single employed percentage. This is the improvement proposition for entry into employment. For graduates included in entry into employment, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Within the authority responsible for entry into employment, a measure collected because it is customary is not sufficient justification. For entry into employment, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-78] [REF-79] [REF-82] [REF-84]

Validation of entry into employment should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in entry into employment, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for entry into employment, contradictions should be investigated rather than averaged. For entry into employment, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-78] [REF-79] [REF-82] [REF-84]

The principal evidence risk is that short or marginal work can be counted equally with sustained work and graduates not seeking work can distort the denominator. For entry into employment, definitions and missing cases can alter both the value and the explanation. For entry into employment, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing entry into employment, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-78] [REF-79] [REF-82] [REF-84]

The design rule is to state the employment definition, reference week, hours, duration, search status and denominator. For entry into employment, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing entry into employment, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to entry into employment, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-78] [REF-79] [REF-82] [REF-84]

Follow-up for entry into employment should specify the action owner, resource, completion evidence and later graduate measure. In reviewing entry into employment, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to entry into employment, public reporting should preserve the earlier baseline and explain a material revision. The evidence for entry into employment therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-78] [REF-79] [REF-82] [REF-84]

A further review test for entry into employment should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for entry into employment should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for entry into employment should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to separate entry speed from job quality and avoid interpreting employment as proof of programme relevance. Applied to entry into employment, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for entry into employment therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in entry into employment, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-78] [REF-79] [REF-82] [REF-84]

9

Employment quality and decent work

Transition review should consider stability, rights, safety, hours and involuntary underemployment where material. This is the improvement proposition for employment quality and decent work. Within the authority responsible for employment quality and decent work, the review should identify the programme claim, graduate population and decision for which the evidence is needed. For employment quality and decent work, a measure collected because it is customary is not sufficient justification. In reviewing employment quality and decent work, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-62] [REF-63] [REF-78] [REF-80]

The principal evidence risk is that any work can be presented as success even where conditions contradict programme or public-interest aims. For employment quality and decent work, definitions and missing cases can alter both the value and the explanation. For employment quality and decent work, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing employment quality and decent work, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-62] [REF-63] [REF-78] [REF-80]

The design rule is to use a compact set of quality measures and protect graduates from employer or immigration consequences. For employment quality and decent work, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing employment quality and decent work, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to employment quality and decent work, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-62] [REF-63] [REF-78] [REF-80]

Validation of employment quality and decent work should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. In reviewing employment quality and decent work, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Applied to employment quality and decent work, contradictions should be investigated rather than averaged. The evidence for employment quality and decent work therefore requires that qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-62] [REF-63] [REF-78] [REF-80]

The decision rule is to identify programme actions on safety, rights knowledge and work readiness while referring systemic issues appropriately. Applied to employment quality and decent work, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for employment quality and decent work therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in employment quality and decent work, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-62] [REF-63] [REF-78] [REF-80]

Follow-up for employment quality and decent work should specify the action owner, resource, completion evidence and later graduate measure. The evidence for employment quality and decent work therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in employment quality and decent work, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for employment quality and decent work, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-62] [REF-63] [REF-78] [REF-80]

A further review test for employment quality and decent work should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for employment quality and decent work should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for employment quality and decent work should state which institutional change is justified and which remaining condition lies beyond provider authority.

10

Occupational and skills relevance

Relevance concerns the use and further development of programme learning in the graduate’s activity. This is the improvement proposition for occupational and skills relevance. For occupational and skills relevance, the review should identify the programme claim, graduate population and decision for which the evidence is needed. In reviewing occupational and skills relevance, a measure collected because it is customary is not sufficient justification. Applied to occupational and skills relevance, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-70] [REF-72] [REF-77] [REF-84]

The design rule is to combine occupational classification, task description, skill use, qualification requirement and graduate judgement. For occupational and skills relevance, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing occupational and skills relevance, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to occupational and skills relevance, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-70] [REF-72] [REF-77] [REF-84]

The principal evidence risk is that job-title matching is crude and self-reported skill use can be affected by expectations and opportunity. For occupational and skills relevance, definitions and missing cases can alter both the value and the explanation. Applied to occupational and skills relevance, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for occupational and skills relevance therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-70] [REF-72] [REF-77] [REF-84]

Validation of occupational and skills relevance should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to occupational and skills relevance, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for occupational and skills relevance therefore requires that contradictions should be investigated rather than averaged. For graduates included in occupational and skills relevance, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-70] [REF-72] [REF-77] [REF-84]

Follow-up for occupational and skills relevance should specify the action owner, resource, completion evidence and later graduate measure. The evidence for occupational and skills relevance therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in occupational and skills relevance, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for occupational and skills relevance, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-70] [REF-72] [REF-77] [REF-84]

A further review test for occupational and skills relevance should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for occupational and skills relevance should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for occupational and skills relevance should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to revise programme content only after checking whether mismatch arises from curriculum, labour demand, recognition or search barriers. For graduates included in occupational and skills relevance, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for occupational and skills relevance, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For occupational and skills relevance, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-70] [REF-72] [REF-77] [REF-84]

11

Earnings, hours and economic independence

Earnings and hours can illuminate transition quality and gender or social inequality. This is the improvement proposition for earnings, hours and economic independence. In reviewing earnings, hours and economic independence, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Applied to earnings, hours and economic independence, a measure collected because it is customary is not sufficient justification. The evidence for earnings, hours and economic independence therefore requires that the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-78] [REF-79] [REF-82] [REF-85]

The principal evidence risk is that income questions have high nonresponse and differ by taxes, benefits, currency, household sharing and irregular work. For earnings, hours and economic independence, definitions and missing cases can alter both the value and the explanation. Applied to earnings, hours and economic independence, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for earnings, hours and economic independence therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-78] [REF-79] [REF-82] [REF-85]

Validation of earnings, hours and economic independence should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to earnings, hours and economic independence, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for earnings, hours and economic independence therefore requires that contradictions should be investigated rather than averaged. For graduates included in earnings, hours and economic independence, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-78] [REF-79] [REF-82] [REF-85]

The design rule is to collect bands or comparable measures where justified and state treatment of missing and mixed income. The evidence for earnings, hours and economic independence therefore requires that data collection should use the minimum information required for the decision and accessible contact routes. For graduates included in earnings, hours and economic independence, measures should permit mixed and changing transitions and preserve a category for unknown status. Within the authority responsible for earnings, hours and economic independence, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-78] [REF-79] [REF-82] [REF-85]

The decision rule is to use distributions and context rather than a single average and never equate higher earnings automatically with better learning. For graduates included in earnings, hours and economic independence, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for earnings, hours and economic independence, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For earnings, hours and economic independence, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-78] [REF-79] [REF-82] [REF-85]

Follow-up for earnings, hours and economic independence should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for earnings, hours and economic independence, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For earnings, hours and economic independence, public reporting should preserve the earlier baseline and explain a material revision. In reviewing earnings, hours and economic independence, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-78] [REF-79] [REF-82] [REF-85]

A further review test for earnings, hours and economic independence should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for earnings, hours and economic independence should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for earnings, hours and economic independence should state which institutional change is justified and which remaining condition lies beyond provider authority.

12

Enterprise, unpaid activity and social benefit

Graduates may create enterprises, contribute unpaid family work, volunteer or apply learning in community roles. This is the improvement proposition for enterprise, unpaid activity and social benefit. Applied to enterprise, unpaid activity and social benefit, the review should identify the programme claim, graduate population and decision for which the evidence is needed. The evidence for enterprise, unpaid activity and social benefit therefore requires that a measure collected because it is customary is not sufficient justification. For graduates included in enterprise, unpaid activity and social benefit, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-63] [REF-80] [REF-83] [REF-86]

Validation of enterprise, unpaid activity and social benefit should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to enterprise, unpaid activity and social benefit, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for enterprise, unpaid activity and social benefit therefore requires that contradictions should be investigated rather than averaged. For graduates included in enterprise, unpaid activity and social benefit, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-63] [REF-80] [REF-83] [REF-86]

The principal evidence risk is that narrow employee categories classify diverse activity as inactivity and can devalue socially useful outcomes. For enterprise, unpaid activity and social benefit, definitions and missing cases can alter both the value and the explanation. For graduates included in enterprise, unpaid activity and social benefit, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for enterprise, unpaid activity and social benefit, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-63] [REF-80] [REF-83] [REF-86]

The design rule is to record activity, voluntariness, skill use, sustainability, support need and movement between statuses. For graduates included in enterprise, unpaid activity and social benefit, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for enterprise, unpaid activity and social benefit, measures should permit mixed and changing transitions and preserve a category for unknown status. For enterprise, unpaid activity and social benefit, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-63] [REF-80] [REF-83] [REF-86]

Follow-up for enterprise, unpaid activity and social benefit should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for enterprise, unpaid activity and social benefit, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For enterprise, unpaid activity and social benefit, public reporting should preserve the earlier baseline and explain a material revision. In reviewing enterprise, unpaid activity and social benefit, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-63] [REF-80] [REF-83] [REF-86]

A further review test for enterprise, unpaid activity and social benefit should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for enterprise, unpaid activity and social benefit should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for enterprise, unpaid activity and social benefit should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to distinguish intended enterprise or social contribution from lack of decent alternatives and connect findings to suitable support. For enterprise, unpaid activity and social benefit, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing enterprise, unpaid activity and social benefit, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to enterprise, unpaid activity and social benefit, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-63] [REF-80] [REF-83] [REF-86]

Part III

Follow-up design and evidence quality

13

Cohort definition and completion status

The cohort should be fixed by programme, award, completion rule, site and reference period. This is the improvement proposition for cohort definition and completion status. The evidence for cohort definition and completion status therefore requires that the review should identify the programme claim, graduate population and decision for which the evidence is needed. For graduates included in cohort definition and completion status, a measure collected because it is customary is not sufficient justification. Within the authority responsible for cohort definition and completion status, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-65] [REF-66] [REF-70] [REF-84]

The principal evidence risk is that mixing completers, leavers, partial achievers and different awards creates an uninterpretable transition rate. For cohort definition and completion status, definitions and missing cases can alter both the value and the explanation. For graduates included in cohort definition and completion status, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for cohort definition and completion status, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-65] [REF-66] [REF-70] [REF-84]

The design rule is to define inclusion before contact and retain separate categories where review questions differ. For graduates included in cohort definition and completion status, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for cohort definition and completion status, measures should permit mixed and changing transitions and preserve a category for unknown status. For cohort definition and completion status, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-65] [REF-66] [REF-70] [REF-84]

Validation of cohort definition and completion status should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Within the authority responsible for cohort definition and completion status, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. For cohort definition and completion status, contradictions should be investigated rather than averaged. In reviewing cohort definition and completion status, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-65] [REF-66] [REF-70] [REF-84]

The decision rule is to reconcile the cohort with certification records and explain exclusions, duplicates and later corrections. For cohort definition and completion status, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing cohort definition and completion status, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to cohort definition and completion status, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-65] [REF-66] [REF-70] [REF-84]

Follow-up for cohort definition and completion status should specify the action owner, resource, completion evidence and later graduate measure. In reviewing cohort definition and completion status, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to cohort definition and completion status, public reporting should preserve the earlier baseline and explain a material revision. The evidence for cohort definition and completion status therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-65] [REF-66] [REF-70] [REF-84]

A further review test for cohort definition and completion status should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for cohort definition and completion status should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for cohort definition and completion status should state which institutional change is justified and which remaining condition lies beyond provider authority.

14

Contact frame and lawful follow-up

Contact routes should be current, proportionate and collected under clear authority. This is the improvement proposition for contact frame and lawful follow-up. For graduates included in contact frame and lawful follow-up, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Within the authority responsible for contact frame and lawful follow-up, a measure collected because it is customary is not sufficient justification. For contact frame and lawful follow-up, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-12] [REF-66] [REF-86]

The design rule is to maintain multiple permitted contact routes, update preferences and separate research contact from compulsory service records. For graduates included in contact frame and lawful follow-up, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for contact frame and lawful follow-up, measures should permit mixed and changing transitions and preserve a category for unknown status. For contact frame and lawful follow-up, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-12] [REF-66] [REF-86]

The principal evidence risk is that graduates with stable digital or employer contact are easier to reach and can bias results toward stronger transitions. For contact frame and lawful follow-up, definitions and missing cases can alter both the value and the explanation. For contact frame and lawful follow-up, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing contact frame and lawful follow-up, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-12] [REF-66] [REF-86]

Validation of contact frame and lawful follow-up should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For contact frame and lawful follow-up, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing contact frame and lawful follow-up, contradictions should be investigated rather than averaged. Applied to contact frame and lawful follow-up, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-12] [REF-66] [REF-86]

Follow-up for contact frame and lawful follow-up should specify the action owner, resource, completion evidence and later graduate measure. In reviewing contact frame and lawful follow-up, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to contact frame and lawful follow-up, public reporting should preserve the earlier baseline and explain a material revision. The evidence for contact frame and lawful follow-up therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-12] [REF-66] [REF-86]

A further review test for contact frame and lawful follow-up should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for contact frame and lawful follow-up should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for contact frame and lawful follow-up should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to measure frame coverage and response by known learner characteristics before interpreting outcomes. Applied to contact frame and lawful follow-up, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for contact frame and lawful follow-up therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in contact frame and lawful follow-up, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-12] [REF-66] [REF-86]

15

Question design and status classification

Questions should allow graduates to describe mixed and changing transitions without being forced into one unsuitable box. This is the improvement proposition for question design and status classification. Within the authority responsible for question design and status classification, the review should identify the programme claim, graduate population and decision for which the evidence is needed. For question design and status classification, a measure collected because it is customary is not sufficient justification. In reviewing question design and status classification, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-70] [REF-78] [REF-80] [REF-82]

The principal evidence risk is that overlapping terms such as employed, training and self-employed produce inconsistent classification. For question design and status classification, definitions and missing cases can alter both the value and the explanation. For question design and status classification, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing question design and status classification, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-70] [REF-78] [REF-80] [REF-82]

Validation of question design and status classification should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For question design and status classification, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing question design and status classification, contradictions should be investigated rather than averaged. Applied to question design and status classification, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-70] [REF-78] [REF-80] [REF-82]

The design rule is to use controlled definitions, reference dates, branching and a hierarchy for multiple concurrent activities. In reviewing question design and status classification, data collection should use the minimum information required for the decision and accessible contact routes. Applied to question design and status classification, measures should permit mixed and changing transitions and preserve a category for unknown status. The evidence for question design and status classification therefore requires that sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-70] [REF-78] [REF-80] [REF-82]

The decision rule is to pilot comprehension and classify from recorded answers under a published rule rather than interviewer assumption. Applied to question design and status classification, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for question design and status classification therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in question design and status classification, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-70] [REF-78] [REF-80] [REF-82]

Follow-up for question design and status classification should specify the action owner, resource, completion evidence and later graduate measure. The evidence for question design and status classification therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in question design and status classification, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for question design and status classification, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-70] [REF-78] [REF-80] [REF-82]

A further review test for question design and status classification should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for question design and status classification should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for question design and status classification should state which institutional change is justified and which remaining condition lies beyond provider authority.

16

Administrative linkage

Linked education, benefit, tax or employment records can improve coverage where lawful and conceptually suitable. This is the improvement proposition for administrative linkage. For administrative linkage, the review should identify the programme claim, graduate population and decision for which the evidence is needed. In reviewing administrative linkage, a measure collected because it is customary is not sufficient justification. Applied to administrative linkage, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-66] [REF-82] [REF-84]

Validation of administrative linkage should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For administrative linkage, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing administrative linkage, contradictions should be investigated rather than averaged. Applied to administrative linkage, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-66] [REF-82] [REF-84]

The principal evidence risk is that administrative presence is collected for another purpose and may omit informal work, skill use, job quality or activity abroad. For administrative linkage, definitions and missing cases can alter both the value and the explanation. Applied to administrative linkage, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for administrative linkage therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-66] [REF-82] [REF-84]

The design rule is to define authority, linkage quality, coverage, variable meaning and separation of identifiable and analytical files. Applied to administrative linkage, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for administrative linkage therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in administrative linkage, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-66] [REF-82] [REF-84]

Follow-up for administrative linkage should specify the action owner, resource, completion evidence and later graduate measure. The evidence for administrative linkage therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in administrative linkage, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for administrative linkage, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-66] [REF-82] [REF-84]

A further review test for administrative linkage should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for administrative linkage should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for administrative linkage should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to use administrative evidence for the proposition it supports and supplement gaps rather than presenting it as a complete transition. For graduates included in administrative linkage, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for administrative linkage, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For administrative linkage, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-66] [REF-82] [REF-84]

17

Qualitative graduate and employer evidence

Interviews and group inquiry can explain barriers, curriculum use and decision routes behind the indicators. This is the improvement proposition for qualitative graduate and employer evidence. In reviewing qualitative graduate and employer evidence, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Applied to qualitative graduate and employer evidence, a measure collected because it is customary is not sufficient justification. The evidence for qualitative graduate and employer evidence therefore requires that the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-70] [REF-71] [REF-80] [REF-84]

The principal evidence risk is that convenience stories can be selected because they confirm the institution’s preferred explanation. For qualitative graduate and employer evidence, definitions and missing cases can alter both the value and the explanation. Applied to qualitative graduate and employer evidence, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for qualitative graduate and employer evidence therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-70] [REF-71] [REF-80] [REF-84]

The design rule is to sample contrasting transitions, use a documented guide, preserve dissent and corroborate material factual claims. Applied to qualitative graduate and employer evidence, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for qualitative graduate and employer evidence therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in qualitative graduate and employer evidence, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-70] [REF-71] [REF-80] [REF-84]

Validation of qualitative graduate and employer evidence should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. The evidence for qualitative graduate and employer evidence therefore requires that reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. For graduates included in qualitative graduate and employer evidence, contradictions should be investigated rather than averaged. Within the authority responsible for qualitative graduate and employer evidence, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-70] [REF-71] [REF-80] [REF-84]

The decision rule is to use qualitative evidence to refine mechanisms and actions without turning individual testimony into prevalence. For graduates included in qualitative graduate and employer evidence, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for qualitative graduate and employer evidence, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For qualitative graduate and employer evidence, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-70] [REF-71] [REF-80] [REF-84]

Follow-up for qualitative graduate and employer evidence should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for qualitative graduate and employer evidence, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For qualitative graduate and employer evidence, public reporting should preserve the earlier baseline and explain a material revision. In reviewing qualitative graduate and employer evidence, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-70] [REF-71] [REF-80] [REF-84]

A further review test for qualitative graduate and employer evidence should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for qualitative graduate and employer evidence should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for qualitative graduate and employer evidence should state which institutional change is justified and which remaining condition lies beyond provider authority.

18

Nonresponse and attrition

Missing graduates can differ systematically in employment, migration, income or satisfaction. This is the improvement proposition for nonresponse and attrition. Applied to nonresponse and attrition, the review should identify the programme claim, graduate population and decision for which the evidence is needed. The evidence for nonresponse and attrition therefore requires that a measure collected because it is customary is not sufficient justification. For graduates included in nonresponse and attrition, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-66] [REF-82] [REF-84]

The design rule is to report frame, contact, response and item missingness by known characteristics and follow a bounded nonresponse sample. Applied to nonresponse and attrition, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for nonresponse and attrition therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in nonresponse and attrition, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-66] [REF-82] [REF-84]

The principal evidence risk is that a high headline response can still omit a small group central to the programme’s equity obligations. For nonresponse and attrition, definitions and missing cases can alter both the value and the explanation. For graduates included in nonresponse and attrition, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for nonresponse and attrition, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-66] [REF-82] [REF-84]

Validation of nonresponse and attrition should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in nonresponse and attrition, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for nonresponse and attrition, contradictions should be investigated rather than averaged. For nonresponse and attrition, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-66] [REF-82] [REF-84]

Follow-up for nonresponse and attrition should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for nonresponse and attrition, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For nonresponse and attrition, public reporting should preserve the earlier baseline and explain a material revision. In reviewing nonresponse and attrition, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-66] [REF-82] [REF-84]

A further review test for nonresponse and attrition should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for nonresponse and attrition should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for nonresponse and attrition should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to apply weighting or sensitivity analysis only under stated assumptions and limit conclusions where bias remains plausible. For nonresponse and attrition, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing nonresponse and attrition, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to nonresponse and attrition, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-66] [REF-82] [REF-84]

Part IV

Equity, context and distribution

19

Sex and gendered transition patterns

Female and male graduates may face different care, safety, occupation and hiring conditions. This is the improvement proposition for sex and gendered transition patterns. The evidence for sex and gendered transition patterns therefore requires that the review should identify the programme claim, graduate population and decision for which the evidence is needed. For graduates included in sex and gendered transition patterns, a measure collected because it is customary is not sufficient justification. Within the authority responsible for sex and gendered transition patterns, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-79] [REF-80] [REF-85]

The principal evidence risk is that a parity total conceals differences in field, hours, pay, stability, progression and involuntary inactivity. For sex and gendered transition patterns, definitions and missing cases can alter both the value and the explanation. For graduates included in sex and gendered transition patterns, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for sex and gendered transition patterns, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-79] [REF-80] [REF-85]

Validation of sex and gendered transition patterns should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in sex and gendered transition patterns, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for sex and gendered transition patterns, contradictions should be investigated rather than averaged. For sex and gendered transition patterns, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-79] [REF-80] [REF-85]

The design rule is to disaggregate core outcomes and examine locally plausible gender mechanisms and programme conditions. Within the authority responsible for sex and gendered transition patterns, data collection should use the minimum information required for the decision and accessible contact routes. For sex and gendered transition patterns, measures should permit mixed and changing transitions and preserve a category for unknown status. In reviewing sex and gendered transition patterns, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-79] [REF-80] [REF-85]

The decision rule is to select curriculum or support action only where evidence links the gap to an institutional contribution. For sex and gendered transition patterns, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing sex and gendered transition patterns, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to sex and gendered transition patterns, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-79] [REF-80] [REF-85]

Follow-up for sex and gendered transition patterns should specify the action owner, resource, completion evidence and later graduate measure. In reviewing sex and gendered transition patterns, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to sex and gendered transition patterns, public reporting should preserve the earlier baseline and explain a material revision. The evidence for sex and gendered transition patterns therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-79] [REF-80] [REF-85]

A further review test for sex and gendered transition patterns should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for sex and gendered transition patterns should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for sex and gendered transition patterns should state which institutional change is justified and which remaining condition lies beyond provider authority.

20

Disability and reasonable accommodation

Disabled graduates may encounter inaccessible workplaces, transport, recruitment and recognition after successful study. This is the improvement proposition for disability and reasonable accommodation. For graduates included in disability and reasonable accommodation, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Within the authority responsible for disability and reasonable accommodation, a measure collected because it is customary is not sufficient justification. For disability and reasonable accommodation, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-10] [REF-12] [REF-66] [REF-83]

Validation of disability and reasonable accommodation should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in disability and reasonable accommodation, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for disability and reasonable accommodation, contradictions should be investigated rather than averaged. For disability and reasonable accommodation, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-10] [REF-12] [REF-66] [REF-83]

The principal evidence risk is that programme completion can be treated as the end of inclusion responsibility even where transition support is unusable. For disability and reasonable accommodation, definitions and missing cases can alter both the value and the explanation. For disability and reasonable accommodation, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing disability and reasonable accommodation, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-10] [REF-12] [REF-66] [REF-83]

The design rule is to collect only necessary accessibility and barrier evidence and provide accessible follow-up and career support. For disability and reasonable accommodation, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing disability and reasonable accommodation, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to disability and reasonable accommodation, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-10] [REF-12] [REF-66] [REF-83]

Follow-up for disability and reasonable accommodation should specify the action owner, resource, completion evidence and later graduate measure. In reviewing disability and reasonable accommodation, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to disability and reasonable accommodation, public reporting should preserve the earlier baseline and explain a material revision. The evidence for disability and reasonable accommodation therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-10] [REF-12] [REF-66] [REF-83]

A further review test for disability and reasonable accommodation should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for disability and reasonable accommodation should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for disability and reasonable accommodation should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to review placement, employer liaison and progression arrangements while preserving the graduate’s substantive choices. Applied to disability and reasonable accommodation, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for disability and reasonable accommodation therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in disability and reasonable accommodation, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-10] [REF-12] [REF-66] [REF-83]

21

Socioeconomic background

Graduates with fewer resources may have less capacity for unpaid search, relocation, further study or delayed entry. This is the improvement proposition for socioeconomic background. Within the authority responsible for socioeconomic background, the review should identify the programme claim, graduate population and decision for which the evidence is needed. For socioeconomic background, a measure collected because it is customary is not sufficient justification. In reviewing socioeconomic background, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-80] [REF-82] [REF-85]

The principal evidence risk is that transition differences can be attributed to motivation without evidence on cost and opportunity. For socioeconomic background, definitions and missing cases can alter both the value and the explanation. For socioeconomic background, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing socioeconomic background, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-80] [REF-82] [REF-85]

The design rule is to use lawful background measures and examine finance, transport, information, networks and unpaid placement requirements. For socioeconomic background, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing socioeconomic background, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to socioeconomic background, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-80] [REF-82] [REF-85]

Validation of socioeconomic background should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. In reviewing socioeconomic background, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Applied to socioeconomic background, contradictions should be investigated rather than averaged. The evidence for socioeconomic background therefore requires that qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-80] [REF-82] [REF-85]

The decision rule is to change institutional costs or support where they create avoidable transition inequality. Applied to socioeconomic background, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for socioeconomic background therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in socioeconomic background, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-80] [REF-82] [REF-85]

Follow-up for socioeconomic background should specify the action owner, resource, completion evidence and later graduate measure. The evidence for socioeconomic background therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in socioeconomic background, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for socioeconomic background, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-80] [REF-82] [REF-85]

A further review test for socioeconomic background should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for socioeconomic background should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for socioeconomic background should state which institutional change is justified and which remaining condition lies beyond provider authority.

22

Migration and cross-border recognition

Graduates may move for work or study and their qualification may be interpreted differently elsewhere. This is the improvement proposition for migration and cross-border recognition. For migration and cross-border recognition, the review should identify the programme claim, graduate population and decision for which the evidence is needed. In reviewing migration and cross-border recognition, a measure collected because it is customary is not sufficient justification. Applied to migration and cross-border recognition, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-64] [REF-65] [REF-69] [REF-81]

The design rule is to include permitted destination and recognition questions and maintain cross-border contact choices. For migration and cross-border recognition, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing migration and cross-border recognition, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to migration and cross-border recognition, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-64] [REF-65] [REF-69] [REF-81]

The principal evidence risk is that local follow-up loses movers and can misclassify missing graduates as unemployed while recognition barriers remain invisible. For migration and cross-border recognition, definitions and missing cases can alter both the value and the explanation. Applied to migration and cross-border recognition, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for migration and cross-border recognition therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-64] [REF-65] [REF-69] [REF-81]

Validation of migration and cross-border recognition should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to migration and cross-border recognition, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for migration and cross-border recognition therefore requires that contradictions should be investigated rather than averaged. For graduates included in migration and cross-border recognition, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-64] [REF-65] [REF-69] [REF-81]

Follow-up for migration and cross-border recognition should specify the action owner, resource, completion evidence and later graduate measure. The evidence for migration and cross-border recognition therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in migration and cross-border recognition, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for migration and cross-border recognition, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-64] [REF-65] [REF-69] [REF-81]

A further review test for migration and cross-border recognition should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for migration and cross-border recognition should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for migration and cross-border recognition should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to separate education comparability, occupational regulation, language and immigration conditions in the finding. For graduates included in migration and cross-border recognition, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for migration and cross-border recognition, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For migration and cross-border recognition, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-64] [REF-65] [REF-69] [REF-81]

23

Geography and local opportunity

Regional labour demand, transport and provider networks affect transition independently of programme quality. This is the improvement proposition for geography and local opportunity. In reviewing geography and local opportunity, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Applied to geography and local opportunity, a measure collected because it is customary is not sufficient justification. The evidence for geography and local opportunity therefore requires that the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-72] [REF-78] [REF-82] [REF-84]

The principal evidence risk is that national averages favour institutions near diverse labour markets and penalise remote programmes without explaining mechanisms. For geography and local opportunity, definitions and missing cases can alter both the value and the explanation. Applied to geography and local opportunity, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for geography and local opportunity therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-72] [REF-78] [REF-82] [REF-84]

Validation of geography and local opportunity should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to geography and local opportunity, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for geography and local opportunity therefore requires that contradictions should be investigated rather than averaged. For graduates included in geography and local opportunity, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-72] [REF-78] [REF-82] [REF-84]

The design rule is to report destination and relevant regional context and compare similar programmes cautiously. The evidence for geography and local opportunity therefore requires that data collection should use the minimum information required for the decision and accessible contact routes. For graduates included in geography and local opportunity, measures should permit mixed and changing transitions and preserve a category for unknown status. Within the authority responsible for geography and local opportunity, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-72] [REF-78] [REF-82] [REF-84]

The decision rule is to identify actions within provider or regional authority such as mobility support, employer reach or further-learning access. For graduates included in geography and local opportunity, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for geography and local opportunity, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For geography and local opportunity, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-72] [REF-78] [REF-82] [REF-84]

Follow-up for geography and local opportunity should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for geography and local opportunity, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For geography and local opportunity, public reporting should preserve the earlier baseline and explain a material revision. In reviewing geography and local opportunity, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-72] [REF-78] [REF-82] [REF-84]

A further review test for geography and local opportunity should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for geography and local opportunity should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for geography and local opportunity should state which institutional change is justified and which remaining condition lies beyond provider authority.

24

Economic cycle and cohort comparison

Graduates entering weak labour markets should not be compared directly with cohorts entering stronger conditions. This is the improvement proposition for economic cycle and cohort comparison. Applied to economic cycle and cohort comparison, the review should identify the programme claim, graduate population and decision for which the evidence is needed. The evidence for economic cycle and cohort comparison therefore requires that a measure collected because it is customary is not sufficient justification. For graduates included in economic cycle and cohort comparison, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-77] [REF-78] [REF-79] [REF-82]

Validation of economic cycle and cohort comparison should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to economic cycle and cohort comparison, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for economic cycle and cohort comparison therefore requires that contradictions should be investigated rather than averaged. For graduates included in economic cycle and cohort comparison, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-77] [REF-78] [REF-79] [REF-82]

The principal evidence risk is that trend changes can be attributed to programme revision when macroeconomic demand changed at the same time. For economic cycle and cohort comparison, definitions and missing cases can alter both the value and the explanation. For graduates included in economic cycle and cohort comparison, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for economic cycle and cohort comparison, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-77] [REF-78] [REF-79] [REF-82]

The design rule is to retain dated labour-market indicators and use multiple cohorts or suitable comparison groups. For graduates included in economic cycle and cohort comparison, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for economic cycle and cohort comparison, measures should permit mixed and changing transitions and preserve a category for unknown status. For economic cycle and cohort comparison, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-77] [REF-78] [REF-79] [REF-82]

Follow-up for economic cycle and cohort comparison should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for economic cycle and cohort comparison, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For economic cycle and cohort comparison, public reporting should preserve the earlier baseline and explain a material revision. In reviewing economic cycle and cohort comparison, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-77] [REF-78] [REF-79] [REF-82]

A further review test for economic cycle and cohort comparison should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for economic cycle and cohort comparison should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for economic cycle and cohort comparison should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to look for changes in skill use, progression and relative position as well as absolute employment. For economic cycle and cohort comparison, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing economic cycle and cohort comparison, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to economic cycle and cohort comparison, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-77] [REF-78] [REF-79] [REF-82]

Part V

Interpretation, thresholds and programme diagnosis

25

Contribution rather than automatic attribution

A programme may contribute to capability and transition without controlling vacancies, hiring or household decisions. This is the improvement proposition for contribution rather than automatic attribution. The evidence for contribution rather than automatic attribution therefore requires that the review should identify the programme claim, graduate population and decision for which the evidence is needed. For graduates included in contribution rather than automatic attribution, a measure collected because it is customary is not sufficient justification. Within the authority responsible for contribution rather than automatic attribution, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-66] [REF-70] [REF-72] [REF-84]

The principal evidence risk is that review panels may credit or blame the programme for every observed graduate status. For contribution rather than automatic attribution, definitions and missing cases can alter both the value and the explanation. For graduates included in contribution rather than automatic attribution, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for contribution rather than automatic attribution, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-66] [REF-70] [REF-72] [REF-84]

The design rule is to map the expected path from curriculum, support and credential to the outcome and test each link. For graduates included in contribution rather than automatic attribution, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for contribution rather than automatic attribution, measures should permit mixed and changing transitions and preserve a category for unknown status. For contribution rather than automatic attribution, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-66] [REF-70] [REF-72] [REF-84]

Validation of contribution rather than automatic attribution should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Within the authority responsible for contribution rather than automatic attribution, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. For contribution rather than automatic attribution, contradictions should be investigated rather than averaged. In reviewing contribution rather than automatic attribution, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-66] [REF-70] [REF-72] [REF-84]

The decision rule is to state the strength and limit of contribution evidence and take no broader corrective action than it supports. For contribution rather than automatic attribution, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing contribution rather than automatic attribution, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to contribution rather than automatic attribution, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-66] [REF-70] [REF-72] [REF-84]

Follow-up for contribution rather than automatic attribution should specify the action owner, resource, completion evidence and later graduate measure. In reviewing contribution rather than automatic attribution, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to contribution rather than automatic attribution, public reporting should preserve the earlier baseline and explain a material revision. The evidence for contribution rather than automatic attribution therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-66] [REF-70] [REF-72] [REF-84]

A further review test for contribution rather than automatic attribution should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for contribution rather than automatic attribution should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for contribution rather than automatic attribution should state which institutional change is justified and which remaining condition lies beyond provider authority.

26

Baseline and cohort trend

Change is interpretable only against a stable or explicitly revised definition and relevant prior condition. This is the improvement proposition for baseline and cohort trend. For graduates included in baseline and cohort trend, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Within the authority responsible for baseline and cohort trend, a measure collected because it is customary is not sufficient justification. For baseline and cohort trend, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-66] [REF-78] [REF-82] [REF-84]

The design rule is to preserve a core measure set, document breaks and re-estimate earlier values only where defensible. For graduates included in baseline and cohort trend, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for baseline and cohort trend, measures should permit mixed and changing transitions and preserve a category for unknown status. For baseline and cohort trend, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-66] [REF-78] [REF-82] [REF-84]

The principal evidence risk is that new questions, response modes or cohort rules can create an apparent improvement. For baseline and cohort trend, definitions and missing cases can alter both the value and the explanation. For baseline and cohort trend, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing baseline and cohort trend, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-66] [REF-78] [REF-82] [REF-84]

Validation of baseline and cohort trend should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For baseline and cohort trend, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing baseline and cohort trend, contradictions should be investigated rather than averaged. Applied to baseline and cohort trend, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-66] [REF-78] [REF-82] [REF-84]

Follow-up for baseline and cohort trend should specify the action owner, resource, completion evidence and later graduate measure. In reviewing baseline and cohort trend, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to baseline and cohort trend, public reporting should preserve the earlier baseline and explain a material revision. The evidence for baseline and cohort trend therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-66] [REF-78] [REF-82] [REF-84]

A further review test for baseline and cohort trend should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for baseline and cohort trend should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for baseline and cohort trend should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to delay trend claims across a material definition break and use the evidence for prospective improvement. Applied to baseline and cohort trend, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for baseline and cohort trend therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in baseline and cohort trend, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-66] [REF-78] [REF-82] [REF-84]

27

External and internal benchmarks

Benchmarks can locate unusual outcomes but require comparable programmes, learners, regions and periods. This is the improvement proposition for external and internal benchmarks. Within the authority responsible for external and internal benchmarks, the review should identify the programme claim, graduate population and decision for which the evidence is needed. For external and internal benchmarks, a measure collected because it is customary is not sufficient justification. In reviewing external and internal benchmarks, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-64] [REF-66] [REF-82] [REF-84]

The principal evidence risk is that rankings invite action even where differences arise from field mix or economic context. For external and internal benchmarks, definitions and missing cases can alter both the value and the explanation. For external and internal benchmarks, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing external and internal benchmarks, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-64] [REF-66] [REF-82] [REF-84]

Validation of external and internal benchmarks should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For external and internal benchmarks, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing external and internal benchmarks, contradictions should be investigated rather than averaged. Applied to external and internal benchmarks, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-64] [REF-66] [REF-82] [REF-84]

The design rule is to select benchmarks by purpose and publish the dimensions of comparability and remaining difference. In reviewing external and internal benchmarks, data collection should use the minimum information required for the decision and accessible contact routes. Applied to external and internal benchmarks, measures should permit mixed and changing transitions and preserve a category for unknown status. The evidence for external and internal benchmarks therefore requires that sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-64] [REF-66] [REF-82] [REF-84]

The decision rule is to treat a benchmark gap as an inquiry trigger and not as proof of quality or failure. Applied to external and internal benchmarks, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for external and internal benchmarks therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in external and internal benchmarks, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-64] [REF-66] [REF-82] [REF-84]

Follow-up for external and internal benchmarks should specify the action owner, resource, completion evidence and later graduate measure. The evidence for external and internal benchmarks therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in external and internal benchmarks, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for external and internal benchmarks, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-64] [REF-66] [REF-82] [REF-84]

A further review test for external and internal benchmarks should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for external and internal benchmarks should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for external and internal benchmarks should state which institutional change is justified and which remaining condition lies beyond provider authority.

28

Skills mismatch diagnosis

Reported mismatch can reflect curriculum, job design, weak demand, career information, recognition or graduate preference. This is the improvement proposition for skills mismatch diagnosis. For skills mismatch diagnosis, the review should identify the programme claim, graduate population and decision for which the evidence is needed. In reviewing skills mismatch diagnosis, a measure collected because it is customary is not sufficient justification. Applied to skills mismatch diagnosis, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-70] [REF-71] [REF-72] [REF-77]

Validation of skills mismatch diagnosis should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For skills mismatch diagnosis, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. In reviewing skills mismatch diagnosis, contradictions should be investigated rather than averaged. Applied to skills mismatch diagnosis, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-70] [REF-71] [REF-72] [REF-77]

The principal evidence risk is that a single overqualification question prompts indiscriminate removal or addition of curriculum content. For skills mismatch diagnosis, definitions and missing cases can alter both the value and the explanation. Applied to skills mismatch diagnosis, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for skills mismatch diagnosis therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-70] [REF-71] [REF-72] [REF-77]

The design rule is to triangulate qualification requirement, task use, employer evidence, vacancy information and graduate goals. Applied to skills mismatch diagnosis, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for skills mismatch diagnosis therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in skills mismatch diagnosis, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-70] [REF-71] [REF-72] [REF-77]

Follow-up for skills mismatch diagnosis should specify the action owner, resource, completion evidence and later graduate measure. The evidence for skills mismatch diagnosis therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in skills mismatch diagnosis, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for skills mismatch diagnosis, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-70] [REF-71] [REF-72] [REF-77]

A further review test for skills mismatch diagnosis should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for skills mismatch diagnosis should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for skills mismatch diagnosis should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to change outcomes only where missing, obsolete or poorly taught learning is supported by evidence. For graduates included in skills mismatch diagnosis, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for skills mismatch diagnosis, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For skills mismatch diagnosis, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-70] [REF-71] [REF-72] [REF-77]

29

Outliers and adverse cases

Small groups with serious transition failure can reveal barriers hidden in the programme average. This is the improvement proposition for outliers and adverse cases. In reviewing outliers and adverse cases, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Applied to outliers and adverse cases, a measure collected because it is customary is not sufficient justification. The evidence for outliers and adverse cases therefore requires that the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-10] [REF-12] [REF-66]

The principal evidence risk is that outliers may be deleted as noise or used as vivid proof without determining representativeness. For outliers and adverse cases, definitions and missing cases can alter both the value and the explanation. Applied to outliers and adverse cases, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for outliers and adverse cases therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-10] [REF-12] [REF-66]

The design rule is to investigate adverse cases under clear selection and privacy rules and compare with successful contrasting cases. Applied to outliers and adverse cases, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for outliers and adverse cases therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in outliers and adverse cases, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-10] [REF-12] [REF-66]

Validation of outliers and adverse cases should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. The evidence for outliers and adverse cases therefore requires that reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. For graduates included in outliers and adverse cases, contradictions should be investigated rather than averaged. Within the authority responsible for outliers and adverse cases, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-10] [REF-12] [REF-66]

The decision rule is to correct severe avoidable barriers even where the aggregate effect is small and report the bounded scope. For graduates included in outliers and adverse cases, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for outliers and adverse cases, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For outliers and adverse cases, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-10] [REF-12] [REF-66]

Follow-up for outliers and adverse cases should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for outliers and adverse cases, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For outliers and adverse cases, public reporting should preserve the earlier baseline and explain a material revision. In reviewing outliers and adverse cases, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-10] [REF-12] [REF-66]

A further review test for outliers and adverse cases should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for outliers and adverse cases should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for outliers and adverse cases should state which institutional change is justified and which remaining condition lies beyond provider authority.

30

Decision thresholds and escalation

Review should define when evidence prompts monitoring, investigation, corrective action or programme redesign. This is the improvement proposition for decision thresholds and escalation. Applied to decision thresholds and escalation, the review should identify the programme claim, graduate population and decision for which the evidence is needed. The evidence for decision thresholds and escalation therefore requires that a measure collected because it is customary is not sufficient justification. For graduates included in decision thresholds and escalation, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-66] [REF-70] [REF-73]

The design rule is to combine magnitude, persistence, equity, evidence strength, rights consequence and reversibility. Applied to decision thresholds and escalation, data collection should use the minimum information required for the decision and accessible contact routes. The evidence for decision thresholds and escalation therefore requires that measures should permit mixed and changing transitions and preserve a category for unknown status. For graduates included in decision thresholds and escalation, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-66] [REF-70] [REF-73]

The principal evidence risk is that fixed numerical thresholds ignore consequence and uncertainty while informal judgement permits inconsistency. For decision thresholds and escalation, definitions and missing cases can alter both the value and the explanation. For graduates included in decision thresholds and escalation, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for decision thresholds and escalation, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-66] [REF-70] [REF-73]

Validation of decision thresholds and escalation should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in decision thresholds and escalation, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for decision thresholds and escalation, contradictions should be investigated rather than averaged. For decision thresholds and escalation, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-66] [REF-70] [REF-73]

Follow-up for decision thresholds and escalation should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for decision thresholds and escalation, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For decision thresholds and escalation, public reporting should preserve the earlier baseline and explain a material revision. In reviewing decision thresholds and escalation, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-66] [REF-70] [REF-73]

A further review test for decision thresholds and escalation should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for decision thresholds and escalation should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for decision thresholds and escalation should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to record the decision rationale and expand action when later evidence shows broader exposure. For decision thresholds and escalation, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing decision thresholds and escalation, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to decision thresholds and escalation, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-66] [REF-70] [REF-73]

Part VI

Improvement action and verification

31

Governance of graduate evidence

One accountable body should maintain definitions, evidence quality, review and corrective follow-up. This is the improvement proposition for governance of graduate evidence. The evidence for governance of graduate evidence therefore requires that the review should identify the programme claim, graduate population and decision for which the evidence is needed. For graduates included in governance of graduate evidence, a measure collected because it is customary is not sufficient justification. Within the authority responsible for governance of graduate evidence, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-66] [REF-70] [REF-73]

The principal evidence risk is that career services, academic teams, marketing and quality offices may hold separate figures and incompatible claims. For governance of graduate evidence, definitions and missing cases can alter both the value and the explanation. For graduates included in governance of graduate evidence, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for governance of graduate evidence, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-66] [REF-70] [REF-73]

Validation of governance of graduate evidence should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in governance of graduate evidence, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for governance of graduate evidence, contradictions should be investigated rather than averaged. For governance of graduate evidence, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-66] [REF-70] [REF-73]

The design rule is to assign data stewardship, analytical review, decision authority, privacy and publication responsibilities. Within the authority responsible for governance of graduate evidence, data collection should use the minimum information required for the decision and accessible contact routes. For governance of graduate evidence, measures should permit mixed and changing transitions and preserve a category for unknown status. In reviewing governance of graduate evidence, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-66] [REF-70] [REF-73]

The decision rule is to reconcile material reports and require one controlled basis for public transition claims. For governance of graduate evidence, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing governance of graduate evidence, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to governance of graduate evidence, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-66] [REF-70] [REF-73]

Follow-up for governance of graduate evidence should specify the action owner, resource, completion evidence and later graduate measure. In reviewing governance of graduate evidence, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to governance of graduate evidence, public reporting should preserve the earlier baseline and explain a material revision. The evidence for governance of graduate evidence therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-66] [REF-70] [REF-73]

A further review test for governance of graduate evidence should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for governance of graduate evidence should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for governance of graduate evidence should state which institutional change is justified and which remaining condition lies beyond provider authority.

32

Curriculum and assessment response

Transition evidence should refine outcomes, content, practice and assessment where a learning gap is demonstrated. This is the improvement proposition for curriculum and assessment response. For graduates included in curriculum and assessment response, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Within the authority responsible for curriculum and assessment response, a measure collected because it is customary is not sufficient justification. For curriculum and assessment response, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-64] [REF-66] [REF-70] [REF-71]

Validation of curriculum and assessment response should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. For graduates included in curriculum and assessment response, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Within the authority responsible for curriculum and assessment response, contradictions should be investigated rather than averaged. For curriculum and assessment response, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-64] [REF-66] [REF-70] [REF-71]

The principal evidence risk is that labour-market change can provoke frequent additions that overload the programme or remove durable capabilities. For curriculum and assessment response, definitions and missing cases can alter both the value and the explanation. For curriculum and assessment response, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing curriculum and assessment response, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-64] [REF-66] [REF-70] [REF-71]

The design rule is to map the finding to learning outcomes and determine whether revision, teaching support or assessment change is warranted. For curriculum and assessment response, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing curriculum and assessment response, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to curriculum and assessment response, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-64] [REF-66] [REF-70] [REF-71]

Follow-up for curriculum and assessment response should specify the action owner, resource, completion evidence and later graduate measure. In reviewing curriculum and assessment response, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. Applied to curriculum and assessment response, public reporting should preserve the earlier baseline and explain a material revision. The evidence for curriculum and assessment response therefore requires that closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-64] [REF-66] [REF-70] [REF-71]

A further review test for curriculum and assessment response should compare at least one adverse transition with a contrasting successful transition from the same defined cohort. The comparison for curriculum and assessment response should identify differences in opportunity, programme use, support, recognition and external context without treating either graduate as representative alone. The resulting explanation for curriculum and assessment response should state which institutional change is justified and which remaining condition lies beyond provider authority.

The decision rule is to trial the change and review learner work and later transition before extending it. Applied to curriculum and assessment response, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for curriculum and assessment response therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in curriculum and assessment response, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-64] [REF-66] [REF-70] [REF-71]

33

Career guidance and transition support

Graduates need timely information, search capability, placement support and routes back to learning. This is the improvement proposition for career guidance and transition support. Within the authority responsible for career guidance and transition support, the review should identify the programme claim, graduate population and decision for which the evidence is needed. For career guidance and transition support, a measure collected because it is customary is not sufficient justification. In reviewing career guidance and transition support, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-63] [REF-73] [REF-80] [REF-81]

The principal evidence risk is that strong curriculum can coexist with weak transition where services are late, inaccessible or concentrated among confident learners. For career guidance and transition support, definitions and missing cases can alter both the value and the explanation. For career guidance and transition support, the study should distinguish what is directly reported, what is derived and what is inferred. In reviewing career guidance and transition support, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-63] [REF-73] [REF-80] [REF-81]

The design rule is to provide staged, inclusive guidance linked to programme and regional opportunities. For career guidance and transition support, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing career guidance and transition support, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to career guidance and transition support, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-63] [REF-73] [REF-80] [REF-81]

Validation of career guidance and transition support should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. In reviewing career guidance and transition support, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. Applied to career guidance and transition support, contradictions should be investigated rather than averaged. The evidence for career guidance and transition support therefore requires that qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-63] [REF-73] [REF-80] [REF-81]

The decision rule is to measure use, reach, graduate action and transition difference while controlling for self-selection. Applied to career guidance and transition support, the finding should state programme contribution, external context, affected groups and material alternatives. The evidence for career guidance and transition support therefore requires that improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For graduates included in career guidance and transition support, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-63] [REF-73] [REF-80] [REF-81]

Follow-up for career guidance and transition support should specify the action owner, resource, completion evidence and later graduate measure. The evidence for career guidance and transition support therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in career guidance and transition support, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for career guidance and transition support, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-63] [REF-73] [REF-80] [REF-81]

34

Employer and further-learning partnerships

Partners can improve work exposure, current information, recognition and progression. This is the improvement proposition for employer and further-learning partnerships. For employer and further-learning partnerships, the review should identify the programme claim, graduate population and decision for which the evidence is needed. In reviewing employer and further-learning partnerships, a measure collected because it is customary is not sufficient justification. Applied to employer and further-learning partnerships, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-62] [REF-66] [REF-73] [REF-84]

The design rule is to state partner responsibilities, learner protection, opportunity allocation, evidence and continuity. For employer and further-learning partnerships, data collection should use the minimum information required for the decision and accessible contact routes. In reviewing employer and further-learning partnerships, measures should permit mixed and changing transitions and preserve a category for unknown status. Applied to employer and further-learning partnerships, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-62] [REF-66] [REF-73] [REF-84]

The principal evidence risk is that agreements may count participation while providing unequal placements or no durable pathway. For employer and further-learning partnerships, definitions and missing cases can alter both the value and the explanation. Applied to employer and further-learning partnerships, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for employer and further-learning partnerships therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-62] [REF-66] [REF-73] [REF-84]

Validation of employer and further-learning partnerships should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to employer and further-learning partnerships, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for employer and further-learning partnerships therefore requires that contradictions should be investigated rather than averaged. For graduates included in employer and further-learning partnerships, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-62] [REF-66] [REF-73] [REF-84]

Follow-up for employer and further-learning partnerships should specify the action owner, resource, completion evidence and later graduate measure. The evidence for employer and further-learning partnerships therefore requires that review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For graduates included in employer and further-learning partnerships, public reporting should preserve the earlier baseline and explain a material revision. Within the authority responsible for employer and further-learning partnerships, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-62] [REF-66] [REF-73] [REF-84]

The decision rule is to review task quality, supervision, credit, hiring fairness and progression rather than agreement volume. For graduates included in employer and further-learning partnerships, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for employer and further-learning partnerships, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For employer and further-learning partnerships, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-62] [REF-66] [REF-73] [REF-84]

35

Publication and responsible communication

Public transition reporting should state definitions, cohort, period, response, missingness and limits near the claim. This is the improvement proposition for publication and responsible communication. In reviewing publication and responsible communication, the review should identify the programme claim, graduate population and decision for which the evidence is needed. Applied to publication and responsible communication, a measure collected because it is customary is not sufficient justification. The evidence for publication and responsible communication therefore requires that the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-05] [REF-66] [REF-81] [REF-84]

The principal evidence risk is that headline employment percentages can mislead applicants and create pressure to suppress adverse evidence. For publication and responsible communication, definitions and missing cases can alter both the value and the explanation. Applied to publication and responsible communication, the study should distinguish what is directly reported, what is derived and what is inferred. The evidence for publication and responsible communication therefore requires that a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-05] [REF-66] [REF-81] [REF-84]

Validation of publication and responsible communication should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to publication and responsible communication, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for publication and responsible communication therefore requires that contradictions should be investigated rather than averaged. For graduates included in publication and responsible communication, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-05] [REF-66] [REF-81] [REF-84]

The design rule is to publish a compact set with distributions, context, revisions and actions and prohibit guaranteed-outcome language. The evidence for publication and responsible communication therefore requires that data collection should use the minimum information required for the decision and accessible contact routes. For graduates included in publication and responsible communication, measures should permit mixed and changing transitions and preserve a category for unknown status. Within the authority responsible for publication and responsible communication, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-05] [REF-66] [REF-81] [REF-84]

The decision rule is to reconstruct selected public claims from source records and correct material inconsistency promptly. For graduates included in publication and responsible communication, the finding should state programme contribution, external context, affected groups and material alternatives. Within the authority responsible for publication and responsible communication, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. For publication and responsible communication, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-05] [REF-66] [REF-81] [REF-84]

Follow-up for publication and responsible communication should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for publication and responsible communication, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For publication and responsible communication, public reporting should preserve the earlier baseline and explain a material revision. In reviewing publication and responsible communication, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-05] [REF-66] [REF-81] [REF-84]

36

Verification of improvement

An action is complete only when implemented and tested against the problem that justified it. This is the improvement proposition for verification of improvement. Applied to verification of improvement, the review should identify the programme claim, graduate population and decision for which the evidence is needed. The evidence for verification of improvement therefore requires that a measure collected because it is customary is not sufficient justification. For graduates included in verification of improvement, the responsible body should state how the result could confirm, refine or challenge an authorised feature of curriculum, assessment, support or public information.[REF-66] [REF-70] [REF-71] [REF-73]

Validation of verification of improvement should compare graduate responses with suitable programme, award, labour-market or receiving-institution evidence. Applied to verification of improvement, reviewers should test frame coverage, item missingness and whether the same terms were understood consistently. The evidence for verification of improvement therefore requires that contradictions should be investigated rather than averaged. For graduates included in verification of improvement, qualitative accounts can establish plausible mechanisms and variation but should not be presented as a population rate.[REF-66] [REF-70] [REF-71] [REF-73]

The principal evidence risk is that approval of a new curriculum or service can be counted as improvement before graduates experience it. For verification of improvement, definitions and missing cases can alter both the value and the explanation. For graduates included in verification of improvement, the study should distinguish what is directly reported, what is derived and what is inferred. Within the authority responsible for verification of improvement, a precise percentage should not be published without the cohort, denominator, reference date and uncertainty necessary to interpret it.[REF-66] [REF-70] [REF-71] [REF-73]

The design rule is to define implementation and outcome evidence, review date, responsible body and fallback when authorising action. For graduates included in verification of improvement, data collection should use the minimum information required for the decision and accessible contact routes. Within the authority responsible for verification of improvement, measures should permit mixed and changing transitions and preserve a category for unknown status. For verification of improvement, sensitive information should be protected and should not be shared with employers or other bodies merely because linkage is technically possible.[REF-66] [REF-70] [REF-71] [REF-73]

Follow-up for verification of improvement should specify the action owner, resource, completion evidence and later graduate measure. Within the authority responsible for verification of improvement, review should test whether intended graduates used the change and whether inequity or burden shifted elsewhere. For verification of improvement, public reporting should preserve the earlier baseline and explain a material revision. In reviewing verification of improvement, closure requires sustained evidence against the original problem, not only confirmation that the institution approved a new document or service.[REF-66] [REF-70] [REF-71] [REF-73]

The decision rule is to compare the affected later cohort, examine unintended effects and retain or revise the measure on evidence. For verification of improvement, the finding should state programme contribution, external context, affected groups and material alternatives. In reviewing verification of improvement, improvement should target a feature within institutional authority and should not reduce durable educational capability to meet one short-term vacancy pattern. Applied to verification of improvement, where evidence remains uncertain but consequence is serious, a reversible protective measure and further inquiry may be appropriate.[REF-66] [REF-70] [REF-71] [REF-73]

References

  1. REF-05

    UNESCO and UNICEF. A Human Rights-Based Approach to Education for All. 2007.

    Rights-based duties concerning access, quality, participation and accountability.

    https://unesdoc.unesco.org/ark:/48223/pf0000154861
  2. REF-10

    UNESCO. Guidelines for Inclusion: Ensuring Access to Education for All. 2005.

    Inclusive system reform, barriers to participation and learner diversity.

    https://unesdoc.unesco.org/ark:/48223/pf0000140224
  3. REF-12

    United Nations General Assembly. Convention on the Rights of Persons with Disabilities. 2006.

    Inclusive education, accessibility and reasonable accommodation.

    https://www.ohchr.org/en/instruments-mechanisms/instruments/convention-rights-persons-disabilities
  4. REF-61

    United Nations Educational, Scientific and Cultural Organization. Revised Recommendation concerning Technical and Vocational Education. 2001.

    International normative guidance on TVET aims, programmes, teachers, guidance and cooperation.

    https://unesdoc.unesco.org/ark:/48223/pf0000126050
  5. REF-62

    UNESCO and International Labour Organization. Technical and Vocational Education and Training for the Twenty-first Century: UNESCO and ILO Recommendations. 2002.

    Joined international guidance on TVET, work, lifelong learning and institutional responsibility.

    https://unesdoc.unesco.org/ark:/48223/pf0000126050
  6. REF-63

    International Labour Organization. Human Resources Development Recommendation, 2004 (No. 195). 2004.

    International labour standard on education, training, lifelong learning, competencies and recognition.

    https://normlex.ilo.org/dyn/nrmlx_en/f?p=NORMLEXPUB:12100:0::NO::P12100_ILO_CODE:R195
  7. REF-64

    European Parliament and Council of the European Union. Recommendation on the Establishment of the European Qualifications Framework for Lifelong Learning. 2008.

    Learning-outcomes-based reference levels expressed through knowledge, skills and competence.

    https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32008H0506(01)
  8. REF-65

    European Parliament and Council of the European Union. Recommendation on the Establishment of a European Credit System for Vocational Education and Training. 2009.

    Units of learning outcomes, credit, assessment, validation, recognition and mobility.

    https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32009H0708(02)
  9. REF-66

    European Parliament and Council of the European Union. Recommendation on the Establishment of a European Quality Assurance Reference Framework for Vocational Education and Training. 2009.

    European quality-assurance framework for TVET planning, implementation, evaluation and review.

    https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32009H0708(01)
  10. REF-67

    Ministers Responsible for Higher Education in the Bologna Countries. The Framework for Qualifications of the European Higher Education Area. 2005.

    Qualifications framework using learning outcomes, cycles, workload and qualification descriptors.

    https://ehea.info/media.ehea.info/file/WG_Frameworks_qualification/85/2/Framework_qualificationsforEHEA-May2005_587852.pdf
  11. REF-69

    Ministers Responsible for Higher Education in the Bologna Countries. Budapest–Vienna Declaration on the European Higher Education Area. 2010.

    Contemporaneous statement on the European Higher Education Area and implementation of Bologna commitments.

    https://ehea.info/Upload/document/ministerial_declarations/Budapest_Vienna_Declaration_598640.pdf
  12. REF-70

    European Centre for the Development of Vocational Training. The Shift to Learning Outcomes: Policies and Practices in Europe. 2009.

    Comparative European analysis of learning-outcomes approaches in education and training.

    https://www.cedefop.europa.eu/files/3054_en.pdf
  13. REF-71

    European Centre for the Development of Vocational Training. Learning Outcomes Approaches in VET Curricula: A Comparative Analysis of Nine European Countries. 2010.

    Evidence on specification and use of learning outcomes in vocational curricula.

    https://www.cedefop.europa.eu/files/5506_en.pdf
  14. REF-72

    European Commission. New Skills for New Jobs: Anticipating and Matching Labour Market and Skills Needs. 2008.

    European policy on skills anticipation, matching, adaptability and labour-market change.

    https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52008DC0868
  15. REF-73

    European Ministers for Vocational Education and Training, European Social Partners and European Commission. The Bruges Communiqué on Enhanced European Cooperation in Vocational Education and Training for 2011–2020. 2010.

    European TVET cooperation priorities on quality, outcomes, mobility, inclusion and lifelong learning.

    https://www.cedefop.europa.eu/files/bruges_en.pdf
  16. REF-75

    United Nations General Assembly. Implementation of Agenda 21, the Programme for the Further Implementation of Agenda 21 and the Outcomes of the World Summit on Sustainable Development. 2011.

    Contemporaneous United Nations sustainable-development and conference-preparation context.

    https://undocs.org/A/RES/66/197
  17. REF-76

    United Nations Conference on Sustainable Development Preparatory Committee. The Future We Want: Zero Draft of the Outcome Document. 2012.

    Preparatory draft available by the cutoff, used only as evidence of current sustainable-development attention.

    https://sustainabledevelopment.un.org/content/documents/370The%20Future%20We%20Want%2010Jan%20clean.pdf
  18. REF-77

    European Commission. An Agenda for New Skills and Jobs: A European Contribution towards Full Employment. 2010.

    European policy concerning skills, qualifications, mobility and labour-market participation.

    https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52010DC0682
  19. REF-78

    International Labour Organization. Global Employment Trends 2012: Preventing a Deeper Jobs Crisis. 2012.

    Contemporaneous evidence on weak labour markets, employment quality and economic uncertainty.

    https://www.ilo.org/publications/global-employment-trends-2012-preventing-deeper-jobs-crisis
  20. REF-79

    International Labour Organization. Global Employment Trends for Youth: 2011 Update. 2011.

    Evidence on youth unemployment, vulnerable employment and transition pressures.

    https://www.ilo.org/publications/global-employment-trends-youth-2011-update
  21. REF-80

    United Nations. World Youth Report 2011: Youth Employment — Youth Perspectives on the Pursuit of Decent Work in Changing Times. 2012.

    United Nations evidence and youth perspectives on education-to-work transition and decent work.

    https://www.un.org/development/desa/youth/world-youth-report/world-youth-report-2011.html
  22. REF-81

    European Commission. Youth on the Move: An Initiative to Unleash the Potential of Young People to Achieve Smart, Sustainable and Inclusive Growth. 2010.

    European policy on education quality, mobility, youth employment and transition.

    https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52010DC0477
  23. REF-82

    European Commission. Employment and Social Developments in Europe 2011. 2011.

    European evidence on employment, labour-market transitions, poverty and social conditions.

    https://op.europa.eu/en/publication-detail/-/publication/c1c84e14-6338-4bd1-a708-62b4f20956fb
  24. REF-83

    European Centre for the Development of Vocational Training. Vocational Education and Training Is Good for You: The Social Benefits of VET for Individuals. 2011.

    Evidence on economic, social and individual benefits associated with vocational education and training.

    https://www.cedefop.europa.eu/files/5517_en.pdf
  25. REF-84

    European Centre for the Development of Vocational Training. Labour-market Outcomes of Vocational Education in Europe: Evidence from the European Union Labour Force Survey. 2011.

    Comparative evidence on employment transitions and occupational outcomes of vocational graduates.

    https://www.cedefop.europa.eu/files/5532_en.pdf
  26. REF-85

    European Commission. The Social and Employment Dimension of the Europe 2020 Strategy. 2011.

    European institutional evidence on employment, inclusion and headline social objectives.

    https://ec.europa.eu/social/BlobServlet?docId=6552&langId=en
  27. REF-86

    United Nations General Assembly. Policies and Programmes Involving Youth. 2011.

    United Nations policy concerning youth participation, education, employment and development.

    https://undocs.org/A/RES/66/121