{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-23e33897afb42b56","slug":"2015-12-01-technical-and-vocational-education-and-training-measurement-and-statistical-uncertainty","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2015-12-01","last_modified_date":"2015-12-01","title":"Technical and vocational education and training: measurement and statistical uncertainty","summary":"Assesses evidence on technical and vocational education and training: measurement and statistical uncertainty.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"International recommendation adopted in November 2015","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The immediate international context is the international recommendation adopted in November 2015. Its significance for technical and vocational education and training lies in the quality of implementation rather than in formal acknowledgement alone. In reviewing the analysis, the value of the present data lies in the questions it can answer reliably and in the limits it makes visible.","The instrument identified by the international recommendation adopted in November 2015 provides a formal policy reference for the analysis. In relation to technical and vocational education and training, this distinction protects learners from overstated claims and enables providers to plan against a defined obligation.","A proper review of the issue should establish the intended outcome before selecting controls or indicators. Oversight of the analysis should reflect the principle that trend claims require comparable observations over time and a documented account of revisions, breaks in series and changes in coverage. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved."]},{"heading":"Evidence base for technical and vocational education and training","paragraphs":["The intended substantive result should remain the starting point for review. Oversight of technical and vocational education and training should reflect the principle that flexible learning should remain transparent about entry requirements, learning outcomes, assessment, progression and the uses for which a qualification or record is intended. Assurance should not stop at adoption, resourcing or completion of administrative tasks.","The technical issue within the issue concerns the basis on which a conclusion is reached. For the available evidence, an estimate should be reported with the uncertainty arising from sampling, measurement, missing information and model choice. A precise number may still support only a cautious conclusion if the underlying assumptions are weak. A conclusion should identify both its evidential basis and the part of the stated scope for which assurance cannot be given.","The principal risks in relation to the comparison are barriers created by time, cost or location, fragmented learner records, short programmes making unsupported outcome claims, and weak connection between training and intended competence. Risk assessment should account for dependencies between controls and the possibility that one failure masks the next.","Relevant evidence for the analysis will normally include learner and employer feedback where appropriate, admission and prior-learning decisions, assessment in relevant contexts, secure records of achieved learning, and transparent fees and recognition information. Evidence outside the relevant period or scope should be identified and given no more weight than its limitations permit. In relation to technical and vocational education and training, conflicting records require reconciliation before a complete assurance conclusion is reached."]},{"heading":"Coverage and comparability","paragraphs":["For operational review of technical and vocational education and training, authorities and providers should proceed in a defined sequence. For the analysis, the reviewer should report intervals or sensitivity ranges where appropriate, test whether the conclusion changes under plausible assumptions, and distinguish statistical detectability from educational significance. Record unresolved uncertainty beside the principal finding. The record should distinguish a finding that requires action from an observation that supports no formal conclusion.","Publication of findings on the issue should distinguish observed values, estimates and interpretation.","Records relating to the comparison should preserve both the conclusion and its limits. New evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion. This is material where learners, authorities or institutions relied on information that cannot be corrected by replacing the current text alone."]},{"heading":"Responsible interpretation","paragraphs":["Care is required in drawing conclusions about technical and vocational education and training. A decision concerning the available evidence should recognise that employment outcomes are affected by economic and labour-market conditions as well as education. They should not be attributed to a programme without an appropriate design and comparison. In reviewing the measure, association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. Limitations should be prominent wherever the finding may influence a consequential decision.","In this case, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Evidence of outcome, rather than completion of tasks, should determine whether corrective work can close.","The appropriate response to the available evidence is therefore one of controlled implementation and review. A clear objective, proportionate evidential basis and account of affected learners are required. Assurance should be withheld for the affected scope until the limitation is resolved."]}],"word_count":718,"content_hash":"sha256-5ad4b22f903524b1996867178122e4897ccf04e87fcab9f3db5fcb5a484f7102","seo_keywords":["technical and vocational education and training","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}