{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-ada85698979ff584","slug":"2015-07-09-using-administrative-data-to-examine-participation-in-lifelong-learning","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2015-07-09","last_modified_date":"2015-07-09","title":"Using administrative data to examine participation in lifelong learning","summary":"Assesses evidence on using administrative data to examine participation in lifelong learning, with particular attention to definitions, population coverage, comparability.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Education 2030 policy framework","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["In 2015, consideration of administrative data to examine participation in lifelong learning must take account of the Education 2030 policy framework and the responsibilities it places before education systems. The analysis of the available evidence proceeds on the basis that evidence should inform action without implying a level of precision, coverage or causal certainty that the underlying data cannot support.","Failure in relation to the issue may arise even where the stated policy is reasonable. Material concerns include limited routes for progression, fragmented learner records, barriers created by time, cost or location, and short programmes making unsupported outcome claims. In relation to using administrative data to examine participation in lifelong learning, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records."]},{"heading":"Analytical scope","paragraphs":["Implementation of administrative data to examine participation in lifelong learning should be organised around a decision that can be tested. A decision concerning the measure should recognise that a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. Oversight requires a traceable line from the approved objective through responsible action to evidence of outcome.","The formal status of the Education 2030 policy framework should be preserved in any public account. For the comparison, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary.","The Education 2030 Framework for Action sets out implementation approaches for Sustainable Development Goal 4. It emphasises inclusion and equity, quality and learning outcomes, lifelong learning, coordinated governance, finance and monitoring. National and provider-level use should identify the particular target being addressed, the responsible authority and the evidence of effect; broad alignment statements are not sufficient for accountability.","A focused examination of the issue requires a clear analytical discipline. The analysis of the measure proceeds on the basis that a proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. A formally complete record is not reliable if its scope or measure does not correspond to the decision being made."],"bullets":["Review claims against evidence.","Remove avoidable participation barriers.","Monitor completion and progression.","Assess the stated competence.","Recognise prior learning against published criteria, identifying the accountable function and affected scope."]},{"heading":"Definitions and data coverage","paragraphs":["Care is required in drawing conclusions about administrative data to examine participation in lifelong learning. For the analysis, employment outcomes are affected by economic and labour-market conditions as well as education. They should not be attributed to a programme without an appropriate design and comparison. In reviewing the comparison, association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. In relation to using administrative data to examine participation in lifelong learning, material limitations should be stated with the finding presented to decision-makers and affected learners.","Relevant evidence for the issue will normally include admission and prior-learning decisions, secure records of achieved learning, assessment in relevant contexts, transparent fees and recognition information, and completion and progression data. Contradictory evidence should be investigated and resolved, not omitted from the record.","Decisions concerning the comparison should remain traceable to the information available for the stated reference period. A revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. Without this distinction, a reporting change may be mistaken for improvement or deterioration in educational practice."]},{"heading":"Use of the findings","paragraphs":["For operational review of administrative data to examine participation in lifelong learning, authorities and providers should proceed in a defined sequence. In reviewing the analysis, responsible bodies should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. The record should distinguish a finding that requires action from an observation that supports no formal conclusion.","Publication of findings on the comparison should distinguish observed values, estimates and interpretation."],"bullets":["For which groups may it fail?","What evidence supports the relationship?","Is direct evidence available?","Would the decision change if the proxy were inaccurate?","What outcome does the proxy represent?"]},{"heading":"Uncertainty and safeguards","paragraphs":["The relevant outcome should be capable of direct and consistent explanation. For administrative data to examine participation in lifelong learning, flexible learning should remain transparent about entry requirements, learning outcomes, assessment, progression and the uses for which a qualification or record is intended. Formal adoption, expenditure and activity do not in themselves establish the intended result. Authorities and providers require evidence of operation and effect, with a route to identify and correct unequal or unintended consequences.","Public reporting on the issue should distinguish established fact, analytical judgement and planned action. Revision history should remain available where users have relied on the earlier conclusion. If definitions, coverage or evidence alter an earlier conclusion, the reason should be stated so that revision is not mistaken for changed performance.","Assurance concerning the comparison requires corroborating evidence across the material scope. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk."]}],"word_count":870,"content_hash":"sha256-a67cdb609a4b6712573ef01cee680bde033915a2d41e079ba130c2f85fdbca4a","seo_keywords":["using administrative data to examine participation in lifelong learning","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}