{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-59aa930cbe61ab7b","slug":"2012-04-16-timeliness-and-completeness-of-data-on-adult-learning-pathways","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2012-04-16","last_modified_date":"2012-04-16","title":"Timeliness and completeness of data on adult learning pathways","summary":"Reviews timeliness and completeness of data on adult learning pathways and identifies the conditions required for sound interpretation, responsible comparison and defensible.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Lifelong-learning and employability policy","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of adult learning pathways is informed by the lifelong-learning and employability policy, with consequences for governance, evidence and the treatment of affected learners. Oversight of the measure should reflect the principle that the value of the present data lies in the questions it can answer reliably and in the limits it makes visible. The effect on learner access and reliable decision-making should inform the scale of control applied.","Risk assessment of the analysis should give particular attention to fragmented learner records, barriers created by time, cost or location, and weak connection between training and intended competence. A provider should also consider short programmes making unsupported outcome claims and prior learning assessed inconsistently. The control response should reflect whether an affected learner can identify the error and obtain an effective remedy in time."]},{"heading":"Evidence base for timeliness and completeness of data on adult learning pathways","paragraphs":["Responsibility for adult learning pathways should be visible at the point where consequential decisions are made. For the comparison, reported averages should be accompanied by sufficient distributional information to identify material differences between learner groups, locations and forms of provision. In relation to timeliness and completeness of data on adult learning pathways, a decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.","The reference point is the lifelong-learning and employability policy. Analysis of the comparison should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. A comparison is reliable only if material differences remain visible. Decision-makers should state which matters are evidenced, which express policy and which require authorised judgement.","The technical issue within the comparison concerns the basis on which a conclusion is reached. A decision concerning the comparison should recognise that data quality comprises accuracy, completeness, timeliness, consistency and traceability. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. Any condition preventing complete assurance should appear with the evidence on which the judgement relies."],"bullets":["Review claims against evidence, with responsibility, scope and timing recorded.","Remove avoidable participation barriers.","Assess the stated competence.","Maintain portable records.","State the purpose and limits of the learning offer."]},{"heading":"Coverage and comparability","paragraphs":["Interpretation of adult learning pathways should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. In this case, employment outcomes are affected by economic and labour-market conditions as well as education. They should not be attributed to a programme without an appropriate design and comparison. In reviewing the issue, international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another.","The evidential record for the available evidence should permit a reviewer to trace the matter from decision to outcome. This may require defined learning and competence outcomes, admission and prior-learning decisions, learner and employer feedback where appropriate, and secure records of achieved learning, supported by transparent fees and recognition information and assessment in relevant contexts. Sampling remains insufficient where it excludes a material group or cannot resolve contradictory evidence or recurrence.","The assurance record for the analysis should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. In relation to timeliness and completeness of data on adult learning pathways, traceable source and version information allow genuine improvement to be distinguished from administrative revision. Revision should not remove an earlier conclusion from the record where reliance has occurred."]},{"heading":"Responsible interpretation","paragraphs":["A proportionate method is available for adult learning pathways. In this case, the reviewer should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. Escalate discrepancies that could alter a published conclusion or individual outcome. Contrary evidence should not be removed merely because aggregate performance appears acceptable.","The analytical record for the available evidence should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations."],"bullets":["Can reported values be traced to source?","Who may amend a record?","Are validation rules operating?","What proportion is missing or late?","Are revisions carried through to public reports?"]},{"heading":"Limitations and reporting","paragraphs":["The system and institutional dimensions of adult learning pathways should be considered together. A decision concerning the issue should recognise that flexible learning should remain transparent about entry requirements, learning outcomes, assessment, progression and the uses for which a qualification or record is intended. The regulatory setting is determined by public authorities, but responsibility for controlled provision remains with the provider. The allocation of responsibility should prevent gaps between system oversight and institutional operation.","Public reporting on the comparison should distinguish established fact, analytical judgement and planned action. Material revisions should be traceable to their reason and effective date.","A complete conclusion on the comparison requires evidence extending beyond an individual measure or safeguard."]}],"word_count":818,"content_hash":"sha256-d5604cbfe61556eb23b9b937d5837892c14e0cf74dce4743ff8f82c71c34affb","seo_keywords":["timeliness and completeness of data on adult learning pathways","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}