{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-dc71938a582cbf13","slug":"2006-02-08-adult-literacy-indicators-require-a-clearer-evidence-base","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2006-02-08","last_modified_date":"2006-02-08","title":"Adult literacy indicators require a clearer evidence base","summary":"Examines adult literacy indicators require a clearer evidence base, defining the evidence base, coverage and limits that should govern comparison and use of the findings.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"2006 Education for All Global Monitoring Report","reference_authority":"United Nations Educational, Scientific and Cultural Organization","sections":[{"heading":null,"paragraphs":["The 2006 Education for All Global Monitoring Report provides the immediate context for adult literacy indicators. the analysis proceeds on the basis that the value of the present data lies in the questions it can answer reliably and in the limits it makes visible. Systems may organise responsibility differently while remaining accountable for comparable public results.","The reference basis—the 2006 Education for All Global Monitoring Report—is evidential rather than self-executing. Any indicator used in relation to the analysis should distinguish description from causal explanation. The result should be accompanied by distributional information, uncertainty and limits on transfer to another setting. Any indicator used in relation to the comparison should distinguish description from causal explanation. Interpretation should retain uncertainty, distributional differences and limits on generalisation."]},{"heading":"Evidence and method","paragraphs":["The 2006 Education for All monitoring work places literacy at the centre of lifelong learning and examines progress towards the international commitment to improve adult literacy by 2015. It distinguishes formal schooling from the wider conditions that enable young people and adults to acquire and use literacy. This requires attention to participation, programme quality, language, gender, poverty and the reliability of literacy measurement.","Analysis of adult literacy indicators should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Reliability depends on preserving the material distinctions between the matters compared. In relation to adult literacy indicators require a clearer evidence base, public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control. The allocation of responsibility should prevent gaps between system oversight and institutional operation.","The evidential basis for the measure should identify source, period, coverage and material limitations. Corroboration is required where a single record cannot support the decision. Comparative findings should not conceal differences capable of changing their meaning. Any indicator used in relation to the measure should distinguish description from causal explanation. A control framework may fail at its interfaces even where each component appears satisfactory in isolation. Analysis of the available evidence should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. A comparison is reliable only if material differences remain visible.","Responsibility for the comparison should be visible at the point where consequential decisions are made. Any indicator used in relation to the issue should distinguish description from causal explanation. Arrangements for the available evidence should provide accurate information, timely support and an accessible route for correction or review without adverse treatment.","Relevant evidence for the available evidence will normally include transparent fees and recognition information, admission and prior-learning decisions, assessment in relevant contexts, learner and employer feedback where appropriate, and secure records of achieved learning. Currency, provenance and representativeness should be established before evidence is used for assurance. Public information on the analysis should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction."],"bullets":["Review claims against evidence.","Recognise prior learning against published criteria before it is relied on for a decision with material effect.","Maintain portable records.","Assess the stated competence.","State the purpose and limits of the learning offer."]},{"heading":"Patterns requiring examination","paragraphs":["Failure in relation to adult literacy indicators may arise even where the stated policy is reasonable. Material concerns include weak connection between training and intended competence, short programmes making unsupported outcome claims, limited routes for progression, and barriers created by time, cost or location. Review should consider whether an exception is prolonged, recurring or capable of affecting learners outside the cases examined.","Implementation of the available evidence can be tested without imposing unnecessary reporting. For the measure, the reviewer should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Evidence concerning the issue should be current, attributable and representative of the affected scope. Material gaps or contradictions should remain visible in the conclusion. In relation to adult literacy indicators require a clearer evidence base, information should not be treated as sufficient merely because it is already available; its relevance to the present question must be established.","Decision-makers using evidence on the issue should be told what the data cannot establish as clearly as what it can. Data used for the available evidence should be interpreted against stable definitions and an identifiable population. A revision or break in series should not be reported as a change in performance.","Conclusions concerning the issue require careful treatment of scope and evidential limits. the analysis proceeds on the basis that employment outcomes are affected by economic and labour-market conditions as well as education. Data used for the issue should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result. Data used for the analysis should be interpreted against stable definitions and an identifiable population. Apparent movement caused by revision should not be attributed to educational performance. Quantitative evidence should be considered with implementation records and the experience of affected learners. A finding should not be separated from limitations capable of changing how it is understood or applied.","For the measure, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. A decision concerning the issue should identify its basis, affected scope and responsible authority, together with any limitation requiring further review.","Public reporting on the comparison should distinguish established fact, analytical judgement and planned action. Records concerning the analysis should remain traceable from source evidence to decision and follow-up. Superseded conclusions should be retained where they informed a material outcome. Analysis of the issue should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.","Neither one indicator nor one control can establish the complete position on the issue. Review of the measure should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event."]}],"word_count":1001,"content_hash":"sha256-64391d40288841e2d982fe0429271b8e0d3103de837adbd98f204d04755c590f","seo_keywords":["adult literacy indicators require a clearer evidence base","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}