{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-b9dd443ae4b5496c","slug":"2018-02-13-learning-to-realise-educations-promise-measuring-learning-rather-than-attendance-alone","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2018-02-13","last_modified_date":"2018-02-13","title":"Learning to realise education’s promise: measuring learning rather than attendance alone","summary":"Assesses evidence on learning to realise education’s promise: measuring learning rather than attendance alone.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"World Development Report 2018","reference_authority":"World Bank","sections":[{"heading":null,"paragraphs":["The World Development Report 2018 provides the immediate context for learning to realise education’s promise. Oversight of the measure should reflect the principle that the value of the present data lies in the questions it can answer reliably and in the limits it makes visible.","The reference basis—the World Development Report 2018—is evidential rather than self-executing. Its value lies in identifying matters for examination; it should not be read as a legal instruction or causal finding. In applying it to the issue, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.","The World Development Report 2018, Learning to Realize Education’s Promise, distinguishes schooling from learning and describes poor outcomes, immediate barriers within teaching and learning, and deeper system-level causes. It proposes three connected directions: assess learning, act on evidence and align actors around learning. Attendance and completion remain important, but they do not provide direct evidence that learners have acquired the intended knowledge and skills."]},{"heading":"Evidence base for learning to realise education’s promise","paragraphs":["The system and institutional dimensions of learning to realise education’s promise should be considered together. Oversight of the measure should reflect the principle that quality assurance should connect stated educational purposes with implemented controls, reliable evidence and action where outcomes fall below expectation. In relation to learning to realise education’s promise, public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control. Each level should be able to demonstrate the decisions and controls for which it is accountable.","The analysis of the comparison should make its decision rule explicit. For the available evidence, a proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. Comparable evidence should be assessed against criteria settled before the result is known.","A narrow control over the analysis may create false assurance. In the present context, learner experience omitted from review, responsibility distributed without clear ownership and variation across sites or programmes may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. A sample confined to compliant cases cannot establish the reliability of the control."]},{"heading":"Coverage and comparability","paragraphs":["Assurance of learning to realise education’s promise should draw on more than one form of evidence. Useful records include learner and staff evidence, implementation and monitoring records, independent checks of material claims, representative outcome information, and exception and complaint records. A positive example may illustrate operation, but it cannot demonstrate coverage or consistency.","Records relating to the available evidence should preserve both the conclusion and its limits. The correction record should state what the new evidence changes and which earlier conclusions or decisions require review."],"bullets":["Collect proportionate evidence.","Identify the affected scope.","Review whether improvement is sustained.","Test material variation.","Assign accountable ownership."]},{"heading":"Responsible interpretation","paragraphs":["A proper review of learning to realise education’s promise should establish the intended outcome before selecting controls or indicators. Oversight of the comparison should reflect the principle that a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. The record should explain why the approach suits the affected context, how material departures are authorised and when review will occur.","Implementation of the measure can be tested without imposing unnecessary reporting. A competent review of the available evidence should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. Reuse of existing information is appropriate only where its purpose, scope and reliability correspond to the decision under review.","Decision-makers using evidence on the available evidence should be told what the data cannot establish as clearly as what it can. Reporting should state whether a result describes, compares or evaluates, together with the level at which it is valid. Application in another setting depends on a separate examination of context and comparability.","For the analysis, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Management should assign each material action to an accountable owner and completion date. Closure requires evidence that the condition has changed; completion of planned activity is not sufficient."]},{"heading":"Limitations and reporting","paragraphs":["Interpretation of learning to realise education’s promise should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. Oversight of the comparison should reflect the principle that quality cannot be inferred from reputation, intention or documentation alone. Documented intention should be tested against practice and observable result. In reviewing the analysis, missing or delayed information may be patterned rather than random.","The measure of progress on the analysis is not the amount of policy or documentation produced. In relation to learning to realise education’s promise, performance should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity."]}],"word_count":854,"content_hash":"sha256-4c28bb4de9f9eae657804bdef91f52001b4ccf5cdf250c11df5f4fdcc6838511","seo_keywords":["learning to realise education’s promise","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}