{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-efe1e068e05b3062","slug":"2018-10-30-a-staged-improvement-plan-for-learning-adjusted-years-of-schooling","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2018-10-30","last_modified_date":"2018-10-30","title":"A staged improvement plan for learning-adjusted years of schooling","summary":"Provides an evidence-led method for improving a staged improvement plan for learning-adjusted years of schooling, from definition of the problem to review of effectiveness.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Human capital and learning outcome measurement","reference_authority":"World Bank","sections":[{"heading":null,"paragraphs":["The immediate international context is the human capital and learning outcome measurement. Its significance for learning-adjusted years of schooling lies in the quality of implementation rather than in formal acknowledgement alone. Oversight of the corrective programme should reflect the principle that the method set out here treats improvement as a controlled cycle of diagnosis, action, measurement and review. Learner protection and reliable decisions require controls commensurate with the nature and scale of risk.","Failure in relation to the intervention may arise even where the stated policy is reasonable. Material concerns include weak assurance of authorship or performance, inconsistent judgement between markers or locations, uncontrolled changes to assessment, and tasks that do not assess the stated outcome. In relation to a staged improvement plan for learning-adjusted years of schooling, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records."]},{"heading":"Defining the problem","paragraphs":["Implementation of learning-adjusted years of schooling should be organised around a decision that can be tested. Oversight of the practice should reflect the principle that the intervention should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners. In practice, the stated objective should connect to responsibility, committed resources, operating evidence and the outcome reported for oversight.","The contemporaneous context is established by the human capital and learning outcome measurement. It does not, without setting-specific evidence, demonstrate the operation of the practice. Decision-makers should state which matters are evidenced, which express policy and which require authorised judgement.","A focused examination of the improvement objective requires a clear analytical discipline. In reviewing the improvement objective, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Gaps may emerge when authority, records or action pass between responsible bodies."],"bullets":["Review differential and anomalous results before it informs a consequential decision.","Calibrate assessors.","Align tasks and criteria with learning outcomes.","Control changes before it informs a consequential decision.","Define the decision each assessment must support."]},{"heading":"Improvement method","paragraphs":["The analysis of learning-adjusted years of schooling should remain within the limits of the evidence. For the improvement objective, a short-term increase in activity may not represent sustained improvement. Measures should remain in place long enough to detect recurrence and unintended effects. A decision concerning the practice should recognise that reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. If uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.","Assurance of the issue under review should draw on more than one form of evidence. Useful records include analysis of results and differential outcomes, appeal and correction records, approval and change-control records, moderation and exception records, and marking criteria and calibrated judgement.","Records relating to the corrective programme should preserve both the conclusion and its limits. A changed evidential position should be applied to the affected scope, including prior decisions that may no longer be reliable. The correction process should identify prior users and decisions where published information has had material effect."]},{"heading":"Measures and review","paragraphs":["For operational review of learning-adjusted years of schooling, authorities and providers should proceed in a defined sequence. The method for the improvement objective is to map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. The conclusion should identify whether further sampling or system-level action is required.","Improvement of the improvement objective should proceed through controlled tests where risk permits."],"bullets":["Where do exceptions occur?","Which evidence establishes operation?","Who controls each stage?","What outcome is intended?","What action is required by the finding?"]},{"heading":"Residual risk and follow-up","paragraphs":["The required public outcome should be stated in operational terms. In reviewing learning-adjusted years of schooling, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Inputs and formal commitments should be distinguished from demonstrated operation and outcome. Implementation evidence should be sufficient to identify unequal consequences and assign corrective responsibility.","For the practice, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. In relation to a staged improvement plan for learning-adjusted years of schooling, the action record should identify who is responsible and when implementation is due.","The appropriate response to the corrective programme is therefore one of controlled implementation and review. A clear objective, proportionate evidential basis and account of affected learners are required. Where evidence cannot support assurance, the limitation should be reported and corrective work should remain open."]}],"word_count":761,"content_hash":"sha256-a28081a74533ac4f5a192f840c425236a94f27b87c6f22ef828cc3097541cca9","seo_keywords":["a staged improvement plan for learning-adjusted years of schooling","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}