{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-942f7b5da4ecdc44","slug":"2018-05-09-closing-the-evidence-loop-in-evidence-based-interventions","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2018-05-09","last_modified_date":"2018-05-09","title":"Closing the evidence loop in evidence-based interventions","summary":"Provides an evidence-led method for improving closing the evidence loop in evidence-based interventions, from definition of the problem to review of effectiveness and residual.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"World Development Report 2018","reference_authority":"World Bank","sections":[{"heading":null,"paragraphs":["Current consideration of evidence-based interventions is informed by the World Development Report 2018, with consequences for governance, evidence and the treatment of affected learners. For the corrective programme, improvement should begin with a defined problem, a credible account of its causes and a measure capable of showing whether the response has worked. The assessment addresses decisions capable of affecting learners, institutions or the proper use of entrusted educational resources. Assessment should focus on the public outcome rather than presume one administrative arrangement.","The system and institutional dimensions of the improvement objective should be considered together. A decision concerning the improvement objective should recognise that quality assurance should connect stated educational purposes with implemented controls, reliable evidence and action where outcomes fall below expectation. In relation to closing the evidence loop in evidence-based interventions, the allocation of responsibility should prevent gaps between system oversight and institutional operation."]},{"heading":"Scope of the improvement","paragraphs":["Evidence collection should be designed around the decision question rather than administrative convenience. For evidence-based interventions, the most relevant material is likely to include implementation and monitoring records, exception and complaint records, representative outcome information, and learner and staff evidence.","The stated reference is World Development Report 2018. Interpretation should preserve the unit and population represented in the data collection. A national or international pattern may justify closer review of the improvement objective, but provider-level action requires evidence relating to the affected provision. The comparability record should identify material variation in coverage, period and classification.","The World Development Report 2018, Learning to Realize Education’s Promise, distinguishes schooling from learning and describes poor outcomes, immediate barriers within teaching and learning, and deeper system-level causes. It proposes three connected directions: assess learning, act on evidence and align actors around learning. Attendance and completion remain important, but they do not provide direct evidence that learners have acquired the intended knowledge and skills.","In practical terms, the corrective programme should be reviewed against a stated method rather than general assurance. In reviewing the issue under review, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. A failure at an interface may have greater learner impact than a weakness confined to one function. Decision-makers should receive an intelligible account of how the result was reached and where it should not be applied.","Risk assessment of the corrective programme should give particular attention to corrective action closed on activity rather than effect, evidence selected to confirm a preferred conclusion, and policy detached from practice. A provider should also consider variation across sites or programmes and responsibility distributed without clear ownership. Stronger controls are required where learners may not detect an error or where later correction cannot restore the lost opportunity."]},{"heading":"Implementation responsibilities","paragraphs":["Responsibility for evidence-based interventions should be visible at the point where consequential decisions are made. For the issue under review, follow-up should determine whether the change is embedded in ordinary operations and whether it has created new risks or unequal effects. Incomplete evidence, unmanaged conflict, absent learner groups or material learner impact require a higher level of review.","Where the intervention involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Contractual or inter-agency arrangements should identify who holds records, informs learners and acts on incidents. In relation to closing the evidence loop in evidence-based interventions, multiple delivery partners do not justify fragmented accountability or remedy.","Accountability and effective correction both depend on a record that can be followed from evidence to decision. For the issue under review, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. Historical decisions should be assessed against the information then available, with later amendments separately dated and explained."],"bullets":["Review whether improvement is sustained.","Assign accountable ownership before using it to determine a learner or provider outcome.","Collect proportionate evidence.","Define the intended outcome before it informs a consequential decision.","Act on adverse findings."]},{"heading":"Testing effectiveness","paragraphs":["The review method for evidence-based interventions should be reproducible. A competent review of the improvement objective should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. The retained analysis should be reproducible from the selected evidence, decision rule and recorded reasons for accepted exceptions.","Improvement of the corrective programme should proceed through controlled tests where risk permits.","Conclusions concerning the improvement objective require careful treatment of scope and evidential limits. For the improvement objective, quality cannot be inferred from reputation, intention or documentation alone. Assurance requires evidence of actual operation together with its material effects. Oversight of the practice should reflect the principle that improvement data should not be selected only because it is readily available. Limitations should be prominent wherever the finding may influence a consequential decision.","Authorities and providers should use the current development to test whether the intervention connects public commitment with effective operation and evidence of result. Institutional improvement and public confidence both depend on transparent responsibility and credible evidence."]}],"word_count":835,"content_hash":"sha256-06ce8c5866503fccb8da51c333793e86ee70e2e5ed4a741ba6b185e4d6f65e52","seo_keywords":["closing the evidence loop in evidence-based interventions","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}