{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-771074d2427adf66","slug":"2024-05-13-from-review-findings-to-sustained-improvement-in-post-pisa-improvement-planning","language":"en","publication_status":"PUBLISHED","publication_date":"2024-05-13","last_modified_date":"2024-05-13","title":"From review findings to sustained improvement in post-PISA improvement planning","summary":"Describes how improvement in post-PISA improvement planning can be planned, measured and maintained through clear responsibility and follow-up evidence.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"PISA 2022 follow-up during 2024","reference_authority":"Organisation for Economic Co-operation and Development","sections":[{"heading":null,"paragraphs":["The present attention to post-PISA improvement planning follows the PISA 2022 follow-up during 2024 and requires a careful distinction between public commitment, institutional practice and demonstrated result. The purpose of an improvement method is not to produce an action plan; it is to change a material condition and verify that the change is sustained.","The quality significance of the intervention follows from a basic distinction between availability and effective provision. Education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation."]},{"heading":"Improvement objective and baseline","paragraphs":["The evidential record for post-PISA improvement planning should permit a reviewer to trace the matter from decision to outcome. This may require coverage and missingness analysis, population and sampling information, disaggregated results, and uncertainty estimates where relevant, supported by triangulation with administrative and qualitative evidence and indicator definitions and metadata. For post-PISA improvement planning, sampling remains insufficient where it excludes a material group or cannot resolve contradictory evidence or recurrence.","The reference point is the PISA 2022 follow-up during 2024. Intervention in the intervention should be proportionate to the identified condition and tested where risk permits. Wider implementation should follow evidence of benefit and acceptable unintended effects. In the context of post-PISA improvement planning, decision-makers should state which matters are evidenced, which express policy and which require authorised judgement.","When examining post-PISA improvement planning, the first PISA 2022 results were released on 5 December 2023, with mathematics as the principal assessment domain and reading and science also reported. The cycle was conducted after major disruption to education systems. Comparisons require attention to participation, coverage and the exceptional context; changes from earlier cycles should not be attributed to a single cause without further evidence.","For decisions concerning post-PISA improvement planning, effectiveness is the demonstrated change in the condition the action was intended to address. In work concerning post-PISA improvement planning, completion of training, publication of guidance or installation of a system is an output and should not be reported as an outcome without further evidence.","A narrow control over the corrective programme may create false assurance. In the present context, proxy measures treated as direct outcomes, changes in definition presented as changes in performance and small differences overstated may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. As regards post-PISA improvement planning, adverse cases should form part of the sample wherever they may reveal a material control weakness."]},{"heading":"Controls and accountable action","paragraphs":["Where post-PISA improvement planning is under review, responsibility should be identifiable at the point where consequential decisions are made. For the assessment of post-PISA improvement planning, the intervention should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners.","Where the corrective programme involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. For post-PISA improvement planning, contractual or inter-agency arrangements should identify who holds records, informs learners and acts on incidents. In the context of post-PISA improvement planning, multiple delivery partners do not justify fragmented accountability or remedy.","When examining post-PISA improvement planning, decisions concerning the issue under review should remain traceable to the information available for the stated reference period. For decisions concerning post-PISA improvement planning, a revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation."],"bullets":["Report uncertainty and revisions.","Document numerator and denominator.","Test comparability.","Analyse missing information before using it to determine a learner or provider outcome.","Avoid causal claims unsupported by the design."]},{"heading":"Evidence of effect","paragraphs":["A competent review of the practice should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects. In work concerning post-PISA improvement planning, continue monitoring long enough to determine whether the improvement is sustained. As regards post-PISA improvement planning, contrary evidence should not be removed merely because aggregate performance appears acceptable.","A decision to close improvement work on post-PISA improvement planning should be made by a person with authority and sufficient independence from implementation.","For the assessment of post-PISA improvement planning, analysis should remain within the limits of the evidence. For the practice, methods should be proportionate to the significance and recurrence of the problem; low-risk local issues and systemic learner-protection failures require different levels of control. Measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. For post-PISA improvement planning, material uncertainty should result in further enquiry or an expressly limited finding.","Progress on from review findings to sustained improvement in post-PISA improvement planning under review is not the amount of policy or documentation produced. In the context of post-PISA improvement planning, the relevant measure is demonstrated public benefit, including detection and correction of material variation."]}],"word_count":793,"content_hash":"sha256-6b9b71522baa5bfa5e47862db0f421411ae8ec1d0a376b464bc05362d4664f76","seo_keywords":["from review findings to sustained improvement in post-PISA improvement planning","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}