Sets out a pathway from review findings to sustained improvement in post-PISA improvement planning, covering responsibility, outcome evidence, residual risk and sustained effect.
The present attention to post-PISA improvement planning follows the PISA 2022 follow-up during 2024 and requires a careful distinction between public commitment, institutional practice and demonstrated result. The purpose of an improvement method is not to produce an action plan; it is to change a material condition and verify that the change is sustained.
For decisions concerning post-PISA improvement planning, education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation.
Improvement objective and baseline
The evidential record for post-PISA improvement planning should permit a reviewer to trace the matter from decision to outcome. This may require coverage and missingness analysis, population and sampling information, disaggregated results, and uncertainty estimates where relevant, supported by triangulation with administrative and qualitative evidence and indicator definitions and metadata. Sampling remains insufficient where it excludes a material group or cannot resolve contradictory evidence or recurrence.
The reference point is the PISA 2022 follow-up during 2024. The corrective action should be proportionate to the identified condition and tested where risk permits. When examining post-PISA improvement planning, wider implementation should follow evidence of benefit and acceptable unintended effects. Decision-makers should state which matters are evidenced, which express policy and which require authorised judgement.
When examining post-PISA improvement planning, the first PISA 2022 results were released on 5 December 2023, with mathematics as the principal assessment domain and reading and science also reported. The cycle was conducted after major disruption to education systems. Comparisons require attention to participation, coverage and the exceptional context; changes from earlier cycles should not be attributed to a single cause without further evidence.
For decisions concerning post-PISA improvement planning, effectiveness is the demonstrated change in the condition the action was intended to address. Completion of training, publication of guidance or installation of a system is an output and should not be reported as an outcome without further evidence.
A narrow control over corrective action may create false assurance. In the present context, proxy measures treated as direct outcomes, changes in definition presented as changes in performance and small differences overstated may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. As regards post-PISA improvement planning, adverse cases should form part of the sample wherever they may reveal a material control weakness.
Controls and accountable action
Within the scope under review, responsibility should be identifiable at the point where consequential decisions are made. For post-PISA improvement planning, the corrective action should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners.
In work concerning post-PISA improvement planning, where responsibilities for delivery are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Contractual or inter-agency arrangements should identify who holds records, informs learners and acts on incidents. Multiple delivery partners do not justify fragmented accountability or remedy.
When examining post-PISA improvement planning, decisions concerning the matter should remain traceable to the information available for the stated reference period. A revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation.
- Report uncertainty and revisions.
- Document numerator and denominator.
- Test comparability.
- Analyse missing information before using it to determine a learner or provider outcome.
- Avoid causal claims unsupported by the design.
Evidence of effect
A competent review of the relevant practice should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects. In work concerning post-PISA improvement planning, continue monitoring long enough to determine whether the improvement is sustained. Contrary evidence should not be removed merely because aggregate performance appears acceptable.
A decision to close improvement work on post-PISA improvement planning should be made by a person with authority and sufficient independence from implementation.
For post-PISA improvement planning, analysis should remain within the limits of the evidence. For the relevant practice, methods should be proportionate to the significance and recurrence of the problem; low-risk local issues and systemic learner-protection failures require different levels of control. Measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. Material uncertainty should result in further enquiry or an expressly limited finding.
Progress on from review findings to sustained improvement in post-PISA improvement planning under review is not the amount of policy or documentation produced. The measure is demonstrated public benefit, including detection and correction of material variation.