Considers the controls required to improve reading, mathematics and science outcomes and to distinguish completed activity from demonstrated change.
The PISA 2009 results released on 7 December 2010 provides the immediate context for reading, mathematics and science outcomes. Any indicator used in relation to internal review of the intervention should distinguish description from causal explanation. Material variation and uncertainty should be reported together with any restriction on wider application. Any indicator used in relation to the affected practice should distinguish description from causal explanation. A reported result should state how outcomes are distributed and where transfer beyond the observed setting is not supported. Improvement work on the intervention should begin with a verified problem, defined baseline and measurable outcome. Completion should depend on evidence of effect rather than completion of planned activity.
Consideration of the affected practice should retain the date and status of PISA 2009 results released on 7 December 2010. Later developments should not be read into the position available at publication. Improvement work on the corrective programme should begin with a verified problem, defined baseline and measurable outcome. Any indicator used in relation to the matter under review should distinguish description from causal explanation. The result should be accompanied by distributional information, uncertainty and limits on transfer to another setting.
Scope of this analysis
The reference basis—the PISA 2009 results released on 7 December 2010—is evidential rather than self-executing. The source can frame further questions without supplying either a binding direction or proof of causation. Any indicator used in relation to reading, mathematics and science outcomes should distinguish description from causal explanation.
Improvement work on the improvement priority should begin with a verified problem, defined baseline and measurable outcome. Data used for the affected practice should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result. The regulatory setting is determined by public authorities, but responsibility for controlled provision remains with the provider. Governance of the intervention requires a clear allocation of authority, information and follow-through. Material matters should be referred to the body authorised to act or accept residual risk.
The review method for internal review of the improvement priority should connect the question under examination to suitable evidence and a conclusion no broader than the tested scope. Corrective action concerning the improvement priority should address the identified cause, assign responsibility and set a review period. Residual risk should remain open until sustained improvement is demonstrated. Organisational location alone does not establish independence. The decision question, affected scope and measure should align; otherwise the conclusion may be unsupported despite substantial documentation.
Apparent movement caused by revision should not be attributed to educational performance. For reading, the corrective programme, the intervention should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners.
Failure in relation to reading, the corrective programme may arise even where the stated policy is reasonable. Data used for the improvement priority should be interpreted against stable definitions and an identifiable population. Risk assessment for the corrective programme should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.
The evidential record should be limited to material that can answer the question under review. Any indicator used in relation to the improvement priority should distinguish description from causal explanation. Intervention in the matter under review should be proportionate to the identified condition and tested where risk permits. Wider implementation should follow evidence of benefit and acceptable unintended effects.
Application in practice
Improvement work on reading, mathematics and science outcomes should begin with a verified problem, defined baseline and measurable outcome. Risk assessment for internal review of the intervention should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material. The principal risks associated with the intervention should be assessed as connected conditions. A failed safeguard may conceal another weakness or prevent timely correction. The assurance record for the improvement priority should permit another competent reviewer to understand the evidence, method, judgement and treatment of material exceptions.
The record for the affected practice should identify the responsible function, decision authority and escalation route. Gaps between public oversight and provider control should not remain implicit. Corrective action concerning the matter under review should address the identified cause, assign responsibility and set a review period.
Corrective action concerning the intervention should address the identified cause, assign responsibility and set a review period. Data used for the corrective programme should be interpreted against stable definitions and an identifiable population. A conclusion should be qualified where unresolved uncertainty may affect the decision.
Decisions concerning reading, the matter under review should remain traceable to the information available for the stated reference period. The reason for revision should be explicit, including whether it arises from new evidence, a methodological change or a different interpretation. Users should not be left to infer a change in performance where the observed movement results from revised reporting.
Where reading, the corrective programme involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Protection should operate across the complete service, irrespective of how delivery is divided.
Any indicator used in relation to the intervention should distinguish description from causal explanation. Risk assessment for the intervention should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.