Improvement work concerning reading, mathematics and science outcomes requires baseline evidence, responsible action, measurable outcomes, independent verification and follow-up.
For the corrective action, corrective action, the purpose of an improvement method is not to produce an action plan; it is to change a material condition and verify that the change is sustained.
For reading, mathematics and science outcomes, corrective action should be proportionate to the identified condition and tested where risk permits.
In assessing reading, mathematics and science outcomes, for reading, mathematics and science outcomes, the PISA 2018 results, released on 3 December 2019, give primary emphasis to reading and also report mathematics and science. They include evidence on performance and its distribution across participating systems. Users should distinguish the assessed constructs from broader claims about education quality, retain uncertainty in comparisons and examine whether aggregate results conceal material differences between learner groups.
Application to reading, mathematics and science outcomes
In the context of reading, mathematics and science outcomes, the central objective should not be obscured by the form of the administrative response. Oversight of the effectiveness of reading, mathematics and science outcomes should reflect the principle that education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation.
For reading, mathematics and science outcomes, completion should depend on evidence of effect rather than completion of planned activity. Corrective action concerning the intended improvement should address the identified cause, assign responsibility and set a review period. Residual risk should remain open until sustained improvement is demonstrated.
Risk assessment of reading, mathematics and science outcomes, the corrective action should give particular attention to proxy measures treated as direct outcomes, data revisions not carried through to published conclusions, and small differences overstated. A provider should also consider incomplete coverage and averages concealing distribution.
Controls for reading, mathematics and science outcomes
Relevant evidence for the effectiveness of reading, mathematics and science outcomes will normally include population and sampling information, disaggregated results, revision and comparability records, uncertainty estimates where relevant, and triangulation with administrative and qualitative evidence. Evidence outside the relevant period or scope should be identified and given no more weight than its limitations permit. Where reading, mathematics and science outcomes is under review, conflicting records require reconciliation before a complete assurance conclusion is reached.
Reporting on the matter should distinguish established fact, analytical judgement and planned action. For reading, mathematics and science outcomes, material revisions should retain their reason and effective date.
- Define the decision the indicator will inform.
- Avoid causal claims unsupported by the design.
- Analyse missing information.
- Disaggregate material results.
- Test comparability, with responsibility, scope and timing recorded.
Review of reading, mathematics and science outcomes
Responsibility for the effectiveness of reading, mathematics and science outcomes should be visible at the point where consequential decisions are made.
A competent review of the corrective action, the matter should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects. In the context of reading, mathematics and science outcomes, continue monitoring long enough to determine whether the improvement is sustained.
When examining reading, mathematics and science outcomes, analysis should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Unfinished work and remaining exposure should be reported rather than absorbed into a general statement of progress.
Risk assessment for the matter should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material. For reading, mathematics and science outcomes, the action record should identify who is responsible and when implementation is due.
Implications for reading, mathematics and science outcomes
Proportionality in relation to the effectiveness of reading, mathematics and science outcomes does not mean reduced protection for learners exposed to greater risk. Oversight of the intended improvement, the corrective action should reflect the principle that measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. Review of the intended improvement should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event.
For reading, mathematics and science outcomes, progress is demonstrated when the intended educational result is achieved, adverse variation is identified and responsible bodies act where it is not.