Improvement planning for learning outcome reporting processes under constrained resources

Corrective action concerning the intended improvement should address the identified cause, assign responsibility and set a review period. Residual risk should remain open until sustained improvement is demonstrated.

Data used for the corrective action should be interpreted against stable definitions and an identifiable population. For learning outcome reporting, apparent movement caused by revision should not be attributed to educational performance. Any indicator used in relation to the intended improvement should distinguish description from causal explanation. Corrective action concerning the corrective action should address the identified cause, assign responsibility and set a review period. Variation in population coverage, reference period or classification should accompany the reported comparison.

Application and scope

In the context of learning outcome reporting, the central objective should not be obscured by the form of the administrative response. Data used for learning outcome reporting processes should be interpreted against stable definitions and an identifiable population.

Any indicator used in relation to the corrective action should distinguish description from causal explanation. For learning outcome reporting, interpretation should retain uncertainty, distributional differences and limits on generalisation. Broad intentions should be converted into decisions capable of review.

Governance of improvement planning for learning outcome reporting processes under constrained resources requires a clear allocation of authority, information and follow-through. For decisions concerning learning outcome reporting, escalation should place material evidence before the authority capable of an effective response.

Corrective action concerning the matter should address the identified cause, assign responsibility and set a review period. This may require disaggregated results, revision and comparability records, population and sampling information, and triangulation with administrative and qualitative evidence, supported by indicator definitions and metadata and coverage and missingness analysis.

• Test comparability.
• Define the decision the indicator will inform, with responsibility, scope and timing recorded.
• Report uncertainty and revisions, with responsibility, scope and timing recorded.
• Disaggregate material results before it informs a consequential decision.
• Analyse missing information.

Controls relevant to improvement planning for learning outcome reporting processes under constrained resources

Risk assessment of learning outcome reporting processes should give particular attention to changes in definition presented as changes in performance, proxy measures treated as direct outcomes, and small differences overstated. A provider should also consider incomplete coverage and data revisions not carried through to published conclusions.

In reviewing learning outcome reporting, amend the plan where evidence does not support the original causal assumption. Review of corrective action should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event.

Governance of the matter requires a clear allocation of authority, information and follow-through.

Risk assessment for the corrective action should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material. In the context of learning outcome reporting, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. Risk assessment for the matter should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.

Across the defined scope, the evidential trail should allow an affected decision to be identified, examined and corrected. Governance of the corrective action requires a clear allocation of authority, information and follow-through. When examining learning outcome reporting, a material issue should not remain with a function lacking authority to resolve it. Historical decisions concerning learning outcome reporting should be assessed against the information then available, with later amendments separately dated and explained.

For learning outcome reporting, the action record should identify who is responsible and when implementation is due.

Data used for corrective action should be interpreted against stable definitions and an identifiable population. When examining learning outcome reporting, progress is demonstrated when the intended educational result is achieved, adverse variation is identified and responsible bodies act where it is not.