Sets out a controlled approach to improving responsible education data use: a structured review method, covering diagnosis, responsible action.
The expanding public reporting and comparative indicators provide the immediate reference point for consideration of responsible education data use in 2017. Improvement of responsible education data use should begin with a defined problem, a credible account of its causes and a measure capable of showing whether the response has worked. Proportionality is demonstrated where learner safeguards and decision reliability correspond to the assessed risk.
The reference basis—the expanding public reporting and comparative indicators—is evidential rather than self-executing. When examining responsible education data use, the material may reveal patterns or evidential gaps, but it neither directs a legal outcome nor establishes causation. In applying it to the relevant practice, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.
For the intended improvement, the public interest is not confined to institutional compliance. For responsible education data use, education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation.
Defining the problem
Review of responsible education data use should be based on a stated method rather than general assurance. For the intended improvement, an improvement plan should connect a verified problem with a specific intervention, accountable ownership, resources, milestones and a measure of effect. Broad intentions should be converted into decisions capable of review. Those required to act should be able to understand the method and its material limitations.
In the context of responsible education data use, a proper review of the intended improvement should establish the intended outcome before selecting controls or indicators. The corrective action should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved.
Improvement method
The principal risks in relation to responsible education data use are incomplete coverage, proxy measures treated as direct outcomes, data revisions not carried through to published conclusions, and changes in definition presented as changes in performance. A weakness in one part of the control environment may obscure a related failure elsewhere. Documents should be tested against the decision process they record and the outcome that followed.
- Analyse missing information.
- Disaggregate material results, identifying the accountable function and affected scope.
- Test comparability.
- Report uncertainty and revisions.
- Avoid causal claims unsupported by the design.
Measures and review
The evidential record for responsible education data use should permit a reviewer to trace the matter from decision to outcome. This may require population and sampling information, triangulation with administrative and qualitative evidence, revision and comparability records, and indicator definitions and metadata, supported by uncertainty estimates where relevant and coverage and missingness analysis. Within the scope under review, conflicting records, absent populations and uncertain follow-through require additional testing.
The method for the relevant practice is to prioritise actions by learner impact and control weakness, establish dependencies, test implementation at suitable intervals and retain unresolved items until effectiveness is verified. As regards responsible education data use, amend the plan where evidence does not support the original causal assumption. The review record should preserve exceptions capable of showing a weakness in design, implementation or coverage.
Improvement of responsible education data use should proceed through controlled tests where risk permits.
Residual risk and follow-up
The analysis of responsible education data use should remain within the limits of the evidence. Improvement data should not be selected only because it is readily available. Measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work.
When examining responsible education data use, records relating to corrective action should preserve both the conclusion and its limits. A changed evidential position should be applied to the affected scope, including prior decisions that may no longer be reliable. The correction process should identify prior users and decisions where published information has had material effect.
In work concerning responsible education data use, for the corrective action, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Management should assign each material action to an accountable owner and completion date. Within the scope under review, an action may be complete while the underlying condition remains, and the two determinations should be recorded separately.
Progress on improving responsible education data use under review is not the amount of policy or documentation produced. Performance in relation to responsible education data use should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity.