Examines the evidential basis for learner agency, with attention to definitions, coverage, reference periods and responsible use of findings.
Against the background of the automation and human-centred education policy, education authorities and providers should review how learner agency is defined, implemented and evidenced. The analysis of the evidence under review proceeds on the basis that the available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison. Learner protection and reliable information should remain central when the scale of the response is determined.
The present position
For learner agency, the public interest is not confined to institutional compliance. For the reported measure, technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. Where learners rely on published information or support decisions, errors should be identifiable and capable of prompt, fair correction.
- Notify users of material limitations within a defined period and review the result.
- Prohibit uses for which evidence or authority is insufficient within a defined period and review the result.
- Review incidents and supplier changes, recording who is responsible and which provision or learners are affected.
- Retain accountable human decision-makers before it informs a consequential decision.
- Test performance across relevant groups, with responsibility, scope and timing recorded.
Operational significance
The historical reference basis is the automation and human-centred education policy. Its relevance to learner agency should be assessed against the affected jurisdiction, learner population and form of provision. International developments provide context; decisions affecting learners require evidence that is current and representative of the setting concerned.
The analysis of the evidence under review should make its decision rule explicit. Oversight of the analytical question should reflect the principle that data quality comprises accuracy, completeness, timeliness, consistency and traceability. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. This supports consistent review and reduces the risk of redefining the basis of judgement after an adverse result appears.
Testing implementation and effect
Implementation of learner agency should be organised around a decision that can be tested. For the analytical question, where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. Oversight requires a traceable line from the approved objective through responsible action to evidence of outcome.
The principal risks in relation to the evidence under review are unclear responsibility between providers and suppliers, unequal performance across learner groups, automation bias in consequential decisions, and loss of meaningful human review. The relationship between the risks is material: one failed safeguard may remove the evidence needed to activate another. A reliable conclusion requires examination of the connected decision record, not a series of separate document checks.
- Are validation rules operating?
- Can reported values be traced to source?
- Who may amend a record?
- What proportion is missing or late?
- Are revisions carried through to public reports?
Proportionality and exceptions
The evidential record for learner agency should permit a reviewer to trace the matter from decision to outcome. This may require learner information and accessible challenge routes, an inventory of systems and their intended uses, pre-deployment and periodic performance testing, and documented authority for each consequential use, supported by records of human review and overrides and supplier change and incident records. Sampling remains insufficient where it excludes a material group or cannot resolve contradictory evidence or recurrence.
A proportionate method is available for the evidence under review. In reviewing the reported measure, responsible bodies should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. Escalate discrepancies that could alter a published conclusion or individual outcome. Adverse cases and unresolved contradictions should be retained because they may reveal limitations concealed by an average result.
Required management attention
Decision-makers using evidence on learner agency should be told what the data cannot establish as clearly as what it can. The nature of the result and its applicable unit—system, institution, programme or learner group—should be explicit. Use in a different context requires an independent judgement that the settings are materially comparable.
Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. Oversight of the reported measure should reflect the principle that a technical capability is not evidence that a use is educationally justified. Accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. In reviewing the comparison, association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. No exception should continue without a documented basis, accountable approval and scheduled review.
Decisions concerning the analytical question should remain traceable to the information available for the stated reference period. Changes in condition, evidence, method and interpretation should be recorded separately when a conclusion is revised. Users should not be left to infer a change in performance where the observed movement results from revised reporting.
Accountability for the comparison should follow decision-making authority. The decision must be referred to the authority capable of changing policy, allocating resources or formally accepting the remaining risk. Operational tasks may be delegated, but accountability for material effects on learners must remain identifiable.
Evidence concerning the evidence under review should be current, attributable and representative of the affected scope. Material gaps or contradictions should remain visible in the conclusion. Clear accountability and reliable evidence support improvement while maintaining public confidence in education.