Reporting learner agency: coverage and revision risk

Against the background of the automation and human-centred education policy, education authorities and providers should review how learner agency is defined, implemented and evidenced. The available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison. Learner protection and reliable information should remain central when the scale of the response is determined.

Evidence base for reporting learner agency

For learner agency, the public interest is not confined to institutional compliance. For the measure, technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. Where learners rely on published information or support decisions, errors should be identifiable and capable of prompt, fair correction.

• Notify users of material limitations.
• Prohibit uses for which evidence or authority is insufficient.
• Review incidents and supplier changes.
• Retain accountable human decision-makers before it informs a consequential decision.
• Test performance across relevant groups, with responsibility, scope and timing recorded.

Coverage and comparability

Automation and human-centred education policy provides the reference point for this analysis. Its relevance to learner agency should be assessed against the affected jurisdiction, learner population and form of provision.

Analysis should make its decision rule explicit. Data quality comprises accuracy, completeness, timeliness, consistency and traceability. When examining learner agency, strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. This supports consistent review and reduces the risk of redefining the basis of judgement after an adverse result appears.

Responsible interpretation

Implementation of learner agency should be organised around a decision that can be tested. For the analysis, where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. Oversight requires a traceable line from the approved objective through responsible action to evidence of outcome.

The principal risks in relation to the available evidence are unclear responsibility between providers and suppliers, unequal performance across learner groups, automation bias in consequential decisions, and loss of meaningful human review. For decisions concerning reporting learner agency, the relationship between the risks is material: one failed safeguard may remove the evidence needed to activate another.

• Are validation rules operating?
• Can reported values be traced to source?
• Who may amend a record?
• What proportion is missing or late?
• Are revisions carried through to public reports?

Limitations and reporting

The evidential record for learner agency should permit a reviewer to trace the matter from decision to outcome. This may require learner information and accessible challenge routes, an inventory of systems and their intended uses, pre-deployment and periodic performance testing, and documented authority for each consequential use, supported by records of human review and overrides and supplier change and incident records. Sampling remains insufficient where it excludes a material group or cannot resolve contradictory evidence or recurrence.

Responsible bodies should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. In work concerning learner agency, escalate discrepancies that could alter a published conclusion or individual outcome. Adverse cases and unresolved contradictions should be retained because they may reveal limitations concealed by an average result.

Limitations and reporting

Decision-makers using evidence on learner agency should be told what the data cannot establish as clearly as what it can. The nature of the result and its applicable unit—system, institution, programme or learner group—should be explicit. Use in a different context requires an independent judgement that the settings are materially comparable.

Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. As regards learner agency, a technical capability is not evidence that a use is educationally justified. Within the scope under review, accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. Association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. No exception should continue without a documented basis, accountable approval and scheduled review.

For reporting learner agency, decisions concerning the analysis should remain traceable to the information available for the stated reference period. Changes in condition, evidence, method and interpretation should be recorded separately when a conclusion is revised.

Accountability for reporting learner agency should follow decision-making authority. Operational tasks may be delegated, but accountability for material effects on learners must remain identifiable.

Evidence concerning the available evidence should be current, attributable and representative of the affected scope. For decisions concerning learner agency, material gaps or contradictions should remain visible in the conclusion.