Quality improvement method

Internal review of implementation of AI literacy obligations

Quality Improvement Methods

Sets out an evidence-led approach to improving implementation of AI literacy obligations, from problem definition to verification of sustained effect.

In 2025, consideration of implementation of AI literacy obligations must take account of the regional artificial intelligence rules applicable from February 2025 and the responsibilities it places before education systems. A decision concerning the corrective programme should recognise that a disciplined improvement process separates immediate containment from corrective action directed at the underlying cause. The effect on learner access and reliable decision-making should inform the scale of control applied.

A proper review the matter under review should establish the intended outcome before selecting controls or indicators. In reviewing the corrective programme, a complete improvement record should define the baseline, affected scope, causal hypothesis, responsible owner, resources, milestones and measures of effectiveness. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved.

Scope of this analysis

The applicability described by the regional artificial intelligence rules applicable from February 2025 changes the implementation context for implementation of AI literacy obligations. Entry into force or applicability establishes an operative reference point, but the resulting duties must still be traced to the persons, services and jurisdictions covered. Authorities should distinguish immediate duties from staged provisions, and providers should retain the legal and operational basis for any conclusion about application.

A focused examination of the matter under review requires a clear analytical discipline. In reviewing the intervention, review is independent when the reviewer is sufficiently separate from the design, operation and approval of the matter to reach and report an impartial conclusion. Organisational location alone does not establish independence. A formally complete record is not reliable if its scope or measure does not correspond to the decision being made.

Failure in relation to the matter under review may arise even where the stated policy is reasonable. Material concerns include unverified outputs entering teaching or assessment, loss of meaningful human review, opaque use of personal or inferred data, and unclear responsibility between providers and suppliers. An exception should be assessed by effect, duration, recurrence and reach, including possible exposure beyond the initial sample.

Relevant evidence for the corrective programme will normally include documented authority for each consequential use, pre-deployment and periodic performance testing, learner information and accessible challenge routes, records of human review and overrides, and data provenance and access controls. Evidence should be current for the reference period, attributable and representative of the conclusion's stated scope. Contradictory evidence should be investigated and resolved, not omitted from the record.

Implications for automated and data-supported education

The review method for implementation of AI literacy obligations should be reproducible. The method for the intervention is to define the review question and criteria, record competence and conflicts, preserve access to relevant evidence, and protect the reviewer’s ability to report adverse findings. Assign acceptance of residual risk to an authority outside the reviewed activity. Documentation should be sufficient to reconstruct the judgement without relying on unrecorded explanation.

The assurance record for the improvement priority should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. This enables later review to separate substantive change from correction, reclassification or expanded coverage. Revision should not remove an earlier conclusion from the record where reliance has occurred.

  • Who decides the response?
  • Can adverse findings be reported without alteration?
  • Who designed and operates the control?
  • Is competence established?
  • Does the reviewer have a relevant conflict?

Evidence and assurance

Where implementation of AI literacy obligations involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Governance between participating bodies should make information duties and corrective authority explicit. Learner safeguards should remain continuous where provision is delivered by several bodies.

The improvement record for the matter under review should contain the verified problem, affected scope, immediate containment, causal analysis, selected intervention, accountable owner, resources, milestones and effectiveness measure. Reporting should distinguish work performed from the outcome demonstrated after implementation. Closure reporting should not obscure unresolved action or risk retained by the responsible authority.

  • Prohibit uses for which evidence or authority is insufficient within a defined period and review the result.
  • Retain accountable human decision-makers, identifying the accountable function and affected scope.
  • Control personal and confidential information, including material exceptions and unequal effects.
  • Test performance across relevant groups, with responsibility, scope and timing recorded.
  • Classify uses by effect on learners before using it to determine a learner or provider outcome.

Conditions for responsible implementation

The quality significance of implementation of AI literacy obligations follows from a basic distinction between availability and effective provision. A decision concerning the affected practice should recognise that technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. Assurance should follow the learner journey and test more than a single access point or aggregate result.

Interpretation of the improvement priority should not extend beyond the population, period and setting examined. A decision concerning the intervention should recognise that a technical capability is not evidence that a use is educationally justified. Accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. In reviewing the affected practice, methods should be proportionate to the significance and recurrence of the problem; low-risk local issues and systemic learner-protection failures require different levels of control. Decision-makers and affected users should receive the conclusion together with its material evidential limits.

A complete conclusion on the improvement priority requires evidence extending beyond an individual measure or safeguard. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk.