Sets out an evidence-led approach to improving AI competency frameworks, from problem definition to verification of sustained effect.
The present attention to the causes of underperformance in AI competency frameworks follows the international frameworks for students and teachers released in 2024 and requires a careful distinction between public commitment, institutional practice and demonstrated result. The analysis of the affected practice proceeds on the basis that effective improvement requires ownership, a time-bound intervention and independent confirmation that the intended result has been achieved. The public-interest question is whether access, learning, fair treatment and reliable information are protected in proportion to the identified risk.
The formal status of the international frameworks for students and teachers released in 2024 should be preserved in any public account. Adoption records an agreed instrument or policy position; it does not necessarily make every provision directly enforceable in every jurisdiction. For the improvement priority, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary. Domestic law and authorised guidance continue to determine specific legal duties.
International artificial-intelligence competency frameworks for students and teachers were released in September 2024. They organise capability around human-centred understanding, ethics, techniques and application, with teacher responsibilities also covering pedagogy and professional development. Competency frameworks guide curriculum and workforce planning; they do not establish that competence has been achieved without suitable learning and assessment evidence.
Implementation of the affected practice should be organised around a decision that can be tested. Oversight of the corrective programme should reflect the principle that a complete improvement record should define the baseline, affected scope, causal hypothesis, responsible owner, resources, milestones and measures of effectiveness. The implementation record should link purpose, authority, resources, operation and reported result.
The present position
The system and institutional dimensions of the causes of underperformance in AI competency frameworks should be considered together. A decision concerning the affected practice should recognise that technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. Public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control. Responsibility at one level cannot be treated as a substitute for action required at the other.
The technical issue within the intervention concerns the basis on which a conclusion is reached. For the intervention, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Assurance should examine the complete process, including each change in custody, authority or decision ownership. The decision record should distinguish the scope supported by evidence from any scope that remains unresolved.
The principal risks in relation to the matter under review are opaque use of personal or inferred data, unclear responsibility between providers and suppliers, automation bias in consequential decisions, and loss of meaningful human review. The relationship between the risks is material: one failed safeguard may remove the evidence needed to activate another. Documents should be tested against the decision process they record and the outcome that followed.
Relevant evidence for the intervention will normally include supplier change and incident records, an inventory of systems and their intended uses, documented authority for each consequential use, data provenance and access controls, and pre-deployment and periodic performance testing. Evidence should be current for the reference period, attributable and representative of the conclusion's stated scope. The record should retain disagreement between sources until its cause and effect are understood.
Implications for automated and data-supported education
The review method for the causes of underperformance in AI competency frameworks should be reproducible. For the improvement priority, the reviewer should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Recurrence, common cause or wider exposure requires systemic action in addition to correction of individual cases. Working papers should allow another competent reviewer to understand the evidence, judgement and treatment of material exceptions.
Improvement of the affected practice should proceed through controlled tests where risk permits. Each test should record the starting condition, change introduced, population affected and result. Wider adoption should follow evidence of benefit and acceptable unintended effects. Where immediate broad action is required, enhanced monitoring should compensate for the absence of a prior limited test.
Decisions concerning the improvement priority should remain traceable to the information available for the stated reference period. A revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. Without this distinction, a reporting change may be mistaken for improvement or deterioration in educational practice.
Testing implementation and effect
Care is required in drawing conclusions about the causes of underperformance in AI competency frameworks. For the affected practice, a technical capability is not evidence that a use is educationally justified. Accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. For the matter under review, methods should be proportionate to the significance and recurrence of the problem; low-risk local issues and systemic learner-protection failures require different levels of control. A finding should not be separated from limitations capable of changing how it is understood or applied.
Public reporting on the matter under review should distinguish established fact, analytical judgement and planned action. A material change should not remove the earlier position from the evidential trail. A revised conclusion should distinguish a change in the underlying condition from a change in method, coverage or evidence.
The appropriate response to the intervention is therefore one of controlled implementation and review. Neither administrative activity nor general assurance should obscure the intended result or its effect on learners. Where evidence cannot support assurance, the limitation should be reported and corrective work should remain open.