AI competency frameworks: implications for institutional accountability

The international frameworks for students and teachers released in 2024 provides the immediate context for AI competency frameworks. The immediate task for education authorities is to distinguish the policy objective from the legal and operational measures needed to give it effect. The control response should be sufficient to protect learners while avoiding burdens not justified by the evidence.

The formal status of the international frameworks for students and teachers released in 2024 should be preserved in any public account. For the policy position, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary.

For AI competency frameworks, international artificial-intelligence competency frameworks for students and teachers were released in September 2024. They organise capability around human-centred understanding, ethics, techniques and application, with teacher responsibilities also covering pedagogy and professional development. Competency frameworks guide curriculum and workforce planning; they do not establish that competence has been achieved without suitable learning and assessment evidence.

Policy context for AI competency frameworks

For AI competency frameworks, the public interest is not confined to institutional compliance. Technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. Where learners rely on published information or support decisions, errors should be identifiable and capable of prompt, fair correction.

Review of the arrangements should be based on a stated method rather than general assurance. When examining AI competency frameworks, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Handovers between responsible functions require examination because material control gaps may otherwise remain concealed.

The principal risks in relation to implementation are unverified outputs entering teaching or assessment, unclear responsibility between providers and suppliers, opaque use of personal or inferred data, and loss of meaningful human review. For decisions concerning AI competency frameworks, a weakness in one part of the control environment may obscure a related failure elsewhere. Documents should be tested against the decision process they record and the outcome that followed.

Responsibilities and affected parties

Relevant evidence for AI competency frameworks will normally include supplier change and incident records, records of human review and overrides, pre-deployment and periodic performance testing, an inventory of systems and their intended uses, and learner information and accessible challenge routes. Currency, provenance and representativeness should be established before evidence is used for assurance. Within the scope under review, conflicting records require reconciliation before a complete assurance conclusion is reached.

For AI competency frameworks, accountability and effective correction both depend on a record that can be followed from evidence to decision. For the issue, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. A material amendment should record its reason and effective date, preserving the information basis of earlier decisions.

• Notify users of material limitations before using it to determine a learner or provider outcome.
• Prohibit uses for which evidence or authority is insufficient.
• Control personal and confidential information before using it to determine a learner or provider outcome.
• Review incidents and supplier changes before using it to determine a learner or provider outcome.
• Classify uses by effect on learners.

Implementation risks

A proper review of AI competency frameworks should establish the intended outcome before selecting controls or indicators. For the arrangements, oversight should test whether formal commitments are reflected in decisions, resource allocation, provider conduct and accessible routes for review. The record for AI competency frameworks should explain why the approach suits the affected context, how material departures are authorised and when review will occur.

Review of the measure should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. In work concerning AI competency frameworks, an isolated incident and a recurring or systemic condition require different findings and responses. Contrary evidence should not be removed merely because aggregate performance appears acceptable.

For decisions concerning AI competency frameworks, the implementation record for the policy position should identify the instrument being applied, its status, the competent authority, the affected jurisdiction and the action expected of each responsible body. Legal obligation, policy position and institutional response should each retain their proper status. Transition arrangements require defined dates, protections during implementation and a scheduled assessment of readiness.

Public reporting on implementation should distinguish established fact, analytical judgement and planned action. In work concerning AI competency frameworks, material revisions should be traceable to their reason and effective date.

Oversight and follow-up

Interpretation of AI competency frameworks should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. A technical capability is not evidence that a use is educationally justified. Accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. Public authorities should avoid imposing administrative activity that cannot be connected to a defined risk, right or educational outcome.

Neither one indicator nor one control can establish the complete position on the policy position. As regards AI competency frameworks, a reasoned conclusion should reconcile the governing requirement, evidence of operation, learner outcomes and residual risk, and remain open to better evidence.