Explains cross-setting evidence in relation to teacher AI capability, with attention to decision authority, material exceptions and continuing assurance.
The generative AI policy and practice provides the immediate context for teacher AI capability. The central issue is the meaning of the expectation in practice, including its scope, the evidence needed to demonstrate it and the circumstances in which it may not apply. Uniform administrative form is not required where equivalent public outcomes can be demonstrated.
Failure in relation to the matter may arise even where the stated policy is reasonable. Material concerns include opaque use of personal or inferred data, unverified outputs entering teaching or assessment, unequal performance across learner groups, and automation bias in consequential decisions. For teacher AI capability, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.
Applicable scope
In the context of teacher AI capability, responsibility should be identifiable at the point where consequential decisions are made. The matter, the assessment question is whether the control operates across the relevant sites, programmes, delivery modes and learner groups, including material exceptions. Incomplete evidence, unmanaged conflict, absent learner groups or material learner impact require a higher level of review.
The relevant context is provided by generative AI policy and practice. Its relevance to the matter should be assessed against the affected jurisdiction, learner population and form of provision. For decisions concerning teacher AI capability, the international development warrants attention, but a consequential conclusion still requires current, attributable and representative evidence for the affected scope.
In work concerning teacher AI capability, international guidance on generative artificial intelligence in education and research was released in September 2023. It calls for a human-centred approach, protection of data privacy, age-appropriate use, validation and institutional capacity. Immediate provider controls should address authorised uses, assessment, disclosure, information security, unequal access and human review while evidence on educational benefit and risk continues to develop.
As regards teacher AI capability, analysis should make its decision rule explicit. Within the scope under review, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Transfer of decisions or records can expose weaknesses not visible in separate reviews of individual controls. A stated decision rule enables comparable examination and limits retrospective explanations of adverse evidence.
- Retain accountable human decision-makers.
- Prohibit uses for which evidence or authority is insufficient, identifying the accountable function and affected scope.
- Notify users of material limitations.
- Control personal and confidential information.
- Review incidents and supplier changes before it is relied on for a decision with material effect.
Implementation and evidence
Interpretation of teacher AI capability should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. For the applicable expectation, a technical capability is not evidence that a use is educationally justified. Accuracy measured in one setting may not transfer to another population, language, curriculum or decision context. A prescribed method should not be treated as the only acceptable method where another approach establishes the same outcome with equivalent evidence.
When examining teacher AI capability, assurance of the matter should draw on more than one form of evidence. Useful records include documented authority for each consequential use, an inventory of systems and their intended uses, pre-deployment and periodic performance testing, learner information and accessible challenge routes, and supplier change and incident records. Evidence of effectiveness should represent the declared scope, including adverse and exceptional cases.
When examining teacher AI capability, records relating to the assurance conclusion should preserve both the conclusion and its limits. The correction record should state what the new evidence changes and which earlier conclusions or decisions require review. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.
Assessment of conformity
The review method for teacher AI capability should be reproducible. The assurance conclusion, the reviewer should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Review should determine whether correction can remain case-specific or must extend across the system. Working papers should allow another competent reviewer to understand the evidence, judgement and treatment of material exceptions.
Interpretation of teacher AI capability should produce a test that another competent reviewer can apply to comparable evidence.
- What outcome is intended?
- Where do exceptions occur?
- Which evidence establishes operation?
- What action is required by the finding?
- Who controls each stage?
Review and corrective action
For teacher AI capability, the public interest is not confined to institutional compliance. Technology may support teaching, administration and access, but consequential educational decisions must remain accountable, explainable and open to effective review. Learner protection requires intelligible information and a timely means of reviewing consequential mistakes or unfair decisions.
The matter, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. For teacher AI capability, material action requires a named responsible function and a defined completion point. Closure requires evidence that the condition has changed; completion of planned activity is not sufficient.
The decision record for teacher AI capability should state the unsupported element and the further work required.