Using administrative data to examine academic integrity incidents and outcomes

Against the background of the expanded remote assessment and digital resources, education authorities and providers should review how administrative data to examine academic integrity incidents and outcomes is defined, implemented and evidenced. The available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison.

A narrow control over the comparison may create false assurance. In the present context, assessment methods that do not support valid judgements, technology access determining educational access and supplier dependency without continuity controls may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage.

Analytical scope

Implementation of administrative data to examine academic integrity incidents and outcomes should be organised around a decision that can be tested. Trend claims require comparable observations over time and a documented account of revisions, breaks in series and changes in coverage. Resources and activity should be reconciled with the operating evidence and result for which the responsible function is accountable.

This analysis is informed by expanded remote assessment and digital resources. Its relevance to the measure should be assessed against the affected jurisdiction, learner population and form of provision.

In the context of academic integrity incidents and outcomes, the analysis should make its decision rule explicit. A proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. Comparable evidence should be assessed against criteria settled before the result is known.

• Provide alternative routes for material barriers before it informs a consequential decision.
• Define the educational purpose of the technology.
• Support staff and learners before it informs a consequential decision.
• Maintain continuity and supplier exit controls.
• Test access before requiring use.

Definitions and data coverage

Care is required in drawing conclusions about administrative data to examine academic integrity incidents and outcomes. Digital participation data should not be treated as a direct measure of learning. Log-ins, connection time and activity counts require interpretation alongside assessment and learner experience. International comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another. Limitations should be prominent wherever the finding may influence a consequential decision.

Within the scope under review, each source should have a stated purpose in supporting or limiting the conclusion. For the measure, the most relevant material is likely to include learner access and participation information, delivery-mode design and approval records, teacher capability and workload information, and supplier performance and exit arrangements. For academic integrity incidents and outcomes, independent records should be reconciled, with disagreement and uncertainty reported alongside the finding.

The assurance record for academic integrity incidents and outcomes should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. Traceable source and version information allow genuine improvement to be distinguished from administrative revision. The evidential history should preserve conclusions that were operative when a material decision was made.

Use of the findings

Authorities and providers reviewing administrative data to examine academic integrity incidents and outcomes should proceed in a defined sequence. Review of the available evidence should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. The record for academic integrity incidents and outcomes should distinguish a finding that requires action from an observation that supports no formal conclusion.

In work concerning academic integrity incidents and outcomes, decision-makers using evidence on the measure should be told what the data cannot establish as clearly as what it can. The nature of the result and its applicable unit—system, institution, programme or learner group—should be explicit. Application in another setting depends on a separate examination of context and comparability.

• For which groups may it fail?
• What outcome does the proxy represent?
• Is direct evidence available?
• Would the decision change if the proxy were inaccurate?
• What evidence supports the relationship?

Uncertainty and safeguards

As regards academic integrity incidents and outcomes, the central objective should not be obscured by the form of the administrative response. A change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Within the scope under review, assurance should not stop at adoption, resourcing or completion of administrative tasks. Implementation evidence should be sufficient to identify unequal consequences and assign corrective responsibility.

Public reporting on academic integrity incidents and outcomes should distinguish established fact, analytical judgement and planned action.

In the context of academic integrity incidents and outcomes, assurance should be withheld for the affected scope until the limitation is resolved.