Research integrity: responsibilities, evidence and follow-up

The present attention to research integrity follows the revised recommendation on science and scientific researchers and requires a careful distinction between public commitment, institutional practice and demonstrated result. The analysis of the corrective programme proceeds on the basis that the method set out here treats improvement as a controlled cycle of diagnosis, action, measurement and review. The decision should address both public impact and the responsibilities attached to entrusted educational resources. Systems may organise responsibility differently while remaining accountable for comparable public results.

Purpose and present context

The formal status of the revised recommendation on science and scientific researchers should be preserved in any public account. Adoption records an agreed instrument or policy position; it does not necessarily make every provision directly enforceable in every jurisdiction. For research integrity, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary. Domestic law and authorised guidance continue to determine specific legal duties.

A proper examination of the matter should establish the intended outcome before selecting controls or indicators. A decision concerning the corrective programme should recognise that the intervention should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved.

A narrow control over the improvement priority may create false assurance. In the present context, inconsistent judgement between markers or locations, uncontrolled changes to assessment and weak assurance of authorship or performance may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. Adverse cases should form part of the sample wherever they may reveal a material control weakness.

The analysis of the intervention should make its decision rule explicit. For the affected practice, effectiveness is the demonstrated change in the condition the action was intended to address. Completion of training, publication of guidance or installation of a system is an output and should not be reported as an outcome without further evidence. A stated decision rule enables comparable examination and limits retrospective explanations of adverse evidence.

Assurance of the intervention should draw on more than one form of evidence. Useful records include assessment maps to learning outcomes, marking criteria and calibrated judgement, appeal and correction records, moderation and exception records, and analysis of results and differential outcomes. Documents should be reconciled with observed practice and, where relevant, the experience of affected learners. A selected successful case does not establish effectiveness across the system.

Application in practice

The analysis of research integrity should remain within the limits of the evidence. For the improvement priority, correcting an individual record does not establish that the process which produced the error has been corrected. In reviewing the corrective programme, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. Material uncertainty should result in further enquiry or an expressly limited finding.

Records relating to the matter under review should preserve both the conclusion and its limits. New evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.

• Define the decision each assessment must support and retain evidence sufficient for independent review.
• Calibrate assessors and retain evidence sufficient for independent review.
• Moderate material variation, with responsibility, scope and timing recorded.
• Review differential and anomalous results and retain evidence sufficient for independent review.
• Retain evidence sufficient for review within a defined period and review the result.

Information required for oversight

A proportionate method is available for research integrity. A competent review of the affected practice should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects. Continue monitoring long enough to determine whether the improvement is sustained. Averages should be tested against adverse cases that may indicate unequal effect or incomplete operation.

A decision to close improvement work on the intervention should be made by a person with authority and sufficient independence from implementation. The closure evidence should cover the relevant period and scope, include adverse cases and show whether the change is sustained. Recurrence or unequal effect should trigger renewed analysis rather than automatic repetition of the same intervention.

• Did the effect reach the intended group?
• What was the baseline?
• Has the improvement been sustained?
• When should an effect be visible?
• What condition should change?

Limitations and safeguards

For research integrity, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Material action requires a named responsible function and a defined completion point. Evidence of outcome, rather than completion of tasks, should determine whether corrective work can close.

The system and institutional dimensions of the intervention should be considered together. The analysis of the intervention proceeds on the basis that assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Authorities and providers hold different responsibilities, both of which must be discharged for the arrangement to operate reliably. Responsibility at one level cannot be treated as a substitute for action required at the other.

The measure of progress on the matter under review is not the amount of policy or documentation produced. A credible measure shows whether the intended result is present across the affected scope and what action follows when it is not.