{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-bdc4b11d80f69f49","slug":"2017-12-04-research-integrity-responsibilities-evidence-and-follow-up","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2017-12-04","last_modified_date":"2017-12-04","title":"Research integrity: responsibilities, evidence and follow-up","summary":"Sets out a controlled approach to research integrity: responsibilities, evidence and follow-up, linking diagnosis, accountable action, outcome measures and verification.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Revised recommendation on science and scientific researchers","reference_authority":"United Nations Educational, Scientific and Cultural Organization","sections":[{"heading":null,"paragraphs":["The present attention to research integrity follows the revised recommendation on science and scientific researchers and requires a careful distinction between public commitment, institutional practice and demonstrated result. The analysis of the corrective programme proceeds on the basis that the method set out here treats improvement as a controlled cycle of diagnosis, action, measurement and review. The decision should address both public impact and the responsibilities attached to entrusted educational resources. Systems may organise responsibility differently while remaining accountable for comparable public results."]},{"heading":"Scope of the improvement","paragraphs":["The formal status of the revised recommendation on science and scientific researchers should be preserved in any public account. For research integrity, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary.","A proper examination of the matter should establish the intended outcome before selecting controls or indicators. A decision concerning the corrective programme should recognise that the intervention should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved.","A narrow control over the improvement objective may create false assurance. In the present context, inconsistent judgement between markers or locations, uncontrolled changes to assessment and weak assurance of authorship or performance may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. In relation to research integrity, adverse cases should form part of the sample wherever they may reveal a material control weakness.","The analysis of the intervention should make its decision rule explicit. For the practice, effectiveness is the demonstrated change in the condition the action was intended to address. Completion of training, publication of guidance or installation of a system is an output and should not be reported as an outcome without further evidence. A stated decision rule enables comparable examination and limits retrospective explanations of adverse evidence.","Assurance of the intervention should draw on more than one form of evidence. Useful records include assessment maps to learning outcomes, marking criteria and calibrated judgement, appeal and correction records, moderation and exception records, and analysis of results and differential outcomes. Documents should be reconciled with observed practice and, where relevant, the experience of affected learners."]},{"heading":"Implementation responsibilities","paragraphs":["The analysis of research integrity should remain within the limits of the evidence. For the improvement objective, correcting an individual record does not establish that the process which produced the error has been corrected. In reviewing the corrective programme, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. In relation to research integrity, material uncertainty should result in further enquiry or an expressly limited finding.","Records relating to the issue under review should preserve both the conclusion and its limits. New evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information."],"bullets":["Define the decision each assessment must support.","Calibrate assessors.","Moderate material variation, with responsibility, scope and timing recorded.","Review differential and anomalous results.","Retain evidence sufficient for review."]},{"heading":"Testing effectiveness","paragraphs":["A proportionate method is available for research integrity. A competent review of the practice should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects. Continue monitoring long enough to determine whether the improvement is sustained. Averages should be tested against adverse cases that may indicate unequal effect or incomplete operation.","A decision to close improvement work on the intervention should be made by a person with authority and sufficient independence from implementation."],"bullets":["Did the effect reach the intended group?","What was the baseline?","Has the improvement been sustained?","When should an effect be visible?","What condition should change?"]},{"heading":"Maintaining the result","paragraphs":["For research integrity, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Material action requires a named responsible function and a defined completion point. Evidence of outcome, rather than completion of tasks, should determine whether corrective work can close.","The system and institutional dimensions of the intervention should be considered together. The analysis of the intervention proceeds on the basis that assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Authorities and providers hold different responsibilities, both of which must be discharged for the arrangement to operate reliably.","Progress on research integrity under review is not the amount of policy or documentation produced."]}],"word_count":773,"content_hash":"sha256-7a3e06c41acf68210979472780621b4616409e2dbaea81ec92ea961f8f246898","seo_keywords":["research integrity","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}