{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-ab86a9f04cc81d06","slug":"2021-10-06-using-administrative-data-to-examine-academic-integrity-incidents-and-outcomes","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2021-10-06","last_modified_date":"2021-10-06","title":"Using administrative data to examine academic integrity incidents and outcomes","summary":"Assesses evidence on using administrative data to examine academic integrity incidents and outcomes, with particular attention to definitions, population coverage.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Expanded remote assessment and digital resources","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Against the background of the expanded remote assessment and digital resources, education authorities and providers should review how administrative data to examine academic integrity incidents and outcomes is defined, implemented and evidenced. In reviewing the available evidence, the available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison.","A narrow control over the comparison may create false assurance. In the present context, assessment methods that do not support valid judgements, technology access determining educational access and supplier dependency without continuity controls may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage."]},{"heading":"Analytical scope","paragraphs":["Implementation of administrative data to examine academic integrity incidents and outcomes should be organised around a decision that can be tested. The analysis of the measure proceeds on the basis that trend claims require comparable observations over time and a documented account of revisions, breaks in series and changes in coverage. In relation to using administrative data to examine academic integrity incidents and outcomes, resources and activity should be reconciled with the operating evidence and result for which the responsible function is accountable.","The historical reference basis is the expanded remote assessment and digital resources. Its relevance to the measure should be assessed against the affected jurisdiction, learner population and form of provision.","the analysis should make its decision rule explicit. A decision concerning the analysis should recognise that a proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. Comparable evidence should be assessed against criteria settled before the result is known."],"bullets":["Provide alternative routes for material barriers before it informs a consequential decision.","Define the educational purpose of the technology.","Support staff and learners before it informs a consequential decision.","Maintain continuity and supplier exit controls.","Test access before requiring use."]},{"heading":"Definitions and data coverage","paragraphs":["Care is required in drawing conclusions about administrative data to examine academic integrity incidents and outcomes. The analysis of the comparison proceeds on the basis that digital participation data should not be treated as a direct measure of learning. Log-ins, connection time and activity counts require interpretation alongside assessment and learner experience. A decision concerning the issue should recognise that international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another. Limitations should be prominent wherever the finding may influence a consequential decision.","Each source should have a stated purpose in supporting or limiting the conclusion. For the measure, the most relevant material is likely to include learner access and participation information, delivery-mode design and approval records, teacher capability and workload information, and supplier performance and exit arrangements. In relation to using administrative data to examine academic integrity incidents and outcomes, independent records should be reconciled, with disagreement and uncertainty reported alongside the finding.","The assurance record for the analysis should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. Traceable source and version information allow genuine improvement to be distinguished from administrative revision. The evidential history should preserve conclusions that were operative when a material decision was made."]},{"heading":"Use of the findings","paragraphs":["For operational review of administrative data to examine academic integrity incidents and outcomes, authorities and providers should proceed in a defined sequence. Review of the available evidence should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. The record should distinguish a finding that requires action from an observation that supports no formal conclusion.","Decision-makers using evidence on the measure should be told what the data cannot establish as clearly as what it can. The nature of the result and its applicable unit—system, institution, programme or learner group—should be explicit. Application in another setting depends on a separate examination of context and comparability."],"bullets":["For which groups may it fail?","What outcome does the proxy represent?","Is direct evidence available?","Would the decision change if the proxy were inaccurate?","What evidence supports the relationship?"]},{"heading":"Uncertainty and safeguards","paragraphs":["The central objective should not be obscured by the form of the administrative response. The analysis of administrative data to examine academic integrity incidents and outcomes proceeds on the basis that a change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Assurance should not stop at adoption, resourcing or completion of administrative tasks. Implementation evidence should be sufficient to identify unequal consequences and assign corrective responsibility.","Public reporting on the measure should distinguish established fact, analytical judgement and planned action.","The appropriate response to the analysis is therefore one of controlled implementation and review. Assurance should be withheld for the affected scope until the limitation is resolved."]}],"word_count":824,"content_hash":"sha256-539e93e1fbc5dd4154382d24d1fe333a515bd101147cc0c21ffc5be96e4a1803","seo_keywords":["using administrative data to examine academic integrity incidents and outcomes","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}