{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-2950de22f48fe9db","slug":"2020-09-01-remote-assessment-integrity-policy-and-regulatory-implications","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2020-09-01","last_modified_date":"2020-09-01","title":"Remote assessment integrity: policy and regulatory implications","summary":"Assesses the policy significance of remote assessment integrity: policy and regulatory implications, distinguishing legal effect, implementation responsibility.","category":{"code":"POLICY_AND_REGULATORY_INTERPRETATION","label":"Industry Policy and Regional Regulatory Interpretation"},"article_type":"Policy and regulatory analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Emergency remote assessment","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Consideration of remote assessment integrity should retain the date and status of Emergency remote assessment. Later developments should not be read into the position available at publication. For the policy matter, the immediate task for education authorities is to distinguish the policy objective from the legal and operational measures needed to give it effect. Governance of the policy matter requires a clear allocation of authority, information and follow-through. Material matters should be referred to the body authorised to act or accept residual risk. Suitability should be judged within the relevant system rather than against a presumed universal administrative model.","The contemporaneous reference point for the affected arrangements is Emergency remote assessment. Its status should be distinguished from the jurisdiction-specific evidence required for implementation. A proportionate examination of the affected arrangements should test routine operation together with adverse and exceptional cases across the relevant delivery settings. Analysis of the relevant measure should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. A comparison is reliable only if material differences remain visible."]},{"heading":"Status and scope","paragraphs":["For remote assessment integrity, the public interest is not confined to institutional compliance. For the implementation question, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. The public-interest assessment of the implementation question should consider access, learning, fair treatment and the reliability of information on which learners make consequential decisions.","In practical terms, the affected arrangements should be reviewed against a stated method rather than general assurance. Any indicator used in relation to the relevant measure should distinguish description from causal explanation. Interpretation should retain uncertainty, distributional differences and limits on generalisation. Governance of the affected arrangements requires a clear allocation of authority, information and follow-through. A material issue should not remain with a function lacking authority to resolve it. Responsibility for the policy matter should be identifiable at each consequential decision point. Accountability for learner impact should remain explicit when delivery tasks are delegated.","A proper review of the implementation question should establish the intended outcome before selecting controls or indicators. Responsibility for the relevant measure should be identifiable at each consequential decision point. Delegation should identify both the operating role and the body retaining oversight of learner impact. Public information on the relevant measure should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction.","The evidential record for the affected arrangements should permit a reviewer to trace the matter from decision to outcome. Data used for the policy matter should be interpreted against stable definitions and an identifiable population. Reporting should identify a break in comparability before describing movement over time. In relation to remote assessment integrity, further cases should be examined when the initial sample does not represent the affected scope or confirm sustained correction."],"bullets":["Moderate material variation.","Control changes, with responsibility, scope and timing recorded.","Calibrate assessors.","Align tasks and criteria with learning outcomes.","Define the decision each assessment must support before using it to determine a learner or provider outcome."]},{"heading":"Public-interest implications","paragraphs":["Risk assessment of remote assessment integrity should give particular attention to uncontrolled changes to assessment, results used beyond the evidence they support, and reasonable adjustment altering the assessed outcome. The assurance record for the policy matter should permit another competent reviewer to understand the evidence, method, judgement and treatment of material exceptions.","Implementation of the affected arrangements can be tested without imposing unnecessary reporting. Responsibility for the issue should be identifiable at each consequential decision point. Any indicator used in relation to the implementation question should distinguish description from causal explanation. The result should be accompanied by distributional information, uncertainty and limits on transfer to another setting. Reporting on the issue should distinguish established fact, analytical judgement and planned action. Material revisions should retain their reason and effective date.","Any indicator used in relation to the affected arrangements should distinguish description from causal explanation. Material variation and uncertainty should be reported together with any restriction on wider application. Data used for the issue should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result.","Particular care is required when interpreting evidence about the relevant measure. Oversight of the policy matter should reflect the principle that reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. For the policy matter, a policy direction should not be presented as a uniform legal obligation where national implementation differs. In relation to remote assessment integrity, providers remain responsible for identifying the requirements that apply to their own activities. Review of the policy matter should include the experience of affected learners, particularly where aggregate reporting may conceal exclusion, delay or unequal treatment.","Records concerning the implementation question should remain traceable from source evidence to decision and follow-up. Superseded conclusions should be retained where they informed a material outcome. Where reliance has occurred, correction may require review of affected decisions as well as amendment of published information.","Data used for the relevant measure should be interpreted against stable definitions and an identifiable population. A revision or break in series should not be reported as a change in performance.","Assessment of the implementation question should reconcile more than one source of evidence and control. Review of the implementation question should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event."]}],"word_count":922,"content_hash":"sha256-0502ef1290cab0e4c3a5b48b55a288a96e2ce043a49732a6fe4f8d3de41c609d","seo_keywords":["remote assessment integrity","education policy and regulation","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}