{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-6b8bccbbe5a6bff5","slug":"2021-06-30-learner-protection-implications-of-remote-assessment","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2021-06-30","last_modified_date":"2021-06-30","title":"Learner-protection implications of remote assessment","summary":"Explains the regulatory context for learner-protection implications of remote assessment and the responsibilities, evidence and safeguards relevant to implementation.","category":{"code":"POLICY_AND_REGULATORY_INTERPRETATION","label":"Industry Policy and Regional Regulatory Interpretation"},"article_type":"Policy and regulatory analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Continued online and hybrid assessment","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The continued online and hybrid assessment provides the immediate context for remote assessment. In reviewing the issue, the significance of the present development lies in implementation: public commitments require an identifiable allocation of authority, resources and accountability. Suitability should be judged within the relevant system rather than against a presumed universal administrative model."]},{"heading":"Regulatory context","paragraphs":["The system and institutional dimensions of remote assessment should be considered together. Oversight of the implementation question should reflect the principle that assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result."],"bullets":["Control changes.","Align tasks and criteria with learning outcomes.","Review differential and anomalous results.","Calibrate assessors.","Retain evidence sufficient for review."]},{"heading":"Operational effect","paragraphs":["The stated reference—the continued online and hybrid assessment—establishes the contemporaneous context. Any conclusion about remote assessment still requires evidence from the setting concerned. The decision basis should identify what is evidenced, what reflects policy and what depends on authorised discretion. That distinction should remain visible in the decision record, public reporting and later review.","A focused examination of the relevant measure requires a clear analytical discipline. In reviewing the relevant measure, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Individually sound controls may not operate effectively when decisions, records or responsibility pass between functions. In relation to learner-protection implications of remote assessment, the decision question, affected scope and measure should align; otherwise the conclusion may be unsupported despite substantial documentation."]},{"heading":"Required governance attention","paragraphs":["A proper review of remote assessment should establish the intended outcome before selecting controls or indicators. A decision concerning the affected arrangements should recognise that oversight should test whether formal commitments are reflected in decisions, resource allocation, provider conduct and accessible routes for review. The basis for selection, authority for exceptions and timing of reassessment should remain traceable.","Risk assessment of the issue should give particular attention to results used beyond the evidence they support, tasks that do not assess the stated outcome, and weak assurance of authorship or performance. A provider should also consider reasonable adjustment altering the assessed outcome and inconsistent judgement between markers or locations."],"bullets":["Which evidence establishes operation?","Who controls each stage?","What outcome is intended?","Where do exceptions occur?","What action is required by the finding?"]},{"heading":"Evidence and accountability","paragraphs":["The evidential record for remote assessment should permit a reviewer to trace the matter from decision to outcome. This may require analysis of results and differential outcomes, authorship and identity controls proportionate to risk, marking criteria and calibrated judgement, and moderation and exception records, supported by assessment maps to learning outcomes and appeal and correction records. Conflicting records, absent populations and uncertain follow-through require additional testing.","Implementation of the affected arrangements can be tested without imposing unnecessary reporting. In reviewing the relevant measure, responsible bodies should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. An isolated incident and a recurring or systemic condition require different findings and responses. In relation to learner-protection implications of remote assessment, existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance question."]},{"heading":"Evidence and accountability","paragraphs":["A policy conclusion on remote assessment should state who is required or expected to act, the source of that expectation and the consequence of non-implementation. Any conclusion should state where differences in law limit its application. Communications should preserve the legal status and effective date of each expectation described.","Any conclusion on the relevant measure should remain within the scope supported by the evidence. Oversight of the affected arrangements should reflect the principle that reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. A decision concerning the policy matter should recognise that a policy direction should not be presented as a uniform legal obligation where national implementation differs. Providers remain responsible for identifying the requirements that apply to their own activities. Decision-makers and affected users should receive the conclusion together with its material evidential limits.","Decisions concerning the issue should remain traceable to the information available for the stated reference period. Without this distinction, a reporting change may be mistaken for improvement or deterioration in educational practice.","Accountability for the implementation question should follow decision-making authority. Relevant evidence should reach the body authorised to commit resources, amend policy or accept residual risk, and its judgement should be recorded. Operational tasks may be delegated, but accountability for material effects on learners must remain identifiable.","A complete conclusion on the relevant measure requires evidence extending beyond an individual measure or safeguard. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk."]}],"word_count":785,"content_hash":"sha256-bc4ed3c7a4b03cbcffb25dc8f5248980ce3b0e247506af55ac139e8a537f78ce","seo_keywords":["learner-protection implications of remote assessment","education policy and regulation","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}