{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-5782130766b906bb","slug":"2020-05-08-monitoring-the-effectiveness-of-emergency-remote-teaching","language":"en","publication_status":"PUBLISHED","publication_date":"2020-05-08","last_modified_date":"2020-05-08","title":"Monitoring the effectiveness of emergency remote teaching","summary":"Provides an evidence-led method for improving emergency remote teaching, from definition of the problem to review of effectiveness and residual risk.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Rapid system-wide shift to remote provision","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The present attention to the effectiveness of emergency remote teaching follows the rapid system-wide shift to remote provision and requires a careful distinction between public commitment, institutional practice and demonstrated result. The method set out here treats improvement as a controlled cycle of diagnosis, action, measurement and review. A proportionate arrangement protects educational outcomes and fair treatment without creating avoidable barriers."]},{"heading":"Improvement objective and baseline","paragraphs":["The stated reference is the rapid system-wide shift to remote provision. Application to the effectiveness of emergency remote teaching depends on evidence from the relevant jurisdiction or institution. Reporting should preserve the different status of facts, public expectations and choices made by institutions.","For emergency remote teaching, the declaration of a pandemic in March 2020 and the rapid closure of education sites have required emergency continuity arrangements on an unprecedented scale. Replacement provision differs sharply in connectivity, devices, home conditions, accessibility and staff readiness. Measures should be treated as emergency responses, with documented authority and review. Continuity reporting should identify learners not reached and should not equate online activity with learning."]},{"heading":"Controls and accountable action","paragraphs":["The quality significance of the effectiveness of emergency remote teaching follows from a basic distinction between availability and effective provision. In the context of emergency remote teaching, education quality depends on sufficient numbers of competent staff who are prepared, supported and assigned work they can perform effectively.","When examining emergency remote teaching, effectiveness is the demonstrated change in the condition the action was intended to address. For decisions concerning emergency remote teaching, completion of training, publication of guidance or installation of a system is an output and should not be reported as an outcome without further evidence. In work concerning emergency remote teaching, the decision question, affected scope and measure should align; otherwise the conclusion may be unsupported despite substantial documentation."],"bullets":["Did the effect reach the intended group?","What condition should change?","What was the baseline?","Has the improvement been sustained?","When should an effect be visible?"]},{"heading":"Evidence of effect","paragraphs":["As regards emergency remote teaching, the applicable expectation should be capable of consistent application. Where emergency remote teaching is under review, a complete improvement record should define the baseline, affected scope, causal hypothesis, responsible owner, resources, milestones and measures of effectiveness. For the assessment of emergency remote teaching, terms governing eligibility, support, assessment, reporting or review should prevent materially different treatment without recorded justification.","Failure in relation to the improvement objective may arise even where the stated policy is reasonable. Material concerns include professional learning disconnected from practice, vacancies or turnover affecting continuity, use of staff outside their competence, and weak evaluation of teaching support. For emergency remote teaching, an exception should be assessed by effect, duration, recurrence and reach, including possible exposure beyond the initial sample."]},{"heading":"Sustaining improvement","paragraphs":["In the context of emergency remote teaching, each source should have a stated purpose in supporting or limiting the conclusion. For the effectiveness of emergency remote teaching, the most relevant material is likely to include workload and allocation data, retention and continuity indicators, observation and learner feedback, and qualification and competence records. When examining emergency remote teaching, each source has limitations; confidence depends on corroboration between independent records and transparent treatment of uncertainty.","For decisions concerning emergency remote teaching, responsible bodies should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects. In work concerning emergency remote teaching, continue monitoring long enough to determine whether the improvement is sustained. As regards emergency remote teaching, averages should be tested against adverse cases that may indicate unequal effect or incomplete operation.","The improvement record for the issue under review should contain the verified problem, affected scope, immediate containment, causal analysis, selected intervention, accountable owner, resources, milestones and effectiveness measure. A completed task does not close the matter unless improvement in the relevant condition is established. Closure reporting should not obscure unresolved action or risk retained by the responsible authority."]},{"heading":"Sustaining improvement","paragraphs":["The analysis of the effectiveness of emergency remote teaching should remain within the limits of the evidence. Correcting an individual record does not establish that the process which produced the error has been corrected. For the practice, qualifications and participation in training are inputs. Where emergency remote teaching is under review, decision-makers should not extend assurance beyond the point supported by the available evidence.","Decisions concerning the intervention should remain traceable to the information available for the stated reference period. For the assessment of emergency remote teaching, transparent treatment of reporting changes prevents artificial movement from being read as substantive progress or decline.","Public reporting on the corrective programme should distinguish established fact, analytical judgement and planned action. For emergency remote teaching, changes to definitions or evidence should be recorded separately from changes in educational performance.","In the context of emergency remote teaching, a complete conclusion on the intervention requires evidence extending beyond an individual measure or safeguard."]}],"word_count":806,"content_hash":"sha256-adaa645cf97681c5482a5ac947a3816196307fc777315b1f82ca8537e9766bb5","seo_keywords":["monitoring the effectiveness of emergency remote teaching","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}