Examines the evidential basis for emergency remote teaching, with attention to definitions, coverage, reference periods and responsible use of findings.
The rapid system-wide shift to remote provision provides the immediate reference point for consideration of emergency remote teaching in 2020. Analysis of the comparison should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning. Review should cover the complete affected scope and preserve material differences between locations, programmes, delivery modes and learner groups. Data used for a disaggregated analysis of the comparison should be interpreted against stable definitions and an identifiable population. Reporting should identify a break in comparability before describing movement over time.
Consideration of the reported measure should retain the date and status of Rapid system-wide shift to remote provision. Later developments should not be read into the position available at publication. Replacement provision differs sharply in connectivity, devices, home conditions, accessibility and staff readiness. Measures should be treated as emergency responses, with documented authority and review. Continuity reporting should identify learners not reached and should not equate online activity with learning.
Purpose and present context
The contemporaneous reference point for emergency remote teaching is Rapid system-wide shift to remote provision. Its status should be distinguished from the jurisdiction-specific evidence required for implementation. Decision-makers should state which matters are evidenced, which express policy and which require authorised judgement. Any indicator used in relation to a disaggregated analysis of the matter examined should distinguish description from causal explanation. The result should be accompanied by distributional information, uncertainty and limits on transfer to another setting.
For the matter examined, the public interest is not confined to institutional compliance. Review of the comparison should include the experience of affected learners, particularly where aggregate reporting may conceal exclusion, delay or unequal treatment. Material arrangements should be communicated clearly, with an accessible route to correct error or unfair treatment.
The assurance record for the reported measure should permit another competent reviewer to understand the evidence, method, judgement and treatment of material exceptions. Any indicator used in relation to the comparison should distinguish description from causal explanation. A decision concerning the matter examined should identify its basis, affected scope and responsible authority, together with any limitation requiring further review. Decision-makers should receive an intelligible account of how the result was reached and where it should not be applied.
Responsibility for the comparison should be visible at the point where consequential decisions are made. Any indicator used in relation to the reported measure should distinguish description from causal explanation. Data used for the matter examined should be interpreted against stable definitions and an identifiable population.
A reasoned conclusion on the comparison should reconcile the governing expectation, evidence of operation, learner outcomes and unresolved risk. A selected successful case is not sufficient. In the present context, professional learning disconnected from practice, workload that limits preparation and feedback and vacancies or turnover affecting continuity may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. Testing should include exceptions and adverse cases, not only routine or successful operation.
Analysis of the analytical question should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. This may require workload and allocation data, support and supervision records, retention and continuity indicators, and qualification and competence records, supported by workforce plans and vacancy information and induction and professional learning participation. Any indicator used in relation to the evidence under review should distinguish description from causal explanation. A reported result should state how outcomes are distributed and where transfer beyond the observed setting is not supported.
Responsibilities and material risks
The review method for emergency remote teaching should be reproducible. In reviewing the evidence under review, responsible bodies should examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. Working papers should allow another competent reviewer to understand the evidence, judgement and treatment of material exceptions.
Any indicator used in relation to a disaggregated analysis of the evidence under review should distinguish description from causal explanation. Interpretation should retain uncertainty, distributional differences and limits on generalisation. Results should be reproducible from the retained data and method. Any causal explanation should be identified separately from descriptive findings and supported by an appropriate design.
Data used for a disaggregated analysis of the matter examined should be interpreted against stable definitions and an identifiable population. A decision concerning the reported measure should recognise that missing or delayed information may be patterned rather than random. Conclusions should account for the possibility that excluded learners or providers differ from those observed. Analysis of the evidence under review should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Assurance should also consider whether staff can apply the required practice and whether organisational conditions permit them to do so. Data used for the analytical question should be interpreted against stable definitions and an identifiable population. A revision or break in series should not be reported as a change in performance.
Accountability and effective correction both depend on the comparison record that can be followed from evidence to decision. For the matter examined, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed.
Where the reported measure involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Governance between participating bodies should make information duties and corrective authority explicit. Protection should operate across the complete service, irrespective of how delivery is divided.
The present development should inform review of the matter examined, with attention to the relationship between commitment, implementation and demonstrated outcome. Public confidence cannot be separated from an institution's ability to identify responsibility and substantiate its conclusions.