{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-ccc9cb8e0a5f2c89","slug":"2020-04-01-a-disaggregated-analysis-of-learning-loss-measurement","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2020-04-01","last_modified_date":"2020-04-01","title":"A disaggregated analysis of learning-loss measurement","summary":"Reviews a disaggregated analysis of learning-loss measurement and identifies the conditions required for sound interpretation, responsible comparison and defensible conclusions.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Prolonged school closures","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The prolonged school closures provides the immediate reference point for consideration of learning-loss measurement in 2020. In reviewing the issue, the principal analytical task is to separate an observed difference from a conclusion about its cause. The materiality of the issue depends on its consequences for learners, responsible institutions and educational resources. Different administrative structures may support the same public-interest outcome.","For the available evidence, the public interest is not confined to institutional compliance. For the measure, continuity arrangements should preserve safe access to learning while protecting academic standards, records, welfare and fair treatment under constrained conditions. In relation to a disaggregated analysis of learning-loss measurement, where learners rely on published information or support decisions, errors should be identifiable and capable of prompt, fair correction."]},{"heading":"Analytical scope","paragraphs":["Relevant evidence for learning-loss measurement will normally include alternative delivery and accessibility arrangements, data backup and recovery tests, records of affected learners and essential services, assessment variation approvals, and welfare referral and safeguarding records. Evidence outside the relevant period or scope should be identified and given no more weight than its limitations permit. In relation to a disaggregated analysis of learning-loss measurement, the record should retain disagreement between sources until its cause and effect are understood.","The stated reference—the prolonged school closures—establishes the contemporaneous context. A reasoned conclusion on the issue should reconcile the governing expectation, evidence of operation, learner outcomes and unresolved risk. A selected successful case is not sufficient.","The technical issue within the analysis concerns the basis on which a conclusion is reached. In reviewing the comparison, an average may improve while a material group experiences no improvement or a worse outcome. Disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals. The judgement should state its supporting evidence and any condition limiting application to the declared scope.","Failure in relation to the available evidence may arise even where the stated policy is reasonable. Material concerns include temporary measures becoming permanent without review, unsafe or unsuitable learning arrangements, loss of contact with learners, and unequal access to replacement provision. Review should consider whether an exception is prolonged, recurring or capable of affecting learners outside the cases examined."]},{"heading":"Definitions and data coverage","paragraphs":["Responsibility for learning-loss measurement should be visible at the point where consequential decisions are made. Oversight of the analysis should reflect the principle that trend claims require comparable observations over time and a documented account of revisions, breaks in series and changes in coverage. Escalation should follow whenever the available record cannot support a safe conclusion for the affected learners.","Public reporting on the measure should distinguish established fact, analytical judgement and planned action. Material revisions should be traceable to their reason and effective date. Changes to definitions or evidence should be recorded separately from changes in educational performance.","A traceable record enables responsibility to be established and errors to be corrected fairly. For the comparison, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. The record should prevent a later amendment from being treated as if it applied when an earlier decision was made."],"bullets":["Monitor participation and welfare.","Define the conditions for restoration or further adaptation before it is relied on for a decision with material effect.","Review the validity of assessment.","Authorise and record temporary changes.","Maintain secure communication and records before using it to determine a learner or provider outcome."]},{"heading":"Use of the findings","paragraphs":["Implementation of learning-loss measurement can be tested without imposing unnecessary reporting. The method for the available evidence is to examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. The assurance record may draw on existing sources, provided their limitations and fitness for the current purpose are examined.","Publication of findings on the issue should distinguish observed values, estimates and interpretation.","Conclusions concerning the issue require careful treatment of scope and evidential limits. A decision concerning the issue should recognise that continuity should not be measured only by whether teaching activity continues. Data used for the available evidence should be interpreted against stable definitions and an identifiable population. Apparent movement caused by revision should not be attributed to educational performance. Limitations should be prominent wherever the finding may influence a consequential decision.","Assessment of the measure should reconcile more than one source of evidence and control. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk."]}],"word_count":760,"content_hash":"sha256-542f8f52d7f754435e141910b5315c0c04d43fe46b394776833ede6da9717aab","seo_keywords":["a disaggregated analysis of learning-loss measurement","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}