{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-d87a92aca5e2b222","slug":"2024-11-11-the-use-of-proxy-measures-in-analysing-leadership-for-learning","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2024-11-11","last_modified_date":"2024-11-11","title":"The use of proxy measures in analysing leadership for learning","summary":"Assesses evidence on the use of proxy measures in analysing leadership for learning, with particular attention to definitions, population coverage, comparability and uncertainty.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"2024/5 Global Education Monitoring Report","reference_authority":"United Nations Educational, Scientific and Cultural Organization","sections":[{"heading":null,"paragraphs":["The immediate international context is the 2024/5 Global Education Monitoring Report. Its significance for leadership for learning lies in the quality of implementation rather than in formal acknowledgement alone. In reviewing the available evidence, the value of the present data lies in the questions it can answer reliably and in the limits it makes visible. The chosen response should address the risk without weakening access, educational quality or fair treatment.","Responsibility for the issue should be visible at the point where consequential decisions are made. Oversight of the available evidence should reflect the principle that trend claims require comparable observations over time and a documented account of revisions, breaks in series and changes in coverage."]},{"heading":"Evidence and method","paragraphs":["The stated reference is 2024/5 Global Education Monitoring Report. The level of inference should not extend beyond the level at which the source data are valid. A national or international pattern may justify closer review of leadership for learning, but provider-level action requires evidence relating to the affected provision. The comparability record should identify material variation in coverage, period and classification.","The technical issue within the issue concerns the basis on which a conclusion is reached. A decision concerning the available evidence should recognise that a proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. In relation to the use of proxy measures in analysing leadership for learning, any condition preventing complete assurance should appear with the evidence on which the judgement relies.","A narrow control over the analysis may create false assurance. In the present context, small differences overstated, data revisions not carried through to published conclusions and incomplete coverage may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage.","Assurance of the measure should draw on more than one form of evidence. Useful records include uncertainty estimates where relevant, population and sampling information, indicator definitions and metadata, disaggregated results, and coverage and missingness analysis. Documents should be reconciled with observed practice and, where relevant, the experience of affected learners. Evidence of effectiveness should represent the declared scope, including adverse and exceptional cases."]},{"heading":"Patterns requiring examination","paragraphs":["A proportionate method is available for leadership for learning. In reviewing the comparison, responsible bodies should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. Adverse cases and unresolved contradictions should be retained because they may reveal limitations concealed by an average result.","In relation to the use of proxy measures in analysing leadership for learning, traceability is necessary for accountable decision-making and fair correction. For the available evidence, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. A material amendment should record its reason and effective date, preserving the information basis of earlier decisions."],"bullets":["Would the decision change if the proxy were inaccurate?","What outcome does the proxy represent?","For which groups may it fail?","Is direct evidence available?","What evidence supports the relationship?"]},{"heading":"Implications for decision-makers","paragraphs":["For leadership for learning, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. An action may be complete while the underlying condition remains, and the two determinations should be recorded separately.","Decision-makers using evidence on the available evidence should be told what the data cannot establish as clearly as what it can. The finding should identify its analytical character and the system, institution, programme or learner population to which it applies. Application in another setting depends on a separate examination of context and comparability."],"bullets":["Document numerator and denominator before it is relied on for a decision with material effect.","Analyse missing information.","Define the decision the indicator will inform, with responsibility, scope and timing recorded.","Test comparability.","Disaggregate material results before it is relied on for a decision with material effect."]},{"heading":"Limits of inference","paragraphs":["The quality significance of leadership for learning follows from a basic distinction between availability and effective provision. A decision concerning the available evidence should recognise that education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation.","Proportionality in relation to the analysis does not mean reduced protection for learners exposed to greater risk. A decision concerning the issue should recognise that measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. For the available evidence, missing or delayed information may be patterned rather than random. The record for an exception should identify the reason, approving authority, period of operation and date for reconsideration.","Any response to the present development should test the evidential connection between the analysis, its implementation and the outcome claimed."]}],"word_count":824,"content_hash":"sha256-429fa1dcde885f755287e831feb23c258aab65d90b2ace9ca9e429d7f6f155d7","seo_keywords":["the use of proxy measures in analysing leadership for learning","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}