{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-71b13e95869921e2","slug":"2017-09-14-measuring-education-leadership-across-education-systems","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2017-09-14","last_modified_date":"2017-09-14","title":"Measuring education leadership across education systems","summary":"Reviews measuring education leadership across education systems and identifies the conditions required for sound interpretation, responsible comparison and defensible.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Accountability and institutional governance","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The accountability and institutional governance provides the immediate reference point for consideration of education leadership in 2017. the analysis proceeds on the basis that the available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison.","The reference point is the accountability and institutional governance. Its wider significance does not replace evidence of how the comparison operates in the affected setting."]},{"heading":"Evidence base for measuring education leadership across education systems","paragraphs":["In relation to measuring education leadership across education systems, the central objective should not be obscured by the form of the administrative response. A decision concerning education leadership should recognise that governing bodies should receive sufficient, reliable and timely information to oversee education quality, learner protection and material institutional risk. The existence of an approved measure or completed activity is not evidence of educational effect. Implementation evidence should be sufficient to identify unequal consequences and assign corrective responsibility.","The technical issue within the issue concerns the basis on which a conclusion is reached. A decision concerning the measure should recognise that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Particular attention should be given to interfaces where responsibility or records pass from one function to another. A conclusion should identify both its evidential basis and the part of the stated scope for which assurance cannot be given.","Responsibility for the comparison should be visible at the point where consequential decisions are made. In this case, a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice.","Assurance of the analysis should draw on more than one form of evidence. Useful records include independent review records, corrective-action verification, conflict declarations and controls, public reports reconciled with controlled records, and risk and assurance plans."],"bullets":["Test management assurance, identifying the accountable function and affected scope.","Define information required for oversight before it informs a consequential decision.","Escalate material exceptions.","Verify corrective action independently, identifying the accountable function and affected scope.","Assign decision authority explicitly before using it to determine a learner or provider outcome."]},{"heading":"Coverage and comparability","paragraphs":["The principal risks in relation to education leadership are material risks omitted from reporting, corrective action closed without verification, conflicts not identified, and management assurance accepted without testing. A weakness in one part of the control environment may obscure a related failure elsewhere.","A proportionate method is available for the comparison. The method for the available evidence is to map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. The conclusion should identify whether further sampling or system-level action is required. In relation to measuring education leadership across education systems, contrary evidence should not be removed merely because aggregate performance appears acceptable.","The analytical record for the available evidence should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.","Interpretation of the comparison should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. A decision concerning the issue should recognise that governance structures do not provide assurance merely because committees exist. Membership, information quality, challenge, decisions and follow-through determine whether oversight is effective. Oversight of the analysis should reflect the principle that missing or delayed information may be patterned rather than random.","Decisions concerning the issue should remain traceable to the information available for the stated reference period. A revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. Without this distinction, a reporting change may be mistaken for improvement or deterioration in educational practice.","Public reporting on the issue should distinguish established fact, analytical judgement and planned action. Material revisions should be traceable to their reason and effective date. A revised conclusion should distinguish a change in the underlying condition from a change in method, coverage or evidence.","The appropriate response to the issue is therefore one of controlled implementation and review. An evidential gap should lead to a qualified conclusion and continued action, not administrative closure."]}],"word_count":694,"content_hash":"sha256-a644da8b05fda6cfd958c8c52005de56cbb5ef28858898cb0b0c86a44bfc0210","seo_keywords":["measuring education leadership across education systems","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}