{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-96c0ce792cc75509","slug":"2009-06-10-integrity-risks-in-education-governance-definitions-and-comparability","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2009-06-10","last_modified_date":"2009-06-10","title":"Integrity risks in education governance: definitions and comparability","summary":"Assesses evidence on integrity risks in education governance: definitions and comparability, with particular attention to definitions, population coverage, comparability.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"2009 governance and inequality agenda","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of integrity risks in education governance is informed by the 2009 governance and inequality agenda, with consequences for governance, evidence and the treatment of affected learners. A decision concerning the issue should recognise that the available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison.","The contemporaneous context is established by the 2009 governance and inequality agenda. It does not, without setting-specific evidence, demonstrate the operation of the available evidence. Authorities and providers should distinguish established fact, policy expectation and matters left to institutional judgement.","The 2009 Education for All Global Monitoring Report, Overcoming Inequality: Why Governance Matters, examines the relationship between disadvantage, resource distribution and the governance of education. It directs attention to disparities associated with wealth, gender, location, language and other conditions. Governance is relevant because decisions on finance, teacher deployment, information and accountability determine whether formal entitlements are realised in practice."]},{"heading":"Analytical scope","paragraphs":["The quality significance of integrity risks in education governance follows from a basic distinction between availability and effective provision. In reviewing the measure, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. In relation to integrity risks in education governance, review should cover the stages at which learners receive information, provision, assessment, support and remedy.","The technical issue within the issue concerns the basis on which a conclusion is reached. Oversight of the available evidence should reflect the principle that comparison requires more than the use of a common label. Definitions, reference periods, population coverage, institutional boundaries and collection practices must be sufficiently aligned for the observed difference to have a stable meaning. A conclusion should identify both its evidential basis and the part of the stated scope for which assurance cannot be given.","The principal risks in relation to the comparison are weak assurance of authorship or performance, reasonable adjustment altering the assessed outcome, inconsistent judgement between markers or locations, and results used beyond the evidence they support. A weakness in one part of the control environment may obscure a related failure elsewhere."]},{"heading":"Definitions and data coverage","paragraphs":["Assurance of integrity risks in education governance should draw on more than one form of evidence. Useful records include assessment maps to learning outcomes, approval and change-control records, appeal and correction records, moderation and exception records, and authorship and identity controls proportionate to risk. Evidence of effectiveness should represent the declared scope, including adverse and exceptional cases.","Decisions concerning the measure should remain traceable to the information available for the stated reference period. In relation to integrity risks in education governance, changes in condition, evidence, method and interpretation should be recorded separately when a conclusion is revised."],"bullets":["Define the decision each assessment must support, with responsibility, scope and timing recorded.","Review differential and anomalous results.","Moderate material variation.","Control changes.","Calibrate assessors."]},{"heading":"Use of the findings","paragraphs":["The governing expectation for integrity risks in education governance should be capable of consistent application. In reviewing the comparison, a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. Criteria affecting learners should not permit materially different interpretation without an evidenced reason.","The review method for the issue should be reproducible. In this case, the reviewer should prepare a comparability table before analysing results. Record common elements, material differences, breaks in series and the direction in which each limitation may affect the conclusion; do not rank systems where those limitations remain material. A competent reviewer should be able to follow the record from source selection to conclusion and exception handling.","Publication of findings on the analysis should distinguish observed values, estimates and interpretation.","Public reporting on the comparison should distinguish established fact, analytical judgement and planned action. Revision history should remain available where users have relied on the earlier conclusion. A revised conclusion should distinguish a change in the underlying condition from a change in method, coverage or evidence."]},{"heading":"Uncertainty and safeguards","paragraphs":["Proportionality in relation to integrity risks in education governance does not mean reduced protection for learners exposed to greater risk. In reviewing the issue, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. Oversight of the measure should reflect the principle that association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis.","The appropriate response to the comparison is therefore one of controlled implementation and review. Assurance should be withheld for the affected scope until the limitation is resolved."]}],"word_count":757,"content_hash":"sha256-f90d2a7483d28ab7b7e5f1e45b634826231f4fed80aabcbb4722066fd8f6164a","seo_keywords":["integrity risks in education governance","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}