{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-e286b6b2dae6b7b5","slug":"2014-07-21-using-administrative-data-to-examine-disaggregated-education-data","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2014-07-21","last_modified_date":"2014-07-21","title":"Using administrative data to examine disaggregated education data","summary":"Assesses evidence on using administrative data to examine disaggregated education data, with particular attention to definitions, population coverage, comparability.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Equity monitoring and data gaps","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of administrative data to examine disaggregated education data is informed by the equity monitoring and data gaps, with consequences for governance, evidence and the treatment of affected learners. A decision concerning the analysis should recognise that comparable indicators can support public decision-making, but they do not remove the need to examine variation within systems and institutions. A proportionate arrangement protects educational outcomes and fair treatment without creating avoidable barriers.","The stated reference is Equity monitoring and data gaps. Use of the findings should remain within the population and analytical level of collection. A national or international pattern may justify closer review of the issue, but provider-level action requires evidence relating to the affected provision. Comparisons and public reporting should retain material differences in coverage, timing and classification.","Implementation of the analysis should be organised around a decision that can be tested. Oversight of the available evidence should reflect the principle that where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. In practice, the stated objective should connect to responsibility, committed resources, operating evidence and the outcome reported for oversight."]},{"heading":"Analytical scope","paragraphs":["For administrative data to examine disaggregated education data, the public interest is not confined to institutional compliance. In reviewing the issue, education systems should examine not only who enters education, but who can participate effectively, progress and complete with the intended learning outcomes.","The technical issue within the issue concerns the basis on which a conclusion is reached. Oversight of the issue should reflect the principle that an average may improve while a material group experiences no improvement or a worse outcome. Disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals. In relation to using administrative data to examine disaggregated education data, a conclusion should identify both its evidential basis and the part of the stated scope for which assurance cannot be given.","The principal risks in relation to the comparison are financial or geographic barriers, completion measures detached from learning, admission without adequate support, and aggregate gains concealing excluded groups. In relation to using administrative data to examine disaggregated education data, the relationship between the risks is material: one failed safeguard may remove the evidence needed to activate another. Review should follow the sequence of decisions and records rather than assess documents in isolation.","Relevant evidence for the issue will normally include records of barriers and support, progression and early-warning information, resource allocation by need, clearly defined access and completion indicators, and disaggregated participation and outcome data. Contradictory evidence should be investigated and resolved, not omitted from the record."]},{"heading":"Definitions and data coverage","paragraphs":["A proportionate method is available for administrative data to examine disaggregated education data. The method for the issue is to examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. The review record should preserve exceptions capable of showing a weakness in design, implementation or coverage.","Publication of findings on the measure should distinguish observed values, estimates and interpretation.","The assurance record for the analysis should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. The evidential history should preserve conclusions that were operative when a material decision was made."]},{"heading":"Use of the findings","paragraphs":["Interpretation of administrative data to examine disaggregated education data should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. In reviewing the measure, equal treatment does not necessarily produce equitable access or outcomes. Different support may be justified where it addresses a documented barrier without changing the required educational outcome. A decision concerning the comparison should recognise that association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis.","Where the available evidence involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Learner safeguards should remain continuous where provision is delivered by several bodies.","The present development should inform review of the issue, with attention to the relationship between commitment, implementation and demonstrated outcome. Improvement should be supported by evidence and an accountable decision record capable of public scrutiny."]}],"word_count":746,"content_hash":"sha256-19bd90c30e0c8359d12445a1eebd021d13de46157b85d108b14c9bd73e54246d","seo_keywords":["using administrative data to examine disaggregated education data","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}