{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-d2a00a0d201327fd","slug":"2008-11-20-the-2008-education-data-release-participation-progression-and-comparability","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2008-11-20","last_modified_date":"2008-11-20","title":"The 2008 education data release: participation, progression and comparability","summary":"Assesses evidence on the 2008 education data release: participation, progression and comparability, with particular attention to definitions, population coverage, comparability.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"2008 Global Education Digest","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The present attention to the 2008 education data release follows the 2008 Global Education Digest and requires a careful distinction between public commitment, institutional practice and demonstrated result. Oversight of the measure should reflect the principle that comparable indicators can support public decision-making, but they do not remove the need to examine variation within systems and institutions."]},{"heading":"Analytical scope","paragraphs":["The historical reference basis is the 2008 Global Education Digest. Its relevance to the 2008 education data release should be assessed against the affected jurisdiction, learner population and form of provision.","Responsibility for the measure should be visible at the point where consequential decisions are made. The analysis of the comparison proceeds on the basis that where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. In relation to the 2008 education data release, incomplete evidence, unmanaged conflict, absent learner groups or material learner impact require a higher level of review.","The technical issue within the measure concerns the basis on which a conclusion is reached. Oversight of the comparison should reflect the principle that comparison requires more than the use of a common label. Definitions, reference periods, population coverage, institutional boundaries and collection practices must be sufficiently aligned for the observed difference to have a stable meaning. The decision record should distinguish the scope supported by evidence from any scope that remains unresolved.","The evidential record for the comparison should permit a reviewer to trace the matter from decision to outcome. This may require revision and comparability records, indicator definitions and metadata, disaggregated results, and population and sampling information, supported by coverage and missingness analysis and uncertainty estimates where relevant."]},{"heading":"Definitions and data coverage","paragraphs":["The system and institutional dimensions of the 2008 education data release should be considered together. The analysis of the issue proceeds on the basis that education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation. Public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control. Each level should be able to demonstrate the decisions and controls for which it is accountable.","Risk assessment of the available evidence should give particular attention to data revisions not carried through to published conclusions, proxy measures treated as direct outcomes, and incomplete coverage. A provider should also consider small differences overstated and changes in definition presented as changes in performance. Stronger controls are required where learners may not detect an error or where later correction cannot restore the lost opportunity."],"bullets":["Test comparability before using it to determine a learner or provider outcome.","Disaggregate material results.","Report uncertainty and revisions.","Define the decision the indicator will inform.","Avoid causal claims unsupported by the design."]},{"heading":"Use of the findings","paragraphs":["The review method for the 2008 education data release should be reproducible. A competent review of the available evidence should prepare a comparability table before analysing results. Record common elements, material differences, breaks in series and the direction in which each limitation may affect the conclusion; do not rank systems where those limitations remain material. The retained analysis should be reproducible from the selected evidence, decision rule and recorded reasons for accepted exceptions.","Publication of findings on the comparison should distinguish observed values, estimates and interpretation.","The analysis of the comparison should remain within the limits of the evidence. In reviewing the analysis, association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. For the comparison, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. If uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.","In relation to the 2008 education data release, traceability is necessary for accountable decision-making and fair correction. For the measure, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. Material changes require a traceable effective date and explanation so that prior reliance can be reviewed fairly."]},{"heading":"Uncertainty and safeguards","paragraphs":["Public reporting on the 2008 education data release should distinguish established fact, analytical judgement and planned action. If definitions, coverage or evidence alter an earlier conclusion, the reason should be stated so that revision is not mistaken for changed performance.","Assessment of the analysis should reconcile more than one source of evidence and control. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk."]}],"word_count":757,"content_hash":"sha256-ff6184b6805d2b43b81097860226a930e509fadfe5d365e2d3d3ebfe9fb94e18","seo_keywords":["the 2008 education data release","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}