{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-33c3c8ae4d1df632","slug":"2014-08-04-progress-against-the-proposed-post-2015-education-goal-interpreting-regional-variation","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2014-08-04","last_modified_date":"2014-08-04","title":"Progress against the proposed post-2015 education goal: interpreting regional variation","summary":"Assesses evidence on progress against the proposed post-2015 education goal: interpreting regional variation.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Muscat Agreement adopted in May 2014","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of progress against the proposed post-2015 education goal is informed by the Muscat Agreement adopted in May 2014, with consequences for governance, evidence and the treatment of affected learners. The analysis of the issue proceeds on the basis that the available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison."]},{"heading":"Evidence and method","paragraphs":["The formal status of the Muscat Agreement adopted in May 2014 should be preserved in any public account. For progress against the proposed post-2015 education goal, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary.","Implementation of the measure should be organised around a decision that can be tested. For the comparison, where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. In relation to progress against the proposed post-2015 education goal, oversight requires a traceable line from the approved objective through responsible action to evidence of outcome.","The principal risks in relation to the analysis are variation across sites or programmes, policy detached from practice, corrective action closed on activity rather than effect, and learner experience omitted from review. A weakness in one part of the control environment may obscure a related failure elsewhere.","A focused examination of the issue requires a clear analytical discipline. the analysis proceeds on the basis that an average may improve while a material group experiences no improvement or a worse outcome. Disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals. An imprecise scope or measure may produce a credible-looking record that does not answer the relevant decision question.","Relevant evidence for the analysis will normally include approved objectives and responsibilities, representative outcome information, exception and complaint records, implementation and monitoring records, and verified corrective action. In relation to progress against the proposed post-2015 education goal, the conclusion should rely on evidence whose date, source and coverage are sufficient for the decision. The record should retain disagreement between sources until its cause and effect are understood."]},{"heading":"Patterns requiring examination","paragraphs":["The analysis of progress against the proposed post-2015 education goal should remain within the limits of the evidence. In reviewing the issue, international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another. In this case, quality cannot be inferred from reputation, intention or documentation alone. Assurance requires evidence of actual operation together with its material effects. If uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.","The assurance record for the comparison should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. This enables later review to separate substantive change from correction, reclassification or expanded coverage. A superseded conclusion should be retained where it formed the basis of a material decision."],"bullets":["Act on adverse findings.","Review whether improvement is sustained, identifying the accountable function and affected scope.","Identify the affected scope before it is relied on for a decision with material effect.","Define the intended outcome.","Collect proportionate evidence."]},{"heading":"Implications for decision-makers","paragraphs":["Implementation of progress against the proposed post-2015 education goal can be tested without imposing unnecessary reporting. In this case, the reviewer should examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. Existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance question.","The analytical record for the available evidence should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations."],"bullets":["Which groups are concealed by the aggregate?","Which disparity requires action first?","Could missing data be unequal?","Are sample sizes adequate?","Are group definitions stable?"]},{"heading":"Limits of inference","paragraphs":["Where progress against the proposed post-2015 education goal involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Multiple delivery partners do not justify fragmented accountability or remedy.","For the available evidence, the public interest is not confined to institutional compliance. In reviewing the analysis, quality assurance should connect stated educational purposes with implemented controls, reliable evidence and action where outcomes fall below expectation.","No individual measure is sufficient to establish effective operation of the measure across the affected scope. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk."]}],"word_count":779,"content_hash":"sha256-d1fe74d018ee4f6440285c1e7bbb881030417fe082dae8dab6bed8178d56aa13","seo_keywords":["progress against the proposed post-2015 education goal","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}