{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-c902dab2eadc7833","slug":"2017-08-14-improving-responsible-education-data-use-a-structured-review-method","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2017-08-14","last_modified_date":"2017-08-14","title":"Improving responsible education data use: a structured review method","summary":"Provides an evidence-led method for improving improving responsible education data use: a structured review method, from definition of the problem to review of effectiveness.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Expanding public reporting and comparative indicators","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The expanding public reporting and comparative indicators provide the immediate reference point for consideration of responsible education data use in 2017. A decision concerning the issue under review should recognise that improvement should begin with a defined problem, a credible account of its causes and a measure capable of showing whether the response has worked. Proportionality is demonstrated where learner safeguards and decision reliability correspond to the assessed risk.","The reference basis—the expanding public reporting and comparative indicators—is evidential rather than self-executing. The material may reveal patterns or evidential gaps, but it neither directs a legal outcome nor establishes causation. In applying it to the practice, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.","For the improvement objective, the public interest is not confined to institutional compliance. The analysis of the intervention proceeds on the basis that education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation."]},{"heading":"Defining the problem","paragraphs":["In practical terms, responsible education data use should be reviewed against a stated method rather than general assurance. For the improvement objective, an improvement plan should connect a verified problem with a specific intervention, accountable ownership, resources, milestones and a measure of effect. Broad intentions should be converted into decisions capable of review. Those required to act should be able to understand the method and its material limitations.","A proper review of the improvement objective should establish the intended outcome before selecting controls or indicators. The analysis of the intervention proceeds on the basis that the intervention should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved."]},{"heading":"Improvement method","paragraphs":["The principal risks in relation to responsible education data use are incomplete coverage, proxy measures treated as direct outcomes, data revisions not carried through to published conclusions, and changes in definition presented as changes in performance. In relation to improving responsible education data use, a weakness in one part of the control environment may obscure a related failure elsewhere. In relation to improving responsible education data use, documents should be tested against the decision process they record and the outcome that followed."],"bullets":["Analyse missing information.","Disaggregate material results, identifying the accountable function and affected scope.","Test comparability.","Report uncertainty and revisions.","Avoid causal claims unsupported by the design."]},{"heading":"Measures and review","paragraphs":["The evidential record for responsible education data use should permit a reviewer to trace the matter from decision to outcome. This may require population and sampling information, triangulation with administrative and qualitative evidence, revision and comparability records, and indicator definitions and metadata, supported by uncertainty estimates where relevant and coverage and missingness analysis. Conflicting records, absent populations and uncertain follow-through require additional testing.","A proportionate method is available for the practice. The method for the practice is to prioritise actions by learner impact and control weakness, establish dependencies, test implementation at suitable intervals and retain unresolved items until effectiveness is verified. Amend the plan where evidence does not support the original causal assumption. The review record should preserve exceptions capable of showing a weakness in design, implementation or coverage.","Improvement of the improvement objective should proceed through controlled tests where risk permits."]},{"heading":"Residual risk and follow-up","paragraphs":["The analysis of responsible education data use should remain within the limits of the evidence. A decision concerning the improvement objective should recognise that improvement data should not be selected only because it is readily available. A decision concerning the improvement objective should recognise that measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work.","Records relating to the corrective programme should preserve both the conclusion and its limits. A changed evidential position should be applied to the affected scope, including prior decisions that may no longer be reliable. The correction process should identify prior users and decisions where published information has had material effect.","For the intervention, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Management should assign each material action to an accountable owner and completion date. An action may be complete while the underlying condition remains, and the two determinations should be recorded separately.","Progress on improving responsible education data use under review is not the amount of policy or documentation produced. Performance should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity."]}],"word_count":764,"content_hash":"sha256-94aa3464f61502e139b2ec338c0e20fd407cb07eba15d99572386808540d4efa","seo_keywords":["improving responsible education data use","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}