{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-01edfe979f6e1b84","slug":"2015-01-23-data-quality-in-reporting-refugee-and-displaced-learner-access","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2015-01-23","last_modified_date":"2015-01-23","title":"Data quality in reporting refugee and displaced learner access","summary":"Reviews data quality in reporting refugee and displaced learner access and identifies the conditions required for sound interpretation, responsible comparison and defensible.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Large-scale displacement and regional education pressure","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The large-scale displacement and regional education pressure provides the immediate context for refugee and displaced learner access. In this case, comparable indicators can support public decision-making, but they do not remove the need to examine variation within systems and institutions."]},{"heading":"Evidence and method","paragraphs":["The quality significance of refugee and displaced learner access follows from a basic distinction between availability and effective provision. In this case, education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation."],"bullets":["Disaggregate material results before it informs a consequential decision.","Test comparability before it informs a consequential decision.","Document numerator and denominator.","Report uncertainty and revisions before it is relied on for a decision with material effect.","Analyse missing information."]},{"heading":"Patterns requiring examination","paragraphs":["The conditions described by the large-scale displacement and regional education pressure create an exceptional operating context for refugee and displaced learner access. Evidence may be incomplete and normal controls may be unavailable, but uncertainty should be stated rather than converted into unsupported assurance. Authorities and providers should record the basis, duration and affected scope of temporary decisions and should reassess them when access, public-health, security or delivery conditions change.","In practical terms, the analysis should be reviewed against a stated method rather than general assurance. Oversight of the issue should reflect the principle that data quality comprises accuracy, completeness, timeliness, consistency and traceability. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. Those required to act should be able to understand the method and its material limitations."]},{"heading":"Implications for decision-makers","paragraphs":["The governing expectation for refugee and displaced learner access should be capable of consistent application. The analysis of the comparison proceeds on the basis that reported averages should be accompanied by sufficient distributional information to identify material differences between learner groups, locations and forms of provision. In relation to data quality in reporting refugee and displaced learner access, criteria affecting learners should not permit materially different interpretation without an evidenced reason.","A narrow control over the measure may create false assurance. In the present context, small differences overstated, changes in definition presented as changes in performance and data revisions not carried through to published conclusions may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. A sample confined to compliant cases cannot establish the reliability of the control."],"bullets":["What proportion is missing or late?","Are revisions carried through to public reports?","Who may amend a record?","Are validation rules operating?","Can reported values be traced to source?"]},{"heading":"Limits of inference","paragraphs":["Assurance of refugee and displaced learner access should draw on more than one form of evidence. Useful records include revision and comparability records, disaggregated results, population and sampling information, uncertainty estimates where relevant, and triangulation with administrative and qualitative evidence. System-wide assurance cannot be inferred from a favourable case chosen after the event.","For operational review of the analysis, authorities and providers should proceed in a defined sequence. Review of the issue should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. Escalate discrepancies that could alter a published conclusion or individual outcome."]},{"heading":"Limits of inference","paragraphs":["The analytical record for refugee and displaced learner access should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.","Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. the analysis proceeds on the basis that measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. In this case, international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another.","Records relating to the analysis should preserve both the conclusion and its limits. In relation to data quality in reporting refugee and displaced learner access, new evidence should trigger a traceable correction and review of decisions materially affected by the earlier conclusion. The correction process should identify prior users and decisions where published information has had material effect.","Public reporting on the issue should distinguish established fact, analytical judgement and planned action. Material revisions should be traceable to their reason and effective date.","Neither one indicator nor one control can establish the complete position on the comparison. A conclusion should be revised when stronger evidence materially changes the assessment of implementation, outcome or risk."]}],"word_count":737,"content_hash":"sha256-7f198c7a0fa445f4278177e5cb117cec829d378680657451af9787270fdbacef","seo_keywords":["data quality in reporting refugee and displaced learner access","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}