{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-cac84e48725c4bd3","slug":"2008-01-11-risk-and-assurance-controls-for-education-data-quality","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2008-01-11","last_modified_date":"2008-01-11","title":"Risk and assurance controls for education data quality","summary":"Explains how risk and assurance controls for education data quality should be applied in practice, including scope, evidential sufficiency, accountable decisions and justified.","category":{"code":"STANDARDS_INTERPRETATION","label":"Standards Interpretation"},"article_type":"Standards interpretation","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"International indicator comparability","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The present attention to education data quality follows the international indicator comparability and requires a careful distinction between public commitment, institutional practice and demonstrated result. For the assurance question, the central issue is the meaning of the expectation in practice, including its scope, the evidence needed to demonstrate it and the circumstances in which it may not apply.","In relation to risk and assurance controls for education data quality, the intended substantive result should remain the starting point for review. Oversight of risk and assurance controls for education data quality should reflect the principle that education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation. Inputs and formal commitments should be distinguished from demonstrated operation and outcome. Assurance should address actual effect and provide a means of correcting disadvantage that the arrangement did not intend."]},{"heading":"Meaning in practice","paragraphs":["Assurance of education data quality should draw on more than one form of evidence. Useful records include coverage and missingness analysis, uncertainty estimates where relevant, indicator definitions and metadata, revision and comparability records, and disaggregated results. Documents should be reconciled with observed practice and, where relevant, the experience of affected learners.","The historical reference basis is the international indicator comparability. Its relevance to the relevant requirement should be assessed against the affected jurisdiction, learner population and form of provision. The international development warrants attention, but a consequential conclusion still requires current, attributable and representative evidence for the affected scope.","In practical terms, the stated expectation should be reviewed against a stated method rather than general assurance. The analysis of the assurance question proceeds on the basis that data quality comprises accuracy, completeness, timeliness, consistency and traceability. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision. The method, assumptions and limitations should be stated in terms suitable for responsible decision-making.","Risk assessment of the relevant requirement should give particular attention to averages concealing distribution, small differences overstated, and proxy measures treated as direct outcomes. A provider should also consider incomplete coverage and data revisions not carried through to published conclusions."]},{"heading":"Responsibilities and material risks","paragraphs":["Responsibility for education data quality should be visible at the point where consequential decisions are made. A decision concerning the control should recognise that evidence is sufficient when it is current, attributable, representative of the relevant scope and capable of being reconciled with other available records. A decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.","The relevant requirement, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions.","Responsibility for the control should be identifiable at each consequential decision point. Accountability for learner impact should remain explicit when delivery tasks are delegated. In relation to risk and assurance controls for education data quality, revision should not remove an earlier conclusion from the record where reliance has occurred."],"bullets":["Analyse missing information.","Report uncertainty and revisions.","Test comparability.","Avoid causal claims unsupported by the design.","Define the decision the indicator will inform."]},{"heading":"Basis for a reliable conclusion","paragraphs":["A proportionate method is available for education data quality. Examination of the matter should trace selected records to source, reconcile totals across systems, quantify missing and late submissions, review manual adjustments and retain a revision history. Escalate discrepancies that could alter a published conclusion or individual outcome. Averages should be tested against adverse cases that may indicate unequal effect or incomplete operation.","The final record on the assurance question should identify the applicable expectation, the relevant scope, the evidence examined, the sampling basis, material exceptions and the reason for the conclusion. Equivalent methods should be assessed by demonstrated result, with the basis for acceptance retained. No complete conclusion should be recorded while a material evidential limitation remains.","The analysis of the control should remain within the limits of the evidence. The analysis of the relevant requirement proceeds on the basis that an isolated example cannot establish consistent operation, and an isolated failure should be evaluated for materiality, recurrence and systemic effect. In reviewing the issue under review, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. Material uncertainty should result in further enquiry or an expressly limited finding.","Responsibility for the issue under review should be identifiable at each consequential decision point. Public confidence cannot be separated from an institution's ability to identify responsibility and substantiate its conclusions."]}],"word_count":745,"content_hash":"sha256-8431bdd9a0547fd7826890efd953dc72ff3ece2d325750eecd23adf4e78e1a0b","seo_keywords":["risk and assurance controls for education data quality","education quality standards","education quality","ICEQC"],"schema_type":"TechArticle"}