{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-bf02ffb137b1484b","slug":"2009-03-12-timeliness-and-completeness-of-data-on-assessment-moderation","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2009-03-12","last_modified_date":"2009-03-12","title":"Timeliness and completeness of data on assessment moderation","summary":"Assesses evidence on timeliness and completeness of data on assessment moderation, with particular attention to definitions, population coverage, comparability and uncertainty.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Cross-system comparability and academic standards","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Analysis of assessment moderation should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning. Analysis of the measure should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information."]},{"heading":"Evidence and method","paragraphs":["The historical reference basis is the cross-system comparability and academic standards. Data used for assessment moderation should be interpreted against stable definitions and an identifiable population. Apparent movement caused by revision should not be attributed to educational performance. Analysis of the analysis should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.","In relation to timeliness and completeness of data on assessment moderation, the central objective should not be obscured by the form of the administrative response. Analysis of the available evidence should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Reliability depends on preserving the material distinctions between the matters compared. Assurance should not stop at adoption, resourcing or completion of administrative tasks. Data used for the available evidence should be interpreted against stable definitions and an identifiable population. Changes in method, definition or series should remain separate from changes in the underlying result.","In practical terms, the issue should be reviewed against a stated method rather than general assurance. Data used for the issue should be interpreted against stable definitions and an identifiable population. Strength in one dimension does not compensate automatically for weakness in another, particularly where the information informs a consequential learner decision.","Responsibility for the analysis should be visible at the point where consequential decisions are made. A decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.","Risk assessment for the issue should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.","The evidential record for the available evidence should permit a reviewer to trace the matter from decision to outcome. Material variation and uncertainty should be reported together with any restriction on wider application. In relation to timeliness and completeness of data on assessment moderation, further cases should be examined when the initial sample does not represent the affected scope or confirm sustained correction."]},{"heading":"Patterns requiring examination","paragraphs":["Data used for the analysis should be interpreted against stable definitions and an identifiable population. Interpretation should retain uncertainty, distributional differences and limits on generalisation. Escalate discrepancies that could alter a published conclusion or individual outcome. Public information on the available evidence should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction.","The assurance record for the analysis should permit another competent reviewer to understand the evidence, method, judgement and treatment of material exceptions. The evidential basis for the analysis should identify source, period, coverage and material limitations. Corroboration is required where a single record cannot support the decision.","A revision or break in series should not be reported as a change in performance. In reviewing the comparison, missing or delayed information may be patterned rather than random. For the measure, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. If uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.","Decisions concerning the comparison should remain traceable to the information available for the stated reference period. The reason for revision should be explicit, including whether it arises from new evidence, a methodological change or a different interpretation.","Records concerning the comparison should remain traceable from source evidence to decision and follow-up. Superseded conclusions should be retained where they informed a material outcome. Any indicator used in relation to assessment moderation should distinguish description from causal explanation. If definitions, coverage or evidence alter an earlier conclusion, the reason should be stated so that revision is not mistaken for changed performance.","Any indicator used in relation to the analysis should distinguish description from causal explanation.","A conclusion on the issue under review should extend no further than the available evidence permits.","Records concerning the issue under review should remain traceable from source evidence to decision and follow-up. Assurance concerning the issue under review should state the scope examined, evidence relied upon and any condition preventing a complete conclusion.","Missing populations, inconsistent records and unresolved exceptions should be reported with the finding.","Public information on the issue under review should state the applicable scope and limitations in terms that affected users can understand, including the basis for any later correction. Unsupported elements should remain open.","Evidence concerning the issue under review should be current, attributable and representative of the affected scope."]}],"word_count":781,"content_hash":"sha256-cef94192bf10fe074b91aa5fcd62726b97987bf6b3e1d16b8c52381ecc7feb98","seo_keywords":["timeliness and completeness of data on assessment moderation","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}