{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-390045cc7bbb0599","slug":"2011-07-28-assessment-security-a-documented-improvement-approach","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2011-07-28","last_modified_date":"2011-07-28","title":"Assessment security: a documented improvement approach","summary":"Provides an evidence-led method for improving assessment security: a documented improvement approach, from definition of the problem to review of effectiveness and residual risk.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Continuity and integrity during disruption","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The policy and evidence context for assessment security has been materially shaped by the continuity and integrity during disruption. In reviewing the improvement objective, a disciplined improvement process separates immediate containment from corrective action directed at the underlying cause. The unit of review should correspond to the full reach of the decision, including significant differences in provision and population."]},{"heading":"Scope of the improvement","paragraphs":["The circumstances described by the continuity and integrity during disruption are developing and may differ materially between locations. Decisions on assessment security should therefore be based on verified information available for the affected community and should be reviewed as conditions change. Temporary measures require recorded authority, learner communication and an end or review point; urgency does not remove the need to preserve safety, fair treatment and reliable records.","The governing expectation for the improvement objective should be capable of consistent application. For the intervention, follow-up should determine whether the change is embedded in ordinary operations and whether it has created new risks or unequal effects. Definitions should provide a stable basis for decisions while allowing relevant differences to be identified and justified.","In practical terms, the issue under review should be reviewed against a stated method rather than general assurance. A decision concerning the issue under review should recognise that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Assurance should examine the complete process, including each change in custody, authority or decision ownership.","Assurance of the improvement objective should draw on more than one form of evidence. Useful records include authorship and identity controls proportionate to risk, approval and change-control records, marking criteria and calibrated judgement, moderation and exception records, and analysis of results and differential outcomes. Documents should be reconciled with observed practice and, where relevant, the experience of affected learners. In relation to assessment security, evidence of effectiveness should represent the declared scope, including adverse and exceptional cases."]},{"heading":"Implementation responsibilities","paragraphs":["The system and institutional dimensions of assessment security should be considered together. For the corrective programme, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result.","Risk assessment of the practice should give particular attention to tasks that do not assess the stated outcome, reasonable adjustment altering the assessed outcome, and uncontrolled changes to assessment. A provider should also consider results used beyond the evidence they support and inconsistent judgement between markers or locations. The control response should reflect whether an affected learner can identify the error and obtain an effective remedy in time."],"bullets":["Define the decision each assessment must support.","Moderate material variation.","Review differential and anomalous results.","Retain evidence sufficient for review before using it to determine a learner or provider outcome.","Align tasks and criteria with learning outcomes."]},{"heading":"Testing effectiveness","paragraphs":["The review method for assessment security should be reproducible. Review of the intervention should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Where evidence indicates a shared cause or broader reach, the response should extend beyond the initial case. Documentation should be sufficient to reconstruct the judgement without relying on unrecorded explanation.","Improvement of the issue under review should proceed through controlled tests where risk permits.","Proportionality in relation to the issue under review does not mean reduced protection for learners exposed to greater risk. For the corrective programme, reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. The analysis of the improvement objective proceeds on the basis that correcting an individual record does not establish that the process which produced the error has been corrected.","Records relating to the practice should preserve both the conclusion and its limits. If further evidence changes the position, the correction should identify its scope and any earlier decision requiring reconsideration. This is material where learners, authorities or institutions relied on information that cannot be corrected by replacing the current text alone."]},{"heading":"Maintaining the result","paragraphs":["For assessment security, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. In relation to assessment security, material action requires a named responsible function and a defined completion point. Closure requires evidence that the condition has changed; completion of planned activity is not sufficient.","Assessment of the intervention should reconcile more than one source of evidence and control. A reasoned conclusion should reconcile the governing requirement, evidence of operation, learner outcomes and residual risk, and remain open to better evidence."]}],"word_count":752,"content_hash":"sha256-3c893df871c1e35ca2c0b02cba8d5a5fafc6d0203fb1725a3bfada1656d21ae1","seo_keywords":["assessment security","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}