{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-59f5d5e391cb60ca","slug":"2009-09-30-documented-controls-for-assessment-moderation","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2009-09-30","last_modified_date":"2009-09-30","title":"Documented controls for assessment moderation","summary":"Sets out the scope, decision criteria and evidential basis relevant to documented controls for assessment moderation, including the treatment of material limitations.","category":{"code":"STANDARDS_INTERPRETATION","label":"Standards Interpretation"},"article_type":"Standards interpretation","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Cross-system comparability and academic standards","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The immediate international context is the cross-system comparability and academic standards. Its significance for documented controls for assessment moderation lies in the quality of implementation rather than in formal acknowledgement alone. In reviewing the assurance question, a standard is effective only when its terms lead to consistent decisions without displacing professional judgement or applicable law. Proportionality requires controls sufficient to protect learners without imposing measures unrelated to the identified risk.","Implementation of the control should be organised around a decision that can be tested. For the assurance question, conformity should not be inferred from a policy document alone; operating records and outcomes should show that the stated arrangements are in use. In relation to documented controls for assessment moderation, resources and activity should be reconciled with the operating evidence and result for which the responsible function is accountable."]},{"heading":"Meaning in practice","paragraphs":["The contemporaneous context is established by the cross-system comparability and academic standards. It does not, without setting-specific evidence, demonstrate the operation of documented controls for assessment moderation. Decision-makers should state which matters are evidenced, which express policy and which require authorised judgement.","The quality significance of the stated expectation follows from a basic distinction between availability and effective provision. Oversight of the relevant requirement should reflect the principle that assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Review should cover the stages at which learners receive information, provision, assessment, support and remedy."],"bullets":["Define the decision each assessment must support.","Retain evidence sufficient for review.","Moderate material variation.","Calibrate assessors.","Review differential and anomalous results."]},{"heading":"Responsibilities and material risks","paragraphs":["In practical terms, documented controls for assessment moderation should be reviewed against a stated method rather than general assurance. For the stated expectation, a reliable record should identify what occurred, when it occurred, who was responsible, the authority for the action and any later correction. Records should remain protected against unauthorised alteration while legitimate amendments remain visible. Decision-makers should receive an intelligible account of how the result was reached and where it should not be applied.","The principal risks in relation to the control are uncontrolled changes to assessment, weak assurance of authorship or performance, inconsistent judgement between markers or locations, and tasks that do not assess the stated outcome. In relation to documented controls for assessment moderation, the relationship between the risks is material: one failed safeguard may remove the evidence needed to activate another.","Relevant evidence for documented controls for assessment moderation will normally include marking criteria and calibrated judgement, authorship and identity controls proportionate to risk, moderation and exception records, approval and change-control records, and assessment maps to learning outcomes. The record should retain disagreement between sources until its cause and effect are understood."],"bullets":["Can records be retrieved throughout the required period?","Are access rights proportionate?","Are partner records subject to equivalent controls?","Is the record attributable?","Can an amendment be distinguished from the original?"]},{"heading":"Basis for a reliable conclusion","paragraphs":["For operational review of documented controls for assessment moderation, authorities and providers should proceed in a defined sequence. In reviewing the issue under review, responsible bodies should specify mandatory fields, source ownership, access rights, retention and correction procedures. Test a sample from creation through use, amendment, reporting and disposal, including records created during disruption or by a delivery partner. The record should distinguish a finding that requires action from an observation that supports no formal conclusion.","Assurance concerning the control should be expressed at the level established by the evidence.","The analysis of the issue under review should remain within the limits of the evidence. A decision concerning the assurance question should recognise that the volume of documentation is not a measure of conformity. Relevance, integrity and coverage are more important than the number of records produced. Oversight of the stated expectation should reflect the principle that reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement.","Decisions concerning the stated expectation should remain traceable to the information available for the stated reference period. The reason for revision should be explicit, including whether it arises from new evidence, a methodological change or a different interpretation.","For the control, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Material action requires a named responsible function and a defined completion point. Evidence of outcome, rather than completion of tasks, should determine whether corrective work can close.","The measure of progress on the assurance question is not the amount of policy or documentation produced. Progress is demonstrated when the intended educational result is achieved, adverse variation is identified and responsible bodies act where it is not."]}],"word_count":777,"content_hash":"sha256-7bb510fba426f434a4c415b8ce044d7bd86f128b60d2e9362a9d60b89afc434b","seo_keywords":["documented controls for assessment moderation","education quality standards","education quality","ICEQC"],"schema_type":"TechArticle"}