{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-20c76bb2e27e38db","slug":"2014-02-04-a-staged-improvement-plan-for-online-assessment","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2014-02-04","last_modified_date":"2014-02-04","title":"A staged improvement plan for online assessment","summary":"Describes how improvement in a staged improvement plan for online assessment can be planned, measured and maintained through clear responsibility and follow-up evidence.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Digital delivery and assessment growth","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of online assessment is informed by the digital delivery and assessment growth, with consequences for governance, evidence and the treatment of affected learners. For the corrective programme, improvement should begin with a defined problem, a credible account of its causes and a measure capable of showing whether the response has worked. The proportionality test should consider both the identified risk and the consequences of the control for affected learners."]},{"heading":"Improvement objective and baseline","paragraphs":["The reference point is the digital delivery and assessment growth. Its wider significance does not replace evidence of how online assessment operates in the affected setting. In relation to a staged improvement plan for online assessment, later review should not obscure whether the earlier position rested on fact, policy or judgement."]},{"heading":"Controls and accountable action","paragraphs":["For online assessment, the public interest is not confined to institutional compliance. The analysis of the issue under review proceeds on the basis that assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. Learners should understand arrangements that materially affect them and have access to timely correction of inaccurate or unfair information, support or decisions.","The analysis of the intervention should make its decision rule explicit. For the intervention, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Transfer points should be tested because responsibility and information may be lost between otherwise sound functions. A stated decision rule enables comparable examination and limits retrospective explanations of adverse evidence."],"bullets":["What outcome is intended?","Which evidence establishes operation?","Who controls each stage?","What action is required by the finding?","Where do exceptions occur?"]},{"heading":"Evidence of effect","paragraphs":["A proper review of online assessment should establish the intended outcome before selecting controls or indicators. The analysis of the intervention proceeds on the basis that a complete improvement record should define the baseline, affected scope, causal hypothesis, responsible owner, resources, milestones and measures of effectiveness. A chosen approach should be justified against its context, with departures and review points under documented control.","Risk assessment of the improvement objective should give particular attention to tasks that do not assess the stated outcome, weak assurance of authorship or performance, and inconsistent judgement between markers or locations. A provider should also consider results used beyond the evidence they support and uncontrolled changes to assessment. The control response should reflect whether an affected learner can identify the error and obtain an effective remedy in time."]},{"heading":"Sustaining improvement","paragraphs":["Evidence should be selected against a clearly defined question. For online assessment, the most relevant material is likely to include approval and change-control records, moderation and exception records, marking criteria and calibrated judgement, and analysis of results and differential outcomes. In relation to a staged improvement plan for online assessment, independent records should be reconciled, with disagreement and uncertainty reported alongside the finding.","For operational examination of the matter, authorities and providers should proceed in a defined sequence. A competent review of the practice should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. The finding should state whether the condition is isolated, recurring or potentially systemic.","The improvement record for the improvement objective should contain the verified problem, affected scope, immediate containment, causal analysis, selected intervention, accountable owner, resources, milestones and effectiveness measure. A completed task does not close the matter unless improvement in the relevant condition is established. The oversight record should preserve both outstanding action and the risk that continues during implementation."]},{"heading":"Sustaining improvement","paragraphs":["The analysis of online assessment should remain within the limits of the evidence. The analysis of the practice proceeds on the basis that correcting an individual record does not establish that the process which produced the error has been corrected. Oversight of the practice should reflect the principle that reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. If uncertainty could change a consequential decision, additional evidence or a narrower conclusion is required.","Accountability and effective correction both depend on a record that can be followed from evidence to decision. For the issue under review, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. Material changes require a traceable effective date and explanation so that prior reliance can be reviewed fairly.","Accountability for the improvement objective should follow decision-making authority. Where work is delegated, the record should continue to identify who is accountable for material consequences to learners.","Any response to the present development should test the evidential connection between the issue under review, its implementation and the outcome claimed. Institutional improvement and public confidence both depend on transparent responsibility and credible evidence."]}],"word_count":793,"content_hash":"sha256-f06a3e00f11f8901483275ded3b6a22f0035485fa5a4581571e392016ec61894","seo_keywords":["a staged improvement plan for online assessment","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}