{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-602f6530cc68a205","slug":"2012-08-21-using-internal-evidence-to-strengthen-large-scale-open-online-learning","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2012-08-21","last_modified_date":"2012-08-21","title":"Using internal evidence to strengthen large-scale open online learning","summary":"Provides an evidence-led method for improving using internal evidence to strengthen large-scale open online learning, from definition of the problem to review of effectiveness.","category":{"code":"QUALITY_IMPROVEMENT_METHODS","label":"Quality Improvement Methods"},"article_type":"Quality improvement method","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Rapid expansion of open online courses in 2012","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The immediate international context is the rapid expansion of open online courses in 2012. Its significance for internal evidence to strengthen large-scale open online learning lies in the quality of implementation rather than in formal acknowledgement alone. The analysis of the practice proceeds on the basis that the purpose of an improvement method is not to produce an action plan; it is to change a material condition and verify that the change is sustained. Learner protection and reliable information should remain central when the scale of the response is determined.","The stated reference is the rapid expansion of open online courses in 2012. Application to the improvement objective depends on evidence from the relevant jurisdiction or institution. That distinction should remain visible in the decision record, public reporting and later review.","In relation to using internal evidence to strengthen large-scale open online learning, the central objective should not be obscured by the form of the administrative response. The analysis of the corrective programme proceeds on the basis that a change in delivery mode should not weaken the defined learning outcomes, learner protection, accessibility or reliability of assessment. Formal adoption, expenditure and activity do not in themselves establish the intended result. Assurance should address actual effect and provide a means of correcting disadvantage that the arrangement did not intend."]},{"heading":"Defining the problem","paragraphs":["In practical terms, internal evidence to strengthen large-scale open online learning should be reviewed against a stated method rather than general assurance. Oversight of using internal evidence to strengthen large-scale open online learning should reflect the principle that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Transfer of decisions or records can expose weaknesses not visible in separate reviews of individual controls. Decision-makers should receive an intelligible account of how the result was reached and where it should not be applied.","Implementation of the issue under review should be organised around a decision that can be tested. Oversight of the practice should reflect the principle that the intervention should be tested on a scale proportionate to the risk before wider implementation, unless immediate system-wide action is necessary to protect learners. Resources and activity should be reconciled with the operating evidence and result for which the responsible function is accountable."]},{"heading":"Improvement method","paragraphs":["Failure in relation to internal evidence to strengthen large-scale open online learning may arise even where the stated policy is reasonable. Material concerns include unclear identity and participation records, technology access determining educational access, inaccessible content or interaction, and reduced opportunities for timely support. An exception should be assessed by effect, duration, recurrence and reach, including possible exposure beyond the initial sample.","Collection should follow a stated evidential need, not the accidental availability of particular records. For the improvement objective, the most relevant material is likely to include teacher capability and workload information, supplier performance and exit arrangements, accessibility and usability testing, and service availability and incident records. In relation to using internal evidence to strengthen large-scale open online learning, each source has limitations; confidence depends on corroboration between independent records and transparent treatment of uncertainty.","For operational review of the corrective programme, authorities and providers should proceed in a defined sequence. A competent examination of the matter should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. Recurrence, common cause or wider exposure requires systemic action in addition to correction of individual cases. Findings should state the affected scope and required action; an observation should not be represented as evidence of conformity or effectiveness."]},{"heading":"Measures and review","paragraphs":["The improvement record for internal evidence to strengthen large-scale open online learning should contain the verified problem, affected scope, immediate containment, causal analysis, selected intervention, accountable owner, resources, milestones and effectiveness measure. A completed task does not close the matter unless improvement in the relevant condition is established. The oversight record should preserve both outstanding action and the risk that continues during implementation.","Interpretation of the intervention should not extend beyond the population, period and setting examined. For the improvement objective, digital participation data should not be treated as a direct measure of learning. Log-ins, connection time and activity counts require interpretation alongside assessment and learner experience. In reviewing the intervention, a short-term increase in activity may not represent sustained improvement. Measures should remain in place long enough to detect recurrence and unintended effects. Material limitations should be stated with the finding presented to decision-makers and affected learners.","The assurance record for the practice should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. Earlier conclusions should remain traceable if they affected a learner, provider or public decision.","Public reporting on the issue under review should distinguish established fact, analytical judgement and planned action. Material revisions should be traceable to their reason and effective date. A revised conclusion should distinguish a change in the underlying condition from a change in method, coverage or evidence.","The appropriate response to the practice is therefore one of controlled implementation and review. The objective should be explicit, the evidence proportionate and learner impact visible. An evidential gap should lead to a qualified conclusion and continued action, not administrative closure."]}],"word_count":871,"content_hash":"sha256-ced260231e067e56edd016ee1051d2fb066ed3ada04da2a83794d628c833d2fa","seo_keywords":["using internal evidence to strengthen large-scale open online learning","education quality improvement","education quality","ICEQC"],"schema_type":"TechArticle"}