{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-3333bd29e8d0ecd9","slug":"2019-12-23-what-national-averages-conceal-about-open-educational-resources","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2019-12-23","last_modified_date":"2019-12-23","title":"What national averages conceal about open educational resources","summary":"Assesses evidence on what national averages conceal about open educational resources, with particular attention to definitions, population coverage, comparability.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"International recommendation adopted in November 2019","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["Current consideration of open educational resources is informed by the international recommendation adopted in November 2019, with consequences for governance, evidence and the treatment of affected learners. For the analysis, the principal analytical task is to separate an observed difference from a conclusion about its cause. Learner protection and reliable decisions require controls commensurate with the nature and scale of risk.","A proper review of the available evidence should establish the intended outcome before selecting controls or indicators. In reviewing the available evidence, trend claims require comparable observations over time and a documented account of revisions, breaks in series and changes in coverage. In relation to what national averages conceal about open educational resources, the record should explain why the approach suits the affected context, how material departures are authorised and when review will occur."]},{"heading":"Analytical scope","paragraphs":["The formal status of the international recommendation adopted in November 2019 should be preserved in any public account. For open educational resources, the instrument should be used to identify the intended direction, the actors addressed and the implementation measures that remain necessary.","The technical issue within the available evidence concerns the basis on which a conclusion is reached. In reviewing the measure, an average may improve while a material group experiences no improvement or a worse outcome. Disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals. The decision record should distinguish the scope supported by evidence from any scope that remains unresolved.","A narrow control over the comparison may create false assurance. In the present context, outdated or inaccurate material, confusion between participation and recognised achievement and uncertain responsibility for learner support may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. The test should deliberately include exceptions and cases in which the expected outcome was not achieved.","The evidential record for the available evidence should permit a reviewer to trace the matter from decision to outcome. This may require accessibility checks, version and maintenance information, correction and withdrawal controls, and clear statements on support and assessment, supported by academic and technical review and licence and provenance records. Conflicting records, absent populations and uncertain follow-through require additional testing."]},{"heading":"Definitions and data coverage","paragraphs":["Implementation of open educational resources can be tested without imposing unnecessary reporting. For the comparison, the reviewer should examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. In relation to what national averages conceal about open educational resources, information should not be treated as sufficient merely because it is already available; its relevance to the present question must be established.","Decisions concerning the issue should remain traceable to the information available for the stated reference period. The reason for revision should be explicit, including whether it arises from new evidence, a methodological change or a different interpretation. Transparent treatment of reporting changes prevents artificial movement from being read as substantive progress or decline."],"bullets":["Which groups are concealed by the aggregate?","Are group definitions stable?","Which disparity requires action first?","Are sample sizes adequate?","Could missing data be unequal?"]},{"heading":"Use of the findings","paragraphs":["For open educational resources, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Evidence of outcome, rather than completion of tasks, should determine whether corrective work can close.","The analytical record for the issue should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations."],"bullets":["Review content and accessibility.","Identify authorship and version before it is relied on for a decision with material effect.","Provide correction routes.","Monitor use without overstating learning.","Maintain or withdraw outdated material."]},{"heading":"Uncertainty and safeguards","paragraphs":["The system and institutional dimensions of open educational resources should be considered together. In reviewing the issue, open access can widen participation, but users require clear information about authorship, licence, quality, accessibility, maintenance and the status of any learning or assessment. Authorities and providers hold different responsibilities, both of which must be discharged for the arrangement to operate reliably. Neither public oversight nor provider control removes the responsibilities assigned to the other level.","Proportionality in relation to the comparison does not mean reduced protection for learners exposed to greater risk. Oversight of the analysis should reflect the principle that availability is not equivalent to accessibility, participation or learning. Each outcome requires separate evidence. A decision concerning the analysis should recognise that a single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners. No exception should continue without a documented basis, accountable approval and scheduled review.","The measure of progress on the analysis is not the amount of policy or documentation produced. Performance should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity."]}],"word_count":815,"content_hash":"sha256-22543c96fcc93e3d8108d03c9a18c81a3519b77d032a427d6193f77608549fb9","seo_keywords":["what national averages conceal about open educational resources","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}