{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-34c3b5c2f988033d","slug":"2014-09-08-learner-wellbeing-measurement-and-statistical-uncertainty","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2014-09-08","last_modified_date":"2014-09-08","title":"Learner wellbeing: measurement and statistical uncertainty","summary":"Examines learner wellbeing: measurement and statistical uncertainty, defining the evidence base, coverage and limits that should govern comparison and use of the findings.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Health emergency and safe learning environments","reference_authority":"competent international public-health and education authorities","sections":[{"heading":null,"paragraphs":["Current consideration of learner wellbeing is informed by the health emergency and safe learning environments, with consequences for governance, evidence and the treatment of affected learners. For the comparison, the value of the present data lies in the questions it can answer reliably and in the limits it makes visible. The control response should be sufficient to protect learners while avoiding burdens not justified by the evidence."]},{"heading":"Evidence and method","paragraphs":["The circumstances described by the health emergency and safe learning environments are developing and may differ materially between locations. Decisions on learner wellbeing should therefore be based on verified information available for the affected community and should be reviewed as conditions change. Temporary measures require recorded authority, learner communication and an end or review point; urgency does not remove the need to preserve safety, fair treatment and reliable records."]},{"heading":"Patterns requiring examination","paragraphs":["For learner wellbeing, the public interest is not confined to institutional compliance. In reviewing the analysis, learners should receive accurate information, safe provision, timely support and a fair route to raise concerns without adverse treatment. Learners should understand arrangements that materially affect them and have access to timely correction of inaccurate or unfair information, support or decisions.","The technical issue within the analysis concerns the basis on which a conclusion is reached. Oversight of the comparison should reflect the principle that an estimate should be reported with the uncertainty arising from sampling, measurement, missing information and model choice. A precise number may still support only a cautious conclusion if the underlying assumptions are weak. In relation to learner wellbeing, any condition preventing complete assurance should appear with the evidence on which the judgement relies."],"bullets":["Are small groups adequately represented?","Is the apparent difference larger than the measurement error?","How should uncertainty affect the decision?","What are the principal sources of uncertainty?","Would a reasonable alternative assumption change the conclusion?"]},{"heading":"Implications for decision-makers","paragraphs":["Responsibility for learner wellbeing should be visible at the point where consequential decisions are made. In reviewing the measure, a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. A decision should not be closed at the operating level where material impact, conflict or a significant evidential gap remains unresolved.","Failure in relation to the analysis may arise even where the stated policy is reasonable. Material concerns include material information provided too late, conflicts affecting decisions, support responsibilities divided or unclear, and complaints discouraged or delayed. The assessment of an exception should address severity, persistence and the likelihood that the condition is more widely present."]},{"heading":"Limits of inference","paragraphs":["Evidence should be selected against a clearly defined question. For learner wellbeing, the most relevant material is likely to include analysis of recurring issues, evidence that remedies and corrective actions were completed, support standards and response records, and complaint, review and appeal records. In relation to learner wellbeing, confidence is strengthened by corroboration, not by the volume of records drawn from the same underlying source.","Implementation of the available evidence can be tested without imposing unnecessary reporting. Review of the measure should report intervals or sensitivity ranges where appropriate, test whether the conclusion changes under plausible assumptions, and distinguish statistical detectability from educational significance. Record unresolved uncertainty beside the principal finding. Existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance question.","Decision-makers using evidence on the available evidence should be told what the data cannot establish as clearly as what it can. Reporting should state whether a result describes, compares or evaluates, together with the level at which it is valid. A finding should not be transferred beyond its setting without testing the relevant contextual differences."]},{"heading":"Limits of inference","paragraphs":["Care is required in drawing conclusions about learner wellbeing. For the measure, a low complaint count may indicate effective provision, but it may also reflect inaccessible processes, fear of consequences or lack of awareness. Additional evidence is required. In reviewing the measure, a single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners. Decision-makers and affected users should receive the conclusion together with its material evidential limits.","The assurance record for the available evidence should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. Traceable source and version information allow genuine improvement to be distinguished from administrative revision. The evidential history should preserve conclusions that were operative when a material decision was made.","Accountability for the measure should follow decision-making authority.","Authorities and providers should use the current development to test whether the measure connects public commitment with effective operation and evidence of result. Institutional improvement and public confidence both depend on transparent responsibility and credible evidence."]}],"word_count":794,"content_hash":"sha256-e19303fd26eaab2a14bada5c207c3f9d0c1710f7e94c3bcbcca26104208852cf","seo_keywords":["learner wellbeing","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}