{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-6c62062d3029e4c6","slug":"2012-02-21-learning-outcome-transparency-interpreting-regional-variation","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2012-02-21","last_modified_date":"2012-02-21","title":"Learning-outcome transparency: interpreting regional variation","summary":"Assesses evidence on learning-outcome transparency: interpreting regional variation, with particular attention to definitions, population coverage, comparability and uncertainty.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Skills, qualifications and mobility policy","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The policy and evidence context for learning-outcome transparency has been materially shaped by the skills, qualifications and mobility policy. Oversight of the analysis should reflect the principle that evidence should inform action without implying a level of precision, coverage or causal certainty that the underlying data cannot support. The effect on learner access and reliable decision-making should inform the scale of control applied."]},{"heading":"Evidence base for learning-outcome transparency","paragraphs":["The stated reference is the skills, qualifications and mobility policy. Application to learning-outcome transparency depends on evidence from the relevant jurisdiction or institution. Reporting should preserve the different status of facts, public expectations and choices made by institutions.","Implementation of the comparison should be organised around a decision that can be tested. In reviewing the issue, a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. In relation to learning-outcome transparency, resources and activity should be reconciled with the operating evidence and result for which the responsible function is accountable.","In practical terms, the issue should be reviewed against a stated method rather than general assurance. The analysis of the available evidence proceeds on the basis that an average may improve while a material group experiences no improvement or a worse outcome. Disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals.","Relevant evidence for the measure will normally include cross-border agreements and responsibility maps, complaint and appeal routes, outcomes for mobile and non-mobile learners, published admission and recognition criteria, and secure and verifiable learner records. Currency, provenance and representativeness should be established before evidence is used for assurance. In relation to learning-outcome transparency, conflicting records require reconciliation before a complete assurance conclusion is reached."]},{"heading":"Coverage and comparability","paragraphs":["For learning-outcome transparency, the public interest is not confined to institutional compliance. In reviewing the comparison, learners should receive accurate information about the status, level, content and recognition of learning before committing time or money across jurisdictions. Learner protection requires intelligible information and a timely means of reviewing consequential mistakes or unfair decisions.","Failure in relation to the issue may arise even where the stated policy is reasonable. Material concerns include unclear awarding responsibility, jurisdictional uncertainty in complaints, claims that overstate recognition or transferability, and loss of records across borders. The assessment of an exception should address severity, persistence and the likelihood that the condition is more widely present."],"bullets":["State the legal and academic status of the offer, with responsibility, scope and timing recorded.","Provide support suited to mobile learners before using it to determine a learner or provider outcome.","Apply criteria consistently before using it to determine a learner or provider outcome.","Preserve verifiable records.","Monitor partner and jurisdictional risks."]},{"heading":"Responsible interpretation","paragraphs":["Implementation of learning-outcome transparency can be tested without imposing unnecessary reporting. In reviewing the comparison, responsible bodies should examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. Existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance question.","The analytical record for the comparison should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.","Interpretation of the issue should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. Oversight of the measure should reflect the principle that transparency supports fair decision-making but does not make qualifications automatically equivalent. The basis and intended use of recognition should be explicit in each consequential decision. Oversight of the available evidence should reflect the principle that international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another.","Decisions concerning the available evidence should remain traceable to the information available for the stated reference period. Without this distinction, a reporting change may be mistaken for improvement or deterioration in educational practice."]},{"heading":"Limitations and reporting","paragraphs":["Where learning-outcome transparency involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Protection should operate across the complete service, irrespective of how delivery is divided.","The measure of progress on the measure is not the amount of policy or documentation produced. Performance should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity."]}],"word_count":756,"content_hash":"sha256-7f715f28a6687a5e16c1ba03fd47f690de03cc221dde3170d2f1d3b3a4eab921","seo_keywords":["learning-outcome transparency","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}