{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-54bcd073facfd5bd","slug":"2013-10-14-cross-system-comparability-in-teaching-and-learning-quality","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2013-10-14","last_modified_date":"2013-10-14","title":"Cross-system comparability in teaching and learning quality","summary":"Assesses evidence on cross-system comparability in teaching and learning quality, with particular attention to definitions, population coverage, comparability and uncertainty.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Global teaching and learning policy debate in 2013","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The policy and evidence context for teaching and learning quality has been materially shaped by the global teaching and learning policy debate in 2013. In this case, the principal analytical task is to separate an observed difference from a conclusion about its cause.","In relation to cross-system comparability in teaching and learning quality, the intended substantive result should remain the starting point for review. In reviewing the comparison, education quality depends on sufficient numbers of competent staff who are prepared, supported and assigned work they can perform effectively. Inputs and formal commitments should be distinguished from demonstrated operation and outcome. Assurance should address actual effect and provide a means of correcting disadvantage that the arrangement did not intend."]},{"heading":"Evidence and method","paragraphs":["Relevant evidence for teaching and learning quality will normally include workforce plans and vacancy information, workload and allocation data, observation and learner feedback, support and supervision records, and qualification and competence records. In relation to cross-system comparability in teaching and learning quality, the record should retain disagreement between sources until its cause and effect are understood.","The stated reference is the global teaching and learning policy debate in 2013. Application to the analysis depends on evidence from the relevant jurisdiction or institution. Authorities and providers should distinguish established fact, policy expectation and matters left to institutional judgement. That distinction should remain visible in the decision record, public reporting and later review.","The 2013/4 Education for All Global Monitoring Report, Teaching and Learning: Achieving Quality for All, places teaching quality and equitable learning at the centre of the post-2015 discussion. It links teacher preparation, deployment, support and working conditions with learner outcomes. Workforce indicators should consequently be interpreted alongside evidence of classroom practice, access to qualified teachers and differences between locations and learner groups.","A focused examination of the comparison requires a clear analytical discipline. For the analysis, comparison requires more than the use of a common label. Definitions, reference periods, population coverage, institutional boundaries and collection practices must be sufficiently aligned for the observed difference to have a stable meaning.","Failure in relation to the issue may arise even where the stated policy is reasonable. Material concerns include use of staff outside their competence, vacancies or turnover affecting continuity, weak evaluation of teaching support, and professional learning disconnected from practice. Materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records."]},{"heading":"Patterns requiring examination","paragraphs":["The governing expectation for teaching and learning quality should be capable of consistent application. A decision concerning the comparison should recognise that a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. Definitions should provide a stable basis for decisions while allowing relevant differences to be identified and justified.","In this case, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Closure requires evidence that the condition has changed; completion of planned activity is not sufficient.","Decisions concerning the comparison should remain traceable to the information available for the stated reference period."],"bullets":["Forecast workforce need.","Monitor workload and turnover.","Prioritise support where learner need is greatest.","Protect time for preparation and feedback, identifying the accountable function and affected scope.","Evaluate professional learning in practice."]},{"heading":"Implications for decision-makers","paragraphs":["The review method for teaching and learning quality should be reproducible. The method for the measure is to prepare a comparability table before analysing results. Record common elements, material differences, breaks in series and the direction in which each limitation may affect the conclusion; do not rank systems where those limitations remain material. Working papers should allow another competent reviewer to understand the evidence, judgement and treatment of material exceptions.","Decision-makers using evidence on the measure should be told what the data cannot establish as clearly as what it can. The nature of the result and its applicable unit—system, institution, programme or learner group—should be explicit. Application in another setting depends on a separate examination of context and comparability.","the analysis should remain within the limits of the evidence. The analysis of the available evidence proceeds on the basis that missing or delayed information may be patterned rather than random. Oversight of the measure should reflect the principle that qualifications and participation in training are inputs. Material uncertainty should result in further enquiry or an expressly limited finding.","The appropriate response to the available evidence is therefore one of controlled implementation and review. A clear objective, proportionate evidential basis and account of affected learners are required. An evidential gap should lead to a qualified conclusion and continued action, not administrative closure."]}],"word_count":770,"content_hash":"sha256-24248a0405c3b0d3b3f111d57e0b6f695cc234f88d567db06d1e59fd42c03b30","seo_keywords":["cross-system comparability in teaching and learning quality","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}