Data and research analysis

Data governance in monitoring evidence-informed teaching

Data Research

Assesses the evidence concerning evidence-informed teaching, including comparability, uncertainty and limits on interpretation.

Current consideration of evidence-informed teaching is informed by the teaching quality agenda, with consequences for governance, evidence and the treatment of affected learners. Data used for the evidence under review should be interpreted against stable definitions and an identifiable population. A revision or break in series should not be reported as a change in performance. Arrangements for the comparison should provide accurate information, timely support and an accessible route for correction or review without adverse treatment. Analysis of the comparison should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Comparative findings should not conceal differences capable of changing their meaning.

The present position

Analysis of evidence-informed teaching should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. A comparison is reliable only if material differences remain visible. Decision-makers should state which matters are evidenced, which express policy and which require authorised judgement. Decisions and public statements should preserve the distinction, including when the matter is reconsidered.

For the evidence under review, the public interest is not confined to institutional compliance. For the reported measure, education quality depends on sufficient numbers of competent staff who are prepared, supported and assigned work they can perform effectively. Where learners rely on published information or support decisions, errors should be identifiable and capable of prompt, fair correction.

A focused examination of the comparison requires a clear analytical discipline. Oversight of the evidence under review should reflect the principle that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Governance of the evidence under review requires a clear allocation of authority, information and follow-through. A material issue should not remain with a function lacking authority to resolve it. The distinction matters because evidence may appear sufficient while addressing a different population, period or outcome.

Responsibility for the matter examined should be visible at the point where consequential decisions are made. Any indicator used in relation to the comparison should distinguish description from causal explanation. A reported result should state how outcomes are distributed and where transfer beyond the observed setting is not supported. The matter should be escalated when evidence is incomplete, a conflict is present, affected learners are not represented or the likely effect is material.

Analysis of the analytical question should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information. Material concerns include weak evaluation of teaching support, use of staff outside their competence, professional learning disconnected from practice, and workload that limits preparation and feedback. Risk assessment for the analytical question should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material.

Assurance of the analytical question should draw on more than one form of evidence. Useful records include induction and professional learning participation, support and supervision records, workload and allocation data, observation and learner feedback, and workforce plans and vacancy information. Assurance should compare the documented arrangement with its operation and learner effect. A selected successful case does not establish effectiveness across the system.

Application in practice

A proportionate method is available for evidence-informed teaching. The method for the evidence under review is to map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. The conclusion should identify whether further sampling or system-level action is required.

Publication of findings on the analytical question should distinguish observed values, estimates and interpretation. Where disaggregation creates small or unstable groups, confidentiality and uncertainty should be managed without concealing a material disparity that requires further investigation.

Interpretation of the evidence under review should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. A proportionate examination of the analytical question should test routine operation together with adverse and exceptional cases across the relevant delivery settings. Assurance should also consider whether staff can apply the required practice and whether organisational conditions permit them to do so. For the reported measure, a single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners.

Decisions concerning the analytical question should remain traceable to the information available for the stated reference period. Any indicator used in relation to the reported measure should distinguish description from causal explanation. Analysis of the reported measure should state the unit of analysis, reference period, coverage, exclusions and treatment of missing information.

Where the comparison involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Governance between participating bodies should make information duties and corrective authority explicit. A proportionate examination of the evidence under review should test routine operation together with adverse and exceptional cases across the relevant delivery settings.

The measure of progress on the analytical question is not the amount of policy or documentation produced. A credible measure shows whether the intended result is present across the affected scope and what action follows when it is not.