Measuring education leadership across education systems

The accountability and institutional governance provides the immediate reference point for consideration of education leadership in 2017. The analysis proceeds on the basis that the available evidence should be interpreted with close attention to definitions, population coverage, collection methods and the limits of comparison.

The reference point is the accountability and institutional governance. Its wider significance does not replace evidence of how the comparison operates in the affected setting.

Evidence base for measuring education leadership across education systems

For education leadership, the central objective should not be obscured by the form of the administrative response. Governing bodies should receive sufficient, reliable and timely information to oversee education quality, learner protection and material institutional risk. The existence of an approved measure or completed activity is not evidence of educational effect. Implementation evidence should be sufficient to identify unequal consequences and assign corrective responsibility.

In work concerning education leadership, the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Particular attention should be given to interfaces where responsibility or records pass from one function to another. A conclusion concerning education leadership should identify both its evidential basis and the part of the stated scope for which assurance cannot be given.

Within the scope under review, responsibility should be identifiable at the point where consequential decisions are made. In this case, a sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice.

Assurance of the analysis should draw on more than one form of evidence. Useful records include independent review records, corrective-action verification, conflict declarations and controls, public reports reconciled with controlled records, and risk and assurance plans.

• Test management assurance, identifying the accountable function and affected scope.
• Define information required for oversight before it informs a consequential decision.
• Escalate material exceptions.
• Verify corrective action independently, identifying the accountable function and affected scope.
• Assign decision authority explicitly before using it to determine a learner or provider outcome.

Coverage and comparability

The principal risks in relation to education leadership are material risks omitted from reporting, corrective action closed without verification, conflicts not identified, and management assurance accepted without testing. A weakness in one part of the control environment may obscure a related failure elsewhere.

The method for the available evidence is to map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. For education leadership, the conclusion should identify whether further sampling or system-level action is required. Contrary evidence should not be removed merely because aggregate performance appears acceptable.

The analytical record for education leadership should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.

Interpretation of the comparison should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. When examining education leadership, governance structures do not provide assurance merely because committees exist. Membership, information quality, challenge, decisions and follow-through determine whether oversight is effective. Missing or delayed information may be patterned rather than random.

Decisions concerning the issue should remain traceable to the information available for the stated reference period. As regards education leadership, a revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. Within the scope under review, without this distinction, a reporting change may be mistaken for improvement or deterioration in educational practice.

Public reporting on the issue should distinguish established fact, analytical judgement and planned action. For education leadership, material revisions should be traceable to their reason and effective date. A revised conclusion should distinguish a change in the underlying condition from a change in method, coverage or evidence.

An evidential gap in relation to education leadership should lead to a qualified conclusion and continued action, not administrative closure.