The use of proxy measures in analysing leadership for learning

Its significance for leadership for learning lies in the quality of implementation rather than in formal acknowledgement alone.

Application and scope

A national or international pattern may justify closer review of leadership for learning, but provider-level action requires evidence relating to the affected provision. The comparability record should identify material variation in coverage, period and classification.

A proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. In the context of leadership for learning, any condition preventing complete assurance should appear with the evidence on which the judgement relies.

A narrow control over the analysis may create false assurance. In the present context, small differences overstated, data revisions not carried through to published conclusions and incomplete coverage may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage.

Assurance of the measure should draw on more than one form of evidence. Useful records include uncertainty estimates where relevant, population and sampling information, indicator definitions and metadata, disaggregated results, and coverage and missingness analysis. In the context of leadership for learning, documents should be reconciled with observed practice and, where relevant, the experience of affected learners.

Relevant controls

Responsible bodies should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. For decisions concerning leadership for learning, adverse cases and unresolved contradictions should be retained because they may reveal limitations concealed by an average result.

For leadership for learning, traceability is necessary for accountable decision-making and fair correction. For the available evidence, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed.

• Would the decision change if the proxy were inaccurate?
• What outcome does the proxy represent?
• For which groups may it fail?
• Is direct evidence available?
• What evidence supports the relationship?

Review criteria

For leadership for learning, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. Across the defined scope, an action may be complete while the underlying condition remains, and the two determinations should be recorded separately.

For leadership for learning, decision-makers using the available evidence should be told what the data cannot establish as clearly as what it can. The finding should identify its analytical character and the system, institution, programme or learner population to which it applies.

• Document numerator and denominator before it is relied on for a decision with material effect.
• Analyse missing information.
• Define the decision the indicator will inform, with responsibility, scope and timing recorded.
• Test comparability.
• Disaggregate material results before it is relied on for a decision with material effect.

Implications for decision-making

For leadership for learning, education indicators should support decisions by describing outcomes and variation with definitions and limitations that permit responsible interpretation.

Proportionality in relation to the analysis does not mean reduced protection for learners exposed to greater risk. In reviewing leadership for learning, measurement can reveal where outcomes differ; it does not by itself establish why they differ or which intervention will work. For the available evidence, missing or delayed information may be patterned rather than random. The record for leadership for learning should identify the reason, approving authority, period of operation and date for reconsideration.

Any response to the present development should test the evidential connection between the analysis, its implementation and the outcome claimed.