Interpreting institutional variation in institutional risk management

Evidence base

Application to institutional variation in institutional risk management depends on evidence from the relevant jurisdiction or institution.

Review of the comparison should follow a stated and reproducible method. Consistency does not require identical decisions regardless of context. For institutional risk management, it requires comparable matters to be treated on the same principles, with material differences explained by relevant evidence and recorded criteria.

Material concerns include management assurance accepted without testing, corrective action closed without verification, governing bodies receiving activity data instead of outcome evidence, and conflicts not identified. For institutional risk management, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.

Assurance of the measure should draw on more than one form of evidence. Useful records include risk and assurance plans, public reports reconciled with controlled records, conflict declarations and controls, independent review records, and corrective-action verification. For institutional risk management, evidence of effectiveness should represent the declared scope, including adverse and exceptional cases.

Application of the evidence to interpreting institutional variation in institutional risk management

Implementation of institutional variation in institutional risk management can be tested without imposing unnecessary reporting. The method for the measure is to use common definitions and decision criteria, calibrate responsible staff, review outliers and compare outcomes across locations and groups. Where variation is justified, retain the reason and verify that it is applied without arbitrary disadvantage. Across the defined scope, reuse of existing information is appropriate only where its purpose, scope and reliability correspond to the decision under review.

For institutional risk management, traceability is necessary for accountable decision-making and fair correction. For comparative analysis, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed.

• Have decision-makers been calibrated?
• Does review correct inconsistent treatment?
• Where are outcomes materially different?
• Is the reason relevant and documented?
• Are common criteria in use?

Controls relevant to interpreting institutional variation in institutional risk management

Accountability for institutional variation in institutional risk management should follow decision-making authority.

When examining institutional risk management, decision-makers using evidence on the comparison should be told what the data cannot establish as clearly as what it can. The finding should identify its analytical character and the system, institution, programme or learner population to which it applies.

• Verify corrective action independently.
• Assign decision authority explicitly.
• Test management assurance.
• Escalate material exceptions.
• Separate incompatible responsibilities.

Review criteria for interpreting institutional variation in institutional risk management

For decisions concerning institutional risk management, governing bodies should receive sufficient, reliable and timely information to oversee education quality, learner protection and material institutional risk.

Proportionality in relation to the measure does not mean reduced protection for learners exposed to greater risk. For institutional risk management, governance structures do not provide assurance merely because committees exist. Across the defined scope, membership, information quality, challenge, decisions and follow-through determine whether oversight is effective. For the available evidence, a single indicator rarely provides an adequate account of quality.

Review prompted by the present development should establish how the comparison moves from stated commitment to accountable implementation and outcome.