Public information expectations for evidence-based interventions

Against the background of the World Development Report 2018, education authorities and providers should review how evidence-based interventions is defined, implemented and evidenced. For the arrangements, the relevant policy question is how the stated public objective is translated into responsibilities that can be applied, supervised and reviewed.

Failure in relation to the policy position may arise even where the stated policy is reasonable. Material concerns include variation across sites or programmes, responsibility distributed without clear ownership, corrective action closed on activity rather than effect, and evidence selected to confirm a preferred conclusion. For evidence-based interventions, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.

Policy context for public information expectations for evidence-based interventions

A proper review of evidence-based interventions should establish the intended outcome before selecting controls or indicators. Implementation should be assessed against observable effects on access, learning, safety and fair treatment, rather than against the existence of a policy statement alone. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved.

The reference basis—the World Development Report 2018—is evidential rather than self-executing. In the context of evidence-based interventions, the material may reveal patterns or evidential gaps, but it neither directs a legal outcome nor establishes causation. In applying it to the measure, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.

For decisions concerning evidence-based interventions, the World Development Report 2018, Learning to Realize Education’s Promise, distinguishes schooling from learning and describes poor outcomes, immediate barriers within teaching and learning, and deeper system-level causes. It proposes three connected directions: assess learning, act on evidence and align actors around learning. Attendance and completion remain important, but they do not provide direct evidence that learners have acquired the intended knowledge and skills.

For the measure, public information should be accurate, current, complete in relation to material matters and presented before a learner is required to make a consequential commitment. For evidence-based interventions, qualifications and limitations should receive comparable prominence to the principal claim. The decision question, affected scope and measure should align; otherwise the conclusion may be unsupported despite substantial documentation.

• Identify the affected scope before using it to determine a learner or provider outcome.
• Assign accountable ownership, identifying the accountable function and affected scope.
• Review whether improvement is sustained.
• Test material variation.
• Define the intended outcome, identifying the accountable function and affected scope.

Responsibilities and affected parties

Care is required in drawing conclusions about evidence-based interventions. Quality cannot be inferred from reputation, intention or documentation alone. Documented intention should be tested against practice and observable result. Within the scope under review, the existence of an international commitment does not remove the need for jurisdiction-specific interpretation, consultation and proportionate transition arrangements. Limitations should be prominent wherever the finding may influence a consequential decision.

Assurance of the measure should draw on more than one form of evidence. Useful records include learner and staff evidence, verified corrective action, independent checks of material claims, representative outcome information, and implementation and monitoring records. For evidence-based interventions, system-wide assurance cannot be inferred from a favourable case chosen after the event.

The assurance record for evidence-based interventions should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. The evidential history should preserve conclusions that were operative when a material decision was made.

Implementation risks

The review method for evidence-based interventions should be reproducible. Responsible bodies should identify material information across the learner journey, assign source ownership, reconcile public statements with controlled records and retain corrections. Test whether a reasonable user can understand status, cost, obligations, support and routes for redress. Documentation should be sufficient to reconstruct the judgement without relying on unrecorded explanation.

In work concerning evidence-based interventions, a policy conclusion on the issue should state who is required or expected to act, the source of that expectation and the consequence of non-implementation. Jurisdictional variation should be identified wherever it narrows the reach of the conclusion. Public communication should not present an aspiration, recommendation or proposed measure as an existing legal duty.

• Who approves changes?
• Does it identify material conditions and limitations?
• Can it be reconciled with the controlled source?
• Is the information available before commitment?
• Are corrections prompt and traceable?

Oversight and follow-up

For evidence-based interventions, the public interest is not confined to institutional compliance. Quality assurance should connect stated educational purposes with implemented controls, reliable evidence and action where outcomes fall below expectation. Within the scope under review, learners should understand arrangements that materially affect them and have access to timely correction of inaccurate or unfair information, support or decisions.

Where responsibilities for delivery relating to evidence-based interventions are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Governance between participating bodies should make information duties and corrective authority explicit. Learner safeguards associated with evidence-based interventions should remain continuous where provision is delivered by several bodies.

When examining evidence-based interventions, any response to the present development should test the evidential connection between the measure, its implementation and the outcome claimed.