Public information expectations for evidence-based interventions

In examining public information expectations for evidence-based interventions, for the arrangements, the relevant policy question is how the stated public objective is translated into responsibilities that can be applied, supervised and reviewed.

Failure in relation to the policy position may arise even where the stated policy is reasonable. Material concerns include variation across sites or programmes, responsibility distributed without clear ownership, corrective action closed on activity rather than effect, and evidence selected to confirm a preferred conclusion. For evidence-based interventions, materiality depends on the consequence and extent of an exception, not only on how often it appears in sampled records.

Policy context for public information expectations for evidence-based interventions

In examining public information expectations for evidence-based interventions, a proper review of evidence-based interventions should establish the intended outcome before selecting controls or indicators.

In the context of evidence-based interventions, the material may reveal patterns or evidential gaps, but it neither directs a legal outcome nor establishes causation. In applying it to the measure, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.

For decisions concerning evidence-based interventions, the World Development Report 2018, Learning to Realize Education’s Promise, distinguishes schooling from learning and describes poor outcomes, immediate barriers within teaching and learning, and deeper system-level causes. It proposes three connected directions: assess learning, act on evidence and align actors around learning. Attendance and completion remain important, but they do not provide direct evidence that learners have acquired the intended knowledge and skills.

For the measure, public information should be accurate, current, complete in relation to material matters and presented before a learner is required to make a consequential commitment. For evidence-based interventions, qualifications and limitations should receive comparable prominence to the principal claim.

• Identify the affected scope before using it to determine a learner or provider outcome.
• Assign accountable ownership, identifying the accountable function and affected scope.
• Review whether improvement is sustained.
• Test material variation.
• Define the intended outcome, identifying the accountable function and affected scope.

Controls relevant to public information expectations for evidence-based interventions

Care is required in drawing conclusions about evidence-based interventions. Across the defined scope, the existence of an international commitment does not remove the need for jurisdiction-specific interpretation, consultation and proportionate transition arrangements.

Assurance of the measure should draw on more than one form of evidence. Useful records include learner and staff evidence, verified corrective action, independent checks of material claims, representative outcome information, and implementation and monitoring records. For evidence-based interventions, system-wide assurance cannot be inferred from a favourable case chosen after the event.

The assurance record for evidence-based interventions should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied.

Review criteria for public information expectations for evidence-based interventions

The review method for evidence-based interventions should be reproducible. Responsible bodies should identify material information across the learner journey, assign source ownership, reconcile public statements with controlled records and retain corrections.

For evidence-based interventions, a policy conclusion on the issue should state who is required or expected to act, the source of that expectation and the consequence of non-implementation. Jurisdictional variation should be identified wherever it narrows the reach of the conclusion. Public communication should not present an aspiration, recommendation or proposed measure as an existing legal duty.

• Who approves changes?
• Does it identify material conditions and limitations?
• Can it be reconciled with the controlled source?
• Is the information available before commitment?
• Are corrections prompt and traceable?

Implications for public information expectations for evidence-based interventions

For evidence-based interventions, the public interest is not confined to institutional compliance. Across the defined scope, learners should understand arrangements that materially affect them and have access to timely correction of inaccurate or unfair information, support or decisions.

Where responsibilities for delivery relating to evidence-based interventions are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Learner safeguards associated with evidence-based interventions should remain continuous where provision is delivered by several bodies.

When examining evidence-based interventions, any response to the present development should test the evidential connection between the measure, its implementation and the outcome claimed.