The reliability of evidence on learning to realise education’s promise is examined together with the limits that apply when findings inform consequential decisions.
In applying it to the issue, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.
For learning to realise education’s promise, the World Development Report 2018, Learning to Realize Education’s Promise, distinguishes schooling from learning and describes poor outcomes, immediate barriers within teaching and learning, and deeper system-level causes. It proposes three connected directions: assess learning, act on evidence and align actors around learning. Attendance and completion remain important, but they do not provide direct evidence that learners have acquired the intended knowledge and skills.
Evidence base for learning to realise education’s promise
Analysis should make its decision rule explicit. For the available evidence, a proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. For learning to realise education’s promise, comparable evidence should be assessed against criteria settled before the result is known.
A narrow control over the analysis may create false assurance. In the present context, learner experience omitted from review, responsibility distributed without clear ownership and variation across sites or programmes may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. For learning to realise education’s promise, a sample confined to compliant cases cannot establish the reliability of the control.
Controls for learning to realise education’s promise
Useful records include learner and staff evidence, implementation and monitoring records, independent checks of material claims, representative outcome information, and exception and complaint records. Across the defined scope, a positive example may illustrate operation, but it cannot demonstrate coverage or consistency.
Records relating to the available evidence should preserve both the conclusion and its limits. For learning to realise education’s promise, the correction record should state what the new evidence changes and which earlier conclusions or decisions require review.
- Collect proportionate evidence.
- Identify the affected scope.
- Review whether improvement is sustained.
- Test material variation.
- Assign accountable ownership.
Review of learning to realise education’s promise
A competent review of the available evidence should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. When examining learning to realise education’s promise, reuse of existing information is appropriate only where its purpose, scope and reliability correspond to the decision under review.
Decision-makers using the available evidence should be told what the data cannot establish as clearly as what it can. For learning to realise education’s promise, reporting should state whether a result describes, compares or evaluates, together with the level at which it is valid.
For the analysis, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. For decisions concerning learning to realise education’s promise, management should assign each material action to an accountable owner and completion date.
Implications for learning to realise education’s promise
Across the defined scope, missing or delayed information may be patterned rather than random.