Learning to realise education’s promise: measuring learning rather than attendance alone

The World Development Report 2018 provides the immediate context for learning to realise education’s promise. The value of the present data lies in the questions it can answer reliably and in the limits it makes visible.

The reference basis—the World Development Report 2018—is evidential rather than self-executing. Its value lies in identifying matters for examination; it should not be read as a legal instruction or causal finding. In applying it to the issue, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.

For learning to realise education’s promise, the World Development Report 2018, Learning to Realize Education’s Promise, distinguishes schooling from learning and describes poor outcomes, immediate barriers within teaching and learning, and deeper system-level causes. It proposes three connected directions: assess learning, act on evidence and align actors around learning. Attendance and completion remain important, but they do not provide direct evidence that learners have acquired the intended knowledge and skills.

Evidence base for learning to realise education’s promise

The system and institutional dimensions of learning to realise education’s promise should be considered together. Quality assurance should connect stated educational purposes with implemented controls, reliable evidence and action where outcomes fall below expectation. Public authorities establish the legal and policy setting; providers remain accountable for the quality and integrity of provision within their control. Each level should be able to demonstrate the decisions and controls for which it is accountable.

Analysis should make its decision rule explicit. For the available evidence, a proxy is useful only where its relationship with the intended outcome is sufficiently understood. Participation, activity and expenditure may support learning, but none constitutes direct evidence of learning without an explicit and tested connection. In work concerning learning to realise education’s promise, comparable evidence should be assessed against criteria settled before the result is known.

A narrow control over the analysis may create false assurance. In the present context, learner experience omitted from review, responsibility distributed without clear ownership and variation across sites or programmes may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. As regards learning to realise education’s promise, a sample confined to compliant cases cannot establish the reliability of the control.

Coverage and comparability

Assurance of learning to realise education’s promise should draw on more than one form of evidence. Useful records include learner and staff evidence, implementation and monitoring records, independent checks of material claims, representative outcome information, and exception and complaint records. Within the scope under review, a positive example may illustrate operation, but it cannot demonstrate coverage or consistency.

Records relating to the available evidence should preserve both the conclusion and its limits. For learning to realise education’s promise, the correction record should state what the new evidence changes and which earlier conclusions or decisions require review.

• Collect proportionate evidence.
• Identify the affected scope.
• Review whether improvement is sustained.
• Test material variation.
• Assign accountable ownership.

Responsible interpretation

A proper review of learning to realise education’s promise should establish the intended outcome before selecting controls or indicators. A sound interpretation should identify the unit of analysis, reference period, denominator, exclusions, missing values and any change in definition or collection practice. The record for learning to realise education’s promise should explain why the approach suits the affected context, how material departures are authorised and when review will occur.

Implementation of the measure can be tested without imposing unnecessary reporting. A competent review of the available evidence should state the construct to be measured, explain why the proxy is expected to represent it, test that relationship against direct evidence and identify circumstances in which the proxy may fail. Do not allow convenience to determine the measure. When examining learning to realise education’s promise, reuse of existing information is appropriate only where its purpose, scope and reliability correspond to the decision under review.

Decision-makers using evidence on the available evidence should be told what the data cannot establish as clearly as what it can. For learning to realise education’s promise, reporting should state whether a result describes, compares or evaluates, together with the level at which it is valid. Application in another setting depends on a separate examination of context and comparability.

For the analysis, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. For decisions concerning learning to realise education’s promise, management should assign each material action to an accountable owner and completion date. Closure requires evidence that the condition has changed; completion of planned activity is not sufficient.

Limitations and reporting

Interpretation of learning to realise education’s promise should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. Quality cannot be inferred from reputation, intention or documentation alone. Documented intention should be tested against practice and observable result. Within the scope under review, missing or delayed information may be patterned rather than random.

For learning to realise education’s promise, progress should not be assessed by the amount of policy or documentation produced. Performance in relation to learning to realise education’s promise should be judged by outcomes and timely response to shortfalls, not by the volume of administrative activity.