Independent review of open educational resources

Against the background of the Paris OER Declaration adopted in June 2012, education authorities and providers should review how open educational resources is defined, implemented and evidenced. In reviewing the matter under review, the central issue is the meaning of the expectation in practice, including its scope, the evidence needed to demonstrate it and the circumstances in which it may not apply. The proportionality test should consider both the identified risk and the consequences of the control for affected learners.

The 2012 Paris OER Declaration calls on states to foster awareness and use of openly licensed educational resources, support enabling policy and infrastructure, strengthen capacity, encourage adaptation and promote research and sharing. Open licensing addresses permission to retain, reuse or adapt material; it does not by itself establish accuracy, accessibility, curricular suitability or the status of any assessment or award.

A proper review of the stated expectation should establish the intended outcome before selecting controls or indicators. Examination of the matter should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event. Suitability, authorised variation and the date for reconsideration should be established when the arrangement is approved.

Purpose and present context

The instrument identified by the Paris OER Declaration adopted in June 2012 provides a formal policy reference for open educational resources. Its text, scope and institutional status should be distinguished from later implementation measures and from voluntary provider commitments. Authorities should state which elements are already operative, which require national action and which serve as guidance. This distinction protects learners from overstated claims and enables providers to plan against a defined obligation.

For the stated expectation, the public interest is not confined to institutional compliance. A decision concerning the relevant requirement should recognise that open access can widen participation, but users require clear information about authorship, licence, quality, accessibility, maintenance and the status of any learning or assessment. Material arrangements should be communicated clearly, with an accessible route to correct error or unfair treatment.

• Monitor use without overstating learning and retain evidence sufficient for independent review.
• State whether assessment or credit is available, with responsibility, scope and timing recorded.
• Verify rights before publication, and retain the basis, responsible function and affected scope.
• Review content and accessibility, including material exceptions and unequal effects.
• Provide correction routes, including material exceptions and unequal effects.

The substantive quality question

A focused examination of open educational resources requires a clear analytical discipline. A decision concerning the assurance matter should recognise that review is independent when the reviewer is sufficiently separate from the design, operation and approval of the matter to reach and report an impartial conclusion. Organisational location alone does not establish independence. The distinction matters because evidence may appear sufficient while addressing a different population, period or outcome.

Risk assessment for the assurance matter should consider severity, reach, duration, recurrence and detectability, with escalation where learner impact may be material. A provider should also consider uncertain responsibility for learner support and confusion between participation and recognised achievement. Preventive safeguards are particularly important when harm is difficult to detect or cannot be fully corrected after the event.

Assurance concerning the stated expectation should state the scope examined, evidence relied upon and any condition preventing a complete conclusion. Unsupported elements should remain open. Useful records include licence and provenance records, version and maintenance information, correction and withdrawal controls, accessibility checks, and academic and technical review. Documentary conformity alone is insufficient where operation or learner experience indicates a material difference. Evidence of effectiveness should represent the declared scope, including adverse and exceptional cases.

• Who decides the response?
• Does the reviewer have a relevant conflict?
• Is competence established?
• Can adverse findings be reported without alteration?
• Who designed and operates the control?

Evidence and assurance

A proportionate method is available for open educational resources. For the relevant requirement, the reviewer should define the review question and criteria, record competence and conflicts, preserve access to relevant evidence, and protect the reviewer’s ability to report adverse findings. Assign acceptance of residual risk to an authority outside the reviewed activity. Averages should be tested against adverse cases that may indicate unequal effect or incomplete operation.

Interpretation of the assurance matter should produce a test that another competent reviewer can apply to comparable evidence. The test should separate mandatory conditions, recommendations and illustrative methods. A finding should describe the evidence and affected scope; it should not rely on undefined terms such as adequate, appropriate or effective without explaining the basis of judgement.

Proportionality in relation to the control does not mean reduced protection for learners exposed to greater risk. Review of the relevant requirement should include the experience of affected learners, particularly where aggregate reporting may conceal exclusion, delay or unequal treatment. Each outcome requires separate evidence. Review of the assurance matter should give particular attention to adverse cases, unequal effects and errors that learners may be unable to identify or remedy after the event. An exception is to remain time-limited, approved and subject to a stated review point.

Accountability and effective correction both depend on a record that can be followed from evidence to decision. For the stated expectation, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. A material amendment should record its reason and effective date, preserving the information basis of earlier decisions.

Where the assurance matter involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. The division of responsibilities should cover records, communication, escalation and the power to require correction. Multiple delivery partners do not justify fragmented accountability or remedy.

The appropriate response to the relevant requirement is therefore one of controlled implementation and review. The objective should be explicit, the evidence proportionate and learner impact visible. Where evidence cannot support assurance, the limitation should be reported and corrective work should remain open.