Clarifies the scope, evidence and assurance considerations relevant to open educational resources.
The recommendation adopted on 25 November 2019 provides the immediate context for open educational resources. The analysis of the matter under review proceeds on the basis that the central issue is the meaning of the expectation in practice, including its scope, the evidence needed to demonstrate it and the circumstances in which it may not apply. The decision should address both public impact and the responsibilities attached to entrusted educational resources. System context should determine the appropriate administrative arrangement within the governing requirements.
Purpose and present context
The instrument identified by the recommendation adopted on 25 November 2019 provides a formal policy reference for open educational resources. Its text, scope and institutional status should be distinguished from later implementation measures and from voluntary provider commitments. Authorities should state which elements are already operative, which require national action and which serve as guidance. This distinction protects learners from overstated claims and enables providers to plan against a defined obligation.
Responsibilities and material risks
The quality significance of open educational resources follows from a basic distinction between availability and effective provision. Oversight of the assurance matter should reflect the principle that open access can widen participation, but users require clear information about authorship, licence, quality, accessibility, maintenance and the status of any learning or assessment. Oversight should examine implementation throughout the learner journey, not only at entry or through one reported outcome.
The analysis of the stated expectation should make its decision rule explicit. A decision concerning the stated expectation should recognise that the subject should be examined as a connected system of policy, people, resources, decisions and evidence. Individually sound controls may not operate effectively when decisions, records or responsibility pass between functions. Comparable evidence should be assessed against criteria settled before the result is known.
- Who controls each stage?
- What action is required by the finding?
- Which evidence establishes operation?
- Where do exceptions occur?
- What outcome is intended?
Evidence and assurance
Responsibility for open educational resources should be visible at the point where consequential decisions are made. A decision concerning the stated expectation should recognise that evidence is sufficient when it is current, attributable, representative of the relevant scope and capable of being reconciled with other available records. Escalation should follow whenever the available record cannot support a safe conclusion for the affected learners.
The principal risks in relation to the matter under review are outdated or inaccurate material, unclear permission to reuse or adapt, inaccessible resources, and uncertain responsibility for learner support. The relationship between the risks is material: one failed safeguard may remove the evidence needed to activate another. Documents should be tested against the decision process they record and the outcome that followed.
Proportionality and exceptions
Each source should have a stated purpose in supporting or limiting the conclusion. For open educational resources, the most relevant material is likely to include version and maintenance information, use and completion data interpreted cautiously, academic and technical review, and licence and provenance records. No source should carry more weight than its coverage and reliability permit, and unresolved uncertainty should remain visible.
Implementation of the stated expectation can be tested without imposing unnecessary reporting. For the control, the reviewer should map the complete process, identify the intended result and responsible authority at each stage, and test normal cases together with exceptions. The conclusion should differentiate an individual error from evidence of a wider control weakness. Information should not be treated as sufficient merely because it is already available; its relevance to the present question must be established.
Interpretation of the assurance matter should produce a test that another competent reviewer can apply to comparable evidence. The test should separate mandatory conditions, recommendations and illustrative methods. A finding should describe the evidence and affected scope; it should not rely on undefined terms such as adequate, appropriate or effective without explaining the basis of judgement.
Maintaining effective oversight
Care is required in drawing conclusions about open educational resources. A decision concerning the control should recognise that availability is not equivalent to accessibility, participation or learning. Each outcome requires separate evidence. For the stated expectation, the volume of documentation is not a measure of conformity. Relevance, integrity and coverage are more important than the number of records produced. Limitations should be prominent wherever the finding may influence a consequential decision.
Decisions concerning the control should remain traceable to the information available for the stated reference period. A revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. A break in method or coverage must not be presented as if it demonstrated a change in educational performance.
Where the assurance matter involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Protection should operate across the complete service, irrespective of how delivery is divided.
The measure of progress on the assurance matter is not the amount of policy or documentation produced. The relevant measure is demonstrated public benefit, including detection and correction of material variation.