Assessing the effectiveness of provider responsibility for open content

In 2012, consideration of the effectiveness of provider responsibility for open content must take account of the open licensing and quality controls and the responsibilities it places before education systems. Consistent application requires a clear distinction between the required result, recommended methods and examples that may assist implementation. The unit of review should correspond to the full reach of the decision, including significant differences in provision and population.

This analysis is informed by open licensing and quality controls. Its relevance to the matter should be assessed against the affected jurisdiction, learner population and form of provision. In the context of provider responsibility for open content, any consequential application should rest on evidence suited to the affected scope, not on the existence of an international development alone.

The system and institutional dimensions of the control should be considered together. Open access can widen participation, but users require clear information about authorship, licence, quality, accessibility, maintenance and the status of any learning or assessment. When examining provider responsibility for open content, authorities and providers hold different responsibilities, both of which must be discharged for the arrangement to operate reliably. Neither public oversight nor provider control removes the responsibilities assigned to the other level.

Applicable scope

In work concerning provider responsibility for open content, effectiveness is the demonstrated change in the condition the action was intended to address. Completion of training, publication of guidance or installation of a system is an output and should not be reported as an outcome without further evidence. A conclusion concerning provider responsibility for open content should identify both its evidential basis and the part of the stated scope for which assurance cannot be given.

For provider responsibility for open content, responsibility should be identifiable at the point where consequential decisions are made. A provider should be able to trace the expectation from approved policy through implementation, monitoring, identified exceptions and corrective action. Escalation should follow whenever the available record cannot support a safe conclusion for the affected learners.

Implementation and evidence

A narrow control over the effectiveness of provider responsibility for open content may create false assurance. In the present context, outdated or inaccurate material, content altered without adequate review and uncertain responsibility for learner support may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage. A sample confined to compliant cases cannot establish the reliability of the control.

Relevant evidence for the applicable expectation will normally include correction and withdrawal controls, academic and technical review, use and completion data interpreted cautiously, licence and provenance records, and accessibility checks. For decisions concerning provider responsibility for open content, currency, provenance and representativeness should be established before evidence is used for assurance. An unresolved contradiction is a limitation on the conclusion and should be reported as such.

Implementation of the control can be tested without imposing unnecessary reporting. For the matter, the reviewer should set a baseline and success measure before intervention, define the review period, compare the result with the intended outcome and examine adverse or unequal effects. As regards provider responsibility for open content, continue monitoring long enough to determine whether the improvement is sustained. Within the scope under review, existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance conclusion.

Assessment of conformity

The final record on the effectiveness of provider responsibility for open content should identify the applicable expectation, the relevant scope, the evidence examined, the sampling basis, material exceptions and the reason for the conclusion. Departure from an illustrative method may be justified where equivalent outcome and evidence are established. No complete conclusion should be recorded while a material evidential limitation remains.

Interpretation of the applicable requirement should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. For the applicable requirement, availability is not equivalent to accessibility, participation or learning. Each outcome requires separate evidence. For provider responsibility for open content, a prescribed method should not be treated as the only acceptable method where another approach establishes the same outcome with equivalent evidence.

Decisions concerning the applicable expectation should remain traceable to the information available for the stated reference period.

Where responsibilities for delivery relating to provider responsibility for open content are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements governing provider responsibility for open content should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Division of delivery responsibilities must not create gaps in learner protection.

When examining provider responsibility for open content, a complete conclusion on the control requires evidence extending beyond an individual measure or safeguard. The final judgement on provider responsibility for open content should connect the applicable expectation to implementation and outcomes while identifying unresolved risk.