Consistency in the assessment of digital accessibility

Against the background of the Web Content Accessibility Guidelines 2.2 issued in October 2023, education authorities and providers should review how consistency in the assessment of digital accessibility is defined, implemented and evidenced. Interpretation should begin with the intended outcome, then identify the controls and evidence needed to show that the outcome is achieved across the declared scope. Assessment should consider learner impact, institutional accountability and stewardship of entrusted resources.

For digital accessibility, the applicable expectation should be capable of consistent application. A provider should be able to trace the expectation from approved policy through implementation, monitoring, identified exceptions and corrective action. Operational definitions should be precise enough to support consistent consequential decisions and explain justified variation.

Scope and application of consistency in the assessment of digital accessibility

The relevant context is provided by Web Content Accessibility Guidelines 2.2 issued in October 2023. Its relevance to consistency in the assessment of digital accessibility should be assessed against the affected jurisdiction, learner population and form of provision. Any consequential application should rest on evidence suited to the affected scope, not on the existence of an international development alone.

In work concerning digital accessibility, WCAG 2.2 was published as a W3C Recommendation on 5 October 2023. It adds nine success criteria concerning keyboard focus, dragging, target size, consistent help, repeated entry and accessible authentication. The standard remains organised under the four established accessibility principles. Education providers should identify the version and conformance level applied and should test complete learner tasks, including third-party components.

Review of the assurance conclusion should be based on a stated method rather than general assurance. Consistency does not require identical decisions regardless of context. For digital accessibility, it requires comparable matters to be treated on the same principles, with material differences explained by relevant evidence and recorded criteria.

Risk assessment should give particular attention to delayed or inconsistent accommodation, formal access without practical participation, and inaccessible digital or physical environments. A provider should also consider support dependent on repeated disclosure and complaint routes that are not accessible. For decisions concerning digital accessibility, stronger controls are required where learners may not detect an error or where later correction cannot restore the lost opportunity.

Relevant evidence for the applicable expectation will normally include accessible learning and assessment materials, complaints and resolution records, accessibility reviews covering the learner journey, records of accommodation decisions and response times, and testing with affected learners. As regards digital accessibility, evidence outside the relevant period or scope should be identified and given no more weight than its limitations permit. The record for digital accessibility should retain disagreement between sources until its cause and effect are understood.

Evidence required

A competent examination of the matter should use common definitions and decision criteria, calibrate responsible staff, review outliers and compare outcomes across locations and groups. In work concerning digital accessibility, where variation is justified, retain the reason and verify that it is applied without arbitrary disadvantage. Averages should be tested against adverse cases that may indicate unequal effect or incomplete operation.

For digital accessibility, the evidential trail should allow an affected decision to be identified, examined and corrected. For the assurance conclusion, the responsible body should be able to identify the evidence considered, the judgement made, the person or body authorised to make it and the action that followed. A material amendment should record its reason and effective date, preserving the information basis of earlier decisions.

• Have decision-makers been calibrated?
• Where are outcomes materially different?
• Does review correct inconsistent treatment?
• Is the reason relevant and documented?
• Are common criteria in use?

Decision criteria and exceptions

For decisions concerning digital accessibility, where responsibilities for delivery are shared with partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Contractual or inter-agency arrangements should identify who holds records, informs learners and acts on incidents. Protection should operate across the complete service, irrespective of how delivery is divided.

The final record on the assurance conclusion should identify the applicable expectation, the relevant scope, the evidence examined, the sampling basis, material exceptions and the reason for the conclusion. In work concerning digital accessibility, if an alternative method is accepted, the record should demonstrate that it achieves the same required outcome. The affected scope should remain open where a material limitation prevents assurance.

• Train staff with decision-making responsibilities.
• Test physical and digital access.
• Provide timely and documented accommodation.
• Identify barriers before they affect an individual learner.
• Monitor unequal outcomes before it informs a consequential decision.

Continuing assurance

For consistency in the assessment of digital accessibility, the public interest is not confined to institutional compliance. Equality of access requires the removal of avoidable barriers to admission, participation, assessment and completion, together with support responsive to individual requirements.

In work concerning digital accessibility, analysis should remain within the limits of the evidence. An isolated example cannot establish consistent operation, and an isolated failure should be evaluated for materiality, recurrence and systemic effect. An inclusive policy is not evidence of inclusive experience. Assurance should examine whether support is available in time, whether learners can use it without disadvantage and whether outcomes reveal persistent barriers. Within the scope under review, material uncertainty should result in further enquiry or an expressly limited finding.

For digital accessibility, any response to the present development should test the evidential connection between the matter, its implementation and the outcome claimed. Public confidence cannot be separated from an institution's ability to identify responsibility and substantiate its conclusions.