ICEQC-R-2007-04 — Public Reporting of Institutional Quality: Materiality and Proportionality cover

专题研究报告

ICEQC-R-2007-04 — Public Reporting of Institutional Quality: Materiality and Proportionality

A global standards-interpretive study of relevant disclosure, contextual evidence, fair comparison and public accountability

发布日期
研究类别
标准解读
报告类型
标准解释研究
地理范围
Global
证据截止日期
负责机构
国际教育质量认证委员会研究与政策司
ICEQC-R-2007-04 — Public Reporting of Institutional Quality: Materiality and Proportionality cover

Publication record

This is the controlled English edition. Evidence and institutional status are stated as at the evidence cut-off date.

Executive summary

Public reporting is one means by which an education institution explains its purposes, conditions, performance and use of entrusted resources. It can help learners make choices, governing bodies discharge responsibility, public authorities identify risks and communities understand whether provision serves them fairly. Yet disclosure does not become useful merely by becoming extensive. A long catalogue of unconnected facts may conceal more than it reveals, while a short set of favourable measures may give an unduly settled account of quality. The interpretive problem is therefore to determine which information is material, how much detail is proportionate and what context is necessary for an honest reading.

Material information is information whose omission, distortion or undue delay could reasonably alter a user’s understanding of institutional quality or a decision made on that basis. Materiality depends on purpose and consequence. Information about completion may be material to a prospective learner, but its meaning changes with the definition of completion, the reference cohort, the programme mix, transfers, part-time study and the institution’s access mission. A matter can be material without being numerically large: an unlawful exclusion, a serious safeguarding failure or the loss of authority to provide a programme may affect a small population yet bear directly on the institution’s capacity and public standing.

Proportionality governs the extent, frequency and form of disclosure. A proportionate report gives enough evidence to understand a material matter, test the principal claim and recognise the limits of comparison. It does not publish personal information, overwhelm readers with immaterial detail or impose the same reporting burden on every institution irrespective of scale, risk and public consequence. Proportionality is not permission to omit difficult facts. Greater risk, greater uncertainty or a greater departure from an expected result usually calls for more explanation, not less.

The evidence available by August 2007 supports a broad view of education quality. International monitoring distinguishes access, learning, equity, resources and institutional conditions, and repeatedly cautions that indicators depend upon definitions and context. Comparative statistics can illuminate patterns, but statistical classifications do not themselves judge an individual institution. Learning measures can contribute important evidence, but observed results reflect prior attainment, student composition, programme purpose and conditions beyond an institution’s control as well as what happens within it.

The public report should begin with the institution’s identity, authority, educational purposes and population. It should then address access and participation; programmes and qualifications; learning and completion; the experience and protection of learners; staffing and educational resources; equity; finance and continuity; governance; and significant change or risk. Each claim should identify its period, population, source and status. The report should distinguish a measured result from an institutional interpretation, and both from a proposed response.

No single score is an adequate public account of institutional quality. Composite ratings often require contestable choices about weights, direction, missing data and the substitution of strength in one domain for weakness in another. Rankings add sensitivity to the selection of peers and to small movements within statistical uncertainty. Where an aggregate is used, its construction and limitations should be visible, and the underlying measures should remain accessible. A serious weakness concerning safety, legality or educational authority should not disappear inside a favourable average.

Fair comparison requires common definitions, sufficiently similar populations and programmes, aligned reference periods, adequate coverage and an account of uncertainty. Where these conditions do not hold, institutions should report their own results and explain the limitation rather than manufacture a league position. Change over time also requires a stable series. A revised definition, new information system, merger, boundary change or altered programme mix may create a statistical break. The responsible response is to mark the break and, where possible, provide a reconciled series; it is not to present unlike observations as improvement or decline.

Distribution is material whenever an average conceals a substantially different experience for a relevant group. Reporting should examine participation, progression, completion and learning by appropriate characteristics where data quality and privacy permit. Disaggregation should serve a legitimate question and should not expose individuals or encourage unreliable conclusions from very small groups. The report should state suppressed categories and the reason for suppression. Equity reporting should identify both the observed difference and the institutional conditions that may be addressed; it should not attribute causation without evidence.

Institutions also hold information that should not be published in identifiable form: individual education records, health and disability information, confidential complaints, personnel matters, security-sensitive details and commercially sensitive terms whose disclosure would cause a concrete public harm. Confidentiality should be bounded, justified and periodically reconsidered. It does not extend automatically to aggregate findings, the existence of a material problem, the governing response or the method used to protect privacy. A public report can acknowledge a serious matter without exposing a person.

Timeliness is part of truthfulness. A result published after the relevant choice, funding decision or governing review may be accurate but of little public value. Institutions should establish a regular cycle and should also report exceptional material events without waiting for the annual document. Correction arrangements are equally important. A corrected figure should retain the original period, identify what changed, explain why it changed and show whether the interpretation was affected. Silent replacement weakens the record and prevents users from understanding the reliability of the reporting system.

The report concludes that public reporting is a reasoned disclosure duty rather than an exercise in institutional promotion. Its adequacy can be tested by asking whether the report identifies the institution and its purposes; addresses each material quality domain; provides relevant and traceable evidence; explains comparability and uncertainty; protects people without hiding institutional responsibility; and connects significant findings to governance and action. A proportionate account is selective, but the selection is governed by public consequence and evidential relevance rather than presentational advantage.

Key findings

  • Materiality is determined by a matter’s capacity to alter a reasonable understanding or decision, not by the convenience of the reporting institution.
  • A small number or rare event may be material where it concerns legality, safety, educational authority, continuity or serious inequity.
  • Proportionality governs the detail, frequency and burden of reporting; it does not justify omission of adverse or uncertain information.
  • Institutional identity, lawful authority, educational purpose, programme scope and learner population are necessary context for every quality account.
  • Access, learning, completion, learner experience, staffing, resources, equity, finance, governance and material risk should be considered together. No single indicator is sufficient.
  • Every reported measure should state its definition, population, period, source, coverage and material limitation.
  • Results and institutional explanations should be separated. An association does not establish that an institutional practice caused the observed result.
  • Comparisons are warranted only where definitions, populations, programmes, periods and coverage are sufficiently aligned.
  • A break in series should be disclosed when definitions, system boundaries, data collection or programme composition change materially.
  • Averages should be disaggregated where they conceal differences relevant to equitable participation, experience or achievement.
  • Small-group reporting should protect identity and should not invite conclusions unsupported by the number or quality of observations.
  • Composite scores and rankings should not conceal underlying measures, uncertainty or a serious weakness that cannot properly be offset by strength elsewhere.
  • Learner surveys require disclosure of the eligible population, response rate, timing, instrument and non-response limitation.
  • Complaints data should distinguish enquiries, informal concerns, formal complaints, findings, remedies and open cases; a low count is not in itself evidence of quality.
  • Financial reporting should connect resources and liabilities to educational capacity and continuity without treating expenditure as a direct measure of learning.
  • Confidentiality may protect individuals and legitimate interests, but it should not conceal the existence, scale or governing response to a material institutional matter.
  • Public reports should be understandable to non-specialists while retaining definitions and source information sufficient for independent scrutiny.
  • Material changes and serious risks may require timely disclosure outside the regular reporting cycle.
  • Corrections should be dated and explained, and the prior public record should remain intelligible.
  • Governing bodies should be able to show how reported findings informed decisions, priorities and follow-up.

Scope and method

This report interprets public reporting duties as they apply to education institutions of different sizes, missions and sectors. It addresses information made available to learners, families, staff, governing bodies, public authorities and communities. It does not prescribe a single national reporting form, determine legal disclosure duties in any jurisdiction or require publication of information whose release would unlawfully harm an individual. “Institution” includes an education provider with responsibility for programmes, learners, staff and resources. “Public reporting” means a deliberate, accessible account to persons beyond the internal management chain.

The analysis uses official comparative education statistics, international education monitoring, human-rights instruments, ministerial policy commitments and contemporary guidance on monitoring and evaluation available by 12 August 2007. The principal statistical anchor is *Education at a Glance 2006*, read with the OECD handbook on comparative education statistics and the UNESCO Institute for Statistics digest. These sources illustrate both the public value of comparable indicators and the definitional discipline needed to interpret them.

The report applies five interpretive tests. Relevance asks whether information bears on an identifiable quality question. Materiality asks whether omission or misstatement could change a reasonable understanding or decision. Sufficiency asks whether the evidence supports the claim being made. Comparability asks whether the relationship drawn between results is valid. Proportionality asks whether the extent and manner of disclosure correspond to likely public consequence, reporting burden, privacy and risk. These tests are related but not interchangeable.

The evidence base is global, but reporting arrangements differ by law, institutional mission, educational level, language and data capacity. The report therefore states decision principles and minimum content rather than assuming that one indicator set fits every setting. Examples are analytical cases, not findings about named institutions. Quantitative claims from international sources are not reproduced where their populations or reference periods would require extensive qualification; the emphasis is on the standards governing their responsible institutional use.

Part I

The Public Meaning of Institutional Quality

1

The interpretive question

the interpretive question cannot be judged without identifying administrative availability is insufficient: institutions routinely hold facts that have little bearing on quality, while information of real public consequence may be difficult to assemble. This matters because public curiosity is also insufficient, because an item may attract attention without supporting a fair judgement. The appropriate principle is decision relevance constrained by evidence, rights and proportionality. An institutional report cannot contain everything known about an institution. Selection is unavoidable. The interpretive question is what principle should govern that selection.

In assessing the interpretive question, authorities must determine learners may decide whether to enrol, remain, transfer or seek assistance. The institutional consequence follows from whether families may assess affordability and support. Staff may consider the conditions for professional work. Governing bodies may direct resources or intervene in risk. Public authorities may determine whether services remain available and equitable. Communities may ask whether an institution fulfils a public purpose. Materiality must therefore be considered across legitimate users, with particular regard to those who bear the consequences of poor or interrupted provision. The relevant decisions are broader than market choice.

Institutional action on the interpretive question should be tested against a technically accurate number paired with an expansive label can still mislead. The institutional consequence follows from whether a report should not assume that all users possess technical knowledge. It should state the question answered by each measure and avoid labels whose ordinary meaning is broader than the definition. “Completion”, for example, may mean completion within the nominal duration, within an extended period, at the reporting institution or anywhere after transfer. Each definition may serve a purpose, but they do not describe the same event.

Institutional quality is not a free-standing property captured once and for all. It concerns the fitness and integrity of educational purposes, the conditions in which learning occurs, learners’ opportunities and achievements, fairness, protection, continuity and the institution’s capacity to recognise and improve weaknesses. International evidence treats quality as involving inputs, processes and outcomes within a social and economic context. Public reporting should preserve that plurality while remaining selective enough to be used.[REF-04]

2

Public interest and legitimate users

Comparative interpretation of public interest and legitimate users depends upon education affects development, participation, work and the exercise of other rights. This matters because institutions may receive public funds, exercise delegated educational functions, award qualifications, hold sensitive records and make decisions with lasting effects. Even where provision is privately financed, the consequences extend beyond a simple transaction. Public reporting makes part of that responsibility visible without converting every institutional judgement into a public vote. The institution’s reporting responsibility arises from consequence and trust.

A defensible account of public interest and legitimate users distinguishes a prospective learner requires clear programme, cost, entry, support and outcome information. The public account remains incomplete unless it explains how a governing body requires more granular evidence on variation, risk and response. A statistical authority may require record-level or standardised returns under lawful controls. Proportionality permits layered reporting: a concise public account, clearly linked definitions and supporting data, and more detailed controlled information for authorised oversight. Layering is legitimate only when the public layer retains every material conclusion. Users do not all need the same level of detail.

Institutional action on public interest and legitimate users should be tested against withholding all information may conceal exclusion. The public account remains incomplete unless it explains how a proportionate solution may combine years, use a broader category, provide a qualitative account or disclose the issue to an authorised body while explaining publicly why a number is suppressed. The objective is not maximum disclosure; it is maximum warranted understanding consistent with rights. Interests can conflict. Publishing a very small group’s completion rate may appear transparent but could expose identity or produce an unstable inference.

For public interest and legitimate users, the material distinction is between the Fundamental Principles of Official Statistics recognise the importance of relevance, impartiality, professional methods and comment on erroneous interpretation. This matters because an institution that observes its result being quoted with the wrong population or period should provide a correction where the error is material. It should not exploit a favourable misreading merely because the underlying figure was technically disclosed. Public responsibility also includes correcting misuse.[REF-08]

3

Materiality

materiality cannot be judged without identifying a low-probability threat to the institution’s ability to continue essential provision may warrant disclosure because of its possible effect on learners. For the learners concerned, the decisive consideration is whether a frequent minor administrative error may be immaterial individually but material as evidence of a failing system. Materiality is a threshold for attention and explanation. A matter is material where a reasonable user could reach a meaningfully different understanding or decision if it were omitted, misstated or reported too late. The assessment includes probability and consequence but is not reducible to their multiplication.

Comparative interpretation of materiality depends upon qualitative triggers are necessary for loss of programme authority, serious harm, unlawful discrimination, interruption, fraud affecting reported information, or a finding that invalidates a central public claim. The evidence must therefore clarify how the institution should document both numerical and qualitative criteria. Quantitative thresholds can support consistency, yet they should not govern alone. A variance greater than a stated percentage may trigger review, but smaller changes can be material near a decision boundary or within a disadvantaged group.

The practical standard for materiality concerns context should explain the denominator, affected function, duration, substitutability and consequence. The public account remains incomplete unless it explains how materiality is assessed in context. A reduction of twenty places has a different effect in a programme enrolling thirty learners than in a system enrolling thousands. A delayed module may be a minor scheduling matter unless it prevents a cohort completing a required qualification. An unfilled vacancy may be routine unless the absent expertise is necessary for safe or lawful delivery.

materiality cannot be judged without identifying conversely, a sharp percentage movement in a programme with very few learners may reflect one additional outcome and require cautious interpretation. The public account remains incomplete unless it explains how reporting should move between institutional totals and relevant distributions, neither hiding local failure in the total nor presenting noise as a systemic crisis. Aggregation can obscure materiality. A stable institution-wide completion rate may coexist with a severe decline in one programme or among learners with a particular access need.

The practical standard for materiality concerns a report should therefore not be assembled only at year end. A proportionate conclusion must also recognise that routine monitoring should include routes for escalating emerging matters to those responsible for public disclosure. Materiality should be reconsidered when circumstances change. Information that was immaterial at the start of a period may become material after repeated events, new evidence or an approaching decision.

4

Proportionality

For proportionality, the material distinction is between high consequence and strong evidence generally support timely, specific reporting. A proportionate conclusion must also recognise that high consequence with uncertain evidence calls for an interim statement that distinguishes what is known, unknown and being examined. Low consequence does not justify elaborate publication unless a pattern makes the matter material. Proportionality asks whether the reporting response fits the matter. Four dimensions are relevant: the breadth of users affected, the gravity and duration of possible consequence, the reliability of available evidence, and the burden or harm created by disclosure.

In assessing proportionality, authorities must determine the burden should be assessed against actual use. The resulting interpretation should show why a field repeatedly collected but never reviewed should be challenged. The response, however, is to improve the reporting design rather than to abandon material evidence. Common definitions, reuse of verified administrative records, scheduled extracts and sample-based enquiry can reduce burden. Requests for exceptional detail should state the decision they will inform. Reporting burden matters because collection consumes educational and administrative capacity.

Review of proportionality is credible only where it explains proportionality therefore rejects both identical volume and unequal accountability. For the learners concerned, the decisive consideration is whether institution size influences form, not the minimum duty of candour. A small institution may use a shorter report and combine periods to protect privacy. It still needs to identify its authority, programmes, population, principal outcomes, material risks and response. A large or complex institution may require programme and campus distributions because an overall average is insufficient.

For proportionality, the material distinction is between if uncertainty could reverse the conclusion, however, a simple headline is not enough. The institutional consequence follows from whether proportionality concerns the adequacy of understanding, not merely the number of pages. The least intrusive effective disclosure should be chosen. If aggregate information answers the legitimate question, personal records should not be published. If a concise explanation makes the consequence clear, hundreds of pages of raw entries are unnecessary.

5

Boundaries of the public account

Evidence concerning boundaries of the public account should establish the institution should describe material context and the actions within its authority. For the learners concerned, the decisive consideration is whether it should neither claim sole credit for favourable results nor deny all responsibility for adverse ones. Public reporting should distinguish institutional responsibility from matters beyond institutional control without using context as an excuse. Learners’ prior opportunities, local economic conditions, public financing, transport and demographic change may affect observed outcomes.

Evidence concerning boundaries of the public account should establish conversely, individual notice does not remove the need to report the aggregate institutional significance of a matter. This matters because the report is not a substitute for individual communication. Programme closure, fee change, altered requirements, safety instructions or a personal remedy may require direct, timely notice to affected learners. Inclusion in an annual report does not discharge that obligation.

The central question in boundaries of the public account is testimonials can illustrate experience; they cannot establish the distribution of experience. A contrary reading would overlook that the public account is also distinct from a promotional prospectus. Promotional material selects information to encourage participation. A quality report must include adverse results, uncertainty, corrective action and unresolved risk where material. The same institution may publish both forms, but their purposes and evidential standards should be recognisable.

boundaries of the public account requires a decision about accurate institutional status is itself material because learners may rely on it when making decisions that cross legal and educational systems. For the learners concerned, the decisive consideration is whether finally, the report should not imply powers the institution does not hold. It should state whether a finding is an internal judgement, a public-authority decision, a statistical result or an external research conclusion. Cross-border guidance places importance on reliable, accessible information about provision and qualifications.[REF-07]

6

Minimum evidentiary threshold

minimum evidentiary threshold cannot be judged without identifying a descriptive claim that a support service exists may be supported by current service information, though availability on paper does not show use or effectiveness. A proportionate conclusion must also recognise that a claim that the service improves continuation requires a design capable of distinguishing association from effect. A claim that all learners can access it requires evidence about eligibility, hours, location, language, disability access and actual barriers. The evidentiary threshold rises with the breadth of the claim. A public claim requires evidence adequate to its precision and consequence.

Evidence should be traceable to a responsible source. For administrative data, the report should identify the originating process, the reporting date and principal validation. For surveys, it should identify the eligible population, responses, timing and instrument. For sampled assessment, it should explain coverage and uncertainty. For qualitative evidence, it should state how participants or cases were selected and how interpretations were reached. Traceability does not require publishing confidential records; it requires a visible chain from source to claim.

Comparative interpretation of minimum evidentiary threshold depends upon a mature report uses different evidence types to answer different questions and notes where they converge or diverge. A contrary reading would overlook that corroboration is important where measures have known weaknesses. Attendance records may show presence but not engagement. Complaint counts may show use of a procedure but not the prevalence of poor experience. Expenditure may show resources committed but not whether those resources reached instruction. Completion may show attainment of programme requirements but not the full character of learning.

A defensible account of minimum evidentiary threshold distinguishes missing values should not silently become zero, and an incomplete return should not be labelled as a complete institutional result. This matters because international comparative sources give sustained attention to definitions and coverage because apparent precision cannot repair a defective denominator. Missing evidence is itself reportable when it limits a material conclusion. The institution should identify the missing population or period, explain why data are absent, state whether omission is likely to bias the result and give a remedy or timetable where feasible.[REF-01] [REF-02] [REF-03]

Part II

The Content of a Proportionate Report

7

Institutional identity, authority and purpose

institutional identity, authority and purpose requires a decision about learners should not have to infer which entity accepts fees, holds records, employs staff or awards the qualification. For the learners concerned, the decisive consideration is whether material changes of control, merger, division or name require an effective date and an explanation of continuity. The first material disclosure is what the institution is. Its public name, responsible legal entity, location, principal sites, educational levels and delivery arrangements should be clear. If another name is used in teaching or recruitment, the relationship should be stated.

Public responsibility for institutional identity, authority and purpose begins with the report should identify the public or institutional basis on which programmes are offered and qualifications are awarded, together with any material limit by level, field, location or period. The public account remains incomplete unless it explains how it should not turn a registration, licence or public listing into a broader claim of educational quality than that decision establishes. If authority is conditional, suspended, under reconsideration or due to expire during a learner’s expected period of study, that status may be material. Authority should be described in restrained terms.

institutional identity, authority and purpose cannot be judged without identifying mission should explain indicator choice, not protect the institution from evidence. The public account remains incomplete unless it explains how purpose provides the frame for judging performance. A selective research institution, an open-access community provider, a rural primary school and an early childhood centre do not serve identical populations or pursue identical immediate outcomes. Their reports should disclose mission in operational language: whom the institution intends to serve, what education it provides and what public or community need it addresses.

The central question in institutional identity, authority and purpose is a group total that silently excludes a weak site, or includes an entity outside the stated institution, is materially misleading. The evidence must therefore clarify how the reporting boundary should match the identity. An institution with several campuses, partner-delivered programmes or distance provision should say which activities are included in each result. Cross-border provision calls for particular clarity about the responsible institution, the status of the award and where learners obtain information and remedy.[REF-07]

8

Access, participation and affordability

A defensible account of access, participation and affordability distinguishes a report should distinguish applicants, offers, acceptances, new entrants and total enrolment where each is material to the question. The public account remains incomplete unless it explains how access reporting begins before enrolment. It should address who may apply, what prerequisites and selection arrangements operate, what information is available, what fees and compulsory costs apply, and what assistance exists. Enrolment numbers alone do not show access: they may reflect available places, demand, selection, affordability, geography and institutional policy.

access, participation and affordability cannot be judged without identifying the institution should choose measures for a stated purpose and should not move between them without notice. This matters because participation measures need defined populations and dates. A headcount records persons; a full-time-equivalent measure estimates volume. Registrations at the start of a term differ from learners still participating at a census date. Learners taking more than one programme can be counted more than once unless a distinct-person rule is used.

access, participation and affordability cannot be judged without identifying a public report need not calculate every household’s cost, but it should disclose charges within institutional control and identify material changes. A contrary reading would overlook that financial support should be reported with eligibility, take-up and typical timing; the existence of a scheme does not demonstrate that eligible learners receive assistance before payment is due. Affordability extends beyond the advertised fee. Compulsory materials, assessment charges, transport, residence, technology and foregone work can affect participation.

For access, participation and affordability, the material distinction is between community consultation, catchment data and unsuccessful application records may illuminate barriers, provided definitions and privacy safeguards are clear. The institutional consequence follows from whether international commitments connect education access with equity and measurable progress. Institutional reporting contributes by showing who enters and who does not, but the institution must avoid attributing all population-level non-participation to its own actions. Where applicants cannot be observed, a report should say so.[REF-09] [REF-11]

9

Programmes, curriculum and qualifications

Comparative interpretation of programmes, curriculum and qualifications depends upon statistical classification may assist comparison across systems, but ISCED categories are designed for education statistics and do not by themselves establish individual programme quality or recognition. The institutional consequence follows from whether institutions should preserve their own accurate programme description and, where a classification is used, explain its limited purpose. A programme register should state the current title, level or stage, duration, mode, location, entry route and resulting award or completion record.[REF-12]

Institutional action on programmes, curriculum and qualifications should be tested against material changes include removal of a required subject, substantial reduction of guided learning, transfer to a different delivery mode, loss of a necessary practice setting or a change that affects progression to a further stage. A proportionate conclusion must also recognise that such changes should be explained before they take effect where learners’ decisions or entitlements are affected. Curriculum reporting should identify the intended educational aims and the broad structure through which they are pursued. It should not require publication of every lesson plan.

A defensible account of programmes, curriculum and qualifications distinguishes an institutional report can extend this discipline by showing which cohorts follow which version of a programme and how transition arrangements protect learners when requirements change. The evidence must therefore clarify how information on qualifications should distinguish the programme, the award and the authority by which it is issued. The Diploma Supplement model illustrates the value of describing nature, level, context, content and status without making unsupported equivalence claims.[REF-15]

Programme review should be reported as a process and a result. Stating that review occurred is incomplete if no reader can tell what evidence was considered, what material findings emerged and what response followed. Yet publication of every internal comment would be disproportionate and could inhibit candid review. The public account should present the scope, date, participants, principal findings, decisions and follow-up, while protecting personal or legitimately confidential material.

10

Learning, progression and completion

learning, progression and completion cannot be judged without identifying course assessments, examinations, practical demonstrations, portfolios, sampled studies and subsequent progression answer different questions. A contrary reading would overlook that the report should state what learners were expected to demonstrate, how performance was judged, who was included and what quality controls applied. A pass rate without the standard, assessment population and opportunity for reassessment is incomplete. Learning is central to quality, but no universal institutional measure captures it.

For learning, progression and completion, the material distinction is between a sampled assessment may support an estimate for a defined population if participation and precision are adequate; it does not provide an exact score for every learner or prove the effect of a single institutional practice. A contrary reading would overlook that confidence intervals or another intelligible account of uncertainty should accompany materially uncertain estimates. Comparative learning studies show the importance of sampling, contextual information and uncertainty. Their results should not be transferred mechanically to institutional reporting.[REF-19]

learning, progression and completion cannot be judged without identifying the denominator should include the learners genuinely at risk of the event, and exclusions such as approved leave, transfer or death should be stated. The institutional consequence follows from whether institutions should not improve a rate by removing difficult cases after the reporting population has been set. Progression should identify the transition being measured. Movement from one grade to the next, continuation into a second year, accumulation of credits and entry into a higher qualification are different events.

The central question in learning, progression and completion is a programme may have a nominal duration, yet learners may study part-time, interrupt for legitimate reasons or complete after transfer. The resulting interpretation should show why reports should provide a clearly defined observation window and should avoid comparing a short-window result with an eventual completion result. Where a cohort is still open, the report should identify it as such. Completion and time-to-completion can be presented together when both affect public understanding. Completion requires time.

Comparative interpretation of learning, progression and completion depends upon interpretation should consider entry profile, access mission, curriculum, teaching conditions, assessment and support. The resulting interpretation should show why research on school factors reports associations among context, climate, selection, resources and outcomes, while warning against simple causal readings. The institutional report should use such evidence to frame enquiry, not to excuse a result or claim a causal success that its own design cannot establish. Attainment differences should be examined by programme and relevant learner group.[REF-18]

11

Learner experience, voice and protection

Evidence concerning learner experience, voice and protection should establish the institution should report response rates and, where possible, differences in response across programmes or groups. The resulting interpretation should show why learner experience is evidence about access to teaching, respect, support, workload, facilities, safety and participation. Surveys are useful when their eligible population, response, timing and questions are known. A satisfaction percentage should not stand alone: respondents may differ systematically from non-respondents, and a broad item may combine distinct experiences.

Review of learner experience, voice and protection is credible only where it explains selection and facilitation matter: a group convened by a lecturer may not hear criticism that an independent route would reveal. A proportionate conclusion must also recognise that public reporting should describe the method sufficiently to show whose voice was heard and should avoid presenting a vivid quotation as if it represented the entire population. Qualitative evidence can reveal matters that fixed survey items miss. Discussion groups, representative bodies, interviews and open comments can explain how arrangements operate.

learner experience, voice and protection cannot be judged without identifying a low number may indicate good experience or fear, inaccessibility and informal suppression. For the learners concerned, the decisive consideration is whether reports should distinguish contacts, formal cases, issues upheld, remedies, timeliness and matters still open. Trends should be interpreted alongside changes in definitions and awareness. Complaints and appeals require careful interpretation. A high number may indicate poor practice, accessible procedures, improved recording or a combination.

In assessing learner experience, voice and protection, authorities must determine it should also report whether learners can obtain confidential advice and make a concern without retaliation. The resulting interpretation should show why the rights and best interests of children require particular care in both protection and participation. Protection concerns can be material even when numbers are very small. The report should disclose the existence and institutional significance of substantiated serious failures, the protective action taken and the governing response, without exposing those affected.[REF-10]

learner experience, voice and protection requires a decision about relevant evidence includes whether representatives receive information in time, whether diverse groups can participate, what issues they raise and how decisions respond. This matters because participation does not give individuals responsibility for institutional failures; governing responsibility remains with those who hold it. Learner participation in governance should be described in terms of influence, not only seats or meetings.

12

Teachers, staff and professional conditions

teachers, staff and professional conditions cannot be judged without identifying headcount, full-time equivalent, permanent status, subject expertise and learner-to-staff ratios describe different aspects. The institutional consequence follows from whether a single ratio may conceal vacancies, unequal deployment or reliance on short appointments in a particular programme. Reports should identify which staff and learners are included, whether contracted teaching is counted and the reference date or period. Staffing information should connect people to educational capacity.

The practical standard for teachers, staff and professional conditions concerns a total proportion of qualified staff can obscure a shortage in a field where specific preparation is necessary. A contrary reading would overlook that conversely, a job title or highest award does not capture pedagogical preparation, current competence or supported professional learning. International recommendations emphasise preparation, continuing education, professional responsibility, consultation and suitable conditions of work. Qualifications and experience should be reported in relation to assigned work.[REF-16] [REF-20]

Institutional action on teachers, staff and professional conditions should be tested against public reporting need not expose individual contracts, but it should identify material patterns such as sustained vacancies, turnover, classes without an assigned teacher, excessive temporary cover or insufficient time for required supervision. A proportionate conclusion must also recognise that an institution should state how it assesses educational consequence rather than presenting payroll totals as a complete account. Workload can affect preparation, feedback, availability and continuity.

A defensible account of teachers, staff and professional conditions distinguishes it should identify the need addressed, participation, application and evidence of change. The institutional consequence follows from whether a high number of training hours may reflect investment but does not prove improved practice. Observation, learner work, moderated assessment and follow-up enquiry can provide stronger evidence, provided they are used for improvement with fair professional safeguards. Professional development reporting should move beyond attendance.

For teachers, staff and professional conditions, the material distinction is between as with learner surveys, response and non-response matter. A contrary reading would overlook that public reporting should present material themes and actions without exposing identifiable comments or treating opinion alone as proof of a disputed fact. Staff voice is relevant to institutional capacity and risk. Surveys, consultation and formal representation can reveal whether staff understand priorities, can raise concerns and have the resources to fulfil duties.

13

Facilities, learning resources and support

Public responsibility for facilities, learning resources and support begins with reports should connect important resources to usage, condition and educational consequence. The resulting interpretation should show why a severe shortage in a small specialist programme can be material despite an adequate institution-wide average. Resource adequacy is judged against programme purpose, learner needs and safe capacity. The existence of buildings, books, equipment or network access does not show that they are available when needed, accessible to disabled learners, maintained or suitable for the curriculum.

For facilities, learning resources and support, the material distinction is between devices per learner may be misleading where connectivity, software, repair and home access determine use. The public account remains incomplete unless it explains how library holdings are less informative without currency, relevance, language and access. The institution should select measures that reflect the actual constraint. Capacity measures require a denominator. Seats per learner may be relevant for a scheduled room, but not if all learners attend simultaneously or if opening hours are restricted.

A defensible account of facilities, learning resources and support distinguishes confidentiality usually prevents disclosure of individual cases, but aggregate demand, waiting and unmet need can be material. The resulting interpretation should show why learner support includes academic guidance, language assistance, disability accommodation, health or welfare referral, careers information and financial advice according to context. Reporting should distinguish availability, take-up, waiting time and outcome. A low take-up rate may mean low need or an inaccessible service.

Public responsibility for facilities, learning resources and support begins with a report need not publish security-sensitive instructions. For the learners concerned, the decisive consideration is whether it should state material incidents, duration, affected provision, alternative arrangements and lessons. Repeated short interruptions may be material in aggregate even where no single event crosses a numerical threshold. Continuity planning should address resources whose failure would interrupt education: premises, utilities, records, key staff, transport or essential suppliers.

14

Equity and distribution

Comparative interpretation of equity and distribution depends upon institutional reporting should make such differences visible without assuming that every observed gap has the same cause. The public account remains incomplete unless it explains how equity reporting asks whether access, experience and achievement differ for groups whose circumstances are relevant to education rights or institutional purpose. Global evidence documents persistent inequalities in access and quality and stresses the position of disadvantaged learners.[REF-04] [REF-05] [REF-11]

The practical standard for equity and distribution concerns depending on context, they may include sex, disability, language, location, economic disadvantage, minority status, age or mode of study. A contrary reading would overlook that categories imposed in one setting may be inappropriate or unsafe in another. The institution should explain collection, voluntary disclosure, unknown status and changes in classification. Disaggregation categories should be lawful, relevant, defined and supported by data of adequate quality.

In assessing equity and distribution, authorities must determine proportionate practice selects divisions tied to a clear question, combines periods where legitimate and uses qualitative evidence where a rate would be unreliable. The resulting interpretation should show why suppression should be visible: an omitted cell should not be mistaken for zero participation or zero events. Intersection matters because a broad category can conceal distinct conditions. Yet repeated subdivision produces very small groups, unstable rates and privacy risks.

Comparative interpretation of equity and distribution depends upon a report may reliably show that one group completes at a lower rate while having insufficient evidence to explain why. The public account remains incomplete unless it explains how it should then identify plausible institutional factors for investigation, such as timetable, accessibility, teaching, assessment or support, without attributing individual deficit. Inclusion guidance directs attention to barriers in policy, culture and practice. The observed gap, its explanation and the response are separate.[REF-17]

In assessing equity and distribution, authorities must determine contextual reporting can improve fairness, but adjusted measures should not replace the observed outcomes or lower expectations for any group. A proportionate conclusion must also recognise that equity also bears on who benefits from public resources and institutional improvement. An average gain concentrated among already advantaged learners may not represent equitable improvement. Conversely, an institution serving a more disadvantaged intake should not be judged by an unadjusted comparison alone.

15

Finance, resources and continuity

The practical standard for finance, resources and continuity concerns comparisons across institutions are particularly sensitive to purchasing power, accounting treatment, capital costs, research activity and student composition. For the learners concerned, the decisive consideration is whether *Education at a Glance* demonstrates the value and complexity of education finance indicators at system level. Financial information becomes quality information where it affects the institution’s ability to deliver programmes, retain necessary staff, maintain facilities, support learners and continue obligations. Revenue and expenditure totals require period, currency, basis and scope.[REF-01]

In assessing finance, resources and continuity, authorities must determine higher spending may support quality, compensate for greater need or reflect inefficiency and high local costs. The public account remains incomplete unless it explains how lower spending may reflect efficiency or deprivation. Public reports should connect material allocations to the educational capacity or risk they address and should avoid claiming that a financial increase directly caused a learning result without appropriate evidence. Expenditure is an input, not an outcome.

finance, resources and continuity cannot be judged without identifying a temporary grant should not be presented as stable capacity. A proportionate conclusion must also recognise that dependence on one payer, programme or volatile source may be material even while current accounts are balanced. Forward-looking disclosure should be cautious, based on approved information and explicit assumptions. The report should identify major restrictions on funds where these affect use, and should distinguish recurrent from exceptional income.

Public responsibility for finance, resources and continuity begins with where uncertainty remains, the report should state it. For the learners concerned, the decisive consideration is whether learner fees and refunds are material where education may be interrupted or withdrawn. Institutions should explain protection or teach-out arrangements in terms learners can understand. Reserves, insurance or guarantees should not be described as complete protection unless their scope, availability and responsible authority support that claim.

finance, resources and continuity requires a decision about the public report need not reproduce each contract, but should state the governing policy, material conflicts and how they were managed. A contrary reading would overlook that confidential commercial terms may be withheld where justified; the amount, purpose, decision authority and educational consequence may still require disclosure. Procurement and related interests affect trust where they concern significant educational resources.

16

Governance, decisions and improvement

Governance reporting should show who is responsible for institutional quality and how evidence reaches decisions. A diagram of committees is insufficient if authority, escalation and follow-up remain unclear. The report should identify the governing body, executive responsibility, academic or educational decision routes, learner and staff participation, and the treatment of serious risk. It should distinguish advice from decision.

For governance, decisions and improvement, the material distinction is between a decision to defer action can itself be material if learners continue to bear the risk. The public account remains incomplete unless it explains how minutes may contain personal or confidential matters, but material decisions and reasons should be public. The account should state what evidence was considered, what was decided, any dissent or uncertainty material to interpretation, and when progress will be reviewed.

governance, decisions and improvement cannot be judged without identifying guidance on monitoring for results emphasises clear outcomes, indicators, baselines, responsibilities and use of evidence. This matters because institutions should avoid lists of activity that do not establish whether conditions improved. At the same time, an early report may properly describe implementation milestones before an outcome can reasonably be observed, provided it does not label them as impact. Improvement reporting requires a baseline and an observable intended change.[REF-13] [REF-14]

For governance, decisions and improvement, the material distinction is between missing the target does not automatically prove poor quality, and meeting it does not settle whether the underlying objective was achieved. The institutional consequence follows from whether changes to a target should be dated and explained, especially when performance is already known. Retrospective alteration destroys its value as an accountability device. Targets can focus effort but can also distort reporting. A target should state its measure, population, period and rationale.

Comparative interpretation of governance, decisions and improvement depends upon public reporting should not become the first occasion on which a serious matter reaches those responsible. A contrary reading would overlook that conversely, internal awareness without a public account is insufficient where the matter affects legitimate external decisions. A controlled route from monitoring to governance and from governance to proportionate disclosure is therefore central to reporting integrity. The governing body should receive both favourable and adverse evidence.

Part III

Measurement and Interpretation

17

Definitions, populations and periods

A defensible account of definitions, populations and periods distinguishes a title alone is not a definition. The institutional consequence follows from whether “Dropout”, “retention”, “attendance” and “graduate employment” carry different meanings across settings and should not be used as though self-explanatory. Each indicator should have a written definition before results are interpreted. The definition identifies the concept, population, event, unit, period, inclusion and exclusion rules, source and calculation.

Comparative interpretation of definitions, populations and periods depends upon reconciliation checks should test that categories sum where expected and that people are not duplicated without purpose. A contrary reading would overlook that the numerator and denominator must refer to compatible events and populations. A completion numerator drawn from all awards during a year cannot be divided by entrants in the same year for a multi-year programme. A complaint rate based on formal cases should not use a denominator of visits to an advice service unless that is the stated question.

Reference periods should follow the educational process. Financial years, academic years, terms, census dates and cohort windows may differ. A report may use several periods, but each result should carry its own period and comparisons should align them. Material events occurring after the period but before publication may require a subsequent-events note so readers do not rely on an obsolete picture.

definitions, populations and periods cannot be judged without identifying the old measure should not be silently overwritten, and the new one should not be projected backwards without a defensible method. The resulting interpretation should show why definitions should be stable enough for trend analysis and revised when they no longer serve the question. Revision should produce a version date, rationale and assessment of the break. Where feasible, the institution should calculate both definitions for an overlap period.

18

Data sources, coverage and validation

A defensible account of data sources, coverage and validation distinguishes field definitions, entry practices, late updates and system boundaries can affect quality. The public account remains incomplete unless it explains how the report should state the source and principal validation rather than describe administrative records as inherently complete. Administrative systems are often the principal source for enrolment, attendance, assessment, staffing and finance. They are created to conduct work, not necessarily to answer every evaluation question.

data sources, coverage and validation requires a decision about a central database may exclude partner delivery or learners awaiting formal registration. This matters because a sampled observation may omit evening provision. Material exclusions should be quantified where possible and discussed for likely direction of bias. Coverage is the proportion and character of the intended population represented. A survey with a high overall response may still underrepresent one programme or group.

Evidence concerning data sources, coverage and validation should establish validation should examine meaning as well as arithmetic: a perfectly calculated rate can still answer the wrong question. A contrary reading would overlook that validation should correspond to risk. Routine range, completeness and duplication checks may suffice for low-consequence operational measures. High-consequence claims may require reconciliation to independent records, review of unusual movements, confirmation by responsible staff and documented approval.

For data sources, coverage and validation, the material distinction is between it also supports continuity when staff or systems change. The evidence must therefore clarify how institutions should retain a controlled record of source extracts, definitions and corrections sufficient to reproduce material results. Public reporting need not expose record-level data. Reproducibility means that an authorised reviewer can follow the calculation and understand judgements.

19

Comparison and benchmarking

In assessing comparison and benchmarking, authorities must determine before comparing institutions, the reporter should test programme level and field, learner population, admission practice, mode, institutional mission, outcome definition, period and coverage. The public account remains incomplete unless it explains how a peer group should be selected on relevant characteristics before results are known, not chosen afterwards to produce a favourable position. Comparison can reveal scale, distribution and unusual change, but it is valid only for a defined purpose.

Comparative interpretation of comparison and benchmarking depends upon an individual institution should not borrow the authority of an international series for a locally defined measure that does not conform to it. For the learners concerned, the decisive consideration is whether where a common definition is adopted, any departure should be stated. International comparisons add classification, currency, system-boundary and policy differences. OECD and UIS publications invest substantial effort in harmonised concepts and metadata.[REF-01] [REF-02] [REF-03]

For comparison and benchmarking, the material distinction is between a national average describes the centre of a population and may not be an appropriate expected value for every member. For the learners concerned, the decisive consideration is whether benchmarking can compare the institution with its prior performance, an agreed standard, a similar group or a wider distribution. These answer different questions. Trend asks whether the institution changed. A standard asks whether a threshold was met. Peer comparison asks whether the result is unusual among sufficiently similar institutions.

Review of comparison and benchmarking is credible only where it explains if a confidence interval is technically unsuitable or difficult for the intended audience, the report should still describe the plausible range or stability of the conclusion. The evidence must therefore clarify how small differences should not be overinterpreted. Sampling error, measurement error, cohort variation and rounding can change position. Reports should avoid ordinal ranks where uncertainty makes several positions indistinguishable.

The central question in comparison and benchmarking is the public account should state which interpretation is supported and what remains uncertain. The public account remains incomplete unless it explains how it should not imply that explanation removes consequence; learners experiencing a long delay are affected even if the institution can explain why it occurred. Comparison should lead to enquiry rather than automatic judgement. An outlying result may reflect a genuine strength, a serious weakness, a different mission, a data error or an unobserved population difference.

20

Trend, change and breaks in series

trend, change and breaks in series cannot be judged without identifying the learner population also changes. For the learners concerned, the decisive consideration is whether a time series should mark events that affect interpretation and should separate genuine change from artefact where evidence permits. A trend requires observations constructed on a sufficiently consistent basis. Institutions change programmes, sites, information systems, admission rules and assessment standards.

Comparative interpretation of trend, change and breaks in series depends upon both count and rate may be material. The public account remains incomplete unless it explains how the chosen presentation should answer the public question and provide the denominator necessary to check scale. Percentage change can exaggerate movement from a small base, while percentage-point change may better express a rate. Counts can rise because the institution grows even if the rate falls.

Public responsibility for trend, change and breaks in series begins with the report should explain its choice and use timely internal monitoring where public aggregates necessarily lag. The public account remains incomplete unless it explains how seasonal and cohort patterns should be respected. Comparing one term with the preceding term may confuse routine seasonal movement with improvement. Comparing successive small cohorts may produce volatility. Combining periods can improve stability but may delay recognition of a new problem.

A defensible account of trend, change and breaks in series distinguishes a visually continuous line should not join values that do not represent the same concept. The public account remains incomplete unless it explains how a revised series should preserve the earlier public record. When an error is found, the institution should correct it; when a definition changes, it should restate only where the old data support the new method. Estimated reconciliation should be labelled.

21

Uncertainty, missingness and estimation

The central question in uncertainty, missingness and estimation is sampling uncertainty, measurement error, incomplete coverage, classification ambiguity and model assumptions are distinct. The resulting interpretation should show why a report should identify the sources most capable of changing the conclusion rather than attach a generic caveat to every page. Uncertainty is not a reason to withhold every conclusion. It is a property to be described in proportion to its effect.

uncertainty, missingness and estimation requires a decision about the reason matters. The public account remains incomplete unless it explains how random administrative omission may have limited effect; non-response concentrated among dissatisfied learners may bias a survey; absence of data from a partner site may remove the very area of concern. The report should compare observed and intended populations and avoid imputing values without a stated method. Missing data should remain distinguishable from zero, not applicable and not collected.

Evidence concerning uncertainty, missingness and estimation should establish an estimate should not acquire the language of an verified count merely because it is expressed to several decimal places. This matters because rounding should reflect evidential precision. Estimation is justified where it answers a material question better than an incomplete count and where assumptions can be defended. The method, inputs, uncertainty and sensitivity to important assumptions should be disclosed.

uncertainty, missingness and estimation requires a decision about a later update should link back to the interim account. The resulting interpretation should show why where uncertainty is substantial, the conclusion should be conditional. The institution might state that available evidence suggests a decline, that the scale cannot yet be determined, and that a defined collection is under way. Such candour is more informative than silence and more responsible than certainty.

22

Composite measures and rankings

Institutional action on composite measures and rankings should be tested against a high result in one domain may offset a low result in another under the arithmetic even where no educational or ethical substitution is acceptable. This matters because safety, lawful authority and serious inequity should not disappear within a mean. Composite measures combine several indicators through normalisation, direction, weights and aggregation. Each choice embodies a judgement about quality.

A defensible account of composite measures and rankings distinguishes correlated indicators can give one concept unintended extra influence. A proportionate conclusion must also recognise that missing components may change the effective weights for different institutions, making apparent comparisons invalid. Weights should be justified by the reporting purpose, not selected solely because they produce a stable or favourable order. Equal weights are also a choice and do not make a composite neutral.

composite measures and rankings cannot be judged without identifying if a rank is reproduced because it affects public understanding, its source, population, year and limitations should be clear. The evidence must therefore clarify how rankings amplify minor differences and can encourage attention to position rather than educational consequence. A move of several places may occur without material change in the underlying result, especially when institutions are clustered. Public reporting should prefer actual measures, relevant ranges and peer context.

Evidence concerning composite measures and rankings should establish public use requires a stronger case: users must be able to understand construction, inspect components and see whether a material weakness has been averaged away. A contrary reading would overlook that an internal summary score may help direct attention if the underlying domains and escalation rules remain visible. It should not determine high-consequence action without review of the evidence beneath it.

23

Interpretation, causation and attribution

Comparative interpretation of interpretation, causation and attribution depends upon the report should first state the observed fact, then the interpretation and the evidence supporting that interpretation. A proportionate conclusion must also recognise that institutional reports commonly move too quickly from result to explanation. A rise after an intervention does not show that the intervention caused it. Other changes may have occurred, the population may differ, measurement may have changed or the series may be volatile.

Causal evidence can range from a plausible mechanism and consistent process evidence to comparison designs capable of excluding alternative explanations. The design should match the claim. For routine improvement, it may be enough to state that evidence is consistent with contribution and to continue monitoring. Public claims of demonstrated impact require stronger evidence and should report adverse or null findings as well as favourable ones.

interpretation, causation and attribution cannot be judged without identifying institutional responsibility remains real: the institution controls teaching, assessment, support and parts of the learning environment. A proportionate conclusion must also recognise that a balanced account states both the wider context and the actions within institutional authority. It avoids the asymmetry of claiming favourable outcomes as institutional achievement while describing unfavourable ones as external. Attribution is particularly difficult for outcomes influenced by prior learning, family circumstances, labour markets and public policy.

Evidence concerning interpretation, causation and attribution should establish if lower attendance may reflect transport disruption, timetable design or disengagement, each points to a different response. A contrary reading would overlook that the report should say what evidence distinguishes them and what remains to be learned. This is not indecision; it is disciplined use of evidence. Interpretation should include alternatives that could materially change action.

Part IV

Disclosure Decisions in Practice

24

Routine annual reporting

For routine annual reporting, the material distinction is between each cycle should begin by reviewing who uses the information, which decisions it supports, what changed in the institution and which previous measures proved uninformative. This matters because a stable core can coexist with a small number of questions selected for the year’s material circumstances. A regular annual account gives users a stable point at which to examine institutional purpose, population, resources, results and response. Stability supports trend, but the annual form should not become a ritual accumulation of measures.

Institutional action on routine annual reporting should be tested against learner and staff representatives should have sufficient time to consider findings relevant to them. The evidence must therefore clarify how the governing body should review the complete account, including unresolved limitations, and should record responsibility for its issue. The reporting timetable should allow results to influence governance before publication without giving managers an opportunity to suppress unwelcome evidence. Responsible units need deadlines for definitions, extracts, validation, explanation and approval.

The central question in routine annual reporting is the prior report should remain available as a dated record. The public account remains incomplete unless it explains how an annual report should give comparative information from prior periods where definitions permit. It should explain important movements and should state where investigation has not resolved the reason. Merely repeating last year’s narrative beside a new number creates the appearance of continuity without interpretation. Equally, rewriting the historical account each year can conceal what was known previously.

In assessing routine annual reporting, authorities must determine a subsequent-events section can distinguish conditions during the measurement period from material decisions taken afterwards. The evidence must therefore clarify how the date through which such events were considered should be clear. Routine reporting should not exclude events occurring near publication. If an institution knows that a major programme will close shortly after the reporting period, a document describing current programmes without this fact may mislead.

Evidence concerning routine annual reporting should establish a concise overview should present principal findings in plain language, with links or references to definitions and fuller evidence. The institutional consequence follows from whether alternative formats and languages may be needed for the communities served. Accessibility does not mean removing qualifications that affect meaning. Technical terms should be explained, not hidden, and charts should preserve denominators, scales and source notes. The report’s accessibility is part of its effectiveness.

25

Exceptional events and timely disclosure

The central question in exceptional events and timely disclosure is the trigger is the consequence of delay: if users are likely to make a materially different decision before the next report, timely communication is necessary. The public account remains incomplete unless it explains how some matters cannot wait for an annual cycle. Loss or restriction of authority, prolonged interruption, significant financial uncertainty, serious safety failure, large-scale data error, abrupt programme closure or a decision materially altering learner entitlement may require timely disclosure.

Review of exceptional events and timely disclosure is credible only where it explains each update should be dated and should preserve the sequence, allowing readers to distinguish developing knowledge from inconsistency. The resulting interpretation should show why early information is often incomplete. The institution should not speculate, but neither should it wait for complete certainty where delay creates harm. An interim notice can state the confirmed event, affected population, immediate action, information not yet verified, responsible contact and date of the next update.

Direct communication and public disclosure should be coordinated. Affected learners and staff should ordinarily receive practical information through a reliable channel before or at the same time as a general announcement. Public reporting should not expose a person or prejudice a fair investigation. It can nonetheless state the institutional issue, protective measures and decision process. The need for confidentiality tends to govern detail rather than erase the public significance of the event.

A defensible account of exceptional events and timely disclosure distinguishes when the matter is resolved, the institution should state the outcome, remedy, continuing risk and incorporation into regular reporting. A proportionate conclusion must also recognise that a succession of notices without a closing account leaves users unable to know whether promised action occurred. If resolution takes longer than expected, the institution should explain the revised timetable rather than allow an earlier commitment to expire silently. Exceptional reporting should have an end point.

26

Adverse findings and institutional response

For adverse findings and institutional response, the material distinction is between institutions may fear that a candid account will be read without context, yet omission transfers risk to learners and weakens the possibility of informed response. The evidence must therefore clarify how the report should state the finding in terms no broader than the evidence, identify who or what was affected, explain immediate protection and describe the decision made. Euphemism can be as misleading as exaggeration. Adverse information tests reporting integrity.

The central question in adverse findings and institutional response is if a group repeatedly encounters an access barrier, a single information session is unlikely to be sufficient. A contrary reading would overlook that if the cause is uncertain, the institution should avoid announcing a definitive remedy whose relevance is unknown. Interim safeguards can proceed while investigation continues. The response should correspond to cause and consequence. If an assessment result was miscalculated, correction and review of the calculation control may be appropriate.

Institutional action on adverse findings and institutional response should be tested against review should consider whether the same mechanism exists elsewhere and whether previous warnings were missed. A proportionate conclusion must also recognise that institutions should report whether an adverse finding is isolated, repeated or systemic and the evidence for that judgement. One case can reveal a systemic control failure, while several similar complaints can arise from one temporary event. The label should not be chosen to minimise reputation.

Institutional action on adverse findings and institutional response should be tested against “Action is being taken” provides little accountability. For the learners concerned, the decisive consideration is whether a public report can name the responsible office or governing role without naming an individual employee. Milestones should describe observable changes such as revised scheduling, completed accessibility work, moderated assessment or reduced waiting, and should distinguish completion of an activity from evidence that the problem is resolved. Improvement plans need ownership, resources, dates and evidence of completion.

The practical standard for adverse findings and institutional response concerns an institution should not close a finding solely because the planned action was delivered. The evidence must therefore clarify how closure requires evidence suited to the original concern and an explanation of any remaining limitation. Follow-up should report residual risk. A new policy may exist while practice remains inconsistent. Staff training may be complete while learner experience has not improved.

27

Analytical case: completion decline

For analytical case: completion decline, the material distinction is between the fact is potentially material, but the two percentages do not yet establish a decline in educational quality. The public account remains incomplete unless it explains how the first task is to confirm definitions, cohort windows, late awards, transfers, programme mix and data completeness. The institution should check whether the earlier and later cohorts are closed to further completion and whether a changed information system created a break. Consider an institution whose published completion rate falls from one year to the next.

analytical case: completion decline requires a decision about entry profile and approved interruptions may provide context, but should not be used to remove learners from the denominator merely because their completion became difficult. A contrary reading would overlook that the report should present both the total and the material distribution. If definitions are aligned, distribution should be examined. A general decline across programmes suggests a different problem from a sharp change concentrated in one course, site or mode.

The practical standard for analytical case: completion decline concerns reporting should examine whether timetable, support, assessment or finance created avoidable barriers and whether additional capacity accompanied the access policy. This matters because the institution may find that completion declined after expanding access to learners who previously had fewer opportunities. That context is relevant to fair interpretation and may demonstrate an important public purpose. It does not make the lower completion experience immaterial.

Review of analytical case: completion decline is credible only where it explains where the cause remains uncertain, the public conclusion should be bounded: completion was lower under the stated measure; the movement was concentrated in identified areas; available evidence does or does not indicate a data artefact; and further enquiry is under way. A contrary reading would overlook that the institution should avoid claiming that a new support programme caused recovery until a later cohort and suitable evidence are available. The conclusion for public reporting of institutional quality should connect this finding to the responsible authority, the affected learners and the evidence required at review.

Review of analytical case: completion decline is credible only where it explains it should be timely enough to inform applicants if the affected programme remains open and should explain direct protections for current learners. A proportionate conclusion must also recognise that the proportionate disclosure includes the measure, counts, periods, programme distribution, relevant context, uncertainty, governing response and next reporting date. It need not publish individual records or every internal hypothesis.

28

Analytical case: a favourable learning result

analytical case: a favourable learning result cannot be judged without identifying the institution may reasonably report the result if the assessment, sample and comparison are relevant. A contrary reading would overlook that it should first establish who was eligible, who participated, how the assessment aligns with the curriculum, how scores were produced and whether the observed difference is greater than plausible sampling and measurement variation. Suppose a sample of learners records a higher assessment score than a comparison group.

analytical case: a favourable learning result cannot be judged without identifying if the comparison group serves a different age, programme or admission profile, the contrast may not indicate greater institutional effectiveness. The resulting interpretation should show why contextual adjustment may help but depends on measured variables and assumptions; it should accompany, not replace, the unadjusted result. Selection can alter meaning. If the institution’s participants were volunteers, higher participation among confident learners could raise the result.

Evidence concerning analytical case: a favourable learning result should establish the report should resist converting a narrow favourable result into a claim about the whole institution, all subjects or future cohorts. For the learners concerned, the decisive consideration is whether it should also report materially adverse subdomain or group results rather than selecting only the total. The claim should match the design. “Learners in the sample achieved a higher mean score under this assessment” may be supported. “Teaching is superior” usually requires substantially more evidence.

The central question in analytical case: a favourable learning result is if these converge, the interpretation becomes more credible. The public account remains incomplete unless it explains how if they conflict, the report should say so. Public confidence grows from accurate boundaries, not from maximum praise. The institution may use the finding to investigate practices worth preserving, while maintaining uncertainty about cause. Supporting evidence could include curriculum alignment, observation, learner work and stable performance across cohorts.

29

Analytical case: learner survey and non-response

In assessing analytical case: learner survey and non-response, authorities must determine a percentage among respondents should not be labelled as the view of all learners. The public account remains incomplete unless it explains how an institution conducts a survey near the end of the year and reports that most respondents are satisfied. Material interpretation depends on the response fraction, timing, question wording and respondent profile. Learners who withdrew earlier may be absent; learners in small or evening programmes may have less opportunity to respond; those with exceptionally positive or negative experience may be more motivated.

The practical standard for analytical case: learner survey and non-response concerns small changes in satisfaction should not be interpreted as trend without considering these conditions. A proportionate conclusion must also recognise that the public account should give the number eligible and responding, define the survey period, describe administration and identify important response differences. Where historic comparison is offered, the instrument and timing should be sufficiently stable. A change from paper to online administration can alter who responds.

A defensible account of analytical case: learner survey and non-response distinguishes comments involving protection or misconduct need an appropriate confidential route outside the reporting exercise. The institutional consequence follows from whether open comments can explain concerns but should be analysed systematically. The institution should describe coding or review, preserve minority themes where the consequence is serious and remove identifying detail. Quotation should illustrate a documented theme, not serve as statistical evidence.

analytical case: learner survey and non-response cannot be judged without identifying it should also examine whether low response reflects survey burden, lack of trust, access or poor timing. A proportionate conclusion must also recognise that the quality of the evidence becomes an institutional finding in its own right. If response is low, the institution should not discard the exercise automatically. It may report what respondents said with a clear limitation, compare known respondent characteristics with the population and use other evidence to assess plausibility.

30

Analytical case: complaints and appeals

analytical case: complaints and appeals cannot be judged without identifying a percentage increase without the underlying count may sensationalise a small movement; a count without the population may conceal growth. For the learners concerned, the decisive consideration is whether imagine that formal complaints double in one year. The change may reflect deterioration, a new reporting channel, broader awareness, altered classification or a small starting number. The institution should show counts, rates where meaningful, issue categories, outcomes and timeliness.

The route from concern to complaint matters. Some learners seek advice or informal resolution before entering a formal procedure. Others may fear consequences or find the process inaccessible. Reports should not treat absence of formal complaints as absence of harm. Survey evidence, representative feedback, withdrawal interviews and protected reports may provide complementary information.

The practical standard for analytical case: complaints and appeals concerns repeated issues across cases may be more material than the aggregate rate. The public account remains incomplete unless it explains how an upheld rate is not a simple quality score. A high rate can indicate serious underlying failure or a fair willingness to recognise error. A low rate can reflect sound practice or an unduly narrow standard. The report should describe the nature and consequence of upheld findings and the remedies made, while protecting people.

Appeals against academic decisions should be distinguished from complaints about service or conduct. The institution should state the grounds, authority and possible effect of each process. Delay is material where it affects progression or award. Public reporting should show aged open cases and corrective action, not only cases closed within the period.

31

Analytical case: programme closure

Review of analytical case: programme closure is credible only where it explains commercial sensitivity or internal deliberation may justify temporary limits before the decision, but once learners’ choices are affected, essential information should not be deferred for presentational convenience. A contrary reading would overlook that a programme closure is material to applicants, current learners, staff and communities. The report should identify the programme, decision date, last intake, expected closure date, reason at an appropriate level and population affected.

In assessing analytical case: programme closure, authorities must determine teach-out arrangements should address curriculum, qualified staff, facilities, assessment, support, records and contingencies if numbers fall. A proportionate conclusion must also recognise that transfer may be offered, but should not be described as equivalent unless credit, cost, location, language, timing and learner circumstances have been considered. The central quality question is whether enrolled learners can complete a coherent programme and obtain the intended award.

The central question in analytical case: programme closure is if public policy changes remove funding or authority, the institution should accurately attribute the decision while explaining its own duties. A proportionate conclusion must also recognise that context does not displace responsibility for communication and continuity. If closure follows weak demand, the institution should separate financial rationale from educational quality. If it follows a quality concern, that concern and its effect on current learners are material.

Institutional action on analytical case: programme closure should be tested against an institutional report issued after the closure announcement should state progress, departures from the plan, complaints and unresolved risks. The resulting interpretation should show why historical results for the programme should remain identifiable rather than being absorbed into a new aggregate that conceals the transition. Follow-up should continue until the final affected cohort has completed or reached another recorded outcome.

32

Analytical case: financial uncertainty

The central question in analytical case: financial uncertainty is it should state the basis and date of the assessment and avoid both premature alarm and unsupported reassurance. This matters because an institution may face uncertainty about revenue expected for the next academic year. The fact becomes material when a reasonable possibility exists that programmes, staffing, support, refunds or continuity will be affected. The report should distinguish an early planning pressure from a threat to continue.

In assessing analytical case: financial uncertainty, authorities must determine later changes require a dated update. The resulting interpretation should show why forecasts depend on enrolment, public decisions, exchange rates, donations, costs and other assumptions. The institution should identify the assumptions most capable of changing the conclusion and give a range or scenarios where a single figure would imply false precision. It should distinguish committed funding from applications or negotiations.

The practical standard for analytical case: financial uncertainty concerns a balanced budget achieved by leaving critical vacancies unfilled may preserve accounts while weakening provision. A contrary reading would overlook that financial and quality reporting should therefore be connected. Mitigation may include staged spending, alternative delivery, reserves or support from a responsible entity. The report should explain the educational effect of each measure.

Review of analytical case: financial uncertainty is credible only where it explains governing oversight and direct communication should be visible. A proportionate conclusion must also recognise that confidential negotiation can protect the institution’s interests, but should not become a blanket reason to withhold consequence. The public may not need the terms of an unfinished agreement; affected learners do need to know if a material risk remains, what protections apply and when the position will be reviewed.

33

Analytical case: small groups and privacy

Evidence concerning analytical case: small groups and privacy should establish suppressing the result protects privacy but may hide a severe barrier. The institutional consequence follows from whether the institution should assess identifiability, consequence and alternative forms of evidence. An institution wishes to report completion by disability status in a programme with very few learners. Publication of the count and rate could permit identification, particularly when community knowledge is combined with the report.

analytical case: small groups and privacy cannot be judged without identifying a qualitative account can state that evidence indicates a material disparity, describe the barriers and response, and withhold the number. A proportionate conclusion must also recognise that controlled disclosure to an authorised body may support scrutiny beyond the public report. Combining several years may provide enough observations, though it changes the question and can conceal recent improvement or deterioration. Combining programmes may protect identity but may mix different conditions.

The central question in analytical case: small groups and privacy is the public report should mark suppression and explain the privacy reason. A contrary reading would overlook that blank space is ambiguous and may be read as missing data or zero. Suppression rules should be set before results are known and should address complementary disclosure, in which a hidden cell can be calculated from totals. They should not be manipulated to suppress only unfavourable values.

A defensible account of analytical case: small groups and privacy distinguishes the institution remains responsible for proportionate protection. The resulting interpretation should show why at the same time, privacy should not silence learner representatives from describing systemic barriers in their own terms. Consent does not always resolve the matter. An individual may feel pressure to permit disclosure, and information about a group can affect others who did not consent.

34

Analytical case: cross-border and partner delivery

A defensible account of analytical case: cross-border and partner delivery distinguishes cross-border guidance emphasises reliable information and responsibilities toward learners. A contrary reading would overlook that an institution delivers a programme through a partner in another country. Public information should identify the entities, locations, division of teaching and support, awarding responsibility, applicable programme requirements and routes for complaint and records. A brand name alone is insufficient.[REF-07]

analytical case: cross-border and partner delivery requires a decision about either choice can materially distort. The institutional consequence follows from whether the institution should establish aligned data fields and validation, report coverage and present separate results where delivery conditions differ. Translation should preserve indicator meaning as well as wording. Institution-wide results may exclude the partner because data arrive through a different system, or include it without marking different definitions.

A defensible account of analytical case: cross-border and partner delivery distinguishes it should provide accurate information available from competent public sources and distinguish educational award from permission to practise. For the learners concerned, the decisive consideration is whether where recognition is uncertain, that uncertainty is material before enrolment. Local context matters for fees, access, language, employment and recognition. The institution should not imply that an award has the same legal or professional effect in every jurisdiction.

analytical case: cross-border and partner delivery requires a decision about contractual arrangements may assign operational tasks, but learners need to know who must remedy interruption, lost records, inadequate teaching or closure. The public account remains incomplete unless it explains how reports should state how partner performance is reviewed, material findings, action and unresolved risk without naming another private quality body or borrowing its authority. Responsibility cannot be delegated out of the public account.

35

Confidentiality and legitimate restriction

Confidentiality protects privacy, fair process, security and certain legitimate institutional interests. It should be grounded in an identifiable harm, not discomfort. The decision should ask what information is sensitive, who would be harmed, how likely and serious the harm is, and whether redaction, aggregation, delay or controlled access can preserve public understanding.

Comparative interpretation of confidentiality and legitimate restriction depends upon names are not the only identifiers; programme, date, rare characteristic and event can identify a person in a small community. The evidence must therefore clarify how data minimisation should occur before drafting, not only through removal of names at the end. Personal education, health, disability, employment and complaint records ordinarily require strong protection. The public report should avoid details that permit re-identification through combination with known facts.

In assessing confidentiality and legitimate restriction, authorities must determine the institution can still disclose a material operational risk and protective action. For the learners concerned, the decisive consideration is whether once a finding is made, continued restriction should be reconsidered. The passage of time, completion of proceedings or aggregation may permit fuller reporting. Fair investigations may require temporary confidentiality so witnesses can be heard and allegations are not presented as findings.

Commercial sensitivity needs a narrower interpretation than institutional preference. A supplier’s proprietary method or ongoing negotiation may justify restricted detail. The public purpose, expenditure category, decision process, conflict controls and educational consequence may remain material. A contract term should not prevent the institution from reporting its own failure or risk.

A defensible account of confidentiality and legitimate restriction distinguishes this allows users to understand the boundary without revealing protected content. A proportionate conclusion must also recognise that a governing body should oversee significant restrictions and should be able to show that less restrictive alternatives were considered. The report should disclose the existence of material information withheld, the category of reason and, where possible, the date or condition for review.

36

Corrections, revisions and contested information

Comparative interpretation of corrections, revisions and contested information depends upon the corrected report should be clearly marked, and the prior version should remain available or its substance be described where lawful. The institutional consequence follows from whether errors should be corrected in a way that strengthens, rather than erases, the record. A correction notice should identify the affected report and measure, original publication date, nature of the error, corrected value or statement, reason, date of correction and effect on conclusions.

Revisions differ from errors. Late records may update a provisional completion rate; a new classification may create a revised series; a methodological improvement may change estimates. The report should label provisional, revised and final status and state the expected revision timetable. Users should not interpret routine revision as misconduct, but institutions should monitor unusually large revisions as evidence of process weakness.

The practical standard for corrections, revisions and contested information concerns institutional authority to publish does not make its interpretation the only permissible one. For the learners concerned, the decisive consideration is whether material disagreement may persist even when facts are accurate. Learner representatives may contest the institution’s interpretation of survey evidence; staff may dispute whether a workload measure captures actual demands. The public report should distinguish factual correction from interpretive disagreement and should present a material, evidence-based alternative fairly.

Requests for correction need an accessible route, responsible decision-maker and reasonable time. The institution should record requests, outcomes and recurring issues. Refusal should explain whether the challenged item was accurate, immaterial, opinion, or outside the institution’s authority. A correction process should not be used to intimidate legitimate criticism or require a complainant to prove facts held only by the institution.

37

Communication without distortion

communication without distortion cannot be judged without identifying the scale of a graph should permit honest visual comparison, and colour or order should not imply categorical judgement where results are continuous or uncertain. This matters because headlines, summaries, graphs and media statements often reach more people than the full report. They therefore carry the same duty of material accuracy. A summary should not select a favourable result while omitting a limitation that reverses its meaning.

In assessing communication without distortion, authorities must determine financial values should state currency and whether adjusted for price change. The public account remains incomplete unless it explains how these details can be presented unobtrusively without making the report inaccessible. Percentages should normally be accompanied by counts when scale matters. Relative change should be paired with the underlying rate where a small base could exaggerate. Averages should identify whether they are mean, median or another measure.

For communication without distortion, the material distinction is between institutional explanations should identify their basis. The evidence must therefore clarify how promises should be reserved for authorised commitments with resources and dates; ambitions should not be described as results. The report should avoid superlatives unless the comparison population and method support them. Language should preserve evidential status. “Measured”, “reported”, “estimated”, “associated”, “suggests” and “caused” are not interchangeable.

The central question in communication without distortion is a literal translation can broaden or narrow an indicator, especially terms concerning completion, qualification, teacher status or disability. The resulting interpretation should show why where several language versions are issued, the institution should identify the controlling version and provide a correction route. Communities should not receive materially less information because they use another language. Translation requires review by persons familiar with education and statistical terms.

38

The governing disclosure test

Institutional action on the governing disclosure test should be tested against what uncertainty or missingness could change interpretation. A proportionate conclusion must also recognise that who may be harmed by disclosure or omission. What action follows. Before publication, each material claim should pass a concise test. What legitimate question does it answer. What population and period does it cover. What source supports it. Is the claim no broader than the evidence. What comparison is made and is it valid.

Public responsibility for the governing disclosure test begins with organisations often scrutinise negative findings while allowing positive claims to pass with weak evidence. This matters because symmetry is necessary. If a causal design would be demanded before accepting an adverse claim, the same standard should govern a favourable impact claim. If a small sample is considered unreliable when results disappoint, it is also unreliable when they please. The test should be applied to adverse and favourable information alike.

The practical standard for the governing disclosure test concerns reviewers should ask what a reasonable user would infer and whether undisclosed evidence would materially alter that inference. The public account remains incomplete unless it explains how the institution should particularly examine programmes or groups with weak data, because invisibility can create a false appearance of success. Material omissions should be considered at report level. Every individual statement may be accurate while the total account is misleading because it excludes an entire domain, population or period.

Public responsibility for the governing disclosure test begins with data owners confirm definition and source; responsible educators confirm contextual accuracy; rights or privacy advisers consider legitimate restriction; executive leadership confirms response; the governing body accepts the public account. For the learners concerned, the decisive consideration is whether these roles may be combined in a small institution, but the judgements should remain explicit and challenge should be possible. Approval should confirm responsibility, not merely style.

Part V

Proportionate Institutional Practice

39

A minimum public reporting cycle

The central question in a minimum public reporting cycle is it then establishes definitions before extraction, including populations, periods, disaggregation and suppression. This matters because this order reduces the temptation to define an indicator after seeing the result. The cycle begins by defining purpose and users. The institution identifies recurring decisions and material domains, reviews changes since the prior period and confirms the reporting boundary.

For a minimum public reporting cycle, the material distinction is between validation examines completeness, duplication, unusual movement, reconciliation and meaning. This matters because analysts prepare findings before explanations are finalised, allowing responsible staff and learner or staff representatives to test interpretation without changing the observed result. Collection should reuse reliable records where possible and add enquiry only for questions those records cannot answer.

a minimum public reporting cycle requires a decision about governing review tests the completeness of the account and assigns follow-up. For the learners concerned, the decisive consideration is whether materiality review considers quantitative movement, qualitative events, affected groups and future decisions. Proportionality review selects the detail, timing and form of disclosure, including privacy protection and direct notice. Drafting distinguishes result, interpretation, action and limitation.

The practical standard for a minimum public reporting cycle concerns the institution should record questions, corrections and decisions informed by the report. A contrary reading would overlook that measures that no one can interpret or act upon should be redesigned; measures that reveal repeated risk may require more frequent monitoring. The next cycle begins with this evidence rather than simply advancing the date. Publication is followed by use.

40

Reporting according to scale and risk

The practical standard for reporting according to scale and risk concerns it may combine periods or use qualitative evidence to protect small groups. This matters because direct knowledge can aid interpretation, but it can also weaken independence and confidentiality; documented definitions and governing challenge remain necessary. Lack of a specialist data office does not justify unsupported claims. A small institution can meet the standard through a concise narrative supported by a limited indicator set.

Public responsibility for reporting according to scale and risk begins with the public report can use layered information so readers move from the institution-wide account to relevant distributions without confronting an unstructured data dump. The institutional consequence follows from whether a large institution needs distributed responsibility and common definitions. Programme, campus, mode and learner-group variation are often material. Central totals should reconcile with local records, and material local weaknesses should reach central governance.

Institutional action on reporting according to scale and risk should be tested against attendance, protection, financial continuity or a programme under corrective action may require monthly or termly governance review and more frequent public updates when external decisions are affected. The institutional consequence follows from whether the collection interval, review interval and publication interval need not be identical, but each should fit the consequence. Risk changes frequency. Stable, low-consequence measures may be annual.

For reporting according to scale and risk, the material distinction is between institutions with limited resources should prioritise a small number of material measures and reliable narrative over extensive weak data. The resulting interpretation should show why capacity building should focus on essential disciplines: definitions, record quality, interpretation, privacy, accessible communication and use. Sophisticated software cannot resolve an unclear question or a biased denominator.

41

Participation in reporting

Institutional action on participation in reporting should be tested against participation should occur early enough to affect scope, not only after the report is written. The public account remains incomplete unless it explains how representatives need access to evidence and an opportunity to record a material alternative view. Learners, staff and communities should contribute to the questions asked and the interpretation of findings, especially where administrative data do not describe experience.

Public responsibility for participation in reporting begins with meetings held at one time or in one language may exclude those whose experience is most relevant. For the learners concerned, the decisive consideration is whether institutions should consider accessible formats, confidential routes, representative sampling and support for participation. The purpose is not to obtain endorsement, but to improve the relevance and fairness of the account. Participation must be inclusive.

The practical standard for participation in reporting concerns this creates a record of reason rather than an appearance of consultation. A contrary reading would overlook that expert judgement remains necessary for statistical and legal questions. Participation does not mean that every preferred measure is valid or every allegation is established. The institution should explain why a proposed item was included, modified or excluded where the decision is material.

participation in reporting cannot be judged without identifying repeated requests for information without visible response can reduce trust and participation, weakening the evidence base in subsequent cycles. The resulting interpretation should show why feedback should close the loop. Participants should be able to see what the report concluded, how their evidence was used and what action followed.

42

Using reports for improvement

using reports for improvement requires a decision about it should connect findings to a manageable number of priorities and preserve attention to routine responsibilities not selected as priorities. The resulting interpretation should show why reporting and improvement are connected but distinct. Publication creates visibility; improvement requires diagnosis, authority, resources and sustained action. The report should not imply that acknowledgement itself resolves a matter.

Each response should state the condition to be changed, the action, responsible role, timing and evidence that will test progress. Process indicators can show whether implementation occurred, while outcome indicators show whether the condition changed. Both may be needed. If expected improvement does not occur, the institution should revisit the causal assumption rather than repeat the activity indefinitely.

Comparative interpretation of using reports for improvement depends upon pressure to raise completion may weaken assessment standards or discourage admission of learners needing support. A proportionate conclusion must also recognise that efforts to reduce complaints may make the procedure harder to use. A balanced measure set and qualitative enquiry can identify displacement. Governing review should reward honest identification of such effects rather than only target attainment. Unintended effects should be monitored.

For using reports for improvement, the material distinction is between long-term change may require several reporting cycles; interim milestones should remain connected to the final educational purpose. The resulting interpretation should show why public follow-up should be proportionate to the original finding. A material commitment in one report should not vanish from the next because attention has moved. The later account should state completion, evidence, delay or revision.

43

Limits of standardisation

The practical standard for limits of standardisation concerns standardisation should secure a comparable core while permitting relevant additions and explanation. For the learners concerned, the decisive consideration is whether common definitions support comparison and reduce burden, particularly for enrolment, finance and completion. International classifications and technical handbooks provide a valuable basis. Yet a common field can conceal different local practices, and a universal set may omit matters central to a particular mission or community.[REF-02] [REF-12]

The central question in limits of standardisation is they should be examined through appropriate evidence rather than excluded. A contrary reading would overlook that conversely, difficulty of measurement should not permit vague assurance; the institution should show what it observed and how judgement was reached. The mere availability of a benchmark should not dictate institutional priorities. Some important qualities, including respect, intellectual challenge, participation and responsiveness, are difficult to represent in one number.

The central question in limits of standardisation is reports should answer the actual institutional question, identify concrete findings and vary depth according to consequence. This matters because a form should timely evidence and limitation, not supply conclusions in advance. Governing readers should be alert to unchanged text where circumstances have changed. Standard forms can promote completeness but can also generate interchangeable prose.

Review of limits of standardisation is credible only where it explains institutions should use common classifications where fit, explain departures and consider comparable research. The resulting interpretation should show why the London Communiqué affirms mobility, recognition, the social dimension and public responsibility within higher education reform. These aims require information that can travel across boundaries while retaining enough context to remain true. Local relevance should not become isolation from wider evidence.[REF-06]

44

Interpretive conclusions

interpretive conclusions cannot be judged without identifying both are judged from the perspective of legitimate public understanding and institutional responsibility. This matters because materiality and proportionality provide a coherent basis for public reporting when applied together. Materiality prevents the institution from hiding consequential information among trivial detail or omitting it because few people are affected. Proportionality prevents the response from becoming indiscriminate disclosure, excessive burden or misleading precision.

The central question in interpretive conclusions is it marks uncertainty, missing data and breaks in series. A contrary reading would overlook that it distinguishes observation, interpretation and intended response. The minimum account identifies the institution, authority, purpose, programmes and population; addresses access, learning, completion, experience, staff, resources, equity, finance, governance and risk; and explains material changes. It gives every measure a definition, population, period, source and limitation.

interpretive conclusions cannot be judged without identifying it directs attention to what the evidence can establish and to what the institution must still learn. The institutional consequence follows from whether where evidence is missing, the absence and its consequence are part of the finding. Comparison is subordinate to validity. A report should decline an invalid rank, an unaligned peer comparison or a causal claim unsupported by design. Restraint does not weaken accountability.

Evidence concerning interpretive conclusions should establish confidentiality should protect them without erasing institutional responsibility. For the learners concerned, the decisive consideration is whether equitable reporting should make material differences visible and direct attention to barriers, while avoiding stigma and unsupported attribution. Rights set boundaries and obligations. Learners and staff should not be exposed through small cells, personal cases or careless narrative.

Evidence concerning interpretive conclusions should establish the quality of reporting therefore lies not in the volume of disclosed data, but in the disciplined relationship among public consequence, evidence, explanation, protection and responsibility. For the learners concerned, the decisive consideration is whether public reporting is complete only when it informs action and preserves a record. Timely exceptional notices, dated corrections, governing response and follow-up enable users to see how the institution handles weakness as well as success.

Part VI

Judgement Rules for Recurrent Questions

45

Whether to report a matter

Evidence concerning whether to report a matter should establish the institution should identify the affected decision, the persons exposed to consequence, the scale and duration, and the strength of evidence. The resulting interpretation should show why a matter need not be certain to be material. Where uncertainty itself bears on continuity, safety or entitlement, the report should state the uncertainty and the means of resolving it. The first judgement is not whether information is favourable, but whether it changes a legitimate understanding.

The central question in whether to report a matter is several short delays, isolated marking errors or small equipment failures may reveal a control weakness. The public account remains incomplete unless it explains how the review should therefore consider both individual events and cumulative pattern. Conversely, many records produced by a new logging system may reflect improved observation rather than increased incidence. The report should explain this distinction rather than select the interpretation most favourable to the institution. Repetition can make an otherwise minor matter material.

Evidence concerning whether to report a matter should establish “Not required” or “not normally published” does not answer whether the matter is material in the present circumstances. This matters because significant omission decisions should be documented and reviewed by a person with authority independent of the result’s owner. The public account should disclose a restricted material matter at the highest level consistent with legitimate protection. Omission requires a reason tied to relevance, privacy, reliability or proportionate burden.

46

How much detail to provide

Public responsibility for how much detail to provide begins with a single total may suffice for a stable low-risk measure. A contrary reading would overlook that programme, site or learner-group detail becomes necessary when the total conceals a material difference. Record-level detail is rarely appropriate in a public quality report because it increases privacy risk without improving the institutional conclusion. Detail should enable a reasonable user to understand the nature, scale, distribution, period and response.

how much detail to provide requires a decision about the visible account should still state any limitation that could change the conclusion. A proportionate conclusion must also recognise that the report should provide enough methodological information to test the principal inference. Readers need not see every data-cleaning instruction, but they should know definitions, source, coverage and important judgement. A supporting definition register may carry recurring technical detail if it is accessible and versioned.

Evidence concerning how much detail to provide should establish the main account supplies context and distributions. The institutional consequence follows from whether linked supporting material provides definitions and additional results. This structure should not bury adverse information several levels below a favourable headline. Navigation and cross-reference are part of proportionate disclosure because inaccessible evidence is not meaningfully public. Layering can reconcile different needs. The opening summary identifies material findings and actions.

47

When qualitative disclosure is sufficient

Qualitative reporting is appropriate where the question concerns process, experience, meaning or a small group for which a stable public number would mislead. It should identify the evidence considered, selection, range of views and method of interpretation. A narrative assertion without source or scope is not made reliable merely by avoiding numbers.

A defensible account of when qualitative disclosure is sufficient distinguishes repeated documented accounts of inaccessible teaching materials may establish a barrier even when the affected population is not precisely counted. The evidence must therefore clarify how the report should state what is established, what scale remains unknown and what action is justified. It should not postpone protection until a statistically complete study can be conducted. A qualitative finding can be material and firm.

The central question in when qualitative disclosure is sufficient is programme records may show withdrawal, while learner accounts identify timetable or support barriers. For the learners concerned, the decisive consideration is whether the report should preserve differences between sources and avoid forcing them into a single score. Numbers can complement rather than displace narrative. Waiting-time data may show scale, while interviews explain why learners abandon a service.

48

When comparison should be withheld

The central question in when comparison should be withheld is this is more informative than a false league position and more candid than suppressing the underlying evidence. The institutional consequence follows from whether a comparison should be withheld when differences in definition, population, programme, period or coverage are capable of reversing the apparent conclusion and cannot be reconciled. The institution may still report each result separately and explain why no direct comparison is made.

The practical standard for when comparison should be withheld concerns it should not substitute a different favourable comparison that suffers from the same weakness. A proportionate conclusion must also recognise that comparison should also be withheld where a peer group was selected after observing results, where missing data affect institutions differently or where small numbers make ranks unstable. If external users are already making the comparison, the institution should explain its defect with concrete reasons.

Review of when comparison should be withheld is credible only where it explains the desire for a long trend does not authorise estimated values presented as observed facts. A proportionate conclusion must also recognise that when comparability improves later, the institution can introduce a series prospectively or calculate an overlap. Historical reconstruction should preserve source limitations.

49

How to report thresholds

Comparative interpretation of how to report thresholds depends upon the report should state their authority and purpose. A proportionate conclusion must also recognise that a legal or programme requirement differs from an internal warning level, and neither should be described as a statistical average. The consequence of crossing the threshold should be clear. Thresholds can mark minimum capacity, trigger review or define entitlement.

For how to report thresholds, the material distinction is between a displayed value of eighty per cent may lie above or below a rule set at the same point depending on unrounded data. A proportionate conclusion must also recognise that sample estimates may not support a binary conclusion. The institution should apply the authorised rule consistently and disclose the measurement limitation where it could affect action. Results close to a threshold require attention to uncertainty and rounding.

how to report thresholds cannot be judged without identifying the report should avoid using compliance with one threshold to imply quality across unrelated domains. For the learners concerned, the decisive consideration is whether a threshold does not make information on distance and distribution irrelevant. Barely meeting a minimum differs from sustained strong performance, while failure concentrated in one group may require a different response from a small general decline.

50

How to describe targets

The central question in how to describe targets is the rationale may derive from minimum entitlement, prior trend, available resources or a planned intervention. A proportionate conclusion must also recognise that an ambitious round number without a credible path can create presentational pressure rather than improvement. A target expresses an intended future level under defined conditions. It should have a baseline, measure, population, date and responsible decision.

Public responsibility for how to describe targets begins with where circumstances change, a target may properly be revised, but the original, reason, approval date and effect should remain visible. The institutional consequence follows from whether progress should show the actual result alongside the target and explain material deviation. Institutions should not report only the fraction of actions completed or replace an unmet outcome target with a new activity measure.

Comparative interpretation of how to describe targets depends upon a target is useful when it directs effort toward the public purpose without displacing rights or distorting the evidence. The public account remains incomplete unless it explains how targets can produce exclusion or gaming when rewards attach narrowly to them. The institution should monitor assessment standards, entry decisions, reclassification and unreported groups.

51

How to report contextual factors

Evidence concerning how to report contextual factors should establish relevant factors may include prior learning, economic conditions, geography, language, public financing, transport, demographic change or emergency interruption. This matters because the report should use evidence rather than stereotype and should state which factors the institution can influence. Context should be included when it materially affects interpretation or response.

Public responsibility for how to report contextual factors begins with adjusted results depend on models and available variables and can conceal the actual experience of learners. A proportionate conclusion must also recognise that they should therefore accompany observed results, with method and assumptions, not replace them. Context should not be asymmetrical. If an institution adjusts an adverse outcome for learner composition, it should apply the same discipline to favourable outcomes.

The practical standard for how to report contextual factors concerns distance may explain low participation in an evening service, but the institutional question concerns scheduling, remote access or transport partnership. For the learners concerned, the decisive consideration is whether a report that ends with context can sound like excuse; one that ignores context can prescribe an ineffective response. The most useful contextual explanation connects circumstance to action.

52

How to represent uncertainty to the public

For how to represent uncertainty to the public, the material distinction is between such wording communicates consequence more effectively than unexplained statistical notation. For the learners concerned, the decisive consideration is whether uncertainty can be stated plainly. The institution can say that a sampled estimate is likely to fall within a range, that missing records may make a result too high, or that the available evidence cannot distinguish two explanations.

In assessing how to represent uncertainty to the public, authorities must determine rounding is appropriate when it does not alter a threshold or hide scale. The institutional consequence follows from whether where the exact count is sensitive, a range or qualitative descriptor may be safer, provided it is defined and not chosen to minimise the issue. Precision should follow evidence. Excess decimal places, narrow categories and exact forecasts may create unwarranted confidence.

Evidence concerning how to represent uncertainty to the public should establish high potential consequence may justify precaution while evidence develops. A contrary reading would overlook that lower consequence may justify continued monitoring. The report should state the basis, next information expected and review date, enabling users to understand both the finding and the institution’s tolerance of risk. The action taken under uncertainty should also be visible.

53

How to report absence of evidence

Review of how to report absence of evidence is credible only where it explains no formal complaints may mean no dissatisfaction, inaccessible procedures or incomplete records. A proportionate conclusion must also recognise that no recorded disability may mean no disabled learners or limited disclosure. The institution should examine the collection route before presenting zero as a quality result. Absence of a recorded event is not necessarily evidence that the event did not occur.

Where evidence was not collected, the report should say so and explain the implication. A new programme may not yet have completion data; a recent graduate survey may not support employment claims; partner records may be incomplete. The institution may provide process or interim evidence, but it should not substitute these for an unavailable outcome.

Public responsibility for how to report absence of evidence begins with a missing peripheral field may be removed from the framework. The evidence must therefore clarify how missing evidence on a central learner entitlement requires a collection plan, responsibility and date. Persistent inability to know a material condition is itself an institutional risk and should reach governance. The response to an evidence gap depends on materiality.

54

How to close the reporting period

how to close the reporting period cannot be judged without identifying it should confirm known limitations and outstanding corrections without asserting an unattainable guarantee that every record is error-free. The resulting interpretation should show why responsibility is demonstrated by the controls applied and readiness to correct. The closing statement should identify the period covered, the date through which material subsequent events were considered and the authority approving the account.

The practical standard for how to close the reporting period concerns where an action is discontinued, the institution should state why and what replaces it, if anything. A contrary reading would overlook that closure of reporting is not closure of unresolved risk. Outstanding actions should carry forward with stable identifiers or clear descriptions. The next report should not require users to reconstruct whether a commitment was completed.

In assessing how to close the reporting period, authorities must determine definitions, source extracts, approvals and correction history enable later explanation. The resulting interpretation should show why retention should protect personal information and should not keep identifiable data longer merely because aggregate public reporting may recur. Records supporting the report should be retained according to lawful and proportionate requirements.

55

Reporting new or changing programmes

reporting new or changing programmes cannot be judged without identifying statements about expected outcomes should be identified as expectations, grounded in a reasoned design rather than presented as achieved quality. The evidence must therefore clarify how new provision has no established outcome series, but it is not beyond public reporting. Before enrolment, the institution should disclose intended curriculum, entry, staffing, facilities, delivery, award, cost and arrangements for monitoring the first cohort.

reporting new or changing programmes cannot be judged without identifying they can identify whether the programme is operating as represented and whether protection is needed while outcome evidence accumulates. A proportionate conclusion must also recognise that early monitoring should focus on conditions visible before completion: recruitment against planned capacity, staffing, access to required resources, learner participation, assessment operation, support and emerging complaints. These measures do not substitute for later learning and completion evidence.

The practical standard for reporting new or changing programmes concerns once cohorts mature, the reporting framework should replace projections with observed results and retain the early record for comparison. The resulting interpretation should show why material deviation from the approved design should be reported. A different site, reduced practice opportunity, delayed specialist appointment or altered award arrangement may affect a learner’s decision even if managers consider it temporary. The institution should state the change, consequence, duration and remedy.

56

Reporting improvement after failure

In assessing reporting improvement after failure, authorities must determine if it concerned unequal completion, an institution-wide rise may not show that the disparity narrowed. This matters because the closure measure should correspond to the affected population and mechanism. Evidence of improvement should be welcomed but tested against the original failure. If a finding concerned delayed feedback, evidence should address timeliness and educational usefulness, not simply publication of a new policy.

Public responsibility for reporting improvement after failure begins with the institution should present enough prior observations and contextual evidence to support the conclusion. The institutional consequence follows from whether where only one later observation exists, “initial improvement” is more accurate than “sustained resolution”. Regression toward ordinary variation can resemble improvement after an unusually poor period. Changes in population, programme boundary or data cleaning can also raise a reported result.

Public responsibility for reporting improvement after failure begins with improvement is credible when evidence converges and the institution continues monitoring after formal closure. The evidence must therefore clarify how the report should recognise costs and unintended consequences. Faster feedback achieved through less substantive comments may meet a time target while weakening value. Higher completion obtained through reduced assessment demand may undermine the programme purpose. Learner work, moderation, experience and distribution should be considered alongside the headline measure.

57

Reporting institutional diversity

In assessing reporting institutional diversity, authorities must determine the precise evidence and expected pattern may differ because the educational purpose differs. The institutional consequence follows from whether institutions differ in mission, scale, learner population and setting. Public reporting should make these differences intelligible without turning them into immunity from common questions. All institutions should show whether learners can access suitable education, learn, progress safely and receive fair treatment.

The practical standard for reporting institutional diversity concerns they should be described with evidence and connected to the institution’s duties, not offered as general explanations for every weak result. The public account remains incomplete unless it explains how a specialist programme may have small cohorts and costly resources; an open-access institution may enrol learners with varied preparation; a remote provider may serve communities facing transport and staffing constraints. Such characteristics affect indicator selection, comparability and response.

Public responsibility for reporting institutional diversity begins with diversity is consistent with accountability when the report explains what quality means for the stated purpose and provides evidence that the purpose is being fulfilled fairly. The evidence must therefore clarify how comparison within mission can improve relevance, but no peer group is perfect. Institutions should also examine minimum requirements, their own trend and distributions within the population.

58

Reporting the social dimension

Institutional action on reporting the social dimension should be tested against it does not prescribe a single demographic indicator across all countries. The public account remains incomplete unless it explains how the London ministerial commitments place continuing emphasis on widening participation, mobility and the social dimension of higher education. At institutional level, this calls for evidence that entry, participation and successful completion are not restricted by avoidable social or economic barriers.[REF-06]

In assessing reporting the social dimension, authorities must determine a stable enrolment share can conceal higher withdrawal, while an improved completion rate can coexist with more selective entry. A contrary reading would overlook that reporting across the pathway prevents one favourable stage from standing for the whole experience. Institutions should examine the stages at which inequality can arise: information, application, admission, enrolment, attendance, progression, completion and movement into further opportunities.

Public responsibility for reporting the social dimension begins with public reporting should connect observed barriers, affected groups, institutional action and results, while recognising that wider public policy also shapes opportunity. The institutional consequence follows from whether support measures should be assessed by reach and timing as well as existence. Assistance arriving after a fee deadline may not prevent exclusion. Academic support offered only during working hours may not serve employed learners.

59

Reporting information for learner choice

The central question in reporting information for learner choice is programme title, award, entry, curriculum, delivery, expected duration, total compulsory charges, support, material placement requirements and likely timetable should be accurate for the intended cohort. The institutional consequence follows from whether historical outcomes should identify the cohort and should not be presented as a guarantee. Information used before enrolment deserves particular scrutiny because the learner cannot yet observe institutional conditions directly.

Review of reporting information for learner choice is credible only where it explains a general reservation that details may change does not excuse a material alteration without explanation. The resulting interpretation should show why choice information should disclose conditions capable of preventing participation or completion: required travel, equipment, language, attendance, practice placement, technology or health and safety obligations where relevant. Important changes should reach applicants before acceptance and enrolled learners through direct notice.

Evidence concerning reporting information for learner choice should establish the report should not imply that an educational award ensures employment, immigration status, recognition or entry to a regulated activity unless the relevant competent authority and conditions establish that effect. For the learners concerned, the decisive consideration is whether employment or progression information should distinguish institutionally verified outcomes, survey responses and illustrative destinations. Response and reference period matter, and labour-market conditions limit attribution.

60

A final public-interest test

In assessing a final public-interest test, authorities must determine if a technically correct report leaves these questions unanswered, it has not yet discharged its public purpose. The public account remains incomplete unless it explains how before issue, the institution should read the report from the position of a learner who must act on it. Can that reader identify who is responsible, what education is offered, what it costs, what evidence exists about learning and completion, which groups experience different conditions, and what material risk remains. Can the reader distinguish an observed result from an explanation and a promise.

a final public-interest test requires a decision about staff need to see whether professional conditions and warnings are represented accurately. The public account remains incomplete unless it explains how governing members need a complete account of material weakness and follow-up. Communities need to understand access, continuity and use of entrusted resources. These perspectives may reveal omissions that a data-led review misses, though each proposed addition must still meet relevance, evidence and privacy requirements. The same test should be applied from the position of staff, governing members and communities.

A defensible account of a final public-interest test distinguishes provisional favourable results should not be highlighted while provisional adverse results are deferred. A contrary reading would overlook that consistent treatment is part of impartial reporting and can be tested directly across the document. Review should pay special attention to asymmetry. Favourable change should not receive a confident causal explanation while adverse change receives lengthy contextual qualification. Small groups should not be displayed when their results are strong and suppressed when weak.

Institutional action on a final public-interest test should be tested against a rate without counts may exaggerate scale; an average may conceal distribution; a current status may be mistaken for the whole reporting period; an adjusted result may appear observed; a target may appear achieved; an internal judgement may appear to carry public authority. For the learners concerned, the decisive consideration is whether clear labels and short explanations can prevent these errors without expanding the report unnecessarily. The institution should then ask what a reader could misunderstand.

A defensible account of a final public-interest test distinguishes reporting that ends at publication cannot demonstrate accountability because it does not show whether evidence changed decisions or whether decisions changed educational conditions. This matters because finally, the institution should ask what happens next. Every material unresolved finding needs a responsible route, timing and evidence for review. Every exceptional commitment needs later public follow-up. Every correction needs a preserved date and explanation.

a final public-interest test cannot be judged without identifying together they give practical meaning to materiality and proportionality across institutions whose missions and capacities differ. For the learners concerned, the decisive consideration is whether these questions do not create a uniform format. They establish the qualities by which different formats can be judged: relevance to legitimate decisions, candour about consequence, sufficiency of evidence, fair comparison, visible uncertainty, protection of persons, accessible explanation and traceable responsibility.

Public responsibility for a final public-interest test begins with periodic review should ask whether each indicator still responds to the quality question, whether those most affected can recognise their experience in it, and whether a different source would reveal conditions hidden by routine aggregation. The institutional consequence follows from whether an institution should also examine the silence surrounding apparently stable results. Stability may represent sustained good practice, but it may reflect an insensitive measure, an unchanged exclusion or a reporting system unable to detect variation.

The public account should preserve institutional memory. Leadership, staff, programme structures and information systems change, while learners may remain affected by decisions made several years earlier. Definitions, commitments and unresolved findings should therefore pass across organisational transitions. A new name or structure should not sever responsibility for a continuing programme, a correction or a promised remedy. Continuity of the public record is part of continuity of educational obligation.

Materiality finally requires judgement, not mechanical compliance. Published indicators, reporting calendars and threshold rules support consistency, yet unusual circumstances will arise beyond them. The responsible decision-maker should be able to explain why an item was included, restricted, delayed or omitted, what evidence informed that choice and how competing harms were weighed. Reasons make discretion reviewable and help later decisions improve. Where reasons cannot withstand public explanation, the disclosure decision should be reconsidered.

The discipline is completed by restraint. A report should not claim international comparability merely because it uses familiar terms, nor institutional excellence because selected results are favourable. It should not imply that disclosure transfers responsibility to the reader. The institution remains accountable for lawful provision, educational conditions, fair decisions and remedies. Public information enables scrutiny and choice; it does not require learners to diagnose hidden defects or accept risks that the institution could reasonably prevent. A clear report therefore states consequences, not only data, and directs affected people to usable assistance. It makes uncertainty visible without allowing uncertainty to become paralysis. Above all, it treats reporting as part of education governance: evidence is gathered, interpreted, reviewed by responsible governors, communicated broadly and revisited until the material matter is resolved or its status is recorded.

References

  1. REF-01

    Organisation for Economic Co-operation and Development. Education at a Glance 2006: OECD Indicators. 2006.

    Comparative education indicators, definitions, institutional and system context, and cautions governing international comparison.

    https://doi.org/10.1787/eag-2006-en
  2. REF-02

    Organisation for Economic Co-operation and Development. OECD Handbook for Internationally Comparative Education Statistics: Concepts, Standards, Definitions and Classifications. 2004.

    Definitions, classifications, coverage rules and methodological conditions for comparable education statistics.

    https://doi.org/10.1787/9789264104112-en
  3. REF-03

    UNESCO Institute for Statistics. Global Education Digest 2006: Comparing Education Statistics Across the World. 2006.

    Internationally comparable education data and the metadata needed to interpret participation, progression and completion measures.

    https://uis.unesco.org/sites/default/files/documents/global-education-digest-2006-comparing-education-statistics-across-the-world-en_0.pdf
  4. REF-04

    Education for All Global Monitoring Report Team. Education for All: The Quality Imperative — EFA Global Monitoring Report 2005. 2004.

    A broad conception of education quality, evidence on learning conditions and outcomes, and cautions against reducing quality to a single measure.

    https://unesdoc.unesco.org/ark:/48223/pf0000137333
  5. REF-05

    Education for All Global Monitoring Report Team. Education for All Global Monitoring Report 2007: Strong Foundations — Early Childhood Care and Education. 2006.

    Evidence on access, equity, quality, staffing and governance in early childhood provision, including limits of available institutional information.

    https://unesdoc.unesco.org/ark:/48223/pf0000147794
  6. REF-06

    European Ministers responsible for Higher Education. Towards the European Higher Education Area: Responding to Challenges in a Globalised World — London Communiqué. 2007.

    Contemporaneous ministerial commitments concerning mobility, recognition, qualifications information, the social dimension and public responsibility in higher education.

    https://ehea.info/Upload/document/ministerial_declarations/2007_London_Communique_English_588697.pdf
  7. REF-07

    UNESCO and OECD. Guidelines for Quality Provision in Cross-border Higher Education. 2005.

    Responsibilities for reliable information, transparency, learner protection and public confidence in cross-border provision.

    https://unesdoc.unesco.org/ark:/48223/pf0000143395
  8. REF-08

    United Nations General Assembly. Fundamental Principles of Official Statistics. 1994. E/RES/1994/29.

    Principles of relevance, impartiality, professional methods, transparent sources and correction of misuse in public statistics.

    https://unstats.un.org/unsd/dnss/gp/fundprinciples.aspx
  9. REF-09

    United Nations Committee on Economic, Social and Cultural Rights. General Comment No. 13: The Right to Education. 1999. E/C.12/1999/10.

    The availability, accessibility, acceptability and adaptability framework and the public-interest basis of education accountability.

    https://www.refworld.org/legal/general/cescr/1999/en/37937
  10. REF-10

    United Nations General Assembly. Convention on the Rights of the Child. 1989. A/RES/44/25.

    Rights concerning non-discrimination, best interests, participation, development and the aims of education.

    https://www.ohchr.org/en/instruments-mechanisms/instruments/convention-rights-child
  11. REF-11

    World Education Forum. The Dakar Framework for Action: Education for All — Meeting Our Collective Commitments. 2000.

    Commitments to equitable access, measurable learning outcomes, quality, participation and accountable monitoring.

    https://unesdoc.unesco.org/ark:/48223/pf0000121147
  12. REF-12

    UNESCO. International Standard Classification of Education: ISCED 1997. 1997.

    Contemporary classification of education levels and programmes and the limits of using statistical categories as quality judgements.

    https://uis.unesco.org/sites/default/files/documents/international-standard-classification-of-education-1997-en_0.pdf
  13. REF-13

    World Bank. Ten Steps to a Results-Based Monitoring and Evaluation System: A Handbook for Development Practitioners. 2004.

    Guidance on indicators, baselines, data collection, analysis, reporting and use of monitoring evidence.

    https://documents.worldbank.org/curated/en/638011468766181874/
  14. REF-14

    United Nations Development Programme Evaluation Office. Handbook on Monitoring and Evaluating for Results. 2002.

    Results-oriented monitoring, stakeholder participation, evidence interpretation and organisational learning.

    https://web.undp.org/evaluation/documents/handbook/me-handbook.pdf
  15. REF-15

    European Commission, Council of Europe and UNESCO. Diploma Supplement: Explanatory Notes and Standard Model. 1997.

    A structured model for communicating the nature, level, context, content and status of completed studies without making equivalence claims.

    https://education.ec.europa.eu/education-levels/higher-education/inclusive-and-connected-higher-education/diploma-supplement
  16. REF-16

    International Labour Organization and UNESCO. Recommendation concerning the Status of Teachers. 1966.

    Principles concerning teacher preparation, professional responsibility, consultation, conditions of work and continuing education.

    https://www.unesco.org/en/legal-affairs/recommendation-concerning-status-teachers
  17. REF-17

    UNESCO. Guidelines for Inclusion: Ensuring Access to Education for All. 2005.

    A framework for identifying barriers to presence, participation and achievement and for interpreting differences among learner groups.

    https://unesdoc.unesco.org/ark:/48223/pf0000140224
  18. REF-18

    Organisation for Economic Co-operation and Development. School Factors Related to Quality and Equity: Results from PISA 2000. 2005.

    Evidence on associations among school context, resources, climate, selection and student outcomes, with limitations on causal interpretation.

    https://doi.org/10.1787/9789264008199-en
  19. REF-19

    Organisation for Economic Co-operation and Development. Learning for Tomorrow's World: First Results from PISA 2003. 2004.

    Comparative learning measures, contextual questionnaires, sampling and uncertainty relevant to responsible public interpretation.

    https://doi.org/10.1787/9789264006416-en
  20. REF-20

    United Nations Educational, Scientific and Cultural Organization. Recommendation concerning the Status of Higher-Education Teaching Personnel. 1997.

    Principles concerning academic responsibility, institutional accountability, participation, employment conditions and professional autonomy.

    https://www.unesco.org/en/legal-affairs/recommendation-concerning-status-higher-education-teaching-personnel