{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-406c23ce9497eccf","slug":"2017-02-16-measuring-public-performance-reporting-across-education-systems","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2017-02-16","last_modified_date":"2017-02-16","title":"Measuring public performance reporting across education systems","summary":"Reviews measuring public performance reporting across education systems and identifies the conditions required for sound interpretation, responsible comparison and defensible.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"2017 accountability agenda","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["In 2017, consideration of public performance reporting must take account of the 2017 accountability agenda and the responsibilities it places before education systems. For the available evidence, the principal analytical task is to separate an observed difference from a conclusion about its cause. Assessment should consider learner impact, institutional accountability and stewardship of entrusted resources. Uniform administrative form is not required where equivalent public outcomes can be demonstrated.","Responsibility for the analysis should be visible at the point where consequential decisions are made. For the comparison, where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. In relation to measuring public performance reporting across education systems, incomplete evidence, unmanaged conflict, absent learner groups or material learner impact require a higher level of review."]},{"heading":"Evidence and method","paragraphs":["The historical reference basis is the 2017 accountability agenda. Its relevance to public performance reporting should be assessed against the affected jurisdiction, learner population and form of provision.","The quality significance of the comparison follows from a basic distinction between availability and effective provision. the analysis proceeds on the basis that governing bodies should receive sufficient, reliable and timely information to oversee education quality, learner protection and material institutional risk. Review should cover the stages at which learners receive information, provision, assessment, support and remedy."],"bullets":["Verify corrective action independently.","Define information required for oversight.","Escalate material exceptions.","Preserve a traceable decision record.","Separate incompatible responsibilities."]},{"heading":"Patterns requiring examination","paragraphs":["The technical issue within public performance reporting concerns the basis on which a conclusion is reached. In reviewing the analysis, public information should be accurate, current, complete in relation to material matters and presented before a learner is required to make a consequential commitment. Qualifications and limitations should receive comparable prominence to the principal claim. The judgement should state its supporting evidence and any condition limiting application to the declared scope.","Failure in relation to the issue may arise even where the stated policy is reasonable. Material concerns include management assurance accepted without testing, material risks omitted from reporting, authority assigned without accountability, and conflicts not identified. An exception should be assessed by effect, duration, recurrence and reach, including possible exposure beyond the initial sample.","Assurance of the analysis should draw on more than one form of evidence. Useful records include corrective-action verification, public reports reconciled with controlled records, independent review records, governing-body papers and decisions, and risk and assurance plans. In relation to measuring public performance reporting across education systems, policy and records should be tested against actual practice, including evidence from learners where appropriate. A positive example may illustrate operation, but it cannot demonstrate coverage or consistency."],"bullets":["Can it be reconciled with the controlled source?","Are corrections prompt and traceable?","Who approves changes?","Is the information available before commitment?","Does it identify material conditions and limitations?"]},{"heading":"Implications for decision-makers","paragraphs":["Implementation of public performance reporting can be tested without imposing unnecessary reporting. In reviewing the analysis, responsible bodies should identify material information across the learner journey, assign source ownership, reconcile public statements with controlled records and retain corrections. Test whether a reasonable user can understand status, cost, obligations, support and routes for redress. Existing records may be used if reliable and relevant, but data collected for another purpose may not answer the assurance question.","The analytical record for the issue should state the research question, data source, unit of analysis, reference period, coverage, exclusions, treatment of missing values and principal limitations.","The analysis of the comparison should remain within the limits of the evidence. the analysis proceeds on the basis that association should not be presented as causation, and statistical significance should not be treated as evidence of educational importance without further analysis. A decision concerning the analysis should recognise that governance structures do not provide assurance merely because committees exist. Membership, information quality, challenge, decisions and follow-through determine whether oversight is effective. Decision-makers should not extend assurance beyond the point supported by the available evidence.","The assurance record for the comparison should retain the date of the evidence, the source responsible for it, the scope examined and the version of any instrument or definition applied. Traceable source and version information allow genuine improvement to be distinguished from administrative revision. A superseded conclusion should be retained where it formed the basis of a material decision.","Public reporting on the issue should distinguish established fact, analytical judgement and planned action. Changes to definitions or evidence should be recorded separately from changes in educational performance.","Neither one indicator nor one control can establish the complete position on the analysis."]}],"word_count":756,"content_hash":"sha256-a2cc8228f3a75003508196c7af11c14f71f72da3b315be05358c83a27546b455","seo_keywords":["measuring public performance reporting across education systems","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}