{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-a5d7ba3f2003437e","slug":"2018-12-28-online-assessment-privacy-definitions-and-comparability","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2018-12-28","last_modified_date":"2018-12-28","title":"Online assessment privacy: definitions and comparability","summary":"Examines online assessment privacy: definitions and comparability, defining the evidence base, coverage and limits that should govern comparison and use of the findings.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"Digital assessment and data protection","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The policy and evidence context for online assessment privacy has been materially shaped by the digital assessment and data protection. For the available evidence, the value of the present data lies in the questions it can answer reliably and in the limits it makes visible.","The governing expectation for the available evidence should be capable of consistent application. Oversight of the issue should reflect the principle that where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. In relation to online assessment privacy, terms governing eligibility, support, assessment, reporting or review should prevent materially different treatment without recorded justification."]},{"heading":"Evidence and method","paragraphs":["The reference basis—the digital assessment and data protection—is evidential rather than self-executing. The material may reveal patterns or evidential gaps, but it neither directs a legal outcome nor establishes causation. In applying it to online assessment privacy, users should review the source definitions, population coverage, reference period and stated limitations before transferring a system-level finding to an individual provider or learner group.","A focused examination of the analysis requires a clear analytical discipline. In this case, comparison requires more than the use of a common label. Definitions, reference periods, population coverage, institutional boundaries and collection practices must be sufficiently aligned for the observed difference to have a stable meaning.","Risk assessment of the measure should give particular attention to secondary use without adequate authority, collection without a defined educational or legal purpose, and excessive access to learner information. A provider should also consider inaccurate data affecting decisions and uncontrolled supplier access or transfer.","Assurance of the measure should draw on more than one form of evidence. Useful records include a register of information assets and purposes, role-based access and access reviews, data-quality and correction controls, retention and secure disposal evidence, and incident response and notification records. A positive example may illustrate operation, but it cannot demonstrate coverage or consistency."]},{"heading":"Patterns requiring examination","paragraphs":["For operational review of online assessment privacy, authorities and providers should proceed in a defined sequence. Review of the issue should prepare a comparability table before analysing results. Record common elements, material differences, breaks in series and the direction in which each limitation may affect the conclusion; do not rank systems where those limitations remain material.","Decisions concerning the comparison should remain traceable to the information available for the stated reference period. In relation to online assessment privacy, a revision should state whether the change concerns the underlying condition, the evidence, the method or the interpretation. Transparent treatment of reporting changes prevents artificial movement from being read as substantive progress or decline."],"bullets":["Is the remaining difference educationally material?","Do the reference periods align?","Are the populations defined on the same basis?","Has a classification changed?","Are exclusions and missing records comparable?"]},{"heading":"Implications for decision-makers","paragraphs":["Where online assessment privacy involves partners, suppliers or several public bodies, responsibility should be mapped across the complete service. Agreements should allocate information exchange, incident escalation, learner communication, record custody and corrective authority. Multiple delivery partners do not justify fragmented accountability or remedy.","Publication of findings on the measure should distinguish observed values, estimates and interpretation."],"bullets":["Assign accountable data owners.","Provide accessible correction and complaint routes.","Control third-party processing, with responsibility, scope and timing recorded.","Test incident and recovery arrangements before using it to determine a learner or provider outcome.","Limit and review access."]},{"heading":"Limits of inference","paragraphs":["The central objective should not be obscured by the form of the administrative response. The analysis of online assessment privacy proceeds on the basis that education information should be collected for a defined purpose, protected in proportion to its sensitivity and retained only for an authorised period. Assurance should not stop at adoption, resourcing or completion of administrative tasks. Assurance should address actual effect and provide a means of correcting disadvantage that the arrangement did not intend.","the analysis should remain within the limits of the evidence. A decision concerning the available evidence should recognise that international comparison can identify variation, but institutional and policy context remains necessary before a practice is transferred from one setting to another. A decision concerning the measure should recognise that security, privacy and data quality are related but distinct. A secure record may still be inaccurate or used without adequate authority, and a lawful use may still be poorly governed. Decision-makers should not extend assurance beyond the point supported by the available evidence.","Neither one indicator nor one control can establish the complete position on the issue."]}],"word_count":741,"content_hash":"sha256-aa993417970338118fa5e44e69f455764faaab004ff3a0cba1c5a34755d7283c","seo_keywords":["online assessment privacy","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}