{"schema_version":"ICEQC_NEWS_ARTICLE_V1","id":"iceqc-news-357b957e7b074e8a","slug":"2006-08-07-equity-analysis-of-multilingual-literacy-assessment","language":"en","publication_status":"READY_FOR_IMPORT","publication_date":"2006-08-07","last_modified_date":"2006-08-07","title":"Equity analysis of multilingual literacy assessment","summary":"Examines equity analysis of multilingual literacy assessment, defining the evidence base, coverage and limits that should govern comparison and use of the findings.","category":{"code":"DATA_RESEARCH","label":"Data Research"},"article_type":"Data and research analysis","publisher":"International Council for Education Quality Certification (ICEQC)","jurisdictional_scope":"International","historical_reference_basis":"International literacy measurement guidance available in 2006","reference_authority":"Relevant public authorities and official international sources","sections":[{"heading":null,"paragraphs":["The immediate international context is the international literacy measurement guidance available in 2006. Its significance for multilingual literacy assessment lies in the quality of implementation rather than in formal acknowledgement alone. A decision concerning the comparison should recognise that evidence should inform action without implying a level of precision, coverage or causal certainty that the underlying data cannot support. Learner protection and reliable decisions require controls commensurate with the nature and scale of risk."]},{"heading":"Analytical scope","paragraphs":["The stated reference is the international literacy measurement guidance available in 2006. Application to multilingual literacy assessment depends on evidence from the relevant jurisdiction or institution. That distinction should remain visible in the decision record, public reporting and later review.","The required public outcome should be stated in operational terms. For the available evidence, assessment should provide valid and sufficiently consistent evidence that the stated learning outcomes have been achieved by the learner receiving the result. In relation to equity analysis of multilingual literacy assessment, inputs and formal commitments should be distinguished from demonstrated operation and outcome. Implementation evidence should be sufficient to identify unequal consequences and assign corrective responsibility."]},{"heading":"Definitions and data coverage","paragraphs":["The technical issue within multilingual literacy assessment concerns the basis on which a conclusion is reached. For the analysis, an average may improve while a material group experiences no improvement or a worse outcome. Disaggregation should follow a defined public-interest question and should protect confidentiality where small numbers could identify individuals. The decision record should distinguish the scope supported by evidence from any scope that remains unresolved.","The governing expectation for the issue should be capable of consistent application. For the available evidence, where an indicator is used as a proxy, the relationship between the proxy and the underlying educational outcome should be stated and tested. Definitions should provide a stable basis for decisions while allowing relevant differences to be identified and justified."]},{"heading":"Use of the findings","paragraphs":["A narrow control over multilingual literacy assessment may create false assurance. In the present context, results used beyond the evidence they support, inconsistent judgement between markers or locations and weak assurance of authorship or performance may produce acceptable aggregate reporting while individual learners remain exposed to material disadvantage.","Relevant evidence for the issue will normally include approval and change-control records, authorship and identity controls proportionate to risk, analysis of results and differential outcomes, appeal and correction records, and assessment maps to learning outcomes. Currency, provenance and representativeness should be established before evidence is used for assurance. An unresolved contradiction is a limitation on the conclusion and should be reported as such."]},{"heading":"Uncertainty and safeguards","paragraphs":["The review method for multilingual literacy assessment should be reproducible. A competent review of the issue should examine results by relevant learner, programme, location and delivery characteristics; compare both levels and rates of change; and test whether observed gaps persist after differences in coverage and prior conditions are considered. Documentation should be sufficient to reconstruct the judgement without relying on unrecorded explanation.","Decision-makers using evidence on the comparison should be told what the data cannot establish as clearly as what it can. Reporting should state whether a result describes, compares or evaluates, together with the level at which it is valid. Use in a different context requires an independent judgement that the settings are materially comparable."]},{"heading":"Uncertainty and safeguards","paragraphs":["Interpretation of multilingual literacy assessment should avoid two errors: treating a formal commitment as proof of effect, and treating one adverse case as proof that every part of the system has failed. Oversight of the issue should reflect the principle that reliability without validity produces consistent but potentially irrelevant results. Validity without adequate consistency may expose learners to unequal judgement. Oversight of the available evidence should reflect the principle that a single indicator rarely provides an adequate account of quality. Quantitative evidence should be considered with implementation records and the experience of affected learners.","Records relating to the comparison should preserve both the conclusion and its limits. A changed evidential position should be applied to the affected scope, including prior decisions that may no longer be reliable. This is material where learners, authorities or institutions relied on information that cannot be corrected by replacing the current text alone.","For the analysis, governing bodies should receive a concise account of the intended result, affected scope, principal risks, evidence limitations and unresolved exceptions. In relation to equity analysis of multilingual literacy assessment, material action requires a named responsible function and a defined completion point.","Assurance concerning the issue requires corroborating evidence across the material scope. The final judgement should connect the applicable expectation to implementation and outcomes while identifying unresolved risk."]}],"word_count":753,"content_hash":"sha256-ad7784337017b610a0d824c5c0eaab30f00a4b210a86ea82b586b26c548bcc80","seo_keywords":["equity analysis of multilingual literacy assessment","international education data research","education quality","ICEQC"],"schema_type":"AnalysisNewsArticle"}