TRANSLATION QUALITY IN INTERNATIONAL LARGE-SCALE ASSESSMENTS IN EDUCATION
Received: 04th September 2021; Revised: 01st December 2021, 10th January 2022; Accepted: 11th January 2022
DOI:
https://doi.org/10.20319/pijss.2022.154168Keywords:
Translation Quality, Translation Quality Assessment, Translation Policy, Translation Quality Standards, Adaptation, VerificationAbstract
During the last 20 years, large-scale international assessments in education became part of international research. The increased number of countries participating in the international studies of PISA, TIMSS, and PIRLS and translation of their assessment instruments in many languages of the world is accompanied by the request to ensure translation quality. Translation quality and its management became and are an important concern for the PISA, TIMMS, and PIRLS. The linguistics quality control centres have developed translation policies, standards, and procedures. This paper aims to present the translation policy and translation quality procedures implemented by PISA, TIMSS, and PIRLS in the last 20-years. The paper is focused on the need for translation quality and illustrates how translation quality is implemented in practice. The paper is based on the translation guidelines, secondary data from the technical reports of these international assessment studies, and recent research findings. This paper concludes that the suitable policy and procedures of translation quality used by PISA, TIMSS, and PIRLS have provided a high quality of translated instruments that has enabled the comparison of assessment results. The article also highlights PISA's, TIMSS's, and PIRLS's contribution to the development of translation quality theory and practice of the educational materials.
References
Bartman, D., Hambleton, R., Grégoire, J., &Muñiz, J. (2018). ITC Guidelines for Translating and Adapting Tests (Second Edition). International Journal of Testing, Volume 18, Issue 2, pp.101-134. https://doi.org/10.1080/15305058.2017.1398166
Bracken, B. A., & Barona, A. (1991). State of the art procedures for translating, validating, and using psycho-educational tests in cross-cultural assessment. School Psychology International, 12(1-2), 119–132. https://doi.org/10.1177/0143034391121010
Byrne, M. B. (2008). Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psicothema, 20 (4), pp. 872–882.
Catford, J. C. (1965).A Linguistic Theory of Translation: An Essay on Applied Linguistics, London: Oxford University Press.
Cook, L. L., Schmitt-Cascallar, A. P., &Brown , C. (2005). Adapting Achievement and Aptitude Tests: A Review of Methodological Issues. In: Hambleton, R. K., Merenda, P. F. & Spielberger, C. D., ed., Adapting Educational and Psychological Tests for Cross-Cultural Assessment. Mahwah, NJ: Lawrence Erlbaum Associates, pp. 171-192.
Dept, S., Ferrari, A., &Wäyrynen, L. (2010).Procedures in Three Multilingual Assessments: A Plea for an Integrated Translation and Adaptation Monitoring Tool.In: Harkness, J. et al., ed., Survey Methods in Multinational, Multiregional and Multicultural Contexts. John Wiley & Sons, Hoboken, NJ, pp.157-173. https://doi.org/10.1002/9780470609927.ch9
Dept, S., Ferrari, A., & Halleux, B. (2017). Translation and cultural appropriateness of survey material in large-scale assessments. In: P. Lietz, P., Cresswell, J., Rust, K. &Adams, R., ed., Implementation of large-scale education assessments. Chichester, UK: Wiley, pp. 168–191. https://doi.org/10.1002/9781118762462.ch6
DIN EN 15038. (2006). Translation services-Service requirements. English version of DIN EN 15038:2006-08.
Grégoire, J., & Hambleton, R. K. (ed.). (2009). Advances in test adaptation research [Special Issue]. International Journal of Testing, 9(2), pp. 73-166. https://doi.org/10.1080/15305050902880678
Grisay, A., de Jong, J., Gebhardt, E., Berezner, A., &Halleux-Monseur, B. (2007). Translation Equivalence across PISA Countries. Journal of Applied Measurement, 8 (3), pp. 249-266.
Hambleton, K.R. & Patsula, L. (1998). Adapting Tests for Use in Multiple Languages and Cultures Social Indicators Research, Volume 45, pp.153–171. https://doi.org/10.1023/A:1006941729637
Hambleton, R. K., Merenda, P. F., & Spielberger, C. D., ed. (2005). Adapting educational and psychological tests for cross-cultural assessment. Mahwah, NJ: Erlbaum. https://doi.org/10.4324/9781410611758
Harkness, J. A., van de Vijer, F.J. R., & Johnson, T.P. (2003). Questionnaire design in comparative research. In: J. A. Harkness, J. F. R. van de Vijver, & P. P. Mohler, ed., Cross-Cultural Survey Methods, Wiley, pp. 19-34. https://doi.org/10.4135/9781849209458.n4
Harkness, J.A. (2007). Improving the comparability of translations. In: Jowell, R., Roberts, C., Fitzgerald, R. & Eva, G., ed., Measuring Attitudes Cross-Nationally: Lessons from the European Social Survey. Sage, Los Angeles, pp. 79-93. https://doi.org/10.1002/9780470609927.ch3
Harkness, J., Edwards, B., Hansen, S. E., Miller, D.,& Villar, A. (2010). Designing Questionnaires for Multipopulation Research. In: Harkness, J., et al., ed., Survey Methods in Multinational, Multiregional and Multicultural Contexts. John Wiley & Sons, Hoboken, NJ, pp. 33-57. https://doi.org/10.1002/9780470609927.ch7
Harkness, J., Villar, A., & Edwards, B. (2010). Translation, Adaptation, and Design. In: Harkness, J. et al., ed., Survey Methods in Multinational, Multiregional and Multicultural Contexts. John Wiley & Sons, Hoboken, NJ, pp. 117-140.
House, J. (1977). (2nd ed., 1981) A Model for Translation Quality Assessment. Tübingen: Narr.
House, J. (1997). Translation Quality Assessment: A Model Revisited. Tübingen: Narr.
House, J. (2015). Translation Quality assessment. Past and present. Routledge. https://doi.org/10.4324/9781315752839
Iliescu, D. (2017). Adapting tests in linguistic and Cultural Situations. Cambridge University Press. https://doi.org/10.1017/9781316273203
ISO 17100:2015. Translation services-Requirements for translation services. https://www.iso.org/standard/59149.html
ITC Guidelines for Translating and Adapting Tests (2nd ed., 2017). International Journal of Testing, https://doi.org/10.1080/15305058.2017.1398166
Jakobson, R. (1966). On Linguistic Aspects of Translation. In: Brower, R., ed., On Translation. New York: Oxford University Press.
Kelly, L. D., Malak, B. (2003). Translating the PIRLS Reading Assessment and Questionnaires. In: Martin, O. M., Mullis, S.I., & and Kennedy, M.A., ed., PIRLS 2001 Technical Report.International Study Center, Lynch School of Education, Boston College pp. 44.
Koller, W. (1995). The Concept of Equivalence and the Object of Translation Studies.Target 7: pp. 191–222. https://doi.org/10.1075/target.7.2.02kol
Koller, W. (2011) (11th ed.) Einführung in die Übersetzungswissenschaft. Tübingen: Francke.
Kristjansson, E. A., Desrochers, A., & Zumbo, B. (2003). Translating and adapting measurement instruments for cross-linguistic and cross-cultural research: A guide for practitioners. Canadian Journal of Nursing Research, 35 (2), pp. 127–142.
Maxwell, B. (1996). Translation and Cultural Adaptation of the Survey Instruments. In: Martin, O.M. & Kelly, L. D., ed., Third International Mathematics and Science Study (TIMSS) Technical Report, Volume I: Design and Development. IEA, pp.8-1-9-1.
Neubert, A. (1970). Elemente einer allgemeinen Theorie der Translation. In:Actes du Xe Congrès International des Linguistes, Bucharest, 1967, pp. 451–56.
Neubert, Albrecht (1985) Text and Translation. Leipzig, Enzyklopädie.
Nida, E. (1964). Towards a Science of Translating. Leiden: E.J. Brill. https://doi.org/10.1163/9789004495746
Nida, E. 1991. Thories of translation. TTR: Traduction, terminologie, redaction, vol.4, no1, 1991, pp. 19-32. https://doi.org/10.7202/037079ar
Nida, E. and Taber, C.R. (1969). The Theory and Practice of Translation. Leiden: E.J. Brill.
Nord, C. (1997). A functional typology of translations. In: Trosborg, A., ed., Text typology and translation, John Benjamins, pp. 43–66. https://doi.org/10.1075/btl.26.05nor
PIRLS 2016. Ebbs, A. & Wry, E. Translation and Layout Verification for PIRLS 2016.TIMSS & PIRLS International Study Center, pp.7.1.
PISA 2018. Translation and adaptation guidelines. Produced by cApStAn and Béatrice Halleux under the supervision of ETS, Core A and Core D Contractors, pp.1.
Pym, A. (2010). Exploring Translation Theories. London and New York: Routledge, p. 324. https://doi.org/10.4324/9780203869291
Reiss, K. (2000). Translation criticism: The potentials and limitations. Categories and criteria for translation quality assessment. Routledge.
Rios, A. J., &Sireci, G.S. (2014). Guidelines Versus Practices in Cross-Lingual Assessment: A Disconcerting Disconnect. International Journal of Testing, Volume 14, Issue 4, pp.289-312 https://doi.org/10.1080/15305058.2014.924006
Sireci, S. G. (2005). The most frequently unasked questions about testing. In: Phelps, P.R., ed., Defending standardized testing, Lawrence Erlbaum Associates Publishers, pp. 111–121.
Standards for Educational and Psychological Testing. (2014). Developed jointly by American Educational Research Association, American Psychological Association, National Council on Measurement in Education, pp. 68.
TIMSS. (2020). Instrument translation and Layout Verification for TIMSS 2019. In: Martin, O.M., Davier von M., & Mullis, S.V. I., ed., Methods, and procedures: TIMSS 2019 Technical report. TIMSS & PIRLS International Study Center, pp. 5.3.
van de Vijver, F. J. R. (2015). Methodological aspects of cross-cultural research. In: M. Gelfand, Y. Hong., & C. Y. Chiu., ed., Handbook of advances in culture & psychology (Vol. 5, pp. 101-160). New York, NY: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780190218966.003.0003
van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage.
Vinay, J. P., & Darbelnet, J. (1995). Comparative Stylistics of French and English: A Methodology for Translation. North America, Amsterdam, and Philadelphia. John Benjamins https://doi.org/10.1075/btl.11
Vinay, J.P.,&Darbelnet, J. (1958). Stylistique Comparée du Francais et de l' Anglais: Méthode de Traduction. Paris: Didier. (Transl. and ed. by Sager, J.C. and Hamel, M.J. (1995) as Comparative Stylistics of French and English: A Methodology for Translation. John Benjamins.
Williams, M. (2004). Translation quality assessment: An Argument-centered approach.
Ottawa: University of Ottawa Press.
Williams, M. (2009). Translation quality assessment. Mutatis Mutandis 2 (1), pp.1-21.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2018 Authors
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
