The proficiency level as a mediator factor in the washback effect process in EPLIS
DOI:
https://doi.org/10.21165/el.v48i1.2151Keywords:
washback effect, aviation English teaching and learning, proficiencyAbstract
This paper aims at investigating how the learners’ proficiency level in an air traffic control initial training program affects their perceptions and attitudes towards an external aviation English test, administered to them at the end of the course. To this end, a questionnaire was designed and delivered to 407 students enrolled in the program. Principal component analyses and hypothesis tests were conducted on the data to plot the significance of the relationships between the fundamental constructs of the questionnaire and the learners’ perceived level of proficiency. Results showed that learners with a higher perceived proficiency rate their knowledge about the exam higher, as well as the frequency with which they engage in preparation activities, the importance of being successful in the test and the alignment between teaching and external examination.Downloads
References
ALDERSON, J. C.; WALL, D. Does washback exist? Applied Linguistics, v. 14, n. 2, p. 115-129, 1993.
ALDERSON, J. C.; BANERJEE, J. Language testing and assessment – Part I. Language Teaching, v. 34, n. 4, p. 213-236, 2001.
ALDERSON, J. C.; HAMP-LYONS, L. TOEFL preparation courses: a study of washback. Language Testing, v. 13, n. 3, p. 281-297, 1996.
BACHMAN, L. F.; PALMER, A. S. Language testing in practice: designing and developing useful language tests. Oxford: Oxford University Press, 1996.
BAILEY, K. Working for washback: A review of the washback concept in language testing. Language Testing, v. 13, n. 3, p. 257-279, 1996.
BURROWS, C. Washback in Classroom-Based Assessment: A study of the Washback Effect in Australian Adult Migrant English Program. In: CHENG, L.; WATANABE, Y.; CURTIS, A. (ed.). Washback in Language Testing: Research, Contexts and Methods. New Jersey: Lawrence Erlbaum Associates, 2004. p. 113-128.
CHENG, L. Changing assessment: washback on teacher’s perspectives and actions. Teaching and Teacher Education, v. 15, n. 3, p. 253-271, 1999.
CHENG, L.; ANDREWS, S.; YU, Y. Impact and consequences of school-based assessment (SBA): Students’ and parents’ views of SBA in Hong Kong. Language Testing, v. 28, n. 2,
p. 221-249, 2010.
GREEN, A. IELTS washback in context: Preparation for academic writing in higher education. Studies in Language Testing 25. Cambridge, UK: Cambridge University Press and Cambridge ESOL, 2007.
HAIR, J. F.; BLACK, W. C.; BABIN, B. J.; ANDERSON, R. E.; TATHAM, R. L. Análise Multivariada de Dados. 6. ed. Porto Alegre: Bookman, 2009.
HUGHES, A. Backwash and TOEFL 2000. Unpublished manuscript. Reading, UK: University of Reading, 1993.
LANZONI, H. DE P. Exame de proficiência em leitura de textos acadêmicos em Inglês: um estudo sobre efeito retroativo. 2004. Tese (Doutorado em Linguística Aplicada) – Instituto de Estudos da Linguagem, Universidade Estadual de Campinas, Campinas, 2004.
MCNAMARA, T.; ROEVER, T. Language Testing: The social dimension. Malden, MA: Blackwell, 2006.
MESSICK, S. Validity and washback in language testing. Language Testing, v. 13, n. 3, p. 241-255, 1996.
ORGANIZAÇÃO DA AVIAÇÃO CIVIL INTERNACIONAL/OACI. Manual on the implementation of ICAO language proficiency requirements: Doc. 9835 AN/453. 2. ed. Montreal, 2010.
SCARAMUCCI, M. V. R. Vestibular e ensino de língua estrangeira (Inglês) na escola pública. Trabalhos de Linguística Aplicada, v. 34, p. 7-20, 1999.
SCARAMUCCI, M. V. R. Efeito Retroativo da Avaliação no Ensino/Aprendizagem de línguas: o estado da Arte. Trabalhos de Linguística Aplicada, v. 43, n. 2, p. 203-226, 2004.
SCARAMUCCI, M. V. R. Validade e consequências sociais das avaliações em contextos de ensino de línguas. Linguarum Arena, v. 2, p. 103-120, 2011.
SCARAMUCCI, M. V. R. et al. Validação do exame de proficiência em Língua Inglesa para profissionais prestadores de serviços de tráfego aéreo do SISCEAB. 2010. Relatório final de pesquisa. Campinas: UNICAMP, 2010.
SOUZA, P. R. O efeito retroativo do EPLIS nas percepções de professores. Brazilian English Language Teaching Journal, v. 8, n. 1, p. 5-29, 2005.Disponível em: http://revistaseletronicas.pucrs.br/ojs/index.php/belt/issue/view/1150. Acesso em: 25 jun. 2017.
SOUZA, P. R. Os componentes determinantes do efeito retroativo de um exame de proficiência em inglês aeronáutico. In: SCARAMUCCI, M. V. R.; TOSQUI-LUCKS, P.; DAMIÃO, S. M. Pesquisas sobre Inglês Aeronáutico no Brasil. Campinas: Pontes, 2018. p. 221-242.
SHOHAMY, E. Language Policy: Hidden agendas and new approaches. New York: Routledge, 2006.
STENLUND, T.; EKLÖF, H.; LYREN, P. Group differences in test-taking behavior: an example from a high-stakes testing program. Assessment in Education, v. 24, n. 1, p. 4-20, 2017.
STONEMAN, B. The impact of an exit English test on Hong Kong undergraduates: a study investigation of the test’ status on students’ test preparation behaviours. 2006. Unpublished PhD Dissertation. Hong Kong Polytechnic University: Hong Kong, China, 2006.
TOSQUI-LUCKS, P. T. et al. Ensino e avaliação de Língua Inglesa para controladores de tráfego aéreo como requisito de segurança em voo. Revista Conexão SIPAER, v. 7, n. 1,
p. 44-54, 2016. Disponível em: http://conexaosipaer.cenipa.gov.br/index.php/sipaer/issue/view/19. Acesso em: 25 jun. 2017.
WATANABE, Y. Teacher factor mediating washback. In: CHENG, L.; WATANABE, Y.; CURTIS, A. (ed.). Washback in Language Testing: Research, Contexts and Methods. New Jersey: Lawrence Erlbaum Associates, 2004. p. 129-146.
