Exploring AI Chatbot Affordances in EFL Higher Education: Impacts on Language Proficiency, Usability, Engagement, and Perceived Effectiveness

Ali Hosseini, Zahra Amirkhani

Abstract


The integration of artificial intelligence (AI) chatbots into English as a Foreign Language (EFL) education represents a transformative shift in language learning methodologies. This mixed-methods study investigates the impact of AI chatbots on the language proficiency, engagement, and motivation of Iranian university students. The findings revealed significant improvements in speaking and vocabulary, attributed to the chat bot’s interactive, low-pressure environment and immediate feedback. However, gains in listening and reading were modest, suggesting limitations in AI’s ability to address culturally nuanced skills. Furthermore, the findings highlighted high usability and engagement, with students praising the chat bot’s availability and gamified exercises. Despite these benefits, challenges such as technical barriers (e.g., connectivity issues), repetitive responses, and ethical concerns (e.g., privacy risks) emerged. Instructors cautioned against overreliance on AI, emphasizing the need for human guidance in fostering critical thinking and creativity. Demographic variations in learning outcomes further underscored the importance of tailoring AI tools to diverse learner backgrounds. A probable conclusion is that while AI chatbots offer significant potential to enhance EFL learning, their integration must be balanced with ethical considerations and human instruction to ensure equitable, effective, and holistic language education. Future research should explore longitudinal impacts, cross-cultural applicability, and hybrid pedagogical models to optimize AI’s role in global language education.


Keywords


Artificial intelligence; Higher education; EFL; Language proficiency; Engagement

Full Text:

PDF

References


AbuSahyon, A., Alzyoud, A., Alshorman, O., & Al-Absi, B. (2023). AI-driven technology and Chatbots as tools for enhancing English language learning in the context of second language acquisition: a review study. International Journal of Membrane Science and Technology, 10(1), 1209-1223.

AlTwijri, L., & Alghizzi, T. M. (2024). Investigating the integration of artificial intelligence in English as foreign language classes for enhancing learners’ affective factors: A systematic review. Heliyon.

Apriani, E., Cardoso, L., Obaid, A. J., Wijayanti, E., Esmianti, F., & Supardan, D. (2024). Impact of AI-Powered ChatBots on EFL Students' Writing Skills, Self-Efficacy, and Self-Regulation: A Mixed-Methods Study. Global Educational Research Review, 1(2), 57-72.

Campbell, R. (2023). Language Learning in the Age of AI: Challenges and Opportunities. Retrieved from https://medium.com/@iPadEFLTeacher/language-learning-in-the-age-of-ai-challenges-and-opportunities-a5a8353bedd4#:~:text=Ultimately%2C%20AI%2Dassisted%20language%20learning,foreign%20tongue%20of%20their%20choosing!

Clugston, B. (2024). ADVANTAGES AND DISADVANTAGES OF AI IN EDUCATION. Retrieved from https://www.ucanwest.ca/blog/education-careers-tips/advantages-and-disadvantages-of-ai-in-education

De la Vall, R. R. F., & Araya, F. G. (2023). Exploring the benefits and challenges of AI-language learning tools. International Journal of Social Sciences and Humanities Invention, 10(01), 7569-7576.

Duong, T.-N.-A., & Chen, H.-L. (2025). An AI Chatbot for EFL Writing: Students’ Usage Tendencies, Writing Performance, and Perceptions. Journal of Educational Computing Research, 07356331241312363.

Etaat, F. (2024). The Effect of AI-Based Applications on EFL Writing Skill Development: An Inquiry into Integration of AI into Language Learning. UiT Norges arktiske universitet.

Fathi, J., Rahimi, M., & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121, 103254.

Gökçearslan, S., Tosun, C., & Erdemir, Z. G. (2024). Benefits, challenges, and methods of artificial intelligence (AI) chatbots in education: A systematic literature review. International Journal of Technology in Education, 7(1), 19-39.

Hamid, H., Zulkifli, K., Naimat, F., Yaacob, N. L. C., & Ng, K. W. (2023). Exploratory study on student perception on the use of chat AI in process-driven problem-based learning. Currents in Pharmacy Teaching and Learning, 15(12), 1017-1025.

Huang, J. (2024). Evaluating Large Language Model (LLM) systems: Metrics, challenges, and best practices. Retrieved from https://medium.com/data-science-at-microsoft/evaluating-llm-systems-metrics-challenges-and-best-practices-664ac25be7e5

Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning. Journal of computer assisted learning, 38(1), 237-257.

Jeon, J. (2024). Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives. Computer Assisted Language Learning, 37(1-2), 1-26.

Jeon, J., & Lee, S. (2024). The impact of a chatbot-assisted flipped approach on EFL learner interaction. Educational Technology & Society, 27(4), 218-234.

Kim, H.-S., Cha, Y., & Kim, N. Y. (2021). Effects of AI chatbots on EFL students' communication skills. 영어학, 21, 712-734.

Kooli, C. (2023). Chatbots in education and research: A critical examination of ethical implications and solutions. Sustainability, 15(7), 5614.

Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024). Roles, users, benefits, and limitations of chatbots in health care: rapid review. Journal of medical Internet research, 26, e56930.

Lin, M. P.-C., & Chang, D. (2020). Enhancing post-secondary writers’ writing skills with a chatbot. Journal of Educational Technology & Society, 23(1), 78-92.

López-Minotta, K. L., Chiappe, A., & Mella-Norambuena, J. (2025). Implementation of Artificial Intelligence to Improve English Oral Expression.

Ma, Y., & Chen, M. (2024). AI-empowered applications effects on EFL learners’ engagement in the classroom and academic procrastination. BMC psychology, 12(1), 739.

Mageira, K., Pittou, D., Papasalouros, A., Kotis, K., Zangogianni, P., & Daradoumis, A. (2022). Educational AI chatbots for content and language integrated learning. Applied Sciences, 12(7), 3239.

Mananay, J. A. (2024). Integrating Artificial Intelligence (AI) in Language Teaching: Effectiveness, Challenges, and Strategies. International Journal of Learning, Teaching and Educational Research, 23(9), 361-382.

Mohamed, A. M. (2024). Exploring the potential of an AI-based Chatbot (ChatGPT) in enhancing English as a Foreign Language (EFL) teaching: perceptions of EFL Faculty Members. Education and Information Technologies, 29(3), 3195-3217.

Papaspyridis, A., & La Greca, J. (2023). AI and education: will the promise be fulfilled? Augmented education in the global age (pp. 119-136): Routledge.

Punar Özçelik, N., & Yangın Ekşi, G. (2024). Cultivating writing skills: the role of ChatGPT as a learning assistant—a case study. Smart Learning Environments, 11(1), 10.

Rezai, A., Namaziandost, E., & Hwang, G.-J. (2024). How can ChatGPT open promising avenues for L2 development? A phenomenological study involving EFL university students in Iran. Computers in Human Behavior Reports, 16, 100510.

Rizvi, N. (2024). From Chalkboards to Chatbots: The Role of Generative AI in Education.

Roca, M. D. L., Chan, M. M., Garcia‐Cabot, A., Garcia‐Lopez, E., & Amado‐Salvatierra, H. (2024). The impact of a chatbot working as an assistant in a course for supporting student learning and engagement. Computer Applications in Engineering Education, 32(5), e22750.

Saifullah, S., Yawan, H., Syafitri, N., & Nurhaliza, S. (2024). INTEGRATING AI CHATBOT INTO LEARNING MANAGEMENT SYSTEM: ENHANCING STUDENT ENGAGEMENT AND LEARNING OUTCOMES. Dharmas Education Journal (DE_Journal), 5(2), 1346-1359.

Sedrakyan, G., Borsci, S., Machado, M., Rogetzer, P., & Mes, M. (2024). Design Implications for Integrating AI Chatbot Technology with Learning Management Systems: A Study-based Analysis on Perceived Benefits and Challenges in Higher Education. Paper presented at the Proceedings of the 2024 International Conference on Artificial Intelligence and Teacher Education.

Sobaih, A. E. (2024). Ethical concerns for using artificial intelligence chatbots in research and publication: Evidences from Saudi Arabia. Journal of Applied Learning and Teaching, 7(1).

Son, J.-B., Ružić, N. K., & Philpott, A. (2023). Artificial intelligence technologies and applications for language learning and teaching. Journal of China Computer-Assisted Language Learning(0).

Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14, 1260843.

Tajik, A. (2025). Exploring the role of AI-driven dynamic writing platforms in improving EFL learners' writing skills and fostering their motivation.

Tiwari, H., Jain, S., Kumar, S., Soni, V., & Negi, A. (2024). AI-driven English language learning: Leveraging applications/APIs for dynamic content and feedback. World Journal of Advanced Research and Reviews, 22(3), 1611-1616.

Vadivel, B., Shaban, A. A., Ahmed, Z. A., & Saravanan, B. (2023). Unlocking English proficiency: Assessing the influence of AI-powered language learning apps on young learners' language acquisition. International Journal of English Language, Education and Literature Studies, 5(2), 123-139.

Wei, X., Chu, X., Geng, J., Wang, Y., Wang, P., Wang, H., . . . Lei, L. (2024). Societal impacts of chatbot and mitigation strategies for negative impacts: A large-scale qualitative survey of ChatGPT users. Technology in Society, 77, 102566.

Yuan, Y. (2024). An empirical study of the efficacy of AI chatbots for English as a foreign language learning in primary education. Interactive Learning Environments, 32(10), 6774-6789.

Zhang, J. (2025). Integrating chatbot technology into English language learning to enhance student engagement and interactive communication skills. Journal of Computational Methods in Sciences and Engineering, 14727978241312992.




DOI: http://dx.doi.org/10.18415/ijmmu.v12i3.6682

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 International Journal of Multicultural and Multireligious Understanding

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

International Journal of Multicultural and Multireligious Understanding (IJMMU) ISSN 2364-5369
https://ijmmu.com
editor@ijmmu.com
dx.doi.org/10.18415/ijmmu
facebook.com/ijmmu
Copyright © 2014-2018 IJMMU. All rights reserved.