PERCEIVED IMPACT OF AI-ASSISTED LEARNING ON CRITICAL THINKING: EVIDENCE FROM CHINESE ENGLISH MAJORS
DOI:
https://doi.org/10.35631/IJMOE.829026Keywords:
AI-Assisted Learning, Critical Thinking Skills (CTSS), English Majors, Paul-Elder Framework for Critical ThinkingAbstract
This study explored how AI-assisted learning influences critical thinking skills (CTSs) among Chinese undergraduate English majors, focusing on analysis, evaluation, inference, and self-regulation from the Paul-Elder framework. Using a mixed-methods approach with 188 survey responses and 10 interviews, a tailored questionnaire measured students perceived CTSs changes. Findings show AI tools are widely used for writing, translation, and idea generation. While perceived analytical gains were modest (M=3.28), scores for evaluation, inference, and self-regulation hovered near neutral. Frequent AI use correlated negatively with self-regulation (r = -0.20, p = 0.007), suggesting risks of cognitive offloading. Interviews indicated that, despite recognizing AI’s limitations, students often relied uncritically on these tools under academic pressure and an efficiency-driven environment. The results highlight a core tension: as efficiency becomes central, independent thinking and metacognition risk being sidelined. Addressing how to shift AI from a cognitive shortcut to a true thinking aid emerges as a key educational challenge.
Downloads
References
Abbasi, B., Wu, Y., & Luo, Z. (2024). Exploring the impact of artificial intelligence on curriculum development in global higher education institutions. Educ. Inf. Technol., 30, 547-581. https://doi.org/10.1007/s10639-024-13113-z
Alshumaimeri, Y., & Alshememry, A. (2024). The Extent of AI Applications in EFL Learning and Teaching. IEEE Transactions on Learning Technologies, 17, 653-663. https://doi.org/10.1109/TLT.2023.3322128
An, X., Chai, C., Li, Y., Zhou, Y., Shen, X., Zheng, C., & Chen, M. (2022). Modeling English teachers’ behavioral intention to use artificial intelligence in middle schools. Education and Information Technologies, 28, 5187-5208. https://doi.org/10.1007/s10639-022-11286-z
Alzubi, A., Nazim, M., & Alyami, N. (2025). Do AI-generative tools kill or nurture creativity in EFL teaching and learning?. Education and Information Technologies. https://doi.org/10.1007/s10639-025-13409-8
Alharbi, W. (2023). The use and abuse of artificial intelligence-enabled machine translation in the EFL classroom: An exploratory study. Journal of Education and e-Learning Research. https://doi.org/10.20448/jeelr.v10i4.5091.
Aoun, J. E. (2017). Robot proof: higher education in the age of artificial intelligence. MIT Press. https://doi.org/10.7551/mitpress/11456.001.0001.
Çelik, I., Gedrimiene, E., Siklander, S., & Muukkonen, H. (2024). The affordances of artificial intelligence-based tools for supporting 21st-century skills:. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.9069.
Cai, L., Msambwa, M., & Daniel, K. (2024). Exploring the impact of integrating AI tools in higher education using the Zone of Proximal Development. Educ. Inf. Technol., 30, 7191-7264. https://doi.org/10.1007/s10639-024-13112-0
Chan, C., & Colloton, T. (2024). Generative AI in Higher Education. . https://doi.org/10.4324/9781003459026.
Dai, K., & Liu, Q. (2024). Leveraging artificial intelligence (AI) in English as a foreign language (EFL) classes: Challenges and opportunities in the spotlight. Comput. Hum. Behav., 159, 108354. https://doi.org/10.1016/j.chb.2024.108354
D., Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E., & , M. (2023). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11. https://doi.org/10.1080/2331186X.2023.2290342
Dickey, E., & Bejarano, A. (2023). GAIDE: A Framework for Using Generative AI to Assist in Course Content Development. 2024 IEEE Frontiers in Education Conference (FIE), 1-9. https://doi.org/10.1109/FIE61694.2024.10893132.
Essien, A., Bukoye, O., O’Dea, C., & Kremantzis, M. (2024). The influence of AI text generators on critical thinking skills in UK business schools. Studies in Higher Education, 49, 865 - 882. https://doi.org/10.1080/03075079.2024.2316881
Eliott, L. (2024). Advantages and Disadvantages of AI in the EFL Classroom. The Asian Conference on Education 2023: Official Conference Proceedings. https://doi.org/10.22492/issn.2186-5892.2024.43
Giannakos, M., Azevedo, R., Brusilovsky, P., Cukurova, M., Dimitriadis, Y., Hernandez-Leo, D., … Rienties, B. (2024). The promise and challenges of generative AI in education. Behaviour & Information Technology, 44(11), 2518–2544. https://doi.org/10.1080/0144929X.2024.2394886
Gonsalves, C. (2024). Generative AI’s Impact on Critical Thinking: Revisiting Bloom’s Taxonomy. Journal of Marketing Education. https://doi.org/10.1177/02734753241305980
Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. SSRN. https://doi.org/10.2139/ssrn.5082524
Guo, K., Pan, M., Li, Y., & Lai, C. (2024). Effects of an AI-supported approach to peer feedback on university EFL students' feedback quality and writing ability. Internet High. Educ., 63, 100962. https://doi.org/10.1016/j.iheduc.2024.100962
Hading, E., Rustan, D., & Ruing, F. (2024). EFL Students' Perceptions on the Integration of AI in Fostering Critical Thinking Skills. GLENS: Global English Insights Journal. https://doi.org/10.61220/glens.v2i1.466
Hsiao, J., & Chang, J. (2023). Enhancing EFL reading and writing through AI-powered tools: design, implementation, and evaluation of an online course. Interactive Learning Environments, 32, 4934 - 4949. https://doi.org/10.1080/10494820.2023.2207187
Hikmawati, A., & Mohammad, N. (2025). Enhancing Critical Thinking with Gen AI: A Literature Review. Buletin Edukasi Indonesia. https://doi.org/10.56741/bei.v4i01.764
Jiang, R. (2022). How does artificial intelligence empower EFL teaching and learning nowadays? A review on artificial intelligence in the EFL context. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1049401
Jiang, X., Li, J., & Chen, C.-H. (2024). Enhancing critical thinking skills with ChatGPT-powered activities in Chinese language classrooms. International Journal of Chinese Language Teaching, 5(1), 47–73. https://doi.org/10.46451/ijclt.20240105
Jia, X., & Tu, J. (2024). Towards a New Conceptual Model of AI-Enhanced Learning for College Students: The Roles of Artificial Intelligence Capabilities, General Self-Efficacy, Learning Motivation, and Critical Thinking Awareness. Syst., 12, 74. https://doi.org/10.3390/systems12030074.
Khan, A., Hasan, M., Islam, M., & Uddin, M. (2024). Artificial Intelligence Tools in Developing English Writing Skills: Bangladeshi University EFL Students’ Perceptions. English Education: Jurnal Tadris Bahasa Inggris. https://doi.org/10.24042/ee-jtbi.v17i2.24369
Liang, W., & Wu, Y. (2024). Exploring the use of ChatGPT to foster EFL learners’ critical thinking skills from a post-humanist perspective. Thinking Skills and Creativity, 54, Article 101645. https://doi.org/10.1016/j.tsc.2024.101645
Liu, W., & Wang, Y. (2024). The effects of using AI tools on critical thinking in English literature classes among EFL learners: An intervention study. European Journal of Education, 59(4). https://doi.org/10.1111/ejed.12804
Liu, J., & Sihes, A. J. B. (2025). Critical thinking in English language teaching in China: Definition, dimensions, and pedagogical implications. International Journal of Academic Research in Business and Social Sciences, 15(2), Article 24803. https://doi.org/10.6007/IJARBSS/v15-i2/24803
Liu, C., Hou, J., Tu, Y., Wang, Y., & Hwang, G. (2021). Incorporating a reflective thinking promoting mechanism into artificial intelligence-supported English writing environments. Interactive Learning Environments, 31, 5614 - 5632. https://doi.org/10.1080/10494820.2021.2012812
Liu, Y., Zhang, H., Jiang, M., Chen, J., & Wang, M. (2024). A systematic review of research on emotional artificial intelligence in English language education. System. https://doi.org/10.1016/j.system.2024.103478
Liu, G., Darvin, R., & , C. (2024). Exploring AI-mediated informal digital learning of English (AI-IDLE): a mixed-method investigation of Chinese EFL learners’ AI adoption and experiences. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2024.2310288
Lawasi, M., Rohman, V., & Shoreamanis, M. (2024). The Use of AI in Improving Student's Critical Thinking Skills. Proceedings Series on Social Sciences & Humanities. https://doi.org/10.30595/pssh.v18i.1279.
Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson Education
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki, M. (2023). Exploring artificial intelligence in academic essay: Higher education students’ perspective. International Journal of Educational Research Open, 5, 100296. https://doi.org/10.1016/j.ijedro.2023.100296
Mittal, U., Sai, S., Chamola, V., & Sangwan, D. (2024). A Comprehensive Review on Generative AI for Education. IEEE Access, 12, 142733-142759. https://doi.org/10.1109/ACCESS.2024.3468368.
Nguyen, T. (2022). Critical Thinking: What it means in a Vietnamese Tertiary EFL Context. English as a Foreign Language International Journal. https://doi.org/10.56498/3292632022.
Ozfidan, B., El‐Dakhs, D., & Alsalim, L. (2024). The use of AI tools in English academic writing by Saudi undergraduates. Contemporary Educational Technology. https://doi.org/10.30935/cedtech/15013.
Pakdel, F., Khojasteh, L., Kafipour, R., & Shahsavar, Z. (2025). Navigating AI writing tools in medical education: A SWOT analysis of L2 academic writing perspectives. Language Teaching Research. https://doi.org/10.1177/13621688251322953
Paul, R., & Elder, L. (2006). Critical Thinking: Learn the Tools the Best Thinkers Use. Pearson Prentice Hall.
Pervaiz, H., Ali, K., Razzaq, S., & Tariq, M. (2025). The Impact of Ai on Critical Thinking and Writing Skills in Higher Education. The Critical Review of Social Sciences Studies. https://doi.org/10.59075/79fkvy72
Ruiz-Rojas, L., Salvador-Ullauri, L., & Acosta-Vargas, P. (2024). Collaborative Working and Critical Thinking: Adoption of Generative Artificial Intelligence Tools in Higher Education. Sustainability. https://doi.org/10.3390/su16135367.
Rusandi, M., , A., Saripah, I., Khairun, D., & , M. (2023). No worries with ChatGPT: building bridges between artificial intelligence and education with critical thinking soft skills.. Journal of public health. https://doi.org/10.1093/pubmed/fdad049
Selwyn, N. (2019). Should robots replace teachers? AI and the future of education. Polity Press.
Sumakul, D. T. Y. G., Hamied, F. A., & Sukyadi, D. (2022). Artificial intelligence in EFL classrooms: Friend or foe? LEARN Journal: Language Education and Acquisition Research Network, 15(1), 232–256. https://so04.tci-thaijo.org/index.php/LEARN/article/view/260103.
Shafei, S., & Mahmood, S. (2025). Critical Analysis of the Impact of AI in Higher Education and Its Consequences on Students. Journal of Information Systems Engineering and Management. https://doi.org/10.52783/jisem.v10i12s.1943.
Shoufan, A. (2023). Exploring students’ perceptions of ChatGPT: Thematic analysis and follow-up survey. IEEE Access, 11, Article 3268224. https://doi.org/10.1109/ACCESS.2023.3268224
Setiawan, F., & Alkhowarizmi, A. (2025). Exploring an Artificial Intelligence as Automated Feedback Program in EFL Writing. ETERNAL (English Teaching Journal). https://doi.org/10.26877/eternal.v16i1.1206
Shen, X., & Teng, M. (2024). Three-wave cross-lagged model on the correlations between critical thinking skills, self-directed learning competency and AI-assisted writing. Thinking Skills and Creativity. https://doi.org/10.1016/j.tsc.2024.101524
Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1260843
Tian, J., & Low, G. D. (2011). Critical thinking and Chinese university students: A review of the evidence. Language, Culture and Curriculum, 24(1), 61–76. https://doi.org/10.1080/07908318.2010.546400
Wu, Z., Halim, H., & Saad, M. (2025). Impact of AI-Supported Multimodal Learning Environments on EFL Students’ Critical Thinking and Self-Regulation. Proceedings of The International Conference on Modern Research in Education, Teaching and Learning. https://doi.org/10.33422/icmetl.v4i1.769
Wang, Y., Wu, J., Chen, F., Wang, Z., Li, J., & Wang, L. (2024). Empirical Assessment of AI-Powered Tools for Vocabulary Acquisition in EFL Instruction. IEEE Access, 12, 131892-131905. https://doi.org/10.1109/ACCESS.2024.3446657
Wang, X., Liu, Q., Pang, H., Tan, S., Lei, J., Wallace, M., & Li, L. (2023). What matters in AI-supported learning: A study of human-AI interactions in language learning using cluster analysis and epistemic network analysis. Comput. Educ., 194, 104703. https://doi.org/10.1016/j.compedu.2022.104703
Walter, Y. (2024). Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21, 1-29. https://doi.org/10.1186/s41239-024-00448-3
Wang, Y., & Xue, L. (2024). Using AI-driven chatbots to foster Chinese EFL students' academic engagement: An intervention study. Comput. Hum. Behav., 159, 108353. https://doi.org/10.1016/j.chb.2024.108353.
Xu, T., & Jumaat, N. (2025). Enhancing Critical Thinking in EFL Writing Through an AI-Supported Blended Learning Model. International Journal of Academic Research in Progressive Education and Development. https://doi.org/10.6007/ijarped/v14-i1/24850
Yuan, L., & Liu, X. (2024). The effect of artificial intelligence tools on EFL learners' engagement, enjoyment, and motivation. Comput. Hum. Behav., 162, 108474. https://doi.org/10.1016/j.chb.2024.108474
Yeh, H. (2024). The synergy of generative AI and inquiry-based learning: transforming the landscape of English teaching and learning. Interactive Learning Environments, 33, 88 - 102. https://doi.org/10.1080/10494820.2024.2335491
Yuan, L., & Liu, X. (2024). The effect of artificial intelligence tools on EFL learners' engagement, enjoyment, and motivation. Comput. Hum. Behav., 162, 108474. https://doi.org/10.1016/j.chb.2024.108474
Yusuf, A., Bello, S., Pervin, N., & Tukur, A. (2024). Implementing a proposed framework for enhancing critical thinking skills in synthesizing AI-generated texts. Thinking Skills and Creativity. https://doi.org/10.1016/j.tsc.2024.101619
Zakaria, N., Hashim, H., & Jamaludin, K. (2025). Exploring the Impact of AI on Critical Thinking Development in ESL: A Systematic Literature Review. Arab World English Journal. https://doi.org/10.24093/awej/ai.19
Zapata-Rivera, J., Torre, I., Lee, C., Cabezuelo, A., Ghergulescu, I., & Libbrecht, P. (2024). Editorial: Generative AI in education. Frontiers in Artificial Intelligence, 7. https://doi.org/10.3389/frai.2024.1532896.
Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: A systematic review. Smart Learning Environments, 11(28). https://doi.org/10.1186/s40561-024-00316-7
