Exploring the Relationship Between Generative Artificial Intelligence Usage and the Development of University Students’ Critical Thinking in Higher Education

Agustina; Dwi Otik Kurniawati; Boy Lumoindong; Irwan Suanto

doi:10.55927/fjst.v5i8.145

Authors

Agustina Politeknik Arutala Johana Hendarto Jakarta
Dwi Otik Kurniawati UIN Sunan Kalijaga Yogyakarta
Boy Lumoindong Universitas Klabat
Irwan Suanto Universitas Islam Negeri Sultan Syarif Kasim Riau

DOI:

https://doi.org/10.55927/fjst.v5i8.145

Keywords:

Critical Thinking, Generative Artificial Intelligence, Students, Higher Education, Longitudinal Studies.

Abstract

The increasingly widespread use of generative artificial intelligence (GenAI) in higher education has raised concerns about its influence on the development of students' critical thinking. This study aims to analyze the relationship between the intensity of GenAI use and changes in students' critical thinking skills. The study used a quantitative approach with a longitudinal correlational design on 186 students from three universities. Data was collected through GenAI usage questionnaires and critical thinking tests at the beginning and end of the semester. The analysis was performed using descriptive statistics, paired t-tests, Pearson correlation, and linear regression. The results showed an increase in critical thinking scores from 68.4 to 74.9, as well as a moderate positive relationship between the use of reflective GenAI and critical thinking development (r=0.46; p<0.001). The findings confirm the importance of the integration of directed, reflective, and evaluation-based GenAI in learning to improve the quality of higher education

References

Agustin, F. A. P., Wulandari, O., & Rusydiyah, E. F. (2024). Enhancing digital literacy through Chat GPT: The impact on Islamic education research skills among students at State Islamic University. Tribakti: Jurnal Pemikiran Keislaman, 35(2), 181–198. https://doi.org/10.33367/tribakti.v35i2.5391

Akastangga, M. D. F., Harmonis, S., & Al Hafidz, R. A. (2023). The impact of ChatGPT on the critical thinking ability of UIN Sunan Kalijaga students. Matrix: Jurnal Manajemen Teknologi dan Informatika, 13(3), 157–165. https://doi.org/10.31940/matrix.v13i3.157-165

Amin, A. M., Adiansyah, R., & Hujjatusnaini, N. (2023). The contribution of communication and digital literacy skills to critical thinking. Jurnal Pendidikan Sains Indonesia, 11(3), 697–712. https://doi.org/10.24815/jpsi.v11i3.30838

Baiquni, A., Rusli, T. I., Juhardin, J., Kholida, L., & Arsam, A. (2025). Analysis of the impact of ChatGPT on learning productivity of Islamic education students. EDURELIGIA: Jurnal Pendidikan Agama Islam, 9(1), 68–81. https://doi.org/10.33650/edureligia.v9i1.10407

Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20, Article 43. https://doi.org/10.1186/s41239-023-00411-8

Darwin, Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki. (2024). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11(1), Article 2290342. https://doi.org/10.1080/2331186X.2023.2290342

Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6, Article 100198. https://doi.org/10.1016/j.caeai.2023.100198

Fadholi, M. A. F. (2025). Application of the Technology Acceptance Model to Chat GPT to measure the critical thinking power of UIN Sunan Ampel Surabaya students. Multitek Indonesia: Jurnal Ilmiah, 19(1), 85–96. https://doi.org/10.24269/mtkind.v19i1.12209

Firdaus, J. A., Ummah, R. I., Aprialini, R. R., Fithriyyah, A., Mahsusi, & Faizin, A. (2025). Ketergantungan penggunaan kecerdasan buatan (AI) pada tugas akademik mahasiswa terhadap kemampuan berpikir kritis dan kreatif. Didaktika: Jurnal Kependidikan, 14(1), 1203–1214. https://doi.org/10.58230/27454312.1634

Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(1), Article 6. https://doi.org/10.3390/soc15010006

Gümüş, M. M., & Kara, M. (2025). Development and validation of the Generative AI Literacy for Learning Scale (GenAI-LLs). Australasian Journal of Educational Technology, 41(4), 1–16. https://doi.org/10.14742/ajet.10236

Hasim, S., Khaira, M., Karunia, G. C. M. K., Limbong, J. A., & Amelia, D. (2023). Pengaruh penggunaan Chat GPT terhadap minat baca mahasiswa. EDUTECH: Jurnal Teknologi Pendidikan, 22(3), 269–279. https://doi.org/10.17509/e.v22i3.62944

Hutapea, G. L., & Rantung, J. (2024). Hubungan persepsi mahasiswa keperawatan dengan sikap penggunaan Chat GPT. Jurnal Penelitian Inovatif, 4(2), 519–528. https://doi.org/10.54082/jupin.350

Hutapea, N. M., & Kabatiah, M. (2025). Pengaruh penggunaan ChatGPT terhadap kemampuan berpikir kritis mahasiswa Jurusan PPKN Angkatan 2023 FIS Unimed. SOCIAL: Jurnal Inovasi Pendidikan IPS, 5(3), 1062–1071. https://doi.org/10.51878/social.v5i3.6709

Jasmadi, J., Saddam, S., & Lasri, L. (2024). Critical thinking: An analytical study on the impact of artificial intelligence (AI) usage on students at Al Washliyah Darussalam University, Banda Aceh. Sekumpul: Journal of Multidisciplinary Education Sciences, 2(1), 25–32. https://doi.org/10.62568/jomes.v2i1.168

Lukman, L., Agustina, R., & Aisy, R. (2023). Problematika penggunaan artificial intelligence (AI) untuk pembelajaran di kalangan mahasiswa STIT Pemalang. Madaniyah, 13(2), 242–255. https://doi.org/10.58410/madaniyah.v13i2.826

Manurung, O., Destiani, A. C., Sugiarto, J., Lolo, A. T. A., & Chai, K. (2023). Identifikasi pengaruh penggunaan ChatGPT terhadap kemampuan berfikir mahasiswa di Universitas Atma Jaya Yogyakarta Prodi Sistem Informasi Angkatan 2021. KONSTELASI: Konvergensi Teknologi dan Sistem Informasi, 3(2), 342–352. https://doi.org/10.24002/konstelasi.v3i2.7241

Nasr, N. R., Tu, C.-H., Werner, J., Bauer, T., Yen, C.-J., & Sujo-Montes, L. (2025). Exploring the impact of generative AI ChatGPT on critical thinking in higher education: Passive AI-directed use or human–AI supported collaboration? Education Sciences, 15(9), Article 1198. https://doi.org/10.3390/educsci15091198

Nazila, M., Mahardika, D., & Sugara, H. (2025). Pengaruh penggunaan ChatGPT terhadap kemampuan berpikir kritis pada mahasiswa bimbingan dan konseling di Universitas Indraprasta PGRI. TheraEdu: Journal of Therapy and Educational Psychology, 1(1), 11–20. https://doi.org/10.63203/021817500

Oates, A., & Johnson, D. (2025). ChatGPT in the classroom: Evaluating its role in fostering critical evaluation skills. International Journal of Artificial Intelligence in Education, 35(4), 1793–1824. https://doi.org/10.1007/s40593-024-00452-8

Putri, M. A., & Panduwinata, L. F. (2025). Pengaruh penggunaan artificial intelligence terhadap berpikir kritis mahasiswa. Jurnal Kajian Ilmu Pendidikan, 6(2), 605–616. https://doi.org/10.55583/jkip.v6i2.1413

Rahmanto, A. A., Arum, M., Rahmawati, D. R., Wijayanti, V. C., & Ramadhan, G. (2024). Artificial intelligence dan critical thinking: Systematic literature review. Jurnal PIPSI: Jurnal Pendidikan IPS Indonesia, 9(3), 242–251. https://doi.org/10.26737/jpipsi.v9i3.5545

Rahmawati, L., Yuliawati, R., Anisah, A., & Hermansyah. (2025). Analisis pengaruh pemanfaatan ChatGPT terhadap keterampilan menyusun pertanyaan efektif pada mahasiswa pendidikan ekonomi. JATI: Jurnal Mahasiswa Teknik Informatika, 9(5), 7858–7864. https://doi.org/10.36040/jati.v9i5.14921

Refaldi, D. A., Faiz, A., Jawakory, M. R., & Rakhmawati, N. A. (2024). Analisis korelasi Pearson faktor pengaruh generative AI terhadap kemampuan berpikir kritis mahasiswa ITS Surabaya. Jurnal Sistem Informasi dan Aplikasi, 2(2), 9–19. https://doi.org/10.52958/jsia.v2i2.7974

Ria, R. R. P., & Yuda, L. S. (2025). Efek Chat Generative Pre-training Transformer terhadap kemampuan berpikir kritis dan computational thinking mahasiswa dalam penulisan karya ilmiah di era Revolusi Industri 5.0. UPGRADE: Jurnal Pendidikan Teknologi Informasi, 2(2), 9–19. https://doi.org/10.30812/upgrade.v2i2.4777

Rizaldi, M., Sasalia, P., & Pancarita. (2024). Efektivitas ChatGPT untuk mendorong berpikir kritis mahasiswa dalam menyelesaikan masalah aljabar. EDU-MAT: Jurnal Pendidikan Matematika, 12(1), 168–181. https://doi.org/10.20527/edumat.v12i1.18668

Saraswati, A. R., Karmina, V. A., Efendi, M. P., Candrakanti, Z., & Rakhmawati, N. A. (2023). Analisis pengaruh ChatGPT terhadap tingkat kemalasan berpikir mahasiswa ITS dalam proses pengerjaan tugas. Jurnal Pendidikan, Bahasa dan Budaya, 2(4), 40–48. https://doi.org/10.55606/jpbb.v2i4.2223

van den Berg, G., & du Plessis, E. (2023). ChatGPT and generative AI: Possibilities for its contribution to lesson planning, critical thinking and openness in teacher education. Education Sciences, 13(10), Article 998. https://doi.org/10.3390/educsci13100998

Veronica, S. Y., Nurfairuzah, D. S., Aulia, I. R., & Azizy, P. Y. (2025). Persepsi mahasiswa dalam penggunaan AI terhadap keterampilan berpikir. BASINDO: Jurnal Kajian Bahasa, Sastra Indonesia, dan Pembelajarannya, 9(2), 328–341. https://doi.org/10.17977/um007v9i22025p328-341

Yusuf, A., Bello, S., Pervin, N., & Tukur, A. K. (2024). Implementing a proposed framework for enhancing critical thinking skills in synthesizing AI-generated texts. Thinking Skills and Creativity, 53, Article 101619. https://doi.org/10.1016/j.tsc.2024.101619