Email this article 
The Impact of Artificial Intelligence on Thesis Writing Skills and Quality among Students at UPN "Veteran" Yogyakarta
Abstract
This study examines the influence of artificial intelligence (AI) on students' thesis-writing abilities in higher education by evaluating its effects on writing proficiency, draft quality, and efficiency in thesis completion. The research employs Partial Least Squares (PLS) structural equation modeling to analyze data collected from 120 undergraduate students at UPN "Veteran" Yogyakarta who frequently utilized AI tools such as Turnitin and Grammarly. Structured questionnaires with high reliability and validity were used for data collection. The findings reveal that AI tools significantly enhance technical aspects of thesis writing, including grammar, coherence, and vocabulary, resulting in improved thesis quality. However, their contribution to developing deeper academic skills, such as critical thinking and argumentation, remains limited. While AI tools effectively address surface-level issues and provide valuable suggestions, they do not adequately support the cultivation of advanced intellectual abilities required for rigorous academic writing. This study highlights the importance of integrating AI tools with traditional teaching methods. Educators are encouraged to use AI to assist with technical writing while continuing to teach critical thinking and argumentation to develop well-rounded writing skills. A balanced approach combining AI technology and human guidance is essential for fostering both technical proficiency and the intellectual depth necessary for high-quality thesis writing.
Keywords
Full Text:
PDFReferences
Abdullah, M. I., Huang, D., Sarfraz, M., Ivascu, L., & Riaz, A. (2021). Effects of internal service quality on nurses’ job satisfaction, commitment and performance: Mediating role of employee well-being. Nursing Open, 8(2), 607–619. https://doi.org/10.1002/nop2.665
Al Mahmud, F. (2023). Investigating EFL Students’ Writing Skills Through Artificial Intelligence: Wordtune Application as a Tool. Journal of Language Teaching and Research, 14(5), 1395–1404. https://doi.org/10.17507/jltr.1405.28
Alharbi, W. (2023). AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools. Education Research International, 2023. https://doi.org/10.1155/2023/4253331
Aljuaid, H. (2024). The Impact of Artificial Intelligence Tools on Academic Writing Instruction in Higher Education: A Systematic Review. Arab World English Journal, 1(1), 26–55. https://doi.org/10.24093/awej/chatgpt.2
Amyatun, R. L., & Kholis, A. (2023). Can Artificial Intelligence (AI) like QuillBot AI Assist Students’ Writing Skills? Assisting Learning to Write Texts using AI. ELE Reviews: English Language Education Reviews, 3(2), 135–154. https://doi.org/10.22515/elereviews.v3i2.7533
Anik, M. H. (2023). Embracing AI Assistants : Unraveling Young Researchers ’ Journey with ChatGPT in Science Education Thesis Writing. Science Education Thesis Writing, PREPRINT (. https://www.researchsquare.com/article/rs-3481002/latest
Biliavska, V., Castanho, R. A., & Vulevic, A. (2022). Analysis of the Impact of Artificial Intelligence in Enhancing the Human Resource Practices. Journal of Intelligent Management Decision, 1(2), 128–136. https://doi.org/10.56578/jimd010206
Cannas, V. G., Ciano, M. P., Saltalamacchia, M., & Secchi, R. (2024). Artificial intelligence in supply chain and operations management: a multiple case study research. International Journal of Production Research, 62(9), 3333–3360.
https://doi.org/10.1080/00207543.2023.2232050
Çoşkun, H., Taştan, S., İyigün, E., Mutlu, F. M., Ceylan, O. M., & Altinsoy, H. İ. (2017). Study on the validity and reliability of the amblyopia and strabismus questionnaire (A&SQ) in Turkish. Turkish Journal of Medical Sciences, 47(2), 483–489. https://doi.org/10.3906/sag-1512-86
Dergaa, I., Chamari, K., Zmijewski, P., & Saad, H. Ben. (2023). From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40(2), 615–622.
https://doi.org/10.5114/BIOLSPORT.2023.125623
Dhaniarti, I., Handayani, I., & Bachri, E. W. (2019). The Utilization Management of Path Analysis Methods to Improve Quality in Writing Research Reports at Higher Education. Aptisi Transactions on Management (ATM), 2(2), 121–128. https://doi.org/10.33050/atm.v2i2.816
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71(March). https://doi.org/10.1016/j.ijinfomgt.2023.102642
Eckes, A., Großmann, N., & Wilde, M. (2018). Studies on the effects of structure in the context of autonomy-supportive or controlling teacher behavior on students’ intrinsic motivation. Learning and Individual Differences, 62, 69–78. https://doi.org/10.1016/J.LINDIF.2018.01.011
Forza, A. G., & Nugroho, S. P. (2023). The Influence Of Remote Work On Innovation Work Behavior With Work Life Behavior And Technostress As Moderating Variables. International Conference on Digital Advance Tourism, Management and Technology, 1(1), 457–466. https://doi.org/10.56910/ictmt.v1i1.89
Ginting, D., & Barella, Y. (2022). Academic writing centers and the teaching of academic writing at colleges: Literature review. Journal of Education and Learning (EduLearn), 16(3), 350–356. https://doi.org/10.11591/edulearn.v16i3.20473
Hegde, A., Srinivasan, S., & Menon, G. (2023). Extraventricular Neurocytoma of the Posterior Fossa: A Case Report Written by ChatGPT. Cureus, April. https://doi.org/10.7759/cureus.35850
Henseler, J., Hubona, G., & Ray, P. A. (2016). Using PLS path modeling in new technology research: Updated guidelines. Industrial Management and Data Systems, 116(1), 2–20. https://doi.org/10.1108/IMDS-09-2015-0382
Hwang, W.-Y., Nurtantyana, R., Purba, S. W. D., Hariyanti, U., Indrihapsari, Y., & Surjono, H. D. (2023). AI and Recognition Technologies to Facilitate English as Foreign Language Writing for Supporting Personalization and Contextualization in Authentic Contexts. Journal of Educational Computing Research, 61(5), 1008–1035. https://doi.org/https://doi.org/10.1177/07356331221137253
Ilma, A., & Sampurna, R. A. A. (2024). Exploring the Impact of Language Models on Undergraduate Thesis Writing Skills among Higher Education Students. Peradaban Journal of Interdisciplinary Educational Research, 2(1), 1–21. https://doi.org/10.59001/pjier.v2i1.152
Jungwirth, D., & Haluza, D. (2023). Artificial Intelligence and the Sustainable Development Goals: An Exploratory Study in the Context of the Society Domain. Journal of Software Engineering and Applications, 16(04), 91–112. https://doi.org/10.4236/jsea.2023.164006
Jurado, R. G., Pettersson, T., & Zwierewicz, M. (2023). Students ’ Attitudes To The Use Of Artificial Intelligence. Conference Name: 16th Annual International Conference of Education, Research and Innovation.
Kautsar, F. A., & Muslichah, M. (2022). The Influence of Accounting Information System Quality on Employee Performance with Good Corporate Governance as a Moderating Variable. International Journal of Science and Management Studies (IJSMS), August, 262–269. https://doi.org/10.51386/25815946/ijsms-v5i4p128
Kim, J., Lee, H., & Cho, Y. H. (2022). Learning design to support student-AI collaboration: perspectives of leading teachers for AI in education. In Education and Information Technologies (Vol. 27, Issue 5). Springer US. https://doi.org/10.1007/s10639-021-10831-6
Kock, N. (2015). A note on how to conduct a factor-based PLS-SEM analysis. International Journal of E-Collaboration, 11(3), 1–9. https://doi.org/10.4018/ijec.2015070101
Kooli, C. (2023). Chatbots en educación e investigación: un examen crítico de las implicaciones y soluciones éticas. Sustainability (Switzerland), 15(7).
Kosasi, S., Lukita, C., Rizachakim, M. H., Faturahman, A., & Kusumawardhani, D. A. R. (2023). The Influence of Digital Artificial Intelligence Technology on Quality of Life with a Global Perspective. APTISI Transactions on Technopreneurship, 5(3), 240–250. https://doi.org/10.34306/att.v5i3.354
Leguina, A. (2015). A primer on partial least squares structural equation modeling (PLS-SEM). International Journal of Research & Method in Education, 38(2), 220–221. https://doi.org/10.1080/1743727x.2015.1005806
Liang, Y. (2023). Balancing: The Effects of AI Tools in Educational Context. Frontiers in Humanities and Social Sciences, 3(8), 7–10. https://doi.org/10.54691/fhss.v3i8.5531
Lim, W. M. (2024). A typology of validity: content, face, convergent, discriminant, nomological and predictive validity. Journal of Trade Science, 12(3), 155–179. https://doi.org/10.1108/jts-03-2024-0016
Liza, L., & Mariana, M. (2023). Can Budget Ratcheting Moderate the Relationship Between Financial Performance and Capital Expenditures? Journal of Data Acquisition and Processing, 38(3), 5472–5485. https://doi.org/10.5281/zenodo.777718
Mariana, Abdullah, S., & Mahmud, M. (2020). Corporate Governance Perception Index , Profitability and Firm Value in Indonesia. Technology and Investment, 11(2), 13–21. https://doi.org/10.4236/ti.2020.112002
Mariana, M., Abdullah, S., & Nadirsyah, N. (2018). Informasi Akuntansi, Informasi Non-Akuntansi, Dan Keputusan Pemberian Kredit. Jurnal Reviu Akuntansi Dan Keuangan, 8(2), 177. https://doi.org/10.22219/jrak.v8i2.37
Maulidina, A., Hidayah, Z., & Maharani, A. (2021). Indonesian Management and Accounting Research Dynamics of Work from Home in The Time of Pandemic Covid-19 as The Implementation of. Indonesian Management and Accounting Research, 20(02).
Miranty, D., Widiati, U., Cahyono, B. Y., & Sharif, T. I. S. T. (2023). Automated writing evaluation tools for Indonesian undergraduate English as a foreign language students’ writing. International Journal of Evaluation and Research in Education, 12(3), 1705–1715. https://doi.org/10.11591/ijere.v12i3.24958
Mohammed, A. M. A. (2024). Investigating EFL Faculty Members’ Perceptions of Integrating Artificial Intelligence Applications to Improve the Research Writing Process: A Case Study at Majmaah University. Arab World English Journal, 1(1), 169–183. https://doi.org/10.24093/awej/chatgpt.11
Momayyezi, M., Fallahzadeh, H., Farzaneh, F., & Momayyezi, M. (2019). Iranian Version of Cancer-Related Fatigue Questionnaire: Construction and Validation. Zahedan Journal of Research in Medical Sciences, In Press(In Press). https://doi.org/10.5812/zjrms.69187
Moussa, A., & Belhiah, H. (2024). Beyond Syntax: Exploring Moroccan Undergraduate with AI-Assisted Writing. Arab World English Journal, 1(1), 138–155. https://doi.org/10.24093/awej/chatgpt.9
Nguyen, T. M., & Malik, A. (2022). A Two-Wave Cross-Lagged Study on AI Service Quality: The Moderating Effects of the Job Level and Job Role. British Journal of Management, 33(3), 1221–1237. https://doi.org/10.1111/1467-8551.12540
Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187–192. https://doi.org/10.1126/science.adh2586
Pedersen, I. (2023). The rise of generative AI and enculturating AI writing in postsecondary education. Frontiers in Artificial Intelligence, 6. https://doi.org/10.3389/frai.2023.1259407
Pinto, D. S., Noronha, S. M., Saigal, G., & Quencer, R. M. (2024). Comparison of an AI-Generated Case Report With a Human-Written Case Report: Practical Considerations for AI-Assisted Medical Writing. Cureus, 16(5). https://doi.org/10.7759/cureus.60461
Rahman, M. M., Khatun, F., Uzzaman, A., Sami, S. I., Bhuiyan, M. A. A., & Kiong, T. S. (2021). A Comprehensive Study of Artificial Intelligence and Machine Learning Approaches in Confronting the Coronavirus (COVID-19) Pandemic. International Journal of Health Services, 51(4), 446–461.
https://doi.org/10.1177/00207314211017469
Rahman, N. A. A., Zulkornain, L. H., & Hamzah, N. H. (2022). Exploring Artificial Intelligence using Automated Writing Evaluation for Writing Skills. Environment-Behaviour Proceedings Journal, 7(SI9), 547–553. https://doi.org/10.21834/ebpj.v7isi9.4304
Rönkkö, M., & Evermann, J. (2013). A Critical Examination of Common Beliefs About Partial Least Squares Path Modeling. Organizational Research Methods, 16(3), 425–448. https://doi.org/10.1177/1094428112474693
Rosli, M. S., Saleh, N. S., Alshammari, S. H., Ibrahim, M. M., Atan, A. S., & Atan, N. A. (2021). Improving Questionnaire Reliability using Construct Reliability for Researches in Educational Technology. International Journal of Interactive Mobile Technologies, 15(4), 109–116. https://doi.org/10.3991/IJIM.V15I04.20199
Sarstedt, M., & Ringle, C. M. (2010). Treating unobserved heterogeneity in PLS path modeling: A comparison of FIMIX-PLS with different data analysis strategies. Journal of Applied Statistics, 37(8), 1299–1318. https://doi.org/10.1080/02664760903030213
Selim, A. S. M. (2024). The Transformative Impact of AI-Powered Tools on Academic Writing: Perspectives of EFL University Students. International Journal of English Linguistics, 14(1), 14. https://doi.org/10.5539/ijel.v14n1p14
Sunarsih, S., Harahap, F., Habibullah, H., & Afandi, M. (2020). The Validity and Reliability of Subjective Well-Being Instruments in Early Adolescents. Humaniora, 11(2), 111–120. https://doi.org/10.21512/humaniora.v11i2.6461
Suryanto, S., Habiburrahim, H., Akmal, S., Zainuddin, Z., Safrul, M. S., & Hanani, F. (2024). Scrutinizing the Impacts of Grammarly Application on Students’ Writing Performance and Perception. Jurnal Ilmiah Peuradeun, 12(2), 465–490. https://doi.org/10.26811/peuradeun.v12i2.1235
Taber, K. S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Talan, T., & Kalinkara, Y. (2023). The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course. Uluslararası Yönetim Bilişim Sistemleri ve Bilgisayar Bilimleri Dergisi, 7(1), 33–40. https://doi.org/10.33461/uybisbbd.1244777
Tohan, Nyoto, & Chandra, T. (2022). The Effect of Teacher’s Competence on the Vocational High School Teachers’ Work Satisfaction and Performance in Prajnamitra Maitreya Foundation, Riau. International Conference on Business Management and Accounting (ICOBIMA), 1(1), 193–212.
Utami, S. P. T., Andayani, Winarni, R., & Sumarwati. (2023). Utilization of artificial intelligence technology in an academic writing class: How do Indonesian students perceive? Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13419
Wang, J. T. H. (2023). Is the laboratory report dead? AI and ChatGPT. Microbiology Australia, 44(3), 144–148. https://doi.org/10.1071/MA23042
Warsini, S., Buettner, P., Mills, J., West, C., & Usher, K. (2015). Psychometric evaluation of the Indonesian version of the Impact of Event Scale-Revised. Journal of Psychiatric and Mental Health Nursing, 22(4), 251–259. https://doi.org/10.1111/jpm.12194
Zou, D., Luo, S., Xie, H., & Hwang, G. J. (2020). A systematic review of research on flipped language classrooms: theoretical foundations, learning activities, tools, research topics and findings. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2020.1839502
Zulfa, S., Dewi, R. S., Hidayat, D. N., Hamid, F., & Defianty, M. (2023). The Use of AI and Technology Tools in Developing Students’ English Academic Writing Skills. The Annual International Conference on Education, 1, 47–63.
DOI: https://doi.org/10.31315/jik.v22i3.14257
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Jurnal Ilmu Komunikasi
Jurnal Ilmu Komunikasi indexed by:
Copyright of Jurnal Ilmu Komunikasi ISSN 1693-3028 (print), ISSN 2407-8220 (online)
Alamat:
Kampus II UPN "Veteran" Yogyakarta, Jl. Babarsari 2, Tambakbayan, Yogyakarta 55281
Phone: (0274)485268
Fax: (0274)487147
Email: jik@upnyk.ac.id