Student Academic Writing Analysis for AI-Based Adaptive Learning System Development Case Study: Building Engineering Education Students

Sri Rahayu; Danny Meirawan; Hanifah Indah Rahmawati; Zahra Ghinaya

doi:10.71222/haezsx57

Authors

Sri Rahayu Technical and Vocational Education, Universitas Pendidikan Indonesia, Bandung, Indonesia Author
Danny Meirawan Building Engineering Education, Universitas Pendidikan Indonesia, Bandung, Indonesia Author
Hanifah Indah Rahmawati Building Engineering Education, Universitas Pendidikan Indonesia, Bandung, Indonesia Author
Zahra Ghinaya Building Engineering Education, Universitas Pendidikan Indonesia, Bandung, Indonesia Author

DOI:

https://doi.org/10.71222/haezsx57

Keywords:

academic writing, artificial intelligence, higher education

Abstract

The advancement of Artificial Intelligence (AI) technology in higher education has been suboptimal in tackling the challenges of student academic writing, as current systems primarily concentrate on technical enhancements and have yet to effectively aid students in formulating logical arguments and coherently organizing ideas. This research seeks to evaluate students' academic writing abilities to inform the development of an AI-driven learning system tailored to their specific requirements. A descriptive quantitative methodology was employed to gather data via online questionnaires from 50 students enrolled in the Building Engineering Education Study Program. The instruments were predicated on five dimensions: writing structure, language proficiency, argumentation and logic, reference utilization, and technical writing skills, utilizing a 1-5 Likert scale. The findings indicate that PTB students fall within the "Very Capable" classification, attaining an average score of 82%. The utilization of references garnered the greatest score at 87%, although writing structure and logical argumentation remain at the lowest level, scoring 79%. The findings reveal difficulties in shifting from descriptive technical writing to argumentative academic discourse, underscoring the necessity for an AI-driven learning system that incorporates a corpus-based instructional method to deliver comprehensive feedback on the formation of coherent argumentation structures. The study advocates for the creation of a comprehensive AI system prototype and its extension to other engineering programs to enhance the academic literacy of students across the nation.

References

1. S. Ocen, J. Elasu, S. M. Aarakit, and C. Olupot, “Artificial intelligence in higher education institutions: review of innovations, opportunities and challenges,” in Frontiers in Education, 2025, vol. 10, p. 1530247.

2. X. Zhai, “Transforming teachers’ roles and agencies in the era of generative AI: Perceptions, acceptance, knowledge, and practices,” J. Sci. Educ. Technol., pp. 1–11, 2024.

3. C. J. Crompton, D. Ropar, C. V. M. Evans-Williams, E. G. Flynn, and S. Fletcher-Watson, “Autistic peer-to-peer information transfer is highly effective,” Autism, vol. 24, no. 7, pp. 1704–1712, 2020.

4. W. Strielkowski, V. Grebennikova, A. Lisovskiy, G. Rakhimova, and T. Vasileva, “AI‐driven adaptive learning for sustainable educational transformation,” Sustain. Dev., vol. 33, no. 2, pp. 1921–1947, 2025.

5. H. Aljuaid, “The impact of artificial intelligence tools on academic writing instruction in higher education: A systematic review,” Arab World English J. Spec. Issue ChatGPT, 2024.

6. T. Arseven and M. Bal, “Critical literacy in artificial intelligence assisted writing instruction: A systematic review,” Think. Ski. Creat., vol. 57, p. 101850, 2025.

7. V. Bradáč, P. Smolka, M. Kotyrba, and T. Průdek, “Design of an intelligent tutoring system to create a personalized study plan using expert systems,” Appl. Sci., vol. 12, no. 12, p. 6236, 2022.

8. B. D. Lund, T. Wang, N. R. Mannuru, B. Nie, S. Shimray, and Z. Wang, “ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing,” J. Assoc. Inf. Sci. Technol., vol. 74, no. 5, pp. 570–581, 2023.

9. T. Amano et al., “The manifold costs of being a non-native English speaker in science,” PLoS Biol., vol. 21, no. 7, p. e3002184, 2023.

10. E. M. Nussbaum, “Critical integrative argumentation: Toward complexity in students’ thinking,” Educ. Psychol., vol. 56, no. 1, pp. 1–17, 2021.

11. H.-Y. Hong, M.-J. Chen, C.-H. Chang, L.-T. Tseng, and C. S. Chai, “AI-supported idea-developing discourse to foster professional agency within teacher communities for STEAM lesson design in knowledge building environment,” Comput. Educ., vol. 229, p. 105241, 2025.

12. Y. S. Rao, “One Nation One Subscription (ONOS) Initiative: SWOT Analysis,” Ann. Libr. Inf. Stud., vol. 72, no. 3, pp. 298–305, 2025.

13. V. Lin, N. E. Barrett, G.-Z. Liu, and H. H.-J. Chen, “A systematic review on inquiry-based writing instruction in tertiary settings,” Writ. Commun., vol. 40, no. 1, pp. 238–281, 2023.

14. D. Zhang, J. T. A. Tan, and S. S. Roy, “A systematic review of interventions improving university students’ EFL writing competence,” Int. J. Learn. Teach. Educ. Res., vol. 22, no. 10, pp. 93–112, 2023.

15. L. Satyaloka and R. T. Padmaningrum, “Systematic Literature Review: Students’ Scientific Argumentation Skills in Chemistry Learning,” Indones. J. Chem. Educ., vol. 1, no. 2, pp. 42–47, 2024.

16. R. Michel-Villarreal, E. Vilalta-Perdomo, D. E. Salinas-Navarro, R. Thierry-Aguilera, and F. S. Gerardou, “Challenges and opportunities of generative AI for higher education as explained by ChatGPT,” Educ. Sci., vol. 13, no. 9, p. 856, 2023.

17. E. R. Babbie, The practice of social research. Cengage Au, 2020.

18. I. H. Sarker, “AI-based modeling: techniques, applications and research issues towards automation, intelligent and smart systems,” SN Comput. Sci., vol. 3, no. 2, p. 158, 2022.

19. H. Crompton, D. Burke, and K. H. Gregory, “The use of mobile learning in PK-12 education: A systematic review,” Comput. Educ., vol. 110, pp. 51–63, 2017.

20. L. Chen, P. Chen, and Z. Lin, “Artificial intelligence in education: A review,” IEEE access, vol. 8, pp. 75264–75278, 2020.

21. A. Nguyen, Y. Hong, B. Dang, and X. Huang, “Human-AI collaboration patterns in AI-assisted academic writing,” Stud. High. Educ., vol. 49, no. 5, pp. 847–864, 2024.

22. W. M. Phyo, M. Nikolov, and Á. Hódi, “What support do international doctoral students claim they need to improve their academic writing in English?,” Ampersand, vol. 12, p. 100161, 2024.

23. C. Zhai, S. Wibowo, and L. D. Li, “The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: a systematic review,” Smart Learn. Environ., vol. 11, no. 1, p. 28, 2024.

24. M. B. A. Riduwan, “Skala pengukuran variabel-variabel penelitian,” 2022.

25. A. Bello, T. Blowers, S. Schneegans, and T. Straza, “3. To be smart, the digital revolution will need,” UNESCO Sci. Rep. race against time smarter Dev., vol. 2021, p. 109, 2021.

26. X. Zhang, Y. Y. Xu, and L. Ma, “Information technology investment and digital transformation: the roles of digital transformation strategy and top management,” Bus. Process Manag. J., vol. 29, no. 2, pp. 528–549, 2023.

27. Y. Shang, S. Zhou, D. Zhuang, J. Żywiołek, and H. Dincer, “The impact of artificial intelligence application on enterprise environmental performance: Evidence from microenterprises,” Gondwana Res., vol. 131, pp. 181–195, 2024.

28. M. A. Rahman, “Gender Bias in Academic Writing: Challenges and Equity Strategies,” Muadalah, vol. 12, no. 1, pp. 15–26, 2024.

29. Y. Chen, M. Li, and M. S.-Y. Jong, “Engaging Young Students in Effective Writing Development: An Augmented Reality-Based Peer Assessment Approach Within a Self-Regulated Learning Context,” J. Educ. Comput. Res., p. 07356331251342672, 2025.

30. R. C. Blackburn and S. R. Madsen, “Women and STEM− A 2025 Update,” Utah Women Stats Res. Snapshot, vol. 58, p. 1, 2025.

31. Y. Shang, G. Sivertsen, Z. Cao, and L. Zhang, “Gender differences among first authors in research focused on the Sustainable Development Goal of Gender Equality,” Scientometrics, vol. 127, no. 8, pp. 4769–4796, 2022.

32. Y. Ma, Y. Teng, Z. Deng, L. Liu, and Y. Zhang, “Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis,” Scientometrics, vol. 128, no. 4, pp. 2105–2143, 2023.

33. Y. Shen et al., “ChatGPT and other large language models are double-edged swords,” Radiology, vol. 307, no. 2. Radiological Society of North America, p. e230163, 2023.

34. B. Wing Yee Siu, M. Afzaal, H. Saleh Aldayel, and S. Curle, “Unlocking the mysteries of academic writing: a corpus-based analysis of lexical bundles in L2 English for engineering students,” Sage Open, vol. 14, no. 4, p. 21582440241299996, 2024.

35. S. W. Y. Barbara, M. Afzaal, and H. S. Aldayel, “A corpus-based comparison of linguistic markers of stance and genre in the academic writing of novice and advanced engineering learners,” Humanit. Soc. Sci. Commun., vol. 11, no. 1, pp. 1–10, 2024.

36. E. Barabadi, S. E. Golparvar, and A. Arghavan, “To put it differently: A cross-disciplinary investigation of reformulation markers in student essays,” Discourse Process., vol. 58, no. 9, pp. 787–803, 2021.

37. I. Vaňková, “Phraseological patterns supporting effective academic writing rhetoric: The case of pedagogy research paper introductions,” Russ. J. Linguist., vol. 29, no. 2, pp. 296–319, 2025.

38. R. Esfandiari and M. Ahmadi, “Syntactic complexity measures and academic writing proficiency: A corpus-based study of professional and students’ prose,” J. Asia TEFL, vol. 18, no. 3, p. 745, 2021.

39. D. Li, N. Noordin, L. Ismail, and D. Cao, “A systematic review of corpus-based instruction in EFL classroom,” Heliyon, vol. 11, no. 2, 2025.

40. A. T. Birhan and Y. Nurie, “Developing engineering students’ engagement in academic writing classes using corpus-based instruction,” Asian-Pacific J. Second Foreign Lang. Educ., vol. 9, no. 1, p. 11, 2024.