Enhancing job application writing: A comparative case study of AI and human feedback on grammar and mechanics
DOI:
https://doi.org/10.26418/jeltim.v7i1.89240Keywords:
artificial intelligence (AI), feedback, job application, writingAbstract
Submission of well-structured job application letters is an essential aspect of business and government recruitment processes. However, due to difficulties with grammar and mechanics, many students, fresh graduates included, fail to produce high-quality job applications. While human reviewers typically give feedback to enhance these skills, Artificial Intelligence (AI) has brought about automated feedback systems. The research compared the performance of two artificial intelligence models, Gemini and ChatGPT, and human experts in assessing job application letters. The study compared feedback in six writing features"”subject-verb agreement, parallelism, spelling, capitalization, punctuation, and sentence variety"”of 10 job application letters composed by final-year high school students. Results indicated that ChatGPT and Gemini performed better than human experts in most metrics. These findings add to the discussion of using AI to improve application letter quality and offer implications regarding the potential of AI-assisted writing feedback. Integrating such tools into writing instruction can offer consistent, real-time feedback, thereby supporting skill development and improving students' employability prospects. The study contributes to the growing field of AI in education by highlighting the practical benefits and potential limitations of AI-generated feedback in high-stakes writing tasks such as job applications
How to cite this paper: Noerjaman, L. A., Dallyono, R., & Hidayati, F. (2025). Enhancing job application writing: A comparative case study of AI and human feedback on grammar and mechanics. Journal of English Language Teaching Innovations and Materials (Jeltim), 7(1), 54-72. http://dx.doi.org/10.26418/jeltim.v7i1.89240
References
Abbas, M. F. F., & Asy’ari, N. F. (2019). Mixed method: Students’ ability in applying writing mechanics in analytical exposition text. ELT-Lectura, 6(2), 147-157. https://doi.org/10.31849/elt-lectura.v6i2.3138
Anderson, J. (2023). Mechanically inclined: Building grammar, usage, and style into writer's workshop. Routledge.
Anggraeni, A. (2019). The use of problem-based learning method to improve students recount text of writing skill of the tenth grade of SMK Ma’arif 2 Penawaja Pugung raharjo of east Lampung (Doctoral dissertation, IAIN Metro). https://repository.metrouniv.ac.id/id/eprint/43/
Aydın, Ö., & Karaarslan, E. (2023). Is ChatGPT leading generative AI? What is beyond expectations? Academic Platform Journal of Engineering and Smart Systems, 11(3), 118-134. https://doi.org/10.21541/apjess.1293702
Carless, D., & Boud, D. (2018). The development of student feedback literacy: enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315-1325. https://doi.org/10.1080/02602938.2018.1463354
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of Generative AI: Implications for educational practice and research. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2195846
Ghafar, Z. N., & Sawalmeh, M. H. M. (2024). Exploring the Pedagogical Significance of Grammar: A Comprehensive Review of Its Role in Language Learning and Teaching. British Journal of Applied Linguistics, 4(1), 13-16. https://doi.org/10.32996/bjal.2024.4.1.2
Ghuman, K., & Prakash, I. (2024). English grammar, vocabulary, and verbal ability for competitive exams. Blue Rose Publishers.
Haase, J., & Hanel, P. H. (2023). Artificial muses: Generative artificial intelligence chatbots have risen to human-level creativity. Journal of Creativity, 33(3), 100066. https://doi.org/10.1016/j.yjoc.2023.100066
Hans, A., & Hans, E. (2017). Role of grammar in communication–writing skills. International Journal of English Language, Literature and Humanities, 5(1), 39-50. https://doi.org/10.24113/ijellh.v5.issue1.42
Hasan, J., & Marzuki, M. (2017). An analysis of student's ability in writing at Riau University Pekanbaru-Indonesia. Theory and Practice in Language Studies, 7(5), 380-388. https://doi.org/10.17507/TPLS.0705.08
Hidayatullah, E. P., ., S. ., & Hati, G. M. (2017). SUBJECT-VERB AGREEMENT ERRORS MADE BY SIXTH SEMESTER ENGLISH EDUCATION STUDENTS. Journal of English Education and Teaching, 1(1), 21–34. https://doi.org/10.33369/jeet.1.1.21-34
Hill, J., & West, H. (2020). Improving the student learning experience through dialogic feed-forward assessment. Assessment & Evaluation in Higher Education, 45(1), 82–97. https://doi.org/10.1080/02602938.2019.1608908
Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022). Artificial intelligence for assessment and feedback to enhance student success in higher education. Mathematical Problems in Engineering, 2022(1), 5215722. https://doi.org/10.1155/2022/5215722
Huda, M., & Gozali, G. (2020). IMPLEMENTING OF POLYTECHNIC STUDENTS’ABILITY OF WRITING APPLICATION LETTERS. Elite: English and Literature Journal, 7(2), 160-171. https://doi.org/10.24252/10.24252/elite.v7i2a5
Imtiaz, M., Hassan, K. H. U., & Akmal, F. (2023). Analyzing Spelling Errors Committed By English as a Second Language (ESL) Learners At Secondary School Level. Journal of Social Sciences Review, 3(2), 181-189. https://doi.org/10.54183/jssr.v3i2.246
Jäger, L. A., Mertzen, D., Van Dyke, J. A., & Vasishth, S. (2020). Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study. Journal of Memory and Language, 111, 104063. https://doi.org/10.1016/j.jml.2019.104063
Khurana, D., Koli, A., Khatter, K., & Singh, S. (2023). Natural language processing: state of the art, current trends and challenges. Multimedia tools and applications, 82(3), 3713-3744. https://doi.org/10.1007/s11042-022-13428-4
Kitila, F., Ali, S., & Bekele, E. (2023). The Impact of Writing Through Integrated Skills Intervention on English Students' Writing Skills: Focus on Vocabulary and Grammar. Journal of Language Teaching and Research, 14(2), 297-303. https://doi.org/10.17507/jltr.1402.04
Kumar, R., & Sharma, L. (2024). AI: The Future of Humanity. Discover Artificial Intelligence. https://doi.org/10.1007/s44163-024-00118-3
Li, M. (2024). Non-native English-speaking (NNES) students’ English academic writing experiences in higher education: A meta-ethnographic qualitative synthesis. Journal of English for Academic Purposes, 71, 101430. https://doi.org/10.1016/j.jeap.2024.101430
Maharani, M. M., & Sholikhatun, E. (2022). Punctuation and Capitalization in Writing: How Do Students Produce Them. Journal of Advanced Multidisciplinary Research, 3(1), 53-61. http://dx.doi.org/10.30659/jamr.3.1.53-61
McCarthy, K. S., Roscoe, R. D., Allen, L. K., Likens, A. D., & McNamara, D. S. (2022). Automated writing evaluation: Does spelling and grammar feedback support high-quality writing and revision? Assessing Writing, 52, 100608. https://doi.org/10.1016/j.asw.2022.100608
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of Artificial Intelligence-powered digital writing assistant in higher education: Randomized controlled trial. Heliyon, 7(5), e07014. https://doi.org/10.1016/j.heliyon.2021.e07014
Nelson, G., & Greenbaum, S. (2015). An Introduction to English Grammar (4th ed.). Routledge. https://doi.org/10.4324/9781315720319
Nunes, A., Cordeiro, C., Limpo, T., & Castro, S. L. (2022). Effectiveness of automated writing evaluation systems in school settings: A systematic review of studies from 2000 to 2020. Journal of Computer Assisted Learning, 38(2), 599–620. https://doi.org/10.1111/jcal.12635
O’Neill, R., & Russell, A. M. T. (2019). Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly. Australasian Journal of Educational Technology, 35(1), 42–56. https://doi.org/10.14742/ajet.3795
Philippakos, Z. A., & MacArthur, C. A. (2016). The effects of giving feedback on the persuasive writing of fourthâ€and fifthâ€grade students. Reading Research Quarterly, 51(4), 419-433. https://doi.org/10.1002/rrq.149
Quin, R., & Driver, D. (2020). Spelling, punctuation and grammar. In Secondary English: Subject and Method (pp. 191–204). chapter, Cambridge: Cambridge University Press.
Rane, N., Choudhary, S. P., & Rane, J. (2024). Acceptance of artificial intelligence technologies in business management, finance, and e-commerce: factors, challenges, and strategies. Studies in Economics and Business Relations, 5(2), 23-44. https://doi.org/10.48185/sebr.v5i2.1333
Rosalina, U., Noryatin, Y., Simbolon, V., Hernika, N., & Nuravianti, S. (2023). Exploring job application letters of EFL learners. Journal on Education, 5(4), 15089-15097. https://doi.org/10.31004/joe.v5i4.2599
Ryan, T. (2020). Effective feedback in digital learning environments. Centre for the Study of Higher Education, University of Melbourne. Retrieved from https://melbourne-cshe.unimelb.edu.au/resources/topics/assessment-and-feedback/specific-help/effective-feedback-in-digital-learning-environments
Sa’adah, A. R. (2020). Writing Skill in Teaching English: An Overview. EDUCASIA: Jurnal Pendidikan, Pengajaran, Dan Pembelajaran, 5(1), 21-35. https://doi.org/10.21462/educasia.v5i1.41
Saeidnia, H. (2023). ChatGPT: A Year Later–Examining Experts’ Opinions, Studies, and Public Perception. Information Matters, 3(12). https://ssrn.com/abstract=4664847
Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023). ChatGPT and other large language models are double-edged swords. Radiology, 307(2), e230163. https://doi.org/10.1148/radiol.230163
Shweba, A. A. A., & Mujiyanto, Y. (2017). Errors of spelling, capitalization, and punctuation marks in writing encountered by first year college students in Al-Merghib University Libya. English Education Journal, 7(2), 93-103. https://doi.org/10.15294/eej.v7i2.15731
Silvia, A., & Roza, V. (2022). An Analysis of Students’ Error in Writing Application Letter at XII Grade in SMK 1 Ranah Batahan. Journal of Educational Management and Strategy, 1(1), 30-39. https://doi.org/10.57255/jemast.v1i1.58
Solikhah, I. (2017). Corrections on Grammar, Sentence Variety and Developing Detail to Qualify Academic Essay of Indonesian Learners. Dinamika Ilmu, 17(1), 115-129. https://doi.org/10.21093/di.v17i1.783
Sun, K., & Wang, R. (2019). Frequency distributions of punctuation marks in English: Evidence from large-scale corpora. English Today, 35(4), 23–35. https://doi.org/10.1017/S0266078418000512
Tong, E. M. W., Tan, K., & Tan, C. (2021). The deployment versus disclosure effects of AI feedback on employee performance. Strategic Management Journal. https://doi.org/10.1002/smj.3322
Watling, C.J. and Ginsburg, S. (2019), Assessment, feedback and the alchemy of learning. Medical Education, 53: 76-85. https://doi.org/10.1111/medu.13645
Wongvorachan, T., Lai, K. W., Bulut, O., Tsai, Y.-S., & Chen, G. (2022). Artificial Intelligence: Transforming the Future of Feedback in Education. Journal of Applied Testing Technology, 23, 95–116. Retrieved from https://jattjournal.net/index.php/atp/article/view/170387
Wu, H., Wang, W., Wan, Y., Jiao, W., & Lyu, M.R. (2023). ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmark. ArXiv, abs/2303.13648. https://doi.org/10.48550/arXiv.2303.13648
Yakubova, Sh. (2023). The Importance of Grammar in Language Learning. Renaissance in the Paradigm of Educational Innovations and Technologies in the 21st Century, 1 (1), 454–456. https://doi.org/10.47689/XXIA-TTIPR-vol1-iss1-pp454-456
Yin, R. K. (2017). Case study research and applications: Design and methods. Sage publications.
Yoon, S., Miszoglad, E., & Pierce, L.R. (2023). Evaluation of ChatGPT Feedback on ELL Writers' Coherence and Cohesion. ArXiv, abs/2310.06505. https://doi.org/10.48550/arXiv.2310.06505
Yuliawati, L. (2021). The mechanics accuracy of students’ writing. English Teaching Journal, 9(1), 45-53. https://doi.org/10.25273/etj.v9i1.8890
Zhou, S. A., & Hiver, P. (2022). The effect of self-regulated writing strategies on students’ L2 writing engagement and disengagement behaviors. System, 106, 102768. https://doi.org/10.1016/j.system.2022.102768
Downloads
Published
Issue
Section
License
Authors retain copyright and grant the journal the right to publish the work, which is simultaneously made available under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence: https://creativecommons.org/licenses/by/4.0/
