Systematic literature review on current instruments of Indonesian information technology-based ELT materials development

Authors

DOI:

https://doi.org/10.26418/jeltim.v7i1.87864

Keywords:

digital language learning, evaluation methodology, instrument validation, IT-based ELT materials, technology integration

Abstract

This study presents a systematic literature review (SLR) employing the PRISMA framework to analyse the development and evaluation of English Language Teaching (ELT) materials in Indonesia between 2016 and 2023. From an initial pool of 1,263 records, 24 studies were included following a rigorous screening process. The findings indicate a growing emphasis on IT-based materials, which accounted for 50% of the studies reviewed. Evaluation practices were observed in 79% of the studies, with 81% of these employing instruments, of which 52% were validated. Validation methods predominantly involved qualitative expert reviews and focus group discussions, underscoring the need for broader adoption of robust quantitative approaches. Despite progress, research remains limited on non-IT-based materials and the application of advanced validation techniques. This study highlights the importance of enhancing evaluation practices and aligning ELT material development with contemporary educational demands. It offers valuable insights for researchers, educators, and policymakers committed to advancing language education in Indonesia. How to cite this paper: Ikhsanudin, Putri, T. C., Ulyasari, N., & Puspitasari, N. L. (2025). Systematic literature review on the current instruments of Indonesian information technology-based ELT materials development. Journal of English Language Teaching Innovations and Materials (Jeltim), 7(1), 146"“167. https://doi.org/10.26418/jeltim.v7i1.87864

Author Biographies

Ikhsanudin Ikhsanudin, Universitas Tanjungpura

Ikhsanudin is an associate professor of ELT. His published books and academic articles are in the areas of methodology, materials, and teacher professional development. He has been invited speakers by universities and conference organizers in Indonesia and overseas including in Singapore, Germany, USA, UK, and Malaysia.

Tri Cantika Putri, Universitas Tanjungpura

Tri Cantika Putri is an English speaking trainer at Kampung Inggris Pontianak and a Master’s student in English Education at Universitas Tanjungpura. Her interests include TEFL and technology in language teaching. She has presented her research at an international conference and continues to develop her skills to contribute to English education.

Nurwinda Laili Puspitasari, Universitas Tanjungpura

Nurwinda Laili Puspitasari is pursuing her master's degree in English Language Education at Universitas Tanjungpura. She presented her paper at an international conference, demonstrating English language education and professional communication in banking sector. Her interests include ESP and instructional design for bankers.

Nur Ulyasari, Universitas Tanjungpura

Nur Ulyasari is an English teacher pursuing a Master’s degree in English Education at Universitas Tanjungpura, Pontianak. Passionate about research in ELT, she has presented at an international conference and aims to enhance her professional skills while contributing to the advancement of English education.

References

Acuña, B. P., & Durão, R. C. F. (2024). Learning English as a second language with artificial intelligence for prospective teachers: A systematic review. Frontiers in Education, 9, Article 1490067. https://doi.org/10.3389/feduc.2024.1490067

Alemi, M. (2016). The use of technology in English language learning: A literature review. International Journal of Research in English Education, 1(2), 115–125. https://doi.org/10.18869/acadpub.ijree.1.2.115

Ammade, S., Mahmud, M., Jabu, B., & Tahmir, S. (2018). Integrating technology in English language teaching: Global experiences and lessons for Indonesia. International Journal of English Linguistics, 8(6), 107–114. https://doi.org/10.5539/ijel.v8n6p107

Anderson, T. R., & Rogan, J. M. (2010). Bridging the educational research–teaching practice gap. Biochemistry and Molecular Biology Education, 38(1), 51–56. https://doi.org/10.1002/bmb.20362

Ansari, A. A., Strachan, K., Hashim, S., & Otoom, S. (2017). Analysis of psychometric properties of the modified SETQ tool in undergraduate medical education. BMC Medical Education, 17(1), Article 124. https://doi.org/10.1186/s12909-017-0893-4

Bachman, L. F. (2000). Modern language testing at the turn of the century: Assuring that what we count counts. Language Testing, 17(1), 1–42. https://doi.org/10.1177/026553220001700101

Borges, V. M. C. (2011). Elaboration and validation of an ESL/EFL software evaluation instrument. Ilha do Desterro, 60, 305–328. https://doi.org/10.5007/2175-8026.2011n60p305

Cao, J., Bhuvaneswari, G., Arumugam, T., & Aravind, B. R. (2023). The digital edge: Examining the relationship between digital competency and language learning outcomes. Frontiers in Psychology, 14, Article 1187909. https://doi.org/10.3389/fpsyg.2023.1187909

Divayana, D. G. H., Ariawan, I. P. W., & Adiarta, A. (2020). Content validity of quality test instrument used for the user interface design of THK-ANEKA-based countenance evaluation application. Journal of Physics: Conference Series, 1516(1), Article 012048. https://doi.org/10.1088/1742-6596/1516/1/012048

Drigas, A., & Charami, F. (2014). ICTs in English learning and teaching. International Journal of Recent Contributions from Engineering, Science & IT (iJES), 2(4), 4–10. https://doi.org/10.3991/ijes.v2i4.4016

Fu, C., Gao, Y., & Wang, X. (2023). Exploring the role of TESOL and digital technology in attitudinal change and sustainable learning for students of higher education. BMC Psychology, 11(1), Article 178. https://doi.org/10.1186/s40359-023-01372-3

Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041

Ghanizadeh, A., Razavi, A., & Jahedizadeh, S. (2015). Technology-enhanced language learning (TELL): A review of resources and upshots. International Letters of Chemistry, Physics and Astronomy, 54, 73–86. https://doi.org/10.18052/www.scipress.com/ilcpa.54.73

Ginaya, G., Somawati, N. P., & Astuti, N. L. P. E. (2020). The use of Quizizz in improving students’ grammar understanding through online learning. Proceedings of the 2nd International Conference on Innovative Research Across Disciplines (ICIRAD 2020), 456–462. https://doi.org/10.2991/assehr.k.201219.084

Hasumi, T., & Chiu, M.-S. (2024). Technology-enhanced language learning in English language education: Performance analysis, core publications, and emerging trends. Cogent Education, 11(1), Article 2346044. https://doi.org/10.1080/2331186X.2024.2346044

Herlina, A. (2014). The utilization of technology to improve English speaking skills. Journal for the Study of English Linguistics, 2(2), 19–28. https://doi.org/10.5296/jsel.v2i2.6665

Karimah, A., & Muslim, A. B. (2019). Redefining EFL (English as a Foreign Language) teachers’ roles in technology-integrated instruction. Proceedings of the 2019 International Conference on Computer Science and Artificial Intelligence, 1–8. https://doi.org/10.1145/3337682.3337686

KarolÄík, Å ., ÄŒipková, E., HruÅ¡ecký, R., & Veselský, M. (2015). The comprehensive evaluation of electronic learning tools and educational software (CEELTES). Informatics in Education, 14(2), 243–260. https://doi.org/10.15388/infedu.2015.14

Luo, Z. (2023). The effectiveness of gamified tools for foreign language learning (FLL): A systematic review. Behavioral Sciences, 13(4), Article 331. https://doi.org/10.3390/bs13040331

Mariappan, V. A. P., & Osman, K. (2023). A systematic literature review of authentic assessment in K-12 ESL/EFL education. Malaysian Journal of Social Sciences and Humanities, 8(5), Article 2303. https://doi.org/10.47405/mjssh.v8i5.2303

Melkonyan, A., & Matevosyan, A. (2020). Technology-assisted foreign language learning (TALL) in the digital age. SHS Web of Conferences, 88, Article 02005. https://doi.org/10.1051/shsconf/20208802005

Mislevy, R. J. (2016). How developments in psychology and technology challenge validity argumentation. Journal of Educational Measurement, 53(3), 265–292. https://doi.org/10.1111/jedm.12117

Nguyen, L. A. T., & Habók, A. (2023). Tools for assessing teacher digital literacy: A review. Journal of Computers in Education, 11(1), 305–332. https://doi.org/10.1007/s40692-022-00257-5

Nikmard, F., & Mohamadi, Z. (2020). Designing and validating a potential assessment inventory for assessing ELTs’ assessment literacy. Language Testing in Asia, 10(1), Article 10. https://doi.org/10.1186/s40468-020-00106-1

Qaddumi, H., Smith, M., Masd, K., Bakeer, A., & Al-Ulbeh, W. A. (2023). Investigating Palestinian in-service teachers’ beliefs about the integration of information and communication technology (ICT) into teaching English. Education and Information Technologies, 28(10), 12785–12806. https://doi.org/10.1007/s10639-023-11689-6

Rahmati, J., Izadpanah, S., & Shahnavaz, A. (2021). A meta-analysis on educational technology in English language teaching. Language Testing in Asia, 11, Article 121. https://doi.org/10.1186/s40468-021-00121-w

Sanchéz, R. B., Corujo-Vélez, C., Palaciosâ€Rodríguez, A., & Graván, P. R. (2020). Teaching digital competence and eco-responsible use of technologies: Development and validation of a scale. Sustainability, 12(18), Article 7721. https://doi.org/10.3390/su12187721

Souza, A. C. de, Alexandre, N. M. C., & Guirardello, E. de B. (2017). Propriedades psicométricas na avaliação de instrumentos: Avaliação da confiabilidade e da validade. Epidemiologia e Serviços de Saúde, 26(3), 649–659. https://doi.org/10.5123/s1679-49742017000300022

Syathroh, I. L., Kareviati, E., Lestari, A. P., & Fitria, N. (2021). Exploring the potentials of technology integration for teaching language skills: A literature review. PROJECT (Professional Journal of English Education), 4(3), 488–496. https://doi.org/10.22460/project.v4i3.p488-496

Vaishnav, P. (2024). Current trends and future prospects in English Language Teaching (ELT). Asian Journal of Education and Social Studies, 50(7), 1–11. https://doi.org/10.9734/ajess/2024/v50i71438

Viruel, S. R., Rivas, E. S., & Ruizâ€Palmero, J. (2025). The role of artificial intelligence in project-based learning: Teacher perceptions and pedagogical implications. Education Sciences, 15(2), Article 150. https://doi.org/10.3390/educsci15020150

Yang, F., Wen, J., & Qi, L. (2020). Information and communication technology in English language education: A review and future research directions. Proceedings of the International Conference on Modern Educational Technology and Innovation and Entrepreneurship (ICMETIE 2020). https://doi.org/10.2991/assehr.k.200306.134

Downloads

Published

2025-05-29

Issue

Vol. 7 No. 1 (2025): April 2025

Section

Articles

License

Authors retain copyright and grant the journal the right to publish the work, which is simultaneously made available under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence: https://creativecommons.org/licenses/by/4.0/