Augmented Reality Technology in Designing Sign Language Learning Applications
DOI:
https://doi.org/10.26418/justin.v12i2.76041Abstract
Sign Language Learning Application Using Augmented Reality Technology with Markerless Method. Communication is an essential need for humans in everyday life. Every individual needs communication to understand the intentions of others towards themselves and their environment. However, some individuals face difficulties in communicating, especially for those with physical disabilities such as the Deaf. One common alternative form of communication used by the Deaf is sign language. This research aims to create a sign language learning application that combines Google Speech voice recognition technology and Augmented Reality with the markerless method. This application converts sound into SIBI sign language movements displayed in the form of 3D animation through Augmented Reality. This application will be used by the general public as a tool in learning sign language. Based on the results of testing that has been done, the application successfully achieves the goals set, with the integration of Google Speech voice recognition and Augmented Reality markerless achieving a success rate of 77.5%.
References
A. S. Nugraheni, A. P. Husain, and H. Unayah, "Optimalisasi penggunaan bahasa isyarat dengan sibi dan bisindo pada mahasiswa difabel tunarungu di prodi pgmi uin sunan kalijaga," Jurnal Holistika, vol. 5, no. 1, pp. 28-33, 2021.
B. L. Basyah and F. M. Elvina, "Rancang Bangun Aplikasi Pembelajaran Bahasa Isyarat Berbasis Android."
A. Harpini, "Infodatin Pusat Data dan Informasi Kementrian Kesehatan RI Disabilitas Rungu," 2019.
O. World Health, World report on hearing. Geneva: World Health Organization, 2021.
B. P. Statistik, "BANYAKNYA DESA MENURUT KEBERADAAN PENYANDANG CACAT DI PROVINSI JAWA BARAT," 18 Juni 2021 2021.
F. Shah, M. S. Shah, W. Akram, A. Manzoor, R. O. Mahmoud, and D. S. Abdelminaam, "Sign language recognition using multiple kernel learning: A case study of Pakistan sign language," Ieee Access, vol. 9, pp. 67548-67558, 2021.
R. Fatmawati, R. Asmara, Y. R. Prayogi, and R. Y. Hakkun, "Aplikasi Pembelajaran Sistem Isyarat Bahasa Indonesia (SIBI) Berbasis Voice Menggunakan OpenSIBI," Technomedia Journal, vol. 7, no. 1 Juni, pp. 22-39, 2022.
B. Afandi, I. Kustiawan, and N. Herman, "Exploration of the augmented reality model in learning," in Journal of Physics: Conference Series, 2019, vol. 1375, no. 1: IOP Publishing, p. 012082.
A. Akbar, A. Y. Husodo, and A. Zubaidi, "Implementasi Google Speech API Pada Aplikasi Koreksi Hafalan Al-Quran Berbasis Android," Jurnal Teknologi Informasi, Komputer, Dan Aplikasinya (JTIKA), vol. 1, no. 1, pp. 1-8, 2019.
A. F. Ramadhan, A. D. Putra, and A. Surahman, "Aplikasi Pengenalan Perangkat Keras Komputer Berbasis Android Menggunakan Augmented Reality (Ar)," Jurnal Teknologi Dan Sistem Informasi, vol. 2, no. 2, pp. 24-31, 2021.
M. A. Bintang, R. Harwahyu, and R. F. Sari, "SMARIoT: Augmented Reality for Monitoring System of Internet of Things using EasyAR," in 2020 4th International Conference on Informatics and Computational Sciences (ICICoS), 2020: IEEE, pp. 1-6.
N. Anggraini, A. Kurniawan, L. K. Wardhani, and N. Hakiem, "Speech recognition application for the speech impaired using the android-based google cloud speech API," TELKOMNIKA (Telecommunication Computing Electronics and Control), vol. 16, no. 6, pp. 2733-2739, 2018.
[13] B. Baglama, Y. Yucesoy, and A. Yikmis, "Using animation as a means of enhancing learning of individuals with special needs," TEM Journal, vol. 7, no. 3, p. 670, 2018.
S. Anugerah, S. Ulfa, and A. Husna, "Pengembangan Video Pembelajaran Bahasa Isyarat Indonesia (Bisindo) Untuk Siswa Tunarungu Di Sekolah Dasar Luar Biasa," JINOTEP: Jurnal Inovasi Teknologi Pembelajaran, vol. 7, no. 2, pp. 76-85, 2020.
R. Ridwang, "Pengenalan bahasa isyarat indonesia (SIBI) menggunakan leap motion controller dan algoritma data mining naïve bayes," Jurnal INSYPRO (Information System and Processing), vol. 2, no. 2, 2017.
G. Gumelar, H. Hafiar, and P. Subekti, "Bahasa isyarat indonesia sebagai budaya tuli melalui pemaknaan anggota gerakan untuk kesejahteraan tuna rungu," Inf. Kaji. Ilmu Komun, vol. 48, no. 1, pp. 65-78, 2018.
Downloads
Additional Files
Published
Issue
Section
License
Copyright (c) 2024 JUSTIN (Jurnal Sistem dan Teknologi Informasi)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The author owns the copyright in his paper and agrees to publish his paper to JUSTIN by giving the rights to the first publication of his paper which is simultaneously licensed under the Creative Commons Attribution License, namely the Similar International 4.0 license (CC BY-NC-SA 4.0).
This is a human-readable summary of (and not a substitute for) the license. Disclaimer.
You are free to:Share "” copy and redistribute the material in any medium or format
Adapt "” remix, transform, and build upon the material
The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
Attribution "” You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial "” You may not use the material for commercial purposes.
ShareAlike "” If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
No additional restrictions "” You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
