SIBI INTRODUCTION USING YOLOv8 AS ANDROID-BASED LEARNING MEDIA
DOI:
https://doi.org/10.26418/telectrical.v3i1.93519Keywords:
SIBI, YOLOv8, Android, object detection, learning media.Abstract
SIBI (Indonesian Sign Language System) is a visual communication system used by the deaf and hard-of-hearing community for interaction. Learning SIBI requires interactive media to enable users to achieve precise gesture mastery. A key challenge in self-directed learning is the lack of real-time feedback to evaluate gesture accuracy, particulary in the absence of instructors or companions. To address this, integrating technology becomes essential for developing an independent and effective SIBI learning framework. This study designed a SIBI letter recognition system using the YOLOv8 model, implemented on the Android platform. The system employs a smartphone camera to detect users hand movements on real-time. Captured hand gestures are processed via the YOLOv8 object detection algorithm, with identification results displayed as bounding box and corresponding text labels in the application interface. The system was tested at three different distances, namely 0.5 meters, 1 meter, and 1.5 meters. The experimental results demonstrated high accuracy rates, achieving 98.72% at a distance of 0.5 meters, 96.15% at 1 meter, and 91.02% at 1.5 meters. These results confirm that the SIBI recognition system based on YOLOv8 is an accurate and effective educational tool, well suited to support the learning process for novice users.References
R. K. A. Wibowo, A. Sanjaya, dan U. Mahdiyah, “Implementasi YOLOv8 pada Pengenalan Sistem Isyarat Bahasa Indonesia,†INOTEK, vol. 8, Agustus 2024. [Online]. Tersedia: https://proceeding.unpkediri.ac.id/index.php/inotek/. Diakses pada: 20 Maret 2025.
Badan Pusat Statistik, “Jumlah Penduduk Berumur 5 Tahun ke Atas Menurut Kelompok Umur, Daerah Perkotaan/Perdesaan, Jenis Kelamin, dan Tingkat Kesulitan Mendengar, Indonesia, Tahun 2022,†[Online]. Tersedia: https://www.bps.go.id/id. Diakses pada: 15 Maret 2025.
M. Aldy, “Rancang Bangun Sistem Penjermah Bahasa Isyarat Untuk Mendukung Kemudahan Komunikasi Bagi Penyandang Tunarungu Dan Tunawicara Berbasis Machine Learningâ€, Skripsi, Universitas Tanjungpura, Pontianak, 2024.
D. Permana And J. Sutopo, “Aplikasi Pengenalan Abjad Sistem Isyarat Bahasa Indonesia (Sibi) Dengan Algoritma Yolov5,†Jurnal Simantec, Vol. 11, No. 2, Pp. 231–240, Jul. 2023, Doi: 10.21107/Simantec.V11i2.19783.
Lembaga Penelitian dan Pengembangan Sistem Isyarat Bahasa Indonesia, Kamus SIBI: Kerjasama antara Kementerian Pendidikan dan Kebudayaan dengan Lembaga Penelitian dan Pengembangan Sistem Isyarat Bahasa Indonesia. [Online]. Tersedia: https://pmpk.kemdikbud.go.id/sibi/. Diakses pada: 15 Maret 2025.
M. F. Naufal And S. F. Kusuma, “Analisis Perbandingan Algoritma Machine Learning Dan Deep Learning Untuk Klasifikasi Citra Sistem Isyarat Bahasa Indonesia (Sibi),†Jurnal Teknologi Informasi Dan Ilmu Komputer, Vol. 10, No. 4, Pp. 873–882, Aug. 2023, Doi: 10.25126/Jtiik.20241046823.
S. Apendi, C. Setianingsih, dan M. W. Paryasto, “Deteksi Bahasa Isyarat Sistem Isyarat Bahasa Indonesia Menggunakan Metode Single Shot Multibox Detector,†e-Proceeding of Engineering, vol. 10, no. 1, hal. 249, Feb. 2023. ISSN: 2355-9365.
S. Nur, A. N. Assyifa, And H. Nurjannah, “Pengembangan Aplikasi Penerjemah Bahasa Isyarat Indonesia (Bisindo) Menggunakan Metode Long-Short Term Memory,†Edusaintek: Jurnal Pendidikan, Sains Dan Teknologi, Vol. 11, No. 1, Pp. 13–30, Jul. 2023, Doi: 10.47668/Edusaintek.V11i1.898.
W. M. Pradnya D And A. P. Kusumaningtyas, “Analisis Pengaruh Data Augmentasi Pada Klasifikasi Bumbu Dapur Menggunakan Convolutional Neural Network,†Jurnal Media Informatika Budidarma, Vol. 6, No. 4, P. 2022, Oct. 2022, Doi: 10.30865/Mib.V6i4.4201.
R. Sapkota et al., “YOLO11 to Its Genesis: A Decadal and Comprehensive Review of the You Only Look Once (YOLO) Series,†arXiv preprint, arXiv:2406.19407v5 [cs.CV], 9 Jan. 2025. [Online]. Tersedia: https://arxiv.org/html/2406.19407v5. Diakses pada: 15 Maret 2025.
M. Grandini, E. Bagli, dan G. Visani, “Metrics for Multi-Class Classification: An Overview,†Aug. 2020. [Online]. Tersedia: http://arxiv.org/abs/2008.05756. Diakses pada: 20 Maret 2025.
Y. A. Pratama, F. Budiman, S. Winarno, And D. Kurniawan, “Analisis Optimasi Algoritma Decision Tree, Logistic Regression Dan Svm Menggunakan Soft Voting,†Jurnal Media Informatika Budidarma, Vol. 7, No. 4, P. 1908, Oct. 2023, Doi: 10.30865/Mib.V7i4.6856.
H. Tantyoko, D. K. Sari, dan A. R. Wijaya, “Prediksi Potensial Gempa Bumi Indonesia Menggunakan Metode Random Forest dan Feature Selection,†Idealis: Indonesian Journal of Information System, vol. 6, no. 2, pp. 83–89, Jul. 2023. [Online]. Tersedia: http://jom.fti.budiluhur.ac.id/index.php/idealis/index. Diakses pada: 20 Maret 2025.
D. Kholiya, A. K. Mishra, N. K. Pandey, and N. Tripathi, “Plant Detection and Counting using Yolo based Technique,†2023 3rd Asian Conference on Innovation in Technology, ASIANCON 2023, p. Ravet, doi: 10.1109/ASIANCON58793.2023.10270530.
Z. Sun, P. Li, Q. Meng, Y. Sun, and Y. Bi, “An Improved YOLOv5 Methodto Detect Tailings Ponds from High-Resolution Remote Sensing Images,†Remote Sens (Basel), vol. 15, no. 7, p. 1796, Apr. 2023, doi: 10.3390/rs15071796.
L. Putra, V. Gunawan, And A. Saragih, "Detection Of Actinic Keratosis Skin Cancer Using Gray Level Co-Occurrence Matrix Texture Extraction And Color Extraction With Support Vector Machine Classification," Teknik, Vol. 44, No. 2, Pp. 158-166, 2023.
M. L. Afkaar, “Datasets Sibi Sign Language Alphabets,†Kaggle, Oct. 15, 2024. [Online]. Available: https://www.kaggle.com/datasets/mlanangafkaar/datasets-lemlitbang-sibi-alphabets.
Downloads
Additional Files
Published
Issue
Section
License
Copyright (c) 2025 Telecommunications, Computers, and Electricals Engineering Journal (TELECTRICAL)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Copyright of the published articles will be transferred to the journal as the publisher of the manuscripts. Therefore, the author confirms that the copyright has been managed by the publisher.
- Publisher of TELECTRICAL is Universitas Tanjungpura.
- The copyright follows Creative Commons Attribution"“ShareAlike License (CC BY SA): This license allows to Share "” copy and redistribute the material in any medium or format, Adapt "” remix, transform, and build upon the material, for any purpose, even commercially.
Telecommunications, Computers, and Electricals Engineering Journal by Universitas Tanjungpura is licensed under CC BY-SA 4.0
