Humanoid Robot Application as COVID-19 Symptoms Checker Using Computer Vision and Multiple Sensors
DOI:
https://doi.org/10.26418/elkha.v13i2.47213Keywords:
ESP32-CAM, Human Body Temperature, nCoV, Oxygen Saturation Level, 7-DoF upper-body of Humanoid Robot.Abstract
Novel Corona Virus (nCoV) infects human"™s respiratory system. It spreads easily when an infected person makes a close contact with other people. To prevent its massive spread, it is necessary to ensure anyone coming to a certain place is not being infected. The symptoms include high body temperature (≥37.5 °C) and low oxygen saturation level (≤95%). This day, most places only check the human body temperature. Thus, the authors are interested to make an attempt to design a system that is able to measure both human body temperature and oxygen saturation level. This work also applies the 7-DoF Upper-Body of Humanoid Robot to prevent virus spread from and to the employee. The system will detect the coming of visitors by using face detection. It requires 7.24 seconds to detect the visitor without a mask, and 1.26 second when the visitor wears a mask. The body temperature measurement was done using GY-906 temperature sensor with an error of 0.51%. For the oxygen saturation level measurement, MAX30100 pulse oximeter module was applied and showed an error of 0.78%. In addition, the upper-body of humanoid robot will perform some gestures to instruct the visitors in every process of the system. The implemented 7-DoF upper-body of humanoid robot has 93.33% gesture comprehension rate. In conclusion, the overall system has been tested and showed success rate up to 75%.
References
D. Telaumbanua, “Urgensi Pembentukan Aturan Terkait Pencegahan Covid-19 di Indonesia,†QALAMUNA J. Pendidikan, Sos. dan Agama, vol. 12, no. 01, pp. 59–70, 2020, doi: 10.37680/qalamuna.v12i01.290.
N. Nurhalimah, “Upaya Bela Negara Melalui Sosial Distancing dan Lockdown Untuk Mengatasi Wabah COVID-19,†SSRN Electron. J., vol. 19, 2020, doi: 10.2139/ssrn.3576405.
H. N. Ulya, “Alternatif Strategi Penanganan Dampak Ekonomi Covid-19 Pemerintah Daerah Jawa Timur Pada Kawasan Agropolitan,†El-Barka J. Islam. Econ. Bus., vol. 3, no. 1, pp. 80–109, 2020, doi: 10.21154/elbarka.v3i1.2018.
UGM, “Kenali Happy Hypoxia Syndrome.†https://ugm.ac.id/id/berita/19992-kenali-happy-hypoxia-syndrome-gejala-baru-covid-19 (accessed Jan. 31, 2021).
R. Wulandari, “Rancang Bangun Pengukur Suhu Tubuh Berbasis Arduino Sebagai Alat Deteksi Awal Covid-19,†Pros. SNFA (Seminar Nas. Fis. dan Apl., vol. 5, pp. 183–189, 2020, doi: 10.20961/prosidingsnfa.v5i0.46610.
B. A. Setyawan, T. Agustianto, S. Fathudin, and A. Widodo, “Prometer: Termometer Non-Kontak Praktis Berbasis,†Din. Vokasional Tek. Mesin, vol. 5, no. Azanella, pp. 129–135, 2020.
D. I. Saputra, G. M. Karmel, and Y. B. Zainal, “Perancangan dan Implementasi Rapid Temperature Screening Contactless dan Jumlah Orang Berbasis IOT dengan Protokol MQTT,†J. Energy Electr. Eng., vol. 02, no. 01, pp. 20–30, 2020.
I. Gunawan, A. Sudianto, and M. Sadali, “Alat Pengukur Suhu Tubuh Berbasis Internet of Things (IoT) Menggunakan ESP8266 dan Firebase Measuring Body Temperature Based Internet of Things (IoT) Using Esp8266 and Firebase,†vol. 11, no. 1, pp. 91–100, 2021.
UI, “Kena Hipoksia kok Pasien COVID-19 Bisa Tak Merasa Sesak.†https://fk.ui.ac.id/infosehat/kena-hipoksia-kok-pasien-covid-19-bisa-tak-merasa-sesak/ (accessed Feb. 04, 2021).
A. V. Nugroho, “Sistem Monitoring Pasien Robot Covid dengan Parameter Suhu , Detak Jantung , Dan Saturasi Oksigen Berbasis Website,†2020.
“Humanoid Robot Reinvent Customer Experience.†https://gfi.world/tn-en/news/parole_expert/139-how-humanoid-robotics-re-invents-customer-experience (accessed Aug. 07, 2021).
S. Behnke, “Humanoid Robots – From Fiction to Reality ?,†KI-Zeitschrift, vol. 4, no. December, pp. 5–9, 2008, [Online]. Available: http://www.ais.uni-bonn.de/papers/KI08_Behnke.pdf.
J. Denny, M. Elyas, S. A. Dcosta, and R. D. DSouza, “Humanoid Robots – Past , Present and the Future,†Eur. J. Adv. Eng. Technol., vol. 3, no. 5, pp. 8–15, 2016, [Online]. Available: https://www.researchgate.net/publication/303806185.
S. Schaal, “Historical Perspective of Humanoid Robot Resaerch in the Americas,†Humanoid Robot. A Ref., no. October, 2018, doi: 10.1007/978-94-007-7194-9.
A. Takanishi, “Historical Perspective of Humanoid Robot Research in Asia,†Humanoid Robot. A Ref., pp. 1–18, 2018, doi: 10.1007/978-94-007-7194-9_145-1.
M. Y. Baihaqi and J. W. Simatupang, “Aplikasi Metode Kontrol Bluetooth Pada Robot Humanoid Berbasis Arduino Mega 2560,†Prosiding Seminar Nasional Energi & Teknologi (SINERGI), vol. 88, pp. 49–56, 2016.
“What is Humanoid Robot.†https://gfi.world/tn-en/news/parole_expert/139-how-humanoid-robotics-re-invents-customer-experience (accessed Jul. 01, 2021).
D. T, “Humanoid Robot Service Malaysia,†2019. https://www.thesundaily.my/local/ecoworld-to-unveil-malaysias-first-robothotel-YF546100 (accessed Jul. 01, 2021).
T. Verge, “Humanoid Robot Service Japan,†2019. https://www.theverge.com/2019/1/15/18184198/japans-robot-hotel-lay-off-work-forhumans (accessed Jul. 01, 2021).
E. Wang, “Humanoid Robot Service China,†2019. https://www.chinamoneynetwork.com/2018/09/20/alibabasai-unit-to-launch-hospitality-robots-in-october (accessed Jul. 01, 2021).
M. W. Lustig and J. Koester, Intercultural Competence: Intercultural Communication Across Cultures, 6th ed. Boston, 2010.
“Body Language.†https://www.alumniportal-deutschland.org/en/career/body-language-intercultural-communication/ (accessed Jul. 01, 2021).
A. Mindess, Reading Between the Signs: Intercultural Communication for Sign Language Interpreters, 2nd ed. Boston: Intercultural Press.
Klopf and W. Donald, Intercultural Encounters: The Fundamental of Intercultural Communication, 1st ed. USA: Morton Publishing Company, 1987.
“ESP 32 CAM.†https://randomnerdtutorials.com/esp32-cam-video-streaming-face-recognition-arduino-ide/ (accessed Feb. 14, 2021).
“UART Communication.†https://www.circuitbasics.com/how-to-set-up-uart-communication-for-arduino/ (accessed Feb. 14, 2021).
“GY906 Temperature Sensor.†https: //create.arduino.cc/projecthub/hardyedela/diy-arduino-gy-906-infrared-thermometer-5881aa (accessed Feb. 15, 2021).
“MAX30100 Pulse Oximeter.†http: //www.alselectro.com/max30100-pulse-oximeter-spo2-and-heart-rate-sensor-module.html (accessed Feb. 15, 2021).
Downloads
Additional Files
Published
Issue
Section
License
Copyright (c) 2021 ELKHA : Jurnal Teknik Elektro

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
1. Proposed Policy for Journals That Offer Open Access
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
2. Proposed Policy for Journals That Offer Delayed Open Access
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication, with the work [SPECIFY PERIOD OF TIME] after publication simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).