COLOR AND SIZE SORTING SYSTEM WITH AN ESP32-BASED ROBOT ARM

Authors

  • Muhamad Gilang Satria Adiguna Universitas Tanjungpura
  • Muhammad Saleh
  • Elang Derdian Marindani

DOI:

https://doi.org/10.26418/j3eit.v11i2.68483

Abstract

Robotics has seen an explosive increase in usage in the past few decades owing to its abundance of benefits and automation capabilities. The use of robotics is especially prominent in industries where the demand for precise and automatic robots in order to increase production efficiency is high. One of the robots commonly used in these industries is the arm robot model, which is a machine designed specifically to mimic some of the human arm"™s capabilities in order to execute certain tasks over and over again, either autonomously or not. This paper will discuss the design of a robotic arm with five degrees of freedom capable of picking up and placing objects with three different colors and sorting the objects based on their size, starting from the largest to the smallest. The inclusion of an additional degree of freedom allows the robot to adjust the rotation of its grip to properly grab rotated objects. With an ESP32-CAM acting as its eyes, the robot is aided by a Python program run remotely on a separate Laptop in order to analyze video stream uploaded by the camera to determine the coordinates, color, size, and rotation of objects placed within the Detection Zone. The implementation of inverse kinematics equations run on an ESP32 microcontroller allows the robot to reach arbitrary coordinates specified by the Python program. Testing revealed that the resulting robot is able to perform the tasks it was designed to, namely recognizing and sorting colored boxes of different colors and sizes, with an accuracy 100% in recognition tasks and an accuracy of 91.5% in sorting tasks.

References

Oxford University Press, “Oxford Dictionary,†Oxford University Press, 2013.

R. Arismarjito, “Robot Lengan Otomatis Sebagai Pemisah Barang Berdasarkan Warna Dengan Menggunakan ATmega 8535,†2011.

R. H. Prabanegara, M. F. Noor, and E. Kunia, “Rancang Bangun Robot Lengan Pemindah dan Penyeleksi Barang Berdasarkan Warna Berbasis Arduino UNO,†Energy-Jurnal Ilmiah Ilmu-Ilmu Teknik, vol. 5, no. 2, pp. 31–40, 2015.

Feriyonika, Martin, Noor C. Basjaruddin, Salman AASAP, “Comparison Between Trot and Wave Gait Applied in Quadruped Robot†, Jurnal ELKHA, pp. 47-54, vol.15 No.1 April 2023

W. Tri Setiawan, E. M. Derdian, P. Studi Teknik Elektro, and J. Teknik Elektro, “Rancang Bangun Robot Lengan 5 DOF Pemindah Barang Menggunakan Sensor Kamera Berbasis Arduino DUE.â€

R. Zefani, A. Zurendra, R. Maulana, and H. Fitriyah, “Implementasi Inverse Kinematics Pada Robot Lengan Untuk Pengambilan Benda Dengan Koordinat Awal Acak,†2020. [Online]. Available: http://j-ptiik.ub.ac.id

M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis and Machine Vision. 1993. doi: 10.1007/978-1-4899-3216-7.

G. Bradski, “The OpenCV Library,†Dr. Dobb’s Journal of Software Tools, 2000.

J. Canny, “A Computational Approach to Edge Detection,†1986.

D. Chakraborty, “OpenCV Contour Approximation ( cv2.approxPolyDP ),†PyImageSearch, 2021.

D. Kuhlman, A Python Book: Beginning Python, Advanced Python, and Python Exercises. 2013.

H. Jaya, Desain dan Implementasi Sistem Robotika Berbasis Mikrokontroler. 2016.

N. Kolban, Kolban’s Book on ESP32. 2017.

Downloads

Published

2023-09-19

Issue

Vol. 11 No. 2: August 2023

Section

Articles

License

Copyright (c) 2023 J3EIT (Journal of Electrical Engineering, Energy, and Information Technology)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

  • Copyright of the published articles will be transferred to the journal as the publisher of the manuscripts. Therefore, the author confirms that the copyright has been managed by the publisher.
  • Publisher of J3EIT is  Universitas Tanjungpura.
  • The copyright follows Creative Commons Attribution"“ShareAlike License (CC BY SA): This license allows to Share  "” copy and redistribute the material in any medium or format, Adapt  "” remix, transform, and build upon the material, for any purpose, even commercially.