Automatic Wound Image Segmentation with U-Net Model for Smartphone Application
DOI:
https://doi.org/10.26418/jp.v10i2.78548Keywords:
U-Net, pretrained model, automatic segmentation, MobileNet2, EfficientNetB0Abstract
Pengenalan citra luka memiliki potensi yang sangat penting dalam analisis luka, termasuk klasifikasi jenis luka, identifikasi infeksi, estimasi penyembuhan, dan penentuan perawatan yang tepat. Salah satu perkembangan terbaru dalam bidang ini adalah segmentasi otomatis pada citra, yang memanfaatkan kemajuan dalam deep learning untuk melakukan ekstraksi citra luka dengan menghilangkan piksel yang tidak relevan dengan luka. Dalam penelitian ini, kami melakukan evaluasi terhadap kinerja arsitektur U-Net dasar dan membandingkannya dengan tiga model pre-trained yang terkenal, termasuk MobileNet, MobileNetV2, EfficientNetB0, dan NasNet mobile sebagai backbone untuk meningkatkan kualitas segmentasi citra lukaReferences
D. Marijanović, E. K. Nyarko, and D. Filko, “Wound Detection by Simple Feedforward Neural Network,†Electron., vol. 11, no. 3, Feb. 2022, doi: 10.3390/electronics11030329.
C. Lindholm and R. Searle, “Wound management for the 21st century: combining effectiveness and efficiency,†Int. Wound J., vol. 13, pp. 5–15, 2016, doi: 10.1111/iwj.12623.
C. P. Loizou, T. Kasparis, O. Mitsi, and M. Polyviou, “Evaluation of wound healing process based on texture analysis,†IEEE 12th Int. Conf. Bioinforma. Bioeng. BIBE 2012, no. November, pp. 709–714, 2012, doi: 10.1109/BIBE.2012.6399754.
F. J. DÃaz-Pernas, M. MartÃnez-Zarzuela, D. González-Ortega, and M. Antón-RodrÃguez, “A deep learning approach for brain tumor classification and segmentation using a multiscale convolutional neural network,†Healthc., vol. 9, no. 2, 2021, doi: 10.3390/healthcare9020153.
X. Liu, L. Song, S. Liu, and Y. Zhang, “A review of deep-learning-based medical image segmentation methods,†Sustain., vol. 13, no. 3, pp. 1–29, 2021, doi: 10.3390/su13031224.
Y. Lecun, Y. Bengio, and G. Hinton, “Deep learning,†Nature, vol. 521, no. 7553. Nature Publishing Group, pp. 436–444, May 27, 2015. doi: 10.1038/nature14539.
G. Lee and H. Fujita, Advances in Experimental Medicine and Biology - Deep Learning in Medical Image Analysis, 1213th ed. Springer International Publishing, 2020. doi: 10.1007/978-3-030-33128-3.
O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional Networks for Biomedical Image Segmentation,†Springer Int. Publ. Switz., vol. 9351, no. Cvd, pp. 234–241, 2015, doi: 10.1007/978-3-319-24574-4.
R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM : Visual Explanations from Deep Networks via Gradient-based Localization,†in 2017 IEEE International Conference on Computer Vision, IEEE, 2017, pp. 618–626. doi: 10.1109/ICCV.2017.74.
C. Wang et al., “A Unified Framework for Automatic Wound Segmentation and Analysis with Deep Convolutional Neural Networks,†in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE, 2015, pp. 2415–2418. doi: 10.1109/EMBC18176.2015.
R. Zhang, D. Tian, D. Xu, W. Qian, and Y. Yao, “A Survey of Wound Image Analysis Using Deep Learning : Classification , Detection , and Segmentation,†IEEE Access, vol. 10, no. June, pp. 79502–79515, 2022, doi: 10.1109/ACCESS.2022.3194529.
C. Wang et al., “Fully automatic wound segmentation with deep convolutional neural networks,†Sci. Rep., vol. 10, no. 1, Dec. 2020, doi: 10.1038/s41598-020-78799-w.
C. Cui et al., “Diabetic Wound Segmentation using Convolutional Neural Networks,†in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, 2019, pp. 1002–1005. doi: 10.1109/EMBC.2019.8856665.
E. P. Ong, C. Tang Ka Yin, and B. H. Lee, “Efficient Deep Learning-based Wound-bed Segmentation for Mobile Applications,†Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. EMBS, vol. 2020-July, pp. 1654–1657, 2020, doi: 10.1109/EMBC44109.2020.9176299.
A. Wagh et al., “Semantic segmentation of smartphone wound images: Comparative analysis of AHRF and CNN-based approaches,†IEEE Access, vol. 8, pp. 181590–181604, 2020, doi: 10.1109/ACCESS.2020.3014175.
C. Wang, D. . Anisuzzaman, and V. Williamson, “Wound Segmentation,†https://github.com/uwm-bigdata/wound-segmentation, 2021. https://github.com/uwm-bigdata/wound-segmentation
A. Breheret, “Pixel Annotation Tool,†https://github.com/abreheret/PixelAnnotationTool, 2017. https://github.com/abreheret/PixelAnnotationTool (accessed Jun. 08, 2023).
K. Team, “Keras Applications.†https://keras.io/api/applications/ (accessed Aug. 15, 2023).
A. G. Howard et al., “MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew,†arXiv Prepr. arXiv1704.04861, 2017, doi: https://doi.org/10.48550/arXiv.1704.04861.
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen, “MobileNetV2: Inverted Residuals and Linear Bottlenecks,†Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 4510–4520, 2018, doi: 10.1109/CVPR.2018.00474.
B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le, “Learning Transferable Architectures for Scalable Image Recognition,†Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 8697–8710, 2018, doi: 10.1109/CVPR.2018.00907.
M. Tan and Q. V Le, “EfficientNet : Rethinking Model Scaling for Convolutional Neural Networks,†in Proceedings of the 36 th International Conference on Machine Learning, California, 2019, pp. 6105–6114. doi: https://doi.org/10.48550/arXiv.1905.11946.
Tensorflow, “tf.keras.losses.CategoricalCrossentropy,†TensorFlow API Documentation. https://www.tensorflow.org/api_docs/python/tf/keras/losses/CategoricalCrossentropy (accessed Jun. 26, 2023).
B. N. Chaithanya, T. J. Swasthika Jain, A. Usha Ruby, and A. Parveen, “An approach to categorize chest X-ray images using sparse categorical cross entropy,†Indones. J. Electr. Eng. Comput. Sci., vol. 24, no. 3, pp. 1700–1710, 2021, doi: 10.11591/ijeecs.v24.i3.pp1700-1710.
Tensorflow, “tf.keras.losses.SparseCategoricalCrossentropy,†TensorFlow API Documentation, 2021. https://www.tensorflow.org/api_docs/python/tf/keras/losses/SparseCategoricalCrossentropy (accessed Jun. 26, 2023).
A. A. Taha and A. Hanbury, “Metrics for evaluating 3D medical image segmentation: Analysis, selection, and tool,†BMC Med. Imaging, vol. 15, no. 1, 2015, doi: 10.1186/s12880-015-0068-x.
S. M. Jaisakthi, P. Mirunalini, and C. Aravindan, “Automated skin lesion segmentation of dermoscopic images using GrabCut and kmeans algorithms,†IET Comput. Vis., vol. 12, no. 8, pp. 1088–1095, 2018, doi: 10.1049/iet-cvi.2018.5289
