Studi Komparatif Multinomial Naïve Bayes, Decision Tree, dan K-Nearest Neighbor dalam Klasifikasi Validasi Ulasan Clash of Clans oleh Pengguna Ahli

Authors

  • Ramadhani Ramadhani Universitas Islam Syekh Yusuf
  • Ramadhanu Ramadhanu Universitas Islam Syekh Yusuf
  • Mohammad Ridwan Universitas Islam Syekh Yusuf
  • Amrullah Fajri Artha Abdillah Universitas Islam Syekh Yusuf
  • Taufik Hidayat Universitas Islam Syekh Yusuf http://orcid.org/0000-0003-3131-6430

Keywords:

Klasifikasi Teks, Clash of Clans, MNB, Decision Tree, K-Nearest Neighbor, Google Play Store,

Abstract

User reviews of the app, including popular games like Clash of Clans, are an important indicator of the quality of the app. However, fake reviews can mislead users and damage the app's reputation. This study aims to classify Clash of Clans reviews on the Google Play Store as "valid" or "invalid" using three algorithms: decision tree (DT), K-Nearest Neighbors (KNN), and Multinomial Naive Bayes (MNB). The dataset used contains 320 Indonesian reviews with a rating of 1 to 3 and validated by experienced players. Text features are extracted using TF-IDF and the model is evaluated using cross validation. The results show that the decision tree has the highest accuracy (64%), followed by MNB (59%) and KNN (53%). Cross validation shows that MNB has the most stable performance, while KNN is more sensitive to data changes. Decision Trees show the lowest performance and are less effective on new data because they tend to overfit. The study provides valuable insights into the selection of user review classification algorithms by considering accuracy, precision, acquisition, and performance stability.

Author Biographies

Ramadhani Ramadhani, Universitas Islam Syekh Yusuf

Penulis adalah mahasiswa S1 Program Studi Teknik Informatika di Universitas Universitas Islam Syekh Yusuf

Ramadhanu Ramadhanu, Universitas Islam Syekh Yusuf

Penulis adalah mahasiswa S1 Program Studi Teknik Informatika di Universitas Universitas Islam Syekh Yusuf

Mohammad Ridwan, Universitas Islam Syekh Yusuf

Dosen di Program Studi Teknik Informatika, Universitas Islam Syekh Yusuf

Amrullah Fajri Artha Abdillah, Universitas Islam Syekh Yusuf

Penulis adalah mahasiswa S1 Program Studi Teknik Informatika di Universitas Universitas Islam Syekh Yusuf

Taufik Hidayat, Universitas Islam Syekh Yusuf

Dosen di Program Studi Teknik Informatika, Universitas Islam Syekh Yusuf

References

A. I. Tanggraeni and M. N. N. Sitokdana, “Analisis Sentimen Aplikasi E-Government Pada Google Play Menggunakan Algoritma Naïve Bayes,†vol. 9, no. 2, pp. 785–795, 2022.

F. Ichsan and H. B. Herawan, “Analisis Sentimen Citayam Fashion Week menggunakan Support Vector Machine Analysis of Citayam Fashion Week Sentiment Using Support Vector Machine,†Jurnal Sistem dan Teknologi Informasi (JustIN), vol. 10, no. 4, pp. 513–517, 2022, doi: 10.26418/justin.v10i4.56664.

N. Khoirunnisaa, K. Nabila, N. Kesuma, S. Setiawan, A. Yunizar, and P. Yusuf, “Klasifikasi Teks Ulasan Aplikasi Netflix Pada Google Play Store Menggunakan Algoritma Naive Bayes dan SVM,†vol. 7, no. 1, pp. 64–73, 2024.

E. Hasibuan and E. A. Heriyanto, “ANALISIS SENTIMEN PADA ULASAN APLIKASI AMAZON SHOPPING DI GOOGLE PLAY STORE MENGGUNAKAN NAIVE BAYES CLASSIFIER,†JTS, vol. 1, no. 3, pp. 13–24, 2022.

N. R. S. A. O. S. Amalia Anjani Arifiyanti, “ANALISIS SENTIMEN ULASAN PENGGUNA BSI MOBILE PADA GOOGLE PLAY DENGAN PENDEKATAN SUPERVISED LEARNING,†JIP (Jurnal Informatika Polinema).

N. Zelina and A. Afiyati, “Analisis Sentimen Ulasan Pengguna Aplikasi M-Banking Menggunakan Algoritma Support Vector Machine dan Decision Tree,†2024.

N. Khoirunnisaa, K. Nabila, N. Kesuma, S. Setiawan, A. Yunizar, and P. Yusuf, “Klasifikasi Teks Ulasan Aplikasi Netflix Pada Google Play Store Menggunakan Algoritma Naive Bayes dan SVM,†vol. 7, no. 1, pp. 64–73, 2024.

A. I. Tanggraeni and M. N. N. Sitokdana, “Analisis Sentimen Aplikasi E-Government Pada Google Play Menggunakan Algoritma Naïve Bayes,†vol. 9, no. 2, pp. 785–795, 2022.

M. Rezki, D. N. Kholifah, M. Faisal, R. Suryadithia, U. Bina, and S. Informatika, “Analisis Review Pengguna Google Meet dan Zoom Cloud Meeting Menggunakan Algoritma Naïve Bayes,†2020. [Online]. Available: http://ejournal.bsi.ac.id/ejurnal/index.php/infortech264

S. Alpin Rizaldi, S. Alam, and I. Kurniawan, “ANALISIS SENTIMEN PENGGUNA APLIKASI JMO (JAMSOSTEK MOBILE) PADA GOOGLE PLAY STORE MENGGUNAKAN METODE NAIVE BAYES 1),†Jurnal Ilmiah Teknik dan Ilmu Komputer, vol. 2, no. 3, pp. 109–117, 2023, doi: 10.55123.

I. Akbar and M. M. Iqbal, “Optimasi Algoritma Support Vector Machine untuk Analisis Klasifikasi Teks Pemintaan Informasi di Platform Online Shop,†Jurnal Accounting Information System (AIMS, vol. 6, no. 2, pp. 119–126, 2023, doi: 10.32627.

Ramadhani and Ramadhanu, “Metode Machine Learning untuk Klasifikasi Data Gizi Balita dengan Algoritma Naïve Bayes, KNN dan Decision Tree,†Jurnal SIMETRIS, vol. 15, no. 1, 2024.

Ramadhani, Ramadhanu, and Taufik Hidayat, “Exploratory Data Analysis (EDA) untuk Mengetahui Distribusi Data Kualitas Susu Sapi,†SAINTIKOM, 2024, [Online]. Available: https://ojs.trigunadharma.ac.id/index.php/jis/index

M. Siino, I. Tinnirello, and M. La Cascia, “Is text preprocessing still worth the time? A comparative survey on the influence of popular preprocessing methods on Transformers and traditional classifiers,†Inf Syst, vol. 121, Mar. 2024, doi: 10.1016/j.is.2023.102342.

N. Nofiyani and W. Wulandari, “Implementasi Electronic Data Processing Untuk meningkatkan Efektifitas dan Efisiensi Pada Text Mining,†JURNAL MEDIA INFORMATIKA BUDIDARMA, vol. 6, no. 3, p. 1621, Jul. 2022, doi: 10.30865/mib.v6i3.4332.

F. N. Zaman, M. A. Fadhilah, M. A. Ulinuha, and K. Umam, “MENGANALISIS RESPONS NETIZEN TWITTER TERHADAP PROGRAM MAKAN SIANG GRATIS MENERAPKAN NLP METODE NAÃVE BAYES,†2024. [Online]. Available: https://jurnal.umj.ac.id/index.php/just-it/index

M. F. Karaca, “Effects of preprocessing on text classification in balanced and imbalanced datasets,†KSII Transactions on Internet and Information Systems, vol. 18, no. 3, pp. 591–609, Mar. 2024, doi: 10.3837/tiis.2024.03.004.

P. Berkecz, G. Orosz, Z. Szántó, G. Szabó, and R. Farkas, “Hybrid lemmatization in HuSpaCy.â€

O. Toporkov and R. Agerri, “On the Role of Morphological Information for Contextual Lemmatization,†Feb. 2023, [Online]. Available: http://arxiv.org/abs/2302.00407

A. A. Khan, “Balanced Split: A new train-test data splitting strategy for imbalanced datasets,†Dec. 2022, [Online]. Available: http://arxiv.org/abs/2212.11116

M. Das, S. Kamalanathan, and P. Alphonse, “A Comparative Study on TF-IDF feature Weighting Method and its Analysis using Unstructured Dataset,†2020.

F. A. Ramadhan, S. H. Sitorus, and T. Rismawan, “Penerapan Metode Multinomial Naïve Bayes untuk Klasifikasi Judul Berita Clickbait dengan Term Frequency - Inverse Document Frequency,†Jurnal Sistem dan Teknologi Informasi (JustIN), vol. 11, no. 1, p. 70, Jan. 2023, doi: 10.26418/justin.v11i1.57452.

B. Qin, J. Zhang, and H. Chen, “Malware detection based on TF-(IDF&ICF) method,†in Journal of Physics: Conference Series, IOP Publishing Ltd, Sep. 2021. doi: 10.1088/1742-6596/2024/1/012030.

Y. Setiawan, D. Gunawan, and R. Efendi, “Feature Extraction TF-IDF to Perform Cyberbullying Text Classification: A Literature Review and Future Research Direction,†in 2022 International Conference on Information Technology Systems and Innovation (ICITSI), IEEE, Nov. 2022, pp. 283–288. doi: 10.1109/ICITSI56531.2022.9970942.

T. Dodiya, “Using Term Frequency - Inverse Document Frequency to find the Relevance of Words in Gujarati Language,†Int J Res Appl Sci Eng Technol, vol. 9, no. 4, pp. 378–381, Apr. 2021, doi: 10.22214/ijraset.2021.33625.

Z. Saurav, M. M. Mitu, N. S. Ritu, Md. A. Hasan, S. Arefin, and D. Md. Farid, “A New Method for Learning Decision Tree Classifier,†in 2023 International Conference on Electrical, Computer and Communication Engineering (ECCE), IEEE, Feb. 2023, pp. 1–6. doi: 10.1109/ECCE57851.2023.10101557.

V. Kalra, I. Kashyap, and H. Kaur, “Effect of Distance Measures on K-Nearest Neighbour Classifier,†in 2022 Second International Conference on Computer Science, Engineering and Applications (ICCSEA), IEEE, Sep. 2022, pp. 1–7. doi: 10.1109/ICCSEA54677.2022.9936314.

R. Hidayat, D. Kartini, M. I. Mazdadi, I. Budiman, and R. Ramadhani, “Implementasi Seleksi Fitur Binary Particle Swarm Optimization pada Algoritma K-NN untuk Klasifikasi Kanker Payudara,†Jurnal Sistem dan Teknologi Informasi (JustIN), vol. 11, no. 1, p. 135, Jan. 2023, doi: 10.26418/justin.v11i1.53608.

N. Kalcheva, G. Marinova, and M. Todorova, “Comparative Analysis of the Bernoulli and Multinomial Naive Bayes Classifiers for Text Classification in Machine Learning,†in 2023 International Conference Automatics and Informatics (ICAI), IEEE, Oct. 2023, pp. 28–31. doi: 10.1109/ICAI58806.2023.10339077.

F. Istighfar, A. B. P. Negara, and T. Tursina, “Klasifikasi Bidang Keahlian Mahasiswa Menggunakan Algoritma Naive Bayes,†Jurnal Sistem dan Teknologi Informasi (JustIN), vol. 11, no. 1, p. 77, Jan. 2023, doi: 10.26418/justin.v11i1.52402.

Y. Widyaningsih, G. P. Arum, and K. Prawira, “APLIKASI K-FOLD CROSS VALIDATION DALAM PENENTUAN MODEL REGRESI BINOMIAL NEGATIF TERBAIK,†BAREKENG: Jurnal Ilmu Matematika dan Terapan, vol. 15, no. 2, pp. 315–322, Jun. 2021, doi: 10.30598/barekengvol15iss2pp315-322.

Y. Ansori and K. F. H. Holle, “Perbandingan Metode Machine Learning dalam Analisis Sentimen Twitter,†Jurnal Sistem dan Teknologi Informasi (JustIN), vol. 10, no. 4, p. 429, Dec. 2022, doi: 10.26418/justin.v10i4.51784.

S. Riyanto, I. S. Sitanggang, T. Djatna, and T. D. Atikah, “Comparative Analysis using Various Performance Metrics in Imbalanced Data for Multi-class Text Classification,†International Journal of Advanced Computer Science and Applications, vol. 14, no. 6, 2023, doi: 10.14569/IJACSA.2023.01406116.

R. Padilla, S. L. Netto, and E. A. B. da Silva, “A Survey on Performance Metrics for Object-Detection Algorithms,†in 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), IEEE, Jul. 2020, pp. 237–242. doi: 10.1109/IWSSIP48289.2020.9145130.

Downloads

Published

2024-11-02

Issue

Vol. 12 No. 4 (2024)

Section

Articles

License

Copyright (c) 2024 JUSTIN (Jurnal Sistem dan Teknologi Informasi)

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

The author owns the copyright in his paper and agrees to publish his paper to JUSTIN by giving the rights to the first publication of his paper which is simultaneously licensed under the Creative Commons Attribution License, namely the Similar International 4.0 license (CC BY-NC-SA 4.0).  

                             

This is a human-readable summary of (and not a substitute for) the license. Disclaimer.

You are free to:
Share "” copy and redistribute the material in any medium or format
Adapt "” remix, transform, and build upon the material
The licensor cannot revoke these freedoms as long as you follow the license terms.

Under the following terms:
Attribution "” You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial "” You may not use the material for commercial purposes.
ShareAlike "” If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
No additional restrictions "” You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.