Penerapan SMOTE untuk Mengatasi Imbalance Class dalam Klasifikasi Television Advertisement Performance Rating Menggunakan Artificial Neural Network

Authors

  • Edi Sutoyo Program Studi Sistem Informasi, Fakultas Rekayasa Industri, Telkom University Jl. Telekomunikasi Jl. Terusan Buah Batu, Sukapura, Kec. Dayeuhkolot, Kota Bandung, Jawa Barat 40257
  • M Asri Fadlurrahman Program Studi Sistem Informasi, Fakultas Rekayasa Industri, Telkom University Jl. Telekomunikasi Jl. Terusan Buah Batu, Sukapura, Kec. Dayeuhkolot, Kota Bandung, Jawa Barat 40257

DOI:

https://doi.org/10.26418/jp.v6i3.42896

Keywords:

Artificial Neural Network, Classification, Data Mining, Imbalance Class, SMOTE

Abstract

Dalam data nyata, ada banyak situasi di mana jumlah instance di satu class jauh lebih sedikit daripada jumlah instance di class lain. Keadaan ini disebut sebagai masalah dataset tidak seimbang (imbalance class). Imbasnya kinerja klasifikasi biasanya menurun di beberapa aplikasi data mining. Pada penelitian ini, diidentifkasi bahwa dataset performansi rating iklan TV yang digunakan memiliki permasalahan imbalance class yang sangat besar dimana instance yang memiliki nilai rating tinggi, jauh lebih sedikit dibandingkan instance yang memiliki nilai rating kecil dan menengah. Sehingga diperlukan metode over-sampling untuk mengatasi permasalahan imbalance class tersebut. Metode yang dapat digunakan adalah Synthetic Minority Over-sampling Technique (SMOTE). Untuk memvalidasi keefektifan model yang diusulkan, dilakukan dua skenario eksperimental yaitu: pertama algoritma ANN langsung digunakan untuk pemodelan tanpa mempertimbangkan ketidakseimbangan kelas, dan kedua dilakukan over-sampling SMOTE untuk meningkatkan jumlah dataset agar mencapai dataset yang seimbang. Hasil eksperimen menunjukkan bahwa performansi ANN+SMOTE mencapai akurasi sebesar 87.06% dibandingkan ANN yang hanya sebesar 86.35%. Penerapan Teknik SMOTE terbukti dapat mengatasi masalah ketidakseimbangan data dan mendapatkan hasil klasifikasi yang lebih baik.

References

P. Kotler and K. L. Keller, MarkKotler, P., & Keller, K. L. 2016.

J. Pych, “Must Know Advertising Terms and Metrics | Bionic Advertising Systems,†Bionic , 2016. .

J. Han, Data Mining: Concepts and Techniques (The Morgan Kaufmann Series in Data Management Systems). 2011.

J. Han, M. Kamber, and J. Pei, Data mining: Data mining Concepts and Techniques, 3rd ed. Morgan Kaufmann, 2012.

G. Kesavaraj and S. Sukumaran, “A study on classification techniques in data mining,†in 2013 4th International Conference on Computing, Communications and Networking Technologies, ICCCNT 2013, 2013, doi: 10.1109/ICCCNT.2013.6726842.

M. M. Saritas and A. Yasar, “Performance Analysis of ANN and Naive Bayes Classification Algorithm for Data Classification,†Int. J. Intell. Syst. Appl. Eng., vol. 7, no. 2, pp. 88–91, Jun. 2019, doi: 10.18201//ijisae.2019252786.

E. Sutoyo, A. Almaarif, and others, “Educational Data Mining for Predicting Student Graduation Using the Na{"i}ve Bayes Classifier Algorithm,†J. RESTI (Rekayasa Sist. Dan Teknol. Informasi), vol. 4, no. 1, pp. 95–101, 2020.

E. Sutoyo, R. R. Saedudin, I. T. R. Yanto, and A. Apriani, “Application of adaptive neuro-fuzzy inference system and chicken swarm optimization for classifying river water quality,†in Proceeding - 2017 5th International Conference on Electrical, Electronics and Information Engineering: Smart Innovations for Bridging Future Technologies, ICEEIE 2017, 2018, vol. 2018-January, pp. 118–122, doi: 10.1109/ICEEIE.2017.8328774.

R. Rachmat and S. Suhartono, “Comparative Analysis of Single Exponential Smoothing and Holt’s Method for Quality of Hospital Services Forecasting in General Hospital,†Bull. Comput. Sci. Electr. Eng., vol. 1, no. 2, pp. 80–86, Aug. 2020, doi: 10.25008/bcsee.v1i2.8.

H. Mudia, “Back Propagation Neural Network for Controlling Coupled Water Tank,†Bull. Comput. Sci. Electr. Eng., vol. 1, no. 1, pp. 12–18, 2020, doi: 10.25008/bcsee.v1i1.4.

S. N. W. Ahmad, M. A. Ismail, E. Sutoyo, S. Kasim, and M. S. Mohamad, “Comparative Performance of Machine Learning Methods for Classification on Phishing Attack Detection,†Int. J., vol. 9, no. 1.5, 2020.

I. Dokare and N. Kant, “Performance Analysis of SVM, k-NN and BPNN Classifiers for Motor Imagery,†Int. J. Eng. Trends Technol., vol. 10, 2014.

S. Dewi, “KOMPARASI 5 METODE ALGORITMA KLASIFIKASI DATA MINING PADA PREDIKSI KEBERHASILAN PEMASARAN PRODUK LAYANAN PERBANKAN,†None, 2016.

A. El-Shahat, Advanced Applications for Artificial Neural Networks. 2018.

S. Haykin, Neural Networks and Learning Machines. 2008.

R. Barandela, R. M. Valdovinos, J. S. Sánchez, and F. J. Ferri, “The imbalanced training sample problem: Under or over sampling?,†in Joint IAPR international workshops on statistical techniques in pattern recognition (SPR) and structural and syntactic pattern recognition (SSPR), 2004, pp. 806–814.

G. E. Batista, R. C. Prati, and M. C. Monard, “A study of the behavior of several methods for balancing machine learning training data,†ACM SIGKDD Explor. Newsl., vol. 6, no. 1, pp. 20–29, 2004.

H. M. Nguyen, E. W. Cooper, and K. Kamei, “Borderline over-sampling for imbalanced data classification,†Int. J. Knowl. Eng. Soft Data Paradig., vol. 3, no. 1, pp. 4–21, 2011.

N. V Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic Minority Over-sampling Technique,†J. Artif. Intell. Res., vol. 16, pp. 321–357, 2002.

I. H. Witten, E. Frank, and M. a Hall, Data Mining: Practical Machine Learning Tools and Techniques (Google eBook). 2011.

D. T. Larose, Discovering Knowledge in Data: An Introduction to Data Mining. 2005.

E. B. Nababan and M. Zarlis, “Analisis Fungsi Aktivasi Sigmoid Biner Dan SIgmoid Bipolar Dalam Algoritma Backpropagation Pada Prediksi Kemampuan Siswa,†J. Teknovasi, vol. 02, no. 1, pp. 103–116, 2015.

D. Svozil, V. Kvasnicka, and J. Pospichal, “Introduction to multi-layer feed-forward neural networks,†Chemom. Intell. Lab. Syst., vol. 39, no. 1, pp. 43–62, 1997.

R. Eldan and O. Shamir, “The power of depth for feedforward neural networks,†in Conference on learning theory, 2016, pp. 907–940.

M. Cilimkovic, “Neural Networks and Back Propagation Algorithm,†Fett.Tu-Sofia.Bg, pp. 3–7, 2010.

G. Dhaneswara and V. (Jurusan I. K. U. K. P. S. Moertini, “Jaringan Saraf Tiruan Propagasi Balik Untuk Klasifikasi Data,†Integr. FMIPA Unpar, 2004.

H. He and E. A. Garcia, “Learning from imbalanced data,†IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263–1284, Sep. 2009, doi: 10.1109/TKDE.2008.239.

Y. Sun, A. K. C. Wong, and M. S. Kamel, “Classification of imbalanced data: A review,†Int. J. Pattern Recognit. Artif. Intell., vol. 23, no. 4, pp. 687–719, Jun. 2009, doi: 10.1142/S0218001409007326.

G. Nguyen, A. Bouzerdoum, and S. L. Phung, “Learning pattern classification tasks with imbalanced data sets,†Fac. Informatics - Pap., Jan. 2009.

S. T. Jishan, R. I. Rashu, N. Haque, and R. M. Rahman, “Improving accuracy of students’ final grade prediction model using optimal equal width binning and synthetic minority over-sampling technique,†Decis. Anal., vol. 2, no. 1, pp. 1–25, Dec. 2015, doi: 10.1186/s40165-014-0010-2.

Downloads

Published

2020-12-17