Seleksi Fitur Menggunakan Sequential Forward Selection untuk Meningkatkan Kinerja Decision Tree dalam Prediksi Batu Empedu
Keywords:
Decision Tree, Feature Selection, Gallstone, Prediction, Sequential Forward SelectionAbstract
Gallstone disease is one of the most common gastrointestinal disorders, and early detection using non-invasive data can support screening prior to imaging examinations. This study aims to improve the performance of the Decision Tree algorithm in predicting gallstone disease by applying the Sequential Forward Selection (SFS) feature selection method. The dataset used is the public Gallstone dataset, consisting of 319 records and 38 features covering demographic, bioimpedance, and laboratory data. The research stages comprise Min-Max standardization, feature selection with SFS, and Decision Tree model development validated using 10-fold cross validation. Model performance was evaluated using a confusion matrix with accuracy and Area Under the Curve (AUC) metrics. The results show that the Decision Tree without feature selection (38 features) achieved an accuracy of only 67.71% and an AUC of 0.677. After applying SFS, the best performance was obtained using only 6 features, namely Coronary Artery Disease, Hyperlipidemia, Height, Hepatic Fat Accumulation, C-Reactive Protein, and Vitamin D, with an accuracy of 76.18% and an AUC of 0.762. Thus, SFS increased the accuracy by 8.46% and the AUC by 0.085 while reducing the number of features by 84%. These findings indicate that SFS not only improves the predictive performance of the Decision Tree but also produces a simpler and more interpretable model for gallstone prediction.
References
Alija, S., Beqiri, E., Gaafar, A. S., & Hamoud, A. K. (2023). Predicting Students Performance Using Supervised Machine Learning Based on Imbalanced Dataset and Wrapper Feature Selection. Informatica, 47(1), 11-20.
Aswal, S., Jyothi, A., & Mehra, R. (2023). Feature Selection Method Based on Honeybee-SMOTE for Medical Data Classification. Informatica, 46(9), 111-118. https://doi.org/10.31449/inf.v46i9.4098
Baddam, A., Akuma, O., Raj, R., Akuma, C. M., Augustine, S. W., & Sheikh Hanafi, I. (2023). Analysis of Risk Factors for Cholelithiasis: A Single-Center Retrospective Study. Cureus, 15(9), e46155. https://doi.org/10.7759/cureus.46155
Baghdadi, N. A., Farghaly Abdelaliem, S. M., Malki, A., Gad, I., Ewis, A., & Atlam, E. (2023). Advanced machine learning techniques for cardiovascular disease early detection and diagnosis. Journal of Big Data, 10(1), 144. https://doi.org/10.1186/s40537-023-00817-1
Bhatt, C. M., Patel, P., Ghetia, T., & Mazzeo, P. L. (2023). Effective Heart Disease Prediction Using Machine Learning Techniques. Algorithms, 16(2), 88. https://doi.org/10.3390/a16020088
Cabello-Solorzano, K., Ortigosa de Araujo, I., Pena, M., Correia, L., & Tallon-Ballesteros, A. J. (2023). The Impact of Data Normalization on the Accuracy of Machine Learning Algorithms: A Comparative Analysis. In Proceedings of the 18th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2023) (Vol. 750, pp. 344-353). Springer. https://doi.org/10.1007/978-3-031-42536-3_33
Chakraborty, C., & Mukherjee, N. (2025). Bayesian Hybrid Machine Learning of Gallstone Risk. arXiv preprint arXiv:2506.14561. https://doi.org/10.48550/arXiv.2506.14561
Chandrasekhar, N., & Peddakrishna, S. (2023). Enhancing Heart Disease Prediction Accuracy through Machine Learning Techniques and Optimization. Processes, 11(4), 1210. https://doi.org/10.3390/pr11041210
Chotchantarakun, K. (2023). Optimizing Sequential Forward Selection on Classification using Genetic Algorithm. Informatica, 47(9), 1-12. https://doi.org/10.31449/inf.v46i9.4964
Esen, I., Arslan, H., Akturk Esen, S., Gulsen, M., Kultekin, N., & Ozdemir, O. (2024). Early prediction of gallstone disease with a machine learning-based method from bioimpedance and laboratory data. Medicine, 103(8), e37258. https://doi.org/10.1097/MD.0000000000037258
Hidayat, R., Kartini, D., Mazdadi, M. I., Budiman, I., & Ramadhani, R. (2023). Implementasi Seleksi Fitur Binary Particle Swarm Optimization pada Algoritma K-NN untuk Klasifikasi Kanker Payudara. Jurnal Sistem dan Teknologi Informasi, 11(2), 135-139.
Ismafillah, D., Rohana, T., & Cahyana, Y. (2023). Analisis Algoritma Pohon Keputusan untuk Memprediksi Penyakit Diabetes Menggunakan Oversampling SMOTE. INFOTECH: Jurnal Informatika dan Teknologi, 4(1), 27-36.
Kurnia, D., Mazdadi, M. I., Kartini, D., Nugroho, R. A., & Abadi, F. (2023). Seleksi Fitur dengan Particle Swarm Optimization pada Klasifikasi Penyakit Parkinson Menggunakan XGBoost. Jurnal Teknologi Informasi dan Ilmu Komputer (JTIIK), 10(5), 1083-1094.
Lam, R., Zakko, A., Petrov, J. C., Kumar, P., Duffy, A. J., & Muniraj, T. (2021). Gallbladder Disorders: A Comprehensive Review. Disease-a-Month, 67(7), 101130. https://doi.org/10.1016/j.disamonth.2021.101130
Nicholas. (2025). Heart Disease Prediction with Decision Tree. Social Science and Humanities Journal, 9(1), 6451-6457. https://doi.org/10.18535/sshj.v9i01.1444
Ozcan, M., & Peker, S. (2023). A classification and regression tree algorithm for heart disease modeling and prediction. Healthcare Analytics, 3, 100130. https://doi.org/10.1016/j.health.2022.100130
Shantal, M., Othman, Z., & Abu Bakar, A. (2023). A Novel Approach for Data Feature Weighting Using Correlation Coefficients and Min-Max Normalization. Symmetry, 15(12), 2185. https://doi.org/10.3390/sym15122185
Wang, X., Yu, W., Jiang, G., Li, H., Li, S., Xie, L., Bai, X., Cui, P., Chen, Q., Lou, Y., Zou, L., Li, S., Zhou, Z., Zhang, C., Sun, P., & Mao, M. (2024). Global Epidemiology of Gallstones in the 21st Century: A Systematic Review and Meta-Analysis. Clinical Gastroenterology and Hepatology, 22(8), 1586-1595. https://doi.org/10.1016/j.cgh.2024.01.051
Yuan, S., Gill, D., Giovannucci, E. L., & Larsson, S. C. (2021). Obesity, Type 2 Diabetes, Lifestyle Factors, and Risk of Gallstone Disease: A Mendelian Randomization Investigation. Clinical Gastroenterology and Hepatology, 19(12), 2540-2548.
Zhang, M., Mao, M., Zhang, C., Hu, F., Cui, P., Li, G., Shi, J., Wang, X., & Shan, X. (2022). Blood lipid metabolism and the risk of gallstone disease: A multi-center cross-sectional study and meta-analysis. Lipids in Health and Disease, 21(1), 26. https://doi.org/10.1186/s12944-022-01635-9
