Optimized Weighted Soft-Voting Hybrid Ensemble for Explainable Network Intrusion Detection on UNSW-NB15 with ROC-Based Benchmarking
Authors: Anusuiya Walre, Mohit Jain Jain
Published in: IJRRETAS, Volume 12, Issue 10, pp. 68-82 (08 Oct 2026)
Impact Factor: 7.95 (2026)
License:
CC BY 4.0 (Open Access)
Certificate: View Certificate
Abstract
Network intrusion detection systems (IDS) must separate malicious from benign traffic at very low false-alarm rates while remaining explainable and inexpensive to run. This paper presents an Optimized Weighted Soft-Voting Hybrid Ensemble (OWSVE) that fuses the class probabilities of Random Forest, CatBoost and LightGBM using weights searched to maximize weighted F1-score. On the 257,673-flow UNSW-NB15 corpus, we remove leakage-prone attributes, select 34 features by mutual information, partition the data 90/10 with stratification, apply Min-Max scaling, and balance the training data with SMOTE. On a held-out test set of 32,936 flows, OWSVE attains 96.37curacy, a Matthews correlation coefficient of 0.9274, a ROC-AUC of 0.9958 and a PR-AUC of 0.9959, exceeding each base learner (ROC-AUC 0.9947–0.9957). Compared with the ROC performance reported for a recent generative-AI-embedded HGT–LSTM–TabTransformer hybrid (AUC 0.95; 0.958 in its cross-dataset table), OWSVE raises the AUC by 0.038 and lowers the false positive rate from 0.0368 to 0.0302 while delivering a higher true positive rate (0.958 versus 0.9548), so its operating point dominates the reference in ROC space. SHAP and LIME analyses show that source load, TCP base sequence number, source packet count and duration drive decisions, giving analysts transparent evidence for each alert.
Keywords
- intrusion detection
- UNSW-NB15
- ensemble learning
- soft voting
- ROC-AUC
- explainable AI
- SHAP
- LIME
- SMOTE
References
- N. Moustafa and J. Slay, “UNSW-NB15: A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set),” in Proc. Military Commun. Inf. Syst. Conf. (MilCIS), Canberra, Australia, 2015, pp. 1–6.
- N. Moustafa and J. Slay, “The evaluation of network anomaly detection systems: Statistical analysis of the UNSW-NB15 data set and the comparison with the KDD99 data set,” Inf. Secur. J.: Glob. Perspect., vol. 25, no. 1–3, pp. 18–31, 2016.
- A. Prabhu B.P. and N. R. Sunitha, “A hybrid artificial intelligence model for cyberattack detection using a generative AI embedded approach,” Discover Artif. Intell., vol. 6, art. 123, 2026, doi:10.1007/s44163-026-00901-4.
- T. Fawcett, “An introduction to ROC analysis,” Pattern Recognit. Lett., vol. 27, no. 8, pp. 861–874, 2006.
- I. Sharafaldin, A. H. Lashkari, and A. A. Ghorbani, “Toward generating a new intrusion detection dataset and intrusion traffic characterization,” in Proc. 4th Int. Conf. Inf. Syst. Secur. Privacy (ICISSP), Portugal, 2018.
- A. Houkan et al., “Artificial intelligence approach to intrusion detection in industrial control systems with real world dataset generation and model evaluation,” Discover Artif. Intell., vol. 5, art. 307, 2025.
- L. Breiman, “Random forests,” Mach. Learn., vol. 45, no. 1, pp. 5–32, 2001.
- T. Chen and C. Guestrin, “XGBoost: A scalable tree boosting system,” in Proc. 22nd ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2016, pp. 785–794.
- L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, “CatBoost: Unbiased boosting with categorical features,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), 2018, pp. 6638–6648.
- G. Ke et al., “LightGBM: A highly efficient gradient boosting decision tree,” in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2017, pp. 3146–3154.
- T. G. Dietterich, “Ensemble methods in machine learning,” in Multiple Classifier Systems, LNCS 1857. Springer, 2000, pp. 1–15.
- N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic minority over-sampling technique,” J. Artif. Intell. Res., vol. 16, pp. 321–357, 2002.
- I. J. Goodfellow, J. Shlens, and C. Szegedy, “Explaining and harnessing adversarial examples,” in Proc. Int. Conf. Learn. Represent. (ICLR), 2015.
- S. M. Lundberg and S.-I. Lee, “A unified approach to interpreting model predictions,” in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2017, pp. 4765–4774.
How to Cite
More from this Issue
- AI-Based Crop Monitoring System: Cotton Disease Detection Using CNNAarya Sonawane, Anmol Patil, Suyog Pande
- Invisible Costs of Digitization: Technostress in Indore’s Financial SectorTrapti Dubey, Rajendra Singh Sisodiya, Vijaya Jain
- Tribal Communities In Bastar District: Challenges and the Role of Social WorkAmit Verma
- Exploring the Impact of Central Bank Digital Currencies on Global Financial SystemsNidhi Vaidya, Swati Mishra, Sneha Jadhav, Vijaya Jain