Dual-Phase Local Search Embedded Multi-Verse Optimizer for Optimal Feature Subset Selection

Authors

1 Department of Industrial Engineering, K. N. Toosi University of Technology, Tehran, Iran.

2 Department of Industrial Engineering, Information Technology Group, K. N. Toosi University of Technology, Tehran, Iran.

10.22059/aie.2025.388689.1936

Abstract

Feature selection plays a pivotal role in enhancing the performance of machine learning models by reducing dimensionality, improving interpretability, and minimizing computational overhead. This study presents the Improved Multi-Verse Optimizer (IMVO), a new feature selection algorithm that merges the global exploration ability of the standard Multi-Verse Optimizer (MVO) with a dual-phase mutation-based local search mechanism. Unlike previous MVO-based or hybrid metaheuristic approaches, IMVO simultaneously strengthens exploitation through targeted refinement of the best solutions and preserves population diversity via periodic random-solution mutations. This strategic combination mitigates premature convergence, accelerates convergence speed, and improves robustness across diverse high-dimensional datasets. Comprehensive experiments on 14 widely used datasets obtained from the UCI repository show that IMVO consistently achieves higher classification accuracy, fewer selected features, and lower fitness values than five state-of-the-art algorithms (MVO, GA, PSO , SSA, HHO). Quantitative analysis using the Wilcoxon signed-rank test certifies the significance of these enhancements, underscoring the algorithm’s reliability. While the inclusion of local search increases computational cost, the demonstrated gains in accuracy, stability, and feature reduction affirm this cost-benefit relationship, positioning IMVO as a competitive and versatile tool for feature selection and related optimization problems.

Keywords

Main Subjects