Novel multiobjective TLBO algorithms for the feature subset selection problem

Kiziloz H. E., Deniz A., Dokeroglu T., COŞAR A.

NEUROCOMPUTING, vol.306, pp.94-107, 2018 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 306
  • Publication Date: 2018
  • Doi Number: 10.1016/j.neucom.2018.04.020
  • Journal Name: NEUROCOMPUTING
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.94-107
  • Keywords: Teaching learning based optimization, Multiobjective feature selection, Supervised learning, LEARNING-BASED OPTIMIZATION, DIFFERENTIAL EVOLUTION, CLASSIFICATION
  • Middle East Technical University Affiliated: Yes


Teaching Learning Based Optimization (TLBO) is a new metaheuristic that has been successfully applied to several intractable optimization problems in recent years. In this study, we propose a set of novel multiobjective TLBO algorithms combined with supervised machine learning techniques for the solution of Feature Subset Selection (FSS) in Binary Classification Problems (FSS-BCP). Selecting the minimum number of features while not compromising the accuracy of the results in FSS-BCP is a multiobjective optimization problem. We propose TLBO as a FSS mechanism and utilize its algorithm-specific parameterless concept that does not require any parameters to be tuned during the optimization. Most of the classical metaheuristics such as Genetic and Particle Swarm Optimization algorithms need additional efforts for tuning their parameters (crossover ratio, mutation ratio, velocity of particle, inertia weight, etc.), which may have an adverse influence on their performance. Comprehensive experiments are carried out on the well-known machine learning datasets of UCI Machine Learning Repository and significant improvements have been observed when the proposed multiobjective TLBO algorithms are compared with state-of-the-art NSGA-II, Particle Swarm Optimization, Tabu Search, Greedy Search, and Scatter Search algorithms. (C) 2018 Elsevier B.V. All rights reserved.