Automatic selection and recommendation of machine learning algorithms

• Grant number: 22/07458-1
• Support Opportunities: Regular Research Grants
• Start date: November 01, 2022
• End date: October 31, 2024
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Agreement: CONFAP - National Council of State Research Support Foundations
• Principal Investigator: Márcio Porto Basgalupp
• Grantee: Márcio Porto Basgalupp
• Host Institution: Instituto de Ciência e Tecnologia (ICT). Universidade Federal de São Paulo (UNIFESP). Campus São José dos Campos. São José dos Campos , SP, Brazil
• City of the host institution: São José dos Campos
• Associated researchers: Ana Carolina Lorena ; André Carlos Ponce de Leon Ferreira de Carvalho ; Cleber Zanchettin ; George Darmiton da Cunha Cavalcanti ; Péricles Barbosa Cunha de Miranda ; Ricardo Cerri

Abstract

The use of meta-learning for algorithm recommendation is a research field that has been extensively explored in recent years. Meta-learning systems for recommending algorithms can be divided into two groups: (a) systems that perform selection of algorithms or models based on meta-features; and (b) systems that search for the best possible classification algorithm in a given space of algorithms, an approach relatively less investigated than the previous one. In previous work by the proponent and his collaborators, three representative search-based meta-learning systems were developed for the automatic construction of algorithms. All of them used the evolutionary algorithm paradigm as a search method, but building different types of classification algorithms -- rule induction, decision tree induction, and Bayesian network induction. These three meta-learning systems, to the best of our knowledge, are the only meta-learning approaches for the automatic construction of algorithms in the literature. Thus, the idea of this research project is to advance in the area of automatic construction of machine learning algorithms, more specifically classification. Among the topics considered open in this area, it is possible to highlight: (I) development of approaches based on different search methods; (II) evolution of decision trees with multiple tests; (III) implementation of multi-objective approaches; (IV) automatic construction of similarity functions in the context of semi-supervised learning; (V) automatic evolution of deep neural networks; (VI) automatic construction of ensemble of classifiers; (VII) automatic construction of multi-target predictors; and (VIII) comparative study of meta-learning approaches for selection/configuration and construction of classification algorithms. (AU)

Scientific publications

(6)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

INOCENCIO JUNIOR, RONALDO LOPES; BASGALUPP, MARCIO P.; LUDERMIR, TERESA B.; LORENA, ANA CAROLINA. Data Balancing for Mitigating Sampling Bias in Machine Learning. 40TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, v. N/A, p. 9-pg., 2025-01-01. (22/07458-1, 21/06870-3, 20/09835-1)

BASGALUPP, MARCIO P.; BARROS, RODRIGO C.; CERRI, RICARDO; NERI, FERRANTE; MIRANDA, PERICLES B. C.; LUDERMIR, TERESA. Grammar-based Evolutionary Approaches for Software Effort Estimation. 2025 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, CEC, v. N/A, p. 4-pg., 2025-01-01. (22/07458-1, 21/06870-3, 20/09835-1)

MIRANDA, THIAGO Z.; SARDINHA, DIORGE B.; NERI, FERRANTE; BASGALUPP, MARCIO P.; CERRI, RICARDO. A Grammar-based multi-objective neuroevolutionary algorithm to generate fully convolutional networks with novel topologies. APPLIED SOFT COMPUTING, v. 149, p. 12-pg., 2023-10-30. (22/14098-1, 22/03590-2, 20/09835-1, 22/07458-1, 13/07375-0)

TORQUETTE, GUSTAVO; BASGALUPP, MARCIO P.; LUDERMIR, TERESA B.; LORENA, ANA CAROLINA. Network-based Instance Hardness Measures for Classification Problems. 40TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, v. N/A, p. 8-pg., 2025-01-01. (22/07458-1, 21/06870-3, 20/09835-1)

NASCIMENTO, ALEXANDRE M.; DE MELO, VINICIUS V.; BASGALUPP, MARCIO P.. Swapping training optimizers and tiny partial datasets to improve performance of lighter neural networks for edge devices. 38TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2023, v. N/A, p. 8-pg., 2023-01-01. (20/09835-1, 22/07458-1)

DA SILVA, CLEBER A. C. F.; ROSA, DANIEL CARNEIRO; MIRANDA, PERICLES B. C.; SI, TAPAS; CERRI, RICARDO; BASGALUPP, MARCIO P.. Automated CNN optimization using multi-objective grammatical evolution. APPLIED SOFT COMPUTING, v. 151, p. 10-pg., 2023-12-13. (20/09835-1, 22/07458-1)