Advanced search
Start date
Betweenand

Is my benchmark of datasets challenging enough?

Grant number: 22/10683-7
Support Opportunities:Scholarships in Brazil - Post-Doctoral
Effective date (Start): September 01, 2022
Status:Discontinued
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
Principal Investigator:Ana Carolina Lorena
Grantee:João Luiz Junho Pereira
Host Institution: Divisão de Ciência da Computação (IEC). Instituto Tecnológico de Aeronáutica (ITA). Ministério da Defesa (Brasil). São José dos Campos , SP, Brazil
Associated research grant:21/06870-3 - Beyond algorithm selection: meta-learning for data and algorithm analysis and understanding, AP.JP2
Associated scholarship(s):23/10419-0 - Multi-objective optimal selection of benchmarking datasets for unbiased and efficient machine learning algorithm evaluation, BE.EP.PD

Abstract

Whenever a new supervised Machine Learning (ML) algorithm or solu- tion is developed, it is imperative to evaluate the predictive performance it attains for diverse datasets. This is done in order to stress out the strengths and weak- nesses of the algorithms and evidence for which situations they are most useful. A common practice is to gather some datasets from public benchmark repositories for such an evaluation. But little or no specific criteria are used in the selection of these datasets, which is often ad-hoc. In this project we will investigate the importance of properly building a diverse and challenging benchmark of datasets in order to properly evaluate ML models and really understand their capabilities. (AU)

News published in Agência FAPESP Newsletter about the scholarship:
More itemsLess items
Articles published in other media outlets ( ):
More itemsLess items
VEICULO: TITULO (DATA)
VEICULO: TITULO (DATA)

Publicações científicas (6)
(Referências obtidas automaticamente do Web of Science e do SciELO, por meio da informação sobre o financiamento pela FAPESP e o número do processo correspondente, incluída na publicação pelos autores)
PEREIRA, JOAO LUIZ JUNHO; MA, BENEDICT JUN; FRANCISCO, MATHEUS BRENDON; RIBEIRO JR, RONNY FRANCIS; GOMES, GUILHERME FERREIRA. A comparison between chaos theory and Levy flights in sunflower optimization for feature selection. EXPERT SYSTEMS, v. 40, n. 8, p. 21-pg., . (22/10683-7)
PEREIRA, JOAO LUIZ JUNHO; GUEDES, FELIPE CIOLINI; FRANCISCO, MATHEUS BRENDON; CHIARELLO, ANDRE GARCIA; GOMES, GUILHERME FERREIRA. Multi-objective design optimization of a high performance disk brake using lichtenberg algorithm. MECHANICS BASED DESIGN OF STRUCTURES AND MACHINES, v. N/A, p. 14-pg., . (22/10683-7)
PEREIRA, JOAO LUIZ JUNHO; FRANCISCO, MATHEUS BRENDON; DE ALMEIDA, FABRICIO ALVES; MA, BENEDICT JUN; CUNHA, SEBASTIAO SIMOES; GOMES, GUILHERME FERREIRA. Enhanced Lichtenberg algorithm: a discussion on improving meta-heuristics. SOFT COMPUTING, v. N/A, p. 29-pg., . (22/10683-7)
DE OLIVEIRA, LUCAS ANTONIO; GOMES, GUILHERME FERREIRA; PEREIRA, JOAO LUIZ JUNHO; FRANCISCO, MATHEUS BRENDON; DEMARBAIX, ANTHONIN; CUNHA JR, SEBASTIAO SIMOES. New Trends of Damage Detection and Identification Based on Vibrothermography in Composite Materials. JOURNAL OF NONDESTRUCTIVE EVALUATION, v. 42, n. 3, p. 16-pg., . (22/10683-7)
SOTOMONTE, CESAR; PEREIRA, JOAO; FRANCISCO, MATHEUS; DE SOUZA, TULIO; PINTO, GABRIEL; JULIO, ALISSON; BUNYA, BRUNO; CORONADO, CHRISTIAN; PALACIO, JOSE; GOMES, GUILHERME. ENERGY MINIMIZATION OF HYDROGEN PRODUCTION VIA BUTANOL STEAM REFORMING. ENVIRONMENTAL ENGINEERING AND MANAGEMENT JOURNAL, v. 22, n. 3, p. 201-pg., . (22/10683-7)
GOMES, GUILHERME FERREIRA; RIBEIRO JUNIOR, RONNY FRANCIS RIBEIRO; PEREIRA, JOAO LUIZ JUNHO; FRANCISCO, MATHEUS BRENDON. An efficient deep learning model to predict the structural response of CFRP isogrid tubes. COMPOSITE STRUCTURES, v. 316, p. 17-pg., . (22/10683-7)

Please report errors in scientific publications list using this form.