An Instance Space Analysis of Regression Problems

Autor(es)

Munoz, Mario Andres ^[1] ; Yan, Tao ^[1] ; Leal, Matheus R. ^[2] ; Smith-Miles, Kate ^[1] ; Lorena, Ana Carolina ^[3] ; Pappa, Gisele L. ^[2] ; Rodrigues, Romulo Madureira ^[3]

Afiliação do(s) autor(es)

^[1] Univ Melbourne, Sch Math & Stat, Parkville, Vic 3010 - Australia

^[2] Univ Fed Minas Gerais, Comp Sci Dept, Av Antonio Carlos 6627, BR-31270901 Belo Horizonte, MG - Brazil

^[3] Inst Tecnol Aeronaut, Div Ciencia Comp, Praca Marechal, Eduardo Gomes 50, BR-12228900 Sao Jose Dos Campos, SP - Brazil

• Tipo de documento: Artigo Científico
• Fonte: ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA; v. 15, n. 2 APR 2021.
• Citações Web of Science: 0

Resumo

The quest for greater insights into algorithm strengths and weaknesses, as revealed when studying algorithm performance on large collections of test problems, is supported by interactive visual analytics tools. A recent advance is Instance Space Analysis, which presents a visualization of the space occupied by the test datasets, and the performance of algorithms across the instance space. The strengths and weaknesses of algorithms can be visually assessed, and the adequacy of the test datasets can be scrutinized through visual analytics. This article presents the first Instance Space Analysis of regression problems in Machine Learning, considering the performance of 14 popular algorithms on 4,855 test datasets from a variety of sources. The two-dimensional instance space is defined by measurable characteristics of regression problems, selected from over 26 candidate features. It enables the similarities and differences between test instances to be visualized, along with the predictive performance of regression algorithms across the entire instance space. The purpose of creating this framework for visual analysis of an instance space is twofold: one may assess the capability and suitability of various regression techniques; meanwhile the bias, diversity, and level of difficulty of the regression problems popularly used by the community can be visually revealed. This article shows the applicability of the created regression instance space to provide insights into the strengths and weaknesses of regression algorithms, and the opportunities to diversify the benchmark test instances to support greater insights. (AU)

• Processo FAPESP: 12/22608-8 - Uso de medidas de complexidade de dados no suporte ao aprendizado de máquina supervisionado
• Beneficiário: Ana Carolina Lorena
• Modalidade de apoio: Auxílio à Pesquisa - Jovens Pesquisadores
• Processo FAPESP: 19/20328-7 - Analisando a diversidade de repositórios públicos de dados em aprendizado de máquina para meta-aprendizado
• Beneficiário: Ana Carolina Lorena
• Modalidade de apoio: Bolsas no Exterior - Pesquisa