Busca avançada
Ano de início
Entree


Budget-aware pruning: Handling multiple domains with less parameters

Texto completo
Autor(es):
Santos, Samuel Felipe dos ; Berriel, Rodrigo ; Oliveira-Santos, Thiago ; Sebe, Nicu ; Almeida, Jurandy
Número total de Autores: 5
Tipo de documento: Artigo Científico
Fonte: PATTERN RECOGNITION; v. 167, p. 10-pg., 2025-11-01.
Resumo

Deep learning has achieved state-of-the-art performance on several computer vision tasks and domains. Nevertheless, it still has a high computational cost and demands a significant amount of parameters. Such requirements hinder the use in resource-limited environments and demand both software and hardware optimization. Another limitation is that deep models are usually specialized into a single domain or task, requiring them to learn and store new parameters for each new one. Multi-Domain Learning (MDL) attempts to solve this problem by learning a single model capable of performing well in multiple domains. Nevertheless, the models are usually larger than the baseline for a single domain. This work tackles both of these problems: our objective is to prune models capable of handling multiple domains according to a user-defined budget, making them more computationally affordable while keeping a similar classification performance. We achieve this by encouraging all domains to use a similar subset of filters from the baseline model, up to the amount defined by the user's budget. Then, filters that are not used by any domain are pruned from the network. The proposed approach innovates by better adapting to resource-limited devices while being one of the few works that handles multiple domains at test time with fewer parameters and lower computational complexity than the baseline model for a single domain. (AU)

Processo FAPESP: 24/04500-2 - Aprendizado profundo para visão computacional: melhorando a generalização com poucos dados
Beneficiário:Samuel Felipe dos Santos
Modalidade de apoio: Bolsas no Brasil - Pós-Doutorado
Processo FAPESP: 23/17577-0 - Compreensão de vídeo por meio de aprendizagem profunda com mínima supervisão humana
Beneficiário:Jurandy Gomes de Almeida Junior
Modalidade de apoio: Auxílio à Pesquisa - Regular