A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems

Autor(es)

Da Silva, Felipe Leno ^[1] ; Reali Costa, Anna Helena ^[1]

Afiliação do(s) autor(es)

^[1] Univ Sao Paulo, Dept Comp Engn, Sao Paulo, SP - Brazil

• Tipo de documento: Artigo Científico
• Fonte: JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH; v. 64, p. 645-703, 2019.
• Citações Web of Science: 2

Resumo

Multiagent Reinforcement Learning (RL) solves complex tasks that require coordination with other agents through autonomous exploration of the environment. However, learning a complex task from scratch is impractical due to the huge sample complexity of RL algorithms. For this reason, reusing knowledge that can come from previous experience or other agents is indispensable to scale up multiagent RL algorithms. This survey provides a unifying view of the literature on knowledge reuse in multiagent RL. We define a taxonomy of solutions for the general knowledge reuse problem, providing a comprehensive discussion of recent progress on knowledge reuse in Multiagent Systems (MAS) and of techniques for knowledge reuse across agents (that may be actuating in a shared environment or not). We aim at encouraging the community to work towards reusing all the knowledge sources available in a MAS. For that, we provide an in-depth discussion of current lines of research and open questions. (AU)

• Processo FAPESP: 18/00344-5 - Reusando soluções de tarefas prévias em aprendizado por reforço multiagente
• Beneficiário: Felipe Leno da Silva
• Modalidade de apoio: Bolsas no Exterior - Estágio de Pesquisa - Doutorado
• Processo FAPESP: 16/21047-3 - ALIS: Aprendizado Autônomo em Sistemas Inteligentes
• Beneficiário: Anna Helena Reali Costa
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 15/16310-4 - Transferência de Conhecimento no Aprendizado por Reforço em Sistemas Multiagentes
• Beneficiário: Felipe Leno da Silva
• Modalidade de apoio: Bolsas no Brasil - Doutorado