Object-Oriented Reinforcement Learning in Cooperative Multiagent Domains

Author(s)

da Silva, Felipe Leno ; Glatt, Ruben ; Reali Costa, Anna Helena ; IEEE

• Document type: Journal article
• Source: PROCEEDINGS OF 2016 5TH BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS 2016); v. N/A, p. 6-pg., 2016-01-01.

Abstract

Although Reinforcement Learning methods have successfully been applied to increasingly large problems, scalability remains a central issue. While Object-Oriented Markov Decision Processes (OO-MDP) are used to exploit regularities in a domain, Multiagent System (MAS) methods are used to divide workload amongst multiple agents. In this work we propose a novel combination of OO-MDP and MAS, called Multiagent Object-Oriented Markov Decision Process (MOO-MDP), so as to accrue the benefits of both strategies and be able to better address scalability issues. We present an algorithm to solve deterministic cooperative MOO-MDPs, and prove that it learns optimal policies while reducing the learning space by exploiting state abstractions. We experimentally compare our results with earlier approaches and show advantages with regard to discounted cumulative reward, number of steps to fulfill the task, and Q-table size. (AU)

• FAPESP's process: 15/16310-4 - Transfer Learning in Reinforcement Learning Multi-Agent Systems
• Grantee: Felipe Leno da Silva
• Support Opportunities: Scholarships in Brazil - Doctorate