| Full text | |
| Author(s): |
dos Santos, Thiago Freitas
[1]
;
Santos, Paulo E.
[2, 1]
;
Ferreira, Leonardo Anjoletto
[1]
;
Bianchi, Reinaldo A. C.
[1]
;
Cabalar, Pedro
[3]
Total Authors: 5
|
| Affiliation: | [1] Ctr Univ FEI, Elect Engn Dept, Sao Bernardo Do Campo - Brazil
[2] Flinders Univ S Australia, Coll Sci & Engn, Adelaide, SA - Australia
[3] Univ A Coruna, Dept Comp Sci, La Coruna - Spain
Total Affiliations: 3
|
| Document type: | Journal article |
| Source: | APPLIED INTELLIGENCE; v. 52, n. 4 JUL 2021. |
| Web of Science Citations: | 0 |
| Abstract | |
Spatial puzzles composed of rigid objects, flexible strings and holes offer interesting challenges for reasoning about spatial entities that are common in the human daily-life's activities. This motivates the use of spatial puzzles as domains of study in this work. The goal of this paper is to investigate the automated solution of this kind of problems by extending an algorithm that combines Answer Set Programming (ASP) with Markov Decision Process (MDP) and Reinforcement Learning (RL), called oASP(MDP). This method is capable of constructing the set of domain states online, i.e., while the agent interacts with a changing environment. The aim of the extension proposed in this work is to add heuristics as a mechanism to accelerate the learning process, resulting in the main contribution of this paper: the Heuristic oASP(MDP) (HoASP(MDP)) algorithm. Experiments were performed on deterministic, non-deterministic and non-stationary versions of the puzzles. Results show that the proposed approach can considerably accelerate the learning process, outperforming other state-of-the-art methods. (AU) | |
| FAPESP's process: | 16/21047-3 - ALIS: Autonomous Learning in Intelligent System |
| Grantee: | Anna Helena Reali Costa |
| Support Opportunities: | Regular Research Grants |
| FAPESP's process: | 17/07833-9 - Heuristics and efficient planning for spatial problems |
| Grantee: | Thiago Freitas dos Santos |
| Support Opportunities: | Scholarships in Brazil - Master |
| FAPESP's process: | 16/18792-9 - Describing, representing and solving spatial puzzles |
| Grantee: | Paulo Eduardo Santos |
| Support Opportunities: | Research Grants - Research Partnership for Technological Innovation - PITE |