Busca avançada
Ano de início
Entree


Representing and Solving Factored Markov Decision Processes with Imprecise Probabilities

Autor(es):
Delgado, Karina Valdivia ; de Barros, Leliane Nunes ; Cozman, Fabio Gagliardi ; Shirota, Ricardo ; Augustin, T ; Coolen, FPA ; Moral, S ; Troffaes, MCM
Número total de Autores: 8
Tipo de documento: Artigo Científico
Fonte: ISIPTA '09: PROCEEDINGS OF THE SIXTH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITY: THEORIES AND APPLICATIONS; v. N/A, p. 3-pg., 2009-01-01.
Resumo

This paper investigates Factored Markov Decision Processes with Imprecise Probabilities; that is, Markov Decision Processes where transition probabilities are imprecisely specified, and where their specification does not deal directly with states, but rather with factored representations of states. We first define a Factored MDPIP, based on a multilinear formulation for MDPIPs; then we propose a novel algorithm for generation of Gamma-maximin policies for Factored MDPIPs. We also developed a representation language for Factored MDPIPs (based on the standard PPDDL language); finally, we describe experiments with a problem of practical significance, the well-known System Administrator Planning problem. (AU)

Processo FAPESP: 08/03995-5 - LOGPROB: lógica probabilística - fundamentos e aplicações computacionais
Beneficiário:Marcelo Finger
Modalidade de apoio: Auxílio à Pesquisa - Temático