Stochastic Optimal Control of Systems for which Control Variation Increases Uncertainty: A Contribution to the Discrete Time Case

Autor(es)

Pedrosa, Filipe C. ; Nereu, Joao C. ; do Val, Joao B. R. ; IEEE

• Tipo de documento: Artigo Científico
• Fonte: 2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC); v. N/A, p. 6-pg., 2017-01-01.

Resumo

This paper applies the CVIU (Control Variation Increases Uncertainty) approach to a discrete time scenario. Important solution characteristics are indicated, which conceptually preserves the findings in the continuous time case presented in [1]. Mainly, the arising of three control regions in the state space and the association of the value function with a discrete Lyapunov and a modified Riccati equation. The former holds within the inaction region, which is near the origin, and the latter holds for regions far from the origin. The SISO case is developed in full and, in conjunction, a comparison with the LQG solution is presented. An evaluation on the system's performance in the context of poorly known systems closes the paper. (AU)

• Processo FAPESP: 16/13508-0 - Modelagem e controle de sistemas estocásticos discretos com dinâmica pouco conhecida
• Beneficiário: Filipe de Carvalho Pedrosa
• Modalidade de apoio: Bolsas no Brasil - Mestrado
• Processo FAPESP: 16/08645-9 - Pesquisas interdisciplinares em redes inteligentes de energia elétrica
• Beneficiário: João Bosco Ribeiro do Val
• Modalidade de apoio: Auxílio à Pesquisa - Temático