Stochastic Optimal Control of Systems for which Control Variation Increases Uncertainty: A Contribution to the Discrete Time Case

Author(s)

Pedrosa, Filipe C. ; Nereu, Joao C. ; do Val, Joao B. R. ; IEEE

• Document type: Journal article
• Source: 2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC); v. N/A, p. 6-pg., 2017-01-01.

Abstract

This paper applies the CVIU (Control Variation Increases Uncertainty) approach to a discrete time scenario. Important solution characteristics are indicated, which conceptually preserves the findings in the continuous time case presented in [1]. Mainly, the arising of three control regions in the state space and the association of the value function with a discrete Lyapunov and a modified Riccati equation. The former holds within the inaction region, which is near the origin, and the latter holds for regions far from the origin. The SISO case is developed in full and, in conjunction, a comparison with the LQG solution is presented. An evaluation on the system's performance in the context of poorly known systems closes the paper. (AU)

• FAPESP's process: 16/13508-0 - Modeling and control of discrete stochastic systems with poorly known dynamics
• Grantee: Filipe de Carvalho Pedrosa
• Support Opportunities: Scholarships in Brazil - Master
• FAPESP's process: 16/08645-9 - Interdisciplinary research activities in electric smart grids
• Grantee: João Bosco Ribeiro do Val
• Support Opportunities: Research Projects - Thematic Grants