TY - JOUR
T1 - Separation Principle for Partially Observed Linear-Quadratic Optimal Control for Mean-Field Type Stochastic Systems
AU - Moon, Jun
AU - Basar, Tamer
N1 - The work of Jun Moon leading to this work was supported in part by the Korea Institute of Energy Technology Evaluation and Planning (KETEP) and the Ministry of Trade, Industry & Energy (MOTIE) of the Republic of Korea (RS-2024-00422103) and in part by the National Research Foundation (NRF) funded by the Korean government (MSIT) (No. RS- 2024-00397400, RS-2024-00421129). The work of Tamer Basar was supported in part by AFOSR under Grant FA9550-19-1-0353. Recommended by Associate Editor D. Antunes The authors would like to thank the Associate Editor and the five anonymous reviewers for their valuable comments and suggestions on an earlier version of the manuscript
PY - 2024
Y1 - 2024
N2 - We consider the partially observed linear-quadratic (LQ) optimal control problem for mean-field type stochastic systems driven by Brownian motion. The control does not have access to complete state information, but only to noisy state information from the (stochastic) observation model. The dynamics and observation model as well as the objective functional include the expected values of state and control variables, known as the mean-field variables. The main result is the separation between optimal control and state estimation. Specifically, we show that the classical separation principle can be extended to the LQ mean-field type problem, where the optimal solution can be obtained by a simple replacement of the state in the complete information case with the state of the optimal filtering process. The main result is proved by decomposing the original problem into stochastic and mean-field parts leading to an equivalent lifted problem, constructing the optimal filtering process for the lifted problem using the innovation approach, and employing the completion of squares method through the orthogonal projection property of the filtering process. Numerical examples are provided to illustrate the theoretical result of the article.
AB - We consider the partially observed linear-quadratic (LQ) optimal control problem for mean-field type stochastic systems driven by Brownian motion. The control does not have access to complete state information, but only to noisy state information from the (stochastic) observation model. The dynamics and observation model as well as the objective functional include the expected values of state and control variables, known as the mean-field variables. The main result is the separation between optimal control and state estimation. Specifically, we show that the classical separation principle can be extended to the LQ mean-field type problem, where the optimal solution can be obtained by a simple replacement of the state in the complete information case with the state of the optimal filtering process. The main result is proved by decomposing the original problem into stochastic and mean-field parts leading to an equivalent lifted problem, constructing the optimal filtering process for the lifted problem using the innovation approach, and employing the completion of squares method through the orthogonal projection property of the filtering process. Numerical examples are provided to illustrate the theoretical result of the article.
KW - Mean-field type systems
KW - optimal filtering
KW - separation principle
KW - stochastic control with partial observations
UR - http://www.scopus.com/inward/record.url?scp=85195409891&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85195409891&partnerID=8YFLogxK
U2 - 10.1109/TAC.2024.3409641
DO - 10.1109/TAC.2024.3409641
M3 - Article
AN - SCOPUS:85195409891
SN - 0018-9286
VL - 69
SP - 8370
EP - 8385
JO - IEEE Transactions on Automatic Control
JF - IEEE Transactions on Automatic Control
IS - 12
ER -