TY - JOUR
T1 - An optimal transport formulation of the Ensemble Kalman filter
AU - Taghvaei, Amirhossein
AU - Mehta, Prashant G.
N1 - Funding Information:
Manuscript received September 27, 2019; revised October 3, 2019 and May 27, 2020; accepted July 30, 2020. Date of publication August 10, 2020; date of current version June 29, 2021. This work was supported by the NSF CMMI under Grant 1462773 and Grant 1761622. This work was carried out while Amirhossein Taghvaei was a graduate student with UIUC. This paper was presented in part at the American Control Conference, Urbana, IL, Boston, MA, July 2016, and in part at Annual American Control Conference, Milwaukee, WI, June 2018. Recommended by Associate Editor D. Efimov. (Corresponding author: Prashant G. Mehta.) Amirhossein Taghvaei was with the University of Illinois at Urbana-Champaign (UIUC), Champaign, IL 61820 USA. He is with the Department of Mechanical, and Aerospace Engineering,University of California Irvine, Irvine, CA 92697 USA (e-mail: [email protected]).
Publisher Copyright:
© 1963-2012 IEEE.
PY - 2021/7
Y1 - 2021/7
N2 - Controlled interacting particle systems such as the ensemble Kalman filter (EnKF) and the feedback particle filter (FPF) are numerical algorithms to approximate the solution of the nonlinear filtering problem in continuous time. The distinguishing feature of these algorithms is that the Bayesian update step is implemented using a feedback control law. It has been noted in the literature that the control law is not unique. This is the main problem addressed in this article. To obtain a unique control law, the filtering problem is formulated here as an optimal transportation problem. An explicit formula for the (mean-field type) optimal control law is derived in the linear Gaussian setting. Comparisons are made with the control laws for different types of EnKF algorithms described in the literature. Via empirical approximation of the mean-field control law, a finite-N controlled interacting particle algorithm is obtained. For this algorithm, the equations for empirical mean and covariance are derived and shown to be identical to the Kalman filter. This allows strong conclusions on convergence and error properties based on the classical filter stability theory for the Kalman filter. It is shown that, under certain technical conditions, the mean squared error converges to zero even with a finite number of particles. A detailed propagation of chaos analysis is carried out for the finite-N algorithm. The analysis is used to prove weak convergence of the empirical distribution as N → ∞. For a certain simplified filtering problem, analytical comparison of the mse with the importance sampling-based algorithms is described. The analysis helps explain the favorable scaling properties of the control-based algorithms reported in several numerical studies in recent literature.
AB - Controlled interacting particle systems such as the ensemble Kalman filter (EnKF) and the feedback particle filter (FPF) are numerical algorithms to approximate the solution of the nonlinear filtering problem in continuous time. The distinguishing feature of these algorithms is that the Bayesian update step is implemented using a feedback control law. It has been noted in the literature that the control law is not unique. This is the main problem addressed in this article. To obtain a unique control law, the filtering problem is formulated here as an optimal transportation problem. An explicit formula for the (mean-field type) optimal control law is derived in the linear Gaussian setting. Comparisons are made with the control laws for different types of EnKF algorithms described in the literature. Via empirical approximation of the mean-field control law, a finite-N controlled interacting particle algorithm is obtained. For this algorithm, the equations for empirical mean and covariance are derived and shown to be identical to the Kalman filter. This allows strong conclusions on convergence and error properties based on the classical filter stability theory for the Kalman filter. It is shown that, under certain technical conditions, the mean squared error converges to zero even with a finite number of particles. A detailed propagation of chaos analysis is carried out for the finite-N algorithm. The analysis is used to prove weak convergence of the empirical distribution as N → ∞. For a certain simplified filtering problem, analytical comparison of the mse with the importance sampling-based algorithms is described. The analysis helps explain the favorable scaling properties of the control-based algorithms reported in several numerical studies in recent literature.
KW - Approximation algorithms
KW - Control systems
KW - Convergence
KW - Error analysis
KW - Kalman filters
KW - Monte Carlo methods
KW - Symmetric matrices
KW - Kalman filter
KW - Stochastic processes
KW - Filtering algorithms
UR - http://www.scopus.com/inward/record.url?scp=85089451235&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85089451235&partnerID=8YFLogxK
U2 - 10.1109/TAC.2020.3015410
DO - 10.1109/TAC.2020.3015410
M3 - Article
AN - SCOPUS:85089451235
SN - 0018-9286
VL - 66
SP - 3052
EP - 3067
JO - IEEE Transactions on Automatic Control
JF - IEEE Transactions on Automatic Control
IS - 7
M1 - 9163273
ER -