TY - CHAP

T1 - Data-driven prediction of confidence for EVAR in time-varying datasets

AU - Axelrod, Allan

AU - Carlone, Luca

AU - Chowdhary, Girish

AU - Karaman, Sertac

N1 - Publisher Copyright:
© Springer Nature Switzerland AG 2018. All rights are reserved.

PY - 2018/11/13

Y1 - 2018/11/13

N2 - The key challenge for Dynamic Data Driven Applications Systems (DDDAS) operating in time-varying environments is to predict when the learned model may lose relevance. If the learned model loses relevance, then the autonomous system is at risk of making wrong decisions. The Entropic Value at Risk (EVAR) is a computationally efficient and coherent risk measure that can be utilized to quantify this model relevance. The value of EVAR is calculated with respect to an assumed confidence value; e.g., a 90% confidence may be desired for robust decision-making. Without a model on the confidence value directly, there is no guarantee that EVAR calculations will reflect the uncertainty present in dynamic real-world environments. In this paper, we present a Bayesian model and learning algorithms to predict the state-dependent confidence necessary for calculating the EVAR in time-varying datasets. We discuss applications of the data-driven EVAR to a monitoring problem, in which a DDDAS agent has to chose a set of sensing locations in order to maximize the expected EVAR of the acquired data. In this way, the DDDAS agent can learn a model on an underlying phenomenon of interest by prioritizing the areas where the model is most likely incorrect but highly valued. We empirically demonstrate the efficacy of the presented model and learning algorithms on five real-world datasets. We show that, overall, the EVAR-Real-time Adative Prediction of Time-varying and Obscure Rewards (EVAR-RAPTOR) algorithm outperforms EVAR-Predicted Information Gain (EVAR-PIG) as well as naive searches such as random and sequential search across these five real-world datasets.

AB - The key challenge for Dynamic Data Driven Applications Systems (DDDAS) operating in time-varying environments is to predict when the learned model may lose relevance. If the learned model loses relevance, then the autonomous system is at risk of making wrong decisions. The Entropic Value at Risk (EVAR) is a computationally efficient and coherent risk measure that can be utilized to quantify this model relevance. The value of EVAR is calculated with respect to an assumed confidence value; e.g., a 90% confidence may be desired for robust decision-making. Without a model on the confidence value directly, there is no guarantee that EVAR calculations will reflect the uncertainty present in dynamic real-world environments. In this paper, we present a Bayesian model and learning algorithms to predict the state-dependent confidence necessary for calculating the EVAR in time-varying datasets. We discuss applications of the data-driven EVAR to a monitoring problem, in which a DDDAS agent has to chose a set of sensing locations in order to maximize the expected EVAR of the acquired data. In this way, the DDDAS agent can learn a model on an underlying phenomenon of interest by prioritizing the areas where the model is most likely incorrect but highly valued. We empirically demonstrate the efficacy of the presented model and learning algorithms on five real-world datasets. We show that, overall, the EVAR-Real-time Adative Prediction of Time-varying and Obscure Rewards (EVAR-RAPTOR) algorithm outperforms EVAR-Predicted Information Gain (EVAR-PIG) as well as naive searches such as random and sequential search across these five real-world datasets.

UR - http://www.scopus.com/inward/record.url?scp=85091546550&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85091546550&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-95504-9_16

DO - 10.1007/978-3-319-95504-9_16

M3 - Chapter

AN - SCOPUS:85091546550

SN - 9783319955032

SP - 381

EP - 404

BT - Handbook of Dynamic Data Driven Applications Systems

PB - Springer

ER -