TY - GEN
T1 - Rare event estimation of high dimensional problems with confidence intervals
AU - Xu, Yanwen
AU - Wang, Pingfeng
N1 - Funding Information:
This research is partially supported by the National Science Foundation through the Faculty Early Career Development (CAREER) award (CMMI-1813111), and the project support from the National Science Foundation (NSF) to the Engineering Research Center for Power Optimization of Electro-Thermal Systems (POETS) with cooperative agreement EEC-1449548.
Publisher Copyright:
© Proceedings of the 2020 IISE Annual. All Rights Reserved.
PY - 2020
Y1 - 2020
N2 - Rare events have low probabilities of occurrence, and computation of such small probabilities is challenging, especially for high dimensional problems. Meanwhile, the robust estimation of the probability with narrow bounds is a key component for rare event estimation. Thus, confidence intervals of the estimator can be established based on the central limit theorem. Yet, the commonly used Monte Carlo simulation method is computationally inefficient as the sample size would be huge to derive a reasonably narrow confidence interval. Therefore, this paper introduces an efficient probability estimation technique that estimate the probability of rare events for high dimensional systems with smaller sample size and provide narrow estimation confidence intervals simultaneously. The asymptotic normality for the estimator has been proved theoretically without strong assumptions, and based on that, an asymptotic confidence interval has been established for the proposed probability estimator. The efficiency of the developed technique for probability estimation with confidence intervals is assessed with several engineering reliability analysis and design examples. Our numerical experiments demonstrate that a narrow confidence interval can be built efficiently with the probability estimation, and the real probability results always located within the proposed estimation bounds, which improve both efficiency and accuracy of the rare events estimation.
AB - Rare events have low probabilities of occurrence, and computation of such small probabilities is challenging, especially for high dimensional problems. Meanwhile, the robust estimation of the probability with narrow bounds is a key component for rare event estimation. Thus, confidence intervals of the estimator can be established based on the central limit theorem. Yet, the commonly used Monte Carlo simulation method is computationally inefficient as the sample size would be huge to derive a reasonably narrow confidence interval. Therefore, this paper introduces an efficient probability estimation technique that estimate the probability of rare events for high dimensional systems with smaller sample size and provide narrow estimation confidence intervals simultaneously. The asymptotic normality for the estimator has been proved theoretically without strong assumptions, and based on that, an asymptotic confidence interval has been established for the proposed probability estimator. The efficiency of the developed technique for probability estimation with confidence intervals is assessed with several engineering reliability analysis and design examples. Our numerical experiments demonstrate that a narrow confidence interval can be built efficiently with the probability estimation, and the real probability results always located within the proposed estimation bounds, which improve both efficiency and accuracy of the rare events estimation.
KW - Rare events
KW - Sequential importance sampling
KW - The confidence interval
UR - http://www.scopus.com/inward/record.url?scp=85105610567&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85105610567&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85105610567
T3 - Proceedings of the 2020 IISE Annual Conference
SP - 1515
EP - 1520
BT - Proceedings of the 2020 IISE Annual Conference
A2 - Cromarty, L.
A2 - Shirwaiker, R.
A2 - Wang, P.
PB - Institute of Industrial and Systems Engineers, IISE
T2 - 2020 Institute of Industrial and Systems Engineers Annual Conference and Expo, IISE 2020
Y2 - 1 November 2020 through 3 November 2020
ER -