Integrated framework for model assessment and advanced uncertainty quantification of nuclear computer codes under Bayesian statistics

Majdi I. Radaideh, Katarzyna Borowiec, Tomasz Kozlowski

Research output: Contribution to journalArticle

Abstract

A framework for model evaluation and uncertainty quantification (UQ)is presented with applications oriented to nuclear engineering simulation codes. Our framework is inspired by the previous research on Bayesian statistics and model averaging. The methodology is demonstrated by performing UQ of three thermal-hydraulic computer codes used for two-phase flow simulation inside nuclear reactors, and conclusions regarding their performance are drawn. The complexity of the framework implementation depends upon the information to be drawn about the models as well as the nature of the models and the data. Uncertainties inherent in the input parameters and experimental data, along with predictive and model-form uncertainty can be quantified in this methodology. A composite (average)model based on the competent models can be created for improved response prediction. Two benchmarks featuring steady-state void fraction data in full-scale light water reactor (LWR)channels are used to demonstrate the methodology. The results show that the three models/codes demonstrate variable competitiveness in reproducing the data (i.e. goodness of fit with the data). There is no consistent trend at which each code excels. The predictive uncertainty (representing individual model deficiency or discrepancy)dominates the model-form uncertainty for many cases in this study due to two reasons: (1)presence of a single competent model for a specific response and (2)poor agreement with experimental data for certain responses at which nuclear codes struggle, such as low pressure and subcooled boiling conditions. In general, improvements in composite predictions (based on posterior model weights)are observed for BFBT data, while slight improvement is found for PSBT. For PSBT, the predictive uncertainty of RELAP5 and TRACE dominates the response uncertainty causing weak improvement. Additional efforts are needed to improve the closure models of these codes in future to reduce the model discrepancy contribution. This framework can be utilized for this purpose at which various closure models for the same code can be assessed in terms of their effect on the final response uncertainty. The proposed framework is flexible and extendable to other types of physics, models, and data. Developing the underlying methodology of calculating the model weights is the main focus in the subsequent studies.

Original languageEnglish (US)
Pages (from-to)357-377
Number of pages21
JournalReliability Engineering and System Safety
Volume189
DOIs
StatePublished - Sep 2019

Fingerprint

Statistics
Uncertainty
Nuclear engineering
Light water reactors
Void fraction
Flow simulation
Composite materials
Nuclear reactors
Two phase flow
Boiling liquids
Physics
Hydraulics

Keywords

  • Bayesian model averaging
  • Model validation
  • Model-form uncertainty
  • Nuclear thermal-hydraulics
  • Uncertainty quantification

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Industrial and Manufacturing Engineering

Cite this

Integrated framework for model assessment and advanced uncertainty quantification of nuclear computer codes under Bayesian statistics. / Radaideh, Majdi I.; Borowiec, Katarzyna; Kozlowski, Tomasz.

In: Reliability Engineering and System Safety, Vol. 189, 09.2019, p. 357-377.

Research output: Contribution to journalArticle

@article{f8392a4e54ae48568fcd00049deb8104,
title = "Integrated framework for model assessment and advanced uncertainty quantification of nuclear computer codes under Bayesian statistics",
abstract = "A framework for model evaluation and uncertainty quantification (UQ)is presented with applications oriented to nuclear engineering simulation codes. Our framework is inspired by the previous research on Bayesian statistics and model averaging. The methodology is demonstrated by performing UQ of three thermal-hydraulic computer codes used for two-phase flow simulation inside nuclear reactors, and conclusions regarding their performance are drawn. The complexity of the framework implementation depends upon the information to be drawn about the models as well as the nature of the models and the data. Uncertainties inherent in the input parameters and experimental data, along with predictive and model-form uncertainty can be quantified in this methodology. A composite (average)model based on the competent models can be created for improved response prediction. Two benchmarks featuring steady-state void fraction data in full-scale light water reactor (LWR)channels are used to demonstrate the methodology. The results show that the three models/codes demonstrate variable competitiveness in reproducing the data (i.e. goodness of fit with the data). There is no consistent trend at which each code excels. The predictive uncertainty (representing individual model deficiency or discrepancy)dominates the model-form uncertainty for many cases in this study due to two reasons: (1)presence of a single competent model for a specific response and (2)poor agreement with experimental data for certain responses at which nuclear codes struggle, such as low pressure and subcooled boiling conditions. In general, improvements in composite predictions (based on posterior model weights)are observed for BFBT data, while slight improvement is found for PSBT. For PSBT, the predictive uncertainty of RELAP5 and TRACE dominates the response uncertainty causing weak improvement. Additional efforts are needed to improve the closure models of these codes in future to reduce the model discrepancy contribution. This framework can be utilized for this purpose at which various closure models for the same code can be assessed in terms of their effect on the final response uncertainty. The proposed framework is flexible and extendable to other types of physics, models, and data. Developing the underlying methodology of calculating the model weights is the main focus in the subsequent studies.",
keywords = "Bayesian model averaging, Model validation, Model-form uncertainty, Nuclear thermal-hydraulics, Uncertainty quantification",
author = "Radaideh, {Majdi I.} and Katarzyna Borowiec and Tomasz Kozlowski",
year = "2019",
month = "9",
doi = "10.1016/j.ress.2019.04.020",
language = "English (US)",
volume = "189",
pages = "357--377",
journal = "Reliability Engineering and System Safety",
issn = "0951-8320",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Integrated framework for model assessment and advanced uncertainty quantification of nuclear computer codes under Bayesian statistics

AU - Radaideh, Majdi I.

AU - Borowiec, Katarzyna

AU - Kozlowski, Tomasz

PY - 2019/9

Y1 - 2019/9

N2 - A framework for model evaluation and uncertainty quantification (UQ)is presented with applications oriented to nuclear engineering simulation codes. Our framework is inspired by the previous research on Bayesian statistics and model averaging. The methodology is demonstrated by performing UQ of three thermal-hydraulic computer codes used for two-phase flow simulation inside nuclear reactors, and conclusions regarding their performance are drawn. The complexity of the framework implementation depends upon the information to be drawn about the models as well as the nature of the models and the data. Uncertainties inherent in the input parameters and experimental data, along with predictive and model-form uncertainty can be quantified in this methodology. A composite (average)model based on the competent models can be created for improved response prediction. Two benchmarks featuring steady-state void fraction data in full-scale light water reactor (LWR)channels are used to demonstrate the methodology. The results show that the three models/codes demonstrate variable competitiveness in reproducing the data (i.e. goodness of fit with the data). There is no consistent trend at which each code excels. The predictive uncertainty (representing individual model deficiency or discrepancy)dominates the model-form uncertainty for many cases in this study due to two reasons: (1)presence of a single competent model for a specific response and (2)poor agreement with experimental data for certain responses at which nuclear codes struggle, such as low pressure and subcooled boiling conditions. In general, improvements in composite predictions (based on posterior model weights)are observed for BFBT data, while slight improvement is found for PSBT. For PSBT, the predictive uncertainty of RELAP5 and TRACE dominates the response uncertainty causing weak improvement. Additional efforts are needed to improve the closure models of these codes in future to reduce the model discrepancy contribution. This framework can be utilized for this purpose at which various closure models for the same code can be assessed in terms of their effect on the final response uncertainty. The proposed framework is flexible and extendable to other types of physics, models, and data. Developing the underlying methodology of calculating the model weights is the main focus in the subsequent studies.

AB - A framework for model evaluation and uncertainty quantification (UQ)is presented with applications oriented to nuclear engineering simulation codes. Our framework is inspired by the previous research on Bayesian statistics and model averaging. The methodology is demonstrated by performing UQ of three thermal-hydraulic computer codes used for two-phase flow simulation inside nuclear reactors, and conclusions regarding their performance are drawn. The complexity of the framework implementation depends upon the information to be drawn about the models as well as the nature of the models and the data. Uncertainties inherent in the input parameters and experimental data, along with predictive and model-form uncertainty can be quantified in this methodology. A composite (average)model based on the competent models can be created for improved response prediction. Two benchmarks featuring steady-state void fraction data in full-scale light water reactor (LWR)channels are used to demonstrate the methodology. The results show that the three models/codes demonstrate variable competitiveness in reproducing the data (i.e. goodness of fit with the data). There is no consistent trend at which each code excels. The predictive uncertainty (representing individual model deficiency or discrepancy)dominates the model-form uncertainty for many cases in this study due to two reasons: (1)presence of a single competent model for a specific response and (2)poor agreement with experimental data for certain responses at which nuclear codes struggle, such as low pressure and subcooled boiling conditions. In general, improvements in composite predictions (based on posterior model weights)are observed for BFBT data, while slight improvement is found for PSBT. For PSBT, the predictive uncertainty of RELAP5 and TRACE dominates the response uncertainty causing weak improvement. Additional efforts are needed to improve the closure models of these codes in future to reduce the model discrepancy contribution. This framework can be utilized for this purpose at which various closure models for the same code can be assessed in terms of their effect on the final response uncertainty. The proposed framework is flexible and extendable to other types of physics, models, and data. Developing the underlying methodology of calculating the model weights is the main focus in the subsequent studies.

KW - Bayesian model averaging

KW - Model validation

KW - Model-form uncertainty

KW - Nuclear thermal-hydraulics

KW - Uncertainty quantification

UR - http://www.scopus.com/inward/record.url?scp=85065424872&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065424872&partnerID=8YFLogxK

U2 - 10.1016/j.ress.2019.04.020

DO - 10.1016/j.ress.2019.04.020

M3 - Article

AN - SCOPUS:85065424872

VL - 189

SP - 357

EP - 377

JO - Reliability Engineering and System Safety

JF - Reliability Engineering and System Safety

SN - 0951-8320

ER -