Shapley effect application for variance-based sensitivity analysis of the few-group cross-sections

Majdi I. Radaideh, Stuti Surani, Daniel O'Grady, Tomasz Kozlowski

Research output: Contribution to journalArticle

Abstract

Analyzing the variance of complex computer models is an essential practice to assess and improve that model by identifying the influential parameters that cause the output variance. Variance-based sensitivity analysis is the process of decomposing the output variance into components associated with each input parameter. In this study, we applied a new concept of variance-based sensitivity analysis inspired by the game theory proposed by Shapley. The technique is called the Shapley effect, and it investigates the contribution of each input parameter as well as its interactions with every other parameter in the system by exploring all possible permutations between them. The Shapley effect is compared to the common Sobol indices technique (first order and total effects) to investigate their performance under correlated and uncorrelated parameters. The Shapley effect demonstrated superior performance when compared to the Sobol indices for correlated input parameters. Shapley effect captured the correlation between the input parameters, expressing the variance contribution in a single index instead of two indices, and normalization of the fractional indices is preserved without over or underestimation. On the other hand, the two algorithms we selected to calculate Sobol indices under correlated inputs experienced different issues including: over/underestimating the output variance, first order effect could be larger than the total effect, possibility of negative indices, unnormalized fractional indices, and difficulty to interpret the results. However, Sobol showed satisfactory performance when the inputs are uncorrelated as the numerical values and input ranking were in good agreement with Shapley effect. The main disadvantage of Shapley effect is its large computational cost especially for high dimensional problems where the number of possible input subsets becomes very large. The results of our tests showed that the thermal fission cross-section carried most of the uncertainty at BOL, and its contribution declines after fuel burnup, which is replaced by the uncertainty contribution of the fast cross-section parameters.

Original languageEnglish (US)
Pages (from-to)264-279
Number of pages16
JournalAnnals of Nuclear Energy
Volume129
DOIs
StatePublished - Jul 2019

Fingerprint

Sensitivity analysis
Game theory
Costs
Uncertainty
Hot Temperature

Keywords

  • Correlation
  • Neutron cross-sections
  • SCALE
  • Shapley effect
  • Sobol
  • Variance-based sensitivity

ASJC Scopus subject areas

  • Nuclear Energy and Engineering

Cite this

Shapley effect application for variance-based sensitivity analysis of the few-group cross-sections. / Radaideh, Majdi I.; Surani, Stuti; O'Grady, Daniel; Kozlowski, Tomasz.

In: Annals of Nuclear Energy, Vol. 129, 07.2019, p. 264-279.

Research output: Contribution to journalArticle

@article{47bdbf6d24d14c57963b7034279917ab,
title = "Shapley effect application for variance-based sensitivity analysis of the few-group cross-sections",
abstract = "Analyzing the variance of complex computer models is an essential practice to assess and improve that model by identifying the influential parameters that cause the output variance. Variance-based sensitivity analysis is the process of decomposing the output variance into components associated with each input parameter. In this study, we applied a new concept of variance-based sensitivity analysis inspired by the game theory proposed by Shapley. The technique is called the Shapley effect, and it investigates the contribution of each input parameter as well as its interactions with every other parameter in the system by exploring all possible permutations between them. The Shapley effect is compared to the common Sobol indices technique (first order and total effects) to investigate their performance under correlated and uncorrelated parameters. The Shapley effect demonstrated superior performance when compared to the Sobol indices for correlated input parameters. Shapley effect captured the correlation between the input parameters, expressing the variance contribution in a single index instead of two indices, and normalization of the fractional indices is preserved without over or underestimation. On the other hand, the two algorithms we selected to calculate Sobol indices under correlated inputs experienced different issues including: over/underestimating the output variance, first order effect could be larger than the total effect, possibility of negative indices, unnormalized fractional indices, and difficulty to interpret the results. However, Sobol showed satisfactory performance when the inputs are uncorrelated as the numerical values and input ranking were in good agreement with Shapley effect. The main disadvantage of Shapley effect is its large computational cost especially for high dimensional problems where the number of possible input subsets becomes very large. The results of our tests showed that the thermal fission cross-section carried most of the uncertainty at BOL, and its contribution declines after fuel burnup, which is replaced by the uncertainty contribution of the fast cross-section parameters.",
keywords = "Correlation, Neutron cross-sections, SCALE, Shapley effect, Sobol, Variance-based sensitivity",
author = "Radaideh, {Majdi I.} and Stuti Surani and Daniel O'Grady and Tomasz Kozlowski",
year = "2019",
month = "7",
doi = "10.1016/j.anucene.2019.02.002",
language = "English (US)",
volume = "129",
pages = "264--279",
journal = "Annals of Nuclear Energy",
issn = "0306-4549",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Shapley effect application for variance-based sensitivity analysis of the few-group cross-sections

AU - Radaideh, Majdi I.

AU - Surani, Stuti

AU - O'Grady, Daniel

AU - Kozlowski, Tomasz

PY - 2019/7

Y1 - 2019/7

N2 - Analyzing the variance of complex computer models is an essential practice to assess and improve that model by identifying the influential parameters that cause the output variance. Variance-based sensitivity analysis is the process of decomposing the output variance into components associated with each input parameter. In this study, we applied a new concept of variance-based sensitivity analysis inspired by the game theory proposed by Shapley. The technique is called the Shapley effect, and it investigates the contribution of each input parameter as well as its interactions with every other parameter in the system by exploring all possible permutations between them. The Shapley effect is compared to the common Sobol indices technique (first order and total effects) to investigate their performance under correlated and uncorrelated parameters. The Shapley effect demonstrated superior performance when compared to the Sobol indices for correlated input parameters. Shapley effect captured the correlation between the input parameters, expressing the variance contribution in a single index instead of two indices, and normalization of the fractional indices is preserved without over or underestimation. On the other hand, the two algorithms we selected to calculate Sobol indices under correlated inputs experienced different issues including: over/underestimating the output variance, first order effect could be larger than the total effect, possibility of negative indices, unnormalized fractional indices, and difficulty to interpret the results. However, Sobol showed satisfactory performance when the inputs are uncorrelated as the numerical values and input ranking were in good agreement with Shapley effect. The main disadvantage of Shapley effect is its large computational cost especially for high dimensional problems where the number of possible input subsets becomes very large. The results of our tests showed that the thermal fission cross-section carried most of the uncertainty at BOL, and its contribution declines after fuel burnup, which is replaced by the uncertainty contribution of the fast cross-section parameters.

AB - Analyzing the variance of complex computer models is an essential practice to assess and improve that model by identifying the influential parameters that cause the output variance. Variance-based sensitivity analysis is the process of decomposing the output variance into components associated with each input parameter. In this study, we applied a new concept of variance-based sensitivity analysis inspired by the game theory proposed by Shapley. The technique is called the Shapley effect, and it investigates the contribution of each input parameter as well as its interactions with every other parameter in the system by exploring all possible permutations between them. The Shapley effect is compared to the common Sobol indices technique (first order and total effects) to investigate their performance under correlated and uncorrelated parameters. The Shapley effect demonstrated superior performance when compared to the Sobol indices for correlated input parameters. Shapley effect captured the correlation between the input parameters, expressing the variance contribution in a single index instead of two indices, and normalization of the fractional indices is preserved without over or underestimation. On the other hand, the two algorithms we selected to calculate Sobol indices under correlated inputs experienced different issues including: over/underestimating the output variance, first order effect could be larger than the total effect, possibility of negative indices, unnormalized fractional indices, and difficulty to interpret the results. However, Sobol showed satisfactory performance when the inputs are uncorrelated as the numerical values and input ranking were in good agreement with Shapley effect. The main disadvantage of Shapley effect is its large computational cost especially for high dimensional problems where the number of possible input subsets becomes very large. The results of our tests showed that the thermal fission cross-section carried most of the uncertainty at BOL, and its contribution declines after fuel burnup, which is replaced by the uncertainty contribution of the fast cross-section parameters.

KW - Correlation

KW - Neutron cross-sections

KW - SCALE

KW - Shapley effect

KW - Sobol

KW - Variance-based sensitivity

UR - http://www.scopus.com/inward/record.url?scp=85061316956&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061316956&partnerID=8YFLogxK

U2 - 10.1016/j.anucene.2019.02.002

DO - 10.1016/j.anucene.2019.02.002

M3 - Article

AN - SCOPUS:85061316956

VL - 129

SP - 264

EP - 279

JO - Annals of Nuclear Energy

JF - Annals of Nuclear Energy

SN - 0306-4549

ER -