Abstract
The multi-metric assessment of model performance in a dominantly single-domain modeling approach (i.e., surface) may not be sufficient to gauge the validity of the model to represent the hydrologic system. Consequently, rating metrics can mathematically validate model results as satisfactory even when some of the simulated hydrologic processes are incorrectly represented during the calibration process. In this paper, we argue that to properly represent the hydrologic system, calibration tasks focused on modifying model parameters should account for equifinality, model inadequacy, and constraint inadequacy. To demonstrate our argument, we conducted a traditional calibration using the Soil and Water Assessment Tool (SWAT) coupled to the Modular Finite-difference Flow Model (MODFLOW) to simulate the hydrologic processes in the Fort Cobb Reservoir Experimental Watershed (FCREW) in central western Oklahoma. The results indicated that model calibration based on metrics from a single domain, in this case using SWAT, did not necessarily guarantee an appropriate representation of water circulation. Moreover, unsupervised calibration techniques based on the objective-function optimization (e.g., inverse calibration using SWAT-CUP SUFI2 algorithm) may not be sufficient if model constraints in multiple domains are not properly set, resulting in distorted parameters. This practice can result in the misrepresentation of water circulation and can have adverse impacts on environmental model results used to support policies and decisions.
| Original language | English (US) |
|---|---|
| Article number | 124032 |
| Journal | Journal of Hydrology |
| Volume | 578 |
| DOIs | |
| State | Published - Nov 2019 |
Fingerprint
Keywords
- Calibration
- Equifinality
- MODFLOW
- Multi-domain
- SWAT
- SWATmf
ASJC Scopus subject areas
- Water Science and Technology
Cite this
Beyond model metrics : The perils of calibrating hydrologic models. / Acero Triana, Juan S.; Chu, Maria L.; Guzman Jaimes, Jorge Alberto; Moriasi, Daniel N.; Steiner, Jean L.
In: Journal of Hydrology, Vol. 578, 124032, 11.2019.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Beyond model metrics
T2 - The perils of calibrating hydrologic models
AU - Acero Triana, Juan S.
AU - Chu, Maria L.
AU - Guzman Jaimes, Jorge Alberto
AU - Moriasi, Daniel N.
AU - Steiner, Jean L.
PY - 2019/11
Y1 - 2019/11
N2 - The multi-metric assessment of model performance in a dominantly single-domain modeling approach (i.e., surface) may not be sufficient to gauge the validity of the model to represent the hydrologic system. Consequently, rating metrics can mathematically validate model results as satisfactory even when some of the simulated hydrologic processes are incorrectly represented during the calibration process. In this paper, we argue that to properly represent the hydrologic system, calibration tasks focused on modifying model parameters should account for equifinality, model inadequacy, and constraint inadequacy. To demonstrate our argument, we conducted a traditional calibration using the Soil and Water Assessment Tool (SWAT) coupled to the Modular Finite-difference Flow Model (MODFLOW) to simulate the hydrologic processes in the Fort Cobb Reservoir Experimental Watershed (FCREW) in central western Oklahoma. The results indicated that model calibration based on metrics from a single domain, in this case using SWAT, did not necessarily guarantee an appropriate representation of water circulation. Moreover, unsupervised calibration techniques based on the objective-function optimization (e.g., inverse calibration using SWAT-CUP SUFI2 algorithm) may not be sufficient if model constraints in multiple domains are not properly set, resulting in distorted parameters. This practice can result in the misrepresentation of water circulation and can have adverse impacts on environmental model results used to support policies and decisions.
AB - The multi-metric assessment of model performance in a dominantly single-domain modeling approach (i.e., surface) may not be sufficient to gauge the validity of the model to represent the hydrologic system. Consequently, rating metrics can mathematically validate model results as satisfactory even when some of the simulated hydrologic processes are incorrectly represented during the calibration process. In this paper, we argue that to properly represent the hydrologic system, calibration tasks focused on modifying model parameters should account for equifinality, model inadequacy, and constraint inadequacy. To demonstrate our argument, we conducted a traditional calibration using the Soil and Water Assessment Tool (SWAT) coupled to the Modular Finite-difference Flow Model (MODFLOW) to simulate the hydrologic processes in the Fort Cobb Reservoir Experimental Watershed (FCREW) in central western Oklahoma. The results indicated that model calibration based on metrics from a single domain, in this case using SWAT, did not necessarily guarantee an appropriate representation of water circulation. Moreover, unsupervised calibration techniques based on the objective-function optimization (e.g., inverse calibration using SWAT-CUP SUFI2 algorithm) may not be sufficient if model constraints in multiple domains are not properly set, resulting in distorted parameters. This practice can result in the misrepresentation of water circulation and can have adverse impacts on environmental model results used to support policies and decisions.
KW - Calibration
KW - Equifinality
KW - MODFLOW
KW - Multi-domain
KW - SWAT
KW - SWATmf
UR - http://www.scopus.com/inward/record.url?scp=85071716289&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85071716289&partnerID=8YFLogxK
U2 - 10.1016/j.jhydrol.2019.124032
DO - 10.1016/j.jhydrol.2019.124032
M3 - Article
AN - SCOPUS:85071716289
VL - 578
JO - Journal of Hydrology
JF - Journal of Hydrology
SN - 0022-1694
M1 - 124032
ER -