Beyond model metrics: The perils of calibrating hydrologic models

Juan S. Acero Triana, Maria L. Chu, Jorge Alberto Guzman Jaimes, Daniel N. Moriasi, Jean L. Steiner

Research output: Contribution to journalArticle

Abstract

The multi-metric assessment of model performance in a dominantly single-domain modeling approach (i.e., surface) may not be sufficient to gauge the validity of the model to represent the hydrologic system. Consequently, rating metrics can mathematically validate model results as satisfactory even when some of the simulated hydrologic processes are incorrectly represented during the calibration process. In this paper, we argue that to properly represent the hydrologic system, calibration tasks focused on modifying model parameters should account for equifinality, model inadequacy, and constraint inadequacy. To demonstrate our argument, we conducted a traditional calibration using the Soil and Water Assessment Tool (SWAT) coupled to the Modular Finite-difference Flow Model (MODFLOW) to simulate the hydrologic processes in the Fort Cobb Reservoir Experimental Watershed (FCREW) in central western Oklahoma. The results indicated that model calibration based on metrics from a single domain, in this case using SWAT, did not necessarily guarantee an appropriate representation of water circulation. Moreover, unsupervised calibration techniques based on the objective-function optimization (e.g., inverse calibration using SWAT-CUP SUFI2 algorithm) may not be sufficient if model constraints in multiple domains are not properly set, resulting in distorted parameters. This practice can result in the misrepresentation of water circulation and can have adverse impacts on environmental model results used to support policies and decisions.

Original languageEnglish (US)
Article number124032
JournalJournal of Hydrology
Volume578
DOIs
StatePublished - Nov 2019

Fingerprint

calibration
gauge
watershed
water
modeling
soil and water assessment tool
parameter

Keywords

  • Calibration
  • Equifinality
  • MODFLOW
  • Multi-domain
  • SWAT
  • SWATmf

ASJC Scopus subject areas

  • Water Science and Technology

Cite this

Beyond model metrics : The perils of calibrating hydrologic models. / Acero Triana, Juan S.; Chu, Maria L.; Guzman Jaimes, Jorge Alberto; Moriasi, Daniel N.; Steiner, Jean L.

In: Journal of Hydrology, Vol. 578, 124032, 11.2019.

Research output: Contribution to journalArticle

Acero Triana, Juan S. ; Chu, Maria L. ; Guzman Jaimes, Jorge Alberto ; Moriasi, Daniel N. ; Steiner, Jean L. / Beyond model metrics : The perils of calibrating hydrologic models. In: Journal of Hydrology. 2019 ; Vol. 578.
@article{8f6f1cbb54f648c9985a2e88fffec49a,
title = "Beyond model metrics: The perils of calibrating hydrologic models",
abstract = "The multi-metric assessment of model performance in a dominantly single-domain modeling approach (i.e., surface) may not be sufficient to gauge the validity of the model to represent the hydrologic system. Consequently, rating metrics can mathematically validate model results as satisfactory even when some of the simulated hydrologic processes are incorrectly represented during the calibration process. In this paper, we argue that to properly represent the hydrologic system, calibration tasks focused on modifying model parameters should account for equifinality, model inadequacy, and constraint inadequacy. To demonstrate our argument, we conducted a traditional calibration using the Soil and Water Assessment Tool (SWAT) coupled to the Modular Finite-difference Flow Model (MODFLOW) to simulate the hydrologic processes in the Fort Cobb Reservoir Experimental Watershed (FCREW) in central western Oklahoma. The results indicated that model calibration based on metrics from a single domain, in this case using SWAT, did not necessarily guarantee an appropriate representation of water circulation. Moreover, unsupervised calibration techniques based on the objective-function optimization (e.g., inverse calibration using SWAT-CUP SUFI2 algorithm) may not be sufficient if model constraints in multiple domains are not properly set, resulting in distorted parameters. This practice can result in the misrepresentation of water circulation and can have adverse impacts on environmental model results used to support policies and decisions.",
keywords = "Calibration, Equifinality, MODFLOW, Multi-domain, SWAT, SWATmf",
author = "{Acero Triana}, {Juan S.} and Chu, {Maria L.} and {Guzman Jaimes}, {Jorge Alberto} and Moriasi, {Daniel N.} and Steiner, {Jean L.}",
year = "2019",
month = "11",
doi = "10.1016/j.jhydrol.2019.124032",
language = "English (US)",
volume = "578",
journal = "Journal of Hydrology",
issn = "0022-1694",
publisher = "Elsevier",

}

TY - JOUR

T1 - Beyond model metrics

T2 - The perils of calibrating hydrologic models

AU - Acero Triana, Juan S.

AU - Chu, Maria L.

AU - Guzman Jaimes, Jorge Alberto

AU - Moriasi, Daniel N.

AU - Steiner, Jean L.

PY - 2019/11

Y1 - 2019/11

N2 - The multi-metric assessment of model performance in a dominantly single-domain modeling approach (i.e., surface) may not be sufficient to gauge the validity of the model to represent the hydrologic system. Consequently, rating metrics can mathematically validate model results as satisfactory even when some of the simulated hydrologic processes are incorrectly represented during the calibration process. In this paper, we argue that to properly represent the hydrologic system, calibration tasks focused on modifying model parameters should account for equifinality, model inadequacy, and constraint inadequacy. To demonstrate our argument, we conducted a traditional calibration using the Soil and Water Assessment Tool (SWAT) coupled to the Modular Finite-difference Flow Model (MODFLOW) to simulate the hydrologic processes in the Fort Cobb Reservoir Experimental Watershed (FCREW) in central western Oklahoma. The results indicated that model calibration based on metrics from a single domain, in this case using SWAT, did not necessarily guarantee an appropriate representation of water circulation. Moreover, unsupervised calibration techniques based on the objective-function optimization (e.g., inverse calibration using SWAT-CUP SUFI2 algorithm) may not be sufficient if model constraints in multiple domains are not properly set, resulting in distorted parameters. This practice can result in the misrepresentation of water circulation and can have adverse impacts on environmental model results used to support policies and decisions.

AB - The multi-metric assessment of model performance in a dominantly single-domain modeling approach (i.e., surface) may not be sufficient to gauge the validity of the model to represent the hydrologic system. Consequently, rating metrics can mathematically validate model results as satisfactory even when some of the simulated hydrologic processes are incorrectly represented during the calibration process. In this paper, we argue that to properly represent the hydrologic system, calibration tasks focused on modifying model parameters should account for equifinality, model inadequacy, and constraint inadequacy. To demonstrate our argument, we conducted a traditional calibration using the Soil and Water Assessment Tool (SWAT) coupled to the Modular Finite-difference Flow Model (MODFLOW) to simulate the hydrologic processes in the Fort Cobb Reservoir Experimental Watershed (FCREW) in central western Oklahoma. The results indicated that model calibration based on metrics from a single domain, in this case using SWAT, did not necessarily guarantee an appropriate representation of water circulation. Moreover, unsupervised calibration techniques based on the objective-function optimization (e.g., inverse calibration using SWAT-CUP SUFI2 algorithm) may not be sufficient if model constraints in multiple domains are not properly set, resulting in distorted parameters. This practice can result in the misrepresentation of water circulation and can have adverse impacts on environmental model results used to support policies and decisions.

KW - Calibration

KW - Equifinality

KW - MODFLOW

KW - Multi-domain

KW - SWAT

KW - SWATmf

UR - http://www.scopus.com/inward/record.url?scp=85071716289&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071716289&partnerID=8YFLogxK

U2 - 10.1016/j.jhydrol.2019.124032

DO - 10.1016/j.jhydrol.2019.124032

M3 - Article

AN - SCOPUS:85071716289

VL - 578

JO - Journal of Hydrology

JF - Journal of Hydrology

SN - 0022-1694

M1 - 124032

ER -