Improved dynamic programming for reservoir operation optimization with a concave objective function

Diminishing marginal utility is an important characteristic of water resources systems. With the assumption of diminishing marginal utility (i.e., concavity) of reservoir utility functions, this paper derives a monotonic relationship between reservoir storage and optimalrelease decision under both deterministic and stochastic conditions, and proposes an algorithm to improve the computational efficiency of both deterministic dynamic programming (DP) and stochastic dynamic programming (SDP) for reservoir operation with concave objective functions. The results from a real-world case study show that the improved DP and SDP exhibit higher computational efficiency than conventional DP and SDP. The computation complexity of the improved DP and SDP is O(n) (order of n, the number of state discretization) compared to O(n²) with conventional DP and SDP.