Uncertainty

Uncertainty estimation with deep learning for rainfall–runoff modeling

Why a useful hydrological forecast needs more than one predicted value.

Research summary2 min readPublished 31 March 2022
Authors
Daniel Klotz; Frederik Kratzert; Martin Gauch; Alden Keefe Sampson; Johannes Brandstetter; Günter Klambauer; Sepp Hochreiter; Grey Nearing
Institution
Johannes Kepler University Linz; Upstream Tech; Google Research
Journal
Hydrology and Earth System Sciences 26, 1673–1693
Geography
Hydrological benchmark study
Method
Mixture density networks; Monte Carlo dropout
DOI
10.5194/hess-26-1673-2022

Research question

How can deep learning produce and evaluate predictive uncertainty for rainfall–runoff modelling?

Method and findings

Klotz and colleagues developed a benchmarking procedure and evaluated four deep-learning baselines: three using mixture density networks and one using Monte Carlo dropout. They found strong uncertainty-estimation baselines, particularly among the mixture-density approaches, and examined model behaviour beyond aggregate performance.

Limitations

A predictive distribution is evaluated within its data and modelling context. It is not a guarantee that future conditions outside that context are adequately represented.

Engineering interpretation

Our interpretationA narrow prediction interval is useful only if its coverage is reliable. Test calibration and sharpness together, then assess the consequences of uncertainty for restrictions, storage depletion and intervention timing. Do not convert a point forecast into a design certainty.

Read the validation workflow before comparing forecast scores.

Sources & further reading

Source findings are distinguished from editorial interpretation. Apply current local criteria and project evidence when making engineering decisions.