Best practices for postprocessing ensemble climate forecasts. Part I: selecting appropriate recalibration methods

Sansom, Philip; Ferro, Christopher; Stephenson, David; Goddard, Lisa M.; Mason, Simon J.

This study describes a systematic approach to selecting optimal statistical recalibration methods and hindcast designs for producing reliable probability forecasts on seasonal-to-decadal time scales. A new recalibration method is introduced that includes adjustments for both unconditional and conditional biases in the mean and variance of the forecast distribution and linear time-dependent bias in the mean. The complexity of the recalibration can be systematically varied by restricting the parameters. Simple recalibration methods may outperform more complex ones given limited training data. A new cross-validation methodology is proposed that allows the comparison of multiple recalibration methods and varying training periods using limited data.

Part I considers the effect on forecast skill of varying the recalibration complexity and training period length. The interaction between these factors is analyzed for gridbox forecasts of annual mean near-surface temperature from the CanCM4 model. Recalibration methods that include conditional adjustment of the ensemble mean outperform simple bias correction by issuing climatological forecasts where the model has limited skill. Trend-adjusted forecasts outperform forecasts without trend adjustment at almost 75% of grid boxes. The optimal training period is around 30 yr for trend-adjusted forecasts and around 15 yr otherwise. The optimal training period is strongly related to the length of the optimal climatology. Longer training periods may increase overall performance but at the expense of very poor forecasts where skill is limited.


  • thumnail for Sansom_PG_etal_2016_JClim_29_7247.pdf Sansom_PG_etal_2016_JClim_29_7247.pdf application/pdf 2.56 MB Download File

Also Published In

Journal of Climate

More About This Work

Academic Units
International Research Institute for Climate and Society
Published Here
March 16, 2020