title: Multimodel ensembles of wheat growth: many models are better than one.
abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.
authors.affiliation: INRA, UMR1095 Genetics, Diversity and Ecophysiology of Cereals (GDEC), 5 chemin de Beaulieu, F-63 100, Clermont-Ferrand, France; Blaise Pascal University, UMR1095 GDEC, F-63 170, Aubière, France.
authors.forename: Pierre
authors.initials: P
authors.lastname: Martre
authors.forename: Daniel
authors.initials: D
authors.lastname: Wallach
authors.forename: Senthold
authors.initials: S
authors.lastname: Asseng
authors.forename: Frank
authors.initials: F
authors.lastname: Ewert
authors.forename: James W
authors.initials: JW
authors.lastname: Jones
authors.forename: Reimund P
authors.initials: RP
authors.lastname: Rötter
authors.forename: Kenneth J
authors.initials: KJ
authors.lastname: Boote
authors.forename: Alex C
authors.initials: AC
authors.lastname: Ruane
authors.forename: Peter J
authors.initials: PJ
authors.lastname: Thorburn
authors.forename: Davide
authors.initials: D
authors.lastname: Cammarano
authors.forename: Jerry L
authors.initials: JL
authors.lastname: Hatfield
authors.forename: Cynthia
authors.initials: C
authors.lastname: Rosenzweig
authors.forename: Pramod K
authors.initials: PK
authors.lastname: Aggarwal
authors.forename: Carlos
authors.initials: C
authors.lastname: Angulo
authors.forename: Bruno
authors.initials: B
authors.lastname: Basso
authors.forename: Patrick
authors.initials: P
authors.lastname: Bertuzzi
authors.forename: Christian
authors.initials: C
authors.lastname: Biernath
authors.forename: Nadine
authors.initials: N
authors.lastname: Brisson
authors.forename: Andrew J
authors.initials: AJ
authors.lastname: Challinor
authors.forename: Jordi
authors.initials: J
authors.lastname: Doltra
authors.forename: Sebastian
authors.initials: S
authors.lastname: Gayler
authors.forename: Richie
authors.initials: R
authors.lastname: Goldberg
authors.forename: Robert F
authors.initials: RF
authors.lastname: Grant
authors.forename: Lee
authors.initials: L
authors.lastname: Heng
authors.forename: Josh
authors.initials: J
authors.lastname: Hooker
authors.forename: Leslie A
authors.initials: LA
authors.lastname: Hunt
authors.forename: Joachim
authors.initials: J
authors.lastname: Ingwersen
authors.forename: Roberto C
authors.initials: RC
authors.lastname: Izaurralde
authors.forename: Kurt Christian
authors.initials: KC
authors.lastname: Kersebaum
authors.forename: Christoph
authors.initials: C
authors.lastname: Müller
authors.forename: Soora Naresh
authors.initials: SN
authors.lastname: Kumar
authors.forename: Claas
authors.initials: C
authors.lastname: Nendel
authors.forename: Garry
authors.initials: G
authors.lastname: O'leary
authors.forename: Jørgen E
authors.initials: JE
authors.lastname: Olesen
authors.forename: Tom M
authors.initials: TM
authors.lastname: Osborne
authors.forename: Taru
authors.initials: T
authors.lastname: Palosuo
authors.forename: Eckart
authors.initials: E
authors.lastname: Priesack
authors.forename: Dominique
authors.initials: D
authors.lastname: Ripoche
authors.forename: Mikhail A
authors.initials: MA
authors.lastname: Semenov
authors.forename: Iurii
authors.initials: I
authors.lastname: Shcherbak
authors.forename: Pasquale
authors.initials: P
authors.lastname: Steduto
authors.forename: Claudio O
authors.initials: CO
authors.lastname: Stöckle
authors.forename: Pierre
authors.initials: P
authors.lastname: Stratonovitch
authors.forename: Thilo
authors.initials: T
authors.lastname: Streck
authors.forename: Iwan
authors.initials: I
authors.lastname: Supit
authors.forename: Fulu
authors.initials: F
authors.lastname: Tao
authors.forename: Maria
authors.initials: M
authors.lastname: Travasso
authors.forename: Katharina
authors.initials: K
authors.lastname: Waha
authors.forename: Jeffrey W
authors.initials: JW
authors.lastname: White
authors.forename: Joost
authors.initials: J
authors.lastname: Wolf
mesh_terms: D002980:Climate; D057231:Climate Change; D004777:Environment; D008954:Models, Biological; D012621:Seasons; D014908:Triticum / Q000254:growth & development*
keywords: ecophysiological model; ensemble modeling; model intercomparison; process-based model; uncertainty; wheat (Triticum aestivum L.)