Abstract
Crop simulation models can be used to estimate impact of current and future climates on crop yields and food security, but require long-term historical daily weather data to obtain robust simulations. In many regions where crops are grown, daily weather data are not available. Alternatively, gridded weather databases (GWD) with complete terrestrial coverage are available, typically derived from: (i) global circulation computer models; (ii) interpolated weather station data; or (iii) remotely sensed surface data from satellites. The present study's objective is to evaluate capacity of GWDs to simulate crop yield potential (Yp) or water-limited yield potential (Yw), which can serve as benchmarks to assess impact of climate change scenarios on crop productivity and land use change. Three GWDs (CRU, NCEP/DOE, and NASA POWER data) were evaluated for their ability to simulate Yp and Yw of rice in China, USA maize, and wheat in Germany. Simulations of Yp and Yw based on recorded daily data from well-maintained weather stations were taken as the control weather data (CWD). Agreement between simulations of Yp or Yw based on CWD and those based on GWD was poor with the latter having strong bias and large root mean square errors (RMSEs) that were 26–72% of absolute mean yield across locations and years. In contrast, simulated Yp or Yw using observed daily weather data from stations in the NOAA database combined with solar radiation from the NASA-POWER database were in much better agreement with Yp and Yw simulated with CWD (i.e. little bias and an RMSE of 12–19% of the absolute mean). We conclude that results from studies that rely on GWD to simulate agricultural productivity in current and future climates are highly uncertain. An alternative approach would impose a climate scenario on location-specific observed daily weather databases combined with an appropriate upscaling method.
Keywords: crop model, maize, rice, weather data, wheat, yield potential
Introduction
Anthropogenic greenhouse gas emissions are likely to modify climate in coming decades (Allen et al., 2000; Oreskes, 2004), and there is increasing concern about impact of climate change on food security (IPCC, 2007; Schmidhuber & Tubiello, 2007). A key question is how future climates will influence capacity to produce adequate food supply at regional to national and global scales. To date, most studies examining global impacts of climate change on crop yields have been based on derived, gridded weather databases (GWDs) that provide complete coverage of earth's terrestrial surface (e.g. Fischer et al., 2002; Foley et al., 2005; Licker et al., 2010; Ciais et al., 2011). At issue is how well such GWDs perform in estimating food production potential in today's climate, which is the central focus of our study.
Establishing research plots in every geographic area of interest to analyze effects of climate on crop production is difficult and cost prohibitive. For this reason agronomists turn to crop simulation models, which capture major interactions among crop genotype, environment, and management. Most previous studies that utilized crop simulation models to evaluate impact of climate change on crop yields have assumed (implicitly or explicitly) that crops were grown with optimal management (Rosenzweig & Parry, 1994; Fischer et al., 2002; Bondeau et al., 2007; Tubiello et al., 2007). This assumption is made because currently available simulation models do not account for all of the interacting constraints that limit crop growth and yield in farmer's fields such as deficient or imbalanced supply of 16 essential nutrients, inadequate or excessive water supply, and yield losses from insect pests, weeds, and diseases. In addition, crop yields can be decreased by imperfect field management that leads to unintended suboptimal plant population or uneven plant stands, effects not accounted for in some crop models. In contrast, under optimal conditions, and when grown with irrigation, crop yield potential (Yp) is determined solely by plant population and solar radiation and temperature during the period from planting to maturity. Evans (1993) defined Yp as the yield of an adapted crop cultivar grown under conditions in which nutrients, pests, and diseases are nonlimiting. When crops are grown without irrigation (i.e. rainfed conditions), a water-limited yield potential (Yw) is determined by the same factors that influence Yp, but also by water supply (soil water at planting plus in-season precipitation) and soil characteristics that affect the plant-available water supply. Simulation of yield potential is relatively straightforward because dry matter accumulation relies solely on the balance between photosynthesis and respiration, and seed yield is determined by partitioning of total dry matter between seed and vegetative organs. All three of these processes are relatively well understood such that underpinning mechanisms can be described in a set of mathematical formulas that comprise the core of crop simulation models. Future crop yields are expected to be producing much nearer yield potential due to increased food demand but limited land and water resources for expansion of agriculture (Godfray et al., 2010). Thus, within the context of climate change and a time horizon of several decades, a focus on yield potential provides a robust proxy for future food production.
Yield potential can be simulated using site-specific, observed weather data or gridded weather data. Gridded weather data are distributed uniformly over space within a spatial grid cell. Values within a cell are typically derived by interpolating site-specific weather data based on coordinates of the sites within the grid and in nearest-neighbor grids, their distance from each other, elevation, and other variables (Hutchinson, 1995; Boer et al., 2001). Gridded weather data have the advantage of full geospatial coverage, but they are derived, rather than observed. Studies that have used gridded weather data to simulate Yp or Yw for a grid are rarely validated against Yp or Yw estimated using actual weather station data from a location within the same grid (Fischer et al., 2002; Foley et al., 2005; Lobell et al., 2008).
More than 30 weather data sources have been used in agricultural research, but only a few of these have been used for global-scale analysis of simulated yields (Ramirez-Villegas & Challinor, 2012). The main differences among sources of those weather databases used to simulate Yp and Yw include: (i) observed site-based vs. interpolated gridded data; (ii) temporal resolution (daily vs. monthly); and (iii) spatial resolution (among gridded databases) (Table 1). Several studies have compared simulated yields using observed, site-specific data with simulations made using gridded or modeled weather data (Mearns et al., 2001; Baron et al., 2005; van Bussel et al., 2011), but these studies only focus on a single source of gridded weather data without considering other databases with different spatial and temporal attributes.
Table 1.
Classification | Source | Time step | Reference and time interval | Geospatial coverage | Reported variables* | Examples |
---|---|---|---|---|---|---|
Point-based data | Weather stations | Daily | HPRCC†, CMA‡, DWD§ (1983–2010) | Regional | Tmin, Tmax, precip, wind speed, Tdew Temp, RH, vapor pressure, radiation | Sinclair & Rawlins (1993), Wang & Connor (1996), Peng et al. (2004), Grassini et al. (2009), Cassman et al. (2010) |
NOAA¶(1900–2010) | Global | Tmin, Tmax, precip, Tdew, wind speed, RH, vapor pressure | ||||
Gridded data | Interpolated and generated based on data from weather stations, satellites, ocean buoys, etc. | Daily | NCEP/DOE Reanalysis II||(1979–2010) | Global (2.5° × 2.5°) (ca. 70 000 km2)¶¶ | Tmin, Tmax, wind speed, precip, RH, wind speed, radiation | Lobell & Asner (2003), Nemani et al. (2003), Schlenker & Roberts (2009), Twine & Kucharik (2009) |
ERA-Interim Reanalysis (1989–2013)** | Global (1.5° × 1.5°) (ca. 25 000 km2) | Tmin, Tmax, wind speed, precip, RH, wind speed, radiation | Rötter (1993), de Wit et al. (2010) | |||
Interpolated from weather stations | Monthly | CRU05 (3.10)††, Univ. Delaware Climate Dataset (1961–2009) | Global (0.5° × 0.5°) (ca. 3000 km2) | Tmin, Tmax, total precip, no. of wet days, vapor pressure | Fischer et al. (2002), Foley et al. (2005), Bondeau et al. (2007), Lobell (2007), Lobell et al. (2008), Battisti & Naylor (2009), Licker et al. (2010), Lobell et al. (2011) | |
Average 50-year monthly mean | WorldClim‡‡ (1950–2000) | Global(ca. 1 km2) | Tmin, Tmax, total precip, no. of wet days | Ortiz et al. (2008), Nelson et al. (2010) | ||
Satellite | Daily | NASA-Power§§(1983–2010) except precip (1997–2010) | Global 1° × 1° (ca. 12 000 km2) | Tmin, Tmax, precip, Tdew, radiation, RH | Lobell et al. (2010) |
Minimum temperature (Tmin), maximum temperature (Tmax), precipitation (precip), relative humidity (RH), incident solar radiation (radiation).
High Plains Regional Climate Center (HPRCC). http://www.cma.gov.cn/english/.
China Meteorological Administration (CMA). http://www.cma.gov.cn/english/.
German Weather Service (DWD. http://www.dwd.de/.
National Oceanic and Atmospheric Administration (NOAA) Global Historical Climate Data-daily: http://www.ncdc.noaa.gov/oa/climate/ghcn-daily/.
National Center for Environmental Prediction/Department of Energy (NCEP). http://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis2.html.
ECMWF re-analysis (ERA). http://www.ecmwf.int/research/era/do/get/era-interim.
Climate Research Unit (CRU). http://badc.nerc.ac.uk/data/cru/.
WorldClim. http://www.worldclim.org/.
National Aeronautics and Space Administration (NASA). http://power.larc.nasa.gov/.
Aproximate grid cell area near the equator.
Assessment of climate change impacts on future crop yield requires confidence in the simulated yields that are taken as a baseline. No previous studies, however, have compared how these baselines may vary depending on source of the global weather data used in the analysis. To fill this knowledge gap, we evaluated how well currently available global GWD perform when used as input for crop model estimates of Yp or Yw compared with similar simulations made with observed, high quality site-based weather data. Underpinning causes for observed differences in simulated yields were identified based on case studies in three major cropping systems: rainfed maize in US, irrigated rice in China, and rainfed wheat in Germany, which together are representative of 25% of global cereal grain supply (assuming German wheat production is representative of wheat production in northwest Europe). We also assessed capacity to simulate crop yields with publicly available weather station data that has greatest global coverage in terms of number and distribution of weather stations, which may provide another option for estimating current baselines and future crop yields in climate change studies.
Materials and methods
Databases selected for comparison
Weather data used as a benchmark for simulation of Yp or Yw were obtained from regional networks of meteorological stations that have complete daily records of weather data, and which also undergo rigorous quality control measures. Available data recorded by these weather stations, hereafter called ‘control weather data’ (CWD), include all daily time-step variables required to simulate Yp or Yw (see detailed description of the variables in the following section). CWD were taken from (i) the High Plains Regional Climate Center for rainfed maize in the USA (HPRCC, 2011); (ii) the China Meteorological Administration for irrigated rice in China (China Meterological Administration, 2009); and (iii) the German Weather Service for rainfed wheat in Germany (DWD, 2009). Four locations in each country were selected based on completeness of weather data records and location in regions with high density of crop production as identified by Van Wart et al. (2013a).
The GWDs selected for our study and one global weather station database are publically accessible, diverse in spatial and temporal resolution, and widely used in the published literature for estimating effects of climate change on food security (Table 1). The three GWDs include: (i) National Center for Environmental Prediction and Department of Energy's reanalysis II (NCEP/DOE) (Kanamitsu et al., 2002); (ii) Climate Research Unit's high-resolution gridded dataset time series 3.1 (CRU) (New et al., 2002); and (iii) National Aeronautics and Space Administration's POWER database (NASA), produced by the NASA Langley Research Center POWER Project funded through the NASA Earth Science Directorate Applied Science Program. A fourth database of location-specific weather data came from weather stations in the National Oceanic and Atmospheric Administration's Global Historical Climate Network-daily, hereafter called NOAA database (NCDC, 2011). In all cases the NOAA weather stations are distinct from the CWD stations although they are in close proximity. A description of spatial and temporal resolution of these weather databases, as well as their reported meteorological variables, is found in Table 1.
Gridded daily NCEP data are derived from a global climate model based on observed weather data from meteorological stations, ocean buoys, satellite data, and other sources (Kalnay et al., 1996; Kanamitsu et al., 2002). Gridded monthly CRU data are derived by interpolating weather data from 14 000 stations around the world using a thin-plate spline method which accounts for latitude, longitude, and elevation (New et al., 2002; Mitchell and Jones, 2005). Gridded, daily NASA-POWER data are derived from satellite observations coupled with the Goddard Earth Observing System Model, an integrated system of models informed by observed data from multiple sources (satellite, ground stations, etc.).
Values calculated for each grid can serve as model input themselves or be understood as values located at the center of the grids. These grid-center values can be used to interpolate values at another location within the grid based on distances from that location to neighboring grid-centers. In the present study, separate simulations of Yp and Yw were performed for all crops based on gridded NCEP and CRU weather data using: (i) reported gridded data for the grid in which the meteorological weather stations were located; and (ii) data interpolated from center points of nearby grids to the location of the CWD meteorological stations by distance-based bilinear interpolation following the method described in Chang (2009).
The NOAA database is an archive of daily historical weather observations from 40 000 meteorological stations around the world, the data of which have undergone several quality control measures (NCDC, 2011). Selected NOAA weather stations were located near CWD sites (Fig.1). Because the NOAA data do not contain values for daily solar radiation, which are critical for robust simulation of crop yields, NOAA data were coupled with satellite-derived NASA daily solar radiation (SR) to estimate Yp and Yw (hereafter called NOAA-SR). This approach was taken for two reasons. First, previous studies have found that simulation of crop yields using a combination of NASA-derived SR and weather station data for temperature and rainfall were in close agreement with simulations based on measured SR at the weather stations (White et al., 2011b; Bai et al., 2010). These studies demonstrate that NASA's SR, though gridded, is well correlated with SR observed at ground stations in topographically homogenous (i.e. flat) regions where field crops are typically grown. Second, use of NASA-derived SR to estimate Yp or Yw was in closer agreement with simulations based on measured SR compared with simulations based on SR estimated from temperature and/or sunshine hours (Van Wart et al., 2013a).
Yield simulations
Crop Yp and Yw were simulated using ORYZA2000 for rice (Bouman et al., 2001), HybridMaize for maize (Yang et al., 2004), and CERES-Wheat (Ritchie et al., 1988), the latter embedded in dssat 4.0 (Jones et al., 2003). Each of these crop simulation models have been well documented and validated against yields measured in field experiments that received optimal management (Ghaffari et al., 2001; Bouman & van Laar, 2006; Grassini et al., 2009). These models operate on a daily time-step; hence, they require daily weather data including incident SR and maximum and minimum temperature (Tmax and Tmin, respectively) to simulate Yp. Simulation of Yw in rainfed cropping systems also requires precipitation and other variables needed to estimate reference evapotranspiration (ETo), including wind speed, dew point temperature, and/or relative humidity (RH). Simulated grain yields in this study are reported at standard moisture contents of 0.140, 0.155, and 0.135 kg H2O kg−1 grain for rice, maize and wheat, respectively, because this is comparable to yield records in global and national databases maintained by agencies such as USDA and FAO. Other input parameters necessary for simulating Yp or Yw for each crop at each location include soil properties (soil texture, soil depth, plant available soil water holding capacity), management practices (sowing date and plant population), and cultivar-specific (genotype) coefficients, which were taken from Van Wart et al. (2013a). These inputs were held constant for the simulation at each location regardless of the GWD data used as input to yield simulations (see Tables S1–S3).
Simulation of Yw for rainfed maize in USA required information on planting date, hybrid maturity, plant population, planting density, and soil properties (including soil texture and initial plant available soil water) as determined by Van Wart et al. (2013a). Maize planting dates were determined as average date from 2003–2008 for which the USDA's Risk Management Agency (RMA) reported 50% of maize area as planted for the counties in which CWD-sites were located (RMA, 2010). Seeding rate and hybrid maturity for the most commonly used hybrids were obtained from field researchers and seed company agronomists. The SSURGO database was used to identify the dominant agricultural soil within 100 km of control-sites based on area planted with maize as identified by the 2009 USDA crop data layer (USDA-NASS, 2009). Initial soil water at planting was assumed to be 100% field capacity, which is typical for most rainfed maize area in the US Corn Belt.
In China, multiple crops are planted in a single year on the same piece of land, as opposed to single cropping found in more temperate regions. In the present study, the dominant rice systems in the targeted locations were simulated, resulting in a total of six rice cropping systems by location combinations (see Tables S1–S3). Data used to simulate irrigated rice Yp using ORYZA2000 were provided by local agronomists in China, including sowing or transplanting date, hill spacing, and dominant rice cultivar for each cropping system as reported by Van Wart et al. (2013a). Soil data were not required because simulations assume irrigation is applied whenever the crop needs water regardless of soil type. Genotypic coefficients were determined for the dominant cultivar in each cropping system based on CWD and actual average transplanting, flowering and maturity dates reported by local agronomists. Calibration of genotypic coefficients was performed using drates software, which iteratively determines coefficients that give simulated estimates of date of rice flowering and maturity consistent with actual reported average rice flowering and maturity dates (Bouman et al., 2001). Genotypic coefficients calibrated for CWD-sites were kept constant across the GWD-based simulations.
Simulation of rainfed winter wheat Yw required data on planting date, plant population, and soil properties. Average planting date and plant population at each site were obtained from the German Weather Service and local breeders and agronomists based on Van Wart et al. (2013a). Genotypic coefficients of the dominant wheat cultivars at each location were provided by Jans Bobert (Leibniz Centre for Agricultural Landscape Research). These genotypic coefficients were kept constant across simulations made with GWD and CWD data. Finally, soil water was assumed to be 100% field capacity at the start of the season (typical of rainfed wheat fields in Germany) and soil properties were retrieved from soil profile descriptions of dominant soil series reported by Hartwich et al. (1995).
Nineteen years of data were available for both the CWD and the four GWDs for all rice simulations and for two of the maize locations (1990–2008). The other two maize locations had CWD for 11 (1998–2008) and 14 years (1995–2008). The longest time-span of consecutive years available from NOAA stations in Germany at the time of this study was from 1983–1991. Because an unbiased analysis requires equivalent time-series for all weather databases, Yw simulations of wheat in Germany were performed over these nine consecutive years using CWD, NCEP, CRU, and NOAA-SR data. However, NASA-POWER data do not begin reporting rainfall until 1997, therefore, simulations of Yw of wheat in Germany and Yw in USA using NASA data were only performed for the years 1997–2008 and compared with CWD-based simulations for the same time interval. Total observations were n = 63 for rainfed maize in the USA (11–19 years, four sites), n = 76 for rice in China (19 years, four sites), and n = 36 for wheat in Germany (9 years, four sites).
Quality control, temporal interpolation, and estimation of missing parameters
Crop models operate on a daily time-step, hence, daily weather data are required to simulate Yp or Yw. The NCEP, NASA, and CWD datasets contain daily values for the entire time-series included in this study. CRU monthly data require temporal interpolation, and raw NOAA station data require correction of missing or erroneous data. Cubic spline interpolation was used to derive daily Tmin, Tmax, vapor pressure, and percent cloud cover (a proxy for sunshine hours) from monthly CRU data. Daily rainfall data were generated from records of total monthly precipitation and monthly wet day records following the stochastic precipitation generation method described in Liu et al. (2009).
To achieve complete daily records for the NOAA data, it was necessary to identify and replace erroneous values and fill in missing values. A spatial regression test (SRT) was used to check weather data of each NOAA station based on whether each datum fell within a confidence interval calculated from a weighted regression estimate of each datum based on nearby station data (Hubbard et al., 2007). For each of at least two stations closest to the station to be tested, a regression estimate is formed for each tested day and parameter (e.g. Tmin, Tmax, rainfall) based on the previous and preceding 15 days of data. A SRT estimated value for each datum is then calculated by weighting each regression estimate by the SE of the regression. If a tested station datum is missing or outside the confidence interval, calculated as the SRT estimate plus or minus 3 SDs (5 for precipitation), it is replaced by the SRT estimate. This method was found to outperform other quality-control methods over a wide variety of agro-climatic regions (Hubbard et al., 2005; You et al., 2008). Approximately 0.5% of all NOAA weather records required correction in the present study. In cases where a single daily record was missing from both the targeted and nearby stations, the average of the preceding and succeeding day was used to substitute the missing value (<0.01% of all weather records in the present study).
All GWDs required estimation of unreported parameters. Following Allen et al. (1998), wind speed was assumed to be equal to 2 m s−1 for CRU. RH was estimated using the Clausius-Clapeyron equation and SR was estimated using the Angstrom equation with percent cloud cover serving as a proxy for the ratio of actual sunshine duration to maximum possible sunshine duration (Foken & Nappo, 2008). Dew point temperature was estimated based on the Magnus-Tetens formula for both CRU and NCEP. ETo was estimated based on Penman-Monteith-FAO equation for all databases.
Evaluation of weather databases for simulation of Yp and Yw
Mean error (ME), root mean square error (RMSE), and coefficient of variation (CV) were calculated for simulated Yp or Yw based on each GWD and NOAA-SR as follows:
(1) |
(2) |
(3) |
where is the Yp or Yw simulated using data from a GWD for the ith site-year, is Yp or Yw simulated using the CWD for the ith site-year, n is the number of site years, and σ and μ are standard deviation and mean, respectively, of simulated Yp or Yw. ME is a measure of average magnitude and bias (+ or −) of the error in simulated yield with GWDs or NOAA-SR compared with simulations with CWD. RMSE and %RMSE quantify average error on an absolute or relative basis compared to control mean values simulated with CWD respectively. CV is a measure of the relative variability in a distribution.
Forward stepwise regression was used to identify weather variables that best explain differences in Yp or Yw as simulated by the different weather data sources (Draper & Smith, 1981). The difference between simulated Yp or Yw based on CWD and a GWD or NOAA-SR was the dependent variable, while the difference between a given weather variable from the CWD and a GWD or NOAA-SR were independent variables. Four weather variables were examined: average daily Tmin and Tmax, cumulative SR, and cumulative water deficit, defined here as precipitation minus ETo. Values of these weather variables were calculated for two crop phases: planting-to-anthesis and anthesis-to-physiological maturity for rice and wheat and planting-to-silking and silking-to-physiological maturity for maize. This resulted in a total of eight possible independent variables for inclusion in stepwise regression for each crop-country case for a given weather database. Only variables significant at P-value ≤0.05 were included in the final regression. Tests for co-linearity were null for all independent variables used in the regressions (P ≥ 0.05).
Results
Simulations with global weather databases
On average, simulated yields were overestimated by more than 1.5 t ha−1 in six of nine cases when based on data from gridded GWD compared with the simulated yields using CWD (Figs 2–4). Of particular note was the average upward bias of about 4.0 t ha−1 for Yw of US maize estimated by CRU and NASA, and for Yp of rice in China by NCEP. However, the bias between gridded GWD and CWD based simulations was not consistent. For example, except for NASA based simulations in Germany, simulations in China and Germany made with GWD data overestimated Yp or Yw. But NCEP-based simulations of Yw for maize in the USA had a negative bias of more than 1.0 t ha−1. While CRU based rainfed maize Yw simulations tended to overestimate Yp and Yw at high yield levels, NCEP and NASA tended to overestimate Yp at lower yield levels. In contrast, simulated yields using NOAA-SR weather data were in reasonably close agreement with yields simulated with CWD, although irrigated rice Yp in China had a modest overestimation of Yw (ME = 0.9 Mg ha−1). On average, %RMSE for Yp and Yw simulations based on gridded GWD was 45% and 33%, respectively, compared with 19% and 14% for NOAA-SR-based simulations. Likewise, the degree of correlation between Yp or Yw estimated by NOAA-derived weather data and the CWD was quite high in all cases, ranging from Pearson correlation r values of 0.70 for rice in China to 0.89 for wheat in Germany. Correlations with CWD values for Yp or Yw based on GWD were much poorer and sometimes not statistically significant.
Yield simulations using gridded GWDs from Chongqing, Chengdu, and Gushi were not well-correlated with simulations based on CWD. Two of these locations (Chongqing and Chengdu) are located in regions with heterogeneous landscapes in which rice is grown in large river valleys surrounded by mountains. Such heterogeneity further exacerbated the magnitude of error in estimates of Yp based on gridded GWD (Fig.3; Table S4). Hence, gridded weather data, assuming uniform distribution of weather variables over the entire grid, are clearly disadvantaged when used to predict crop yields in such heterogeneous grids—especially in GWD with large grid size like NCEP.
Compared with simulations using weather data based at grid centers, interpolation from grid centers to station locations had a negligible effect on accuracy of all CRU-based simulations for all sites (difference in RMSE <3%). The effect was similarly negligible for rainfed maize and rainfed wheat simulations based on NCEP data. However, for NCEP simulations of Yp of rice in China, interpolation of data dramatically increased the bias. Simulations of rice Yp using interpolated NCEP data had an RMSE which was 47% larger than rice Yp simulations made using noninterpolated NCEP data. We speculate this large differences between simulations made using interpolated and noninterpolated NCEP weather data are due to the large size of NCEP's 70 000 km2 grids and the heterogeneous landscape in some of the grids included in this study (see Table S3).
Reasons for bias in simulated yields with global weather databases
Stepwise multiple regression helped assess the causes of underlying bias in estimates of Yp and Yw using simulations with GWD, especially for rainfed maize and wheat, which are grown in regions with relatively uniform topography in the USA and Germany respectively (see Table S5 for a summary of GWD and NOAA-SR weather data biases). The range in average annual precipitation, however, differs markedly among CWD sites in Germany (500 and 850 mm) the USA (450–900 mm) and rainfall does not replace evapotranspiration in much of the western Corn Belt where the CWD sites are located (Grassini et al., 2009). As a result, estimated water deficit and solar radiation had a large influence on discrepancies between Yw estimated by GWDs and CWD (Table 2). In general, the sign of coefficients in Table 2 are indicative of the relationship between that variable and yield. For instance, a positive sign for water deficit indicates that as this variable increases (less precipitation and more ETo) so do the deviations in simulated yields with a GWD as compared with simulations using the CWD. The closer GWD and NOAA-SR based simulated yields were to CWD based simulations (i.e. low RMSE and ME as shown in Figs 2–4), the poorer the explanatory power of the final regression model. For example, the water deficit calculated over the USA simulated maize growing season was 76% and 86% smaller for simulations based on CRU (data not shown) and NASA data, respectively, compared with those based on CWD (Fig.5a). Similarly, water deficit was 31% larger with NCEP maize simulations than with CWD, especially during the post-silking phase in which water deficit was 43% larger than the CWD (see Figs S1–S12).
Table 2.
Database | Independent variables† | Coefficient‡ | Explanatory power (%) | Adjusted R2 | F-test |
---|---|---|---|---|---|
Maize | |||||
NOAA | Post-S solar radiation* | 0.005 | 11 | ||
Post-S water deficit*** | 0.008 | 16 | 0.25 | 11.1*** | |
NCEP | Post-S solar radiation*** | 0.011 | 29 | ||
Post-S water deficit*** | 0.024 | 49 | 0.77 | 105.5*** | |
CRU | Post-S average daily Tmax*** | −1.412 | 33 | ||
Pre-S water deficit** | −0.005 | 17 | |||
Post-S water deficit** | 0.015 | 13 | 0.61 | 33.5*** | |
NASA | Post-S solar radiation*** | 0.011 | 64 | ||
Post-S water deficit*** | 0.030 | 22 | 0.85 | 136.2*** | |
Rice | |||||
NOAA | Post-A solar radiation*** | 0.005 | 12 | 0.11 | 14.1*** |
NCEP | Pre-A average daily Tmax*** | −0.879 | 45 | ||
Post-A solar radiation*** | −0.002 | 14 | 0.58 | 76.6*** | |
CRU | Post-A average daily Tmax* | −0.379 | 5 | 0.04 | 5.5* |
NASA | Post-A average daily Tmax** | −0.135 | 24 | ||
Pre-A solar radiation*** | 0.005 | 10 | 0.33 | 27.6*** | |
Wheat | |||||
NOAA | Pre-A solar radiation*** | 0.006 | 36 | 0.34 | 19.1*** |
NCEP | Pre-A average daily Tmin*** | 3.921 | 38 | 0.36 | 21.0*** |
CRU | Pre-A average daily Tmin*** | −0.876 | 30 | ||
Post-A solar radiation* | 0.005 | 8 | 0.34 | 10.2*** | |
NASA | Pre-A solar radiation*** | 0.004 | 44 | 0.43 | 32.9*** |
Variables were significant at
P < 0.05
P < 0.01, and
P < 0.001.
Coefficients reported are b values from the multiple regression equation: y = a + b1x1 + b2x2 + b3x3 + … + e.
In some cases, differences between a specific weather variable in GWD and CWD did not have a large impact on estimates of yield potential because the variable in question was not a sensitive parameter. For example, although the water deficit was grossly overestimated for wheat in Germany in the CRU database, this bias did not have a large influence on the discrepancy in Yw estimates because rainfall is generally adequate for rainfed wheat in most of Germany (Figs 4 and 5b). Given adequate rainfall, the differences in simulated wheat yields were attributed more to differences in temperature and solar radiation (Table 2). For example, average pre-anthesis daily minimum temperature was lower in NCEP data compared with CWD data (0.9 °C vs. 3.0 °C). In some cases these low temperatures induced simulated frost-kill while in others they increased the pre-anthesis growth period and allowed for greater dry-matter accumulation by the time of anthesis, which increased grain set and final yield.
Discussion
The twelve sites evaluated in this study included simulations of the three most important cereal crop species, in three major crop producing countries with very different climates and water regimes. Assessment of different sources of weather data for their capacity to simulate crop yields across this diversity of crops and environments gives confidence that findings from this study can be generalized to other major crop production regions. Results presented here document that GWDs, such as NCEP, CRU, or NASA, do a poor job of simulating Yp and Yw of rice, wheat, and maize. In contrast, simulations of crop yields based on NOAA-SR data, derived from actual weather stations, outperformed simulations made using the GWDs in nearly all cases especially for topographically diverse regions or where water deficit is a major limiting factor to rainfed crop production. Reasons for discrepancy between simulated Yp or Yw using GWDs vs. simulations using location-specific, high-quality weather data were attributed to biases in temperature, SR, and/or degree of water deficit in the GWDs.
Climate heterogeneity in GWDs is smoothed by interpolations or modeling, which may not appropriately capture topographic features affecting climate (Daly, 2006). Temporal interpolations, such as deriving daily data from monthly average values (e.g. CRU) are also problematic as they likewise attenuate the degree of weather event variegation, especially for extreme events. Using interpolation from grid-centers of a GWD to actual location of the control weather stations in the CWD did little to remove these biases or to improve the accuracy of yield simulation. Use of gridded GWD data can therefore lead to erroneous conclusions about the impact of climate change. It may be argued that differences in weather data do not have a large impact on long-term average crop yield estimates based on simulation if differences are random and cancel each other out over time or in cases where crop performance is not sensitive to a specific weather parameter (such as rainfall in Germany). However, food security and vulnerability of future populations will depend on annual variability of global crop yields as well as long-term average yields (Schmidhuber & Tubiello, 2007). Furthermore, inability to reproduce interactions between environment and management under current weather raises the question of whether these databases or those derived from them should be used in studies aiming at reproducing the impact of future weather on management adaptations to climate change.
The GWDs compared in this study are being used to derive climate change scenarios, such as those found in the IPCC 4th assessment, which in turn are used in analysis of the impact of future climate change on crop yields (IPCC, 2007; Battisti & Naylor, 2009). These GWDs do not provide a reliable or realistic baseline of crop yield simulations nor will climate change scenarios based on data from these GWDs. Such climate change scenarios do not produce credible representations of location-specific climate nor even climate at larger scales (Masson & Knutti, 2011; Ramirez-Villegas & Challinor, 2012). In this article, we extend these results to evaluate capacity of these GWDs to simulate crop yields.
Credible assessment of the impact of future climate on food production depends on ability to estimate crop yields accurately under a wide array of climates, cropping systems, and water regimes. The poor performance of GWDs in estimating crop yields as shown in this study calls into question the many prior evaluations of climate change impact on crop production based on use of GWDs (Table 1) (see also White et al., 2011a). Because land use change is closely linked to agriculture, accurate estimates of crop yield levels have a large impact on future land-use and emissions from the agricultural production sector (Balmford et al., 2005). Hence, there are trade-offs between spatial granularity and accuracy of crop management and weather data and need for complete global terrestrial coverage (Bondeau et al., 2007; Ciais et al., 2011).
Given results of this manuscript, estimates of crop production should be based on actual data from ground weather stations that report the key weather variables that drive crop growth and yield, including daily maximum/minimum temperature, rainfall, and SR. For ground weather stations that do not report SR (such as the NOAA station network), SR from NASA can be used in combination with the reported daily temperature and rainfall. If location-specific, daily weather data are not available, and assuming relatively flat topography typical of many major crop-producing regions, nearby data within 50–100 km would presumably be more appropriate for use in crop models than grid-based data. Use of point-based weather station data to estimate regional and global impact of climate change on food production capacity is challenged, however, by the need to upscale results. Use of agro-climatic zones provides a means to perform this aggregation for upscaling although the required degree of geospatial granularity remains an issue still to be addressed (Wood & Pardey, 1998; Van Wart et al., 2013b).
Also at issue is how to achieve complete terrestrial coverage in global assessments of climate change impact on future food security, which includes regions not currently inhabited or producing crops. Availability of weather data from such regions is sparse at best and often lacking entirely. Use of GWD is the only current option. We therefore propose that global analyses using GWD should be complemented with studies based on upscaling from point-based weather station data for the major centers of current crop production.
Acknowledgments
We thank Dr. K. Christian Kersebaum (Leibniz Centre for Agricultural Landscape Research), the Central Agrometeorological Research Station of the German Weather Service and Dr. Jinshun Bai (China Agricultural University) for providing weather data used in this study. Thanks to Rebecca Davis (USDA-RMA) who provided data on maize crop planting progress for selected counties in the United States. We also thank Dr. Robert Oglesby, Dr. Cynthia Hays, and Dr. Song Feng (University of Nebraska-Lincoln) for their assistance in organizing and extracting gridded weather data.
Supporting Information
Additional Supporting Information may be found in the online version of this article
References
- Allen RG, Pereira LS, Raes D, et al. Crop Evapotranspiration: Guidelines for Computing Crop Water Requirements, FAO Irrigation and Drainage Paper 56. Rome, Italy: Food and Agriculture Organization of the United Nations; 1998. available at: http://www.fao.org/docrep/X0490E/x0490e00.htm (accessed 20 December 2011) [Google Scholar]
- Allen MR, Stott PA, Mitchell JF, et al. Quantifying the uncertainty in forecasts of anthropogenic climate change. Nature. 2000;407:617–620. doi: 10.1038/35036559. [DOI] [PubMed] [Google Scholar]
- Bai J, Chen X, Dobermann A, et al. Evaluation of NASA satellite- and model-derived weather data for simulation of maize yield potential in China. Agronomy Journal. 2010;102:9–16. [Google Scholar]
- Balmford A, Green RE, Scharlemann JPW. Sparing land for nature: exploring the potential impact of changes in agricultural yield on the area needed for crop production. Global Change Biology. 2005;11:1594–1605. [Google Scholar]
- Baron CBS, Balme M, Sarr B, et al. From GCM grid cell to agricultural plot: scale issues affecting modelling of climate impact. Philosophical transactions of the Royal Society of London. Series B, Biological sciences. 2005;360:2095–2108. doi: 10.1098/rstb.2005.1741. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Battisti DS, Naylor RL. Historical warnings of future food insecurity with unprecedented seasonal heat. Science. 2009;323:240–244. doi: 10.1126/science.1164363. [DOI] [PubMed] [Google Scholar]
- Boer EPJ, de Beurs KM, Harkamp AD. Kriging and thin plate splines for mapping climate variables. International Journal of Applied Earth Observation and Geoinformation. 2001;3:146–154. [Google Scholar]
- Bondeau A, Smith PC, Zaehle S, et al. Modelling the role of agriculture for the 20th century global terrestrial carbon balance. Global Change Biology. 2007;13:679–706. [Google Scholar]
- Bouman BAM, van Laar HH. Description and evaluation of the rice growth model ORYZA2000 under nitrogen-limited conditions. Agricultural Systems. 2006;87:249–273. [Google Scholar]
- Bouman BAM, Kropff MJ, Tuong TP, et al. Oryza2000: Modeling Lowland Rice. Los Baños, Philippines: International Rice Research Institute; 2001. [Google Scholar]
- van Bussel LGJ, Muller C, van Keulen H, Ewert F, Leffelaar PA. The effect of temporal aggregation of weather input data on crop growth models’ results. Agricultural and Forest Meteorology. 2011;151:607–619. [Google Scholar]
- Cassman KG, Grassini P, van Wart J. Global food security in a changing climate: crop yield trends and yield potential. In: Rosenzweig C, Hillel D, editors. Handbook of Climate Change and Agroecosystems: Impacts, Adaptation, and Mitigation. London, UK: Imperial College Press; 2010. pp. 37–51. [Google Scholar]
- Chang KT. Introduction to Geographic Information Systems. New York, NY: McGraw Hill; 2009. [Google Scholar]
- China Meterological Association. Tmin, Tmax and Incident Solar Radiation (1990-2008) Beijing, China: National Meteorological Center; 2009. [Google Scholar]
- Ciais P, Gervois S, Vuichard N, et al. Effects of land use change and management on the European cropland carbon balance. Global Change Biology. 2011;17:320–338. [Google Scholar]
- Daly C. Guidelines for assessing the suitability of spatial climate data sets. International Journal of Climatology. 2006;26:707–721. [Google Scholar]
- Draper N, Smith H. Applied Regression Analysis. New York: John Wiley & Sons, Inc; 1981. 2nd edn. [Google Scholar]
- DWD. Tmax, Tmin, Incident Solar Radiation, Relative Humidity, Precipitation and Windspeed (1983-1992) Offenbach, Germany: Deutscher Wetterdienst; 2009. [Google Scholar]
- Evans LT. Crop Evolution, Adaptation and Yield. Cambridge: Cambridge University Press; 1993. [Google Scholar]
- Fischer G, Van Velthuizen H, Shah M, et al. Global Agroecological Assessment for Agriculture in the 21st Century: Methodology and Results. Laxenburg, Austria: International Institute for Applied Systems Analysis; 2002. IIASA Research Report RR-02-02. [Google Scholar]
- Foken T, Nappo CJ. Micrometeorology. Berlin: Springer-Verlag; 2008. [Google Scholar]
- Foley JA, Defries R, Asner GP, et al. Global consequences of land use. Science. 2005;309:570–574. doi: 10.1126/science.1111772. [DOI] [PubMed] [Google Scholar]
- Ghaffari A, Cook HF, Lee HC. Simulating winter wheat yields under temperate conditinos: exploring different management scenarios. European Journal of Agronomy. 2001;15:231–240. [Google Scholar]
- Godfray HCJ, Beddington JR, Crute IR, et al. Food security: the challenge of feeding 9 billion people. Science. 2010;327:812–818. doi: 10.1126/science.1185383. [DOI] [PubMed] [Google Scholar]
- Grassini P, Yang HS, Cassman KG. Limits to maize productivity in Western Corn-Belt: a simulation analysis for fully irrigated and rainfed conditions. Agricultural and Forest Meteorology. 2009;149:1254–1265. [Google Scholar]
- Hartwich R, Behrens J, Eckelmann W, et al. Bodenübersichtskarte der Bundesrepublik Deutschland 1:1 000 000 (BÜK1000) – Erläuterungen und Textlegende (Beiheft zur Karte) Hanover, Germany: Federal Institute for Geosciences and Natural Resources; 1995. [Google Scholar]
- HPRCC. HPRCC Classic Online Services Weather Data Retrieval System. Lincoln, NE, USA: High Plains Regional Climate Center, University of Nebraska; 2011. [Google Scholar]
- Hubbard KG, Goddard S, Sorensen WD, et al. Performance of quality assurance procedures for an Applied Climate Information System. Journal of Atmospheric and Oceanic Technology. 2005;22:105–112. [Google Scholar]
- Hubbard KG, Guttman NB, You J, et al. An improved QC process for temperature in the daily cooperative weather observations. Journal of Atmospheric and Oceanic Technology. 2007;24:206–213. [Google Scholar]
- Hutchinson MF. Interpolating mean rainfall using thin plate smoothing splines. International Journal of Geographical Information Systems. 1995;9:385–403. [Google Scholar]
- IPCC. Climate Change 2007: Impacts, Adaptation and Vulnerability. Contribution of Working Group II to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge, UK: Cambridge University Press; 2007. [Google Scholar]
- Jones JW, Hoogenboom G, Porter CH, et al. The DSSAT cropping system model. European Journal of Agronomy. 2003;18:235–265. [Google Scholar]
- Kalnay E, Kanamitsu M, Kistler R, et al. The NCEP/NCAR 40-year reanalysis project. Bulletin of the American Meteorological Society. 1996;77:437–471. [Google Scholar]
- Kanamitsu M, Ebisuzaki W, Woolen J, et al. NCEP–DOE AMIP-II REANALYSIS (R-2) Bulletin of the American Meteorological Society. 2002;83:1631–1643. [Google Scholar]
- Licker R, Johnston M, Foley JA, et al. Mind the gap: how do climate and agricultural management explain the ‘yield gap’ of croplands around the world. Global Ecology and Biogegraphy. 2010;19:769–782. [Google Scholar]
- Liu J, Williams JR, Wang X, et al. Using MODAWEC to generate daily weather data for the EPIC model. Environmental Modelling and Software. 2009;24:655–664. [Google Scholar]
- Lobell D. Changes in diurnal temperature range and national cereal yields. Agricultural and Forest Meteorology. 2007;145:229–238. [Google Scholar]
- Lobell DB, Asner GP. Climate and management contributions to recent trends in U.S. agricultural yields. Science. 2003;299:1032. doi: 10.1126/science.1078475. [DOI] [PubMed] [Google Scholar]
- Lobell DB, Burke MB, Tebaldi C, et al. Prioritizing climate change adaptation needs for food security in 2030. Science. 2008;319:607–610. doi: 10.1126/science.1152339. [DOI] [PubMed] [Google Scholar]
- Lobell DB, Ortiz-Monasterio JI, Lee AS. Satellite evidence for yield growth opportunities in Northwest India. Field Crops Research. 2010;118:13–20. [Google Scholar]
- Lobell DB, Schlenker W, Costa-Roberts J. Climate trends and global crop production since 1980. Science. 2011;333:616–620. doi: 10.1126/science.1204531. [DOI] [PubMed] [Google Scholar]
- Masson D, Knutti R. Spatial-scale dependence of climate model performance in the CMIP3 ensemble. Journal of Climate. 2011;24:2680–2692. [Google Scholar]
- Mearns LO, Easterling W, Hays C, et al. Comparison of agricultural impacts of climate change calculated from high and low resolution climate change scenarios: part I. The uncertainty due to spatial scale. Climate Change. 2001;51:131–172. [Google Scholar]
- Mitchell TD, Jones PD. Mitchell and Jones, 2005: an improved method of constructing a database of monthly climate observations and associated high-resolution grids. International Journal of Climatology. 2005;25:693–712. [Google Scholar]
- NCDC. Global Historical Climatology Network-Daily. National Oceanic and Aerospace Administration-National Climatic Data Center (NOAA-NCDC) Asheville, NC: 2011. Available at: http://www.ncdc.noaa.gov/oa/climate/ghcn-daily/ (accessed 20 September 2012) [Google Scholar]
- Nelson GC, Rosegrant MW, Palazzo A, et al. Food Security, Farming and Climate Change to 2050. Washington, DC: International Food Policy Research Institute; 2010. [Google Scholar]
- Nemani RR, Keeling CD, Hashimoto H, et al. Climate-driven increases in global terrestrial net primary production from 1982 to 1999. Science. 2003;300:1560–1563. doi: 10.1126/science.1082750. [DOI] [PubMed] [Google Scholar]
- New M, Lister D, Hulme M, et al. A high-resolution data set of surface climate over global land areas. Climate Research 21. Climate Research. 2002;21:1–25. [Google Scholar]
- Oreskes N. Beyond the ivory tower. The scientific consensus on climate change. Science. 2004;306:1686. doi: 10.1126/science.1103618. [DOI] [PubMed] [Google Scholar]
- Ortiz R, Sayre KD, Govaerts B, et al. Climate change: can wheat beat the heat? Agriculture, Ecosystems and the Environment. 2008;126:46–58. [Google Scholar]
- Peng S, Huang J, Sheehy JE, et al. Rice yields decline with higher night temperature from global warming. Proceedings of the National Academy of Sciences of the United States of America. 2004;101:9971–9975. doi: 10.1073/pnas.0403720101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ramirez-Villegas J, Challinor A. Assessing relevant climate data for agricultural applications. Agricultural and Forest Meteorology. 2012;161:26–45. [Google Scholar]
- Ritchie JT, Godwin DC, Otter-Nacke S. CERES-Wheat. Austin, TX: University of Texas Press; 1988. [Google Scholar]
- RMA. Maize Planting Progress by County. United States Department of Agriculture, Risk Management Agency; 2010. Available at: http://www.rma.usda.gov/ (accessed 20 September 2012) [Google Scholar]
- Rosenzweig C, Parry ML. Potential impact of climate change on world food supply. Nature. 1994;367:133–138. [Google Scholar]
- Rötter RP. Germany: University of Trier; 1993. Simulation of the biophysical limitations to maize production under rainfed conditions in Kenya: evaluation and application of the model WOFOST. PhD Thesis. [Google Scholar]
- Schlenker W, Roberts MJ. Nonlinear temperature effects indicate severe damages to U.S. crop yields under climate change. Proceedings of the National Academy of Sciences of the United States of America. 2009;106:15594–15598. doi: 10.1073/pnas.0906865106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schmidhuber J, Tubiello FN. Global food security under climate change. Proceedings of the National Academy of Sciences of the United States of America. 2007;104:19703–19708. doi: 10.1073/pnas.0701976104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sinclair TR, Rawlins SL. Intraseasonal variation in soybean and maize yields under global environmental change. Agronomy Journal. 1993;85:406–409. [Google Scholar]
- Tubiello FN, Soussana JF, Howden SM. Crop and pasture response to climate change. Proceedings of the National Academy of Sciences of the United States of America. 2007;104:19686–19690. doi: 10.1073/pnas.0701728104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Twine TE, Kucharik CJ. Climate impacts on net primary productivity trends in natural and managed ecosystems of the central and eastern United States. Agricultural and Forest Meteorology. 2009;149:2143–2163. [Google Scholar]
- USDA National Agricultural Statistics Service Cropland Data Layer. Published crop-specific data layer [Online] Washington, DC: USDA-NASS; 2009. Available at http://nassgeodata.gmu.edu/CropScape / (accessed December 2011) [Google Scholar]
- USDA-NRCS (U.S. Department of Agriculture-Natural Resources Conservation Service) Soil Survey Geographic (SSURGO) Data Base: Data Use Information. Fort Worth, Texas: National Cartography and GIS Center; 1995. [Google Scholar]
- Van Wart J, Kersebaum KC, Peng S, Milner M, Cassman KG. A protocol for estimating crop yield potential at regional to national scales. Field Crops Research. 2013a;143:34–43. [Google Scholar]
- Van Wart J, van Bussel LGJ, Wolf J, et al. Use of agro-climatic zones to upscale simulated crop yield potential. Field Crops Research. 2013b;143:44–55. [Google Scholar]
- Wang YP, Connor DJ. Simulation of optimal development for spring wheat at two locations in southern Australia under present and changed climate conditions. Agricultural and Forest Meteorology. 1996;79:9–28. [Google Scholar]
- White JW, Hoogenboom G, Kimball BA, et al. Methodologies for simulating impacts of climate change on crop production. Field Crops Research. 2011;124:357–368. [Google Scholar]
- White JW, Hoogenboom G, Wilkens PW, et al. Evaluation of satellite-Based, modeled-derived daily solar radiation data for the continental United States. Agronomy Journal. 2011b;103:1242–1251. [Google Scholar]
- de Wit A, Baruth B, Boogaard H, et al. Using ERA-INTERIM for regional crop yield forecasting in Europe. Climate Research. 2010;44:41–53. [Google Scholar]
- Wood S, Pardey PG. Agroecological aspects of evaluating agricultural R and D. Agricultural Systems. 1998;57:13–41. [Google Scholar]
- Yang HS, Doberman A, Lindquist JL, et al. Hybrid-maize-a maize simulation model that combines two crop modeling approaches. Field Crops Research. 2004;87:131–154. [Google Scholar]
- You J, Hubbard KG, Goddard S. Comparison of Methods for Spatially Estimating Station Temperatures in a Quality Control System. International Journal of Climatology. 2008;28:777–787. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.