Skip to main content
Wiley - PMC COVID-19 Collection logoLink to Wiley - PMC COVID-19 Collection
letter
. 2021 Feb 12;48(4):e2020GL090699. doi: 10.1029/2020GL090699

The Impact of COVID‐19 on Weather Forecasts: A Balanced View

Bruce Ingleby 1,, Brett Candy 2, John Eyre 2, Thomas Haiden 1, Christopher Hill 3,4, Lars Isaksen 1, Daryl Kleist 3, Fiona Smith 5, Peter Steinle 5, Stewart Taylor 2,6, Warren Tennant 2, Christopher Tingwell 5
PMCID: PMC7883092  PMID: 33612881

Abstract

Aircraft reports are an important source of information for numerical weather prediction (NWP). From March 2020, the COVID‐19 pandemic resulted in a large loss of aircraft data but despite this it is difficult to see any evidence of significant degradation in the forecast skill of global NWP systems. This apparent discrepancy is partly because forecast skill is very variable, showing both day‐to‐day noise and lower frequency dependence on the mean state of the atmosphere. The definitive way to cleanly assess aircraft impact is using a data denial experiment, which shows that the largest impact is in the upper troposphere. The method used by Chen (2020, https://doi.org/10.1029/2020gl088613) to estimate the impact of COVID‐19 is oversimplistic. Chen understates the huge importance of satellite data for modern weather forecasts and raises more alarm than necessary about a drop in forecast accuracy.

Keywords: aircraft data, COVID‐19, data assimilation, numerical weather prediction, observation impact, satellite data

Key Points

  • Aircraft meteorological observations have been badly affected by the pandemic but satellite observations have continued unaffected

  • Tests show that the largest impact of aircraft observations is at 10–12 km altitude at short range

  • There is no obvious degradation of forecast accuracy in 2020; variations in predictability and addition of other observations play a role

1. Introduction

To put matters into context, we briefly describe the way that global weather forecasting is improving over time (Section 2). Part of the improvement has come from more and better observations. The year 2020 saw a large decrease in aircraft observations but also increases in satellite observations (Section 3). This paper is in part a response to Chen (2020), which the authors regard as flawed in some respects. Our reasons are that observation impacts can best be quantified through denial studies (Section 4), and that interannual variability of forecast skill (Section 5) complicates the comparison of the 2020 performance with previous years. We discuss previous publications on the subject (Section 6) and finish with conclusions (Section 7). More details about aircraft data and a “no aircraft” study from a different forecast center can be found in the supporting information.

2. Context: The Success of Global Weather Forecasting

Bauer et al. (2015) describe “the quiet revolution” of numerical weather prediction (NWP) improving forecasts such that useful skill is retained one more day into the forecast range for every decade of research and development. This is illustrated in their Figure 1, but even this smoothed time series hints at fluctuations in skill as a result of variations in predictability. One component of NWP is the data assimilation system which combines a previous forecast with information from the latest observations to create an “analysis”, a set of fields that forms the initial conditions for the next forecast.

Figure 1.

Figure 1

(a) Number of aircraft wind reports processed (black) and used (blue) at ECMWF—excluding Mode‐S, green line shows the number of used Mode‐S winds. The vertical lines show the dates used in (b) and (c). (b) and (c) Positions of used aircraft reports in a 12‐h period (09‐21 UTC) on 2020‐03‐04 and 2020‐04‐29, respectively.

Magnusson and Källén (2013) note that improvements in NWP skill arise from model changes, improved data assimilation methods and new observations. They showed that over the period 1980–2012 new/improved observations gave less forecast improvement than model or assimilation changes. However, improved observing systems are still important. Meteorological satellite data started to become available in the late 1970s and since then there has been a reasonably comprehensive global observing system. Satellite data have become a dominant factor in forecast skill—before 1979 skill in the southern hemisphere, where relatively few in situ observations are available, was significantly worse than in the northern hemisphere, but satellite data closed this gap whilst still improving the northern hemisphere (Uppala et al., 2005).

In this paper, the results and figures presented from the European Centre for Medium‐Range Weather Forecasts (ECMWF) are broadly representative of those seen at other global NWP centers, including the Met Office, Bureau of Meteorology and the National Centers for Environmental Prediction (NCEP).

3. The Effect of COVID‐19 on Aircraft Reports and Other Observing System Changes

Many aircraft reports are provided via the AMDAR program (Petersen, 2016), coordinated by the World Meteorological Organisation (WMO). Commercial aircraft measure wind and temperature for their own needs and a small fraction of these are provided to the weather forecasting community. A subset of aircraft also reports humidity observations. COVID‐19 caused some reductions in Chinese aircraft reports earlier, but the main decrease in numbers started in mid‐March 2020 (Figure 1a: there is also a weekly cycle with a minimum number on Sundays). In February and early March 2020, ECMWF was using about 600,000 aircraft reports per day (Figure 1b). There was a minimum in the second half of April—just under 150,000 reports per day (75% decrease)—as shown in Figure 1c, where some oceanic areas look particularly sparse. By late July, numbers had recovered to about 47% of the February values but there was a slight decline in August. Over Europe, the number of aircraft flights decreased more than the number of AMDARs because the data provider only selects some of the possible observations (such as one profile per airport per 3 h). A small proportion of reports come from cargo flights and these decreased less or even increased.

There were reductions in surface and radiosonde (balloon) reports in some areas, although within Europe there were extra radiosonde profiles from some stations until the end of August—to mitigate the loss of aircraft data. The commercial company FLYHT offered their aircraft data free of charge during the hiatus and some NWP centers are using these although the number of extra observations is relatively small. In late July, ECMWF started using Mode‐S aircraft winds over Europe which are an updated/expanded version of the observations described by de Haan (2011)—and locally very dense (green line in Figure 1a.). In October/November, the number of reports over Europe decreased again—as can be seen for Mode‐S (the increase of Mode‐S in late August comes from the use of a more complete data stream).

Satellite operations were largely unaffected, which is fortunate given the importance of satellite data for NWP, and, as usual, some new data streams became available. In January 2020, ECMWF started assimilating wind data from a novel lidar instrument on Aeolus, its main impact on forecasts is in the tropics and southern hemisphere—where wind information is sparse (ECMWF, 2020). In March, ECMWF started to use satellite radio occultation measurements from the COSMIC‐2 mission (Schreiner et al., 2020) and in mid‐May occultation measurements from the Spire company which were being made available during the hiatus. Although different global NWP systems process largely the same set of observations there are some differences in the sources of observations used and the thinning/data selection applied. All centers represented by the authors have reinforced their global observing system with the introduction of new observations during 2019/2020.

One estimate of the relative impact of different sets of observations is given by Forecast Sensitivity to Observation Impact (FSOI, Cardinali, 2009; Langland & Baker, 2004). In early 2020, aircraft provided about 13% of the total ECMWF FSOI but by April it had fallen to about 4%. With the increased numbers of observations, the FSOI from radio occultation has increased from about 4% to over 12% by June. ECMWF FSOI for all satellite data was about 74% in 2019. The calculation of FSOI involves approximations and a single measure of forecast skill. Different NWP systems will rank aircraft data slightly differently and some centers show a stronger dependence on satellite observations than others.

Table 1 summarizes the main observing systems used by global NWP, one of the points to note is that different systems have different strengths and weaknesses. For example, some measurements need bias correction whereas others act as “anchor observations” (Eyre, 2016).

Table 1.

Simplified Description of Main Observing Systems Used for Global NWP

System Variables/advantages Caveats/notes
Satellite
Microwave (MW) and Infrared (IR) sounders Temperature and humidity, also sea surface temperature Limited (IR) or very limited (MW) vertical resolution
Near global IR cannot see through clouds
MW can see through clouds Need bias correction
Difficult to use at low levels over ice/snow
Atmospheric motion vectors (AMVs) Winds Some areas/levels hardly sampled
Widespread Height assignment difficult
Radio occultation High resolution profiles of refractivity Information on temperature in the stratosphere and upper troposphere; information on humidity in the lower troposphere.
Near global
Does not need bias correction
Scatterometer Ocean surface winds Direction ambiguity
Semiempirical calibration
Microwave imagers Total column water vapor (TCWV), sea ice TCWV used over oceans
Doppler wind lidar Line‐of‐sight wind profiles Single component of wind
Prototype needs bias correction
In situ
Aircraft Wind, temperature and some humidities Very uneven distribution
Locally high density Temperatures need bias correction
Radiosondes Wind, temperature, and humidity profiles Poor spatial and time distribution (often 2/day)
High vertical resolution Upper level humidity measurement is difficult
Closest to reference measurements
Surface Pressure (most important), temperature, humidity, wind, sea surface temperature, snow depth Sparse over oceans and some deserts
Locally high density Local effects can make some measurements unrepresentative of wider area

4. “NoAircraft” Studies

The use of aircraft in the ECMWF assimilation system is described in Cardinali et al. (2003) and Ingleby et al. (2019). It includes the correction of aircraft temperature biases similar to that of Zhu et al. (2015). In 2019, an observing system experiment (OSE) or “data denial test” was run at ECMWF for the period January 28 to April 30, 2019: a Control using all observations was compared with a NoAircraft experiment without aircraft data, but otherwise the same. Figure 2a shows that the biggest impact is in the northern hemisphere at 250–200 hPa (about 11–12 km in height), which would be expected as most reports are delivered from typical aircraft cruising altitudes. Figures 2b and 2c show results comparing the 12‐h forecasts to radiosonde temperatures and winds for the NoAircraft experiment and another experiment removing only aircraft temperature observations (NoAircraftT).

Figure 2.

Figure 2

Impact of aircraft data on ECMWF forecasts. (a) The difference in vector wind root‐mean‐square (RMS) error between forecasts with and without aircraft observations, verified against ECMWF operational analyses. Yellow/red colors indicate worse forecasts without aircraft reports, and hatching indicates statistically significant differences at the 95% confidence level. The largest impacts are in the range up to 24‐h ahead, but a significant impact is seen in forecasts up to 7 days ahead (only selected ranges shown). (b) and (c) The impact on 12‐h forecast fit to (b) radiosonde temperature and (c) radiosonde wind, for latitudes 20°N‐90°N. The black line is for the NoAircraft experiment (as above), the red line is for an experiment without aircraft temperature—both normalized by control values. The horizontal bars show 95% confidence intervals.

Care is needed in interpreting verification against analyses especially at short range (discussed below), but the NoAircraft forecasts also verified respectively 12% and 9% worse at 250 hPa against radiosonde winds and temperatures for 20°N‐90°N, confirming the signal of strongest impact at this height. The NoAircraftT experiment reveals that most of the impact comes from aircraft winds rather than the temperatures. The NoAircraft impact at the surface is small at short range. Aviation is also a major user of short‐range upper tropospheric forecasts, both for safety and efficiency. Head and tail winds affect the time taken for a particular flight and, based on the short‐range wind forecast, the amount of fuel taken on board is tailored to the expected conditions.

Met Office OSEs for 90 days from August 15, 2019 (see supporting information) show a similarly large impact from aircraft data around 250 hPa at short range, decreasing over time. The effect on the position forecasts of tropical cyclones (TCs, also known as hurricanes) was also examined with the NoAircraft forecasts being very similar at most ranges but slightly worse at longer forecast ranges (position errors 2.5% worse at 6‐days range, but this was not statistically significant). TCs extend throughout the troposphere, although the winds are strongest in the lower troposphere. Commercial aircraft (at upper levels over the ocean) will tend to fly around the convective activity, thus it seems likely that their impact on short‐range TC forecasts will be relatively small. There will have some impact on TC track forecasts in the medium‐range, but satellite data are probably more important (e.g., McNally et al., 2014).

Drawing on a range of studies Sato and Riishojgaard (2016) noted aircraft data as being amongst the five most important observing systems contributing to global NWP (the others being microwave sounders, hyperspectral infrared sounders, radiosondes, and atmospheric motion vectors). As discussed in Section 3 radio occultations have become more important in 2020.

5. Verification Scores in 2020 Versus Previous Years

All forecast centers regularly verify their forecasts by comparing them to estimates of the truth: verification for 2020 is examined and compared to previous years to see if there is any clear signal from the loss of aircraft data. The truth estimates can be from observations or analysis fields and various performance measures are computed (see https://www.cawcr.gov.au/projects/verification/). Recent ECMWF performance is shown in Haiden et al. (2019), also online under https://www.ecmwf.int/en/forecasts/charts. At short‐range (1 or 2 days) verification is particularly dependent on the choice of reference, see Figure 3 of Lawrence et al. (2019). Analysis error can sometimes be correlated with short‐range forecast error. Observation error can usually be considered independent, but the effective sample size is smaller and radiosonde coverage over the oceans and in the Southern Hemisphere is poor. Because of the noise in verification scores very long experiments are needed to establish statistical significance for modest changes (Geer, 2016). The issues with noise and statistical significance are even more pronounced for smaller verification areas. Centers verify both deterministic and probability forecasts for a large range of variables, and 500 hPa geopotential height is often used to emphasize large‐scale pattern impacts. Surface temperature and precipitation fields contain smaller scale features and are more difficult to analyze and predict accurately. Thus it is more difficult to obtain statistically stable results for these fields.

Figure 3.

Figure 3

Verification of operational ECMWF 24‐h wind forecasts for 20°N‐90°N against analyses at three levels for 2018 (bottom), 2019 (middle), and 2020 (top). The thin lines show values every 12 h, the thick lines a 7‐day running mean.

Given the results in Figure 2, we expect to see the largest impact in the upper troposphere and short‐range forecasts and so Figure 3 shows time series of wind errors for ECMWF 1‐day forecasts including 250 hPa—keeping the above mentioned limitations of short‐range forecast verification with analyses in mind. The errors are larger at 250 hPa than the other levels shown, because this corresponds approximately to the mid‐latitude jet stream. There is no jump in March 2020 that can be associated with the drop in aircraft numbers but there is considerable day‐to‐day variation and some indications of part of a seasonal cycle.

Standard forecast verification scores from eight different NWP centers are shown in Figure 4: a seasonal cycle can be clearly seen as can some indication of a downward trend over time. Summer 2019 was unusually predictable (more apparent in the high values of anomaly correlation). This may have been due to a strong negative North Atlantic Oscillation (NAO) index (see https://www.cpc.ncep.noaa.gov/products/precip/CWlink/pna/month_nao_index.shtml). There is some evidence, mainly for the boreal winter, that negative NAO is linked to higher predictability (Ferranti et al., 2015; Langland & Maue, 2012), its role in spring/summer 2019 is somewhat speculative. It is also useful to compare with results from a reanalysis, such as ERA5 (Hersbach et al., 2020)—see supporting information.

Figure 4.

Figure 4

Verification of 3‐day 00 UTC forecasts of 500 hPa geopotential height against their own analyses. Top root‐mean‐square, bottom anomaly correlation (small/large values are “good,” respectively). DWD: Deutscher Wetterdienst (Germany), NCEP: National Centers for Environmental Prediction (USA), UKMO: Met Office (UK), KMA: Korea Meteorological Administration, BoM: Bureau of Meteorology (Australia), CMC: Canadian Meteorological Center, JMA: Japan Meteorological Administration.

Most importantly, these time series show that forecast skill in spring 2020 did not fall outside the range of values seen for the same season in previous years. We do not claim that the loss of aircraft observations due to COVID‐19 has no effect, only that the signal is too small to be statistically detectable by a simple comparison of forecast skill in 1 or 2 months of 2020 against the skill of previous years.

6. Discussion

Using a regional forecast system, James and Benjamin (2017) report that aircraft are the most important observing system over North America. In an updated study, James et al. (2020) found that removing 80% of the aircraft data gave less than 80% of the impact of removing all the aircraft data (the boundary conditions came from a global forecast system using all aircraft data, this would have a small effect at short range). We expect a slight reduction in the impact per observation as data density increases and this is also seen for other observation types (e.g., Poli et al., 2008).

Chen (2020) is entitled “COVID‐19 pandemic imperils weather forecast”—perhaps overdramatic. Given the variation of forecast skill on various timescales we regard the comparison of skill from different periods to infer aircraft impact as used by Chen as oversimplistic. There is no evidence that the “signal” calculated by Chen is specifically due to COVID‐related reductions to aircraft reports, rather than a consequence of interannual variations in predictability. One complicating factor is that spring/summer 2019 was unusually predictable as discussed above. Chen compared NCEP Global Forecast System (GFS) forecasts with corresponding Global Data Assimilation System (GDAS) analyses. For completeness, we note that the GFS underwent a major upgrade in June 2019 (https://www.noaa.gov/media-release/noaa-upgrades-us-global-weather-forecast-model) and that the analyses would not usually be called reanalyzes as Chen does (the GDAS changes from year to year whereas a reanalysis system uses the same system for a multiyear or multidecade period).

Observation impacts tend to be largest at short range and decrease with forecast range (e.g., Figure 2a above; Lawrence et al., 2019) whereas Chen suggests that the impact increases with forecast range—his results are more suggestive of predictability than of observation changes. He only shows surface fields even though the largest impact of aircraft data is in the upper troposphere.

Finally, Chen understates the huge role that satellite data plays in modern NWP (“cloud properties from satellites are important for rainfall forecasts”): satellite data provide near‐global coverage with information predominantly on temperature and humidity, with less but still substantial information on wind.

7. Conclusions

Aircraft reports suffered a 75% decline in numbers from mid‐March to mid‐April 2020; in May the number started increasing again. Despite the loss of data there is no clear signal in the forecast skill—partly because the skill shows considerable variability on daily, seasonal, and interannual timescales (Figures 3 and 4). However, aircraft reports have been shown via a range of evaluation measures to be important for NWP: from data denial studies run using 2019 data we are confident that short‐range forecast skill would have been higher in March to July 2020 with a “normal” number of aircraft reports—especially in the upper troposphere. It should be emphasized that a denial study is the worst‐case scenario, whereas during the COVID‐19 pandemic we did still receive at least 25% of aircraft observations, which probably gave more than 25% of the “normal” aircraft impact (see Section 6). Locally some areas did experience a complete loss of aircraft observations.

Observation coverage can fluctuate for several reasons, for example a satellite or an instrument can fail. Maintaining the breadth of the global observing system helps to improve the robustness of weather forecasts. Aircraft form one of about six leading observing systems that contribute most to global NWP. Different observing systems have different strengths and weaknesses (Table 1). At short‐range aircraft are the largest contributor to forecast skill over North America (James & Benjamin, 2017). Prior to the pandemic there were plans for increased aircraft reports via a collaboration between the International Air Transport Association and WMO and other sources like Mode‐S and third‐party data: such extra aircraft reports will be a welcome contribution and will likely contribute to improved forecast skill.

Overall, we can find no evidence that the decrease in aircraft observations has handicapped numerical forecasts of extreme weather to an extent large enough to incur significant economic impact.

Supporting information

Supporting Information S1

Acknowledgments

At ECMWF Mohamed Dahoui and Martin Janousek helped with monitoring and verification aspects, Hans Hersbach and Iain Russell helped with Figure S1.

Ingleby, B. , Candy, B. , Eyre, J. , Haiden, T. , Hill, C. , Isaksen, L. , et al. (2021). The impact of COVID‐19 on weather forecasts: A balanced view. Geophysical Research Letters, 48, e2020GL090699 10.1029/2020GL090699

Data Availability Statement

Verification scores from multiple NWP centers calculated according to WMO recommendations are available from https://apps.ecmwf.int/wmolcdnv/. Operational analysis and forecast data from 12 global NWP centers are available from https://confluence.ecmwf.int/display/TIGGE. To access ERA5 reanalysis fields see https://confluence.ecmwf.int/display/CKB/How+to+download+ERA5. Observations (GDAS Daily BUFR Files) are available from https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/global-data-assimilation-system-gdas.

References

  1. Bauer, P. , Thorpe, A. , & Brunet, G. (2015). The quiet revolution of numerical weather prediction. Nature, 525, 47–55. 10.1038/nature14956 [DOI] [PubMed] [Google Scholar]
  2. Cardinali, C. (2009). Monitoring the observation impact on the short‐range forecast. Quarterly Journal of the Royal Meteorological Society, 135, 239–250. 10.1002/qj.366 [DOI] [Google Scholar]
  3. Cardinali, C. , Isaksen, L. , & Anderson, E. (2003). Use and impact of automated aircraft data in a global 4DVAR data assimilation system. Monthly Weather Review, 131, 1865–1877. [Google Scholar]
  4. Chen, Y. (2020). COVID‐19 pandemic imperils weather forecast. Geophysical Research Letters, 47, e2020GL088613 10.1029/2020GL088613 [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. de Haan, S. (2011). High‐resolution wind and temperature observations from aircraft tracked by Mode‐S air traffic control radar. Journal of Geophysical Research, 116, D10111 10.1029/2010JD015264 [DOI] [Google Scholar]
  6. ECMWF . (2020). ECMWF starts assimilating Aeolus wind data. Retrieved from https://www.ecmwf.int/en/about/media-centre/news/2020/ecmwf-starts-assimilating-aeolus-wind-data [Google Scholar]
  7. Eyre, J. R. (2016). Observation bias correction schemes in data assimilation systems: A theoretical study of some of their properties. Quarterly Journal of the Royal Meteorological Society, 142, 2284–2291. 10.1002/qj.2819 [DOI] [Google Scholar]
  8. Ferranti, L. , Corti, S. , & Janousek, M. (2015). Flow‐dependent verification of the ECMWF ensemble over the Euro‐Atlantic sector. Quarterly Journal of the Royal Meteorological Society, 141, 916–924. 10.1002/qj.2411 [DOI] [Google Scholar]
  9. Geer, A. J. (2016). Significance of changes in medium‐range forecast scores. Tellus A: Dynamic Meteorology and Oceanography, 68(1), 30229. [Google Scholar]
  10. Haiden, T. , Janousek, M. , Vitart, F. , Ferranti, L. , & Prates, F. (2019). Evaluation of ECMWF forecasts, including the 2019 upgrade ECMWF Technical Memorandum 835. Retrieved from https://www.ecmwf.int/en/publications
  11. Hersbach, H. , Bell, B. , Berrisford, P. , Hirahara, S. , Horányi, A. , Muñoz‐Sabater, J. , et al. (2020). The ERA5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146, 1999–2049. 10.1002/qj.3803 [DOI] [Google Scholar]
  12. Ingleby, B. , Isaksen, L. , & Kral, T. (2019). Evaluation and impact of aircraft humidity data in ECMWF's NWP system ECMWF Technical Memorandum 855. Retrieved from https://www.ecmwf.int/en/publications
  13. James, E. P. , & Benjamin, S. G. (2017). Observation system experiments with the hourly updating Rapid Refresh Model using GSI hybrid ensemble‐variational data assimilation. Monthly Weather Review, 145, 2897–2918. 10.1175/MWR-D-16-0398.1 [DOI] [Google Scholar]
  14. James, E. P. , Benjamin, S. G. , & Jamison, B. D. (2020). Commercial‐aircraft‐based observations for NWP: Global coverage, data impacts, and COVID‐19. Journal of Applied Meteorology and Climatology, 59, 1809–1825. 10.1175/JAMC-D-20-0010.1 [DOI] [Google Scholar]
  15. Langland, R. H. , & Baker, N. L. (2004). Estimation of observation impact using the NRL atmospheric variational data assimilation adjoint system. Tellus A: Dynamic Meteorology and Oceanography, 56(3), 189–201. 10.3402/tellusa.v56i3.14413 [DOI] [Google Scholar]
  16. Langland, R. H. , & Maue, R. N. (2012). Recent Northern Hemisphere mid‐latitude medium‐range deterministic forecast skill. Tellus A: Dynamic Meteorology and Oceanography, 64(1). 10.3402/tellusa.v64i0.17531 [DOI] [Google Scholar]
  17. Lawrence, H. , Bormann, N. , Sandu, I. , Day, J. , Farnan, J. , & Bauer, P. (2019). Use and impact of Arctic observations in the ECMWF Numerical Weather Prediction system. Quarterly Journal of the Royal Meteorological Society, 145, 3432–3454. 10.1002/qj.3628 [DOI] [Google Scholar]
  18. Magnusson, L. , & Källén, E. (2013). Factors influencing skill improvements in the ECMWF forecasting system. Monthly Weather Review, 141, 3142–3153 10.1175/MWR-D-12-00318.1 [DOI] [Google Scholar]
  19. McNally, T. , Bonavita, M. , & Thépaut, J.‐N. (2014). The role of satellite data in the forecasting of Hurricane Sandy. Monthly Weather Review, 142(2), 634–646. 10.1175/MWR-D-13-00170.1 [DOI] [Google Scholar]
  20. Petersen, R. (2016). On the impact and benefits of AMDAR observations in operational forecasting – Part 1: A review of the impact of automated aircraft wind and temperature reports. Bulletin of the American Meteorological Society, 97, 585–602. 10.1175/BAMS-D-14-00055.1 [DOI] [Google Scholar]
  21. Poli, P. , Healy, S. B. , Rabier, F. , & Pailleux, J. (2008). Preliminary assessment of the scalability of GPS radio occultations impact in numerical weather prediction. Geophysical Research Letters, 35, L23811 10.1029/2008GL035873 [DOI] [Google Scholar]
  22. Sato, Y. , & Riishojgaard, L. P. (2016). Report of the Sixth WMO Workshop on the impact of various observing systems on numerical weather prediction, Shanghai, China. Retrieved from https://community.wmo.int/wigos-events-and-reports [Google Scholar]
  23. Schreiner, W. S. , Weiss, J. P. , Anthes, R. A. , Braun, J. , Chu, V. , Fong, J. , et al. (2020). COSMIC‐2 radio occultation constellation: First results. Geophysical Research Letters, 47, e2019GL086841 10.1029/2019GL086841 [DOI] [Google Scholar]
  24. Uppala, S. M. , Kållberg, P. W. , Simmons, A. J. , Andrae, U. , Bechtold, V. D. C. , Fiorino, M. , et al. (2005). The ERA‐40 re‐analysis. Quarterly Journal of the Royal Meteorological Society, 131, 2961–3012. 10.1256/qj.04.176 [DOI] [Google Scholar]
  25. Zhu, Y. , Derber, J. , Purser, R. , Ballish, R. , & Whiting, J. (2015). Variational correction of aircraft temperature bias in the NCEP's GSI analysis system. Monthly Weather Review, 143, 3774–3803. 10.1175/MWR-D-14-00235.1 [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supporting Information S1

Data Availability Statement

Verification scores from multiple NWP centers calculated according to WMO recommendations are available from https://apps.ecmwf.int/wmolcdnv/. Operational analysis and forecast data from 12 global NWP centers are available from https://confluence.ecmwf.int/display/TIGGE. To access ERA5 reanalysis fields see https://confluence.ecmwf.int/display/CKB/How+to+download+ERA5. Observations (GDAS Daily BUFR Files) are available from https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/global-data-assimilation-system-gdas.


Articles from Geophysical Research Letters are provided here courtesy of Wiley

RESOURCES