Skip to main content
PMC home page
Scientific Data logoLink to Scientific Data
. 2021 Jul 12;8:170. doi: 10.1038/s41597-021-00964-1

Global soil moisture data derived through machine learning trained with in-situ measurements

Sungmin O 1,✉, Rene Orth 1
PMCID: PMC8275613  PMID: 34253737

Abstract

While soil moisture information is essential for a wide range of hydrologic and climate applications, spatially-continuous soil moisture data is only available from satellite observations or model simulations. Here we present a global, long-term dataset of soil moisture derived through machine learning trained with in-situ measurements, SoMo.ml. We train a Long Short-Term Memory (LSTM) model to extrapolate daily soil moisture dynamics in space and in time, based on in-situ data collected from more than 1,000 stations across the globe. SoMo.ml provides multi-layer soil moisture data (0–10 cm, 10–30 cm, and 30–50 cm) at 0.25° spatial and daily temporal resolution over the period 2000–2019. The performance of the resulting dataset is evaluated through cross validation and inter-comparison with existing soil moisture datasets. SoMo.ml performs especially well in terms of temporal dynamics, making it particularly useful for applications requiring time-varying soil moisture, such as anomaly detection and memory analyses. SoMo.ml complements the existing suite of modelled and satellite-based datasets given its distinct derivation, to support large-scale hydrological, meteorological, and ecological analyses.

Subject terms: Hydrology, Hydrology

Measurement(s) wetness of soil
Technology Type(s) machine learning
Factor Type(s) soil layer • temporal interval • geographic location
Sample Characteristic - Environment soil
Open in a new tab

Machine-accessible metadata file describing the reported data: 10.6084/m9.figshare.14790510

Background & Summary

Soil moisture plays a key role in land-atmosphere interactions through its control on water, energy, and carbon cycles1,2. Weather and climate variations are mediated by the soil moisture status3–6. Therefore, the spatiotemporal variations of soil moisture can influence the development and the persistence of extreme weather events such as heat waves, droughts, floods, and fires7–11. For these reasons, soil moisture information is required to support a wide range of research and applications, e.g. agricultural monitoring, flood and drought prediction, climate projections, and carbon cycle modelling12. Consequently, soil moisture is recognised as an Essential Climate Variable by the Global Climate Observing System13.

Despite its scientific and societal importance, large-scale long-term observations of soil moisture are scarce. There is a significant number of in-situ soil moisture measurement networks14, but they are not uniformly distributed. Satellite observations allow the derivation of global-scale soil moisture estimates; however, they represent only the top few centimetres of the soil. Moreover, satellite retrievals in areas with complex topography, dense vegetation, and frozen or snow-covered soils are challenging, leading to data gaps15. On the other hand, physically-based models can provide seamless soil moisture data at the global scale, but large differences exist across the models due to different and uncertain parameterisations of e.g. the spatial heterogeneity of soils and vegetation, and the non-linear relationship between soil moisture and evapotranspiration16,17. In summary, each source of soil moisture data has characteristic strengths and weaknesses.

Meanwhile, machine-learning (ML) presents an alternative opportunity to produce seamless soil moisture data. The usefulness of ML algorithms for soil moisture estimation or forecasting has been demonstrated in previous studies. For instance, ML is used to merge soil moisture information from different data sources18, to retrieve soil moisture from satellite observations like brightness temperature or backscatter19–21, or to simulate soil moisture using meteorological forcing22–24. In the last case, ML algorithms are able to ‘learn’ the complex relationship between soil moisture (target) and meteorological variables (predictors) from training data. In this way, soil moisture information can be inferred from readily observed predictor data in an empirical way without explicit knowledge of the physical behaviour of the system (e.g. land surface processes). In general, physically-based models include a range of mechanisms which are considered important and leave out others. By learning soil moisture dynamics directly from training data, ML algorithms may or may not find the same mechanisms, and hence yield different results. Consequently, the resulting soil moisture data is independent from, and can complement existing satellite-based or model-derived datasets. Similar data-driven approaches to derive gridded datasets using ML algorithms have been successfully employed in the cases of land-atmosphere fluxes25 and runoff 26.

Here we present a novel global-scale gridded soil moisture dataset generated through a data-driven approach (Fig. 1). Namely, we employ a Long Short-Term Memory neural network (LSTM)27 to build a soil moisture simulation model. Daily meteorological time series and static features obtained from both reanalysis and remote sensing datasets are used as predictor variables. As a target variable, we use adjusted in-situ soil moisture measurements from different depths obtained from the International Soil Moisture Network (ISMN)14 and the National Center for Monitoring and Early Warning of Natural Disasters of Brazil (CEMADEN)28.

Fig. 1.

Fig. 1

Open in a new tab

Schematic of data-driven approach to generate global-scale gridded soil moisture from in-situ measurements. The LSTM model is trained with meteorological data over days t-364 to t and static features to simulate target soil moisture at day t. As in-situ measurements are point level data, they are adjusted using long-term mean and standard deviation of ERA5 gridded soil moisture to represent soil moisture at a 0.25 degree resolution. The model maps input-output relationships at a single grid pixel, but is trained using a combination of training data from grid pixels where in-situ soil moisture measurements are available.

In-situ soil moisture measurements have widely used as target variables for ML model training, often directly at a point-scale18,20,23. To use in-situ data for soil moisture modeling at a grid-scale, the limited spatial representativeness of in-situ data should be carefully considered. A recent study applied the extended triple collocation technique and selected only in-situ measurements that well represent soil moisture dynamics at the spatial scale similar to satellite footprints21. On the other hand, in our study, the raw point-level data are scaled to match means and variabilities of the European Centre for Medium-Range Weather Forecasts (ECMWF) ERA5 gridded soil moisture at the corresponding grid cells in order to allow seamless merging of measurements across different stations and time periods, and to estimate soil moisture at a target grid-scale. This allows training the ML model using in-situ data collected from a large number of stations around the globe.

Our new global soil moisture dataset, SoMo.ml, provides soil moisture at three different depths: 0–10 cm, 10–30 cm, and 30–50 cm, corresponding to Layer 1, Layer 2, and Layer 3, respectively. The data has a spatiotemporal resolution of 0.25° and daily, covering the period of 2000 to 2019. See Table 1 for more details.

Table 1.

Specifications of SoMo.ml v1.

Data type Gridded
Spatial Extent Quasi-global (90° N–60° S)
Temporal coverage 2000 to 2019
Spatial Resolution 0.25° × 0.25°
Temporal Resolution daily
Variables Soil moisture at three layers (0–10 cm, 10–30 cm, and 30–50 cm)
Unit Volumetric soil moisture [m3m−3]
File format NetCDF
Key strengths 1) Global scale, long-term data. 2) Distinct data derivation compared to existing gridded soil moisture products. 3) Better agreement with in-situ measurements in terms of temporal soil moisture dynamics.
Limitations 1) Performance depends on in-situ data availability, which is low in tropical regions including Africa.
2) Uncertainty and errors in measurements may affect the model performance.
3) ERA5-based scaling is necessary, making long-term means and variabilities of SoMo.ml similar to ERA5 data.
Open in a new tab

Methods

Target soil moisture data preparation

Target soil moisture data at 0.25° and daily resolution for model training is constructed using the in-situ measurements. From the ISMN data only ‘good’ observations are selected, based on the quality flag29. The full list of ISMN networks involved in this study can be found in Table 2. CEMADEN provides only useful-quality data30. Both datasets provide sub-daily data and daily averages are computed for the days with at least six available sub-daily estimates. Stations or sensors with less than 2 months of data are discarded.

Table 2.

List of ISMN14 participating networks and the number of sensors per depth considered in this study.

Network Country Number of sensors used (Layer1/Layer2/Layer3)
AMMA-CATCH64 Benin, Niger, Mali 10/6/4
ARM65 USA 61/42/44
BIEBRZA-S-166 Poland 20/10/5
BNZ-LTER67 Alaska 15/13/10
CALABRIA Italy 0/4/0
CAMPANIA68 Italy 0/2/0
CARBOAFRICA69 Sudan 1/1/0
COSMOS70 USA 6/36/1
CTP-SMTMN71 China 72/73/73
DAHRA72 Senegal 1/1/1
FLUXNET-AMERIFLUX73 USA 0/2/0
FMI74 Finland 24/13/8
FR-Aqui75 France 4/2/2
GROW76 UK 149/0/0
GTK Finland 7/7/7
HiWATER-EHWSN77 China 166/46/46
HOBE78 Denmark 70/54/0
HSC-SELMACHEON Korea 1/0/0
HYDROL-NET-PERUGIA79 Italy 2/0/0
ICN80 USA 1/1/1
IIT-KANPUR India 1/1/1
IMA-CAN181 Italy 12/0/0
IPE Spain 2/1/0
iRON82 USA 11/18/0
LAB-net83 Chile 3/1/0
MAQU84 China 19/0/0
METEROBS Italy 1/1/0
MOL-RAO85 Germany 2/2/1
MySMNet Malaysia 7/0/7
OZNET86 Australia 35/38/38
PTSMN87 New Zealand 0/20/20
REMEDHUS88 Spain 24/0/0
RISMA89 Canada 58/43/44
RSMN Romania 20/0/0
SASMAS90 Australia 14/14/0
SCAN91 USA 293/288/287
SKKU Korea 5/5/5
SMOSMANIA92 France 29/30/0
SNOTEL93 USA 404/415/399
SOILSCAPE94 USA 135/145/33
SW-WHU95 China 3/0/0
SWEX-POLAND96 Poland 16/4/16
TERENO97 Germany 14/14/14
UDC-SMOS98 Germany 28/8/5
UMBRIA68 Italy 0/13/13
UMSUOL Italy 1/1/1
USCRN99 USA 109/88/ 88
USDA-ARS100 USA 2/0/0
VAS Spain 7/0/0
WEGENERNET101 Austria 0/12/0
WSMN102 UK 7/0/0
Open in a new tab

In total, we collect in-situ measurements from 51 ISMN networks across the globe. More detailed information can be found from https://ismn.geo.tuwien.ac.at/en/networks/.

In-situ measurements across the different sites are collected with various sensor types, which have different calibrations. Therefore, the means and variances of the obtained time series are not necessarily comparable, which could introduce artifacts during the LSTM training. For this reason, we adjust the mean and standard deviation of the daily in-situ time series to those of the respective ERA5 grid-cell soil moisture within the overlapping period. As ERA5 soil moisture is available at 0–7 cm, 7–28 cm, and 28–100 cm depths, it is vertically interpolated into the target layer depths with a depth-weighted averaging. If more than one in-situ measurement time series is available at the same depth within the same grid cell (0.25°), their average is taken (Fig. 1). As a result, the adjusted in-situ target data resembles ERA5 soil moisture in terms of mean and standard deviation, while its daily temporal variations follow the ground observations. Our approach is also based on the fact that temporal variations from point-level data have a greater areal representation compared to absolute soil moisture values31,32. We can therefore assume that point-level data contains sufficient information to infer soil moisture dynamics at the grid scale.

For each soil layer, we preferentially select the adjusted in-situ measurement taken at the mid-depth of the layer; i.e. 5 cm, 20 cm, and 40 cm, respectively. If no data is available at the mid-depth, the measurement taken closest to the mid-depth, and within the layer, is chosen, leading to a total of 1114, 1064, and 683 grid pixels for the three layers, respectively. The location of the grid cells with available target soil moisture is shown in Fig. 2a. Selected depths and data lengths of target soil moisture data employed for each layer are depicted in Fig. 2b. A considerable fraction of the target data is obtained from North America across diverse hydro-climatic regions (see Fig. 3). While training data from South America represents warm and semiarid regions, those from Asia mostly cover relatively cold regions.

Fig. 2.

Fig. 2

Open in a new tab

(a) Spatial distribution of the target soil moisture data; 1114, 1064, and 683 grid cells are available for the layers of 0–10 cm, 10–30 cm, and 30–50 cm, respectively. (b) Data length and measurement depths of the target soil moisture over the period of 2000–2019.

Fig. 3.

Fig. 3

Open in a new tab

Distribution of target soil moisture across hydro-climatic regimes for each layer. The total number of target data grid cells is given for each continent. Global grid pixels are randomly sampled (5%) from all land pixels for brevity.

Model training

LSTM is a special kind of recurrent neural networks that is capable of learning long-term dependencies across time steps in sequential data27. It has been widely used in land surface modelling such as runoff or soil moisture simulations23,24,33,34. An adapted version of the LSTM architecture, Entity-Aware LSTM33, that can ingest time-varying forcing and static inputs separately is used in this study, thereby allowing the algorithm to explicitly differentiate the two different types of information.

We model soil moisture using the Entity-Aware LSTM architecture (hereafter referred to as ‘LSTM model’); the model consists of 1) 128 of hidden units, 2) one LSTM layer with one dense layer, and 3) 0.5 of dropout rate. These model hyperparameters are selected through a grid search (searching the optimal hyperparameters over the pre-defined hyperparameter space) with 5-fold cross validation. The entire dataset is split into five folds, each containing approximately 20% of the data. While the dataset is randomly split into the folds, neighbouring grid pixels are grouped into the same fold to account for spatial auto-correlation. The training of the model is performed using data from four folds, while the model validation is made with the remaining fold. This operation is repeated five times so that each fold is used once as an independent validation set, and finally the performance is averaged across the repetitions to obtain a representative estimate.

The LSTM model is trained to learn the relationship between the multiple predictor variables and the target soil moisture. The model is trained separately for each soil layer. The predictor data used for the LSTM-based soil moisture modelling is listed in Table 3. The meteorological inputs during days t-364 to t are used to simulate soil moisture at day t; i.e. the model can establish the relationship of present soil moisture with present and past meteorological forcing over a full annual cycle. All input data are normalised using their mean and standard deviation to enhance the training efficiency35. We use the mean squared error divided by the standard deviation of soil moisture at each individual grid cell as a loss function. This scaling ensures comparative values of the loss function across wet and dry regions with potentially different temporal variabilities33.

Table 3.

Predictor data used for the LSTM model.

Variable Source Description
Dynamic Air temperature ERA536 Daily meteorological forcing obtained from ECMWF reanalysis
Precipitation
Specific humidity
Net surface radiation
Downward surface solar radiation
Land surface temperature
Soil moisture from upper layer(s) for second and third layers SoMo.ml50 ML-based soil moisture produced in this study
Static Mean precipitation ERA536 Long-term mean precipitation
Aridity ERA536 Ratio of net radiation to precipitation
Topography ETOPO141 Mean and standard deviation of sub-grid scale elevation values at each grid cell
Vegetation type GLDAS42 Predominant vegetation type (MODIS-derived) at each grid cell
Soil type GLDAS42 Clay, sand and silt fractions based on FAO Soil Map of the World43
Soil porosity GLDAS42 Soil porosity across layers, based on FAO Soil Map of the World44
Open in a new tab

Meteorological forcing variables are prepared from new global atmospheric reanalysis ERA5 produced by ECMWF36. There are several reasons why ERA5 is chosen. First, ERA5 uses large amounts and diverse kinds of observations such as synoptic station data, satellite radiance, and ground-based radar precipitation information via the 4D-Var data assimilation. Its enhanced quality as meteorological forcing, compared to its predecessor ERA-Interim, has been demonstrated through an experiment with land surface models37. Second, ERA5 allows the generation of long-term global-scale soil moisture data. The direct use of observations such as satellite data introduces the problem of gaps in space and time, and different or limited time periods covered by the respective variables. In this sense, the current version of SoMo.ml can also serve as a baseline data to evaluate performance of updated data versions in the future, e.g., by comparing with data generated from machine learning trained with purely observational data for selected variables. Finally, ERA5 is available with only a few months latency, allowing corresponding future updates of the SoMo.ml dataset.

For the deeper layers, soil moisture simulated from the upper layer(s) is additionally used as input data. Although the model performance of different combinations of input variables could be exhaustively compared to find ‘best’ predictors, we select meteorological forcing variables that are commonly used in physically-based modeling; the usefulness of such variables in land surface hydrologic modeling has been proven over many decades38,39. In addition, we assess the relative importance of predictors for the soil moisture simulations and find that land surface temperature has the greatest effect on the model performance for the top layer, while soil moisture in the upper layers(s) is the most important variable for the deeper layers. Further details are given in the following section.

For the static data, long-term mean precipitation and aridity over the period of 2000–2019 is computed using the ERA5 data36. Aridity is defined as the ratio of net radiation (converted into mm) divided by precipitation40. We characterise topography through mean and standard deviation of sub-grid scale elevation, as obtained from the ETOPO1 digital elevation model41. In addition, we use soil type and land cover information from the Global Land Data Assimilation System (GLDAS) data archive42. GLDAS resampled soil porosity and fractions of sand, silt, and clay from FAO datasets43 into 0.25° spatial resolution. The land cover is based on MODIS-derived 20-category vegetation data that uses a modified International Geosphere–Biosphere Programme classification scheme44. We use GLDAS Dominant Vegetation Type Data Version 2 which assigned the predominant vegetation type to each 0.25° grid cell.

Importance of predictors

The relative importance of predictor variables for the soil moisture simulation is quantified using a permutation approach. The importance is defined as the decrease in model accuracy when the time series of a particular variable is randomly permuted to remove the information contained in its temporal dynamics45,46. In the case of the static features, we permute all variables at the same time; each variable is randomly shuffled in space. As shown in Fig. 4, for the top layer, land surface temperature is the most significant explanatory variable among the considered meteorological forcings, followed by precipitation and 2m-temperature, in terms of both normalised root-mean-square error (NRMSE) and correlation coefficient. Land surface temperature and its diurnal amplitude has been recognised previously as a proxy for soil wetness47–49, confirming the LSTM results. The static data is relevant for the soil moisture performance only in terms of NRMSE. This is in line with previous findings showing that e.g. soil and vegetation types influence the spatial variability of soil moisture, but not so much the temporal dynamics31. While a wide range of predictor variables, including static variables, makes a significant contribution to the model performance for the first layer, (simulated) soil moisture in the upper layer(s) has the greatest effect on the model performance for the deeper layers.

Fig. 4.

Fig. 4

Open in a new tab

Relative importance of predictor variables for the simulated soil moisture data. We permute each predictor variable separately and compare the respective decreases in model performance; NRMSE and correlation coefficient are considered. For the static features, we permute all variables together at the same time.

Global data generation

The LSTM model is trained using the entire training dataset which consists of the available target soil moisture data and corresponding predictor data. After establishing the internal relationships (‘learning’), the model is applied using the predictor data over a quasi-global area of 90° N–60° S at 0.25° spatial resolution. In order to account for the random initialisation of LSTM’s trainable parameters, five simulations are performed and final soil moisture values are computed as an average of the five simulations.

Data Records

The SoMo.ml dataset can be accessed at figshare50. Three compressed files (.zip) contain data in NetCDF format for the three respective layers. An example file name is ‘SoMo.ml_v1_<LAYER>_<YYYY>.nc’, with LAYER and YYYY standing for soil moisture layer depth and year, respectively.

Technical Validation

Model validation

The validity of the LSTM model in soil moisture modeling is tested through 5-fold cross-validation. The simulated soil moisture for the validation is hereafter referred to as SoMo.ml*, as this simulation data differs somewhat from the actual SoMo.ml because it is not based on training with all available target data, but only with 80% of the data according to the 5-fold cross validation approach.

Figure 5a shows that the mean of SoMo.ml* at each pixel generally agrees well with that of the target data (Pearson’s r ranges between 0.92 to 0.98), indicating that the model captures spatial variations of soil moisture. The model shows somewhat better performance towards deeper layers. In Fig. 5b,frequency distributions of the entire time series of SoMo.ml* and target soil moisture are compared. Again, reasonable agreement is observed, although the simulated soil moisture exhibits smaller variability with larger minimum and smaller maximum values, as can also be seen from the slightly higher peaks of SoMo.ml*. The entire soil moisture time series are further compared for particular (sub-)continents in Fig. 5c. In terms of both distributions and medians, the model shows a satisfactory performance overall. However, relatively less agreement is observed in Africa, Australia, and South America. This is probably because the model has difficulties learning the soil moisture dynamics there as most grid cells from these regions are characterised by extreme hydro-climatic conditions (e.g. very warm or arid, see Fig. 3) for which only few in-situ observations are available. The (hydro-climatic) diversity of training data can significantly affect the performance of data-driven modelling; when given more diverse training data, models can acquire more complete knowledge of input-output relationships and therefore perform better across various regimes34. Overall, the LSTM model successfully learns soil moisture dynamics from the training data and can reproduce them at unseen locations.

Fig. 5.

Fig. 5

Open in a new tab

Comparison between SoMo.ml* (blue) and target soil moisture (grey) at each layer: comparison of (a) pixel-averaged soil moisture, (b) frequency distributions of daily soil moisture from all training grid cells, and (c) daily soil moisture from grid cells for each continent.

Comparison with independent in-situ measurements

Cross-validation (5-fold) is made through a direct grid-to-point comparison between the SoMo.ml* and the in-situ measurements as done in many previous studies51–55. This validation also enables a comparative assessment of modelled soil moisture from the LSTM with that of state-of-the-art global gridded datasets such as ERA5, GLEAM52, and the satellite-based ESA-CCI15 datasets. Established skill scores such as NRMSE, relative bias, and correlation coefficient are used to quantify the agreement with the ground truth data.

Figure 6 shows the distribution of the NRMSE of SoMo.ml* across climate regimes (left) and a comparison of these results with the respective performances of the reference datasets (right). NRMSE is defined as the RMSE divided by the means of ground truth. Although SoMo.ml* shows slightly higher biases at some stations over warm and arid regions, there is no clear overall climate dependency of the NRMSE. In Layer 1, while the median NRMSE of SoMo.ml* is similar to that of ESA-CCI, which shows lowest NRMSE, a wider spread of errors is observed. ERA5 and GLEAM tend to overestimate in-situ measurements (see Fig. S1 in Supplementary Information for relative biases), leading to slightly higher NRMSE values. In the deeper layers, where ESA-CCI is not available, NRMSE values of SoMo.ml* are slightly lower but overall similar to those of the ERA5 and GLEAM references. As a result, this comparison highlights similar deviations of absolute soil moisture values from in-situ measurements across the considered datasets.

Fig. 6.

Fig. 6

Open in a new tab

Comparison of absolute soil moisture between SoMo.ml* and in-situ data for each layer (top to bottom): (left) NRMSE values of SoMo.ml* at each measurement station and (right) comparison with other global gridded datasets. Triangles show mean and box plot whiskers show the 0.2 to 0.8 quantiles of the NRMSE across all measurement stations. The boxes are ranked according to the median NRMSE so that the best performing data is positioned at the top.

Figure 7 shows results from a similar comparison, but focusing on the time-variability of the soil moisture dataset as expressed by the correlation of soil moisture anomalies with in-situ measurements. To exclude the impact of the seasonal cycle, we consider short-term anomalies56,57. For each soil moisture at day d, a period P is defined as P = [d-17, d + 17] (corresponding to a 5-week window). If at least 10 data are available within the period, the average soil moisture and corresponding anomaly are computed. Equations are applied to each station and a grid pixel it lies on. No pronounced climate dependency of the correlations is observed for SoMo.ml* (Fig. 7, left). Comparing with the reference datasets, SoMo.ml* outperforms them for the top layer. While overall anomaly correlations decrease in the deeper layers, also for these layers SoMo.ml* shows closer agreement with the observations than the reference datasets. The results underline the particular strength of SoMo.ml*, and likely also the actual SoMo.ml, to represent the temporal variability of soil moisture. This is somewhat expected; while this comparison is done against independent in-situ measurements, the temporal dynamics of SoMo.ml* are directly learned from (remaining) in-situ measurements. Similar results are obtained when using the correlations of long-term absolute soil moisture, and of anomalies derived by removing the mean daily averages (Figs. S2 and S3, respectively). We also compute the triple collocation error58–60, which is widely used to estimate random error variance of soil moisture data in the absence of reliable ground reference data, confirming the results from Figs. 6 and 7 and underlining the usefulness of SoMo.ml (Fig. S4).

Fig. 7.

Fig. 7

Open in a new tab

Same as in Fig. 6, but for correlation coefficient of anomalies where anomalies are determined by removing the mean of a surrounding 35-day window for each value.

Note that ESA-CCI has missing values in space and time and GLEAM is available only until 2018, such that partly different spatiotemporal data are used among datasets in the comparison. We repeat the analysis above using only data where all datasets are available and find very similar results (not shown). In summary, compared with state-of-the-art references, SoMo.ml* shows a comparable performance in terms of biases, while outperforming the other datasets in terms of temporal correlations, which highlights the benefits of using in-situ observation more directly in the derivation of soil moisture dataset.

Global-scale comparison with existing gridded datasets

Next, we examine the spatial patterns of SoMo.ml at the global scale. Figure 8a presents the median soil moisture values over the entire period. Low values in arid regions such as southwest North America, North Africa, central Asia, and Australia and high values in more humid regions such as the northern latitudes and Southeast Asia are well captured. Figure 8b compares latitudinal profile of SoMo.ml against that of the reference datasets (Fig. 8b). Overall, we find a satisfactory consistency between global patterns of SoMo.ml and the reference datasets. For instance, the highest average soil moisture occurs near the equator in the tropics, while driest soil moisture is found near 20° N. These patterns are overall well reproduced in SoMo.ml. This is expected to some extent because we rescale the target soil moisture using ERA5 means and standard deviations, such that the LSTM algorithm will pick up these ERA5 characteristics in locations and at time steps with available in-situ measurements. Nonetheless, SoMo.ml between 15° N and 25° N tends to be wetter than the reference datasets (over the eastern part of the Sahara desert), especially in the deeper layers. More generally, SoMo.ml might not properly describe soil moisture in very-arid regions, which can be related to a lack of training data from such regions (see Fig. 3). Different patterns found in ESA-CCI along the equator are mostly due to the missing data. Over very high latitudes over 60° N, we can observe relatively large differences across datasets, probably due to different freezing and thawing patterns. Meanwhile, in-situ measurements (not adjusted) do not show a meaningful pattern of latitudinal averages but large variability across stations and sensors, whereby it is not clear to which extent this is due to different sensor types and calibrations or due to actual moisture differences caused by heterogeneous land surface characteristics. Additional comparison among the global soil moisture datasets can be found from Figs. S5–S7 in Supplementary Information.

Fig. 8.

Fig. 8

Open in a new tab

(a) Global maps of 20-year long-term medians of SoMo.ml. (b) Comparison of latitudinal profiles among the considered datasets. In the case of GLEAM, root-zone soil moisture is used for both Layer 2 and Layer 3.

Usage Notes

We present a global, multi-layer, long-term soil moisture dataset generated through a data-driven approach, and with comprehensive ground truth data. For model training, we preprocess the in-situ measurements to obtain more spatiotemporally consistent, grid-scale target soil moisture data by adopting mean and standard deviation from ERA5 data while preserving the observed temporal variations from the in-situ measurements. Any gridded soil moisture can possibly be used as a scaling reference, but the selection of reference will not affect the main characteristic of SoMo.ml, i.e. resembling temporal patterns of the in-situ measurements. Our newly generated soil moisture data outperforms other existing gridded datasets, including ERA5, in terms of daily temporal dynamics as indicated by highest temporal (anomaly) correlation with the ground observations. Nonetheless, the data quality in conditions outside the spatiotemporal range sampled within the observations is potentially uncertain. LSTM performance can be significantly affected by the (lack of) hydro-climatic diversity in the training data, even more than by the quantity of data34. As shown in Fig. 3, while the in-situ soil moisture measurements are obtained from networks worldwide, the data does not cover all globally occurring hydro-climatic conditions. Therefore, relatively high uncertainty outside the training conditions such as at high latitudes and in arid regions is expected. However, this lack of observations in particular conditions also presents a challenge to other datasets/models57,61. Therefore, for instance, using SoMo.ml within an ensemble of differently derived datasets could be a promising solution to obtain more reliable soil moisture information in these data-sparse regions62,63. As a result, our new soil moisture dataset is a valuable addition to the existing suite of soil moisture datasets, and can enhance future large-scale hydrologic and ecologic analyses, and also benchmark studies to evaluate land surface models and remote sensing data.

Supplementary information

Supplementary Information (1.3MB, pdf)

Acknowledgements

We would like to thank Ulrich Weber (Max Planck Institute for Biogeochemistry) for preprocessing and providing the datasets. We also thank Sophia Walther (Max Planck Institute for Biogeochemistry) for her valuable comments. This study is supported by the German Research Foundation (Emmy Noether grant 391059971).

Author contributions

S.O. and R.O. designed the study. S.O. performed the computations and data analysis. All authors discussed the results and wrote the paper.

Funding

Open Access funding enabled and organized by Projekt DEAL.

Code availability

The LSTM model implemented in this study and figure scripts are available from https://github.com/osungmin/SciData2021_SoMo_v1. Note that the LSTM model is built by adopting python modules obtained from https://github.com/kratzert/ealstm_regional_modeling.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

The online version contains supplementary material available at 10.1038/s41597-021-00964-1.

References

  • 1.Daly E, Porporato A. A review of soil moisture dynamics: from rainfall infiltration to ecosystem response. Environ. Eng. Sci. 2005;22:9–24. doi: 10.1089/ees.2005.22.9. [DOI] [Google Scholar]
  • 2.Seneviratne SI, et al. Investigating soil moisture–climate interactions in a changing climate: A review. Earth-Sci. Rev. 2010;99:125–161. doi: 10.1016/j.earscirev.2010.02.004. [DOI] [Google Scholar]
  • 3.Koster RD, et al. Realistic initialization of land surface states: Impacts on subseasonal forecast skill. J. Hydrometeorol. 2004;5:1049–1063. doi: 10.1175/JHM-387.1. [DOI] [Google Scholar]
  • 4.Orth R, Seneviratne SI. Using soil moisture forecasts for sub-seasonal summer temperature predictions in Europe. Clim. Dyn. 2014;43:3403–3418. doi: 10.1007/s00382-014-2112-x. [DOI] [Google Scholar]
  • 5.Prodhomme C, Doblas-Reyes F, Bellprat O, Dutra E. Impact of land-surface initialization on sub-seasonal to seasonal forecasts over Europe. Clim. Dyn. 2016;47:919–935. doi: 10.1007/s00382-015-2879-4. [DOI] [Google Scholar]
  • 6.Denissen JM, Teuling AJ, Reichstein M, Orth R. Critical soil moisture derived from satellite observations over europe. J. Geophys. Res. Atmos. 2020;125:e2019JD031672. doi: 10.1029/2019JD031672. [DOI] [Google Scholar]
  • 7.Lorenz R, Jaeger EB, Seneviratne SI. Persistence of heat waves and its link to soil moisture memory: persistence of heat waves. Geophys. Res. Lett. 2010;37:L09703. doi: 10.1029/2010GL042764. [DOI] [Google Scholar]
  • 8.Mueller B, Seneviratne SI. Hot days induced by precipitation deficits at the global scale. PNAS. 2012;109:12398–12403. doi: 10.1073/pnas.1204330109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Whan K, et al. Impact of soil moisture on extreme maximum temperatures in Europe. Weather. Clim. Extremes. 2015;9:57–67. doi: 10.1016/j.wace.2015.05.001. [DOI] [Google Scholar]
  • 10.Sharma A, Wasko C, Lettenmaier DP. If precipitation extremes are increasing, why aren’t floods? Water Resour. Res. 2018;54:8545–8551. doi: 10.1029/2018WR023749. [DOI] [Google Scholar]
  • 11.O S, Hou X, Orth R. Observational evidence of wildfire-promoting soil moisture anomalies. Sci. Rep. 2020;10:11008. doi: 10.1038/s41598-020-67530-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Brown ME, et al. NASA’s Soil Moisture Active Passive (SMAP) mission and opportunities for applications users. Bull. Amer. Meteor. Soc. 2013;94:1125–1128. doi: 10.1175/BAMS-D-11-00049.1. [DOI] [Google Scholar]
  • 13.WMO. Systematic observation requirements for satellite-based products for climate: 2011 update. Report No. GCOS-154https://library.wmo.int/doc_num.php?explnum_id=3710 (2011).
  • 14.Dorigo WA, et al. The International Soil Moisture Network: a data hosting facility for global in situ soil moisture measurements. Hydrol. Earth Syst. Sci. 2011;15:1675–1698. doi: 10.5194/hess-15-1675-2011. [DOI] [Google Scholar]
  • 15.Dorigo W, et al. ESA CCI Soil Moisture for improved Earth system understanding: State-of-the art and future directions. Remote Sens. Environ. 2017;203:185–215. doi: 10.1016/j.rse.2017.07.001. [DOI] [Google Scholar]
  • 16.Dirmeyer PA, et al. GSWP-2: Multimodel analysis and implications for our perception of the land surface. Bull. Amer. Meteor. Soc. 2006;87:1381–1398. doi: 10.1175/BAMS-87-10-1381. [DOI] [Google Scholar]
  • 17.Koster RD, et al. On the nature of soil moisture in land surface models. J. Clim. 2009;22:4322–4335. doi: 10.1175/2009JCLI2832.1. [DOI] [Google Scholar]
  • 18.Xu H, et al. Quality improvement of satellite soil moisture products by fusing with in-situ measurements and GNSS-r estimates in the western continental U.S. Remote Sensing. 2018;10:1351. doi: 10.3390/rs10091351. [DOI] [Google Scholar]
  • 19.Ahmad S, Kalra A, Stephen H. Estimating soil moisture using remote sensing data: A machine learning approach. Adv. Water Resour. 2010;33:69–80. doi: 10.1016/j.advwatres.2009.10.008. [DOI] [Google Scholar]
  • 20.Rodriguez-Fernandez, N. J., de Souza, V., Kerr, Y. H., Richaume, P. & Al Bitar, A. Soil moisture retrieval using SMOS brightness temperatures and a neural network trained on in situ measurements. In 2017 IEEE International Geoscience and Remote Sensing Symposium, 1574–1577, 10.1109/IGARSS.2017.8127271 (2017).
  • 21.Yuan Q, Xu H, Li T, Shen H, Zhang L. Estimating surface soil moisture from satellite observations using a generalized regression neural network trained on sparse ground-based measurements in the continental U.S. J. Hydrol. 2020;580:124351. doi: 10.1016/j.jhydrol.2019.124351. [DOI] [Google Scholar]
  • 22.Gill MK, Asefa T, Kemblowski MW, McKee M. Soil moisture prediction using support vector machines. J. Am. Water Resour. Assoc. 2006;42:1033–1046. doi: 10.1111/j.1752-1688.2006.tb04512.x. [DOI] [Google Scholar]
  • 23.Adeyemi O, Grove I, Peets S, Domun Y, Norton T. Dynamic neural network modelling of soil moisture content for predictive irrigation scheduling. Sensors. 2018;18:3408. doi: 10.3390/s18103408. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Fang K, Shen C. Near-real-time forecast of satellite-based soil moisture using long short-term memory with an adaptive data integration kernel. J. Hydrometeorol. 2019;21:399–413. doi: 10.1175/JHM-D-19-0169.1. [DOI] [Google Scholar]
  • 25.Jung M, et al. The FLUXCOM ensemble of global land-atmosphere energy fluxes. Sci. Data. 2019;6:74. doi: 10.1038/s41597-019-0076-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Ghiggi G, Humphrey V, Seneviratne SI, Gudmundsson L. GRUN: an observation-based global gridded runoff dataset from 1902 to 2014. Earth Syst. Sci. Data. 2019;11:1655–1674. doi: 10.5194/essd-11-1655-2019. [DOI] [Google Scholar]
  • 27.Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation. 1997;9:1735–1780. doi: 10.1162/neco.1997.9.8.1735. [DOI] [PubMed] [Google Scholar]
  • 28.Costa JM, 2020. A soil moisture dataset over the Brazilian semiarid region. Mendeley Data. [DOI]
  • 29.Dorigo W, et al. Global automated quality control of in situ soil moisture data from the international soil moisture network. Vadose Zone Journal. 2013;12:21pp. doi: 10.2136/vzj2012.0097. [DOI] [Google Scholar]
  • 30.Zeri M, et al. Tools for communicating agricultural drought over the brazilian semiarid using the soil moisture index. Water. 2018;10:1421. doi: 10.3390/w10101421. [DOI] [Google Scholar]
  • 31.Mittelbach H, Seneviratne SI. A new perspective on the spatio-temporal variability of soil moisture: temporal dynamics versus time-invariant contributions. Hydrol. Earth Syst. Sci. 2012;16:2169–2179. doi: 10.5194/hess-16-2169-2012. [DOI] [Google Scholar]
  • 32.Mälicke M, Hassler SK, Blume T, Weiler M, Zehe E. Soil moisture: variable in space but redundant in time. Hydrol. Earth Syst. Sci. 2020;24:2633–2653. doi: 10.5194/hess-24-2633-2020. [DOI] [Google Scholar]
  • 33.Kratzert F, et al. Towards learning universal, regional, and local hydrological behaviors via machine learning applied to large-sample datasets. Hydrol. Earth Syst. Sci. 2019;23:5089–5110. doi: 10.5194/hess-23-5089-2019. [DOI] [Google Scholar]
  • 34.O, S., Dutra, E. & Orth, R. Robustness of process-based versus data-driven modelling in changing climatic conditions. J. Hydrometeor. 1929–1944, 10.1175/JHM-D-20-0072.1 (2020).
  • 35.LeCun, Y. A., Bottou, L., Orr, G. B. & Müller, K.-R. Efficient BackProp. In Neural networks: tricks of the trade, Second Edition, 9–48, 10.1007/978-3-642-35289-8_3 (Springer Berlin Heidelberg, Berlin, Heidelberg, 2012).
  • 36.Hersbach, H. et al. The ERA5 global reanalysis. Q. J. R. Meteorol. Soc. qj.3803, 10.1002/qj.3803 (2020).
  • 37.Albergel C, et al. ERA-5 and ERA-Interim driven ISBA land surface model simulations: which one performs better? Hydrol. Earth Syst. Sci. 2018;22:3515–3532. doi: 10.5194/hess-22-3515-2018. [DOI] [Google Scholar]
  • 38.Sheffield J, Goteti G, Wood EF. Development of a 50-year high-resolution global dataset of meteorological forcings for land surface modeling. J. Clim. 2006;19:3088–3111. doi: 10.1175/JCLI3790.1. [DOI] [Google Scholar]
  • 39.Balsamo G, et al. A revised hydrology for the ECMWF model: Verification from field site to terrestrial water storage and impact in the Integrated Forecast System. J. Hydrometeorol. 2009;10:623–643. doi: 10.1175/2008JHM1068.1. [DOI] [Google Scholar]
  • 40.Budyko, M. Climate and life. Academic Press: New York, NY, USA (1974).
  • 41.Amante, C. ETOPO1 1 Arc-Minute Global Relief Model: Procedures, Data Sources and Analysis. NOAA National Geophysical Data Center10.7289/V5C8276M (2009).
  • 42.Rodell M, et al. The Global Land Data Assimilation System. Bull. Amer. Meteor. 2004;85:381–394. doi: 10.1175/BAMS-85-3-381. [DOI] [Google Scholar]
  • 43.Reynolds CA, Jackson TJ, Rawls WJ. Estimating soil water-holding capacities by linking the Food and Agriculture Organization Soil map of the world with global pedon databases and continuous pedotransfer functions. Water Resour. Res. 2000;36:3653–3662. doi: 10.1029/2000WR900130. [DOI] [Google Scholar]
  • 44.Friedl M, et al. Global land cover mapping from MODIS: algorithms and early results. Remote Sens. Environ. 2002;83:287–302. doi: 10.1016/S0034-4257(02)00078-0. [DOI] [Google Scholar]
  • 45.Breiman L. Random forests. Machine learning. 2001;45:5–32. doi: 10.1023/A:1010933404324. [DOI] [Google Scholar]
  • 46.Molnar, C. Interpretable machine learning. GitHub https://christophm.github.io/interpretable-ml-book/ (2019).
  • 47.Aires F, Prigent C, Rossow W. Sensitivity of satellite microwave and infrared observations to soil moisture at a global scale: 2. global statistical relationships. J. Geophys. Res. Atmos. 2005;110:D11103. doi: 10.1029/2004JD005094. [DOI] [Google Scholar]
  • 48.Cammalleri C, Vogt J. On the role of land surface temperature as proxy of soil moisture status for drought monitoring in europe. Remote Sens. 2015;7:16849–16864. doi: 10.3390/rs71215857. [DOI] [Google Scholar]
  • 49.Prigent C, Aires F, Rossow W, Robock A. Sensitivity of satellite microwave and infrared observations to soil moisture at a global scale: Relationship of satellite observations to in situ soil moisture measurements. J. Geophys. Res. Atmos. 2005;110:D07110. doi: 10.1029/2004JD005087. [DOI] [Google Scholar]
  • 50.O S, Orth R. 2021. Global soil moisture from in situ measurements using machine learning - SoMo.ml. figshare. [DOI] [PMC free article] [PubMed]
  • 51.Albergel C, de Rosnay P, Balsamo G, Isaksen L, Muñoz-Sabater J. Soil moisture analyses at ECMWF: evaluation using global ground-based in situ observations. J. Hydrometeorol. 2012;13:1442–1460. doi: 10.1175/JHM-D-11-0107.1. [DOI] [Google Scholar]
  • 52.Martens B, et al. GLEAM v3: satellite-based land evaporation and root-zone soil moisture. Geosci. Model Dev. 2017;10:1903–1925. doi: 10.5194/gmd-10-1903-2017. [DOI] [Google Scholar]
  • 53.Pablos M, González-Zamora A, Sánchez N, Martínez-Fernández J. Assessment of root zone soil moisture estimations from SMAP, SMOS and MODIS observations. Remote Sens. 2018;10:981. doi: 10.3390/rs10070981. [DOI] [Google Scholar]
  • 54.Al-Yaari, A. et al. Validation of satellite microwave retrieved soil moisture with global ground-based measurements. In IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium, 3743–3746, 10.1109/IGARSS.2018.8517557 (IEEE, Valencia, 2018).
  • 55.Li, M., Wu, P. & Ma, Z. Comprehensive evaluation of soil moisture and soil temperature from third-generation atmospheric and land reanalysis datasets. Int. J. Climatol. joc.6549, 10.1002/joc.6549 (2020).
  • 56.Albergel C, et al. Skill and global trend analysis of soil moisture from reanalyses and microwave remote sensing. J. Hydrometeorol. 2013;14:1259–1277. doi: 10.1175/JHM-D-12-0161.1. [DOI] [Google Scholar]
  • 57.Dorigo W, et al. Evaluation of the ESA CCI soil moisture product using ground-based observations. Remote Sens. Environ. 2015;162:380–395. doi: 10.1016/j.rse.2014.07.023. [DOI] [Google Scholar]
  • 58.Stoffelen A. Toward the true near-surface wind speed: Error modeling and calibration using triple collocation. J. Geophys. Res. Oceans. 1998;103:7755–7766. doi: 10.1029/97JC03180. [DOI] [Google Scholar]
  • 59.Gruber A, et al. Recent advances in (soil moisture) triple collocation analysis. Int. J. Appl. Earth. Obs. Geoinf. 2016;45:200–211. doi: 10.1016/j.jag.2015.09.002. [DOI] [Google Scholar]
  • 60.Paulik, C, 2021. TUW-GEO/pytesmo: v0.10.0. Zenodo. [DOI]
  • 61.Reichle RH, et al. Global assessment of the SMAP Level-4 surface and root-zone soil moisture product using assimilation diagnostics. J. Hydrometeorol. 2017;18:3217–3237. doi: 10.1175/JHM-D-17-0130.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Guo Z, Dirmeyer PA, Gao X, Zhao M. Improving the quality of simulated soil moisture with a multi-model ensemble approach. Q. J. R. Meteorol. Soc. 2007;133:731–747. doi: 10.1002/qj.48. [DOI] [Google Scholar]
  • 63.Wang A, Bohn TJ, Mahanama SP, Koster RD, Lettenmaier DP. Multimodel ensemble reconstruction of drought over the continental United States. J. Clim. 2009;22:2694–2712. doi: 10.1175/2008JCLI2586.1. [DOI] [Google Scholar]
  • 64.Lebel T, et al. AMMA-CATCH studies in the Sahelian region of West-Africa: An overview. J. Hydrol. 2009;375:3–13. doi: 10.1016/j.jhydrol.2009.03.020. [DOI] [Google Scholar]
  • 65.Phillips TJ, et al. Using ARM observations to evaluate climate model simulations of land-atmosphere coupling on the U.S. southern Great Plains. J. Geophys. Res. Atmos. 2017;122(11):524–11,548. doi: 10.1002/2017JD027141. [DOI] [Google Scholar]
  • 66.Dabrowska-Zielinska, K. et al. Soil moisture in the Biebrza wetlands retrieved from Sentinel-1 imagery. Remote Sensing10, 10.3390/rs10121979 (2018).
  • 67.Van Cleve, K., Chapin, F. & Ruess, R. Bonanza creek long term ecological research project climate database. University of Alaska Fairbankshttp://www.lter.uaf.edu/ (2015).
  • 68.Brocca L, et al. Soil moisture estimation through ASCAT and AMSR-E sensors: An intercomparison and validation study across Europe. Remote Sens. Environ. 2011;115:3390–3408. doi: 10.1016/j.rse.2011.08.003. [DOI] [Google Scholar]
  • 69.Ardö J. A 10-year dataset of basic meteorology and soil properties in central Sudan. Dataset Papers in Geosciences. 2013;2013:1–6. doi: 10.7167/2013/297973. [DOI] [Google Scholar]
  • 70.Zreda M, et al. COSMOS: the COsmic-ray Soil Moisture Observing System. Hydrol. Earth Syst. Sci. 2012;16:4079–4099. doi: 10.5194/hess-16-4079-2012. [DOI] [Google Scholar]
  • 71.Yang K, et al. A multiscale soil moisture and freeze–thaw monitoring network on the third pole. Bull. Am. Meteorol. Soc. 2013;94:1907–1916. doi: 10.1175/BAMS-D-12-00203.1. [DOI] [Google Scholar]
  • 72.Tagesson T, et al. Ecosystem properties of semiarid savanna grassland in West Africa and its relationship with environmental variability. Global Change Biology. 2015;21:250–264. doi: 10.1111/gcb.12734. [DOI] [PubMed] [Google Scholar]
  • 73.Baldocchi D, et al. FLUXNET: A new tool to study the temporal and spatial variability of ecosystem-scale carbon dioxide, water vapor, and energy flux densities. Bulletin of the American Meteorological Society. 2001;82:2415–2434. doi: 10.1175/1520-0477(2001)082&#x0003c;2415:FANTTS&#x0003e;2.3.CO;2. [DOI] [Google Scholar]
  • 74.Ikonen J, et al. The Sodankylä in situ soil moisture observation network: an example application of ESA CCI soil moisture product evaluation. Geoscientific Instrumentation, Methods and Data Systems. 2016;5:95–108. doi: 10.5194/gi-5-95-2016. [DOI] [Google Scholar]
  • 75.Al-Yaari, A. et al. The AQUI soil moisture network for satellite microwave remote sensing validation in south-western France. Remote Sensing10, 10.3390/rs10111839 (2018).
  • 76.Cobley A, Hemment D, Rowan J, Taylor N, Woods M. 2020. Grow soil moisture data. GROW Observatory. [DOI]
  • 77.Kang J, et al. Hybrid optimal design of the eco-hydrological wireless sensor network in the middle reach of the Heihe river basin, China. Sensors. 2014;14:19095–19114. doi: 10.3390/s141019095. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Bircher S, Skou N, Jensen KH, Walker JP, Rasmussen L. A soil moisture and temperature network for SMOS validation in Western Denmark. Hydrol. Earth Syst. Sci. 2012;16:1445–1463. doi: 10.5194/hess-16-1445-2012. [DOI] [Google Scholar]
  • 79.Morbidelli R, Saltalippi C, Flammini A, Rossi E, Corradini C. Soil water content vertical profiles under natural conditions: matching of experiments and simulations by a conceptual model. Hydrological Processes. 2014;28:4732–4742. doi: 10.1002/hyp.9973. [DOI] [Google Scholar]
  • 80.Hollinger SE, Isard SA. A soil moisture climatology of Illinois. Journal of Climate. 1994;7:822–833. doi: 10.1175/1520-0442(1994)007&#x0003c;0822:ASMCOI&#x0003e;2.0.CO;2. [DOI] [Google Scholar]
  • 81.Biddoccu M, Ferraris S, Opsi F, Cavallo E. Long-term monitoring of soil management effects on runoff and soil erosion in sloping vineyards in Alto Monferrato (North–West Italy) Soil and Tillage Research. 2016;155:176–189. doi: 10.1016/j.still.2015.07.005. [DOI] [Google Scholar]
  • 82.Osenga EC, Arnott JC, Endsley KA, Katzenberger JW. Bioclimatic and soil moisture monitoring across elevation in a mountain watershed: Opportunities for research and resource management. Water Resources Research. 2019;55:2493–2503. doi: 10.1029/2018WR023653. [DOI] [Google Scholar]
  • 83.Mattar, C., Santamaría-Artigas, A., Durán-Alarcón, C., Olivera-Guerra, L. & Fuster, R. LAB-net the first chilean soil moisture network for remote sensing applications. Procd. IV Recent Advances in Quantitative Remote Sensing Symposium (2014).
  • 84.Su Z, et al. The Tibetan Plateau observatory of plateau scale soil moisture and soil temperature (Tibet-Obs) for quantifying uncertainties in coarse resolution satellite and model products. Hydrol. Earth Syst. Sci. 2011;15:2303–2316. doi: 10.5194/hess-15-2303-2011. [DOI] [Google Scholar]
  • 85.Beyrich, F. & Adam, W. Site and Data Report for the Lindenberg Reference Site in CEOP - Phase 1. Berichte des Deutschen Wetterdienstes (2007).
  • 86.Smith, A. B. et al. The Murrumbidgee soil moisture monitoring network data set: data and analysis note. Water Resources Research48, 10.1029/2012WR011976 (2012).
  • 87.Hajdu I, Yule I, Bretherton M, Singh R, Hedley C. Field performance assessment and calibration of multi-depth AquaCheck capacitance-based soil moisture probes under permanent pasture for hill country soils. Agricultural Water Management. 2019;217:332–345. doi: 10.1016/j.agwat.2019.03.002. [DOI] [Google Scholar]
  • 88.Sanchez N, Martinez-Fernandez J, Scaini A, Perez-Gutierrez C. Validation of the SMOS L2 soil moisture data in the REMEDHUS network (Spain) IEEE Transactions on Geoscience and Remote Sensing. 2012;50:1602–1611. doi: 10.1109/TGRS.2012.2186971. [DOI] [Google Scholar]
  • 89.Ojo ER, et al. Calibration and evaluation of a frequency domain reflectometry sensor for real-time soil moisture monitoring. Vadose Zone Journal. 2015;14:vzj2014.08.0114. doi: 10.2136/vzj2014.08.0114. [DOI] [Google Scholar]
  • 90.Rüdiger, C. et al. Goulburn River experimental catchment data set: GOULBURN RIVER EXPERIMENTAL DATA SET. Water Resources Research43, 10.1029/2006WR005837 (2007).
  • 91.Schaefer GL, Cosh MH, Jackson TJ. The USDA natural resources conservation service soil climate analysis network (SCAN) Journal of Atmospheric and Oceanic Technology. 2007;24:2073–2077. doi: 10.1175/2007JTECHA930.1. [DOI] [Google Scholar]
  • 92.Calvet, J.-C. et al. In situ soil moisture observations for the CAL/VAL of SMOS: the SMOSMANIA network. 2007 IEEE International Geoscience and Remote Sensing Symposium 1196–1199, 10.1109/IGARSS.2007.4423019 (2007).
  • 93.Al Bitar A, et al. Evaluation of SMOS Soil Moisture Products Over Continental U.S. Using the SCAN/SNOTEL Network. IEEE Transactions on Geoscience and Remote Sensing. 2012;50:1572–1586. doi: 10.1109/TGRS.2012.2186581. [DOI] [Google Scholar]
  • 94.Moghaddam M, 2016. Soil moisture profiles and temperature data from SoilSCAPE sites, USA. ORNL DAAC. [DOI]
  • 95.Chen N, et al. Cyber-Physical Geographical Information Service-enabled control of diverse in-situ sensors. Sensors. 2015;15:2565–2592. doi: 10.3390/s150202565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Marczewski W, et al. Strategies for validating and directions for employing SMOS data, in the Cal-Val project SWEX (3275) for wetlands. Hydrology and Earth System Sciences Discussions. 2010;7:7007–7057. doi: 10.5194/hessd-7-7007-2010. [DOI] [Google Scholar]
  • 97.Zacharias S, et al. A network of terrestrial environmental observatories in Germany. Vadose Zone Journal. 2011;10:955–973. doi: 10.2136/vzj2010.0139. [DOI] [Google Scholar]
  • 98.Schlenz F, dall’Amico JT, Loew A, Mauser W. Uncertainty assessment of the SMOS validation in the upper Danube catchment. IEEE Transactions on Geoscience and Remote Sensing. 2012;50:1517–1529. doi: 10.1109/TGRS.2011.2171694. [DOI] [Google Scholar]
  • 99.Bell JE, et al. U.S. Climate Reference Network soil moisture and temperature observations. J. Hydrometeorol. 2013;14:977–988. doi: 10.1175/JHM-D-12-0146.1. [DOI] [Google Scholar]
  • 100.Jackson TJ, et al. Validation of Advanced Microwave Scanning Radiometer soil moisture products. IEEE Transactions on Geoscience and Remote Sensing. 2010;48:4256–4272. doi: 10.1109/TGRS.2010.2051035. [DOI] [Google Scholar]
  • 101.Kirchengast G, Kabas T, Leuprecht A, Bichler C, Truhetz H. WegenerNet: A pioneering high-resolution network for monitoring weather and climate. Bull. Am. Meteorol. Soc. 2014;95:227–242. doi: 10.1175/BAMS-D-11-00161.1. [DOI] [Google Scholar]
  • 102.Petropoulos GP, McCalmont JP. An operational in situ soil moisture & soil temperature monitoring network for West Wales, UK: The WSMN network. Sensors. 2014;95:227–242. doi: 10.3390/s17071481. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Citations

  1. Costa JM, 2020. A soil moisture dataset over the Brazilian semiarid region. Mendeley Data. [DOI]
  2. O S, Orth R. 2021. Global soil moisture from in situ measurements using machine learning - SoMo.ml. figshare. [DOI] [PMC free article] [PubMed]
  3. Paulik, C, 2021. TUW-GEO/pytesmo: v0.10.0. Zenodo. [DOI]
  4. Cobley A, Hemment D, Rowan J, Taylor N, Woods M. 2020. Grow soil moisture data. GROW Observatory. [DOI]
  5. Moghaddam M, 2016. Soil moisture profiles and temperature data from SoilSCAPE sites, USA. ORNL DAAC. [DOI]

Supplementary Materials

Supplementary Information (1.3MB, pdf)

Data Availability Statement

The LSTM model implemented in this study and figure scripts are available from https://github.com/osungmin/SciData2021_SoMo_v1. Note that the LSTM model is built by adopting python modules obtained from https://github.com/kratzert/ealstm_regional_modeling.

Articles from Scientific Data are provided here courtesy of Nature Publishing Group

RESOURCES