Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2022 Oct 5;19(19):12719. doi: 10.3390/ijerph191912719

Detecting Metabolic Thresholds from Nonlinear Analysis of Heart Rate Time Series: A Review

Giovanna Zimatore 1,2,*, Maria Chiara Gallotta 3, Matteo Campanella 1, Piotr H Skarzynski 4,5,6, Giuseppe Maulucci 7,8,*, Cassandra Serantoni 7,8, Marco De Spirito 7,8, Davide Curzi 9, Laura Guidetti 9, Carlo Baldari 1, Stavros Hatzopoulos 10
Editor: Paul B Tchounwou
PMCID: PMC9564658  PMID: 36232025

Abstract

Heart rate time series are widely used to characterize physiological states and athletic performance. Among the main indicators of metabolic and physiological states, the detection of metabolic thresholds is an important tool in establishing training protocols in both sport and clinical fields. This paper reviews the most common methods, applied to heart rate (HR) time series, aiming to detect metabolic thresholds. These methodologies have been largely used to assess energy metabolism and to identify the appropriate intensity of physical exercise which can reduce body weight and improve physical fitness. Specifically, we focused on the main nonlinear signal evaluation methods using HR to identify metabolic thresholds with the purpose of identifying a method which can represent a useful tool for the real-time settings of wearable devices in sport activities. While the advantages and disadvantages of each method, and the possible applications, are presented, this review confirms that the nonlinear analysis of HR time series represents a solid, robust and noninvasive approach to assess metabolic thresholds.

Keywords: metabolic threshold, heart rate variability, sport, recurrence quantification analysis, nonlinear dynamic, Poincaré plot, wearable devices

1. Introduction

During incremental intensity exercises, metabolic changes are observed and therefore the identification of metabolic thresholds allows personalized workload prescription milestones to be assessed. According to the Skinner diagram [1], during increasing intensity exercise, three phases of the body’s energy usage and two threshold points might be established.

With increasing exercise intensity, the aerobic threshold (AerT) [1] describes the transition from aerobic metabolism (production of energy using oxygen) to anaerobic metabolism (production of energy without oxygen); the anaerobic threshold (AnT) [2] describes the transition in which an over-proportional increase in ventilation occurs as a result of increased carbon dioxide production. During incremental exercise, these thresholds suggest two different workloads. The first threshold (AerT) defines the upper limit of an almost exclusive aerobic exercise with a low blood lactate concentration (about 2 mM/l). The threshold AnT is related to the highest workload of maximal lactate production rate in a steady state, i.e., when the production and the removal of blood lactate concentration are in equilibrium (about 4 mM/l). From a practical point of view, the AerT detection is widely used both in medicine and in the sports fields, where the threshold detection is used for investigating sedentary subjects and the active recovery processes. On the contrary, the AnT detection concerns almost exclusively amateur and professional athletes, and its role is to create targeted training programs [3,4].

These thresholds are usually detected by ventilatory (gas exchange) or metabolic (blood lactate) parameters [2]. The gas exchange testing (cardiopulmonary exercise test, CPET) and the blood lactate sampling are the gold standards in threshold detection [5,6]. Threshold estimation occurs by assessing heart and lungs performance at rest and during exercise [7], or evaluating blood lactate concentration [4]. Despite their efficiency, the widespread use of these methods is severely impaired due to them being highly invasive (as they require blood draws) and impractical (as they require a laboratory equipped with specific devices and trained operators) [8].

Several papers have demonstrated the validity of analysis of heart rate temporal series during sports activities [9,10,11,12,13,14,15,16,17,18,19,20,21,22] (see Table A1 of Appendix A). This is an important advancement in the field allowing many of the limitations already reported to be overcome. Indeed, although HR is commonly detected by using a conventional ECG device that requires the use of on-body electrodes wired to a recorder [23], nowadays, a number of wearable smart devices (wrist, watch [24], phone [25], finger ring [26], etc.) are available, allowing the measurement of HR quickly, continuously and in all situations of everyday life including fitness activities. These devices optically detect HR trough measurements of volumetric changes of blood in a vein, usually located at the level of the wrist (photoplethysmography—PPG) [27]. The detection accuracy of some of these devices [28,29], that can also contextually detect position, velocity and acceleration, has been certified by the Food and Drug Administration (FDA).

Despite the undoubted advantage in using HR time series, we should note that, typically, data analysis techniques are based on the assumption of signal stationarity. However, the inherently nonstationary nature of HR [30], which physiologically changes continuously to adapt to external stimuli, may generate unreliable conclusions. Although several signal preprocessing methodologies have been proposed to overcome such issues [9,11,30,31,32,33,34], approaches based on nonlinear analysis appear to be the more common approach.

This review is structured as follows: in Section 2, the main characteristics of HR time series analysis are described. In Section 3, a comparison is presented among the most representative nonlinear methods, such as the Poincaré geometry [21], the Detrended Fluctuation Analysis (DFA) [16,35], the Entropy [36,37,38] and the Recurrence Quantification Analysis (RQA) [30,33]. In Section 4, the applications of these techniques in the detection of metabolic thresholds are reported. In Section 5, the advantages and limitations of these methods are presented. Finally, in the Appendix A there is a description of the statistical procedures used in each section.

2. Heart Rate Time Series Analysis

Heart physiology is one of the first areas in Biology where the ideas of complexity and deterministic chaos (familiar to studies in Physics) produced practical applications [31]. As previously mentioned, nonlinear methods of HR classification have been developed to highlight and emphasize HR nonlinear fluctuations.

The oscillation patterns of a healthy heart are complex and constantly changing, allowing the cardiovascular system to rapidly adjust the sudden physical and psychological challenges to homeostasis [30]. The autonomic nervous system (ANS) controls HR through the balancing action of the sympathetic (S) and the parasympathetic (PS) nervous system. Increased S or diminished PS activity results in cardiac acceleration. Conversely, a low S activity or a high PS activity causes cardiac deceleration [23,39]. An additional fine HR regulation is maintained by the respiratory control centers which modulate the vagal outflow in the brainstem [10,31,40]. In this context, HR and heart rate variability (HRV) are strictly regulated by ANS and can provide relevant details on its dynamics and control mechanisms. To analyze HR signals, feature-based time-domain methods, frequency-domain methods and non-linear time-domain methods are typically used.

2.1. Feature-Based Time-Domain Methods

The methods based on the analysis of the time evolution of an ECG signal or a beat-by-beat HR record (as a discrete time series, Figure 1) are termed as time-domain analysis methods.

Figure 1.

Figure 1

Heart rate variation (in beats per minute—bpm) of a healthy female subject during an incremental exercise (for more details see Appendix A.4).

HR record can be expressed in bpm (beats/minute), but the main descriptors of the time-domain analysis are expressed in the literature in terms of the RR interval (milliseconds, ms). RR is the distance between two successive R waves of the QRS signal on the electrocardiogram. Time-domain features are denominated as [23,40]:

  • RMSSD, the root mean square of difference between adjacent RR intervals

  • SDNN, the standard deviation of all RR intervals

  • SDSD or SDDS, the standard deviation of differences between adjacent RR intervals (or RR series)

  • MSD, the mean successive difference between adjacent RR intervals

  • MASD, the mean absolute successive difference between adjacent RR intervals

2.2. Frequency-Domain Methods

The power spectrum analysis techniques transform time series data into frequency-domain data. The fast Fourier transform (FFT) and the short time Fourier transform (STFT) are the most common power-spectrum analysis techniques [41,42]. These spectral methods require a mathematical manipulation of the data and large time series (i.e., large amounts of data points). Conventional analysis methods based on the Fourier transform technique are not very suitable for the analysis of non-stationary signals, since these signals change over time. The main principle of STFT consists in choosing a small enough window for analysis in which the signal can be considered stationary. Moreover, when slowly and rapidly changing transient events occur, the STFT introduces significant errors. As the analysis window of the time-domain data gets narrower, the time resolution and the assumption of stationarity is improved, but the frequency resolution is reduced.

Frequency-domain analysis can distinguish between high frequency (HF) and low frequency (LF) components in the data and can identify peaks related to autonomic control [43] (see Figure 2, the peaks in green and blue). Since the HF and the LF correspond to short and long-latency components in the HR time series, they can be, respectively, considered as qualitative indicators of sympathetic and parasympathetic activity [39].

Figure 2.

Figure 2

Spectral analysis of heart rate (HR) of a healthy female subject (the same as shown in Figure 1, for more details see Appendix A.4).

During heavy exercise (i.e., work intensity above AerT), there is a prevalence of HF components in contrast to LF components. The opposite effect has been observed during moderate exercise, i.e., prevalence of LF components compared to HF [18]. Unfortunately, during long-term recordings, there is a lower HR modulation stability which introduces significant difficulties in the interpretation of the frequency-domain analysis data. For this reason, time-domain methods are primarily used for data analysis.

To overcome the lower HR modulation stability, Cottin et al. (2004) [18] proposed a method where the mean high frequency peak (HFpeak, Hz) and the area of HF power (HFp, ms2) could be computed automatically from the spectrogram. Then, the HF product [18,44] can be estimated by multiplying the HFpeak (Hz) by HFp (ms2).

STFT and a time–frequency domain method were applied in the detection of the metabolic thresholds, and their applications are discussed in Section 4.

3. Nonlinear Analysis for HR Time Series

3.1. Poincarè Geometry

The Poincaré plot is a geometrical and nonlinear analysis method with numerous applications in different scientific domains [45], and it is extensively used for a qualitative visualization of the physiological signals involved [12,13,14]. It represents one of the most used methods in the assessment of heart rate dynamics in recent literature. In the review by Henriques et al. (2020) [34], it was reported that over 300 publications involving this analysis method on HR time series have been published, resulting in over 18,000 citations.

In the Poincaré plot, all values of a time series are plotted against previous values, leading to an ellipsoidal point cloud (Figure 3). Plot shapes can be categorized into functional classes to indicate cardiac functioning [13,15]. Moreover, this diagram may be analyzed quantitatively by the standard deviations of the distances RR–RR(i) to the lines y = x and y = −x + 2(RR–RRm), where RR–RRm is the mean of all RR–RR(i). The standard deviations are referred to as SD1 (green line) and SD2 (blue line) (Figure 3). Starting with the relationship between successive beats and the behavior of the heart, the graphic gives summary relevant information: the transverse axis of the ellipse (SD1) is a measure of the short-term changes in the RR intervals and is considered as an indicator of the parasympathetic activity; the longitudinal axis (SD2) reflects the long-term changes in the RR intervals, and it is considered as an inverse indicator of the sympathetic activity.

Figure 3.

Figure 3

(a) Poincaré plot of RR time series from a healthy subject at rest; (b) Poincaré plot of the same time series as in Figure 1 (for more details see Appendix A.4).

The correlations between SD1 and SD2 are enclosed into two important indices [12,31]: the sympathetic stress index (stress score = 1000/SD2) and the sympathetic–parasympathetic ratio (S/PS ratio = SD1/SD2), which have been recently described by Orellana et al. (2015) [23] in a longitudinal cohort study on soccer players.

One of the first Poincaré studies on HR (Tulppo et al. (1996) [12]) showed how this approach could provide useful relevant information of the HR dynamics during exercise, for events which are not easily detected by the conventional feature-based methods, such as during atropine administration and after a parasympathetic block.

Mourot et al. (2004) [13] have compared the traditional time and frequency-domain analysis assessment of HRV with the nonlinear Poincaré plot analysis of RR in healthy sedentary subjects, overtrained subjects, and trained subjects. This methodology was proposed to identify fatigue and/or to prevent an overtraining syndrome where a narrowing pattern was observed in the shape of the Poincaré plots. This distinctive shape formed by enhanced sympathetic and withdrawn parasympathetic activity was also detected in participants after supine and standing training, most likely due to increased parasympathetic activity.

Naranjo-Orellana et al. (2015) [15] proposed the Poincaré plot to evaluate the S/PS ratio for the follow-up of the individual assimilation of weekly workloads, using weekly recording of the HRV over a period of 10 min, and they discussed the validity of this method in monitoring the training status.

The Poincaré nonlinear method has many applications in the detection of the metabolic thresholds, as described in Section 4.

3.2. Detrended Fluctuation Analysis (DFA)

DFA is a useful algorithm that has proven useful in measuring the long-term autocorrelation of non-stationary time series. It can quantitatively characterize the complexity of the series using fractal theory [16,35,46].

In general, DFA measures the mean square deviation of a signal from its local trend line, on a variety of scales. The steps for the procedure are as follows:

  1. For a time series RR(i), the integrated time series y(k) can be expressed as:

y(k)=i=1k[RR(i)RR¯)] (1)

where RR(i) corresponds to the i-th point of the RR time series and the RR¯ is the average of all the points.

  • 2.

    The time interval is divided in windows with equal length n, to quantify the vertical characteristic scale of y(k);

  • 3.

    In each window n, a least-squares line is fit to the data (representing the trend in that window). The y-coordinate of the straight-line segments is denoted by yn(k). The integrated time series is detrended, y(k), by subtracting the local trend, yn(k), in each window (see Figure 1b in [35]).

  • 4.

    The root mean square fluctuation of the integrated and detrended time series is estimated by the formula:

F(n)=1Nk=1N[y(k)yn(k))]2 (2)

The procedure is repeated by dividing the time series into time-windows with different lengths. After that, the log-log scale of the F(n) versus the window size n is depicted. Representing the function F(n) in a log-log diagram, two parameters are defined: α1, as the slope of the regression line relating log(F(n)) to log (n) with n usually comprised in the interval from 4 to 16; α2, as the slope of the regression line relating log(F(n)) to log(n) with n in the interval from 16 to 64. The fractal dynamics of the time series are represented by the existence of a linear relation between F(n) and the number of parts. The value of α provides information about the series self-correlations:

  • if 0 < α < 0.5, then the process exhibits anti-correlations;

  • if α = 0.5, then the process is a random process, such as white noise;

  • if 0.5 < α <  1, then the process exhibits positive correlations;

  • if α= 1, a long-range correlation in the time-series occurs, corresponding to the typical 1/f noise, where f is the frequency. The 1/f slope of the log(power) vs. log(frequency) plot was obtained from a linear regression;

  • if α > 1, then the process is non-stationary;

  • if α  =  1.5, the process represents a random walk such as Brownian noise.

The slope values, α1 (or DFA-α1) for long correlation (in green) and α2 (or DFA-α2) for short correlation (in blue), are shown in Figure 4.

Figure 4.

Figure 4

Detrended Fluctuation Analysis (DFA) of RR time series from a healthy subject (the same as shown in Figure 1, for more details see Appendix A.4).

The potentiality of DFA on HR analysis was confirmed by Goya-Esteban (2012) [19], who suggested how this nonlinear method could assess relevant information about physiological recovery, which is the time period between the end of exercise and the subsequent return to resting state in an all-out exercise test in eight male amateur triathletes, during and after high intensity exercise.

Chen et al. (2015) [16] introduced an innovative time-varying parameter called the cardiac stress index (CSI), which is similar to the stress score introduced in the Poincaré plot explanation. The CSI is defined as the ratio of the number of events with α < 1 to the total number of events, and it may be used to represent the progressive status of cardiac stress continuously and quantitatively.

The DFA method was shown to have relevant applications in the detection of metabolic thresholds [47,48], and the information is presented in Section 4.

3.3. Entropy

Entropy quantifies the degree of order in a signal (regular, predictable, and limited complexity systems produce signals with low entropy). Two main entropy measurements can be used to assess the complexity of biological signals, such as heart rate, respiration, or EEG signals [49]. These are approximate entropy (ApEn) [50,51] and sample entropy (SampEn) [38]. Sample entropy (SampEn) is a modification of the approximate entropy (ApEn), introduced for the first time by Pincus (1991) [36], and used for assessing the complexity of physiological time series signals. In the following, the definitions of these measurements are provided.

3.3.1. Approximate Entropy (ApEn)

A brief description of the algorithm for computing approximate entropy is reported. Starting from a time series of RR intervals of length N, the maximum absolute difference between their respective scalar components is calculated as the distance D[Xi,Xj] between vectors Xi and Xj, where Xi = [RRi, RRi+1… RRi+m−1] is the i-th vector of length m constructed from the N RR intervals RR1, RR2, …, RRN. For each vector Xi, Bi is the relative number of vectors Xj, (with j = 1,2, N − m + 1) for which D[Xi,Xj] ≤ r, where r is a tolerance value (or “radius” in the following); then, Cim(r) is computed.

The count Bj(r) is the number of vectors Xm(j) within r of Xm+1(i), and Cim(r) is defined as the ratio:

Cim(r)=Bj(r)Nm+1 (3)

By taking natural logarithm of each Cim(r), the index Φm(r) is reckoned:

Φm(r)=1Nm+1i=1Nm+1ln Cim(r)  (4)

Finally, ApEn expresses the logarithmic probability that the signal repeats within the tolerance of r for both m and m+1 points.

ApEn(m,r,N)=Φm(r)Φm+1(r) (5)

Higher ApEn values suggest a more complex time series structure [37,49,50,51,52].

3.3.2. Sample Entropy (SampEn)

The SampEn is a modification of the approximate entropy (ApEn) since (i) the self-matches are excluded in the calculation of Bj(r), and (ii) to ensure that the number of RR intervals used for Bj(r)m is the same as the number of RR intervals available for Bj(r)m+1, for a fixed m, only the first N–m RR intervals in Xj of length m are used for calculating j(r)m+1:

Cim(r)=Bj(r)mNm (6)
Cim+1(r)=Bj(r)m+1Nm+1 (7)

Cim(r) is an estimate for the probability that two different sequences of RR intervals will match for m points, whereas Cim+1(r) estimates for the probability that two different sequences will match for m+1 points.

SampEnm(r)=ln Cim+1(r)Cim(r)  (8)

The sample entropy is essentially the negative logarithm of the ratio of the probability that any two different sequences in a time series match for m points to the probability that any two different sequences in the time series match for m + 1 points [47]. Since Cim+1(r) will always be smaller or equal to Cim(r), SampEn will always be either zero or positive. A smaller value of SampEn in the time series indicates more self-similarity in the time series or less noise.

In a descriptive longitudinal cohort studied by Orellana et al. (2015) [35], the behavior of SampEn during a work accumulation overtime (i.e., throughout the season) was observed in high level athletes (soccer players). The group values of SampEn were always above 1, and with a clear tendency for stability throughout the season.

For our knowledge, there are no reports in the literature of any entropy applications in the detection of the metabolic thresholds.

3.4. Recurrence Quantification Analysis (RQA)

Statistical methods have been widely used to assess signals generated by adaptive biological systems, by using different approaches to describe physiological changes, including ANS activity, in terms of phase transitions [30,53].

RQA is a statistical, graphical and analytical tool [30,32] for studying nonlinear dynamical systems that has been effectively applied in a variety of fields, including physiology [10,54,55,56], earthquakes geoscience [57,58] and finance [59]. RQA was shown to be a reliable technique in analyzing the chaotic and stochastic dynamics of the physiological signals [60].

The procedure to obtain the RQA measures is briefly described here below:

Starting from a time series of RR intervals, the vectors Xi= (RRi, RRi+τ,…, RRi+(m−1)·τ), with i = 1,…, K, with K = [N − (m − 1)×τ)], are defined, where m is the embedding dimension and τ is the embedding lag. RRi represents the RR value corresponding to the i-th time position. Then, the series was arranged in successive columns (the columns number is defined by the embedding dimension m), each one obtained by applying a delay in time (lag parameter) to the original sequence, thus creating an embedding matrix, as in Equation (9) (for τ =2).

[RR1RR3 RR2RR4RRN]=[e1,1e1,2 e1,me2,1e2,2e2,me3,meN2m+2,1eN2m+2,2eN2m+2,m] (9)

The embedding matrix is generated by representing the series in column format (RRi in left side) and copying it into m consecutive columns, each one displaced by a number τ of points (e1,1 = RR1, e1,2 = RR3…, on the right side).

If the distance between the j-th and i-th rows of the embedding matrix is smaller than a predetermined value (known as the radius or cut-off [30,61,62]), the value 1 is associated to the element (i,j) of the distance matrix. If instead of associating a binary value, the value of the distance is associated, the distance matrix is called an unthresholded recurrence plot (Figure 5). The horizontal and vertical axes of the recurrence plot are the i and j indexes.

Figure 5.

Figure 5

Unthresholded recurrence plot of the RR time series (ms) (light blue line) recorded as a breath-by-breath, from a cardiopulmonary exercise test (CPET) device (Cosmed, Rome, Italy). The red and green lines show the change of pattern at the first and second threshold, respectively. On the horizontal and vertical axes, the j-th and i-th indices are reported, respectively. (For more details see in Appendix A.3 and Appendix A.4).

The number and placement of dots (called recurrence points) on the graph are used to calculate the RQA measures (Figure 5, on the left side). The percentage of determinism (DET) and laminarity (LAM) are two main parameters that quantify the specific characteristics of the time series.

The percent of determinism (DET) is the percentage of recurrence points which form diagonal lines (l), and it indicates the degree of deterministic structure of the signal. It is usually an indicator of regime changes and phase transitions [63]:

DET=l=lminKl P(l)l=1Kl P(l) (10)

where P(l) is the histogram of diagonal lines l in the RP and lmin is the minimal considered length of a diagonal line; laminarity (LAM) is the percentage of recurrence points forming vertical line segments in the recurrence plot and indicates the fraction of laminar phases (intermittency) in the tested system:

LAM=l=vminKv P(v)l=1Kv P(v) (11)

where P(v) is the histogram of vertical lines v in the RP, and vmin is the minimal considered length of a vertical line. More details can be found in [62,63,64] and [9,30,31].

The investigation of the evolution of the RQA measures over time was obtained by using windows that are shifted along the RP’s major diagonal (the RQ epoch-by-epoch method is called RQE). This allows the detection of transitions in dynamical systems in different application fields [45,57,58,59,60,61,62]. DET and LAM reckoned by RQE are used for metabolic threshold detection in [65] and in [66] (see Section 4.2.2). From a theoretical point of view, the ability of RQA to predict abrupt changes is in line with the fact that RQA is based upon changes in the correlation structure of the observed phenomenon that is known to precede the actual event. In the Figure 5, three different patterns are recognizable.

Gorban et al. (2010) [67] studied the behavior of systems approaching a critical transition in a wide range of conditions ranging from physiology to ecology and finance. In all these cases, they observed that a drastic increase of the internal correlation, together with an increase in variance, appeared before the crisis symptoms. The RQA is totally independent from stationarity constraints; it does not need long streams of data and it is focused on the quantification of correlation structure of the studied dynamics. For these reasons, it is particularly suited to locate transition behavior in signals.

RQA is a statistical approach that converges to the same results of theoretical ones [68,69,70] without the need of any a priori hypothesis [71]. In the last few years, new papers have used the same or similar language to describe noise-induced critical transitions in natural, social and technological systems, which can lead to detrimental system breakdowns [70]. Statistical physics concepts and methods are commonly used in the complex natural system, such as the Earth, as recently discussed in Fan et al. (2021) [72]; Pitsik et al. (2020) [54] reported that the RQA method was developed to numerically investigate EEG by using various complexity measurements. Recently, Hasselman (2022) [71] explained that the common purpose of RQA is to characterize the dynamics presented during the observation time, rather than to infer a true model, process or estimate a population model parameter.

One of the first applications of RQA on RR time series suggested that the cardiac age may be revealed from healthy individual tachograms (RR time series) [31]. This approach has successfully predicted the age of a hundred participants based on a gradual increase in the deterministic character of the heartbeat. This allowed for the development of a simple and comprehensive model of the aging effect on cardiac dynamics: HR dynamics become more predictable (constrained) on a beat-by-beat basis as age proceeds [31]. Hoshi et al. investigated the HR complexity of healthy and young individuals after recovery from maximal exercise [29]. The regularity of the HR rhythm was shown to increase after maximal exercise, while the signal’s complexity decreased throughout the recovery phase. After 80 min, these conditions progressively reverted to rest levels and reached recovery. Singh [17] found that the RQA complexity index can significantly discriminate between age groups even from small data sets. These results corroborate the findings of previous studies [9,10,31].

The RQA enabled a robust method to identify laminar states and their transitions to a regular as well as to other chaotic regimes in complex systems [65]. Indeed, these transitions can be only qualitatively distinguished by spectral analysis.

RQA analysis was recently included in different commercial or open-source software such as Kubios [73], RHRV [74] and RR-APET [75]. Physionet, a web portal containing an extensive database of physiologic signals as well as software tools [76], has already announced the possibility to perform different HRV analysis. Additional software tools for HR analysis are reported in a paper by Rodriguez-Linares et al. (2014) [77].

As it is shown in Section 4, some differences occur when the test is performed in a laboratory or in an open field setup, where the experimental constraints are controlled with more difficulty. For example, a lower accuracy in the data collection was observed to have a considerable impact on the derived results.

In summary, RQA measures can successfully describe variations in ANS activity and localize dynamical transitions [65,66]. The encouraging applications on metabolic thresholds detection will be discussed in the next section.

4. HR Time Series Analysis for Detection of Metabolic Thresholds during Exercise

In this section we describe the application of the HR time series analysis methods for the detection of the metabolic thresholds, and their applications. HRV is the most used measure. A comprehensive and clear explanation of investigations concerning the interrelation between HRV and ANS is reported by Dong (2016) [76], who examined how the application of HRV on physical exercise may play a significant role in sports physiology. HRV can be considered a performance indicator, such as the VO2max, the power, the rating of perceived exertion (RPE) and the blood lactate concentration (BLa), which classify individuals and set their training zones [77]. Furthermore, in HRV studies related to metabolic thresholds and exercise physiology on athletes, it is needed to describe accurately the analysis methods, the population samples, the training protocols and the intensity and duration schedules [78,79]. Buchheit (2007) [80] stated that most of the contradictory findings are due to methodological flaws and/or data misinterpretation, rather than limits of HR measurements to effectively inform on training status.

The 13 papers selected by using Covidence Online Software (see Additional info of Appendix A.4) regarding the detection of metabolic thresholds through HRV analysis are presented in chronological order in Table 1. In the following sections, we will distinguish feature- based methods (4.1) and non-linear methods (4.2) for the detection of metabolic thresholds. The original name chosen by authors for the parameters are generally conserved in the text.

Table 1.

HR and metabolic thresholds.

Authors Subjects Physical
Exercise
HR Detection Methods Statistical
Validation
Gold Standard
Buchheit et al., 2007 [81] 72 Trained boys, runners Treadmill CPET
Chest belt Polar T61; watch Polar 810s
Spectral analysis
HFp and (ln fHFm./HFp)
HRVT2 vs. HRDP
for VO2 r = 0.88 *; for HR r = 0.85 *
Gas exchange
Karapetian et al., 2008 [82] 24 Healthy adults Cyclergometer Watch and chest belt
Polar Vantage XL
Time analysis
SDNN, MSD
HRVT1 vs. VT1 for VO2 r = 0.89;
HRVT 2 vs. LT2 for VO2 r = 0.82
Gas exchange
Blood lactate
Quinart et al., 2013 [83] 20 Obese adolescents Cyclergometer CPET
Chest belt and watch
Polar 810s
Spectral analysis
HFp and (ln fHFm./HFp)
Time analysis RMSSD
HRT1 at VT1
for HR r = 0.91 ** 95% CI (0.84–0.95);
HRT2 at VT2
for HR r = 0.91 ** 95% CI (0.83–0.95)
Gas exchange
Cassirame et al., 2015 [84] 9 Healthy adults ski-mountaineers Alpine skiing track Chest belt Polar T61; portable recorder FRWD B100 Time–frequency analysis
fHF × HFp
HRT2 vs. VT2
for HR r = 0.91;
for speed r = 0.92
for HR small LoA (3.6 bpm)
Gas exchange
Vasconcellos et al., 2015 [85] 35 Adolescents (15 obese) Cyclergometer CPET
Chest belt and watch
Polar TM RS800cx
Time analysis RMSSD HRVT1 vs. VT1
for VO2 from r = 0.89 ** and test–retest reliability r = 0.59 *
Gas exchange
Ribeiro et al., 2018 [86] 13 Young soccer players Treadmill CPET
Chest belt and watch
Polar F11 HRM
Graphics analysis (shift of RR interval) HRVT2 vs. VT2
for time r = 0.84 *;
for HR r = 0.97 *;
for VO2 r = 0.97 *
Gas exchange
Nascimento et al., 2019 [87] 19 Male runners Maximal incremental running test (MIRT) Chest belt and watch
Polar 810s
Poincaré plot, DFA (Dmax) No correlation for HR1 at LT1 for HR; HRT2 at LT2 for HR r = 0.71 **;
HRT1 at LT1 for speed r = 0.46 *, 95% CI (0.9–1.9); HRT2 at LT2;
for speed r = 0.48 * 95% CI (0.8–1.6)
Blood lactate
Novelli et al., 2019 [88] 68 Untrained subjects Cyclergometer Chest belt and watch Polar RS800CX
RRinterval
Time analysis, Poincaré plot
RMSSD and SD1
No significant difference (p < 0.05) between the test and retest for any of the variables.
All variables at HRVT1 and the heart rate at HRVT2 showed CV ~10%.
Gas exchange
Zimatore et al., 2020 [65] 20 Obese adults Treadmill CPET
Chest belt Polar RS 400
RQA HRVT1 vs. VT1
for time r = 0.70 **; for speed r = 0.84 **;
no statistically significant differences (p < 0.05) for time, speed, VO2, and MFO;
Gas exchange
Stergiopoulos et al., 2021 [89] 15 Healthy adults Treadmill, multistage running test (MSRT) ECG TEL100, MP 100A Biopac Time and apectral analysis
HFP
no statistically significant differences between the running speed at VT2 and EDRT (F (2,28) = 0.83, p = 0.45, η2 = 0.05) Gas exchange
Zimatore et al., 2021 [66] 31 Healthy adolescents Cyclergometer CPET
Chest belt
Garmin ^ HRM-Dual™
RQA HRVT1 vs. VT1
for HR r = 0.87 *;
for workload r = 0.95; for VO2 r = 0.91 *;
HRVT2 vs. VT2, for HR r = 0.89;
for workload r = 0.97; for VO2 r = 0.97
Gas exchange
Rogers et al., 2021 [90] 17 Male adults Treadmill Chest belt Polar H7 DFA HRVT1 vs. VT1
for HR r = 0.96 **;
HRVT2 vs. VT2
for HR r = 0.78 **;
Gas exchange
Afroundeh et al., 2021 [91] 103 Young males Treadmill Chest belt Polar T31 DFA, modified Dmax HRVT1 at LT1
for HR ICC = 0.88 **;
for speed ICC = 0.40 **
Blood lactate

For sake of simplicity, the first and the second thresholds obtained by HR are named HRVT1 and HRVT2, respectively; those obtained by the gas exchange method are named VT1 and VT2, those obtained by blood lactate method are named LT1 and LT2; HRDP is HR obtained by the HR deflection point; LoA, limits of agreement; MFO, maximal fat oxidation (* p < 0.05; ** p < 0.001). * In the first column, the first author ref. is reported; ^ Olathe, KS, USA.

4.1. Feature-Based Methods for the Detection of Metabolic Threshold

Buchheit et al. (2007) [81] used spectral analysis and compared the accuracy of the HR deflection point (HRDP) and the second HR variability threshold (HRVTh2) to predict anaerobic threshold (AnT) in 72 boys during an incremental test to exhaustion. The test was conducted on a treadmill with the grade set at 1%; the initial velocity was 6.0 km/h and was linearly increased by 1 km/h every minute. A chest belt was used to continuously record beat-to-beat HR during exercise. The deflection point was determined from slope trends of successive linear regressions. HRVTh2 was visually determined from the high frequency’s peak HFp and power density trends (ln fHFm./HFp); the VSFT method was carried out with a 64-s moving window and a time shift of 3 s. No differences were found in VO2 or HR, and a significant relationship between these variables at AnT was found (HRVTh2 versus HRDP r = 0.88 and r = 0.85 for VO2 and HR, respectively, p < 0.001)

Taking into account the original RR intervals, the standard deviation of the RR interval (SDNN) was found to be closely related to the AerT, but no verification studies have been conducted [82]; in this context, Karapetian’s study (2008) [82] has demonstrated a marked RR interval deflection point in the stage of exercise when the lactate threshold took place (determined via the BLa blood levels). Twenty-four adults performed a graded maximal test on a cyclergometer; the exercise intensity started at 25 W, and every 3 min the intensity increased at 25 W increments. The RR intervals of the last 2 min of each stage were used for the analysis of HRV. Time-domain indices such as the standard deviation (SDNN), the mean successive difference (MSD) and the mean absolute difference between consecutive RR intervals have been shown to strongly correlate with the vagal tone during the exercise (r = 0.87 and 0.92, respectively; p < 0.001). The visual detection of the HRV threshold (HRVT) consists of searching for the HRV deflection point using the MSD method, which was calculated for each exercise stage. To determine the HRVT, the MSD and SDNN of HR intervals for each stage of exercise were graphically plotted against the work rate. The results for the determination of HRVT during incremental exercise testing, using RR interval data, showed similarities in VO2 (L/min) values between LT detection and HRVT detected by the HRV deflection point. (HRVT1 vs. VT1 r = 0.89 for VO2, and HRVT2 vs. LT2 r = 0.82 for VO2, p < 0.001)

In 15 healthy young soccer players, Stergiopoulos et al. (2021) [89] explored the feasibility of estimating the second ventilatory threshold VT2 (AnT) through different HR variability indices during an incremental laboratory test and a multistage shuttle run test (MSRT) until exhaustion. ANOVA, p = 0.45, found no statistically significant differences between VT2 and the threshold established using both the high frequency product (HFp) and ECG-derived respiration (EDR) (see the Appendix A session, for EDR). The incremental test was conducted on a treadmill with 1-min phases and a starting speed of 8.0 km/h. Up until exhaustion, the speed increment between each stage was 0.5 km/h.

The patients ran back and forth on an indoor wooden surface between two 20-m markers as part of a one-minute procedure for the MSRT. This test was divided into 1-min sections with a starting speed of 8.0 km/h and 0.5 km/h increments every minute. The second ventilatory threshold was determined to be the point of the first abrupt increase in HFp after it had reached a minimum (followed by variable values) (HRVT2).

Quinart et al. (2014) [83] used both time-domain and frequency-domain analyses to estimate AerT and AnT from HRV in their investigation of metabolic threshold detection; the root mean square of successive differences (RMSSD) was performed using the RR intervals of the last 60 s of each stage in an incremental exercise test on a cycle ergometer. The RMSSD values move on a decreasing curve until they reach a point of stabilization. A higher correlation with the gold standard (gas exchanged) was found in 20 obese adolescents.

First and second thresholds (HRVTS1 and HRVTS2) were calculated using time-varying (average value every 3 s) functions that, respectively, corresponded to the first non-linear increase after reaching a minimum and to the last abrupt increase of the function ln(fHFm *HFp). To remove artifacts, HF peaks were modelled using a third order equation (fHFm). For both thresholds, a high Pearson’s correlation was obtained (HRT1 vs. VT1 r = 0.91, 95CI % (0.84–0.95) for HR and HRT2 vs. VT2 r = 0.91 95% CI (0.83–0.95) for HR (p < 0.001)).

One of the rare studies based on the “field” tests was the study performed on a skiing track described by Cassirame et al., 2015 [84], where the skiing track was 950 m long with an ascent of 168 m and an average gradient of 9.1°. The skiers began at 3 km/h and the speed was increased by 0.5 km/h every minute until exhaustion. Beat-by-beat RR intervals were recorded by the Polar® T61 sensors, respectively. The metabolic threshold was estimated by fHF*HFp and was compared with the VT1 and VT2 averaged values (for every 10 s), estimated by the “respiratory equivalent” method [2]. HFp and the product of fHF*HFp were plotted against time; the first threshold estimate (VT1fH) was determined as the first abrupt increase in fHF*HFp after it had reached a minimum, while the second threshold (VT2fH) corresponded to the final abrupt increase [44]. Cassirame et al., (2015) [84] found high correlations between HRT2 vs. VT2 for HR (r = 0.91) and speed (r = 0.92), with small limits of agreement LoA (3.6 bpm for HR). The gas exchanged (being the gold standard) were valued by a portable measurement system (Cosmed K4b2, Rome, Italy) [92].

Vasconcellos et al. (2015) [85] estimated the anaerobic threshold HRVT1 by analyzing the RMSSD values of RR intervals within each 60 s stage, through CPET in 35 adolescent subjects (in whom 15 were obese). Their methodology followed the same approach used by Quinart (2014) [83]. The HRVT1 was defined as a HRV deflection point, below which there was no-further reduction in the RMSSD values (suggesting a parasympathetic withdrawal). The initial load in CPET was set at 25 W with an increment of 10 W/min until exhaustion. Correlations between HRVT1 and the gold standard (gas exchanged) VT1 for VO2 and VO2 reserve ranged from 0.89 to 0.95 (p < 0.001), and test–retest reliability ranged from 0.59 to 0.82 (p < 0.006).

Due to its strong connection with the inhibition of the vagal and activation of the sympathetic ANS, HRV can even predict the second metabolic threshold (AnT).

Ribeiro et al. (2018) [86] identified the second threshold in 15 young soccer players, at the point where the RR time series shifted during the incremental test CPET. The data were independently identified by two researchers. A ramp protocol was applied with an initial velocity of 7 km/h and increments of 1 km/h every minute until exhaustion. Even in this work, the gas exchange method was used as the gold standard technique. A Polar® F11 chest belt was used to record the HR simultaneously to physical exercise. The RR intervals were determined by applying the equation: RR = 60000/HR. The HRV second threshold (here named RRiT2 = HRVT2) was independently identified, by two researchers, at the point where there was a shift in the RR curve. Ribeiro et al. (2018) [86] found positive correlations for all parameters predicted at the AnT (for time r = 0.84; for HR r = 0.97 and for VO2 r = 0.97), and they observed that those values were lower than those determined by the gold standard.

In summary, these studies applied linear methods and were mainly conducted in laboratory conditions; only a few studies were based on the “field” tests, and they used the gas exchange method as the gold standard. All studies used a chest belt to collect heart rate time series. Since different test protocols and different statistical methods were used, comparison is difficult; however, further useful information about research questions can be extracted from the obtained limitations.

4.2. Nonlinear Methods for the Detection of Metabolic Threshold

4.2.1. Poincaré Plots and DFA for the Detection of Metabolic Threshold

By using Poincaré Plots, all measures of HR vagal modulation progressively decreased until the ventilatory threshold level was reached when sympathetic activation was reflected as changes in the SD1/SD2 ratio [87,88]. Nascimento et al. (2019) [87] have applied the Dmax method to estimate the lactate threshold (AnT), during a maximal incremental running test. They proposed a new approach based on SD1 and SD2 by using the Dmax method firstly introduced by Cheng et al. (1992) [93]. The Dmax method calculates the point that yields the maximal distance from a curve representing the ventilatory and the metabolic variables as a function of oxygen uptake (VO2) to the black line formed by the two end points (orange) of the curve (Figure 6).

Figure 6.

Figure 6

How the threshold (lowest red point) is determined by the Dmax method: it is estimated by the longest perpendicular distance between SD1 (predicted by a third order polynomial function over actual value) from the linear regression calculated with the first and last values of the curve. The speed (km/h) corresponds to the treadmill velocity.

The AerT and AnT were estimated during a maximal incremental running test in 19 male runners [87]. All participants used a cardio belt for beat-to-beat heart rate measurements. The treadmill test started at 8 km/h, which was increased by 1 km/h every 3 min, until exhaustion. The HR was recorded continuously throughout the assessment. RR interval data were estimated from the last 60 s of each stage of exercise. The gold standard used blood lactate methods. The identification of LT1 by the Dmax method on HRV data was demonstrated, and no statistically significant differences were observed between test and re-test (p = 0.55). For additional details, see Table 1.

Novelli et al. (2019) [88] evaluated the reproducibility of the HRVT by different HRV indexes (RMSSD and SD1) in 68 untrained young individuals, tested twice (non-consecutive days with a 72-h interval, maximum incremental cycle ergometer test): no significant differences were found (p < 0.05) between the test and retest for any of the variables evaluated. The test started with a workload of 15 W which was increased by 15 W per minute, keeping 60 RPM until volitional exhaustion. The RR intervals were recorded continuously (by Polar® RS800CX); the metabolic thresholds were determined with these two criteria: the first one was identified by the physical effort intensity where the values of the SD1 and RMSSD index were < 3 ms and were < 1 ms, respectively.

Another example of the Dmax method is the work of Afroundeh et al. (2021) [91]. They assessed the agreement between HR deflection point (HRDP) variables with the gold standard (maximal lactate steady state, MLSS, at second threshold), in young males with different body mass indices (classified in four different groups). The HRDP was determined using a modified Dmax method. The 103 young male subjects were tested via a standard running incremental protocol, with an individualized speed increment from 0.3 to 1.0 km/h. Beat-by-beat HR (sampling rate of 1 Hz) was measured continuously during the exercise tests by Polar® T31 sensor. If the individual was more active and/or of normal weight, the speed increment was set to a higher limit in order to enable him to stay within the target completion time of 12–16 min. If the subject was obese, the speed increment was of 0.3 km/h. A good agreement was observed between HRDP and MLSS for HR for all participants (p < 0.001).

In Rogers et al. (2021) [90], the short-term scaling exponent α1 determined by DFA has been shown to steadily change with increasing exercise intensity. The study included data from 17 male adults, via an incremental treadmill test. The speed and inclination started from 2.7 km/h at a 10% grade, increased by 1.3 km/h and 2% grade every 3 min, until exhaustion. It was found that an α1 value of 0.75 was directly associated with the first ventilatory threshold and an α1 value of 0.50 with the second one. This is a rare situation where a fixed value was suggested as a means to identify the thresholds. Based on the Bland–Altman analysis and linear regression, a strong agreement between VT and HRVT measured by HR (for the first threshold r = 0.96, p < 0.001; for the second threshold r = 0.78, p < 0.001) was found.

4.2.2. RQA for the Detection of Metabolic Thresholds

Recently, the RQA has proposed a simple landscape where a description of the cardio-respiratory physiological coupling is available under an increasing physical effort in terms of complexity and dynamical transitions. The change in the RP pattern was evident in Figure 5 (as in Figure 7 of [65] and Figure 1 of [66]). The RQA-based approach was validated, using both determinism (DET) and laminarity (LAM), to identify the ventilatory thresholds [65,66]: the assessment of the AerT threshold (red line in Figure 5) occurs upon the identification of a DET minimum (DETmin) confirmed by the corresponding minimum of LAM (LAMmin). The AnT threshold (green line Figure 5) is detected when the DET value reaches a saturation plateau [66]. In the epoch-by-epoch analysis (the window size was w = 100 data points), the delay in the embedding procedure (lag) was set to 1, the embedding dimension was 7, the cut-off distance (radius) was 50 and the diagonal and vertical line minimum was 4 (l min = v min). The RQA was used to detect the first metabolic threshold [65] from HRV during a graded incremental physical exercise. The epoch-by-epoch analysis permitted the detection of a chaos-order transition of the time series dynamic, which corresponded to the aerobic threshold. Additional results were obtained in subjects with different levels of fitness, and it was demonstrated that even the second threshold is detectable by RQA from HR [66]. The ordinary least products (OLP) regression analysis showed that, at both thresholds, the RQA and the gold standard methods (gas exchanged) had very strong correlations (r > 0.8) across all variables (HR, VO2 and workload).

In summary, it can be observed that the different studies reported in this section were characterized by a higher homogeneity in the protocol of physical exercises tests and in the starting hypotheses. In the following paragraph, a detailed explanation about their main limitations will be presented, showing the use of non-linear methods in new applications offered by the synergic complement between nonlinear methods and “big data” approaches. The first results (real time monitoring) can be implemented in the near future in wearable devices.

5. Known Issues in Using Nonlinear Methods

This section discusses some relevant issues in the evaluation of the metabolic thresholds from HR data by nonlinear analyses (Figure 7):

  • (i)

    The intrinsic individual variability of the subject and the dependence by his/her fitness level and the body mass status;

  • (ii)

    The accumulated sampling error and the noise levels of the devices used to record the HR data (sampling rate, motion, for both ECG or HR beat-by-beat monitor);

  • (iii)

    The intrinsic features of the recorded signal, as non-stationarity or the trend;

  • (iv)

    The dependence on the parametric values for the chosen analysis method (i.e., input values chosen for the algorithms, type of detrending, etc.).

Figure 7.

Figure 7

From the subject to the method: a presentation of the principal limitations in the HR data processing. In the insets: ECG, Experimental set: treadmill and facemask, Quark RMR-CPET Cosmed, Rome, Italy.

A significant limitation in HR time series analysis is the high individual variability. The individual variability of the cardiac signal is a common problem of all physiological systems. In RQA-based methods, individual amplitude differences do not disturb the time series features, given each single RQA is auto-scaled on its proper standard deviation. The possible sources of uncertainty in determining the thresholds may originate from the exercise protocol, used to produce a specific workload, and that is also related to the subject’s fitness level. As it is explained in the introduction, the stationary hypothesis is an intrinsic limitation in most of the techniques of analysis used, except for DFA and RQA.

There are various reasons why the different approaches have been found to be inefficient in determining metabolic thresholds, even if the relevant aspects generally concern the quality of the acquired signals. The epoch-by-epoch analysis with sliding windows was used to observe the change of complexity in time [66], and it was useful even in reducing the noise where, in the incremental exercises, the workload changed every 60 s [65]. The epoch-by-epoch analysis was carried out on superimposed windows of 100 points, shifted by one point (about 2 s) [66].

Another issue in the HRV analysis during incremental exercises is the presence of a trend that can cover subtle but fundamental structures of the signal. In previous studies [65,66], the authors have analyzed HRV recorded during incremental physical exercise by a chest strap (Polar® sensor, connected with the device Quark RMR-CPET Cosmed™, Rome, Italy), and a strong linear correlation with the linear increase of the workload was found. To remove this trend, a linear fit to detrend HR data was chosen; since it is a robust approach avoiding data overfitting analysis, initial rest and recovery (the test is sub-maximal, thus the VO2max values were excluded) were not considered; the equation of the trend line was found and, from the original time series, the theoretical one was subtracted point by point: in this way, the final new series corresponded to a detrended signal [65,66].

Another interesting issue was raised by Henriques et al. (2020) [34]. They discussed the fact that most algorithms are parametric; therefore, the choice of the input parameters can influence the results. The procedure to mitigate this limitation is to run the algorithms with different input parameter values and choose those maximizing the differences in the observed output measurements.

A variety of computational approaches have been developed to assist specialists in providing an objective and time-efficient determination of ventilatory thresholds; however, the currently existing algorithms require pre-processing actions and are extremely sensitive to the signal-to-noise ratio.

Recently, an alternative approach to detect thresholds, but not including the HR time series, was proposed by Zignoli et al. 2020 [94]. CPET data interpretation has been improved using artificial intelligence (AI) technologies such as machine learning. This approach could reduce evaluation errors and the variability of interpretations across different experts and centers. It is built on a network of internationally recognized professionals in the field of ventilatory thresholds by CPET. Previously collected datasets are utilized to train a convolutional neural network for the interpretation of new data files. Since it would be impossible to evaluate the impact of an inaccurate evaluation on the whole algorithm performance, this approach can be nowadays used only in parallel with human visual inspection.

6. Conclusions

The gold standards methodologies adopted to detect metabolic thresholds [1,2] suffer from major application limitations that severely restrict their dissemination to large segments of the population.

To overcome some of these limitations, complementary and alternative procedures based on the analysis of HR time series have been suggested. The rationale behind these approaches lies in the observation that metabolic adaptation due to external stimuli is mediated through a complex regulation of cardiovascular and cardiorespiratory systems.

Cardiovascular and cardiorespiratory systems very likely interact with each other in a nonlinear way that can be detected by monitoring HR during an incremental physical exercise [9,32,62,95]. Indeed, under the hypothesis that fatigue is a conscious interpretation of the homoeostatic, centrally controlling mechanisms [66], it can be considered an order parameter in the chaos–order transition [65].

Time-domain descriptors of HR dynamics, such as RMSSD, HF or SD1 of the Poincaré plot, can be determined and have been proved to provide relevant insight into cardiac parasympathetic regulation [13,32,39,52]. Accordingly, the cardiac sympathetic activity that generates highly nonstationary rapid responses cannot be described by standard HR time series data analysis methods [52].

In addition, as several nonlinear methods (DFA and RQA) do not request stationarity, long data series and pre-processing data manipulation have been largely adopted to monitor physical exercise and to detect metabolic thresholds.

In a sports-context, the short- and long-term DFA components well describe the complexity, although short-term components have been found to be more reliable than the long-term ones [47,48,52,96]. DFA α1 has been also used to evaluate aerobic and anaerobic threshold [87,88,89,90]. This method is reliable in determining thresholds and independent on test protocols/workout, but requires a strong preprocessing of HRV data to avoid artefacts.

Moreover, RQA-based methods have been adopted to explore HR response during incremental exercise for the localization of metabolic transitions [65,66]. These approaches, while requiring minimal data preprocessing and allowing an immediate visual localization of the metabolic transitions, were found to be robust and reliable. The threshold points can also be quantitatively determined as they correspond to an abrupt change in determinism and laminarity, detected by DETmin and LAMmin, respectively, in the epoch-by-epoch RQA procedure (see the Appendix A.3). At both thresholds, OLP regression analysis had very strong correlations between RQA and the gold standard across HR, VO2 and workload.

In conclusion, the nonlinear analysis of HR time series can be considered a valid alternative metric to assess metabolic thresholds providing easy-to-read and -use parameters to medical and paramedical staff. Furthermore, since HR data can be easily acquired by many low-cost devices, including smartwatches, the large widespread usage of nonlinear analysis of HR time series for a personalized evaluation of fitness level and planning/monitoring of training or rehabilitation procedures can be reasonably expected.

Acknowledgments

Sourced studies were imported into Covidence Online Software (Covidence systematic review software, Veritas Health Innovation, Melbourne, Australia. Available at [97]). Covidence is a comprehensive literature review and screening software package, offering data extraction capabilities and comparison of different datasets among researchers. It was used just in the early stage of this review [98]. Two independent reviewers screened studies (starting from two main keywords: “heart rate” and “metabolic thresholds”) for relevance based on titles/abstracts and later full texts (M.C.G, G.Z.), with disagreements resolved through discussion or by consulting a third reviewer (M.D.S.).

Abbreviations

HR heart rate
HRV heart rate variability
HRVT heart rate variability threshold
CPET cardiopulmonary exercise test
ECG electrocardiography
AerT aerobic threshold
AnT anaerobic threshold
ANS autonomic nervous system
S sympathetic activity
PS parasympathetic activity
CSI cardiac stress index
SD1 standard deviation of instantaneous beat-to-beat interval variability
SD2 standard deviation of continuous long-term R–R interval variability
DFA detrended fluctuation analysis
ApEn approximate entropy
RQA recurrence quantification analysis
DET percent of determinism
FFT fast Fourier transform
HF high frequencies
LF low frequencies
VO2 oxygen consumption
Ln(rMSSD) natural logarithm of root mean square standard deviation
BLa blood lactate production

Appendix A

Table A1.

Research article reporting relationships between HR time series features and physical exercise.

Authors Physical Exercise Non-Linear Method
Marwan et al., 2002 [9] Cycling RQA
Censi et al., 2002 [10] Resting RQA
Auber et al., 2003 [11] Cyclergometer Frequency analysis
Tulppo et al., 1996 [12] Cyclergometer Poincaré plot
Mourot et al., 2004 [13,14] Cyclergometer Poincaré plot
Orellana et al., 2015 [15] Soccer Descriptive analysis
Chen et al., 2015 [16] Cyclergometer DFA
Singh 2019 [17] Resting RQA, ApEn
Cottin et al., 2004 [18] Cyclergometer Frequency analysis
Goya-Esteban et al., 2012 [19] Cyclergometer DFA
Wittstein et al., 2019 [20] Treadmill DFA
Hoshi et al., 2016 [21] Soccer, basketball, handball RQA
Blasco-Lafarga et al., 2017 [22] Cyclergometer DFA

In the first column, the first author [ref] is reported.

Appendix A.1. Statistical Analysis, Accuracy and Reliability

To study the reliability and accuracy of the data (from a detection or a results’ analysis), many statistical tools can be applied. Accuracy refers to the closeness between the estimated value and the (unknown) true value. Assessing the accuracy of an estimate involves evaluating the error associated with an estimate; thus, it is evaluated in terms of the potential sources of error that differ across datasets. Reliability refers to the closeness of the initial estimated value(s) to the subsequent ones. Assessing reliability involves comparing estimates over time.

The Student’s t-test and Wilcoxon test were typically employed to compare two classes of parametric data after the Shapiro–Wilkcoxon test was performed to determine the normality of the data. Following various graded levels of discriminating, the Pearson correlation index r or the more comprehensive methods, such as ANOVA, can be utilized to uncover even small variations between groups.

The intraclass correlation coefficient (ICC: mixed two-way) was used to test relative reproducibility, and the standard error of measurement (SEM), which measures the precision of individual test scores and is derived from the mean-squared error (MSE) from repeated measures, was used to test absolute reproducibility. When comparing more than two classes or groups, an ANOVA was performed (SEM = √MSE), utilizing the participant’s coefficient of variation (CV = (standard deviation/mean) × 100). In addition, the minimal difference detectable, or MDD, which is the smallest change ascribed to a true difference between repeated measurements, was computed (MDD = 1.96 2 × SEM).

The Bland–Altman plot, r Pearson correlation, and t test coupled analysis methods were used to examine the agreement between two procedures, on conformance to the gold standard (gas exchange or bloody lactate status), or between the test and retest.

Appendix A.2. Electrocardiogram Derived Respiration (EDR)

Electrocardiogram derived respiration (EDR) algorithms were initially developed in response to the need for an indirect extraction of respiration and the interest in a simultaneous investigation of the respiratory and cardiac systems [99]. The primary benefit of them is the ability to derive a surrogate respiratory signal using only standard electrocardiogram (ECG) equipment, eliminating the need for commonly used respiration recording devices, which are typically bulky and expensive, in addition to having the potential to interfere with natural breathing. In the literature, different algorithms were presented for eliciting the respiratory information from the ECG signal.

Appendix A.3. Determinism and Laminarity Epoch-by-Epoch

Figure A1.

Figure A1

Top panel: the same picture as Figure 5. Bottom panel: the percentage of recurrence points which form diagonal lines (DET) and the percentage of recurrence points which form vertical lines (LAM) epoch by epoch vs. time (min:sec) of detrended RR interval of Figure 5 (light blue line), recorded as a breath-by-breath, from a CPET device (Cosmed, Rome, Italy), in the sub-maximal test where the workload changed every 60 s. The red line highlights the statistically relevant minimum that corresponds to the AerT, and the green line corresponds to the AnT where the percent of determinism reaches saturation (see Appendix A.4).

Appendix A.4. Software for Creating Figures

Figure 1, Figure 2, Figure 3 and Figure 4 were obtained specifically for this review by pyHRV, a toolbox for heart rate variability (HRV) written in Python [100].

Figure 5 and Figure A1 were obtained specifically for this review by RQA software ver.14.1 [101].

Author Contributions

Conceptualization, M.D.S., G.Z. and M.C.G.; software, M.C.G. and G.Z.; investigation, M.C. and C.S.; writing—original draft preparation, M.D.S., G.Z., D.C., M.C. and C.S.; writing—review and editing, S.H., C.S., G.M., G.Z. and S.H.; visualization, C.S., S.H. and P.H.S.; supervision, C.B., P.H.S., L.G., G.M, G.Z. and M.D.S. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research received no external funding.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Skinner J.S., McLellan T.H. The transition from aerobic to anaerobic metabolism. Res. Q. Exerc. Sport. 1980;51:234–248. doi: 10.1080/02701367.1980.10609285. [DOI] [PubMed] [Google Scholar]
  • 2.Meyer T., Lucía A., Earnest C.P., Kindermann W. A conceptual framework for performance diagnosis and training prescription from submaximal gas exchange parameters--theory and application. Int. J. Sports Med. 2005;26:S38–S48. doi: 10.1055/s-2004-830514. [DOI] [PubMed] [Google Scholar]
  • 3.Baldari C., Videira M., Madeira F., Sergio J., Guidetti L. Lactate removal during active recovery related to the individual anaerobic and ventilatory thresholds in soccer players. Eur. J. Appl. Physiol. 2004;93:224–230. doi: 10.1007/s00421-004-1203-5. [DOI] [PubMed] [Google Scholar]
  • 4.Faude O., Kindermann W., Meyer T. Lactate threshold concepts: How valid are they? Sports Med. 2009;39:469–490. doi: 10.2165/00007256-200939060-00003. [DOI] [PubMed] [Google Scholar]
  • 5.Sales M.M., Sousa C.V., da Silva Aguiar S., Knechtle B., Nikolaidis P.T., Alves P.M., Simões H.G. An integrative perspective of the anaerobic threshold. Physiol. Behav. 2019;205:29–32. doi: 10.1016/j.physbeh.2017.12.015. [DOI] [PubMed] [Google Scholar]
  • 6.Poole D.C., Rossiter H.B., Brooks G.A., Gladden L.B. The anaerobic threshold: 50+ years of controversy. J. Physiol. 2021;599:737–767. doi: 10.1113/JP279963. [DOI] [PubMed] [Google Scholar]
  • 7.Pettitt R.W., Clark I.E., Ebner S.M., Sedgeman D.T., Murray S.R. Gas exchange threshold and VO2max testing for athletes: An update. J. Strength Cond Res. 2013;27:549–555. doi: 10.1519/JSC.0b013e31825770d7. [DOI] [PubMed] [Google Scholar]
  • 8.Mankowski R.T., Michael S., Rozenberg R., Stokla S., Stam H.J., Praet S.F. Heart-Rate Variability Threshold as an Alternative for Spiro-Ergometry Testing: A Validation Study. J. Strength Cond Res. 2017;31:474–479. doi: 10.1519/JSC.0000000000001502. [DOI] [PubMed] [Google Scholar]
  • 9.Marwan N., Wessel N., Meyerfeldt U., Schirdewan A., Kurths J. Recurrence-plot-based measures of complexity and their application to heart-rate-variability data. Phys. Rev. 2002;E66:026702. doi: 10.1103/PhysRevE.66.026702. [DOI] [PubMed] [Google Scholar]
  • 10.Censi F., Calcagnini G., Cerutti S. Coupling patterns between spontaneous rhythms and respiration in cardiovascular variability signals. Comput. Methods Programs Biomed. 2002;68:37–47. doi: 10.1016/S0169-2607(01)00158-4. [DOI] [PubMed] [Google Scholar]
  • 11.Aubert A.E., Seps B., Beckers F. Heart rate variability in athletes. Sports Med. 2003;33:889–919. doi: 10.2165/00007256-200333120-00003. [DOI] [PubMed] [Google Scholar]
  • 12.Tulppo M.P., Makikallio T.H., Takala T.E., Seppanen T.H., Huikuri H.V. Quantitative beat-to-beat analysis of heart rate dynamics during exercise. Am. J. Physiol-Heart C. 1996;271:H244–H252. doi: 10.1152/ajpheart.1996.271.1.H244. [DOI] [PubMed] [Google Scholar]
  • 13.Mourot L., Bouhaddi M., Perrey S., Cappelle S., Henriet M.T., Wolf J.P., Rouillon J.D., Regnard J. Decrease in heart rate variability with overtraining: Assessment by the Poincaré plot analysis. Clin. Physiol. Funct. Imaging. 2004;24:10–18. doi: 10.1046/j.1475-0961.2003.00523.x. [DOI] [PubMed] [Google Scholar]
  • 14.Mourot L., Bouhaddi M., Perrey S., Rouillon J.-D., Regnard J. Quantitative Poincaré plot analysis of heart rate variability: Effect of endurance training. Eur. J. Appl. Physiol. 2004;91:79–87. doi: 10.1007/s00421-003-0917-0. [DOI] [PubMed] [Google Scholar]
  • 15.Orellana N.J., De la Cruz B., Sarabia E., Del Hoyo M., Domínguez S. Two new indexes for the assessment of autonomic balance in elite soccer players. Int. J. Sports Physiol. Perform. 2015;10:452–457. doi: 10.1123/ijspp.2014-0235. [DOI] [PubMed] [Google Scholar]
  • 16.Chen S.W., Liaw J.W., Chang Y.J., Chan H.L., Chiu L.Y. A cycling movement-based system for real-time muscle fatigue and cardiac stress monitoring and analysis. PLoS ONE. 2015;10:e0130798. doi: 10.1371/journal.pone.0130798. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Singh V. A unified nonlinear approach based on recurrence quantification analysis and approximate entropy: Application to the classification of heart rate variability of age-stratified subjects. Med. Biol Eng Comput. 2019;57:741–755. doi: 10.1007/s11517-018-1914-0. [DOI] [PubMed] [Google Scholar]
  • 18.Cottin F., Médigue C., Leprêtre P.M., Papelie R.Y., Koralsztein J.P., Billat V. Heart rate variability during exercise performed below and above ventilatory threshold. Med. Sci. Sports Exerc. 2004;36:594–600. doi: 10.1249/01.MSS.0000121982.14718.2A. [DOI] [PubMed] [Google Scholar]
  • 19.Goya-Esteban R., Barquero-Pérez O., Sarabia-Cachadina E., de la Cruz-Torres B., Naranjo-Orellana J., Rojo-Alvarez J.L. Heart rate variability non linear dynamics in intense exercise. Comp Cardiol. 2012;39:177–180. [Google Scholar]
  • 20.Wittstein M.W., Starobin J.M., Schmitz R.J. Cardiac and gait rhythms in healthy younger and older adults during treadmill walking tasks. Aging Clin. Exp. Res. 2019;31:367–375. doi: 10.1007/s40520-018-0962-5. [DOI] [PubMed] [Google Scholar]
  • 21.Hoshi R.A., Pastre C.M., Vanderlei L.C.M., Godoy M.F. Recurrence Plots and Their Quantifications: Expanding Horizons. Springer; Cham, Switzerland: 2016. Assessment of heart rate complexity recovery from maximal exercise using recurrence uantification analysis; pp. 157–168. [Google Scholar]
  • 22.Blasco-Lafarga C., Camarena B., Mateo-March M. Cardiovascular and autonomic responses to a maximal exercise test in elite youngsters. Int. J. Sports Med. 2017;38:666–674. doi: 10.1055/s-0043-110680. [DOI] [PubMed] [Google Scholar]
  • 23.Malik M., Bigger J.T., Camm A.J., Kleiger R.E., Malliani A., Moss A.J., Schwartz P.J. Heart rate variability: Standards of measurement, physiological interpretation, and clinical use. Eur. Heart J. 1996;17:354–381. doi: 10.1093/oxfordjournals.eurheartj.a014868. [DOI] [PubMed] [Google Scholar]
  • 24.Plews D.J., Scott B., Altini M., Wood M., Kilding A.E., Laursen P.B. Comparison of heart rate variability recording with smartphone photoplethysmography, Polar H7 Chest Strap, and Electrocardiography. Int. J. Sports Physiol. Perform. 2017;12:1324–1328. doi: 10.1123/ijspp.2016-0668. [DOI] [PubMed] [Google Scholar]
  • 25.Bellenger C.R., Miller D., Halson S.L., Roach G., Sargent C. Wrist-based photoplethysmography assessment of heart rate and heart rate variability: Validation of WHOOP. Sensors. 2021;21:3571. doi: 10.3390/s21103571. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Cao R., Azimi I., Sarhaddi F., Niela-Vilen H., Axelin A., Liljeberg P., Rahmani A.M. Accuracy assessment of Oura ring nocturnal heart rate and heart rate variability in comparison with electrocardiography in time and frequency domains: Comprehensive analysis. J. Med. Internet Res. 2022;24:e27487. doi: 10.2196/27487. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Nuuttila O.P., Korhonen E., Laukkanen J., Kyröläinen H. Validity of the wrist-worn Polar Vantage V2 to measure heart rate and heart rate variability at rest. Sensors. 2022;22:137. doi: 10.3390/s22010137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Bayoumy K., Gaber M., Elshafeey A., Mhaimeed O., Dineen E.H., Marvel F.A., Martin S.S., Muse E.D., Turakhia M.P., Tarakji K.G., et al. Smart wearable devices in cardiovascular care: Where we are and how to move forward. Nat. Rev. Cardiol. 2021;18:581–599. doi: 10.1038/s41569-021-00522-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Hernando H., Roca S., Sancho J., Alesanco Á., Bailón R. Validation of the apple watch for heart rate variability measurements during relax and mental stress in healthy subjects. Sensors. 2018;18:2619. doi: 10.3390/s18082619. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Marwan N., Romano M.C., Thiel M., Kurths J. Recurrence plots for the analysis of complex systems. Phys. Rep. 2007;438 doi: 10.1016/j.physrep.2006.11.001. [DOI] [Google Scholar]
  • 31.Giuliani A., Piccirillo G., Marigliano V., Colosimo A. A nonlinear explanation of aging-induced changes in heartbeat dynamics. A. J. Physiol-Heart C. 1998;C 275:H1455–H1461. doi: 10.1152/ajpheart.1998.275.4.H1455. [DOI] [PubMed] [Google Scholar]
  • 32.Acharya U.R., Joseph K.P., Kannathal N., Lim C.M., Suri J.S. Heart rate variability: A review. Med. Bio. Eng. Comput. 2006;44:1031–1051. doi: 10.1007/s11517-006-0119-0. [DOI] [PubMed] [Google Scholar]
  • 33.Webber C.L., Zbilut J.P. Dynamical assessment of physiological systems and states using recurrence plot strategy. J. Appl. Physiol. 1994;76:965. doi: 10.1152/jappl.1994.76.2.965. [DOI] [PubMed] [Google Scholar]
  • 34.Henriques T., Ribeiro M., Teixeira A., Castro L., Antunes L., Costa-Santos C. Nonlinear Methods Most Applied to Heart-Rate Time Series: A Review. Entropy. 2020;22:309. doi: 10.3390/e22030309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Peng C.K., Havlin S., Stanley H.E., Goldberger A.L. Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series. Chaos. 1995;5:82–87. doi: 10.1063/1.166141. [DOI] [PubMed] [Google Scholar]
  • 36.Pincus S.M. Approximate entropy as a measure of system complexity. Proc. Natl. Acad. Sci. USA. 1991;88:2297–2301. doi: 10.1073/pnas.88.6.2297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Mesin L. Estimation of complexity of sampled biomedical continuous time signals using approximate entropy. Front. Physiol. 2018;11:710. doi: 10.3389/fphys.2018.00710. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Richman J.S., Moorman J.R. Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol. Circ. Physiol. 2000;278:H2039–H2049. doi: 10.1152/ajpheart.2000.278.6.H2039. [DOI] [PubMed] [Google Scholar]
  • 39.Schumacher A. Linear and nonlinear approaches to the analysis of RR interval variability. Biol. Res. Nurs. 2004;5:211–221. doi: 10.1177/1099800403260619. [DOI] [PubMed] [Google Scholar]
  • 40.Shaffer F., Ginsberg J.P. An Overview of Heart Rate Variability Metrics and Norms. Front. Public Health. 2017;5:258. doi: 10.3389/fpubh.2017.00258. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Chatfield C. The Analysis of Time Serie. 6th ed. Chapman & Hall; New York, NY, USA: 2003. Chapter 7. [Google Scholar]
  • 42.Sorensen H.V., Jones D.L., Heideman M.T., Burrus C.S. Real-valued fast Fourier transform algorithms. IEEE Trans Signal Process. 1987;35:849–863. doi: 10.1109/TASSP.1987.1165220. [DOI] [Google Scholar]
  • 43.Ekelund L.G. The Beat-by-Beat Investigation of Cardiovascular Function: Measurement, Analysis and Applications. Oxford University Press; New York, NY, USA: 1987. [Google Scholar]
  • 44.Cottin F., Médigue C., Lopes P., Leprêtre P.M., Heubert R., Billat V. Ventilatory thresholds assessment from heart rate variability during an incremental exhaustive running test. Int. J. Sports Med. 2007;28:287–294. doi: 10.1055/s-2006-924355. [DOI] [PubMed] [Google Scholar]
  • 45.Voss A., Schulz S., Schroeder R., Baumert M., Caminal P. Methods derived from nonlinear dynamics for analysing heart rate variability. Philos. Trans. Royal Society A. 2008;367:277–296. doi: 10.1098/rsta.2008.0232. [DOI] [PubMed] [Google Scholar]
  • 46.Buchheit M., Laursen P.B. High-Intensity Interval Training, Solutions to the Programming Puzzle: Part II: Anaerobic Energy, Neuromuscular Load and Practical Applications. Sports Med. 2013;43:927–954. doi: 10.1007/s40279-013-0066-5. [DOI] [PubMed] [Google Scholar]
  • 47.Gronwald T., Hoos O., Ludyga S., Hottenrott K. Nonlinear dynamics of heart rate variability during incremental cycling exercise. Res. Sports Med. 2019;27:88–98. doi: 10.1080/15438627.2018.1502182. [DOI] [PubMed] [Google Scholar]
  • 48.Gronwald T., Hoos O. Correlation properties of heart rate variability during endurance exercise: A systematic review. Ann Noninvasive Electrocardiol. 2020;25:e12697. doi: 10.1111/anec.12697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Alù F., Miraglia F., Orticoni A., Judica E., Cotelli M., Rossini P.M., Vecchio F. Approximate entropy of brain network in the study of hemispheric differences. Entropy. 2020;22:1220. doi: 10.3390/e22111220. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Zhang X.D., Shen B. Entropy for the Complexity of Physiological Signal Dynamics. Adv. Exp. Med. Biol. 2017;1028:39–53. doi: 10.1007/978-981-10-6041-0_3. [DOI] [PubMed] [Google Scholar]
  • 51.Melillo P., Bracale M., Pecchia L. Nonlinear Heart Rate Variability features for real-life stress detection. Case study: Students under stress due to university examination. Biomed. Eng. Online. 2011;10:96. doi: 10.1186/1475-925X-10-96. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Michael S., Graham K.S., Davis G.M. Cardiac autonomic responses during exercise and post-exercise recovery using heart rate variability and systolic time intervals—A review. Front Physiol. 2017;8:301. doi: 10.3389/fphys.2017.00301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Laborde S., Mosley E., Thayer J.F. Heart rate variability and cardiac vagal tone in psychophysiological research–recommendations for experiment planning, data analysis, and data reporting. Front. Psychol. 2017;8:213. doi: 10.3389/fpsyg.2017.00213. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Pitsik E., Frolov N., Hauke Kraemer K., Grubov V., Maksimenko V., Kurths J., Hramov A. Motor execution reduces EEG signals complexity: Recurrence quantification analysis study. Chaos. 2020;30:023111. doi: 10.1063/1.5136246. [DOI] [PubMed] [Google Scholar]
  • 55.Zimatore G., Cavagnaro M., Skarzynski P.H., Fetoni A., Hatzopoulos S. Detection of age-related hearing losses (ARHL) via transient-evoked otoacoustic emissions. Clin. Interv. Aging. 2020;15:1–9. doi: 10.2147/CIA.S252837. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Zimatore G., Cavagnaro M. Recurrence Analysis of Otoacoustic Emissions. In: Marwan N., Webber C.L., editors. Recurrence Quantification Analysis: Theory and Best Practices. Springer; Cham, Switzerland: 2015. pp. 253–278. [Google Scholar]
  • 57.Lin M., Zhao G., Wang G. Recurrence quantification analysis for detecting dynamical changes in earthquake magnitude time series. Int. J. Modern Phys. C. 2015;26:1550077. doi: 10.1142/S0129183115500771. [DOI] [Google Scholar]
  • 58.Chelidze T., Matcharashvili T. Dynamical Patterns in Seismology. In: Marwan N., Webber C.L., editors. Recurrence Quantification Analysis: Theory and Best Practices. Springer; Cham, Switzerland: 2015. pp. 259–335. [Google Scholar]
  • 59.Addo P.M., Billio M., Guegan D. Nonlinear dynamics and recurrence plots for detecting financial crisis. N. Am. J. Econ. Financ. 2013;26:416–435. doi: 10.1016/j.najef.2013.02.014. [DOI] [Google Scholar]
  • 60.Araújo N.S., Reyes-Garcia S.Z., Brogin J., Bueno D.D., Cavalheiro E.A., Scorza C.A., Faber J. Chaotic and stochastic dynamics of epileptiform-like activities in sclerotic hippocampus resected from patients with pharmacoresistant epilepsy. PLoS Comp. Biol. 2022;18:e1010027. doi: 10.1371/journal.pcbi.1010027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Marwan N., Webber C.L. Mathematical and computational foundations of Recurrence Quantification. In: Marwan N., Webber C.L., editors. Recurrence Quantification Analysis: Theory and Best Practices. Springer; Cham, Switzerland: 2015. pp. 3–43. [Google Scholar]
  • 62.Zbilut J.P., Thomasson N., Webber C.L. Recurrence quantification analysis as a tool for nonlinear exploration of nonstationary cardiac signals. Med. Eng. Phys. 2002;24:53–60. doi: 10.1016/S1350-4533(01)00112-6. [DOI] [PubMed] [Google Scholar]
  • 63. [(accessed on 9 September 2022)]. Available online: http://www.recurrence-plot.tk/rqa.php.
  • 64.Trulla L., Giuliani A., Zbilut J.P., Webber C.L., Jr. Recurrence quantification analysis of the logistic equation with transients. Phys. Lett. A. 1996;223:255–260. doi: 10.1016/S0375-9601(96)00741-4. [DOI] [Google Scholar]
  • 65.Zimatore G., Gallotta M.C., Innocenti L., Bonavolontà V., Ciasca G., De Spirito M., Guidetti L., Baldari C. Recurrence quantification analysis of heart rate variability during continuous incremental exercise test in obese subjects. Chaos. 2020;30:033135. doi: 10.1063/1.5140455. [DOI] [PubMed] [Google Scholar]
  • 66.Zimatore G., Gallotta M.C., Bonavolontà V., Falcioni L., Campanella M., De Spirito M., Guidetti L., Baldari C. Recurrence quantification analysis of heart rate variability to detect both ventilatory thresholds. PLoS ONE. 2021;16:e0249504. doi: 10.1371/journal.pone.0249504. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Gorban A.N., Smirnova E.V., Tyukina T.A. Correlations, risk and crisis: From psychology to finance. Phys. A. 2010;389:3193–3217. doi: 10.1016/j.physa.2010.03.035. [DOI] [Google Scholar]
  • 68.Scheffer M., Bascompte J., Brock W.A., Brovkin V., Carpenter S.R., Dakos V., Held H., Van Nes E.H., Rietkerk M., Sugihara G. Early-warning signals for critical transitions. Nature. 2009;461:53–59. doi: 10.1038/nature08227. [DOI] [PubMed] [Google Scholar]
  • 69.Lenton M., Livina V.N., Dakos V., van Nes E.H., Scheffer M. Early warning of climate tipping points from critical slowing down: Comparing methods to improve robustness. [(accessed on 1 October 2022)];Philos. Trans. Math. Phys. Eng. Sci. 2012 370:1185–1204. doi: 10.1098/rsta.2011.0304. Available online: https://www.jstor.org/stable/41348438. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Ma J., Xu Y., Li Y., Tian R., Kurths J. Predicting noise-induced critical transitions in bistable systems. Chaos. 2019;29:081102. doi: 10.1063/1.5115348. [DOI] [PubMed] [Google Scholar]
  • 71.Hasselman F. Early warning signals in phase space: Geometric resilience loss indicators from multiplex cumulative recurrence networks. Front Physiol. 2022;13:859127. doi: 10.3389/fphys.2022.859127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Fan J., Meng J., Ludescher J., Chen X., Ashkenazy Y., Kurths J., Havlin S., Schellnhuber H.J. Statistical physics approaches to the complex Earth system. Phys. Rep. 2021;896:1–84. doi: 10.1016/j.physrep.2020.09.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Tarvainen M.P., Niskanen J.P., Lipponen J.A., Ranta-Aho P.O., Karjalainen P.A. Kubios HRV–heart rate variability analysis software. Comput. Meth. Prog. Biomed. 2014;113:210–220. doi: 10.1016/j.cmpb.2013.07.024. [DOI] [PubMed] [Google Scholar]
  • 74.García A., Otero J.M., Presedo X.A., Félix P. A Software Toolkit for Nonlinear Heart Rate Variability Analysis; Proceedings of the Computing in Cardiology Conference (CinC); Zaragoza, Spain. 22–25 September 2013; [(accessed on 1 October 2022)]. pp. 393–396. Available online: http://rhrv.r-forge.r-project.org/ [Google Scholar]
  • 75.McConnell M., Schwerin B., So S., Richards B. RR-APET-Heart rate variability analysis software. Comput. Methods Programs Biomed. 2020;185:105127. doi: 10.1016/j.cmpb.2019.105127. [DOI] [PubMed] [Google Scholar]
  • 76.Physionet. [(accessed on 9 September 2021)]. Available online: https://www.physionet.org.
  • 77.Rodriguez-Linares L., Lado M.J., Vila X.A., Mendez A.J., Cuesta P. gHRV: Heart rate variability analysis made easy. Comput. Met. Prog. Biomed. 2014;116:26–38. doi: 10.1016/j.cmpb.2014.04.007. [DOI] [PubMed] [Google Scholar]
  • 78.Dong J.G. The role of heart rate variability in sports physiology. Exp. Ther. Med. 2016;11:1531–1536. doi: 10.3892/etm.2016.3104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Giovanelli N., Scaini S., Billat V., Lazzer S. A New Field Test to Estimate the Aerobic and Anaerobic Thresholds and Maximum Parameters. Eur. J. Sport Sci. 2020;20:437–443. doi: 10.1080/17461391.2019.1640289. [DOI] [PubMed] [Google Scholar]
  • 80.Buchheit M. Monitoring training status with HR measures: Do all roads lead to Rome? Front. Phys. 2014;5:73. doi: 10.3389/fphys.2014.00073. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Buchheit M. Heart-Rate Deflection Point and the Second Heart-Rate Variability Threshold during Running Exercise in Trained Boys. Ped. Exer. Sci. 2007;19:192–204. doi: 10.1123/pes.19.2.192. [DOI] [PubMed] [Google Scholar]
  • 82.Karapetian G.K., Engels H.J., Gretebeck R.J. Use of heart rate variability to estimate LT and VT. Int. J. Sports Med. 2008;29:652–657. doi: 10.1055/s-2007-989423. [DOI] [PubMed] [Google Scholar]
  • 83.Quinart S., Mourot L., Negre V., Simon-Rigaud M.L., Nicolet-Guénat M., Bertrand A.M., Meneveau N., Mougin F. Ventilatory thresholds determined from HRV: Comparison of 2 methods in obese adolescents. Int J Sports Med. 2014;35:203–208. doi: 10.1055/s-0033-1345172. [DOI] [PubMed] [Google Scholar]
  • 84.Cassirame J., Tordi N., Fabre N., Duc S., Durand F., Mourot L. Heart rate variability to assess ventilatory threshold in ski-mountaineering. Eur. J. Sport Sci. 2015;15:615–622. doi: 10.1080/17461391.2014.957729. [DOI] [PubMed] [Google Scholar]
  • 85.Vasconcellos F., Seabra A., Montenegro R., Cunha F., Bouskela E., Farinatti P. Can heart rate variability be used to estimate gas exchange threshold in obese adolescents? Int. J. Sports Med. 2015;36:654–660. doi: 10.1055/s-0034-1398654. [DOI] [PubMed] [Google Scholar]
  • 86.Pereira U.R., Ribeiro G.S., Lopes A.L. Can Heart Rate Variability Predict the Second Metabolic Threshold in Young Soccer Players? Int. J. Exer. Sci. 2018;11:1105–1111. [Google Scholar]
  • 87.Nascimento E.M.F., Antunes D., do Nascimento Salvador P.C., Borszcz F.K., de Lucas R.D. Applicability of Dmax Method on Heart Rate Variability to Estimate the Lactate Thresholds in Male Runners. J. Sports Med. 2019;2019:1–9. doi: 10.1155/2019/2075371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Novelli F.I., de Araújo J.A., Tolazzi G.J., Tricot G.K., Arsa G., Cambri L.T. Reproducibility of Heart Rate Variability Threshold in Untrained Individuals. Int. J. Sports Med. 2019;40:95–99. doi: 10.1055/a-0800-8633. [DOI] [PubMed] [Google Scholar]
  • 89.Stergiopoulos D.C., Kounalakis S.N., Miliotis P.G., Geladas N.D. Second Ventilatory Threshold Assessed by Heart Rate Variability in a Multiple Shuttle Run Test. Int. J. Sports Med. 2021;42:48–55. doi: 10.1055/a-1214-6309. [DOI] [PubMed] [Google Scholar]
  • 90.Rogers B., Giles D., Draper N., Hoos O., Gronwald T. New Detection Method Defining the Aerobic Threshold for Endurance Exercise and Training Prescription Based on Fractal Correlation Properties of Heart Rate Variability. Front. Physiol. 2021;11:596567. doi: 10.3389/fphys.2020.596567. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91.Afroundeh R., Hofmann P., Esmaeilzadeh S., Narimani M., Pesola A.J. Agreement between heart rate deflection point and maximal lactate steady state in young adults with different body masses. Physiol. Int. 2019;108:137–150. doi: 10.1556/2060.2021.00004. [DOI] [PubMed] [Google Scholar]
  • 92.Guidetti L., Meucci M., Bolletta F., Emerenziani G.P., Gallotta M.C., Baldari C. Validity, reliability and minimum detectable change of COSMED K5 portable gas exchange system in breath-by-breath mode. PLoS ONE. 2018;13:e0209925. doi: 10.1371/journal.pone.0209925. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Cheng B., Kuipers H., Snyder A.C., Keizer H.A., Jeukendrup A., Hesselink M. A new approach for the determination of ventilatory and lactate thresholds. Int J Sports Med. 1992;13:518–522. doi: 10.1055/s-2007-1021309. [DOI] [PubMed] [Google Scholar]
  • 94.Zignoli A., Fornasiero A., Rota P., Muollo V., Peyré-Tartaruga L.D.A., Low F.Y., Fontana D., Besson M., Pühringer S., Ring-Dimitriou S., et al. Oxynet: A collective intelligence that detects ventilatory thresholds in cardiopulmonary exercise tests. Eur. J. Sport Sci. 2020;22:425–435. doi: 10.1080/17461391.2020.1866081. [DOI] [PubMed] [Google Scholar]
  • 95.Marwan N. A historical review of recurrence plots. Eur. Phys. J. Spec. Top. 2008;164:3–12. doi: 10.1140/epjst/e2008-00829-1. [DOI] [Google Scholar]
  • 96.Casadei B., Cochrane S., Johnston J., Conway J., Sleight P. Pitfalls in the interpretation of spectral analysis of the heart rate variability during exercise in humans. Acta Physiol. Scand. 1995;153:125–131. doi: 10.1111/j.1748-1716.1995.tb09843.x. [DOI] [PubMed] [Google Scholar]
  • 97.Covidence. [(accessed on 9 September 2022)]. Available online: https://www.covidence.org/
  • 98.Cleo G., Scott A.M., Islam F., Julien B., Beller E. Usability and acceptability of four systematic review automation software packages: A mixed method design. Syst Rev. 2019;8:145. doi: 10.1186/s13643-019-1069-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Moody G.B., Mark R.G., Zoccola A., Mantero S. Derivation of respiratory signals from multi-lead ECGs. Comput. Cardiol. 1985;12:113–116. [Google Scholar]
  • 100.Highlights—pyHRV—“OpenSource Python Toolbox for Heart Rate Variability 0.4 Documentation”. [(accessed on 1 October 2022)]. Available online: https://pyhrv.readthedocs.io/en/latest/index.html.
  • 101.RQC.exe and RQE.exe files belong to RQA ver. 8.1 are included in RQA software ver.14.1. 2012. [(accessed on 1 October 2022)]. Available online: http://cwebber.sites.luc.edu.

Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES