Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2024 Nov 19;19(11):e0313919. doi: 10.1371/journal.pone.0313919

Concurrent validity of novel smartphone-based apps monitoring barbell velocity in powerlifting exercises

Alexander Renner 1,*,#, Benedikt Mitter 2,#, Arnold Baca 1,#
Editor: Gianpiero Greco3
PMCID: PMC11575817  PMID: 39561127

Abstract

The aim of this study was to determine the validity of three smartphone applications measuring barbell movement velocity in resistance training and comparing them to a commercially available linear transducer. Twenty competitive powerlifters (14 male and 6 female) completed a progressive loading protocol in the squat, bench press and deadlift (sumo or conventional) until reaching 90% of the highest load they had achieved in a recent competition. Mean velocity was concurrently recorded with three smartphone applications: Qwik VBT (QW), Metric VBT (MT), MyLift (ML), and one linear transducer: RepOne (RO). 3D motion capturing (Vicon) was used to calculate specific gold standard trajectory references for the different systems. A total of 589 repetitions were recorded with a mean velocity of (mean ± standard deviation [min-max]) 0.44 ± 0.17 [0.11–1.04] m·s-1, of which MT and ML failed to identify 52 and 175 repetitions, respectively. When compared to Vicon, RO and QW consistently delivered valid measurements (standardized mean bias [SMB] = 0 to 0.21, root mean squared error [RMSE] = 0.01 to 0.04m·s-1). MT and ML failed to deliver a level of validity comparable to RO (SMB = -0.28 to 0.14, RMSE = 0.04–0.14m·s-1), except for MT in the bench press (SMB = 0.07, RMSE = 0.04m·s-1). In conclusion, smartphone applications can be as valid as a linear transducer when assessing mean concentric barbell velocity. Out of the smartphone applications included in this investigation, QW delivered the best results.

Introduction

The term velocity-based training (VBT) in the context of resistance training is used to describe training in which the movement velocity of strength exercises is integrated as a variable into the prescription, monitoring and/or evaluation of the training program [1].

While recent research supports a more in-depth analysis of velocity curves and the use of variables such as the time of the concentric movement phase, the two most commonly addressed VBT variables are mean velocity and peak velocity [1, 2]. Mean velocity refers to the average concentric movement velocity, and peak velocity refers to the maximum instantaneous velocity reached during the concentric phase of the movement [3, 4]. In the context of powerlifting exercises, mean velocity is usually the variable of choice [5]. This is due to mean velocity being more reliable compared to peak velocity [68].

In the past, the popularity of integrating velocity as a training parameter has increased due to better availability of linear transducers (LTs) [9]. This trend seems to be continuing due to more and different measurement systems entering the market. As of the writing of this paper, four different technologies can be distinguished for measuring barbell velocity: accelerometers, LTs, smartphone applications (SAs), and optic devices. While highly valid and reliable measurement systems for measuring barbell velocity are available on the market, the main obstacle for including barbell velocity as a variable for monitoring and prescribing training seems to be the high cost associated with such measurement systems [10]. Therefore, SAs could provide a low-cost alternative to more established technologies, and they may significantly enhance accessibility for practitioners to incorporate mean velocity as a training parameter. Additionally, smartwatch applications have emerged as similar tools that also show promising results in this domain [11].

SAs designed for the assessment of movement velocity typically function according to the same principle of measuring and tracking a reference point of known size in a video and basing all kinematic calculations on this reference. In barbell exercises, for instance, SAs may use weight-plates with standardized diameters as the reference object [12]. The theoretical limitations of such an approach are resolution and frames per second of the recorded video. In theory, this basic principle is straightforward and accurate. However, in practical applications, several factors can influence its accuracy. The most significant of these include the tilting of the barbell, camera distortion, and movement in the coronal plane. Thus, the question arises as to the extent to which SAs achieve valid measurement results in real-world settings. Previous validation studies of SAs that measure barbell velocity have mainly concentrated on the app MyLift, formerly known as PowerLift. These studies have yielded inconclusive results, with some supporting its accuracy and reliability [3, 1315] while others concluded that it is highly prone to error [1618]. Another problem which seems to be more specific to SAs are missed repetitions and ghost repetitions. Missed repetitions refer to repetitions which were performed and recorded but not identified as a repetition by the measurement system due to error. Ghost repetitions refer to extra repetitions that were identified by the system, but not performed by the lifter. Ghost repetitions usually occur when the unracking of the barbell is counted as a repetition or when a single repetition is evaluated as multiple repetitions.

Previous work in this field has demonstrated that the validity of different technologies and even of different devices applying the same technology can vary based on which type of exercise is used [10, 19]. However, research has yet to investigate the concurrent accuracy and precision of multiple different SAs developed to assess movement velocity in resistance training. Therefore, the present study was designed to evaluate the validity and missed repetition rate of the smartphone apps Qwik VBT, Metric VBT and MyLift, and compare them to a gold standard 3D Motion Capture System (Vicon). Moreover, a LT (RepOne) was applied as a practical reference, to give practitioners further insight into whether SAs could replace more established and expensive VBT hardware.

Methods

Experimental approach to the problem

Following the recommendations of Weakly et al. [10] this study utilized gold standard criterion measures across a range of relative loads and exercises. Therefore, Vicon Nexus 3D motion capture technology was utilized to establish precise trajectory references for the outputs of each system. The reliability of this technology in measuring 3D kinematics has been previously confirmed elsewhere [20, 21].

To further enable comparison with established field-based technologies, a LT (RepOne Tether, RepOne Strength, New York, United States) was included alongside the 3D motion capture gold standard. Although the current LT model from RepOne (RO) has not been validated yet, the earlier model, known as the "Open Barbell System," was validated against a gold standard 3D high-speed motion capture system. In this study, the Open Barbell System was declared a valid measurement method [22].

Because the average concentric velocity decreases gradually with higher percentages of the one repetition maximum (1RM) [5], a gradual loading protocol was selected to encompass a broader spectrum of velocities. A further benefit of a gradual loading protocol is that sticking points and other changes to barbell kinematics might only become apparent closer to muscular failure [23, 24]. The decrease and subsequent increase of concentric movement velocity throughout the sticking point region imposes a further challenge on the different systems.

As suggested by Weakly et al. [10], the different systems were evaluated across a variety of exercises with distinct kinematic features. In this study, powerlifting exercises were selected, specifically the squat, bench press, and deadlift, each possessing distinct characteristics. These free-motion barbell exercises introduce additional challenges compared to Smith-machine exercises, including horizontal movements that technologies might encounter in real-world situations [15]. The squat is characterized by a long range of motion, a relatively straight bar path due to the fact that the center of mass must be maintained over the base of support and an eccentric/concentric movement pattern [25]. When performed by experienced powerlifting athletes and to the technical standards of the International Powerlifting Federation (IPF) the bench press is characterized by a short range of motion, a J-curve shaped concentric bar path [26], an eccentric/isometric/concentric movement pattern and also different velocity profiles depending on the range of motion [25, 27]. The deadlift is characterized by a range of motion that typically falls between the squat and bench press, and a relatively straight bar path. In contrast to the other investigated exercises, it is initiated by a concentric movement phase [25]. In competitive powerlifting, two major deadlift types can be distinguished: the conventional deadlift, where the hands are placed laterally to the legs, and the sumo deadlift, where the hands are placed between the legs. Due to the wider stance, the sumo deadlift is typically associated with a shorter range of motion compared to the conventional deadlift [28]. It can be assumed that lifters, due to their training history and individual anthropometric constitution, are primarily proficient in one type of deadlift. Since the investigated systems apply the same processing algorithm for the determination of barbell kinematics in the two deadlift types, the participants were instructed to perform the deadlift using the same type as in their most recent competition.

Subjects

Twenty competitive powerlifters (14 male and 6 female) volunteered to participate in this study. The participants were recruited from the 25th of May 2023 until the 28th of June 2023. Sample characteristics are summarized in Table 1. An extensive questionnaire was used to ensure that all participants met the inclusion criteria. The inclusion criteria were being free of illness and injury and having a valid sports pass of their national powerlifting federation. Furthermore, all participants were required to exhibit participation at a powerlifting competition within the last 6 months prior to the test, for which they achieved a WILKS coefficient of at least 300. The WILKS coefficient pertains to the Powerlifting total, which is the sum of the heaviest successful attempts in the squat, bench press and deadlift. It has been reported to be a valid method for adjusting powerlifting performance to body mass and sex [29]. Subjects were briefed on the procedure and purpose of the trial before signing a written informed consent form. The methodological protocol was conducted following the Declaration of Helsinki and approved by a local ethics committee (reference number 00976).

Table 1. Subject characteristics.

Variable Mean ± SD (min-max)
Age (y) 26±4.9 (18–38)
Body mass (kg) 83.4±19.8 (55.8–147.7)
Height (cm) 173.2±9.6 (160–196)
Absolute squat 1RM (kg) 193.5±54.5 (120–310)
Absolute bench press 1RM (kg) 123.5±44.6 (55–230)
Absolute deadlift 1RM (kg) 224.9±59.4 (142.5–360)
Powerlifting total (kg) 541.9±155.9 (332.5–900)
Relative squat 1RM (kg·kgBM-1) 2.32±0.43 (1.68–3.46)
Relative bench press 1RM (kg·kgBM-1) 1.46±0.36 (0.88–2.28)
Relative deadlift 1RM (kg·kgBM-1) 2.71±0.48 (2.07–3.88)
Wilks coefficient 394.88±58.99 (326.34–499.05)
IPF GL coefficient 80.89±11.61 (66.38–102.86)

1RM, One-repetition maximum; IPF GL, International Powerlifting Federation Good Lift; kgBM, kg body mass; SD, standard deviation.

Procedures

All subjects visited the laboratory on a single occasion. Upon arrival, personal data of the subject was recorded. This included sex, age, self-reported body height, body mass at recent competition and strength performance at recent competition. Based on the results of the recent competition, the loads for the gradual loading protocol were calculated. After a guided warm-up by a certified Level II Coach of the IPF, subjects performed ascending loading protocols for squat, bench press, and deadlift in the specified order. For each exercise, participants completed a single repetition with 45%, 50%, 55%, 60%, 65%, 70%, 75%, 80%, 85% and 90% of their recent competition best, with barbell loads being rounded to the nearest multiple of 2.5kg. To keep the execution of the powerlifting movement standardized, all repetitions were performed according to the technical rules of the IPF [25]. A licensed powerlifting referee was present at every session and enforced the technical rules. For all recorded repetitions, general recommendations for the assessment of force-velocity and load-velocity data were followed as closely as possible [30]. If a lift was unsuccessful or deemed to be too heavy for successful completion by either the subject or the present coach the protocol was stopped prematurely. All exercises were performed using a 20-kg powerlifting barbell, calibrated weight plates, competition collar and an IPF competition combo rack (Eleiko, Halmstad, Sweden). All three SAs request the diameter of the loaded weight plate. To enable the use of 450mm weight plates in all load conditions, 2.5kg technique plates were applied for loads below 65kg.

For each SA, the latest version was installed on one of three identical iPhones SE 2022 (Apple Inc., Cupertino, CA). For Metric VBT (MT), the version 2.3.1 was used. For My Lift (ML), the smartphone application My Jump Lab version 3.2.9 was used. For Qwik (QW), the version 0.94 was used. All three iPhones were placed in a 1m high custom-built smartphone stand with all three iPhones in direct contact with each other. This stand was placed 3m laterally from the lateral end of the barbell. The iPhones were positioned so that the center of the barbell was in the middle of the screen. To nullify any potential bias related to the specific position (left, middle, or right) of the iPhone, the iPhones were rotated after every subject.

All SAs request the user to film the exercise from the side and adjust the plate diameter if a non-standard sized weight plate (450mm diameter) is used. For MT and ML the videos were recorded with the SAs themself. For QW, the videos were recorded with the native camera application (1920x1080, 60FPS) of the iPhone, and imported into the SA afterwards.

The tether of the RO was placed on the opposing barbell sleeve. The floor unit was aligned for each exercise to minimize tether angle offset from perfect vertical orientation. The RO was connected to an iPhone X (Apple Inc., Cupertino, CA) through Bluetooth running the RepOne Personal app version 1.1.5.

Neither QW, ML, nor RO have the option to select a specific exercise before recording the repetitions. For MT, the correct exercise was chosen before starting the recording. The mean velocity measurements of the RO unit and the SAs were documented during the testing sessions. Wherever possible, the full range of capabilities offered by the individual SAs was used to ensure the highest quality measurements. Specifically, for ML, it was ensured that the "Plate detected" status was displayed before every repetition. For MT, the video function was used to distinguish between ghost repetitions and actual repetitions whenever feasible. The actual repetitions were included in the statistical analysis, while also documenting the ghost repetitions separately. Importantly, these ghost repetitions were not counted as missed repetitions as long as a clear distinction between the ghost repetition and the actual repetition was possible. For QW, the plates were tagged as accurately as possible. Additionally, the native video footage was trimmed to start approximately 5 seconds before the start of each repetition and conclude roughly one second after the bar was returned to the competition combination or placed on the ground.

Reflective pearl markers with a diameter of 26mm (B&L Engineering, Santa Ana, CA) were placed on each lateral end of the barbell. The trajectories of the markers were recorded using a 3D motion tracking system composed of twelve 8.1 megapixel infrared cameras (Vicon V8; Vicon Motion Systems Limited, Oxfordshire, England), sampling at a rate of 200 Hz. The raw trajectory data were then processed in 3D reconstruction software (Vicon Nexus 2.14; Vicon Motion Systems Limited, Oxfordshire, England) by applying a fourth-order Butterworth filter with phase- shift correction and a 10-Hz cutoff frequency to the position. Mean velocity was determined as the first derivative of distance with respect to time during the concentric phase of each repetition. This involved analyzing the velocity data and identifying segments where the velocity surpassed predefined thresholds. The velocity data was processed using a Python script for this purpose. An instantaneous velocity threshold of 0.02m/s was established for rep detection, while a 10cm threshold was set to filter out smaller repetitions resulting from barbell unracking, reracking and slight movements during this process. When both of these thresholds were exceeded, a rep was detected for this specific segment and in these identified segments, mean velocity was calculated by dividing distance by time.

In cases where multiple repetitions were detected within a single performed repetition due to unracking or reracking motions, the repetitions were cross-checked against the 3D reconstructed barbell movement to ensure the correct repetition was selected.

The applied Python script was uploaded to a public repository (https://doi.org/10.5281/zenodo.10864547). The experimental setup is displayed in Fig 1.

Fig 1. Experimental setup.

Fig 1

Statistical analysis

Analysis was completed separately for each practical system (RO, QW, MT, ML) and for each investigated exercise (squat, bench press, deadlift) using two different linear mixed effects models with correlated random intercepts and slopes. For model 1, velocity output from the practical system was expressed as a function of velocity output from Vicon. For model 2, velocity output for each repetition was modeled as a function of source, where source was expressed as a binary dummy variable representing either Vicon or the practical system. Models were fitted according to the Bayesian framework, utilizing the rstan R package (version 2.26.23) and customized Stan scripts (Stan version 2.26.3). Weakly informative standardized priors were defined for all parameters. Based on model 1, estimated intercepts and slopes were interpreted concurrently as indicators of proportional bias, R2 was calculated as a standardized indicator of random error, and the root mean squared error (RMSE) was calculated from posterior predictive distributions to represent absolute precision. Moreover, the standardized mean bias (SMB) was estimated from model 2. Posterior distributions were summarized using their mean and 95% Highest Density Interval (HDI).

The practical relevance of estimated error in smartphone-based velocity monitoring was evaluated using the models comparing Vicon to RO as a practical reference. In particular, the more extreme 95% HDI limit of each calculated statistic was used to construct a region of practical equivalence (ROPE) around the values indicating a perfect match, which are defined as follows: intercept = 0, slope = 1, R2 = 1, RMSE = 0, SMB = 0. If the effect direction of the calculated statistic was supported by at least 95% of posterior probability, it was deemed statistically clear and labeled as “likely”.

R and Stan scripts used for the analysis were uploaded to a public repository, to provide further details on the statistical modeling and applied priors (https://doi.org/10.5281/zenodo.10864547).

Results

Out of the 600 planned repetitions of the 20 study participants, one squat repetition was not completed due to the weight being deemed too heavy. Furthermore, 8 deadlift repetitions were not performed for the same reason. One deadlift repetition was attempted but not completed due to the lifter losing grip of the barbell during the repetition and for one deadlift repetition the trajectories of the reflective pearl markers were not analyzable due to reflections of the barbell interfering with the markers. Fig 2 presents the missed repetition rates for the different systems and exercises. RO and QW showed perfect performance with no missed or ghost repetitions. ML, on the other hand, exhibited no ghost repetitions but had three and four missed repetitions in the squat and deadlift, respectively. Additionally, ML failed to record 168 reps in the bench press. Due to the low number of recorded repetitions, caution is advised when interpreting statistical analyses for ML in the bench press. MT was the only system to register ghost repetitions, totaling 16 (2 in the squat and 14 in the bench press). MT also displayed 7, 12, and 33 missed repetitions in the squat, bench press, and deadlift, respectively.

Fig 2. Missed repetition rate across systems.

Fig 2

Values indicate the percentage of repetitions that were not identified by the system in the given exercise. B, bench press; D, deadlift; S, squat.

Figs 35 display the SMB, RMSE and R2 calculated for each system-exercise combination.

Fig 3. Standardized mean bias (SMB) estimated from model 2.

Fig 3

The mean and 95% HDI of the posterior distribution for each device are summarized numerically to the right-hand side of the plot. Shaded areas mark the region of practical equivalence defined by the 95% Highest Density Interval (HDI) of RepOne. p(Θ ϵ R), probability of the parameter falling into the region of practical equivalence; ML, MyLift; MT, Metric VBT; QW, Qwik VBT; RO, RepOne.

Fig 5. Coefficient of determination (R2) of model 1.

Fig 5

The mean and 95% HDI of the posterior distribution for each device are summarized numerically to the right-hand side of the plot. Shaded areas mark the region of practical equivalence defined by the 95% Highest Density Interval (HDI) of RepOne. p(Θ ϵ R), probability of the parameter falling into the region of practical equivalence; ML, MyLift; MT, Metric VBT; QW, Qwik VBT; RO, RepOne.

Fig 4. Root mean square error (RMSE) of posterior predictive distributions calculated from model 1.

Fig 4

The mean and 95% HDI of the posterior distribution for each device are summarized numerically to the right-hand side of the plot. Shaded areas mark the region of practical equivalence defined by the 95% Highest Density Interval (HDI) of RepOne. p(Θ ϵ R), probability of the parameter falling into the region of practical equivalence; ML, MyLift; MT, Metric VBT; QW, Qwik VBT; RO, RepOne.

For all investigated exercises, intercepts and slopes estimated from model 1 were likely equivalent between RO and QW, except for the deadlift (slope: p(Θ ∈ ROPE) = 94.5%). Compared to RO, MT resulted in likely decreased slopes for all exercises (p(Θ ∈ ROPE) < 2.5%), and likely increased intercepts for the bench press and deadlift (p(Θ ∈ ROPE) < 0.1%). For ML, results were unclear with respect to ROPE in all cases. However, the intercept was likely below the line of identity in the squat (p(Θ < 0) = 99.7%) and likely above the line of identity in the deadlift (p(Θ > 0) = 98%). Moreover, the slope was likely lower compared to the line of identity in the deadlift (p(Θ < 1) = 95.6%). Fig 6 displays the group-level fits for model 1 with their respective intercept and slope.

Fig 6. Scatter plots with group-level functions of model 1.

Fig 6

For each practical system and investigated exercise, the mean and 95% HDI of the group-level intercept and slope are summarized numerically to the right-hand side of the plot. Dashed lines represent the line of identity (intercept = 0, slope = 1); ML, MyLift; MT, Metric VBT; QW, Qwik VBT; RO, RepOne.

The complete dataset which was used for all calculations was uploaded to a public repository (https://doi.org/10.5281/zenodo.10864547).

Discussion

The goal of the present investigation was to determine the validity of 3 SAs and one LT determining mean barbell movement velocity across a range of loads in the powerlifting exercises. To the best of the authors’ knowledge, this study is the first one to investigate the validity of multiple SAs and the RO.

RO served as a practical criterion in the present study, since recent research promoted LTs as favorable field-based systems for velocity monitoring [4]. Our results indicate that RO is only subject to neglectable bias in the squat and deadlift, as portrayed by the SMB, with no indications of substantial over- or underestimation. These results conform with what has previously been reported for other LT systems, such as the GymAware Power Tool (GA). For example, Thompson et al. declared GA a valid and reliable measurement tool for mean velocity in the back squat, where it performed exceptionally well in regression analyses (point estimate [95% confidence interval], intercept = -0.005 [-0.014, 0.003], slope = 0.991 [0.979, 1.004], R2 = 0.99) [30]. Contrary to the squat and deadlift, we found that RO likely overestimates mean velocity in the bench press at trivial to small magnitude (mean [95% HDI], SMB = 0.21 [0.04, 0.38], mean difference = 0.02 [0, 0.04] m·s-1). Model functions further illustrate a slight tendency for proportional bias in the bench press, where error increases with movement velocity. While an exploratory analysis of factors causing the exercise-specific bias in RO was beyond the scope of the present study, it may be assumed that the effect could be partially explained by kinematic characteristics of the investigated exercises, such as horizontal barbell displacement during the concentric movement phase. Importantly, a study conducted by Mitter et al. under similar experimental conditions showed that GA may perform at slightly higher standardized accuracy in the bench press [19]. In the present study, random error of RO, as evaluated by R2 and RMSE, was also more pronounced in the bench press compared to the other two exercises. Our findings on RMSE in RO conform to what previously mentioned research reported on GA [19], suggesting that RO might perform at comparable precision. Overall, readers should be aware that for the bench press, RO may not be universally considered an ideal practical criterion to evaluate bias in SAs. Thus, findings from respective ROPE-analyses should be interpreted with caution.

QW yielded a level of validity that was equivalent to RO for all investigated statistics and exercises, except for R2 in the squat, where more than 99.9% of posterior probability fell below the ROPE threshold defined by RO. Importantly, QW still showed excellent validity on its own and the lack of overlapping posterior distributions may be explained by the HDIs being exceptionally narrow in both cases (mean [95% HDI], RO: R2 = 0.9983 [0.9981, 0.9984], QW: R2 = 0.9959 [0.9955, 0.9962]). Based on the results of model 1, there was a 94.5% probability of the slope parameter falling into the ROPE, thus missing the predefined threshold for clear effects. Interestingly, in the bench press and deadlift, there was a tendency for QW to provide higher precision compared to RO, as evidenced by a slightly lower RMSE. Among the three investigated SAs, QW was the only one to record all completed repetitions. No ghost repetitions were recorded by QW during data acquisition.

SMB estimates for MT indicate that, on average, the application provides equivalent accuracy compared to RO in the bench press. Results were deemed unclear in the other two exercises. However, the presence of proportional bias was identified based on likely substantial deviations of the intercept and slope parameters in the bench press and deadlift, as well as for the slope parameter in the squat. In all cases, statistics reveal a tendency of MT underestimating velocity at higher barbell speed. These trends were paired with a tendency of MT overestimating velocity at lower barbell speed in the bench press and deadlift. In terms of random error, R2 statistics highlight worse performance compared to RO that was likely substantial in all investigated exercises. Similarly, precision was substantially worse compared to RO in the squat and deadlift, as illustrated by the RMSE. In case of the bench press, data hint towards equivalent precision when comparing MT to RO, with a 93.4% probability of the RMSE falling into the ROPE. Regarding its ability to correctly detect repetitions across powerlifting exercises, MT was the only investigated smartphone application that recorded ghost repetitions during data acquisition. Furthermore, it failed to record single repetitions in all three exercises, with its missed repetition rate being highest in the deadlift. To our knowledge, MT has thus far only been validated in one more peer-reviewed study, which compared it to a gold standard 3D Motion Capture System and reported Pearson’s correlation coefficients ranging from 0.67 to 0.95 across different exercise categories [31]. While the authors declared MT as a valid and reliable measurement method for the assessment of mean velocity, it was not directly compared to a LT. However, the accuracy levels reported for MT were still well below the accuracy levels typically seen in LTs [10, 19]. This is further corroborated by the findings of the present investigation. Moreover, the creators of MT published an internal validation study, where they compared MT with a gold standard 3D high-speed motion capture system [32]. Similar to the present study, a slight tendency for MT to underestimate mean velocity in the front squat and at high movement speed in the deadlift, but only neglectable mean bias in the bench press was found.

Data collected from ML did not reveal clear estimates for SMB, but a tendency towards trivial bias in the squat and deadlift. No clear signs of proportional bias were identified for ML in the squat and bench press. However, analysis indicated the presence of proportional bias in the deadlift, resulting in a tendency of ML underestimating velocity at higher barbell speed. This effect may to some extent be caused by multiple outliers produced by four participants at loads ranging from 45% to 75% 1RM, for which ML recorded exceptionally low movement velocity of less than 0.06m·s-1. Thus, the identified proportional bias may not validly apply to most observations, and extreme outliers may be explained by confounders other than movement velocity. In terms of random error, as portrayed by R2, and precision, as portrayed by RMSE, ML performed substantially worse compared to RO in all three exercises. While ML missed single repetitions during data acquisition in all three exercises, this was only observed at a low rate in the squat and deadlift. In the bench press, however, ML registered only 16% of completed repetitions. It may be assumed that ML’s ability to successfully detect repetitions is inversely associated with characteristic features of the bench press, such as the distance traveled by the barbell in horizontal and vertical direction. Readers should be aware that the comparably low sample size drawn from ML in the bench press may compromise the robustness of derived statics. These results are in accordance with the findings of Martínez-Cava et al. who, although only examining PV, also declared ML less accurate than a LT [17].

Overall, the results of the present study indicate that among the three investigated SAs, QW is the only one recording mean velocity at an accuracy and precision comparable to RO in all three powerlifting exercises.

In general, it seems like the kinematic thresholds used by the different developers play a major role in the validity of the different SAs. If the threshold for range of motion is set too low, more ghost repetitions will be detected. If it is set too high, more missed repetitions will be the consequence. If the threshold for instantaneous velocity to identify the start and end of the concentric movement phase is too low, different movement and/or movement phases beyond the concentric phase of the actual repetitions might be included in a measurement. If it is set too high, parts of the repetition might be excluded as a consequence. It seems like QW, along with its features to tag the plates and the option to cut the native video to a length where only the repetition is included, selected the best kinematic thresholds for valid mean velocity measurements in powerlifting exercises.

Despite using an approved gold standard criterion for kinematic measurement, the results of this investigation should be treated with caution. This is primarily due to two factors. First, a validation study can only supply momentary insight into a dynamically changing system. Developers of SAs typically publish software updates on a regular basis. Therefore, the results of the present investigation may not speak for more recent software versions of each analyzed system. Second, the study design yields only limited external validity. All SAs were tested under favorable conditions. A standardized filming position with the smartphones placed in a stable stand was used. Furthermore, the area of the laboratory where data collection was completed was free of any objects which might disturb the measurement. Adequate lighting was also ensured. Therefore, it might be difficult to predict how the investigated systems will perform in a regular training environment. This issue seems to be more relevant for the SAs than the RO since the RO only involves placing the unit on a magnetic surface and attaching the wire of the unit with a strap onto the barbell, in a way to minimize horizontal displacement. This represents a closed system which is much less reliant on other external factors. The usage of SAs, on the other hand, may potentially be limited by a multitude of confounders introduced by a regular training environment. Such confounders may include the suboptimal placement and orientation of the smartphone’s camera, or interferences caused by other objects and people, affecting recordings and lighting.

The findings of this study provide evidence that SAs can be a valid method of assessing mean concentric barbell velocity in powerlifting exercises. Using the same hardware, different SAs delivered vastly heterogeneous results. The authors recommend exercising caution when using non-validated SAs to measure mean concentric barbell velocity in powerlifting exercises, as the SAs may be prone to substantial measurement error and low repetition detection rates. Among the SAs tested in this study, the Qwik VBT system delivered the best results, showing high levels of accuracy and precision across exercises. Notably, it performed as well as, if not better than, the RepOne LT system and may, thus, contribute to overcoming the financial barrier to the widespread application of velocity-based training methodology. However, it should be noted that the study identified more limitations than advantages for SAs overall, and the Qwik VBT system stands out as an exception rather than the rule.

Acknowledgments

The authors express their gratitude to all athletes who participated in this study and further to everyone who gave up their time to make this investigation possible. The authors had no professional relationship with any companies or manufacturers of products validated in this study. There are no conflicts of interest related to the content of this study.

Data Availability

All relevant data are available at https://doi.org/10.5281/zenodo.10864547.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Weakley J, Mann B, Banyard H, et al. Velocity-based training: from theory to application. Strength Cond J. 2021;43(2):31–49. [Google Scholar]
  • 2.Achermann B, Smith D, Lorenzetti S. Velocity-based strength training: comparing duration and mean velocity to predict the maximum number of repetitions in a set. ISBS Proceedings Archive. 2024;42(1):2. Available at: https://commons.nmu.edu/isbs/vol42/iss1/2 [Google Scholar]
  • 3.Pérez-Castilla A, Piepoli A, Delgado-García G, Garrido-Blanca G, García-Ramos A. Reliability and concurrent validity of seven commercially available devices for the assessment of movement velocity at different intensities during the bench press. J Strength Cond Res. 2019;33(5):1258–1265. doi: 10.1519/JSC.0000000000003118 [DOI] [PubMed] [Google Scholar]
  • 4.Tomasevicz CL, Hasenkamp RM, Ridenour DT, Bach CW. Validity and reliability assessment of 3-D camera-based capture barbell velocity tracking device. J Sci Med Sport. 2020;23(1):7–14. doi: 10.1016/j.jsams.2019.07.014 [DOI] [PubMed] [Google Scholar]
  • 5.Helms ER, Storey A, Cross MR, et al. RPE and velocity relationships for the back squat, bench press, and deadlift in powerlifters. J Strength Cond Res. 2017;31(2):292–297. doi: 10.1519/JSC.0000000000001517 [DOI] [PubMed] [Google Scholar]
  • 6.Fernandes JFT, Lamb KL, Clark CCT, et al. Comparison of the FitroDyne and GymAware rotary encoders for quantifying peak and mean velocity during traditional multijointed exercises. J Strength Cond Res. 2021;35(6):1760–1765. doi: 10.1519/JSC.0000000000002952 [DOI] [PubMed] [Google Scholar]
  • 7.García-Ramos A, Barboza-González P, Ulloa-Díaz D, et al. Reliability and validity of different methods of estimating the one-repetition maximum during the free-weight prone bench pull exercise. J Sports Sci. 2019;37(19):2205–2212. doi: 10.1080/02640414.2019.1626071 [DOI] [PubMed] [Google Scholar]
  • 8.García-Ramos A, Ulloa-Díaz D, Barboza-González P, et al. Assessment of the load-velocity profile in the free-weight prone bench pull exercise through different velocity variables and regression models. PLoS One. 2019;14(2):e0212085. doi: 10.1371/journal.pone.0212085 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Guerriero A, Varalda C, Piacentini MF. The role of velocity-based training in the strength periodization for modern athletes. J Funct Morphol Kinesiol. 2018;3(4):55. doi: 10.3390/jfmk3040055 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Weakley J, Morrison M, García-Ramos A, et al. The validity and reliability of commercially available resistance training monitoring devices: a systematic review. Sports Med. 2021;51(3):443–502. doi: 10.1007/s40279-020-01382-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Achermann B, Oberhofer K, Ferguson SJ, Lorenzetti SR. Velocity-based strength training: the validity and personal monitoring of barbell velocity with the Apple Watch. Sports. 2023;11(7):125. doi: 10.3390/sports11070125 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Core Advantage Pty Ltd. Metric Coach User Guide [Internet]. 2024. [cited 2024 Mar]. Available from: https://www.metric.coach/user-guide. [Google Scholar]
  • 13.Balsalobre-Fernández C, Marchante D, Baz-Valle E, Alonso-Molero I, Jiménez SL, Muñóz-López M. Analysis of wearable and smartphone-based technologies for the measurement of barbell velocity in different resistance training exercises. Front Physiol. 2017;8:649. doi: 10.3389/fphys.2017.00649 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Balsalobre-Fernández C, Marchante D, Muñoz-López M, Jiménez SL. Validity and reliability of a novel iPhone app for the measurement of barbell velocity and 1RM on the bench-press exercise. J Sports Sci. 2018;36(1):64–70. doi: 10.1080/02640414.2017.1280610 [DOI] [PubMed] [Google Scholar]
  • 15.Silva R, Rico-González M, Lima R, et al. Validity and reliability of mobile applications for assessing strength, power, velocity, and change-of-direction: a systematic review. Sensors. 2021;21(8):2623. doi: 10.3390/s21082623 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Courel-Ibáñez J, Martínez-Cava A, Morán-Navarro R, et al. Reproducibility and repeatability of five different technologies for bar velocity measurement in resistance training. Ann Biomed Eng. 2019;47(7):1523–1538. doi: 10.1007/s10439-019-02265-6 [DOI] [PubMed] [Google Scholar]
  • 17.Martínez-Cava A, Hernández-Belmonte A, Courel-Ibáñez J, et al. Correction: reliability of technologies to measure the barbell velocity: implications for monitoring resistance training. PLoS One. 2020;15(7):e0236073. doi: 10.1371/journal.pone.0236073 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Thompson SW, Rogerson D, Dorrell HF, Ruddock A, Barnes A. The reliability and validity of current technologies for measuring barbell velocity in the free-weight back squat and power clean. Sports. 2020;8(7):94. doi: 10.3390/sports8070094 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Mitter B, Hölbling D, Bauer P, et al. Concurrent validity of field-based diagnostic technology monitoring movement velocity in powerlifting exercises. J Strength Cond Res. 2021;35(8):2170–2178. doi: 10.1519/JSC.0000000000003143 [DOI] [PubMed] [Google Scholar]
  • 20.Topley M, Richards JG. A comparison of currently available optoelectronic motion capture systems. J Biomech. 2020;106:109820. doi: 10.1016/j.jbiomech.2020.109820 [DOI] [PubMed] [Google Scholar]
  • 21.Windolf M, Götzen N, Morlock M. Systematic accuracy and precision analysis of video motion capturing systems—exemplified on the Vicon-460 system. J Biomech. 2008;41(12):2776–2780. doi: 10.1016/j.jbiomech.2008.06.024 [DOI] [PubMed] [Google Scholar]
  • 22.Goldsmith JA, Trepeck C, Halle JL, et al. Validity of the Open Barbell and Tendo weightlifting analyzer systems versus the Optotrak Certus 3D motion-capture system for barbell velocity. Int J Sports Physiol Perform. 2019;14(4):540–543. doi: 10.1123/ijspp.2018-0684 [DOI] [PubMed] [Google Scholar]
  • 23.Duffey MJ, Challis JH. Fatigue effects on bar kinematics during the bench press. J Strength Cond Res. 2007;21(2):556–560. doi: 10.1519/R-19885.1 [DOI] [PubMed] [Google Scholar]
  • 24.Kompf J, Arandjelović O. The sticking point in the bench press, the squat, and the deadlift: similarities and differences, and their significance for research and practice. Sports Med. 2017;47(4):631–640. doi: 10.1007/s40279-016-0615-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.International Powerlifting Federation. Technical Rules Book 2023. [Internet]. 2024 [cited 2024 Mar]. Available from: https://www.powerlifting.sport/fileadmin/ipf/data/rules/technical-rules/english/IPF_Technical_Rules_Book_2023__1_.pdf. [Google Scholar]
  • 26.McLaughlin TM, Madsen NH. Bench press: bench press techniques of elite heavyweight powerlifters. Natl Strength Cond Assoc J. 1984;6(4):44–44. [Google Scholar]
  • 27.Matykiewicz P, Krzysztofik M, Filip-Stachnik A, Wilk M. The bench press exercise performed with increased range of motion allows for greater bar velocities. J Phys Educ Sport. 2021;21:1737–1743. [Google Scholar]
  • 28.Kasovic J, Martin B, Fahs CA. Kinematic differences between the front and back squat and conventional and sumo deadlift. J Strength Cond Res. 2019;33(12):3213–3219. doi: 10.1519/JSC.0000000000003377 [DOI] [PubMed] [Google Scholar]
  • 29.Vanderburgh PM, Batterham AM. Validation of the Wilks powerlifting formula. Med Sci Sports Exerc. 1999;31(12):1869–1875. doi: 10.1097/00005768-199912000-00027 [DOI] [PubMed] [Google Scholar]
  • 30.Picerno P. Good practice rules for the assessment of the force-velocity relationship in isoinertial resistance exercises. Asian J Sports Med. 2017;8(3):1. [Google Scholar]
  • 31.Taber C, Patterson E, Shah J, Francis P, Wager J. Validity and reliability of a computer vision system to determine bar displacement and velocity. Int J Strength Cond. 2023;3(1). [Google Scholar]
  • 32.Tober J, Tober D, Lauder M, McInnis D, McInnis T. Reliability and validity of the Metric VBT application (v0.3) [Internet]. 2024. [cited 2024 Mar]. Available from: https://assets-global.website-files.com/614c3620865176137fd91b18/624ce6ba74256028daaf208a_Reliability_and_validity_of_the_MetricVBT_application_(v0.3).pdf. [Google Scholar]

Decision Letter 0

Gianpiero Greco

28 Aug 2024

PONE-D-24-27051Concurrent validity of novel smartphone-based apps monitoring barbell velocity in powerlifting exercisesPLOS ONE

Dear Dr. Renner,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Oct 12 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Gianpiero Greco

Academic Editor

PLOS ONE

Journal requirements: 1. When submitting your revision, we need you to address these additional requirements. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The article was properly prepared in accordance with scientific research standards. The authors used appropriate research methodology. The reservations that may arise concern only a small number of sources used in the bibliography (it would be worth supplementing it in subsequent articles with publications by Prof. Michał Wilk or Prof. Michał Krzysztofik). The topic is extremely interesting due to the usefulness of the results achieved in the process of sports training or training of people practicing strength sports recreationally.

Reviewer #2: Review of “Concurrent validity of novel smartphone-based apps monitoring barbell velocity in powerlifting exercises”

This paper presents a valuable effort to examine the validity of three smartphone apps designed to quantify the velocity of a barbell during the three major powerlifting exercises. The study’s approach, which includes the use of a linear position transducer and a comparison with the Vicon system as the gold standard, is commendable. Additionally, it’s great to see that the study included both male and female powerlifters, providing a more comprehensive analysis.

Abstract:

To strengthen the abstract, it would be beneficial to include data on the typical mean velocity or the relative size of the RMSE compared to the mean velocity. This additional information would help readers quickly grasp the significance of the findings.

Introduction:

While the introduction provides a solid foundation, the use of abbreviations could be made clearer. For instance, “MV” stands for mean velocity, but “MT” refers to an app, which may be confusing for readers.

•Line 42: The discussion around the different velocity parameters (mean velocity, peak velocity, etc.) could be elaborated to better reflect the ongoing debate in the field.

•Line 54: It might be worth mentioning that there are also smartwatch applications available that serve similar functions.

Table 1:

The values in Table 1 would benefit from rounding to more meaningful figures. For example, 541.88±155.91 could be rounded to 541±156 to enhance readability and comprehension.

Methodology:

•Line 169: A more detailed description of the barbell fixation would be helpful. Including a picture of the setup would significantly improve clarity.

•Additionally, please provide information on the frequency of the sensors used in the iPhone.

•Line 207: Clarifying the thresholds and any other steps involved in data processing would enhance the transparency of the methodology.

Figures:

The resolution of the figures, particularly Figure 6, needs improvement as it is currently difficult to read. High-quality visuals are crucial for effective communication of the data.

Results Section:

The beginning of the results section currently reads more like a continuation of the methods. Revising this to make it more reader-friendly would improve the flow of the paper.

•Line 248: Further clarification is needed here. Could you explain the reasoning behind this choice?

•Text and Figure 2: It would be helpful to present the data only once to avoid redundancy. Including ghost repetitions in Figure 2 would also provide a clearer representation of the findings.

Currently, the results section blends text and figure legends. If the legends are removed, there is little information left in the text. Including more detailed information directly in the results section would enhance its substance.

Discussion:

Lastly, the addition of two models to interpret the data seems to introduce some confusion. It would be beneficial to ensure that these models align closely with the study’s objectives, or to reconsider their inclusion if they do not add substantial value.

I hope these suggestions help in refining your manuscript. With these revisions, the paper has the potential to make a significant contribution to the field.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Silvio Lorenzetti

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Nov 19;19(11):e0313919. doi: 10.1371/journal.pone.0313919.r002

Author response to Decision Letter 0


9 Oct 2024

Dear reviewers,

we would like to thank you for the constructive feedback. You can find our detailed response in the document "Response to Reviewers".

Attachment

Submitted filename: Response to Reviewers.pdf

pone.0313919.s001.pdf (81KB, pdf)

Decision Letter 1

Gianpiero Greco

4 Nov 2024

Concurrent validity of novel smartphone-based apps monitoring barbell velocity in powerlifting exercises

PONE-D-24-27051R1

Dear Dr. Renner,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Gianpiero Greco

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: Thank you for the revision. All the raised points have been addressed properly. It is fine for me and the letter was helpful.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: Yes: Silvio R. Lorenzetti

**********

Acceptance letter

Gianpiero Greco

8 Nov 2024

PONE-D-24-27051R1

PLOS ONE

Dear Dr. Renner,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Gianpiero Greco

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response to Reviewers.pdf

    pone.0313919.s001.pdf (81KB, pdf)

    Data Availability Statement

    All relevant data are available at https://doi.org/10.5281/zenodo.10864547.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES