Skip to main content
PLOS One logoLink to PLOS One
. 2022 Dec 30;17(12):e0277831. doi: 10.1371/journal.pone.0277831

Bi-Directional Axial Transmission measurements applied in a clinical environment

Jean-Gabriel Minonzio 1,2,3,*, Donatien Ramiandrisoa 4, Johannes Schneider 5, Eva Kohut 6, Melanie Streichhahn 6, Ulrik Stervbo 5,7, Rainer Wirth 8, Timm Henning Westhoff 7, Kay Raum 5, Nina Babel 5,7
Editor: John Leicester Williams9
PMCID: PMC9803229  PMID: 36584002

Abstract

Accurate measurement of cortical bone parameters may improve fracture risk assessment and help clinicians on the best treatment strategy. Patients at risk of fracture are currently detected using the current X-Ray gold standard DXA (Dual XRay Absorptiometry). Different alternatives, such as 3D X-Rays, Magnetic Resonance Imaging or Quantitative Ultrasound (QUS) devices, have been proposed, the latter having advantages of being portable and sensitive to mechanical and geometrical properties. The objective of this cross-sectional study was to evaluate the performance of a Bi-Directional Axial Transmission (BDAT) device used by trained operators in a clinical environment with older subjects. The device, positioned at one-third distal radius, provides two velocities: VFAS (first arriving signal) and VA0 (first anti-symmetrical guided mode). Moreover, two parameters are obtained from an inverse approach: Ct.Th (cortical thickness) and Ct.Po (cortical porosity), along with their ratio Ct.Po/Ct.Th. The areal bone mineral density (aBMD) was obtained using DXA at the femur and spine. One hundred and six patients (81 women, 25 men) from Marien Hospital and St. Anna Hospital (Herne, Germany) were included in this study. Age ranged from 41 to 95 years, while body mass index (BMI) ranged from 16 to 47 kg.m−2. Three groups were considered: 79 non-fractured patients (NF, 75±13years), 27 with non-traumatic fractures (F, 80±9years) including 14 patients with non-vertebral fractures (NVF, 84±7years). Weak to moderate significant Spearman correlations (R ranging from 0.23 to 0.53, p < 0.05) were found between ultrasound parameters and age, BMI. Using multivariate Partial Least Square discrimination analyses with Leave-One-Out Cross-Validation (PLS-LOOCV), we found the combination of VFAS and the ratio Ct.Po/Ct.Th to be predictive for all non traumatic fractures (F) with the odds ratio (OR) equals to 2.5 [1.6-3.4] and the area under the ROC curve (AUC) equal to 0.63 [0.62-0.65]. For the group NVF, combination of four parameters VA0. Ct.Th, Ct.Po and Ct.Po/Ct.Po, along with age provides a discrimination model with OR and AUC equals to 7.5 [6.0-9.1] and 0.75 [0.73-0.76]. When restricted to a smaller population (87 patients) common to both BDAT and DXA, BDAT ORs and AUCs are comparable or slightly higher to values obtained with DXA. The fracture risk assessment by BDAT method in older patients, in a clinical setting, suggests the benefit of the affordable and transportable device for the routine use.

Introduction

Osteoporosis is associated with a pathological bone remodelling leading to an increased bone fragility and risk of fractures [1]. It remains a major public health problem worldwide, partly due to population aging, even if the fracture rate tends to decrease [2]. Therefore, it is still crucial to prevent the most severe fractures [3]. The current gold standard for detecting patients at risk of fractures is the Dual-energy X-ray Absorptiometry (DXA), assessing the areal or projected Bone Mineral Density (aBMD g.cm−2), directly measured at the main fracture sites, i.e., hip and spine [4]. However, a majority of patients with fragility fractures have a T-score higher than the threshold defined by the World Health Organization (WHO), i.e., T-score = -2.5 [5]. Moreover, the accessibility to DXA is limited, usually restricted to larges cities, in numerous countries such as in Latin America [6]. That is why, several alternatives have been proposed.

Different X-rays technologies have emerged to assess bone quality, providing in particular cortical bone parameters. Indeed, because of its projection technique and low spatial resolution, DXA is not able to separate trabecular and cortical compartments. On the contrary, Quantitative Computed Tomography (QCT) has the ability to provide 3D bone volume, from which image processing techniques allow extracting material and geometrical properties such as cortical thickness (Ct.Th), cortical porosity (Ct.Po) and volumetric bone mineral density (vBMD g.cm−3). While QCT has the advantage to be directly performed at the hip and spine [7], peripheral QCT (pQCT) is limited to peripheral sites such as tibia and radius [8]. Moreover, High resolution-pQCT (HR-pQCT) has a better resolution, allowing to directly image the larger pores, usually associated with resorption cavities [9, 10]. Similarly to QCT, Magnetic Resonance Imaging (MRI) has also been proposed as a DXA alternative, providing a MRI-derived porosity index in 3D volume [11].

Quantitative ultrasound (QUS) has been also proposed for clinical bone assessment, due to it advantages in term of cost, portability and sensitivity to both elasticity and geometry of the medium explored by the waves [12]. A first QUS measurement configuration corresponds to the transverse transmission, originally targeting cancellous bone at the heel [13], the earliest and best-validated clinical bone ultrasound device. Transverse transmission has also been applied at the one third distal [14] or distal [15] radius. A second configuration corresponds to back scattering or pulse-echo techniques, applied at the hip and spine [16], tibia [17] and radius [18, 19]. Moreover, note that echography has been recently enhanced to quantitative cortical bone imaging [20, 21]. Finally the last QUS configuration correspond to axial transmission (AT), with transducers aligned along the long bone axis [22]. The first measured clinical AT parameter was the velocity of the First Arriving Signal (VFAS also sometimes designated as speed of sound SOS), with frequencies of interest ranging from a few kHz [23], hundred of kHz [24] to a few MHz [25]. Its fracture discrimination ability has been shown similar or equivalent to DXA in numerous clinical studies since the 1990’s [26]. Authors proposed to measure a second clinical AT parameter, the slowest velocity denoted fundamental flexural guided waves (FFGW) [27] or the fundamental anti-symmetric Lamb mode A0 [28], with similar fracture discrimination abilities.

In order to provide performance beyond aBMD and ultrasonic velocities, complete AT signals could be studied. Indeed, the signal richness is linked to the waves guided by the cortical shell, originated in the reflections and interference along the propagation path [22]. Therefore, measured ultrasonic Guided Waves (GW) associated with an appropriate waveguide model have the potential to yield estimates of cortical parameters of clinical interest. For example, cortical thickness can be estimated using the FFGW [27] or combined material and geometrical cortical properties using all measured guided modes [29, 30]. Several signal processing approaches have been proposed to analyse GW measured with AT, such as the Radon transform for multichannel signals [31], dispersive Radon transform [32], adaptive array signal processing [33] or rotation invariant technique [34]. Likewise, Machine and Deep Learning approaches have been proposed to osteoporosis [35], guided waves [36] and both [37].

Using projection of waveguide models onto the singular vector basis of bidirectional axial transmission (BDAT) signals, concurrent identification of cortical thickness (Ct.Th) and porosity (Ct.Po) were validated on ex vivo human specimens [38, 39]. Then, in a first clinical study, assessment of Ct.Th and Ct.Po by BDAT were used to discriminate between (non traumatic) fractured and non-fractured patients [40]. In this pilot study, BDAT measurements were carried out by physicists using a simplistic guiding interface, based on the visual appreciation of the guided wave spectrum image [40]. The aim of this study is to test, in a second cross-sectional study, if the device could be easily used in a clinical environment, by hospital operators using an improved guiding interface relying on additional quantitative criteria. In addition to cortical thickness (Ct.Th) and porosity (Ct.Po), two velocities VFAS and VA0 are also measured in this study. Discrimation abilities of combination of these parameters with clinical factors will be tested using multivariate Partial Least Square discrimination analyses with Leave-One-Out Cross-Validation (PLS-LOOCV) and compared to DXA performance. Assessment of these BDAT parameters may improve the clinical identification of patients at high risk of fracture.

Materials and methods

Subjects

One hundred and nineteen patients (93 women, 26 men), aged from 41 to 95 years old, BMI from 16 to 47 kg.m−2, were recruited from Marien Hospital and St. Anna Hospital (Herne, Germany) between August 2018 and February 2019. Exclusion criteria were: traumatic fracture (n = 2), ultrasonic measurement failure (n = 11), femoral DXA failure (n = 10) and vertebral DXA failure (n = 9). Due to the relatively small number of patients, two populations will be considered in the following: the complete successful BDAT measurement minus two traumatic fractures (n = 106), in order to explore BDAT fracture discrimination ability and the same group minus the 19 DXA failures (n = 87), in order to compare both techniques.

A written informed consent was provided by the subjects. The procedure of the study was in accordance with the Declaration of Helsinki. The OsteoSys study protocol was approved by the ethical committee of Ruhr University Bochum (no. 16–5714 approved on the 07.06.2016, including an amendment approved on the 24.01.2017) [41]. The information about non-traumatic fracture, including site and time, was collected in medical records. Three groups were created: a control group with patients without fracture (NF); patients with any non-traumatic fractures (F) divided in two subgroups: patients with vertebral fractures (VF) and patients with non vertebral fractures (NVF). Each patient of the fractured group presented only one non-traumatic fracture, i.e., there is no patient with multiple fractures.

Measurements

Ultrasonic measurement were performed using the QUS device (Azalée, Paris, France) consisting in three custom-made parts. First, a 1-MHz bi-directional axial transmission (BDAT) probe adapted to forearm measurements (Vermon, Tours, France), is composed of a linear array of piezocomposite elements divided in three parts: one array of 24 receivers surrounded by two arrays of 5 transmitters each. The transmitter and receiver array pitches are respectfully equal to 1 and 0.8 mm. Second, an electronic device used to transmit, receive and digitize signals (Althaïs, Tours, France). The electronic device allows exciting each transmitter successively with a wideband pulse (170 V, 1-MHz central frequency). Third, a human machine interface (HMI), developed to display the spectrum of guided waves and provide the cortical parameters in quasi real-time (at a frame rate up to 4 Hz) and to guide the operator in finding during measurement the optimal position of the probe with respect to the main bone axis (BleuSolid, Paris, France).

Estimates of cortical thickness and porosity are obtained by searching the maximum position of the so-called Proj function. This approach is an extension of the signal processing applied to extract the experimental guided mode wave numbers from the maxima of the so-called Norm function [42], also denoted guided wave spectrum images [37]. In case of the Norm function, each pixel corresponds to the projection of attenuated plane plane into the basis of the reception singular vectors. Similarly, in case of the Proj function, each pixel corresponds to the projection of waveguide model, parametrized by cortical thickness and porosity. Typical examples of Proj functions (left column) along with their associated experimental guided modes corresponding to the maxima of the Norm functions (right column) are illustrated on Fig 1. Details about signal processing steps can be found in Refs. [38, 39]. In addition to Ct.Th and Ct.Po estimates, two ultrasonic velocities VFAS (first arriving signal) and VA0 (A0 Lamb mode) are also measured [28, 43]. Finally, five cortical parameters are obtained: two velocities VFAS and VA0; two inverse problem parameters Ct.Th and Ct.Po and additionally the ratio Ct.Po/Ct.Th.

Fig 1.

Fig 1

Typical examples of Norm (left) and Proj (right) functions measured in vivo: maximum in the (Ct.Th—Ct.Po) plane (right) corresponds to the best fitting wave guide model, shown with lines in the (fk) plane (left), and provides estimates of cortical thickness and porosity.

A specific scanning methodology was carefully followed for measuring the patients. BDAT measurements were performed on a standardized region of interest (ROI), i.e., the center of the probe is placed at the lateral side of the one-third distal radius. Measurements were done on the non-dominant forearm. When the non-dominant forearm undergoes a recent fracture for example, measurements were done on the contralateral arm. The probe was placed in contact with the skin using ultrasonic gel for coupling (Aquasonic, Parker Labs Inc., Fairfield NJ, USA). The measurement protocol consists of four series of ten acquisitions. By means of the parameter values displayed in real-time by the HMI, once a correct position is found, a series of ten successive acquisitions are recorded without moving the probe. Each series corresponds to an intermediate repositioning of the probe. The final values of the identified waveguide parameters are set to the mean of the values of each successful series. The BDAT measurement on a patient typically lasts 10 to 15 minutes. Measurement were performed by clinical operators after a 2 day training session. In the previous pilot study, BDAT measurements were carried out by physicists using a first version of the guiding interface, based on the real time visualisation of the guided wave spectrum image, or Norm function [40]. In the updated version of interface, used in this study, several improvements have been implanted in order to make the measurement more robust, i.e., to ensure that the probe is correctly aligned with respect to the bone axis. First, real time measurement of the two velocities VA0 and VFAS are provided.Secondly, if these two values are obtained, the inverse problem is performed in real time, using a gradient approach calculation of the Proj function. On the contrary, if the two velocities are not obtained, the probe is considered as not correctly aligned and calculations are performed for the next probe position.

Three DXA parameters are considered corresponding to measurements performed on the L1–L4 lumbar spine (aBMD spine), femoral neck (aBMD fn) and total femur (aBMD total). The two femoral aBMD values correspond to the mean of the values obtained for both femurs. If only one side was available, the retained aBMD corresponded to the existing value.

Statistical analysis

Non parametric tests were used, and statistical results were considered significant for p-value values below 0.05. For each variable, a Wilcoxon–Mann–Whitney test was performed to determine whether the values were significantly different between the non-fractured group and any non-traumatic fractured group. Spearman’s rank correlation analysis was used to compare estimates of ultrasonic parameters with age, BMI and aBMD values.

Following Armbrecht et al. [17], the fragility fracture discrimination performance of BDAT and DXA was assessed by means of multivariate Partial Least Square discrimination analyses with Leave-One-Out Cross-Validation (PLS-LOOCV) using the libPLS library [44]. Significant parameters were used to build a first set of discrimination models used to predict vertebral, non-vertebral, and all fragility fractures. A second set of models was also build using parameters associated with p-values lower than 0.01. In addition to DXA and/or BDAT parameters, other parameters were anthropometric data (weight, height, BMI), gender and age. The mean and standard error (SE) of the area under the curve (AUC) of the receiver operation characteristics (ROC), accuracy, sensitivity, and odds ratio (OR) with 95% confidence intervals (CI) were calculated. All statistical tests were performed using the Statistics Toolbox of Matlab R2021b (MathWorks, Natick, MA, USA).

Finally, in order to compare with classical statistical approach, odds ratios (ORs) were also calculated using binomial logistic regression analysis. ORs are expressed as increases in the estimated fracture risk per one standard deviation decrease. To estimate the sensitivity and specificity of the different parameters for the fracture discrimination, the receiver operator characteristic (ROC) curves were calculated. In addition, the area under the curve (AUC) was determined. Adjusted ORs and AUCs were computed with age, gender and BMI as covariates [45]. Combinations of BDAT, i.e., Ct.Th and Ct.Po as well as the ratio Ct.Po/Ct.Th, were also investigated. Results are provided in Supporting information.

Results

BDAT measurement failure

The ultrasonic measurement failed for 9.2% of the total cohort (11 out of 119). Fig 2 displays the failure rate as a function of BMI or age (up) together with the BMI and age distributions (down) for 106 patients. It can be observed that failure rate tends to increase with both age and BMI. However, increase with age appears to be more regular than increase with BMI: failure rate is constant and about 10% for BMI smaller than 32 kg.m−2 while a a failure rate about 17% is observed for larger BMIs. Moreover, no association were observed between measurement failure and fractures.

Fig 2. BDAT measurement failure rate and distribution for BMI and age, for the first population (106 patients).

Fig 2

Patient characteristics

Among the 106 patients for whom the measurements were successful, 79 belongs to the control group without fracture (NF), 27 with non-traumatic fractures (F) corresponding to 13 patients with vertebral fractures (VF) and 14 with non vertebral fractures (NVF) associated with the following sites: 10 hip fractures, femoral neck (n = 7), pelvis (n = 2), pertrochanter (n = 1) as well as 4 others sites, humerus (n = 2), elbow (n = 1) and shoulder (n = 1). The patient characteristics are shown in Table 1.

Table 1. Descriptive characteristics as mean and standard deviation for the first population (106 patients).

NF (N = 79) F (N = 27) VF (N = 13) NVF (N = 14)
age (years) 75.0 (13.1) 79.7 (9.2) 74.8 (9.4) 84.2 (6.5)*
Height (cm) 164.9 (8.6) 164.7 (8.5) 166.2 (9.0) 163.7 (8.3)
Weight (kg) 71.8 (18.4) 69.2 (10.9) 71.8 (11.3) 66.7 (10.2)
BMI (kg.m−2) 26.2 (5.6) 25.4 (3.4) 26.1 (3.9) 24.9 (3.0)
VFAS (m.s−1) 3993 (99) 3949 (80)* 3961 (87) 3938 (75)*
VA0 (m.s−1) 1680 (70) 1656 (70) 1685 (68) 1630 (63)*
Ct.Th (mm) 2.7 (0.6) 2.4 (0.7) 2.5 (0.7) 2.3 (0.7)
Ct.Po (%) 10.0 (4.6) 11.1 (4.3) 9.3 (3.6) 12.8 (4.2)*
Ct.Po/Ct.Th 3.86 (1.74) 4.84 (1.77)* 3.92 (1.68) 5.70 (1.42)***

BMI, body mass index; US ultrasound; Ct.Th, cortical thickness; Ct.Po cortical porosity; NF non fractured, F all non traumatic fractures VF vertebral fractures, NVF non vertebral fractures, *p < 0.05, **p < 0.01, ***p < 0.001 vs non-fractured group.

As expected, age was significantly higher for fractured population (80 years) than for controls (75 years). The age difference is larger between non-vertebral fractures (85 years) and controls. Patients with vertebral fractures were found with similar age to controls (75 years). No significant differences were observed in BMI, height and weight between groups. Ct.Th was marginally lower in fractured groups (2.3—2.5 mm; p = 0.10) in comparison with the non-fractured group (2.7 mm). Ct.Po was higher in the F and NVF groups (11.1—12.8%) compared to the non-fractured group (10.0%), however the difference was only significant for the NVF group (p = 0.03). The ratio Ct.Po/Ct.Th was significantly higher in both F and NVF fractured groups (4.8—5.6) compared to the non-fractured group (3.9). The two ultrasonic velocities VFAS and VA0 are lower in the fractured groups. The VFAS difference is significant for both F and NVF groups while VA0 difference is significant only for NVF fractures. Spearman’s correlation coefficients R between BDAT parameters, age and BMI are reported in Table 2. BDAT parameters are significantly correlated with age and BMI, with R ranging from 0.23 to 0.53. Ct.Th and Ct.Po as well as age and BMI are not correlated.

Table 2. Spearman’s correlation coefficients R between BDAT parameters, age and BMI, for the first population (106 patients).

Ct.Th Ct.Po VFAS VA0 age BMI
Ct.Th - 0.18 0.22 * 0.41 *** - 0.38 *** 0.23 *
Ct.Po 0.18 - - 0.21 ** - 0.59 *** 0.26 ** -0.35 ***
VFAS 0.22 * - 0.21 ** - 0.31 ** - 0.47 *** 0.26 ***
VA0 0.41 *** - 0.59 *** 0.31 ** - - 0.53 *** 0.42 ***
age - 0.38 *** 0.26 ** - 0.47 *** - 0.53 *** - -0.11
BMI 0.23 * - 0.35 *** 0.26 *** 0.42 *** -0.11 -

* p < 0.05,

** p < 0.01,

*** p < 0.001

Comparison between BDAT and DXA parameters

In order to compare BDAT performances with the current gold standard DXA, a second population of 87 patients was considered, taking into account failure cases of both techniques. First, Spearman’s correlations were reported in Table 3. Almost all correlations were found significant, except aBMD spine with Ct.Th and VA0. Significant correlation coefficient R varies from 0.21 to 0.46. The largest coefficients, i.e., above 0.4, were observed for aBMD fn with Ct.Th/Ct.Po, VFAS and VA0. Estimation of the three aBMD from ultrasound Bi-Directional Axial Transmission and anthropometric parameters using PLS regression are shown in Fig 3, with R2 ranging from 0.25 to 0.35.

Table 3. Spearman’s correlation coefficients R between BDAT and DXA parameters and the second population (87 patients).

aBMD total aBMD fn aBMD spine
Ct.Th 0.21 * 0.26 * 0.09
Ct.Po - 0.28 ** - 0.38 *** - 0.21 *
Ct.Po/Ct.Th - 0.39 ** - 0.48 *** - 0.24 *
VFAS 0.46 *** 0.45 *** 0.39 ***
VA0 0.37 ** 0.44 *** 0.19

* p < 0.05,

** p < 0.01,

*** p < 0.001

Fig 3. Estimation of aBMD at femur neck (a), total femur (b) and spine (c) from ultrasound Bi-Directional Axial Transmission and anthropometric parameters using PLS regression.

Fig 3

Fracture discrimination

First, results of discrimination performance analyses obtained with PLS-LOOCV approach are considered and summarized in Table 4. The p-values of significant results (p < 0.05) are indicated in bold letters. Results for the vertebral fractures (VF group) are not shown as any combination parameters, either with BDAT or DXA, was found discriminant. For the first population (BDAT only, N = 106), all non traumatic fractures (F) and all significant parameters, combination of VFAS and Ct.Po/Ct.Th provided a moderate discrimination (AUC = 0.63, OR = 2.5). When restricted to the 14 non vertebral fractures (NVF), discrimination significantly improved to AUC equal to 0.75 and OR equal to 7.5. In this case, all five BDAT, along with age, are significant or very close (VFAS p = 0.052). Similar results are observed for the second population (N = 87), matched for both techniques. In case of all non traumatic fractures (F), moderate discrimination was observed for both techniques, with AUCs equals to 0.66 (BDAT and DXA) and ORs equals to 2.9 (BDAT) and 2.4 (DXA). As for the first population, better discrimination was observed for non vertebral fractures (NVF), with AUCs equals to 0.76 (BDAT) and 0.74 (DXA) and ORs equals to 16.4 (BDAT) and 7.1 (DXA). Both femoral aBMD were found significant contrary to spinal aBMD. When the two techniques were combined, an improvement was observed for the F group, with AUC and OR equals to 0.69 and 3.1, respectively. Considering the second set of models, build with parameters associated with p < 0.01, AUC and OR values tended to slightly increase. For example, for the NVF group of the second population, AUC increased from 0.76 to 0.78, while OR remained unchanged. For the NVF group, BDAT (AUC = 0.78) performed better than DXA (AUC = 0.74), while DXA (AUC = 0.67) slightly outperformed BDAT (AUC = 0.66) for F group. Combination of both techniques allowed a limited improved with AUC reaching 0.69 (F) and 0.79 (NVF). One can observe that the ratio Ct.Po/Ct.Th was the main parameter for the NVF group while the best discrimination performances were obtained using combination of parameters for the F group.

Table 4. Discrimination obtained with PLS-LOOCV: p values, odds ratios (OR) and areas under the ROC curve (AUC) for both BDAT and DXA techniques for the two populations (106 and 87 patients).

N = 106 (79 NF) N = 87 (64 NF)
BDAT BDAT DXA BDAT & DXA
27 F 14 NVF 23 F 13 NVF 23 F 13 NVF 23 F 13 NVF
Ct.Th 0.053 0.035 * 0.097 0.076 - - 0.097 0.076
Ct.Po 0.246 0.032 * 0.189 0.023 * - - 0.189 0.023 *
VFAS 0.040 * 0.052 0.018 * 0.024 * - - 0.018 * 0.024 *
VA0 0.135 0.015 * 0.108 0.019 * - - 0.108 0.019 *
Ct.Po/Ct.Th 0.013 * <0.001 *** 0.023 * <0.001 *** - - 0.023 * <0.001 **
age 0.090 0.012 * 0.025 * 0.003 ** 0.025 * 0.003 ** 0.025 * 0.003 **
height 0.484 0.315 0.481 0.252 0.481 0.252 0.481 0.252
weight 0.978 0.645 0.622 0.373 0.622 0.373 0.622 0.373
BMI 0.482 0.370 0.659 0.381 0.659 0.381 0.659 0.381
gender 0.743 0.912 0.514 0.978 0.514 0.978 0.514 0.978
aBMD fn - - - - 0.003 ** 0.002 ** 0.003 ** 0.002 **
aBMD total - - - - 0.007 ** 0.009 ** 0.007 ** 0.009 **
aBMD spine - - - - 0.140 0.125 0.140 0.125
models build with all significant parameters (p < 0.05)
AUC 0.63 0.75 0.66 0.76 0.66 0.74 0.69 0.77
CI [0.62–0.65] [0.73–0.76] [0.64–0.68] [0.73–0.78] [0.65–0.68] [0.72–0.76] [0.66–0.71] [0.75–0.80]
OR 2.5 7.5 2.9 16.4 2.4 7.1 3.1 7.1
CI [1.6–3.4] [6.0–9.1] [1.9–4.0] [14.3–18.5] [1.4–3.4] [5.5–8.7] [2.1–4.1] [5.5–8.7]
accuracy 0.59 0.60 0.60 0.64 0.57 0.61 0.61 0.61
sensitivity 0.67 0.86 0.70 0.92 0.65 0.85 0.70 0.85
specificity 0.56 0.56 0.56 0.58 0.56 0.56 0.58 0.56
models build with parameters p < 0.01
AUC - 0.76 - 0.78 0.67 0.74 0.67 0.79
CI - [0.76–0.76] - [0.77–0.79] [0.65–0.69] [0.72–0.76] [0.65–0.69] [0.77–0.81]
OR - 7.5 - 16.4 3.9 7.1 3.9 7.1
CI - [6.0 9.1] - [14.3 18.5] [2.8–4.9] [5.5–8.7] [2.8–4.9] [5.5–8.7]
accuracy - 0.60 - 0.64 0.62 0.61 0.62 0.61
sensitivity - 0.86 - 0.92 0.74 0.85 0.74 0.85
specificity - 0.56 - 0.58 0.58 0.56 0.58 0.56

Reference category is non fractured (NF); CI confidence interval;

* p < 0.05;

** p < 0.01;

*** p < 0.001;

Secondly, results obtained with the classical method, i.e., logistic regression, are reported in S1 Table (first population) and S2 Table (second population) for the F and NVF groups. As before, the VF group is not reported due to the lack of significance. Systematic adjustment for cofounder variables age, BMI and gender was made for all the analyses due to the weak to moderate significant Spearman’s correlations (R ranging from 0.23 to 0.53, p < 0.05 Table 2). Similar results compared to the first method (PLS-LOOC) were observed, e.g. moderate and good discrimination for the F and NVF groups, respectively. Moreover, one can observed that the confidence intervals are systematically larger for the logistic regression compared to the PLS-LOOCV method. For example, in case of non vertebral fractures, the AUC for adjusted Ct.Po/Ct.Th is equal to 0.81 [0.65—0.90], whereas the PLS analysis provided a value of 0.76 [0.73—0.76] for the same patients of the first population (106 patients).

Discussion

This study investigated the ability of the five BDAT parameters VFAS, VA0, Ct.Th, Ct.Po and the ratio Ct.Po/Ct.Th to discriminate retrospectively patients with non-traumatic fractures from the control group, in a clinical environment. These parameters were estimated from measurements at the one-third distal radius using an ultrasonic guided wave technology, i.e., the Bi-Directional Axial Transmission (BDAT). In this second cross-sectional study, measurements were performed by clinical operators, in contrary to the pilot study, for which measurements were performed by laboratory staff. The discriminator values of BDAT parameters were assessed using multivariate Partial Least Square discrimination analyses with Leave-One-Out Cross-Validation (PLS-LOOCV) and a binomial logistic regression analysis. The main findings from this study were that VFAS and the ratio Ct.Th/Ct.Po were discriminant for all non-traumatic fractures (F). Discrimination was found better for non-vertebral fractures (NVF) with all BDAT parameters significantly or marginally discriminant. BDAT performance were found comparable (F) or slightly better (NVF) than the current gold standard DXA.

Our study demonstrate the clinical utility of bi-directional axial transmission measurements, corroborating previous BDAT study showing Ct.Po adjusted with age, BMI and cortisone, as discriminant parameter for all non-traumatic fractures as well as for subgroups hip, forearm and vertebral fractures [40]. However, in the pilot clinical study, the reference population was younger (NF 62 ± 7 years vs 73 ± 13 in this study) and no men were included. Moreover, the population was also larger with 201 included patients against 106 in the present study. The lack of sensitivity to vertebral fractures in this study may be partly explained by the fact that vertebral fractures are associated with trabecular bone [46] whereas the measurement site (one-third distal radius) is mainly cortical. In addition contrary to the pilot study, no significant age difference were observed between control and VF groups in the present study (Table 1).

An important observation was that the failure rate decreased from 20%, as observed in the pilot clinical study [40]), to 9% (11 out of 119), in this current study. This is likely due to the improvement of the guiding interface and acquisition protocol which were improved and adapted for trained operators. In the first version, the guiding feedback was visual and therefore more operator dependant. The operator was looking for the best guided wave spectrum image. The current version provides a real time numerical feedback about the probe alignment. In this study, the BDAT failure rate is lower than DXA one on the same population (17%, 20 out of 119). It can be noticed that the current BDAT failure rate is comparable to the usual DXA failure rate (10—11%) [47] and to failure rates of previous ultrasonic devices [43, 48]. It can be noticed that four patients corresponded to failure for both BDAT and vertebral DXA, however without manifest explanation.

A main advantage of the BDAT approach is to provide estimates of two physical parameters of cortical bone, thickness and porosity, which knowledge would potentially help the physician in his diagnosis [5]. Cortical thickness has been found discriminant of fracture in several previous studies [49]. For example, Long et al. showed in 2015 that the normalized cortical bone thickness (NCBT) estimated from the patient’s hip DXA, discriminated hip fracture [50]. Likewise, Ye et al. demonstrated in 2020 that estimates of distal radius cortical thickness (DRCT), obtained from anteroposterior radiographs, can predict osteoporosis [51]. Likewise, cortical bone porosity is also known to be associated with fragility fractures [52]. Cortical bone parameters, derived from QCT or HR-pQCT, have been found discriminant for fragility fractures in numerous studies [7, 53]. For example, Ohlsson et al. shown that the cortical bone area predicts incident fractures independently of aBMD in older men [54]. Cortical bone porosity can also be evaluated from MRI ultrashort echo time (UTE) [11, 55]. In all previously cited methods, i.e., DXA, BDAT, QCT and MRI, the sub-millimetric spatial resolution does not allow to resolve the cortical pores. Therefore, cortical bone appears as a homogenized material, which elasticity can be parametrized with porosity [56]. Recently, it has been shown that cortical thinning and accumulation of large cortical pores in the tibia reflect local structural deterioration of the femoral neck and can predict fragility fractures [10, 17]. The second HR-pQCT generation, with a lower resolution, is able to resolve the larger pores, usually associated with resorption cavities [17].

A first limitation of this study is the number of included patients, i.e., 106, and in particular the number of fractured patients, with numbers ranging from 13 to 27. It was observed that all five BDAT parameters were almost always significant or marginal. The statistical significance of each parameters as well as their combinations is expected to increase with larger patient groups. That is why, further studies would be necessary to strengthen the interest of the method. In particular, prospective studies would be of major interest. A second limitation is that fact that DXA measurements were performed on skeletal sites, i.e., spine and hip, that are different from the BDAT ones, i.e., one-third distal radius, which limits the comparisons between the two techniques. However, on can observe that the additive value in term of discrimination when combining BDAT and DXA (last column of Table 4). A third limitation concerns the comprehension of the failure cases. First, high values of soft tissue layer are known to limit BDAT measurement due to the difficulty to align the probe with the bone axis and as parallel as possible to the bone surface [43]. A second source of measurement failure is associated with the irregularity of the internal cortical bone layer due to trabecularisation [38, 57].

To overcome this last limitation, simulations of guided wave propagation using realistic cortical bone map should be helpful to gain insight about the impact of the waveguide irregularities on the guide mode propagation and their measurement [58]. Moreover, an improved guided interface could also help to diminish the failure rate. Tests are currently done with an interface showing the Proj function in a real time in addition to the Norm function (Fig 1). To this end, significant calculation speed up have been obtained [59]. In addition, improved detection of patients at risk of fractures may be also achieved by the incorporation of novel ultrasonic parameters. For example, cortical bone attenuation appears to be a factor of interest [60]. A recent study showed that this parameter could be experimentally estimated using Dictionary Learning and Orthogonal Matching Pursuit points of view [19]. Moreover, attenuation can be taken into account in the viscoelastic model and therefore into the waveguide model using a simplified homogenization model depending one additional temporal parameter τmatrix [61]. Moreover, Machine learning approaches could also be used, in parallel or in addition to physical modeling, in order to improve the fracture discrimination [35, 37]. Deep Learning could be applied to guided wave spectrum or inverse problem images, following approaches already tested in medical ultrasound [62]. Finally, cortical bone parameters obtained with BDAT could be of interest beyond osteoporosis detection, for example for femoral stem stability monitoring [63] or other bone diseases [64].

Conclusion

In summary, this study shows the potential of BDAT measurements to provide four in vivo parameters: cortical thickness and porosity estimates and two velocities VFAS and VA0, using a portable and non-ionizing device in a clinical environment.The fracture risk assessment by BDAT method in older patients, in a clinical setting, suggests the benefit of the affordable and transportable device for the routine use.

Supporting information

S1 Table. Discrimination obtained with logistic regression: Odds ratios (OR) and areas under the ROC curve (AUC) for BDAT technique on the first population (106 patients).

(PDF)

S2 Table. Discrimination obtained with logistic regression: Odds ratios (OR) and areas under the ROC curve (AUC) for both techniques BDAT and DXA and the second population (87 patients).

(PDF)

Data Availability

Data are available at: https://osf.io/xy9qv/.

Funding Statement

This work was supported by the EFRE.NRW program OsteoSys [EFRE-0800411 and EFRE-0800427, LS-1-1-019c]. Jean-Gabriel Minonzio is supported by Grant ANID / FONDECYT / REGULAR / 1201311 and ECOS 200061. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. There was no additional external funding received for this study.

References

  • 1. Clynes MA, Harvey NC, Curtis EM, Fuggle NR, Dennison EM, Cooper C. The epidemiology of osteoporosis. British medical bulletin. 2020;133(1):105–117. doi: 10.1093/bmb/ldaa005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Ormeño J, Martínez R, Frías C, Plessing C, Quevedo I. Decreasing hip fracture rates among older adults in Chile, 2001–2019. Archives of Osteoporosis. 2022;17:26. doi: 10.1007/s11657-022-01067-z [DOI] [PubMed] [Google Scholar]
  • 3. Liu J, Curtis E, Cooper C, Harvey N. State of the art in osteoporosis risk assessment and treatment. Journal of Endocrinological Investigation. 2019;42. doi: 10.1007/s40618-019-01041-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. de Oliveira MA, Moraes R, Castanha EB, Prevedello AS, Filho JV, Bussolaro FA, et al. Osteoporosis Screening: Applied Methods and Technological Trends. Medical Engineering & Physics. 2022; p. 103887. doi: 10.1016/j.medengphy.2022.103887 [DOI] [PubMed] [Google Scholar]
  • 5. Choksi P, Jepsen KJ, Clines GA. The challenges of diagnosing osteoporosis and the limitations of currently available tools. Clinical diabetes and endocrinology. 2018;4:12. doi: 10.1186/s40842-018-0062-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Maeda SS, LLibre RDS, Arantes HP, de Souza GC, Molina FFC, Wiluzanski D, et al. Challenges and opportunities for quality densitometry in Latin America. Archives of Osteoporosis. 2021;16(1):23. doi: 10.1007/s11657-021-00892-y [DOI] [PubMed] [Google Scholar]
  • 7. Kral R, Osima M, Borgen TT, Vestgaard R, Richardsen E, Åshild Bjørnerem. Increased cortical porosity and reduced cortical thickness of the proximal femur are associated with nonvertebral fracture independent of Fracture Risk Assessment Tool and Garvan estimates in postmenopausal women. PLOS ONE. 2017;12(9):e0185363. doi: 10.1371/journal.pone.0185363 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Jiang H, Robinson D, Yates C, Lee PVS, Wark JD. Peripheral quantitative computed tomography (pQCT)–based finite element analysis provides enhanced diagnostic performance in identifying non-vertebral fracture patients compared with dual-energy X-Ray absorptiometry. Osteoporosis International. 2020;31. doi: 10.1007/s00198-019-05213-1 [DOI] [PubMed] [Google Scholar]
  • 9. Cappelle S, Moreau M, Karmali R, Iconaru L, Baleanu F, Kinnard V, et al. Discriminating value of HR-pQCT for fractures in women with similar FRAX scores: a substudy of the FRISBEE cohort. Bone. 2020;143:115613. doi: 10.1016/j.bone.2020.115613 [DOI] [PubMed] [Google Scholar]
  • 10. Iori G, Schneider J, Reisinger A, Heyer F, Peralta L, Wyers C, et al. Cortical thinning and accumulation of large cortical pores in the tibia reflect local structural deterioration of the femoral neck. Bone. 2020;137:115446. doi: 10.1016/j.bone.2020.115446 [DOI] [PubMed] [Google Scholar]
  • 11. Hong AL, Ispiryan M, Padalkar MV, Jones BC, Batzdorf AS, Shetye SS, et al. MRI-derived bone porosity index correlates to bone composition and mechanical stiffness. Bone Reports. 2019;11:100213. doi: 10.1016/j.bonr.2019.100213 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Behforootan S, Boughton O, Hansen U, Cobb J, Huthwaite P, Abel R. Ultrasound and Bone Disease: A Systematic Review. World Journal of Surgery and Surgical Research. 2021;4:1296. [Google Scholar]
  • 13. Gao C, Song H, Chen B, Zhang Z, Yue H. The Assessment of the Osteoporosis Self-Assessment Tool for Asians and Calcaneal Quantitative Ultrasound in Identifying Osteoporotic Fractures and Falls Among Chinese People. Frontiers in Endocrinology. 2021;12:508. doi: 10.3389/fendo.2021.684334 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Stein E, Rosete F, Young P, Kamanda-Kosseh M, McMahon D, Luo G, et al. Clinical Assessment of the 1/3 Radius Using a New Desktop Ultrasonic Bone Densitometer. Ultrasound in Medicine & Biology. 2013;39:388–395. doi: 10.1016/j.ultrasmedbio.2012.09.024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Brausch L, Dirksen R, Risser C, Schwab M, Stolz C, Tretbar S, et al. Classification of Distal Growth Plate Ossification States of the Radius Bone Using a Dedicated Ultrasound Device and Machine Learning Techniques for Bone Age Assessments. Applied Sciences. 2022;12(7). doi: 10.3390/app12073361 [DOI] [Google Scholar]
  • 16. Cortet B, Dennison E, Diez-Perez A, Locquet M, Muratore M, Nogués X, et al. Radiofrequency Echographic Multi Spectrometry (REMS) for the diagnosis of osteoporosis in a European multicenter clinical context. Bone. 2021;143:115786. doi: 10.1016/j.bone.2020.115786 [DOI] [PubMed] [Google Scholar]
  • 17. Armbrecht G, Nguyen Minh H, Massmann J, Raum K. Pore-size distribution and frequency-dependent attenuation in human cortical tibia bone discriminate fragility fractures in postmenopausal women with low bone mineral density. JBMR Plus. 2021;n/a(n/a):e10536. doi: 10.1002/jbm4.10536 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. van den Berg P, Schweitzer D, Van Haard PM, Geusens P, van den Bergh J. The use of pulse-echo ultrasound in women with a recent non-vertebral fracture to identify those without osteoporosis and/or a subclinical vertebral fracture: a pilot study. Archives of Osteoporosis. 2020;15:56. doi: 10.1007/s11657-020-00730-7 [DOI] [PubMed] [Google Scholar]
  • 19. Minonzio JG, Han C, Cassereau D, Grimal Q. In vivo pulse-echo measurement of apparent broadband attenuation and Q factor in cortical bone: A preliminary study. Physics in Medicine and Biology. 2021;66(15):155002. doi: 10.1088/1361-6560/ac1022 [DOI] [PubMed] [Google Scholar]
  • 20. Renaud G, Clouzet P, Cassereau D, Talmant M. Measuring anisotropy of elastic wave velocity with ultrasound imaging and an autofocus method—application to cortical bone. Physics in medicine and biology. 2020;65:23. doi: 10.1088/1361-6560/abb92c [DOI] [PubMed] [Google Scholar]
  • 21. Fincke J, Zhang X, Shin B, Ely G, Anthony BW. Quantitative Sound Speed Imaging of Cortical Bone and Soft Tissue: Results From Observational Data Sets. IEEE Transactions on Medical Imaging. 2022;41(3):502–514. doi: 10.1109/TMI.2021.3115790 [DOI] [PubMed] [Google Scholar]
  • 22. Tran TNHT, Le LH, Ta D. Ultrasonic Guided Waves in Bone: A Decade of Advancement in Review. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 2022; p. 1–1. doi: 10.1109/TUFFC.2022.3197095 [DOI] [PubMed] [Google Scholar]
  • 23. Vogl F, Friesenbichler B, Hüsken L, de Quervain IAK, Taylor WR. Can low-frequency guided waves at the tibia paired with machine learning differentiate between healthy and osteopenic/osteoporotic subjects? A pilot study. Ultrasonics. 2019;94:109–116. doi: 10.1016/j.ultras.2018.11.012 [DOI] [PubMed] [Google Scholar]
  • 24. Biver E, Pepe J, de Sire A, Chevalley T, Ferrari S. Associations between radius low-frequency axial ultrasound velocity and bone fragility in elderly men and women. Osteoporosis International. 2019;30(2):411–421. doi: 10.1007/s00198-018-4725-0 [DOI] [PubMed] [Google Scholar]
  • 25. Chiba K, Suetoshi R, Cretin D, Arai T, Kawajiri T, Okayama A, et al. Development of a QUS Device to Evaluate Deterioration of Cortical Bone: Verification by HR-pQCT and Measurements in Healthy Individuals and Dialysis Patients. Journal of Clinical Densitometry. 2021;24(1):94–105. doi: 10.1016/j.jocd.2020.02.002 [DOI] [PubMed] [Google Scholar]
  • 26. Fu Y, Li C, Luo W, Chen Z, Liu Z, Ding Y. Fragility fracture discriminative ability of radius quantitative ultrasound: a systematic review and meta-analysis. Osteoporosis International. 2021;32:23–38. doi: 10.1007/s00198-020-05559-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Kilappa V, Xu K, Moilanen P, Heikkola E, Ta D, Timonen J. Assessment of the Fundamental Flexural Guided Wave in Cortical Bone by an Ultrasonic Axial-Transmission Array Transducer. Ultrasound in Medicine & Biology. 2013;39(7):1223–1232. doi: 10.1016/j.ultrasmedbio.2013.02.002 [DOI] [PubMed] [Google Scholar]
  • 28. Schneider J, Ramiandrisoa D, Armbrecht G, Ritter Z, Felsenberg D, Raum K, et al. In Vivo Measurements of Cortical Thickness and Porosity at the Proximal Third of the Tibia Using Guided Waves: Comparison with Site-Matched Peripheral Quantitative Computed Tomography and Distal High-Resolution Peripheral Quantitative Computed Tomography. Ultrasound in Medicine & Biology. 2019;45(5):1234–1242. doi: 10.1016/j.ultrasmedbio.2019.01.008 [DOI] [PubMed] [Google Scholar]
  • 29. Bochud N, Vallet Q, Minonzio JG, Laugier P. Predicting bone strength with ultrasonic guided waves. Scientific Reports. 2017;7:43628. doi: 10.1038/srep43628 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Pereira D, Fernandes J, Belanger P. Ex Vivo Assessment of Cortical Bone Properties Using Low-Frequency Ultrasonic Guided Waves. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 2020;67(5):910–922. doi: 10.1109/TUFFC.2019.2958035 [DOI] [PubMed] [Google Scholar]
  • 31. Tran TNHT, Le LH, Sacchi MD, Nguyen VH, Lou EHM. Multichannel filtering and reconstruction of ultrasonic guided wave fields using time intercept-slowness transform. The Journal of the Acoustical Society of America. 2014;136(1):248–259. doi: 10.1121/1.4881929 [DOI] [PubMed] [Google Scholar]
  • 32. Xu K, Laugier P, Minonzio JG. Dispersive Radon transform. The Journal of the Acoustical Society of America. 2018;143(5):2729–2743. doi: 10.1121/1.5036726 [DOI] [PubMed] [Google Scholar]
  • 33. Okumura S, Nguyen VH, Taki H, Haïat G, Naili S, Sato T. Rapid High-Resolution Wavenumber Extraction from Ultrasonic Guided Waves Using Adaptive Array Signal Processing. Applied Sciences. 2018;8(4). doi: 10.3390/app8040652 [DOI] [Google Scholar]
  • 34. Chen Q, Xu K, Ta D. High-resolution Lamb waves dispersion curves estimation and elastic property inversion. Ultrasonics. 2021;115:106427. doi: 10.1016/j.ultras.2021.106427 [DOI] [PubMed] [Google Scholar]
  • 35. Smets J, Shevroja E, Hügle T, Leslie WD, Hans D. Machine Learning Solutions for Osteoporosis—A Review. Journal of Bone and Mineral Research. 2021;36(5):833–851. doi: 10.1002/jbmr.4292 [DOI] [PubMed] [Google Scholar]
  • 36. Li Y, Xu K, Li Y, Xu F, Ta D, Wang W. Deep Learning Analysis of Ultrasonic Guided Waves for Cortical Bone Characterization. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 2021;68(4):935–951. doi: 10.1109/TUFFC.2020.3025546 [DOI] [PubMed] [Google Scholar]
  • 37. Miranda D, Olivares R, Munoz R, Minonzio JG. Improvement of patient classification using feature selection applied to Bi-Directional Axial Transmission. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 2022; 69(9):2663–2671. doi: 10.1109/TUFFC.2022.3195477 [DOI] [PubMed] [Google Scholar]
  • 38. Minonzio JG, Bochud N, Vallet Q, Bala Y, Ramiandrisoa D, Follet H, et al. Bone cortical thickness and porosity assessment using ultrasound guided waves: An ex vivo validation study. Bone. 2018;116:111–119. doi: 10.1016/j.bone.2018.07.018 [DOI] [PubMed] [Google Scholar]
  • 39. Schneider J, Iori G, Ramiandrisoa D, M H, Gräsel M, Chappard C, et al. Ex Vivo cortical porosity and thickness predictions at the tibia using full-spectrum ultrasonic guided-wave analysis. Archives of Osteoporosis. 2019;14:21. doi: 10.1007/s11657-019-0578-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Minonzio JG, Bochud N, Vallet Q, Ramiandrisoa D, Etcheto A, Briot K, et al. Ultrasound-based estimates of cortical bone thickness and porosity are associated with non-traumatic fractures in postmenopausal women: A pilot study. Journal of Bone and Mineral Research. 2019;34(9):1585–1596. doi: 10.1002/jbmr.3733 [DOI] [PubMed] [Google Scholar]
  • 41. Pourhassan M, Buehring B, Stervbo U, Rahmann S, Mölder F, Rütten S, et al. Osteosarcopenia, an Asymmetrical Overlap of Two Connected Syndromes: Data from the OsteoSys Study. Nutrients. 2021;13(11). doi: 10.3390/nu13113786 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Minonzio JG, Talmant M, Laugier P. Guided wave phase velocity measurement using multi-emitter and multi-receiver arrays in the axial transmission configuration. The Journal of the Acoustical Society of America. 2010;127(5):2913–2919. doi: 10.1121/1.3377085 [DOI] [PubMed] [Google Scholar]
  • 43. Talmant M, Kolta S, Roux C, Haguenauer D, Vedel I, Cassou B, et al. In vivo Performance Evaluation of Bi-Directional Ultrasonic Axial Transmission for Cortical Bone Assessment. Ultrasound in Medicine and Biology. 2009;35(6):912–919. doi: 10.1016/j.ultrasmedbio.2008.12.008 [DOI] [PubMed] [Google Scholar]
  • 44. Li HD, Xu QS, Liang YZ. libPLS: An integrated library for partial least squares regression and linear discriminant analysis. Chemometrics and Intelligent Laboratory Systems. 2018;176:34–43. doi: 10.1016/j.chemolab.2018.03.003 [DOI] [Google Scholar]
  • 45. Ravindrarajah R, Hazra N, Charlton J, Jackson S, Dregan A, Gulliford M. Incidence and mortality of fractures by frailty level over 80 years of age: cohort study using UK electronic health records. BMJ Open. 2018;8:e018836. doi: 10.1136/bmjopen-2017-018836 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Oppenheimer-Velez ML, Giambini H, Rezaei A, Camp JJ, Khosla S, Lu L. The trabecular effect: A population-based longitudinal study on age and sex differences in bone mineral density and vertebral load bearing capacity. Clinical Biomechanics (Bristol, Avon). 2018;55:73–78. doi: 10.1016/j.clinbiomech.2018.03.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Blake GM, Fogelman I. How important are BMD accuracy errors for the clinical interpretation of DXA scans? Journal of Bone Mineral Research. 2008;23(4):457–462. doi: 10.1359/jbmr.071119 [DOI] [PubMed] [Google Scholar]
  • 48. Moilanen P, Määttä M, Kilappa V, Xu L, Nicholson PHF, Alén M, et al. Discrimination of fractures by low-frequency axial transmission ultrasound in postmenopausal females. Osteoporosis International. 2013;24(2):723–730. doi: 10.1007/s00198-012-2022-x [DOI] [PubMed] [Google Scholar]
  • 49. Bielesz B, Patsch J, Fischer L, Bojic M, Winnicki W, Weber M, et al. Cortical porosity not superior to conventional densitometry in identifying hemodialysis patients with fragility fracture. PLOS ONE. 2017;12:e0171873. doi: 10.1371/journal.pone.0171873 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Long Y, Leslie W D, Luo Y Study of DXA-derived lateral–medial cortical bone thickness in assessing hip fracture risk. Bone Reports 2015; p. 44–51. doi: 10.1016/j.bonr.2015.02.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Ye C, Guo Y, Zheng Y, Wu Z, Chen K, Zhang X, et al. Distal radial cortical bone thickness correlates with bone mineral density and can predict osteoporosis: a cohort study. Injury. 2020;51(11):2617–2621. doi: 10.1016/j.injury.2020.08.018 [DOI] [PubMed] [Google Scholar]
  • 52. Granke M, Makowski AJ, Uppuganti S, Nyman JS. Prevalent role of porosity and osteonal area over mineralization heterogeneity in the fracture toughness of human cortical bone. Journal of Biomechanics. 2016;49(13):2748–2755. doi: 10.1016/j.jbiomech.2016.06.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53. Mikolajewicz N, Bishop N, Burghardt A, Folkestad L, Hall A, Kozloff K, et al. HR-pQCT Measures of Bone Microarchitecture Predict Fracture: Systematic Review and Meta-Analysis. Journal of Bone and Mineral Research. 2020;35:446–459. doi: 10.1002/jbmr.3901 [DOI] [PubMed] [Google Scholar]
  • 54. Ohlsson C, Sundh D, Wallerek A, Nilsson M, Karlsson M, Johansson H, et al. Cortical Bone Area Predicts Incident Fractures Independently of Areal Bone Mineral Density in Older Men. The Journal of Clinical Endocrinology & Metabolism. 2017;102(2):516–524. doi: 10.1210/jc.2016-3177 [DOI] [PubMed] [Google Scholar]
  • 55. Sollmann N, Löffler MT, Kronthaler S, Böhm C, Dieckmeyer M, Ruschke S, et al. MRI-Based Quantitative Osteoporosis Imaging at the Spine and Femur. Journal of Magnetic Resonance Imaging. 2021;54(1):12–35. doi: 10.1002/jmri.27260 [DOI] [PubMed] [Google Scholar]
  • 56. Granke M, Grimal Q, Saïed A, Nauleau P, Peyrin F, Laugier P. Change in porosity is the major determinant of the variation of cortical bone elasticity at the millimeter scale in aged women. Bone. 2011;49:1020–6. doi: 10.1016/j.bone.2011.08.002 [DOI] [PubMed] [Google Scholar]
  • 57. Kameo Y, Sakano N, Adachi T. Theoretical concept of cortical to cancellous bone transformation. Bone Reports. 2020;12:100260. doi: 10.1016/j.bonr.2020.100260 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Guha A, Aynardi M, Shokouhi P, Lissenden CJ. Identification of long-range ultrasonic guided wave characteristics in cortical bone by modelling. Ultrasonics. 2021;114:106407. doi: 10.1016/j.ultras.2021.106407 [DOI] [PubMed] [Google Scholar]
  • 59. Araya C, Martinez A, Ramiandrisoa D, Ta D, Xu K, Osses A, et al. Real Time Waveguide Parameter Estimation Using Sparse Multimode Disperse Radon Transform. In: 2021 IEEE UFFC Latin America Ultrasonics Symposium (LAUS); 2021. p. 1–4. [Google Scholar]
  • 60. Singleton RC, Pharr GM, Nyman JS. Increased tissue-level storage modulus and hardness with age in male cortical bone and its association with decreased fracture toughness. Bone. 2021;148:115949. doi: 10.1016/j.bone.2021.115949 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Aróstica R, Aguilera A, Osses A, Minonzio JG. A simplified homogenization model applied to viscoelastic behavior of cortical bone at ultrasonic frequencies. Journal of Biomechanics. 2022;131:110868. doi: 10.1016/j.jbiomech.2021.110868 [DOI] [PubMed] [Google Scholar]
  • 62. Liu S, Wang Y, Yang X, Lei B, Liu L, Li SX, et al. Deep Learning in Medical Ultrasound Analysis: A Review. Engineering. 2019;5(2):261–275. doi: 10.1016/j.eng.2018.11.020 [DOI] [Google Scholar]
  • 63. Nazari-Farsani S, Vuopio ME, Aro HT. Bone Mineral Density and Cortical-Bone Thickness of the Distal Radius Predict Femoral Stem Subsidence in Postmenopausal Women. The Journal of Arthroplasty. 2020;35(7):1877–1884.e1. doi: 10.1016/j.arth.2020.02.062 [DOI] [PubMed] [Google Scholar]
  • 64. Raimann A, Mehany SN, Feil P, Weber M, Pietschmann P, Boni-Mikats A, et al. Decreased Compressional Sound Velocity Is an Indicator for Compromised Bone Stiffness in X-Linked Hypophosphatemic Rickets (XLH). Frontiers in Endocrinology. 2020;11. doi: 10.3389/fendo.2020.00355 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

John Leicester Williams

15 Aug 2022

PONE-D-22-03874Bi-Directional Axial Transmission measurements applied in a clinical environmentPLOS ONE

Dear Dr. Minonzio,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please address the concerns raised by the reviewers regarding rewriting and editing the manuscript and providing explanations on the previously published ultrasound methods that you cite in this manuscript, as well as providing a more detailed justification for the statistical methods and approaches. Please also consider the requirement for making your data available in a public data base.

Please submit your revised manuscript by Sep 24 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

John Leicester Williams, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating in your Funding Statement:

 [This work was supported by the EFRE.NRW program OsteoSys [EFRE-0800411 and

EFRE-0800427, LS-1-1-019c]. Jean-Gabriel Minonzio is supported by Grant ANID /

FONDECYT / REGULAR / 1201311 and ECOS 200061. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now.  Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement.

Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

3. Thank you for stating the following in the Competing Interests section:

“JGM is a cofounder of Azalée. The remaining authors state that they have no conflicts

of interest.”

We note that one or more of the authors are employed by a commercial company: Azalée

a.            Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

b. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc. 

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

4. Thank you for stating the following in the Acknowledgments Section of your manuscript:

” This work was supported by the EFRE.NRW program OsteoSys [EFRE-0800411 and 305 EFRE-0800427, LS-1-1-019c]. Jean-Gabriel Minonzio is supported by Grant ANID / 306 FONDECYT / REGULAR / 1201311 and ECOS 200061. The authors would like to 307 thanks Azal´ee and BleuSolid for their support”

We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

“This work was supported by the EFRE.NRW program OsteoSys [EFRE-0800411 and

EFRE-0800427, LS-1-1-019c]. Jean-Gabriel Minonzio is supported by Grant ANID /

FONDECYT / REGULAR / 1201311 and ECOS 200061. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. We noticed you have some minor occurrence of overlapping text with the following previous publication(s), which needs to be addressed:

- https://ieeexplore.ieee.org/document/8579872

The text that needs to be addressed involves the Introduction.

In your revision ensure you cite all your sources (including your own works), and quote or rephrase any duplicated text outside the methods section. Further consideration is dependent on these concerns being addressed.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: I Don't Know

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The review comments to the authors can be found as an attachment.

Reviewer #2: The manuscript presents the results of a clinical study on the use of quantitative ultrasound for the detection of osteoporosis. The manuscript is well written and easy to understand. The manuscript focuses on the statistics extracted from the clinical study with limited details on the method the authors used. I understand that the method was already published in other papers but it would be useful to the reader to have a better description of the BDAT method. However, as a scientist with minimal knowledge in statistics, I can hardly judge the quality of the analysis of the results.

There are still a few points that I believe could improve the quality of the manuscript:

1. PLOS Data Policy requires author to make all data available. In this case, the authors say that the data is included in the manuscript. However, I believe that there would be value to the scientific community to be able to access the raw data (time traces) required to extract the bone parameters.

2. The current figure resolution is low. The quality should be improved before publication.

I finally noted a couple of typos:

line 46 - slower instead of slowest

line 299 - parameters

Reviewer #3: The authors evaluated Bi-Directional Axial Transmission (BDAT) device in clinical environment. Four in vivo parameters, including cortical thickness, cortical porosity, velocity of first arriving signal and velocity of A0 mode, are provided by the BDAT device used by the trained operators. The results suggest that the device is affordable and transportable for routine use. Generally, the paper is well organized. The results are solid and convincing. Therefore, the reviewer would recommend acceptance of this manuscript after minor revision. Below are some suggestions for the authors to improve the manuscript.

1. In page 3 line 91, what is the pitch size of the ultrasound probe?

2. In page 4 line 139, the author claim that the variable selection was found by subwindow permutation analysis using 1000 Monte Carlo samplings until a stable set was found. Can this part be explained more detailed?

3.In page 5 line 170, the author claims that the total is 9 hip fractures, but 8 femoral neck, 2 pelvis and 1 pertrochanter are 11 hip fractures. Please check the numbers again.

4. In page 2 line 43, some representative approaches in processing axial transmission signals can be considered to be listed before machine learning approaches, such as the Radon transform for multichannel guided waves signal processing and dispersive Radon transform method etc.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: review-D-22-03874.pdf

PLoS One. 2022 Dec 30;17(12):e0277831. doi: 10.1371/journal.pone.0277831.r002

Author response to Decision Letter 0


23 Sep 2022

Dear Editor

1) .tex files have been added

2) and 3) The Competing Interests Statement is now

The authors state that they have no conflicts of interest.

4) the figure has been suppressed

5) Table 6 is now cited in the text

Best Regards

Jean-Gabriel Minonzio

Attachment

Submitted filename: Herne_response.pdf

Decision Letter 1

John Leicester Williams

4 Nov 2022

Bi-Directional Axial Transmission measurements applied in a clinical environment

PONE-D-22-03874R1

Dear Dr. Minonzio,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

John Leicester Williams, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Please note the PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: I Don't Know

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: No

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: The authors have addressed all my comments.

However, the data supporting the results will only be available on request.

Reviewer #3: The authors evaluated Bi-Directional Axial Transmission (BDAT) device in clinical environment. Four in vivo parameters, including cortical thickness, cortical porosity, velocity of first arriving signal and velocity of A0 mode, are provided by the BDAT device used by the trained operators. The results suggest that the device is affordable and transportable for clinical routine use. Generally, the paper is well organized. The results are solid and convincing. Therefore, the reviewer would recommend acceptance of this manuscript.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

Acceptance letter

John Leicester Williams

22 Nov 2022

PONE-D-22-03874R1

Bi-Directional Axial Transmission measurements applied in a clinical environment

Dear Dr. Minonzio:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. John Leicester Williams

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Discrimination obtained with logistic regression: Odds ratios (OR) and areas under the ROC curve (AUC) for BDAT technique on the first population (106 patients).

    (PDF)

    S2 Table. Discrimination obtained with logistic regression: Odds ratios (OR) and areas under the ROC curve (AUC) for both techniques BDAT and DXA and the second population (87 patients).

    (PDF)

    Attachment

    Submitted filename: review-D-22-03874.pdf

    Attachment

    Submitted filename: Herne_response.pdf

    Data Availability Statement

    Data are available at: https://osf.io/xy9qv/.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES