Highlights
-
•
Lower T1 tongue intensity relates to more severe current bulbar function in ALS.
-
•
Smaller tongue size and more rounded tongue shape predict more rapid motor/bulbar function decline.
-
•
Tongue echointensity, area and shape relate to age, sex, height and weight.
Keywords: Amyotrophic lateral sclerosis, Tongue, Ultrasound, MRI, Biomarker, Intensity, Prognosis
Abbreviations: ALS, amyotrophic lateral sclerosis; ALSFRS-R, revised ALS functional rating scale; CON, controls; FLIRT, FMRIB's Linear Image Registration Tool; FMRBI, functional magnetic resonance imaging of the brain; FSL, FMRIB's Software Library; HRUS, high-resolution ultrasound; ICC, intraclass correlation coefficient; LMND, lower motor neuron dominant; MPRAGE, magnetization prepared rapid gradient echo; MRI, magnetic resonance imaging; NIV, non–invasive ventilation; PLS, primary lateral sclerosis; ROI, region of interest; RR, reference ROI; SOD1, superoxide dismutase – 1; SD, standard deviation; TIV, tracheostomy – invasive ventilation; TR, tongue ROI; UMND, upper motor neuron dominant
Abstract
A few systematic imaging studies employing ultrasound (HRUS) and magnetic resonance imaging (MRI) have suggested tongue measures to aid in diagnosis of amyotrophic lateral sclerosis (ALS). The relationship between structural tongue alterations and the ALS patients’ bulbar and overall motor function has not yet been elucidated. We here thus aimed to understand how in-vivo tongue alterations relate to motor function and motor function evolution over time in ALS.
Our study included 206 ALS patients and 104 age- and sex-matched controls that underwent HRUS and 3T MRI of the tongue at baseline. Sonographic measures comprised coronal tongue echointensity, area, height, width and height/width ratio, while MRI measures comprised sagittal T1 intensity, tongue area, position and shape. Imaging-derived markers were related to baseline and longitudinal bulbar and overall motor function.
Baseline T1 intensity was lower in ALS patients with more severe bulbar involvement at baseline. Smaller baseline coronal (HRUS) and sagittal (MRI) tongue area, smaller coronal height (HRUS) and width (HRUS) as well as more rounded sagittal tongue shape predicated more rapid functional impairment - not only of bulbar, but also of overall motor function - in ALS.
Our results suggest that in-vivo sonography und MRI tongue measures could aid as biomarkers to reflect bulbar and motor function impairment.
Graphical abstract
1. Introduction
Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disorder with considerable variation in presenting features and progression (Al Chalabi et al., 2016). Heterogeneity of clinical presentation may stem from several factors such as functional reserve or compensating capacities, genetic susceptibility and environmental factors (Al Chalabi and Hardiman, 2013). Prognostic biomarkers of ALS are needed, particularly of bulbar involvement, which is, of course, not the only, but a key determinant of long-term prognosis and survival in this disorder (Rosenbohm et al., 2017). The establishment of a non-invasive marker of bulbar involvement may be of value in prevention aspiration pneumonia and managing nutrition, feeding and rehabilitation. Currently, there is no such marker or any technique applicable in the clinical setting that would have the potential to assess the progression of bulbar involvement at the individual patient level.
Several case reports and some systematic imaging studies employing ultrasound and magnetic resonance imaging (MRI) have suggested structural tongue measures to aid in the differentiation between ALS and patients with other neurological conditions or healthy controls (Cha and Patten, 1989; Fox and Cohen, 2012; Lee et al., 2018; Misawa et al., 2011; Nakamori et al., 2016). The relationship of quantitative tongue measurements and ALS progression is unknown.
In consideration of these uncertainties, we conducted a large cross-sectional and longitudinal study measuring several tongue features using both, high-resolution ultrasound (HRUS) and 3T MRI. Both techniques provide different advantages and disadvantages. HRUS is widely available and suitable for serial studies even in advanced stages. However, user-dependence of HRUS may limit its reliability (Nijholt et al., 2017). MRI, in contrast, provides more standardized results and hence reliability, but is less well suited to serial studies due to its cost, restricted availability and requirement for patient cooperation (Jenkins et al., 2013). This study was designed to compare the usefulness of MRI and HRUS in predicting functional decline in ALS.
2. Material & methods
2.1. Sample
The cohort comprised n = 206 ALS patients who underwent MRI, HRUS or both. As part of an ongoing longitudinal MRI study of the brain, which was initiated in 2011 to investigate the ALS patients’ cognition and their underlying functional and structural brain alterations, patients were recruited at the Departments of Neurology at the Otto-von-Guericke University, Magdeburg; Hannover Medical School; and the University Medical Center, Rostock, Germany. ALS was diagnosed by two out of three experienced neurologists (JP, SP, SV) and patients suffered from definite, probable, possible or suspected ALS according to the El Escorial criteria and its revisions (Brooks et al., 2000; Brooks, 1994; Carvalho et al., 2008; Carvalho and Swash, 2009). Exclusion criteria were concurrent neuromuscular or neurological disorders of the CNS or PNS or motor neuron diseases other than ALS as well as contraindications against MRI. N = 175 (85%) patients underwent 3T MRI of the brain (also mapping the tongue) between 04/2011 and 02/2017. N = 48 (23%) patients underwent HRUS examination of the tongue between 09 / 2015 and 12 / 2016, and they were recruited at the Departments of Neurology Magdeburg and Hannover, only (Table 1). There was an overlap of n = 17 (8%) ALS patients who underwent both MRI and HRUS.
Table 1.
Total cohort | MRI cohort | HRUS cohort | ||||||
---|---|---|---|---|---|---|---|---|
ALS | CON | ALS | CON | p | ALS | CON | p | |
n = 206 | n = 104 | n = 175 | n = 87 | n = 48 | n = 17 | |||
Age in years** | 63 (32;83) | 61 (33;83) | 62 (32;83) | 62 (33;83) | 1.0 | 65 (45;81) | 58 (50;77) | 0.052 |
Male sex, n (%)*** | 129 (63) | 64 (62) | 110 (63) | 55 (63) | 1.0 | 30 (63) | 9 (53) | 0.5 |
Height in cm*, mean [SD] | 172 [9] | 173 [10] | 172 [10] | 174 [9] | 0.4 | 172 [8] | 172 [11] | 1.0 |
Weight in kg*, mean [SD] | 74 [14] | 80 [13] | 74 [14] | 80 [13] | 0.1 | 76 [16] | 80 [14] | 0.3 |
Unless otherwise reported median (range) is given. For group comparisons independent-samples t-test*, Mann-Whitney U test** or χ² test*** was conducted. P-values <0.05 were deemed statistically significant.
ALS, amyotrophic lateral sclerosis; CON, controls; HRUS, high-resolution ultrasound; MRI, magnetic resonance imaging.
Additionally, n = 104 age- and sex- matched healthy control subjects were recruited at the Departments of Neurology at the Otto-von-Guericke University, Magdeburg and the University Medical Center, Rostock, Germany via public announcement. None of the control participants suffered from any neurodegenerative, neuroinflammatory or neuromuscular disorders nor did they display any specific abnormalities on the neurological exam. They were all cognitively normal. N = 87 (84%) of them underwent MRI between 04/2011 and 02/2017 at the Departments of Neurology at the Otto-von-Guericke University, Magdeburg and the University Medical Center, Rostock, Germany; and n = 17 (16%) underwent HRUS during 09/2015 and 12/2016 at the Department of Neurology at the Otto-von-Guericke University, Magdeburg (Table 1).
The discrepancies of sample size between both imaging cohorts originate from the different recruitment periods. The recruitment of HRUS patients or controls started in 2015 and took place over a comparable short period of 15 months; while the recruitment of MRI patients or controls was part of a longer-lasting study that already started in 2011 with a recruitment period of 70 months (please see above). The small overlap between both imaging cohorts not only results from the short overlap period during recruitment, but also from the fact that MRI took place at 2 centers (Magdeburg, Rostock), while HRUS was performed at one center only (Magdeburg).
The local ethics committees approved the study and all subjects gave informed consent (75/11, 16/17).
2.2. Clinical data
The sonographic or MRI examination was considered as a baseline. At baseline disease severity was assessed using the revised ALS functional rating scale (ALSFRS-R) (Cedarbaum et al., 1999). Median (range) disease duration from disease onset to baseline was 17 (0.7–272) months, and from diagnosis to baseline it was 5 (0–122) months (Table 2). N = 125 ALS patients underwent at least one, and n = 78 patients underwent at least two follow-up ALSFRS-R measures. N = 81 patients were lost to longitudinal follow-up due to death (n = 20, 25%), switching to another medical center (n = 44, 54%) or undetermined reasons (n = 17, 21%). Timespan between each follow-up was approximately 3 months. Median (range) time span between baseline and the last available ALSFRS-R was 8.5 (0.2 – 63) months. Statistical analysis comprised the composite score for bulbar, respiratory, fine and gross motor function (maximum score 48 points) and the bulbar sub-score (maximum score 12 points).
Table 2.
Total ALS cohort | MRI ALS cohort | HRUS ALS cohort | p | |
---|---|---|---|---|
n = 206 | n = 175 | n = 48 | ||
Limb onset, n (%)** | 139 (67) | 115 (66) | 37 (77) | 0.4 |
Classic ALS, n (%)** | 134 (65) | 116 (66) | 27 (56) | 0.2 |
LMND ALS, n (%)** | 41 (20) | 33 (19) | 13 (27) | 0.3 |
UMND ALS, n (%)** | 21 (10) | 16 (9) | 6 (13) | 0.5 |
PLS, n (%)** | 10 (5) | 9 (5) | 2 (4) | 0.7 |
Disease duration from symptom onset to imaging in months* | 17 (0.7;272) | 16 (3;272) | 22 (0.7;148) | 0.5 |
Duration from diagnosis to imaging in months* | 5 (0;122) | 5 (0;122) | 3 (0;124) | 0.1 |
ALSFRS-R total baseline* | 39 (13;48) | 40 (14;48) | 36 (8;46) | 0.04 |
ALSFRS-R bulbar baseline* | 11 (1;12) | 11 (1;12) | 11 (0;12) | 0.8 |
Last available ALSFRS-R total* | 34 (3;47) | 35 (3;47) | 29 (7;46) | 0.2 |
ALSFRS-R total decline* | 9 (0;37) | 9 (0;37) | 9 (0;23) | 0.6 |
Last available ALSFRS-R bulbar* | 10 (0;12) | 10 (0;12) | 9 (0;12) | 0.9 |
ALSFRS-R bulbar decline* | 1 (0;9) | 1 (0;9) | 0 (0;7) | 0.4 |
NIV, n (%)** | 18 (9) | 10 (4) | 10 (15) | 0.03 |
PEG, n (%)** | 11 (5) | 5 (2) | 6 (9) | 0.04 |
Familial ALS, n (%)** | 17 (10) | 17 (11) | 2 (8) | 0.5 |
Unless otherwise reported median (range) is given. Decline of ALSFRS-R total score and bulbar sub-score was determined through subtracting the respective baseline minus the last available score in terms of longitudinal follow-up. Concerning the ALSFRS-R total (bulbar sub-score) decline n = 118 (114) ALS patients were available. For group comparisons Mann-Whitney U test* or χ²** test has been conducted. Statistics relate to the comparison of the MRI ALS cohort against the HRUS ALS cohort. P-values <0.05 were deemed statistically significant.
ALS, amyotrophic lateral sclerosis; ALSFRS-R, revised ALS functional rating scale; HRUS, high resolution ultrasound; LMND, lower motor neuron dominant; MRI, magnetic resonance imaging; NIV, non-invasive ventilation; PEG, percutaneous endoscopic gastrostomy; PLS, primary lateral sclerosis; UMND, upper motor neuron dominant.
Clinical phenotype distribution at baseline comprised classic ALS (n = 134, 65%), lower motor neuron dominant ALS (LMND ALS, n = 41, 20%) and upper motor neuron dominant ALS (UMND ALS, n = 21, 10%), classified in accordance with previously specified operational definitions (Schreiber et al., 2015). We also included patients with primary lateral sclerosis (PLS, n = 10, 5%), a syndrome of pure upper motor neuron involvement that has been considered part of the motor neuron disease spectrum (Al Chalabi et al., 2016; Finegan et al., 2019) (Table 2). In detail, at the time of tongue imaging, a variable combination of LMN and UMN signs in the bulbar, cervical and lumbosacral regions were found in those designated as classic ALS who, in turn, fulfilled the El Escorial criteria of definite or probable ALS. All patients with LMND ALS had clinical and electrophysiological evidence of sporadic progressive pure LMN involvement in one or more regions without clinical signs of UMN dysfunction, which must have been the predominant finding for at least 12 months after symptom onset. UMND ALS patients, in contrast, had either no LMN signs, or, if present: (1) they were restricted to only one neuraxis level (bulbar, cervical, or lumbosacral); and (2) electromyography (EMG) abnormalities were limited to sparse fibrillation potentials/positive sharp waves or minor enlargement of motor unit potentials in one or at most two muscles for at least 12 months after symptom onset (Schreiber et al., 2015). The diagnostic criteria for PLS required a period of at least 4 years in which there were only UMN signs on examination (Gordon et al., 2006).
Ventilation status was available in n = 185 (90%) patients, and gastrostomy status was available in n = 185 (90%) patients. At baseline n = 20 (10%) patients required assisted ventilation (non-invasive ventilation [NIV]); of these, n = 18 required NIV for at least 12 hours per day during night- or day-time, while n = 2 required NIV for 24 hours. Additionally, n = 11 (5%) patients had a gastrostomy at baseline (Table 2). Mean (SD) duration of ventilation and gastrostomy at baseline was 5.9 (7.7) and 8.7 (10.6) months.
In a subset of n = 169 ALS cases (82%), genetic testing was performed for superoxide dismutase 1 protein (SOD1) and/or chromosome 9 open reading frame 72 protein (C9orf72) gene mutations. N = 17 of them were diagnosed to suffer from familial ALS (n = 2 were positive for SOD1 gene mutation, n = 15 were positive for C9orf 72 gene mutation) (Table 2).
2.3. Ultrasound of the tongue
Coronal tongue images were obtained with subjects examined in a 30° leaning position while seated using an 8-MHz probe (LOGIQ 7 System; GE Healthcare); all examinations were performed by the same investigator (CG) in one center (Department of Neurology; Magdeburg). During all measures initial settings, comprising contrast and depth were kept constant. Per subject two to six images depicting the same coronal plane were stored in order to provide redundancy in case of artefacts in images. Smaller number of images could be taken in those patients that suffered from advanced disease stages in that they could not sit for a longer time or had swallowing disturbances with retention of saliva.
All images were imported to ImageJ Version 1.5 (National Institute of Health, USA). The latter was used to perform a visual quality check and consequent manual delineation of the whole tongue area, which was conducted by one investigator (NH), blinded to diagnostic group. The tongue area was defined through its anatomical boundaries that are (a) the hyperechoic tongue root (top), (b) the hyperechoic tongue dorsum (bottom) and (c) the transition from hyperechoic muscular tongue tissue to the hypoechoic tissue of the oral cavity (lateral margins) (Fig. 1). Delineated tongue area was then taken as a region of interest (ROI) to calculate the quantitative features of the tongue. Mean echointensity was defined as the gray level derived from each ROI pixel; coronal area was calculated by multiplying the total number of tongue ROI pixels with the area per pixel; coronal height and width was calculated by multiplying the distance in pixels within the respective plane direction with the corresponding pixel dimension, and the height/width ratio was calculated as well (Fig. 1). The parameters derived from one session's multiple images were consequently averaged.
To assess the measures‘ reliability, images of n = 10 randomly selected subjects were delineated 3 times by the same investigator (NH) and once by a second investigator (LF).
2.4. 3T MRI of the tongue
At both imaging sites (Magdeburg and Rostock), sagittal cerebral 3D-MPRAGE (magnetization-prepared rapid gradient-echo) scans were acquired at a Siemens MAGNETOM Verio 3 T MRI scanner (Siemens, Erlangen, Germany) using a 32-channel head coil, and applying the same pulse sequence setting (echo time 4.82 ms, repetition time 2500 ms, inversion time 1100 ms, flip angle 7°, voxel size 1 × 1 × 1 mm3, matrix 256 × 256 × 192), respectively. To account for varying head sizes and alignments, the bias-corrected scans were registered to a centered mean template applying an affine (12 degrees of freedom) linear registration using the linear image registration tool (FLIRT) provided as a part of the FMRIB's Software Library (FSL) version 6.0 (Jenkinson et al., 2002). Tongue analysis was conducted in a coplanar manner using one section per subject. DICOM images were imported to Mango viewer version 4.0.1 (Research Imaging Institute, University of Texas Health Science Center, USA) to again manually delineate the whole tongue area by the same blinded investigator (NH). In line with the work by Cha and Patten (Cha and Patten, 1989) we concentrated on the midsagittal slice of the MRI volume as this is a distinct slice found with relative ease in clinical practice, irrespective of tongue dimension. Each delineation was performed in the same mid-sagittal cross-section of the aligned scans to obtain two ROIs, the mid-sagittal tongue ROI (TR) as well as an approximately trapezoidal ROI serving as a reference for the individual samples (Fig. 2). The TR was defined through its anatomical boundaries that are (a) the hyperintense epithelium with its papilla (apex and upper surface), (b) the hyperintense lingual tonsil (back) and (c) the transition from the isointense tongue muscle to the hypointense mouth tissue (bottom). The reference ROI (RR) was used to account for the varying median extent of the individuals’ oral cavity. The RR was also defined through its anatomical boundaries starting from the visible tip of the upper front teeth to their inner edge along the palate to the back of the pharynx (Fig. 2). The lower ROI boundary was drawn parallel to the palate interconnecting the tip of the teeth with the back of the pharynx (Fig. 2). To again assess the measures‘ reliability images of n = 10 randomly chosen subjects were delineated three times by the same investigator (NH) and once by a second investigator (LF). A center line was fitted to the points enclosed in RR, that minimizes the distance to these points in a least square sense (Fig. 2). The points at which the lines perpendicular to the center line intersected with the tooth tip and the back of the pharynx were marked and used to normalize the positions along the center line, with a value of 0 located at the pharynx and 1 at the teeth. In order to assess the tongue size, the mid-sagittal tongue area was evaluated by multiplying the number of pixels contained in TR with the area covered by a single pixel. The median component of the tongue position was estimated by calculating the center of the points in TR and projecting this center point onto the center line (Fig. 2). Applying a solver based upon the Khachiyan algorithm (Todd and Yıldırım, 2007), the minimum volume enclosing ellipsoid was estimated for the points contained in TR (Fig. 2). The shape of TR was quantified by the resulting ellipsoids’ numerical eccentricity a, and minor axis length b (Fig. 2). The tongue ROI was moreover used to calculate the tongue's mean unnormalized T1 intensity. All calculations, both for HRUS and MRI measures, were carried out using Mathwork's MATLAB R2016a, SPM12 and FMRIB Software Library v5 (Jenkinson et al., 2012).
2.5. Statistics
Statistical analyses were conducted using IBM SPSS statistics (Version 24.0). Averages from all HRUS images per patient were taken for each HRUS tongue feature. Intra- and inter-rater reliability was calculated using the intraclass correlation coefficient (ICC).
We first aimed to test for the existence of any relationship between sonographic or MRI data and the cohort's demographics (age, sex, height, weight), that would have be taken into account for further analysis, an thus performed bivariate correlations, independent-samples t-tests or Mann-Whitney U tests. Bivariate correlations have further been used to assess any relationship between sonographic or MRI data and the ALS patients’ clinical variables (disease duration, baseline ALSFRS-R and its bulbar sub-score). P-values < 0.05 were deemed statistically significant.
Group comparisons were performed using general linear models with each tongue measure considered as dependent variable and group as independent variable. Subgroup comparisons thereby focused on bulbar and respiratory severely affected patients who may present more distinct tongue alterations (Cha and Patten, 1989; Fox and Cohen, 2012; Matsuda et al., 2016; McKee et al., 2013; Nakayama et al., 2017). Group and subgroup comparisons were thus conducted between the following: (i) ALS patients vs. controls, (ii) bulbar-onset patients vs. limb-onset patients vs. controls, (iii) patients requiring assisted ventilation vs. patients not requiring assisted ventilation, (iv) patients with vs. without gastrostomy. Covariate adjustment was conducted where necessary in order to account for any correlations between the tongue measures and the patients’ demographics (see Results). As ALS patients were considered within four different constellations Bonferroni-adjusted p-values of <0.05/4 = 0.013 were deemed statistically significant.
Furthermore, the potential of imaging-based tongue variables to predict the disease course in ALS patients has so far remained unexplored. As the longitudinal progression of disease was recorded clinically by the ALSFRS-R, random intercept mixed effects linear models with ALSFRS-R total or its bulbar sub-score (dependent variable), various tongue measures (each included as main effect), time in months (main effect) and time × tongue measures interaction effects were conducted. Each tongue measure was median split and the resulting binary dummy-coded variable (performing high (above median) vs. performing low (below median) on each tongue measure, coded as 1 vs. 0) was included in random intercept mixed effects linear models. Estimates e (and the respective confidence intervals) of time interaction effects displayed the measures of interest indicating absolute ALSFRS-R (total or bulbar sub-score) differences between median split levels for each tongue measure over time. Covariate adjustment was performed if necessary (see Results). As there were two outcome measures for each model, Bonferroni-adjusted p-values <0.05/2 = 0.025 were deemed statistically significant.
In consideration that PLS is a distinct entity, which is part of the motor neuron disease spectrum, but has a completely different disease course, all analysis were repeated after excluding the PLS cases from the cohort. None of the results changed after exclusion of the PLS patients.
Sample size calculations for a hypothetical, randomized, controlled trial with a 12-month observation period were conducted using a 2-sample t-test, assuming equal group means, a 50% treatment effect on the decline of the ALSFRS-R score, a linear ALSFRS-R decline, a 2-sided significance of 0.05, and a power of 0.8. Analysis was performed using nQuery winter 2019 release (ver 8.5.0) software (Statistical Solutions Ltd, Cork, Ireland).
3. Results
3.1. Demographics and clinical data of the cohort
Demographics of the whole cohort under consideration are given in Table 1. There were no group differences between ALS subjects of the HRUS or MRI cohort and controls with respect to age, sex, height and weight.
Table 2 demonstrates the patients’ clinical data. Mean ALSFRS-R total score was significantly lower and prevalence of gastrostomy, as well as prevalence of patients requiring ventilation was significantly higher in ALS Patients who underwent tongue HRUS compared to those who underwent 3T MRI. There were, however, no differences between the HRUS and MRI ALS sample with respect to their remaining clinical data.
3.2. Tongue features
For each tongue measure intra- and inter-rater reliability was good to excellent with ICC values ranging from 0.8 to 1.0 (for sonography: echointensity 0.9 and 0.9, area 0.8 and 0.9, height 0.8 and 0.8, width 0.8 and 0.9, height/width ratio 0.8 and 0.8; for MRI: T1 intensity 1.0 and 1.0, area 1.0 and 0.7, position 1.0 and 0.8, shape 0.9 and 0.9).
Lower HRUS echointensity was related to greater height (r = −0.4, p = 0.001) and male sex (t(63) = 4.0, p < 0.001); larger sonographic area, height and width was related to greater weight (r = 0.3, p = 0.007; r = 0.3, p = 0.03; r = 0.3, p = 0.007). Larger MRI tongue area was correlated with greater weight (r = 0.3, p = 0.002) and male sex (Z = −3.3, p = 0.001); sagittal tongue shape was related to age in that older age was associated with a more rounded shaped tongue (r = 0.2, p = 0.009) (for the detailed results of the correlation analysis see Supplemental Table 1).
Lower T1 intensity (r = 0.2, p = 0.02) was related to a lower ALSFRS-R bulbar sub-score at baseline (Fig. 3). There was no association between any other HRUS or MRI measures and disease duration, ALSFRS-R total or its bulbar sub-score (baseline measures).
3.3. Group- and subgroup- comparisons
Bulbar- compared to limb-onset patients displayed a significantly lower T1 intensity of the tongue (p < 0.001, F(2) = 8.5) (Fig. 3). The remaining tongue measures, however, did not differ between bulbar- and limb-onset patients.
Further group comparisons did not reveal any differences between (i) ALS and controls, (ii) patients requiring assisted ventilation vs. patients not requiring assisted ventilation, (iii) patients with vs. without gastrostomy, regarding any tongue measure derived from HRUS or MRI (for the detailed results of the group comparisons see Supplemental Table 2).
Results remained unchanged after excluding patients with assisted ventilation or without gastrostomy or with UMND ALS or PLS phenotypes.
3.4. Longitudinal analysis
Longitudinal analysis using mixed effects linear models revealed significant time interaction effects on ALSFRS-R total and its bulbar sub-score of sonographic tongue area (e = 0.5 [CI 0.3; 0.6], p ≤ 0.001; e = 0.2 [CI 0.1; 0.2], p ≤ 0.001), height (e = 0.3 [CI 0.1; 0.4], p = 0.002; e = 0.1 [CI 0.1; 0.2], p ≤ 0.001) and width (e = 0.5 [CI 0.3; 0.6], p ≤ 0.001; e = 0.2 [CI 0.1; 0.2], p ≤ 0.001) (Supplemental Table 3). In summary, patients with larger baseline sonographic measures (area, height, width) compared to those displaying smaller baseline sonographic measures declined at a monthly rate of 0.3 to 0.5 points (for ALSFRS-R total score) or 0.1 to 0.2 points (for ALSFRS-R bulbar sub-score) slower (Fig. 4). Additionally, we found significant time interaction effects of the MRI-based tongue area on ALSFRS-R bulbar sub-score (e = 0.05 [CI 0.01; 0.08], p = 0.004) and of the MRI-based tongue shape on the ALSFRS-R total score (e = 0.1 [CI 0.02; 0.2], p = 0.015). This implies, that patients with larger tongue area or more ellipsoidal tongue shape at baseline MRI declined at a monthly rate of 0.04 (for ALSFRS-R bulbar sub-score) or 0.1 points (for ALSFRS-R total score) slower when compared to those with smaller tongue area or more rounded tongue shape.
In translating these findings to the context of a randomized, controlled clinical trial with a 12-month observation period, a sample size calculation based on the HRUS cohort was carried out to have an 80% chance (α = 0.05) of detecting a 50% therapy effect on ALSFRS-R decline, which corresponds to a decreased mean decline from −12.9 per year to −6.5 points per year. Based on the sonographic cohort, the necessary size of each trial arm is estimated as 34 patients. In case possible candidate were also selected to additionally show submedian values for sonographic tongue area, tongue height or tongue width, the necessary size of each trial arm would decrease to 29 (−15%), 32 (−6%) or 26 (−24%), respectively (Supplemental Table 4).
The same evaluation for the MRI cohort with an annualized mean ALSFRS-R decline of −9.0 resulted in a necessary size of each trial arm of 44 patients, which could be reduced to 41 (−7%) or 40 (−9%) by only including patients with submedian MRI-based tongue area or tongue shape, respectively (Supplemental Table 5).
4. Discussion
This large study suggests that lower T1 intensity of the tongue could be a marker of more severe bulbar involvement in ALS. Smaller baseline coronal (HRUS) and sagittal tongue area (MRI), smaller coronal height (HRUS) and width (HRUS) as well as more rounded sagittal tongue shape might have the potential to predicate more rapid functional impairment - not only of bulbar, but also of overall motor function - in ALS. Future studies have to further confirm the potential of in-vivo HRUS und MRI tongue features to potentially serve as biomarkers to reflect motor function impairment.
Former tongue studies in ALS were limited by low resolution imaging, insufficient data quantification and small sample sizes. In addition to overcoming all these shortcomings, application of an advanced analysis technique allowed derivation of several novel tongue measures. In particular, qualitative HRUS- and MRI-based tongue measures such as echointensity and T1 intensity, position and shape have been rigorously quantified using a novel approach whereas former studies relied only on visual or semi-quantitative evaluation.
More severe bulbar involvement was related to lower tongue T1 intensity. The skeletal muscle in autopsied ALS patients with long-lasting disease (up to 317 months) is characterized by atrophic fibers, increase of connective tissue and fatty replacement (Ahmadi et al., 2010; Borgia et al., 2017; Dupuis and Echaniz-Laguna, 2010; Trias et al., 2018). These chronic changes resulting from longstanding denervation (May et al., 2000) have been proposed to give rise to increased T1 intensity on MRI (Theodorou et al., 2012), but correlation studies between histopathology and MRI in ALS are absent. There is, indeed, only one study with less than 40 patients with longstanding ALS and one case report, that have specifically taken into account T1 alterations of the tongue muscle. Performing visual analysis, the authors described higher T1 intensities of the tongue (Cha and Patten, 1989; Fox and Cohen, 2012), but replication of their results within larger independent studies is still missing. Low T1 intensity, in contrast, has been proposed to represent edema or inflammatory cellular infiltration indicating subacute denervation (Theodorou et al., 2012; Zhang et al., 2013), and is thought to be apparent at earlier ALS disease stages. Consistent with this interpretation, autopsy studies display cellular (e.g. neutrophils, lymphocytes) skeletal muscle inflammation in ALS patients (Al-Sarraj et al., 2014; Trias et al., 2018), especially in those with comparably shorter disease duration (up to 55 months). The association between bulbar involvement and lower T1 intensity in our study could presumably mirror the early disease stage of our ALS sample, reflected by a short median baseline disease duration of 17 months and relatively preserved bulbar function (median baseline ALSFRS-R bulbar sub-score of 11 points). However, our data and the provided interpretation of these findings have to be considered with caution. First, effect size of the relationship between bulbar involvement and lower T1 intensity was small. Further, T1 sequences are not well suited to detect edema or inflammation, but have been rather designed to assess atrophy, fibrosis and fatty degeneration. Moreover, considering disease stage to play a role, one would have expected to find any relationship between T1 intensity and disease duration or any group differences between less advanced or more advanced disease stages (as indicated by the need for ventilation and/or gastrostomy). But this was not the case in our ALS sample. Large studies also taking into account the evolution of T1 intensity of the tongue are therefore needed to replicate our findings.
Several baseline tongue features (HRUS: smaller coronal area, height and width; MRI: smaller area and rounded shape) seemed to predict worse long-term motor and bulbar function as assessed using the ALSFRS-R over a median (range) follow-up time of 8.5 (0.23 - 63) months. Concerning ALS patients with the above mentioned tongue features, there was only a slight difference in monthly decline of 0.5 to 0.1 points (ALSFRS-R total score) or 0.2 to 0.1 points (ALSFRS-R bulbar sub-score) compared to ALS patients with the opposite tongue features, which limits the practical relevance of that finding. This is underscored by the variability of the tongue measures, indicated by their relationship to several demographical data (such as age or sex), allowing for the detectability of only extreme changes. The low magnitude of functional decline may not be a problem in a sufficiently large group (like our sample), but it might be not useful at the individual level. Our longitudinal results further indicate that there would be a difference between ALS and controls at some point later in the illness. It is thus no surprise that cohorts with more advanced disease would be more likely to show positive results, but this is arguably of limited use because diagnostic markers are most needed in early disease stages where the clinical profile is typically more ambiguous. However, the results of the power analyses indicate that the presented variables might prove useful if employed as additional inclusion parameters in therapeutic trials, as they would allow focusing on patients with e.g. smaller sonographic tongue area or tongue width which are more likely to show a steep ALSFRS-R decline. This might make it possible to either reduce the size of trial arms or increase the power of a trial with the same number patients.
Chronic invasive ventilation (up to 87 months) has been related to tongue enlargement in ALS (Matsuda et al., 2016; McKee et al., 2013; Nakayama et al., 2017), and so could mask tongue atrophy in ALS. None of the patients in our sample required invasive ventilation, however, and there were only 10% receiving non-invasive ventilation. It has been unclear whether non-invasive ventilation results in any structural tongue alterations as well. Our results comparing patients with non-invasive to those without ventilation suggests there is no relationship between non-invasive ventilation and structural tongue features.
Likewise, from a clinical perspective pronounced/sole upper motor neuron involvement with a spastic tongue muscle in UMND ALS and PLS could have also masked tongue atrophy. Furthermore, macroglossia has been reported an early feature of PLS (Chang and Kwak, 2019). On the other hand, tongue muscle atrophy and intensity alterations have been proposed to mainly result from predominant lower motor neuron involvement (Cha and Patten, 1989). Therefore inclusion of UMND ALS and PLS phenotypes may have led to concerns of masked tongue atrophy in ALS, but the data did not support this hypothesis. Overall, incident tongue enlargement possibly resulting from ventilation or spastic phenotypes was thus not masking tongue atrophy and therefore not the reason behind absent tongue group differences between ALS and controls. In this large sample there was a robust relationship between various tongue measures and weight and sex, replicating previous findings (Cha and Patten, 1989; Matsuda et al., 2016; Nakamori et al., 2016). These findings seem to be a better explanation for why the majority of tongue measures were not useful diagnostically - i.e. with so much variability in the normal population, one would require extreme changes (which were not anticipated at early disease stages) to identify a disease-specific marker.
Tongue features did not differ between ALS patients with or without gastrostomy, but with only n = 11 gastrostomy participants, this may simply reflect lack of power. This might be explained by the fact that gastrostomy is considered and placed in any case patients suffering from dysphagia, even at early ALS disease stages without severe bulbar dysfunction (Nunes et al., 2016). Early gastrostomy placement thereby not only reduces the procedure risks but further relates to a better prognosis in ALS (Conde et al., 2018). The participating centers of that study applied an early gastrostomy as recommended, which is reflected by a comparably long mean (SD) duration of having gastrostomy of 8.7 (10.1) months in contrast to the relatively short median disease duration of 17 months.
Both HRUS and MRI are non-invasive investigations. As already stated, HRUS is, however, more feasible in advanced disease stages, in that patients do not need to lie flat as is required during MRI scanning. The MRI-based method, however, has the advantage that it can be acquired as part of the standard cranial MRI that forms part of the routine diagnostic work-up in ALS. Regarding their potential to serve as prognostic markers in ALS, both imaging techniques the longitudinal findings of this study indicate that both HRUS or MRI tongue measures have potential to monitor patients’ long-term motor/bulbar function.
There are several study limitations. As already mentioned, effect sizes were small and associations between clinical and imaging measures were little robust. Moreover, albeit performing several group and subgroup analysis, we have restricted the corrections for multiple testing. Further, despite large, our patient cohort was still quite heterogeneous with small, diverse and unequal clinical subgroups, especially for the distinct imaging modalities. Heterogeneity and variability was also evident in the patients’ longitudinal evaluations with little standardized time intervals between the clinical visits and several cases that have been lost-to-follow up. These are, however, very common issues when performing a clinical study with patients suffering from such a devastating neurodegenerative disease like ALS. Analysis was further restricted to static imaging and offline evaluations, which do not represent sufficient information about the dynamic data reproducibility in the clinical setting. Future studies should further take into account dynamic tongue measures (e.g. fasciculations) as well as bulbar muscle groups beyond the tongue. We further did not consider any possible influence of tongue fasciculations on our static tongue measures. Additionally, MRI analysis took account of T1 images only, and follow-up studies should consider further MRI sequences (e.g. T2 images, diffusion tensor imaging) to bring in other important information regarding tissue properties. Future studies should also focus on 3-dimensional analysis of the tongue in order to detail possibly irregular patterns of tongue atrophy in ALS. One may also consider applying high-frequency probes to provide more details on the sonographic fine muscular structure of the tongue.
In summary, MRI-based T1 tongue intensity appears to be a marker of current bulbar involvement in ALS, whereas larger sonographic tongue area, width and height as well as larger MRI-based tongue area and ellipsoidal tongue shape at baseline could be markers of long-term motor function in ALS. These results highlight the potential role of in-vivo tongue imaging to serve as a tool for current bulbar involvement as well as for motor function evolution over time in ALS, making these imaging approaches potentially useful measures for future clinical or therapeutic trials.
Ethical publication statement
We confirm that we have read the Journal's position on issues involved in ethical publication and affirm that this report is consistent with those guidelines.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Financial disclosure
None of the authors have any disclosures to declare.
CRediT authorship contribution statement
Nathalie Hensiek: Investigation, Conceptualization, Writing - original draft, Visualization, Writing - review & editing. Frank Schreiber: Conceptualization, Methodology, Software, Validation, Formal analysis, Data curation, Writing - review & editing, Visualization. Thomas Wimmer: Investigation, Validation, Data curation. Jörn Kaufmann: Resources, Data curation, Methodology, Software, Conceptualization. Judith Machts: Data curation, Investigation, Resources. Laura Fahlbusch: Investigation, Validation. Cornelia Garz: Investigation, Resources, Data curation. Susanne Vogt: Data curation, Investigation, Resources. Johannes Prudlo: Investigation, Resources, Data curation, Supervision. Reinhard Dengler: Investigation, Resources, Data curation, Supervision. Susanne Petri: Investigation, Resources, Data curation, Supervision. Peter J. Nestor: Conceptualization, Investigation, Resources, Data curation, Supervision. Stefan Vielhaber: Investigation, Resources, Data curation, Supervision. Stefanie Schreiber: Conceptualization, Resources, Writing - review & editing, Supervision, Project administration.
Declaration of Competing Interests
None of the authors have potential conflicts of interest to be disclosed.
Acknowledgements
We thank Anne-Katrin Baum, Department of Neurology, Otto-von-Guericke University, Magdeburg, Germany, for technical assistance, and Christa Sobetzko, Department of Neurology, Otto-von-Guericke University, Magdeburg, Germany, for data collection.
Footnotes
Supplementary material associated with this article can be found, in the online version, at doi:10.1016/j.nicl.2020.102233.
Appendix. Supplementary materials
References
- Ahmadi M., Liu J.-.X., Brännström T., Andersen P.M., Stål P., Pedrosa-Domellöf F. Human extraocular muscles in ALS. Invest. Ophthalmol. Vis. Sci. 2010;51(7):3494–3501. doi: 10.1167/iovs.09-5030. [DOI] [PubMed] [Google Scholar]
- Al Chalabi A., Hardiman O. The epidemiology of ALS: a conspiracy of genes, environment and time. Nat. Rev. Neurol. 2013;9(11):617–628. doi: 10.1038/nrneurol.2013.203. [DOI] [PubMed] [Google Scholar]
- Al Chalabi A., Hardiman O., Kiernan M.C., Chio A., Rix-Brooks B., van den Berg L.H. Amyotrophic lateral sclerosis: moving towards a new classification system. Lancet Neurol. 2016;15(11):1182–1194. doi: 10.1016/S1474-4422(16)30199-5. [DOI] [PubMed] [Google Scholar]
- Al-Sarraj S., King A., Cleveland M., Pradat P.-.F., Corse A., Rothstein J.D., Leigh P.N., Abila B., Bates S., Wurthner J., Meininger V. Mitochondrial abnormalities and low grade inflammation are present in the skeletal muscle of a minority of patients with amyotrophic lateral sclerosis; an observational myopathology study. Acta Neuropathol. Commun. 2014;2:165. doi: 10.1186/s40478-014-0165-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borgia D., Malena A., Spinazzi M., Desbats M.A., Salviati L., Russell A.P., Miotto G., Tosatto L., Pegoraro E., Sorarù G., Pennuto M., Vergani L. Increased mitophagy in the skeletal muscle of spinal and bulbar muscular atrophy patients. Hum. Mol. Genet. 2017;26(6):1087–1103. doi: 10.1093/hmg/ddx019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brooks B.R. El Escorial world federation of neurology criteria for the diagnosis of amyotrophic lateral sclerosis. J. Neurol. Sci. 1994;124:96–107. doi: 10.1016/0022-510x(94)90191-0. [DOI] [PubMed] [Google Scholar]
- Brooks B.R., Miller R.G., Swash M., Munsat T.L. El Escorial revisited: revised criteria for the diagnosis of amyotrophic lateral sclerosis. Amyotroph. Lateral Sc. 2000;1(5):293–299. doi: 10.1080/146608200300079536. [DOI] [PubMed] [Google Scholar]
- Carvalho M., Dengler R., Eisen A., England J.D., Kaji R., Kimura J., Mills K., Mitsumoto H., Nodera H., Shefner J., Swash M. Electrodiagnostic criteria for diagnosis of ALS. Clin. Neurophysiol. 2008;119(3):497–503. doi: 10.1016/j.clinph.2007.09.143. [DOI] [PubMed] [Google Scholar]
- Carvalho M., Swash M. Stratifying disease stages with different progression rates determined by electrophysiological tests in patients with amyotrophic lateral sclerosis. Muscle Nerve. 2009;40(2):318. doi: 10.1002/mus.21408. [DOI] [PubMed] [Google Scholar]
- Cedarbaum J.M., Stambler N., Malta E., Fuller C., Hilt D., Thurmond B., Nakanishi A. The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. BDNF ALS study group (Phase III) J. Neurol. Sci. 1999;169(1–2):13–21. doi: 10.1016/s0022-510x(99)00210-5. [DOI] [PubMed] [Google Scholar]
- Cha C.H., Patten B.M. Amyotrophic lateral sclerosis: abnormalities of the tongue on magnetic resonance imaging. Ann. Neurol. 1989;25(5):468–472. doi: 10.1002/ana.410250508. [DOI] [PubMed] [Google Scholar]
- Chang M.C., Kwak S. Macroglossia in primary lateral sclerosis: a case report. Int J Neurosci. 2019;129(12):1189–1191. doi: 10.1080/00207454.2019.1645141. [DOI] [PubMed] [Google Scholar]
- Conde B., Martins N., Rodrigues I., Pimenta A.C., Winck J.C. Functional and endoscopic indicators for percutaneous endoscopic gastrostomy (PEG) in amyotrophic lateral sclerosis patients. J. Clin. Med. 2018;7(10) doi: 10.3390/jcm7100352. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dupuis L., Echaniz-Laguna A. Skeletal muscle in motor neuron diseases: therapeutic target and delivery route for potential treatments. Curr. Drug Targets. 2010;11(10):1250–1261. doi: 10.2174/1389450111007011250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Finegan E., Chipika R.H., Shing S.L.H., Hardiman O., Bede P. Primary lateral sclerosis: a distinct entity or part of the ALS spectrum? Amyotroph. Lateral Scler. Frontotemporal Degener. 2019;20(3–4):133–145. doi: 10.1080/21678421.2018.1550518. [DOI] [PubMed] [Google Scholar]
- Fox M.D., Cohen A.B. Bright tongue sign. Neurology. 2012;79(14):1520. doi: 10.1212/WNL.0b013e31826d5ffc. in ALS. [DOI] [PubMed] [Google Scholar]
- Gordon P.H., Cheng B., Katz I.B., Pinto M., Hays A.P., Mitsumoto H., Rowland L.P. The natural history of primary lateral sclerosis. Neurology. 2006;66(5):647–653. doi: 10.1212/01.wnl.0000200962.94777.71. [DOI] [PubMed] [Google Scholar]
- Jenkins T.M., Burness C., Connolly D.J., Rao D.G., Hoggard N., Mawson S., McDermott C.J., Wilkinson I.D., Shaw P.J. A prospective pilot study measuring muscle volumetric change in amyotrophic lateral sclerosis. Amyotroph. Lat. Scl. Fr. 2013;14(5–6):414–423. doi: 10.3109/21678421.2013.795597. [DOI] [PubMed] [Google Scholar]
- Jenkinson M., Bannister P., Brady M., Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage. 2002;17(2):825–841. doi: 10.1016/s1053-8119(02)91132-8. [DOI] [PubMed] [Google Scholar]
- Jenkinson M., Beckmann C.F., Behrens T.E.J., Woolrich M.W., Smith S.M. FSL. Neuroimage. 2012;62(2):782–790. doi: 10.1016/j.neuroimage.2011.09.015. [DOI] [PubMed] [Google Scholar]
- Lee E., Xing F., Ahn S., Reese T.G., Wang R., Green J.R., Atassi N., van Wedeen J., El Fakhri G., Woo J. Magnetic resonance imaging based anatomical assessment of tongue impairment due to amyotrophic lateral sclerosis: a preliminary study. J. Acoust. Soc. Am. 2018;143(4):EL248. doi: 10.1121/1.5030134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Matsuda C., Shimizu T., Nakayama Y., Haraguchi M., Hakuta C., Itagaki Y., Ogura A., Murata K., Taira M., Numayama T., Kinoshita M. Macroglossia in advanced amyotrophic lateral sclerosis. Muscle Nerve. 2016;54(3):386–390. doi: 10.1002/mus.25058. [DOI] [PubMed] [Google Scholar]
- May D.A., Disler D.G., Jones E.A., Balkissoon A.A., Manaster B.J. Abnormal signal intensity in skeletal muscle at MR imaging: patterns, pearls, and pitfalls. Radiographics. 2000 doi: 10.1148/radiographics.20.suppl_1.g00oc18s295. 20 Spec No, S295-315. [DOI] [PubMed] [Google Scholar]
- McKee H.R., Escott E., Damm D., Kasarskis E. Macroglossia in amyotrophic lateral sclerosis. JAMA Neurol. 2013;70(11):1432–1435. doi: 10.1001/jamaneurol.2013.3138. [DOI] [PubMed] [Google Scholar]
- Misawa S., Noto Y., Shibuya K., Isose S., Sekiguchi Y., Nasu S., Kuwabara S. Ultrasonographic detection of fasciculations markedly increases diagnostic sensitivity of ALS. Neurology. 2011;77(16):1532–1537. doi: 10.1212/WNL.0b013e318233b36a. [DOI] [PubMed] [Google Scholar]
- Nakamori M., Hosomi N., Takaki S., Oda M., Hiraoka A., Yoshikawa M., Matsushima H., Ochi K., Tsuga K., Maruyama H., Izumi Y., Matsumoto M. Tongue thickness evaluation using ultrasonography can predict swallowing function in amyotrophic lateral sclerosis patients. Clin Neurophysiol. 2016;127(2):1669–1674. doi: 10.1016/j.clinph.2015.07.032. [DOI] [PubMed] [Google Scholar]
- Nakayama Y., Shimizu T., Matsuda C., Haraguchi M., Hayashi K., Mochizuki Y., Nagao M., Kawata A., Isozaki E. Non-motor manifestations in ALS patients with tracheostomy and invasive ventilation. Muscle Nerve. 2017 doi: 10.1002/mus.26004. [DOI] [PubMed] [Google Scholar]
- Nijholt W., Scafoglieri A., Jager-Wittenaar H., Hobbelen J.S.M., van der Schans C.P. The reliability and validity of ultrasound to quantify muscles in older adults: a systematic review. J. Cachexia Sarcopenia Muscle. 2017;8(5):702–712. doi: 10.1002/jcsm.12210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nunes G., Santos C.A., Grunho M., Fonseca J. Enteral feeding through endoscopic gastrostomy in amyotrophic lateral sclerosis patients. Nutr. Hosp. 2016;33(5):561. doi: 10.20960/nh.561. [DOI] [PubMed] [Google Scholar]
- Rosenbohm A., Peter R.S., Erhardt S., Lulé D., Rothenbacher D., Ludolph A.C., Nagel G. Epidemiology of amyotrophic lateral sclerosis in Southern Germany. J. Neurol. 2017;264(4):749–757. doi: 10.1007/s00415-017-8413-3. [DOI] [PubMed] [Google Scholar]
- Schreiber S., Abdulla S., Debska-Vielhaber G., Machts J., Dannhardt-Stieger V., Feistner H., Oldag A., Goertler M., Petri S., Kollewe K., Kropf S., Schreiber F., Heinze H.J., Dengler R., Nestor P.J., Vielhaber S. Peripheral nerve ultrasound in amyotrophic lateral sclerosis phenotypes. Muscle Nerve. 2015;51(5):669–675. doi: 10.1002/mus.24431. [DOI] [PubMed] [Google Scholar]
- Theodorou D.J., Theodorou S.J., Kakitsubata Y. Skeletal muscle disease: patterns of MRI appearances. Br. J. Radiol. 2012;85(1020):e1298–e1308. doi: 10.1259/bjr/14063641. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todd M.J., Yıldırım E.A. On Khachiyan’s algorithm for the computation of minimum-volume enclosing ellipsoids. Discrete Appl. Math. 2007;155(13):1731–1744. [Google Scholar]
- Trias E., King P.H., Si Y., Kwon Y., Varela V., Ibarburu S., Kovacs M., Moura I.C., Beckman J.S., Hermine O., Barbeito L. Mast cells and neutrophils mediate peripheral motor pathway degeneration in Als. JCI insight. 2018;3(19) doi: 10.1172/jci.insight.123249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang H., Wang X., Guan M., Li C., Luo L. Skeletal muscle evaluation by MRI in a rabbit model of acute ischaemia. Br. J. Radiol. 2013;86(1026) doi: 10.1259/bjr.20120042. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.