Skip to main content
PeerJ logoLink to PeerJ
. 2017 Aug 15;5:e3586. doi: 10.7717/peerj.3586

Single phase computed tomography is equivalent to dual phase method for localizing hyperfunctioning parathyroid glands in patients with primary hyperparathyroidism: a retrospective review

Fanny Morón 1, Alfred Delumpa 1, Justin Chetta 1,, Danielle Guffey 2, David Dunaway 1
Editor: Henkjan Huisman
PMCID: PMC5562135  PMID: 28828238

Abstract

Objective

This study aims to compare the sensitivity of dual phase (non-contrast and arterial) versus single phase (arterial) CT for detection of hyper-functioning parathyroid glands in patients with primary hyperparathyroidism.

Methods

The CT scans of thirty-two patients who have biochemical evidence of primary hyperparathyroidism, pathologically proven parathyroid adenomas, and pre-operative multiphase parathyroid imaging were evaluated retrospectively in order to compare the adequacy of single phase vs. dual phase CT scans for the detection of parathyroid adenomas.

Results

The parathyroid adenomas were localized in 83% of cases on single arterial phase CT and 80% of cases on dual phase CT. The specificity for localization of parathyroid tumor was 96% for single phase CT and 97% for dual phase CT. The results were not significantly different (p = 0.695). These results are similar to those found in the literature for multiphase CT of 55–94%.

Conclusions

Our study supports the use of a single arterial phase CT for the detection of hyperfunctioning parathyroid adenomas. Advances in knowledge: a single arterial phase CT has similar sensitivity for localizing parathyroid adenomas as dual phase CT and significantly reduces radiation dose to the patient.

Keywords: Parathyroid adenoma, CT, 4DCT, Hyperparathryoidism

Introduction

Primary hyperparathyroidism occurs in 0.2% to 0.5% of the general population with approximately 100,000 new reported cases per year in the United States and estimated annual incidence of 27.7 per 100 person years (Liebert, 1991; Wermers et al., 1997). Approximately 75–85% of primary hyperparathyroidism is caused by hormone overproduction by a single hyperfunctioning gland (Fraser, 2009; Ghandur-Mnaymneh & Kimura, 1984). Surgical excision of the abnormal gland is the definitive treatment (Fraser, 2009; Suliburk & Perrier, 2007).

Preoperative imaging for the purpose of localization of the hyperfunctioning gland may allow the surgeon to perform minimally invasive directed parathyroidectomy if the culprit gland is identified. Minimally invasive technique (MIT) is associated with decreased morbidity relative to four-gland exploration. This technique may be performed under local anesthesia which can be performed in candidates who may not be sutitable for general anesthesia and can be used to prevent the need for overnight hospitalization (Suliburk & Perrier, 2007).

Traditional preoperative localization uses ultrasound and sestamibi scans, which have reported sensitivities for abnormal parathyroid localization up to 74% and 58% respectively (Tublin et al., 2009). More recently, dynamic multiphase computed tomography (4DCT) using 4 phases (non-contrast and post-contrast arterial, early and delayed venous phases) shows higher sensitivities of 55–87% (Hunter et al., 2012; Rodgers et al., 2006; Starker et al., 2011). Some authors suggest that two or three phase scans may yield similar results (Hunter et al., 2014; Hunter et al., 2012; Kelly, Hamberg & Hunter, 2014).

In 4DCT, the arterial phase best discriminates between the density of hypervascular parathyroid adenomas and lymph nodes when compared to other phases (Beland et al., 2011; Raghavan et al., 2014). A 2014 study by Raghavan et al. supports single arterial phase computed tomography (CT) for routine localization of parathyroid disease. Our study aims to compare the sensitivity and accuracy of dual phase (non-contrast and arterial) versus single phase (arterial) CT for the localization of hyperfunctioning glands in patients with primary hyperparathyroidism. If localization rates are similar in the two groups, then a single phase CT would offer the same clinical benefit thereby reducing patient radiation dose and possibly increasing efficiency within the radiology department.

Materials and Methods

Our institutional review board approved this study (H-35723). Data was collected retrospectively and de-identified in compliance with Health Insurance Portability and Accountability Act regulations. No consent was required or performed as per our internal IRB approval.

Patient selection

Between June 2012 and October 2014, 78 patients with primary hyperparathyroidism underwent parathyroidectomy. Of these, 32 patients met the following inclusion criteria for our study. This included preoperative laboratory data consistent with primary hyperparathyroidism (elevated serum calcium and serum parathyroid hormone), preoperative dual phase neck CT performed for localization of abnormal parathyroid gland(s), and parathyroid surgical resection. The most common reason for exclusion was due to the lack of preoperative CT. Pre-operative CT was done only if sestamibi and ultrasound did not have concordant results in localizing the potential hyperfunctioning gland.

CT technique

Patients were imaged on a 64-section multidetector CT scanner. A few patients were imaged on a 16-section multidetector CT scanner. An unenhanced phase was first obtained from the angle of the mandible to 2 cm below the carina. Then 100 mL of iodinated contrast material (Omnipaque 350) was injected at 4 mL/second via a pressure injector 25 s before an arterial phase was obtained. The same field of view was used for the arterial phase. Imaging parameters were set at 120 kVp, 150–600 mA range, gantry rotation time of 0.4 s, pitch of 1, detector configuration section width of 0.625 mm, total beam width of 40 mm, and table translational speed of 67 mm/second. Arterial phase images were acquired with a 0.625 mm slice thickness, 400 HU window width, and 50 HU window center. Axial, sagittal, and coronal images with 2.5 mm slice thickness were also reconstructed. Arterial phase maximum intensity projection (MIP) images were reconstructed with a 1.25 mm slice thickness and a 0.625 mm spacing. Images were evaluated on a Fuji Synapse PACS.

Image analysis

Two board-certified neuroradiologists (F.M., D.D) independently reviewed each CT examination in two sessions separated by at least one week remote to the date of the operation. The readers were blinded to clinical information including surgical and pathology findings except for the diagnosis of primary hyperparathyroidism. In the first session, only the arterial phase was utilized for interpretation. The studies were again randomized and reinterpreted in a second session using both the unenhanced and arterial phases.

Abnormal lesions in characteristic locations predicted by parathyroid embryology were considered possible abnormal parathyroid glands despite other imaging characteristics. Characteristic locations are usually in the midline neck, between the carotid spaces, and anterior or anterolateral to the spine. In the craniocaudal dimension, most are found between the hyoid bone and carina (Randall et al., 2009). During each interpretation if an abnormal parathyroid gland was identified, the reader was tasked with indicating the quadrant (right upper quadrant, left upper quadrant, right lower quadrant, left lower quadrant, or ectopic location of the abnormal gland) on a worksheet. Sagittal midline and transverse planes through the mid-thyroid gland defined the four quadrants (Fig. 1). An abnormal gland in an unexpected location of a normal parathyroid gland location was considered ectopic.

Figure 1. Four quadrants system used to determine localization of parathyroid gland.

Figure 1

No overly descended glands were found on this group of patients. Photo published with permission from Carolyn Iverson.

Surgical technique

The surgeon used MIT when imaging localized a suspicious hyperfunctioning gland. This technique entailed limited unilateral neck dissection with resection of the lesion which was concerning by imaging. In those patients without a suspicious gland by imaging, a lengthier neck exploration was performed which included examination of all parathyroid glands.

Pathology/biochemical analysis

All patients had biochemical data suggestive of primary hyperparathyroidism. All patients had surgically resected abnormal parathyroid glands. The surgeon reported localization of the lesions to the four quadrants or ectopic (Fig. 1). Intraoperative PTH was collected in order to assure immediate biochemical result. The pathological diagnosis was confirmed histologically. Calcium was checked following the surgical procedure to assess for an enduring result.

Statistical analysis

Accuracy, sensitivities, specificities, and positive predictive value of localization with exact 95% confidence intervals (CI) were calculated for each reader and each session on a per quadrant basis (four quadrants and ectopic). The gold standard for diagnosis was operative reports in conjunction with histology and biochemical data. These measures were calculated and compared using generalized estimating equations (GEE) with a logit link function and exchangeable correlation matrix. The GEE model accounted for the correlation of multiple lesions within a patient and multiple readers. The estimation of sensitivity and specificity is conditional on the operative results while the estimation of positive predictive value is conditional on the imaging results. Inter-reader agreement was assessed with a Kappa statistic. All statistical analyses were performed using Stata v 12.1 (StataCorp, College Station, TX, USA).

Results

A total of 32 patients (41% of all patients who underwent parathyroidectomy) were identified during the study period who met inclusion criteria. The patients ages ranged from 19 to 79 years old (median 59 years old), the majority of whom (97%) were women. Of all included patients, three had a prior neck surgery. None of the patient’s had a known or clinically suspected genetic proclivity for hyperparathyroidism.

The preoperative serum calcium ranged from 9.6–13.2 mg/dL (normal 8–10 mg/dL) and serum intact parathyroid hormone (iPTH) ranged from 64–789 mg/dL (normal 10–55 mg/dL). Intraoperative PTH was noted to fall in 94% of patients following resection as defined by the Miami criteria. Ninety-one percent had a normal calcium level result at a single time-variable point following surgery. The remaining 9% were lost to follow-up. No patients presented with persistent or recurrent disease.

A preoperative sestamibi SPECT/CT was performed in 88% of patients and 46% of scans localized a hyperfunctioning gland. Also, a preoperative neck ultrasound was performed in 81% of patients and 38% of scans localized a hyperfunctioning gland. Half of all included patients underwent MIT excision and the other half underwent exploratory excision. Patient demographics as well as pre-operative laboratory results are summarized in Table 1.

Table 1. Demographics and laboratory results.

N Percentage/Range
Sex (M) 31 97%
Median Age (years) 59 19–79
Prior neck surgery 3 9%
Median pre-op serum Ca (mg/dL) 11 9.6–13.2
Median pre-op serum PTH (mg/dL) 191 64–789
Pre-op SPECT/CT 28 88%
Surgical Procedure (Minimally Invasive/Explorative) 16/16 50%/50%

Of the included patients, 75% had single gland disease and 25% had multi-gland disease, defined as more than one hyperfunctioning gland. The single gland tumors weighed from 90–21,000 mg (median 600 mg) while multi-gland tumors weighed 10–1,000 mg (median 275 mg). Abnormal parathyroid gland characteristics are summarized in Table 2.

Table 2. Abnormal parathyroid gland characteristics.

N Percentage/Range
Number of patients with single gland disease 24 75%
Number of patients with multiple gland disease 8 25%
Median tumor weight
Single gland disease 600 mg 90–21,000 mg
Multiple gland disease 275 mg 10–10,000 mg

The tumors were localized to quadrant or ectopic location in 83% of cases on single arterial phase CT and 80% of cases on dual phase CT. The results were not significantly different (p = 0.695). The specificity for localization of parathyroid tumor was 96% for single phase CT and 97% for dual phase CT. The positive predictive value for abnormal gland localization was 88% (95% CI [77–94]) and 89% (95% CI [78–95]) for single and dual phase scans respectively. Overall accuracy for correctly localizing a hyperfunctioning gland for single and dual phase scans is 93% (95: CI [86–96]) and 92% (95% CI [86–96]) respectively. Results are summarized in Table 3.

Table 3. Localization to a quadrant.

Accuracy Sensitivity Specificity Positive predictive value
Single phase 93% (86–96) 83 (73–90) 96 (93–98) 88 (77–94)
Dual phase 92% (86–96) 80 (70–88) 97 (92–99) 89 (78–95)

The overall inter-reader agreement was calculated at each location. The single phase CT had an overall kappa score of 0.705 (CI [0.650–0.742]) and dual phase CT had an overall kappa score of 0.595 (CI [0.398–0.698]). These Kappa scores indicate substantial agreement.

Discussion

Multiple authors advocate multiphase CT scans for the localization of parathyroid adenomas (Bahl et al., 2015; Griffith et al., 2015; Hunter et al., 2012; Raghavan et al., 2014; Rodgers et al., 2006; Starker et al., 2011). These protocols utilize up to four separate phases. The sensitivity of localization of parathyroid adenomas in the literature has been reported to be as high as 55–94%. Our results demonstrate sensitivities for localization of 81.4% (95% CI [74.8–86.9]) when using a single arterial phase protocol.

Our study also demonstrates a Cohen’s kappa score of 0.705 (0.650–0.742) on single-phase studies, which indicates a substantial inter-observer agreement. The high concordance between readers is evidence of generalizable results. The difference in concordance may be due in part to the lack of a strict imaging criteria aside from location. Abnormal lesions in characteristic locations by embryology were considered potential parathyroid glands despite other imaging characteristics.

Hyperenhancement of hyperfunctioing parathyroid glands is well-described and a good diagnostic clue (Randall et al., 2009). However, atypical hypoenhancing adenomas have more recently been described; thus, strict criteria based on lesion density was not utilized (Bahl et al., 2015). Some cases remain non-diagnostic when using arterial hyperenhancement alone. Non-arterial and delayed phases in parathyroid CT protocols have traditionally been used in order to solve these scans. However, challenges which would be resolved with additional phases may not be significant contributors to the number of false negative or non-diagnostic scans.

Many of the non-diagnostic scans reported in prior studies resulted from characteristics unrelated to enhancement (Hoang et al., 2014). These include glands which are obscured by streak artifact (related to IV contrast bolus or patient’s shoulders), cystic changes, intralesional hemorrhage, and altered vascular supply from prior surgery, thyroiditis or goiter (Hoang et al., 2014). The same characteristics resulted in many of the false negatives in our study as well and would not be remedied with the use of additional scans.

Another common use for additional phases is for discriminating a regional lymph node from a hyperfunctioning parathyroid gland. The radiologists in our study did not encounter difficulty separating parathyroid lesions from regional lymph nodes given that hyperfunctioning glands enhance to a value 40–60 Hounsfield units (HU) more on arterial phase than what would be expected for an enhancing lymph node based on multiple prior enhancement versus time models (Beland et al., 2011; Gafton et al., 2012; Raghavan et al., 2014) (Fig. 2). A parathyroid adenoma would also be expected to be lobulated in morphology possibly with the presence of a polar vessel (an enlarged feeding artery or draining vein) (Bahl et al., 2014; Hoang et al., 2014).

Figure 2. Right upper quadrant parathyroid adenoma.

Figure 2

(A and B) Axial and coronal images, the adenoma enhances to 140 HU (thick arrow) while the lymph node enhances to 45 HU (thin arrow).

There are examples where an additional phase may provide utility. An intrinsically hyper-attenuated exophytic thyroid nodule may be difficult to differentiate from an enhancing parathyroid adenoma without an unenhanced scan. This was not a significant contributor to the number of false negative scans in our study. There are also instances in which the thyroid gland is hypo-attenuating, usually from prior thyroiditis, and a non-contrast scan would not add information to the interpretation of the study (Fig. 3).

Figure 3. Right lower quadrant parathyroid adenoma.

Figure 3

(A) Axial arterial phase, the adenoma enhances to 160 HU(thick arrow),while the lymph node enhances close to 35 HU (elliptical ROI). (B)The non-contrast image of a hypo-attenuating thyroid does not contribute to the interpretation (elliptical ROI close to 35 HU). (C–D) Post contrast arterial coronal and sagittal images help localize the adenoma.

Limiting the number of scans in a protocol is of particular importance because it is an effective way to lower radiation dosage (Costello et al., 2013). Our study reduces radiation exposure by up to one-half while obtaining the same diagnostic information. This is especially important for younger patients whose lifetime attributable risk is significantly increased by the added radiation exposure (National Cancer Institute, 2009).

There are some limitations of this study. The study is retrospective and the sample size is small. Only patients with primary hyperparathyroidism were included, thus the results are not generalizable for other patient populations. In addition, the single and dual phase studies were read by the same radiologists, which may result in memory bias. This bias was mitigated by reading the studies at least one week apart and de-identifying the patient information.

Conclusion

In conclusion, our study supports the use of a single arterial phase CT for the localization of hyper-functioning parathyroid glands. Our study found similar sensitivity and specificity of a single phase CT when compared to a dual phase CT in this specific patient population. A single-phase study may result in a reduction of radiation exposure by up to one-half, making the single phase scan a beneficial alternative to a dual phase scan. Further larger-scale studies are needed to confirm our findings.

Supplemental Information

Data S1. Raw data.
DOI: 10.7717/peerj.3586/supp-1

Acknowledgments

We would like to give a special thanks to our surgeon contributors, Dr. James Suliburk and Dr. Nadia Mohyuddin. Also, we would like to thank Ms. Carlyn Iverson for allowing us to use her artwork.

Funding Statement

The authors received no funding for this work.

Additional Information and Declarations

Competing Interests

The authors declare there are no competing interests.

Author Contributions

Fanny Morón conceived and designed the experiments, performed the experiments, prepared figures and/or tables, reviewed drafts of the paper.

Alfred Delumpa performed the experiments, analyzed the data, wrote the paper.

Justin Chetta wrote the paper, prepared figures and/or tables, submission.

Danielle Guffey conceived and designed the experiments, analyzed the data.

David Dunaway conceived and designed the experiments, performed the experiments, reviewed drafts of the paper.

Human Ethics

The following information was supplied relating to ethical approvals (i.e., approving body and any reference numbers):

Our institutional review board approved this study (H-35723). Data was collected retrospectively and de-identified in compliance with Health Insurance Portability and Accountability Act regulations. No consent was required or performed as per our internal IRB approval.

Data Availability

The following information was supplied regarding data availability:

The raw data has been supplied as Data S1.

References

  • Bahl et al. (2014).Bahl M, Muzaffar M, Vij G, Sosa J, Choudhury KR, Hoang J. Prevalence of the polar vessel sign in parathyroid adenomas on the arterial phase of 4D CT. American Journal of Neuroradiology. 2014;35:578–581. doi: 10.3174/ajnr.A3715. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Bahl et al. (2015).Bahl M, Sepahdari AR, Sosa JA, Hoang JK. Parathyroid adenomas and hyperplasia on four-dimensional CT scans: three patterns of enhancement relative to the thyroid gland justify a three-phase protocol. Radiology. 2015;277(2):454–462. doi: 10.1148/radiol.2015142393. [DOI] [PubMed] [Google Scholar]
  • Beland et al. (2011).Beland MD, Mayo-Smith WW, Grand DJ, Machan JT, Monchik JM. Dynamic MDCT for localization of occult parathyroid adenomas in 26 patients with primary hyperparathyroidism. American Journal of Roentgenology. 2011;196:61–65. doi: 10.2214/AJR.10.4459. [DOI] [PubMed] [Google Scholar]
  • Costello et al. (2013).Costello JE, Cecava ND, Tucker JE, Bau JL. CT radiation dose: current controversies and dose reduction strategies. American Journal of Roentgenology. 2013;201:1283–1290. doi: 10.2214/AJR.12.9720. [DOI] [PubMed] [Google Scholar]
  • Fraser (2009).Fraser WD. Hyperparathyroidism. The Lancet. 2009;374:145–158. doi: 10.1016/S0140-6736(09)60507-9. [DOI] [PubMed] [Google Scholar]
  • Gafton et al. (2012).Gafton A, Glastonbury C, Eastwood J, Hoang J. Parathyroid lesions: characterization with dual-phase arterial and venous enhanced CT of the neck. American Journal of Neuroradiology. 2012;33:949–952. doi: 10.3174/ajnr.A2885. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Ghandur-Mnaymneh & Kimura (1984).Ghandur-Mnaymneh L, Kimura N. The parathyroid adenoma. a histopathologic definition with a study of 172 cases of primary hyperparathyroidism. The American Journal of Pathology. 1984;115(1):70–83. [PMC free article] [PubMed] [Google Scholar]
  • Griffith et al. (2015).Griffith B, Chaudhary H, Mahmood G, Carlin A, Peterson E, Singer M, Patel S. Accuracy of 2-phase parathyroid CT for the preoperative localization of parathyroid adenomas in primary hyperparathyroidism. American Journal of Neuroradiology. 2015;36:2373–2379. doi: 10.3174/ajnr.A4473. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Hoang et al. (2014).Hoang JK, Sung W-K, Bahl M, Phillips CD. How to perform parathyroid 4D CT: tips and traps for technique and interpretation. Radiology. 2014;270:15–24. doi: 10.1148/radiol.13122661. [DOI] [PubMed] [Google Scholar]
  • Hunter et al. (2014).Hunter GJ, Ginat DT, Kelly HR, Halpern EF, Hamberg LM. Discriminating parathyroid adenoma from local mimics by using inherent tissue attenuation and vascular information obtained with four-dimensional CT: formulation of a multinomial logistic regression model. Radiology. 2014;270:168–175. doi: 10.1148/radiol.13122851. [DOI] [PubMed] [Google Scholar]
  • Hunter et al. (2012).Hunter GJ, Schellingerhout D, Vu TH, Perrier ND, Hamberg LM. Accuracy of four-dimensional CT for the localization of abnormal parathyroid glands in patients with primary hyperparathyroidism. Radiology. 2012;264:789–795. doi: 10.1148/radiol.12110852. [DOI] [PubMed] [Google Scholar]
  • Kelly, Hamberg & Hunter (2014).Kelly H, Hamberg L, Hunter G. 4D-CT for preoperative localization of abnormal parathyroid glands in patients with hyperparathyroidism: accuracy and ability to stratify patients by unilateral versus bilateral disease in surgery-naive and re-exploration patients. American Journal of Neuroradiology. 2014;35:176–181. doi: 10.3174/ajnr.A3615. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Liebert (1991).Liebert MA. Discussion section VII discussion of conference issues before development of consensus conference statement. Journal of Bone and Mineral Research. 1991;6:S161–S164. [Google Scholar]
  • National Cancer Institute (2009).National Cancer Institute. Fast Stats: an interactive tool for access to SEER cancer statistics. Surveillance Research Program, National Cancer Institute; Rockville: 2009. [Google Scholar]
  • Raghavan et al. (2014).Raghavan P, Durst CR, Ornan DA, Mukherjee S, Wintermark M, Patrie JT, Xin W, Shada AL, Hanks JB, Smith PW. Dynamic CT for parathyroid disease: are multiple phases necessary? American Journal of Neuroradiology. 2014;35:1959–1964. doi: 10.3174/ajnr.A3978. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Randall et al. (2009).Randall GJ, Zald PB, Cohen JI, Hamilton BE. Contrast-enhanced MDCT characteristics of parathyroid adenomas. American Journal of Roentgenology. 2009;193:W139–W143. doi: 10.2214/AJR.08.2098. [DOI] [PubMed] [Google Scholar]
  • Rodgers et al. (2006).Rodgers SE, Hunter GJ, Hamberg LM, Schellingerhout D, Doherty DB, Ayers GD, Shapiro SE, Edeiken BS, Truong MT, Evans DB. Improved preoperative planning for directed parathyroidectomy with 4-dimensional computed tomography. Surgery. 2006;140:932–941. doi: 10.1016/j.surg.2006.07.028. [DOI] [PubMed] [Google Scholar]
  • Starker et al. (2011).Starker LF, Mahajan A, Björklund P, Sze G, Udelsman R, Carling T. 4D parathyroid CT as the initial localization study for patients with de novo primary hyperparathyroidism. Annals of Surgical Oncology. 2011;18:1723–1728. doi: 10.1245/s10434-010-1507-0. [DOI] [PubMed] [Google Scholar]
  • Suliburk & Perrier (2007).Suliburk JW, Perrier ND. Primary hyperparathyroidism. The Oncologist. 2007;12:644–653. doi: 10.1634/theoncologist.12-6-644. [DOI] [PubMed] [Google Scholar]
  • Tublin et al. (2009).Tublin ME, Pryma DA, Yim JH, Ogilvie JB, Mountz JM, Bencherif B, Carty SE. Localization of parathyroid adenomas by sonography and technetium Tc 99m sestamibi single-photon emission computed tomography before minimally invasive parathyroidectomy are both studies really needed? Journal of Ultrasound in Medicine. 2009;28:183–190. doi: 10.7863/jum.2009.28.2.183. [DOI] [PubMed] [Google Scholar]
  • Wermers et al. (1997).Wermers RA, Khosla S, Atkinson EJ, Hodgson SF, O’Fallon WM, Melton LJ. The rise and fall of primary hyperparathyroidism: a population-based study in Rochester, Minnesota, 1965–1992. Annals of Internal Medicine. 1997;126:433–440. doi: 10.7326/0003-4819-126-6-199703150-00003. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data S1. Raw data.
DOI: 10.7717/peerj.3586/supp-1

Data Availability Statement

The following information was supplied regarding data availability:

The raw data has been supplied as Data S1.


Articles from PeerJ are provided here courtesy of PeerJ, Inc

RESOURCES