Abstract
Background
Ultrasound guided fine needle aspiration (USFNA) biopsies of thyroid nodules sometimes create a decision-making dilemma for surgeons as they may yield falsely benign results. The McGill Thyroid Nodule Score + (MTNS+) was developed to aid in clinical guidance regarding the management of patients with these USFNA results. The aim of this study was to assess the MTNS+ as a clinical tool in patients with benign preoperative thyroid nodule USFNAs and to analyze the relationship between nodule size and malignancy in these patients.
Methods
We conducted a retrospective chart review of 1312 patients who underwent thyroidectomies between 2010 and 2015 at the McGill University Teaching Hospitals. Patients with Bethesda II (benign) USFNA results, calculated MTNS+, and nodule size evaluated on ultrasound were included in the study. The false-negative rate was calculated, and MTNS+ and nodule size were each compared to final pathology results. Binary logistic regression was used for statistical analysis.
Results
Of the 1312 patients, 101 met the inclusion criteria and together had an average MTNS+ score of 6.83, which corresponds to a predicted malignancy rate between 25 and 33 %. Final pathology revealed malignancy in 16 (15.8 %) subjects. The average MTNS+ of patients with malignant nodules on surgical pathology was 8.25, while that of patients with benign nodules was 6.56.
Patients with nodule size 1–1.9 cm (a) and 2–2.9 cm (b) each had an equal rate of malignancy of 2.97 % (n = 3), nodule size 3–3.9 cm (c) had a rate of 1.98 % (n = 2), and nodule size ≥4 cm (d) a rate of 7.92 % (n = 8).
Conclusion
The rate of malignancy (15.8 %) is higher than expected when reviewing the risk of malignancy in nodules considered as Bethesda class 2. On the other hand, the rate is lower than the 25–33 % predicted by the MTNS+. We also found a higher malignancy rate for nodules above 4 cm in size, but size was a poor predictor of malignancy when used alone. Therefore, while the MTNS+ may be helpful at helping to identify USFNAs that are incorrectly classified as benign, the percentage risk of malignancy is lower than expected.
Keywords: McGill Thyroid Nodule Score, Thyroid cancer, Ultrasound-guided fine needle aspiration biopsy, Benign nodule, Bethesda II, Nodule size
Background
The incidence of thyroid cancer has been significantly and rapidly increasing in Canada over the past 30 years [1, 2]. Ultrasound-guided fine needle aspiration (USFNA) biopsy is currently considered the gold standard for the assessment and management of thyroid nodules. While it is undeniable that USFNAs provide very important information as to the nature of the nodule, they may yield a falsely benign result in 5 % of cases [3, 4]. Given the potential health implications of misclassifying malignant thyroid nodules as benign, it is necessary to find a complementary clinical tool to evaluate the risk of malignancy and properly select patients who require surgery.
Previous studies [1, 5, 6] advocate the McGill Thyroid Nodule Score + (MTNS+), as a valuable scoring-system used to accurately determine a patient’s overall risk of malignancy. The MTNS+ is based on 23 known thyroid cancer risk factors, which are tabulated and then assigned a percentage risk of malignancy (Table 1) [6].
Table 1.
TSH Thyroid stimulating hormone. Tg Thyroglobulin. PET Positron emission tomography
This study aims to assess the accuracy of the MTNS+ in predicting the risk of malignancy of thyroid nodules with benign USFNAs. The association between nodule size and malignancy rate is also evaluated. Findings could reduce the proportion of missed malignancies and improve management of patients with thyroid nodules.
Methods
Multi-center ethics review approval was obtained from Research Ethics Committees at the Jewish General Hospital (JGH) and the McGill University Health Centre (MUHC).
We conducted a retrospective chart review of 1312 patients who underwent thyroidectomies at the McGill University Teaching Hospitals between January 2010 and March 2015. 101 patients (7.7 %) met inclusion criteria that consisted of having Bethesda II (benign) USFNA biopsy results, pre-operative calculated MTNS+ scores and recorded nodule size on ultrasound. We excluded patients with unavailable pre-operative MTNS+, USFNA and nodule size results. All USFNA samples were obtained by endocrinologists, thyroid surgeons, or radiologists. Collected information on the MTNS+ was based on a scoring sheet that has been regularly filled out over many years when a patient consults the doctor. Positron emission tomography (PET) scan and BRAF mutation are the two MTNS+ variables that are not routinely measured.
MTNS+ and thyroid nodule size on ultrasound were each compared to final post-operative pathology classified as either benign or malignant. Papillary microcarcinomas with extrathyroidal extension (ETE) were considered malignant due to their unpredictable aggressive behaviour when associated with ETE [6, 7]. All other papillary microcarcinomas were considered benign, as they usually progress indolently [6, 7]. Using USFNA allowed us to ensure malignancy was assigned to the ipsilateral nodule that was biopsied, thus avoiding falsely assigning malignancy to benign nodules in patients with multinodular thyroid glands. The malignancy rate, the mean MTNS+, and the standard deviations were calculated for the group of patients with Bethesda II cytology, as well as within each subgroup: malignant and benign on surgical pathology results. Statistical analysis was done using Binary Logistic Regression for MTNS+ when compared to malignancy rates. Nodule size was separated into four categories: a) 1–1.9 cm, b) 2–2.9 cm, c) 3–3.9 cm, and d) ≥4 cm. Malignancy rates were calculated for each category and a receiver operating characteristic (ROC) curve was also computed for malignancy and nodule size as a continuous variable. Bivariate regression analysis and Spearman’s correlations were run to compare MTNS+ and nodule size.
Results
Of the 1312 charts reviewed, 101 patients (7.7 %) met inclusion criteria. Patient age ranged from 23 to 85, with a mean of 52 years old. There was a 6-fold female predominance with a male to female ratio of 14:87. Final pathology revealed malignancy in 16 subjects (15.8 %), while 85 (84.2 %) were benign. One of the 16 patients included in the malignant group had a microcarcinoma with ETE on final pathology. In this selected patient population, MTNS+ scores ranged from 1 to 18, with a mean value and standard deviation (SD) of 6.83 ± 2.31.
MTNS+ and malignancy
Benign and malignant rates and densities for each MTNS+ are presented in Table 2 and Fig. 1, respectively. Amongst the 101 patients included in the study, all malignant nodules had an MTNS+ equal to or above 5, while benign nodules had MTNS+ values as low as 1. Average MTNS+ of patients with malignant pathology (8.25 ± 2.86 [95 % CI 6.72, 9.78]) was higher than MTNS+ of patients in the benign group (6.56 ± 2.11 [95 % CI 6.11, 7.02]) (Table 3). The MTNS+ mean difference between malignant and benign groups was 1.69 with 95 % confidence interval (CI) [0.11, 3.26].
Table 2.
MTNS | Total (n) | Benign n (%) | Malignant n (%) |
---|---|---|---|
1 | 1 | 1 (1.0) | 0 (0.0) |
2 | 1 | 1 (1.0) | 0 (0.0) |
3 | 0 | 0 (0.0) | 0 (0.0) |
4 | 9 | 9 (8.9) | 0 (0.0) |
5 | 21 | 20 (19.8) | 1 (1.0) |
6 | 14 | 13 (12.9) | 1 (1.0) |
7 | 20 | 15 (14.9) | 5 (5.0) |
8 | 17 | 12 (11.9) | 5 (5.0) |
9 | 7 | 5 (5.0) | 2 (2.0) |
10 | 7 | 6 (5.9) | 1 (1.0) |
11 | 2 | 2 (2.0) | 0 (0.0) |
12 | 0 | 0 (0.0) | 0 (0.0) |
13 | 1 | 1 (1.0) | 0 (0.0) |
14 | 0 | 0 (0.0) | 0 (0.0) |
15 | 0 | 0 (0.0) | 0 (0.0) |
16 | 0 | 0 (0.0) | 0 (0.0) |
17 | 0 | 0 (0.0) | 0 (0.0) |
18 | 1 | 0 (0.0) | 1 (1.0) |
Total | 101 | 85 (84.2) | 16 (15.8) |
MTNS+ McGill Thyroid Nodule Score Plus. USFNA Ultrasound guided fine needle aspiration
Table 3.
Bethesda II Thyroid Nodules (N = 101) | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Benign (84.2 %) | Malignant (15.8 %) | |||||||||
N | Mean | StdDev | Min | Max | N | Mean | StdDev | Min | Max | |
MTNS | 85 | 6.56 | 2.11 | 1 | 13 | 16 | 8.25 | 2.86 | 5 | 18 |
MTNS+ McGill Thyroid Nodule Score Plus. StdDev standard deviation
A positive association between MTNS+ and malignancy was confirmed by logistic regression analysis with an odds ratio of 1.34 [95 % CI 1.05, 1.71].
MTNS+ and nodule size
Largest nodule size on ultrasound ranged between 1 and 8.9 cm with a mean and standard deviation of 4.13 cm ±1.53. A positive correlation between MTNS+ and nodule size was shown by Spearman’s correlation with an “r” coefficient value of 0.146 [95 % CI -0.05, 0.33]. The MTNS+ odds ratio was 1.52 [95 % CI 1.130, 2.044] when adjusted for nodule size through bivariate regression analysis. Patients with nodule size 1–1.9 cm had an OR of 16.2 [95 % CI 1.83, 143.427], those with nodule size 2–2.9 cm had an OR of 4.387 [95 % CI 0.806, 23.876], and nodule size 3–3.9 cm an OR of 0.341 [95 % CI 0.063, 1.832] when compared to nodules above 4 cm in size.
Nodule size and malignancy
Benign and malignancy rates according to nodule size categories (cm) are presented in Table 4. Average nodule size was similar in patients with malignant and benign pathology (3.67 cm ±1.60, and 4.23 cm ±1.51, respectively). Patients with nodule size 1–1.9 cm (a) had a rate of malignancy of 2.97 % (n = 3), nodule size 2-2.9 cm (b) a rate of 2.97 % (n = 3), nodule size 3–3.9 cm (c) a rate of 1.98 % (n = 2), and nodule size ≥4 cm (d) a malignancy rate of 7.92 % (n = 8) (Fig. 2). ROC curve for nodule size and malignancy rate is presented in Fig. 3.
Table 4.
Nodule Size (cm) | Total n (%) | Benign n (%) | Malignant n (%) |
---|---|---|---|
a) 1–1.9 | 6 (5.94) | 3 (2.97) | 3 (2.97) |
b) 2–2.9 | 9 (8.91) | 6 (5.94) | 3 (2.97) |
c) 3–3.9 | 36 (35.64) | 34 (33.66) | 2 (1.98) |
d) ≥4 | 50 (49.50) | 42 (41.58) | 8 (7.92) |
Total | 101 (100) | 85 (84.16) | 16 (15.84) |
Nodule sizes were determined pre-operatively by ultrasound and were subdivided into categories a) 1–1.9 cm, b) 2–2.9 cm, c) 3–3.9 cm, d) ≥4 cm
USFNA Ultrasound guided fine needle aspiration
Discussion
Approximately 60 % of all performed USFNAs are Bethesda II (benign) on cytology [8] and should ideally result in a relief for patients, surgeons, and clinicians, in terms of treatment and prognosis. However, the 5 % false-negative rate of benign USFNAs [3, 9] cannot be disregarded. This is why the American Thyroid Association (ATA), the American Association of Clinical Endocrinologists (AACE) and the European Thyroid Association (ETA) suggest close observation of patients with follow-up ultrasounds 6–18 months later, and repeat USFNA if nodule growth is seen [3, 10].
Despite these recommendations, researchers continue to challenge the falsely benign rate stated by the Bethesda Classification [2, 9–11]. The 15.8 % rate of malignancy identified in our specific series is substantially higher than that predicted by Bethesda and ATA guidelines for benign USFNAs. Yet, it is consistent with the higher rates reported throughout literature, reaching values as high as 24.2 % [2, 5, 10–12]. This wide range may be explained in part by variations in technique, expertise and subjective interpreting differences between pathologists reading the slides and physicians performing ultrasounds and USFNAs in different institutions. Nevertheless, the difference remains significant. With this scientific scepticism, benign USFNA results will continue to pose a dilemma for the thyroid surgeon, particularly when known risk factors such as suspicious ultrasound findings or exposure to ionizing radiation are present.
Several studies recommend considering both cytology and suspicious ultrasound findings before making treatment decisions [10, 12]. Interestingly, Chernyavsky et al. found that a remarkable 90 % of falsely benign USFNAs (10.2 %) in their series had suspicious characteristics on ultrasound [10]. They go on to suggest repeat USFNA in these cases, in support of several other publications [10, 12, 13].
This is the reason that an evidence-based scoring system such as the MTNS+ assists in the pre-operative assessment of thyroid nodules. Its use could allow for earlier therapeutic decision-making. The MTNS+ has been shown to be an accurate tool for predicting the risk of malignancy [1, 6]. This 23-parameter summative tool (Table 1) proposed by Sands et al. and then modified in 2013 by Scheffler et al., was developed in order to help physicians formulate the management of thyroid nodules [1, 6]. It takes into consideration multiple evidence-based risk factors such as clinical factors (family history, exposure to radiation), worrisome ultrasound features, as well as cytology results. Combined into a single score, they enable a comprehensive identification of thyroid nodules that are more likely to harbour a malignant disease.
Our study succeeds in demonstrating that the MTNS+ can be helpful in patients with benign USFNAs, but not as precise as when assessing indeterminate nodules. The 101 patients with benign USFNA in our study had a mean MTNS+ of 6.83 (±2.31), a value that predicts a risk of malignancy between 25 and 33 % (Table 1). Although this predicted range overestimates the true 15.8 % rate found in our study (Tables 2 and 3), both values, in support of recent studies, prove to be significantly higher than the 0–5 % stated by the ATA guidelines and the Bethesda classification [3, 9]. This leads to the question of whether an additional USFNA parameter in which points are subtracted for patients with Bethesda II USFNA results should be added to the MTNS+ in order to improve its accuracy. New studies are currently underway to answer this question.
With a statistically significant MTNS+ mean difference between malignant and benign nodules, it is clear that malignant nodules tend to have a higher MTNS+ score than benign nodules. In addition, the odds ratio of 1.34 suggests that for every increase in 1 point of MTNS+, there is an increase of 34 % in odds of malignancy for this patient population. When adjusted for nodule size in our bivariate regression analysis, the odds ratio for MTNS+ increases to 1.52 and remains statistically significant.
Williams et al., one of the only other Canadian-based studies, had also reported a falsely benign rate of 16 % [2]. Our equal malignancy rate supports their recommendation that physicians should consider the malignancy rate for the particular patient population being treated rather than solely relying on generalized literature values based on cytology [2]. At our institution it is uncommon for patients with benign USFNA’s to undergo surgery. Only patients with a high index of suspicion using the MTNS+ had surgery and were included in this analysis. More specifically, this group of patients had either worrisome ultrasound characteristics or risk factors for thyroid cancer that were a cause for concern. The MTNS+ scoring system automatically calculates these variables and enables informed and improved communication with patients. Therefore, the decision was made to operate despite the USFNA results. Other factors that may have contributed in certain cases are the presence of anxiety, compressive symptoms, or if the patient feels that the risk is too high to leave the nodule there. As a result, the true malignancy rate of patients who did not undergo surgery remains unknown. Therefore, our study does not contradict the commonly quoted 0–3 % malignancy rate of benign USFNAs stated by the Bethesda Classification [9]. In addition, the selection bias when selecting thyroidectomy patients is inevitable in surgical studies. It may also differ from one institution to another since there is still no consensus and no universal algorithm used to increase suspicion index for patients with benign USFNAs.
Large nodule size has long been proposed as a risk factor for malignancy of thyroid nodules. This holds true for patients with benign USFNAs, as previous findings have shown falsely benign rates ranging from 10.4 to 17 % [14–17] in nodules larger than 3 or 4 cm, depending on the study. Our study only supports these findings for nodules above 4 cm in size, although the malignancy rate of 7.92 % was slightly lower than that found in other studies. Only 1.98 % of nodules between 3 and 3.9 cm were malignant, which is lower than that of smaller and larger nodules (Fig. 2). This could be explained by the small number of patients in each nodule size category. However, with a weak ROC curve (Fig. 3), and since 44.58 % of nodules were above 4 cm and benign on final pathology (Fig. 2), it is clear that nodule size is a poor predictor of malignancy when used alone for patients with benign USFNAs.
The major limitation of this study is the selection bias. All patients underwent thyroidectomy based on higher clinical suspicion of malignancy using the MTNS+. This leaves the true malignancy rate unknown for patients who did not undergo surgery. Unfortunately, this is the case for research involving surgical patients.
Conclusion
With the uncertain malignancy rate of benign USFNAs, the multitude of possible risk factors and the presence of a spectrum of management alternatives (observation alone, to re-biopsy and even thyroidectomy), the ensuing discussion with the patient is often confusing, and leads to further anxiety. MTNS+ appeases this problem as it allows the physician to describe the risk of malignancy to the patient as an individualized percentage, thus simplifying communication [1]. While MTNS+ in patients with benign USFNAs plays a role in determining the management in patients with benign thyroid nodules, it is less powerful than USFNAs with indeterminate nodules.
Acknowledgements
We would like to acknowledge Dr. Lawrence Joseph for completing the statistical analyses of this study.
Financial support/disclosures
Funding from the BioMed Central Membership of Canadian Society of Otolaryngology – Head and Neck Surgery.
Abbreviations
- USFNA
ultrasound guided fine needle aspiration
- MTNS+
McGill Thyroid Nodule Score +
- JGH
Jewish General Hospital
- MUHC
McGill University Health Centre
- ETE
extrathyroidal extension
- ATA
American Thyroid Association
- AACE
American Association of Clinical Endocrinologists
- ETA
European Thyroid Association
- PET
positron emission tomography
Footnotes
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
RP proposed the research topic and designed the study. SK reviewed the charts, completed the database, and performed initial data interpretation. These were revised by SB. SK authored the initial manuscript, which was subsequently reviewed and approved by SK, SB, RP, VF, MH, MT, LR. Result interpretation and important modifications were made by all authors to enable completion of this manuscript. All authors read and approved the final manuscript.
References
- 1.Sands NB, Karls S, Amir A, Tamilia M, Gologan O, Rochon L, et al. McGill Thyroid Nodule Score (MTNS): “rating the risk,” a novel predictive scheme for cancer risk determination. J Otolaryngol Head Neck Surg. 2011;40 Suppl 1:S1–13. [PubMed] [Google Scholar]
- 2.Williams BA, Bullock MJ, Trites JR, Taylor SM, Hart RD. Rates of thyroid malignancy by FNA diagnostic category. J Otolaryngol Head Neck Surg. 2013;42:61. doi: 10.1186/1916-0216-42-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Cooper DS, Doherty GM, Haugen BR, Kloos RT, Lee SL, Mandel SJ, et al. Revised American thyroid association management guidelines for patients with thyroid nodules and differentiated thyroid cancer. Thyroid. 2009;19(11):1167–214. doi: 10.1089/thy.2009.0110. [DOI] [PubMed] [Google Scholar]
- 4.Alexander EK, Heering JP, Benson CB, Frates MC, Doubilet PM, Cibas ES, et al. Assessment of nondiagnostic ultrasound-guided fine needle aspirations of thyroid nodules. J Clin Endocrinol Metab. 2002;87(11):4924–7. doi: 10.1210/jc.2002-020865. [DOI] [PubMed] [Google Scholar]
- 5.Varshney R, Forest VI, Mascarella MA, Zawawi F, Rochon L, Hier MP, et al. The Mcgill thyroid nodule score - does it help with indeterminate thyroid nodules? J Otolaryngol Head Neck Surg. 2015;44:2. doi: 10.1186/s40463-015-0058-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Scheffler P, Forest VI, Leboeuf R, Florea AV, Tamilia M, Sands NB, et al. Serum thyroglobulin improves the sensitivity of the McGill Thyroid Nodule Score for well-differentiated thyroid cancer. Thyroid. 2014;24(5):852–7. doi: 10.1089/thy.2013.0191. [DOI] [PubMed] [Google Scholar]
- 7.Ardito G, Revelli L, Giustozzi E, Salvatori M, Fadda G, Ardito F, et al. Aggressive papillary thyroid microcarcinoma: prognostic factors and therapeutic strategy. Clin Nucl Med. 2013;38(1):25–8. doi: 10.1097/RLU.0b013e318279bc65. [DOI] [PubMed] [Google Scholar]
- 8.Ajmal S, Rapoport S, Ramirez Batlle H, Mazzaglia PJ. The natural history of the benign thyroid nodule: what is the appropriate follow-up strategy? J Am Coll Surg. 2015;220(6):987–92. doi: 10.1016/j.jamcollsurg.2014.12.010. [DOI] [PubMed] [Google Scholar]
- 9.Cibas ES, Ali SZ, Conference NCITFSotS. The Bethesda system for reporting thyroid cytopathology. Am J Clin Pathol. 2009;132(5):658–65. doi: 10.1309/AJCPPHLWMI3JV4LA. [DOI] [PubMed] [Google Scholar]
- 10.Chernyavsky VS, Shanker BA, Davidov T, Crystal JS, Eng O, Ibrahim K, et al. Is one benign fine needle aspiration enough? Ann Surg Oncol. 2012;19(5):1472–6. doi: 10.1245/s10434-011-2079-3. [DOI] [PubMed] [Google Scholar]
- 11.Deniwar A, Hambleton C, Thethi T, Moroz K, Kandil E. Examining the Bethesda criteria risk stratification of thyroid nodules. Pathol Res Pract. 2015;211(5):345–8. doi: 10.1016/j.prp.2015.02.005. [DOI] [PubMed] [Google Scholar]
- 12.Choi YJ, Jung I, Min SJ, Kim HJ, Kim JH, Kim S, et al. Thyroid nodule with benign cytology: is clinical follow-up enough? PLoS One. 2013;8(5) doi: 10.1371/journal.pone.0063834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Moon HJ, Kim EK, Kwak JY. Malignancy risk stratification in thyroid nodules with benign results on cytology: combination of thyroid imaging reporting and data system and Bethesda system. Ann Surg Oncol. 2014;21(6):1898–903. doi: 10.1245/s10434-014-3556-2. [DOI] [PubMed] [Google Scholar]
- 14.McCoy KL, Jabbour N, Ogilvie JB, Ohori NP, Carty SE, Yim JH. The incidence of cancer and rate of false-negative cytology in thyroid nodules greater than or equal to 4 cm in size. Surgery. 2007;142(6):837–44. doi: 10.1016/j.surg.2007.08.012. [DOI] [PubMed] [Google Scholar]
- 15.Wharry LI, McCoy KL, Stang MT, Armstrong MJ, LeBeau SO, Tublin ME, et al. Thyroid nodules (>/=4 cm): can ultrasound and cytology reliably exclude cancer? World J Surg. 2014;38(3):614–21. doi: 10.1007/s00268-013-2261-9. [DOI] [PubMed] [Google Scholar]
- 16.Giles WH, Maclellan RA, Gawande AA, Ruan DT, Alexander EK, Moore FD, Jr, et al. False negative cytology in large thyroid nodules. Ann Surg Oncol. 2015;22(1):152–7. doi: 10.1245/s10434-014-3952-7. [DOI] [PubMed] [Google Scholar]
- 17.Meko JB, Norton JA. Large cystic/solid thyroid nodules: a potential false-negative fine-needle aspiration. Surgery. 1995;118(6):996–1003. doi: 10.1016/S0039-6060(05)80105-9. [DOI] [PubMed] [Google Scholar]