Abstract
Introduction
Recently, new sets of diagnostic criteria were proposed, including criteria by the ACTTION-American Pain Society Pain Taxonomy (AAPT) group and Fibromyalgia Assessment Status (FAS) 2019 modified criteria for fibromyalgia (FM). Here, we explored the performances of the AAPT criteria and modified FAS criteria for diagnosing FM compared to existing American College of Rheumatology (ACR) criteria.
Methods
We enrolled 95 patients with FM and 108 patients who had other rheumatologic disorders, including rheumatoid arthritis, systemic lupus erythematosus, osteoarthritis, and myofascial pain syndrome. All patients were classified using proposed criteria including the 1990, 2010, 2011, and 2016 versions of the ACR criteria.
Results
In patients with existing FM diagnoses, FM was diagnosed in 56.8% using the AAPT criteria and in 60.0% using the modified FAS criteria. However, FM was diagnosed in 37.9%, 97.9%, 90.5%, and 94.7% of those patients using the 1990, 2010, 2011, and 2016 ACR criteria, respectively. For the AAPT criteria, the sensitivity was 56.8% and the specificity was 94.4%. For the modified FAS criteria, the sensitivity was 60.0% and the specificity was 92.6%. The areas under the receiver-operating characteristic curve were 0.852 (95% confidence interval [CI] 0.801–0.903) for the AAPT criteria and 0.903 (95% CI 0.861–0.944) for the modified FAS criteria, which were lower than the existing ACR criteria.
Conclusions
Although the AAPT criteria and modified FAS criteria have simplified the diagnostic criteria to facilitate patient identification, their poor diagnostic accuracy will limit the adoption and spread of these criteria in routine clinical practice.
Keywords: Fibromyalgia, Diagnostic criteria, Performance
Key Summary Points
| Why carry out this study? |
| Recently, new sets of diagnostic criteria were proposed, including criteria by the ACTTION-American Pain Society Pain Taxonomy (AAPT) group and Fibromyalgia Assessment Status (FAS) 2019 modified criteria for fibromyalgia (FM) |
| Because the appropriateness of the AAPT criteria and modified FAS criteria have not yet been assessed, we explored the performances of the AAPT criteria and modified FAS criteria for diagnosing FM compared to existing American College of Rheumatology (ACR) criteria |
| What was learned from the study? |
| Although the AAPT criteria and modified FAS criteria have simplified the diagnostic criteria to facilitate patient identification, these criteria had lower diagnostic accuracy than most ACR criteria |
| The 2016 ACR criteria showed the best performance among the various diagnostic criteria |
Digital Features
This article is published with digital features, including a summary slide to facilitate understanding of the article. To view digital features for this article go to https://doi.org/10.6084/m9.figshare.14555949.
Introduction
Fibromyalgia (FM) is a chronic pain disorder characterized by chronic widespread pain and associated symptoms, including fatigue, sleep disorder, depression, and anxiety [1]. FM has become a considerable problem for patients and healthcare providers that leads to functional impairment, poor quality of life, and socioeconomic burdens [2, 3]. Although many efforts have been implemented to improve the diagnostic accuracy of FM in recent decades, it remains underdiagnosed or under-recognized. A previous study showed that the diagnosis of FM requires > 2 years and that patients with chronic pain will see a mean of 3.7 different physicians during that period [4].
The American College of Rheumatology (ACR) released the first set of criteria to discriminate FM from other chronic pain disorders in 1990 [5]. The 1990 ACR criteria had several weak points such as the absence of extra-pain manifestations, subjective attribution of tender point examination, and difficulty of implementation. Therefore, the same authors provided new, presumably improved preliminary FM criteria in 2010/2011 [6, 7]. These 2010/2011 ACR criteria for FM excluded the tender point examination and included a systemic symptom-based assessment of conditions including fatigue, sleep problems, and cognitive and somatic symptoms. However, these criteria led to misclassification because the included widespread pain index (WPI), which indicates the number of pain locations, does not consider the spatial distribution of these locations. By omitting the definition of generalized pain, the 2010/2011 ACR criteria provided uncertain discrimination between FM and localized functional pain syndromes. Smythe et al. [8] described other limitations of the 2010/2011 ACR criteria, including dilution, inconsistency, loss of specificity, and loss of the ability to recognize FM in patients with other disease states. To resolve these problems and improve the usefulness of the criteria, revised ACR criteria were released in 2016 [9]. These criteria minimized the misclassification of regional pain disorders from FM and eliminated the previously confusing recommendations regarding diagnostic exclusions. Recently, to resolve problems related to diagnosis (e.g., the considerable complexity of the existing criteria), the Analgesic, Anesthetic, and Addiction Clinical Trial Translations Innovations Opportunities and Networks (ACTTION) public-private partnership with the US Food and Drug Administration (FDA) and the American Pain Society initiated the ACTTION-American Pain Society Pain Taxonomy (AAPT) to develop “core diagnostic criteria” that would be clinically useful for discriminating FM from chronic pain disorders [10]. The aim of this approach was to apply the multidimensional diagnostic framework to FM and identify new approaches to diagnose FM that might improve its identification in clinical practice. Concurrently, a modified version of the Fibromyalgia Assessment Status (FAS) criteria (originally published in 2009) was released [11]. The AAPT criteria and modified FAS criteria included fatigue and sleep disorder as the main associated symptoms and simplified the number of pain sites involved. The common goal of these new sets of criteria was to reduce the complexity of FM diagnosis and enable the FM criteria to be more easily implemented in clinical practice. Because the appropriateness of the AAPT criteria and modified FAS criteria have not yet been assessed, we validated the Korean versions of these new sets of criteria and evaluated the performances of these criteria for diagnosing FM compared to the existing ACR criteria.
Methods
Study Design and Population
The sample size was calculated using G*Power software; assuming sensitivity = 0.8, specificity = 0.8, and α = 0.05, the minimum sample size was 90 participants. Assuming a drop-out rate of approximately 10%, we attempted to recruit 99 participants and 99 controls. In total, 203 patients (95 with FM and 108 with various rheumatic diseases such as rheumatoid arthritis, systemic lupus erythematosus, osteoarthritis, and myofascial pain syndrome) were invited to join the study during outpatient visits to Chonnam National University Hospital. All evaluations were performed between January 2020 and October 2020. Patients with FM had been diagnosed by experienced rheumatologists based on their clinical features before the study assessment; they were regularly followed up at Chonnam National University Hospital. The original diagnosis of FM was based on a history of chronic widespread pain, associated symptoms, and tender point examinations. Patients with rheumatoid arthritis met the 2010 ACR/European League Against Rheumatism criteria for rheumatoid arthritis [12], and patients with systemic lupus erythematosus satisfied the 1997 update of the 1982 ACR revised criteria [13]. Patients with osteoarthritis met the ACR classification criteria [14], and patients with myofascial pain syndrome were diagnosed using the Travell and Simons criteria [15]. We thus enrolled 56 patients with rheumatoid arthritis, 24 patients with systemic lupus erythematosus, 16 patients with osteoarthritis, and 12 patients with myofascial pain syndrome. The study was approved by the institutional review board of Chonnam National University Hospital (IRB no. CNUH-2020-041). All patients provided written informed consent upon enrollment in the study. The methods of this study are adopted from our previous study [16].
Patients were interviewed using structured questionnaires, which included assessments of their sociodemographic characteristics and clinical manifestations (e.g., age, symptom duration, disease duration, marital status, educational level, employment status, family history, social history, and comorbidities). To assess FM symptom severity, visual analog scales were used by patients to rate their current levels of pain and fatigue. All patients were assessed using the 1990, 2010, 2011, and 2016 ACR criteria; AAPT criteria; and modified FAS criteria. A trained rheumatologist assessed tender points with reference to the standardized survey manual [17]. These were identified by direct palpation at 18 specific sites; a force of 4.0 kg was delivered via direct thumb palpation, in accordance with the standardized protocol. The tender point count was the sum of the number of such points, and a tender point score was calculated by summing the scores for each tender point as follows: 0, no tenderness; 1, light tenderness (confirmed verbally upon questioning); 2, moderate tenderness (spontaneous verbal response); 3, severe tenderness (physical movement away).
Development of Korean Versions of the AAPT Criteria and Modified FAS Criteria
Three translators (including a rheumatologist) independently translated the AAPT criteria [10] and modified FAS criteria [11] into the Korean language. Reverse translation was independently performed by three bilingual native English speakers who were blinded to the original English version. Specific cultural adaptations were not performed in this study because the questionnaires used with the AAPT criteria and modified FAS criteria lack content related to cultural differences. The AAPT criteria are based on three items. FM can be diagnosed in patients when the following criteria are satisfied: multisite pain defined as ≥ 6 sites of pain from among 9 possible sites (head, left/right arms, chest, abdomen, upper back and spine, lower back and spine including the buttocks, and left/right legs), moderate to severe sleep problems or fatigue, and multisite pain plus fatigue or sleep problems for at least 3 months. The presence of another pain disorder or related symptoms does not rule out a diagnosis of FM. The modified FAS criteria are also based on three items including fatigue, quality of sleep, and chronic widespread pain. The level of fatigue and sleep quality is scored from 0 to 10, and chronic widespread pain is rated in 19 body regions. The total score is 39 points, and FM can be diagnosed when a patient’s score is ≥ 20 points.
To evaluate instrument comprehensibility, 20 patients with FM were interviewed to rate their comprehension of each question using the following four-point scale: 1, somewhat understandable; 2, moderately understandable; 3, understandable; 4, completely understandable. Questions were considered acceptable if they were scored as 3 or 4. Test-retest reliability was evaluated at 2-week intervals in 20 patients with FM. The first evaluation was assessed during a single clinic visit, and the second was assessed at the next clinic visit. During the 2-week period, no intervention was provided.
Construct validity was evaluated by comparing the AAPT criteria and modified FAS criteria with the 1990, 2010, 2011, and 2016 ACR criteria. Responses to the AAPT criteria and modified FAS criteria were also compared to those of the revised Fibromyalgia Impact Questionnaire (FIQR), the EuroQol five-dimensional questionnaire (EQ-5D), and the Multidimensional Health Assessment Questionnaire (MDHAQ). The quality of life and other dimensions of FM were assessed using the Korean version of the FIQR [18], which features 21 questions that are each rated using an 11-point numerical rating scale (score range 0–10, where 10 is the worst score). The FIQR is divided into three linked dimensions: function (nine questions), overall impact (two questions), and symptoms (10 questions). The summed function score (0–90) is divided by three, the summed overall impact score (0–20) is not transformed, and the summed symptom score (0–100) is divided by two. The total score is the sum of these three domain scores. The EQ-5D includes the following five dimensions: mobility, self-care, engagement in usual activities, pain/discomfort, and anxiety/depression [19]. Each dimension has the following three levels of severity: no, some, and extreme problems. The MDHAQ consists of 18 questions, including 8 on activities of daily living, 6 on advanced activities of daily living, and 4 on psychologic distress. The Korean version of the MDHAQ was used in this study [20]. For the evaluation of psychiatric symptoms, depression was evaluated using the Korean version of the Beck Depression Inventory (BDI) [21], which consists of 21 multiple-choice questions. Each item is rated on a 4-point scale, and the scores are summed to yield a total ranging from 0 to 63, where higher scores represent more severe depression. To evaluate the presence and severity of anxiety, the Korean version of the State-Trait Anxiety Inventory (STAI) was used [22]. This instrument includes the STAI-I (anxiety associated with a specific event) and STAI-II subscales (anxiety as a stable personality characteristic) and contains 40 items overall (20 each for the STAI-I and STAI-II).
Comparison of the 1990, 2010, 2011, and 2016 ACR Criteria with the AAPT Criteria and Modified FAS Criteria
To compare the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and Cohen’s kappa coefficient among the previous sets of ACR criteria and the AAPT and modified FAS criteria, all patients underwent physical examinations for the evaluation of tender points in accordance with the 1990 ACR criteria. Then, they completed questionnaires as required by the 2010, 2011, and 2016 ACR criteria; AAPT criteria; and modified FAS criteria.
Statistical Analyses
All statistical analyses were performed using IBM SPSS Statistics for Windows (version 20; IBM Corp. Armonk, NY, USA) and STATA (version 11.0; StataCorp, College Station, TX, USA). Values are expressed as means ± standard deviations for continuous variables and as percentages for categorical variables. The normality of the data distribution was assessed using the Kolmogorov-Smirnov test. Continuous variables were compared using Student’s t test and the Mann-Whitney U test. Qualitative variables were compared between the two groups using the chi-square test or Fisher’s exact test. Test-retest reliability was assessed by calculating the Spearman correlation coefficients. The internal consistencies of the AAPT criteria and modified FAS criteria were assessed using Cronbach’s alpha, which measures how closely test items are interrelated and thus the extent to which they assess the same construct. When all items are closely related, Cronbach’s alpha will approach 1. Internal consistency was considered adequate if Cronbach’s alpha was at least 0.7. To assess construct validity, Spearman correlation coefficients were used to compare the results of the AAPT criteria and modified FAS criteria with those of the FIQR, MD-HAQ, and EQ-5D and with those of the 1990, 2010, 2011, and 2016 ACR criteria. Receiver-operating characteristic curves were generated, and area under the curve values were calculated to determine sensitivity, specificity, PPV, and NPV. A p value of < 0.05 was considered to indicate statistical significance.
Results
Of the 203 included patients, 95 with FM and 108 with various rheumatologic disorders completed the questionnaire at the time of enrollment. The mean overall patient age was 50.5 ± 11.7 years, and 82.3% of patients were women. The mean disease duration in all patients was 43.6 ± 50.7 months.
The baseline characteristics of patients with FM were compared to those of patients who had other diseases, as shown in Table 1. The mean age of patients with FM was 48.7 ± 10.7 years, and that of patients who had other rheumatologic diseases was 52.0 ± 12.4 years. In total, 86.3% of patients with FM and 78.7% of all other patients were women. Compared to patients who had other diseases, patients with FM scored significantly higher on the pain visual analog scale; fatigue visual analog scale; FIQR; tender point number and count in the 1990 ACR criteria; WPI and symptom severity score (SSS) in the 2010 ACR criteria; WPI and SSS in the 2011 ACR criteria; WPI and SSS in the 2016 ACR criteria; items 1, 2, and 3 in the AAPT criteria; and fatigue level, sleep quality level, and pain sites in the modified FAS criteria (all values were p < 0.001). In addition, scores in the EQ-5D, MD-HAQ, BDI, and STAI-II were higher in patients with FM than in those who had other rheumatologic diseases (all values were p < 0.001).
Table 1.
Baseline characteristics of 95 patients with fibromyalgia and 108 patients with other rheumatic diseases
| Variable | Total (n = 203) | FM (n = 95) | Other diseases (n = 108) | p value |
|---|---|---|---|---|
| Age, years | 50.5 ± 11.7 | 48.7 ± 10.7 | 52.0 ± 12.4 | 0.042 |
| Women (%) | 167 (82.3) | 82 (86.3) | 85 (78.7) | 0.157 |
| Symptom duration, months | 56.1 ± 52.3 | 53.7 ± 45.3 | 58.3 ± 57.9 | 0.526 |
| Disease duration, months | 43.6 ± 50.7 | 36.4 ± 38.4 | 50.0 ± 58.9 | 0.050 |
| Education level, years | 11.9 ± 3.2 | 11.8 ± 3.2 | 11.9 ± 3.2 | 0.921 |
| Marital status (%) | 0.005 | |||
| Unmarried | 10 (4.9) | 8 (8.4) | 2 (1.9) | |
| Married | 182 (89.7) | 78 (82.1) | 104 (96.3) | |
| Divorce | 5 (2.5) | 3 (3.2) | 2 (1.9) | |
| Bereavement | 6 (3.0) | 6 (6.3) | 0 (0) | |
| Employment (%) | 58 (28.6) | 23 (24.2) | 35 (60.3) | 0.197 |
| Pain VAS | 5.9 ± 3.1 | 8.3 ± 1.4 | 3.9 ± 2.6 | < 0.001 |
| Fatigue VAS | 5.9 ± 3.1 | 8.4 ± 1.4 | 3.8 ± 2.7 | < 0.001 |
| FIQR | 49.2 ± 32.7 | 78.1 ± 15.3 | 23.9 ± 20.6 | < 0.001 |
| 1990 | ||||
| Tender point number | 5.8 ± 5.8 | 10.6 ± 4.5 | 1.7 ± 2.9 | < 0.001 |
| Tender point count | 16.0 ± 17.2 | 29.6 ± 14.4 | 4.1 ± 8.3 | < 0.001 |
| 2010 | ||||
| WPI | 8.1 ± 6.5 | 13.4 ± 4.6 | 3.3 ± 3.5 | < 0.001 |
| SSS | 5.8 ± 3.5 | 8.6 ± 2.1 | 3.4 ± 2.6 | < 0.001 |
| 2011 | ||||
| WPI | 8.0 ± 6.5 | 13.4 ± 4.6 | 3.2 ± 3.4 | < 0.001 |
| SSS | 5.2 ± 3.4 | 7.8 ± 2.4 | 2.9 ± 2.3 | < 0.001 |
| 2016 | ||||
| WPI | 8.3 ± 6.3 | 13.6 ± 4.5 | 3.6 ± 3.2 | < 0.001 |
| SSS | 5.9 ± 3.6 | 8.9 ± 2.2 | 3.2 ± 2.3 | < 0.001 |
| AAPT | ||||
| Item 1 (%) | 68 (33.5) | 57 (60.0) | 11 (10.2) | < 0.001 |
| Item 2 (%) | 145 (71.4) | 91 (95.8) | 54 (50.0) | < 0.001 |
| Item 3 (%) | 61 (30.0) | 55 (57.9) | 6 (5.6) | < 0.001 |
| FAS | ||||
| Fatigue | 5.4 ± 3.7 | 7.8 ± 2.2 | 3.4 ± 3.5 | < 0.001 |
| Sleep disturbance | 4.6 ± 3.5 | 6.7 ± 2.8 | 2.7 ± 3.0 | < 0.001 |
| Pain sites | 5.2 ± 3.3 | 7.8 ± 2.4 | 2.9 ± 2.3 | < 0.001 |
| EQ-5D | 4.0 ± 2.6 | 5.8 ± 1.8 | 2.4 ± 2.2 | < 0.001 |
| MD-HAQ | 22.3 ± 16.4 | 34.9 ± 10.6 | 11.2 ± 11.9 | < 0.001 |
| BDI | 19.2 ± 14.3 | 29.2 ± 12.0 | 10.3 ± 9.6 | < 0.001 |
| STAI-I | 20.2 ± 7.9 | 22.2 ± 8.5 | 18.6 ± 6.9 | 0.001 |
| STAI-II | 24.4 ± 9.5 | 28.4 ± 9.6 | 20.9 ± 8.0 | < 0.001 |
| Underlying disease | ||||
| Hypertension | 18 (8.9) | 9 (9.5) | 9 (8.3) | 0.775 |
| Diabetes mellitus | 9 (4.4) | 3 (3.2) | 6 (5.6) | 0.408 |
| Cerebrovascular disease | 5 (2.5) | 4 (4.2) | 1 (0.9) | 0.132 |
| Thyroid disease | 6 (3.0) | 5 (5.3) | 1 (0.9) | 0.069 |
Unless otherwise specified, the data are shown as mean ± standard deviation
FM fibromyalgia, VAS visual analog scale, FIQR revised Fibromyalgia Impact Questionnaire, WPI Widespread Pain Index, SSS symptom severity scale, AAPT Analgesic, Anesthetic, and Addiction Clinical Trial Translations Innovations Opportunities and Networks-American Pain Society Pain Taxonomy criteria, FAS Fibromyalgia Assessment Status, EQ-5D EuroQol five-dimensional questionnaire, MD-HAQ Multidimensional Health Assessment Questionnaire, BDI Beck Depression Inventory, STAI State-Trait Anxiety Inventory
The test-retest reliability of the AAPT criteria and modified FAS criteria was assessed in 20 patients over a 2-week interval (Table 2). The Spearman coefficients of the AAPT criteria ranged from 0.761 to 0.805, and those of the modified FAS criteria ranged from 0.752 to 0.805, both indicating very acceptable internal consistency. The Cronbach’s alpha of the AAPT criteria was 0.814, and that of the modified FAS criteria was 0.897.
Table 2.
Test-retest reliabilities of the AAPT criteria and the modified FAS criteria in 20 patients with fibromyalgia
| Variables | Spearman coefficient |
|---|---|
| AAPT | |
| Item 1 | 0.781 |
| Item 2 | 0.761 |
| Item 3 | 0.805 |
| FAS | |
| Fatigue | 0.752 |
| Sleep disturbance | 0.772 |
| Pain sites | 0.805 |
AAPT Analgesic, Anesthetic, and Addiction Clinical Trial Translations Innovations Opportunities and Networks-American Pain Society Pain Taxonomy criteria, FAS Fibromyalgia Assessment Status
To evaluate the construct validities of the AAPT criteria and modified FAS criteria, we compared these criteria with the 1990, 2010, 2011, and 2016 ACR criteria (Table 3). Items 1, 2, and 3 of the AAPT criteria showed moderate and strong associations with the 1990, 2010, 2011, and 2016 ACR criteria, ranging from 0.477 to 0.770. Similarly, the fatigue, sleep, and pain domains of the modified FAS criteria were moderately to strongly associated with the existing ACR criteria, ranging from 0.535 to 0.940. In addition, the AAPT criteria and modified FAS criteria were significantly correlated with the FIQR, EQ-5D, MDHAQ, and BDI, but not the STAI. Using the AAPT criteria, FM was diagnosed in 56.8% of patients with a prior diagnosis of FM and in 5.6% of those who had other rheumatologic disorders. Using the modified FAS criteria, FM was diagnosed in 60.0% of patients with a prior diagnosis of FM and in 7.4% of those who had other rheumatologic disorders. However, FM was diagnosed in 37.9%, 97.9%, 90.5%, and 94.7% of patients with FM using the 1990, 2010, 2011, and 2016 ACR criteria, respectively.
Table 3.
Comparison of correlation coefficients among the AAPT criteria; the modified FAS criteria; and the 1990, 2010, 2011, and 2016 ACR criteria
| Variable | AAPT | Modified FAS | ||||
|---|---|---|---|---|---|---|
| Item 1 | Item 2 | Item 3 | Fatigue | Sleep | Pain | |
| 1990 | ||||||
| TP number | 0.694 | 0.477 | 0.770 | 0.549 | 0.535 | 0.659 |
| TP count | 0.683 | 0.500 | 0.761 | 0.563 | 0.537 | 0.670 |
| 2010 | ||||||
| WPI | 0.524 | 0.567 | 0.547 | 0.613 | 0.627 | 0.778 |
| SSS | 0.481 | 0.643 | 0.498 | 0.738 | 0.746 | 0.940 |
| 2011 | ||||||
| WPI | 0.528 | 0.558 | 0.537 | 0.607 | 0.624 | 0.774 |
| SSS | 0.500 | 0.663 | 0.524 | 0.742 | 0.729 | 0.896 |
| 2016 | ||||||
| WPI | 0.542 | 0.547 | 0.565 | 0.616 | 0.632 | 0.783 |
| SSS | 0.541 | 0.667 | 0.551 | 0.727 | 0.710 | 0.897 |
| FIQR | 0.548 | 0.598 | 0.622 | 0.684 | 0.666 | 0.795 |
| EQ-5D | 0.427 | 0.480 | 0.504 | 0.568 | 0.552 | 0.640 |
| MD-HAQ | 0.423 | 0.518 | 0.514 | 0.619 | 0.591 | 0.686 |
| BDI | 0.416 | 0.481 | 0.513 | 0.579 | 0.578 | 0.666 |
| STAI-I | 0.174 | 0.133 | 0.228 | 0.159 | 0.241 | 0.206 |
| STAI-II | 0.352 | 0.186 | 0.356 | 0.270 | 0.292 | 0.360 |
AAPT Analgesic, Anesthetic, and Addiction Clinical Trial Translations Innovations Opportunities and Networks-American Pain Society Pain Taxonomy criteria, FAS Fibromyalgia Assessment Status, ACR American College of Rheumatology, FIQR revised Fibromyalgia Impact Questionnaire, EQ-5D EuroQol five-dimensional questionnaire, MD-HAQ Multidimensional Health Assessment Questionnaire, BDI Beck Depression Inventory, STAI State-Trait Anxiety Inventory, TP tender point, WPI Widespread Pain Index, SSS symptom severity scale
*All values were p < 0.001; statistical analyses were done with Spearman’s rank correlation coefficient
Table 4 shows the sensitivity, specificity, PPV, and NPV of the AAPT criteria and modified FAS criteria. The sensitivity and specificity of the AAPT criteria were 56.8% (95% confidence interval [CI] 46.3–66.9%) and 94.4% (95% CI 88.3–97.9%), respectively, and the PPV and NPV of the AAPT criteria were 90.0% (95% CI 80.2–95.2%) and 71.3% (95% CI 66.3–75.9%), respectively. The Cohen’s kappa coefficients were 0.376 between the 1990 ACR criteria and the AAPT criteria and 0.864 between the 2011 ACR criteria and the AAPT criteria. The sensitivity and specificity of the modified FAS criteria were 60.0% (95% CI 49.4–69.9%) and 92.6% (95% CI 85.9–96.8%), respectively, and the PPV and NPV of the modified FAS criteria were 87.7% (95% CI 78.2–93.4%) and 72.5% (95% CI 67.2–77.2%), respectively. The Cohen’s kappa coefficients were 0.323 between the 1990 ACR criteria and the modified FAS criteria, and 0.536 between the 2016 ACR criteria and the modified FAS criteria.
Table 4.
Sensitivity, specificity, positive and negative predictive values of the 1990, 2010, 2011, and 2016 ACR criteria; the AAPT criteria; and the modified FAS criteria
| Criteria | Sensitivity (%) (95% CI) | Specificity (%) (95% CI) | PPV (%) (95% CI) | NPV (%) (95% CI) | Cohen’s kappa | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1990 | 2010 | 2011 | 2016 | AAPT | FAS | |||||
| 1990 ACR | 37.9 (28.1–48.4) | 95.4 (89.5–98.5) | 87.8 (74.7–94.6) | 63.6 (59.7–67.3) | 0.385 | 0.303 | 0.374 | 0.376 | 0.323 | |
| 2010 ACR | 97.9 (92.6–99.4) | 77.8 (68.8–85.2) | 79.5 (73.1–84.7) | 97.7 (91.4–99.4) | 0.385 | 0.727 | 0.813 | 0.788 | 0.480 | |
| 2011 ACR | 90.5 (82.8–95.6) | 71.3 (61.8–79.6) | 73.5 (67.2–79.0) | 89.5 (81.9–94.2) | 0.303 | 0.727 | 0.773 | 0.864 | 0.534 | |
| 2016 ACR | 94.7 (88.1–98.3) | 87.9 (80.3–93.4) | 87.4 (80.6–92.0) | 95.0 (88.9–97.8) | 0.374 | 0.813 | 0.773 | 0.779 | 0.536 | |
| AAPT | 56.8 (46.3–66.9) | 94.4 (88.3–97.9) | 90.0 (80.2–95.2) | 71.3 (66.3–75.9) | 0.376 | 0.788 | 0.864 | 0.779 | 0.532 | |
| Modified FAS | 60.0 (49.4–69.9) | 92.6 (85.9–96.8) | 87.7 (78.2–93.4) | 72.5 (67.2–77.2) | 0.323 | 0.480 | 0.534 | 0.536 | 0.532 | |
CI confidence interval, PPV positive predictive value, NPV negative predictive value, ACR American College of Rheumatology, AAPT Analgesic, Anesthetic, and Addiction Clinical Trial Translations Innovations Opportunities and Networks-American Pain Society Pain Taxonomy criteria, FAS Fibromyalgia Assessment Status
Figure 1 shows the receiver-operating characteristic curve comparing the diagnostic accuracies of the various sets of criteria. The areas under the curve of the AAPT criteria and modified FAS criteria were 0.852 (95% CI 0.801–0.903) and 0.903 (95% CI 0.861–0.944). Furthermore, the areas under the curve of the 1990, 2010, 2011, and 2016 ACR criteria were 0.931 (95% CI 0.891–0.972), 0.953 (95% CI 0.925–0.981), 0.960 (95% CI 0.936–0.984), and 0.970 (95% CI 0.951–0.989), respectively. The areas under the curve of the AAPT criteria and modified FAS criteria were lower than those of the 1990, 2010, 2011, and 2016 ACR criteria.
Fig. 1.
Receiver-operating characteristic curve analyses comparing the diagnostic accuracies of the 1990, 2010, 2011, and 2016 ACR criteria; the AAPT criteria; and the modified FAS criteria
Discussion
In this study, the new AAPT criteria and updated FAS criteria had lower diagnostic accuracies than the 1990, 2010, 2011, and 2016 ACR criteria in terms of lower sensitivities and lower areas under the curve values. Furthermore, the 2016 ACR criteria demonstrated the best performance among the criteria in this study.
For several decades, extensive efforts have been made to improve the classification, diagnostic criteria, and screening criteria for clinical identification of patients with FM. First, the 1990 ACR criteria adopted tender point examination using an expert consensus approach [5]. Because of the difficulty and heterogeneity of tender point examination among physicians, subsequent ACR criteria eliminated this examination. Although the 2010/2011 ACR criteria introduced “widespread pain” and associated extra-pain symptoms [6, 7], other challenges persisted. Myofascial pain syndrome could be misdiagnosed as FM, and the spatial distribution of pain could be overlooked. To address these problems, the revised 2016 ACR criteria introduced the requirement for ≥ 4 of the 5 body regions to exhibit “generalized pain” rather than “widespread pain” [9]. Although the revised 2016 ACR criteria permitted the coexistence of other diseases, difficulties remain in the clinical diagnosis of FM due to the criteria complexity and various comorbidities [8]. To reduce time involved in patient diagnosis and to improve implementation in daily practice, the AAPT criteria and modified FAS criteria were recently developed [10, 11]. These criteria were proposed to reflect the current understanding of FM and to be easily used for the diagnosis and follow-up of patients with FM.
In this study, the AAPT criteria had lower diagnostic accuracy than the 1990, 2010, 2011, and 2016 ACR criteria. The AAPT FM working group introduced new criteria to improve the identification of patients with FM by simplifying the FM diagnostic criteria [10]. The concept of multisite pain was proposed as a substitute for chronic widespread pain, in which the presence of ≥ 6 sites of pain (from among 9 possible sites) is necessary for diagnosis with FM. In our study, 34 patients with FM who satisfied the WPI of the 2016 ACR criteria did not satisfy the definition of multisite pain (item 1) of the AAPT criteria, suggesting that multisite pain is a stricter requirement than the WPI in the existing ACR criteria. Similarly, the AAPT criteria only focused on sleep disturbance and fatigue among the various associated extra-pain symptoms to simplify the diagnostic criteria, such that patients with mild or fluctuating symptoms were not identified by the AAPT criteria. Salaffi et al. [11] compared the performances of the 2011 ACR criteria, 2016 ACR criteria, and AAPT criteria, showing that the AAPT criteria had the worst performance in terms of sensitivity, specificity, and correct classification. These findings are consistent with our results that the AAPT criteria had the lowest diagnostic accuracy among the six sets of criteria. Taken together, the findings emphasize that simplicity is prioritized in the AAPT criteria, rather than diagnostic accuracy. Thus, extra caution is necessary when the AAPT criteria are used for the diagnosis of patients with chronic pain.
Similar to the AAPT criteria, the current study showed that the modified FAS criteria had lower diagnostic accuracy than the 1990, 2010, 2011, and 2016 ACR criteria. The modified FAS criteria constitute the updated version of the FAS questionnaire developed in 2009 [23]. These criteria use a simplified rating of chronic widespread pain that involves description of the presence or absence of pain in 19 body regions, rather than assessing pain in those body regions using four-point numerical scales. Also similar to the AAPT criteria, the modified FAS criteria focused on fatigue and quality of sleep to simplify the diagnostic criteria. Thus, despite their simplicity, the modified FAS criteria had similar limitations in diagnosing patients with FM compared to the AAPT criteria, which led the two sets of criteria to demonstrate lower diagnostic accuracy than the existing ACR criteria. Although these two sets of criteria did not accomplish their intended goals, it remains important to facilitate the diagnosis of patients with FM without reduced accuracy. Further efforts are needed to facilitate FM diagnosis, particularly with respect to the challenges facing patients with chronic pain that is not adequately managed.
Conclusions
The AAPT criteria and modified FAS criteria showed lower sensitivity, specificity, and diagnostic accuracy than the 1990, 2010, 2011, and 2016 ACR criteria. Surprisingly, the 2016 ACR criteria had the best diagnostic accuracy among the criteria assessed in this study. Further large population-based validation studies are needed to support our findings.
Acknowledgements
Funding
This study and the journal’s Rapid Service Fee were supported by a Grant (BCRI20047) from Chonnam National University Hospital Biomedical Research Institute.
Authorship
All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, take responsibility for the integrity of the work as a whole, and have given their approval for this version to be published.
Author Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by J-HK, S-EC, HX, D-JP, J-KL, and S-SL. The first draft of the manuscript was written by J-HK and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Disclosures
Ji-Hyoun Kang, Sung-Eun Choi, Haimuzi Xu, Dong-Jin Park, Jung-Kil Lee, and Shin-Seok Lee have nothing to disclose.
Compliance with Ethics Guidelines
The study was approved by the institutional review board of Chonnam National University Hospital (IRB no. CNUH-2020-041) and was conducted in accordance with the second Declaration of Helsinki. All patients provided written informed consent upon enrollment in the study.
Data Availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
- 1.Park DJ, Lee SS. New insights into the genetics of fibromyalgia. Korean J Intern Med. 2017;32:984–995. doi: 10.3904/kjim.2016.207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kim SK, Kim SH, Lee CK, et al. Effect of fibromyalgia syndrome on the health-related quality of life and economic burden in Korea. Rheumatology (Oxford) 2013;52:311–320. doi: 10.1093/rheumatology/kes255. [DOI] [PubMed] [Google Scholar]
- 3.Lee JW, Lee KE, Park DJ, et al. Determinants of quality of life in patients with fibromyalgia: a structural equation modeling approach. PLoS ONE. 2017;12:e0171186. doi: 10.1371/journal.pone.0171186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Choy E, Perrot S, Leon T, et al. A patient survey of the impact of fibromyalgia and the journey to diagnosis. BMC Health Serv Res. 2010;10:102. doi: 10.1186/1472-6963-10-102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Wolfe F, Smythe HA, Yunus MB, et al. The American College of Rheumatology 1990 Criteria for the Classification of Fibromyalgia. Report of the Multicenter Criteria Committee. Arthritis Rheum. 1990;33:160–172. doi: 10.1002/art.1780330203. [DOI] [PubMed] [Google Scholar]
- 6.Wolfe F, Clauw DJ, Fitzcharles MA, et al. Fibromyalgia criteria and severity scales for clinical and epidemiological studies: a modification of the ACR Preliminary Diagnostic Criteria for Fibromyalgia. J Rheumatol. 2011;38:1113–1122. doi: 10.3899/jrheum.100594. [DOI] [PubMed] [Google Scholar]
- 7.Wolfe F, Clauw DJ, Fitzcharles MA, et al. The American College of Rheumatology preliminary diagnostic criteria for fibromyalgia and measurement of symptom severity. Arthritis Care Res (Hoboken) 2010;62:600–610. doi: 10.1002/acr.20140. [DOI] [PubMed] [Google Scholar]
- 8.Smythe HA. Unhelpful criteria sets for "diagnosis" and "assessment of severity" of fibromyalgia. J Rheumatol. 2011;38:975–978. doi: 10.3899/jrheum.110142. [DOI] [PubMed] [Google Scholar]
- 9.Wolfe F, Clauw DJ, Fitzcharles MA, et al. 2016 Revisions to the 2010/2011 fibromyalgia diagnostic criteria. Semin Arthritis Rheum. 2016;46:319–329. doi: 10.1016/j.semarthrit.2016.08.012. [DOI] [PubMed] [Google Scholar]
- 10.Arnold LM, Bennett RM, Crofford LJ, et al. AAPT diagnostic criteria for fibromyalgia. J Pain. 2019;20:611–628. doi: 10.1016/j.jpain.2018.10.008. [DOI] [PubMed] [Google Scholar]
- 11.Salaffi F, Di Carlo M, Farah S, et al. Diagnosis of fibromyalgia: comparison of the 2011/2016 ACR and AAPT criteria and validation of the modified Fibromyalgia Assessment Status. Rheumatology (Oxford) 2020;59:3042–3049. doi: 10.1093/rheumatology/keaa061. [DOI] [PubMed] [Google Scholar]
- 12.Aletaha D, Neogi T, Silman AJ, et al. 2010 Rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Arthritis Rheum. 2010;62:2569–2581. doi: 10.1002/art.27584. [DOI] [PubMed] [Google Scholar]
- 13.Hochberg MC. Updating the American College of Rheumatology revised criteria for the classification of systemic lupus erythematosus. Arthritis Rheum. 1997;40:1725. doi: 10.1002/art.1780400928. [DOI] [PubMed] [Google Scholar]
- 14.Altman R, Asch E, Bloch D, et al. Development of criteria for the classification and reporting of osteoarthritis. Classification of osteoarthritis of the knee. Diagnostic and Therapeutic Criteria Committee of the American Rheumatism Association. Arthritis Rheum. 1986;29:1039–1049. doi: 10.1002/art.1780290816. [DOI] [PubMed] [Google Scholar]
- 15.Simons DG, Travell JG, Simons LS. Travell & Simons' Myofascial pain and Dysfunction. The Trigger Point Manual. Upper Half of Body. Baltimore: Lippincott Williams & Wilkins; 1999. [Google Scholar]
- 16.Kang JH, An M, Choi SE, et al. Performance of the revised 2016 fibromyalgia diagnostic criteria in Korean patients with fibromyalgia. Int J Rheum Dis. 2019;22:1734–1740. doi: 10.1111/1756-185X.13661. [DOI] [PubMed] [Google Scholar]
- 17.Okifuji A, Turk DC, Sinclair JD, Starz TW, Marcus DA. A standardized manual tender point survey. I. Development and determination of a threshold point for the identification of positive tender points in fibromyalgia syndrome. J Rheumatol. 1997;24:377–383. [PubMed] [Google Scholar]
- 18.Seo SR, Park DJ, Kang JH, et al. Cross-cultural adaptation of the Revised Korean version of the Fibromyalgia Impact Questionnaire: its association with physical function and quality of life. Int J Rheum Dis. 2016;19:459–464. doi: 10.1111/1756-185X.12640. [DOI] [PubMed] [Google Scholar]
- 19.Kim SH, Ahn J, Ock M, et al. The EQ-5D-5L valuation study in Korea. Qual Life Res. 2016;25:1845–1852. doi: 10.1007/s11136-015-1205-2. [DOI] [PubMed] [Google Scholar]
- 20.Lee SS, Park MJ, Yoon HJ, Park YW, Park IH, Park KS. Evaluating the Korean version of the Multidimensional Health Assessment Questionnaire in patients with rheumatoid arthritis. Clin Rheumatol. 2006;25:353–357. doi: 10.1007/s10067-005-0049-5. [DOI] [PubMed] [Google Scholar]
- 21.Rhee MK, Lee YH, Park SH, et al. A standardization study of Beck Depression Inventory I—Korean version (K-BDI): reliability and factor analysis. Kor J Psychopathol. 1995;4:77–95. [Google Scholar]
- 22.Kim JT, Shin DK. A study based on the standardization of the STAI for Korea. N Med J. 1978;21:69–75. [Google Scholar]
- 23.Salaffi F, Sarzi-Puttini P, Girolimetti R, Gasparini S, Atzeni F, Grassi W. Development and validation of the self-administered Fibromyalgia Assessment Status: a disease-specific composite measure for evaluating treatment effect. Arthritis Res Ther. 2009;11:R125. doi: 10.1186/ar2792. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.