Abstract
Background
A positive D-dimer test has high sensitivity but relatively poor specificity for the diagnosis of pulmonary embolism, causing difficulty for clinicians unskilled in pulmonary embolism diagnosis in determining whether a patient with a positive D-dimer test needs to undergo computed tomographic pulmonary angiography.
Objectives
We sought to develop a new clinical decision-making rule based on a positive D-dimer result to predict the probability of pulmonary embolism and to guide clinicians in making decisions regarding the need for computed tomographic pulmonary angiography.
Methods
We conducted a prospective, multicenter study in three hospitals in China. A total of 3014 inpatients with positive D-dimer results were included. In the derivation group, we built a multivariate logistic regression model and deduced a regression equation from which our score was derived. Finally, we validated the score in an independent cohort.
Results
Our score included nine variables (points): chest pain (1.4), chest tightness (2.3), shortness of breath (3.6), hemoptysis (3.4), heart rate ≥100 beats/min (3.6), blood gas analysis (2.9), electrocardiogram presenting a typical S1Q3T3 pattern (4.1), electrocardiogram findings (2.4), and ultrasonic cardiogram findings (3.7). The sensitivities and specificities were 100% and 86.94%, respectively, in the derivation group and 100% and 90.82%, respectively, in the validation group. Additionally, the observed and predicted proportions of patients who underwent computed tomographic pulmonary angiography were 16.82% and 10.76%, respectively, in the derivation group and 18.72% and 11.40%, respectively, in the validation group.
Conclusions
The new score can categorize inpatients with a positive D-dimer test as pulmonary embolism-likely or pulmonary embolism-unlikely, thus reducing unnecessary computed tomographic pulmonary angiography examinations.
Keywords: diagnostic management, D-dimer, pulmonary embolism, computed tomographic pulmonary angiography, clinical decision-making rule
Introduction
Pulmonary embolism (PE) is a serious disease with high morbidity and mortality.1,2 In addition, because it has nonspecific clinical manifestations and lacks a specific auxiliary examination, PE is associated with high rates of misdiagnosis and missed diagnoses, which has been a common source of medical disputes.3 Therefore, it is imperative to achieve an accurate and early diagnosis of PE.
Currently, clinicians rely on a variety of noninvasive diagnostic tests, such as plasma D-dimer measurements, blood gas analyses, lower limb proximal deep vein compression ultrasonography, and computed tomographic pulmonary angiography (CTPA), which is acknowledged as the gold standard method, to diagnose PE.4,5 Clinicians pay specific attention to patients with a positive D-dimer test because it has a sensitivity of approximately 97% for PE. However, the specificity of a positive D-dimer test for PE is only approximately 40%,6,7 causing difficulty for clinicians, especially clinicians inexperienced with PE diagnosis, in determining the probability of PE and whether the gold standard CTPA test is needed for an accurate diagnosis. In addition, it is not feasible to extensively use CTPA to reduce the risk of a missed diagnosis in PE. Only approximately 27% of patients who undergo CTPA have been reported to be subsequently diagnosed8; therefore, increased use of CTPA represents a waste of medical resources, results in expensive investigations, and increases related risks.9,10 In addition, CTPA cannot be performed in suspected PE patients in many rural hospitals due to lack of equipment. Therefore, more appropriate and noninvasive approaches for PE diagnosis need to be explored and developed.
In response to these findings, a few clinically predictive models for PE have been developed to separate suspected PE patients into groups with different pretest probabilities.11,12 Two of the most validated and widely used clinical prediction tools are the Wells score and the revised Geneva score.12–14 Of these, the Wells score is more accurate than the revised Geneva score for diagnosing PE15,16; however, its utility is controversial because subjective criteria (e.g., “whether an alternative diagnosis is less likely than PE”) carry a great deal of weight in scoring17 and limit its standardization, resulting in poor interobserver reproducibility. The Wells group further found that the combination of a low or intermediate clinical probability according to the Wells score and a normal D-dimer result can be inferred to safely exclude a diagnosis of PE.17–19 However, there is currently no explanation for why this combination is effective, and many clinicians are therefore confused when interpreting results. Above all, these scores are based on patients with suspected PE according to their clinical history rather than positive D-dimer results and are intended to predict the likelihood of PE, aiming to help clinicians who are inexperienced with PE diagnosis make further clinical decisions related to confirming or excluding a PE diagnosis. Thus, in this study, we analyze hospitalized patients who have already undergone testing for D-dimer with positive results (i.e., not all symptomatic patients are analyzed) and explore a new clinical prediction rule that is based on positive D-dimer results and objective clinical variables. We hope that this system will guide clinicians in making appropriate decisions for patients with positive D-dimer results and reduce unnecessary CTPA examinations.
In the present study, we developed a clinical decision-making rule that is based on positive D-dimer results. We combined clinical variables that can be observed in inpatients in real-time, including symptoms, signs and findings on frequently performed texts (e.g., electrocardiography, electrocardiogram (ECG), echocardiography, ultrasonic cardiogram (UCG), and blood gas levels).20 Moreover, our rule is derived from a study involving a large multicenter cohort of inpatients with positive D-dimer results, and our test passed an external retrospective validation, demonstrating that it is credible and valid.
Methods
Study Design and Patients
We designed a multicenter prospective outcome study with the aim of developing a clinical decision-making rule to aid in PE diagnosis. We conducted the study at the in-patient departments of three general and teaching hospitals (The Second Affiliated Hospital of Chongqing Medical University, China; The Second People’s Hospital of Chengdu, China; and The First Affiliated Hospital of Kunming Medical College, China) from August 2016 to May 2017. Clinicians assessed inpatients’ conditions and determined whether they needed to undergo a plasma D-dimer test, and we selected consecutive inpatients with elevated plasma D-dimer who were older than 18 years as the eligible study population. The following exclusion criteria were applied: (1) ongoing anticoagulant treatment, (2) contraindications to CT (e.g., a known allergy to contrast iodine agents, a risk of allergic reaction, creatinine clearance of 0.50 mL/s (30 mL/min),21 or pregnancy), (3) an estimated life expectancy of less than one month, and (4) younger than 18 years. We obtained written informed consent from all enrolled patients in addition to the approval of the ethics committee of our institution. Between August 1, 2016 and May 31, 2017, we screened 3101 patients with a positive plasma D-dimer result and excluded 87 patients because of a contraindication for CT (n = 52) or protocol violations (n = 35). In total, we enrolled 3014 patients in this study.
Once the patients were enrolled, they underwent a sequential diagnostic work-up, including an arterial blood gas analysis (while breathing room air), ECG, UCG, and chest radiography. The clinicians in charge of the patients performed the clinical evaluations, including recording demographic characteristics on a standardized data form (Form 1); recording clinical signs and symptoms of PE; and recording the results of arterial blood gas analysis tests, ECG, UCG, and chest radiography. We did not interfere with the clinicians’ decisions regarding diagnostic and treatment strategies and merely noted which patients underwent CTPA and the discharge diagnosis.
Form 1.
Collect the basic clinical data of inpatients.
Diagnostic Strategy
We considered patients PE positive if they met at least one of the following conditions: a positive pulmonary angiogram in patients with a high clinical probability, a positive helical CT scan, a high-probability VQ scan plus a moderate or high pretest probability22 or a venous thromboembolic event within the one-month follow-up period. Most of the patients were diagnosed by CTPA, which is the most commonly used imaging test to confirm PE because of its diagnostic accuracy and wide availability. After the patients were discharged from the hospital, we tracked them for up to one month by telephone. During this month, we estimated the incidence of confirmed symptomatic thromboembolic events as the rate of missed diagnoses of PE during hospitalization.
Score derivation
The patients who were hospitalized between August 1, 2016 and March 31, 2017 were defined as the derivation sample. We evaluated all the clinical variables (15 variables referred to here as X1–X15, see Table 2) in our database that are known to be potentially associated with PE and performed a univariate analysis to select predictive variables (defined as those with p values <0.05, indicating significance) for a logistic stepwise regression model. We included the variables that were significantly associated with PE in a logistic stepwise regression analysis, which was performed using the least squares principle (α = 0.1). The strength of the association between each candidate predictor and PE was determined using odds ratios. We established a multiple linear regression model and derived the regression equation
The points assigned to each variable of the scoring system were determined according to the coefficient of variation, and a constant (4.05) was used as the cutoff value to classify patients into PE-likely or PE-unlikely categories; patients with scores higher than 4.05 were regarded as PE-likely, and those with scores of 4.05 or less were classified as PE-unlikely.
Table 2.
Variables enrolled in and their associations with pulmonary embolism in the univariate analysis.
| Odds ratio |
95% Wald |
||||
|---|---|---|---|---|---|
| Parameter | Chi-square | Pr > ChiSq | Estimate | Confidence limits | |
| Intercept | 31.4233 | <.0001 | |||
| X3 chest pain | 5.5029 | 0.0190 | 4.365 | 1.274 | 14.951 |
| X4 chest tightness | 16.3760 | <.0001 | 10.632 | 3.384 | 33.408 |
| X5 cough | 0.3940 | 0.5302 | 1.528 | 0.407 | 5.739 |
| X6 anhelation | 44.2457 | <.0001 | 37.223 | 12.822 | 108.058 |
| X7 hemoptysis | 5.8181 | 0.0159 | 14.921 | 1.660 | 134.148 |
| X8 cyanosis | 1.9688 | 0.1606 | 2.834 | 0.661 | 12.148 |
| X9 jugular venous distention | 1.0946 | 0.2955 | 2.217 | 0.499 | 9.851 |
| X10 lower limb edema | 2.1410 | 0.1434 | 2.740 | 0.710 | 10.573 |
| X11 heart rate ≥ 100 beats/min | 11.1617 | 0.0008 | 6.585 | 2.179 | 19.897 |
| X12 BP < 90/60 mmHg | 0.8223 | 0.3645 | 2.059 | 0.432 | 9.815 |
| X13 blood gas: (SpO2 <90% or PaO2 <80 mmHg or PaCO2 <35 mmHg) | 28.5034 | <.0001 | 21.507 | 6.972 | 66.340 |
| X14 ECG: S1Q3T3 | 12.5245 | 0.0004 | 16.470 | 3.490 | 77.718 |
| X15 ECG: (Incomplete or complete right bundle branch block; or presence of pulmonary P wave or right axis deviation; or T wave inversion in V1–V4, ST abnormal) | 20.3676 | <.0001 | 11.948 | 4.069 | 35.087 |
| X16 UCG: (or PAP >30 mmHg; or right ventricular enlargement; or TRPG > 30 mmHg) | 15.8445 | <.0001 | 9.678 | 3.165 | 29.593 |
| X17 X-ray: (pulmonary trunk expansion, or bulging pulmonary artery segment) | 0.7616 | 0.3828 | 2.104 | 0.396 | 11.181 |
ECG: electrocardiogram; UCG: ultrasonic cardiogram; PAP: pulmonary arterial pressure; TRPG: tricuspid regurgitation peak systolic gradient.
Score validation
We validated the score in an independent cohort of inpatients who were enrolled between April 1, 2017 and May 31, 2017 were not recruited into the derivation set and were recruited from two hospitals (The Second Affiliated Hospital of Chongqing Medical University, China, and The Second People’s Hospital of Chengdu, China). The diagnostic algorithm and the diagnostic criteria used to determine the presence of PE were identical to those used in the derivation sample study. We collected the variables that were significantly associated with PE and retrospectively calculated the score for each patient. All patients were then followed for one month after they were discharged from the hospital.
Statistical analysis
We assessed the validity and value of our score by calculating its sensitivity and specificity, agreement rate, positive and negative predictive values, false-positive rate, and false-negative rate in both the derivation group and the validation group. We then compared the above data between the derivation and validation samples. In addition, we compared the proportions of observed and predicted patients who underwent CTPA in both the derivation and the validation group using a chi-square test. A p value <0.05 indicated a significant discrepancy between the observed and predicted events. We performed all statistical analyses using SPSS software.
Results
Table 1 shows the basic characteristics of the participants. Including events in the one-month follow-up period, a total of 70 patients (2.33%) were confirmed to have PE. We found that two patients were misdiagnosed during hospitalization and were regarded as PE-positive during the one-month follow-up period; these two patients were assigned to the PE-likely category by our scoring system.
Table 1.
The basic characteristics of the participants.
| Characteristics | Missing values, n (%) | Value |
|---|---|---|
| Derivation group | ||
| Total patients | 2270 | |
| One month follow-up | 11 (0.48%) | 2259 (99.52%) |
| Patients with confirmed PE | 0 | 50 (2.21%) |
| Basic demographics | ||
| Men | 0 | 1239 (54.85%) |
| Women | 0 | 1020 (45.15%) |
| Mean age | 0 | 60.09 ± 15.05 |
| Symptoms | ||
| Chest pain | 0 | 180 (7.97%) |
| Chest tightness | 0 | 204 (9.03%) |
| Cough | 0 | 345 (15.27%) |
| Anhelation | 0 | 183 (8.10%) |
| Hemoptysis | 0 | 43 (1.90%) |
| Signs | ||
| Cyanosis | 0 | 218 (9.65%) |
| Jugular venous distention | 0 | 200 (8.85%) |
| Lower limb edema | 0 | 261 (11.55%) |
| Heart rate ≥100 beats/min | 0 | 196 (8.68%) |
| BP <90/60 mmHg | 0 | 174 (7.70%) |
| Blood gas : SpO2<90% or PaO2 <80 mmHg or PaCO2 <35 mmHg | 0 | 187 (8.28%) |
| Clinical examination | ||
| ECG: S1Q3T3 | 0 | 48 (2.12%) |
| ECG: Incomplete or complete right bundle branch block; Or presence of pulmonary P wave or right axis deviation; Or T wave inversion in lead V1-V4, ST abnormal | 0 | 199 (8.81%) |
| UCG:(Or PAP>30 mmHg;Or right ventricular enlargement; Or TRPG >30 mmHg) | 0 | 198 (8.76%) |
| X-ray:(pulmonary trunk expansion, or bulging pulmonary artery segment) | 0 | 235 (10.40%) |
| Validation group | ||
| Total patients | 744 | |
| One month follow-up | 7 (0.94%) | 737 (99.06%) |
| Patients with confirmed PE | 0 | 18 (2.44%) |
| Basic demographics | ||
| Men | 0 | 413 (56.04%) |
| Women | 0 | 324 (43.96%) |
| Mean age | 0 | 61.04 ± 26.23 |
| Symptoms | ||
| Chest pain | 0 | 57 (7.73%) |
| Chest tightness | 0 | 88 (11.94%) |
| Anhelation | 0 | 70 (9.50%) |
| Hemoptysis | 0 | 11 (1.49%) |
| Signs | ||
| Heart rate ≥ 100 beats/min | 0 | 50 (6.78%) |
| Blood gas:SpO2 <90% or PaO2<80 mmHg or PaCO2<35 mmHg) | 0 | 70 (9.50%) |
| Clinical examination | ||
| ECG: S1Q3T3 | 0 | 15 (2.04%) |
| ECG: Incomplete or complete right bundle branch block; Or presence of pulmonary P wave or right axis deviation; Or T wave inversion in lead V1-V4, ST abnormal | 0 | 81 (10.99%) |
| UCG: (or PAP>30 mmHg; or right ventricular enlargement; or TRPG> 30 mmHg) | 0 | 66 (8.96%) |
ECG: electrocardiogram; UCG: ultrasonic cardiogram; PAP: pulmonary arterial pressure; TRPG: tricuspid regurgitation peak systolic gradient.
We identified 15 variables that were potentially associated with PE. The association between each variable and PE is shown in Table 2. In all, nine variables were found to be significantly associated with PE and were included in the stepwise logistic regression analysis (Table 3). These included chest pain; chest tightness; shortness of breath; hemoptysis; heart rate ≥100 beats/min; blood gas analysis (room air, SpO2<90%, PaO2<80 mmHg or PaCO2 <35 mmHg); an ECG presenting a typical S1Q3T3 pattern; an ECG presenting at least one of the following: (1) incomplete or complete right bundle branch block, (2) the presence of pulmonary P wave or right axis deviation, or (3) T wave inversion in the lead V1–V4 and abnormal ST; and a UCG presenting at least one of the following: (1) PAP >30 mmHg, (2) right ventricular enlargement, or (3) TRPG >30 mmHg. We assigned points for the score and applied cutoff values according to the regression equation (see the Methods section), including the nine variables that independently predicted PE (Table 4). Table 4 presents the final score and the optimal cutoff values used to determine the predefined prevalence of PE in each clinical category; patients with scores higher than 4.05 were considered PE-likely, and those with scores of 4.05 or less were considered PE-unlikely (see the Methods section).
Table 3.
Variables significantly associated with pulmonary embolism in a stepwise logistic regression analysis.
| Odds ratio |
95% Wald |
||||
|---|---|---|---|---|---|
| Variable | Chi-square | Pr > ChiSq | Estimate | Confidence limits | |
| Intercept | 132.4390 | <.0001 | |||
| X3 chest pain | 5.5845 | 0.0181 | 3.998 | 1.267 | 12.616 |
| X4 chest tightness | 16.6543 | <.0001 | 9.873 | 3.287 | 29.652 |
| X6 anhelation | 45.5563 | <.0001 | 35.286 | 12.537 | 99.311 |
| X7 hemoptysis | 10.2926 | 0.0013 | 28.962 | 3.705 | 226.407 |
| X11 heart rate≥100 beats/min | 13.4341 | 0.0002 | 6.430 | 2.377 | 17.395 |
| X13 blood gas: (SpO2 <90% or PaO2 <80 mmHg Or PaCO2 <35 mmHg) | 30.2509 | <.0001 | 19.886 | 6.852 | 57.714 |
| X14 ECG: S1Q3T3 pattern | 11.4889 | 0.0007 | 13.248 | 2.974 | 59.023 |
| X15 ECG: (Incomplete or complete right bundle branch block; or presence of pulmonary P wave or right axis deviation; or T wave inversion in lead V1–V4, ST abnormal) | 21.7549 | <.0001 | 10.944 | 4.004 | 29.911 |
| X16 UCG: (or PAP > 30 mmHg; or right ventricular enlargement; or TRPG >30 mmHg) | 18.2755 | <.0001 | 9.161 | 3.318 | 25.292 |
ECG: electrocardiogram; UCG: ultrasonic cardiogram; PAP: pulmonary arterial pressure; TRPG: tricuspid regurgitation peak systolic gradient.
Table 4.
Final score.
| Variables | Points |
|---|---|
| Chest pain | 1.4 |
| Chest tightness | 2.3 |
| Anhelation | 3.6 |
| Hemoptysis | 3.4 |
| Heart rate ≥ 100 beats/min | 3.6 |
| blood gas: (SpO2<90% or PaO2<80 mmHg or PaCO2<35 mmHg) | 2.9 |
| ECG: S1Q3T3 pattern | 4.1 |
| ECG: (incomplete or complete right bundle branch block; or presence of pulmonary P wave or right axis deviation; or T wave inversion in lead V1–V4, ST abnormal) | 2.4 |
| UCG: (or PAP> 30 mmHg; or right ventricular enlargement; or TRPG> 30 mmHg) | 3.7 |
| Clinical probability | |
| PE-like | >4.05 |
| PE-unlike | <4.05 |
ECG: electrocardiogram; UCG: ultrasonic cardiogram; PAP: pulmonary arterial pressure; TRPG: tricuspid regurgitation peak systolic gradient.
Validity and value of the score
In the derivation group, we retrospectively computed scores for 2259 of the 2270 patients; values were missing for 11 patients (6 of them quit midway through the study for personal reasons, and the other 5 could not be contacted by telephone during the follow-up period). Table 5 presents the proportion of patients in the derivation group in each category. As shown in Table 5, the sensitivity/true-positive rate (TPR) and the negative predictive value (NPV) of the score were 100%, and the rate of missed PE diagnosis (false-negative rate) was as low as 0.00%, indicating that our score has significant value for excluding PE. However, its specificity/true-negative rate (TNR) was equal to 86.94%, its false-positive rate was 11.09%, and its positive predictive value (PPV) was only 16.95%, demonstrating that our score is useful for screening for PE. The agreement rate of the score was 89.15%, indicating that the number of patients predicted to have or not have PE had a relatively high rate of consistency with the observed numbers. In the validation set, we calculated scores for 737 out of 744 patients; values were missing for seven patients (two quit midway through the study for personal reasons, and the other five could not be contacted by telephone during the follow-up period). Table 5 presents the proportion of patients in the validation group that were assigned to each category. As shown in Table 5, the validity and values (including sensitivity, specificity, agreement rate, FPR, FNR, PPV, and NPV) of the score were similar between the derivation and validation samples and showed no significant differences.
Table 5.
Proportion of patients in each category and the validity and values of the score.
| Observed |
||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Predicted | PE | non-PE | Total | Sensitivity/TPR | Specificity/TNR | Agreement rate | FPR | FNR | PPV | NPV |
| (a) Derivation group | ||||||||||
| PE-like | 50 | 245 | 295 | 100% | 86.94% | 89.15% | 11.09% | 0.00% | 16.95% | 100% |
| PE-unlike | 0 | 1964 | 1964 | |||||||
| Total | 50 | 2209 | 2259 | |||||||
| (b) Validation group | ||||||||||
| PE-like | 20 | 64 | 84 | 100% | 88.60% | 93.86% | 9.18% | 0.00% | 21.43% | 100% |
| PE-unlike | 0 | 653 | 653 | |||||||
| Total | 20 | 717 | 737 | |||||||
PE: pulmonary embolism; TPR: true-positive rate; TNR: true–negative rate; PPV: positive predictive value; NPV: negative predictive value; FPR: false-positive rate; FNR: false-negative rate.
The score also demonstrated the potential to decrease the proportion of patients undergoing CTPA exams. Our score recommended that 326 of the 2996 patients who were analyzed in this study undergo CTPA. As shown in Table 6, the observed and predicted proportions of patients who needed CTPA were 16.82% and 10.76% (p < 0.05), respectively, in the derivation group and 18.72% and 11.40% (p < 0.05). These ratios were similar between the derivation and validation groups and showed no significant difference.
Table 6.
Observed and predicted proportions of patients undergoing CTPA in both derivation group and validation group.
| Group Patients, n(%) | Derivation | Validation | Total |
|---|---|---|---|
| Total | 2259 | 737 | 2996 |
| Undergo CTPA (observed) | 380 (16.82%) | 138 (18.72%) | 518 (17.29%) |
| Undergo CTPA (predicted) | 243 (10.76%) | 84 (11.40%) | 327 (10.91%) |
CTPA: computed tomographic pulmonary angiography.
Discussion
In this study, we present a clinical decision-making rule that was developed using a large multicenter cohort of consecutive inpatients with positive plasma D-dimer results. The score, which was derived using a recommended method, was standardized and based on clinical information that was collected from the patients in real-time. The score allows clinicians to make appropriate decisions for patients with positive D-dimer results and is expected to reduce unnecessary CTPA examinations.
Clinicians always view a positive plasma D-dimer test as a cautionary sign of PE because of its high sensitivity for PE. However, the specificity of D-dimer is only approximately 30%–40%,6,7 causing difficulty for clinicians who are inexperienced in diagnosing PE in determining the probability of PE and whether a further diagnostic strategy is needed based on a positive D-dimer result.23 We therefore developed a new rule for predicting PE in which we combined a positive D-dimer result with other clinical features. We selected several items significantly associated with PE for inclusion into the score, including symptoms and signs commonly encountered in PE and the results of related clinical examinations (blood gases, ECG, UCG).24–26 The data related to the clinical manifestations included in the score are easy to obtain from the patient’s history and a physical examination. In addition, the clinical examinations required are relatively noninvasive and simple to perform, which is acceptable for patients. Moreover, all the variables included in this score are reasonably straightforward and objective, and the scorer can easily come to a “black or white” conclusion (i.e., whether the patient is PE-likely or PE-unlikely). These factors make our score easy to compute and repeatable. Therefore, this scoring system is feasible for both clinicians and inpatients.
We clearly identified PE, the outcome of interest, and defined PE using accepted diagnostic criteria that were verified during a one-month follow-up period.27 All the items included in this score were precisely defined and reasonably straightforward to obtain. In addition, we used classical statistical methods, including univariate analysis, to identify the variables that are significant associated with PE. This was followed by a logistic stepwise regression analysis that included all the identified significant predictors. In addition, the score was validated by different clinicians in a cohort of patients that was entirely nonoverlapping with the derivation sample. As shown in Table 5, our score also achieved favorable accuracy in both the derivation and validation sets. Indeed, the diagnostic criteria, follow-up mode, and diagnostic algorithm used in the two sets were identical. Although the validation samples were recruited from the same two centers (The Second Affiliated Hospital of Chongqing Medical University, China, and The Second People's Hospital of Chengdu, China) as that of derivation group, they were recruited during different periods (August 2016 to March 2017 and April 2017 to May 2017, respectively). However, a commonly accepted rule requires that there should be at least five test cases with the predicted outcome (PE) per independent variable. In our derivation sample group, 50 patients were confirmed to have PE, and the final score comprised only nine variables, for an average of 5.6 cases for per variable. We consider that this result may be due to our broad inclusion criteria (inpatients with elevated plasma D-dimer levels). The clinicians did not have strict inclusion criteria for performing the D-dimer test for hospitalized patients because the plasma D-dimer test is relatively inexpensive (approximately $12) and aids in the diagnosis of many diseases. Clinically, the D-dimer test can assist in the diagnosis of patients with suspected PE and suspected lower extremity deep venous thrombosis28 and can be performed as a routine screening test before and after surgery and for elderly or bedridden patients as well as patients with atrial fibrillation or myocardial infarction.29,30 In addition, the use of the D-dimer test is promising in the diagnosis of periprosthetic joint infection and for predicting some types of cancer.31,32 Therefore, the group of patients with elevated D-dimer levels will inevitably include many patients with other diseases other than PE. However, this issue does not reduce the value of our score because our score is not only intended to predict PE but to help clinicians make appropriate diagnostic decisions for patients with elevated D-dimer levels. Unavoidably, our study has the limitation of missing data. In the derivation and validation groups, we missed 11 (0.48%) and 7 (0.94%) patients, respectively; 8 of them quit midway through the study for personal reasons, and the other 10 patients were lost to contact during the one month of follow-up. Nevertheless, 0.48% and 0.94% are quite low missing rates and do not weaken the reliability of our results. Although our research can help clinicians decide whether to perform CTPA to exclude PE in patients with positive D-dimer results, our model requires further examinations, such as ultrasound, ECG, and blood gas analysis, which are somewhat expensive. However, it can avoid excessive CTPA and missed diagnosis of PE and can help clinicians, especially those who are inexperienced with PE diagnosis, to make appropriate clinical decisions for patients with elevated plasma D-dimer levels.
Many clinicians, especially nonspecialists (e.g., nonrespiratory or cardiovascular physicians) who diagnose PE, commonly run into problems when they encounter patients with a positive plasma D-dimer result. In cases of missed PE diagnosis, some clinicians manage these patients radically by broadly assigning examinations, such as CTPA, VA scans, chest 64–detector row CT, or even anticoagulation therapy, as preventive measures.33 In contrast, some clinicians choose to temporarily wait when inpatients have a positive D-dimer result and reexamine their plasma D-dimer levels after a few days. However, the patient’s symptoms could become aggravated during this time, resulting in further necessary measures. Our score can be used in inpatients with a positive plasma D-dimer result to enable clinicians to evaluate the likelihood of PE and predict which patients require further examinations. A patient with a positive D-dimer test and a score of at least 4.05 points on our scoring system has a high probability of having PE. We therefore recommend that these patients, who were classified as PE-likely by our system, undergo the gold standard test, CTPA. As shown in Table 6, the rate at which CTPA examinations were recommended by our scoring system and the rate observed in an actual clinical setting were 10.91% and 17.29%, respectively (p < 0.05). Hence, this scoring system, to some extent, could be used to reduce the number of unnecessary CTPA examinations. Hence, our scoring system not only lightens the burden on patients but also helps clinicians to make timely decisions regarding the diagnosis of and therapeutic strategy for inpatients with a positive D-dimer test. However, this system’s clinical usefulness and the adherence of both clinicians and patients should be further studied.
The present score is not a diagnostic criterion but rather a tool to help doctors, especially non-PE specialists, determine which patients with a positive D-dimer test need to undergo a CTPA examination. As the results show, our score resulted in a false-negative rate (rate of missed diagnoses) of 0.00% (p>0.05) in the both the derivation and validation groups. Its sensitivity (TPR) was correspondingly high at 100% in both the derivation and validation groups, indicating that the score accurately and effectively identified PE patients. Regardless of sensitivity or specificity, our score seems more favorable than the Wells score and the Geneva score.34 A meta-analysis comparing Wells scores and Geneva score shows that the sensitivities ranged from 63.8% to 79.3% and 55.3% to 73.6%, respectively, and that the specificities ranged from 48.8% to 90.0% and 51.2% to 89%, respectively.34 However, further appropriate statistical analysis is required for their comparison. However, to minimize the rate of missed diagnoses, false-positive and relatively low-specificity results are unavoidable (Table 5). In the derivation and validation groups, we achieved false-positive rates (the misdiagnosis rate) of 11.09% and 9.18%, respectively (p>0.05), and specificities of 86.94% and 90.82%, respectively (p>0.05). Our score did result in the misdiagnosis of some non-PE diseases. For instance, a patient who suffered from atrial fibrillation and had a rapid heart rate combined with an intracardiac mural thrombus and heart failure was regarded as PE-likely by our system. In addition, another patient with chest wall trauma accompanied by a reactive increase in plasma D-dimer levels was also classified as PE-likely by our scoring system because the patient suffered from chest pain and subsequently presented with a rapid heart rate (>100 beats/min) and overventilation (PCO2 <35 mmHg). Therefore, the presented rules could be further improved in the future.
The Wells rule is the most extensively validated and most widely used rule for making clinical decisions. It is mainly based on risk factors for PE, such as malignancy, surgery and previous DVT/PE.7 The scoring system presented here relies far more on clinical information, including symptoms, signs, and the results of additional clinical examinations performed after a positive D-dimer test that can be obtained in real-time. We therefore suggest that our score and the Wells score may be complementary in clinical applications. In addition, the Wells rule includes one real-time clinical item, i.e., “whether an alternative diagnosis is less likely than PE.”7 This item is important but is also subjective and dependent on the clinical experience of the practitioner. Our score can assist clinicians in assessing this type of subjective criterion by dividing patients into PE-likely and PE-unlikely categories. We therefore propose that our scoring system should be combined with the Wells rule to improve the accuracy of clinical diagnoses of PE. Such a combined system remains to be studied.
In summary, we developed the first PE-related decision-making rule that is specific to inpatients with a positive D-dimer result. Our aim is to assist clinicians, especially non-PE specialists, in deciding which patients require further CTPA examination. The score is intended to minimize the rate of missed diagnoses in PE and reduce unnecessary CTPA examinations. Furthermore, our score, which is based on clinical manifestations and simple auxiliary examinations, is straightforward to obtain, objective in nature, and easy for both patients and clinicians to comply with. We therefore expect it to be widely used.
Footnotes
Authors’ contribution: M. L. wrote the manuscript, performed the analyses, and participated in designing the study. D. J. supervised and participated in the analyses and participated in writing and designing the study. C. L. constructed the prediction models, performed the statistical analyses, and helped to write the study. Z. L., Z. X., J. L., and C. W. participated in gathering the data. Y. J. coordinated the handling of samples. All authors reviewed the manuscript carefully and approved the final version.
Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: D. J., the corresponding author of the present study, is supported by a grant from the National Natural Science Foundation of China (grant number 81650003).
References
- 1.Ozsu SS, Durmus ZG, Coskuner MB, et al. Does the incidence and mortality of pulmonary thromboembolism change over the years? Turk Thorac J 2017; 18: 78–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Smith SB, Geske JB, Kathuria P, et al. Analysis of national trends in admissions for pulmonary embolism. Chest 2016; 150: 35–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Paparoupa M, Spineli L, Framke T, et al. Pulmonary embolism in pneumonia: still a diagnostic challenge? Results of a case-control study in 100 patients. Dis Mark 2016; 2016: 1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Robert-Ebadi H, Glauser F, Planquette B, et al. Safety of multidetector computed tomography pulmonary angiography to exclude pulmonary embolism in patients with a likely pretest clinical probability. J Thromb Haemost 2017; 15: 1584–1590. [DOI] [PubMed] [Google Scholar]
- 5.van der Hulle T, van Es N, den Exter PL, et al. Is a normal computed tomography pulmonary angiography safe to rule out acute pulmonary embolism in patients with a likely clinical probability? Thromb Haemost 2017; 117: 1622–1629. [DOI] [PubMed] [Google Scholar]
- 6.Glober N, Tainter CR, Brennan J, et al. Use of the d-dimer for detecting pulmonary embolism in the emergency department. J Emerg Med 2018; 54: 585–592. [DOI] [PubMed] [Google Scholar]
- 7.Choi H, Krishnamoorthy D. The diagnostic utility of D-dimer and other clinical variables in pregnant and post-partum patients with suspected acute pulmonary embolism. Int J Emerg Med 2018; 11: 10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Moores LK, Jackson WL, Jr, et al. Meta-analysis: outcomes in patients with suspected pulmonary embolism managed with computed tomographic pulmonary angiography. Ann Int Med 2004; 141: 866–874. [DOI] [PubMed] [Google Scholar]
- 9.Molaee S, Ghanaati H, Safavi E, et al. Computed tomography pulmonary angiography for evaluation of patients with suspected pulmonary embolism: use or overuse. Iran J Radiol 2015; 12: e22383. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Alhassan S, Sayf AA, Arsene C, et al. Suboptimal implementation of diagnostic algorithms and overuse of computed tomography-pulmonary angiography in patients with suspected pulmonary embolism. Ann Thorac Med 2016; 11: 254–260. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Turan O, Turgut D, Gunay T, et al. The contribution of clinical assessments to the diagnostic algorithm of pulmonary embolism. Adv Clin Exp Med 2017; 26: 303–309. [DOI] [PubMed] [Google Scholar]
- 12.Ceriani E, Combescure C, Le Gal G, et al. Clinical prediction rules for pulmonary embolism: a systematic review and meta-analysis. J Thromb Haemost 2010; 8: 957–970. [DOI] [PubMed] [Google Scholar]
- 13.Guo DJ, Zhao C, Zou YD, et al. Values of the Wells and revised Geneva scores combined with D-dimer in diagnosing elderly pulmonary embolism patients. Chin Med J 2015; 128: 1052–1057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.den Exter PL, van den Hoven P, van der Hulle T, et al. Performance of the revised Geneva score in patients with a delayed suspicion of pulmonary embolism. Eur Respir J 2014; 43: 1801–1804. [DOI] [PubMed] [Google Scholar]
- 15.Di Marca S, Cilia C, Campagna A, et al. Comparison of Wells and revised Geneva rule to assess pretest probability of pulmonary embolism in high-risk hospitalized elderly adults. J Am Geriatr Soc 2015; 63: 1091–1097. [DOI] [PubMed] [Google Scholar]
- 16.Ma Y, Huang J, Wang Y, et al. Comparison of the Wells score with the revised Geneva score for assessing pretest probability of pulmonary embolism in hospitalized elderly patients. Eur J Intern Med 2016; 36: e18–e19. [DOI] [PubMed] [Google Scholar]
- 17.Wells PS, Anderson DR, Rodger M, et al. Derivation of a simple clinical model to categorize patients probability of pulmonary embolism: increasing the models utility with the SimpliRED D-dimer. Thromb Haemost 2000; 83: 416–420. [PubMed] [Google Scholar]
- 18.van Es J, Beenen LF, Gerdes VE, et al. The accuracy of D-dimer testing in suspected pulmonary embolism varies with the Wells score. J Thromb Haemost 2012; 10: 2630–2632. [DOI] [PubMed] [Google Scholar]
- 19.Ma Y, Wang Y, Liu D, et al. A safe strategy to rule out pulmonary embolism: The combination of the Wells score and D-dimer test: one prospective study. Thromb Res 2017; 156: 160–162. [DOI] [PubMed] [Google Scholar]
- 20.Firdous N, Nasa P, Bansal A, et al. Comparison of non-invasive diagnostic tests to multi-detector CT pulmonary angiography for the diagnosis of pulmonary embolism. J Cardiovasc Dis Res 2013; 4: 40–43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Davenport MS, Khalatbari S, Cohan RH, et al. Contrast medium-induced nephrotoxicity risk assessment in adult inpatients: a comparison of serum creatinine level- and estimated glomerular filtration rate-based screening methods. Radiology 2013; 269: 92–100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Curtis BR, Cox M, Poplawski M, et al. Low yield of ventilation and perfusion imaging for the evaluation of pulmonary embolism after indeterminate CT pulmonary angiography. Emerg Radiol 2017; 24: 525–530. [DOI] [PubMed] [Google Scholar]
- 23.Crawford F, Andras A, Welch K, et al. D-dimer test for excluding the diagnosis of pulmonary embolism. Cochrane Database of Syst Rev 2016; 8: CD010864. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Qaddoura A, Digby GC, Kabali C, et al. The value of electrocardiography in prognosticating clinical deterioration and mortality in acute pulmonary embolism: a systematic review and meta-analysis. Clin Cardiol 2017; 40: 814–824. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Mok KH, Wong SW, Wong YM, et al. Clinical characteristics, risk factors and outcomes of South-East Asian patients with acute pulmonary embolism. Int J Cardiol 2017; 249: 431–433. [DOI] [PubMed] [Google Scholar]
- 26.Comert S, Caglayan B, Akturk U, et al. The role of thoracic ultrasonography in the diagnosis of pulmonary embolism. Ann Thorac Med 2013; 8: 99. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Saar JA, Maack C, Society of Cardiology European. Diagnosis and management of acute pulmonary embolism. ESC guidelines 2014. Herz 2015; 40: 1048–1054. [DOI] [PubMed] [Google Scholar]
- 28.Nybo M, Hvas AM. Age-adjusted D-dimer cut-off in the diagnostic strategy for deep vein thrombosis: a systematic review. Scand J Clin Lab Investig 2017; 77: 568–573. [DOI] [PubMed] [Google Scholar]
- 29.Hijazi Z, Oldgren J, Siegbahn A, et al. Application of biomarkers for risk stratification in patients with atrial fibrillation. Clin Chem 2017; 63: 152–164. [DOI] [PubMed] [Google Scholar]
- 30.Kikkert WJ, Claessen BE, Stone GW, et al. D-dimer levels predict ischemic and hemorrhagic outcomes after acute myocardial infarction: a HORIZONS-AMI biomarker substudy. J Thromb Thrombolysis 2014; 37: 155–164. [DOI] [PubMed] [Google Scholar]
- 31.Shahi A, Kheir MM, Tarabichi M, et al. Serum D-dimer test is promising for the diagnosis of periprosthetic joint infection and timing of reimplantation. J Bone Joint Surg 2017; 99: 1419–1427. [DOI] [PubMed] [Google Scholar]
- 32.Gao XL, Wang SS, Cao DB, et al. The role of plasma D-dimer levels for predicting lymph node and mediastinal lymph node involvement in non-small cell lung cancer. Clin Respir J 2018; 12: 2151–2156. [DOI] [PubMed] [Google Scholar]
- 33.Zhang LT, Long YL, Yang J, et al. Association between D-dimer levels and clinical events in patients with mechanical heart valve replacement under oral anticoagulation therapy. Zhonghua xin xue guan bing za zhi 2017; 45: 852–856. [DOI] [PubMed] [Google Scholar]
- 34.Shen JH, Chen HL, Chen JR, et al. Comparison of the Wells score with the revised Geneva score for assessing suspected pulmonary embolism: a systematic review and meta-analysis. J Thromb Thromb 2016; 41: 482–492. [DOI] [PubMed] [Google Scholar]

