Skip to main content
PLOS One logoLink to PLOS One
. 2024 Mar 7;19(3):e0295050. doi: 10.1371/journal.pone.0295050

Comparison of five different disseminated intravascular coagulation criteria in predicting mortality in patients with sepsis

Amara Zafar 1, Filza Naeem 1, Muhammad Zain Khalid 1, Safia Awan 1, Muhammad Mehmood Riaz 1, Saad Bin Zafar Mahmood 1,*
Editor: Yoshihisa Tsuji2
PMCID: PMC10919643  PMID: 38452037

Abstract

Objective

Even though patients with sepsis and DIC have a higher mortality rate compared to those without DIC, screening for DIC is not currently part of sepsis management protocols. This may be due to a lack of literature on the frequency of DIC occurrence in sepsis patients, as well as the absence of evidence on the optimal DIC criteria to use for identifying DIC and predicting mortality among the five criteria available. To address this gap, this study investigates the predictive value of five different criteria for diagnosing DIC and its relationship to patient outcomes in our population of sepsis patients.

Methods

In the Medicine department of Aga Khan University Hospital, a retrospective observational study was conducted, enrolling all adult patients with International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) coding of sepsis and clinical suspicion of DIC between January 2018 and December 2020. To diagnose DIC, five different criteria were utilized, namely the International Society of Thrombosis and Hemostasis (ISTH), the Korean Society on Thrombosis and Hemostasis (KSTH), the Japanese Association for Acute Medicine (JAAM), the revised-JAAM (RJAAM), and the Japanese Ministry of Health and Welfare (JMHW). The study analyzed the sensitivity, specificity, negative predictive value, positive predictive value, and accuracy of these five criteria, as well as the overall prediction of mortality.

Results

Of 222 septic patients included in this study with clinical suspicion of DIC, 94.6% of patient had DIC according to KSTH criteria, followed by JAAM (69.4%), ISTH (64.0%), JMHW (53.2%) and lastly R-JAAM (48.6%). KSTH had sensitivity of 95.4% in diagnosing DIC and predicting mortality with a positive predictive value of 70% but specificity of 7.3% only. JAAM had sensitivity of 75.9%, positive predictive value of 75.9% with a specificity of 45.5%. ISTH had sensitivity of 69.4%, positive predictive value 75.3% and specificity of 48.5%.

Conclusion

DIC can impose a significant burden on septic patients and its presence can lead to higher mortality rates. Early detection through screening for DIC in septic patients can potentially reduce mortality. However, it is necessary to identify the most appropriate diagnostic criteria for each population, as various criteria have demonstrated different performance in different populations. Establishing a gold standard for each population can aid in accurate diagnosis of DIC.

Introduction

Sepsis is a critical medical condition that may lead to several complications, one of which is disseminated intravascular coagulation (DIC) [1]. The International Society on Thrombosis and Hemostasis (ISTH) provided a definition for DIC in 2001, stating that it is an acquired syndrome that involves the intravascular activation of coagulation and a loss of localization due to various causes [2]. DIC is a disorder that can be life-threatening and is associated with poor prognosis in sepsis patients, those with associated DIC have a higher mortality rate compared to patients without DIC. In a study of ICU patients with severe sepsis, the prevalence of DIC was 50.9% and the overall mortality rate was 21.5%. The mortality rate was found to be 17.5% for non-DIC patients and 24.8% for those with DIC complications [3]. Diagnosis of DIC is of crucial importance for ICU and critically ill patients; however, no single laboratory tests for accurate diagnosis of DIC is currently available [4].

The diagnosis of DIC is a challenging task due to the variety of clinical presentations and laboratory abnormalities. Several DIC criteria have been proposed and are currently used in clinical practice and research studies. To date, there are five different diagnostic criteria for DIC available, namely; ISTH (International society of thrombosis and hemostasis), KSTH (Korean society on thrombosis and hemostasis), JAAM (Japanese association for Acute medicine) RJAAM (revised-JAAM) and JMHW(Japanese ministry of health and welfare). In 2001, ISTH published the first international diagnostic criteria for overt DIC based on the modification of JMHW criteria [5]. JAAM criteria was published in 2005 and was revised by Gando et al. in 2006 and revealed that the revised JAAM (rJAAM) score had a better prognostic outcome than the JAAM in ICU patients [6]. In a study done on ICU patients in France, no significant difference between JAAM and ISTH criteria was observed; among 582 patients, 32.1% were diagnosed with DIC according to ISTH-DIC score, and 34.4% according to JAAM-DIC score [7].

A prospective study done in Korea which included 100 patients with severe sepsis/septic shock, compared the five diagnostic criteria of DIC for accurate diagnosis and mortality predictor as an outcome parameter. It concluded that the KSTH and JMHW criteria revealed greater statistical significance (P = 0.007, and 0.479, respectively) when applied on Day 1 and proved to result in overall ICU mortality [4]. This was the only study we can find in literature to have compared the five different DIC criteria together.

DIC screening is not a part of sepsis management yet. This could be attributed to the scarcity in literature about the frequency of occurrence of DIC in patients with sepsis. In a study in Japan, it was observed that DIC screening in ICU patients with sepsis was associated with a reduction in mortality [8]. In patients with sepsis induced DIC, favorable outcome of anticoagulant therapy on the mortality rate have been reported in literature [9].

To the best of our knowledge, no studies have been done in Pakistan which compare the different criteria of DIC with each other in terms of diagnostic accuracy and relationship with mortality. Therefore, the major objective of our study was to compare the performance of five different DIC criteria in patients with sepsis in our population in accurately diagnosing DIC and predicting outcomes in terms of mortality.

Material and methods

Study design/data source and collection

This was a retrospective study conducted in the Medicine Department of Aga Khan University Hospital (AKUH). Aga Khan University Hospital is one of the largest academic tertiary care centers in South Asia. It is a 300 bed facility with a state of the art emergency department and rooms of different acuities; low-monitoring ward beds with a nurse ratio of approximately 5:1, 70 high dependency units with 24 hour cardiac monitoring, non-invasive mechanical ventilation facilities and nurse ratio of 5:2, and 15 intensive care units (ICU) with mechanical ventilator facilities and nurse ratio of 1:1. In addition, the hospital has a rapid response team (ICU nurse and doctor) which is the first responder to hospital areas in case of a medical emergency. The hospital also has a robust transport mechanism for patients who need to be shifted to ICU. Such patients are accompanied by an Advanced cardiac life support (ACLS) certified nurse and doctor along with the RRT nurse. Sepsis was defined as life-threatening organ dysfunction caused by a dysregulated host response to infection [10].

The study included all adult (> 18 years) patients with International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) coding of sepsis based on the Dombrovskiy definition (Infection codes: 003.1, 020.2, 022.3, 036.2, 036.3, 038.0–038.4, 038.8, 038.9, 054.5, 098.89, 112.5, 785.52, 995.91, 995.92 AND Organ dysfunction codes: 286.6, 286.9, 287.5, 293.0, 297.4, 348.1, 348.3, 427.5, 458.0, 458.8, 458.9, 518.81, 518.82, 570, 572.2, 573.4, 584, 780.01, 785.5, 786.09, 799.1, 796.3) [10] and Modified Martin Criteria (Infection codes: 038.0–038.4, 038.8, 038.9, 003.1, 020.2, 036.2, 036.3, 054.5, 098.89, 112.5, 112.81, 117.9, 790.7, 995.91 AND organ dysfunction codes: 518.81, 518.82, 518.84, 518.85, 786.09, 799.1, 785.5 with all sub codes, 458, 796.3, 584 with all sub codes, 580, 570, 572.2, 573.3, 286.6, 286.9, 287.3–5, 293, 348.1, 348.3, 357.82, 780.01, 780.09, 276.2) [11] from January 2018 to December 2020 were reviewed. Patients in whom the routine DIC laboratory tests (platelet, D-dimer, fibrin/fibrin degradation product (FDP), prothrombin time (PT), activated partial thromboplastin time (aPTT), and fibrinogen) were done were included in this study.

Information was collected from the study center’s administrative database, which is managed by the hospital’s Health Information Management System (HIMS) Department. A total of 1999 medical records from the period of 2018 to 2020 were thoroughly reviewed. These records had been coded with ICD-9-CM for sepsis. After applying the inclusion criteria, 222 medical records were found to be eligible and were included in the study. Non-probability consecutive sampling was employed. Medical record files were systematically reviewed and patients meeting inclusion criteria were included. Scores were applied as per the criteria and outcome was noted from the records by the same data collector.

The questionnaire recorded the age and gender of the participants. Systemic Inflammatory Response Syndrome (SIRS) was computed based on the temperature, respiratory rate, heart rate, and the white blood cell count reported when the patients DIC workup was done. The data collection team also took note of the need for intubation and dialysis during the patients’ hospital stay, as well as whether they developed septic shock at any point. The study utilized the initial vital signs recorded in the emergency department and the first lactate measurement during the hospital stay to compare survivors and non-survivors. The SOFA score was calculated using the first recorded PaO2/FiO2, platelet count, bilirubin, MAP (hypotension), Glasgow Coma Score (GCS), and creatinine (or urine output). For coagulation marker comparison, only patients who had their platelet count, PT, aPTT, fibrinogen, d-dimer, and FDP measured were included.

All the elements used to assess DIC criteria for each patient originated from a single day. On the initial day, 44.3% underwent DIC evaluation based on clinical judgment, while on the second day, the assessment was conducted for 33.3%. On the third day, 13.1% underwent evaluation, followed by 4.2% on the fourth day, and 3.4% on the fifth day. The remaining four patients underwent DIC evaluation on days 6, 8, 10, and 11, respectively. Hence, these investigations were carried out on the day when the clinician suspected the patient might be experiencing DIC. These values were not the worst reported values during the admission but were done on a single day. Each patient included underwent evaluation using all five DIC diagnostic criteria: JAAM, R-JAAM, JMHW, ISTH, and KSTH (Table 1, Fig 1).

Table 1. Summary of five different DIC diagnostic criteria applied in the present study [4].

Parameters Score KSTH ISTH JAAM JMHW
Platelets, × 10 9 /L 0 > 100 > 100 ≥ 120 > 120
1 ≤ 100 ≤ 100 ≥80 and < 120 or >30%↓ (≤ 24 hrs) 80–120
2 ≤ 50 50–80
3 < 80 or > 50%↓ (≤ 24 hrs) < 50
PT, sec 0 < 3 < 3 < 1.2 (PT ratio) < 1.25
1 ≥ 3 ≥ 3 and < 6 ≥ 1.2 1.25–1.67
2 ≥ 6 ≥ 1.67
aPTT, sec 0 < 5
1 ≥ 5
Fibrin related marker, μg/mL 0 No increase * No increase * No increase < 10
1 Increase Moderate increase 10–20
2 Moderate increase 20–40
3 Marked increase § Marked increase ** ≥ 40
Fibrinogen, g/L 0 > 1.5 > 1.0 > 3.5 > 1.5
1 ≤ 1.5 ≤ 1.0 ≤ 3.5 1.0–1.5
2 ≤ 1.0
SIRS score 0 0–2
1 ≥ 3
Underlying disease 1 Present
Bleeding 1 Present
Organ failure 1 present
Total DIC ≥ 3 DIC ≥ 5 DIC ≥ 5 DIC ≥ 7

R-JAAM criteria have same score system with JAAM except fibrinogen score.

aPTT = activated partial thromboplastin time, DIC = disseminated intravascular coagulation, FDP = fibrin/fibrinogen degradation product, ISTH = International Society on Thrombosis and Haemostasis, JAAM = Japanese Association for Acute Medicine, JMHW = Japanese Ministry of Health and Welfare, KSTH = Korean Society on Thrombosis and Hemostasis, PT = prothrombin time, R-JAAM = Revised JAAM, SIRS = systemic inflammatory response syndrome.

*D-dimer < 1.0

D-dimer ≥ 1.0

1.0 ≤ D-dimer < 5.0

§D-dimer ≥ 5.0

FDP < 10

10 ≤ FDP < 25

**FDP ≥ 25.

Fig 1. Selection of sample of the study and application of DIC criteria.

Fig 1

Eligibility criteria

Patients with hematologic diseases, underlying bleeding disorders, on medications such as anticoagulation or chemotherapy, Child Pugh grade C liver cirrhosis were excluded from this study.

Patient and public involvement statement

This study was conducted retrospectively by examining medical records and electronic data. The research did not involve live interviews or direct interaction with patients. Patient confidentiality and anonymity were maintained, and no identifying information that could be used to track participants was included. The study questionnaire was labelled with a serial number. The ethical review committee (ERC) of Aga Khan University Hospital (AKUH), Karachi, Pakistan approved the study as an exemption (IRB reference number: 2021-6280-19084).

Statistical analysis

All the patients were divided into two groups, survivors and non survivors. Clinical and laboratory parameters were compared between the two groups. The sensitivity, specificity, positive predictive value, negative predictive value, and accuracy of five different DIC diagnostic criteria in terms of overall prediction of mortality were analyzed using the Statistical Package for Social Science (SPSS) version 23. Results were presented as mean ± standard deviation or median with interquartile range (IQR) for continuous variables and frequency (percentages) for categorical variables. Analytical analysis was done according to the study objectives. For comparative analysis, Chi-square, or Fisher’s Exact for categorical variables and Mann–Whitney U, or independent sample t-test wherever applicable. All p-values were two-sided and considered as statistically significant if < 0.05.

Results

Baseline clinical and laboratory characteristics between the survivors and non-survivors of sepsis

Out of 222 patients enrolled in this study, 68 (30.6%) patients survived and 154 (69.4%) did not survive. There was no statistically significant difference observed in mortality in age and gender. The mean age of survivors was 55.1 ± 19.1 years and for non-survivors it was 56.9 ± 18.7 years. 89 patients (40.1%) were intubated and experienced an Intensive Care Unit stay.

Patients who required the need of dialysis had higher mortality rates (p-value 0.004). Patients who were intubated, developed septic shock, had higher SOFA and SIRS scores and higher lactate levels were seen to have significantly higher mortality rates (p-value <0.001). The median SOFA score for non-survivors was 13 [11.7–15.0] and for survivors it was 8 [5.0–10.0]. Lactate was higher on initial presentation among non-survivors (median of 5 mM/L [2.0–13.0]) than survivors (median of 2 mM/L [1.0–2.9).

Among infections, genitourinary (GU) infections were significantly associated with mortality (p = 0.030), out of 78 patients with GU infections, 47 (60.3%) patients did not survive and 31 (39.7%) survived. The presence of fungus was found in 50 patients (22.5%) and its presence was significantly associated with mortality, 44 (88%) patients out of 50 did not survive, while only 6 (12%) patients survived (p = 0.001). Blood culture was positive in 92 (41.1%) patients, out of which 70 (76.1%) did not survive and 22 (23.9%) survived. There was no significant difference observed in the presence of bacteraemia between survivors and non-survivors (p = 0.068). Out of the 222 patients, 3 (1.4%) had Tuberculosis, 1 (0.5%) had meningitis, 90 (40.5%) had respiratory tract infection (sputum culture positive), 25 (11.3%) had gastrointestinal infection, 78 (35.1%) had GU infection, and 12 (5.4%) had bone and skin infections. Out of 90 patients with respiratory tract infection, 24 (27%) survived and 66 (73%) did not survive (p = 0.290).

When the vital signs of the patients recorded on arrival to the emergency were compared, it was seen that patients who had higher respiratory rate (p<0.001), higher heart rate (p = 0.002) and lower mean arterial pressures (p<0.001) had significantly higher mortality rates.

When coagulation profile was compared, finding of low platelets was significantly associated with mortality (p value = 0.02). High PT (p value = 0.001) and aPTT (p value = 0.004), low fibrinogen (p value = 0.05), and higher FDP (p value = 0.01) were all found to be significantly associated with mortality. D-dimer was the only coagulation marker not found to be significantly associated with mortality (p value = 0.06) (Table 2).

Table 2. Comparison of baseline clinical and laboratory characteristics between survivors and non-survivors.

Variables Survivors (n = 68) Non-survivors (n = 154) P value
Age, yr 55.1 ± 19.1 56.9 ± 18.7 0.52
Sex (M:F ratio) 32:36 85:69 0.26
Diabetes Mellitus 22(32.4) 73(47.4) 0.03
Hypertension 33(48.5) 73(47.4) 0.87
Clinical outcomes
 Dialysis, No. (%) 13(19.1) 60(39) 0.004
 Ventilator use, No. (%) 15(22.1) 74(48.1) <0.001
 Bacteremia, No. (%) 22(32.4) 70(45.5) 0.06
Septic shock, No. (%) 55(80.9) 153(99.4) <0.001
SOFA score 8.0(5.0–10.0) 13.0(11.7–15.0) <0.001
SIRS score 3.0-(2.0–3.0) 3.0(3.0–4.0) <0.001
Lactate, mM/L 2.0(1.0–2.9) 5.0(2.0–13.2) <0.001
Initial vital sign
 Respiratory rate/min 26.0(20.0–26.0) 28.0(26.0–30.0) <0.001
 Heart beats/min 110.0(94.0–115.0) 113.0(104.7–123.0) 0.002
 Temperature, °C 36.1(36.0–37.0) 37.0(36.0–38.0) 0.07
MAP 65.5(56.0–72.7) 50.0(45.0–62.2) <0.001
Coagulation markers
 Platelet, × 109/L 82.0(35.7–164.5) 55.0(31.7–93.2) 0.02
 PT, sec 16.2(14.0–19.5) 20.3(14.8–27.3) 0.001
 aPTT, sec 35.0(27.2–46.1) 40.7(30.0–62.7) 0.004
 D-dimer, μg/mL 6.0(2.4–14.3) 7.7(3.7–19.6) 0.06
 FDP, μg/mL 5.0(5.0–16.2) 5.0(5.0–20.0) 0.01
 Fibrinogen, g/L 258.0(168.2–454.5) 216.0(131.7–352.7) 0.05

P values were obtained from the Pearson’s χ2 test (for dichotomous variables) and the t-test or Mann-Whitney U test (for continuous variables) and the results were expressed as the mean ± sd or median and interquartile range (IQR, 25th–75th percentile).

aPTT = activated partial thromboplastin time, F = female, FDP = fibrin degradation product, M = male, PT = prothrombin time, SOFA = sequential organ failure assessment.

Comparing DIC diagnosis and prediction of mortality rates using five distinct diagnostic criteria

On application of the five DIC criteria on our study sample, 210 patients (94.6%) had DIC according to KSTH criteria, followed by 154 patients (69.4%) by JAAM, 142 patients (64%) by ISTH, 118 patients (53.2%) by JMHW and 108 patients (48.6%) by R-JAAM. All groups diagnosed with DIC according to different criteria had a high mortality rate. Specifically, the mortality rate was 70% for KSTH, 75.4% for ISTH, 76% for JAAM, 78.7% for R-JAAM, and 78% for JMHW (Table 3).

Table 3. Comparison of outcome between different DIC criteria.

DIC Criteria- N Discharged Expired
N (%) N (%)
KSTH 210 63 (30.0) 147 (70.0)
ISTH 142 35 (24.6) 107 (75.4)
JAAM 154 37 (24.0) 117 (76.0)
R-JAAM 108 23 (21.3) 85 (78.7)
JMHW 118 26 (22.0) 92 (78.0)

DIC = disseminated intravascular coagulation, ISTH = International Society on Thrombosis and Haemostasis, JAAM = Japanese Association for Acute Medicine, R-JAAM = Revised JAAM, JMHW = Japanese Ministry of Health and Welfare, KSTH = Korean Society on Thrombosis and Hemostasis.

Performance evaluation of five different DIC diagnostic criteria

In terms of predicting mortality in patients with sepsis, KSTH demonstrated a sensitivity of 95.4% but a specificity of only 7.3%. JAAM had a sensitivity of 75.9%, a specificity of 45.5%, a positive predictive value of 75.9%, and an accuracy of 66.6%. ISTH had a sensitivity of 69.4%, a specificity of 48.5%, a positive predictive value of 75.3%, and an accuracy of 63.0%. R-JAAM had the highest specificity (66.1%) and positive predictive value (78.7%) among all five criteria, but its sensitivity (55.1%) and accuracy (58.5%) were low (Table 4).

Table 4. Performance of five different DIC diagnostic criteria in the prediction of overall mortality.

Diagnostic criteria Sensitivity, % (No.) Specificity, % (No.) PPV, % (No.) NPV, % (No.) Accuracy, % (No.)
 KSTH criteria 95.4 7.3 70.0 41.6 68.4
 ISTH criteria 69.4 48.5 75.3 41.2 63.0
 JAAM criteria 75.9 45.5 75.9 45.5 66.6
 R-JAAM criteria 55.1 66.1 78.7 39.4 58.5
 JMHW criteria 59.7 617 77.9 40.3 60.3

ISTH = International Society on Thrombosis and Haemostasis, JAAM = Japanese Association for Acute Medicine, NPV = negative predictive value, PPV = positive predictive value, R-JAAM = revised JAAM, JMHW = Japanese Ministry of Health and Welfare, KSTH = Korean Society on Thrombosis and Hemostasis.

Discussion

Sepsis is a life-threatening condition that arises when the body’s response to an infection injures its tissues and organs. Mortality in sepsis remains high, and accurate and reliable prognostic tools are essential to identify patients who are at risk of dying. One such tool is the use of different DIC criteria, which are commonly used to assess the severity of coagulopathy in patients with sepsis. Various populations have shown varying results in the diagnosis of DIC when utilizing different criteria.

The purpose of our study was to assess the effectiveness of the five different DIC screening criteria in accurately identifying patients with DIC, as well as to compare the outcomes of these patients. By doing so, we aimed to determine which criteria was the most sensitive in our population. Our study findings indicate that among the evaluated models, KSTH demonstrated superior sensitivity and accuracy, while R-JAAM exhibited the highest specificity and positive predictive value for mortality prediction in sepsis patients as compared to others. Additionally, our study also revealed associated mortality rates, providing important insight into the clinical implications of DIC diagnosis.

As far as we are aware, only one published study has compared the performance of the five DIC criteria in predicting mortality among patients with severe sepsis or septic shock who were admitted to the ICU. The results of this study suggested that both the KSTH and JMHW criteria performed better than the ISTH, JAAM, and R-JAAM criteria in predicting overall ICU and 28-day mortality [4]. Overall, comparison between two studies would be difficult as one was prospective while the other was retrospective. Moreover, it is important to note that each population has different racial characteristics and hence different thrombolytic mechanisms [12].

Our study found that 64.0%, 69.4% and 94.6% of patients were diagnosed with DIC using the ISTH, JAAM and KSTH scoring systems, respectively. Our analysis suggests that the inclusion of SIRS criteria and differences in platelet count and fibrinogen scores may account for the variations in diagnostic outcomes between the criteria. These findings are consistent with a study conducted in a tertiary hospital in France, which reported DIC diagnosis rates of 32.1% using ISTH and 34.4% using JAAM among ICU patients [7].

Another study comparing JAAM and ISTH criteria found that the JAAM DIC scoring system accurately diagnosed all patients with ISTH overt DIC at the time of severe sepsis diagnosis, while the ISTH overt DIC system missed many patients and was unable to detect non-overt DIC. This indicates that the JAAM system is more effective in selecting DIC patients with a poor prognosis and those requiring treatment. The JAAM system showed high sensitivity and moderate specificity using the ISTH overt DIC criteria as a benchmark. The study suggests that the ISTH overt DIC criteria may be too strict in selecting patients at risk of death and may require the assistance of a non-overt DIC scoring system in a critical care setting [13]. Similarly, another study demonstrated that the JAAM criteria diagnosed all patients identified as having DIC using the KSTH, JMHW, and ISTH criteria as well [4].

A prospective study by the Japanese Society of Thrombosis and Hemostasis (JSTH) assessed three different sets of DIC diagnostic criteria. The JAAM acute phase DIC criteria demonstrated the highest sensitivity, detecting twice as many cases of DIC compared to the other two criteria sets. The JMHW and ISTH overt-DIC criteria followed in sensitivity. Mortality prediction was used as an evaluation criterion since there is no gold standard for diagnosing DIC. The JAAM criteria exhibited the highest sensitivity (80.0%) for predicting mortality but had low specificity (33.2%) [14]. Our study also revealed that JAAM exhibited superior sensitivity (75.9%) in predicting mortality compared to ISTH (69.4%) and JMHW (59.7%). Our study identified low specificity for all three criteria, including JAAM (45.5%), ISTH (48.5%), and JMHW (61.7%). R-JAAM exhibited the highest specificity (66.1%) in our study, while KSTH demonstrated the lowest specificity (7.3%).

The KSTH DIC criteria offer the advantage of being concise and not requiring a weighted score, which makes them a relatively simple option for calculating for the presence of DIC. However, the KSTH criteria are not yet accepted as an international diagnostic method due to a lack of clinical application data to support their use. Several studies have compared the KSTH criteria with other DIC criteria. One study found that the KSTH criteria were more sensitive predictors of mortality than the ISTH criteria, with a concordance rate of 84.7% and a K-coefficient of 0.6 [15]. Another study demonstrated a good level of agreement between the KSTH criteria and ISTH criteria, suggesting that the KSTH criteria may be a useful diagnostic tool for DIC [4]. In our study KSTH had the highest sensitivity (95.4%) but it had the lowest specificity (7.3%) in predicting mortality. Our study included patients who had clinical suspicion of DIC. This reinforces the relevance of utilizing KSTH criteria for our population, as 94.6% of the study sample satisfied the KSTH criteria. This high statistical sensitivity would make KSTH a valuable tool for screening of septic patients having DIC and thus predicting their prognosis.

The establishment of the JMHW criteria marked the first set of criteria for diagnosing DIC. The subsequent global adoption of ISTH overt-DIC criteria as the diagnostic criteria of choice has led to it becoming the widely accepted standard [16, 17].

Although our study provided valuable insights into the diagnostic criteria of DIC in septic patients, it is important to acknowledge its limitations. Firstly, being a single-center study with a limited sample size, the results may not be generalizable to the wider population. Moreover, ICD-9-CM coding for sepsis has been found to be categorized differently across literature and needs to be looked thoroughly between different institutions. Secondly, due to the retrospective nature of the study, only patients who had routine laboratory DIC tests were included, potentially leading to the exclusion of some patients with DIC. The selection of patients who underwent coagulation testing relied on the clinical judgment of physicians, representing a notable constraint in our study. Lastly, our study used hospital course mortality as the outcome measure, without a standardized follow-up period, which may affect the accuracy of our findings. Moreover, our study also did not include the treatment regimens for these patients due to the variability and since there is yet to be an international consensus on whether DIC should be a therapeutic target with anticoagulant therapy [12]. These limitations highlight the need for future studies to further investigate the diagnostic criteria of DIC in septic patients in larger more diverse populations with standardized outcome measures.

The sensitivity and specificity of the various DIC criteria for predicting mortality in sepsis patients differ from one another. While some studies indicate that specific criteria are more precise than others, additional research is necessary to identify the most effective DIC criteria for use in clinical settings. It is essential to validate the optimal cut-off values for laboratory parameters and determine the most precise and dependable DIC criteria for diagnosing and managing patients with this complex medical condition.

Conclusion

This groundbreaking cohort study is the first of its kind in our country, providing valuable insight into the comparison of the five different diagnostic criteria’s of DIC. Our findings serve as a steppingstone towards future prospective studies, ultimately leading to the identification of a gold standard diagnostic criteria best suited for our population. Our study highlights the critical importance of DIC screening as a part of sepsis management, given the high mortality rate observed in patients with sepsis induced DIC. Our study findings indicate that among the five evaluated models of DIC, KSTH demonstrated superior sensitivity and accuracy, while R-JAAM exhibited the highest specificity and positive predictive value for mortality prediction in sepsis patients as compared to others. Our study results highlight the need for large-scale studies to validate these findings before making it a part of local guidelines. The significant burden of DIC in septic patients emphasizes the need for early DIC screening as part of sepsis management, with the potential to reduce mortality rates—an avenue that warrants further exploration.

Supporting information

S1 Data

(SAV)

pone.0295050.s001.sav (74.5KB, sav)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Nishibori M. Novel aspects of sepsis pathophysiology: NETs, plasma glycoproteins, endotheliopathy and COVID-19. Journal of Pharmacological Sciences. 2022. Jun 15. doi: 10.1016/j.jphs.2022.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Adelborg K, Larsen JB, Hvas AM. Disseminated intravascular coagulation: epidemiology, biomarkers, and management. British Journal of Haematology. 2021. Mar;192(5):803–18. doi: 10.1111/bjh.17172 [DOI] [PubMed] [Google Scholar]
  • 3.Gando S, Shiraishi A, Yamakawa K, Ogura H, Saitoh D, Fujishima S, et al. Role of disseminated intravascular coagulation in severe sepsis. Thrombosis Research. 2019. Jun 1;178:182–8. doi: 10.1016/j.thromres.2019.04.025 [DOI] [PubMed] [Google Scholar]
  • 4.Ha SO, Park SH, Hong SB, Jang S. Performance evaluation of five different disseminated intravascular coagulation (DIC) diagnostic criteria for predicting mortality in patients with complicated sepsis. Journal of Korean medical science. 2016. Nov 1;31(11):1838–45. doi: 10.3346/jkms.2016.31.11.1838 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Saito S, Uchino S, Hayakawa M, Yamakawa K, Kudo D, Iizuka Y, et al. Epidemiology of disseminated intravascular coagulation in sepsis and validation of scoring systems. Journal of Critical Care. 2019. Apr 1;50:23–30. doi: 10.1016/j.jcrc.2018.11.009 [DOI] [PubMed] [Google Scholar]
  • 6.Gando S, Iba T, Eguchi Y, Ohtomo Y, Okamoto K, Koseki K, et al. A multicenter, prospective validation of disseminated intravascular coagulation diagnostic criteria for critically ill patients: comparing current criteria. Crit Care Med. 2006. Mar;34(3):625–31. doi: 10.1097/01.ccm.0000202209.42491.38 [DOI] [PubMed] [Google Scholar]
  • 7.Helms J, Severac F, Merdji H, Clere-Jehl R, François B, Mercier E, et al. Performances of disseminated intravascular coagulation scoring systems in septic shock patients. Annals of intensive care. 2020. Dec;10(1):1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Umemura Y, Yamakawa K, Hayakawa M, Hamasaki T, Fujimi S. Screening itself for disseminated intravascular coagulation may reduce mortality in sepsis: A nationwide multicenter registry in Japan. Thrombosis Research. 2018. Jan 1;161:60–6. doi: 10.1016/j.thromres.2017.11.023 [DOI] [PubMed] [Google Scholar]
  • 9.Umemura Y, Yamakawa K, Ogura H, Yuhara H, Fujimi S. Efficacy and safety of anticoagulant therapy in three specific populations with sepsis: a meta‐analysis of randomized controlled trials. Journal of Thrombosis and Haemostasis. 2016. Mar;14(3):518–30. doi: 10.1111/jth.13230 [DOI] [PubMed] [Google Scholar]
  • 10.Rhee C and others, for the Centers for Disease Control and Prevention Epicenters Program, Comparison of Trends in Sepsis Incidence and Coding Using Administrative Claims Versus Objective Clinical Data, Clinical Infectious Diseases. 2015. Jan; 60(1):88–95. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bouza C, Lopez-Cuadrado T, Amate-Blanco JM. Use of explicit ICD9-CM codes to identify adult severe sepsis: impacts on epidemiological estimates. Crit Care. 2016. Oct 3;20(1):313. doi: 10.1186/s13054-016-1497-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Ushio N, Wada T, Ono Y, Yamakawa K. Sepsis-induced disseminated intravascular coagulation: an international estrangement of disease concept. Acute Med Surg. 2023. May 4;10(1):e00843. doi: 10.1002/ams2.843 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Gando S, Saitoh D, Ogura H, Fujishima S, Mayumi T, Araki T, et al. A multicenter, prospective validation study of the Japanese Association for Acute Medicine disseminated intravascular coagulation scoring system in patients with severe sepsis. Critical care. 2013. Jun;17(3):1–8. doi: 10.1186/cc12783 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Takemitsu T, Wada H, Hatada T, Ohmori Y, Ishikura K, Takeda T, et al. Prospective evaluation of three different diagnostic criteria for disseminated intravascular coagulation. Thrombosis and haemostasis. 2011;105(01):40–4. doi: 10.1160/TH10-05-0293 [DOI] [PubMed] [Google Scholar]
  • 15.Lee JH, Song JW, Song KS. Diagnosis of overt disseminated intravascular coagulation: a comparative study using criteria from the International Society versus the Korean Society on Thrombosis and Hemostasis. Yonsei medical journal. 2007. Aug 31;48(4):595–600. doi: 10.3349/ymj.2007.48.4.595 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Toh CH, Hoots WK. The scoring system of the scientific and standardisation Committee on Disseminated Intravascular Coagulation of the International Society on Thrombosis and Haemostasis: a 5‐year overview. J. Thromb. Haemost. 2007; 5: 604–6. doi: 10.1111/j.1538-7836.2007.02313.x [DOI] [PubMed] [Google Scholar]
  • 17.Gando S, Levi M, Toh CH. Disseminated intravascular coagulation. Nat. Rev. Dis. Primers 2016; 2: 16037 doi: 10.1038/nrdp.2016.37 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Yoshihisa Tsuji

28 Jun 2023

PONE-D-23-14306Comparison of five different Disseminated Intravascular Coagulation Criteria in predicting mortality in Patients with SepsisPLOS ONE

Dear Dr. Bin Zafar Mahmood,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 12 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Yoshihisa Tsuji

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.pl2.os.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

3. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

4. Please include a separate caption for each figure in your manuscript.

Additional Editor Comments:

There are several problems in methodology, and it does not reach a publishable level. The points raised by the reviewers are essential; please respond to these questions.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: No

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The Manuscript compared the performance of five DIC diagnostic criteria focusing on the prediction of mortality in Pakistan. A retrospective cohort study using electronic medical records was conducted. The authors concluded that Japanese Association for Acute Medicine (JAAM) and Korean Society on Thrombosis and Hemostasis (KSTH) criteria were most valuable diagnostic criteria for screening septic patients for DIC in Pakistan population.

Major Comments

1) The details what is sepsis in ICD-9 was not written specifically. A description of what sepsis is included is needed.

2) There is no data description regarding the implementation of DIC score assessment. Basically, DIC scores do not use the parameters from time points apart in time. Are the parameters measured at the same time? What percentage of the evaluation was done on day 1?

3) A significant confounding factor regarding DIC diagnosis and mortality is intervention for DIC. The information about ICU admission rates and treatment for DIC needed.

4) It is not mentioned whether the DIC score evaluator was aware of the information regarding patient outcomes.

5) All of 5 criteria seem to have low predictive accuracy. Nevertheless, the authors recommend the use of the DIC score, but what is the advantage of recommending its use over other mortality predictors? I think the conclusion should be changed.

Minor Comments

1) For external validation, information on the clinical setting is needed. For example, information on patient transport routes and ICU admission rates is needed.

2) No unit description for lactate in Line 168.

Reviewer #2: This study compared the 5 different DIC criteria, and revealed the diagnostic accuracy for septic DIC as well as prediction of mortality. Unfortunately, I cannot accept this study for the following some reasons. Please see comments below.

<Major revision>

1) Internal validity

In this study, the relationship between DIC and patient outcomes were analyzed, but never analyzed some important confounding factors such as comorbidities.

2) External validity

It is difficult to apply the results of the 222 patients included in the study to patients with sepsis in general. The number included in the study is too small to generalize the result.

3) Feasibility

The authors recommend the combined use of JAAM and KSTH criteria for septic DIC. This means “ double standard “ in the diagnosis, which is inconsistent with current practice of sepsis.

4) Novelty

The authors mentioned Reference No.8 evaluating 5 DIC criteria like them, and the results were different between them. They never explained the reason of the inconsistent results. The novelty was unclear.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Mar 7;19(3):e0295050. doi: 10.1371/journal.pone.0295050.r002

Author response to Decision Letter 0


12 Aug 2023

1 The details of what sepsis is in ICD-9 was not written specifically. A description of what sepsis is included is needed.

We acknowledge this shortcoming. Dombrovskiy definition of sepsis was taken and has now been explained in methodology. The new reference has also been included (#11) Page 6 Line 111-115

2 There is no data description regarding the implementation of DIC score assessment. Basically, DIC scores do not use the parameters from time points apart in time. Are the parameters measured at the same time? What percentage of the evaluation was done on day 1?

We acknowledge that this data is missing. This has now been included “All the elements used to assess DIC criteria for each patient originated from a single day. On the initial day, 44.3% underwent DIC evaluation based on clinical judgment, while on the second day, the assessment was conducted for 33.3%. On the third day, 13.1% underwent evaluation, followed by 4.2% on the fourth day, and 3.4% on the fifth day. The remaining four patients underwent DIC evaluation on days 6, 8, 10, and 11, respectively.” Page 7, Line 139-143

3 A significant confounding factor regarding DIC diagnosis and mortality is intervention for DIC. The information about ICU admission rates and treatment for DIC needed.

We acknowledge this deficiency. The data for ICU admission rates and outcome was available and has been included. 89 patients (40.1%) were intubated and experienced an Intensive Care Unit stay. However, treatment received has not been included and has been acknowledged as a limitation. Page 11, Line 184 and Page 19, Line 318-321

4 It is not mentioned whether the DIC score evaluator was aware of the information regarding patient outcomes.

Since this is a retrospective study, medical record files were systematically reviewed and patients meeting inclusion criteria were included. Scores were applied as per the criteria and outcome was noted from the records by the same data collector. This detail has been included in the methodology also. Page 6, Line 124-127

5 All of 5 criteria seem to have low predictive accuracy. Nevertheless, the authors recommend the use of the DIC score, but what is the advantage of recommending its use over other mortality predictors? I think the conclusion should be changed.

We have changed the conclusion to state "Our study findings indicate that among the five evaluated models of DIC, KSTH demonstrated superior sensitivity and accuracy, while R-JAAM exhibited the highest specificity and positive predictive value for mortality prediction in sepsis patients as compared to others. Our study results highlight the need for large scale studies to validate these findings before generalizing it and making it a part of local guidelines." Page 20, Line 336-341

6 For external validation, information on the clinical setting is needed. For example, information on patient transport routes and ICU admission rates is needed.

We have added more information regarding the clinical setting. "Aga Khan University Hospital is one of the largest academic tertiary care centers in South Asia. It is a 600 bed facility with a state of the art emergency department and rooms of different acuities; low-monitoring ward beds with a nurse ratio of approximately 5:1, high dependency units with 24 hour cardiac monitoring, non-invasive mechanical ventilation facilities and nurse ratio of 5:2, and intensive care units (ICU) with mechanical ventilator facilities and nurse ratio of 1:1. In addition, the hospital has a rapid response team consisting of an ICU nurse and doctor and is the first responder to hospital areas in case of any emergency. The hospital also has a robust transport mechanism for patients who need to be shifted to ICU. Such patients are accompanied by an Advanced cardiac life support (ACLS) certified nurse and doctor along with the RRT nurse." Page 5, Line 100-109

7 No unit description for lactate in Line 168.

The unit for lactate (mM/L) has been added Page 11, Line 189-190

____________________________________________________________________________________________________________

1 Internal validity

In this study, the relationship between DIC and patient outcomes were analyzed, but never analyzed some important confounding factors such as comorbidities.

We agree that data on comorbidities is necessary. The two most important comorbidities diabetes and hypertension have now been included in Table 2 Page 12, Line 213

2 External validity

It is difficult to apply the results of the 222 patients included in the study to patients with sepsis in general. The number included in the study is too small to generalize the result.

We have changed the conclusion to state

Our study findings indicate that among the five evaluated models of DIC, KSTH demonstrated superior sensitivity and accuracy, while R-JAAM exhibited the highest specificity and positive predictive value for mortality prediction in sepsis patients as compared to others. Our study results highlight the need for large scale studies to validate these findings before generalizing it and making it a part of local guidelines. Page 20, Line 336-341

3 Feasibility

The authors recommend the combined use of JAAM and KSTH criteria for septic DIC. This means “ double standard “ in the diagnosis, which is inconsistent with current practice of sepsis.

We have changed the conclusion to state

Our study findings indicate that among the five evaluated models of DIC, KSTH demonstrated superior sensitivity and accuracy, while R-JAAM exhibited the highest specificity and positive predictive value for mortality prediction in sepsis patients as compared to others. Our study results highlight the need for large scale studies to validate these findings before generalizing it and making it a part of local guidelines. Page 20, Line 336-341

4 Novelty

The authors mentioned Reference No.8 evaluating 5 DIC criteria like them, and the results were different between them. They never explained the reason of the inconsistent results. The novelty was unclear.

We have explained the reason with a source reference. "Overall, comparison between two studies would be difficult as one was prospective while the other was retrospective. Moreover, it is important to note that each population has different racial characteristics and hence different thrombolytic mechanisms." Page 17, Line 264-267

Attachment

Submitted filename: Response to Reviewers.docx

pone.0295050.s002.docx (19.6KB, docx)

Decision Letter 1

Yoshihisa Tsuji

4 Sep 2023

PONE-D-23-14306R1Comparison of five different Disseminated Intravascular Coagulation Criteria in predicting mortality in Patients with SepsisPLOS ONE

Dear Dr. Mahmood,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

Reviewer #1 pointed out important points below. Please check and respond again.

==============================

Please submit your revised manuscript by Oct 19 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Yoshihisa Tsuji

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: No

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Major Comments

1) Thank you for providing more information on the ICD-9 criteria for inclusion based on Dombrovskiy's work, but reading Dombrovskiy's article, it seems to cover severe sepsis based on sepsis-1. Is it correct to understand that this corresponds to "sepsis" according to today's sepsis-3 definition? A definition of sepsis is needed.

2) According to the #11 literature, the classification is by ICD-9 CM Code, not ICD-9.

Which coding is correct?

3) Thank you for describing the data on the implementation of the DIC score assessment. I understand that the evaluations are carried out at different points in time, does this mean that the worst values are used as data? Do you mean the initial assessment? Please describe it in a way that the reader can understand.

4)Regarding results. I calculated the performance of the JMHW from the data in the manuscript, but there is concern that the results for specificity, positive predictive value and accuracy are incorrect. My calculations yielded a specificity of 61.8%, a PPV of 78.0% and an accuracy of 60.3%.

If the results of the calculations are in error, the performance difference in the five criteria appears to be narrowing.

If the results change, the conclusions should be re-considered.

5)It should be stated in the Limitation that the timing of coagulation testing is dependent on clinician bias and that the therapeutic interventions for the diagnosis of DIC are unknown.

Reviewer #2: The authors answered all questions adequately and reflected them in the text. I have no further comments.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Mar 7;19(3):e0295050. doi: 10.1371/journal.pone.0295050.r004

Author response to Decision Letter 1


19 Oct 2023

Reviewer 1:

1 Thank you for providing more information on the ICD-9 criteria for inclusion based on Dombrovskiy's work, but reading Dombrovskiy's article, it seems to cover severe sepsis based on sepsis-1. Is it correct to understand that this corresponds to "sepsis" according to today's sepsis-3 definition? A definition of sepsis is needed.

Thank you for taking the time to review our article, and we appreciate your feedback. Your attention to detail is invaluable in helping us improve the clarity of our work.

As required the definition of sepsis has been added as mentioned below with the appropriate reference.

“Sepsis was defined as life-threatening organ dysfunction caused by a dysregulated host response to infection”

However, global literature itself acknowledges the inconsistent strategies in selecting ICD codes for sepsis and the resulting problem. Most of these ICD codes for sepsis have been categorized before 2016 when Sepsis-3 definition was not in use.

The first JAMA paper (Singer M, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016 Feb 23;315(8):801-10.) on Sepsis-3 defined sepsis as per the definition mentioned above and advised to use only two explicit codes (995.92 and 785.52) for sepsis categorization.

However, a most recent article by Rudd and colleagues (Rudd et al. Global, regional, and national sepsis incidence and mortality, 1990–2017: analysis for the Global Burden of Disease Study. Lancet. 2020; 395: 200-211) and an extended commentary by Duke and colleagues accepts that using only explicit codes mentioned above may be inconsistent, unreliable and underestimate the true prevalence of sepsis.

The advice by these authors is that sepsis diagnosis should require two simultaneous diagnosis codes: one for an infectious disease and another for an acute organ dysfunction diagnosis. Unfortunately, the new categorization being done now is based on ICD-10-CM codes, whereas our hospital has switched to ICD-10-CM codes from 2022 and all previous coding has been done based on ICD-9-CM codes. Therefore, we utilized the existing work of Dombrovskiy's for ICD-9-CM code list from the work of Rhee and others, for the Centers for Disease Control and Prevention Epicenters Program as mentioned in the manuscript. This ICD-9-CM coding was also approved and provided by our Hospital Management Information System (HIMS) office tasked with maintaining all the patient data and categorizing them according to ICD codes.

I would like to clarify that the ICD-9-CM codes in this article mentioned under the heading of Dombrovskiy's definition do enroll severe sepsis patients but based on the same definition of having a source of infection along with an evidence of organ dysfunction. This definition is comparable to sepsis definition as per sepsis-3 which is applicable nowadays as also seen in the JAMA paper quoted above.

However, to enhance the validity of our study, we also included the modified Martin Criteria as done by Bouza and colleagues, Fortunately, there were only a few additional ICD-9-CM codes that were added as mentioned in text

“and Modified Martin Criteria (Infection codes: 038.0 - 038.4, 038.8, 038.9, 003.1, 020.2 , 036.2, 036.3, 054.5, 098.89, 112.5, 112.81, 117.9, 790.7, 995.91 AND organ dysfunction codes: 518.81, 518.82, 518.84, 518.85, 786.09, 799.1, 785.5 with all sub codes, 458 , 796.3 , 584 with all sub codes, 580 , 570, 572.2, 573.3, 286.6, 286.9, 287.3-5, 293, 348.1, 348.3, 357.82, 780.01, 780.09, 276.2)”

However, importantly no additional entries were obtained in the study cohort likely because the coding done by the HIMS office is based on the Dombrovskiy's code list.

To further add, we have added the ICD coding issues as a limitation in our manuscript

“Moreover, ICD-9-CM coding for sepsis has been found to be categorized differently across literature and needs to be looked thoroughly between different institutions.”

I believe that this explanation would help in clarifying any remaining issues regarding the sepsis definition in our manuscript. Moreover, the study’s main objective is to compare the different DIC criteria, and we believe that the study methodology can easily be replicated at another institution using ICD-9-CM or ICD-10-CM codes as per the hospital ICD code list.

Page 6, Line 109-121 and Page 20, Line 321-322

2 According to the #11 literature, the classification is by ICD-9 CM Code, not ICD-9.

Which coding is correct?

We apologize for this misconception.

The ICD-9 is just an abbreviated form of the full ICD-9-CM Code. ICD-9-CM is the official system of assigning codes to diagnoses and procedures associated with hospital utilization. This is abbreviated to ICD-9.

To make it easy and clear for the readers we have used the term “ICD-9-CM” all over the manuscript now.

3 Thank you for describing the data on the implementation of the DIC score assessment. I understand that the evaluations are carried out at different points in time, does this mean that the worst values are used as data? Do you mean the initial assessment? Please describe it in a way that the reader can understand.

We appreciate your diligence in seeking clarification.

The following text is already included in the methodology section but has been highlighted again in the manuscript.

“All the elements used to assess DIC criteria for each patient originated from a single day. On the initial day, 44.3% underwent DIC evaluation based on clinical judgment, while on the second day, the assessment was conducted for 33.3%. On the third day, 13.1% underwent evaluation, followed by 4.2% on the fourth day, and 3.4% on the fifth day. The remaining four patients underwent DIC evaluation on days 6, 8, 10, and 11, respectively. Hence, these investigations were carried out on the day when the clinician suspected the patient might be experiencing DIC. These values are not the worst reported values during the admission but were done on a single day”

Page 7, Line 144-151

4 Regarding results. I calculated the performance of the JMHW from the data in the manuscript, but there is concern that the results for specificity, positive predictive value and accuracy are incorrect. My calculations yielded a specificity of 61.8%, a PPV of 78.0% and an accuracy of 60.3%.

If the results of the calculations are in error, the performance difference in the five criteria appears to be narrowing.

If the results change, the conclusions should be re-considered.

We are extremely thankful for highlighting the numerical inaccuracies within Table 4. These errors have been thoroughly reviewed and rectified in the manuscript. We can confirm that all other numerical data has been meticulously scrutinized and found to be accurate.

Fortunately, these corrections do not alter the overall conclusions of the manuscript, as our study does not offer a definitive criterion based on our findings, rather encourage the researchers to consider replicating this study in a prospective manner to yield more robust results considering the high overall mortality. However, the required value changes have been made in the table and text.

5 It should be stated in the Limitation that the timing of coagulation testing is dependent on clinician bias and that the therapeutic interventions for the diagnosis of DIC are unknown.

We do agree with your opinion on both accounts and have made the changes. This was already mentioned in the manuscript, but we have further clarified it based on your valuable suggestion.

The following text has been added in limitations to further clarify the limitations.

“The selection of patients who underwent coagulation testing relied on the clinical judgment of physicians, representing a notable constraint in our study.”

Regarding therapeutic interventions the following lines were already present.

“Moreover, our study also did not include the treatment regimens for these patients due to the variability and since there is yet to be an international consensus on whether DIC should be a therapeutic target with anticoagulant therapy”

Page 20, Line 324-330

Reviewer 2: The authors answered all questions adequately and reflected them in the text. I have no further comments.

Thank you for taking the time to review our article, and we appreciate your feedback.

Attachment

Submitted filename: Response to Reviewers_2_191023.docx

pone.0295050.s003.docx (22.1KB, docx)

Decision Letter 2

Yoshihisa Tsuji

15 Nov 2023

Comparison of five different Disseminated Intravascular Coagulation Criteria in predicting mortality in Patients with Sepsis

PONE-D-23-14306R2

Dear Dr. Mahmood,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Yoshihisa Tsuji

Academic Editor

PLOS ONE

Acceptance letter

Yoshihisa Tsuji

20 Nov 2023

PONE-D-23-14306R2

Comparison of five different Disseminated Intravascular Coagulation Criteria in predicting mortality in Patients with Sepsis

Dear Dr. Mahmood:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Yoshihisa Tsuji

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Data

    (SAV)

    pone.0295050.s001.sav (74.5KB, sav)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0295050.s002.docx (19.6KB, docx)
    Attachment

    Submitted filename: Response to Reviewers_2_191023.docx

    pone.0295050.s003.docx (22.1KB, docx)

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES