Abstract
Introduction
Conclusive data on the accuracy and clinical applicability of non-invasive screening tests for oesophageal varices (OV) in patients with compensated cirrhosis remain lacking. We conducted this study to identify currently available tests, estimate their diagnostic performance and then exemplify how these could be utilized in clinical practice.
Materials and methods
A systematic literature search was performed to identify all primary studies that reported accuracy using oesophagogastroduodenoscopy (OGD) as the gold standard. Sources searched included Ovid MEDLINE, Ovid EMBASE and The Cochrane Library databases.
Results
Twenty-one studies with a total of 2471 patients were identified. Several tests were evaluated in more than three studies. Platelet count/spleen diameter ratio (PSR) had the highest summary area under the curve for detection of any size OV of 0.85 (95% confidence interval 0.78–0.92). At a cut-off of 909 (n = 4 studies) and prevalence rates of 10, 20, 30, 40 and 50% for OV, PSR screening correctly avoided the need for OGD in 70, 62, 55, 47 and 39% of patients, respectively.
Conclusions
PSR appears to be the most accurate and validated non-invasive screening test for OV in patients with compensated cirrhosis. At a cut-off of 909, PSR could be clinically useful to avoid OGDs in a significant proportion of patients.
Keywords: Diagnosis; non-invasive markers; platelet to spleen ratio; liver stiffness measurement
Key summary
The majority of patients with compensated cirrhosis undergoing invasive screening with oesophagogastroduodenoscopy (OGD) do not have oesophageal varices (OV).
Several non-invasive tests have been evaluated in this setting with variable results and cut-off values. The value of these tests in clinical practice remains unclear.
Currently available non-invasive tests for OV specific to patients with compensated cirrhosis are identified and compared.
Platelet count/spleen diameter ratio (PSR) appears to be the most accurate and validated test for OV in this cohort. At a cut-off of 909, PSR could be clinically utilized to avoid OGDs in a significant proportion of patients.
Introduction
Current guidelines recommend screening all patients diagnosed with liver cirrhosis for oesophageal varices (OV) using oesophagogastroduodenoscopy (OGD).1 Present estimates suggest that only 30–40% of patients with compensated cirrhosis have OV at the index OGD.2 Moreover, the prevalence of medium/large OV in those patients is low at approximately 10%.3 Therefore, a large proportion of compensated cirrhosis patients currently undergo serial negative OGDs at a significant cost and additional discomfort4 with potentially marginal clinical benefit.5 In fact, empirical therapy with non-selective beta blockers was more cost-effective than OGD screening when both strategies were compared to no screening.5 Thus, the stratification of patients with OV and judicious selction of patients for therapy is an important and common clincial problem.
A large number of studies have evaluated the accuracy of non-invasive serum and imaging biomarkers in predicting the presence of OV. However, both individual studies and meta-analyses have inherent limitations as they are performed on heterogeneous populations with both compensated and decompensated cirrhosis; hence, they are subject to a high risk of spectrum bias and are challenging to translate into clinical practice.6–8 Compensated cirrhosis represents a significantly different clinical entity, with lower prevalence of OV as well as lower risk of variceal bleeding and death compared to decompensated cirrhosis.9
The availability of simple, non-invasive tests of liver fibrosis and advances in radiological imaging will inevitably result in the earlier diagnosis of cirrhosis.10 This will enrich the number of patients with compensated cirrhosis and having data specific to this population will be imperative in guiding bespoke management strategies. The aims of this study were to: a) identify, using a systematic review, non-invasive diagnostic tests that detect OV in compensated cirrhosis; b) compare overall diagnostic performance, using meta-analysis, of different diagnostic tests in compensated cirrhosis; and c) create a clinical applicability model to highlight the number of OGDs that could be saved using non-invasive tests at a specified threshold and varying prevalence of OV.
Materials and methods
This study was conducted according to guidance provided by the Cochrane Collaboration handbook for systematic reviews,11 and followed a pre-specified protocol.
Search strategy
We searched Ovid MEDLINE, Ovid EMBASE and The Cochrane Library databases for studies published from database inception to 1 March 2017 for relevant articles evaluating all diagnostic tests for the prediction of OV in patients with compensated cirrhosis. No restrictions were applied to the search algorithm (Supplementary Table 1).
Study selection and outcome measures
Studies were included if:
They were performed on adult patients aged 18 years or older.
Subjects had proven liver cirrhosis of any aetiology, defined by typical clinical and radiological criteria with or without histological criteria.12
Patients had compensated cirrhosis as defined by Child–Pugh A grade, or absence of ascites, encephalopathy and previous variceal haemorrhage.
OGD was used as the reference standard.
Sufficient data was provided to allow the generation of a 2 × 2 diagnostic table.
The primary outcome measure was the diagnostic performance of index tests for the detection of any size OV. This was chosen because identification of any OV in patients with compensated cirrhosis results in a change in clinical management, either by reduced interval of surveillance OGD or initiation of primary prophylaxis measures to prevent an index variceal bleed.
Study quality was assessed independently by two investigators (SSS and DH) using the updated version of the quality assessment of diagnostic accuracy studies (QUADAS-2) tool.13
Statistical analysis
Meta-analyses were performed using the DerSimonian–Laird random effects model14 to calculate (with 95% confidence intervals (Cis)): pooled sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR−), diagnostic odds ratio DOR and summary area under the curve (AUC). Summary receiver operating characteristic curves were used to compare the overall accuracy of different tests.15
We aimed to estimate the proportion of OGDs saved by implementing a pre-screening strategy with a non-invasive marker compared to the current practice of universal screening. This clinical applicability was evaluated using the likelihood ratios to calculate post-test probability based on Bayes’ theorem.16 This concept is depicted visually with a Fagan’s Bayesian nomogram.16 Estimates of the pre-test probability of OV were derived from the pooled prevalence across all studies as well as other prevalence rates reported in the literature. The clinical applicability was measured only for tests that are validated in more than one study using the same threshold as identified by our systematic review. Analysis was performed using Meta-DiSc (version 1.4, Ramón y Cajal Hospital, Madrid, Spain) and Stata (version 12.1, College Station, Texas, USA) software packages.
Heterogeneity, subgroup analyses and publication bias
Heterogeneity was examined both by visual inspection of the forest plots, and by statistical assessment using the chi-square and inconsistency (I2) tests. The I2 describes the percentage of total variation across studies that is due to heterogeneity rather than chance. Values of I2 of 25, 50 and 75% may be considered to represent low, moderate and high inconsistency.17 Exploratory subgroup analyses were conducted to investigate sources of heterogeneity. Evidence of publication bias or small study effects was assessed using both visual inspection of the funnel plot and Deek’s asymmetry test18 whenever there were approximately 10 or more studies included in the meta-analysis.19 A p-value of < 0.10 was suggestive of significant asymmetry and therefore the possible presence of publication bias.
Results
The search strategy identified 5527 citations that were all screened by reading the title and abstract. We identified 185 potentially eligible articles that were all read in full. Twenty-one studies with a total of 2471 patients with compensated cirrhosis were included in the systematic review.20–40 Fifteen studies (1695 patients)20–33,39 evaluated similar markers and were also included in the meta-analysis (Figure 1). Details are summarized in Tables 1 and 2, respectively. Results of the QUADAS-2 quality assessment are shown in supplementary Table 2.
Figure 1.
Flow diagram of the search strategy and selection of studies eligible for data analysis. OGD: oesophagogastroduodenoscopy.
Table 1.
Characteristics of included studies (n = 21).
| Author and year | Country and design | No. of pts | Marker | Outcome measure | Cut-off | Se, Sp |
|---|---|---|---|---|---|---|
| Giannini et al.20 2003 | Italy Retrospective | 145 | PSR | Any OV | 909 | 100, 71 |
| Giannini et al.21 2006 | Multicentrea Prospective | 111 | PSR | Any OV | 909 | 79, 73 |
| Camma et al.22 2009 | Italy Prospective | 104 | PSR | Any OV | 792 | 83, 60 |
| HOMA-IR score | Any OV | 3.5 | 61, 76 | |||
| Predictive model | Any OV | N/A | 75, 75 | |||
| Agha et al.23 2009 | Pakistan Prospective | 114 | PSR | Any OV | 909 | 100, 98 |
| Abu El-Makarem et al.24 2011 | Egypt Prospective | 46 | PSR | Any OV | 939.7 | 100, 82 |
| Esmat and Rashid25 2011 | Egypt Prospective | 20 | PSR | Any OV | 1574 | 100, 85 |
| Platelet count | Any OV | 221 × 103/µL | 86, 54 | |||
| Spleen length | Any OV | 12.5 cm | 100, 77 | |||
| Colecchia et al.26 2012 | Italy Prospective | 100 | PSR | Any OV | 1883 | 98, 26 |
| LSM (Fibroscan) | Any OV | 16.4 kPa | 96, 60 | |||
| SSM (Fibroscan) | Any OV | 41.3 kPa | 98, 66 | |||
| LSPS | Any OV | 1.32 | 98, 64 | |||
| Mangone et al.27 2012 | Italy Prospective | 87 | PSR | Any OV | 909 | 58, 66 |
| Calvaruso et al.28 2013 | Italy Prospective | 96 | PSR | Any OV | 800 | 74, 70 |
| Med + OV | 640 | 73, 65 | ||||
| LSM (Fibroscan) | Any OV | 17 kPa | 71, 57 | |||
| Med + OV | 19 kPa | 72, 55 | ||||
| Modified SSMb | Any OV | 50 kPa | 65, 61 | |||
| Med + OV | 54 kPa | 80, 70 | ||||
| AST:ALT ratio | Any OV | 0.8 | 69, 67 | |||
| Med + OV | 1 | 69, 72 | ||||
| APRI | Any OV | 1.5 | 67, 52 | |||
| Med + OV | 2 | 60, 56 | ||||
| Wang et al.29 2012 | Taiwan Prospective | 126 | LSM (Fibroscan) | Any OV | 12 kPa | 67, 77 |
| Med + OVc | 21 kPa | 77, 87 | ||||
| Platelet count | Any OV | 117 × 103/µL | 67, 73 | |||
| Med + OV | 110 × 103/µL | 85, 72 | ||||
| APRI | Any OV | 0.77 | 71, 67 | |||
| Med + OV | 1.24 | 85, 81 | ||||
| Kazemi et al.30 2006 | France Prospective | 165 | LSM (Fibroscan) | Any OV | 13.9 kPa | 95, 43 |
| Med + OV | 19 kPa | 90, 60 | ||||
| Castera et al.31 2009 | France Retrospective | 70 | LSM (Fibroscan) | Any OV | 21.5 kPa | 76, 78 |
| Med + OV | 30.5 kPa | 77, 85 | ||||
| Fibrotest | Any OV | 0.78 | 72, 69 | |||
| Med + OV | 0.78 | 77, 61 | ||||
| Prothrombin index | Any OV | 80% | 44, 84 | |||
| Med + OV | 80% | 62, 82 | ||||
| AST:ALT ratio | Any OV | 1 | 68, 89 | |||
| Med + OV | 1 | 69, 77 | ||||
| Lok index | Any OV | 0.6 | 68, 82 | |||
| Med + OV | 0.6 | 85, 75 | ||||
| Platelet count | Any OV | 140 × 103/µL | 56, 76 | |||
| Med + OV | 140 × 103/µL | 77, 75 | ||||
| APRI | Any OV | 1.3 | 68, 64 | |||
| Med + OV | 1.3 | 77, 60 | ||||
| Pritchett et al.32 2011 | Canada Prospective | 211 | LSM (Fibroscan) | Med + OV | 19.8 kPa | 91, 56 |
| Platelet count | Med + OV | 101 × 103/µL | 65, 77 | |||
| Burton Jr et al.33 2007 | USA Prospective | 74 | Platelet count | Med + OVd | 80 × 103/µL | 100, 87 |
| Emam et al.34 2009 | Egypt Retrospective | 70 | Regression model | Any OV | 7 | 80, 100 |
| Med + OV | 13 | 100, 92 | ||||
| Colli et al.35 2001 | Italy Prospective | 50 | U/S Dopplere | Any OV | 0.7 | 58, 85 |
| U/S Dopplerf | Any OV | 0.07 | 79, 23 | |||
| Berzigotti36 2008 | Italy Prospective | 60 | Regression model | Any OV | −1.02 | 93, 37 |
| Berzigotti37 2013 | Italy and Spain Prospective | 117g | LSPS | Any OV | 3.21 | 81, 86 |
| OV risk score | Any OV | −0.16 | 81, 86 | |||
| Liu38 2008 | Taiwan Prospective | 240h | Duplex dopplerk | Any OV | 3 | 89, 93 |
| 143i | Duplex dopplerk | Any OV | 3 | 95, 94 | ||
| 383j | Duplex dopplerk | Any OV | 3 | 92, 93 | ||
| Takuma39 2013, Japan | Japan Prospective | 226 | SSM (ARFI) | Any OV | 3.18 m/s | 98, 63 |
| Med + OVc | 3.3 m/s | 98, 67 | ||||
| Lisotti40 2014 | Italy Prospective | 96 | ICG-r15 | Any OV | <10% | 98, 52 |
| Any OV | ≥22.9% | 54, 90 | ||||
| Med + OV | <13.3% | 100, 42 | ||||
| Med + OV | ≥22.9% | 58, 73 |
Homeostasis model assessment-insulin resistance = fasting insulin (µU/mL) × fasting glucose (mmol/L)/22.5); AST to platelet ratio index = (AST/upper limit of normal)/platelets × 100; Fibrotest = 4.467 × log [α2-macroglobulin (g/L)] − 1.357 × log [haptoglobin (g/L)] + 1.017 × log [γ-glutamyl transpeptidase (IU/L)] + 0.0281 × (age (in years)) + 1.737 × log [bilirubin (µmol/L)] − 1.184 × [apolipoprotein A1 (g/L)] + 0.301 × sex (female = 0, male = 1) − 5.540; Prothrombin index = (Prothrombin time control plasma/prothrombin time patient plasma) × 100. Lok index: log odds = − 5.56 − 0.0089 × platelets (103/mm3) + 1.26 × (AST/ALT) + 5.27 × INR. OV risk score = − 4.364 + 0.538 × spleen diameter − 0.049 × platelet count − 0.044 × LS + 0.001 × (LS × platelet count).
ALT: alanine aminotransferase; APRI: AST to platelet ratio index; ARFI: acoustic radiation force impulse; AST: aspartate aminotransferase; HOMA-IR: homeostasis model assessment-Insulin resistance; ICG-r15: indocyanine green 15-minute retention; LS: liver stiffness; LSM: liver stiffness measurement; LSPS ratio: liver stiffness measurement × spleen diameter/platelet count; Med+: medium/large as defined by classification system used in each study; No. of pts: number of patients included in the 2 × 2 table; OV: oesophageal varices; PSR: platelet count/spleen diameter ratio; Se, sensitivity (%); Sp: specificity (%); SSM: spleen stiffness measurement; U/S: ultrasound international normalised ratio.
Italy, Austria and USA.
Fibroscan using a modified software version with a range between 1.5 and 150 kPa.
Included grade I with high-risk stigmata for bleeding or any grade II or III OV.
Medium or grade II varices were classified as small in this study.
Renal resistive index.
Portal congestive index.
Training cohort, data for validation cohort not extractable.
Training cohort.
Validation cohort.
All cohort.
Spleno-portal index.
Table 2.
Baseline characteristics of patients included in the systematic review and meta-analysis.
| Study author/year | Country | Mean age, years | % male | Aetiology % (cause) | Prevalence any OV (med+) |
|---|---|---|---|---|---|
| Giannini et al.20 2003 | Italy | n/s | n/s | n/s | 45 |
| Giannini et al.21 2006 | Multicentrea | n/s | n/s | n/s | 34 |
| Camma et al.22 2009 | Italy | 61.4 | 57.7 | 100 (HCV) | 61 (10) |
| Agha et al.23 2009 | Pakistan | n/s | n/s | 100 (HCV) | 26 |
| Abu El-Makarem et al.24 2011 | Egypt | n/s | n/s | 100 (HCV) | 30 |
| Esmat and Rashid25 2011 | Egypt | n/s | n/s | 100 (HCV) | 45 |
| Colecchia et al.26 2012 | Italy | 54 | 71 | 100 (HCV) | 53 (26) |
| Mangone et al.27 2012 | Italy | 62.8 | 58.6 | 63 (HCV), 11 (HBV), 8 (alcohol), 18 (otherb) | 36 (10) |
| Calvaruso et al.28 2013 | Italy | 63.2 | 69.8 | 100 (HCV) | 56 (27) |
| Wang et al.29 2012 | Taiwan | 54.5 | 73.8 | 100 (HBV) | 38 (10) |
| Kazemi et al.30 2006 | France | 56 | 67 | 59 (HCV), 10 (HBV), 22 (alcohol), 9 (other) | 45 (29) |
| Castera et al.31 2009 | France | 54.1 | 60 | 100 (HCV) | 36 (19) |
| Pritchett et al.32 2011 | Canada | 53.3 | 72 | 73 (HCV), 9 (HBV), 14 (alcohol), 5 (other) | n/s (37) |
| Burton Jr et al.33 2007 | USA | n/s | n/s | n/s | 56 (9) |
| Emam et al.34 2009 | Egypt | 43.5 | 55.7 | n/s | 64 (29) |
| Colli et al.35 2001 | Italy | 49.8 | 76 | 45 (HCV), 36 (alcohol), 11 (HH), 8 (other) | 48 |
| Berzigotti36 2008 | Italy | 60.1 | 58.3 | 80 (HCV), 12 (alcohol), 8 (other) | 47 (13) |
| Berzigotti37 2013 | Italy/Spain | 60 | 70.1 | 67 (HCV), 9 (HBV), 14 (alcohol), 8 (other) | 32 (12) |
| Liu38 2008 | Taiwan | 59c | 59.6 | 55 (HCV), 28 (HBV), 5 (alcohol), 11 (other) | 43 |
| 58d | 63.6 | 50 (HCV), 36 (HBV), 6 (alcohol), 8 (other) | 43 | ||
| Takuma39 2013 | Japan | n/s | n/s | n/s | 27 |
| Lisotti40 2014 | Italy | 60.3 | 69.7 | 59 (HCV), 14 (HBV), 20 (alcohol), 7 (other) | 48 (13) |
HBV: hepatitis B virus; HCV: hepatitis C virus; med+: medium/large; n/s: not stated; OV: oesophageal varices.
Italy, Austria and USA.
Other includes non-alcoholic fatty liver disease, mixed viral and alcohol, cryptogenic and hereditary haemochromatosis.
Training cohort.
Validation cohort.
Diagnostic tests identified
Platelet count/spleen diameter ratio
Nine studies (n = 823 patients)20–28 evaluated platelet count/spleen diameter ration (PSR) for the diagnosis of any size OV in patients with compensated cirrhosis. The pooled sensitivity and specificity were 0.87 (95% CI 0.83–0.90) and 0.71 (95% CI 0.67–0.75), respectively (Figure 2 and Table 3). The summary AUC was 0.85 (95% CI 0.78–0.92) (supplementary Figure 1). Only one study evaluated the accuracy of PSR for the detection of medium/large OV.28 There was evidence of significant heterogeneity between studies, and subgroup analyses (supplementary Table 3) identified study location as the only significant source of heterogeneity (DOR: western = 8.8 (95% CI 3.8–20.0) versus non-western = 255.9 (95% CI 33.4–1962.4); p = 0.0130). No evidence of significant publication bias was detected (p = 0.88).
Figure 2.
Forest plots of studies evaluating the sensitivity (top) and specificity (bottom) of platelet count/spleen diameter ratio for the diagnosis of any size oesophageal varices in patients with compensated cirrhosis. * indicates studies using 909 cut-off. CI: confidence interval; df: degrees of freedom.
Table 3.
Random effects meta-analysis results of studies reporting the diagnostic accuracy of currently available markers for the detection of oesophageal varices in patients with compensated cirrhosis.
| Test | Outcome | N | Se | I 2 | Sp | I 2 | LR+ | LR− | Summary AUC |
|---|---|---|---|---|---|---|---|---|---|
| PSR | Any OV | 9 | 0.87 (0.83–0.90) | 93 | 0.71 (0.67–0.75) | 92 | 3.1 (1.9–5.2) | 0.18 (0.09–0.4) | 0.85 (0.78–0.92) |
| LSM | Any OV | 5 | 0.83 (0.77–0.87) | 87 | 0.60 (0.54–0.65) | 88 | 2.2 (1.6–3.0) | 0.28 (0.16–0.5) | 0.78 (0.73–0.83) |
| Med + OV | 5 | 0.87 (0.81–0.91) | 48 | 0.67 (0.63–0.71) | 91 | 2.7 (1.9–3.8) | 0.25 (0.15–0.4) | 0.85 (0.80–0.90) | |
| Platelet count | Any OV | 3 | 0.65 (0.54–0.75) | 18 | 0.72 (0.64–0.79) | 12 | 2.3 (1.7–3.1) | 0.50 (0.12–0.3) | 0.76 (0.71–0.81) |
| Med + OV | 4 | 0.70 (0.61–0.79) | 58 | 0.77 (0.72–0.81) | 50 | 3.4 (2.5–4.8) | 0.37 (0.22–0.6) | 0.83 (0.80–0.86) | |
| SSMa | Any OV | 3 | 0.88 (0.82–0.92) | 95 | 0.64 (0.57–0.70) | 0 | 2.4 (1.9–3.2) | 0.08 (0.0–3.2) | 0.66 (0.59–0.73) |
| APRI | Any OV | 3 | 0.69 (0.60–0.77) | 0 | 0.62 (0.55–0.70) | 18 | 1.8 (1.4–2.3) | 0.52 (0.39–0.7) | 0.77 (0.71–0.83) |
| Med + OV | 3 | 0.71 (0.57–0.83) | 24 | 0.68 (0.62–0.74) | 87 | 2.2 (1.1–4.4) | 0.43 (0.2–0.95) | 0.77 (0.53–1.0) |
Data presented as values (95% confidence interval). I2 presented as percentage. N, number of studies.
AUC: area under the curve; APRI: aspartate aminotransferase (AST) to platelet ratio index; LR+: positive likelihood ratio; LR−: negative likelihood ratio; LSM: liver stiffness measurement; med+: medium/large; OV: oesophageal varices; PSR: platelet count/spleen diameter ratio; Se: sensitivity; Sp: specificity; SSM: spleen stiffness measurement.
One of the three studies used acoustic radiation force impulse technique for SSM.39
Liver stiffness measurement
Five studies (n = 553 patients) evaluated the accuracy of liver stiffness measurement (LSM) by transient elastography (Fibroscan®, Echosens, Paris, France) for the diagnosis of any size OV.26,28–31 Variable cut-offs were used (16.4, 17, 12, 13.9 and 21.5 kPa) (Table 1). The pooled sensitivity and specificity were 0.83 (95% CI 0.77–0.87) and 0.60 (95% CI 0.54–0.65), respectively (Figure 3). The summary AUC was 0.78 (95% CI 0.73–0.83) (supplementary Figure 2). Five studies (n = 664 patients) reported the accuracy of LSM for the diagnosis of medium/large OV (Table 3).28–32
Figure 3.
Forest plots of studies evaluating the sensitivity (top) and specificity (bottom) of liver stiffness measurement by transient elastography for the diagnosis of any size oesophageal varices in patients with compensated cirrhosis. CI: confidence interval; df: degrees of freedom.
Platelet count
Three studies (n = 216 patients) evaluated the accuracy of platelets count for the diagnosis of any size OV.25,29,31 Cut-offs analysed were 117, 140 and 221 ×103/µL (Table 1). The pooled sensitivity, specificity and summary AUC were 0.65 (95% CI 0.54–0.75), 0.72 (95% CI 0.64–0.79) and 0.76 (95% CI 0.71–0.81), respectively. Four studies (n = 481 patients) evaluated the accuracy of platelets count for the diagnosis of medium/large OV (Table 3).29,31–33
Spleen stiffness measurement
Three studies assessed the accuracy of spleen stiffness measurement (SSM) for the detection of any OV (n = 422 patients).26,28,39 The pooled sensitivity, specificity and summary AUC were 0.88 (95% CI 0.82–0.92), 0.64 (95% CI 0.57–0.70) and 0.66 (95% CI 0.59–0.73), respectively (Table 3). In the study by Takuma et al.,39 the acoustic radiation force impulse technique was used for SSM, while the other two studies used the Fibroscan.26,28 Two of the three studies above also reported data on accuracy for medium/large OV (Table 1).28,39
Aspartate aminotransferase to platelet ratio index
The aspartate aminotransferase to platelet ration index (APRI) test was evaluated in three studies with regards to the detection of any OV as well as medium/large OV (n = 292 patients).28,29,31 The pooled sensitivity, specificity and summary AUC for the diagnosis of any OV were 0.69 (95% CI 0.60–0.77), 0.62 (95% CI 0.55–0.70) and 0.77 (95% CI 0.71–0.83), respectively (threshold effect, –<0.001). Data for medium/large OV are shown in Table 3 (threshold effect, p < 0.001).
Other tests
Several other non-invasive tests have been evaluated with variable results (Table 1).
Clinical applicability model
PSR was the only non-invasive marker that had multiple validation studies at a consistent threshold (four studies used the 909 cut-off)20,21,23,27 (supplementary Table 3), hence included in the model. At the 909 cut-off, the pooled sensitivity, specificity, LR+ and LR− for the diagnosis of any size OV were 0.87 (95% CI 0.81–0.92), 0.78 (95% CI 0.73–0.83), 4.0 (95% CI 1.9–7.8) and 0.16 (95% CI 0.02–0.71), respectively (supplementary Table 3). These values were applied to five different hypothetical cohorts with prevalence rates for any size OV at 10, 20, 30, 40 and 50%. The proportions of correctly saved endoscopies (true negative) were 70, 62, 55, 47 and 39%, respectively, while the proportions of incorrectly saved endoscopies (false negative) in those five cohorts were 1, 2.5, 4, 5 and 6%, respectively (Figure 4). Results of all Fagan’s plots are shown in supplementary Figure 3.
Figure 4.
Bar chart representation of the proportion of endoscopies saved in a cohort of patients with compensated cirrhosis undergoing pre-screening test with platelet count/spleen diameter ratio at a cut-off of 909.
*Example calculation: at a prevalence of 30% for OV = 30% with ‘disease’ and 70% with ‘no disease’, therefore TP = sensitivity (0.87) *prevalence (30%) = 26% and the remaining 4% are FN. Similarly, TN = specificity (0.78) *1 − prevalence (70%) = 55% and the remaining 15% are FP. Hence, correctly saved = TN = 55%; incorrectly saved = FN = 4%; and performed = TP + FP = 26% + 15% = 41%. Based on Fagan’s nomogram (top image), the post-test probability of a negative test is 6.4% (6.4% of those who test negative (TN + FN) will have the disease, i.e. FN), so FN = 0.064 × (55% + 4%) = 4%.
FN: false negative; FP: false positive; LR: likelihood ratio; OV: oesophageal varices; post prob.: post-test probability; PSR: platelet count/spleen diameter ratio; TN: true negative; TP: true positive.
Discussion
Principal findings
This is the first comprehensive systematic review (including 2471 patients) and meta-analysis (including 1695 patients) of all non-invasive diagnostic tests for the detection of OV in patients with compensated cirrhosis using the same methodology. The vast majority of studies were published within the last decade, which highlights the recent and ongoing search for alternative pathways to improve the effectiveness of screening in this low-risk group with cirrhosis. Focusing on tests included in the meta-analysis, PSR was the most frequently evaluated with nine studies in total,20–28 followed by LSM (five studies),26,28–31 platelet count (five studies),25,29,31–33 SSM (three studies)26,28,39 and APRI (three studies).28,29,31 For the diagnosis of any size OV across all cut-offs, PSR had the highest summary AUC compared to other tests (0.85; 95% CI 0.78–0.92), while the accuracy of LSM was higher than platelet count and APRI for the detection of medium/large OV (summary AUC 0.85; 95% CI 0.80–0.90) (Table 3).
Pooled data on the performance of the aforementioned tests represent a global summary of test accuracy based on current literature. However, these values have limited inference and cannot be adopted into clinical practice due to the variation in cut-offs used for each test. We tested PSR at the single 909 threshold, validated by multiple studies, within a clinical applicability model. We demonstrated that a significant proportion of OGDs could be saved ranging from 39–70% dependent on the prevalence of OV with a respective range of 50–10%. This provides encouraging evidence that existing non-invasive markers could be adopted into clinical practice. Our data suggest that the benefits of PSR become less evident in the context of high prevalence of OV (50% or higher), which is more likely to occur in decompensated cirrhosis.3
Study strengths and limitations
This systematic review and meta-analysis had several strengths. We only evaluated patients with compensated cirrhosis as defined by the Baveno IV criteria.41 It is now recognized that the development of diagnostic tests and prognostic models should be specific to each clinical status (compensated versus decompensated), because treatment aims and outcomes are different in those two groups of patients.41 Some studies reported data on patients with compensated cirrhosis as a subgroup within the main article. In order not to miss such studies, our search strategy was designed to be inclusive of all patients with cirrhosis regardless of their compensation status; therefore, we reviewed a large number (n = 185) of manuscripts in full to identify the eligible 21 studies that were included in this review. Moreover, we evaluated all currently available tests in the literature and obtained pooled data for some of the tests using the same methodology, hence, this enables direct comparisons between the tests’ global accuracy to be made rather than relying on indirect comparisons from individual meta-analyses that use different methodologies and inclusion/exclusion criteria. Finally, we presented a tangible outcome measure using a clinical applicability model to estimate the potential reduction in unnecessary screening endoscopies by adopting a non-invasive marker into the OV testing algorithm.
There are also several limitations that need to be considered when interpreting the results. As with most diagnostic accuracy meta-analyses,11 we observed high heterogeneity across studies evaluating PSR, LSM and SSM. In case of PSR, this could be explained based on the location where the study was performed, but in case of other markers, subgroup analyses were not performed due to the small number of studies available. There may be several possible explanations for heterogeneity including study-, patient- or test-related factors (supplementary Table 2). Variation in diagnostic thresholds used for the same test could be an important source of heterogeneity. We accounted for this in our analysis and found no evidence of a significant threshold effect in cases of PSR, LSM and SSM studies (p-value > 0.05 for all analyses), but not in cases of platelet count and APRI studies (p < 0.001). This may raise doubts regarding the validity of pooling data from studies evaluating the latter two tests, hence these results should be interpreted with caution. Operator bias and inter-/intra-observer agreement on the diagnosis of OV are also important factors to consider, hence our primary outcome was presence of any OV (present versus absent) rather than medium/large OV, in order to minimize bias introduced by variability in classification systems used across different studies to define the size of OV.
Implications for clinical practice and areas for future research
Findings from this study have several important implications for clinical practice. We identified the currently available non-invasive markers for the detection of OV and obtained global estimates of their accuracy. Pooled data from this systematic review should be used in health economic modelling studies to evaluate the cost-effectiveness of different markers in screening for OV.
PSR was found to be the most accurate marker and its potential is enhanced by the fact that its components are readily available in clinical practice as part of standard care (i.e. platelet count and ultrasound). A criticism of PSR is the subjectivity in measurement of spleen bipolar diameter, but studies have shown the latter to be a reliable parameter with excellent reproducibility as measured by both kappa statistic and intra-class correlation coefficient.42,43
LSM by transient elastography was the second most accurate diagnostic test in this study and has validated diagnostic accuracy for the detection of cirrhosis across mixed aetiologies.44 Therefore, the advantage is that one test could be used to diagnose cirrhosis and also stratify for OV; however, the precise thresholds for diagnosing OV are yet to be defined.8,44 As highlighted by this systematic review, the range of thresholds ranged from 13.9–21.5 kPa. Transient elastography requires trained operators and has a small but significant failure rate in 3–5% of patients.45,46 Stiffness-based methods have a various proportion of non-valid results, and therefore the actual outcome of the studies that use these methods should incorporate non-valid measurements among the failures of the test.
We demonstrate that adopting PSR at the 909 cut-off into clinical practice can result in a significant (≥55%) saving of unnecessary OGDs in populations with ≤ 30% prevalence for OV. This will reduce the cost of screening and focus efforts on the remaining patients who require an OGD (PSR-test positive) by, for instance, allocating them to more specialist lists operated by endoscopists with expertise in diagnosis and management. The major clinical consequence of misdiagnosis is to fail to detect OV that could bleed in the future. The false negative percentage in compensated cirrhosis was in the range of 1–6% (Figure 4), and it is important to note that not all of these would require prophylaxis with either band ligation or pharmacological therapy in the context of early compensated cirrhosis (i.e. primary prophylaxis is currently recommended for medium/large OV in this cohort).1 In contrast, the percentage of false negative tests will rise in decompensated cirrhosis (as illustrated by the relationship between the incorrectly saved OGDs and prevalence of OV in Figure 4), and the consequences of missing OV will be more significant as mortality and morbidity are higher in this cohort.9 This gives further credence to the concept of stratifying compensated versus decompensated cirrhosis before applying a diagnostic test for OV.
Conclusions
Several non-invasive markers have been evaluated to screen for OV in patients with compensated cirrhosis. PSR appears to be the most accurate in detecting any size OV compared to other tests. It is also the most frequently studied test with promising clinical applicability. Based on current estimates, initial screening with PSR at a cut-off of 909 can result in correctly saving unnecessary endoscopies in a significant proportion of patients. This benefit is highest and the risk of missing OV is lowest with lower prevalence rates for the target condition in the tested population. Prospective validation studies, including randomized controlled trials, are needed to confirm these findings and assess the impact of these diagnostic interventions on robust end-points such as the number of variceal bleeds or deaths prevented by using one testing strategy compared to another.
Supplemental Material
Supplemental material for Non-invasive tests for the detection of oesophageal varices in compensated cirrhosis: systematic review and meta-analysis by Sarmed S. Sami, David Harman, Krish Ragunath, Dankmar Böhning, Julie Parkes and Indra Neil Guha in United European Gastroenterology Journal
Acknowledgements
None.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
S. S. Sami is funded by an Olympus-Core National Endoscopy Research Fellowship grant, Core charity, United Kingdom. No other source of funding was required for this study.
Ethics approval
Ethical approval was not required for this study
Informed consent
Informed consent was not required for this study.
References
- 1.de Franchis R, Baveno VF. Revising consensus in portal hypertension: Report of the Baveno V consensus workshop on methodology of diagnosis and therapy in portal hypertension. J Hepatol 2010; 53: 762–768. [DOI] [PubMed] [Google Scholar]
- 2.D’Amico G. Esophageal varices: From appearance to rupture; natural history and prognostic indicators. In: Groszmann RJ, Bosch J. (eds). Portal Hypertension in the 21st Century, Dordrecht: Springer, 2004, pp. 147–154. [Google Scholar]
- 3.Kovalak M, Lake J, Mattek N, et al. Endoscopic screening for varices in cirrhotic patients: Data from a national endoscopic database. Gastrointest Endosc 2007; 65: 82–88. [DOI] [PubMed] [Google Scholar]
- 4.Abraham NS, Fallone CA, Mayrand S, et al. Sedation versus no sedation in the performance of diagnostic upper gastrointestinal endoscopy: A Canadian randomized controlled cost-outcome study. Am J Gastroenterol 2004; 99: 1692–1699. [DOI] [PubMed] [Google Scholar]
- 5.Spiegel BM, Targownik L, Dulai GS, et al. Endoscopic screening for esophageal varices in cirrhosis: Is it ever cost effective? Hepatology 2003; 37: 366–377. [DOI] [PubMed] [Google Scholar]
- 6.Ying L, Lin X, Xie ZL, et al. Performance of platelet count/spleen diameter ratio for diagnosis of esophageal varices in cirrhosis: a meta-analysis. Dig Dis Sci 2012; 57: 1672–1681. [DOI] [PubMed] [Google Scholar]
- 7.Singh S, Eaton JE, Murad MH, et al. Accuracy of spleen stiffness measurement in detection of esophageal varices in patients with chronic liver disease: Systematic review and meta-analysis. Clin Gastroenterol Hepatol 2014; 12: 935–945. [DOI] [PubMed] [Google Scholar]
- 8.Shi KQ, Fan YC, Pan ZZ, et al. Transient elastography: a meta-analysis of diagnostic accuracy in evaluation of portal hypertension in chronic liver disease. Liver Int 2013; 33: 62–71. [DOI] [PubMed] [Google Scholar]
- 9.Fleming KM, Aithal GP, Card TR, et al. The rate of decompensation and clinical progression of disease in people with cirrhosis: A cohort study. Aliment Pharmacol Ther 2010; 32: 1343–1350. [DOI] [PubMed] [Google Scholar]
- 10.Chou R, Wasson N. Blood tests to diagnose fibrosis or cirrhosis in patients with chronic hepatitis C virus infection: A systematic review. Ann Intern Med 2013; 158: 807–820. [DOI] [PubMed] [Google Scholar]
- 11.Deeks JJ, Bossuyt PM, Gatsonis C. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 1.0.0, London: The Cochrane Collaboration, 2009. [Google Scholar]
- 12.Heidelbaugh JJ, Bruderly M. Cirrhosis and chronic liver failure: Part I. Diagnosis and evaluation. Am Fam Physician 2006; 74: 756–762. [PubMed] [Google Scholar]
- 13.Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011; 155: 529–536. [DOI] [PubMed] [Google Scholar]
- 14.DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986; 7: 177–188. [DOI] [PubMed] [Google Scholar]
- 15.Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports: A new meta-analytic method. Med Decis Making 1993; 13: 313–321. [DOI] [PubMed] [Google Scholar]
- 16.Roulot D, Costes JL, Buyck JF, et al. Transient elastography as a screening tool for liver fibrosis and cirrhosis in a community-based population aged over 45 years. Gut 2011; 60: 977–984. [DOI] [PubMed] [Google Scholar]
- 17.Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ 2003; 327: 557–560. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Egger M, Davey Smith G, Schneider M, et al. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315: 629–634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Sterne JA, Sutton AJ, Ioannidis JP, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 2011; 343: d4002–d4002. [DOI] [PubMed] [Google Scholar]
- 20.Giannini E, Botta F, Borro P, et al. Platelet count/spleen diameter ratio: Proposal and validation of a non-invasive parameter to predict the presence of oesophageal varices in patients with liver cirrhosis. Gut 2003; 52: 1200–1205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Giannini EG, Zaman A, Kreil A, et al. Platelet count/spleen diameter ratio for the noninvasive diagnosis of esophageal varices: Results of a multicenter, prospective, validation study. Am J Gastroenterol 2006; 101: 2511–2519. [DOI] [PubMed] [Google Scholar]
- 22.Camma C, Petta S, Di Marco V, et al. Insulin resistance is a risk factor for esophageal varices in hepatitis C virus cirrhosis. Hepatology 2009; 49: 195–203. [DOI] [PubMed] [Google Scholar]
- 23.Agha A, Anwar E, Bashir K, et al. External validation of the platelet count/spleen diameter ratio for the diagnosis of esophageal varices in hepatitis C virus-related cirrhosis. Dig Dis Sci 2009; 54: 654–660. [DOI] [PubMed] [Google Scholar]
- 24.Abu El Makarem MA, Shatat ME, Shaker Y, et al. Platelet count/bipolar spleen diameter ratio for the prediction of esophageal varices: The special Egyptian situation: Noninvasive prediction of esophageal varices. Hep Mon 2011; 11: 278–284. [PMC free article] [PubMed] [Google Scholar]
- 25.Esmat S, Rashid L. A comparative study between three noninvasive predictors of oesophageal varices in post hepatitis C virus liver cirrhosis in Egypt. Acta Gastroenterol Belg 2011; 74: 497–502. [PubMed] [Google Scholar]
- 26.Colecchia A, Montrone L, Scaioli E, et al. Measurement of spleen stiffness to evaluate portal hypertension and the presence of esophageal varices in patients with HCV-related cirrhosis. Gastroenterology 2012; 143: 646–654. [DOI] [PubMed] [Google Scholar]
- 27.Mangone M, Moretti A, Alivernini F, et al. Platelet count/spleen diameter ratio for non-invasive diagnosis of oesophageal varices: is it useful in compensated cirrhosis? Dig Liver Dis 2012; 44: 504–507. [DOI] [PubMed] [Google Scholar]
- 28.Calvaruso V, Bronte F, Conte E, et al. Modified spleen stiffness measurement by transient elastography is associated with presence of large oesophageal varices in patients with compensated hepatitis C virus cirrhosis. J Viral Hepat 2013; 20: 867–874. [DOI] [PubMed] [Google Scholar]
- 29.Wang JH, Chuah SK, Lu SN, et al. Transient elastography and simple blood markers in the diagnosis of esophageal varices for compensated patients with hepatitis B virus-related cirrhosis. J Gastroenterol Hepatol 2012; 27: 1213–1218. [DOI] [PubMed] [Google Scholar]
- 30.Kazemi F, Kettaneh A, N’Kontchou G, et al. Liver stiffness measurement selects patients with cirrhosis at risk of bearing large oesophageal varices. J Hepatol 2006; 45: 230–235. [DOI] [PubMed] [Google Scholar]
- 31.Castera L, Bail BL, Roudot-Thoraval F, et al. Early detection in routine clinical practice of cirrhosis and oesophageal varices in chronic hepatitis C: Comparison of transient elastography (FibroScan) with standard laboratory tests and non-invasive scores. J Hepatol 2009; 50: 59–68. [DOI] [PubMed] [Google Scholar]
- 32.Pritchett S, Cardenas A, Manning D, et al. The optimal cut-off for predicting large oesophageal varices using transient elastography is disease specific. J Viral Hepat 2011; 18: e75–e80. [DOI] [PubMed] [Google Scholar]
- 33.Burton JR, Liangpunsakul S, Lapidus J, et al. Validation of a multivariate model predicting presence and size of varices. J Clin Gastroenterol 2007; 41: 609–615. [DOI] [PubMed] [Google Scholar]
- 34.Emam E, Ramadan A, Badway M, et al. Prediction of oesophageal varices in patients with compensated cirrhosis: A novel scoring system. Arab J Gastroenterol 2009; 10: 129–134. [Google Scholar]
- 35.Colli A, Fraquelli M, Pometta R, et al. Renovascular impedance and esophageal varices in patients with Child-Pugh class A cirrhosis. Radiology 2001; 219: 712–715. [DOI] [PubMed] [Google Scholar]
- 36.Berzigotti A, Gilabert R, Abraldes JG, et al. Noninvasive prediction of clinically significant portal hypertension and esophageal varices in patients with compensated liver cirrhosis. Am J Gastroenterol 2008; 103: 1159–67. [DOI] [PubMed]
- 37.Berzigotti A, Seijo S, Arena U, et al. Elastography, spleen size, and platelet count identify portal hypertension in patients with compensated cirrhosis. Gastroenterology 2013; 144: 102–11. [DOI] [PubMed]
- 38.Liu CH, Hsu SJ, Liang CC, et al. Esophageal varices: noninvasive diagnosis with duplex Doppler US in patients with compensated cirrhosis. Radiology 2008; 248: 132–9. [DOI] [PubMed]
- 39.Takuma Y, Nouso K, Morimoto Y, et al. Measurement of spleen stiffness by acoustic radiation force impulse imaging identifies cirrhotic patients with esophageal varices. Gastroenterology 2013; 144: 92–101. [DOI] [PubMed]
- 40.Lisotti A, Azzaroli F, Buonfiglioli F, et al. Indocyanine green retention test as a noninvasive marker of portal hypertension and esophageal varices in compensated liver cirrhosis. Hepatology 2014; 59: 643–50. [DOI] [PubMed]
- 41.de Franchis R. Evolving consensus in portal hypertension. Report of the Baveno IV consensus workshop on methodology of diagnosis and therapy in portal hypertension. J Hepatol 2005; 43: 167–76. [DOI] [PubMed]
- 42.Sebastianes PM, Sales DM, Santos J-EM, et al. Interobserver variability of ultrasound parameters in portal hypertension. Memórias do Instituto Oswaldo Cruz 2010; 105: 409–13. [DOI] [PubMed]
- 43.Winkfield B, Aube C, Burtin P and Cales P. Inter-observer and intra-observer variability in hepatology. Eur J Gastroenterol Hepatol 2003; 15: 959–66. [DOI] [PubMed]
- 44.Friedrich-Rust M, Ong MF, Martens S, et al. Performance of transient elastography for the staging of liver fibrosis: a meta-analysis. Gastroenterology 2008; 134: 960–74. [DOI] [PubMed]
- 45.Foucher J, Castera L, Bernard PH, et al. Prevalence and factors associated with failure of liver stiffness measurement using FibroScan in a prospective study of 2114 examinations. Eur J Gastroenterol Hepatol 2006; 18: 411–2. [DOI] [PubMed]
- 46.Ji D, Shao Q, Han P, et al. The frequency and determinants of liver stiffness measurement failure: a retrospective study of “real-life” 38,464 examinations. PLoS One 2014; 9: e105183. [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplemental material for Non-invasive tests for the detection of oesophageal varices in compensated cirrhosis: systematic review and meta-analysis by Sarmed S. Sami, David Harman, Krish Ragunath, Dankmar Böhning, Julie Parkes and Indra Neil Guha in United European Gastroenterology Journal




