Abstract
Computed Tomography derived Fractional Flow Reserve (CTFFR) is an emerging non-invasive imaging modality to assess functional significance of coronary stenosis. We performed a meta-analysis to compare the diagnostic performance of CTFFR to invasive Fractional Flow reserve (FFR). Electronic search was performed to identify relevant articles. Pooled Estimates of sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR−) and diagnostic odds ratio (DOR) with corresponding 95% confidence intervals (CI) were calculated at the patient level as well as the individual vessel level using hierarchical logistic regression, summary receiver operating characteristic (SROC) curve and area under the curve were estimated. Our search yielded 559 articles and of these 17 studies was included in the analysis. A total of 2,191 vessels in 1294 patients were analyzed. Pooled estimates of sensitivity, specificity, LR+, LR− and DOR with corresponding 95% CI at per-patient level were 83% (79–87), 72% (68–76), 3.0 (2.6–3.5), 0.23 (0.18–0.29) and 13 (9–18) respectively. Pooled estimates of sensitivity, specificity, LR+, LR− and DOR with corresponding 95% CI at per-vessel level were 85% (83–88), 76% (74–79), 3.6 (3.3–4.0), 0.19 (0.16–0.22) and 19 (15–24). The area under the SROC curve was 0.89 for both per patient level and at the per vessel level. In our meta-analysis, CTFFR demonstrated good diagnostic performance in identifying functionally significant coronary artery stenosis compared to the FFR.
Introduction
Coronary computed tomography angiography (CCTA) is a non-invasive imaging test to evaluate the burden of coronary artery disease (CAD) and has a high sensitivity and diagnostic accuracy in excluding obstructive CAD in low to intermediate risk patients1,2. However, CCTA has low specificity and has low positive predictive value for determining the functional significance of the lesions identified and remains a fundamental weakness of this test3. Less than half of the obstructive lesions identified by CCTA were associated with functional ischemia upon evaluation by invasive coronary angiography (ICA)4–6. This therefore may lead to unnecessary invasive coronary angiography (ICA) and/or additional unnecessary testing7,8.
Invasive assessment of the functional significance of the coronary stenosis is evaluated using fractional flow reserve (FFR). Several randomized control trials have demonstrated the clinical utility and long-term mortality benefit using FFR-guided revascularization, which has been adapted widely in clinical practice9–13. more recent studies have demonstrated that FFR could be estimated from the CCTA study using novel iteration techniques and can determine the functional significance of coronary stenotic lesions14. The CT guided FFR (CTFFR) approach utilizes application of computational fluid dynamics to CCTA images to determine the functional severity of the lesions15,16. CTFFR estimates virtual hyperemia across a lesion by using computational flow modeling without the need for vasodilator agents17. Several studies have reported feasibility and diagnostic performance of CTFFR14,18–33. We performed this meta-analysis to compare the diagnostic performance of CTFFR in comparison to the gold standard FFR.
Results
Eligible studies
Our search yielded 559 articles with relevant publications. Most publications were not relevant for the meta-analysis given the use of a broad search strategy. After exclusion of duplicates, 452 articles remained and further 366 articles were excluded based on the review of title and the abstract. After final review and application of inclusion and exclusion criteria, seventeen studies were included in the analysis. Figure 1 details our exclusive search results and the exclusion process.
Of the seventeen studies that were included, four were multicenter prospective studies14,18–20, six were single center prospective studies24,26–28,30,33 and seven were single-center retrospective studies21–23,25,29,31,32. Eight studies reported diagnostic accuracy of CTFFR on a per-patient basis and 17 studies reported on an individual vessel level basis. Study and baseline characteristics are detailed in Tables 1 and S1. Individual study estimates of diagnostic accuracy of CTFFR to identify ischemia-causing lesions are detailed in Supplementary Table S2 for per-patient level, while Supplementary Table S3 details per-vessel diagnostic accuracy results. The overall quality of included studies per quality assessment of diagnostic accuracy studies tool (QUADAS-2) was good (Supplementary Figs S1–S3).
Table 1.
Author | Year | Number of Patients | Number of lesions/vessels | Age (Yrs.) (Mean ± SD) | Male % | Cut off Value | |||
---|---|---|---|---|---|---|---|---|---|
Total | Total | Mean | SD | FFR | FFR(CT) | ||||
Koo14 | Multicenter prospective | 2011 | 103 | 159 | 62.7 | 9 | 72 | <0.8 | <0.8 |
Min18 | Multicenter prospective | 2012 | 252 | 407 | 62.9 | 9 | 71 | <0.8 | <0.8 |
Norgaard19 | Multicenter prospective | 2014 | 254 | 484 | 64 | 10 | 64 | <0.8 | <0.8 |
Kim20 | Multicenter retrospective | 2014 | 44 | 48 | 65 | 9 | 80 | <0.8 | <0.8 |
Renker21 | Single-center retrospective | 2014 | 53 | 67 | 61.2 | 12 | 64 | <0.8 | <0.8 |
Coenen22 | Single-center retrospective | 2015 | 106 | 189 | 61.4 | 9 | 77 | <0.8 | <0.8 |
De Geer23 | Single-center retrospective | 2015 | 21 | 23 | 60 | 40–74 | 52.4 | <0.8 | <0.8 |
Kruk24 | Single-center Prospective | 2016 | 90 | 96 | 63.4 | 8 | 32 | <0.8 | <0.8 |
Zhang25 | Single-center Retrospective | 2016 | 21 | 32 | 52 | 10 | 76 | <0.8 | <0.8 |
Gaur26 | Single-center Prospective | 2017 | 60 | 124 | 61 | 10 | 83 | <0.8 | <0.8 |
Kawaji27 | Single-center Prospective | 2017 | 43 | 70 | 70.8 | 8 | 65 | <0.8 | <0.8 |
Ko28 | Single-center Prospective | 2017 | 30 | 56 | 60 | 9 | 70 | <0.8 | <0.8 |
Kurata29 | Single-center Retrospective | 2017 | 21 | 29 | 69.6 | 9 | 76 | <0.8 | <0.8 |
Osawa30 | Single-center Prospective | 2017 | 20 | 26 | 73 | 8 | 80 | <0.8 | <0.8 |
Packard31 | Single-center Retrospective | 2017 | 75 | 207 | 66 | 10 | 75 | <0.8 | <0.8 |
Shi32 | Single-center Retrospective | 2017 | 29 | 36 | 68.1 | 8 | 55.2 | <0.8 | <0.8 |
Yang33 | Single-center Prospective | 2017 | 72 | 138 | 62.7 | 9 | 89 | <0.8 | <0.8 |
Data Synthesis
Our study included a total of 17 studies with 1,294 patients. Among the 1,294 patients, a total of 2,191 individual vessels were assessed using FFR and CTFFR. The FFR was chosen as the gold standard and the results of CTFFR as expressed in reference to the FFR.
Patient Level Analysis
The pooled estimates of sensitivity and specificity for CTFFR were 83% (95% CI: 79–87) and 72% (95% CI: 68–76), respectively (Fig. 2 and Table 2). The positive likelihood ratio (LR+), negative likelihood ratio (LR−) and diagnostic odds ratio (DOR) for CTFFR with respect to FFR were 3.0 (95% CI: 2.6–3.5), 0.23 (95% CI: 0.18–0.29) and 13% (95% CI: 9–18), respectively (Table 2). The area under the curve of the summary receiver operating characteristic curve (SROC) for CTFFR was 0.89 (95% CI 0.83–0.94) demonstrating good fit (Fig. 3).
Table 2.
Analysis Level | No. of Studies | Combined Data | Sensitivity | Specificity | LR+ | LR− | DOR |
---|---|---|---|---|---|---|---|
Per-patient | 8 | 1294 | 83% (79–87)* | 72% (68–76) | 3.0 (2.6–3.5) | 0.23 (0.18–0.29) | 13 (9–18) |
Per-vessel | 17 | 2191 | 85% (83–88) | 76% (74–79) | 3.6 (3.3–4.0) | 0.19 (0.16–0.22) | 19 (15–24) |
LR+ = positive likelihood ratio; LR− = negative likelihood ratio; DOR = diagnostic odds ratio; *Numbers in parentheses are 95% confidence intervals (CIs).
Individual Coronary Vessel Level Analysis
The pooled estimates of sensitivity and specificity for CTFFR with respect to FFR on an individual vessel level analyses were 85% (95% CI 83–88) and 76% (95% CI 74–79), respectively (Figs 4, 5 and Table 2). The LR+, LR− and DOR were 3.6 (95% CI 3.3–4.0), 0.19 (95% CI 0.16–0.22) and 19 (95% CI 15–24) (Supplementary Table S3). The area under the curve at the individual vessel level analysis of the SROC for the CTFFR was 0.89 (95% 0.86–0.93) suggesting good diagnostic accuracy compared to FFR (Fig. 6).
Further, posterior estimation using Bayes Nomogram was performed. At the patient level analysis using a pre-test probability of disease of 25%, a positive result on CTFFR would increase the likelihood of disease to 53%, whereas a negative test would decrease the likelihood of disease to 5% (Supplementary Fig. S4). When individual vessel level analysis was repeated, the results were similar (Supplementary Fig. S5). This therefore suggests a very high negative predictive value for exclusion of hemodynamically significant stenosis with CTFFR.
Publication bias
Assessment for publication bias was performed using Deek’s funnel plot asymmetry test. There was no evidence of publication bias at both per patient (p = 0.48) and per vessel level (p = 0.86) analyses. However, given the low sensitivity of the Deek’s funnel plot as well as the small number of studies included in this meta-analysis, publication bias cannot be absolutely eliminated.
Meta-regression
Multivariate meta-regression analysis was performed at per-patient level and per-vessel level for the covariates including study design, sample size (less or more than 100), year of publication, region of study, quality of study, method of CTFFR appraisal, prevalence of CAD, proportion of hypertensive patients, proportion of diabetic patients, proportion of smokers and proportion of patients with dyslipidemia to identify potential sources of heterogeneity (Supplementary Table S4). These exploratory variables were not found to have a significant impact on the heterogeneity of the results at both patient level as well as individual vessel level (Supplementary Table S5).
Discussion
The results of our meta-analysis suggest that CTFFR has good diagnostic accuracy in detecting functionally significant coronary stenosis when compared to the FFR. These findings remained consistent at both per-patient and per-vessel level analysis.
CCTA is useful for noninvasive assessment of CAD in stable ischemic heart disease, as well as in patients with acute onset chest pain and acute coronary syndromes34–36. Studies have demonstrated its clinical utility and prognostic value in patients with suspected CAD with a very high negative predictive value37. However, CCTA overestimates the severity of stenotic lesions with only a minority of identified lesions being functionally ischemic therefore leading to increased utilization of ICA4,38,39. Thus, the management of obstructive lesions identified on CCTA remains challenging40, resulting in low positive predictive value. In the cardiac catheterization lab, the functional significance of a stenotic lesion in the coronary arteries has been evaluated using instantaneous wave free ratio (iFR) and or FFR. The FFR technique requires induction of coronary hyperemia with adenosine, but the iFR technique does not need induction of coronary hyperemia41. These tests have been well validated and the new hybrid algorithm using iFR and FFR has been adapted in several catheterization laboratories across the United States41. Depending on the functional significance of the lesion, immediate revascularization of the stenotic lesion or deferred revascularization with medical treatment strategies could be adopted13,42,43. However, these techniques require an invasive approach and the peri-procedural complications associated with such an approach are not trivial. Also, ICA could result in unnecessary hospitalization and additional costs to the patient.
The ideal alternative would therefore be a non-imaging test that could assess the functional significance of a coronary stenotic lesion. The CTFFR was therefore proposed as a test to determine the functional significance of coronary lesions by use of computational fluid dynamics to the CCTA images15,16. Using multiplanar imaging and computer software, virtual hyperemia and computation modeling could be performed to estimate the functional significance of the lesions using CTFFR approach17. Calculation of CTFFR involves three main elements: physiological modeling of blood flow along with anatomical modeling of coronary arteries, and solution of governing equations of blood flow using numerical methods16. Since CCTA images are obtained during resting conditions, reducing resting microcirculatory resistance in the computational model simulates hyperemic response leading to computation of CTFFR17. As diseased and healthy vessels adapt to the amount of blood flow they carry, microcirculatory resistance is modeled. The luminal area of the feeding coronary artery is inversely proportional to the resistance of the vessel17,44,45. CTFFR therefore offers several advantages in terms of obviating the need for vasodilator administration, altering of the CCTA protocols or the need for additional radiation beyond what is normally expected during acquiring of CCTA images46.
In our meta-analysis, we observed that the CTFFR performed very well compared to the FFR in diagnosing functional significance of coronary stenosis and more importantly affords a very high negative predictive value to the test as seen on the Bayes nomogram. However, the studies did not report outcomes data and therefore at this time it is unclear if CTFFR strategy could result in improved prognosis by deferring coronary angiography and potentially revascularization. But it is clear from the results of our analysis that CTFFR offers more information than the traditional CCTA alone.
More recently, post hoc analysis based on hypothetical simulations of outcomes to assess clinicoeconomical effectiveness of using CTFFR to guide clinical decision making were reported47,48. Hlatky et al., projected that the patient stratified by CTFFR to undergo ICA and PCI had 30% lower costs and 12% fewer events at 1 year compared to the patients undergoing ICA with visually guided PCI47. In the other study by Kimura et al., a projected cost savings of 32% and 19% fewer adverse cardiac events were observed using a similar strategy as Hlatky et al.48. Further, Kim et al., demonstrated the improvement in diagnostic accuracy of CTFFR in identifying ischemic lesions by virtual coronary stenting using advanced computational models20. In the Prospective Longitudinal Trial of FFRCT: Outcomes and Resource Impacts (PLATFORM) study, the patients in the CTFFR arm had 32% lower costs of utilization but similar QOL scores in comparison to patients in ICA arm at 90 days49.
There are limitations to both the CTFFR and FFR techniques. In the CTFFR technique, artifacts induced from patient motion, blooming artifact from coronary calcification and insignificant contrast enhancement may limit the validity of the results50. In the case of FFR, procedural technique, the dose of vasodilator agent used to induce maximal hyperemia, distal microvascular resistance of the coronary arteries and high left ventricular end diastolic pressures can affect the results. Therefore, adequate attention to the patient’s clinical presentation and symptoms should also be factored in prior to proceeding with revascularization in addition to the above techniques.
Our study has several limitations. The studies included were few and had a small number of patients which decreases the robustness of the findings. Since, this is a meta-analysis all the weaknesses inherent to the individual studies will be inherited to our study. The included studies were published over a period of 5 years and there could have been alterations to the protocols in the study as well as improvements to the imaging and software algorithms that could contribute to the heterogeneity among the studies. Further, there could be inter-observed and intra-observer variability in interpreting the findings on these respective tests. Also, the dose of adenosine infused to induce coronary hyperemia could be variable among different centers across which these studies were performed contributing to varying findings among the studies. All the studies excluded patients with bypass grafts and therefore our results are not applicable to these patients. Lastly, publication bias although was tested and excluded could contribute to the findings of our study.
Materials and Methods
Data sources and searches
An extensive electronic search of Cochrane, SCOPUS and PubMed databases was performed for relevant articles using the following search terms: “computed tomography”, “CT angiography”, “computed tomography angiography”, “fractional flow reserve”, “FFR”, “fractional flow reserve, myocardial”. The search was restricted to publications in English and the final search was performed on April 2017.
Study Selection
The following inclusion criteria were applied: (1) Age of the study population >18 yrs.; (2) CTFFR being the index test; (3) Design of the study being a diagnostic accuracy study; (4) FFR was chosen as the reference standard; (5) Data must allow construction of two-by-two contingency table. In case of multiple studies published from the same institution, the study reporting the highest number of subjects was included and the remaining studies were excluded from the final analysis.
Data extraction and quality assessment
The initial search was performed independently by two reviewers and studies were selected for inclusion by mutual consensus. In case of disagreement, a third reviewer resolved disagreements between reviewers through discussion to achieve a consensus. Once the studies were selected for inclusion, the data was screened to meet the inclusion criteria and thereafter the following data points were extracted: true positive (TP), true negative (TN), false positive (FP) and false negative (FN). Additionally, cumulative demographic variables of patients included in the study were also extracted. We then performed meta-analysis at both the patient and the individual vessel levels. The quality of included studies was assessed using QUADAS-2 tool51.
Data synthesis and Analysis
Continuous variables are presented as mean values and categorical data as percentages. The analysis of diagnostic performance of CTFFR was performed at both patient and individual vessel levels. We estimated the pooled sensitivity and specificity. In addition, negative predictive value (NPV), positive predictive value (PPV), LR+, LR− and DOR with respective 95% confidence intervals were performed. A weighted average of the pooled data on per-patient or per-vessel level was performed using bivariate random effects model52. The summary estimates with their 95% confidence intervals (CI) were calculated after anti-logit transformation of the mean logit sensitivity and specificity and respective standard errors. Statistical heterogeneity was defined as I2 statistic value greater than 50%53. The summary receiver operating characteristic curve (SROC) was derived using the logit estimates of sensitivity, specificity and their respective variances. This was then used to construct a hierarchical SROC curve and the area under the curve (AUC) estimated. An AUC range of 0.75–0.92 was considered to have good degree of diagnostic accuracy and an AUC range of 0.93–0.96 was considered to be a very good diagnostic test54. Publication bias was visually assessed using Deek’s funnel plot. The Deek’s funnel plot utilizes regression of diagnostic log odd’s ratio against 1/square root (effective sample size) and further weighting by effective sample size. A p-value of the slope coefficient of <0.10 indicated asymmetry and thereby publication bias55.
Meta-regression analysis was performed to identify potential sources of heterogeneity. We performed meta-regression for covariates including study design, sample size (less or more than 100), year of publication, region of study, quality of study, method of CTFFR appraisal, prevalence of coronary artery disease, proportion of hypertensive patients, proportion of diabetic patients, proportion of smokers and proportion of patients with dyslipidemia to identify potential sources of heterogeneity. Further, post-estimation models using Bayes methods were performed to compute the post-test likelihood of presence or absence of disease using a pre-test likelihood of having disease of 25%. This meta-analysis was performed in compliance with the Meta-analysis of Observational Studies in Epidemiology and the quality of reporting for meta-analysis and Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines56,57. All the above analyses were performed in R, version 3.4.3, using “mada” package. The calculations for AUC and its confidence interval were performed using MetaDiSc version 1.4.
Conclusion
The results of our study suggest that CTFFR has a good diagnostic accuracy and performs well in comparison to the FFR in the assessment of functional significance of the coronary stenotic lesions. The CTFFR technique is still evolving and needs further evaluation with assessment of clinical outcomes prior to widespread clinical adaptation.
Electronic supplementary material
Author Contributions
P.A. and A.K. contributed equally to the work. P.A. and A.K. designed the study and wrote the manuscript. P.A., V.Y. and A.K. downloaded and analyzed the data. V.Y., O.E. and C.K. prepared the tables and figures and reviewed the manuscript. R.S. and R.Z. reviewed and revised the manuscript.
Competing Interests
The authors declare no competing interests.
Footnotes
Electronic supplementary material
Supplementary information accompanies this paper at 10.1038/s41598-018-29910-9.
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.De Cecco CN, et al. Coronary artery computed tomography scanning. Circulation. 2014;129:1341–1345. doi: 10.1161/CIRCULATIONAHA.113.002835. [DOI] [PubMed] [Google Scholar]
- 2.Min JK, Shaw LJ, Berman DS. The present state of coronary computed tomography angiography a process in evolution. Journal of the American College of Cardiology. 2010;55:957–965. doi: 10.1016/j.jacc.2009.08.087. [DOI] [PubMed] [Google Scholar]
- 3.Tamarappoo BK, et al. Assessment of the relationship between stenosis severity and distribution of coronary artery stenoses on multislice computed tomographic angiography and myocardial ischemia detected by single photon emission computed tomography. Journal of nuclear cardiology: official publication of the American Society of Nuclear Cardiology. 2010;17:791–802. doi: 10.1007/s12350-010-9230-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Meijboom WB, et al. Comprehensive assessment of coronary artery stenoses: computed tomography coronary angiography versus conventional coronary angiography and correlation with fractional flow reserve in patients with stable angina. Journal of the American College of Cardiology. 2008;52:636–643. doi: 10.1016/j.jacc.2008.05.024. [DOI] [PubMed] [Google Scholar]
- 5.Schuijf JD, Bax JJ. CT angiography: an alternative to nuclear perfusion imaging? Heart (British Cardiac Society) 2008;94:255–257. doi: 10.1136/hrt.2006.105833. [DOI] [PubMed] [Google Scholar]
- 6.Moscariello A, et al. Coronary CT angiography versus conventional cardiac angiography for therapeutic decision making in patients with high likelihood of coronary artery disease. Radiology. 2012;265:385–392. doi: 10.1148/radiol.12112426. [DOI] [PubMed] [Google Scholar]
- 7.Lauer MS. CT angiography: first things first. Circulation. Cardiovascular imaging. 2009;2:1–3. doi: 10.1161/CIRCIMAGING.108.841429. [DOI] [PubMed] [Google Scholar]
- 8.Hachamovitch R, Di Carli MF. Methods and limitations of assessing new noninvasive tests: part I: Anatomy-based validation of noninvasive testing. Circulation. 2008;117:2684–2690. doi: 10.1161/CIRCULATIONAHA.107.708586. [DOI] [PubMed] [Google Scholar]
- 9.Tonino PA, et al. Fractional flow reserve versus angiography for guiding percutaneous coronary intervention. The New England journal of medicine. 2009;360:213–224. doi: 10.1056/NEJMoa0807611. [DOI] [PubMed] [Google Scholar]
- 10.De Bruyne B, et al. Fractional flow reserve-guided PCI versus medical therapy in stable coronary disease. The New England journal of medicine. 2012;367:991–1001. doi: 10.1056/NEJMoa1205361. [DOI] [PubMed] [Google Scholar]
- 11.Park SJ, et al. Trends in the outcomes of percutaneous coronary intervention with the routine incorporation of fractional flow reserve in real practice. European heart journal. 2013;34:3353–3361. doi: 10.1093/eurheartj/eht404. [DOI] [PubMed] [Google Scholar]
- 12.Li J, et al. Long-term outcomes of fractional flow reserve-guided vs. angiography-guided percutaneous coronary intervention in contemporary practice. European heart journal. 2013;34:1375–1383. doi: 10.1093/eurheartj/eht005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.van Nunen LX, et al. Fractional flow reserve versus angiography for guidance of PCI in patients with multivessel coronary artery disease (FAME): 5-year follow-up of a randomised controlled trial. Lancet (London, England) 2015;386:1853–1860. doi: 10.1016/S0140-6736(15)00057-4. [DOI] [PubMed] [Google Scholar]
- 14.Koo BK, et al. Diagnosis of ischemia-causing coronary stenoses by noninvasive fractional flow reserve computed from coronary computed tomographic angiograms. Results from the prospective multicenter DISCOVER-FLOW (Diagnosis of Ischemia-Causing Stenoses Obtained Via Noninvasive Fractional Flow Reserve) study. Journal of the American College of Cardiology. 2011;58:1989–1997. doi: 10.1016/j.jacc.2011.06.066. [DOI] [PubMed] [Google Scholar]
- 15.Kim HJ, et al. Patient-specific modeling of blood flow and pressure in human coronary arteries. Annals of biomedical engineering. 2010;38:3195–3209. doi: 10.1007/s10439-010-0083-6. [DOI] [PubMed] [Google Scholar]
- 16.Taylor CA, Fonte TA, Min JK. Computational fluid dynamics applied to cardiac computed tomography for noninvasive quantification of fractional flow reserve: scientific basis. Journal of the American College of Cardiology. 2013;61:2233–2241. doi: 10.1016/j.jacc.2012.11.083. [DOI] [PubMed] [Google Scholar]
- 17.Nakanishi R, Budoff MJ. Noninvasive FFR derived from coronary CT angiography in the management of coronary artery disease: technology and clinical update. Vasc Health Risk Manag. 2016;12:269–278. doi: 10.2147/VHRM.S79632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Min JK, et al. Diagnostic accuracy of fractional flow reserve from anatomic CT angiography. Jama. 2012;308:1237–1245. doi: 10.1001/2012.jama.11274. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Norgaard BL, et al. Diagnostic performance of noninvasive fractional flow reserve derived from coronary computed tomography angiography in suspected coronary artery disease: the NXT trial (Analysis of Coronary Blood Flow Using CT Angiography: Next Steps) Journal of the American College of Cardiology. 2014;63:1145–1155. doi: 10.1016/j.jacc.2013.11.043. [DOI] [PubMed] [Google Scholar]
- 20.Kim KH, et al. A novel noninvasive technology for treatment planning using virtual coronary stenting and computed tomography-derived computed fractional flow reserve. JACC. Cardiovascular interventions. 2014;7:72–78. doi: 10.1016/j.jcin.2013.05.024. [DOI] [PubMed] [Google Scholar]
- 21.Renker M, et al. Comparison of diagnostic value of a novel noninvasive coronary computed tomography angiography method versus standard coronary angiography for assessing fractional flow reserve. The American journal of cardiology. 2014;114:1303–1308. doi: 10.1016/j.amjcard.2014.07.064. [DOI] [PubMed] [Google Scholar]
- 22.Coenen A, et al. Fractional flow reserve computed from noninvasive CT angiography data: diagnostic performance of an on-site clinician-operated computational fluid dynamics algorithm. Radiology. 2015;274:674–683. doi: 10.1148/radiol.14140992. [DOI] [PubMed] [Google Scholar]
- 23.De Geer J, et al. Software-based on-site estimation of fractional flow reserve using standard coronary CT angiography data. Acta radiologica (Stockholm, Sweden: 1987) 2016;57:1186–1192. doi: 10.1177/0284185115622075. [DOI] [PubMed] [Google Scholar]
- 24.Kruk M, et al. Workstation-Based Calculation of CTA-Based FFR for Intermediate Stenosis. JACC. Cardiovascular imaging. 2016;9:690–699. doi: 10.1016/j.jcmg.2015.09.019. [DOI] [PubMed] [Google Scholar]
- 25.Zhang JM, et al. Simplified Models of Non-Invasive Fractional Flow Reserve Based on CT Images. Plos one. 2016;11:e0153070. doi: 10.1371/journal.pone.0153070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Gaur S, et al. FFR Derived From Coronary CT Angiography in Nonculprit Lesions of Patients With Recent STEMI. JACC. Cardiovascular imaging. 2017;10:424–433. doi: 10.1016/j.jcmg.2016.05.019. [DOI] [PubMed] [Google Scholar]
- 27.Kawaji T, et al. Feasibility and diagnostic performance of fractional flow reserve measurement derived from coronary computed tomography angiography in real clinical practice. International Journal of Cardiovascular Imaging. 2017;33:271–281. doi: 10.1007/s10554-016-0995-9. [DOI] [PubMed] [Google Scholar]
- 28.Ko, B. et al. Noninvasive CT-Derived FFR Based on Structural and Fluid Analysis. A Comparison With Invasive FFR for Detection of Functionally Significant Stenosis. JACC: cardiovascular imaging. (no pagination), 2016 Date of Publication: March 21, http://onlinelibrary.wiley.com/o/cochrane/clcentral/articles/138/CN-01301138/frame.html (2017). [DOI] [PubMed]
- 29.Kurata A, et al. The effect of blood pressure on non-invasive fractional flow reserve derived from coronary computed tomography angiography. European radiology. 2017;27:1416–1423. doi: 10.1007/s00330-016-4541-x. [DOI] [PubMed] [Google Scholar]
- 30.Osawa K, et al. Coronary lesion characteristics with mismatch between fractional flow reserve derived from CT and invasive catheterization in clinical practice. Heart and vessels. 2017;32:390–398. doi: 10.1007/s00380-016-0892-0. [DOI] [PubMed] [Google Scholar]
- 31.Packard RR, Li D, Budoff MJ, Karlsberg RP. Fractional flow reserve by computerized tomography and subsequent coronary revascularization. European heart journal cardiovascular Imaging. 2017;18:145–152. doi: 10.1093/ehjci/jew148. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Shi C, et al. A study of noninvasive fractional flow reserve derived from a simplified method based on coronary computed tomography angiography in suspected coronary artery disease. Biomed Eng Online. 2017;16:43. doi: 10.1186/s12938-017-0330-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Yang DH, et al. Diagnostic performance of on-site CT-derived fractional flow reserve versus CT perfusion. European heart journal cardiovascular Imaging. 2017;18:432–440. doi: 10.1093/ehjci/jew094. [DOI] [PubMed] [Google Scholar]
- 34.Li S, et al. Diagnostic accuracy of 320-slice computed tomography angiography for detection of coronary artery stenosis: meta-analysis. International journal of cardiology. 2013;168:2699–2705. doi: 10.1016/j.ijcard.2013.03.023. [DOI] [PubMed] [Google Scholar]
- 35.Sara L, et al. Accuracy of multidetector computed tomography for detection of coronary artery stenosis in acute coronary syndrome compared with stable coronary disease: a CORE64 multicenter trial substudy. International journal of cardiology. 2014;177:385–391. doi: 10.1016/j.ijcard.2014.08.130. [DOI] [PubMed] [Google Scholar]
- 36.Linde JJ, et al. Cardiac computed tomography guided treatment strategy in patients with recent acute-onset chest pain: results from the randomised, controlled trial: CArdiac cT in the treatment of acute CHest pain (CATCH) International journal of cardiology. 2013;168:5257–5262. doi: 10.1016/j.ijcard.2013.08.020. [DOI] [PubMed] [Google Scholar]
- 37.Al-Mallah MH, Qureshi W, Pantelic M, Nour K. Long term prognostic value of Coronary Computed Tomography Angiography in suspected coronary artery disease: a 62 month median follow-up study. International journal of cardiology. 2014;176:1244–1246. doi: 10.1016/j.ijcard.2014.07.203. [DOI] [PubMed] [Google Scholar]
- 38.Budoff MJ, et al. Diagnostic performance of 64-multidetector row coronary computed tomographic angiography for evaluation of coronary artery stenosis in individuals without known coronary artery disease: results from the prospective multicenter ACCURACY (Assessment by Coronary Computed Tomographic Angiography of Individuals Undergoing Invasive Coronary Angiography) trial. Journal of the American College of Cardiology. 2008;52:1724–1732. doi: 10.1016/j.jacc.2008.07.031. [DOI] [PubMed] [Google Scholar]
- 39.Meijboom WB, et al. Diagnostic accuracy of 64-slice computed tomography coronary angiography: a prospective, multicenter, multivendor study. Journal of the American College of Cardiology. 2008;52:2135–2144. doi: 10.1016/j.jacc.2008.08.058. [DOI] [PubMed] [Google Scholar]
- 40.Lin FY, et al. Mortality risk in symptomatic patients with nonobstructive coronary artery disease: a prospective 2-center study of 2,583 patients undergoing 64-detector row coronary computed tomographic angiography. Journal of the American College of Cardiology. 2011;58:510–519. doi: 10.1016/j.jacc.2010.11.078. [DOI] [PubMed] [Google Scholar]
- 41.Escaned J, et al. Prospective Assessment of the Diagnostic Accuracy of Instantaneous Wave-Free Ratio to Assess Coronary Stenosis Relevance: Results of ADVISE II International, Multicenter Study (ADenosine Vasodilator Independent Stenosis Evaluation II) JACC. Cardiovascular interventions. 2015;8:824–833. doi: 10.1016/j.jcin.2015.01.029. [DOI] [PubMed] [Google Scholar]
- 42.Ito T, Tani T, Fujita H, Ohte N. Relationship between fractional flow reserve and residual plaque volume and clinical outcomes after optimal drug-eluting stent implantation: insight from intravascular ultrasound volumetric analysis. International journal of cardiology. 2014;176:399–404. doi: 10.1016/j.ijcard.2014.07.115. [DOI] [PubMed] [Google Scholar]
- 43.De Bruyne B, et al. Fractional flow reserve-guided PCI for stable coronary artery disease. The New England journal of medicine. 2014;371:1208–1217. doi: 10.1056/NEJMoa1408758. [DOI] [PubMed] [Google Scholar]
- 44.Seiler C, Kirkeeide RL, Gould KL. Measurement from arteriograms of regional myocardial bed size distal to any point in the coronary vascular tree for assessing anatomic area at risk. Journal of the American College of Cardiology. 1993;21:783–797. doi: 10.1016/0735-1097(93)90113-F. [DOI] [PubMed] [Google Scholar]
- 45.Sharma P, et al. A framework for personalization of coronary flow computations during rest and hyperemia. Conference proceedings:… Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference. 2012;2012:6665–6668. doi: 10.1109/EMBC.2012.6347523. [DOI] [PubMed] [Google Scholar]
- 46.Min JK, et al. Usefulness of noninvasive fractional flow reserve computed from coronary computed tomographic angiograms for intermediate stenoses confirmed by quantitative coronary angiography. The American journal of cardiology. 2012;110:971–976. doi: 10.1016/j.amjcard.2012.05.033. [DOI] [PubMed] [Google Scholar]
- 47.Hlatky MA, et al. Projected costs and consequences of computed tomography-determined fractional flow reserve. Clinical cardiology. 2013;36:743–748. doi: 10.1002/clc.22205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Kimura T, et al. Cost analysis of non-invasive fractional flow reserve derived from coronary computed tomographic angiography in Japan. Cardiovascular intervention and therapeutics. 2015;30:38–44. doi: 10.1007/s12928-014-0285-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Hlatky MA, et al. Quality-of-Life and Economic Outcomes of Assessing Fractional Flow Reserve With Computed Tomography Angiography: PLATFORM. Journal of the American College of Cardiology. 2015;66:2315–2323. doi: 10.1016/j.jacc.2015.09.051. [DOI] [PubMed] [Google Scholar]
- 50.Baumann S, et al. Comparison of Coronary Computed Tomography Angiography-Derived vs Invasive Fractional Flow Reserve Assessment: Meta-Analysis with Subgroup Evaluation of Intermediate Stenosis. Academic radiology. 2016;23:1402–1411. doi: 10.1016/j.acra.2016.07.007. [DOI] [PubMed] [Google Scholar]
- 51.Whiting, P. F. et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies (2011). [DOI] [PubMed]
- 52.Reitsma JB, et al. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of clinical epidemiology. 2005;58:982–990. doi: 10.1016/j.jclinepi.2005.02.022. [DOI] [PubMed] [Google Scholar]
- 53.Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ (Clinical research ed.) 2003;327:557–560. doi: 10.1136/bmj.327.7414.557. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Jones CM, Athanasiou T. Summary receiver operating characteristic curve analysis techniques in the evaluation of diagnostic tests. The Annals of thoracic surgery. 2005;79:16–20. doi: 10.1016/j.athoracsur.2004.09.040. [DOI] [PubMed] [Google Scholar]
- 55.Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. Journal of clinical epidemiology. 2005;58:882–893. doi: 10.1016/j.jclinepi.2005.01.016. [DOI] [PubMed] [Google Scholar]
- 56.Liberati, A. et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration (2009). [DOI] [PMC free article] [PubMed]
- 57.Stroup, D. F. et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group (2000). [DOI] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.