Skip to main content
EuroIntervention logoLink to EuroIntervention
editorial
. 2021 May 17;17(1):18–19. doi: 10.4244/EIJV17I1A3

Can machine learned algorithms further illuminate intracoronary imaging in PCI and improve the human touch?

AI-guided image interpretation

Thomas Johnson 1,*, Peter O'Kane 2
PMCID: PMC9707524  PMID: 33998525

Intravascular optical coherence tomography (IVOCT) is a mature technology although its adoption remains limited in most regions. An international survey in 20181 observed that >50% of European respondents undertook intracoronary imaging (ICI) in <5% of patients, compared with >95% of Japanese respondents who reported imaging use in >15% of patients (the reality being that >90% of all Japanese procedures are image guided). This stark contrast may be based on reimbursement. Interestingly, however, increasing PCI experience was associated with an increased adoption of imaging. This observation is consistent with our own experience that greater adoption of ICI has highlighted significant challenges in the interpretation of the coronary angiogram. “Lumenography” cannot reliably provide effective identification of calcific or lipidic plaque. Consequently, plaque modification and stent landing-site selection are purely at the physician’s discretion. Systematic use of ICI can guide decision making, stent selection and optimisation better, with a positive impact on outcomes2. However, it is important to acknowledge that studies of image-guided intervention are challenged by operator adherence to optimisation criteria, failing in up to half of patients3. Much of this failure represents disease complexity; however, core lab analysis highlights deficiencies in operator identification of tissue components, such as external elastic lamina.

Beyond this, IVOCT characterisation of plaque components has been shown to predict future events. The CLIMA study demonstrated that the combination of a minimum lumen area <3.5 mm2, fibrous cap <75 μm, lipid arc >180° and macrophages was independently predictive of cardiac death or target segment myocardial infarction (MI) with a hazard ratio of 7.54 (95% CI: 3.1-18.6)4. Similarly, the recently presented COMBINE OCT-FFR study demonstrated that identification of thin-cap fibroatheroma, despite absence of ischaemia (FFR >0.80), was predictive of a composite of cardiac mortality, target vessel MI, clinically driven target lesion revascularisation and unstable angina at 18 months, with a hazard ratio of 4.6 (presented by Elvin Kedhi at TCT Connect 2020, October 14). Tissue components including cholesterol clefts, lipidic plaque, neovascularisation and macrophage were more commonly identified in event-prone lesions. These data suggest that plaque characterisation and identification of vulnerable plaque may facilitate targeted therapy, passifying the plaque and avoiding future events.

The challenge remains adoption of ICI during routine PCI. The EAPCI/CVIT survey identified a lack of time, cost and limited training/education as the most frequent obstacles to imaging use1. Our personal view is that the lack of education and an inability to interpret IVOCT confidently represent the greatest barrier. Consequently, harnessing artificial intelligence (AI)-guided image interpretation could transform the approach for PCI operators less experienced in image guidance who are willing to learn.

In this issue of EuroIntervention, Chu and colleagues provide validation of an automated tool for plaque characterisation in IVOCT using AI, with a processing time <25 seconds, suggesting potential real-time clinical utility5.

An AI model using a convolutional neural network was trained on a large data set of IVOCT pullbacks, undertaken in stable patients from three previous studies. Over 11,000 OCT frames were annotated by two highly experienced IVOCT analysts in order to delineate lumen contours, internal elastic lamina, non-tissue parts and plaque components, including fibrous tissue, lipidic pool or calcium, in addition to markers of plaque instability and inflammation, including macrophage, cholesterol crystals or micro-vessels. Internal evaluation of a test data set demonstrated excellent model performance with best segmentation of fibrous, followed by calcific and then lipidic plaque. Interestingly, the model struggled with detection of macrophage, with a Dice coefficient of 0.489.

Subsequently, the model was tested on an externally derived series of OCT runs. Firstly, the sample was assessed by an expert panel of IVOCT users, from three highly respected core labs. Impressively, consensus on plaque characterisation was achieved in 99% of plaque regions. Unanimous agreement was observed in 81%, most frequently for cholesterol crystals, then calcific plaque, fibrous plaque, macrophage and then lipidic plaque. Despite the limitations of characterising attenuated plaque components, diagnostic accuracy in the external validation was achieved in 86.6% of 598 tissue regions, with best identification of fibrous plaque over lipidic and then calcific plaque.

It is important to recognise that both machine and humans found interpretation of plaque components with attenuating properties most challenging. However, the inter-observer agreement for both macrophage and lipid was impressively high amongst expert users (81.8% and 73.7%, respectively). This suggests that human interpretation incorporates more than simple image recognition, instead combining the image with interpretation of the backscatter/attenuation characteristics plus association with neighbouring lipidic plaque. However, it is unlikely that this expert user interpretation of an individual OCT frame was undertaken in 0.07±0.01 seconds. Image interpretation is further enhanced by evaluating sequential frames, rather than isolated frame analysis. The AI model tested has acknowledged this fact, adopting “pseudo-3D input”.

The validation of this AI-based characterisation tool should be extended to patients presenting with acute coronary syndrome (ACS), in whom markers of vulnerability are more frequently encountered, thereby challenging the accuracy of the existing tool. Despite this, it is our “imaging-biased” opinion that this exciting technology must be harnessed to aid wider adoption of plaque characterisation, procedural decision making and subsequent optimisation of medical therapies potentially to enhance treatment for patients with coronary artery disease. Further development of AI-based plaque characterisation may be achieved through integration of additional information, including attenuation/backscatter characteristics and profiling of the patient including comorbidities, biomarkers and gene profiling.

Undoubtedly, the greatest limitations to adopting an invasive imaging strategy in routine clinical practice are lack of time, money and training1. AI provides a solution for limited time and training assuming that a probe has been wielded. Now all we need to do is to find a machine that can print money and persuade the majority of interventional cardiologists to look beyond the angiogram!

Acknowledgments

Conflict of interest statement

T. Johnson has received speaker fees and consultancy/advisory fees from Abbott Vascular, Boston Scientific and Terumo. P. O’Kane has received speaker fees from Abbott Vascular, Terumo, and Philips in the last 36 months.

Contributor Information

Thomas Johnson, Bristol Heart Institute, University Hospitals Bristol & Weston NHS Foundation Trust, Bristol, United Kingdom.

Peter O'Kane, Dorset Heart Centre, University Hospitals Dorset NHS Foundation Trust, Bournemouth, United Kingdom.

References

  1. Koskinas KC, Nakamura M, Räber L, Colleran R, Kadota K, Capodanno D, Wijns W, Akasaka T, Valgimigli M, Guagliumi G, Windecker S, Byrne RA. Current use of intracoronary imaging in interventional practice – Results of a European Association of Percutaneous Cardiovascular Interventions (EAPCI) and Japanese Association of Cardiovascular Interventions and Therapeutics (CVIT) Clinical Practice Survey. EuroIntervention. 2018;14:e474–84. doi: 10.4244/EIJY18M03_01. [DOI] [PubMed] [Google Scholar]
  2. Gao XF, Ge Z, Kong XQ, Kan J, Han L, Lu S, Tian NL, Lin S, Lu QH, Wang XY, Li QH, Liu ZZ, Chen Y, Qian XS, Wang J, Chai DY, Chen CH, Pan T, Ye F, Zhang JJ, Chen SL ULTIMATE Investigators. 3-Year Outcomes of the ULTIMATE Trial Comparing Intravascular Ultrasound Versus Angiography-Guided Drug-Eluting Stent Implantation. JACC Cardiovasc Interv. 2021;14:247–57. doi: 10.1016/j.jcin.2020.10.001. [DOI] [PubMed] [Google Scholar]
  3. Räber L, Mintz GS, Koskinas KC, Johnson TW, Holm NR, Onuma Y, Radu MD, Joner M, Yu B, Jia H, Meneveau N, de la Torre Hernandez JM, Escaned J, Hill J, Prati F, Colombo A, Di Mario C, Regar E, Capodanno D, Wijns W, Byrne RA, Guagliumi G. Clinical use of intracoronary imaging. Part 1: guidance and optimization of coronary interventions. An expert consensus document of the European Association of Percutaneous Cardiovascular Interventions. EuroIntervention. 2018;14:656–77. doi: 10.4244/EIJY18M06_01. [DOI] [PubMed] [Google Scholar]
  4. Prati F, Romagnoli E, Gatto L, La Manna A, Burzotta F, Ozaki Y, Marco V, Boi A, Fineschi M, Fabbiocchi F, Taglieri N, Niccoli G, Trani C, Versaci F, Calligaris G, Ruscica G, Di Giorgio A, Vergallo R, Albertucci M, Biondi-Zoccai G, Tamburino C, Crea F, Alfonso F, Arbustini E. Relationship between coronary plaque morphology of the left anterior descending artery and 12 months clinical outcome: the CLIMA study. Eur Heart J. 2020;41:383–91. doi: 10.1093/eurheartj/ehz520. [DOI] [PubMed] [Google Scholar]
  5. Chu M, Jia H, Gutiérrez-Chico JL, Maehara A, Ali ZA, Zeng X, He L, Zhao C, Matsumura M, Wu P, Zeng M, Kubo T, Xu B, Chen L, Yu B, Mintz GS, Wijns W, Holm NR, Tu S. Artificial intelligence and optical coherence tomography for the automatic characterisation of human atherosclerotic plaques. EuroIntervention. 2021;17:41–50. doi: 10.4244/EIJ-D-20-01355. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from EuroIntervention are provided here courtesy of Europa Group

RESOURCES