Abstract
Background
Transcatheter aortic valve implantation (TAVI) has seen indication expansion and thus exponential growth in demand over the past decade. In many jurisdictions, the growing demand has outpaced capacity, increasing wait times and preprocedural adverse events. In this study, we derived prediction models that estimate the risk of adverse events on the waitlist and developed a triage tool to identify patients who should be prioritized for TAVI.
Methods and Results
We included adult patients in Ontario, Canada referred for TAVI and followed up until one of the following events first occurred: death, TAVI procedure, removal from waitlist, or end of the observation period. We used subdistribution hazards models to find significant predictors for each of the following outcomes: (1) all‐cause death while on the waitlist; (2) all‐cause hospitalization while on the waitlist; (3) receipt of urgent TAVI; and (4) a composite outcome. The median predicted risk at 12 weeks was chosen as a threshold for a maximum acceptable risk while on the waitlist and incorporated in the triage tool to recommend individualized wait times. Of 13 128 patients, 586 died while on the waitlist, and 4343 had at least 1 hospitalization. A total of 6854 TAVIs were completed, of which 1135 were urgent procedures. We were able to create parsimonious models for each outcome that included clinically relevant predictors.
Conclusions
The Canadian TAVI Triage Tool (CAN3T) is a triage tool to assist clinicians in the prioritization of patients who should have timely access to TAVI. We anticipate that the CAN3T will be a valuable tool as it may improve equity in access to care, reduce preventable adverse events, and improve system efficiency.
Keywords: access to care, observational study, prediction model, TAVI, transcatheter aortic valve implantation, transcatheter aortic valve replacement
Subject Categories: Health Services, Ethics and Policy, Quality and Outcomes, Aortic Valve Replacement/Transcather Aortic Valve Implantation, Valvular Heart Disease
Nonstandard Abbreviations and Acronyms
- CAN3T
Canadian TAVI Triage Tool
- CIHI‐DAD
Canadian Institute for Health Information Discharge Abstract Database
- TAVI
transcatheter aortic valve implantation
Clinical Perspective.
What Is New?
The Canadian TAVI Triage Tool (CAN3T), is a tool to assist clinicians in identifying and prioritizing patients referred for transcatheter aortic valve implantation who are at higher risk for adverse events.
What Are the Clinical Implications?
The CAN3T has the potential to improve waitlist management and equity in access to care and reduce the number of unplanned procedures and adverse events.
The past decade has seen a paradigm shift in the therapeutic options for the management of severe aortic stenosis, with the emergence of transcatheter aortic valve implantation (TAVI) as an alternative to surgical aortic valve replacement. As evidence has accumulated, TAVI has become the standard of care for inoperable and high–surgical risk patients, and a reasonable alternative for intermediate– and low–surgical risk patients. 1 As a result, the demand for TAVI has grown exponentially worldwide, outpacing capacity in many jurisdictions, resulting in substantial wait times. 2 , 3 For example, in Ontario, Canada, despite a 5‐fold improvement in the penetration of TAVI in the health system, 2 , 4 median wait times worsened from 80 days in 2012 to 110 days in 2018. 5
Previous research has found that longer wait times for TAVI are associated with important adverse events such as mortality and hospitalization. 6 Not only this, the deterioration in health status that occurs from waiting translates to reduced recovery and greater mortality in the postprocedural period. 7 This is particularly true if deterioration results in a hospitalization and the need for an urgent, unplanned procedure. 8 , 9 Long wait times have detrimental health system impacts, including increases in health care costs and reductions in the availability for elective procedures. 10
The approach to long wait times requires both an increase in overall system capacity as well as proper waitlist management. Expanding system capacity increases the procedural volumes, reducing the average time patients are at risk for adverse events. 11 This, however, has been particularly challenging with system disruptions such as the COVID‐19 pandemic, which in many jurisdictions forced hospitals to halt or reduce the availability of elective procedures. 12 Risk‐stratification tools have been considered important approaches to waitlist management and can assist clinicians in triaging patients by identifying and prioritizing those at higher risk of preprocedural adverse events to reduce the negative consequences of longer wait times. 11 To date, there is a paucity of such evidence‐based tools or recommendations for waitlist management of patients referred for TAVI.
Accordingly, our goal was to address this gap in knowledge by identifying characteristics that are associated with an increased risk of adverse events while on the waitlist, derive models to predict the risk of these adverse events at different time points, and finally develop a tool (the Canadian TAVI Triage Tool [CAN3T]) that can be used by clinicians to identify high‐risk patients who should be prioritized for TAVI.
METHODS
Study Design and Setting
We conducted an observational retrospective cohort study using population‐based administrative data from Ontario, Canada, held at ICES (previously known as the Institute for Clinical Evaluative Sciences). The use of anonymized administrative data held at ICES without patient consent is permitted in Ontario based on section 45 of Ontario's Personal Health Information Protection Act, which does not require review by a research ethics board. Because of the sensitive nature of the data collected for this study, requests to access the data set from qualified researchers trained in human subject confidentiality protocols may be sent to ICES at ices.on.ca.
Data Sources
This study used the CorHealth Ontario Clinical Registry as the primary data source. Reporting to the database is mandatory in Ontario, and a requirement for provincial procedural funding. 2 The database receives demographic, comorbidity, and procedural data, and its accuracy has been previously validated by means of retrospective chart review and comparisons with other databases. 13 The CorHealth registry is linked to administrative databases held at ICES using unique, encoded identifiers. The Canadian Institute for Health Information Discharge Abstract Database (CIHI‐DAD) provided data on acute hospitalizations, complications, as well as supplemented baseline comorbidity and procedural data. Validated ICES‐derived databases were used to identify diabetes, 14 , 15 heart failure, 16 hypertension, 17 , 18 chronic obstructive pulmonary disease, 19 and dementia. 20 Medical frailty was determined using the Hospital Frailty Risk Score. 21 Comorbidities and previous cardiac procedures were identified during the period of up to 20 years before referral. Mortality was ascertained via the Registered Persons Database as were additional demographic variables such as quintile of median neighborhood income and rural residence. Details on the variable definitions can be found in Table S1.
Study Population
All Ontario residents older than 18 years were eligible for the study. The index event for inclusion was referral for TAVI, from April 1, 2012, to March 31, 2020. Patients were followed up until the first of death on the waitlist, removal from the waitlist (off‐listing), receipt of a TAVI procedure, or March 31, 2020 (the time at which patients who still remained in the waitlist were censored). For patients who had repeat TAVI during the period of the study, only the first procedure was included. Patients were excluded from the analysis if they had invalid birth, death dates, or identifiers. Patients who remained on the TAVI waitlist for longer than 1 year were also excluded (≈1.6% of patients); the rationale for this exclusion is that such patients with excessive wait times were likely referred for TAVI but did not have an indication for the procedure after evaluation from the heart team and remained on the waitlist for monitoring their clinical evolution.
Outcome Measures
The 4 primary outcomes of interest were: (1) death from any causes while on the TAVI waitlist; (2) all‐cause hospitalization while on the waitlist; (3) receipt of an urgent TAVI (defined as a TAVI procedure during an acute hospitalization); and (4) a composite outcome defined as the first of all‐cause waitlist hospitalization, death, or urgent TAVI.
Statistical Analysis
To identify predictors of adverse events on the waitlist, we used the subdistribution hazards model, also known as the Fine‐Gray model. This model allows for the estimation of the cumulative incidence function while accounting for competing risks that would preclude the occurrence of the outcome of interest. 22 , 23 Competing risks are relevant in our study as we were only interested in events during the preprocedural period, and therefore any events that resulted in removal of the patient from the waitlist must be considered in the analysis. For all‐cause death, removal from the waitlist (off‐listing) or receipt of a TAVI procedure were considered competing risks; for urgent TAVI, death or off‐listing; for all‐cause hospitalization, off‐listing or death or receipt of TAVI; and for the composite outcome, off‐listing was the only competing risk.
Model Building
To achieve a parsimonious and clinically useful model, we performed variable selection in three steps. In the first step, certain candidate variables were removed from further consideration based on an assessment of their correlations and practical considerations. Stepwise backward selection was then performed until all variables in the model had a significance level <0.05. 24 Finally, significant variables with negative coefficients were removed due to potential collider bias and no biological plausibility. 25 We did not assess linearity of the effects of continuous covariates nor did we include any interactions between covariates.
Model Performance
We assessed the discrimination and calibration of each model. To quantify the discriminative ability, we calculated the concordance statistic (C‐statistic) and the area under the receiver operating characteristic curve. At each time point of interest, random pairs of patients were compared, with one with the outcome and the other without the outcome. We used the Brier score to assess overall predictive accuracy, estimating the mean difference between the observed status and predicted probability of event at each time point; therefore, values closer to 0 indicate better performance of the model. 26 We also calculated the calibration slope. A slope closer to 1 indicates optimal calibration. 27
All performance measures and predicted risks were assessed at 14, 30, 60, and 84 days. We defined 84 days from referral (12 weeks) as a maximum wait time for any patient, as per the current Canadian Cardiovascular Society guidelines. 28
Maximum Acceptable Risk
The maximum acceptable risk is somewhat arbitrary and based on clinical expertise. Incorporating the 84‐day threshold from the guidelines, based on the distribution of predicted risks in our cohort, we defined the median risk at 84 days as a threshold for a maximum acceptable risk. Therefore, our tool will recommend that a patient have a TAVI performed in a maximum of 84 days if the predicted risk at this time is equal or lower than the threshold for maximum acceptable risk; if the predicted risk is higher than the threshold at 84 days, the tool will provide a maximum individualized wait time that should be <84 days, and is defined as the number of days at which the predicted risk reaches the threshold.
Validation
We performed internal validation of the models using bootstrapping to calculate optimism‐corrected performance measures, following the procedures described by Steyerberg. 24 A schematic of the internal validation summarizes the validation process and can be found in Figure S1.
Missing Data
Our data were mostly complete, with the exception of New York Heart Association class, of which 28.39% was missing. To utilize all available data, we performed multiple imputation using the multivariate imputation using a chained equations algorithm over 5 iterations, generating 10 complete data sets. Estimates were combined using Rubin rules. For the validation procedures, the multiple imputation was nested in the bootstrapping, ie, for each bootstrapped data set, 10 complete data sets were generated and statistics were summarized accordingly, yielding 1 estimate per bootstrapped sample. Figure S1 provides an analytical schematic of the model derivation and validation.
All analyses were conducted in the R statistical environment, version 3.6.1 (R Foundation for Statistical Computing), 29 using the packages survival, rms, riskRegression, pec, and mice. Statistical significance was defined by a 2‐sided P value <0.05.
RESULTS
Cohort
We identified 13 809 referrals for TAVI in Ontario from April 1, 2012 to March 31, 2020 in 13 380 unique patients. After excluding 41 patients with invalid identifiers, index or removal dates, and procedures performed elsewhere, 13 339 remained. Demographic and clinical characteristics of the patients are summarized in the Table. An additional 211 patients were excluded for having follow‐up times >1 year, yielding a total of 13 128 patients included in the analysis (Figure 1). Throughout the period of the study, 586 (4.46%) patients died while on the waitlist and 4343 (33.08%) had at least 1 all‐cause hospitalization. A total of 6854 TAVIs were completed (52.21% of all referrals), from which 1135 (16.56%) were urgent procedures. From the 4872 (37.1%) patients who were off‐listed, 1029 (7.84%) were rereferred for surgical aortic valve replacement and 3843 (29.27%) were off‐listed for other reasons. Possible causes for off‐listing include cancellation of the procedure, patient or physician decision to not treat the disease, decision to manage disease without invasive intervention, and decision to monitor the patient (who may be reconsidered for the procedure at a later time).
Table .
Baseline Patient Characteristics (N=13 128)
| Age, y | |
| Mean±SD | 81.0±8.3 |
| Median (IQR) | 82 (76–87) |
| Women | 5906 (45.0) |
| Rural residence | 1598 (12.2) |
| Income quintile | |
| 1 | 2631 (20.0) |
| 2 | 2832 (21.6) |
| 3 | 2668 (20.3) |
| 4 | 2424 (18.5) |
| 5 | 2539 (19.3) |
| Charlson Comorbidity Index | |
| Mean±SD | 1.4±1.8 |
| Median (IQR) | 1 (0–2) |
| NYHA class | |
| I | 1094 (11.6) |
| II | 2942 (31.3) |
| III | 4605 (49.0) |
| IV | 760 (8.1) |
| Congestive heart failure | 7096 (54.0) |
| Cardiac/atrial arrhythmia | 2321 (17.7) |
| Peripheral vascular disease | 342 (2.6) |
| Cerebrovascular disease | 545 (4.1) |
| COPD | 4528 (34.5) |
| Cognitive impairment/dementia | 989 (7.5) |
| Cancer | 864 (6.6) |
| Dialysis | 442 (3.4) |
| Interstitial lung disease* | 133 (1.0) |
| Liver disease | 231 (1.8) |
| Renal disease | 883 (6.7) |
| Diabetes | 5736 (43.7) |
| Hypertension | 11 945 (91.0) |
| Dyslipidemia | 7426 (56.6) |
| Hospital Frailty Risk Score | |
| Mean±SD | 2.6±4.6 |
| Median (IQR) | 0 (0–3.4) |
| Prior stroke | 306 (2.3) |
| Coronary artery/ischemic heart disease | 4931 (37.6) |
| Previous CABG | 2025 (15.4) |
| Previous PCI | 2241 (17.1) |
| Previous valve surgery† | 1140 (8.7) |
| Previous pacemaker (includes CRT‐P) | 1076 (8.2) |
| Previous ICD (includes CRT‐D) | 201 (1.5) |
| Fiscal year of referral | |
| 2012 | 408 (3.1) |
| 2013 | 883 (6.7) |
| 2014 | 1252 (9.5) |
| 2015 | 1492 (11.4) |
| 2016 | 1679 (12.8) |
| 2017 | 1945 (14.8) |
| 2018 | 2265 (17.2) |
| 2019 | 3204 (24.41) |
| Wait time, d | |
| Mean±SD | 97.1±79.7 |
| Median (IQR) | 78 (32–143) |
| Death | 586 (4.5) |
| All‐cause hospitalization | 4343 (33.1) |
| Urgent TAVI | 1135 (8.6) |
| Elective TAVI | 5719 (43.6) |
| Off‐listed | 4872 (37.1) |
| Censored | 816 (6.2) |
Values are expressed as number (percentage) unless otherwise indicated. CABG indicates coronary artery bypass graft; COPD, chronic obstructive pulmonary disease; CRT‐D, cardiac resynchronization therapy defibrillator; CRT‐P, cardiac resynchronization therapy pacemaker; IQR, interquartile range; NYHA, New York Heart Association; PCI, percutaneous coronary intervention; and TAVI, transcatheter aortic valve implantation.
Includes pulmonary fibrosis.
Includes aortic, mitral, tricuspid, and pulmonary valves.
Figure 1. Cohort flow diagram.

TAVI indicates transcatheter aortic valve implantation.
Table S2 summarizes patients' characteristics by waitlist outcomes. In general, patients who were off‐listed and rereferred to surgical aortic valve replacement were the healthiest of the cohort. Patients who died on the waitlist or underwent urgent TAVI were more likely to have congestive heart failure, those who died on the waitlist were more likely to be undergoing dialysis, and those who underwent urgent TAVI had more likely undergone previous valve surgery.
Model Building
After an initial assessment, we removed the Charlson Comorbidity Index as it was correlated with many other variables. Prior stroke and dialysis were also removed because they had similar definitions and therefore correlated with cerebrovascular disease and renal disease, respectively. The remaining variables were included for stepwise backward selection (Figure S3; Table S3). Dyslipidemia and previous pacemaker were removed for having negative coefficients. The final models are presented in Figure 2, and baseline cumulative incidence function for selected time points are shown in Table S4.
Figure 2. Final subdistribution hazards models.

COPD indicates chronic obstructive pulmonary disease; NYHA, New York Heart Association; PCI, percutaneous coronary intervention; and TAVI, transcatheter aortic valve implantation.
For all‐cause death, the final model included frailty, sex, age, congestive heart failure, chronic obstructive pulmonary disease, liver disease, renal disease, and interstitial lung disease. The urgent TAVI model included New York Heart Association class, congestive heart failure, coronary artery or ischemic heart disease, previous percutaneous coronary intervention, and valve disease. The all‐cause hospitalization model included frailty, sex, New York Heart Association class, age, diabetes, congestive heart failure, chronic obstructive pulmonary disease, liver disease, coronary artery or ischemic heart disease, and previous valve surgery. Finally, for the composite outcome, the same variables were used as in the hospitalization, with the addition of renal disease.
All variables retained in the final models were also present in >50% of the models derived in bootstrap samples (Figures S2 and S3).
Model Performance
Apparent and corrected performance measures can be found in Table S5. At 84 days, optimism‐corrected C statistics varied from 0.63 (95% CI, 0.62–0.64) focomposite outcome) to 0.71 (95% CI, 0.69–0.74) (urgent TAVI) (Figure S4), area under the curve varied from 0.66 (95% CI, 0.63–0.69) (death) to 0.71 (95% CI, 0.69–0.73) (urgent TAVI), and Brier scores varied from 0.02 (death) to 0.19 (composite outcome) (Figure S5). The calibration slopes varied from 0.79 (death) to 0.99 (urgent TAVI).
Predicted Risks
The distribution and quantiles of predicted risks at 84 days in our cohort can be found in Table S6 and Figure S6. In the full cohort, 586 patients (4.46%) died on the waitlist, with predicted risks at 84 days ranging from 0.58% to 27.55% and a median of 2.5%; 1135 patients (8.65%) underwent an urgent TAVI within 84 days, with predicted risks ranging from 1.82% to 46.93% and a median of 7.77%; and 4343 patients (33.08%) were hospitalized within 84 days on the waitlist, with predicted risks ranging from 9.26% to 69.33% and a median of 28.25%.
In terms of the composite outcome at 84 days, 4559 patients (34.73%) experienced the composite outcome, with predicted risks ranging from 8.93% to 73.16% and a median of 27.92%.
Based on the median predicted risk at 84 days in our cohort, the thresholds for a maximum acceptable risk were as follows: for all‐cause death it was 2.5%, for urgent TAVI, 7.77%; for all‐cause hospitalization, 28.25%; and for the composite outcome, 27.92%. As an example, if a patient has a predicted risk of death that reaches this maximum acceptable risk of 2.5% at 60 days, the tool will recommend that the patient should wait no longer than 60 days to undergo TAVI. If, in contrast, a patient has a predicted risk of death that does not reach 2.5% within 84 days, the tool will recommend that the patient wait no longer than 12 weeks for the procedure, in accordance with current Canadian guidelines.
DISCUSSION
This study described the development and validation of the CAN3T, an online tool that can be used to assist waitlist management for patients referred for TAVI in the identification of patients at high risk for preprocedural adverse events. We followed best practices recommended for the development and validation of clinical prediction models, 30 using a representative registry, including a thorough assessment of the data, incorporating subject matter in the model specification process, and using validated methods to deal with missing data and for internal validation.
To date, there is no prioritization system developed specifically for TAVI. Similar clinical tools designed for prioritization of patients on waitlists have successfully improved waitlist management and patient outcomes. A clinical priority system designed in New Zealand, prioritizing patients for valve surgery and coronary artery bypass graft by severity of symptoms, showed an 80% reduction in preprocedural deaths, 31 and a recently implemented prioritization framework for elective procedures in England has shown improvements in data quality and management of the waitlists. 32 Notwithstanding, only few studies have systematically assessed the effectiveness of prioritization tools thus far. 33 The CAN3T has the potential to improve patient outcomes, avoiding the occurrence of preventable preprocedural hospitalizations and deaths, and consequently improving system efficiency with fewer urgent procedures and shorter procedural length of stay.
Many characteristics have emerged as important predictors of adverse events on the TAVI waitlist. Unsurprisingly, a history of congestive heart failure was a significant risk factor for all outcomes with a substantial impact. Among the candidate comorbidities, frailty, chronic obstructive pulmonary disease, liver disease, renal disease, and coronary/ischemic heart disease were predictors of most of the adverse events; from the previous cardiac procedures, valve surgery was the most commonly significant predictor. Only a few studies have also investigated risk factors for preprocedural outcomes in different cohorts of patients referred for TAVI: Popovic and colleagues concluded that EuroSCORE, body mass index, and frailty indices do have prognostic value both for the pre‐ and the post‐TAVI period, 34 and Shimura et al identified New York Heart Association class, frailty, prior coronary artery bypass graft, pulmonary disease, albumin, creatinine, and hemoglobin as predictors of mortality after referral for TAVI. 35 Our study is broadly consistent with this previous work; however, it is important to emphasize that our models were developed for clinical predictions and not to assess causal relationships between the risk factors and outcomes. Therefore, our findings should not be used as evidence to confirm or exclude any risk factors for the events we were interested in making predictions for.
Most available risk stratification tools developed to triage patients classify patients into risk categories. We expand on this approach by presenting a novel paradigm for waitlist management that does not attempt to classify patients but instead incorporates the deterioration in health that occurs while patients wait for a procedure. The CAN3T was designed to be used by the heart team during the postreferral assessment, and answers the question of how long a patient referred for TAVI can wait until their risk of an adverse event becomes excessive, in a very flexible way as patients nor the maximum wait times are categorized. Acknowledging that there is no consensus on what can be considered an excessive risk of an adverse event, and that this definition may change within a specific setting, we incorporated this as a modifiable parameter in our tool. We also provide the predicted risk at different meaningful time points so the clinician can understand better how these risks increase with time (Figure 3). Another feature of the CAN3T is the inclusion of different adverse events, allowing the user to choose 1 outcome they may find more suitable or relevant to their setting. Alternatively, all outcomes may also be used to inform prioritization; in this case, the maximum recommended wait time for TAVI would be the earliest time when any of the outcomes reach the risk thresholds.
Figure 3. The Canadian TAVI Triage Tool (CAN3T) online tool.

TAVI indicates transcatheter aortic valve implantation.
We believe this flexibility of the tool is an attractive feature as different programs may have a different patient profile or different eligibility criteria for the procedure, and these particularities can be considered when defining which outcomes or threshold values will be used to triage patients. Indeed, the lack of flexibility in prioritization tools has been cited as a barrier to their use and acceptance by clinicians. 33
Our study must be interpreted in the context of some limitations that merit discussion. First, despite the use of a large data set, our models build on data from Ontario only, which performs ≈45% of all TAVIs in Canada, 2 thus limiting the generalizability of the tool to other contexts. Another important limitation of the CAN3T tool was its moderate performance, with C statistics that ranged from 0.63 to 0.75, and which will inevitably be lower in any external population. Dynamic models incorporating changes after referral and time‐covariate interactions could possibly have improved performance; however, they would require much more data and constant retriage of the patient after the initial triage, which may be a barrier for implementation of the tool.
The difficulty in achieving optimal performance has been an issue in other prediction models derived in TAVI cohorts, and 1 of the possible causes is the fact that this population is older and with many comorbidities, which makes it difficult to distinguish adverse events caused by aortic stenosis itself. 36 On the other hand, the complex relationship between comorbidities, symptoms, and severity of aortic stenosis justifies the potential value of less‐specific outcomes in clinical decision‐making for the patient with AS. In the current study, we only collected data for all‐cause hospitalization and death, and we acknowledge that not having cause‐specific outcomes is a limitation of this study as some admissions and deaths may not be related to AS and thus not preventable by earlier TAVI. However, we believe that it is possible that models with cause‐specific and all‐cause outcomes have comparable performances, and we plan to explore this in future studies.
Arguably, the clinical utility of a prediction model (its ability to change clinical decision‐making) is more important than an optimal performance, and we believe this is the case for the CAN3T. Despite its moderate performance, the tool can be an important ally to identify patients who would benefit from being prioritized for TAVI, specifically when we consider that there is no such tool yet available for this purpose. Such value is also greater in a period when many health systems face unprecedented long wait times after the COVID‐19 pandemic, 37 during which many of health care resources for elective procedures such as TAVI had to be reallocated for the management of patients with COVID‐19.
An additional issue that may impact the performance of the CAN3T is the dynamism of the TAVI landscape. During the past decade we have seen an expansion of indication for TAVI to lower surgical risk in patients, as well as improvements in the technology and procedure, consequently affecting the patient profile and risk prediction. 36 , 38 Our models were built on data collected over 8 years, a period that encompasses much of this evolution. To explore possible temporal changes in our cohort throughout these 8 years, we observed the median time to event per fiscal year (Figure S7) and applied our models to calculate, for each outcome, the median risk per fiscal year of referral (Figure S8). For time to event, no clear trend was observed from 2012 to 2016, followed by a decreasing trend between 2017 and 2019. As for the median predicted risks, we did observe a reduction after 2014, which is compatible with the expansion of TAVI from higher to lower surgical risk groups. Although we acknowledge that including a more diverse population to derive our models may affect their internal validity, incorporating this diversity may be beneficial for their external validity. These temporal changes, added to the effects of the COVID‐19 pandemic, may impact the performance of our models in the future and will be the object of examination in future studies.
The use of data from a pre‐COVID period may also be seen as a limitation, but this decision was based on research findings demonstrating that disruptions caused by the pandemic led to reductions in detection, referrals, and cardiovascular procedures, affecting wait times, patient profile, and incidence of adverse events 39 , 40 ; we therefore believe that data from the pre‐COVID period is more representative of the population and generalizable to other settings.
The CAN3T is publicly available and can be accessed at https://sunnybrook.ca/CAN3T. As future steps of this work, our group plans on performing studies to assess different aspects of the clinical utility of the tool, such as cluster randomized trials, prospective observational studies, and model‐based simulations. These studies will allow us to investigate some of the complexities involved in the adoption of triage tools into routine clinical practice. 41 With dissemination of the tool, experiences from institutions will be used to inform future updates. We also plan on externally validating the models using TAVI registries from other Canadian provinces.
CONCLUSIONS
The CAN3T is a triage tool developed to assist the clinician in the prioritization of patients who should have timely access to TAVI. It was derived from a population‐level registry, using validated methods, and has moderate discrimination. User feedback and external validation of the models in a different population may not only improve its performance and generalizability but also incorporate changes in patient profile that occur within the dynamic TAVI landscape. We anticipate the CAN3T to be a valuable support tool for patients and clinicians, with the potential of bringing meaningful changes to the health system as it improves equity in access to care, reduces preventable adverse events, and improves system efficiency.
Sources of Funding
Dr Wijeysundera is supported by the Canada Research Chairs Program. Dr Madan is supported by the Heart and Stroke Foundation of Canada.
Disclosures
None.
Supporting information
Acknowledgments
This study was supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH) and the Ministry of Long‐Term Care (MLTC). Parts of this material are based on data and information compiled and provided by the Canadian Institutes for Health Information (CIHI) and CorHealth Ontario. The analyses, conclusions, opinions, and statements expressed herein are solely those of the authors and do not reflect those of the funding or data sources; no endorsement is intended or should be inferred. Parts of this material are based on data or information compiled and provided by CIHI. However, the analyses, conclusions, opinions, and statements expressed in the material are those of the authors, and not necessarily those of CIHI. The authors acknowledge that the clinical registry data used in this publication are from participating hospitals through CorHealth Ontario, which serves as an advisory body to the MOH, is funded by the MOH, and is dedicated to improving the quality, efficiency, access, and equity in the delivery of the continuum of adult cardiac, vascular, and stroke services in Ontario, Canada.
This article was sent to Amgad Mentias, MD, Associate Editor, for review by expert referees, editorial decision, and final disposition.
Supplemental Material is available at https://www.ahajournals.org/doi/suppl/10.1161/JAHA.123.033768
For Sources of Funding and Disclosures, see page 9.
References
- 1. Ontario Health (Quality) . Transcatheter aortic valve implantation in patients with severe aortic valve stenosis at low surgical risk: a health technology assessment. Ont Health Technol Assess Ser. 2020;20:1–148. [PMC free article] [PubMed] [Google Scholar]
- 2. CCS TAVI Quality Working Group . National Quality Report: Transcatheter Aortic Valve Implantation. Canadian Cardiovascular Society; 2019. [Google Scholar]
- 3. Ali N, Faour A, Rawlins J, Dawkins S, Appleby CE, MacCarthy P, Byrne J, Trivedi U, Curzen N, Banning AP, et al. “Valve for life”: tackling the deficit in transcatheter treatment of heart valve disease in the UK. Open Heart. 2021;8:e001547. doi: 10.1136/openhrt-2020-001547 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Miranda RN, Qiu F, Manoragavan R, Fremes S, Lauck S, Sun L, Tarola C, Tam DY, Mamas M, Wijeysundera HC. Drivers and outcomes of variation in surgical versus transcatheter aortic valve replacement in Ontario, Canada: a population‐based study. Open Heart. 2022;9:e001881. doi: 10.1136/openhrt-2021-001881 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Albassam O, Henning KA, Qiu F, Cram P, Sheth TN, Ko DT, Woodward G, Austin PC, Wijeysundera HC. Increasing wait‐time mortality for severe aortic stenosis: a population‐level study of the transition in practice from surgical aortic valve replacement to transcatheter aortic valve replacement. Circ Cardiovasc Interv. 2020;13:e009297. doi: 10.1161/CIRCINTERVENTIONS.120.009297 [DOI] [PubMed] [Google Scholar]
- 6. Elbaz‐Greener G, Masih S, Fang J, Ko DT, Lauck SB, Webb JG, Nallamothu BK, Wijeysundera HC. Temporal trends and clinical consequences of wait times for transcatheter aortic valve replacement: a population‐based study. Circulation. 2018;138:483–493. doi: 10.1161/CIRCULATIONAHA.117.033432 [DOI] [PubMed] [Google Scholar]
- 7. Arnold SV, Afilalo J, Spertus JA, Tang Y, Baron SJ, Jones PG, Reardon MJ, Yakubov SJ, Adams DH, Cohen DJ, et al. Prediction of poor outcome after transcatheter aortic valve replacement. J Am Coll Cardiol. 2016;68:1868–1877. doi: 10.1016/j.jacc.2016.07.762 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Elbaz‐Greener G, Yarranton B, Qiu F, Wood DA, Webb JG, Fremes SE, Radhakrishnan S, Wijeysundera HC. Association between wait time for transcatheter aortic valve replacement and early postprocedural outcomes. J Am Heart Assoc. 2019;8:e010407. doi: 10.1161/JAHA.118.010407 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Steffen J, Stocker A, Scherer C, Haum M, Fischer J, Doldi PM, Theiss H, Braun D, Rizas K, Peterß S, et al. Emergency transcatheter aortic valve implantation for acute heart failure due to severe aortic stenosis in critically ill patients with or without cardiogenic shock. Eur Heart J Acute Cardiovasc Care. 2022;11:877–886. doi: 10.1093/ehjacc/zuac131 [DOI] [PubMed] [Google Scholar]
- 10. Ando T, Adegbala O, Villablanca PA, Akintoye E, Ashraf S, Briasoulis A, Telila T, Takagi H, Grines CL, Schreiber T, et al. Predictors of hospital cost after transcatheter aortic valve implantation in the United States: from the Nationwide Inpatient Sample database. Am J Cardiol. 2019;123:1142–1148. doi: 10.1016/j.amjcard.2018.12.044 [DOI] [PubMed] [Google Scholar]
- 11. Graham MM, Knudtson ML, O'Neill BJ, Ross DB; Canadian Cardiovascular Society Access to Care Working Group . Treating the right patient at the right time: access to cardiac catheterization, percutaneous coronary intervention and cardiac surgery. Can J Cardiol. 2006;22:679–683. doi: 10.1016/S0828-282X(06)70936-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Martin GP, Curzen N, Goodwin AT, Nolan J, Balacumaraswami L, Ludman PF, Kontopantelis E, Wu J, Gale CP, de Belder MA, et al. Indirect impact of the COVID‐19 pandemic on activity and outcomes of transcatheter and surgical treatment of aortic stenosis in England. Circ Cardiovasc Interv. 2021;14:e010413. doi: 10.1161/CIRCINTERVENTIONS.120.010413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Wijeysundera HC, Qiu F, Koh M, Prasad TJ, Cantor WJ, Cheema A, Chu MWA, Czarnecki A, Feindel C, Fremes SE, et al. Comparison of outcomes of balloon‐expandable versus self‐expandable transcatheter heart valves for severe aortic stenosis. Am J Cardiol. 2017;119:1094–1099. doi: 10.1016/j.amjcard.2016.12.016 [DOI] [PubMed] [Google Scholar]
- 14. Guttmann A, Nakhla M, Henderson M, To T, Daneman D, Cauch‐Dudek K, Wang X, Lam K, Hux J. Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatr Diabetes. 2010;11:122–128. doi: 10.1111/j.1399-5448.2009.00539.x [DOI] [PubMed] [Google Scholar]
- 15. Hux JE, Ivis F, Flintoft V, Bica A. Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002;25:512–516. doi: 10.2337/diacare.25.3.512 [DOI] [PubMed] [Google Scholar]
- 16. Schultz SE, Rothwell DM, Chen Z, Tu K. Identifying cases of congestive heart failure from administrative data: a validation study using primary care patient records. Chronic Dis Inj Can. 2013;33:160–166. doi: 10.24095/hpcdp.33.3.06 [DOI] [PubMed] [Google Scholar]
- 17. Tu K, Campbell NR, Chen Z‐L, Cauch‐Dudek KJ, McAlister FA. Accuracy of administrative databases in identifying patients with hypertension. Open Med. 2007;1:e18–e26. [PMC free article] [PubMed] [Google Scholar]
- 18. Tu K, Chen Z, Lipscombe LL. Canadian hypertension education program outcomes research taskforce. Prevalence and incidence of hypertension from 1995 to 2005: a population‐based study. CMAJ. 2008;178:1429–1435. doi: 10.1503/cmaj.071283 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Gershon AS, Wang C, Guan J, Vasilevska‐Ristovska J, Cicutto L, To T. Identifying individuals with physcian diagnosed COPD in health administrative databases. COPD. 2009;6:388–394. doi: 10.1080/15412550903140865 [DOI] [PubMed] [Google Scholar]
- 20. Jaakkimainen RL, Bronskill SE, Tierney MC, Herrmann N, Green D, Young J, Ivers N, Butt D, Widdifield J, Tu K. Identification of physician‐diagnosed Alzheimer's disease and related dementias in population‐based administrative data: a validation study using family physicians' electronic medical records. J Alzheimers Dis. 2016;54:337–349. doi: 10.3233/JAD-160105 [DOI] [PubMed] [Google Scholar]
- 21. Gilbert T, Neuburger J, Kraindler J, Keeble E, Smith P, Ariti C, Arora S, Street A, Parker S, Roberts HC, et al. Development and validation of a Hospital Frailty Risk Score focusing on older people in acute care settings using electronic hospital records: an observational study. Lancet. 2018;391:1775–1782. doi: 10.1016/S0140-6736(18)30668-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Fine JP, Gray RJ. A proportional hazards model for the subdistribution of a competing risk. J Am Stat Assoc. 1999;94:496–509. doi: 10.1080/01621459.1999.10474144 [DOI] [Google Scholar]
- 23. Austin PC, Lee DS, Fine JP. Introduction to the analysis of survival data in the presence of competing risks. Circulation. 2016;133:601–609. doi: 10.1161/CIRCULATIONAHA.115.017719 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Steyerberg EW. Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. Cham: Springer International Publishing; 2019. doi: 10.1007/978-3-030-16399-0 [DOI] [Google Scholar]
- 25. Griffith GJ, Morris TT, Tudball MJ, Herbert A, Mancano G, Pike L, Sharp GC, Sterne J, Palmer TM, Davey Smith G, et al. Collider bias undermines our understanding of COVID‐19 disease risk and severity. Nat Commun. 2020;11:5749. doi: 10.1038/s41467-020-19478-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Zhang Z, Cortese G, Combescure C, Marshall R, Lee M, Lim HJ, Haller B. Overview of model validation for survival regression model with competing risks using melanoma study data. Ann Transl Med. 2018;6:325. doi: 10.21037/atm.2018.07.38 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Vergouwe Y, Steyerberg EW, Eijkemans MJC, Habbema JDF. Validity of prognostic models: when is a model clinically useful? Semin Urol Oncol. 2002;20:96–107. doi: 10.1053/suro.2002.32521 [DOI] [PubMed] [Google Scholar]
- 28. Asgar AW, Ouzounian M, Adams C, Afilalo J, Fremes S, Lauck S, Leipsic J, Piazza N, Rodes‐Cabau J, Welsh R, et al. 2019 Canadian Cardiovascular Society position statement for transcatheter aortic valve implantation. Can J Cardiol. 2019;35:1437–1448. doi: 10.1016/j.cjca.2019.08.011 [DOI] [PubMed] [Google Scholar]
- 29. R Core Team . R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. 2019. https://www.R‐project.org/ Accessed March 04, 2021. [Google Scholar]
- 30. Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35:1925–1931. doi: 10.1093/eurheartj/ehu207 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Mahon B, Sasse A, Stewart R. The development and validation of a clinical priority system score for cardiac surgery used throughout New Zealand. Eur Heart J. 2018;39:ehy566.P5454. doi: 10.1093/eurheartj/ehy566.P5454 [DOI] [Google Scholar]
- 32. Wathes R, Malhotra K, Flott K, Nath A, Urch C. Towards a standardised method of patient prioritisation that accounts for clinical harm. Future Healthc J. 2021;8:e42–e46. doi: 10.7861/fhj.2020-0109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Déry J, Ruiz A, Routhier F, Bélanger V, Côté A, Ait‐Kadi D, Gagnon M‐P, Deslauriers S, Lopes Pecora AT, Redondo E, et al. A systematic review of patient prioritization tools in non‐emergency healthcare services. Syst Rev. 2020;9:227. doi: 10.1186/s13643-020-01482-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Popovic B, Molho A, Varlot J, Fay R, Metzdorf PA, Elfarra M, Maureira P, Juillière Y, Huttin O, Camenzind E. Prognostic influence of acute decompensated heart failure in patients planned for transcatheter aortic valve implantation. Catheter Cardiovasc Interv. 2020;96:E542–E551. doi: 10.1002/ccd.28813 [DOI] [PubMed] [Google Scholar]
- 35. Shimura T, Yamamoto M, Kano S, Hosoba S, Sago M, Kagase A, Koyama Y, Tsujimoto S, Otsuka T, Tada N, et al. Patients refusing transcatheter aortic valve replacement even once have poorer clinical outcomes. J Am Heart Assoc. 2018;7:e009195. doi: 10.1161/JAHA.118.009195 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Martin GP, Sperrin M, Mamas MA. Pre‐procedural risk models for patients undergoing transcatheter aortic valve implantation. J Thorac Dis. 2018;10:S3560–S3567. doi: 10.21037/jtd.2018.05.67 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Howlett NC, Wood RM. Modeling the recovery of elective waiting lists following COVID‐19: scenario projections for England. Value Health. 2022;25:1805–1813. doi: 10.1016/j.jval.2022.06.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Tam DY, Miranda RN, Elbatarny M, Wijeysundera HC. Real‐world health‐economic considerations around aortic‐valve replacement in a publicly funded health system. Can J Cardiol. 2021;37:992–1003. doi: 10.1016/j.cjca.2020.11.015 [DOI] [PubMed] [Google Scholar]
- 39. Tam DY, Qiu F, Manoragavan R, Fremes SE, Hassan A, Ko DT, Lauck SB, Naimark D, Ouzounian M, Sander B, et al. The impact of the COVID‐19 pandemic on cardiac procedure wait list mortality in Ontario, Canada. Can J Cardiol. 2021;37:1547–1554. doi: 10.1016/j.cjca.2021.05.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Forcillo J, Wood DA, Abdel‐Razek O, Adreak N, Asgar A, Chedrawy E, Eckstein J, Legare J‐F, Natarajan MK, Pibarot P, et al. A national strategy to detect and treat heart valve diseases in Canada. Can J Cardiol. 2023;39:567–569. doi: 10.1016/j.cjca.2023.01.021 [DOI] [PubMed] [Google Scholar]
- 41. Lesko LJ, Zineh I, Huang S‐M. What is clinical utility and why should we care? Clin Pharmacol Ther. 2010;88:729–733. doi: 10.1038/clpt.2010.229 [DOI] [PubMed] [Google Scholar]
- 42. Wald R, Quinn RR, Luo J, Li P, Scales DC, Mamdani MM, Ray JG; University of Toronto Acute Kidney Injury Research Group . Chronic dialysis and death among survivors of acute kidney injury requiring dialysis. JAMA. 2009;302:1179–1185. doi: 10.1001/jama.2009.1322 [DOI] [PubMed] [Google Scholar]
- 43. Tu JV, Chu A, Donovan LR, Ko DT, Booth GL, Tu K, Maclagan LC, Guo H, Austin PC, Hogg W, et al. The Cardiovascular Health in Ambulatory Care Research Team (CANHEART): using big data to measure and improve cardiovascular health and healthcare services. Circ Cardiovasc Qual Outcomes. 2015;8:204–212. doi: 10.1161/CIRCOUTCOMES.114.001416 [DOI] [PubMed] [Google Scholar]
- 44. Lee DS, Stitt A, Wang X, Yu JS, Gurevich Y, Kingsbury KJ, Austin PC, Tu JV. Administrative hospitalization database validation of cardiac procedure codes. Med Care. 2013;51:e22–e26. doi: 10.1097/MLR.0b013e3182329778 [DOI] [PubMed] [Google Scholar]
- 45. Wulff JN, Ejlskov L. Multiple imputation by chained equations in praxis: guidelines and review. Electron J Bus Res Methods. 2017;15:17. [Google Scholar]
- 46. Rubin DB. Multiple Imputation for Nonresponse in Surveys. 1st ed. John Wiley & Sons, Ltd; 1987. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
