Abstract
Background:
Randomized controlled trials (RCTs) are the “gold standard” for comparing the safety and efficacy of therapies, but may be limited due to high costs, lack of feasibility, and difficulty enrolling “real-world” patient populations. The Extending Trial-Based Evaluations of Medical Therapies Using Novel Sources of Data (EXTEND) Study seeks to evaluate whether data collected within procedural registries and claims databases can reproduce trial results by substituting surrogate non-trial based variables for exposures and outcomes.
Methods and Results:
Patient level data from two clinical trial programs – the Dual Antiplatelet Therapy (DAPT) Study and the United States CoreValve Studies – will be linked to a combination of national registry, administrative claims and health system data. The concordance between baseline and outcomes data collected within non-trial datasets and trial information, including adjudicated endpoint events, will be assessed. We will compare the study results obtained using these alternative data sources to those derived using trial-ascertained variables and endpoints using trial-adjudicated endpoints and covariates.
Conclusions:
Linkage of trials to registries and claims data represents an opportunity to utilize alternative data sources in place of and as adjuncts to randomized clinical trial data, but requires further validation. The results of this research will help determine how these data sources can be used to improve our present and future understanding of new medical treatments.
Keywords: Clinical trials, administrative claims, outcomes research
INTRODUCTION
Randomized controlled trials (RCTs) are considered the gold standard for comparing the efficacy and safety of therapies, but suffer from a number of important limitations including high costs, limited feasibility, and difficulty enrolling “real-world” patient populations, which limit the generalizability of their findings. Alternatively, observational study designs that harness the large amounts of data routinely collected within disease and procedural registries, health system databases, and payer claims are relatively inexpensive and allow for powerful and efficient long-term evaluation of medical therapies in representative populations. However, these studies are also subject to inherent issues such as miscoding and confounding by unmeasured variables. The combined use of prospectively designed trials that also harness passively collected data in the form of registries or claims databases represents a unique opportunity to leverage the randomization scheme of clinical trials to minimize confounding, while gaining the efficiencies of evaluating outcomes through existing data already collected in the routine course of clinical care. Such data could be used, among others ways, to 1) replace the collection of baseline patient information and subsequent outcomes, 2) augment data collection, through filling in gaps of data that was not captured by clinical trials, and 3) assess the generalizability of trial populations, through comparisons between trial participants and non-participants1.
While harnessing existing registries to support trials has been advocated,2 to date, these approaches have only been used in a small number of trials3–7 using a limited number of endpoints. Recently, the use of multi-stakeholder real world evidence (e.g., clinical registries, electronic health records, and administrative billing claims) for medical device evaluation and regulatory decision making has been advocated by the US Food and Drug Administration who established the National Evaluation System for Health Technology (NEST) program to efficiently generate safety and efficacy data to support pre- and post-marketing regulatory decisions.8 However, in which situations and for what endpoints these designs may readily be implemented while maintaining validity has not been widely tested in comparison to traditional trial design and data collection.2,5,9–12
The linkage of previously conducted clinical trials with registries and claims databases provides the opportunity to more rigorously evaluate more pragmatically designed registry-based clinical trials. The Extending Trial-Based Evaluations of Medical Therapies Using Novel Sources of Data (EXTEND) study will seek to address these questions by linking data from claims, procedural registries, and administrative databases with data from two separate clinical trial programs (Figure 1). The EXTEND-DAPT substudy will utilize linkage to the Dual Antiplatelet Therapy (DAPT) Study,13 a prospective, multicenter, randomized, double-blind trial that assessed the effectiveness and safety of 12 versus 30 months of DAPT in subjects undergoing percutaneous coronary intervention (PCI) with placement of either a drug-eluting stent (DES) or bare metal stent (BMS). The EXTEND-CoreValve substudy will utilize data from the United States (US) CoreValve program, a set of prospective trials evaluating the efficacy and safety of transcatheter aortic valve replacement (TAVR) with the CoreValve self-expanding prosthesis in patients with severe aortic stenosis at intermediate, high, or extreme risk of mortality from surgical aortic valve replacement (SAVR).
Figure 1:
Linkage of non-trial data sources to trial scheme and rationale
Our primary aims of the of the study are to 1) examine whether outcomes collected in non-trial datasets agree with data collected, cleaned and adjudicated within trials, 2) assess whether the analysis using claims-based outcomes results in the same treatment effect estimates as those observed in trials, and 3) develop measures to assess trial generalizability through the comparison of trial participants and non-participants within large real-world datasets.
STUDY DESIGN
The EXTEND study is a National Heart, Lung, and Blood Institute-funded study (1R01HL136708) that will link clinical trial adjudicated data (i.e. “actively” acquired data) and administrative claims or registry information obtained on trial participants (i.e. “passively” acquired data) to evaluate how non-trial datasets can be used as surrogates or adjuncts to traditional randomized trials. It represents a multi-institutional collaboration involving an academic, federal, and industry partnership between the Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology at Beth Israel Deaconess Medical Center (Boston, MA), the Baim Institute for Clinical Research, the American College of Cardiology, and Medtronic.®
DATA SOURCES
Clinical Trial Data
EXTEND-DAPT
Clinical trial data for EXTEND-DAPT will come from the DAPT Study, a multicenter RCT evaluating long-term dual antiplatelet therapy among patients receiving coronary stents. This was the largest post-marketing study of coronary stent-treated patients to date,14 enrolling more than 25,000 patients. We will include all US patients enrolled in the DAPT Study (N = 25,678) for this analysis (Table 1).13 Patients undergoing percutaneous coronary intervention (PCI) with a bare metal or drug-eluting coronary stent were enrolled and treated with thienopyridine plus aspirin for one year. Thereafter, patients were randomized either to aspirin plus thienopyridine or to aspirin plus placebo for another 18 months. The study, operated by the Baim Institute for Clinical Research, employed limited data collection and risk-based site monitoring to reduce trial costs, and used a centralized Clinical Events Committee (CEC) for event adjudication.
Table 1:
Summary of Studies Included in the EXTEND-Study
| Trial name | Subjects | Sites | STS-PROM score | Comparison | Randomization Strategy | Primary endpoint | Primary Analysis | Rate of primary endpoint in Arm A* | Rate of primary endpoint in Arm B* | P-Value for Primary Endpoint |
|---|---|---|---|---|---|---|---|---|---|---|
| DAPT | 25,678 | 452 | N/A | 12 vs. 30 months DAPT | Randomized | All-cause mortality or stent-thrombosis at 30 months post PCI | Intention to Treat | 4.3% (Death) 0.4% (Stent thrombosis) |
5.9% (Death) 1.4% (Stent thrombosis) |
P < 0.001 for both outcomes (superiority) |
| SURTAVI | 1,660 | 87 | 3–15% | CoreValve bioprosthesis vs. SAVR | Randomized (Bayesian) | All-cause 2 year mortality or disabling stroke | Modified Intention to Treat | 12.6% | 14.0% | Posterior Probability >0.99 (noninferiority) |
| US CoreValve High Risk Study | 750 | 45 | >15% | CoreValve bioprosthesis vs. SAVR | Randomized | All-cause 1 year mortality | Per protocol | 14.2% | 19.1% | P < 0.001 (noninferiority), P = 0.04 (superiority) |
| US Pivotal Extreme Risk Study | 639 | 41 | >50% | CoreValve bioprosthesis vs. objective performance goal | Nonrandomized | All-cause 1 year mortality or major stroke | Intention to Treat | 26.0% | 43.0% | P <0.001 |
| US CoreValve Continued Access Study | 2,732 | 44 | 3 to >50% | CoreValve bioprosthesis | Nonrandomized | All-cause mortality (High
Risk) All-cause mortality or major stroke (Extreme Risk) |
Intention to Treat | 34.2% (Death) 40.3% (MACCE) |
N/A | N/A |
| US CoreValve Expanded Use Study | 767 | 41 | >50% | CoreValve bioprosthesis | Nonrandomized | All-cause mortality or major stroke at 1 year | Intention to Treat | N/A | N/A | N/A |
Arm A = 30 months of DAPT (EXTEND-DAPT) or TAVR (EXTEND-CoreValve). Arm B = 12 months of DAPT (EXTEND-DAPT) or SAVR (EXTEND-CoreValve). STS-PROM = Society of Thoracic Surgeons Predicted Risk of Mortality Score. TAVR = transcatheter aortic valve replacement. SAVR = surgical aortic valve replacement.
EXTEND-CoreValve
Clinical trial data for EXTEND-CoreValve will come from the US CoreValve Pivotal Trials database, a set of 3 large studies (N = 3,049) comparing TAVR and SAVR for individuals with severe aortic stenosis: the Surgical or Transcatheter Aortic-Valve Replacement in Intermediate Risk Patients (SURTAVI) study (N = 1660),15 the US CoreValve High Risk study (N = 750),16 and the US CoreValve Extreme Risk Study (N = 639)17 (Table 1). While the SURTAVI and US CoreValve High Risk studies were randomized comparisons of CoreValve bioprostheses and SAVR, the Extreme Risk Study was a nonrandomized comparison of TAVR to an objective performance measure. Additionally, US TAVR recipients included in the single arm Continued Access Study (CAS; N = 2,732) and Expanded Use Study (N = 767) will be included in EXTEND-CoreValve. The Continued Access Study is a single arm cohort study of individuals receiving a CoreValve TAVR in the High Risk or Extreme Risk Pivotal Trials, intended for follow-up of outcomes and adverse events. The US CoreValve Expanded Use Study represents a subset of patients excluded from the US CoreValve Extreme Risk Pivotal Trial population due to one or more additional comorbidities. It includes six primary cohorts: individuals excluded due to severe mitral valve regurgitation, severe tricuspid valve regurgitation, end stage renal disease, low-gradient low-output aortic stenosis, valve in valve with failed bioprosthetic surgical valve, and those with 2 or more of the listed conditions.
Registry Data
Registry data for EXTEND-DAPT will come from the American College of Cardiology (ACC) National Cardiovascular Data Registry (NCDR) CathPCI Registry involving more than 1,700 hospitals in the US.18 This is a national quality improvement registry of patients undergoing cardiac catheterization and PCI, and includes data from more than 1,700 hospitals drawn from all 50 states in the US.19 The registry collects detailed sociodemographic, clinical and procedural information for more than 600,000 patients at participating centers each year, along with in-hospital outcomes. Vital status will be obtained from the National Death Index, a centralized registry of death record information maintained by the National Center for Health Statistics and made available for research purposes. EXTEND-CoreValve will not involve linkage to registry data.
Claims Data
Payer claims data for linkage to trial data in EXTEND-DAPT and EXTEND-CoreValve will come from Medicare fee-for-service (FFS) beneficiary claims. Research files from the Centers for Medicare and Medicaid Services (CMS) for the years 2003–2014 (2009–2014 for EXTEND-DAPT), consisting of a 100% sample of patient- and hospital-level inpatient billing data for Medicare FFS beneficiaries in the Medicare Provider and Analysis Review (MedPAR dataset) and Inpatient Standard Analytical Files (SAF; Part A claims).
Data Management
To permit the exchange of data across multiple platforms, data use agreements were obtained between the Smith Center and CMS, the Smith Center and Medtronic® (for CoreValve data), the Baim Institute and CMS, and the Baim Institute and the American College of Cardiology (for registry data in EXTEND-DAPT). While EXTEND-CoreValve data will be located behind a secure firewall at the Smith Center and analyzed by Smith Center biostatisticians, EXTEND-DAPT data will be located behind a secure firewall at the Baim Institute and analyze by Baim Institute biostatisticians. As contacting individual trial participants was infeasible and the study was thought to present minimal risk to participants, a waver of informed consent was obtained in addition to institutional review board (IRB) approval from the BIDMC IRB for EXTEND-CoreValve (obtained via the Smith Center) and is pending for EXTEND-DAPT. Data linkage and analyses will be performed with SAS v 9.4 (SAS Institute, Cary, NC). As per the data use agreements, a deidentified EXTEND dataset cannot be made publicly available.
COVARIATES, OUTCOMES, AND STATISTICAL CONSIDERATIONS
Linkage Strategy
We will use deterministic linkage methods to perform multiple distinct linkages between datasets based on presence or absence of direct identifiers (Figure 1). As direct patient identifiers are not available in the DAPT Study and US CoreValve Pivotal Trials, a deterministic matching algorithm will be applied, similar to previously described methods.18,20 Specifically, we will link records from different data sources using age or date of birth, sex, admission and discharge dates, procedure date and type, and hospital identifier. In cases where multiple records are linked (more likely for EXTEND-DAPT), additional variables including stent type, stent brand, number of stents, and myocardial infarction during index hospitalization may be used. This general strategy has been found to effectively match 86% of CMS patients undergoing PCI at NCDR-CMS linkable hospitals, and 75% of patients age 65 or greater within the CathPCI Registry.18 For linkage of claims to CathPCI registry data, patient identifiers are available and will be submitted securely to CMS to match individuals included in both datasets.
Using these linkage rules, we have already successfully linked 80% of patients in the US CoreValve Pivotal Trials and Continued Access Study to the Medicare Current Beneficiary Summary File (e.g. the “denominator” file) (Figure 2). To do so, we evaluated 6,548 patients in the CoreValve Pivotal Trials dataset. After excluding patients under age 65 and those patients who underwent the index procedure at Veterans Affairs or European hospitals, a total of 5,936 patients were identified for potential linkage (High Risk Study, N = 735; Extreme Risk Study, N = 620; SURTAVI, N = 1305; Expanded Use Study, N = 634; Continued Access Registry for the Extreme Risk Study, N = 1568; Continued Access Registry for the High Risk Study, N = 1074). As a given healthcare facility could have multiple names in the trial or CMS datasets, sites were matched based on CMS hospital provider number. The frequency of occurrence of the provider number in the CMS data was used to check that the provider number identified corresponded to the most likely hospital match. Using procedure date, birthdate, and physician provider number as merging criteria and hospital provider number as the checking criterion, we were able to uniquely match 3225 patients (3225/3997 [80.7%]) of those in the High Risk and Extreme Risk Pivotal Studies and Continued Access Study).
Figure 2:
Diagram illustrating linkage strategy and results for the EXTEND-CoreValve study
As the SURTAVI trial lacked birthdate information, procedure date, admission date, discharge date, and physician provider number were used as merging criteria and both hospital provider number and difference in age between the trial and CMS was used as checking criteria. Only those with a listed age in CMS within 1 year of the age listed in the trial were considered a true match. Using these criteria, we matched 1005 (1005/1305 [77.0%]) unique patients in SURTAVI to CMS data. For the Expanded Use Study, procedure date and birthdate were used as merging criteria and gender and procedure date as checking criteria, resulting in 505 (505/634 [79.7%]) individuals being successfully matched to CMS data. A comparison of linked and non-linked trial participants will be done for EXTEND-DAPT to evaluate their differences. A similar comparison has already been conducted for EXTEND-CoreValve and showed minimal differences between linked and non-linked populations (Table 2). As Medicare Advantage Health Maintenance Organizations (HMO) represented 13–30% of overall Medicare enrollees during the time period evaluated,21 we consider the majority of non-matched individuals likely to be Medicare Advantage enrolled.
Table 2:
Characteristics of Linked and Non-Linked Individuals Included in the EXTEND-CoreValve
| Characteristic | Linked group (N = 4230) | Non-linked group (N =1072) | p-value |
|---|---|---|---|
| Age — years ± SD | 83.0 ± 6.7 | 82.4 ± 7.1 | 0.02 |
| Female sex — no. (%) | 1939 (45.8) | 478 (44.6) | 0.47 |
| Body Mass Index - kg/m2 ± SD | 28.2 ± 6.2 | 28.3 ± 6.4 | 0.14 |
| New York Heart Association class — no. (%) | 0.69 | ||
| Class II | 811 (19.2) | 218 (20.3) | |
| Class III | 2781 (65.7) | 696 (20.0) | |
| Class IV | 638 (15.1) | 158 (19.9) | |
| Society of Thoracic Surgeons Risk Score — % ± SD | 7.9 ± 4.5 | 7.5 ± 4.4 | 0.02 |
| Logistic EuroSCORE — % ± SD | 19.5 ± 14.6 | 20.0 ± 15.7 | 0.0011 |
| Diabetes mellitus — no. (%) | |||
| All | 1585 (37.5) | 400 (37.3) | 0.94 |
| Controlled by insulin | 545 (12.9) | 143 (13.3) | 0.68 |
| History of hypertension — no. (%) | 3955 (93.5) | 1000 (93.3) | 0.80 |
| Peripheral vascular disease — no./total no. (%) | 1787 (42.4) | 474 (44.2) | 0.28 |
| Prior stroke — no./total no. (%) | 496 (11.7) | 113 (10.6) | 0.28 |
| Prior transient ischemic attack — no./total no. (%) | 425 (10.1) | 93 (8.7) | 0.19 |
| Cardiac risk factors— no./total no. (%) | |||
| Coronary artery disease | 3189 (75.4) | 813 (75.8) | 0.76 |
| Prior coronary-artery bypass surgery | 1315 (31.1) | 320 (29.9) | 0.46 |
| Prior percutaneous coronary intervention | 1468 (34.7) | 364 (34.0) | 0.65 |
| Balloon Valvuloplasty | 417 (9.9) | 98 (9.1) | 0.53 |
| Pre-Existing Pacemaker of Implantable Cardioverter-Defibrillator | 818 (19.3) | 234 (21.8) | 0.07 |
| Prior myocardial infarction | 1025 (24.2) | 252 (23.5) | 0.63 |
| Congestive heart failure | 4126 (97.5) | 1033 (96.4) | 0.04 |
| Prior atrial fibrillation or atrial flutter | 1711 (40.5) | 427 (39.9) | 0.73 |
Baseline characteristics of individuals whose trial data could and could not be linked to Medicare claims. SD = standard deviation. No. = number.
Validation of Outcomes
Linkage of clinical trials and administrative data permits the validation of outcomes determined from Medicare and non-Medicare claims against rigorously adjudicated clinical trial variables. As it is unknown if CEC-adjudicated exposure and outcome variables will record certain information as well as claims, we will evaluate agreement in the aggregated outcomes between claims data and trial data. To do this, we will specify a 14 day time window before and after a trial adjudicated event in which a claim submitted for a trial-participant for a similar event during this time will be considered a “match.” Specifically, as each individual may have multiple possible “event matches,” the difference between the index procedure date and the event date will be determined for both CMS and trial populations. The difference between these two values represents the discrepancy between dates. The event with the lowest discrepancy in dates, following within the 14-day window will be considered the matched event. For those with multiple events in a given hospitalization, only the first event will be considered. As time latency for reporting of trial events could result in mismatched event dates, a 14-day window before and after the event dates will be applied as above to identify the most likely possible match.
We will conduct a number of validation analyses for each outcome using a hierarchical algorithm as follows. First, codes representing a given outcome and matched to trial events will be ranked based on the frequency of occurrence. If multiple codes are used to represent a trial event, only the code most frequently used overall will be considered. Kappa statistics will be determined for each code and outcome pair. Additionally, assuming trials as the criterion standard, the sensitivity, specificity, positive, and negative predictive values for the most commonly used codes will be determined for each outcome subtype (e.g. for neurologic events, we will consider hemorrhagic stroke, ischemic stroke, and transient ischemic attack separately). Additionally, recursive partitioning will be used in sensitivity analysis to identify that this hierarchical algorithm identifies a similar parsimonious list of claims that identify each outcome, with N-fold cross-validation used to identify the extent of overfitting. Both procedural (e.g. transfusion) and diagnosis (e.g. gastrointestinal hemorrhage) codes will be considered in the event matching. No medication information is available in the proposed datasets.
Additionally, we will construct Kaplan-Meier plots to assess the agreement in time to events between trial and claims data over the study period, using the censoring dates from the trial. As codes during trial follow-up could represent individuals with a history of a given outcome in some cases, we will construct separate Kaplan-Meier estimates for individuals without a code for that outcome in the year prior to the date of their index procedure. An exhaustive list of claims (eTables 1–4) will be considered for each event to identify those codes which best agree with trial variables and outcomes.
For EXTEND-DAPT, we will include all patients who underwent PCI with a Food and Drug Administration approved stent between August 13, 2009 and July 1, 2011. Baseline characteristics of patients will be determined based on International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) and Current Procedural Terminology (CPT) codes (eTable 1). Clinical and comorbidity variables will be determined for individuals, using claims available up to one year prior to the admission date of hospitalization for PCI. The co-primary outcomes include definite or probable stent thrombosis or MACCE (e.g. death, myocardial infarction, or stroke), during the period of 12–30 months post enrollment, similar to those in the DAPT study (eTable 2).
For EXTEND-CoreValve, adults (≥18 years) in the CMS database hospitalized from January 1, 2003 to December 31, 2016 with the ICD-9-CM procedure codes for TAVR and SAVR will be included if able to be successfully linked to the US CoreValve Pivotal data. Clinical and comorbidity variables will be determined for individuals undergoing aortic valve replacement (AVR), using claims available up to one year prior to the admission date of hospitalization for AVR (eTable 3). Mirroring the trials, the primary outcomes will include all-cause mortality at 1 year (High Risk trial) and all-cause mortality or stroke at 12 months (Extreme Risk trial). As outcome data was incomplete beyond one year in SURTAVI, all-cause mortality and stroke at 1 years will be used as the primary outcome for this comparison. Additional outcomes will include rates of major vascular complications, major bleeding, hospitalization for acute kidney injury, cardiogenic shock, permanent pacemaker implantation, new onset atrial fibrillation, or mechanical complications from heart valve prosthesis placement (eTable 4).5,10,22–37
As both DAPT and CoreValve trials relied on individual site reporting to identify hospitalization events, it is possible that claims may identify adverse events not otherwise reported for trial adjudication. By contrast, codes for adverse events may not be included in hospitalization discharge billing records if they were not the primary reason for hospitalization. As such, all coding positions will be used to identify potential events.
Reproducing Trial Results
After validation of endpoints, we will compare trial results to those obtained from claims data. Specifically, we will assess whether or not claims, that have been identified as being the best surrogates of trial variables, can reproduce the results observed in the trials when substituted for CEC-adjudicated endpoints among the linked study populations. As the definitions for each outcome differed by trial, each trial result will be reproduced independently.
Using the linked datasets, we will perform a comparison of the overall results obtained from claims alone vs. the original trial analyses for both the DAPT and CoreValve populations. This will include an assessment of 1) the direction of effect, 2) the magnitude of the hazard ratio, and 3) the differences in absolute event rates (due to differences in sensitivity/specificity of endpoints) and the corresponding numbers needed to treat/harm. Specifically, in EXTEND-DAPT, only those individuals in the DAPT trial who can be successfully linked to both the CathPCI registry and CMS data will be included in analyses of claims and registry data to reproduce trial results. In the EXTEND-CoreValve study, only those individuals in the US CoreValve Pivotal Trials who can be successfully linked to CMS data will be included.
In the EXTEND-DAPT study, we will utilize non-trial data to evaluate the primary randomized comparison of 30 vs. 12 months of dual antiplatelet therapy in the linked CMS-DAPT-CathPCI dataset. Specifically, we will use the stratified log-rank test to compare the cumulative incidence of MACCE and stent thrombosis between treatment arms, with a superiority hypothesis. A comparison of the primary safety endpoint of claims-defined bleeding between randomized groups will conducted using a non-inferiority analysis and the Farrington-Manning risk difference approach with a non-inferiority margin of 0.8%.13 We will subsequently compare the study results from above to those attained using trial-ascertained variables and endpoints, using the technique for qualitative comparison mentioned above.
In the EXTEND-CoreValve study, we will use claims to reproduce trial results, evaluating 1- and 2-year rates of death using a non-inferiority margin of 7.5% between treatment arms for the High-Risk study,16 and a 12-month rate of death using a “placebo” rate of 43% for the Extreme-Risk study,17 as used in the trials. Results obtained through analysis of claims data will be compared to trial endpoints to assess whether results are concordant in direction and magnitude of effect, difference in event rates, consistency of subgroup effects, and number needed to treat/harm.
As the accuracy of coding for an outcome could lead to the conclusion of non-inferiority due to Type II error, sensitivity analyses will be performed assuming different rates of coding for a given outcome to evaluate how robust the findings are to coding inaccuracies or deficient validation.
Additional Aims
While the primary intention of the EXTEND study is to evaluate the agreement of results obtained via trial-collected data and administrative-claims or registry-obtained data, linkage of these diverse data sources permits study of a number of common questions. First, as trials have been criticized for not enrolling a generalizable population,18,38 we will evaluate the external validity of these two trial populations by directly comparing participants undergoing PCI or aortic valve replacement included in the trials to those not included in the trials, but undergoing these procedures within the larger registries or claims datasets. Thus, linkage of trials to registry and claims data may, in the future, permit direct assessment of trial generalizability.
Second, as trials may be limited by financial or personnel resources to acquire certain detailed historical information on their participants,38 we plan to evaluate whether the addition of historical information obtained from claims data, can identify subgroups with differential treatment benefit or harm. By leveraging the randomization of trial participants, we hope to enrich the historical information available for the identification of prognostic and predictive factors. Doing so, we hope to identify individuals with the maximal benefit and minimal harms from the therapies being studied, which may assist in the future in identifying those who benefit most from cardiovascular and non-cardiovascular therapies.
CONCLUSIONS
The timely and efficient evaluation of new medical treatment strategies, therapies and devices is critical to improving public health and informing care decisions. Ubiquitous administrative data collected in the routine care of patients remain underutilized sources of information that could be used to support clinical trial evaluations of novel medical interventions and identify subgroups of particular benefit or harm to these interventions. This approach, while promising, requires testing and validation. Thus, we will link data from several large cardiovascular clinical trials to non-trial data to evaluate whether these data can be used to reproduce trial results, augment information on subgroups with particular benefit or harm, and assess the generalizability to non-trial populations. The information learned has great potential to inform the future conduct of clinical trials, while offering novel insights into the efficacy and safety of multiple cardiovascular and non-cardiovascular therapies.
Supplementary Material
Funding:
Dr. Yeh is funded by a grant from the National, Heart, Lung, and Blood Institute (1R01HL136708–01) for the proposed study. Dr. Strom is funded by a grant from the American Heart Association (18CDA34110267) outside the submitted work.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Disclosures: Dr. Popma reports receiving institutional grants from Medtronic, Edwards Lifesciences, Abbott, and Boston Scientific and is on the medical advisory board for Edwards Lifesceinces, and Boston Scientific. Dr. Mauri reports receiving consulting fees from Amgen, Boehringer Ingleheim, Corvia, and ReCor as well as research grants awarded to Brigham and Women’s Hospital from Biotronik, Boston Scientific, ReCor, and Svelte. Additionally, Dr. Mauri reports employment as of June 4, 2018 with Medtronic. Dr. Yeh reports grant support from Abiomed, Astra Zeneca and Boston Scientific, and consulting fees from Abbott, Boston Scientific, Medtronic, and Teleflex. All other authors have no disclosures.
REFERENCES
- 1.Yeh RW, Kennedy K, Spertus JA, et al. Do postmarketing surveillance studies represent real-world populations? A comparison of patient characteristics and outcomes after carotid artery stenting. Circulation. 2011;123(13):1384–1390. [DOI] [PubMed] [Google Scholar]
- 2.Lauer MS, D’Agostino RB Sr., The randomized registry trial--the next disruptive technology in clinical research? N Engl J Med. 2013;369(17):1579–1581. [DOI] [PubMed] [Google Scholar]
- 3.Frobert O, Lagerqvist B, Olivecrona GK, et al. Thrombus aspiration during ST-segment elevation myocardial infarction. N Engl J Med. 2013;369(17):1587–1597. [DOI] [PubMed] [Google Scholar]
- 4.Rao SV, Hess CN, Barham B, et al. A registry-based randomized trial comparing radial and femoral approaches in women undergoing percutaneous coronary intervention: the SAFE-PCI for Women (Study of Access Site for Enhancement of PCI for Women) trial. JACC Cardiovascular interventions. 2014;7(8):857–867. [DOI] [PubMed] [Google Scholar]
- 5.Guimaraes PO, Krishnamoorthy A, Kaltenbach LA, et al. Accuracy of Medical Claims for Identifying Cardiovascular and Bleeding Events After Myocardial Infarction : A Secondary Analysis of the TRANSLATE-ACS Study. JAMA cardiology. 2017;2(7):750–757. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kiyota Y, Schneeweiss S, Glynn RJ, Cannuscio CC, Avorn J, Solomon DH. Accuracy of medicare claims-based diagnosis of acute myocardial infarction: estimating positive predictive value on the basis of review of hospital records. American heart journal. 2004;148(1):99–104. [DOI] [PubMed] [Google Scholar]
- 7.Elena B-D, Amy DW, Yan Y, David SN, Martha JR, Brian FG. Accuracy of ICD-9-CM Codes for Identifying Cardiovascular and Stroke Risk Factors. Medical Care. 2005;43(5):480–485. [DOI] [PubMed] [Google Scholar]
- 8.US Food and Drug Administration. National Evaluation System for Health Technology (NEST). 2018;https://www.fda.gov/aboutfda/centersoffices/officeofmedicalproductsandtobacco/cdrh/cdrhreports/ucm301912.htm.
- 9.Hlatky MA, Ray RM, Burwen DR, et al. Use of Medicare data to identify coronary heart disease outcomes in the Women’s Health Initiative. Circ Cardiovasc Qual Outcomes. 2014;7(1):157–162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Psaty BM, Delaney JA, Arnold AM, et al. Study of Cardiovascular Health Outcomes in the Era of Claims Data: The Cardiovascular Health Study. Circulation. 2016;133(2):156–164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ahmad FS, Chan C, Rosenman MB, et al. Validity of Cardiovascular Data From Electronic Sources: The Multi-Ethnic Study of Atherosclerosis and HealthLNK. Circulation. 2017;136(13):1207–1216. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Udell JA, Wang TY, Li S, et al. Clinical trial participation after myocardial infarction in a national cardiovascular data registry. Jama. 2014;312(8):841–843. [DOI] [PubMed] [Google Scholar]
- 13.Mauri L, Kereiakes DJ, Normand SL, et al. Rationale and design of the dual antiplatelet therapy study, a prospective, multicenter, randomized, double-blind trial to assess the effectiveness and safety of 12 versus 30 months of dual antiplatelet therapy in subjects undergoing percutaneous coronary intervention with either drug-eluting stent or bare metal stent placement for the treatment of coronary artery lesions. American heart journal. 2010;160(6):1035–1041, 1041.e1031. [DOI] [PubMed] [Google Scholar]
- 14.Mauri L, Kereiakes DJ, Yeh RW, et al. Twelve or 30 months of dual antiplatelet therapy after drug-eluting stents. N Engl J Med. 2014;371(23):2155–2166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Leon MB, Smith CR, Mack MJ, et al. Transcatheter or Surgical Aortic-Valve Replacement in Intermediate-Risk Patients. N Engl J Med. 2016;374(17):1609–1620. [DOI] [PubMed] [Google Scholar]
- 16.Adams DH, Popma JJ, Reardon MJ, et al. Transcatheter aortic-valve replacement with a self-expanding prosthesis. N Engl J Med. 2014;370(19):1790–1798. [DOI] [PubMed] [Google Scholar]
- 17.Popma JJ, Adams DH, Reardon MJ, et al. Transcatheter aortic valve replacement using a self-expanding bioprosthesis in patients with severe aortic stenosis at extreme risk for surgery. J Am Coll Cardiol. 2014;63(19):1972–1981. [DOI] [PubMed] [Google Scholar]
- 18.Yeh RW, Czarny MJ, Normand SL, et al. Evaluating the generalizability of a large streamlined cardiovascular trial: comparing hospitals and patients in the dual antiplatelet therapy study versus the National Cardiovascular Data Registry. Circ Cardiovasc Qual Outcomes. 2015;8(1):96–102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Masoudi FA, Ponirakis A, Yeh RW, et al. Cardiovascular care facts: a report from the national cardiovascular data registry: 2011. J Am Coll Cardiol. 2013;62(21):1931–1947. [DOI] [PubMed] [Google Scholar]
- 20.Yeh RW, Secemsky EA, Kereiakes DJ, et al. Development and Validation of a Prediction Rule for Benefit and Harm of Dual Antiplatelet Therapy Beyond 1 Year After Percutaneous Coronary Intervention. Jama. 2016;315(16):1735–1749. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Jacobson GDA, Neuman T, Gold M. Medicare Advantage 2017 Spotlight: Enrollment Market Update. 2017; https://www.kff.org/medicare/issue-brief/medicare-advantage-2017-spotlight-enrollment-market-update/.
- 22.Rao SV, Dai D, Subherwal S, et al. Association between periprocedural bleeding and long-term outcomes following percutaneous coronary intervention in older patients. JACC Cardiovascular interventions. 2012;5(9):958–965. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Carnahan RM, Moores KG. Mini-Sentinel’s systematic reviews of validated methods for identifying health outcomes using administrative and claims data: methods and lessons learned. Pharmacoepidemiol Drug Saf. 2012;21 Suppl 1:82–89. [DOI] [PubMed] [Google Scholar]
- 24.Ellis ER, Culler SD, Simon AW, Reynolds MR. Trends in utilization and complications of catheter ablation for atrial fibrillation in Medicare beneficiaries. Heart rhythm : the official journal of the Heart Rhythm Society. 2009;6(9):1267–1273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Hlatky MA, Ray RM, Burwen DR, et al. Use of Medicare Data to Identify Coronary Heart Disease Outcomes In the Women’s Health Initiative (WHI). Circulation Cardiovascular quality and outcomes. 2014;7(1):157–162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Brennan JM, Peterson ED, Messenger JC, et al. Linking the National Cardiovascular Data Registry CathPCI Registry with Medicare claims data: validation of a longitudinal cohort of elderly patients undergoing cardiac catheterization. Circ Cardiovasc Qual Outcomes. 2012;5(1):134–140. [DOI] [PubMed] [Google Scholar]
- 27.Ammann EM, Leira EC, Winiecki SK, et al. Chart validation of inpatient ICD-9-CM administrative diagnosis codes for ischemic stroke among IGIV users in the Sentinel Distributed Database. Medicine. 2017;96(52):e9440. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Saczynski JS, Andrade SE, Harrold LR, et al. A systematic review of validated methods for identifying heart failure using administrative data. Pharmacoepidemiol Drug Saf. 2012;21 Suppl 1(0 1):129–140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Andrade SE, Harrold LR, Tjia J, et al. A systematic review of validated methods for identifying cerebrovascular accident or transient ischemic attack using administrative data. Pharmacoepidemiol Drug Saf. 2012;21 Suppl 1:100–128. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Wahl PM, Rodgers K, Schneeweiss S, et al. Validation of claims-based diagnostic and procedure codes for cardiovascular and gastrointestinal serious adverse events in a commercially-insured population. Pharmacoepidemiol Drug Saf. 2010;19(6):596–603. [DOI] [PubMed] [Google Scholar]
- 31.Lakshminarayan K, Larson JC, Virnig B, et al. Comparison of Medicare claims versus physician adjudication for identifying stroke outcomes in the Women’s Health Initiative. Stroke. 2014;45(3):815–821. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Kumamaru H, Judd SE, Curtis JR, et al. Validity of claims-based stroke algorithms in contemporary Medicare data: reasons for geographic and racial differences in stroke (REGARDS) study linked with medicare claims. Circ Cardiovasc Qual Outcomes. 2014;7(4):611–619. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Cheng CL, Lee CH, Chen PS, Li YH, Lin SJ, Yang YH. Validation of acute myocardial infarction cases in the national health insurance research database in taiwan. Journal of epidemiology. 2014;24(6):500–507. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Thakkar B, Patel A, Mohamad B, et al. Transcatheter aortic valve replacement versus surgical aortic valve replacement in patients with cirrhosis. Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions. 2016;87(5):955–962. [DOI] [PubMed] [Google Scholar]
- 35.Samore MH, Evans RS, Lassen A, et al. Surveillance of medical device-related hazards and adverse events in hospitalized patients. Jama. 2004;291(3):325–334. [DOI] [PubMed] [Google Scholar]
- 36.Mahaffey KW, Harrington RA, Akkerhuis M, et al. Disagreements between central clinical events committee and site investigator assessments of myocardial infarction endpoints in an international clinical trial: review of the PURSUIT study. Current controlled trials in cardiovascular medicine. 2001;2(4):187–194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Mahaffey KW, Harrington RA, Akkerhuis M, et al. Systematic adjudication of myocardial infarction end-points in an international clinical trial. Current controlled trials in cardiovascular medicine. 2001;2(4):180–186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Stuart EA, Bradshaw CP, Leaf PJ. Assessing the generalizability of randomized trial results to target populations. Prevention science : the official journal of the Society for Prevention Research. 2015;16(3):475–485. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.


