Skip to main content
Journal of General Internal Medicine logoLink to Journal of General Internal Medicine
. 2020 Apr 6;35(8):2329–2337. doi: 10.1007/s11606-020-05777-3

Comparative Safety and Effectiveness of Direct-Acting Oral Anticoagulants Versus Warfarin: a National Cohort Study of Nursing Home Residents

Matthew Alcusky 1,, Jennifer Tjia 1, David D McManus 1,2, Anne L Hume 3, Marc Fisher 4, Kate L Lapane 1
PMCID: PMC7403286  PMID: 32291717

Abstract

Background

Research comparing direct-acting oral anticoagulants (DOACs) to warfarin has excluded nursing home residents, a vulnerable and high-risk population.

Objective

To compare the safety and effectiveness of DOACs versus warfarin.

Design

New-user cohort study (2011–2016).

Patients

US nursing home residents aged > 65 years with non-valvular atrial fibrillation enrolled in fee-for-service Medicare for > 6 months.

Exposures

Initiators of DOACs (2881 apixaban, 1289 dabigatran, 3735 rivaroxaban) were 1:1 propensity matched to warfarin initiators.

Main Measures

Outcomes included ischemic stroke or transient ischemic attack (i.e., ischemic cerebrovascular event), bleeding (extracranial or intracranial), other vascular events, death, and a composite of all outcomes. Absolute rate differences (RD) and cause-specific hazard ratios (HR) with 95% confidence intervals (CI) were estimated. Subgroup analyses were performed by alignment of DOAC dosing with labeling.

Key Results

Median age (84 years), CHA2DS2-Vasc (5), and ATRIA risk scores (3) were similar across medications. Clinical outcome rates were similar for dabigatran and rivaroxaban users versus warfarin users. However, ischemic cerebrovascular event rates were higher among dabigatran and rivaroxaban users that received reduced dosages without an indication. Overall, apixaban users had higher ischemic cerebrovascular event rates (HR 1.86; 95% CI 1.00–3.45) and lower bleeding rates (HR 0.66; 95% CI 0.49–0.88), but outcome rates varied by dosing alignment. Mortality rates (per 100 person-years) were lower for apixaban (RDs − 9.30; 95% CI − 13.18 to − 5.42), dabigatran (RDs − 10.79; 95% CI − 14.98 to − 6.60), and rivaroxaban (RDs − 8.92; 95% CI − 12.01 to − 5.83) versus warfarin; composite outcome findings were similar.

Conclusions

Among US nursing home residents, the DOACs were each associated with lower mortality versus warfarin. Misaligned DOAC dosing was common in nursing homes and was associated with clinical and mortality outcomes. Overall, DOAC users had lower rates of adverse outcomes including mortality compared with warfarin users.

Electronic supplementary material

The online version of this article (10.1007/s11606-020-05777-3) contains supplementary material, which is available to authorized users.

KEY WORDS: comparative effectiveness, anticoagulants, atrial fibrillation, nursing homes

INTRODUCTION

The RE-LY,1 ROCKET-AF,2 and ARISTOTLE3 trials demonstrated superiority or non-inferiority in safety and effectiveness for each of the direct-acting oral anticoagulants (DOACs) versus warfarin, but excluded nursing home (NH) residents. Observational evidence comparing the safety and effectiveness of warfarin and the DOACs for older adults has also been limited to community-dwelling patients.46 Generalizability to NH settings is complicated because residents have greater functional limitations, cognitive impairment, polypharmacy, and comorbidities.7

To address uncertainty regarding the relative safety and effectiveness of the DOACs and warfarin in the contemporary NH setting, we separately compared new users of apixaban, rivaroxaban, and dabigatran to new users of warfarin in a national cohort of NH residents with atrial fibrillation. Motivated by earlier reports describing deviation from labeled dosing,7, 8 we also examined heterogeneity in estimates across strata defined by alignment (or misalignment) of DOAC dosing with labeling recommendations.

METHODS

Data Sources

Data were obtained through a data use agreement with the Centers for Medicare and Medicaid Services. The Master Beneficiary Summary File contained vital status and enrollment in Medicare and Medicaid. Medicare Part A provided inpatient and skilled nursing facility (SNF) records. Medication dispensing records and drug characteristics were sourced from the Medicare Part D Event and Characteristics Files. The Minimum Data Set (MDS) 3.0, composed of (previously validated)9 national data collected through mandatory assessments, provided information on SNF and long-stay residents in Medicare/Medicaid-certified NHs (96% of US NHs). The UMassMed IRB approved this study (H00015376).

Study Design

A retrospective cohort study compared NH residents initiating apixaban, rivaroxaban, or dabigatran to warfarin initiators during the period July 01, 2011, to December 31, 2016. The index date was the first observed dispensing of an oral anticoagulant. Indexing of new DOAC users began in the month following marketing of apixaban (12/2012) and rivaroxaban (11/2011). Follow-up continued until a study outcome; anticoagulant discontinuation (treatment gap > 14 days); anticoagulant switch; end of Medicare Parts A, B, and D fee-for-service enrollment; or end of the study period (12/31/2016).

Source Population

The population included residents of US NHs > 65 years of age and diagnosed with non-valvular atrial fibrillation who newly initiated a DOAC or warfarin. Included residents had > 6 months of pre-index Medicare fee-for-service enrollment and at least one diagnosis for atrial fibrillation, atrial flutter, or dysrhythmia on Part A or MDS 3.0 records during the pre-index year (Supplemental Table 1). Because medications in hospitals, SNF, or hospice settings are not included in Part D data, we excluded residents in these settings on the index date. We also excluded residents with another indication for anticoagulant initiation based on an inpatient diagnosis of venous thromboembolism (VTE), valvular disease, or total hip/knee replacement during the baseline 6 months. Residents with cancer or in a coma were also excluded.

Anticoagulant Use

We operationalized anticoagulant use to evaluate specific anticoagulants (warfarin, apixaban, dabigatran, rivaroxaban). New users were residents initiating one of these medications without prior use of an oral anticoagulant in the preceding 6 months. The date of the first oral anticoagulant dispensing was the index date. Following the index dispensing, an as-treated approach was implemented using fill dates and number of days supplied from Part D claims to determine if residents remained exposed to the index medication on each day of follow-up. The end of treatment was assigned once the supply from the most recent medication fill was depleted and a gap in treatment of > 14 days occurred. Because DOACs are available in two dosages, we categorized residents as initiating standard or reduced doses. Rivaroxaban 10 mg users were considered less than standard dose users not aligned with labeling.

Outcomes

Primary time-to-event outcomes included ischemic cerebrovascular event (ischemic stroke or transient ischemic attack (TIA)), intracranial or extracranial (all non-cerebral sites) bleeding, and a composite net clinical benefit outcome comprising ischemic stroke, TIA, intracranial bleeding, extracranial bleeding, venous thromboembolism (VTE), acute myocardial infarction (AMI), systemic embolism, and all-cause mortality. Each of the components of the net clinical benefit outcome was evaluated as secondary outcome. All clinical outcomes were operationalized from diagnoses on hospitalization records using validated ICD-9 code-based algorithms (Supplemental Table 1),1013 which were converted to ICD-10 using General Equivalence Mapping.14 All outcomes were evaluated for the maximum duration of follow-up.

Covariates

Covariates included sociodemographics, the CHA2DS2-VASc15 and ATRIA16 risk scores, and their components, hospitalizations, medication use, cognitive impairment, and functioning in activities of daily living (ADLs). Baseline hospitalizations for clinical events were recorded (Supplemental Table 1).10, 12 The number of hospitalizations and unique medications during the pre-index 6 months was summed. Residents were classified as users of medication classes (antiplatelets, non-steroidal anti-inflammatory drugs, statins, angiotensin-converting enzyme inhibitors and angiotensin receptor blockers, selective serotonin reuptake inhibitors) associated with study outcomes1721 if > 1 Part D claim was present during the pre-index 6 months.

Comorbid clinical conditions were operationalized using information from MDS 3.0 assessments with the exception of renal functioning, which was categorized as no impairment, chronic renal insufficiency without end-stage disease or dialysis,22 end-stage renal disease (MDS item I1500) without dialysis, and dialysis (MDS item O0100J2). Cognitive status was categorized using the MDS 3.0 Cognitive Function Scale.23 Functional limitations were summarized using the ADL score (range 0–16, higher scores indicate greater limitation).24

Statistical Analysis

We developed three separate cohorts for each DOAC using nearest neighbor propensity score matching (caliper 0.05) to assemble comparable groups of warfarin initiators. Propensity score estimation included the above-described covariates (each associated with > 1 outcome),1721, 2527 avoiding bias from inclusion of variables only associated with exposure.2830 Matching was performed within index year to identify a comparison group that reflected prevailing real-world treatment conditions during a given period. After matching, all characteristics with sufficient prevalence in the cohort (> 5%) to represent potential confounding threats were well-balanced (standardized difference < 0.10).31

Incidence rates were calculated for all primary and secondary outcomes. Cox proportional hazards models estimated cause-specific hazard ratios to account for competing risks of other study outcomes. To avoid censoring patients who experienced a clinical event and then died shortly thereafter, residents were not censored for clinical events in all-cause mortality analyses. More than half of NHs contributed a single resident; Cox proportional hazards frailty models which accounted for state-level clustering did not change estimates. Dose was examined in combination with renal function as a source of heterogeneity. Pre-specified analyses were performed within subgroups defined by DOAC dose alignment with labeling (Supplemental Table 2).3234 To evaluate channeling bias in the early DOAC post-approval period,35 we conducted stratified analyses by halves of the study period. To examine the effects of the drug interaction between anticoagulants and antiplatelets, stratified analyses were performed. The proportional hazards assumption was evaluated graphically (log-log plots and plots of Schoenfeld residuals) and satisfied for all models.

Sensitivity Analyses

To examine residual confounding, hospitalizations for pneumonia and chronic obstructive pulmonary disease (COPD) were evaluated as falsification outcomes not expected to be associated with treatment.36, 37

RESULTS

Among 3422 apixaban, 3758 rivaroxaban, and 1289 dabigatran initiators, 84%, 99%, and 100% were matched to warfarin initiators. The matched apixaban, rivaroxaban, and dabigatran cohorts were drawn from 2599, 3065, and 1549 facilities, respectively.

Resident Characteristics

Resident characteristics were summarized by treatment for the eligible population (n = 21,346; Supplemental Table 3) and within matched cohorts (Table 1). Warfarin and DOAC users within each cohort had median CHA2DS2-Vasc risk scores of 5 (Q1 4, Q3 6) and ATRIA risk scores of 3 (Q1 3, Q3 6).

Table 1.

Characteristics of Residents Treated with Apixaban, Dabigatran, Rivaroxaban, and Matched Warfarin Users

Apixaban cohort Dabigatran cohort Rivaroxaban cohort
Apixaban n = 2881 Warfarin n = 2881 Dabigatran n = 1289 Warfarin n = 1289 Rivaroxaban n = 3735 Warfarin n = 3735
Demographics
  Age in years, median (Q1, Q3) 84 (77, 89) 84 (76, 89) 83 (77, 89) 83 (77, 89) 84 (77, 89) 84 (77, 89)
  Women (%) 68.5 67.8 67.2 69.7 69.3 68.2
  Non-white race/ethnicity (%) 15.6 15.1 13.8 13.0 15.0 15.0
  Enrolled in Medicaid (%) 68.5 70.3 74.9 72.2 72.1 71.8
Hospital admissions in prior year (%)
  1 36.8 37.9 33.4 31.3 36.1 36.4
  2–3+ 33.4 32.7 30.1 31.0 30.6 28.6
  Ischemic stroke 12.7 12.8 12.6 11.4 10.6 10.6
  Extracranial or intracranial bleed 1.8 1.8 1.5 1.8 1.3 1.5
Time since first observed nursing home entry, median (Q1, Q3) 588 (103, 1319) 609 (114, 1287) 325 (108, 618) 302 (100, 617) 543 (118, 1073) 585 (120, 1103)
Unique medications, median (Q1, Q3) 21 (13, 31) 22 (13, 32) 17 (11, 25) 16 (10, 24) 21 (13, 30) 21 (13, 31)
DOAC dose (%)
  Less than standard 50.3 NA 42.1 NA 59.4 NA
Select medications (%)
  NSAID 35.5 36.4 28.2 25.6 35.1 36.7
  Antiplatelet 25.0 23.7 23.0 22.7 22.7 22.2
  Statin 59.5 60.5 49.4 45.5 54.9 55.5
  SSRI 47.2 48.2 45.6 46.2 48.9 49.3
  ACE inhibitor or ARB 62.0 62.4 59.4 57.0 60.9 60.6
Comorbidities(%)
  Diabetes 39.5 37.5 37.2 35.7 35.3 35.7
  Heart failure 35.8 34.8 36.9 36.5 33.4 33.6
  Hypertension 85.9 85.7 84.2 83.4 83.9 84.0
  Coronary artery disease 29.9 27.5 29.3 28.1 26.4 25.6
  Anemia 29.5 28.8 27.4 26.4 28.8 29.4
  Fall history 16.4 17.8 17.1 15.4 19.0 19.7
  Stroke 22.0 21.4 24.7 23.5 22.5 21.7
Renal impairment
  Chronic renal insufficiency 22.1 23.4 16.8 16.1 19.4 20.4
  End-stage renal disease 13.7 13.8 11.5 12.7 11.5 12.5
  Dialysis 3.1 3.7 Suppressed per DUA Suppressed per DUA 0.5 0.6
  History of pneumonia 6.0 7.2 5.5 5.8 7.0 6.0
  Chronic lung disease 26.5 27.3 26.8 29.6 27.9 28.0
CHA2DS2-Vasc risk score, median (Q1,Q3) 5 (4, 6) 5 (4, 6) 5 (4, 6) 5 (4, 6) 5 (4, 6) 5 (4, 6)
ATRIA bleeding risk score, median (Q1, Q3) 3 (3, 6) 3 (3, 6) 3 (3, 6) 3 (3, 6) 3 (3, 6) 3 (3, 6)
Cognitive skills (%)
  Mildly impaired 26.2 25.7 27.5 26.5 26.5 25.6
  Moderately to severely impaired 32.8 33.0 33.1 34.7 37.0 37.0
ADL score (0–16), median (Q1, Q3) 10 (7, 11) 10 (7, 11) 9 (6, 11) 9 (7, 11) 10 (7, 12) 10 (8, 12)
Life expectancy > 6 months 99.5 99.7 > 99.5 > 99.5 > 99.0 > 99.0

ADLs activities of daily living, NSAID non-steroidal anti-inflammatory drugs, SSRI selective serotonin reuptake inhibitor, ACE angiotensin-converting enzyme, ARB angiotensin receptor blocker, DUA data use agreement, DOAC direct-acting oral anticoagulant

Follow-up

The median duration of follow-up in the apixaban cohort was 137 (Q1 45, Q3 326) days for apixaban and 124 (Q1 40, Q3 285) days for warfarin users, during which time 663 events and 767 events occurred over 1792 and 1602 person-years, respectively. Median follow-up was 134 (Q1 44, Q3 162) days for dabigatran and 212 (Q1 57, Q3 580) days for matched warfarin users, during which time 372 and 571 events occurred during 1153 and 1384 person-years, respectively. Median follow-up was 139 (Q1 42, Q3 374) days for rivaroxaban and 147 (Q1 44, Q3 376) days for warfarin users, during which time 1049 and 1223 events occurred over 2710 and 2722 person-years, respectively. The most common reason for censoring was end of the study in the apixaban cohort and medication discontinuation in the dabigatran and rivaroxaban cohorts (Supplemental Table 4).

Apixaban Versus Warfarin

The incidence of ischemic stroke/TIA was 1.67 events/100 person-years among apixaban users and 0.94 events/100 person-years among warfarin users (Fig. 1; Table 2). Bleeding (intracranial and extracranial) rates were 4.35 and 6.74 events per 100 person-years among apixaban and warfarin users, respectively.

Figure 1.

Figure 1

Absolute differences in clinical event, mortality, and composite outcome rates between direct-acting oral anticoagulant and warfarin users. TIA, transient ischemic attack; AMI, acute myocardial infarction; VTE, venous thromboembolism; SE, systemic embolism.

Table 2.

Number of Events and Incidence Rates by Anticoagulant in Matched Cohorts of DOAC and Warfarin Users

No. of events Events/100 PYs No. of events Events/100 PYs Rate difference (95% CI)
Apixaban n = 2881 Warfarin n = 2881 Apixaban vs. warfarin
Ischemic stroke/TIA 30 1.67 15 0.94 0.73 (− 0.03 to 1.49)
Ischemic stroke 24 1.34 13 0.81 0.53 (− 0.16 to 1.22)
Bleeding 78 4.35 108 6.74 − 2.39 (− 3.99 to − 0.79)
AMI/VTE/SE 41 2.29 54 3.37 − 1.08 (− 2.22 to 0.06)
Mortality† 554 30.7 645 40.0 − 9.30 (− 13.18 to − 5.42)
Composite 669 37.0 767 47.9 − 10.90 (− 15.31 to − 6.49)
Dabigatran n = 1289 Warfarin n = 1289 Dabigatran vs. Warfarin
Ischemic stroke/TIA 20 1.73 26 1.88 − 0.15 (− 1.20 to 0.90)
Ischemic stroke 14 1.21 18 1.30 − 0.09 (− 0.96 to 0.78)
Bleeding 70 6.07 73 5.28 0.79 (− 1.08 to 2.66)
AMI/VTE/SE 25 2.17 44 3.18 − 1.01 (− 2.27 to 0.25)
Mortality† 283 24.3 496 35.09 − 10.79 (− 14.98 to − 6.60)
Composite 372 32.25 571 41.27 − 9.02 (− 13.73 to − 4.31)
Rivaroxaban n = 3735 Warfarin n = 3735 Rivaroxaban vs. warfarin
Ischemic stroke/TIA 50 1.84 46 1.69 0.15 (− 0.56 to 0.86)
Ischemic stroke 37 1.36 36 1.32 0.04 (− 0.58 to 0.66)
Bleeding 175 6.46 164 6.02 0.44 (− 0.89 to 1.77)
AMI/VTE/SE 76 2.80 84 3.08 − 0.28 (− 1.19 to 0.63)
Mortality† 824 30.15 1052 38.07 − 8.92 (− 12.01 to − 5.83)
Composite 1049 38.70 1223 44.91 − 6.21 (− 9.65 to − 2.77)

Matched on propensity scores that were estimated using the following variables: age, sex, cognitive status, functioning in activities of daily living, CHA2DS2-Vasc score, ATRIA score, number of recent hospitalizations, recent ischemic stroke hospitalization, recent TIA hospitalization, recent AMI hospitalization, recent systemic embolism hospitalization, recent extracranial bleed hospitalization, recent intracranial hemorrhage hospitalization, renal functioning, recent fall, hip fracture, coronary artery disease, peripheral vascular disease, anemia, diabetes, heart failure, hypertension, stroke, hemiplegia, aphasia, use of ACE inhibitors/ARBs, NSAID use, antiplatelet use, statin use, selective serotonin reuptake inhibitor use, and number of unique medications

†40 apixaban (7.2% of those who died) and 58 (8.9%) warfarin users experienced a clinical event prior to death; 26 (9.2%) dabigatran and 68 (13.7%) warfarin users experienced a clinical event prior to death; 76 (9.2%) rivaroxaban users and 123 (11.7%) warfarin users experienced a clinical event prior to death

TIA transient ischemic attack, AMI acute myocardial infarction, VTE venous thromboembolism, SE systemic embolism, DOAC direct-acting oral anticoagulant, ACE angiotensin-converting enzyme, ARBs angiotensin receptor blockers, NSAIDS non-steroidal anti-inflammatory drugs

Hazard ratios comparing apixaban to warfarin were 1.86 (95% CI 1.00–3.45) for ischemic stroke/TIA and 0.66 (0.49–0.88) for bleeding (Table 3). The mortality hazard ratio closely resembled the composite hazard ratio (HR 0.79; 95% CI 0.71–0.88). Estimates for individual clinical components were directionally aligned with the composite outcomes, with modest variation in magnitude (Supplemental Table 5).

Table 3.

Incidence Rates and Results of Cox Proportional Hazards Models Comparing Matched DOAC and Warfarin Groups Overall and by Time Period

Apixaban versus warfarin
2013–2016                                    2015–2016                               2013–2014
Overall (n = 5762) Apixaban (n = 2333) Warfarin (n = 2333) Apixaban (n = 548) Warfarin (n = 548)
HR (95% CI) No. of events (rate per 100 PYs) HR (95% CI) No. of events (rate per 100 PYs) HR (95% CI)
Ischemic stroke/TIA† 1.86 (1.00–3.45) Suppressed per DUA Suppressed per DUA 2.71 (1.21–6.06) Suppressed per DUA Suppressed per DUA 0.89 (0.31–2.55)
Bleeding 0.66 (0.49–0.88) 61 (5.18) 78 (7.18) 0.73 (0.52–1.02) 17 (2.77) 30 (5.81) 0.49 (0.27–0.89)
AMI/VTE/SE† 0.70 (0.46–1.05) Suppressed per DUA Suppressed per DUA 0.89 (0.55–1.43) Suppressed per DUA Suppressed per DUA 0.36 (0.16–0.83)
Mortality 0.78 (0.70–0.88) 407 (37.29) 468 (39.60) 0.81 (0.71–0.93) 147 (23.70) 180 (34.52) 0.70 (0.57–0.88)
Composite 0.79 (0.71–0.88) 495 (27.58) 551 (30.70) 0.84 (0.74–0.95) 168 (27.38) 216 (41.86) 0.67 (0.55–0.82)
Dabigatran versus warfarin
2011–2016                                    2014–2016                               2011–2013
Overall (n = 2578) Dabigatran (n = 378) Warfarin (n = 378) Dabigatran (n = 911) Warfarin (n = 911)
HR (95% CI) No. of events (rate per 100 PYs) HR (95% CI) No. of events (rate per 100 PYs) HR (95% CI)
Ischemic stroke/TIA† 0.92 (0.51–1.65) Suppressed per DUA Suppressed per DUA NE Suppressed per DUA Suppressed per DUA 0.87 (0.47–1.58)
Bleeding 1.10 (0.80–1.53) 16 (6.19) 17 (6.66) 0.93 (0.47–1.84) 54 (6.04) 56 (4.96) 1.16 (0.80–1.69)
AMI/VTE/SE 0.66 (0.40–1.09) 16 (1.79) 31 (2.74) 0.69 (0.29–1.61) 130 (21.93) 160 (30.69) 0.65 (0.35–1.18)
Mortality 0.68 (0.59–0.79) 212 (23.48) 398 (34.42) 0.71 (0.53–0.97 71 (27.25) 98 (38.12) 0.67 (0.57–0.79)
Composite 0.76 (0.67–0.87) 280 (31.28) 454 (40.24) 0.78 (0.59–1.02) 92 (35.57) 117 (45.83) 0.76 (0.65–0.88)
Rivaroxaban versus warfarin
2011–2016                                    2014–2016                              2011–2013
Overall (n = 7470) Rivaroxaban (n = 2832) Warfarin (n = 2832) Rivaroxaban (n = 903) Warfarin (n = 903)
HR (95% CI) No. of events (rate per 100 PYs) HR (95% CI) No. of events (rate per 100 PYs) HR (95% CI)
Ischemic stroke/TIA 1.09 (0.73–1.63) 34 (1.89) 23 (1.29) 1.48 (0.87–2.51) 16 (1.75) 23 (2.46) 0.71 (0.38–1.34)
Bleeding 1.07 (0.87–1.33) 118 (6.58) 123 (6.88) 0.96 (0.74–1.23) 57 (6.22) 41 (4.39) 1.42 (0.95–2.13)
AMI/VTE/SE 0.91 (0.67–1.24) 62 (3.46) 56 (3.13) 1.10 (0.77–1.58) 14 (1.53) 28 (3.00) 0.52 (0.27–0.98)
Mortality 0.79 (0.72–0.87) 563 (31.17) 709 (39.15) 0.80 (0.71–0.89) 261 (28.18) 343 (36.00) 0.78 (0.60–0.92)
Composite 0.86 (0.79–0.94) 725 (40.40) 830 (46.39) 0.87 (0.79–0.96) 324 (35.36) 393 (42.08) 0.84 (0.73–0.97)

Matched on propensity scores that were estimated using the following variables: age, sex, cognitive status, functioning in activities of daily living, CHA2DS2-Vasc score, ATRIA score, number of recent hospitalizations, recent ischemic stroke hospitalization, recent TIA hospitalization, recent AMI hospitalization, recent systemic embolism hospitalization, recent extracranial bleed hospitalization, recent intracranial hemorrhage hospitalization, renal functioning, recent fall, hip fracture, coronary artery disease, peripheral vascular disease, anemia, diabetes, heart failure, hypertension, stroke, hemiplegia, aphasia, use of ACE inhibitors/ARBs, NSAID use, antiplatelet use, statin use, selective serotonin reuptake inhibitor use, and number of unique medications

†Cell sizes suppressed so that no cell was < 11 per data use agreement

TIA transient ischemic attack, AMI acute myocardial infarction, VTE venous thromboembolism, SE systemic embolism, NE not estimable, HR hazard ratio, CI confidence interval, DOAC direct-acting oral anticoagulant, DUA data use agreement

In analyses exploring heterogeneity by alignment of dosing with labeling recommendations, hazard ratios comparing bleeding rates between apixaban and warfarin consistently favored apixaban except in the subgroup receiving standard dose apixaban in the presence of an indication for dose reduction (Fig. 2; Supplemental Table 6). Although point estimates for ischemic stroke/TIA consistently favored warfarin, the number of events was small in each subgroup. Mortality (and composite) rates were lower among aligned standard dose apixaban users and among low dose apixaban users without an indication for dose reduction.

Figure 2.

Figure 2

Results of Cox proportional hazards models comparing ischemic stroke/transient ischemic attack (TIA), bleeding, and mortality rates by dose between apixaban and warfarin users (top), dabigatran and warfarin users (middle), and rivaroxaban and warfarin users (bottom*). Asterisk indicates the axis for rivaroxaban versus warfarin was scaled to maintain consistency with the other plots.

In analyses by index year (Table 3), point estimates favored apixaban for all outcomes among those initiating anticoagulants in 2013–2014. Associations were attenuated, or in the case of ischemic stroke/TIA, reversed among those initiating during 2015–2016. Stratified analyses by antiplatelet use suggested heterogeneity may exist in the treatment-outcome association (Supplemental Table 7). Associations between treatment and the falsification outcomes pneumonia and COPD were not indicative of strong residual cofounding (Supplemental Table 8). Modest heterogeneity by sex and race/ethnicity was observed for stroke/TIA only (Supplemental Table 9).

Dabigatran Versus Warfarin

The incidence of ischemic stroke/TIA among dabigatran and warfarin users was 1.73 and 1.88 events per 100 person-years, respectively. Bleeding rates per 100 person-years were 6.07 (dabigatran) and 5.28 (warfarin). Hazard ratios did not suggest a meaningful difference in the rate of either outcome. Mortality and composite event rates were lower among dabigatran users.

Although confidence intervals were wide, point estimates for ischemic stroke/TIA favored dabigatran across dosing subgroups with the exception of those receiving less than standard dosing without an indication (Fig. 2, Supplemental Table 6). Bleeding rates were comparable for dabigatran and warfarin users across dosing subgroups with the exception of the group receiving standard doses in the presence of an indication for dose reduction. Mortality and composite rates were lower among dabigatran users in each dosing subgroup except for those receiving standard doses in the presence of an indication for dose reduction.

Rivaroxaban Versus Warfarin

The incidence of ischemic stroke/TIA was 1.84 events/100 person-years among rivaroxaban and 1.69 events/100 person-years among warfarin users. Bleeding rates were 6.46 (rivaroxaban) and 6.02 (warfarin) events per 100 person-years. Intracranial hemorrhage, mortality, and composite event rates were lower among rivaroxaban users. As in the apixaban cohort, heterogeneity in the incidence of ischemic and bleeding events was observed between warfarin initiators in the first and second halves of the study period (Table 3).

In subgroup analyses by dosing alignment (Fig. 2, Supplemental Table 6), mortality and composite event rates were lower among standard dose rivaroxaban users but not among low dose rivaroxaban users, regardless of indication. Bleeding rates were higher among low dose rivaroxaban users with an indication for dose reduction, while ischemic stroke/TIA rates were higher among low dose rivaroxaban users without an indication.

DISCUSSION

In this national study of US NH residents, apixaban, rivaroxaban, and dabigatran were associated with lower mortality rates compared with warfarin. Treatment-outcome associations for clinical endpoints varied between DOACs. Heterogeneity was observed across dosing subgroups and over the study period. In aggregate, the results of this first investigation of the comparative effectiveness of the DOACs versus warfarin among NH residents suggested that DOAC use was associated with lower rates of adverse outcomes including mortality compared with warfarin.

Despite the large burden of vascular risk factors in the NH population, we observed ischemic stroke rates generally consistent with anticoagulants in BAFTA and the DOAC trials.13, 38 Rates of major bleeding, a more stringent definition than our hospitalization outcome, ranged from 2.1 to 3.6 for the DOACs and 3.1 to 3.4 for warfarin across trials.13 Unlike the generally similar safety and effectiveness outcome rates, mortality rates in trials13, 38 were one-fifth to one-third the mortality rates in the NH setting. Consistent with our findings, all-cause mortality rates were lower for the DOACs versus warfarin in trials13 and in Medicare.5 Other comparative studies among community-dwelling older adults which did not consider dosing have generally reported similar findings to the DOAC trials, with mixed signals of potential safety and effectiveness benefits for specific DOACs versus warfarin across studies.46

Utilization of low and misaligned DOAC dosages was more prevalent in the NH than in community-based cohorts.8, 39 Although some fraction of such dosing is potentially inappropriate, deviation from labeled dosing is also likely to occur as a consequence of shared decision-making between clinicians, caregivers, and patients (as recommended in clinical guidelines40). Our results can be used as inputs into such shared decision-making processes, which should consider how safety and effectiveness of alternative medication and dosing regimens align with an individual’s characteristics and goals of care. Dose-specific evidence on the safety and effectiveness of low DOAC dosages is limited, particularly among high-risk older adults. The 75 mg dabigatran dose, which is only marketed in the USA, was not studied in the RE-LY trial.1 Only pooled analyses were reported for rivaroxaban doses in ROCKET-AF.2 Estimates for the 2.5 mg apixaban dose were consistent with the 5 mg dose in ARISTOTLE, although the sample size was small.3

Our findings were consistent with earlier research studying off-label dosing. Among community-dwelling patients, ischemic stroke rates were higher among low dose apixaban users with and without a renal indication.8 For apixaban users considered underdosed (i.e., 2.5 mg without a renal indication), the ischemic stroke risk was nearly five times greater than among apixaban 5 mg users, with similar bleeding rates.8 A pooled analysis of all 3 DOACs indicated that standard dosing in patients with a renal indication was associated with a more than twofold higher risk of major bleeding without a countervailing benefit for stroke risk.8 Another study of community-dwelling ORBIT-AF registry members reported similar off-label dosing-outcome associations.39

Low dose apixaban and rivaroxaban users (with or without an indication) had higher rates of ischemic stroke/TIA, while underdosing (but not low dosing by indication) of dabigatran was associated with elevated ischemic stroke/TIA risk. The increased bleeding rate among aligned low dose rivaroxaban (15 mg dose is 75% of the standard dose) but not underdosed rivaroxaban users may stem from the 36% of underdosed residents using rivaroxaban 10 mg (50% of standard) off-label. The protective association with mortality for underdosed DOACs, which was not present for aligned low dosages of apixaban or rivaroxaban, requires further study. Subtherapeutic dosing is expected to be associated with lower bleeding and higher ischemic event rates. Clinicians may have prescribed low dosages of DOACs for residents on the basis of unobserved perceived risk factors for bleeding or life-threatening bleeding. Because we lack cause of death information, under-detection of fatal clinical events was possible for residents who experienced a study outcome and were not hospitalized (i.e., died in the NH). However, a larger proportion of warfarin users that died were observed to have experienced a stroke, bleed, or other vascular event prior to death compared with users of each of the DOACs (Table 2). Comparatively lower fatal bleeding risk (versus similar warfarin users) that was of greater magnitude than any comparatively higher fatal ischemic event risk is one possible mechanism consistent with the observed mortality associations among the “underdosed” subgroup.

The recency of DOAC marketing and higher costs introduced the potential for channeling bias.35 Multiple studies in community-dwelling populations have found higher socioeconomic status to be associated with higher DOAC use after accounting for other factors (including prescriber specialty),41, 42 suggesting the cost of newer (branded) DOACs may have deterred utilization for certain patients of lower socioeconomic status. The effects of cost on treatment selection were less concerning in our study because more than two-thirds of DOAC and warfarin users were dually Medicare-Medicaid enrolled (and had copay assistance).

Changes in outcomes among residents initiating warfarin before and after DOACs were commonly used suggest the quality of warfarin therapy may have been shifting over time. Alternatively, those initiating warfarin after widespread DOAC use may have been better candidates for warfarin or residents of facilities with better management of warfarin patients. We lacked laboratory values on renal functioning and time in therapeutic range. The response to warfarin is varied and therefore warfarin therapy is titrated to a target range. Our comparative estimates represent the real-world outcomes for warfarin users based on how warfarin was managed in US nursing homes during the period 2011–2016. Systematic increases or decreases in the time spent in the therapeutic range among warfarin users in nursing homes would change the relative risk for adverse outcomes in DOAC versus warfarin comparisons. Minor adverse events managed in the NH were not detected and may have differed between groups; censoring for a treatment gap was more common among DOAC users and anticoagulant switching was more common among warfarin users. Such censoring may contribute to underestimation of the event rates that would have been observed had all residents remained on their index treatment. Generalizability to community-dwelling populations may be limited by distinct medication utilization patterns and goals of care in the NH setting.

CONCLUSIONS

DOAC users had lower mortality rates than warfarin users. Misaligned DOAC dosing was common (33.5% apixaban, 40.9% dabigatran, 55.6% rivaroxaban) and less than recommended dosing was associated with higher ischemic cerebrovascular event rates and lower mortality rates (apixaban, dabigatran, and rivaroxaban) while higher than recommended dosing was associated with higher bleeding rates (apixaban and dabigatran). Ultimately, low ischemic stroke rates without excessive bleeding among both DOAC and warfarin users reinforce the clinical utility of anticoagulation with either class for older NH residents.

Electronic Supplementary Material

ESM 1 (54KB, docx)

(DOCX 53 kb).

Contributors

None.

Funding Information

The study was funded by the National Institute on Aging (R21AG060529-01). DDM’s time was also supported by R01HL126911, R01HL137734, R01HL137794, R01HL141434, R01HL136660, and U54HL143541 from the National Heart, Lung, and Blood Institute.

Compliance with ethical standards

Conflict of Interest

DDM has received research grant funding from Bristol-Myers Squibb, Boeringher-Ingelheim, Pfizer, Samsung, Philips Healthcare, Philips, Biotronik, and FlexCon and has received consultancy fees from Bristol-Myers Squibb, Pfizer, Flexcon, Boston Biomedical Associates. Other authors have no relationships to disclose.

Footnotes

Prior Presentations

35th Annual International Conference on Pharmacoepidemiology and Drug Safety, August 28, 2019

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Connolly SJ, Ezekowitz MD, Yusuf S, et al. RE-LY Steering Committee and Investigators. Dabigatran versus warfarin in patients with atrial fibrillation. N Engl J Med. 2009;361:1139–51. doi: 10.1056/NEJMoa0905561. [DOI] [PubMed] [Google Scholar]
  • 2.Patel MR, Mahaffey KW, Garg J, et al. ROCKET AF Investigators. Rivaroxaban versus warfarin in nonvalvular atrial fibrillation. N Engl J Med. 2011;365:883–91. doi: 10.1056/NEJMoa1009638. [DOI] [PubMed] [Google Scholar]
  • 3.Granger CB, Alexander JH, McMurray JJ, ARISTOTLE Committees and Investigators et al. Apixaban versus warfarin. N Engl J Med. 2011;365:981–992. doi: 10.1056/NEJMoa1107039. [DOI] [PubMed] [Google Scholar]
  • 4.Coleman CI, Peacock WF, Bunz TJ, Alberts MJ. Effectiveness and Safety of Apixaban, Dabigatran, and Rivaroxaban Versus Warfarin in Patients with Nonvalvular Atrial Fibrillation and Previous Stroke or Transient Ischemic Attack. Stroke. 2017;48(8):2142–2149. doi: 10.1161/STROKEAHA.117.017474. [DOI] [PubMed] [Google Scholar]
  • 5.Lip GY, Keshishian A, Li X, et al. Effectiveness and Safety of Oral Anticoagulants Among Nonvalvular Atrial Fibrillation Patients. Stroke. 2018;49(12):2933–2944. [DOI] [PMC free article] [PubMed]
  • 6.Martinez BK, Sood NA, Bunz TJ, Coleman CI. Effectiveness and Safety of Apixaban, Dabigatran, and Rivaroxaban Versus Warfarin in Frail Patients With Nonvalvular Atrial Fibrillation. J Am Heart Assoc. 2018;7:e008643. doi: 10.1161/JAHA.118.008643. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Alcusky M, McManus DD, Hume AL, Fisher M, Tjia J, Lapane KL. Changes in Anticoagulant Utilization among United States Nursing Home Residents with Atrial Fibrillation from 2011-2016. J Am Heart Assoc. 2019;7(9):e012023 [DOI] [PMC free article] [PubMed]
  • 8.Yao X, Shah ND, Sangaralingham LR, Gersh BJ, Noseworthy PA. Non-Vitamin K Antagonist Oral Anticoagulant Dosing in Patients With Atrial Fibrillation and Renal Dysfunction. J Am Coll Cardiol. 2017;69:2779–2790. doi: 10.1016/j.jacc.2017.03.600. [DOI] [PubMed] [Google Scholar]
  • 9.Saliba S, Buchcanan J. Development & Validation of a Revised Nursing Home Assessment Tool: MDS 3.0. Rand Health Corporation. 2008. Centers for Medicare and Medicaid Services Contract No. 500-00-0027.
  • 10.Cunningham A, Stein CM, Chung CP, Daugherty JR, Smalley WE, Ray WA. An automated database case definition for serious bleeding related to oral anticoagulant use. Pharmacoepidemiol Drug Saf. 2011;20(6):560–6. [DOI] [PMC free article] [PubMed]
  • 11.White RH, Garcia M, Sadeghi B, et al. Evaluation of the predictive value of ICD-9-CM coded administrative data for venous thromboembolism in the United States. Thromb Res. 2010;126(1):61–67. doi: 10.1016/j.thromres.2010.03.009. [DOI] [PubMed] [Google Scholar]
  • 12.Kumamaru H, Judd SE, Curtis JR, et al. Validity of claims-based stroke algorithms in contemporary medicare data: reasons for geographic and racial differences in stroke (REGARDS) study linked with medicare claims. Circ Cardiovasc Qual Outcomes. 2014;7:611–9. doi: 10.1161/CIRCOUTCOMES.113.000743. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Kiyota Y, Schneeweiss S, Glynn RJ, Cannuscio CC, Avorn J, Solomon DH. Accuracy of medicare claims-based diagnosis of acute myocardial infarction: Estimating positive predictive value on the basis of review of hospital records. Am Heart J. 2004;148(1):99–104. doi: 10.1016/j.ahj.2004.02.013. [DOI] [PubMed] [Google Scholar]
  • 14.Centers for Medicare and Medicaid Services (CMS). ICD-10-CM and GEMs. 2016. from https://www.cms.gov/Medicare/Coding/ICD10/2016-ICD-10-CM-and-GEMs.html. Accessed September 5, 2018
  • 15.Lip GYH, Nieuwlaat R, Pisters R, Lane DA, Crijns HJGM. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: The Euro Heart Survey on atrial fibrillation. Chest. 2010;137(2):263–272. doi: 10.1378/chest.09-1584. [DOI] [PubMed] [Google Scholar]
  • 16.Fang MC, Go AS, Chang Y, et al. A new risk scheme to predict warfarin-associated hemorrhage: The ATRIA (Anticoagulation and Risk Factors in Atrial Fibrillation) Study. J Am Coll Cardiol. 2011;58:395–401. doi: 10.1016/j.jacc.2011.03.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Bangalore S, Fakheri R, Toklu B, Ogedegbe G, Weintraub H, Messerli FH. Angiotensin-Converting Enzyme Inhibitors or Angiotensin Receptor Blockers in Patients Without Heart Failure? Insights From 254,301 Patients From Randomized Trials. Mayo Clin Proc. 2016;91(1):51–60. doi: 10.1016/j.mayocp.2015.10.019. [DOI] [PubMed] [Google Scholar]
  • 18.Coxib and traditional NSAID Trialists' (CNT) Collaboration. Bhala N, Emberson J, et al. Vascular and upper gastrointestinal effects of non-steroidal anti-inflammatory drugs: meta-analyses of individual participant data from randomised trials. Lancet. 2013;382(9894):769–79. doi: 10.1016/S0140-6736(13)60900-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Quinn GR, Singer DE, Chang Y, et al. Effect of selective serotonin reuptake inhibitors on bleeding risk in patients with atrial fibrillation taking warfarin. Am J Cardiol. 2014;114:583–6. doi: 10.1016/j.amjcard.2014.05.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Dans AL, Connolly SJ, Wallentin L, et al. Concomitant use of antiplatelet therapy with dabigatran or warfarin in the Randomized Evaluation of Long-Term Anticoagulation Therapy (RE-LY) trial. Circulation. 2013;127(5):634–40. doi: 10.1161/CIRCULATIONAHA.112.115386. [DOI] [PubMed] [Google Scholar]
  • 21.Yebyo HG, Aschmann HE, Kaufmann M, Puhan MA. Comparative effectiveness and safety of statins as a class and of specific statins for primary prevention of cardiovascular disease: A systematic review, meta-analysis, and network meta-analysis of randomized trials with 94,283 participants. Am Heart J. 2019;210:18–28. doi: 10.1016/j.ahj.2018.12.007. [DOI] [PubMed] [Google Scholar]
  • 22.Winkelmayer WC, Schneeweiss S, Mogun H, Patrick AR, Avorn J, Solomon DH. Identification of individuals with CKD from medicare claims data: A validation study. Am J Kidney Dis. 2005;46(2):225–232. doi: 10.1053/j.ajkd.2005.04.029. [DOI] [PubMed] [Google Scholar]
  • 23.Thomas KS, Dosa D, Wysocki A, Mor V. The Minimum Data Set 3.0 Cognitive Function Scale. Med Care. 2017;55(9):e68–e72. doi: 10.1097/MLR.0000000000000334. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Morris J, Fries B, Morris S. Scaling ADLs with the MDS. J Gerontol A Biol Sci Med Sci. 1999;54(11):M546–M553. doi: 10.1093/gerona/54.11.m546. [DOI] [PubMed] [Google Scholar]
  • 25.Kurichi JE, Bogner HR, Streim JE, et al. Predicting 3-year mortality and admission to acute-care hospitals, skilled nursing facilities, and long-term care facilities in Medicare beneficiaries. Arch Gerontol Geriatr. 2017;73:248–256. doi: 10.1016/j.archger.2017.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Hapca S, Guthrie B, Cvoro V, et al. Mortality in people with dementia, delirium, and unspecified cognitive impairment in the general hospital: prospective cohort study of 6,724 patients with 2 years follow-up. Clin Epidemiol. 2018;10:1743–1753. doi: 10.2147/CLEP.S174807. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Leelakanok N, Holcombe AL, Lund BC, Gu X, Schweizer ML. Association between polypharmacy and death: A systematic review and meta-analysis. J Am Pharm Assoc (2003) 2017;57(6):729–738.e10. doi: 10.1016/j.japh.2017.06.002. [DOI] [PubMed] [Google Scholar]
  • 28.Wyss R, Girman CJ, LoCasale RJ, Brookhart AM, Stürmer T. Variable Selection for Propensity Score Models When Estimating Treatment Effects on Multiple Outcomes: a Simulation Study. Pharmacoepidemiol Drug Saf. 2013;22(1):77–85. [DOI] [PMC free article] [PubMed]
  • 29.Patrick AR, Schneeweiss S, Brookhart MA, et al. The implications of propensity score variable selection strategies in pharmacoepidemiology: an empirical illustration. Pharmacoepidemiol Drug Saf. 2011;20(6):551–9. doi: 10.1002/pds.2098. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Stürmer T. Variable selection for propensity score models. Am J Epidemiol. 2006;163(12):1149–1156. doi: 10.1093/aje/kwj149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Ali MS, Groenwold RH, Pestman WR, et al. Propensity score balance measures in pharmacoepidemiology: a simulation study. Pharmacoepidemiol Drug Saf. 2014;23(8):802–11. doi: 10.1002/pds.3574. [DOI] [PubMed] [Google Scholar]
  • 32.Pradaxa [package insert]. Ridgefield, CT: Boehringer Ingelheim. 2012. https://www.accessdata.fda.gov/drugsatfda_docs/label/2010/022512s000lbl.pdf. Accessed June 25, 2017.
  • 33.Xarelto [package insert]. Leverkusen, Germany: Janssen. 2011. https://www.accessdata.fda.gov/drugsatfda_docs/label/2011/022406s000lbl.pdf. Accessed June 25, 2017.
  • 34.Eliquis [package insert]. Princeton, New Jersey: Bristol Myers Squibb. 2012. https://www.accessdata.fda.gov/drugsatfda_docs/label/2012/202155s000lbl.pdf. Accessed September 1, 2017.
  • 35.Petri H, Urquhart J. Channeling bias in the interpretation of drug effects. Stat Med. 1991;10(4):577–81. doi: 10.1002/sim.4780100409. [DOI] [PubMed] [Google Scholar]
  • 36.Yale New Haven Health Services Corporation/Center for Outcomes Research & Evaluation. 2014 Measures updates and specifications report hospital-level 30-day risk-standardized readmission measures. 2014. Available at: http://altarum.org/sites/default/files/uploaded-publicationfiles/Rdmsn_Msr_Updts_HWR_0714_0.pdf. Accessed February 27, 2019.
  • 37.Lindenauer PK, Normand SLT, Drye EE, et al. Development, validation, and results of a measure of 30-day readmission following hospitalization for pneumonia. J Hosp Med. 2011;6(3):142–150. doi: 10.1002/jhm.890. [DOI] [PubMed] [Google Scholar]
  • 38.Mant J, Hobbs F, Fletcher K, et al. Warfarin versus aspirin for stroke prevention in an elderly community population with atrial fibrillation: a randomized controlled trial. Lancet. 2007;370:493–503. doi: 10.1016/S0140-6736(07)61233-1. [DOI] [PubMed] [Google Scholar]
  • 39.Steinberg BA, Shrader P, Thomas L, et al. ORBIT-AF Investigators and Patients. Off-Label Dosing of Non-Vitamin K Antagonist Oral Anticoagulants and Adverse Outcomes: The ORBIT-AF II Registry. J Am Coll Cardiol. 2016;68(24):2597–2604. doi: 10.1016/j.jacc.2016.09.966. [DOI] [PubMed] [Google Scholar]
  • 40.January CT, Wann LS, Calkins H, et al. 2019 AHA/ACC/HRS Focused Update of the 2014 AHA/ACC/HRS Guideline for the Management of Patients With Atrial Fibrillation: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Rhythm Society. J Am Coll Cardiol. 2019. (19)30209–8. [DOI] [PubMed]
  • 41.Zhu J, Alexander GC, Nazarian S, Segal JB, Wu AW. Trends and Variation in Oral Anticoagulant Choice in Patients with Atrial Fibrillation, 2010-2017. Pharmacotherapy. 2018;38(9):907–920. doi: 10.1002/phar.2158. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Steinberg BA, Shrader P, Thomas L, et al. Outcomes Registry for Better Informed Treatment of Atrial Fibrillation (ORBIT-AF) Investigators and Patients. Factors associated with non-vitamin K antagonist oral anticoagulants for stroke prevention in patients with new-onset atrial fibrillation: Results from the Outcomes Registry for Better Informed Treatment of Atrial Fibrillation II (ORBIT-AF II) Am Heart J. 2017;189:40–47. doi: 10.1016/j.ahj.2017.03.024. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ESM 1 (54KB, docx)

(DOCX 53 kb).


Articles from Journal of General Internal Medicine are provided here courtesy of Society of General Internal Medicine

RESOURCES