Abstract
Aims
Multiple endpoints with varying clinical relevance are available to establish the efficacy of device-based treatments. Given the variance among blood pressure measures and medication changes in hypertension trials, we performed a win ratio analysis of outcomes in a sham-controlled, randomised trial of renal denervation (RDN) in patients with uncontrolled hypertension despite commonly prescribed antihypertensive medications. We propose a novel prioritised endpoint framework for determining the treatment benefit of RDN compared with sham control.
Methods and results
We analysed the SPYRAL HTN-ON MED pilot study data using a prioritised hierarchical endpoint comprised of 24-hour mean ambulatory systolic blood pressure (SBP), office SBP, and medication burden. A generalised pairwise comparisons methodology (win ratio) was extended to examine this endpoint. Clinically relevant thresholds of 5 and 10 mmHg were used for comparisons of ambulatory and office SBP, respectively, and therefore to define treatment “winners” and “losers”. For a total number of 1,596 unmatched pairs, the RDN subject was the winner in 1,050 pairs, the RDN subject was the loser in 378 pairs, and 168 pairs were tied. The win ratio in favour of RDN was 2.78 (95% confidence interval [CI]: 1.58 to 5.48; p<0.001) and corresponding net benefit statistic was 0.42 (95% CI: 0.20 to 0.63). Sensitivity analyses performed with differing blood pressure thresholds and according to drug adherence testing demonstrated consistent results.
Conclusions
The win ratio method addresses prior limitations by enabling inclusion of more patient-oriented results while prioritising those endpoints considered most clinically important. Applying these methods to the SPYRAL HTN-ON MED pilot study (ClinicalTrials.gov Identifier: NCT02439775), RDN was determined to be superior regarding a hierarchical endpoint and a “winner” compared with sham control patients.
Introduction
The win ratio has been introduced as a new analytical method to report composite endpoints in clinical trials1. Unlike traditional methods that consider all contributory endpoints of equal importance and by time to event rather than clinical weight, the win ratio enables prioritisation of clinical endpoints and addresses differing risk profiles among patients by using pairwise comparisons. The win ratio has recently been applied to contemporary pharmaceutical and device-based cardiovascular trials, providing an informative, readily interpretable estimate of treatment differences2,3,4,5. Given the variance among blood pressure measures and medication changes in hypertension trials, we performed a win ratio analysis of outcomes in a sham-controlled, randomised trial of renal denervation (RDN) in patients with uncontrolled hypertension despite commonly prescribed antihypertensive medications.
Methods
STUDY DESIGN
The design and primary results of the randomised, assessor- and patient-blinded, sham-controlled SPYRAL HTN-ON MED pilot study have been published previously6,7. Briefly, patients were enrolled with both systolic and diastolic hypertension with office systolic blood pressure (SBP) ≥150 and <180 mmHg, office diastolic blood pressure ≥90 mmHg, and a mean 24-hr ambulatory SBP ≥140 and <170 mmHg despite 1 to 3 commonly prescribed antihypertensive medication classes. Patients were randomised 1:1 to RDN or sham procedure to assess the primary endpoint of change in mean 24-hr ambulatory SBP at six months. Medication adherence was assessed using tandem high-performance liquid chromatography and mass spectroscopy of urine and plasma by an independent core laboratory8. All local ethics committees approved the protocol, and written informed consent was obtained from all patients. The study complied with the Declaration of Helsinki and was registered at www.clinicaltrials.gov as NCT02439775. The authors had full access to the data and take responsibility for its integrity and the data analysis.
DATA COLLECTION AND ENDPOINTS
An automatic ambulatory blood pressure monitor (Mobil-O-Graph™; IEM GmbH, Stolberg, Germany) was used to measure ambulatory blood pressure at baseline and follow-up6,9. A composite medication index was calculated for each subject based on their prescribed blood pressure reduction medication, as described in Supplementary Appendix 110,11.
A hierarchical endpoint was created using the following six-month endpoints and prioritised in the following order of clinical importance: 24-hr mean ambulatory SBP (ASBP), followed by office SBP (OSBP), then change in medication burden (Index):
1. ΔASBP = 24-hr mean ambulatory systolic blood pressure change from baseline to follow-up;
2. ΔOSBP = Office systolic blood pressure change from baseline to follow-up;
3. ΔIndex = Prescribed medication burden change from baseline to follow-up.
STATISTICAL ANALYSIS
The win ratio was introduced in 2012 in the setting of a cardiovascular trial for heart failure1 which extended the approach described by Finkelstein and Schoenfeld12. The win ratio method was developed in the context of time-to-event endpoints, but can be readily extended to continuous, ordinal, count, and binary endpoints13,14, which is referred to as the generalised pairwise comparisons method. The approach compares every patient randomised to RDN with every patient randomised to sham control, each time noting who “won”.
Let NR and NS be the number of patients randomised to RDN and sham control, respectively. Then one constructs all NR×NS pairs. An example is shown in Figure 1A. Because each subject can only belong to a single pair in matched comparisons and would result in subjects being excluded15, unmatched comparisons were performed to include all patients in the analysis. Each pair is then compared on the prioritised endpoint that was prospectively defined. Hypothetical blood pressure reductions are shown in Figure 1B. Beginning with ambulatory SBP, if the RDN patient has a ≥5 mmHg reduction compared with the control patient, then the RDN patient is the “winner”. If the control patient has a greater decline (≥5 mmHg) compared with the RDN patient, the control patient is the “winner”; correspondingly, the RDN patient is the “loser”. Once a winner is declared by pairwise comparison, that pair is no longer available for consideration in subsequent analyses (Figure 1C). If a pairwise comparison of ambulatory SBP results is the same (i.e., a tie), then patients are compared by the next endpoint, in this case change from baseline in office SBP (Figure 1D). Note that, if one of the patients is missing endpoint data, then that pair is automatically considered a tie since it is not possible to evaluate them; such pairs are referred to as non-informative ties. For the primary analysis, the 5 mmHg threshold was chosen based on consensus that this reduction represented a minimal goal for ambulatory SBP reduction by RDN16,17,18.
For office SBP, a threshold of ≥10 mmHg was applied in the comparison of two subjects to declare a “winner”, a threshold also based on published consensus16,17,18. A sensitivity analysis was also performed using thresholds of 3.5 mmHg for ambulatory SBP and 6 mmHg for office SBP. For medication index, no threshold was imposed since reductions in either number or medication or dose may be clinically relevant. An additional sensitivity analysis was performed using medication index derived by drug testing analysis rather than prescription records.
Once all pairs have been considered, the numbers of winners (NW), losers (NL), and ties (NT) are tallied. Since each pair is mutually exclusive, NW+NL+NT=NR×NS. The win ratio statistic is calculated as RW=NW/NL. Calculation of a 95% confidence interval (CI) and p-value was performed using the bootstrap method (with 30,000 samples). A net benefit statistic, or proportion in favour of treatment statistic, was also calculated14. The net benefit (BW) is calculated as the difference between the number of winning pairs and the number of losing pairs divided by the total number of pairs: BW=(NW−NL)/NT. BW ranges from −1 (if the sham control arm is uniformly better than the RDN arm) to +1 (if the RDN arm is uniformly better than the sham control arm), and equals 0 if there is no net difference between the arms.
Statistical analyses were performed based on the intention-to-treat principle. R version 3.6.2 (R Foundation for Statistical Computing, Vienna, Austria) was used to perform all analyses. Analysis of covariance (ANCOVA) models adjusted for baseline blood pressure were used to estimate treatment effects separately for ambulatory and office SBP. The Wilcoxon-Mann-Whitney U test was used to compare change in medication index scores between treatment arms. The R package BuyseTest version 1.8.5 was used to calculate win ratios, CIs and p-values13. A p-value <0.05 was considered to be statistically significant.
Results
Adjusted treatment effects for both ambulatory and office SBP were statistically significant favouring RDN compared with sham control, as previously reported (Table 1). For each blood pressure endpoint, the statistical comparison was made on the basis of all data, and prescription medication data were also available on all randomised subjects at baseline and at six-month follow-up visit. In total, 13 patients had a change in prescription medication index value between baseline and six-month follow-up – 8 patients (19%) in the control arm, and 5 patients (13%) in the RDN cohort. The mean change in index was 0.13 units for the sham control group and 0.06 units for RDN patients (p=0.48). In the control group, the change in medication index ranged from −0.25 units to +2.5 units, whereas the changes ranged from −0.5 to +1.0 units among patients treated with RDN.
Table 1. Change from baseline statistics for ASBP and OSBP, including ANCOVA baseline adjusted treatment effects, all at six-month follow-up in the SPYRAL HTN-ON MED pilot study.
Endpoint | RDN arm Mean±SD (N) | Control arm Mean±SD (N) | ANCOVA treatment effect* | 95% CI | p-value |
ASBP (mmHg) | −9.0±11.0 (36) | −1.6±10.7 (36) | −7.0 | −12.0 to −2.1 | 0.006 |
OSBP (mmHg) | −9.4±12.5 (38) | −2.6±12.9 (40) | −6.6 | −12.4 to −0.9 | 0.025 |
* Treatment effect in favour of renal denervation. ASBP: ambulatory systolic blood pressure; OSBP: office systolic blood pressure; RDN: renal denervation |
For the prioritised endpoints analysis, 38 RDN patients and 42 sham control patients were randomised, yielding the multiple of 1,596 pairs (Figure 2). Each pair was first evaluated for change in ambulatory SBP at six-month follow-up (with a pre-specified margin of 5 mmHg), with pairs categorised as “winners” for RDN (green boxes), “losers” (orange boxes), or “ties” (blue boxes) (Figure 2). The tied pairs were subsequently carried forward for comparison of office SBP at six-month follow-up (with a margin of 10 mmHg). Any remaining ties were finally evaluated for change in medication index between baseline and six months. Altogether, there were 1,050 pairs where the RDN subject was the winner, 378 pairs where the RDN subject was the loser, and 168 pairs that were tied on completion of the stepwise analysis (Figure 2). Missing outcome data were responsible for 300/605 ambulatory SBP ties, 76/278 office SBP ties, and 0/168 medication index ties. Accordingly, the win ratio in favour of RDN was 2.78 (95% CI: 1.58 to 5.48; p<0.001). After back-transformation, this result corresponds to a 74% (95% CI: 61% to 85%) probability (2.78 / [2.78 + 1]) of winning with RDN (conditional on not being a tie). The corresponding net benefit statistic was 0.42 (95% CI: 0.20 to 0.63).
A sensitivity analysis was performed using thresholds of 3.5 mmHg and 6 mmHg for ambulatory and office SBP, respectively. In this instance, the win ratio was similar with a value of 2.67 (95% CI: 1.56 to 5.00; p<0.001). The net benefit statistic was 0.43 (95% CI: 0.21 to 0.64). In addition, the same analysis was applied when using medication index changes according to direct drug testing data versus prescription data. By this method, the win ratio was 2.43 (95% CI: 1.44 to 4.49; p=0.001).
Discussion
Emphasis on a single efficacy endpoint in device-based hypertension trials has several limitations considering clinically relevant yet different measures of blood pressure but also changes in medication dose and number. Conversely, a single composite endpoint for evaluating continuous endpoint components is unfavourable since it would require pre-specified artificial weightings, therefore underscoring the need for an alternative methodology. In the present study, the win ratio method addresses these prior limitations by enabling inclusion of more patient-oriented results while prioritising those endpoints considered most clinically important. Applying these methods to the SPYRAL HTN-ON MED pilot study6, RDN was determined to be superior regarding a hierarchical endpoint with a win ratio of 2.78 favouring RDN as the “winner” compared with sham control patients.
A novel aspect of this research is that it represents the first known application of win ratio techniques to the field of device-based hypertension treatment outcomes. Second, we have incorporated a hierarchical endpoint of multiple continuous outcomes and applied thresholds to each pairwise comparison. This approach is analogous to incorporating super-superiority margins into a prioritised endpoint framework, providing the ability to distinguish a priori clinically meaningful differences. Also with this method, generalised pairwise comparisons remain evaluable in the presence of missing data. Specifically, if there are missing data on the first component of the hierarchical endpoint, then the pair will progress to the next tier for evaluation. Traditionally, in a single endpoint comparison, subjects with missing data would usually be discarded.
The win ratio can potentially introduce efficiency to the design of a clinical trial19. Unlike conventional methods limited to composite endpoints of a single variable type, the win ratio enables analysis of composites that include time-to-event, recurrent event, continuous and/or categorical outcomes15. The impact on statistical power is complex and depends on the prioritised endpoints included in the analysis, with addition of continuous (e.g., quality-of-life measurements) and recurrent event (e.g., rehospitalisations) outcomes increasing the overall power20. Compared with larger trials involving traditional comparisons, maintenance of statistical power with smaller sample size may be achieved with lower expense3,15. Also, as demonstrated, missing data for a prioritised endpoint do not necessarily preclude the inclusion of the subject/pair at subsequent endpoint evaluations. In contrast to more common methods dependent upon time-to-first-event occurrence (e.g., Kaplan-Meier estimates, log-rank test, or Cox proportional hazards regression), the win ratio also enables assessment of multiple endpoints while permitting prioritisation of clinical endpoints that are intuitive and readily interpretable. Not only may the incidence of an event be compared, but also the time to occurrence. Finally, the win ratio can also incorporate quantitative quality-of-life scores, medication indices or other tests relevant to a therapy in addition to clinical events. As a result, the methodology has already been assimilated into prospective trial designs21. Unique to this study were three continuous endpoints - ambulatory SBP, office SBP, and medication index. Incorporating all endpoints into a single statistic as opposed to a complex multivariate (multiple outcomes) model is considered to be an advantage. In the present study, ordering of the endpoints was based on clinical justification, and the comparison thresholds used for SBP-represented measures were proposed by expert consensus16,17,18. Importantly, neither the ordering nor thresholds are fixed, such that the methodology is flexible and alternative pre-specified choices can be used. Moreover, there is no restriction on the selection of endpoints to be examined; for example, additional endpoints of interest may include reduction in diastolic blood pressure. The choice of medication index used was based on pragmatic data reduction arguments, seeking a way to balance number of medications together with their class type, prescribed dose, and standard dose. Notably, several alternative medication indices are available, including the defined daily dose22. Even the number of prescribed medications may be considered, although this model probably represents an oversimplification of change in medication burden since it neglects change in dose.
As experience grows with the win ratio method, the methodology described and illustrated herein should be considered as an additional supplementary endpoint analysis or even as a primary analysis for future trials in device-based hypertension treatment. Moreover, this methodology presents an additional perspective for both interpretation of clinical benefit and to inform shared decision making. In the former instance, the win ratio can also be translated to a probability likelihood: if the win ratio is 2.78 in the current study, then the probability that the RDN patient wins compared with sham control is 74% (2.78 / [2.78 + 1]). In a population of patients with similar enrolment criteria to ON MED, explanations of probability of benefit and outcome are especially relevant to individual patient preference. If renal denervation is efficacious, then a patient may prefer a blood pressure reduction with commensurate decline in medication burden, especially if the medication has undesirable side effects or if medication adherence is challenging. Not only can the win ratio be considered as a measure of relative benefit, but also the net benefit can be considered an absolute measure and summarise the treatment effect for all endpoints. Further, the prioritised endpoint methodology employed in this study may be generalised to allow for repeated measures. For example, medication burden assessment separately at both six and 12 months provides an extensible opportunity to analyse the long-term durability of RDN therapy. This method may therefore be especially relevant to device-based hypertension trials since medication changes per protocol are typically not allowed until later time points. Finally, the methodology can be used to assess a mixture of different endpoint types, such as inclusion of both a continuous endpoint (e.g., change from baseline in ambulatory SBP) and a binary endpoint (e.g., office SBP <140 mmHg at follow-up).
Limitations
A limitation of this analysis is that, despite demonstration of statistically significant blood pressure reductions with RDN in the SPYRAL HTN-ON MED pilot trial6, performance of the win ratio analyses is based on a limited study population. Also, unlike time-to-event outcomes (e.g., death more important than rehospitalisation), establishing the clinical priority of endpoints for continuous measures may be more ambiguous in a device-based hypertension study15. Notwithstanding this, the endpoint components, ordering, and any thresholds to be applied were reported and clinically justified prospectively in a statistical analysis plan, although this was a post hoc analysis and the study was not designed and powered for this kind of approach. Further, despite protocol recommendations for medication changes to improve blood pressure control, such changes were performed at the treating physician’s discretion and therefore may either overestimate or underestimate differences when considering patient preference and adherence. However, results were consistent in the present study when limited to actual drug adherence by testing. Longer-term follow-up regarding medication changes may amplify potential differences; however, later results were not included in the present study since control patients were permitted by protocol to cross over to RDN. Finally, the win ratio method does not account for the regression to the mean phenomenon23. Extensions to correct for this might include the use of residuals or stratified win ratio statistics, which represents an area of future research specific to this methodology.
Conclusion
The win ratio analysis allows utilisation of several endpoints in a prioritised way to assess the efficacy of device-based hypertension treatments such as renal denervation. This novel approach addresses the limitation of single endpoint measurements for efficacy and may be particularly important for assessment of long-term efficacy. When applied to the SPYRAL HTN-ON MED pilot study data to address both blood pressure and medication changes, the win ratio method demonstrates unequivocal benefit for RDN compared with sham control.
Impact on daily practice
Multiple endpoints with varying clinical relevance are available to establish the efficacy of device-based treatments. The win ratio method outlined in this paper enables inclusion of patient-oriented results while prioritising those endpoints considered most clinically important. Applying these methods to the SPYRAL HTN-ON MED pilot study, RDN was determined to be superior regarding a hierarchical endpoint and a “winner” compared with sham control patients.
Supplementary data
Acknowledgments
Acknowledgements
The principal investigators and trial steering committees designed the protocol in conjunction with the sponsor. Jessica Dries-Devlin, PhD, CMPP, and Beth Ferri, PhD, CMPP, both of Medtronic, provided editorial support. Vanessa DeBruin, MS, and Sandeep Brar, MD, provided trial design expertise and manuscript review.
Funding
This work was supported by Medtronic.
Conflict of interest statement
D. Kandzari reports institutional research/grant support from Medtronic and Ablative Solutions, and personal consulting honoraria from Medtronic. G. Hickey, S. Cohen, M. Fahy, and G. Lamberti are employees and shareholders of Medtronic. S. Pocock reports consultant fees from Medtronic outside the submitted work. M.A. Weber reports personal fees from Medtronic, Ablative Solutions, ReCor, and Boston Scientific, all outside the submitted work. M. Böhm reports personal fees from Amgen, Bayer, Servier, Medtronic, Boehringer Ingelheim, Vifor, Bristol Myers Squibb, and AstraZeneca, all outside the submitted work. F. Mahfoud is supported by Deutsche Gesellschaft für Kardiologie (DGK), and Deutsche Forschungsgemeinschaft (SFB TRR219) and has received scientific support and speaker honoraria from Bayer, Boehringer Ingelheim, Medtronic and ReCor Medical.
Abbreviations
- ANCOVA
analysis of covariance
- ASBP
ambulatory systolic blood pressure
- AVR
aortic valve replacement
- OSBP
office systolic blood pressure
- RDN
renal denervation
- SBP
systolic blood pressure
Contributor Information
David Kandzari, Department of Interventional Cardiology, Piedmont Heart Institute, Atlanta, GA, USA.
Graeme Hickey, Coronary and Structural Heart Division, Medtronic PLC, Santa Rosa, CA, USA.
Stuart Pocock, Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, United Kingdom.
Michael A. Weber, Department of Medicine, SUNY Downstate College of Medicine, Brooklyn, NY, USA.
Michael Böhm, Department of Internal Medicine III, Klinik für Innere Medizin III, Kardiologie, Angiologie, Internistische Intensivmedizin, Universitätsklinikum des Saarlandes, Saarland University, Homburg, Germany.
Sidney Cohen, Coronary and Structural Heart Division, Medtronic PLC, Santa Rosa, CA, USA.
Martin Fahy, Coronary and Structural Heart Division, Medtronic PLC, Santa Rosa, CA, USA.
Giuseppina Lamberti, Coronary and Structural Heart Division, Medtronic PLC, Santa Rosa, CA, USA.
Felix Mahfoud, Department of Internal Medicine III, Klinik für Innere Medizin III, Kardiologie, Angiologie, Internistische Intensivmedizin, Universitätsklinikum des Saarlandes, Saarland University, Homburg, Germany.
References
- Pocock SJ, Ariti CA, Collier TJ, Wang D. The win ratio: a new approach to the analysis of composite endpoints in clinical trials based on clinical priorities. Eur Heart J. 2012;33:176–82. doi: 10.1093/eurheartj/ehr352. [DOI] [PubMed] [Google Scholar]
- Bakal JA, Roe MT, Ohman EM, Goodman SG, Fox KA, Zheng Y, Westerhout CM, Hochman JS, Lokhnygina Y, Brown EB, Armstrong PW. Applying novel methods to assess clinical outcomes: insights from the TRILOGY ACS trial. Eur Heart J. 2015;36:385–92a. doi: 10.1093/eurheartj/ehu262. [DOI] [PubMed] [Google Scholar]
- Milojevic M, Head SJ, Andrinopoulou ER, Serruys PW, Mohr FW, Tijssen JG, Kappetein AP. Hierarchical testing of composite endpoints: applying the win ratio to percutaneous coronary intervention versus coronary artery bypass grafting in the SYNTAX trial. EuroIntervention. 2017;13:106–14. doi: 10.4244/EIJ-D-16-00745. [DOI] [PubMed] [Google Scholar]
- Capodanno D, Gargiulo G, Buccheri S, Chieffo A, Meliga E, Latib A, Park SJ, Onuma Y, Capranzano P, Valgimigli M, Narbute I, Makkar RR, Palacios IF, Kim YH, Buszman PE, Chakravarty T, Sheiban I, Mehran R, Naber C, Margey R, Agnihotri A, Marra S, Leon MB, Moses JW, Fajadet J, Lefevre T, Morice MC, Erglis A, Alfieri O, Serruys PW, Colombo A, Tamburino C DELTA Investigators. Computing Methods for Composite Clinical Endpoints in Unprotected Left Main Coronary Artery Revascularization: A Post Hoc Analysis of the DELTA Registry. JACC Cardiovasc Interv. 2016;9:2280–8. doi: 10.1016/j.jcin.2016.08.025. [DOI] [PubMed] [Google Scholar]
- Hara H, van Klaveren D, Takahashi K, Kogame N, Chichareon P, Modolo R, Tomaniak M, Ono M, Kawashima H, Wang R, Gao C, Niethammer M, Fontos G, Angioi M, Ribeiro VG, Barbato E, Leandro S, Hamm C, Valgimigli M, Windecker S, Jüni P, Steg PG, Verbeeck J, Tijssen JGP, Sharif F, Onuma Y, Serruys PW GLOBAL LEADERS Trial Investigators. Comparative Methodological Assessment of the Randomized GLOBAL LEADERS Trial Using Total Ischemic and Bleeding Events. Circ Cardiovasc Qual Outcomes. 2020;13:e006660. doi: 10.1161/CIRCOUTCOMES.120.006660. [DOI] [PubMed] [Google Scholar]
- Kandzari DE, Böhm M, Mahfoud F, Townsend RR, Weber MA, Pocock S, Tsioufis K, Tousoulis D, Choi JW, East C, Brar S, Cohen SA, Fahy M, Pilcher G, Kario K SPYRAL HTN-ON MED Trial Investigators. Effect of renal denervation on blood pressure in the presence of antihypertensive drugs: 6-month efficacy and safety results from the SPYRAL HTN-ON MED proof-of-concept randomised trial. Lancet. 2018;391:2346–55. doi: 10.1016/S0140-6736(18)30951-6. [DOI] [PubMed] [Google Scholar]
- Kandzari DE, Kario K, Mahfoud F, Cohen SA, Pilcher G, Pocock S, Townsend R, Weber MA, Böhm M. The SPYRAL HTN Global Clinical Trial Program: Rationale and design for studies of renal denervation in the absence (SPYRAL HTN OFF-MED) and presence (SPYRAL HTN ON-MED) of antihypertensive medications. Am Heart J. 2016;171:82–91. doi: 10.1016/j.ahj.2015.08.021. [DOI] [PubMed] [Google Scholar]
- Ewen S, Meyer MR, Cremers B, Laufs U, Helfer AG, Linz D, Kindermann I, Ukena C, Burnier M, Wagenpfeil S, Maurer HH, Böhm M, Mahfoud F. Blood pressure reductions following catheter-based renal denervation are not related to improvements in adherence to antihypertensive drugs measured by urine/plasma toxicological analysis. Clin Res Cardiol. 2015;104:1097–105. doi: 10.1007/s00392-015-0905-5. [DOI] [PubMed] [Google Scholar]
- Kario K, Böhm M, Mahfoud F, Townsend RR, Weber MA, Patel M, Tyson CC, Weil J, Agdirlioglu T, Cohen SA, Fahy M, Kandzari DE. Twenty-Four-Hour Ambulatory Blood Pressure Reduction Patterns After Renal Denervation in the SPYRAL HTN-OFF MED Trial. Circulation. 2018;138:1602–4. doi: 10.1161/CIRCULATIONAHA.118.035588. [DOI] [PubMed] [Google Scholar]
- Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, Jr, Jones DW, Materson BJ, Oparil S, Wright JT, Jr, Roccella EJ Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure. National Heart, Lung, and Blood Institute; National High Blood Pressure Education Program Coordinating Committee. Seventh report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure. Hypertension. 2003;42:1206–52. doi: 10.1161/01.HYP.0000107251.49515.c2. [DOI] [PubMed] [Google Scholar]
- Law MR, Wald NJ, Morris JK, Jordan RE. Value of low dose combination treatment with blood pressure lowering drugs: analysis of 354 randomised trials. BMJ. 2003;326:1427. doi: 10.1136/bmj.326.7404.1427. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Finkelstein DM, Schoenfeld DA. Combining mortality and longitudinal measures in clinical trials. Stat Med. 1999;18:1341–54. doi: 10.1002/(SICI)1097-0258(19990615)18:11<1341::AID-SIM129>3.0.CO;2-7. [DOI] [PubMed] [Google Scholar]
- Buyse M. Generalized pairwise comparisons of prioritized outcomes in the two-sample problem. Stat Med. 2010;29:3245–57. doi: 10.1002/sim.3923. [DOI] [PubMed] [Google Scholar]
- Peron J, Buyse M, Ozenne B, Roche L, Roy P. An extension of generalized pairwise comparisons for prioritized outcomes in the presence of censoring. Stat Methods Med Res. 2018;27:1230–9. doi: 10.1177/0962280216658320. [DOI] [PubMed] [Google Scholar]
- Redfors B, Gregson L, Crowley A, McAndrew T, Ben-Yehuda O, Stone GW, Pocock SJ. The win ratio approach for composite endpoints: practical guidance based on previous experience. Eur Heart J. 2020;41:4391–9. doi: 10.1093/eurheartj/ehaa665. [DOI] [PubMed] [Google Scholar]
- FDA Executive Summary: General Issues Panel - Clinical Evaluation of Anti-Hypertensive Devices. Gaithersburg, MD, USA: US Food and Drug Administration; 2018.
- Mahfoud F, Azizi M, Ewen S, Pathak A, Ukena C, Blankestijn PJ, Böhm M, Burnier M, Chatellier G, Durand Zaleski I, Grassi G, Joner M, Kandzari DE, Kirtane A, Kjeldsen SE, Lobo MD, Lüscher TF, McEvoy JW, Parati G, Rossignol P, Ruilope L, Schlaich MP, Shahzad A, Sharif F, Sharp ASP, Sievert H, Volpe M, Weber MA, Schmieder RE, Tsioufis C, Wijns W. Proceedings from the 3rd European Clinical Consensus Conference for clinical trials in device-based hypertension therapies. Eur Heart J. 2020;41:1588–99. doi: 10.1093/eurheartj/ehaa121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mahfoud F, Schmieder RE, Azizi M, Pathak A, Sievert H, Tsioufis C, Zeller T, Bertog S, Blankestijn PJ, Böhm M, Burnier M, Chatellier G, Durand Zaleski I, Ewen S, Grassi G, Joner M, Kjeldsen SE, Lobo MD, Lotan C, Lüscher TF, Parati G, Rossignol P, Ruilope L, Sharif F, van Leeuwen E, Volpe M, Windecker S, Witkowski A, Wijns W. Proceedings from the 2nd European Clinical Consensus Conference for device-based therapies for hypertension: state of the art and considerations for the future. Eur Heart J. 2017;38:3272–81. doi: 10.1093/eurheartj/ehx215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bebu I, Lachin JM. Large sample inference for a win ratio analysis of a composite outcome based on prioritized components. Biostatistics. 2016;17:178–87. doi: 10.1093/biostatistics/kxv032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Verbeeck J, Spitzer E, de Vries T, van Es GA, Anderson WN, Van Mieghem NM, Leon MB, Molenberghs G, Tijssen J. Generalized pairwise comparison methods to analyze (non)prioritized composite endpoints. Stat Med. 2019;38:5641–56. doi: 10.1002/sim.8388. [DOI] [PubMed] [Google Scholar]
- Spitzer E, Van Mieghem NM, Pibarot P, Hahn RT, Kodali S, Maurer MS, Nazif TM, Rodés-Cabau J, Paradis JM, Kappetein AP, Ben-Yehuda O, van Es GA, Kallel F, Anderson WN, Tijssen J, Leon MB. Rationale and design of the Transcatheter Aortic Valve Replacement to UNload the Left ventricle in patients with ADvanced heart failure (TAVR UNLOAD) trial. Am Heart J. 2016;182:80–8. doi: 10.1016/j.ahj.2016.08.009. [DOI] [PubMed] [Google Scholar]
- World Health Organization. WHO Collaborating Centre for Drug Statistics Methodology. 2018. [7 June 2020]. https://www.whocc.no/ddd/definition_and_general_considera/
- Pocock SJ, Bakris G, Bhatt DL, Brar S, Fahy M, Gersh BJ. Regression to the Mean in SYMPLICITY HTN-3: Implications for Design and Reporting of Future Trials. J Am Coll Cardiol. 2016;68:2016–25. doi: 10.1016/j.jacc.2016.07.775. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.