Skip to main content
BMJ Open logoLink to BMJ Open
. 2019 Aug 30;9(8):e028438. doi: 10.1136/bmjopen-2018-028438

Balance of benefits and harms of different blood pressure targets in people with multiple chronic conditions: a quantitative benefit-harm assessment

Hélène E Aschmann 1, Cynthia M Boyd 2, Craig W Robbins 3,4,5,6,7, Richard A Mularski 8,9,10, Wiley V Chan 11, Orla C Sheehan 12, Renée F Wilson 13, Wendy L Bennett 14, Elizabeth A Bayliss 15,16, Tsung Yu 17, Bruce Leff 2, Karen Armacost 18, Carol Glover 18, Katie Maslow 18,19, Suzanne Mintz 18,20, Milo A Puhan 1,
PMCID: PMC6720326  PMID: 31471435

Abstract

Objective

Recent studies suggest that a systolic blood pressure (SBP) target of 120 mm Hg is appropriate for people with hypertension, but this is debated particularly in people with multiple chronic conditions (MCC). We aimed to quantitatively determine whether benefits of a lower SBP target justify increased risks of harm in people with MCC, considering patient-valued outcomes and their relative importance.

Design

Highly stratified quantitative benefit-harm assessment based on various input data identified as the most valid and applicable from a systematic review of evidence and based on weights from a patient preference survey.

Setting

Outpatient care.

Participants

Hypertensive patients, grouped by age, gender, prior history of stroke, chronic heart failure, chronic kidney disease and type 2 diabetes mellitus.

Interventions

SBP target of 120 versus 140 mm Hg for patients without history of stroke.

Primary and secondary outcome measures

Probability that the benefits of a SBP target of 120 mm Hg outweigh the harms compared with 140 mm Hg over 5 years (primary) with thresholds >0.6 (120 mm Hg better), <0.4 (140 mm Hg better) and 0.4 to 0.6 (unclear), number of prevented clinical events (secondary), calculated with the Gail/National Cancer Institute approach.

Results

Considering individual patient preferences had a substantial impact on the benefit-harm balance. With average preferences, 120 mm Hg was the better target compared with 140 mm Hg for many subgroups of patients without prior stroke, especially in patients over 75. For women below 65 with chronic kidney disease and without diabetes and prior stroke, 140 mm Hg was better. The analyses did not include mild adverse effects, and apply only to patients who tolerate antihypertensive treatment.

Conclusions

For most patients, a lower SBP target was beneficial, but this depended also on individual preferences, implying individual decision-making is important. Our modelling allows for individualised treatment targets based on patient preferences, age, gender and co-morbidities.

Keywords: Blood pressure target, systolic blood pressure, hypertension, multiple chronic conditions, benefit-harm balance, benefit-harm assessment, patient preferences


Strengths and limitations of this study.

  • This is the first comprehensive benefit-harm assessment of systolic blood pressure targets in people with multiple chronic conditions (MCC), considering patient-valued outcomes and their relative importance.

  • The model is based on the most valid and applicable data from a systematic review of evidence, and on a patient preference survey to inform the relative importance of outcomes.

  • Analyses were stratified by age, gender and prevalent comorbidities, and additionally by individual preferences in a sensitivity analysis, to clarify whether the benefit-harm balance of systolic blood pressure targets depends on individual preferences.

  • Due to lacking evidence we could not include all patient-valued outcomes, in particular mild adverse events – therefore, the results apply only to people who tolerate antihypertensive treatment.

  • Techniques to measure the blood pressure differed between trials and may differ between trials and clinical practice, therefore, an interpretation of what would be the analogous targets in clinical practice may be required.

Background

Recommended blood pressure targets for people with multiple chronic conditions (MCC) and hypertension vary across guidelines.1–4 The recent publication of three randomised clinical trials (RCTs), ACCORD in people with diabetes,5 SPRINT in people without diabetes6 and SPS3 in people with lacunar stroke,7 caused debate in the medical community about the benefits and harms of systolic blood pressure (SBP) targets lower than 140 mm Hg, since lower targets reduced the risk of some cardiovascular outcomes, but increased the incidence of adverse events, and because the effect on mortality differed across the RCTs.5–8 Concerns were voiced that the absolute benefit of lower SBP targets is small and may not outweigh the absolute harm, especially in older adults with MCC.9 Furthermore, techniques to measure the blood pressure differed between trials and may differ between trials and clinical practice.1 10

The question of which blood pressure target is optimal for people with MCC and whether this differs for some groups of people was recently identified as a priority question by people with MCC and caregivers in a multi-step, mixed-methods process involving guideline developers.11 The benefit-harm balance depends on the baseline incidence for different outcomes, the relative effect of different targets and the relative importance of potential benefit and harm outcomes to the patient.12 13 Clinical guidelines often consider these three key elements when developing recommendations but often do so unsystematically and qualitatively. The National Cancer Institute has developed methods for quantitative benefit-harm assessment to elucidate the benefit-harm balance of treatment alternatives in a systematic and transparent way.13 14 Using such methods, the absolute beneficial and harmful effects on different outcomes are weighed and compared on a common scale.

In order to determine the benefit-harm balance of different blood pressure targets specifically for people with MCC, and to clarify whether the balance depends on baseline characteristics or outcome preferences, we performed quantitative assessments for a priori defined subgroups based on age, gender, prior history of stroke, chronic kidney disease (CKD), diabetes and chronic heart failure.

Methods

Study design

We performed a quantitative benefit-harm assessment and followed the Consolidated Health Economic Evaluation Reporting Standards for cost-effectiveness analyses.15 We modelled the benefit-harm balance in different subgroups according to the Gail/National Cancer Institute approach13 that has been used before to assess various prevention treatments.16–19 This method calculates absolute risk differences of treatments (ie, the difference in expected number of events for each outcome) from baseline incidence and relative effects and weighs the absolute risk differences on different outcomes according to their importance relative to each other. Importantly, it considers competing risks (eg, death), and the statistical uncertainty of input parameters.

Definition of the target population, subgroups and outcomes

The target population was people age 50 and older with hypertension and multiple chronic conditions in the USA. Based on patient and caregiver input and clinical judgement, we predefined subgroups according to prevalence and possible impact on the benefit-harm balance: age, gender, prior history of ischaemic stroke, CKD, type 2 diabetes mellitus and chronic heart failure. Based on a literature review of outcomes that have been used in relevant RCTs5–7 augmented by qualitative research with patients and caregivers,11 we aimed to include the following patient-valued outcomes: acute kidney injury (AKI), CKD, end-stage renal disease (ESRD), stroke, death, treatment burden, cognitive impairment, injurious falls, hypotension, dizziness, syncope, myocardial infarction and heart failure.

Evidence selection

Relative effects of blood pressure targets on all outcomes

Systematic search for RCTs on blood pressure targets

We systematically searched for RCTs on blood pressure targets. Since a number of systematic reviews were published recently we did not duplicate their entire search but identified relevant and recent systematic reviews first (figure 1). The detailed search methods are described in online supplementary figures S1 and S2, table S1. From the systematic reviews and update searches, we identified 20 RCTs of blood pressure targets in an adult population in a non-intensive care setting. We did not use any of the meta-analyses of the eight systematic reviews because they were either based on or standardised by achieved blood pressure, or included trials that did not compare blood pressure targets (but eg, one vs two antihypertensives), or focused on prehypertension.

Figure 1.

Figure 1

Flow chart of the search for RCTs comparing blood pressure targets based on existing systematic reviews and the RCT selection. CKD, chronic kidney disease; RCTs, randomised clinical trials; SR, systematic review.

Supplementary data

bmjopen-2018-028438supp001.pdf (1.2MB, pdf)

Inclusion and exclusion of RCTs on blood pressure targets

We excluded three RCTs with high risk of bias,20–22 as assessed with the Cochrane Risk of Bias Tool23 (see online supplementary table S2), 12 RCTs that did not report enough outcomes or events to judge the benefit-harm balance (eight reported no harm outcomes,24–31 two reported only CKD as a harm outcome32 33 and one reported only sparse data on benefit outcomes,34 and one reported only sparse data on harm outcomes35), one RCT because the study population was not our target population,36 and one because the targets that were compared were so high (<150/85 vs <180/105 mm Hg) that they were no longer clinically relevant (figure 1 and online supplementary figure S3).37 We included three RCTs: SPRINT,6 ACCORD,5 which both compared 120 mm Hg versus 140 mm Hg, and SPS3,7 8 which compared <130 mm Hg to 131 to 149 mm Hg. SPRINT included people without prior stroke and without diabetes, ACCORD included people with diabetes but without prior stroke and SPS3 included people with lacunar stroke. Notably, we could not include dizziness, cognitive impairment and treatment burden in our analysis due to lacking evidence. For treatment burden, we considered evidence on increased number of pills per day, more doctor appointments or burden due to diet and exercise.

Considerations on effect modification and heterogeneity

Our search indicated no relevant heterogeneity between subgroups in the publications of the trials, however, the relative risks reported by the three RCTs sometimes differed. In a few cases, this heterogeneity was clearly due to sparse data bias, and thus we corrected these estimates (table 1).38 39 The remaining heterogeneity was either due to different study populations or different outcome definitions. As a first step to ensure applicability, we did not pool the estimates from SPRINT, ACCORD and SPS3, but we applied the estimates to subgroups in our benefit-harm assessment according to the study population (ie, SPRINT to people without prior history of stroke and diabetes, ACCORD to people with diabetes and without stroke and SPS3 to people with stroke, respectively). In a second step, we made exceptions for a few outcomes, where we applied the estimates from SPRINT instead of ACCORD or vice-versa, when differences in estimates were judged to be due to the outcome definition rather than because of different study populations (table 1).

Table 1.

Incidence rate ratios for the comparison of different systolic blood pressure targets

Targets (mm Hg) SPRINT ACCORD SPS3
<120 vs <140 <120 vs <140 <130 vs 130–149
Target population in benefit-harm assessment
Prior history of:
 Diabetes No Yes Yes or no
 CKD Yes or no Yes or no No
 Stroke No No Yes
Benefit outcomes
 Mortality 0.74 (0.60, 0.91) 1.05 (0.83, 1.32) 1.06 (0.80, 1.41)
 Myocardial infarction 0.84 (0.63, 1.11) 0.87 (0.68, 1.11) 0.91 (0.57, 1.47)
 Heart failure 0.62 (0.44, 0.86) 0.93 (0.68, 1.26) *
 Stroke 0.89 (0.62, 1.27) 0.58 (0.38, 0.89) 0.83 (0.65, 1.06)
 ESRD 0.59 (0.18, 1.80) 0.59 (0.18, 1.80)†† *
Harm outcomes
 CKD 1.91 (1.35, 2.70)† 1.91 (1.35, 2.70) 1.41 (1.15, 1.67)‡
 Hypotension 1.70 (1.31, 2.22) 2.61 (1.21, 5.66)§ 1.55 (0.78, 3.10)
 Syncope 1.44 (1.13, 1.85) 1.44 (1.13, 1.85) 2.33 (0.71, 6.95)
 Injurious falls 1.01 (0.86, 1.18) 1.01 (0.86, 1.18)¶ 1.07 (0.54, 2.10)**
 AKI 1.70 (1.35, 2.15) 1.70 (1.35, 2.15)¶ *
 Dizziness
 Treatment burden
 Cognitive impairment

Incidence rate ratios calculated based on number of events and number of patient-years in each trial arm. Outcomes are grouped into benefit outcomes and harm outcomes according to the SPRINT estimate. Estimates larger than one imply that the outcome occurs more frequently with the lower blood pressure target. Conversely, estimates lower than one mean the lower blood pressure target reduces the risk for that outcome.

*SPS3 did not report heart failure, ESRD and AKI, and we did not extrapolate from SPRINT or ACCORD because the SBP targets were different.

†We used the CKD estimate from ACCORD instead of SPRINT, because an incident estimated glomerular filtration rate <30 mL/min/1.73 m2 is more likely symptomatic and patient-important than <60 mL/min/1.73 m2.

‡The estimate for CKD in SPS3 is an OR, extracted from a posthoc analysis of the trial data.

§Corrected for sparse data bias with a prior incidence rate ratio between 1 and 5.

¶We used estimates from SPRINT for injurious falls and AKI because ACCORD did not report them, and we used the estimate from SPRINT for syncope because we assessed the ACCORD estimate as high risk of bias.

**Corrected for sparse data bias with a prior incidence rate ratio between 0.5 and 2. We could not include dizziness, treatment burden and cognitive impairment in our main analysis.

††We used the ESRD estimate from SPRINT instead of ACCORD because SPRINT considered only incident ESRD in patients who had prior history of CKD.

AKI, acute kidney injury; CKD, chronic kidney disease; ESRD, end-stage renal disease; OR, odds ratio; SBP, systolic blood pressure.

Because we decided to apply only estimates from SPS3 to people with prior history of stroke, and because important outcomes for patients with CKD were not reported in SPS3, namely AKI and ESRD, we did not calculate a benefit-harm balance for people with both a history of stroke and CKD, as there would be significant uncertainty in the balance.

Baseline incidence of all outcomes

To address baseline incidence of outcomes for people with hypertension according to age, gender and prior patient history (stroke, diabetes, heart failure and CKD), adapting a previously described method,12 we prioritised different sources in the following order:

  1. US national registries that reflect the target population as closely as possible.

  2. Observational studies with similar study population as the target population.

  3. RCTs.

The latter were favoured the least because, compared with observational studies, restrictive inclusion criteria or recruitment mechanisms can substantially affect baseline incidence rates. To avoid inconsistency, we based as many estimates as possible on prediction models and incidence tables based on the Atherosclerosis Risk in Communities (ARIC) study.40–44 Assumptions about additional risk factors beyond those defining the subgroups were necessary when prediction models included other risk factors (see online supplementary table S3 for an overview on which subgroups affected the baseline incidence of which outcomes). We also developed a web-calculator in which the impact of all risk factors can be explored.

Relative importance of outcomes from patient preference survey

We surveyed people with MCC and hypertension in the USA using best-worst scaling (Aschmann et al, ‘Outcome preferences of older people with multiple chronic conditions and hypertension: A cross-sectional survey using best-worst scaling’, submitted), a preference elicitation method which provides weights for outcomes relative to one another and is easy to understand.45 Both the Institutional Review Boards of Johns Hopkins University and Kaiser Permanente Colorado approved the survey. In brief, we sent paper surveys to members of Kaiser Permanente Colorado aged 60 or older who had hypertension and at least two other chronic conditions. We presented respondents with 11 blocks of five outcomes and asked them which they would worry about most, and which least. We analysed 207 responses with a conditional logit model. Based on this, we used the following weights in the main analysis: death (1), myocardial infarction (0.66), heart failure (0.65), stroke (0.76), ESRD (0.47), CKD (0.45), hypotension (0.01), syncope (0.11), injurious falls (0.02), AKI (0.33), treatment burden (0). Respondents were aged 60 to 97, and the most common conditions additionally to hypertension were hyperlipidaemia, CKD and diabetes. They were similar to non-respondents in terms of age, number of comorbidities, gender, race and ethnicity. Because baseline characteristics were not associated with different preferences, we applied the weights to all subgroups in the benefit-harm assessment, including people younger than 60 years.

Statistical analysis

We calculated the number of expected events over 5 years in a population of 10 000 based on the baseline incidence and relative effects.13 Longer time horizons may be more relevant, but the RCTs were too short to inform relative risks and incidence rates for longer than 5 years, especially for adverse events like AKI or CKD. All-cause mortality was considered a competing risk for all other outcomes. We considered statistical uncertainty of estimates in relative effects and distributions in baseline incidences (due to distributions of risk factors accounted for in prediction models) in 100 000 repetitions in the analysis (equations in online supplementary file).

Subsequently, we calculated the Gail index13 as the weighted difference in event numbers: the difference in number of expected events for each outcome is multiplied with its relative importance, and the weighted differences are summed across outcomes. For example, if we only considered stroke and CKD, and if we expect 58 less strokes but 201 more CKD events with the lower target, the Gail index would be (−58)×0.76+201×0.45=+46, that is, there would be 46 more events of ‘importance 1’ with the lower target, thus the higher target would be better. However, to account for statistical uncertainty, we repeated the calculation of the Gail index 100 000 times. In the example above, this would yield a distribution with a mean Gail index of +46.

We then calculated the probability that one SBP target is better than another. In the example, the probability that the higher target is better is the proportion of the repetitions when the Gail index was greater than zero. For example, a probability of 0.7 that the higher target is better inversely means the probability is 0.3 that the lower target is better. We categorised the probabilities into greater than 0.6 (target better than reference), smaller than 0.4 (target worse than reference) and in between (unclear which is better).

To define a range of possible estimates of the benefit-harm balance, we performed two additional analyses – one favouring the lower and one the upper target – taking into account (non-statistical) uncertainty in the baseline incidence.

Sensitivity analyses

To investigate the effect of individual preferences, we generated preference values for each respondent in the survey based on individual best-minus-worst scores (a count measure). In sensitivity analysis 1, we applied the individual preference values. In sensitivity analysis 2, we additionally included treatment burden, assuming 20% of people have more treatment burden with the lower target than with 140 mm Hg. In sensitivity analyses 3 to 5 we assigned different population preference weights (preferences on an aggregate level, see online supplementary table S4).

Software

We performed calculations in R V.3.3.1.

Patient and public involvement

The research question was identified as a priority question by people with MCC and caregivers.11 A preference survey among people with MCC informed on applicable weights for outcomes in the benefit-harm assessment. Four patient and caregiver co-investigators were involved throughout the project, starting with the conception of the study. In particular, they helped in the development of the survey, and contributed to framing the conclusions and to drafting a summary of the results that was sent to all survey respondents. They continue to help with the dissemination of the study results.

Results

Table 2 shows the expected number of events over 5 years per 10 000 people, across three age groups in people without prior history of stroke (mixed population with and without diabetes, CKD and heart failure) with SBP targets of 140 mm Hg and 120 mm Hg. In 50 to 64 year olds 361 deaths are expected per 10 000 people over 5 years with a target of 140 mm Hg, and 281 deaths are expected with a target of 120 mm Hg. Hence, 80 deaths per 10 000 people 50 to 64 years old over 5 years can be prevented by targeting 120 mm Hg instead of 140 mm Hg (corresponding to a number needed to treat of 125). Targeting 120 mm Hg would result in higher incidence of CKD, AKI, hypotension, syncope and injurious falls. For example, in the same group of 10 000 people, 118 additional cases of incident CKD would be caused by targeting 120 mm Hg instead of 140 mm Hg (corresponding to a number needed to harm of 85).

Table 2.

Number of events in 10 000 persons without prior history of stroke over 5 years

Target (mm Hg) Age 50–64 Age 65–74 Age 75–84
140 120 Difference 140 120 Difference 140 120 Difference
Death 361 281 +80 852 694 +158 2037 1661 +376
Myocardial infarction 187 158 +29 320 274 +46 462 401 +61
Heart failure 195 131 +64 567 402 +165 763 543 +220
Stroke 104 91 +13 246 208 +38 443 385 +58
ESRD 50 32 +18 68 43 +25 60 39 +21
CKD 126 244 −118 192 371 −179 209 410 −201
AKI 194 332 −138 189 325 −136 177 308 −131
Hypotension 253 463 −210 285 551 −266 382 733 −351
Syncope 292 424 −132 275 401 −126 552 809 −257
Injurious falls 528 535 −7 728 741 −13 2022 2082 −60

Number of expected events in 10 000 people without prior history of stroke over 5 years with a target of 140 mm Hg or 120 mm Hg, and the difference in numbers of events between the two targets.

AKI, acute kidney injury; CKD, chronic kidney disease; ESRD, end-stage renal disease.

Benefit-harm balance of blood pressure targets in subgroups with population weights

We explored 120 subgroups defined by age (50 to 64, 65 to 74, 75 to 84 years), gender (male, female), prior history of diabetes (yes, no), CKD (no: estimated glomerular filtration rate >60, stage 3A: 45 to 59, stage 3B: 30 to 44, stage 4: 15 to 29 mL/min/1.73 m2), chronic heart failure (yes, no) and stroke (yes, no). Furthermore, a web-calculator is available with which the impact of further risk factors and individual preferences can be explored (https://www.ebpi.uzh.ch/en/translational_research/archive_translational_research/archive_health_research_methods/benefit_harm_assessments.html).

In table 3, the probability that a lower SBP target of 120 or <130 mm Hg is better than a higher target of 140 or 131 to 149 mm Hg is shown for all subgroups, considering all available outcomes and accounting for statistical uncertainty of the estimates. In the main analysis, the probability that the lower target is better than the higher target was greater than 0.6 for 72 of 120 subgroups (blue cells: additional analyses with different assumptions for baseline incidences also yielded a probability above 0.6, see online supplementary table S5). Notably, this was true for all male subgroups aged 75 to 84 without prior stroke, and for all subgroups of people with prior stroke aged 50 to 64 years.

Table 3.

Benefit-harm balance of different systolic blood pressures: probability that the lower target is better

Diabetes CKD CHF Age
50–64
Age
65–74
Age
75–84
120 vs 140 mm Hg, SPRINT Probability that lower target is better in men without stroke & without diabetes
No No No 0.96 1.00 1.00
No No Yes 0.72 0.91 0.96
No Stage 3A No 0.96 1.00 1.00
No Stage 3B No 0.53 0.92 0.99
No Stage 4 No 0.48 0.80 0.97
No Stage 3A Yes 0.87 0.95 0.97
No Stage 3B Yes 0.43 0.74 0.89
No Stage 4 Yes 0.41 0.64 0.82
120 vs 140 mm Hg, SPRINT In women without stroke & without diabetes
No No No 0.63 0.98 1.00
No No Yes 0.27 0.75 0.94
No Stage 3A No 0.77 1.00 1.00
No Stage 3B No 0.12 0.69 0.99
No Stage 4 No 0.26 0.55 0.93
No Stage 3A Yes 0.57 0.92 0.97
No Stage 3B Yes 0.06 0.34 0.80
No Stage 4 Yes 0.20 0.31 0.60
120 vs 140 mm Hg, ACCORD In men without stroke & with diabetes
Yes No No 0.71 0.89 0.93
Yes No Yes 0.89 0.97 0.98
Yes Stage 3A No 0.92 0.95 0.96
Yes Stage 3B No 0.66 0.85 0.91
Yes Stage 4 No 0.45 0.74 0.89
Yes Stage 3A Yes 0.98 0.99 0.99
Yes Stage 3B Yes 0.88 0.97 0.97
Yes Stage 4 Yes 0.71 0.93 0.96
120 vs 140 mm Hg, ACCORD In women without stroke & with diabetes
Yes No No 0.37 0.70 0.81
Yes No Yes 0.69 0.89 0.92
Yes Stage 3A No 0.66 0.85 0.88
Yes Stage 3B No 0.31 0.54 0.73
Yes Stage 4 No 0.33 0.51 0.69
Yes Stage 3A Yes 0.92 0.97 0.97
Yes Stage 3B Yes 0.63 0.84 0.91
Yes Stage 4 Yes 0.57 0.78 0.88
<130 vs 131–149 mm Hg, SPS3 In men with stroke
No No No 0.70 0.58 0.44
No No Yes 0.68 0.60 0.49
Yes No No 0.68 0.61 0.48
Yes No Yes 0.66 0.59 0.54
<130 vs 131–149 mm Hg, SPS3 In women with stroke
No No No 0.71 0.59 0.40
No No Yes 0.69 0.60 0.46
Yes No No 0.69 0.60 0.46
Yes No Yes 0.67 0.62 0.50

The probability that the lower target (120 mm Hg or <130 mm Hg) is a better target than the higher target (140 mm Hg or 131 to 149 mm Hg) is shown for all subgroups (calculated from 100 000 repetitions). Subgroups are presented according to which RCT was used to inform the analysis and what targets were compared. A probability of 0.5 means that both targets have the same benefit-harm balance. Blue colour indicates the lower target was better also in additional analysis with different assumptions for baseline incidences, and orange colour indicates the higher target was better also in the additional analyses. We did not calculate the benefit-harm balance of different blood pressure targets for people with prior history of stroke and CKD, because renal outcomes that would be important for people with CKD, but rare for people without CKD, were not reported by SPS3.

CHF, chronic heart failure; CKD, chronic kidney disease; RCT, randomised clinical trial.

The probability that 120 mm Hg is better than 140 mm Hg was less than 0.4 for eight subgroups – these eight subgroups were women aged 50 to 74 who have a prior history of CKD stage 3B or 4 and without history of stroke (orange cells). The different results between subgroups partly arise due to lower cardiovascular risk in women and higher risk of AKI in people with CKD. In older people, the increased incidence of cardiovascular events and death drive the benefit-harm balance (data not shown). In subgroups with prior history of stroke, the probability that <130 mm Hg is better than 131 to 149 mm Hg was never lower than 0.4.

The mean index describes the clinical relevance of net benefit or harm as the mean number of events (with equivalent importance as death) that were prevented or caused by targeting 120 mm Hg instead of 140 mm Hg (see online supplementary table S6). Across subgroups, the maximum was 1133 with a possible range of 828 to 1193 (based on different assumptions for baseline risks) prevented events among 10 000 people over 5 years, attained in the subgroup of men aged 75 to 84, without history of stroke, but with history of diabetes, heart failure and stage 3A CKD.

Sensitivity analyses considering individual preferences

The impact of the variation in individual preferences (sensitivity analysis 1) is shown in figure 2. For eight subgroups the probability that the lower target is better was always greater than 0.6 – that is, for these subgroups, with every possible preference found in the survey, the better target was always 120 mm Hg. In many subgroups without prior history of stroke, especially with ages 50 to 64 years, the probability of 120 mm Hg to be better than 140 mm Hg almost spanned the full range of 0 to 1, as indicated by the whiskers in figure 2. This meant that any probability of 120 mm Hg being better or worse was possible, and depended on the preference of the individual. For example, using weights from a survey respondent who worried most about ESRD, followed by stroke and AKI, we calculated a probability of 0.05 that 120 mm Hg is better for a woman with diabetes, stage 4 CKD and heart failure but no prior history of stroke. For the same subgroup, using weights from a survey respondent for whom myocardial infarction, heart failure and stroke were the most worrisome outcomes, the probability was 0.95 that 120 mm Hg is better. For people with prior history of stroke, the range of the probability that <130 mm Hg is better than 131 to 149 mm Hg was also wide. Thus, the probability that <130 mm Hg is better was dependent on the preferences of the individual. Sensitivity analyses 3 to 5 (see online supplementary tables S7–10) confirmed the results of sensitivity analysis 1. A sensitivity analysis with equal weights for all outcomes is shown in online supplementary table S11.

Figure 2.

Figure 2

Sensitivity analysis 1 - impact of variation in preferences between individuals. Distribution (full range, IQR and median) of the benefit-harm balance with 207 different sets of weights, according to the preferences of all 207 individuals in the preference survey. In almost all subgroups, the variation in individual preferences lead to wide ranges of balances, with some favouring a lower target (dark grey shaded), and some favouring a higher target (light grey shade). In eight subgroups without prior history stroke, even with the most extreme preferences, the better target was always 120 mm Hg. CHF, Chronic heart failure; CKD, Chronic kidney disease; DM, Diabetes mellitus type 2; IQR, interquartile range.

Sensitivity analyses considering individual preferences and additionally including treatment burden

In a further sensitivity analysis (sensitivity analysis 2), we added treatment burden, one of the patient-important outcomes for which we did not have data. Based on the preference survey, we assumed 20% of people would have more treatment burden with a lower blood pressure target due to needing an additional medication. While considering treatment burden decreased the median probability that the lower target is better, it also widened the range of the probability in most subgroups (see online supplementary figure S4).

Discussion

Our analyses showed that the benefit-harm balance of SBP targets in people with MCC and hypertension depends on age, gender, comorbidities (history of diabetes, CKD, heart failure and stroke) and largely on the outcome preferences of patients. Our results highlight the importance of performing qualitative and quantitative preference surveys to identify patient-important outcomes and determine weights, and to assess the impact of different preferences on the benefit-harm balance. Preferences should be assessed in the target population, and it is known that physicians can have different preferences.46 If there is large variation in individual preferences, there are two possible consequences. First, it is possible that one intervention is still consistently better, as was true for a few of the subgroups in our analyses. Second, the balance can be preference-sensitive, as was true for most of the subgroups in our analyses, where the probability of one target being better than the other spanned almost the full range of 0 to 1, depending on the individual’s preferences. In this case, shared decision-making with explicit determination of the individual’s preferences may be appropriate. Further research is needed on how to elicit individual preferences in the clinic. Patient decision aids with an integrated calculation of the benefit-harm balance may help in shared decision-making when the benefit-harm balance is preference-sensitive and depends on prior medical history. The web-calculator that we provided as an addendum is not ready to be used as a decision aid – for this, the tool would need to be extensively tested with patients and clinicians. It would also need to convey the uncertainty in the benefit-harm balance, for example showing estimates of the benefit-harm balance using different prediction models for baseline incidences.

While for most subgroups the benefit-harm balance of SBP targets was preference-sensitive, and shared decision-making would accordingly be appropriate, for a few subgroups, one target was clearly better. We identified eight subgroups without prior history of stroke for which a target of 120 mm Hg was better even for extreme preferences. The benefit-harm balance shifted only when we assumed that individuals perceived the additional treatment burden as high. The absolute benefit was relatively high, with 436 to 1133 events of equivalent importance to death prevented in 10 000 people over 5 years.

Two guidelines about blood pressure targets have been published in 2017 from US organisations: the American College of Cardiology/American Heart Association (ACC/AHA)1 and the American College of Physicians (ACP).2 Neither performed a quantitative benefit-harm assessment with explicit weights. Their recommendations differ, both from each other and from our results, mostly due to four reasons. First, the ACC/AHA guideline did not consider any adverse events except the combined outcome ‘renal outcomes’ (including ESRD and AKI) – that is, the guideline made a trade-off between cardiovascular benefit and renal harm, but did not take into account other harms of lower targets like syncope. Second, the ACC/AHA guideline considered only relative risk reductions in the underlying systematic review, and it is unclear how it considered absolute effects of different targets. Third, both guidelines assessed achieved blood pressure additionally, which we did not consider, because these values can deviate from the target for a large number of reasons, and were not randomised in the trials. Fourth, the implicit weights that were assigned differed, as we interpret from the published rationale. The ACC/AHA guideline implicitly weighs cardiovascular events more than possible adverse events – which may reflect the preferences of many, but not all patients. The ACP guideline implicitly weighs treatment burden and adverse events more than the ACC/AHA guideline, and states that while <140 mm Hg would further reduce the cardiovascular risk in people aged 60 or older, the additional benefit is small and inconsistent across outcomes.

Notwithstanding our different methods and results, we agree on many points with both guidelines. Our results indicate that indeed individual assessment of benefits and harms in people with MCC is important, like the ACP guideline recommends, and individual preferences should be considered. The ACC/AHA guideline sees significant benefit of a lower SBP target, but adjusts the target of 120 mm Hg to 130 mm Hg because in real-world practice, achieved blood pressure measurements tend to be higher than in the setting of a RCT.1 10 Similarly, our results indicate that a SBP target of 120 mm Hg has significant potential to benefit subgroups without prior history of stroke and no CKD of stage 3B or higher. In contrast, a SBP target of 140 mm Hg was better for some subgroups of women aged 50 to 64 with CKD stages 3B or 4. The ACC/AHA guideline recommends a target of 130 mm Hg for people with prior history of CKD, which may reflect that most cases of CKD are of stage 3A,44 where lower targets may be more beneficial.

Our approach to identify the optimal SBP target for people with MCC had several strengths. First, we predefined the subgroups of relevance for people with MCC. Second, in collaboration with patients and caregivers, we identified patient-important outcomes, and regularly informed them about the progress to assure the results would be meaningful to people with MCC. Third, we performed sensitivity analyses with different weights and could show in which subgroups the benefit-harm balance could shift, and in which the balance was relatively stable. Finally, to quantify the uncertainty in the probability that one target is better than another, we performed additional analyses including all assumptions that we were unsure about, to get a conservative estimate of what the range of possible estimates may be.

Our analyses emphasise where most uncertainty remains. Evidence is lacking for cognitive impairment and for mild adverse events, such as daily mild dizziness. SPS3 did not report heart failure, ESRD and AKI, which adds uncertainty for people with prior history of stroke. As these outcomes are particularly important in people with CKD, the benefit-harm balance for people with prior history of stroke and CKD cannot be judged. People with heart failure were not well represented in the trials, therefore, uncertainty is larger for subgroups with heart failure. Furthermore, our main analysis did not include treatment burden, as we would have needed to know how many more people experience significantly more treatment burden with lower targets. However, our analyses indicate treatment burden may not shift the benefit-harm balance drastically on average, but it may increase the impact of variation in individual preferences.

Our model puts the most applicable, valid and precise evidence into context. To address this gap in evidence in a study instead, a very large RCT would be needed, in which older people with MCCs – and in different combinations of MCCs – are well represented, and which includes a preference survey among participants. Chances are no such RCT will ever be performed. A major limitation is, therefore, that it is difficult to confirm the results of the model. However, in the absence of a study, a model that follows a systematic approach based on epidemiological principles and the available clinical evidence is necessary to inform this question. We aimed to assess the benefit-harm balance of different blood pressure targets; how these targets are best achieved was out of scope. Techniques to measure the blood pressure differed between trials and may differ between trials and clinical practice.1 10 Therefore, we presented the results using different trials separately, because their targets may be interpreted differently. As the target setting was the USA and we used baseline risks applicable there, the benefit-harm balance of SBP targets may be different in other countries.

Conclusions

In conclusion, the lower SBP targets have significant potential to benefit people with MCC who tolerate antihypertensive treatment, especially among those who do not have CKD stage 3B or higher and no history of ischaemic stroke. The potential benefit is largest in people older than 75 who do not have a history of ischaemic stroke. Shared decision-making should take place, as individual preferences can have a substantial influence on the benefit-harm balance.

Supplementary Material

Reviewer comments
Author's manuscript

Acknowledgments

This article was prepared using the SPRINT_POP Research Materials obtained from the NHLBI Biologic Specimen and Data Repository Information Coordinating Center and does not necessarily reflect the opinions or views of the SPRINT_POP or the NHLBI.

Footnotes

Contributors: CMB, CWR, WVC, WLB, KA, CG, KM, SM and MAP acquired the funding for the project. HEA and RFW curated the data, HEA analysed the data and MAP contributed to the data analysis. HEA, CMB, OCS, RFW and TY contributed to literature searches and data extraction. HEA, CMB, CWR, RAM, WVC, OCS, RFW, WLB, EAB, TY, BL and MAP contributed to the development of the model. CMB and RFW performed project administration. CMB, RFW and MAP supervised the project. HEA, CMB and MAP drafted the original manuscript. All authors contributed to the conceptualisation of the study, reviewed and edited the manuscript and approved the final manuscript.

Funding: Research reported in this article was funded through a Patient-Centered Outcomes Research Institute (PCORI) Award (ME-1310-07619). The statements in this article are solely the responsibility of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute (PCORI), its Board of Governors or Methodology Committee. Hélène Aschmann was also supported through a PhD fellowship of the Béatrice Ederer-Weber Foundation.

Competing interests: None declared.

Patient consent for publication: Not required.

Ethics approval: This modelling study is based on published data except for the patient preference survey. Both the Institutional Review Boards of Johns Hopkins University (00114695) and Kaiser Permanente Colorado (CO-15-2195) approved the survey.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data availability statement: Data are available upon reasonable request.

References

  • 1. Whelton PK, Carey RM, Aronow WS, et al. 2017 ACC/AHA/AAPA/ABC/ACPM/AGS/APhA/ASH/ASPC/NMA/PCNA Guideline for the prevention, detection, evaluation, and management of high blood pressure in adults: executive summary. J Am Coll Cardiol 2018;71:2199–269. 10.1016/j.jacc.2017.11.005 [DOI] [PubMed] [Google Scholar]
  • 2. Qaseem A, Wilt TJ, Rich R, et al. Pharmacologic treatment of hypertension in adults aged 60 years or older to higher versus lower blood pressure targets: a clinical practice guideline from the American College of physicians and the American Academy of family physicians. Ann Intern Med 2017;166:430–7. 10.7326/M16-1785 [DOI] [PubMed] [Google Scholar]
  • 3. James PA, Oparil S, Carter BL, et al. 2014 Evidence-based guideline for the management of high blood pressure in adults, report from the panel members appointed to the eighth joint National Committee (JNC8). JAMA 2013;1097:1–14. [DOI] [PubMed] [Google Scholar]
  • 4. Mancia G, Fagard R, Narkiewicz K, et al. 2013 ESH/ESC guidelines for the management of arterial hypertension: the task force for the management of arterial hypertension of the European Society of hypertension (ESH) and of the European Society of cardiology (ESC). Eur Heart J 2013;34:2159–219. 10.1093/eurheartj/eht151 [DOI] [PubMed] [Google Scholar]
  • 5. Cushman WC, Evans GW, Byington RP, et al. Effects of intensive blood-pressure control in type 2 diabetes mellitus. N Engl J Med 2010;362:1575–85. 10.1056/NEJMoa1001286 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Wright JT, Williamson JD, Whelton PK, et al. A randomized trial of intensive versus standard blood-pressure control. N Engl J Med 2015;373:2103–16. 10.1056/NEJMoa1511939 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. The SPS3 Study Group Blood-Pressure targets in patients with recent lacunar stroke: the SPS3 randomised trial. Lancet 2013;382:507–15. 10.1016/S0140-6736(13)60852-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Peralta CA, McClure LA, Scherzer R, et al. Effect of intensive versus usual blood pressure control on kidney function among individuals with prior lacunar stroke: a post hoc analysis of the secondary prevention of small subcortical strokes (SPS3) randomized trial. Circulation 2016;133:584–91. 10.1161/CIRCULATIONAHA.115.019657 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Ortiz E, James PA. Let's not sprint to judgment about new blood pressure goals. Ann Intern Med 2016;164:692 10.7326/M15-3123 [DOI] [PubMed] [Google Scholar]
  • 10. Weiss J, Freeman M, Low A, et al. Benefits and harms of intensive blood pressure treatment in adults aged 60 years or older: a systematic review and meta-analysis. Ann Intern Med 2017;166:419–29. 10.7326/M16-1754 [DOI] [PubMed] [Google Scholar]
  • 11. Bennett WL, Robbins CW, Bayliss EA, et al. Engaging stakeholders to inform clinical practice guidelines that address multiple chronic conditions. J Gen Intern Med 2017;32:883–90. 10.1007/s11606-017-4039-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Fain KM, Yu T, Li T, et al. Evidence selection for a prescription drug's benefit-harm assessment: challenges and recommendations. J Clin Epidemiol 2016;74:151–7. 10.1016/j.jclinepi.2016.02.018 [DOI] [PubMed] [Google Scholar]
  • 13. Gail MH, Costantino JP, Bryant J, et al. Weighing the risks and benefits of tamoxifen treatment for preventing breast cancer. J Natl Cancer Inst 1999;91:1829–46. 10.1093/jnci/91.21.1829 [DOI] [PubMed] [Google Scholar]
  • 14. Puhan MA, Singh S, Weiss CO, et al. A framework for organizing and selecting quantitative approaches for benefit-harm assessment. BMC Med Res Methodol 2012;12:173 10.1186/1471-2288-12-173 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Husereau D, Drummond M, Petrou S, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS)—explanation and elaboration: a report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Health 2013;16:231–50. 10.1016/j.jval.2013.02.002 [DOI] [PubMed] [Google Scholar]
  • 16. Stegeman I, Bossuyt PM, Yu T, et al. Aspirin for primary prevention of cardiovascular disease and cancer. A benefit and harm analysis. PLoS One 2015;10:e0127194–12. 10.1371/journal.pone.0127194 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Puhan MA, Yu T, Stegeman I, et al. Benefit-harm analysis and charts for individualized and preference-sensitive prevention: example of low dose aspirin for primary prevention of cardiovascular disease and cancer. BMC Med 2015;13:250 10.1186/s12916-015-0493-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Yu T, Fain K, Boyd CM, et al. Benefits and harms of roflumilast in moderate to severe COPD. Thorax 2014;69:616–22. 10.1136/thoraxjnl-2013-204155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Yebyo HG, Aschmann HE, Puhan MA. Finding the balance between benefits and harms when using statins for primary prevention of cardiovascular disease: a modeling study. Ann Intern Med 2018. doi: 10.7326/M18-1279 [Epub ahead of print 04 Dec 2018]. 10.7326/M18-1279. [DOI] [PubMed] [Google Scholar]
  • 20. Hannson L. The BBB Study: the effect of intensified antihypertensive treatment on the level of blood pressure, side-effects, morbidity and mortality in "well-treated" hypertensive patients. Behandla Blodtryck Bättre. Blood Press 1994;3:248–54. 10.3109/08037059409102265 [DOI] [PubMed] [Google Scholar]
  • 21. Sarnak MJ, Greene T, Wang X, et al. The effect of a lower target blood pressure on the progression of kidney disease: long-term follow-up of the modification of diet in renal disease study. Ann Intern Med 2005;142:342–51. 10.7326/0003-4819-142-5-200503010-00009 [DOI] [PubMed] [Google Scholar]
  • 22. Toto RD, Mitchell HC, Smith RD, et al. “Strict” blood pressure control and progression of renal disease in hypertensive nephrosclerosis. Kidney Int 1995;48:851–9. 10.1038/ki.1995.361 [DOI] [PubMed] [Google Scholar]
  • 23. Higgins JPT, Altman DG, Gøtzsche PC, et al. The Cochrane collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Estacio R, Coll J, Tran Z, et al. Effect of intensive blood pressure control with valsartan on urinary albumin excretion in normotensive patients with type 2 diabetes. Am J Hypertens 2006;19:1241–8. 10.1016/j.amjhyper.2006.05.011 [DOI] [PubMed] [Google Scholar]
  • 25. Verdecchia P, Staessen JA, Angeli F, et al. Usual versus tight control of systolic blood pressure in non-diabetic patients with hypertension (Cardio-Sis): an open-label randomised trial. Lancet 2009;374:525–33. 10.1016/S0140-6736(09)61340-4 [DOI] [PubMed] [Google Scholar]
  • 26. Estacio RO, Jeffers BW, Hiatt WR, et al. The effect of nisoldipine as compared with enalapril on cardiovascular outcomes in patients with non-insulin-dependent diabetes and hypertension. N Engl J Med 1998;338:645–52. 10.1056/NEJM199803053381003 [DOI] [PubMed] [Google Scholar]
  • 27. Schrier RW, Estacio RO, Esler A, et al. Effects of aggressive blood pressure control in normotensive type 2 diabetic patients on albuminuria, retinopathy and strokes. Kidney Int 2002;61:1086–97. 10.1046/j.1523-1755.2002.00213.x [DOI] [PubMed] [Google Scholar]
  • 28. Wright JT, Bakris G, Greene T, et al. Effect of blood pressure lowering and antihypertensive drug class on progression of hypertensive kidney disease: results from the AASK trial. JAMA 2002;288:2421–31. 10.1001/jama.288.19.2421 [DOI] [PubMed] [Google Scholar]
  • 29. Hansson L, Zanchetti A, Carruthers SG, et al. Effects of intensive blood-pressure lowering and low-dose aspirin in patients with hypertension: principal results of the hypertension optimal treatment (HOT) randomised trial. The Lancet 1998;351:1755–62. 10.1016/S0140-6736(98)04311-6 [DOI] [PubMed] [Google Scholar]
  • 30. Asayama K, Ohkubo T, Metoki H, et al. Cardiovascular outcomes in the first trial of antihypertensive therapy guided by self-measured home blood pressure. Hypertens Res 2012;35:1102–10. 10.1038/hr.2012.125 [DOI] [PubMed] [Google Scholar]
  • 31. Ruggenenti P, Perna A, Loriga G, et al. Blood-pressure control for renoprotection in patients with non-diabetic chronic renal disease (REIN-2): multicentre, randomised controlled trial. Lancet 2005;365:939–46. 10.1016/S0140-6736(05)71082-5 [DOI] [PubMed] [Google Scholar]
  • 32. JATOS Study Group Principal results of the Japanese trial to assess optimal systolic blood pressure in elderly hypertensive patients (JATOS). Hypertens Res 2008;31:2115–27. 10.1291/hypres.31.2115 [DOI] [PubMed] [Google Scholar]
  • 33. Ogihara T, Saruta T, Rakugi H, et al. Target blood pressure for treatment of isolated systolic hypertension in the elderly: valsartan in elderly isolated systolic hypertension study. Hypertension 2010;56:196–202. 10.1161/HYPERTENSIONAHA.109.146035 [DOI] [PubMed] [Google Scholar]
  • 34. Mant J, McManus RJ, Roalfe A, et al. Different systolic blood pressure targets for people with history of stroke or transient ischaemic attack: PAST-BP (Prevention After Stroke—Blood Pressure) randomised controlled trial. BMJ 2016;352352 10.1136/bmj.i708 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Wei Y, Jin Z, Shen G, et al. Effects of intensive antihypertensive treatment on Chinese hypertensive patients older than 70 years. J Clin Hypertens 2013;15:420–7. 10.1111/jch.12094 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Schrier R, McFann K, Johnson A, et al. Cardiac and renal effects of standard versus rigorous blood pressure control in autosomal-dominant polycystic kidney disease: results of a seven-year prospective randomized study. J Am Soc Nephrol 2002;13:1733–9. 10.1097/01.ASN.0000018407.60002.B9 [DOI] [PubMed] [Google Scholar]
  • 37. UK Prospective Diabetes Study Group Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38. UK prospective diabetes Study Group. BMJ 1998;317:703–13. 10.1136/bmj.317.7160.703 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Greenland S, Mansournia MA, Altman DG. Sparse data bias: a problem hiding in plain sight. BMJ 2016;22 10.1136/bmj.i1981 [DOI] [PubMed] [Google Scholar]
  • 39. Greenland S. Bayesian perspectives for epidemiological research: I. Foundations and basic methods. Int J Epidemiol 2006;35:765–75. 10.1093/ije/dyi312 [DOI] [PubMed] [Google Scholar]
  • 40. National institutes of health National Heart Lung and Blood Institute Incidence & Prevalence: 2006 Chart Book on Cardiovascular and Lung Diseases. Available: http://www.bls.gov/oes/2010/may/stem.htm [Accessed 18 May 2017].
  • 41. Agarwal SK, Chambless LE, Ballantyne CM, et al. Prediction of incident heart failure in general practice: the Atherosclerosis risk in communities (ARIC) study. Circ Heart Fail 2012;5:422–9. 10.1161/CIRCHEARTFAILURE.111.964841 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Chambless LE, Heiss G, Shahar E, et al. Prediction of ischemic stroke risk in the Atherosclerosis risk in Communities study. Am J Epidemiol 2004;160:259–69. 10.1093/aje/kwh189 [DOI] [PubMed] [Google Scholar]
  • 43. Kshirsagar AV, Bang H, Bomback AS, et al. A simple algorithm to predict incident kidney disease. Arch Intern Med 2008;168:2466–73. 10.1001/archinte.168.22.2466 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Grams ME, Astor BC, Bash LD, et al. Albuminuria and estimated glomerular filtration rate independently associate with acute kidney injury. JASN 2010;21:1757–64. 10.1681/ASN.2010010128 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Yu T, Holbrook JT, Thorne JE, et al. Outcome preferences in patients with noninfectious uveitis: results of a Best-Worst scaling study. Invest Ophthalmol Vis Sci 2015;56:6864–72. 10.1167/iovs.15-16705 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. McAlister FA, O'Connor AM, Wells G, et al. When should hypertension be treated? The different perspectives of Canadian family physicians and patients. CMAJ 2000;163:403–8. [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2018-028438supp001.pdf (1.2MB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES