Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2019 Feb 12;3:156. Originally published 2018 Dec 7. [Version 2] doi: 10.12688/wellcomeopenres.14936.2

Economic evaluation plan of a randomised controlled trial of intra-nodular injection of anti-TNF and placebo among patients with early Dupuytren’s disease: Repurposing Anti-TNF for Treating Dupuytren’s Disease (RIDD)

May Ee Png 1,a, Melina Dritsaki 1, Alastair Gray 2, Rafael Pinedo-Villanueva 1, Oliver Rivero-Arias 3, Jagdeep Nanchahal 4
PMCID: PMC6354323  PMID: 30756094

Version Changes

Revised. Amendments from Version 1

We are grateful to both Mrs Belen Corbacho and Dr Raymond Oppong for their supportive reports and constructive comments about our health economics analysis plan (HEAP). In accordance with their suggestions, we have made changes to the HEAP publication. We have clarified details regarding the modelling (i.e. under what condition will it be needed, why it is required, literature review of existing models, the model parameters and the treatments used in early versus late stage DD). We have also clarified the definition of a “health system” and the relative merits of comparing usual care to anti-TNF instead of placebo to anti-TNF in our analysis.

Abstract

Dupuytren’s disease (DD) is a common fibroproliferative condition of the palmar and digital fascia of the hand; however, there is currently no approved treatment for early stage DD. The objective of this paper is to describe the methods applied to assess the cost-effectiveness of adalimumab injections compared to usual care for controlling the progression of early stage DD in the Repurposing Anti-TNF for Treating Dupuytren’s Disease (RIDD) trial.

Measure of effectiveness and resource use will be obtained from a randomised clinical trial, carried out in three healthcare centres, and recruiting a minimum of 138 patients aged 18 years and above with a diagnosis of early stage DD. Resource use and utility measures (quality-adjusted life years) will be collected at 3, 6, 9, 12 (primary outcome endpoint) and 18 months post-randomisation. A within-trial cost-utility analysis (CUA) will be conducted at 12 months and if the intervention is effective, a decision analytic model will be applied to estimate the lifetime effectiveness and costs. The analysis will be performed from a health system (National Health Service and personal social services) perspective. Sensitivity analysis will be conducted to assess the robustness of the results.

RIDD is the first randomised controlled trial with an economic evaluation conducted among patients with early stage DD. The protocol described here records our intent to conduct both a within-trial CUA alongside the RIDD study and a lifetime CUA using decision-analytic modelling.

Keywords: dupuytren, anti-TNF, adalimumab, economic, cost-effectiveness

Introduction

Dupuytren’s disease (DD) is a common and progressive fibroproliferative disorder of the palmar and digital fascia of the hand that affects 0.6% of the general population aged 18 years and 12% among those aged 55 years in Western countries 1.

Current treatment for DD, which includes fasciectomy, needle fasciotomy and collagenase fasciotomy, aims to correct the flexion deformities and restore hand function and is recommended when the digital flexion contractures limit hand function and/or the proximal interphalangeal joint is flexed to 30 degrees or more. Ideally, treatment of DD would be directed towards patients with early stage disease, defined as flexion deformities of 30 degrees or less at the metacarpophalangeal and/or at the proximal interphalangeal joint (with a maximum total flexion deformity of 60 degrees), in order to prevent progression of cords development and flexion contractures of the digits. However, there is currently no approved therapy for the treatment of early stage DD and a recent systematic review suggested a lack of robust evidence for treatments, including radiotherapy and intra-nodular steroid injection, proposed for this group of patients 2.

No previous study reporting economic evaluations of interventions for patients with early stage DD has been identified 3. However, a recent systematic review published by the trial team 3 identified four studies, all of which synthesised evidence from various sources, rather than a single randomised controlled trial, and reported the cost-effectiveness of collagenase clostridium histolyticum injection, percutaneous needle fasciotomy or limited fasciectomy among patients with late stage DD.

Here, we present a summary of a health economics analysis plan being undertaken to the second part of the Repurposing anti-TNF for treating Dupuytren’s disease (RIDD) trial, which targets patients with early stage DD. A detailed description of the study design is available in the published protocol which contains details on the methodology (e.g. recruitment, interventions, approval/consent, etc.) 4. This trial has been registered with the European Clinical Trials Database (EudraCT: 2015-001780-40) and its Ethics Reference is 15/SC/0259. In brief, a minimum of 138 participants aged 18 years old and above, with early stage DD will be recruited from two UK centres and one centre from the Netherlands. Participants will be randomised to receive either anti-TNF (adalimumab) or placebo (normal saline) injection in a 1:1 ratio. The optimal dose and formulation of adalimumab was found to be 40 mg in 0.4 ml in our dose-ranging phase 2a clinical trial 5. The primary objective of the second part of the trial is to determine if optimal dose of anti-TNF injection is superior to placebo injection in controlling disease progression among patients with early stage DD by assessment of nodule hardness at 12 months after the first treatment. Secondary objectives include comparing the development of Dupuytren’s nodules and its associated cord, flexion deformities of the fingers and impairment of hand function for participants between each treatment arms and monitoring for adverse events 4.

Methods

The objectives of the economic evaluation conducted in this study are to assess the cost-effectiveness of anti-TNF compared to usual care (i.e. no treatment) among patients with early stage DD via a within-trial cost-utility analysis (CUA), and to model lifetime cost-utility if anti-TNF is shown to be effective in controlling disease progression at 12 months follow-up (primary outcome end point). No treatment instead of placebo will be used as the comparator. In the RIDD trial, placebo is being administered as an experimental control and not used in routine care for patients with early stage DD.

Study design

The first proposed economic evaluation involves conducting a CUA of anti-TNF compared with usual care (no treatment) using quality-adjusted life years (QALYs) gained as the main health outcome measure alongside the clinical trial at 12 months. The second proposed economic evaluation consists of using decision-analytic modelling to perform a lifetime CUA based on RIDD trial results and additional data from published literature for predicted lifetime QALYs and healthcare costs.

For both analyses, a health system (i.e. National Health Service (NHS) and personal social services (PSS)) perspective will be adopted for the base case analysis, where the economic evaluation is conducted with the most likely or preferred set of assumptions and values, as recommended by the National Institute of Health and Clinical Excellence (NICE) 6, while the societal perspective will be examined as part of the sensitivity analysis.

Estimation of costs

Direct medical costs related to trial. As we assume that there are no significant differences in direct medical cost between trial arms other than the drug being administered, all direct medical cost related to the trial except manpower is excluded from the cost estimation. Since the usual care is no treatment, the cost of manpower will be included for the anti-TNF group only. Manpower cost will be estimated by assuming that the injection will be administered by a medically qualified clinician at consultant level in the outpatient setting.

The type of injection (adalimumab or saline), the estimated volume administered in case of partial administration as well as any optional application of local anaesthetic cream will be recorded in the trial case report forms (CRFs). In the case of anaesthetic cream application, a dosage of 1500 mg will be assumed 7. Potential adverse events at the injection site (local itching, redness, blister, nerve injury, local bruising, and haematoma) will be captured in the CRF. Unit cost of the injection will be obtained from the latest version of the British National Formulary (BNF) 8 ( Table 1).

Table 1. Resource items utilised in RIDD trial.

Resource item Unit Source Reference
to source
Direct medical costs related to trial (drug administration)
Success of injection (fully) ml BNF [ 8]
Success of injection (partial) ml BNF [ 8]
Anaesthetic cream mg BNF [ 8]
Other direct medical costs
Inpatient care visit NHS Reference cost [ 9]
Outpatient care
   Hand surgery: Surgeon consultation visit NHS Reference cost [ 9]
   Hand surgery: Radiotherapy visit NHS Reference cost [ 9]
   Hand surgery: Steroid/collagenase injection visit NHS Reference cost [ 9]
   Hand surgery: Dressing change visit NHS Reference cost [ 9]
   Radiology: Ultrasound scan visit NHS Reference cost [ 9]
   Physio- or hand therapy visit NHS Reference cost [ 9]
   Emergency department visit NHS Reference cost [ 9]
Primary and community care
   General Practitioner visit PSSRU [ 10]
   General Practitioner home visit PSSRU [ 10]
   General Practitioner phone call PSSRU [ 10]
   Practice nurse hour PSSRU [ 10]
   Physiotherapist hour PSSRU [ 10]
   Occupational therapist hour PSSRU [ 10]
   Calls to NHS 111 hour PSSRU [ 10]
Medication BNF [ 8]
Direct nonmedical cost
Personal social services
   Meals on wheels day PSSRU [ 10]
   Laundry services load North Yorkshire County
Council
[ 11]
   Social worker visit PSSRU [ 10]
   Care worker/ help at home visit PSSRU [ 10]
Missed work RIDD trial
Travel RIDD trial
Child care RIDD trial
Help with housework RIDD trial
Indirect cost
Income lost RIDD trial

BNF, British National Formulary; NHS, National Health Service; PSSRU, Personal Social Service Research Unit.

Other direct medical costs. Utilisation of health and social care services that are not related to the trial will be collected through a patient-completed questionnaire at 3, 6, 9, 12 and 18 months after the baseline injection. The questionnaires will capture the frequency of use of community-based health and social care services, number and duration of admissions to inpatient wards, number of diagnostic tests (ultrasound scan), use of outpatient services (physiotherapy, emergency department, surgeon consultation, radiotherapy, dressing change) and medication use for the past three months at each follow-up time points. Unit costs for each resource item will be sourced from the latest available national sources, e.g. NHS Reference cost and personal social service research unit (PSSRU) 9, 10. The defined daily dose (DDD) of each trial-related medication will be obtained from the World Health Organisation (WHO) website using the relevant anatomical therapeutic chemical (ATC) classification code 12. Unit costs of these medication will be obtained from the BNF ( Table 1).

Direct nonmedical cost and indirect cost. Data collected in the participant questionnaires at each time point will also capture the direct non-medical (personal social services, travel expenses, cost of childcare and help with housework) and indirect costs (income loss) borne by participants and carers as a result of their health state. Unit costs will be obtained from national sources or patients ( Table 1).

Estimation of health utilities

Impact on participants’ health-related quality of life in each arm will be assessed using data from the EQ-5D-5L (five-level version) instrument collected at baseline, 3, 6, 9, 12 and 18 months from baseline 13. As per the NICE position statement, responses to the EQ-5D-5L will be converted into multi-attribute utility scores using an approved “cross-walk” to the three-level instrument and its established utility algorithm for the UK, using the mapping function developed by van Hout et al. 14.

The responsiveness of the EQ-5D-5L instrument in early stage DD has not been evaluated and hence the quality of life impact according to number and severity of affected fingers will also be assessed based on utilities from a recent discrete choice experiment using responses from the UK general adult population 15.

Decision-analytic modelling

The second proposed economic evaluation will comprise a lifetime Markov cohort model with a 6-month cycle length. This will be constructed if the optimal dose of anti-TNF is found to be effective in controlling the disease progression (in terms of showing a statistically significant difference between the anti-TNF or no treatment groups based on the primary or secondary outcomes) at 12 months follow-up 2. A long-term model is needed as this treatment is expected to reduce the proportion of patients progressing to late stage DD. Disease progression of the patients in the trial will be tracked using CRFs which record the nodule size on ultrasound scan, range of motion of affected digit and patient reported outcome measures. A Markov model approach was chosen as the events occur repeatedly over time.

The preliminary model ( Figure 1) will consist of the following health states: treatment success and failure of early stage DD, recurrence of early stage DD, development of late stage DD, treatment success and failure of late stage DD, recurrence of late stage DD and death. Late stage DD will be defined as flexion deformities of 30 degrees or greater at the metacarpophalangeal or at the proximal interphalangeal joint with a limitation of hand function. Recurrence for early stage DD will be defined as an increase in nodule hardness or size on ultrasound scan or increase of flexion deformity following successful treatment. Recurrence for late stage DD will be defined as the recurrence of contracture of 30 degrees or more in a joint of the digit that was successfully treated to achieve correction to within 5 degrees of neutral 16. Treatment success for both early stage DD and late stage DD would be defined as no change or an improvement in nodule hardness or size, or flexion deformity. Treatment failure for both early- and late stage DD will be defined as progression of the disease such that the patient seeks further intervention, usually as a result of deteriorating hand function and/or flexion deformity at the interphalangeal joints of more than 30 degrees. Age and sex-specific all-cause mortality data will be incorporated in the model based on interim UK life tables, which are available from the Office of National Statistics, if there are no published evidence which indicates a difference in mortality between patients with DD and equivalent controls.

Figure 1. Schematic representation of the preliminary economic model structure.

Figure 1.

Treatments for early stage DD would be the interventions in the RIDD trial (anti-TNF versus usual care) while those for late stage DD would be the interventions stated in the study conducted by Brazelli et al., 17 namely collagenase clostridium histolyticum, percutaneous needle fasciotomy and limited fasciectomy.

Model parameters such as the costs, health utilities and transition probabilities for early stage DD in the first 12 months will be informed using data from the second part of the RIDD trial. More specifically, the transition probabilities for the early stage DD will be determined from the proportion of patients who moved to the next health stated based on the changes in range-of-motion measurements obtained during the trial. The utilities and costs of patients at each health state will in turn be determined from the EQ-5D-5L and health resource questionnaires administered during the trial. These model parameters for late stage DD will be obtained from 18 months data of the RIDD trial and from published literature as required, including Brazelli et al. 17 and Gu et al. 15.

Adverse events from the treatment of early stage DD, if any, will be modelled using data from the RIDD trial while adverse events/complications for treatment of late stage DD will be modelled using published literature, for example the publication by Chen et al. 18.

Data analysis

Inflation and discounting. Due to the small trial sample size (n=35) to be recruited from the Netherlands and to simplify the analysis, the same unit costs (in UK Sterling pounds) for resource utilisation in the Netherlands will be assumed as we do not foresee significant differences in the health resource utilisation between UK and the Netherlands. However, if there is a significant difference in relevant cost items such as length of stay, we will adjust them to the average value in the country of interest for the base case analysis (UK). This is in line with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) guideline which recommends doing multivariable cost regressions to adjust for country effects as one of its recommendations for estimating country-specific costs for multinational studies 19. All costs will be revalued for analysis when appropriate and reported to latest UK prices using the NHS hospital & community health services (HCHS) index for health service resources. For lifetime estimates, the costs and QALYs will be discounted at 3.5% according to UK Treasury guidelines 20.

Statistical analysis. Analysis will be performed on an intention-to-treat basis. Mean and associated measures of uncertainty of costs for each cost category, as well as for estimated QALYs, will be calculated at each time point within each trial arm. Differences between these means will be calculated and tested for statistically significant differences from zero using parametric t-tests.

Cost-utility analysis. Data collected will be used to calculate the cost and QALY per trial participant over the 18 month time horizon of the trial; the baseline to 12 months trial data will be used in the within-trial CUA, while the 18 months trial data will be used in the long term decision analytic model. In the base case analysis, costs examined from the health system perspective would consist of the direct medical costs and direct nonmedical costs. Using these data, the mean difference in costs and the mean difference in QALYs between the control group (treatment) and the intervention group (anti-TNF) will be estimated to give an incremental cost effectiveness ratio (ICER) and an estimate of incremental net benefit (INB). A cost-effectiveness threshold of £20,000 per additional QALY as recommended by NICE will be used to estimate the cost-effectiveness of the intervention 21. An intervention with an ICER below the £20,000 per QALY threshold will generally be considered cost-effective.

Missing data. The nature and pattern of the ‘missing-ness’ will be carefully considered; reasons for missing data will be ascertained and reported if possible and, if necessary, multiple imputation methods will be applied to address the missing data.

Sensitivity analysis. Several deterministic (one-way sensitivity analysis) and a probabilistic sensitivity analysis to explore uncertainties surrounding key parameters in the within-trial economic evaluation (e.g. including societal perspective) and decision-analytic modelling (e.g. transition probabilities) will be undertaken. In order to explore the missing data assumptions, sensitivity analysis will be run on the per-protocol population and multiple imputation method. Cost assumptions in the analysis will also be modified if relevant.

Results from the deterministic sensitivity analysis will be presented in Tornado diagrams in order to compare the relative importance of the parameters. Results from the probabilistic sensitivity analysis will be presented using cost-effectiveness acceptability curve (CEAC) which shows the probability that anti-TNF is cost-effective relative to no treatment across a range of cost-effectiveness thresholds. The CEAC will be generated based on the proportion of bootstrap replicates with positive incremental net benefits 22, 23. The probability that anti-TNF is less costly or more effective than no treatment will be based on the proportion of bootstrap replicates that have negative incremental costs or positive incremental health benefits, respectively.

Discussion

RIDD is the first randomised controlled trial with an economic evaluation conducted among patients with early stage DD; previous studies had utilised decision analytic models (two using expected value decision analytic models and two using Markov models) to estimate the cost-effectiveness in the management of late stage DD 3.

Key strengths of the economic evaluation conducted alongside the trial include a comprehensive assessment of health and social care services resource usage and a reliable method for estimating unit costs from published national sources 24. Economic evaluation conducted alongside the trial also allows reliable estimates of cost effectiveness to be produced at low marginal cost and a wide range of statistical and econometric tests can be utilised since data will be at an individual level 25.

Key limitations of the economic evaluation include response bias and non-response bias due to the nature of the data collection (via patient-reported questionnaires) 26. Response bias occurs when there is a systematic difference in the way participants answered such that their answers do not accurately represent their experience, while non-response bias occurs when there is a systematic difference in characteristics between the responders and non-responders 27. Furthermore, we are not considering the health system perspective of the Netherlands due to the relatively small number of patients being recruited although we would be adjusting for any country effects in our analysis.

In our view, presenting this methodology paper, which serves as a standard operating procedure, before the end of the trial helps safeguards the transparency and consistency of the steps that should be followed as part of the evaluation 28. This in turn will improve the robustness of our evaluation of the health economic data from the RIDD trial.

Data availability

No data are associated with this article.

Funding Statement

The RIDD Trial is funded by the Health Innovation Challenge Fund (HICF), a parallel funding partnership between the Wellcome Trust and the Department of Health UK. MEP, MD, SL, AG, JN are funded by the Wellcome Trust HICF grant [102538, assigned to J Nanchahal]. Costs for the IMP are covered by 180 Therapeutics LP.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; referees: 2 approved]

References

  • 1. Lanting R, Broekstra DC, Werker PM, et al. : A systematic review and meta-analysis on the prevalence of Dupuytren disease in the general population of Western countries. Plast Reconstr Surg. 2014;133(3):593–603. 10.1097/01.prs.0000438455.37604.0f [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Ball C, Izadi D, Verjee LS, et al. : Systematic review of non-surgical treatments for early dupuytren’s disease. BMC Musculoskelet Disord. 2016;17(1):345. 10.1186/s12891-016-1200-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Dritsaki M, Rivero-Arias O, Gray A, et al. : What do we know about managing Dupuytren’s disease cost-effectively? BMC Musculoskelet Disord. 2018;19(1):34. 10.1186/s12891-018-1949-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Nanchahal J, Ball C, Swettenham J, et al. : Study protocol: A multi-centre, double blind, randomised, placebo-controlled, parallel group, phase II trial (RIDD) to determine the efficacy of intra-nodular injection of anti-TNF to control disease progression in early Dupuytren’s disease, with an embedded dose response study [version 2; referees: 2 approved]. Wellcome Open Res. 2017;2:37. 10.12688/wellcomeopenres.11466.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Nanchahal J, Ball C, Davidson D, et al. : Anti-Tumour Necrosis Factor Therapy for Dupuytren’s Disease: A Randomised Dose Response Proof of Concept Phase 2a Clinical Trial. EBioMedicine. 2018;33:282–8. 10.1016/j.ebiom.2018.06.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. National Institute for Health and Care Excellence: Guide to the methods of technology appraisal 2013. Natl Inst Heal Care Excell. 2013. [PubMed] [Google Scholar]
  • 7. Underwood M, Ashby D, Carnes D, et al. : Topical or oral ibuprofen for chronic knee pain in older people. The TOIB study. Health Technol Assess. 2008;12(22):iii-iv–ix-155. 10.3310/hta12220 [DOI] [PubMed] [Google Scholar]
  • 8. Joint Formulary Committee: British National Formulary (online). London BMJ Gr. Pharm. Press.2018; (accessed 1 Jul 2018). Reference Source [Google Scholar]
  • 9. National Health Service: Reference costs.2018; (accessed 1 Jul 2018). Reference Source [Google Scholar]
  • 10. Personal Social Services Research Unit: Unit costs of health and social care.2018; (accessed 1 Jul 2018). Reference Source [Google Scholar]
  • 11. North Yorkshire County Council: Paying for care at home.2018; (accessed 1 Jul 2018). Reference Source [Google Scholar]
  • 12. World Health Organization Collaborating Centre for Drug Statistics Methodology: ATC/DDD index 2018.2018; (accessed 1 Jul 2018). Reference Source [Google Scholar]
  • 13. Herdman M, Gudex C, Lloyd A, et al. : Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36. 10.1007/s11136-011-9903-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. van Hout B, Janssen MF, Feng YS, et al. : Interim scoring for the EQ-5D-5L: Mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15(5):708–15. 10.1016/j.jval.2012.02.008 [DOI] [PubMed] [Google Scholar]
  • 15. Gu NY, Botteman MF, Gerber RA, et al. : Eliciting health state utilities for Dupuytren’s contracture using a discrete choice experiment. Acta Orthop. 2013;84(6):571–8. 10.3109/17453674.2013.865097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Hurst LC, Badalamente MA, Hentz VR, et al. : Injectable collagenase clostridium histolyticum for Dupuytren's contracture. N Engl J Med. 2009;361(10):968–79. 10.1056/NEJMoa0810866 [DOI] [PubMed] [Google Scholar]
  • 17. Brazzelli M, Cruickshank M, Tassie E, et al. : Collagenase clostridium histolyticum for the treatment of dupuytren’s contracture: systematic review and economic evaluation. Health Technol Assess. 2015;19(90):1–202. 10.3310/hta19900 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Chen NC, Shauver MJ, Chung KC: Cost-effectiveness of open partial fasciectomy, needle aponeurotomy, and collagenase injection for dupuytren contracture. J Hand Surg Am. 2011;36(11):1826–34.e32. 10.1016/j.jhsa.2011.08.004 [DOI] [PubMed] [Google Scholar]
  • 19. Ramsey SD, Willke RJ, Glick H, et al. : Cost-effectiveness analysis alongside clinical trials II-An ISPOR Good Research Practices Task Force report. Value Health. 2015;18(2):161–72. 10.1016/j.jval.2015.02.001 [DOI] [PubMed] [Google Scholar]
  • 20. HM Treasury: The Green Book: appraisal and evaluation in central government.2007. Reference Source [Google Scholar]
  • 21. National Institute for Health and Care Excellence: Judging whether public health interventions offer value for money.2013; (accessed 1 Jul 2018). Reference Source [Google Scholar]
  • 22. Briggs AH, Mooney CZ, Wonderling DE: Constructing confidence intervals for cost-effectiveness ratios: an evaluation of parametric and non-parametric techniques using Monte Carlo simulation.In: Stat Med.1999;18(23):3245–62. [DOI] [PubMed] [Google Scholar]
  • 23. Stinnett AA, Mullahy J: Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analysis. Med Decis Making. 1998;18(2 Suppl):S68–80. 10.1177/0272989X98018002S09 [DOI] [PubMed] [Google Scholar]
  • 24. Mogyorosy Z, Smith PC: The main methodological issues in costing health care services - a literature review.2005. Reference Source [Google Scholar]
  • 25. Petrou S, Gray A: Economic evaluation alongside randomised controlled trials: design, conduct, analysis, and reporting. BMJ. 2011;342:d1548. 10.1136/bmj.d1548 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Sedgwick P: Questionnaire surveys: Sources of bias. BMJ. 2013;347:f5265 10.1136/bmj.f5265 [DOI] [Google Scholar]
  • 27. Sedgwick P: Non-response bias versus response bias. BMJ. 2014;348:g2573 10.1136/bmj.g2573 [DOI] [Google Scholar]
  • 28. Dritsaki M, Gray A, Petrou S, et al. : Current UK Practices on Health Economics Analysis Plans (HEAPs): Are We Using Heaps of Them? Pharmacoeconomics. 2018;36(2):253–7. 10.1007/s40273-017-0598-x [DOI] [PubMed] [Google Scholar]
Wellcome Open Res. 2019 Jan 30. doi: 10.21956/wellcomeopenres.16285.r34551

Referee response for version 1

Raymond Oppong 1,2

The aim of this study is to describe the methods for assessing the cost-effectiveness of adalimumab injections compared to placebo for the management of dupuytren’s disease.  The authors propose a within-trial economic evaluation over 12 months and a model-based economic evaluation over a lifetime horizon if the intervention is found to be effective.   

This protocol is very well written and the methods adequately described. Resource use, cost and health outcome data collection for the economic evaluation have been adequately described.

A potential limitation of the within-trial economic evaluation is the placebo comparator. Normally, you would want to compare treatments with usual care/practice.

The paper states on page 3 that “For both analyses, a health system (National Health Service (NHS) and personal social services (PSS)) perspective will be adopted for the base case analysis” A health system can be broader than this depending on how you choose to define it.

With respect to the costing, even though assume the same unit costs for the UK and Netherlands has been justified in this case, it may be worth exploring other options (e.g. the effect of multicountry costing) in sensitivity analysis.

The model could also be better described. E.g. the description provided in the paper just mentions treatments for early and late stage DD but does not give an indication of what these treatments are.

The authors state that a DAM will be conducted if the intervention is found to be effective at 12 months. A better justification should be provided for this.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2019 Feb 8.
May Ee Png 1

We would like to thank both Mrs Belen Corbacho and Dr Raymond Oppong for their supportive reports and helpful comments about our health economics analysis plan (HEAP). We have amended the HEAP manuscript accordingly.

Comment 1: A potential limitation of the within-trial economic evaluation is the placebo comparator. Normally, you would want to compare treatments with usual care/practice.

Response: As mentioned in our response to Reviewer 1’s Comment 5, we are updated the methodology and relevant text in the abstract and main text to compare anti-TNF with usual care.

Comment 2: The paper states on page 3 that “For both analyses, a health system (National Health Service (NHS) and personal social services (PSS)) perspective will be adopted for the base case analysis” A health system can be broader than this depending on how you choose to define it.

Response: As defined in our original statement, health system refers to the NHS and PSS. 

We’ve changed the statement as follows:

For both analyses, a health system (i.e. National Health Service (NHS) and personal social services (PSS)) perspective will be adopted for the base case analysis…

Comment 3: With respect to the costing, even though assume the same unit costs for the UK and Netherlands has been justified in this case, it may be worth exploring other options (e.g. the effect of multicountry costing) in sensitivity analysis.

Response: As mentioned under “Data analysis – Inflation and discounting”, we would estimate this cost according to the ISPOR guideline which recommends performing multivariable cost regressions to adjust for country effects for estimating country-specific costs for multinational studies. Furthermore, as mentioned in the ISPOR guideline, "intercountry differences in population characteristics and treatment patterns are more likely to influence summary measures between countries rather than differences in unit costs". Furthermore, since only a relatively small number of patients will be recruited from Netherlands (n=35) versus at least 138 patients from the UK, it is unlikely that the overall cost results will differ significantly even if other approaches were adopted.

Reference: Ramsey SD, Willke RJ, Glick H, et al. Cost-effectiveness analysis alongside clinical trials II - An ISPOR good research practices task force report. Value Heal 2015;18:161–72.

Comment 4: The model could also be better described. E.g. the description provided in the paper just mentions treatments for early and late stage DD but does not give an indication of what these treatments are.

Response: We have included a paragraph under “Methods – Decision-analytic modelling” as follows:

Treatments for early stage DD would be the interventions in the RIDD trial (anti-TNF versus placebo) while those for late stage DD would be the interventions stated in the study conducted by Brazelli et al [17], namely collagenase clostridium histolyticum, percutaneous needle fasciotomy and limited fasciectomy.

Comment 5: The authors state that a DAM will be conducted if the intervention is found to be effective at 12 months. A better justification should be provided for this.

Response: As detailed in our response to Reviewer 1’s Comment 1, we have updated the methodology for better clarification.

Wellcome Open Res. 2019 Jan 14. doi: 10.21956/wellcomeopenres.16285.r34411

Referee response for version 1

Belen Corbacho 1

I have no concern about economics methods as they seem robust and according to current best practice for such analyses. The research team has extensive experience in their field of health economics and clinical trials. Therefore the authors place the team in a great position to undertake and informs a timely research question.

The authors have appropriately justified the need for this study. The economic evaluation plan provides a thorough overview of the cost-effectiveness analysis that will be conducted in the RIDD trial. Nevertheless I have some comments/questions the authors might want to address:

  • In addition to the main within-trial economic evaluation (cost per QALY approach in accordance with NICE guidance), the co-applicants also plan to conduct modelling work if deemed appropriate. The authors say that they will only do the model if the treatment is effective. I advise the authors to explain this further (e.g effective on primary outcome statistical significance / primary outcome not statistical significance / effective on secondary outcomes / effective on QoL).

  • I would suggest including a section to summarize the review of existing literature. The authors are planning to use a number of economic evaluations, however they give no detail about databases searched, number of relevant evaluations identified, model structure in relevant papers, categories of resource use included in the models etc. They could include a table as Annex to give further details on this.

  • The authors should provide the reader with a justification for the need of the long term model. A key point is to clarify what is the treatment expecting to capture, which I would advise to explain further in the text. Is the treatment expected to delay progression to late DD? If this is the case: (i) how quickly this is expected (e.g is the follow-up of the trial enough to capture this?); and (ii) how is this captured? If this is captured in the RIDD trial this should be listed (i.e percentage of patients that become late DD). If this is not captured in the trial, is there any relevant study that relates the primary or secondary outcome to late DD? I think this is a critical point, because if treatment is not expected to delay progression then it’s all about symptomatic management, and if this is the case there might be no need for such a sophisticated model.

  • Similarly, I would suggest to provide more detail on the statistical analysis which will inform the model: how it is planned to estimate transition probabilities, utilities of health states and costs. My main concern is how the authors are planning to implement the model, given that the trial has 138 patients to inform transitions. It might be helpful to justify the numbers in the analysis plan; and consider the possibility of simplifying the model structure according to these numbers.

  • Regarding utilities, I would like to see further details about how they are getting the utilities from the trial. For example, details about the statistical model that will be used to define eq5d given the health state. Similarly, more detail should be given to how costs related to health stated will be estimated (e.g sources).

  • In relation to direct costs, I am not sure I understand the decision of excluding man power. In clinical practice it won´t be about the new drug vs placebo but the new drug vs current treatment. Therefore, I don’t think excluding man power is correct, as cost-effectiveness is about clinical practice, and in clinical practice there will be staff costs related to the treatment, even if outpatient visit is only £80, this should also be considered. 

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2019 Feb 8.
May Ee Png 1

We would like to thank both Mrs Belen Corbacho and Dr Raymond Oppong for their supportive reports and helpful comments about our health economics analysis plan (HEAP). We have amended the HEAP manuscript accordingly.

Comment 1: In addition to the main within-trial economic evaluation (cost per QALY approach in accordance with NICE guidance), the co-applicants also plan to conduct modelling work if deemed appropriate. The authors say that they will only do the model if the treatment is effective. I advise the authors to explain this further (e.g effective on primary outcome statistical significance / primary outcome not statistical significance / effective on secondary outcomes / effective on QoL).

Response: As mentioned in the “Decision-analytic modelling” section, the modelling will be performed if the trial shows that anti-TNF injection is found to be effective in controlling the disease progression at 12 months follow-up (which is the primary outcome). The text has been changed as follows in order to clarify this point:

The second proposed economic evaluation will comprise a lifetime Markov cohort model with a 6-month cycle length. This will be constructed if the optimal dose of anti-TNF is found to be effective in controlling the disease progression in terms of showing a statistically significant differences between the anti-TNF or no treatment groups based on the primary or secondary outcomes at 12 months follow-up.

Comment 2: I would suggest including a section to summarize the review of existing literature. The authors are planning to use a number of economic evaluations, however they give no detail about databases searched, number of relevant evaluations identified, model structure in relevant papers, categories of resource use included in the models etc. They could include a table as Annex to give further details on this.

Response: We have already described the current state of the value for money of competing alternatives to treat and manage Dupuytren’s disease in a recent literature review (Dritsaki, 2018); hence we have updated our Introduction to reflect this:

However, a recent systematic review published by the trial team [3] identified four studies, all of which synthesised evidence from various sources, rather than a single randomised controlled trial, and reported the cost-effectiveness of collagenase clostridium histolyticum injection, percutaneous needle fasciotomy or limited fasciectomy among patients with late stage DD.

Reference: Dritsaki M, Rivero-Arias O, Gray A, et al. What do we know about managing Dupuytren’s disease cost-effectively? BMC Musculoskelet Disord 2018;19:34. doi:10.1186/s12891-018-1949-2

Comment 3: The authors should provide the reader with a justification for the need of the long term model. A key point is to clarify what is the treatment expecting to capture, which I would advise to explain further in the text. Is the treatment expected to delay progression to late DD? If this is the case: (i) how quickly this is expected (e.g is the follow-up of the trial enough to capture this?); and (ii) how is this captured? If this is captured in the RIDD trial this should be listed (i.e percentage of patients that become late DD). If this is not captured in the trial, is there any relevant study that relates the primary or secondary outcome to late DD? I think this is a critical point, because if treatment is not expected to delay progression then it’s all about symptomatic management, and if this is the case there might be no need for such a sophisticated model.

Response: The treatment is expected to reduce the proportion of patients progressing to late-stage DD. Regarding (i), since we are only recruiting patients with a clear history of disease progression, we anticipate that at least some will progress to the late disease stage. For (ii), disease progression will be tracked using case report forms (CRFs) which record the nodule hardness, nodule size via ultrasound imaging, range of motion of affected digit and patient reported outcome measures.

The following sentence has been added to the “Methods – Decision-analytic modelling” section:

A long-term model is needed as this treatment is expected to reduce the proportion of patients progressing to late stage DD. Disease progression of the patients in the trial will be tracked using CRFs which record nodule hardness, the nodule size on ultrasound scan, range of motion of affected digit and patient reported outcome measures.

Comment 4: Similarly, I would suggest to provide more detail on the statistical analysis which will inform the model: how it is planned to estimate transition probabilities, utilities of health states and costs. My main concern is how the authors are planning to implement the model, given that the trial has 138 patients to inform transitions. It might be helpful to justify the numbers in the analysis plan; and consider the possibility of simplifying the model structure according to these numbers.

Regarding utilities, I would like to see further details about how they are getting the utilities from the trial. For example, details about the statistical model that will be used to define eq5d given the health state. Similarly, more detail should be given to how costs related to health stated will be estimated (e.g. sources).

Response: The “Methods – Decision-analytic modelling” section has been updated as follows:

Model parameters such as the costs, health utilities and transition probabilities for early stage DD in the first 12 months will be informed using data from the second part of the RIDD trial. More specifically, the transition probabilities for the early stage DD will be determined from the proportion of patients who moved to the next health stated based on the changes in range-of-motion measurements obtained during the trial. The utilities and costs of patients at each health state will in turn be obtained from the EQ-5D-5L and health resource questionnaires administered during the trial. These model parameters for late stage DD will be obtained from 18 months data of the RIDD trial and from published literature as required, including Brazelli et al. [17] and Gu et al. [15].

Comment 5: In relation to direct costs, I am not sure I understand the decision of excluding man power. In clinical practice it won´t be about the new drug vs placebo but the new drug vs current treatment. Therefore, I don’t think excluding man power is correct, as cost-effectiveness is about clinical practice, and in clinical practice there will be staff costs related to the treatment, even if outpatient visit is only £80, this should also be considered.

Response: We have updated the methodology (in the “Methods – Direct medical costs related to trial” section) to include the cost of manpower as suggested by the reviewer. The following has been added:

Since the usual care is no treatment, the cost of manpower will be included for the anti-TNF group only. Manpower cost will be estimated by assuming that the injection will be administered by a medically qualified clinician at consultant level in the outpatient setting.

To make things clearer for readers without health economics background in trials, we have also added the following at the beginning of the Methods section:

No treatment instead of placebo will be used as the comparator. In the RIDD trial placebo is being administered as an experimental control and not used in routine care for patients with early stage DD.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    No data are associated with this article.


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES