Skip to main content
Sage Choice logoLink to Sage Choice
. 2020 Apr 29;34(7):934–945. doi: 10.1177/0269216320913463

Economic evaluation of a combined screening and stepped-care treatment program targeting psychological distress in patients with metastatic colorectal cancer: A cluster randomized controlled trial

Mohamed El Alili 1,*,✉, Claudia SEW Schuurhuizen 2,3,*, Annemarie MJ Braamse 4, Aartjan TF Beekman 3, Mecheline H van der Linden 5, Inge R Konings 2, Joost Dekker 3, Judith E Bosmans 1
PMCID: PMC7787671  PMID: 32348700

Abstract

Background:

Psychological distress is highly prevalent among patients with metastatic colorectal cancer.

Aims:

To perform an economic evaluation of a combined screening and treatment program targeting psychological distress in patients with metastatic colorectal cancer in comparison with usual care.

Design:

Societal costs were collected alongside a cluster randomized controlled trial for 48 weeks. A total of 349 participants were included.

Setting:

Participants were recruited from oncology departments at 16 participating hospitals in the Netherlands.

Methods:

Outcome measures were the Hospital Anxiety and Depression Scale and quality-adjusted life-years. Missing data were imputed using multiple imputation. Uncertainty was estimated using bootstrapping. Cost-effectiveness planes and cost-effectiveness acceptability curves were estimated to show uncertainty surrounding the cost-effectiveness estimates. Sensitivity analyses were performed to check robustness of results.

Results:

Between treatment arms, no significant differences were found in Hospital Anxiety and Depression Scale score (mean difference: –0.058; 95% confidence interval: –0.13 to 0.011), quality-adjusted life-years (mean difference: 0.042; 95% confidence interval: –0.015 to 0.099), and societal costs (mean difference: –1152; 95% confidence interval: –5058 to 2214). Cost-effectiveness acceptability curves showed that the probability of cost-effectiveness was 0.64 and 0.74 at willingness-to-pay values of €0 and €10,000 per point improvement on the Hospital Anxiety and Depression Scale, respectively. The probability that the intervention was cost-effective compared to usual care for quality-adjusted life-years was 0.64 and 0.79 at willingness-to-pay values of €0 and €20,000 per quality-adjusted life-year, respectively.

Conclusion:

The intervention is dominant over usual care, primarily due to lower costs in the intervention group. However, there were no statistically significant differences in clinical effects and the uptake of the intervention was quite low. Therefore, widespread implementation cannot be recommended.

Keywords: Cost–benefit analysis, clinical trial, terminal care, colorectal neoplasms, neoplasm metastasis, psychotherapy


What is already known about the topic?

  • Distress negatively affects the healthcare system because of its association with reduced quality of life.

  • Routine screening for distress is recommended by major cancer organizations on the assumption that identification of elevated distress levels will result in an increased uptake of care and, consequently, reduction of distress.

What this paper adds?

  • Although the intervention program was dominant over usual care, it did not significantly improve distress and quality of life.

  • In addition, the uptake of the intervention was quite low.

  • Therefore, widespread implementation of the intervention program cannot be recommended based on the results of this study.

Implications for practice, theory, or policy

  • Psychosocial needs of patients in end-of-life care are often already met through support by relatives and primary caregivers.

Introduction

Colorectal cancer is the third most common cancer in males and second most common in females.1,2 More than 1.3 million patients are diagnosed with colorectal cancer worldwide each year.3 Approximately 40%–50% of those diagnosed with colorectal cancer develop metastatic colorectal cancer and for most of them curative treatment is not possible anymore. Patients with an advanced state of disease have a high prevalence of distress.4,5 Distress negatively affects the healthcare system because of its association with reduced health-related quality of life,6,7 reduced treatment adherence, and poor prognosis.8,9 Furthermore, psychological distress among cancer patients is associated with an economic burden. A recently published paper showed, for example, that higher psychological distress in patients with cancer is associated with higher mental healthcare and primary care costs.10

Routine screening for distress is recommended by major cancer organizations since it is assumed that identification of elevated levels of distress will result in increased uptake of psychosocial services and, as a consequence, reduction of distress.11–14 However, implementation of such programs requires the use of scarce healthcare resources. Therefore, it is important to assess not only the effectiveness but also the cost-effectiveness of screening and treatment programs in cancer patients.15 Cost-effectiveness is an important factor in deciding whether such a program should be implemented into hospital routine care. Stepped-care approaches have been advocated as a potentially cost-effective approach to providing mental care and support.16 Combining routine screening for distress among metastatic colorectal cancer patients with a stepped-care treatment approach could result in a more efficient way of providing psychological support to this group of patients.

An intervention program was, therefore, developed to detect and reduce distress in patients with metastatic colorectal cancer who were mainly receiving palliative care. This intervention program, the TES program, combined targeted selection (T), enhanced care (E), and referral to evidence-based interventions using a stepped-care (S)-oriented approach (hereafter referred to as intervention program). Although no evidence was found that the intervention program resulted in improved patient outcomes for distress, it showed improved patient satisfaction with care and better self-reported cognitive functioning,17 making it important to also estimate the joint uncertainty surrounding the cost and effect differences between the treatments.18 Therefore, the aim of this study is to assess the cost-effectiveness and cost-utility of the intervention program in comparison with usual care among patients with metastatic colorectal cancer scheduled to start palliative treatment with first-line chemotherapy from a societal perspective.

Methods

Study design

The economic evaluation was conducted from a societal perspective alongside a multi-center, cluster randomized controlled trial (RCT) comparing the intervention program with usual care among patients with metastatic colorectal cancer.19 Effect and cost outcomes were evaluated at baseline, and after 3, 10, 24, and 48 weeks, meaning that the time horizon was 48 weeks. The trial was approved by the Medical Ethics Committee of the VU University Medical Center and is registered in the Dutch trial registry (http://www.trialregister.nl/trialreg/index.asp, identifier: NTR4034). The study was conducted in accordance with the Declaration of Helsinki and Good Clinical Practice guidelines. Detailed information on the study design and the intervention program is provided elsewhere.17,19

Population and setting

Between July 2013 and October 2016, participants were recruited from oncology departments at 16 participating hospitals in the Netherlands. All participants provided written informed consent. Participants were eligible if (a) they had a diagnosis of metastatic colorectal cancer, (b) they were scheduled to start palliative treatment with first-line chemotherapy, and (c) they had a life expectancy of more than 3 months. Exclusion criteria for participation were (a) younger than 18 years or older than 85 years, (b) insufficient command of the Dutch language, (c) recent psychotherapy (i.e. in the past 3 months, at least one session every 2 weeks), and (d) severe psychopathology.

Randomization and sample size

This study was a cluster RCT, in which participating hospitals were used as the unit of randomization to avoid contamination between treatment groups. The randomization procedure was performed by a blinded statistician, prior to participant recruitment. Due to the nature of the intervention, oncologists, nurses, psychologists, and patients could not be blinded. However, statistical analyses were performed blinded for group status.

The overall expected effect size was 0.18. To demonstrate this effect on the Hospital Anxiety and Depression Scale (HADS), a minimum of 302 participants was needed. This was based on a longitudinal design with four follow-up measurements, a within-subject correlation of ρ = 0.30, a two-sided α ⩽ 0.05, and a β = 0.80. In a cluster RCT, individuals within a cluster (i.e. hospital) cannot be assumed to be independent.20 Consequently, an intra-cluster correlation (ICC) of 0.005 was assumed, meaning 715 participants were needed.19,21,22 During the recruitment period, the actual proportion of participants treated for psychological distress in the intervention program group was lower than expected. The observed low uptake of the intervention program triggered the need to pursue a futility analysis, resulting in halted recruitment.17

Intervention

Participants in hospitals assigned to the intervention program were screened for psychological distress by a trained nurse/clinical nurse specialist before the start of chemotherapy, and at 10 and 18 weeks after the start of chemotherapy using the HADS and the “Lastmeter” (Distress Thermometer and corresponding Problem List).23,24 A score of ⩾13 on the HADS or ⩾5 on the Lastmeter was seen as an indicator for psychological distress. In routine practice, a considerable number of patients scheduled for palliative treatment do not receive adequate psychological support, because psychological needs are under-recognized in clinical oncology practice.25–27 Therefore, within the intervention program, regular screening for psychological distress took place. After evaluation of the psychological distress scores, trained nurses proposed treatment in the form of stepped care to participants scoring above the thresholds. In addition, the intervention program was also offered to participants who expressed the need to talk to a professional. The steps of the intervention program consisted of (a) watchful waiting, (b) a guided self-help program via Internet or a booklet, (c) face-to-face problem-solving therapy offered by a trained nurse, and (d) referral to specialized psychosocial services and/or psychotropic medication. The rationale behind the first step, watchful waiting, is that psychological distress often decreases or disappears over time (natural course). The second and third steps in the intervention program are based on problem-solving therapy which has been shown to be effective in treating psychological distress.28–32 The last step in the intervention program is psychotherapy, medication, or referral to other services. This step is only initiated if psychological distress persists. More detailed information about the intervention program is provided elsewhere.17,19

In the control group, participants received usual care. Treatment of psychological distress in this group of participants was only initiated when psychological distress was recognized by healthcare providers. Care was not restricted in any way.

The intervention program aimed to improve usual care in several ways.17,19 These improvements include the following: formal screening at frequent intervals for distress versus ad hoc interviews if participants mention problems or when an oncologist or nurse identifies problems; enhanced care provided by a collaborative team which is coordinated by a trained nurse versus regular care provided by an oncologist and nurse; diagnostic evaluation with standardized interviews assessing distress and problem analysis by psychologists versus non-standardized interviews by oncologists and nurses; and provision of a guided self-help program, individual face-to-face counseling, medication, or planned referral to other treatments versus ad hoc support, advice, and referral to other treatments when needed.

Clinical outcomes

The clinical outcomes of this economic evaluation were the HADS and quality-adjusted life-years (QALYs). The HADS was measured at baseline, and after 3, 10, 24 weeks, and 48 weeks.33 The HADS is a 14-item self-assessment scale (range: 0–42) for measuring psychological distress. The HADS has shown to be reliable, valid, and responsive.34 QALYs were calculated based on health-related quality-of-life measurements at baseline, and after 3, 10, 24, and 48 weeks using the EuroQol (EQ-5D-5L).35 The EQ-5D-5L assessed quality of life on five dimensions (mobility, self-care, activities of daily living, pain/discomfort, and depression/anxiety) with five answer levels (no problems to severe problems). The EQ-5D-5L health states were converted to utility scores using the Dutch tariff, where 0 refers to death and 1 to full health (range: –0.446 to 1, where negative utilities indicate that a health state is valued worse than death).36 Using the area-under-the-curve method, QALYs were calculated by multiplying the amount of time a participant spent in a specific health state with the utility score associated with that health state. Transitions between health states were linearly interpolated.

Costs

Costs were collected from the societal perspective and included the following: oncological treatment costs, medication costs, other healthcare costs, informal care costs, lost productivity costs due to absenteeism from paid work, and intervention costs. Healthcare utilization outside the hospital, informal care, and absenteeism from paid work were measured using an adapted version of the Trimbos and iMTA questionnaire for Costs Associated with Psychiatric illness (TiC-P, adapted version).37 The adapted cost questionnaire was administered at 10, 24, and 48 weeks after baseline with a recall period of 3 months. Costs were valued using standard costs from the Dutch costing guideline.38 Medications were valued using prices from www.medicijnkosten.nl.38 Costs related to oncological treatment were based on treatment costs of metastatic colorectal cancer reported by Farkkila et al.39 and converted using purchasing power parities (PPPs).40 The shadow price of informal care is assumed to be equal to the tariff for cleaning work. Lost productivity costs due to absenteeism from work were calculated using gender-specific income values of the Dutch population and calculated according to the friction cost method. The friction cost method assumes that after a specific period of time (i.e. friction period: 85 days), the sick employee is replaced and that there are consequently no productivity losses anymore after this period.41 All costs were expressed in euros for the year 2016 using consumer price indices.42 Discounting was not necessary because follow-up was shorter than 52 weeks.

Intervention program costs were estimated using a bottom-up approach. Resources involved in the implementation of the intervention program were based on a logbook, which was prospectively completed by the research nurses. The following costs were included: (a) costs of development of the intervention program, (b) costs related to training the nurses and psychologists, and (c) costs related to resources used in the implementation of the intervention program for each participant. Costs of development of the intervention program included the costs of printing booklets and building a website for the guided self-help program. Website costs were based on a similar web-based intervention43 and converted using PPP.40 Costs for training of nurses and psychologists were based on their hourly wage. Costs related to resources used in stepped care for each participant were based on the time a participant spent with a health professional (i.e. screening time of 5 min with trained nurse), a face-to-face problem-solving therapy session (i.e. 30 min with a trained nurse), and referral to specialized psychosocial services and/or psychotropic medication (i.e. standard price of a consultation with a psychologist or psychiatrist from the Dutch costing guideline). A detailed table with all prices that were used to value costs is provided in Supplemental Appendix S1.

Statistical analyses

Cost-effectiveness and cost-utility analyses were performed according to the intention-to-treat principle. Missing cost-and-effect data were replaced using multiple imputation with chained equations (MICE).44 Cost and effect data were assumed to be “Missing At Random.”45 The imputation model included variables that differed at baseline, were related to missing data, or were associated with the outcome. To deal with the skewed distribution of cost data, predictive mean matching (PMM) was used in MICE.46 The number of imputed datasets was increased until the loss of efficiency was less than 5%, resulting in 20 imputed datasets.46 Each of the imputed datasets was analyzed separately as described below. Results from the multiple datasets were pooled using Rubin’s rules.47

Multilevel regression models were used to estimate differences in costs and effects between the treatment groups while accounting for the hierarchical structure of the data. For costs, a two-level structure was used where hospital and participants represented the first and second level, respectively. For the difference in HADS, an additional level was used to account for repeated observations (i.e. HADS scores at different time points). The multilevel regression model for the difference in HADS included three levels; that is, repeated observations (third level) are clustered within participants (second level) and participants are clustered within hospitals (first level). Thus, the analysis accounted for a longitudinal hierarchical structure. Progression of metastatic colorectal cancer was added as a covariate in the regression models to adjust for possible confounding, as was performed in the effectiveness analysis.17 Incremental cost-effectiveness ratios (ICERs) were calculated by dividing the difference in total costs by the difference in effects. Bias-corrected bootstrapping was used to estimate 95% confidence intervals around the mean cost and effect differences (5000 replications). Statistical uncertainty surrounding ICERs was illustrated by plotting the bootstrapped cost-effect pairs on a cost-effectiveness plane (CE plane). Cost-effectiveness acceptability curves (CEACs) were also estimated, which demonstrated the probability that the intervention program is cost-effective compared to usual care for a range of different ceiling ratios (i.e. the willingness-to-pay for one point decrease in HADS or for one additional QALY).48 In the Netherlands, the informal threshold of cost-effectiveness for medical interventions ranges between €20,000 and €80,000 per QALY gained.49 For outcome measures such as the HADS, no formal cost-effectiveness thresholds have been determined. Analyses were performed in IBM SPSS Statistics 24® (IBM Corp., Armonk, NY, USA), StataSE 16® (StataCorp LP, CollegeStation, TX, USA), and MLwiN® version 2.36 (University of Bristol, Bristol, UK).50

Sensitivity analysis

Four sensitivity analyses (SAs) were performed. First, the economic evaluation was performed from the healthcare perspective (SA1). Second, the Human Capital approach was used to estimate lost productivity costs (SA2). With the human capital approach, all lost productivity hours were included in the cost estimates. In the third sensitivity analysis (SA3), training costs of healthcare providers in the intervention program were added to total societal costs. In the last sensitivity analysis (SA4), the regression models in the cost-effectiveness analysis were not adjusted for possible confounding by disease progression.

Results

Population

Sixteen oncology departments consented to participate and were allocated to the intervention program (n = 8) or usual care (n = 8). In total, 393 participants met the inclusion criteria and were willing to participate. Of these 393 participants, 5 died before the start of the study, 13 were too ill to participate, and 25 withdrew their consent or could not be contacted. Thus, 349 participants were included, of whom 184 participated in the intervention program group and 165 received treatment as usual. Table 1 presents baseline characteristics of the two study groups. There was a clinically relevant difference in HADS score at baseline between the groups: the usual care group scored higher on the HADS than the intervention program group.

Table 1.

Baseline characteristics.

Participant characteristics Intervention program (n = 184)
n (%)
Usual care (n = 165)
n (%)
Age, mean (SD) 66.25 (9.8) 65.84 (10.6)
Gender
 Male 113 (61.4) 111 (67.3)
 Female 71 (38.6) 54 (32.3)
ECOG PS
 0 48 (26.1) 34 (20.6)
 1 71 (28.6) 34 (20.6)
 2 6 (3.3) 5 (3.0)
 Missing 59 (32.1) 92 (55.8)
Chemotherapy regimen
 Capecitabine 36 (19.6) 36 (21.8)
 CAPOX 124 (67.4) 116 (70.3)
 FOLFOX 17 (9.2) 7 (4.2)
 Other 1 (0.5)
 Missing 1 (0.5) 2 (1.2)
Marital status
 Married/domestic partnership 133 (72.3) 123 (74.5)
 Unmarried/divorced/widowed 49 (26.6) 40 (24.2)
 Missing 2 (1.1) 2 (1.2)
Education
 Low 10 (5.4) 9 (5.5)
 Middle 122 (66.3) 101 (61.2)
 High 49 (26.6) 52 (31.5)
 Missing 3 (1.6) 3 (1.8)
Working
 Yes 39 (21.2) 42 (24.5)
 No/retired 143 (77.7) 121 (73.3)
 Missing 2 (1.1) 2 (1.2)
Time from diagnosis primary tumor to start of study (months)
 <1.5 52 (28.3) 64 (38.8)
 1.5–10 66 (35.9) 48 (29.1)
 >10 65 (35.3) 51 (30.9)
 Baseline HADS score, mean (SD) 8.81 (0.24) 10.31 (0.26)
 Baseline EQ-5D utility score, mean (SD) 0.80 (0.02) 0.80 (0.01)

SD: standard deviation; ECOG PS: Eastern Cooperative Oncology Group Performance Status; EQ-5D: EuroQol-5 Dimensions; HADS: Hospital Anxiety and Depression Scale.

In the intervention program group, 47 participants (25.5%) died versus 51 participants (30.9%) in the usual care group. On average, participants in the intervention program group survived 1 week longer than participants in the usual care group, but this difference was not statistically significant (intervention program 43 vs usual care 42 weeks, 95% confidence interval (CI): –1.6 to 3.2). During follow-up, 110 (40%) participants in the intervention program group and 98 (41%) participants in the usual care group completed the study. Of these, 141 (40%) had missing data. Participants with incomplete data significantly differed from those with complete data regarding gender (higher rate of incomplete data for males), progression of disease (higher rate of incomplete data for participants with progression of metastatic colorectal cancer), smoking (higher rate of incomplete data for smokers), and primary location of tumor (higher rate of incomplete data for participants with left-sided tumor).

Overall, 48 participants entered stepped care after screening and a total of 62 interventions were used. Watchful waiting was used most frequently (n = 41; 66.1%). The guided self-help program was chosen two times by participants, but neither one of those two participants actually started this treatment due to disease progression. Face-to-face problem-solving therapy was given to one participant, and a referral to specialized psychosocial services and/or psychotropic medication was made 18 times.

Clinical outcomes (HADS and QALY)

The mean score on the HADS at different time points is summarized in Table 2. The overall difference in HADS over time between the intervention program and usual care was –0.058, indicating that the intervention program resulted in a decrease of 0.058 points more on the HADS than usual care; however, this difference was not statistically significant (95% CI: –0.13 to 0.011). The mean difference in QALYs between the groups was 0.042, which was also not statistically significant (95% CI: –0.015 to 0.10).

Table 2.

Multiple imputed effects and costs for the intervention program group (n = 184) and usual care group (n = 110) after 48 weeks.

Outcomes Mean (SE) Mean difference (95% CI)a,b
Intervention program (n = 184) Usual care (n = 165)
Hospital Anxiety and Depression Scale (HADS) score (0–42)
 Baseline 8.81 (0.24) 10.31 (0.26) –0.058 (–0.13 to 0.011)c
  T1 8.72 (0.47) 10.16 (0.57)
  T2 8.39 (0.53) 10.43 (0.65)
  T3 8.02 (0.59) 9.89 (0.69)
  T4 7.76 (0.58) 9.78 (0.79)
Quality-adjusted life-year (QALY) (0–1) 0.63 (0.018) 0.58 (0.020) 0.042 (–0.015 to 0.099)
Healthcare costs
 Primary care 784 (63) 725 (67) 58 (–119 to 233)
 Mental healthcare 93 (25) 110 (25) –18 (–83 to 56)
 Home care 1910 (718) 2798 (1201) –888 (–4159 to 1484)
 Outside hospital 15 (6) 19 (7) –5 (–22 to 12)
 Treatment costs 24,356 (614) 23,892 (696) 526 (–1155 to 2215)
 Intervention 31 (2) 0 (0) 31 (28 to 35)
 Total healthcare costs 27,189 (916) 27,545 (1362) –295 (–3844 to 2579)
Non-healthcare costs
 Lost productivity 2008 (379) 2301 (421) –290 (–1389 to 806)
 Informal care 2915 (369) 3482 (565) –567 (–1890 to 559)
 Total non-healthcare costs 4923 (503) 5784 (680) –857 (–2411 to 622)
Total societal costs 32,112 (1073) 33,329 (1627) –1152 (–5058 to 2214)

SE: standard error; 95% CI: 95% confidence interval.

Variables included in the multiple imputation model are described in the lower part of the table. Multiple imputation model consisted of variables that differed at baseline (HADS); variables that were related to missingness (Eastern Cooperative Oncology Group score, progression, smoking, gender, education, primary location of cancer, and number of metastases); variables that were associated with the outcome (Eastern Cooperative Oncology Group score, progression, comorbidities, work, type of chemotherapy, number of metastases, primary location of cancer, drinking, smoking, gender, and education).

a

Corrected for progression.

b

Uncertainty around cost differences estimated using the non-parametric bootstrap.

c

Overall effect over time corrected for score on HADS at baseline.

Costs

The mean total intervention costs amounted to €31 per participant (see Table 2). There were no statistically significant differences in total healthcare costs per participant between the intervention program group and the usual care group (–€295; 95% CI: –3844 to 2579), non-healthcare costs (–€857; 95% CI: –2427 to 615), or total societal costs (–€1152; 95% CI: –5058 to 2214). The main contributor to total societal costs was the metastatic colorectal cancer treatment costs (76% vs 72% of total societal costs).

Cost-effectiveness and cost-utility

For the HADS, the ICER was €19,991 per point of improvement on the HADS (see Table 3), indicating that improvement of one point on the HADS scale was associated with a saving of €19,991 in the intervention program group as compared to the usual care group. Thus, the intervention program was dominant over usual care. The CEAC (Figure 1(b)) shows that the probability of cost-effectiveness at ceiling ratios of €0, €20,000, and €80,000 per point improvement on the HADS and the probability that the intervention program is cost-effective compared to usual care were 64%, 82%, and 95%, respectively.

Table 3.

Results of the cost-effectiveness analysis, cost-utility analysis, and sensitivity analyses.

Outcome ΔC (95% CI)a,b ΔE (95% CI)a ICER CE plane (%)
NE SE SW NW
Main analysis: Societal perspective
 HADS score (0–42) –1152 (–4595 to 1908) –0.058 (–0.13 to 0.0095)c 19,991 35 60 4 1
 QALYs (0–1) –1152 (–4631 to 1955) 0.042 (–0.0094 to 0.094) –27,277 35 60 4 1
SA1: Healthcare perspective
 HADS score (0–42) –295 (–3279 to 2585) –0.058 (–0.13 to 0.0095)c 5115 47 47 4 2
 QALYs (0–1) –295 (–3254 to 2639) 0.042 (–0.0098 to 0.094) –6980 47 47 4 2
SA2: Human capital approach
 HADS score (0–42) –2155 (–7900 to 2160) –0.058 (–0.13 to 0.0095)c 37,414 36 58 5 1
 QALYs (0–1) –2155 (–7940 to 2117) 0.042 (–0.0098 to 0.094) –51,051 36 58 4 2
SA3: Including training costs
 HADS score (0–42) –1152 (–4595 to 1908) –0.058 (–0.13 to 0.0095)c 19,991 35 60 4 1
 QALYs (0–1) –1152 (–4632 to 1955) 0.042 (–0.0098 to 0.094) –27,277 35 60 4 1
SA4: Unadjusted analyses
 HADS score (0–42) –1217 (–4886 to 1933) –0.057 (–0.12 to 0.0098) 21,211 35 60 4 1
 QALYs (0–1) –1217 (–4846 to 1988) 0.039 (–0.018 to 0.095) –31,304 33 58 7 2

CE plane: cost-effectiveness plane; ICER: incremental cost-effectiveness ratio; NE: northeast quadrant; NW: northwest quadrant; SA: sensitivity analysis; SE: southeast quadrant; SW: southwest quadrant; 95% CI: 95% confidence interval; QALYs: quality-adjusted life-years; HADS: Hospital Anxiety and Depression Scale.

a

Corrected for progression.

b

Uncertainty around cost differences estimated using the non-parametric bootstrap.

c

Overall effect over time corrected for score on HADS at baseline.

Figure 1.

Figure 1.

Cost-effectiveness planes and cost-effectiveness acceptability curves: (a) cost-effectiveness plane for difference in HADS, (b) cost-effectiveness acceptability curve for difference in HADS, (c) cost-effectiveness plane for difference in QALY, and (d) cost-effectiveness acceptability curve for difference in QALY.

HADS: Hospital Anxiety and Depression Scale; QALY: quality-adjusted life-years.

The cost-utility analysis (CUA) resulted in an ICER of €–27,277 per QALY, meaning that to gain one QALY, €27,277 is saved in the intervention program group as compared to the usual care group, again indicating dominance of the intervention program over usual care. The CEAC (Figure 1(d)) shows probabilities that the intervention program is cost-effective compared to usual care of 64%, 79%, and 94% at ceiling ratios of €0, €20,000, and €80,000 per QALY, respectively.

SA

From the healthcare perspective (SA1) as compared with the main analysis, a smaller total cost difference was found. At ceiling ratios of €0 per additional unit of effect, the probability that the intervention program is cost-effective compared to usual care was 51% both for the HADS and QALYs. This increased to 75% and 71% for a ceiling ratio of €20,000 per additional unit of effect for the HADS and QALYs, respectively.

In comparison with the main analysis, using the Human Capital Approach to calculate lost productivity costs (SA2) resulted in larger cost savings for the intervention program as compared to usual care. However, the difference in societal costs between the groups was not statistically significant (€–2155; 95% CI: –7900 to 2160). The CEACs show that the probability of cost-effectiveness was 63% for a ceiling ratio of €0 per additional unit of effect. At a ceiling ratio of €20,000 per additional unit of effect, the probability of cost-effectiveness increased to 74% and 79% for HADS and QALY, respectively.

Adding training costs of healthcare providers to total societal costs (SA3) did not change the cost difference substantially as compared to the main analysis (€–1152; 95% CI: –4595 to 1908). Probabilities of cost-effectiveness were similar to the primary analysis. This was also the case for the unadjusted analyses (i.e. without adjustment for covariates).

Discussion

Main findings

This economic evaluation showed that there were no statistically significant differences in clinical outcomes (HADS and QALYs) or societal costs between the intervention program and usual care. At a ceiling ratio of €0 per additional unit of effect, the probability of the intervention program being cost-effective compared to usual care was 64% and this increased to 82% and 79% at a ceiling ratio of €20,000 per additional unit of effect for the HADS and QALY, respectively. Although the intervention program showed dominance over usual care, with relatively high probabilities of cost-effectiveness at the Dutch threshold of €20,000 per QALY, this was mainly driven by lower costs (in particular, lower costs of home care), whereas there were no clinically relevant differences in distress scores between groups. Results from the SA showed similar cost-effectiveness results as the main analysis. The exact numbers in this article are slightly different than in the accompanying paper presenting the results of the effectiveness analysis. However, the conclusion was not affected, that is, there was no difference in improvement in HADS score between the study arms.17 This difference is caused by the use of multiple imputation to handle missing data in the economic evaluation.

Strengths and limitations

An important strength of this study was the pragmatic design which increases the generalizability of the results. Second, a societal perspective was used, meaning that all relevant costs were collected regardless of who payed for them. This makes it possible to identify shifting of costs between sectors. Third, different levels of hierarchy were accounted for in the analysis of costs and effects, namely participants (level 2) nested within different hospitals (level 1).20 For effects, an additional level was added that took into account the multiple, correlated HADS measurements within participants over time (repeated measures of HADS; level 3).51 However, there are also some limitations. First, 40% of data were missing which was accounted for by using multiple imputation; this is the preferred method to deal with missing data in economic evaluations.52 Second, a relatively short time horizon was used (i.e. 48 weeks). However, due to the severe nature of the disease, severe deterioration or death within this period is likely. Thus, this time horizon may be long enough. Third, oncological treatment and website costs were not measured during the trial, but were calculated using data from other studies.39,43 To make these cost estimates comparable between countries, costs were converted using PPPs.40 Finally, although the EQ-5D is the preferred instrument to estimate utility scores, it may not capture all important aspects of palliative care.53,54 Therefore, to capture psychological distress among this group of terminally ill participants, the HADS was included as an outcome measure as well.23,55

Interpretation of findings and comparison with the literature

A systematic review concluded that screening for distress among cancer patients in itself does not improve psychological distress, but that screening should be combined with pharmacological or behavioral interventions to improve psychological distress.56 The intervention program combined both of these elements, but found no difference in improvement in HADS score over time between palliative care patients receiving the intervention program and patients receiving usual care. The absence of effect is most likely due to the much lower than expected uptake of the intervention program; only a minority of participants in the intervention program group did actually receive treatment for psychological distress.17 This low uptake is, however, in line with recent findings in other studies.57–59 Low uptake may be related to the fact that palliative care patients’ psychosocial needs are already being met through support from relatives and primary caregivers (i.e. doctors and nurses).60 One study found that most cancer patients do not need special psychosocial counseling other than discussing their emotional issues with their caregiver (i.e. doctor) and family.61 Other potential explanations of the low uptake of the intervention could be the stigma associated with psychosocial care or the stress of additional appointments for patients in the palliative care phase.62,63 Although the intervention program was found to be dominant over usual care, there is much uncertainty as reflected in the 95% CIs and the estimated probabilities of cost-effectiveness. This, in combination with the lack of a clinical effect, makes it difficult to draw a strong conclusion about the cost-effectiveness of the intervention program compared to usual care. The limited effectiveness of the intervention is in line with a study performed by Hollingworth et al.64 who evaluated an intervention consisting of a face-to-face meeting. The meeting involved a conversation with a trained nurse during which concerns were identified and potential solutions were discussed followed by immediate actions. The intervention was found to be feasible and relatively cheap (i.e. £19). Nevertheless, the authors did not find evidence that the intervention improved physical well-being or quality of life and was not considered cost-effective compared to usual care.

The findings of this study and the aforementioned previous studies should not be construed as evidence that psychological treatment of distress is not effective. On the contrary, a systematic review found that psychological treatment for patients with cancer effectively reduces psychological distress.65 Moreover, a recent study concluded that a stepped-care procedure similar to the intervention program was effective in reducing distress and highly likely to be cost-effective in comparison with usual care in patients with head, neck, and lung cancer.66,67 Thus, psychological treatment of distress can be effective, but how to identify palliative care patients in need of effective psychological treatment is an important question. The findings of this study indicate that screening and subsequently offering treatment to distressed patients in the palliative care phase is not more effective than selection of patients for psychological treatment by clinicians (case finding).

The number of QALYs gained in the intervention program group as compared to the usual care group was smaller than minimally important differences for QALYs reported in the literature68,69 and were not statistically significant. This minor gain in QALYs is driven by an insignificant increase in both the length of life and quality of life in the intervention program group as compared to the usual care group. The modest positive effect on quality of life of the intervention program is in line with the clinical analyses that showed significantly improved participant satisfaction with care and better self-reported cognitive functioning, which was attributed to the enhanced conversation between participants and healthcare providers about the participants’ emotional concerns in the intervention program group.17 Both distress and quality of life have been shown to improve after discussing emotional issues with primary caregivers,70–72 regardless of their primary distress scores.

Due to the skewed distribution of costs, economic evaluations alongside clinical trials are generally underpowered which is reflected in wide confidence intervals.73 In this study, total societal costs in the intervention program group were €1152 lower than in the usual care group. This difference was small as compared to the mean costs in the groups (€32,112 and €33,329) and not statistically significant. However, there were some striking differences in costs. On one hand, our results showed that metastatic colorectal cancer treatment costs in the intervention program group were non-significantly higher than in the usual care group, which is related to the non-significant increase in survival of participants in this group. On the other hand, home care and informal care costs were substantially lower in the intervention program group as compared to the usual care group, although not statistically significant possibly due to the low power of the study for costs. Healthcare costs for patients at the end of their life, just before death, are often higher than for patients at another stage in life. This is not explicitly attributable to the costs of dying, but to the costs of care provided to patients during their last phase,74 especially in terms of nursing care and informal care. It is unsure, however, whether this observed difference in home care and informal care costs can be explained by this or that this is a chance finding.

Conclusion

Based on the results of this study, the intervention program is considered dominant over usual care, which was driven by lower costs in the intervention program group. However, there was considerable uncertainty surrounding the cost-effectiveness estimates and there were no statistically significant differences in distress between the groups. In addition, the uptake of the intervention was quite low. Therefore, widespread implementation cannot be recommended based on this study.

Supplemental Material

Appendix_1_Cost_categories_with_unit_prices_ – Supplemental material for Economic evaluation of a combined screening and stepped-care treatment program targeting psychological distress in patients with metastatic colorectal cancer: A cluster randomized controlled trial

Supplemental material, Appendix_1_Cost_categories_with_unit_prices_ for Economic evaluation of a combined screening and stepped-care treatment program targeting psychological distress in patients with metastatic colorectal cancer: A cluster randomized controlled trial by Mohamed El Alili, Claudia S.E.W Schuurhuizen, Annemarie M.J. Braamse, Aartjan T.F. Beekman, Mecheline H. van der Linden, Inge R. Konings, Joost Dekker and Judith E. Bosmans in Palliative Medicine

Footnotes

Author contributions: All authors declare that they (1) made a substantial contribution to the concept of design of the work, or acquisition, analysis, or interpretation of data; (2) drafted the article or revised it critically for important intellectual content; (3) approved the version to be published; and (4) participated sufficiently in the work to take public responsibility for appropriate portions of the content.

Declaration of conflicting interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by Alpe d’HuZes Foundation/KWF Kankerbestrijding (VU 2011-5279).

ORCID iD: Mohamed El Alili Inline graphic https://orcid.org/0000-0002-6341-7976

Supplemental material: Supplemental material for this article is available online.

References

  • 1. Torre LA, Bray F, Siegel RL, et al. Global cancer statistics, 2012. CA Cancer J Clin 2015; 65(2): 87–108. [DOI] [PubMed] [Google Scholar]
  • 2. Fitzmaurice C, Dicker D, Pain A, et al. ; Global Burden of Disease Cancer Collobaration. The Global Burden of Cancer 2013. JAMA Oncol 2015; 1: 505–527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Ferlay J, Soerjomataram I, Dikshit R, et al. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer 2015; 136(5): E359–E386. [DOI] [PubMed] [Google Scholar]
  • 4. Simon AE, Thompson MR, Flashman K, et al. Disease stage and psychosocial outcomes in colorectal cancer. Colorectal Dis 2009; 11(1): 19–25. [DOI] [PubMed] [Google Scholar]
  • 5. Vodermaier A, Linden W, MacKenzie R, et al. Disease stage predicts post-diagnosis anxiety and depression only in some types of cancer. Br J Cancer 2011; 105(12): 1814–1817. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Quinten C, Coens C, Mauer M, et al. Baseline quality of life as a prognostic indicator of survival: a meta-analysis of individual patient data from EORTC clinical trials. Lancet Oncol 2009; 10(9): 865–871. [DOI] [PubMed] [Google Scholar]
  • 7. Shim EJ, Mehnert A, Koyama A, et al. Health-related quality of life in breast cancer: a cross-cultural survey of German, Japanese, and South Korean patients. Breast Cancer Res Treat 2006; 99(3): 341–350. [DOI] [PubMed] [Google Scholar]
  • 8. Brown KW, Levy AR, Rosberger Z, et al. Psychological distress and cancer survival: a follow-up 10 years after diagnosis. Psychosom Med 2003; 65(4): 636–643. [DOI] [PubMed] [Google Scholar]
  • 9. DiMatteo MR, Lepper HS, Croghan TW. Depression is a risk factor for noncompliance with medical treatment: meta-analysis of the effects of anxiety and depression on patient adherence. Arch Intern Med 2000; 160(14): 2101–2107. [DOI] [PubMed] [Google Scholar]
  • 10. Compen F, Adang E, Bisseling E, et al. Exploring associations between psychiatric disorder, psychological distress, and health care utilization in cancer patients. Psycho-oncology 2018; 27(3): 871–878. [DOI] [PubMed] [Google Scholar]
  • 11. National Institute for Clinical Excellence (NICE). Guideline on cancer services: improving supportive and palliative care for adults with cancer. NICE, 2004, https://www.nice.org.uk/guidance/csg4/resources/improving-supportive-and-palliative-care-for-adults-with-cancer-pdf-773375005
  • 12. National Comprehensive Cancer Network. NCCN clinical practice guidelines in oncology, 2008, https://www.nccn.org/professionals/physician_gls/default.aspx
  • 13. Institute of Medicine. Cancer care for the whole patients: meeting psychosocial health needs. Washington, DC: Institute of Medicine, 2007. [Google Scholar]
  • 14. Carlson LE, Bultz BD. Efficacy and medical cost offset of psychosocial interventions in cancer care: making the case for economic analyses. Psycho-oncology 2004; 13(12): 837–849; discussion 850. [DOI] [PubMed] [Google Scholar]
  • 15. Carlson LE, Waller A, Mitchell AJ. Screening for distress and unmet needs in patients with cancer: review and recommendations. J Clin Oncol 2012; 30(11): 1160–1177. [DOI] [PubMed] [Google Scholar]
  • 16. Bower P, Gilbody S. Stepped care in psychological therapies: access, effectiveness and efficiency. Br J Psychiatry 2005; 186: 11–17. [DOI] [PubMed] [Google Scholar]
  • 17. Schuurhuizen C, Braamse AMJ, Beekman ATF, et al. Screening and stepped care targeting psychological distress in patients with metastatic colorectal cancer: the TES cluster randomized trial. J Natl Compr Canc Netw 2019; 17(8): 911–920. [DOI] [PubMed] [Google Scholar]
  • 18. Briggs AH, O’Brien BJ. The death of cost-minimization analysis? Health Econ 2001; 10: 179–184. [DOI] [PubMed] [Google Scholar]
  • 19. Schuurhuizen CS, Braamse AM, Beekman AT, et al. Screening and treatment of psychological distress in patients with metastatic colorectal cancer: study protocol of the TES trial. BMC Cancer 2015; 15: 302. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Twisk JW. Applied multilevel analysis: a practical guide for medical researchers. Cambridge: Cambridge University Press, 2006. [Google Scholar]
  • 21. Campbell MK, Grimshaw JM. Cluster randomised trials: time for improvement. BMJ 1998; 317(7167): 1171–1172. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Braeken AP, Lechner L, van Gils FC, et al. The effectiveness of the Screening Inventory of Psychosocial Problems (SIPP) in cancer patients treated with radiotherapy: design of a cluster randomised controlled trial. BMC Cancer 2009; 9: 177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Herrmann C. International experiences with the Hospital Anxiety and Depression Scale-a review of validation data and clinical results. J Psychosom Res 1997; 42(1): 17–41. [DOI] [PubMed] [Google Scholar]
  • 24. Tuinman MA, Gazendam-Donofrio SM, Hoekstra-Weebers JE. Screening and referral for psychosocial distress in oncologic practice. Cancer 2008; 113(4): 870–878. [DOI] [PubMed] [Google Scholar]
  • 25. Fann JR, Thomas-Rich AM, Katon WJ, et al. Major depression after breast cancer: a review of epidemiology and treatment. Gen Hosp Psychiatry 2008; 30(2): 112–126. [DOI] [PubMed] [Google Scholar]
  • 26. Ryan H, Schofield P, Cockburn J, et al. How to recognize and manage psychological distress in cancer patients. Eur J Cancer Care (Engl) 2005; 14(1): 7–15. [DOI] [PubMed] [Google Scholar]
  • 27. Shimizu K. Effects of integrated psychosocial care for distress in cancer patients. Jpn J Clin Oncol 2013; 43(5): 451–457. [DOI] [PubMed] [Google Scholar]
  • 28. Cuijpers P, van Straten A, Warmerdam L. Problem solving therapies for depression: a meta-analysis. Eur Psychiatry 2007; 22(1): 9–15. [DOI] [PubMed] [Google Scholar]
  • 29. Floyd M, Scogin F, McKendree-Smith NL, et al. Cognitive therapy for depression: a comparison of individual psychotherapy and bibliotherapy for depressed older adults. Behav Modif 2004; 28(2): 297–318. [DOI] [PubMed] [Google Scholar]
  • 30. Malouff JM, Thorsteinsson EB, Schutte NS. The efficacy of problem solving therapy in reducing mental and physical health problems: a meta-analysis. Clin Psychol Rev 2007; 27(1): 46–57. [DOI] [PubMed] [Google Scholar]
  • 31. Nezu AM, Nezu CM, Felgoise SH, et al. Project genesis: assessing the efficacy of problem-solving therapy for distressed adult cancer patients. J Consult Clin Psychol 2003; 71(6): 1036–1048. [DOI] [PubMed] [Google Scholar]
  • 32. Van Straten A, Cuijpers P, Smits N. Effectiveness of a web-based self-help intervention for symptoms of depression, anxiety, and stress: randomized controlled trial. J Med Internet Res 2008; 10(1): e7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983; 67: 361–370. [DOI] [PubMed] [Google Scholar]
  • 34. Bjelland I, Dahl AA, Haug TT, et al. The validity of the Hospital Anxiety and Depression Scale: an updated literature review. J Psycho Res 2002; 52: 69–77. [DOI] [PubMed] [Google Scholar]
  • 35. Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011; 20: 1727–1736. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Versteegh MM, Vermeulen K, Evers S, et al. Dutch tariff for the five-level version of EQ-5D. Value Health 2016; 19: 343–352. [DOI] [PubMed] [Google Scholar]
  • 37. Bouwmans C, De Jong K, Timman R, et al. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Serv Res 2013; 13: 217–217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Hakkaart-van Roijen L, Van der Linder N, Bouwmans C, et al. Richtlijn voor het uitvoeren van economische evaluaties in de gezondheidszorg. Diemen: Zorginstituut Nederland, 2016. [Google Scholar]
  • 39. Farkkila N, Torvinen S, Sintonen H, et al. Costs of colorectal cancer in different states of the disease. Acta Oncol 2015; 54(4): 454–462. [DOI] [PubMed] [Google Scholar]
  • 40. OECD Eurostat. Eurostat-OECD methodological manual on purchasing power parities, 2012, https://www.oecd.org/sdd/prices-ppp/PPP%20manual%20revised%202012.pdf
  • 41. Van den Hout WB. The value of productivity: human-capital versus friction-cost method. Ann Rheum Dis 2010; 69(Suppl. 1): i89–i91. [DOI] [PubMed] [Google Scholar]
  • 42. Statistics Netherlands Statline. Statline consumer pricing index, 2017, https://opendata.cbs.nl/statline/#/CBS/en/ [Google Scholar]
  • 43. Buntrock C, Berking M, Smit F, et al. Preventing depression in adults with subthreshold depression: health-economic evaluation alongside a pragmatic randomized controlled trial of a web-based intervention. J Med Internet Res 2017; 19(1): e5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Van Buuren S, Groothuis-Oudshoorn K. mice: multivariate Imputation by Chained Equations in R. J Stat Soft 2011; 45: 67. [Google Scholar]
  • 45. Faria R, Gomes M, Epstein D, et al. A Guide to handling missing data in cost-effectiveness analysis conducted within randomised controlled trials. Pharmacoeconomics 2014; 32(12): 1157–1170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med 2011; 30(4): 377–399. [DOI] [PubMed] [Google Scholar]
  • 47. Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley, 1987, p. 258. [Google Scholar]
  • 48. Fenwick E, O’Brien BJ, Briggs A. Cost-effectiveness acceptability curves—facts, fallacies and frequently asked questions. Health Econ 2004; 13(5): 405–415. [DOI] [PubMed] [Google Scholar]
  • 49. Karpenko AW, Geenen JW, Vreman RA, et al. The introduction of a threshold for the Icer and the implications for reimbursement of drugs in the Dutch healthcare system. Value Health 2017; 20: A671. [Google Scholar]
  • 50. Rabash J, Charlton C, Browne WJ, et al. MLwiN (Version 2.36). Bristol: Centre for Multilevel Modelling, University of Bristol, 2009. [Google Scholar]
  • 51. Twisk JW. Applied longitudinal data analysis for epidemiology: a practical guide. Cambridge: Cambridge University Press, 2013. [Google Scholar]
  • 52. Burton A, Billingham LJ, Bryan S. Cost-effectiveness in clinical trials: using multiple imputation to deal with incomplete cost data. Clin Trials 2007; 4(2): 154–161. [DOI] [PubMed] [Google Scholar]
  • 53. Dzingina MD, McCrone P, Higginson IJ. Does the EQ-5D capture the concerns measured by the Palliative care Outcome Scale? Mapping the Palliative care Outcome Scale onto the EQ-5D using statistical methods. Palliat Med 2017; 31(8): 716–725. [DOI] [PubMed] [Google Scholar]
  • 54. Wichmann AB, Adang EMM, Stalmeier PFM, et al. The use of Quality-Adjusted Life Years in cost-effectiveness analyses in palliative care: mapping the debate through an integrative review. Palliat Med 2017; 31(4): 306–322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Herrmann C. International experiences with the Hospital Anxiety and Depression Scale—a review of validation data and clinical results. J Psychosom Res 1997; 42(1): 17–41. [DOI] [PubMed] [Google Scholar]
  • 56. Meijer A, Roseman M, Delisle VC, et al. Effects of screening for psychological distress on patient outcomes in cancer: a systematic review. J Psycho Res 2013; 75: 1–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Shimizu K, Ishibashi Y, Umezawa S, et al. Feasibility and usefulness of the “Distress Screening Program in Ambulatory Care” in clinical oncology practice. Psychooncology 2010; 19(7): 718–725. [DOI] [PubMed] [Google Scholar]
  • 58. Funk R, Cisneros C, Williams RC, et al. What happens after distress screening? Patterns of supportive care service utilization among oncology patients identified through a systematic screening protocol. Support Care Cancer 2016; 24(7): 2861–2868. [DOI] [PubMed] [Google Scholar]
  • 59. Brebach R, Sharpe L, Costa DS, et al. Psychological intervention targeting distress for cancer patients: a meta-analytic study investigating uptake and adherence. Psycho-oncology 2016; 25: 882–890. [DOI] [PubMed] [Google Scholar]
  • 60. Dekker J, Braamse A, Schuurhuizen C, et al. Distress in patients with cancer–on the need to distinguish between adaptive and maladaptive emotional responses. Acta Oncol 2017; 56(7): 1026–1029. [DOI] [PubMed] [Google Scholar]
  • 61. Mullai N. Psychosocial distress screening in cancer care. J Clin Oncol 2016; 34: 187–187. [Google Scholar]
  • 62. Clement S, Schauman O, Graham T, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med 2014; 45: 11–27. [DOI] [PubMed] [Google Scholar]
  • 63. Institute of Medicine Committee on Psychosocial Services to Cancer Patients/Families in a Community Setting. The National Academies collection: reports funded by National Institutes of Health. In: Adler NE, Page AEK. (eds) Cancer care for the whole patient: meeting psychosocial health needs. Washington, DC: National Academies Press; National Academy of Sciences, 2008, pp. 85–90. [Google Scholar]
  • 64. Hollingworth W, Metcalfe C, Mancero S, et al. Are needs assessments cost effective in reducing distress among patients with cancer? A randomized controlled trial using the Distress Thermometer and Problem List. J Clin Oncol 2013; 31(29): 3631–3638. [DOI] [PubMed] [Google Scholar]
  • 65. Faller H, Schuler M, Richard M, et al. Effects of psycho-oncologic interventions on emotional distress and quality of life in adult patients with cancer: systematic review and meta-analysis. J Clin Oncol 2013; 31(6): 782–793. [DOI] [PubMed] [Google Scholar]
  • 66. Krebber Leemans CR, de Bree R, van Straten A, et al. Stepped care targeting psychological distress in head and neck and lung cancer patients: a randomized clinical trial. BMC Cancer 2012; 12: 173–173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67. Jansen F, Krebber AM, Coupe VM, et al. Cost-utility of stepped care targeting psychological distress in patients with head and neck or lung cancer. J Clin Oncol 2017; 35: 314–324. [DOI] [PubMed] [Google Scholar]
  • 68. Walters SJ, Brazier JE. Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D. Qual Life Res 2005; 14(6): 1523–1532. [DOI] [PubMed] [Google Scholar]
  • 69. Pickard AS, Neary MP, Cella D. Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health Qual Life Outcomes 2007; 5: 70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70. Carlson LE, Groff SL, Maciejewski O, et al. Screening for distress in lung and breast cancer outpatients: a randomized controlled trial. J Clin Oncol 2010; 28(33): 4884–4891. [DOI] [PubMed] [Google Scholar]
  • 71. Velikova G, Brown JM, Smith AB, et al. Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology. Br J Cancer 2002; 86(1): 51–59. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72. Taenzer P, Bultz BD, Carlson LE, et al. Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients. Psycho-oncology 2000; 9(3): 203–213. [DOI] [PubMed] [Google Scholar]
  • 73. Briggs A. Economic evaluation and clinical trials: size matters: the need for greater power in cost analyses poses an ethical dilemma. BMJ 2000; 321: 1362–1363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74. Stooker T, van Acht JW, van Barneveld EM, et al. Costs in the last year of life in The Netherlands. Inquiry 2001; 38(1): 73–80. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Appendix_1_Cost_categories_with_unit_prices_ – Supplemental material for Economic evaluation of a combined screening and stepped-care treatment program targeting psychological distress in patients with metastatic colorectal cancer: A cluster randomized controlled trial

Supplemental material, Appendix_1_Cost_categories_with_unit_prices_ for Economic evaluation of a combined screening and stepped-care treatment program targeting psychological distress in patients with metastatic colorectal cancer: A cluster randomized controlled trial by Mohamed El Alili, Claudia S.E.W Schuurhuizen, Annemarie M.J. Braamse, Aartjan T.F. Beekman, Mecheline H. van der Linden, Inge R. Konings, Joost Dekker and Judith E. Bosmans in Palliative Medicine


Articles from Palliative Medicine are provided here courtesy of SAGE Publications

RESOURCES