Abstract
Objective.
To describe the feasibility of a meaning-centered group psychotherapy (MCGP) adaptation in a sample of Portuguese cancer patients.
Method.
The study was carried out according to four steps: 1st — Transcultural adaptation and validation (focus groups); 2nd — Preliminary study with MCGP original version (to test its feasibility); 3rd — Adaptation of MCGP original version to a 4-session version (and internal pilot study); and 4th — Pilot exploratory trial (MCGP-4 session version), implemented between January 1, 2018 and December 31, 2019. Inclusion criteria were >18 years, psychological complaints, and difficulty to adapt to cancer. Allocation was according to participants’ preference: MCGP vs. care as usual (CAU). Primary outcomes were: MCGP adapted version improved quality of life (QoL) and spiritual well-being; secondary outcomes were improvement of depression, anxiety, and distress. Assessments were done at baseline (T1) and 1 month after (T2), with self-report socio-demographic and clinical questionnaires, Distress Thermometer (DT), McGill Quality of Life Questionnaire (MQOL), Functional Assessment of Chronic Illness Therapy — Spiritual Well-Being Scale (FACIT-Sp-12), Hospital Anxiety and Depression Scale, and its subscales (HADS — HADS-D, HADS-A).
Results.
In the 1st step, and through focus groups, the manual was reformulated and tested. The preliminary study (2nd step) with MCGP original version showed a high number of dropouts which could jeopardize the study and, after reframing the sessions content, MCGP was adapted to a 4-session version, and its feasibility was tested by an internal pilot study (3rd step). The pilot exploratory trial (4th step) had 91 participants. Most socio-demographic and clinical characteristics between the groups (51: MCGP; 40: CAU) had no statistically significant differences. A comparison between the two groups at T2 showed that the MCGP group scored significantly higher in the general (U = 552.00, P < 0.001), and existential (U = 727.50, P = 0.018) domains and total score (U = 717.50, P = 0.015) of QoL, and CAU presented statistical higher levels in DT (U = 608.50, P = 0.001). Comparing the groups between T1 and T2, the MCGP group had a statistically significant improvement in the general (Z = −3.67, P < 0.001) and psychosocial (Z = −2.89, P = 0.004) domains and total score (Z = −2.71, P = 0.007) of QoL, and a statistically significant decrease in DT (Z = −2.40, P = 0.016). In terms of group effects, the MCGP group presented increased general (b = 1.42, P < 0.001, ), and support (b = 0.80, P = 0.045, ) domains and total score (b = 0.81, P = 0.013, ) of QoL (small to elevated dimensions), and decreased levels of depression (b = −1.14, P = 0.044, ), and distress (b = −1.38, P = 0.001, ) (small to medium dimensions), compared with CAU. At T2, participants who attended ≥3 sessions (n = 38) had a statistically significant higher score in the general domain (U = 130.50, P = 0.009) of QoL, comparing with those who attended 1 or 2 sessions (n = 13).
Significance of results.
This study supports the benefits of an MCGP adapted version in improving QoL and psychologic well-being. More studies are necessary to address the limitations of this pilot exploratory trial, as its small sample size.
Keywords: Cancer, Meaning-centered group psychotherapy adaptation, Portuguese, Quality-of-life benefits
Introduction
Spiritual well-being and a sense of meaning are important influences for quality of life (QoL) in patients with advanced cancer (Field and Cassel, 1997; Sinclair et al., 2006).
The importance of the existential care lead to the emergence of meaning-focused interventions (Breitbart, 2002; Chochinov et al., 2005; Puchalski, 2013) in advanced cancer patients or terminally ill (Yalom and Greaves, 1977; Spiegel et al., 1981; Edelman et al., 1999; Edmonds et al., 1999; Classen et al., 2001; Kissane et al., 2003, 2007; Lee et al., 2006; Breitbart et al., 2010; Chochinov et al., 2011). In response to this need, Breitbart and his investigation group developed meaning-centered psychotherapy (MCP) to help patients with advanced cancer sustain or enhance a sense of meaning and purpose in their lives, even as they approach the end of life (Breitbart, 2000, 2002; Greenstein and Breitbart, 2000; Breitbart et al., 2010, 2015; Van der Spek et al., 2013; Applebaum et al., 2015). MCP was first developed in a group format (meaning-centered group psychotherapy — MCGP), which is a manualized eight-week intervention (each session: 1.5 h) that utilizes a combination of didactics, experiential exercises and discussion (Breitbart, 2002). The first randomized control trial (RCT) showed benefits in enhancing spiritual well-being and a sense of meaning (Breitbart et al., 2010). Further studies suggested that more severe forms of despair respond better to existential interventions (Breitbart et al., 2015).
The goal of this study is to describe the feasibility of an MCGP adaptation in a sample of Portuguese cancer patients. The outcomes were: MCGP adapted version improves QoL and spiritual well-being (primary), and the levels of depression, anxiety, and distress (secondary).
Methods
Procedures
This study was implemented according to four steps. Transcultural adaptation and validation of MCGP standardized manual to the Portuguese language was carried out through focus groups (1st step). The preliminary study with the original version of MCGP (2nd step) revealed a high number of dropouts, which could jeopardize the study, and led to the 3rd step — adaptation of MCGP original version to a 4-session version (maintaining the same periodicity and duration of the original version), and internal pilot study (to test its feasibility), which followed the same methodology as the 4th step, except regarding the care as usual (CAU) group. A pilot exploratory trial (4th step — Figure 1) had two arms, according to allocation criteria: MCGP vs. CAU. MCGP was led by a therapist (psychiatrist) and attended by another health professional for training purposes, and after participants’ consent.
Fig. 1.

Pilot exploratory trial (aintent to treat analysis; bMCGP: before the 1st session/ CAU: 1st moment; cMCGP: after the last session/CAU: 1 month after T1; DT, distress thermometer; FACIT-Sp-12, functional assessment of chronic illness therapy — spiritual well-being scale; HADS, hospital anxiety and depression scale; MCGP, meaning-centered group psychotherapy).
It was carried out two assessments (T1 — MCGP: before the 1st session vs. CAU: 1st moment; T2 — MCGP: after the last session vs. CAU: 1 month after T1) with socio-demographic and clinical questionnaires and self-report instruments to measure QoL, spiritual, and psychological well-being: Distress Thermometer (DT; Ouakinin et al., 2015; National Comprehensive Cancer Network, 2017), McGill Quality of Life Questionnaire (MQOL; Cohen et al., 1997; Duarte et al., 2010), Functional Assessment of Chronic Illness Therapy — Spiritual Well-Being Scale (FACIT-Sp-12; FACIT Group, 2011; Pereira and Santos, 2011), and Hospital Anxiety and Depression Scale (HADS; subscales: depression [HADS-D] and anxiety [HADS-A]; Zigmond and Snaith, 1983; Pais-Ribeiro et al., 2007). After each session, the therapist completed “Checklist of therapist adherence,” a self-report to assess if the goals of each session were achieved (Breitbart and Poppito, 2014).
Participants
Participants with cancer were recruited at a district hospital (Centro Hospitalar Barreiro-Montijo) and two cancer associations (Portuguese League Against Cancer and Algarve Cancer Association) in Portugal, between January 1, 2018 and December 31, 2019. To ensure reliability, the inclusion criteria of this convenience sample (>18 years, psychological complaints, as depressed mood and anxiety, and difficulty to adapt to cancer) satisfied the following assumptions: to replicate previous methodologies; to consist in a formal indication for existential psychotherapies (Teixeira, 2006; Breitbart and Alici, 2014; Julião, 2014; Van der Spek et al., 2014; Van Lankveld et al., 2018); and to use Hierarchical Taxonomy of Psychopathology (HiTOP) — a dimensional psychopathological classification (Kotov et al., 2017; Conway et al., 2019) — to facilitate symptoms recognition by the recruiters (medical oncologists and psychologists). The authors assumed that screening of distress it would not be a good measure to inclusion criteria, as high levels of distress do not necessarily correspond to maladaptive responses, as these are determined by a complex process of mental adjustment (Moyer et al., 2009; Croy, 2010; Van Lankveld et al., 2018). Exclusion criteria were: cognitive deficits that interfere in the capacity to give informed consent, psychotic symptoms or substance abuse (Julião, 2014). The allocation was according to participants preference to be included in MCGP vs. CAU (Applebaum et al., 2012). The participants were contacted, within 1 month after having expressed their availability, when it was reached a minimum of 5 per group (Applebaum et al., 2012), and it was considered dropout when they participate in less than 3 sessions (this cut-off ensures the “same dose” of treatment, it is the ideal to verify differences in the outcomes keeping and, at the same time, maintain a conservative approach) (Breitbart et al., 2015). For participants with current psychiatric/psychologic follow-up, their therapists were informed.
MCGP has no known risks, and its structure provides space for participants personal feedback (Breitbart and Poppito, 2014). The study was approved by the Institutional Ethical Committees, and the Portuguese National Commission of Data Protection, in accordance with the principles embodied in the Declaration of Helsinki.
Statistical analysis
For the internal pilot study (3rd step) and the checklist of therapist adherence, it was performed a descriptive analysis. For the pilot exploratory trial (4th step), it was carried out a sample characterization, using descriptive analyses and chi-square test. For group comparisons, parametric and nonparametric tests were used (Wilcoxon test, Mann–Whitney, and Student’s t-tests). Analysis of group effects in primary and secondary outcomes used ANCOVA (independent variables: MCGP and CAU; dependent variables: 2nd assessment; covariate: 1st assessment; six covariables were identified to control possible confounding influences — age, gender, cancer stage, current chemotherapy [CT] treatments, personal psychiatric history, and current follow-up). Primary outcomes were QoL (MQOL total score and all domains) and spiritual well-being (FACIT total score and both dimensions). Secondary outcomes were depression (HADS-D), anxiety (HADS-A), and distress (DT). ANCOVA analysis demonstrated homogeneous variances for all variables; the assumption of slope homogeneity showed that there was not significant interaction between each dependent variable and the covariate, except for the support domain of QdV (P = 0.022). The groups had a similar dimension, so ANCOVA was robust to the analysis of these assumptions. The effect dimension was calculated using partial eta2 ([]; small effect size: , medium: , high: ). Also, it was done a comparison analysis (T1 and T2) of spiritual and psychological between the participants who attended 1 or 2 sessions and those who attended 3 or all sessions.
Intent to treat analysis was performed, and missing values were inputted according to the expectation–maximization method. Analysis used SPSS, version 25, and values P < 0.05 was considered statistically significant.
Results
1st step: Transcultural adaptation and validation
Transcultural adaptation and validation was performed by four focus groups, led by the therapist, to evaluate the manual comprehensibility (Goes, 2007; Pasquali, 2009; Epstein et al., 2015; Medeiros et al., 2015). The first two focus groups discussed the manual content (1st group: cancer patients; 2nd: mental health professionals without experience in MCP), and the results were discussed in the 3rd group, constituted by experts. The findings showed the necessity to clarify some of MCP core concepts (Figure 2), which seemed culturally determined and independent from the educational level (Da Ponte et al., 2017). The manual’s reformulation was tested in another focus group, with cancer patients, and it was verified the substantial improvement of its comprehensibility.
Fig. 2.

Meaning-centered group psychotherapy transcultural adaptation and validation.
2nd step: Preliminary study (MCGP original version — 8 sessions)
Of the initial sample (n = 11), six dropped out (the main reason was time consumption by the hospital, at the expense of participants’ personal life), and the majority of these did not complete the 2nd assessment.
3rd step: Adaptation of MCGP original version to a 4-session version (and internal pilot study)
Because of dropouts in the preliminary study that could jeopardized the investigation, and after consulting previous adaptations of MCGP to different settings (Breitbart et al., 2010, 2012, 2015, 2018; Van der Spek et al., 2014, 2016; Lichtenthal et al., 2015; Rosenfeld et al., 2017), the participantś preference for some themes (in the first steps of the study), and discussing with the author, MCGP was adapted to a 4-session version (Table 1). This consisted of a combination of sessions 1 and 2 (“Moments with Meaning” and “Cancer and Meaning”) and sessions 5, 6, and 7 (Attitudinal, Creative, and Experiential Sources of Meaning) of the original version in single sessions (respectively); similarly to the original version, and because of its importance described in previous studies, “Historical Sources of Meaning” occupied an entire session (Breitbart et al., 2010, 2012, 2015, 2018; Van der Spek et al., 2014, 2016; Lichtenthal et al., 2015; Rosenfeld et al., 2017). Based on therapist training in MCP and available support material (Memorial Sloan Kettering Cancer Center, 2016), it was designed a short manual with the goals and exercises of each session, which conserved the same structure as MCGP original version: after a brief presentation of the therapist and the participants (session 1), session’s themes were presented, experiential exercises were distributed and participants were asked to write their answers; the remaining time consisted of didactic discussions and participants’ feedback.
Table 1.
Structure of meaning-centered group psychotherapy-4 session version
| Sessions | Themes | Content and experiential exercises |
|---|---|---|
| 1 | Moments with Meaning; Cancer and Meaning | Introduction; Identity before and after cancer: who am I? How cancer affected your answers? |
| 2 | Historical Sources of Meaning | Life as a legacy: that was given (memories, relations, traditions… with meaning), that we live (roles and activities with meaning) and give |
| 3 | Attitudinal, Creative and Experiential Sources of Meaning | To confront cancer limitations; Creativity, courage and responsibility: what are your responsibilities? Are you responsible for what and whom?; and Love, beauty, and humor: connecting with life; Life legacy |
| 4 | Transitions: reflections and hopes for the future | Life legacy; Reflection of group lessons: do you understand better “sources of meaning”? Can you use them in daily life? |
Of the initial sample (n = 15), one-third of participants dropped out. The findings showed improvements in spiritual well-being (FACIT-Sp-12 total score: T1 — 32.54 vs. T2 — 33.77; FACIT-Sp-12 dimension meaning/peace: T1 — 32.54 vs. T2 — 33.77), levels of depression (HADS-D: T1 — 6.5 vs. T2 — 2.6), anxiety (HADS-A: T1 — 8.67 vs. T2 — 6.2), distress (DT: T1 — 4.56 vs. T2 — 3.75), and QoL (MQOL total score: T1 — 6.18 vs. T2 — 6.99; MQOL existential domain: T1 — 6.87 vs. T2 — 7.91).
4th step: Pilot exploratory trial (MCGP-4 session version)
Sample description
Socio-demographic and clinical characteristics of the sample are represented in Table 2. Of the 91 participants, 51 (56%) participated in MCGP and 40 (44%) in CAU. The mean age of the sample was 61.04 years (SD: ±11.42; MCGP: 59.57; CAU: 62.93), and the majority was female, married, and retired. In terms of clinical characteristics, breast cancer was the most frequent (MCGP: 51% vs. CAU: 70.0%), as it was the located stage (74.5% vs. 60%); most of participants were submitted to surgical (72.5% vs. 92.5%) and CT (64.7% vs. 82.5%) treatments and had physical comorbidities (62.7% vs. 60.0%). Although most of socio-demographic and clinical characteristics between the groups had no statistically significant differences, a more significant proportion of MCGP participants lived in a rural area and a lesser proportion lived in the suburbs of Lisbon, compared with CAU (48.9% vs. 7.9%; 35.6% vs. 71.1%, χ2 = 18.85, P < 0.001); fewer proportion of MCGP participants had done surgery, comparing with CAU (72.5% vs. 92.5%, χ2 = 5.87, P = 0.015), and a higher proportion of MCGP participants had personal psychiatric history (62.7% vs. 37.5%, χ2 = 5.72, P = 0.017), and current follow-up (60.8% vs. 35.0%, χ2 = 5.96, P = 0.015), comparing with CAU. Of the participants that were not on current follow-up, there was a significantly higher percentage of MCGP participants that considered it would be beneficial (82.4% vs. 50.0%, χ2 = 4.71, P = 0.030), comparing with CAU.
Table 2.
Socio-demographic and clinical characteristics of meaning-centered group psychotherapy (MCGP) and care as usual (CAU) groups (n = 91)
| MCGP (n = 51) | CAU (n = 40) | |||||
|---|---|---|---|---|---|---|
| n | % | n | % | t/χ2 | P | |
| Age | −1.40 | 0.165 | ||||
| Mean | 59.57 | 62.93 | ||||
| SD | 12.04 | 10.42 | ||||
| Gender | 1.49 | 0.222 | ||||
| Masculine | 13 | 25.5 | 6 | 15.0 | ||
| Feminine | 38 | 74.5 | 34 | 85.0 | ||
| Residence areaa | 16.85 | <0.001 | ||||
| Urban area of Lisbon | 7 | 15.6 | 8 | 21.1 | ||
| Suburban area of Lisbon | 16 | 35.6 | 27 | 71.1 | ||
| Rural area | 22 | 48.9 | 3 | 7.9 | ||
| Marital statusa | 3.81 | 0.283 | ||||
| Single | 5 | 10.0 | 1 | 2.6 | ||
| Married | 34 | 68.0 | 25 | 64.1 | ||
| Widow | 3 | 6.0 | 6 | 15.4 | ||
| Divorced | 8 | 16.0 | 7 | 17.9 | ||
| Level of education | 2.82 | 0.420 | ||||
| W/o degree | 2 | 3.9 | 0 | 0.0 | ||
| Primary school | 16 | 31.4 | 13 | 32.5 | ||
| High school | 20 | 39.2 | 20 | 50.0 | ||
| University degree | 13 | 25.5 | 7 | 17.5 | ||
| Professional situationa | 5.21 | 0.390 | ||||
| Unemployed | 2 | 3.9 | 0 | 0.0 | ||
| Student | 1 | 2.0 | 0 | 0.0 | ||
| Sick leave | 3 | 5.9 | 0 | 0.0 | ||
| Housekeeper | 2 | 3.9 | 1 | 2.6 | ||
| Employed | 16 | 31.4 | 13 | 33.3 | ||
| Retired | 27 | 52.9 | 25 | 64.1 | ||
| Cancer location | 12.93 | 0.298 | ||||
| Bladder | 3 | 5.9 | 0 | 0.0 | ||
| Breast | 26 | 51.0 | 28 | 70.0 | ||
| Colon | 6 | 11.8 | 6 | 15.0 | ||
| Gastric | 3 | 5.9 | 1 | 2.5 | ||
| Kidney | 1 | 2.0 | 0 | 0.0 | ||
| Lung | 4 | 7.8 | 4 | 10.0 | ||
| Lymphoma | 2 | 3.9 | 0 | 0.0 | ||
| Ovary | 1 | 2.0 | 0 | 0.0 | ||
| Prostate | 3 | 5.9 | 0 | 0.0 | ||
| CNS | 1 | 2.0 | 0 | 0.0 | ||
| Thyroid | 0 | 0.0 | 1 | 2.5 | ||
| Uterus | 1 | 2.0 | 0 | 0.0 | ||
| Cancer stage | 2.17 | 0.140 | ||||
| Located | 38 | 74.5 | 24 | 60.0 | ||
| Advanced | 13 | 25.5 | 16 | 40.0 | ||
| “Was you submitted to surgery?” | 5.87 | 0.015 | ||||
| Yes | 37 | 72.5 | 37 | 92.5 | ||
| No | 14 | 27.5 | 3 | 7.5 | ||
| “Was you submitted to CT?” | 3.56 | 0.059 | ||||
| Yes | 33 | 64.7 | 33 | 82.5 | ||
| No | 18 | 35.3 | 7 | 17.5 | ||
| “Was you submitted to RT?” | 0.79 | 0.375 | ||||
| Yes | 22 | 43.1 | 21 | 52.5 | ||
| No | 29 | 56.9 | 19 | 47.5 | ||
| “Was you submitted to HT?” | 0.66 | 0.415 | ||||
| Yes | 15 | 29.4 | 15 | 37.5 | ||
| Yes | 36 | 70.6 | 25 | 62.5 | ||
| “Are you under CT treatments in this moment?” | 0.07 | 0.798 | ||||
| Yes | 10 | 19.6 | 7 | 17.5 | ||
| No | 41 | 80.4 | 33 | 82.5 | ||
| Other diseasesa | 0.07 | 0.789 | ||||
| Yes | 32 | 62.7 | 24 | 60.0 | ||
| No | 19 | 37.3 | 16 | 40.0 | ||
| “Did you ever went to psychiatrist?” | 5.72 | 0.017 | ||||
| Yes | 32 | 62.7 | 15 | 37.5 | ||
| No | 19 | 37.3 | 25 | 62.5 | ||
| “Are you under psychiatric/psychologic follow-up at this moment?” | 5.96 | 0.015 | ||||
| Yes | 31 | 60.8 | 14 | 35.0 | ||
| No | 20 | 39.2 | 26 | 65.0 | ||
| “Why are you being followed by a psychiatrist/psychologist?” | 5.33 | 0.378 | ||||
| Anxiety | 9 | 24.3 | 9 | 42.9 | ||
| Depression | 14 | 37.8 | 7 | 33.3 | ||
| Anxiety and depression | 12 | 32.4 | 4 | 19.0 | ||
| Fatigue | 0 | 0.0 | 1 | 4.8 | ||
| Physical disease | 1 | 2.7 | 0 | 0.0 | ||
| Other | 1 | 2.7 | 0 | 0.0 | ||
| “If you aren’t being followed by a psychiatrist/psychologist, do you think it would be beneficial?” | 4.71 | 0.030 | ||||
| Yes | 14 | 82.4 | 14 | 50.0 | ||
| No | 3 | 17.6 | 14 | 50.0 | ||
Variable with missing values; CAU, care as usual; CNS, central nervous system; CT, chemotherapy; HT, hormone therapy; RT, radiotherapy; SD, standard deviation; w/o, without.
Group comparison and group effects
The comparison between groups (Table 3) in T1 showed that there was statistically significant differences in the psychosocial domain of QoL (mean: MCGP: 4.83 vs. CAU: 6.70; U = 566.90, P < 0.001) and anxiety (mean: MCGP: 9.33 vs. CAU: 7.00; U = 646.00, P = 0.003), where the MCGP group scored significantly lower in the psychosocial domain of QoL, and higher in anxiety, comparing with the CAU group. At T2, there was statistically significant differences between the general (mean: MCGP: 7.08 vs. CAU: 5.95; U = 552.00, P < 0.001), physical (mean: MCGP: 5.93 vs. CAU: 5.26; U = 731.50, P = 0.018) and existential (mean: MCGP: 6.98 vs. CAU: 6.57; U = 727.50, P = 0.018) domains and the total score (mean: MCGP: 6.64 vs. CAU: 6.24; U = 717.50, P = 0.015) of QoL, and anxiety (mean: MCGP: 8.66 vs. CAU: 7.31; U = 740.50, P = 0.023), where the MCGP group scored significantly higher. On the other hand, the CAU group presented statistical higher levels in DT (mean: MCGP: 4.32 vs. CAU: 5.69; U = 608.50, P = 0.001), in comparison with the MCGP group. Comparing the groups between T1 and T2, for the MCGP group, there was a statistically significant improvement in the general (mean: T1: 5.45 vs. T2: 7.08; Z = −3.67, P < 0.001) and psychosocial (mean: T1: 4.83 vs. T2: 6.20; Z = −2.89, P = 0.004) domains and total score (mean: T1: 5.88 vs. T2: 6.64; Z = −2.71, P = 0.007) of QoL, and a statistically significant decrease in DT (mean: T1: 5.28 vs. T2: 4.32; Z = −2.40, P = 0.016). In the CAU group, there was a significant statistical decrease in the support domain (mean: T1: 6.14 vs. T2: 5.69; Z = −2.18, P = 0.029) of QoL and a significant statistical increase in DT (mean: T1: 4.81 vs. T2: 5.69; Z = 02.44, P = 0.015).
Table 3.
Medians, means, standard deviations, and tests of the normal distribution for each group, in the pre- (T1) and in the post-test (T2) (intent to treat analysis)
| MCGP (n = 51) | CAU (n = 40) | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Pre-test (T1) | Post-test (T2) | Pre-test (T1) | Post-test (T2) | |||||||||||||||||
| Med | M | SD | KS p | SW p | Med | M | SD | KS p | SW p | Med | M | SD | KS p | SW p | Med | M | SD | KS p | SW p | |
| MQOL | ||||||||||||||||||||
| General | 5.00 | 5.45 | 2.89 | 0.010 | 0.032 | 7.00 | 7.08 | 1.85 | <0.001 | <0.001 | 7.00 | 6.32 | 1.54 | 0.001 | 0.088 | 6.00 | 5.95 | 1.36 | 0.001 | 0.079 |
| Physical | 5.41 | 5.49 | 1.68 | <0.001 | 0.066 | 5.64 | 5.93 | 1.64 | <0.001 | <0.001 | 5.41 | 5.31 | 0.83 | 0.012 | 0.080 | 5.50 | 5.26 | 1.53 | <0.001 | <0.001 |
| Psychosocial | 4.50 | 4.83 | 2.57 | 0.200 | 0.276 | 6.54 | 6.20 | 2.41 | 0.001 | 0.010 | 6.63 | 6.70 | 1.61 | 0.200 | 0.577 | 6.54 | 6.98 | 1.76 | 0.053 | 0.013 |
| Existential | 6.66 | 6.66 | 2.30 | 0.200 | 0.015 | 6.80 | 6.98 | 1.86 | <0.001 | <0.001 | 6.59 | 6.84 | 1.29 | 0.027 | 0.010 | 6.50 | 6.57 | 0.97 | 0.076 | 0.388 |
| Support | 6.76 | 6.76 | 2.69 | 0.015 | 0.002 | 6.32 | 6.81 | 2.12 | <0.001 | <0.001 | 6.50 | 6.14 | 2.21 | 0.049 | 0.005 | 6.32 | 5.69 | 2.11 | <0.001 | 0.002 |
| Total score | 5.88 | 5.88 | 1.75 | 0.117 | 0.149 | 6.47 | 6.64 | 1.73 | <0.001 | <0.001 | 6.21 | 6.41 | 1.17 | 0.200 | 0.092 | 6.30 | 6.24 | 1.11 | 0.003 | <0.001 |
| FACIT | ||||||||||||||||||||
| Meaning/Peace | 19.00 | 18.14 | 6.12 | 0.073 | 0.031 | 18.00 | 18.11 | 5.02 | <0.001 | <0.001 | 19.00 | 18.40 | 5.62 | 0.003 | <0.001 | 18.00 | 17.85 | 5.18 | 0.007 | 0.043 |
| Faith | 10.61 | 10.59 | 5.04 | 0.056 | 0.043 | 9.66 | 9.61 | 3.80 | <0.001 | 0.001 | 11.00 | 10.63 | 3.61 | 0.104 | 0.495 | 10.00 | 9.71 | 3.17 | <0.001 | 0.001 |
| Total score | 28.74 | 28.48 | 9.60 | 0.200 | 0.440 | 27.87 | 27.82 | 7.22 | <0.001 | <0.001 | 29.00 | 29.08 | 7.35 | 0.034 | 0.006 | 27.87 | 27.93 | 5.92 | 0.001 | 0.034 |
| HADS | ||||||||||||||||||||
| Depression | 6.72 | 7.20 | 4.14 | 0.008 | 0.050 | 6.44 | 6.19 | 3.03 | <0.001 | 0.002 | 7.00 | 6.09 | 2.91 | 0.028 | 0.068 | 7.00 | 6.75 | 2.78 | 0.017 | 0.186 |
| Anxiety | 8.30 | 9.33 | 4.42 | 0.167 | 0.201 | 8.06 | 8.66 | 3.73 | <0.001 | <0.001 | 7.00 | 7.00 | 2.64 | 0.003 | 0.117 | 8.00 | 7.31 | 2.40 | 0.054 | 0.237 |
| Distress thermometer | ||||||||||||||||||||
| Total score | 5.00 | 5.28 | 2.74 | 0.008 | 0.059 | 4.92 | 4.32 | 2.18 | <0.001 | 0.001 | 5.07 | 4.81 | 2.21 | <0.001 | 0.038 | 4.92 | 5.69 | 1.28 | <0.001 | <0.001 |
CAU, care as usual; FACIT, Functional Assessment of Chronic Illness Therapy Spiritual Well-Being Scale; HADS, Hospital Anxiety and Depression Scale; KS: Kolmogorov–Smirnov; M, mean; Med, median; MCGP, meaning-centered group psychotherapy; MQOL, McGill Quality of Life Questionnaire; SD, Standard Deviation; SW, Shapiro–Wilk.
ANCOVA analysis (Table 4) tested group effects in QoL, spiritual well-being, anxiety, depression, and distress, after controlling for the scores in T1, as well as age, gender, cancer stage, CT treatments, and personal psychiatric history. For QoL and spiritual well-being, after accounting for the covariables effects, general, and support domains and the total score of QoL were significantly influenced by the group (group effect with small to elevated dimensions), where the MCGP group, compared with the CAU group, had an increase in general (b = 1.42, P < 0.001, ), and support (b = 0.80, P = .045, ) domains and total score (b = 0.81, P = 0.013, ) of QoL. For spiritual well-being, there was not an improvement in the MCGP group, comparing with the CAU group. For depression, anxiety and distress, after taking into account the covariables effect, it was found significant differences in the variables depression and distress, with an improvement (decrease) in levels of depression (b = −1.14, P = 0.044, ) and distress (b = −1.38, P = 0.001, ) in the MCGP group, in comparison with the CAU group. These results had small to medium dimension effects.
Table 4.
Average change scores and standard deviations for all variables by group, covariance analysis, and effect size (n = 91)
| MCGP (n = 51) | CAU (n = 40) | |||||||
|---|---|---|---|---|---|---|---|---|
| M | SD | M | SD | Difference | F | P | ||
| MQOL | ||||||||
| General | 7.21 | 0.21 | 5.79 | 0.24 | 1.42 | 17.89 | <0.001 | 0.179 |
| Physical | 5.90 | 0.23 | 5.30 | 0.27 | 0.60 | 2.68 | 0.105 | 0.032 |
| Psychosocial | 6.48 | 0.31 | 6.63 | 0.36 | −0.15 | 0.08 | 0.782 | 0.001 |
| Existential | 7.05 | 0.20 | 6.49 | 0.23 | 0.56 | 3.13 | 0.081 | 0.037 |
| Support | 6.67 | 0.25 | 5.87 | 0.28 | 0.80 | 4.15 | 0.045 | 0.048 |
| Total score | 6.82 | 0.20 | 6.02 | 0.23 | 0.81 | 6.45 | 0.013 | 0.073 |
| FACIT | ||||||||
| Meaning/Peace | 18.20 | 0.61 | 17.74 | 0.70 | 0.46 | 0.22 | 0.639 | 0.003 |
| Faith | 9.62 | 0.45 | 9.71 | 0.51 | −0.09 | 0.02 | 0.902 | 0.000 |
| Total score | 27.89 | 0.81 | 27.84 | 0.93 | 0.05 | 0.00 | 0.969 | 0.000 |
| HADS | ||||||||
| Depression | 5.93 | 0.35 | 7.07 | 0.40 | −1.14 | 4.17 | 0.044 | 0.048 |
| Anxiety | 8.21 | 0.37 | 7.88 | 0.42 | 0.33 | 0.32 | 0.574 | 0.004 |
| Distress thermometer | ||||||||
| Total score | 4.32 | 0.25 | 5.70 | 0.29 | −1.38 | 11.89 | 0.001 | 0.127 |
CAU, Care as usual; FACIT, Functional Assessment of Chronic Illness Therapy Spiritual Well-Being Scale; HADS, Hospital Anxiety and Depression Scale; M, mean; MCGP, meaning-centered group psychotherapy; MQOL, McGill Quality of Life Questionnaire; SD, standard deviation; η2p, eta2 partial.
Attrition rate
The attrition rate was 25.5% (13 dropouts), and the main reasons were illness and appointments (n = 3, 23.1%, respectively). In T1, participants that frequented 1 or 2 sessions (n = 13) had a statistically significant higher score in FACIT total score (U = 128.50, P = 0.010), and its dimension faith (U = 123.50, P = 0.007), comparing with those participants that frequented ≥3 sessions (n = 38). In T2, those participants that frequented ≥3 sessions had a statistically significative higher score in the general domain of QoL (U = 130.00, p = 0.009), comparing with those that frequented less sessions.
Checklist of therapist adherence
The therapist was less adherent to session 3 (mean: 5.75; minimum: 4; maximum: 7), comparing all sessions. The main reason was the difficulty of accomplishing all the goals of the session’ themes (Attitudinal, Creative, and Experiential Sources of Meaning), namely the exercises related to “Experiential Sources of Meaning.”
Discussion
MCGP transcultural adaptation and validation showed that existential themes, particularly “sources of meaning” or “transcendence,” raised questions culturally determined and related to the “meaning of life” (Hambleton and Patsula, 1990; Swaine-Verdier et al., 2004; Goes, 2007; Pasquali, 2009; Epstein et al., 2015; Medeiros et al., 2015; Da Ponte et al., 2017). The high number of dropouts verified with MCGP original version is well described in previous studies that reported the link between the limitations of psychosocial research in cancer patients and personal time-consumption by medical care (Croy, 2010; Applebaum et al., 2012). The internal pilot study using MCGP adapted version supported its feasibility and possible positive benefits in QoL and spiritual and psychological well-being.
Many socio-demographic and clinical characteristics between MCGP and CAU had not statistically significant differences, which supports the sample’s homogeneity. Although a higher proportion of MCGP participants had personal psychiatric history and current follow-up, these variables were controlled by statistical analysis. On the other hand, the smaller proportion of MCGP participants submitted to surgery gives to this group a lower theoretical risk of psychopathology (McFarland et al., 2019), but this result needs to be integrated with the rest, namely the number of participants in question (MCGP: 37/51 vs. CAU = 37/40).
The group comparison in the 1st assessment showed that MCGP, compared with the CAU group, presented a reduction of QoL, in its psychosocial domain, and higher levels of anxiety. In the 2nd assessment, the MCGP group, compared with the CAU group, presented higher QoL in its general, physical and existential domains and total score, and, although it was not statistically significant, an improvement in the psychosocial domain of QoL (mean: T1: 4.83 vs. T2: 6.20). Similarly, the result of higher levels of anxiety in MCGP, comparing with the CAU group, needs to be integrated in the improvement (not statistically significant) of its levels (mean: T1: 9.33 vs. T2: 8.66). The group comparison between assessments supports the previous findings, as the MCGP group presented better QoL in its general and psychosocial domains and total score. The new finding of higher levels of distress in the MCGP group, comparing with the CAU group, give additional evidence of its benefit in this dimension of psychological well-being.
In terms of group effects, for the primary outcome (MCGP adapted version improves QoL and spiritual well-being), it was verified a group effect, with small to high dimensions, in which the MCGP group, compared with the CAU group, presented a higher QoL (general and support domains, and total score), but not for spiritual well-being. This last data needs to be integrated in former results, namely the mean values of FACIT, and its dimension meaning/peace, at baseline (and also in 2nd assessment), which could mean that there was little space for improvement (MCGP: FACIT total score — T1: 28.48 vs. T2: 27.82; dimension meaning/peace — T1: 18.11 vs. T2: 18.40; FACIT Group, 2011). For the secondary outcome (MCGP adapted version improves levels of depression, anxiety, and distress), it was verified a group effect, with small to medium dimensions, in which the MCGP group improved levels of depression and distress, supporting the former results of group comparison.
It was also verified that participants who attended less sessions had better spiritual well-being at the beginning and, therefore, less need for psychotherapy. The improvement in QoL after psychotherapy in participants who attend more sessions can support the benefit of MCGP in QoL.
In terms of limitations, our pilot exploratory trial did not consist of RCT but an efficacy study, which is considered the more appropriate to study psychosocial interventions, given that it ensures external validity (Croy, 2010). The small sample, its cultural characteristics, and the adaptation in a short version of MCGP, could have conditioned the absence of its proven benefit in spiritual well-being. It is well described the relation between the benefit and duration of psychotherapies (Spiegel, 1978; Spiegel et al., 1981). Our recruitment rate was only possible by the expansion of inclusion criteria and allocation method — the first limitation was overpassed by our methodology (replication of previous studies) and statistical analysis (control of confounding variables) (Van Lankveld et al., 2018). The absence of screening for distress at the baseline was admitted, but it followed the assumption that high levels of distress do not necessarily correspond to maladaptive responses, as it is not the intensity but the nature of distress that determines the response (Moyer et al., 2009; Croy, 2010; Van Lankveld et al., 2018). The second limitation — allocation according to participants’ preference — was also considered, given its relation with prognosis (Deeks et al., 2003). Although this, former studies gave strength to the intervention’s efficacy, pointing to the inconsistency between participants’ preference and attrition (Applebaum et al., 2012).
The reduction of the number of sessions in this adapted version could represent an advantage in terms of attrition rate (25.5%), taking into account that studies using MGCP original version showed rates between 25.8% and 56.9% (Applebaum et al., 2012; Breitbart et al., 2015).
The checklist of the therapist’s adherence revealed his difficulty in adhering to all of session 3 goals, namely the completion of exercises. To overpass this limitation, the authors suggest dividing this session into two.
In conclusion, the preliminary results gave evidence for the benefits of the MCGP adapted version in increasing QoL and psychological well-being. The authors believe that there is space to improve the consistency of this study, with a reformulation of the MCGP adapted version and a larger sample.
Acknowledgments.
The authors would like to thanks to the Portuguese League Against Cancer, South Regional Centre, Lisbon, namely its Psycho-Oncology Unit, for their collaboration, in these three main areas: recruitment of the sample, administration of questionnaires to the control group, and logistical support for conducting the study.
Footnotes
Conflict of interest. The authors declare no conflict of interests.
References
- Applebaum AJ, Lichtenthal WG, Pessin HA, et al. (2012) Factors associated with attrition from a randomized controlled trial of meaning-centered group psychotherapy for patients with advanced cancer. Psycho-Oncology 21(11), 1195–1204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Applebaum AJ, Kulikowski JR and Breitbart W (2015) Meaning-centered psychotherapy for cancer caregivers (MCP-C): Rationale and overview. Palliative and Supportive Care 13(6), 1631–1641. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breitbart W (2000) Spirituality and meaning in supportive care: Spirituality and meaning-centered group psychotherapy intervention in advanced cancer. Supportive Care in Cancer 10, 272–278. [DOI] [PubMed] [Google Scholar]
- Breitbart W (2002) Spirituality and meaning in supportive care: Spirituality- and meaning-centered group psychotherapy interventions in advanced cancer. Supportive Care in Cancer 10(4), 272–280. [DOI] [PubMed] [Google Scholar]
- Breitbart W and Alici Y (2014) Psychosocial Palliative Care. New York: Oxford University Press. [Google Scholar]
- Breitbart W and Poppito SR (2014) Meaning Centered Group Psychotherapy for Patients with Advanced Cancer. New York: Oxford University Press. [Google Scholar]
- Breitbart W, Rosenfeld B, Gibson C, et al. (2010) Meaning-centered group psychotherapy for patients with advanced cancer: A pilot randomized controlled trial. Psycho-Oncology 19(1), 21–28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breitbart W, Poppito S, Rosenfeld B, et al. (2012) Pilot randomized controlled trial of individual meaning-centered psychotherapy for patients With advanced cancer. Journal of Clinical Oncology 30(12), 1304–1309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breitbart W, Rosenfeld B, Pessin H, et al. (2015) Meaning-centered group psychotherapy: An effective intervention for improving psychological well-being in patients with advanced cancer. Journal of Clinical Oncology 33(7), 749–754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breitbart W, Pessin H, Rosenfeld B, et al. (2018) Individual meaning-centered psychotherapy for the treatment of psychological and existential distress: A randomized controlled trial in patients with advanced cancer. Cancer 124(15), 3231–3239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chochinov HM, Hack T, Hassard T, et al. (2005) Understanding the will to live in patients nearing death. Psychosomatics 46, 7–10. [DOI] [PubMed] [Google Scholar]
- Chochinov HM, Kristjanson LJ, Breitbart W, et al. (2011) Effect of dignity therapy on distress and end-of-life experience in terminally ill patients: A randomised controlled trial. The Lancet Oncology 12(8), 753–762. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Classen C, Butler LD, Koopman C, et al. (2001) Supportive-expressive group therapy and distress in patients with metastatic breast cancer: A randomized clinical intervention trial. Archives of General Psychiatry 58, 494–501. [DOI] [PubMed] [Google Scholar]
- Cohen SR, Mount BM, Bruera E, et al. (1997) Validity of the McGill quality of life questionnaire in the palliative care setting: A multi-centre Canadian study demonstrating the importance of the existential domain. Palliative Medicine 11(1), 3–20. [DOI] [PubMed] [Google Scholar]
- Conway CC, Forbes MK, Forbush KT, et al. (2019) A hierarchical taxonomy of psychopathology can transform mental health research. Perspectives on Psychological Science 14(3), 419–436. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Croy P (2010) An Investigation of the Outcomes of Psycho-Oncology Interventions. New Zealand: Massey University. [Google Scholar]
- Da Ponte G, Ouakinin S, Breitbart W (2017) Adaptation of meaning centered psychotherapy to Portuguese language. Publication Manual of the America Psychosomatic Society, A27. [Google Scholar]
- Deeks J, Dinnes J, D’Amico R, et al. (2003) Evaluating non-randomised intervention studies. Health Technology Assessment 7(27), 1–173. [DOI] [PubMed] [Google Scholar]
- Duarte AC, Querido AI and Dixe MA (2010) Validação trancultural da “McGill quality of life questionnaire”- Qualidade de vida dos doentes em cuidados paliativos. International Journal of Developmental and Educational Psychology 4(1), 437–448. [Google Scholar]
- Edelman S, Bell DR and Kidman AD (1999) A group cognitive therapy programme with metastatic breast cancer patients. Psycho-Oncology 8, 295–305. [DOI] [PubMed] [Google Scholar]
- Edmonds CV, Lockwood GA and Cunningham AJ (1999) Psychological response to long-term group therapy: A randomized trial with metastatic breast cancer patients. Psycho-Oncology 8, 74–91. [DOI] [PubMed] [Google Scholar]
- Epstein J, Santo RM and Guillemin F (2015) A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. Journal of Clinical Epidemiology 68(4), 435–441. [DOI] [PubMed] [Google Scholar]
- FACIT Group (2011) FACIT Functional Assessment of Chronic Illness Therapy. Available at: www.facit.org (retrieved October 11, 2014).
- Field MJ and Cassel CK (1997). Approaching Death: Improving Care at the End of Life. Washington, DC: National Academies Press. [PubMed] [Google Scholar]
- Goes PS (2007) Validação de Instrumentos de Pesquisa. Available at: https://docs.ufpr.br/ñiveam/microdasala/aulas/tecnicas_de_pesquisa/validação_odonto.pdf (retrieved July 8, 2014).
- Greenstein M and Breitbart W (2000) Cancer and the experience of meaning: A group psychotherapy program for people with cancer. American Journal of Psychotherapy 54, 486–500. [DOI] [PubMed] [Google Scholar]
- Hambleton RK and Patsula L (1990) Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices. Journal of Applied Testing Technology 1(1), 1–30. [Google Scholar]
- Julião M (2014). Eficácia da Terapia da Dignidade no Sofrimento Psicossocial de Doentes em Fim de Vida Seguidos em Cuidados Paliativos - Ensaio Clínico Aleatorizado e Controladp. Universidade de Lisboa. [Google Scholar]
- Kissane DW, Bloch S, Smith GC, et al. (2003) Cognitive-existential group psychotherapy for women with primary breast cancer: A randomised controlled trial. Psycho-Oncology 12(6), 532–546. [DOI] [PubMed] [Google Scholar]
- Kissane DW, Grabsch B, Clarke DM, et al. (2007) Supportive-expressive group therapy for women with metastatic breast cancer: Survival and psychosocial outcome from a randomized controlled trial. Psycho-Oncology 1(16), 277–286. [DOI] [PubMed] [Google Scholar]
- Kotov R, Waszczuk MA, Krueger RF, et al. (2017) The hierarchical taxonomy of psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology 126(4), 454–477. [DOI] [PubMed] [Google Scholar]
- Lee V, Cohen SR, Edgar L, et al. (2006) Meaning-making intervention during breast or colorectal cancer treatment improves self-esteem, optimism, and self-efficacy. Social Science & Medicine 62, 3133–3145. [DOI] [PubMed] [Google Scholar]
- Lichtenthal WG, Corner GW, Sweeney CR, et al. (2015) Mental health services for parents who lost a child to cancer: If we build them, will they come? Journal of Clinical Oncology 33(20), 2246–2253. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McFarland DC, Walsh L, Napolitano S, Morita J, et al. (2019). Suicide in patients with cancer: Identifying the risk factors. Retrieved June 30, 2020, from https://www.cancernetwork.com/view/suicide-patients-cancer-identi-fying-risk-factors. [PubMed]
- Medeiros R, Júnior M, Pinto D, et al. (2015) Modelo de validação de conteúdo de Pasquali nas pesquisas em Enfermagem. Revista de Enfermagem Referência 4, 127–135. [Google Scholar]
- Moyer A, Sohl SJ, Knapp-Oliver SK, et al. (2009) Characteristics and methodological quality of 25 years of research investigating psychosocial interventions for cancer patients. Cancer Treatment Reviews 35(5), 475–484. [DOI] [PMC free article] [PubMed] [Google Scholar]
- MSKKC (2016) Meaning Centered Psychotherapy Web Portal. Available at: https://mskcc.cloud-cme.com/ (retrieved February 13, 2017).
- National Comprehensive Cancer Network (2017) Distress management - NCCN guidelines. Available at: https://www.nccn.org/patients/guidelines/distress/files/assets/basic-html/page-1.html# (retrieved December 21, 2019). [DOI] [PubMed]
- Ouakinin S, Eusebio S, Torrado M, et al. (2015) Stress reactivity, distress and attachment in newly diagnosed breast cancer patients. Health Psychology and Behavioral Medicine 3(1), 424–438. [Google Scholar]
- Pais-Ribeiro J, Silva I, Ferreira T, et al. (2007) Validation study of a Portuguese version of the hospital anxiety and depression scale. Psychology Health & Medicine 12(2), 225–235. [DOI] [PubMed] [Google Scholar]
- Pasquali L (2009) Psicometria. Revista da Escola de Enfermagem da USP 43, 992–999. [Google Scholar]
- Pereira F and Santos C (2011) Adaptação cultural da functional assessment of chronic illness therapy-spiritual well-being (FACIT-Sp): estudo de validação em doentes oncológicos na fase final de fim de vida. Cadernos de Saúde 2(4), 37–45. [Google Scholar]
- Puchalski CM (2013) Integrating spirituality into patient care: An essential element of person-centered care. Polskie Archiwum Medycyny Wewnętrznej 123(9), 491–497. [PubMed] [Google Scholar]
- Rosenfeld B, Saracino R, Tobias K, et al. (2017) Adapting meaning-centered psychotherapy for the palliative care setting: Results of a pilot study. Palliative Medicine 31(2), 140–146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sinclair S, Pereira J and Raffin S (2006) A thematic review of the spirituality literature within palliative care. Journal of Palliative Medicine 9, 464–479. [DOI] [PubMed] [Google Scholar]
- Spiegel DYI (1978) A support group for dying patients. Int J Group Psychother 28(2), 233–245. [DOI] [PubMed] [Google Scholar]
- Spiegel D, Bloom JR and Yalom I (1981) Group support for patients with metastatic cancer: A randomized outcome study. Archives of General Psychiatry 38, 527–533. [DOI] [PubMed] [Google Scholar]
- Swaine-Verdier A, Doward LC, Hagell P, et al. (2004) Adapting quality of life instruments. Value in Health 7(1), 27–30. [DOI] [PubMed] [Google Scholar]
- Teixeira J (2006) Introdução à psicoterapia existencial. Análise Psicológica 3, 289–309. [Google Scholar]
- van der Spek N, Vos J, van Uden-Kraan CF, et al. (2013) Meaning making in cancer survivors: A focus group study. PLoS ONE 8(9), 22–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van der Spek N, Vos J, van Uden-Kraan CF, et al. (2014) Effectiveness and cost-effectiveness of meaning-centered group psychotherapy in cancer survivors: Protocol of a randomized controlled trial. BMC Psychiatry 14(1), 22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van der Spek N, Vos J, van Uden-Kraan CF, et al. (2016) Efficacy of meaning-centered group psychotherapy for cancer survivors: A randomized controlled trial. Psychological Medicine 47(11), 1990–2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Lankveld JDM, Fleer J, Schroevers ML, et al. (2018) Recruitment problems in psychosocial oncology research. Psycho-Oncology 27(9), 2296–2298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yalom ID and Greaves C (1977) Group therapy with the terminally ill. American Journal of Psychiatry 134, 396–400. [DOI] [PubMed] [Google Scholar]
- Zigmond AS and Snaith RP (1983) The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica 63, 361–370. [DOI] [PubMed] [Google Scholar]
