Abstract
Conducting rigorous psychosocial intervention research with cancer patients has many challenges including encouraging them to join studies, asking them to engage in interventions or be part of control conditions, and to provide data over follow-up assessments. Here, we highlight valuable insights regarding such challenges provided by investigators studying psychosocial interventions for cancer patients. Handling these skillfully has important implications for the internal and external validity of this research and the ethical treatment of participants. Challenges noted in research reports included in a systematic review of 25 years of research (comprising 488 unique projects) investigating interventions designed to enhance cancer patients’ quality of life were compiled. Among the difficulties mentioned was the fact that patients may not feel the need for psychosocial interventions and thus may not be interested in joining an intervention study. Patients who do feel the need for such interventions may be deterred from joining trials by the prospect of being randomized to a non-preferred group; if they do join a trial, participants may be disappointed, drop out, or seek compensatory additional assistance if they are assigned to a control group. Apart from randomization, other aspects of research may be off-putting to participants or potential participants, such as the language of consent forms or the intrusiveness of questions being asked. Potential remedies, such as research awareness interventions, monetary incentives, partnering with cancer support organizations, and using designs that take preferences into account merit consideration and further research inquiry.
Keywords: neoplasms, patient selection, reproducibility of results, ethics
Conducting rigorous psychosocial intervention research with cancer patients has many challenges. Recruiting cancer patients to join studies, asking them to engage in interventions or to participate in control conditions for the sake of research, and to continue to provide data over the course of follow-up assessments involves planning, organization, skill, sensitivity, and resources, such as personnel and study infrastructure. In a comprehensive systematic review of 25 years of research (comprising 488 unique projects) investigating interventions designed to enhance cancer patients’ quality of life, we noted evidence of such challenges 1. For instance, for the 178 projects for which this could be calculated, 27% of eligible participants did not become involved in the research; for the 215 projects for which this could be calculated, the proportion of participants dropping out of treatment was 11%. Investigators did not often monitor or document in their reports additional off-study assistance obtained by participants or contamination of intervention ingredients across treatment groups, so it is difficult to determine their true incidence. However, 14% of the studies reviewed did note that such additional assistance was received and 7% of the multiple-group studies stated that there was some contamination across groups. In coding this large group of study reports, numerous challenges related to the internal and external validity of the research and the ethical treatment of study participants came to light. Because these were often noted only parenthetically in study reports, we highlight here the valuable insights that these challenges provide (see Table 1) and discuss possible strategies for addressing them.
Table 1.
Patient Reluctance to be Part of Pyschosocial Intervention Research | Participant Disappointment Regarding their Study Group Assignment | Lack of Adherence to Treatment and Study Drop Out |
Perceptions of the value of psychosocial interventions | Adverse psychological reactions | Burdens and demands of treatment |
Perceptions of their need for psychosocial interventions | Low engagement in treatment | Engaging in additional potentially therapeutic activities |
Feelings about being involved in research and reactions to research procedures |
Efforts to gain access to assistance offered in comparison group elsewhere | Non-randomly missing follow-up data |
Aversion to being randomly assigned to a treatment group |
Patient Reluctance to be Part of Psychosocial Intervention Research
Successfully recruiting participants to enroll in studies investigating psychosocial interventions for cancer patients depends upon their perceptions of the value of and their need for psychosocial interventions. For instance, newly diagnosed breast, colorectal, gastric, or prostate cancer patients were invited to join a randomized trial of an individual psychological support intervention 2. Twenty-five percent of decliners reported that they had no need for any psychosocial intervention. Conversely, some participants have noted that their willingness to be involved in a study was rooted only in a desire to help others in a similar situation, but they had no need for psychotherapy themselves 3. Evidence suggests that most cancer patients do not make use of psychosocial resources naturalistically. For instance, a survey of women with breast cancer listed in a tumor registry indicated that 82% were not currently in or had ever participated in any type of cancer support program 4. Some study reports have noted low patient enthusiasm for psychosocial interventions when provided. In a trial of psychological therapy for patients with testicular cancer, recruitment was stopped after 2.5 years because of the low numbers agreeing to participate 5. Whereas 16% refused completely, 44% of those approached were willing only to complete assessments but not to participate in the specific intervention offered, indicating that it was not the research per se to which they were adverse. The authors noted that early-stage outpatients, who refused at higher rates than did later-stage inpatients, may have been reassured by their good prognosis and, thus, were reluctant to make additional trips to the hospital. Other authors have noted the relatively small proportion of patients who choose to attend available hospital support programs, but maintain that this lack of interest may be due to misconceptions about the interventions offered and lack of knowledge about the benefits they might provide 6. Regardless of whether or not patients’ perception of lack of need for or interest in psychosocial interventions is realistic, the unwillingness of many cancer patients to participate in psychosocial interventions makes enrollment of study samples difficult.
Successful recruitment to studies of psychosocial interventions also depends on participants’ feelings about and willingness to be involved in a research project. Reluctance to participate in research when in the throes of facing a life-threatening illness is, of course, understandable 7. In a study noted above 2, 25% of those approached declined to participate, and 11% of these specified that they did not want to be involved in research. Other studies have reported low uptake rates (e.g., 33%, 8, with one multisite trial of psychosocial support for women with metastatic breast cancer randomizing fewer than 9% of patients who were eligible 9. Quite likely, rates of uptake in research depend upon patient demographic, psychological, and disease characteristics. For instance, we noted in our review that fewer than 5% of interventions included patients that were in the palliation stage of treatment 1, and this may likely be related to the challenges of working with dying patients. However, some researchers have noted the feasibility of recruiting even very ill, metastatic cancer patients 10.
Research uptake may also be determined by aspects of study procedures. For example, the inquiries of some investigators may be perceived as intrusive, especially by patients for whom diagnosis and treatment already have resulted in a sense of a lack of control and a lowering of self-esteem. Of 101 men with prostate cancer who refused to take part in a study of an intervention to enhance communication between patients about to undergo radical prostatectomy and their medical providers and partners, 12% mentioned that they found the study questionnaire too personal 11. Similarly, the wording of consent forms has been noted as a problem arising in recruitment to cancer supportive care trials 12. Investigators may not be aware that such rituals of the research process, taken for granted and well-understood by researchers, can provoke discomfort and represent barriers to successful recruitment.
The majority of studies in this area use randomized trial study designs 1. Although this methodology is rigorous from the perspective of establishing group equivalence and controlling for self-selection factors (which do seem to operate when patients can choose an active as opposed to a control treatment 13), it may elicit reluctance from potential participants. Some evidence documents that dislike of randomization is a barrier to enrollment in cancer clinical trials in general 14. Goodwin et al. (2000) noted in their trial that, as the availability of support groups outside the study and awareness of their potential benefits increased, potential participants were less amenable to being randomized, potentially to a control group. This difficulty has been mentioned by other investigators 15. Although from the investigators’ perspective, the off-study support groups were not offering the same type of therapy, were not therapist-led, or long-term, the off-study support groups seemed to be perceived by patients to be of similar value, and thus represented attractive competitors 10.
Participant Disappointment Regarding Treatment Group Assignment
Although a proportion of studies investigating psychosocial interventions for cancer patients examine a single type of treatment and conduct pre-and post-treatment assessments of functioning, the majority are multiple-group studies that contrast active treatments to a control condition or compare two types of treatment (e.g., these made up 74% of the investigations in our prior review, Moyer et al., in press). A large proportion of these (e.g., 66% in our prior review) use control conditions that involve no treatment, treatment as usual, or a wait-list condition that has the option of receiving the active treatment after the study is complete. Not surprisingly, these contrasted conditions may be differentially attractive to participants. In a trial of a complementary/alternative medicine (CAM) therapy-oriented intervention versus a standard therapy control group, potential participants were drawn to the study because of an interest in CAM and were not interested in participating in the standard therapy 16. In an investigation that compared the effectiveness of a cognitive-behavior therapy intervention to a no-therapy control condition in metastatic breast cancer patients 17, some participants, understandably, registered disappointment at having been randomized to the control group. Other authors have noted similar reactions 15, some despite diligent pilot work to develop a preparation and debriefing protocol for the randomization procedure 18. Conversely, other authors noted that they randomized participants to the intervention and control groups on a 3:1 ratio because they expected refusals to participate in their group intervention (a behavioral intervention for newly diagnosed cancer patients) to be particularly high 19. This was explained by noting that in Israel, where the study was conducted, receiving psychotherapy carried a stigma, especially among those with medical conditions. In a study that compared a coping skills intervention for cancer patients delivered in an individual versus a group format some participants were reluctantly assigned to the group format 8. These individuals then attended the intervention meetings only sporadically, compromising the group processes and jeopardizing the successful completion of the trial.
Some authors have noted effects on study outcomes that may result from such potential “resentful demoralization,” or negative reactions to being assigned to a non-preferred condition 20. During a randomized clinical trial of a mindfulness-based stress reduction (MBSR) program versus freely-chosen stress management activities for women with breast cancer, participants unintentionally learned their group assignment prior to completing baseline assessments 21. Although the groups were similar in terms of demographic and health status variables, those assigned to the MBSR condition had superior depression, trait anxiety, quality of life, sense of coherence, and sense of control scores. This pattern suggested that the differences in psychological variables were the result of participants’ awareness of their group assignment and their expectations about it. Conversely, results from another randomized trial of a cancer rehabilitation program that emphasized physical training, information, and coping skills did not find any evidence that potential reactions to being assigned to control groups influenced any of the outcome variables 22. In this trial, non-participants (who did agree to complete assessments) reported lower levels of most problems at baseline compared to participants, potentially indicating a reduced level of need for the intervention. Relative to these non-participants, control participants did not show differences in the proportion improving or deteriorating over time on three variables believed to be particularly sensitive to resentful demoralization: depressive symptoms, fighting spirit, and quality of life. Finally, other authors noted difficulty in obtaining full data from members of their control group in which they had higher numbers refuse to have a blood draw, perhaps because these participants felt that they were not receiving anything in return for being in the study 23.
When participants are disappointed with their group assignment they may be motivated to try to gain access elsewhere to the assistance that they hoped to obtain by joining the trial. Although this compensatory behavior may reduce the likelihood of identifying a true intervention effect and cloud the results of the study 22, it is an understandable response on the part of participants. Furthermore, it may be viewed as unethical in some situations to try to prevent this type of help-seeking. Some investigators noted that their institutional ethics committee required that participants assigned to control conditions be specifically made aware of other resources that they could access outside the study 17.
Treatment contamination, whereby participants assigned to control conditions gain access to active ingredients of the treatment under study, appears to be particularly common in trials of exercise interventions for cancer patients 24–26. Other examples of contamination included control group participants joining an outside support group in a trial of two types of group psychosocial support 27; control group participants keeping track of side effects, when monitoring side effects was part of the experimental intervention 28; a control participant obtaining a commercially-produced guided imagery tape in a study testing a version of such tapes 29; control participants obtaining copies of a publicly-available videotape that was part of an intervention 30; and a participant assigned to standard care in a study of a computer-based nursing intervention enlisting the assistance of a clinical oncology nurse specialist after querying those who were receiving it 7. Occasionally, treatment contamination resulted from compassionate responses on the part of investigators; in a trial of psychotherapeutic support for gastrointestinal cancer patients undergoing surgery, a proportion of the control group (25%) requested that they be transferred to the experimental group and the investigators complied 31. It would seem that contamination is most likely when the treatment under study is one that may be easily accessed or approximated outside the study, such as exercise.
As more evidence accumulates about the usefulness of psychosocial interventions for cancer patients, and more patients join trials in the hope of gaining access to treatment, the use no-treatment control groups has become ethically objectionable. In other areas of investigation, for instance, evaluations of treatment of alcohol use disorders, no-treatment control groups (in non-drug studies) are used fairly infrequently 32. However, designing appropriate attention-placebo conditions for behavioral interventions may be challenging. A study that used a 30-minute “chat” about issues unrelated to patients’ illness to control for the attention of a brief psychotherapeutic intervention found that it appeared to have some therapeutic value 33, 34. Similarly, meeting repeatedly with an empathetic research assistant over the course of data collection unintentionally led some participants to report that they felt as if they had received an intervention 8. Finally, the authors of a trial of an educational intervention for newly-diagnosed cancer patients about to undergo radiotherapy concluded that although there was a significant effect on depression, that, because knowledge scores were not affected, that this effect was likely a non-specific effect of attention 35. Because of the recognized importance of social support to cancer patients 36, investigators are compelled to walk the fine line of providing supportive interactions to their research participants in the context of their participation in a trial while still creating distinct interventions with unique supportive components. Because of the particular importance of educational support to cancer patients 36, it is likely, however, that warmth and attention from research staff can be successfully distinguished from elements of support that are particularly relevant to the cancer experience.
Lack of Participant Adherence to Psychosocial Interventions
Psychosocial interventions vary in the amount of involvement and active participation that they require on the part of cancer patients. Whereas educational interventions entail very little, support groups involve much more emotional investment and effort, and psychotherapy may demand deeper self exploration 37. Similarly, patients vary greatly in the extent to which they are willing to become deeply involved in interventions and become engaged in psychological self-help work 38, 39, with some study participants actually showing resistance to it 8. In a computer-mediated social support group for women with breast cancer, 46% actively participated and wrote 4 or more messages whereas 54% did not actively participate and wrote 3 or fewer messages 40. In terms of predictors of level of participation, race and stage of cancer did not differentiate those who decided to actively participate from those who did not. For the active participants, 18 demographic, health, attitude, and social variables were explored as moderators. Those moderators that proved to be significant predictors of the number of words written were being Caucasian and having a higher energy level. In another study, adherence to exercise in trials was predicted by being male, level of extraversion, perceived control over ability to exercise, and normative beliefs about social network members’ support for regular exercise 41.
Cancer patients in trials of psychosocial interventions have also been noted to deliberately engage in other activities that may be helpful to them. Examples of additional assistance included support groups provided outside of the study 9, 42, 43; professional counseling or psychotherapy 44, 45; antidepressant medications, meditation, yoga 46; antianxiety medications 47; CAM techniques 48–50; exercise 18; church groups 51; breathing exercises, relaxation tapes 52; prayer 53; radio programs, television programs, and books 54; the internet 55; initiating additional contact among group members 44; and support received from members of patients’ medical team 3, 56.
In some cases, additional assistance has, counter-intuitively, been found to be accessed more by intervention participants than by control participants. For instance, in a study examining a group psychotherapeutic intervention delivered as group conference call versus usual psychosocial care, no attempt was made to limit the control group members’ access to supportive resources available in the community or through national organizations 57. The intervention participants used significantly more outside services (i.e., support groups, retreats, educational programs, booklets, and videos) than did control participants and rated the value of these outside services as significantly higher. It may be that the type of person who joins such a trial is also the type of person who would be likely to seek out numerous forms of assistance.
Furthermore, participants may drop out of treatment altogether. A study that examined predictors of completing a 12-week, twice-weekly structured exercise program found that participants completing the program were older, had completed treatment as opposed to still being in treatment, and had early-stage as opposed to later-stage cancer 58. In this study, one-quarter of the sample did not complete the program, giving reasons such as treatment side effects and work or personal factors. Another study that reported a 20% attrition rate from an electronic support group for women with breast cancer found that those who dropped out were less able to cope with anxiety, had higher levels of fatalism, less pain interference, and less posttraumatic growth 59. Dropout is problematic in and of itself, but when there is differential dropout from intervention and control groups this introduces the possibility of bias. For instance, in one study, when participants learned that they were assigned to the control group, 25% of them dropped out 60. Conversely, a study of an 18-week computer-based symptom management nursing intervention focused on symptom management, noted that 13 of 55 patient/caregiver dyads dropped out of the intervention condition because it took too much time 7.
Participant Drop-Out of Follow-up Assessments
Missing follow-up data, especially when it is missing in non-random ways, can be problematic for interpretation of results. For example, some authors report differential follow-up rates from intervention and control conditions 61, but further bias can be introduced if such differential group dropout is related to participant characteristics. The true effect of an intervention could be diminished or reversed if, for instance, distressed patients in the intervention group feel obliged to participate in follow-up assessments whereas distressed patients in the control group feel less obliged to do so 62. A pattern of findings supporting this notion was documented in a study of home visits for patients with colorectal cancer 63. A marginally significant interaction between level of anxiety and intervention group and non-response on subsequent follow-up 62 indicated that those who were more anxious were more likely to complete follow-ups.
Practical and Logistical Difficulties
A significant proportion, about one-third, of the research evaluating psychosocial interventions for cancer patients involves treatment delivered in group formats 1. Interventions delivered in groups of other patients are thought to be particularly useful in that they can normalize the experience of cancer 64, reduce isolation 65, and make use of helpful psychological processes such as social comparison, informational and emotional social support, and the helper therapy principle, whereby individuals gain from assisting others 66. Forming groups of patients, however, has logistical challenges. Some authors have noted that in order to accrue participants rapidly enough to fill groups they needed to randomize participants in a ratio of 2:1 to intervention and control groups, necessitating an increase in total sample size; similarly, smaller participating centers in their multi-site trial could not recruit enough participants to fill groups 10. Such delays can result in loss of potential participants due to incapacitation as time passes 18. Conducting research with ill populations also means that some participants be lost due to morbidity or death (e.g.,7. The content of the intervention may also be affected by this. Some authors have noted that death of members in some but not all of the groups meant that the content of the discussions were quite different across them 18. Physical deterioration due to advancing illness may also affect psychosocial outcomes. In a trial of supportive-expressive group therapy for women with metastatic breast cancer, there was a significant increase in levels of pain and distress documented in the last assessment before death 67 which may introduce some bias irrespective of condition.
Investigations of behavioral interventions share many of the challenges of investigations medical interventions such as selective enrollment, lack of engagement in treatment, and drop out and loss to follow-up, however some challenges are unique to trials of behavioral interventions, such as the inability to blind participants and treatment providers to treatment, the more prominent influence of treatment provider-participant relationship factors, and the challenge of designing credible control conditions 68. These aspects mean that researchers in this area need to be particularly creative, thoughtful, and resourceful; below we discuss some potential ways to address these challenges.
Potential Remedies
Some preliminary work has begun to try to increase the awareness of research trials in cancer patients and decrease misconceptions about them. These efforts have taken the form of sending a letter to all patients letting them know that offering a clinical trial was the norm and that standard care was always available 69 and a series of media products that conveyed a message of hope and put a human face on clinical research 70. Monetary incentives are another potential means of addressing reluctance to participate in psychosocial intervention research, as well as improving adherence 71. In this area of investigation providing incentives for participation is a strategy that has not been commonly used in the past, prompting some researchers, who have had difficulty recruiting participants, to suggest that they are something that researchers conducting psychosocial intervention research with cancer patients should consider 23. One study of a psychoeducational group intervention for African American breast cancer patients offered financial compensation for attending group meetings (with control participants receiving the same amount of money as those who attended all meetings), for completing assessments, and to cover the cost of transportation. The study had a good recruitment rate (63%) and an 86% follow-up rate with the assessment 12-months following the intervention 72. Financial incentives are common in other areas of research, potential participants (e.g., in genetic research) report that they are motivating73, and even fairly large incentives have been shown to effectively increase the representativeness of follow-up data while not inducing participant perceptions of coercion74. Future research should directly investigate the role that incentives might play in recruitment and retention in trials of psychosocial interventions for cancer.
Because preferences for one type of treatment versus another appear to have important effects, it may be important to include assessments of such preferences and their potential effects on trial outcomes. As an example, one study of two types of exercise versus usual care found that although 23% of their sample had no preference, 41% preferred the resistance exercise training whereas 36% preferred the aerobic exercise training 75. Participants who preferred resistance exercise training had improved quality of life when they were assigned to that treatment rather than to usual care or aerobic exercise training and those who had no preference had improved quality of life when they were assigned to aerobic exercise training compared with resistance exercise. In behavioral weight-loss trials, for instance, extensive orientation using motivational interviewing techniques prior to randomization have been successful in helping potential participants understand the reasons for alternative trial conditions and reducing attrition 76. Alternatively, research designs that take preferences into account when assigning participants to groups, and appropriate methods to analyze them, have also been developed 77–81.
Competition from off-study resources, which can affect study recruitment and contamination, speaks to the notion that cancer patients are motivated to seek out resources that may be helpful to them. Potential participants may not be aware of the differences in the type of interventions offered by cancer support organizations and research studies. Thus it may be valuable for investigators, where possible, to note to potential participants how the interventions being evaluated in their trials may be distinct from those offered by cancer support organizations. At the same time, because cancer support organizations provide numerous valuable services to cancer patients, 82, and often are familiar to and respected by the public, partnering with them may be a valuable strategy for researchers. The California Breast Cancer Research Program Community Research Collaboration award, which supports scientific research of community-based ideas in the area of breast cancer 83, and The National Center on Minority Health and Health Disparities Community-Based Participatory Research Initiative 84 are some examples of funding mechanisms that create synergy between academic expertise and community experience. Similarly, shifting the focus to implementing interventions that have already been shown to be effective rather than re-evaluating them would be valuable.
In an example of an intervention funded by one of these awards, a community-initiated, theoretically-based workbook-journal was designed as an alternative to a face-to-face support group for isolated rural women with breast cancer 55. It was created and evaluated by a partnership of researchers, a group of rural women with breast cancer, and medical and social work professionals. The input of the community partners revealed that the required language for the consent form outlining risks and benefits would be off-putting to potential participants and led to ways to make the consent forms more appealing (changing font, using color, using the term “participant” instead of “subject”). This type of collaboration will likely be fruitful in developing study procedures that are sensitive to participants’ point of view.
Similarly, more input from cancer patients and potential research participants is essential. Research participants in general are seldom asked about their experience of participation 85. Thus, focus groups or research querying patients themselves about the types, formats, structure, timing, and ingredients of interventions and trials could be extremely valuable, especially prior to embarking on a proposed trial. For instance, in one survey of a large group of patients with various cancer types, participants noted that they preferred to be involved in an intervention immediately after diagnosis, that obtaining medical information was an important goal, that a drop-in format was desirable, compared to the closed membership format with a predetermined duration typically provided in intervention studies, and the inclusion of spiritual components, not often included in interventions designed by researchers, was welcomed 86. A focus on patients’ perspectives is related to the suggestion to borrow insights from the field of marketing, such as better understanding what people in a market segment value and conveying persuasively the value proposition to them, in the development and conduct of clinical trials 87. Such feedback will help ensure that researchers are developing useful and appropriate psychosocial interventions for cancer patients and delivering them in the most acceptable way.
Some researchers have begun to try to predict contamination, with an eye toward developing strategies to avoid it. For instance, one study examined which participants are more likely to engage in physical activity when assigned to the control condition of an exercise trial. Past exercise, being male, and exercise intentions assessed before learning group assignment predicted level of exercise engaged in during the trial 41. This finding led to the simple recommendation to minimize potential contamination by screening out regular exercisers from such trials. Some investigators have attempted to reduce contamination by downplaying the potential benefits of the intervention; this may not be feasible or realistic in all studies. One study that examined the therapeutic effects of a structured interview designed to enhance coping, optimism, and health-related quality of life wished to avoid control group participants perceiving the intervention as desirable and trying to reproduce it on their own 88. Thus, the investigators simply presented the interview as a means to investigate the experiences of women with breast cancer during and after chemotherapy, rather than as an intervention.
Wait-list procedures, whereby participants assigned to control conditions are given access to the active treatment at a later point, may mitigate problems with disappointment with being assigned to a control condition. Participants seem to welcome the opportunity to have access to the treatment later. One study of an intervention designed to improve patient recall of diagnostic information audiotaped cancer patients’ initial consultations with their oncologist and provided the tapes only to those in the experimental condition initially 89. The authors noted that, even 3 months later, 77% of those in the control condition were interested in receiving the audiotape. Similarly, 89% of patients in the control condition of a study of a preparatory booklet for radiation therapy wished to receive a copy when they were later offered it 90. However, in trials of exercise programs for cancer patients where control participants are instructed not to embark on a structured exercise program and assured that when the trial is complete they would be given a personalized exercise prescription just like the experimental condition, levels of contamination have still been moderate 25, 41. Also, it is important to note that wait list procedures may be inappropriate or unethical, given that cancer patients may need particular types of assistance offered by an intervention under study at particular points in their treatment trajectory (e.g., decision assistance when treatment planning is occurring), that short-term psychological adjustment predicts long-term adjustment 91, and participants themselves prefer early intervention 86. Thus, it seems prudent to monitor and report this type of additional activity, particularly in cases where there may be ethical problems in restricting it, or where it may be difficult to control access to the active ingredients of treatment.
Designing appropriate control treatments for behavioral intervention trials is challenging compared to medical interventions because it is difficult to create a treatment that is considered to be inactive (or have some inactive ingredients), but is still a credible intervention to participants 68, 92. Some authors suggest that whether this has been successful can be monitored by assessing participant expectations of benefits, monitoring process of change variables, and documenting differential dropout rates 68.
Conclusion
Difficulties encountered in prior work provide lessons for issues to consider when designing and planning future studies investigating psychosocial interventions for cancer patients. Investigators should be aware that patients may not feel the need for psychosocial interventions and thus may not be interested in joining a study. Those who do feel the need for such interventions may be deterred from joining trials by the prospect of being randomized to a control group; those assigned to a control group may be disappointed, drop out, or engage in compensatory additional assistance. Other aspects of research may be give participants pause, such as the legal language used in consent forms, or the intrusiveness of the questions being asked of them. The extent to which a sample is representative of the population to which it is intended to draw conclusions has relevance for its external validity: the degree to which results from a study are generalizable. As such, addressing reluctance of cancer patients to join and remain in intervention research is critical. Participant disappointment with their treatment group assignment, and subsequent contamination or lack of adherence, has important implications for the internal validity of this research: the degree to which the results represent the phenomenon under study, and should also be the focus of attention. Similarly, study procedures or the wording of study materials that are viewed as off-putting or intrusive by research participants should motivate investigators to develop more acceptable methods. The challenges noted here are certainly not unique to psycho-oncology, as difficulties related to recruitment, reactance, and retention may be found in any area of research 93. For instance, in a survey of 114 multicenter clinical trials, less than one-third recruited their target sample size within the time originally specified, and around one-third required extensions to do so 94. Potential strategies to address these challenges may include research awareness interventions, incentives, partnering with community organizations, special efforts to inform participants about the rationale of research methodology, alternative research designs, and assessing and monitoring preferences, additional assistance, and contamination. Finally, as the challenges noted here were largely not the focus of inquiry, research directed intentionally to study challenges related to recruitment, reactions to treatment assignment, treatment engagement, and retention and potential strategies to address them is encouraged to provide further insights regarding improving the rigor of this work.
Acknowledgments
This work was supported by a grant from the National Cancer Institute (R01 CA100810) to Anne Moyer.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Contributor Information
Anne Moyer, Department of Psychology, Stony Brook University, Stony Brook, NY 11794-2500, Tel: (631) 632-7811, Fax: (631) 632-7876, anne.moyer@sunysb.edu.
Sarah K. Knapp-Oliver, Department of Psychology, Mount Holyoke College, 50 College Street, South Hadley, MA 01075-1462, Tel: (413) 538-2107, sknapp@mtholyoke.edu.
Stephanie J. Sohl, Mount Sinai School of Medicine, Department of Oncological Sciences, 1425 Madison Avenue, Box 1130, New York, NY 10029-6574, Phone: (212) 659-5504, Fax: (212) 849-2566, Stephanie.Sohl@mssm.edu.
Stefan Schnieder, Department of Psychology, Stony Brook, University, Stony Brook, NY 11794-2500, Tel: (631) 632-7875, Fax: (631) 632-7876, Stefan.schneider@sunysb.edu.
Anna H.L. Floyd, Department of Psychology, Stony Brook University, Stony Brook, NY, 11794-2500, Tel: (631) 632-7875, Fax: (631) 632-7875, ahfloyd@ic.sunysb.edu.
References
- 1.Moyer A, Sohl SJ, Knapp-Oliver SK, et al. Characteristics and methodological quality of 25 years of research investigating psychosocial interventions for cancer patients. Cancer Treat Rev. doi: 10.1016/j.ctrv.2009.02.003. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Hellbom M, Brandberg Y, Glimelius B, et al. Individual psychological support for cancer patients: utilisation and patient satisfaction. Patient Educ Couns. 1998;34:247–256. doi: 10.1016/s0738-3991(98)00033-0. [DOI] [PubMed] [Google Scholar]
- 3.Prince BJ. Hospitalized, post-mastectomy coping modification and anxiety reduction. DAI. 1995;56:117. [Google Scholar]
- 4.Michalec B. Exploring the multidimensional benefits of breast cancer support groups. J Psychosoc Oncol. 2005;23:159–179. doi: 10.1300/j077v23n02_10. [DOI] [PubMed] [Google Scholar]
- 5.Moynihan C, Bliss JM, Davidson J, et al. Evaluation of adjuvant psychological therapy in patients with testicular cancer: Randomised controlled trial. BMJ. 1998;316:429–435. doi: 10.1136/bmj.316.7129.429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cunningham AJ, Edmonds CV, Hampson AW, et al. A group psychoeducational program to help cancer patients cope with and combat their disease. Adv J Mind Body Health. 1991;7:41–56. [Google Scholar]
- 7.Rawl SM, Given BA, Given CW, et al. Intervention to improve psychological functioning for newly diagnosed patients with cancer. Oncol Nurs Forum. 2002;29:967–975. doi: 10.1188/02.ONF.967-975. [DOI] [PubMed] [Google Scholar]
- 8.Edgar L, Rosberger Z, Collet JP. Lessons learned: Outcomes and methodology of a coping skills intervention trial comparing individual and group formats for patients with cancer. Int J Psychiatry Med. 2001;31:289–304. doi: 10.2190/U0P3-5VPV-YXKF-GRG1. [DOI] [PubMed] [Google Scholar]
- 9.Goodwin PJ, Leszcz M, Ennis M, et al. The effect of group psychosocial support on survival in metastatic breast cancer. N Engl J Med. 2001;345:1719–1726. doi: 10.1056/NEJMoa011871. [DOI] [PubMed] [Google Scholar]
- 10.Goodwin PJ, Leszcz M, Quirt G, et al. Lessons learned from enrollment in the BEST study--a multicenter, randomized trial of group psychosocial support in metastatic breast cancer. J Clin Epidemio. 2000;53:47–55. doi: 10.1016/s0895-4356(99)00148-1. [DOI] [PubMed] [Google Scholar]
- 11.Perez MA. Prostate cancer patients and their partners: Effectiveness of a brief communication enhancement intervention prior to undergoing radical prostatectomy. DAI. 2000;62:113. [Google Scholar]
- 12.Buss MK, DuBenske LL, Dinauer S, et al. Patient/caregiver influences for declining participation in supportive oncology trials. J Support Oncol. 2008;6:168–174. [PubMed] [Google Scholar]
- 13.Carlsson ME, Strang PM. Educational support programme for gynaecological cancer patients and their families. Acta Oncol. 1998;37:269–275. doi: 10.1080/028418698429577. [DOI] [PubMed] [Google Scholar]
- 14.Mills EJ, Seely D, Rachlis B, et al. Barriers to participation in clinical trials of cancer: a meta-analysis and systematic review of patient-reported factors. Lancet Oncol. 2006;7:141–148. doi: 10.1016/S1470-2045(06)70576-9. [DOI] [PubMed] [Google Scholar]
- 15.Kraemer HC, Kuchler T, Spiegel D. Use and misuse of the consolidated standards of reporting trials (CONSORT) guidelines to assess research findings: Comment on Coyne, Stefanek, and Palmer (2007) Psychol Bull. 2009;135:173–178. doi: 10.1037/0033-2909.135.2.173. [DOI] [PubMed] [Google Scholar]
- 16.Levine EG, Eckhardt J, Targ E. Change in post-traumatic stress symptoms following psychosocial treatment for breast cancer. Psychooncology. 2005;14:618–635. doi: 10.1002/pon.882. [DOI] [PubMed] [Google Scholar]
- 17.Edelman S, Bell DR, Kidman AD. A group cognitive behaviour therapy programme with metastatic breast cancer patients. Psychooncology. 1999;8:295–305. doi: 10.1002/(SICI)1099-1611(199907/08)8:4<295::AID-PON386>3.0.CO;2-Y. [DOI] [PubMed] [Google Scholar]
- 18.Edmonds CV, Lockwood GA, Cunningham AJ. Psychological response to long-term group therapy: a randomized trial with metastatic breast cancer patients. Psychooncology. 1999;8:74–91. doi: 10.1002/(SICI)1099-1611(199901/02)8:1<74::AID-PON339>3.0.CO;2-K. [DOI] [PubMed] [Google Scholar]
- 19.Baider L, Peretz T, Hadani PE, et al. Psychological intervention in cancer patients: a randomized study. Gen Hosp Psychiatry. 2001;23:272–277. doi: 10.1016/s0163-8343(01)00158-x. [DOI] [PubMed] [Google Scholar]
- 20.Cook T, Campbell DT. Quasi-experimentation: Design and analysis issues for field settings. Chicago, IL: Rand McNally; 1979. [Google Scholar]
- 21.Shapiro SL, Figueredo AJ, Caspi O, et al. Going quasi: the premature disclosure effect in a randomized clinical trial. J Behav Med. 2002;25:605–621. doi: 10.1023/a:1020693417427. [DOI] [PubMed] [Google Scholar]
- 22.Berglund G, Bolund C, Gustafsson UL, et al. Is the wish to participate in a cancer rehabilitation program an indicator of the need? Comparisons of participants and non-participants in a randomized study. Psychooncology. 1997;6:35–46. doi: 10.1002/(SICI)1099-1611(199703)6:1<35::AID-PON241>3.0.CO;2-J. [DOI] [PubMed] [Google Scholar]
- 23.Larson MR, Duberstein PR, Talbot NL, et al. A presurgical psychosocial intervention for breast cancer patients. psychological distress and the immune response. J Psychosom Res. 2000;48:187–194. doi: 10.1016/s0022-3999(99)00110-5. [DOI] [PubMed] [Google Scholar]
- 24.Pickett M, Mock V, Ropka ME, et al. Adherence to moderate-intensity exercise during breast cancer therapy. Cancer Pract. 2002;10:284–292. doi: 10.1046/j.1523-5394.2002.106006.x. [DOI] [PubMed] [Google Scholar]
- 25.Courneya KS, Friedenreich CM, Sela RA, et al. The group psychotherapy and home-based physical exercise (group-hope) trial in cancer survivors: Physical fitness and quality of life outcomes. Psychooncology. 2003;12:357–374. doi: 10.1002/pon.658. [DOI] [PubMed] [Google Scholar]
- 26.Mock V, Frangakis C, Davidson NE, et al. Exercise manages fatigue during breast cancer treatment: A randomized controlled trial. Psychooncology. 2005;14:464–477. doi: 10.1002/pon.863. [DOI] [PubMed] [Google Scholar]
- 27.Targ EF, Levine EG. The efficacy of a mind-body-spirit group for women with breast cancer: A randomized controlled trial. Gen Hosp Psychiatry. 2002;24:238–248. doi: 10.1016/s0163-8343(02)00191-3. [DOI] [PubMed] [Google Scholar]
- 28.Kobulnicky CJH. The behavioral impact of teaching patients to monitor side effects of chemotherapy: An intervention study. DAI. 2002;63:347. [Google Scholar]
- 29.Kolcaba K, Fox C. The effects of guided imagery on comfort of women with early stage breast cancer undergoing radiation therapy. Oncol Nurs Forum. 1999;26:67–72. [PubMed] [Google Scholar]
- 30.Stanton AL, Ganz PA, Kwan L, et al. Outcomes from the moving beyond cancer psychoeducational, randomized, controlled trial with breast cancer patients. J Clin Oncol. 2005;23:6009–6018. doi: 10.1200/JCO.2005.09.101. [DOI] [PubMed] [Google Scholar]
- 31.Kuchler T, Henne-Bruns D, Rappat S, et al. Impact of psychotherapeutic support on gastrointestinal cancer patients undergoing surgery: Survival results of a trial. Hepatogastroenterology. 1999;46:322–335. [PubMed] [Google Scholar]
- 32.Swearingen CE, Moyer A, Finney JW. Alcohol treatment outcome studies, 1970–1998: An expanded look at the nature of the research. Addict Behav. 2002;27:1–23. doi: 10.1016/s0306-4603(01)00251-9. [DOI] [PubMed] [Google Scholar]
- 33.Burton MV, Parker RW. A randomized control trial of preoperative psychology preparation for mastectomy. Psychooncology. 1995;4:1–19. [Google Scholar]
- 34.Burton MV, Parker RW, Wollner JM. The psychotherapeutic value of a 'chat': A verbal response modes study of a placebo attention control with breast cancer patients. Psychother Research. 1991;1:39–61. [Google Scholar]
- 35.Pruitt BT, Waligora-Serafin B, McMahon T, et al. An educational intervention for newly-diagnosed cancer patients undergoing radiotheraphy. Psychooncology. 1993;2:55–62. [Google Scholar]
- 36.Helgeson VS, Cohen S. Social support and adjustment to cancer: reconciling descriptive, correlational, and intervention research. Health Psychol. 1996;15:135–148. doi: 10.1037//0278-6133.15.2.135. [DOI] [PubMed] [Google Scholar]
- 37.Edmonds CVI. A randomized study assessing the psychological effects of a longterm psychological intervention on metastatic breast cancer patients. DAI. 1997;58:305. [Google Scholar]
- 38.Cunningham AJ, Edmonds CV, Jenkins GP, et al. A randomized controlled trial of the effects of group psychological therapy on survival in women with metastatic breast cancer. Psychooncology. 1998;7:508–517. doi: 10.1002/(SICI)1099-1611(199811/12)7:6<508::AID-PON376>3.0.CO;2-7. [DOI] [PubMed] [Google Scholar]
- 39.Cunningham AJ, Edmonds CV, Phillips C, et al. A prospective, longitudinal study of the relationship of psychological work to duration of survival in patients with metastatic cancer. Psychooncology. 2000;9:323–339. doi: 10.1002/1099-1611(200007/08)9:4<323::aid-pon465>3.0.co;2-b. [DOI] [PubMed] [Google Scholar]
- 40.Shaw BR. The functions and influence of insightful disclosure within computer-mediated support groups on women with breast cancer. DAI. 2000;61:156. doi: 10.1207/s15327027hc1902_5. [DOI] [PubMed] [Google Scholar]
- 41.Courneya KS, Friedenreich CM, Sela RA, et al. Correlates of adherence and contamination in a randomized controlled trial of exercise in cancer survivors: an application of the theory of planned behavior and the five factor model of personality. Ann Behav Med. 2002;24:257–268. doi: 10.1207/S15324796ABM2404_02. [DOI] [PubMed] [Google Scholar]
- 42.Coward DD. Facilitation of self-transcendence in a breast cancer support group: II. Oncol Nurs Forum. 2003;30:291–300. doi: 10.1188/03.ONF.291-300. [DOI] [PubMed] [Google Scholar]
- 43.Kramer MM. The effects of exercise on psychological well-being in women recovering from breast cancer. DAI. 1996;57(03B):101. [Google Scholar]
- 44.Spiegel D, Morrow GR, Classen C, et al. Group psychotherapy for recently diagnosed breast cancer patients: a multicenter feasibility study. Psychooncology. 1999;8:482–493. doi: 10.1002/(sici)1099-1611(199911/12)8:6<482::aid-pon402>3.0.co;2-w. [DOI] [PubMed] [Google Scholar]
- 45.Wenzel LB. Coping with illness-related stress during recovery from early-stage gynecologic cancer. DAI. 1988;50:154. [Google Scholar]
- 46.Kissane DW, Bloch S, Smith GC, et al. Cognitive-existential group psychotherapy for women with primary breast cancer: a randomised controlled trial. Psychooncology. 2003;12:532–546. doi: 10.1002/pon.683. [DOI] [PubMed] [Google Scholar]
- 47.Olson K, Hanson J, Michaud M. A phase II trial of Reiki for the management of pain in advanced cancer patients. J Pain Symptom Manage. 2003;26:990–997. doi: 10.1016/s0885-3924(03)00334-8. [DOI] [PubMed] [Google Scholar]
- 48.Golant M, Altman T, Martin C. Managing cancer side effects to improve quality of life: a cancer psychoeducation program. Cancer Nurs. 2003;26:37–44. doi: 10.1097/00002820-200302000-00005. [DOI] [PubMed] [Google Scholar]
- 49.Ganz PA, Greendale GA, Petersen L, et al. Managing menopausal symptoms in breast cancer survivors: results of a randomized controlled trial. J Natl Cancer Inst. 2000;92:1054–1064. doi: 10.1093/jnci/92.13.1054. [DOI] [PubMed] [Google Scholar]
- 50.Durak EP, Lilly PC, Hackworth JL. Physical and psychosocial responses to exercise in cancer patients: A two year follow up survey with prostate, leukemia, and general carconima. J Exercise Physiol Online. 1999;2 [Google Scholar]
- 51.Coleman EA, Tulman L, Samarel N, et al. The effect of telephone social support and education on adaptation to breast cancer during the year following diagnosis. Oncol Nurs Forum. 2005;32:822–829. doi: 10.1188/05.onf.822-829. [DOI] [PubMed] [Google Scholar]
- 52.Cohen L, Warneke C, Fouladi RT, et al. Psychological adjustment and sleep quality in a randomized trial of the effects of a Tibetan yoga intervention in patients with lymphoma. Cancer. 2004;100:2253–2260. doi: 10.1002/cncr.20236. [DOI] [PubMed] [Google Scholar]
- 53.Collinge WB. Effects of a complementary cancer therapy program on coping and quality of life. DAI. 1987;49:148. [Google Scholar]
- 54.Ward S, Donovan HS, Owen B, et al. An individualized intervention to overcome patient-related barriers to pain management in women with gynecologic cancers. Res Nurs Health. 2000;23:393–405. doi: 10.1002/1098-240x(200010)23:5<393::aid-nur6>3.0.co;2-o. [DOI] [PubMed] [Google Scholar]
- 55.Angell KL, Kreshka MA, McCoy R, et al. Psychosocial intervention for rural women with breast cancer: The Sierra-Stanford Partnership. J Gen Intern Med. 2003;18:499–507. doi: 10.1046/j.1525-1497.2003.20316.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Bruera E, Pituskin E, Calder K. The addition of an audiocassette recording of a consultation to written recommendations for patients with advanced cancer: A randomized, controlled trial. Cancer. 1999;86:2420–2425. [PubMed] [Google Scholar]
- 57.Heiney SP, McWayne J, Hurley TG, et al. Efficacy of therapeutic group by telephone for women with breast cancer. Cancer Nurs. 2003;26:439–447. doi: 10.1097/00002820-200312000-00003. [DOI] [PubMed] [Google Scholar]
- 58.Young-McCaughan S, Mays MZ, Arzola SM, et al. Research and commentary: Change in exercise tolerance, activity and sleep patterns, and quality of life in patients with cancer participating in a structured exercise program. Oncol Nurs Forum. 2003;30:441–454. doi: 10.1188/03.ONF.441-454. [DOI] [PubMed] [Google Scholar]
- 59.Lieberman MA, Golant M, Giese-Davis J, et al. Electronic support groups for breast carcinoma: a clinical trial of effectiveness. Cancer. 2003;97:920–925. doi: 10.1002/cncr.11145. [DOI] [PubMed] [Google Scholar]
- 60.Fawzy FI, Cousins N, Fawzy NW, Kemeny ME. A structured psychiatric intervention for cancer patients: I. Changes over time in methods of coping and affective disturbance. Arch Gen Psychiatry. 1990;47:720–725. doi: 10.1001/archpsyc.1990.01810200028004. [DOI] [PubMed] [Google Scholar]
- 61.Ritz LJ, Nissen MJ, Swenson KK, et al. Effects of advanced nursing care on quality of life and cost outcomes of women diagnosed with breast cancer. Oncol Nurs Forum. 2000;27:923–932. [PubMed] [Google Scholar]
- 62.Ross L, Thomsen BL, Boesen EH, Johansen C. In a randomized controlled trial, missing data led to biased results regarding anxiety. J Clin Epidemiol. 2004;57:1131–1137. doi: 10.1016/j.jclinepi.2004.03.010. [DOI] [PubMed] [Google Scholar]
- 63.Ross L, Thomsen BL, Karlsen RV, et al. A randomized psychosocial intervention study on the effect of home visits on the well-being of Danish colorectal cancer patients-the INCA project. Psychooncology. 2005;14:949–961. doi: 10.1002/pon.899. [DOI] [PubMed] [Google Scholar]
- 64.Wortman CB, Dunkel-Schetter C. Interpersonal relationships and cancer: A theoretical analysis. J Soc Issues. 1979;35:120–155. [Google Scholar]
- 65.Vugia HD. Support groups in oncology: Building hope through the human bond. J Psychosoc Oncol. 1991;9:89–107. [Google Scholar]
- 66.Gottlieb BH, Wachala ED. Cancer support groups: a critical review of empirical studies. Psychooncology. 2007;16:379–400. doi: 10.1002/pon.1078. [DOI] [PubMed] [Google Scholar]
- 67.Butler LD, Koopman C, Cordova MJ, et al. Psychological distress and pain significantly increase before death in metastatic breast cancer patients. Psychosom Med. 2003;65:416–426. doi: 10.1097/01.psy.0000041472.77692.c6. [DOI] [PubMed] [Google Scholar]
- 68.Whitehead WE. Control groups appropriate for behavioral interventions. Gastroenterology. 2004;126 Suppl 1:S159–S163. doi: 10.1053/j.gastro.2003.10.038. [DOI] [PubMed] [Google Scholar]
- 69.Quinn GP, Bell BA, Bell MY, et al. The guinea pig syndrome: improving clinical trial participation among thoracic patients. J Thorac Oncol. 2007;2:191–196. doi: 10.1097/JTO.0b013e318031cdb6. [DOI] [PubMed] [Google Scholar]
- 70.Quinn GP, Bell-Ellison BA, Bell MY, et al. A message of hope: creation of the Faces of Lung Cancer project for increasing awareness of clinical trials. Eur J Cancer Care (Engl) 2008 Nov;17:601–610. doi: 10.1111/j.1365-2354.2007.00919.x. [DOI] [PubMed] [Google Scholar]
- 71.Mapstone J, Elbourne D, Roberts I. Strategies to improve recruitment to research studies. Cochrane Database Syst Rev. 2007 doi: 10.1002/14651858.MR000013.pub3. MR000013. [DOI] [PubMed] [Google Scholar]
- 72.Taylor KL, Lamdan RM, Siegel JE, et al. Psychological adjustment among African American breast cancer patients: one-year follow-up results of a randomized psychoeducational group intervention. Health Psychol. 2003;22:316–323. doi: 10.1037/0278-6133.22.3.316. [DOI] [PubMed] [Google Scholar]
- 73.Kaufman D, Murphy J, Scott J, Hudson K. Subjects matter: a survey of public opinions about a large genetic cohort study. Genet Med. 2008;10:831–839. doi: 10.1097/GIM.0b013e31818bb3ab. [DOI] [PubMed] [Google Scholar]
- 74.Festinger DS, Marlowe DB, Dugosh KL, et al. Higher magnitude cash payments improve research follow-up rates without increasing drug use or perceived coercion. Drug Alcohol Depend. 2008;96:128–135. doi: 10.1016/j.drugalcdep.2008.02.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Courneya KS, McKenzie DC, Mackey JR, et al. Moderators of the effects of exercise training in breast cancer patients receiving chemotherapy: a randomized controlled trial. Cancer. 2008;112:1845–1853. doi: 10.1002/cncr.23379. [DOI] [PubMed] [Google Scholar]
- 76.Goldberg JH, Kiernan M. Innovative techniques to address retention in a behavioral weight-loss trial. Health Ed Res. 2005;20:439–447. doi: 10.1093/her/cyg139. [DOI] [PubMed] [Google Scholar]
- 77.Long Q, Little RJ, Lin X. Causal inference in hybrid intervention trials involving choice. J Am Stat Assoc. 2008;103:474–484. [Google Scholar]
- 78.Janevic MR, Janz NK, Dodge JA, et al. The role of choice in health education intervention trials: A review and case study. Soc Sci Medicine. 2003;56:1581–1592. doi: 10.1016/s0277-9536(02)00158-2. [DOI] [PubMed] [Google Scholar]
- 79.Rücker G. A two-stage trial design for testing treatment, self-selection and treatment preference effects. Stat Med. 1989;8:477–485. doi: 10.1002/sim.4780080411. [DOI] [PubMed] [Google Scholar]
- 80.TenHave TR, Coyne J, Salzer M, Katz I. Research to improve the quality of care for depression: alternatives to the simple randomized clinical trial. Gen HospPsychiatry. 2003;25:115–123. doi: 10.1016/s0163-8343(02)00275-x. [DOI] [PubMed] [Google Scholar]
- 81.Wennberg JE, Barry MJ, Fowler FJ, et al. Outcomes research, PORTs, and health care reform. Ann N Y Acad Sci. 1993;703:52–62. doi: 10.1111/j.1749-6632.1993.tb26335.x. [DOI] [PubMed] [Google Scholar]
- 82.Institute of Medicine. Cancer care for the whole patient. Washington, DC: The National Academies Press; 2008. [Google Scholar]
- 83.California Breast Cancer Research Program. Community collaboration. [Accessed March 19, 2009]; Available at: http://www.cbcrp.org/community/index.php.
- 84.National Institutes of Health. Part I Overview. [Accessed March 19, 2009]; Available at: http://grants.nih.gov/grants/guide/rfa-files/RFA-MD-07-003.html.
- 85.Ribisl KM, Walton MA, Mowbray CT, et al. Minimizing participant attrition in panel studies through the use of effective retention and tracking strategies: Review and recommendations. Eval Program Plann. 1996;19:1–25. 1996. [Google Scholar]
- 86.Sherman AC, Pennington J, Latif U, et al. Patient preferences regarding cancer group psychotherapy interventions: a view from the inside. Psychosomatics. 2007;48:426–432. doi: 10.1176/appi.psy.48.5.426. [DOI] [PubMed] [Google Scholar]
- 87.Francis D, Roberts I, Elbourne DR, et al. Marketing and clinical trials: a case study. Trials. 2007;8:37. doi: 10.1186/1745-6215-8-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Kovacs AH. The design and evaluation of a brief intervention to enhance well-being among women with breast cancer completing chemotherapy. DAI. 2003;64:76. [Google Scholar]
- 89.Ong LM, Visser MR, Lammes FB, et al. Effect of providing cancer patients with the audiotaped initial consultation on satisfaction, recall, and quality of life: A randomized, double-blind study. J Clin Oncol. 2000;18:3052–3060. doi: 10.1200/JCO.2000.18.16.3052. [DOI] [PubMed] [Google Scholar]
- 90.Eardley A. Patients' worries about radiotherapy: Evaluation of a preparatory booklet. Psychol Health. 1988;2:79–89. 1988. [Google Scholar]
- 91.Lebel S, Rosberger Z, Edgar L, Devins GM. Predicting stress-related problems in long-term breast cancer survivors. J Psychosom Res. 2008;65:513–523. doi: 10.1016/j.jpsychores.2008.07.018. [DOI] [PubMed] [Google Scholar]
- 92.Hart T, Fann JR, Novack TA. The dilemma of the control condition in experience-based cognitive and behavioural treatment research. Neuropsychological Rehabilitation. 2008;18:1–21. doi: 10.1080/09602010601082359. [DOI] [PubMed] [Google Scholar]
- 93.Moyer A. Psychomethodology: The psychology of human participation in science. J Psychol Sci Technol. in press. [Google Scholar]
- 94.Campbell MK, Snowdon C, Francis D, et al. Recruitment to randomised trials: strategies for trial enrollment and participation study. The STEPS study. Health Technol Assess. 2007;11 doi: 10.3310/hta11480. iii, ix-105. [DOI] [PubMed] [Google Scholar]