Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2017 Oct 1.
Published in final edited form as: J Oncol Pract. 2016 Oct;12(10):859–862. doi: 10.1200/JOP.2016.015610

Implementation of Symptom Questionnaires Into Oncology Workflow

Angela M Stover 1, Ethan M Basch 1
PMCID: PMC5508563  NIHMSID: NIHMS873971  PMID: 27601508

Treatment-related symptoms are common among patients with metastatic cancer and can result in distress, decrements in physical function, and unplanned hospitalizations.1,2 Symptom management is a cornerstone of clinical practice, and both symptom management and quality of life are consistently among the highest priorities to patients with cancer and their caregivers.3,4 Typically, clinicians elicit symptom information at clinic visits through unstructured discussions. However, with this approach, care teams do not detect burdensome symptoms up to one half of the time, and clinicians’ symptom ratings have low reliability.57 Under detection of symptoms occurs for several reasons. Visits with clinicians may be too infrequent or too short to adequately capture symptom burden. Patients may have trouble recalling how frequent or burdensome their symptoms have been in between visits due to recall bias.8,9 Communication between clinicians and patients may be hampered by status and educational differences, language barriers, expectations about clinical encounters, lack of trust, not feeling well, and more.10,11

One solution is to systematically screen for symptoms between visits by asking patients to complete weekly patient-reported outcome (PRO) measures about their pain, nausea, and other symptoms. PRO measures are the preferred approach for assessing symptoms across health care contexts because patients are in the best position to report on their own experiences and because PROs provide a more comprehensive understanding of those experiences.12 Routine use of PROs has been identified as a priority area by the President’s Cancer Panel and national oncology societies such as ASCO.13,14 However, health care systems lack roadmaps for how to change multiple system levels and infrastructures to integrate PRO measures into clinical workflow, which is an implementation problem. Thus, a critical need exists for comprehensive implementation strategies that address barriers and strengthen facilitators unique to each health care system.

A growing body of evidence shows that the collection of PRO measures from patients and their review during visits yield better clinical outcomes. For example, use of symptom questionnaires increases communication between clinicians and patients, detection of problematic symptoms, and satisfaction with care.1518 In a single-site randomized trial in the United States, > 700 patients who underwent chemotherapy were randomly assigned to complete weekly Web-based symptom questionnaires versus usual care. Patients in the intervention group who systematically completed symptom questionnaires were more likely to be alive at 1 year, were able to continue with treatment longer, and had fewer emergency department visits.19 Treating physicians received symptom reports at visits, and nurses received e-mail alerts when patients reported a worsening of 12 common symptoms (ie, predetermined clinical criteria were met). The PRO intervention showed the greatest benefits for patients with lower education and less computer experience,19 which suggests that health disparities could be reduced with PRO integration into clinical workflow.

A second phase III randomized trial in Europe was closed early for clear survival benefit for the intervention group, which completed weekly symptom questionnaires. At multiple sites, patients with metastatic lung cancer randomly assigned to complete weekly symptom questionnaires had a mean survival time of 19 months versus 12 months in usual care patients.20 Similar benefits have been shown in other randomized trials.2124 The probable mechanism at work is that clinicians were made aware of symptom increases sooner and could then intervene earlier to avoid adverse and costly outcomes.

As more trials demonstrate efficacy and the idea of patient-centered care matures,25,26 incorporation of symptom questionnaires into routine clinical workflow will become increasingly important for health care systems. Every US health care system faces this issue as the Centers for Medicare & Medicaid Services Electronic Health Record Incentive Program’s meaningful use requirements continue to increase annually.27 National (and international) oncology societies, federal agencies, and individual health care systems have a major opportunity to plan and implement a rollout of system-level changes over the next 5 years to ensure that PROs are integrated into routine clinical workflow. This may require an evolution of organizational culture to emphasize the importance of PROs and adaption of electronic health record systems.

National oncology and PRO methodology societies and federal agencies have published recommendations for questionnaire implementation, but no comprehensive plans have been put forward. For instance, the International Society of Quality of Life Research28 and Snyder et al29 outlined a series of starter questions that health care systems can use to self-assess their unique needs for PRO implementation planning. Similarly, the Department of Veterans Affairs has several recommendations for designing applications to capture patient-generated data to enhance patient-clinician partnerships, including health system culture, data value, architecture, policy, data standards, clinical workflow, data visualization, and analytics and population reach.30

The National Cancer Institute recommends that the following 12 common symptoms be assessed across cancer types during clinical trials: fatigue, insomnia, pain, anxiety (includes worry), depression (includes sadness),anorexia (appetite loss), nausea, constipation, diarrhea, dyspnea, cognitive problems, and sensory neuropathy.31 The idea is that practices can assess common symptoms and decide on additional PRO areas relevant for each cancer type.32,33 For instance, bladder and bowel issues are relevant in prostate and colorectal cancer but less relevant in breast cancer. At least one systematic review is needed that identifies all PRO and quality-of-life measures (general and disease specific) and then provides a menu of the best-performing scales in oncology practice. Oncology societies and federal agencies then can provide guidance on how to choose PRO measures so that results are comparable across health care systems.

This collection of recommendations is an excellent start to implementation planning, but more work that focuses on systems-level changes is needed. A newer field, implementation science, can guide societies, agencies, and health care systems to start to think through solutions to the system barriers they will face.3436 Implementation strategies typically encompass six key stages: planning, educating, financing, restructuring, managing quality, and attending to the policy context.37 For the planning and educating stages, the involvement of all potential stakeholders, including patients, clinicians, practice staff, decision makers, quality officers, financial officers, informaticians, PRO methodologists, health services and researchers, will be critical. Health care innovation changes typically take 2 to 4 years for full implementation38; thus, planning should start early. Research on multidisciplinary teams with skill sets in clinical care, informatics, PRO methodology, and implementation science is needed to develop and evaluate comprehensive implementation plans that are sustainable.

Broad-level guidance is needed from societies and federal agencies, but each health care system and practice will need tailored implementation strategies that fit their unique needs. Implementation measures for health care have advanced significantly over the past 20 years.3942 Interdisciplinary research teams will be able to map implementation process and outcome measures to the challenges specific to PRO integration. More useful results will be obtained if research teams evaluate implementation strategies simultaneously at multiple levels (eg, patient, provider, care team workflow, medical record system) rather than treat them as separate interventions.42 In 6 to 8 years, this new field should be ready to develop cluster randomized trials with head-to-head comparisons of various implementation strategies to examine what works best in which context and for whom.

Three final issues that health care systems and research teams will need to consider are flexible workflows that allow for future change, the training of care team members on how to use PRO measures, and reduction of clinician burden. The idea of learning health care systems is that they continually improve processes as more data emerge from within the health care system itself and as national guidelines are updated for high-quality cancer are.43 In other words, health care systems need to not only learn implementation strategies but also be flexible enough to de-adopt low-value clinical procedures that are no longer recommended or do not perform well in some contexts.44 A key piece to flexible workflows is the training of clinicians and staff on how to interpret PRO results for the specific questionnaires chosen and the best ways to discuss results with patients. PRO training could be incorporated into existing training needs, such as the Commission on Cancer’s training recommendation for interpreting psychosocial distress measures.45 This is one area where oncology societies could make a big difference in ensuring high-quality training in PRO measures for clinical practice.

The redesign of clinical workflow also allows the opportunity to consider pieces that are no longer relevant in favor of adding PRO implementation. For example, clinicians spend a considerable amount of time in documenting quality performance measures.46 A lesser known benefit of integrating PRO measures into clinical workflow is that PRO results could be quality metrics in and of themselves.47,48 For example, similar practices could be compared on the percentage of patients who receive chemotherapy who report moderate to high pain.4648 In this case, clinicians may be able to reduce performance metric documentation because PRO results would be available for practice comparisons. An emerging research issue in this area is which variables to adjust for to ensure fair comparisons (case-mix and risk adjustment).48

In summary, five key areas should be considered for comprehensive implementation planning of PRO integration into health care systems:

  • A menu of implementation strategies that overcomes not only barriers that most systems face but also barriers and facilitators unique to each system;

  • Multidisciplinary teams with all potential stakeholders represented during the planning and educating stages to ensure sustainability;

  • Flexible workflows that allow for future implementation and de-adoption of low-quality care;

  • Careful consideration about the best ways to reduce burden on clinicians when changing workflow; and

  • Training for clinicians and staff on PRO interpretation and how to discuss results with patients.

Acknowledgments

The production of this manuscript was funded by the Conquer Cancer Foundation Mission Endowment. Supported by Grant No. R25-CA116339 from the Cancer Care Quality Training Program and Grant No. R25-CA171994 from the Mentored Training in Dissemination and Implementation in Cancer project. We thank Leah Zullig, David Chambers, and Ramzi Salloum for reading a prior draft.

Footnotes

Authors’ Disclosures of Potential Conflicts of Interest

Disclosures provided by the authors are available with this article at jop.ascopubs.org.

Implementation of Symptom Questionnaires Into Oncology Workflow

The following represents disclosure information provided by authors of this manuscript. All relationships are considered compensated. Relationships are self-held unless noted. I = Immediate Family Member, Inst = My Institution. Relationships may not relate to the subject matter of this manuscript. For more information about ASCO’s conflict of interest policy, please refer to www.asco.org/rwc or jop.ascopubs.org/site/misc/ifc.xhtml.

Angela M. Stover

No relationship to disclose

Ethan M. Basch

No relationship to disclose

References

  • 1.Henry DH, Viswanathan HN, Elkin EP, et al. Symptoms and treatment burden associated with cancer treatment: Results from a cross-sectional national survey in the U.S. Support Care Cancer. 2008;16:791–801. doi: 10.1007/s00520-007-0380-2. [DOI] [PubMed] [Google Scholar]
  • 2.Cleeland CS, Zhao F, Chang VT, et al. The symptom burden of cancer: Evidence for a core set of cancer-related and treatment-related symptoms from the Eastern Cooperative Oncology Group Symptom Outcomes and Practice Patterns study. Cancer. 2013;119:4333–4340. doi: 10.1002/cncr.28376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Butt Z, Rosenbloom SK, Abernethy AP, et al. Fatigue is the most important symptom for advanced cancer patients who have had chemotherapy. J Natl Compr Canc Netw. 2008;6:448–455. doi: 10.6004/jnccn.2008.0036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Steinhauser KE, Christakis NA, Clipp EC, et al. Factors considered important at the end of life by patients, family, physicians, and other care providers. JAMA. 2000;284:2476–2482. doi: 10.1001/jama.284.19.2476. [DOI] [PubMed] [Google Scholar]
  • 5.Fromme EK, Eilers KM, Mori M, et al. How accurate is clinician reporting of chemotherapy adverse effects? A comparison with patient-reported symptoms from the Quality-of-Life Questionnaire C30. J Clin Oncol. 2004;22:3485–3490. doi: 10.1200/JCO.2004.03.025. [DOI] [PubMed] [Google Scholar]
  • 6.Laugsand EA, Sprangers MA, Bjordal K, et al. Health care providers underestimate symptom intensities of cancer patients: A multicenter European study. Health Qual Life Outcomes. 2010;8:104. doi: 10.1186/1477-7525-8-104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Atkinson TM, Li Y, Coffey CW, et al. Reliability of adverse symptom event reporting by clinicians. Qual Life Res. 2012;21:1159–1164. doi: 10.1007/s11136-011-0031-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Litwin MS, McGuigan KA. Accuracy of recall in health-related quality-of-life assessment among men treated for prostate cancer. J Clin Oncol. 1999;17:2882–2888. doi: 10.1200/JCO.1999.17.9.2882. [DOI] [PubMed] [Google Scholar]
  • 9.Taminiau-Bloem EF, Van Zuuren FJ, Visser MRM, et al. Opening the black box of cancer patients’ quality-of-life change assessments: A think-aloud study examining the cognitive processes underlying responses to transition items. Psychol Health. 2011;26:1414–1428. doi: 10.1080/08870446.2011.596203. [DOI] [PubMed] [Google Scholar]
  • 10.Rodin G, Mackay JA, Zimmermann C, et al. Clinician-patient communication: A systematic review. Support Care Cancer. 2009;17:627–644. doi: 10.1007/s00520-009-0601-y. [DOI] [PubMed] [Google Scholar]
  • 11.Epstein RM, Street RL., Jr . Patient-Centered Communication in Cancer Care: Promoting Healing and Reducing Suffering. Bethesda, MD: National Cancer Institute; 2007. (NIH Publication No. 07-6225). [Google Scholar]
  • 12.National Comprehensive Cancer Network. NCCN guidelines for supportive care. http://www.nccn.org/professionals/physician_gls/f_guidelines.asp#supportive.
  • 13.President’s Cancer Panel. Connected Health: Improving Patients’ Engagement and Activation for Cancer-Related Outcomes: President’s Cancer Panel 2014–2015 Series. http://deainfo.nci.nih.gov/advisory/pcp/glance/ConnectedHealth14–15.pdf.
  • 14.Basch E, Snyder C, McNiff K, et al. Patient-reported outcome performance measures in oncology. J Oncol Pract. 2014;10:209–211. doi: 10.1200/JOP.2014.001423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Howell D, Molloy S, Wilkinson K, et al. Patient-reported outcomes in routine cancer clinical practice: A scoping review of use, impact on health outcomes, and implementation factors. Ann Oncol. 2015;26:1846–1858. doi: 10.1093/annonc/mdv181. [DOI] [PubMed] [Google Scholar]
  • 16.Valderas JM, Kotzeva A, Espallargues M, et al. The impact of measuring patient-reported outcomes in clinical practice: A systematic review of the literature. Qual Life Res. 2008;17:179–193. doi: 10.1007/s11136-007-9295-0. [DOI] [PubMed] [Google Scholar]
  • 17.Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13:211. doi: 10.1186/1472-6963-13-211. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Kotronoulas G, Kearney N, Maguire R, et al. What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. J Clin Oncol. 2014;32:1480–1501. doi: 10.1200/JCO.2013.53.5948. [DOI] [PubMed] [Google Scholar]
  • 19.Basch E, Deal AM, Kris MG, et al. Symptom monitoring with patient-reported outcomes during routine cancer treatment: A randomized controlled trial. J Clin Oncol. 2016;34:557–565. doi: 10.1200/JCO.2015.63.0830. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Denis F, Lethrosne C, Pourel N, et al. Overall survival in patients with lung cancer using a Web-application–guided follow-up compared to standard modalities: Results of phase III randomized trial. J Clin Oncol. 2016;34(suppl) abstr LBA9006. [Google Scholar]
  • 21.Velikova G, Booth L, Smith AB, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: A randomized controlled trial. J Clin Oncol. 2004;22:714–724. doi: 10.1200/JCO.2004.06.078. [DOI] [PubMed] [Google Scholar]
  • 22.Detmar SB, Muller MJ, Schornagel JH, et al. Health-related quality-of-life assessments and patient-physician communication: A randomized controlled trial. JAMA. 2002;288:3027–3034. doi: 10.1001/jama.288.23.3027. [DOI] [PubMed] [Google Scholar]
  • 23.Cleeland CS, Wang XS, Shi Q, et al. Automated symptom alerts reduce postoperative symptom severity after cancer surgery: A randomized controlled clinical trial. J Clin Oncol. 2011;29:994–1000. doi: 10.1200/JCO.2010.29.8315. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Berry DL, Blumenstein BA, Halpenny B, et al. Enhancing patient-provider communication with the electronic self-report assessment for cancer: A randomized trial. J Clin Oncol. 2011;29:1029–1035. doi: 10.1200/JCO.2010.30.3909. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Committee on Quality of Health Care in America, Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001. [Google Scholar]
  • 26.Rosenzveig A, Kuspinar A, Daskalopoulou SS, et al. Toward patient-centered care: A systematic review of how to ask questions that matter to patients. Medicine (Baltimore) 2014;93:e120. doi: 10.1097/MD.0000000000000120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Centers for Medicare & Medicaid Services. Medicare and Medicaid EHR Incentive Program basics. https://www.cms.gov/regulations-and-guidance/legislation/ehrincentiveprograms/basics.html.
  • 28.Aaronson N, Elliott T, Greenhalgh J, et al. User’s Guide to Implementing Patient-Reported Outcomes Assessment in Clinical Practice. 2015 doi: 10.1007/s11136-011-0054-x. Version 2. http://www.isoqol.org/UserFiles/2015UsersGuide-Version2.pdf. [DOI] [PubMed]
  • 29.Snyder CF, Aaronson NK, Choucair AK, et al. Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Qual Life Res. 2012;21:1305–1314. doi: 10.1007/s11136-011-0054-x. [DOI] [PubMed] [Google Scholar]
  • 30.Woods SS, Evans NC, Frisbee KL. Integrating patient voices into health information for self-care and patient-clinician partnerships: Veterans Affairs design recommendations for patient-generated data applications. J Am Med Inform Assoc. 2016;23:491–495. doi: 10.1093/jamia/ocv199. [DOI] [PubMed] [Google Scholar]
  • 31.Reeve BB, Mitchell SA, Dueck AC, et al. Recommended patient-reported core set of symptoms to measure in adult cancer treatment trials. J Natl Cancer Inst. 2014;106:dju129. doi: 10.1093/jnci/dju129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Chera BS, Eisbruch A, Murphy BA, et al. Recommended patient-reported core set of symptoms to measure in head and neck cancer treatment trials. J Natl Cancer Inst. 2014;106:dju127. doi: 10.1093/jnci/dju127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Chen RC, Chang P, Vetter RJ, et al. Recommended patient-reported core set of symptoms to measure in prostate cancer treatment trials. J Natl Cancer Inst. 2014;106:dju132. doi: 10.1093/jnci/dju132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Flottorp SA, Oxman AD, Krause J, et al. A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35. doi: 10.1186/1748-5908-8-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Brownson RC, Colditz GA, Proctor EK. Dissemination and Implementation Research in Health: Translating Science to Practice. 1. Oxford, UK: Oxford University Press; 2012. [Google Scholar]
  • 36.Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8:22. doi: 10.1186/1748-5908-8-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Powell BJ, McMillen JC, Proctor EK, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–157. doi: 10.1177/1077558711430690. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Grol R, Wensing M, Eccles M, et al. Improving Patient Care: The Implementation of Change in Health Care. New York, NY: Wiley; 2013. [Google Scholar]
  • 39.Rabin BA, Lewis CC, Norton WE, et al. Measurement resources for dissemination and implementation research in health. Implement Sci. 2016;11:42. doi: 10.1186/s13012-016-0401-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Curran GM, Bauer M, Mittman B, et al. Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50:217–226. doi: 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007;28:413–433. doi: 10.1146/annurev.publhealth.28.021406.144145. [DOI] [PubMed] [Google Scholar]
  • 42.Emmons KM, Weiner B, Fernandez ME, et al. Systems antecedents for dissemination and implementation: A review and analysis of measures. Health Educ Behav. 2012;39:87–105. doi: 10.1177/1090198111409748. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Abernethy AP, Ahmad A, Zafar SY, et al. Electronic patient-reported data capture as a foundation of rapid learning cancer care. Med Care. 2010;48:S32–S38. doi: 10.1097/MLR.0b013e3181db53a4. suppl 6. [DOI] [PubMed] [Google Scholar]
  • 44.Niven DJ, Mrklas KJ, Holodinsky JK, et al. Towards understanding the de-adoption of low-value clinical practices: A scoping review. BMC Med. 2015;13:255. doi: 10.1186/s12916-015-0488-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Commission on Cancer. 3.2 – Psychosocial distress screening. Cancer Program Standards: Ensuring Patient-Centered Care (ed 2016) https://www.facs.org/~/media/files/quality%20programs/cancer/coc/2016%20coc%20standards%20manual_interactive%20pdf.ashx.
  • 46.Casalino LP, Gans D, Weber R, et al. US physician practices spend more than $15.4 billion annually to report quality measures. Health Aff (Millwood) 2016;35:401–406. doi: 10.1377/hlthaff.2015.1258. [DOI] [PubMed] [Google Scholar]
  • 47.Basch E, Torda P, Adams K. Standards for patient-reported outcome-based performance measures. JAMA. 2013;310:139–140. doi: 10.1001/jama.2013.6855. [DOI] [PubMed] [Google Scholar]
  • 48.Stover AM, Basch EM. Using patient-reported outcome measures as quality indicators in routine cancer care. Cancer. 2016;122:355–357. doi: 10.1002/cncr.29768. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES