Abstract
Background. Recent data and policy decisions have led to the availability of lung cancer screening (LCS) for individuals who are at increased risk of developing lung cancer. In establishing implementation policies, the US Preventive Services Task Force recommended and the Centers for Medicare and Medicaid Services required that individuals who meet eligibility criteria for LCS receive a patient counseling and shared decision-making consultation prior to LCS. Methods. This study evaluated the potential of a values clarification/preference elicitation exercise and brief educational intervention to reduce decisional conflict regarding LCS. Participants (N = 210) completing a larger online survey responded to a measure of decisional conflict prior to and following administration of a conjoint survey and brief educational narrative about LCS. The conjoint survey included 22 choice sets (two of which were holdout cards), incorporating 5 attributes with 17 levels. Results. Results pertaining to changes in decisional conflict showed that participants reported statistically significantly and clinically meaningful reductions in decisional conflict following administration of the brief educational narrative and conjoint survey across the total score (Δ = 29.30; d = 1.09) and all four decisional conflict subscales: Uncertainty (Δ = 27.75; d = 0.73), Informed (Δ = 35.32; d = 1.11), Values Clarity (Δ = 31.82; d = 0.85), and Support (Δ = 18.78; d = 0.66). Discussion. While the study design precludes differentiating the effects of the brief educational narrative and the conjoint survey, data suggest that these tools offer a reasonable approach to clarifying personal beliefs and perspectives regarding LCS participation. Given the complicated nature of LCS decisions and recent policies advocating informed and shared decision-making approaches, conjoint surveys should be evaluated as one of the tools that could help individuals make choices about LCS participation.
Keywords: conjoint analysis, decision making, lung cancer screening, patient preferences
Results of the National Lung Screening Trial (NLST) clearly document a reduction in lung cancer mortality associated with annual lung cancer screening (LCS) using low-dose computed tomography (LDCT).1 These data, combined with results of other LCS trials, led the US Preventive Services Task Force (USPSTF) to update their LCS recommendation to a B grade,2 indicating that LDCT-based LCS holds high certainty that the net benefit is moderate or there is moderate certainty that there is a moderate to substantial net benefit. However, in addition to this recommendation, NLST data also documented noteworthy harms associated with screening.1,3 These harms, including a combination of physical, psychosocial, economic, and opportunity costs, must be weighed against the potential benefits of screening.4
Policy recommendations stemming from the USPSTF decision have advocated that clinicians utilize shared decision making as the recommended platform, including the discussion of benefits, harms, and unknowns of LCS and engaging in joint decision making with screening candidates. Similarly, nearly every authoritative professional and advocacy organization that has subsequently favored LDCT-based LCS implementation (e.g., American Cancer Society,5 American Lung Association,6 National Comprehensive Cancer Network,7 American Association for Thoracic Surgery,8 and others) also supported the need for informed and shared decision making, owing to the complexity of the decision to pursue LCS. The American Academy of Family Physicians contends that it is premature to support broad implementation of LCS, and so it also currently recommends that clinicians and patients use informed and shared decision making in the process of considering LDCT-based LCS for individual patients.9
The USPSTF LCS recommendation also has a direct effect on health insurance coverage in the United States. The Affordable Care Act10,11 recommends the use of informed and shared decision making as the desired approach for addressing LCS with patients.2 The Centers for Medicare & Medicaid Services (CMS), in taking a landmark stance regarding the implementation of shared decision making, stated that patient counseling and shared decision making are required components of the LCS process and must be documented in advance of screening to qualify for reimbursement of screening services.12 In addition, CMS mandated that clinicians use one or more decision support tools to facilitate the decision process. The inclusion of a decision support tool into the consultation may help address noted gaps in clinician knowledge of LCS.13–15 To support the importance of this step in the screening process, CMS has added LCS counseling and shared decision making as a reimbursable preventive service benefit.16
In support of the need for counseling and shared decision making, several studies have documented substantial deficits in patient17 and provider13,14,18–20 LCS knowledge and awareness and that some patients have not engaged their primary care clinicians prior to pursuing screening.21 Community-based studies of screening have shown a lack of understanding of potential harms and unknowns.21–25 Studies of clinicians have likewise shown similar concerns about knowledge of screening benefits, harms, and uncertainties13,14,18–20,22,23,26 that would challenge the ability to achieve high-quality, truly informed decisions about screening.
While the complexity of LCS decision making provides a solid justification for policy regarding patient counseling and the use of shared decision making, the CMS requirement to include decision support tools precedes the availability of LCS-specific decision aids with a base of evidence demonstrating efficacy in supporting informed and shared decisions. Funded efforts are underway to develop LCS decision aids,27–30 and under the direction of Dr. Robert Volk, the Eisenberg Center for Clinical Decisions and Communications Science has developed a series of tools that are currently in use by clinicians and patients to support informed and shared decision making concerning LCS.31
To extend the library of decision aids that support informed and shared decision making about LCS, the investigative team developed a plan to build a decision aid (LuCaS) that incorporated conjoint analysis as the principal values clarification tool that would promote deliberation and reflection on the decision. Additionally, once embedded within LuCaS, users would receive feedback regarding the results of their conjoint exercise (e.g., relative importance, utilities, etc.) to use in subsequent decision making. However, the feedback element was not included in the current project. As a step in the process of developing LuCaS, a web-based decision support tool dedicated to supporting informed decision making about LCS, the study team developed and administered a conjoint valuation survey to elicit patient preferences about LCS and inform the development of a values clarification exercise to be embedded within LuCaS. The framework for LuCaS is derived from the Knowledge-Empowerment-Values model, which seeks to help individuals develop and apply 1) an appropriate fund of decision-relevant information, 2) applicable decision making and communication skills, and 3) clear personal preferences and values. If data support the feasibility and utility of the conjoint valuation survey, the plan was to integrate the conjoint exercise into LuCaS as the central values clarification tool.
According to International Patient Decision Aid Standards, values clarification exercises32–34 constitute a key element of decision aids and decision support tools.35 One approach to values clarification uses conjoint analysis or discrete choice experiments36 to provide decision makers with a strategy to consider the health choice at hand, while considering the likely tradeoffs in terms of benefits, harms, and unknowns. The major benefit of using conjoint exercises is that they emulate real-life scenarios more effectively than individual questions that do not simultaneously take into account the multiple attributes of a decision scenario. The major downside is that conjoint exercises can be time consuming and somewhat burdensome for some individuals. Previous colorectal cancer screening decision research that examined the use of conjoint exercises in contrast to rating and ranking tasks failed to identify clear benefit to the conjoint exercise in terms of decision outcomes even though conjoint methods revealed a somewhat different pattern of attribute importance scores.37 Pignone and colleagues suggested that studies examining pre to post changes in decision outcomes, as conducted in this study, would be beneficial in evaluating the utility of conjoint and other discrete choice approaches in terms of clarifying patient preferences and supporting informed decision making.37
The brief educational narrative and conjoint exercise used in this study was developed using data from interviews conducted with individuals at risk of lung cancer, the empirical literature on LCS, and investigator knowledge and experience regarding LCS. As shown in Box 1, the conjoint exercise included 5 attributes with 17 levels describing these attributes. Prior to implementing the conjoint exercise, the complete survey underwent cognitive interviewing38,39 to identify and correct issues that challenged effective survey administration.
Box 1.
Attributes (5) and levels (17) Included in the Conjoint Valuation Survey.
| 1. Out of Pocket Costs a. $50 b. $275 c. $500 2. Mortality Reduction (Benefit) a. 1% b. 10% c. 20% 3. Health Care Provider Recommendation a. Against Screening b. For Screening c. “Personal Decision” d. No Discussion 4. False Positive Rate (Harm) a. 10% b. 25% c. 40% 5. Access to Screening a. Convenient location, extended hours b. Convenient locations, normal business hours c. Inconvenient location, extended hours d. Inconvenient location, normal business hours |
The primary aim of this study was to examine the impact of a brief educational narrative and conjoint exercise on decisional conflict regarding LCS decisions among individuals at high risk for lung cancer. Investigators hypothesized that the brief educational narrative and conjoint exercise regarding decision-influencing attributes involving LDCT would significantly reduce decision conflict and all its component parts. As part of a larger investigation using a nationally representative panel of individuals at high risk for lung cancer, this study employed a single-arm (pretest-posttest design) of this intervention. Participants completed a measure of decisional conflict prior to reviewing the brief educational narrative and the conjoint survey and then completed the decisional conflict measure a second time immediately after completing the conjoint survey.
Methods
The study was conducted online using the web-enabled KnowledgePanel and standardized instruments to evaluate the impact of the intervention among individuals determined to be at high risk for developing lung cancer.
Procedure
Knowledge Networks (KN) conducts online surveys using the web-enabled KnowledgePanel (a probability-based panel designed to be representative of the US population).39–42 To establish and maintain its panel of participants, KN conducts random digit dialing of telephone numbers. Persons in selected households are invited by telephone to participate in the panel, and provided with an internet appliance and connection, if needed. The KN databases include over 300 health and demographic variables describing individuals on the panel, allowing for oversampling of underrepresented groups.
The study involved surveying a national sample of English-speaking individuals 45 years of age or older who were former or current smokers with at least a 20 pack-year history and without a history of lung cancer. We targeted a population that was approximately 50% female; 25% African American and 25% Hispanic; and 25% rural dwelling. The target sample size was 200 completed surveys, using a conservative approach to the sample size estimation algorithm developed by Orme for conjoint methodology.43 Of the 525 individuals invited to participate, 304 did not meet eligibility criteria due to an insufficient smoking history, leaving 223 who met study eligibility criteria.
Investigators developed and delivered all components of the survey to KN, including a specific description of conjoint value analysis scenarios. KN sent invitations in batches to panel members fitting eligibility criteria. In an effort to achieve the target population, the demographic characteristics of new recipients varied as respondents completed the survey. Each respondent received a $30 honorarium. All data were entered directly into databases, so missing data were limited and only due to participant refusal or early survey termination prior to completion.
Participants
Of the 223 eligible KnowledgePanel members, 210 (94%) of respondents completed the online consent procedures and became participants. Participants had a mean age of 61.69 years (SD = 8.46), reported an average smoking exposure of 39.95 pack years (SD = 20.10), and a substantial majority indicated have internet access in the home (80%). As shown in Table 1, participants reported a range of educational achievement, were approximately equally represented by females and males, and identified as having health insurance. Due to planned oversampling, 51 participants were African American (24%), and 59 participants described themselves as Hispanic American (28%).
Table 1.
Demographic Characteristics of Study Participants (N = 210)
| Demographic Characteristic | f | %a,b |
|---|---|---|
| Race/ethnicity | ||
| African American | 52 | 24 |
| Hispanic American | 59 | 28 |
| Caucasian | 96 | 46 |
| Sex | ||
| Female | 109 | 52 |
| Male | 101 | 48 |
| Marital status | ||
| Married | 121 | 58 |
| Widowed | 18 | 9 |
| Divorced | 32 | 15 |
| Separated | 3 | 1 |
| Never married | 18 | 9 |
| Living with partner | 18 | 9 |
| Education | ||
| Less than high school | 27 | 13 |
| Completed high school | 69 | 33 |
| Some college or trade school | 79 | 38 |
| Bachelor’s degree or more | 35 | 17 |
| Annual household income | ||
| Less than $15,000 | 32 | 15 |
| $15,000 to $24,999 | 25 | 12 |
| $25,000 to $34,999 | 22 | 10 |
| $35,000 to $49,999 | 33 | 16 |
| $50,000 to $74,999 | 42 | 20 |
| $75,000 or more | 56 | 27 |
| Health insurance statusc | ||
| Through employer | 96 | 51 |
| Medicare | 81 | 41 |
| Medicaid | 32 | 18 |
| Independent/private purchase | 29 | 16 |
| Other | 17 | 9 |
| MSA status | ||
| Metro | 138 | 66 |
| Non-metro | 72 | 34 |
| Work status | ||
| Working—paid employee | 57 | 27 |
| Working—self-employed | 8 | 4 |
| Not working—layoff | 1 | 0 |
| Not working—looking for work | 14 | 7 |
| Not working—retired | 74 | 35 |
| Not working—disabled | 45 | 21 |
| Not working—other | 11 | 5 |
MSA, metropolitan statistical area.
Percentages exceeded 100% due to rounding.
Percentages below 100% due to missing data.
Participants selected all that apply.
Intervention
The intervention included a full-profile conjoint value analysis instrument with 22 cards/vignettes and a brief educational narrative on LCS. The conjoint exercise consisted of 5 attributes (with a total of 17 levels; see Box 1) that were developed following analysis of key informant interviews with individuals at risk for lung cancer and informed by the available research literature and the investigative team’s extensive clinical and research experience in LCS. The selection was guided by efforts to represent accurately the principal aspects of the LCS environment that would be considered in LCS choices, including benefits, harms, clinical recommendations, and environmental considerations. The final attributes included expected mortality reduction (benefit), false positive rate (harm), cost, provider recommendation, and access. After each scenario, a 9-point Likert-type ratings scale anchored by “would definitely not get screened” and “would definitely get screened” was used to assess importance scores. All respondents received the same scenarios, although the order of scenario presentation and order of attributes varied. The specific conjoint scenarios were generated using Sawtooth Software Inc. (Orem, UT). We used orthogonality, along with guidance from Johnson and Orme,44 suggesting that individuals can answer over 20 pair-based comparisons without substantial task fatigue, as the criterion for determining the composition as well as number of the conjoint analysis tasks. In addition to the conjoint valuation survey, a brief educational narrative was provided that described the LCS decision, introduced the conjoint procedure, and defined a false positive screening result. The brief educational narrative included 410 words written at the 7.5 grade level as assessed by the Flesch-Kinkaid grade level formula. Introductory materials such as this are a vital part of preparing participants to complete a conjoint survey but may also serve as a co-intervention because they accompany the conjoint survey. See Appendix A for the brief educational narrative and the introduction to the conjoint valuation survey.
Measures
Background Characteristics
Two sources of information on background characteristics were included. Participants responded to several background questions on the PRE survey administered following consent procedures, and additional background history was available on all panel members from KN. On the PRE survey, participants responded to questions pertaining to their history of a cancer diagnosis, lung illnesses, and comorbid illness. Participants also responded to questions regarding their history of smoking and tobacco use. This set included items drawn from national surveys to assess current smoking status, years of smoking, age of smoking initiation, current average daily smoking volume, when an individual quit, quit attempts, interest in quitting, number of quit attempts lasting 3 months or longer, and nicotine dependence. Additional background data were available from their KnowledgePanel participant profile, including age, education, race/ethnicity, gender, marital status, employment status, insurance coverage, household information (e.g., size, number of adults, children, and income), internet use, health status, and geographic information about residence.
Lung Cancer Screening Awareness and Experience
On the PRE survey, participants were asked about their level of awareness and any past experience with LCS on five survey items. Specifically, the items asked about LCS awareness options, awareness of LDCT, understanding the potential benefits of LCS, and understanding the potential harms of LCS. One item asked if a health care clinician had ever talked with them about LCS. Each understanding and awareness item was measured on a 7-point Likert-type scale, and the experience item was measured dichotomously (yes/no), but a “don’t know” option was allowed.
Decisional Conflict
Participants completed a slightly adapted low literacy version (DCS-LL)45 of the original Decisional Conflict Scale (DCS).46,47 The DCS-LL was designed to reduce literacy and time burdens among individuals completing the instrument in research settings.45 The DCS-LL includes 10 items and employs a three response options: yes (0), unsure (2), and no (4). The full scale and subscales scores are calculated by summing responses, dividing by the number of items, and multiplying by 25. This creates scores ranging from 0 (no decisional conflict) through 100 (high decisional conflict) for the total scale and four subscales (e.g., Uncertainty, Informed, Values Clarity, and Support). Previous research has demonstrated the utility of this instrument as a reliable and valid measure of decisional conflict in a number of studies examining the efficacy of decision aids in oncology settings.45,47 The original version of the DCS-LL includes one item that combines assessment of benefits of screening and not screening and another item that assesses the potential risks and side effects of screening and not screening. Both of these items were subdivided to allow an assessment of these factors for screening and not screening separately because these were viewed as two separate and important factors related to the LCS context. Thus, the adapted version of the DCS-LL included 12 items with the two additional items loading onto the Informed subscale.45 Estimates of internal consistency reliability were solid on the PRE (α = .89) and POST (α = .92). On the subscales, estimates of internal consistency were .80 or above for the Uncertainty, Informed, and Values Clarity subscales. However, the Support subscales internal consistency estimates were suboptimal. On the PRE survey, internal consistency was estimated to be .51, and the estimated on the POST survey was .66. Overall, the data suggested strong reliability with the exception of the Support subscale. In addition to the mean total score and mean subscale scores, cut-point scores were calculated to facilitate individual-level analyses. As recommended, a cut-point of equal to or below 25 was used as it has been associated with a higher degree of decision implementation or readiness to make a decision.46,48
Analyses
Sawtooth software was used to generate the 20 scenarios (plus 2 holdouts) embedded within the conjoint valuation survey. Holdout choice scenarios are included in the conjoint survey but are not used to calculate the results. Data from holdout responses can be used for cross-validation of conjoint results using predictive modeling. Details regarding the development and analysis of the results of the conjoint valuation survey have been reported separately.49
Descriptive statistics were used to characterize the sample, describe participant self-ratings of awareness, understanding, and LCS experiences as well as total and subscale decisional conflict scores. Subsequently, paired t tests were conducted to test the hypothesis that the intervention would reduce decisional conflict. Additionally, McNemar’s tests were conducted after decisional conflict scores were dichotomized as >25 and ≤25 to indicate desired levels of decisional conflict in preparation for decision making.46 Due to the use of several subscales, alpha was set at .01, and Cohen’s d was used to describe the effect size. Finally, univariate and multivariate regression analyses between demographic characteristics (including tobacco use) and change in decisional conflict scores were conducted to examine potential associations.
Results
At baseline, participants generally reported a moderate level of awareness and understanding of the benefits and harms associated with LCS. On the 7-point Likert-type scale of awareness of LCS options, the mean rating was 4.13 (SD = 2.12), and the awareness rating for LDCT specifically was 3.39 (SD = 2.12). With regard to understanding LCS benefits, the mean rating was 4.77 (SD = 1.91), but the understanding of potential harms was 3.25 (SD = 2.05), notably lower. In terms of experience, only 19% of participants indicated that they had ever spoken with a clinician about LCS (40/210).
To examine the impact of the conjoint survey and brief introductory narrative, total and subscale decisional conflict scores on the PRE and POST surveys were compared using paired t tests (Table 2). For the total score and each subscale, participants reported relatively high levels of decisional conflict on the PRE survey, followed by substantially and significantly lower decision conflict levels on the POST survey.
Table 2.
Decisional Conflict Scores (N = 209)
| Scale | PRE, Mean (SD) | POST, Mean (SD) | Δ, Mean | P Value | d | PRE, % ≤25 | POST, % ≤25 |
|---|---|---|---|---|---|---|---|
| Overall | 47.61 (27.24) | 18.31 (22.15) | 29.30 | <0.0001 | 1.09 | 24.8 | 72.7 |
| Uncertainty | 53.23 (37.72) | 25.48 (33.79) | 27.75 | <0.0001 | 0.73 | 29.5 | 63.2 |
| Informed | 52.21 (30.54) | 16.89 (24.49) | 35.32 | <0.0001 | 1.11 | 20.0 | 73.7 |
| Values clarity | 49.04 (35.08) | 17.22 (28.31) | 31.82 | <0.0001 | 0.85 | 31.4 | 77.0 |
| Support | 35.45 (28.80) | 16.67 (23.23) | 18.78 | <0.0001 | 0.66 | 41.0 | 68.9 |
In addition to conducting group-level analyses of decisional conflict rating scale scores, individual-level analyses examined rates of participants who scored equal to or below a cut-point score of 25 (Table 2).46 On the baseline PRE survey, 24.8% of participants had total decisional conflict scores of 25 or less. On the subscales, 29.5%, 20%, 31.4%, and 41% had sub-26 scores on the Uncertainty, Informed, Values Clarity, and Support subscales, respectively. At the POST survey, the percentage of individuals with sub-26 total decisional conflict increased to 72.7%. On the subscales, 63.2%, 73.7%, 77.0%, and 68.9% of participants had sub-26 scores on the Uncertainty, Informed, Values Clarity, and Support subscales, respectively. Based on McNemar’s test to evaluate repeated measures dichotomous data revealed statistically significant changes across the total score and all four subscales (Ps < 0.001).
Univariate regression analyses were conducted with change in the overall DCS score as the dependent variable and demographic and tobacco use characteristics (e.g., age, gender, education, race/ethnicity, income, marital status, current smoking status, and pack-year smoking history) as the independent/explanatory variables. The only significant association found was between income category and change in DCS score, with individuals in the two highest income categories having significantly larger reductions in decisional conflict (P < 0.05). To assess the robustness of this result, we subsequently ran a multivariate regression including all of the above-mentioned demographic variables (Table 3). As in the univariate results, the only significant association between demographic characteristics and change in DCS score in the multivariate analysis was that the highest two income categories continued to be significantly associated with a greater change in the DCS score relative to the lowest income category.
Table 3.
Summary of Univariate and Multivariate Regression Analysis for Variables Predicting Change in Decisional Conflict Scores (N = 209)a
| Variables | Univariate Regression (R2) | Beta | SE B | t | P Value |
|---|---|---|---|---|---|
| Age | .000 | −0.05 | 0.25 | −0.21 | 0.834 |
| Sex/gender | .000 | ||||
| Male | REF | ||||
| Female | 1.47 | 3.94 | 0.37 | 0.711 | |
| Race/ethnicity | .004 | ||||
| Caucasian | REF | ||||
| African American | −3.34 | 5.13 | −0.65 | 0.516 | |
| Hispanic | −3.04 | 4.89 | −0.62 | 0.535 | |
| Marital status | .002 | ||||
| Partnered | REF | ||||
| Not partnered | −2.23 | 4.70 | −0.47 | 0.636 | |
| Education | .012 | ||||
| Less than high school | REF | ||||
| Completed high school | −1.57 | 6.48 | −0.24 | 0.809 | |
| Some college | 1.36 | 6.44 | 0.21 | 0.833 | |
| Bachelor or more | 1.18 | 7.77 | 0.15 | 0.879 | |
| Annual household income | .039 | ||||
| Less than $15,000 | REF | ||||
| $15,000 to $24,999 | 10.60 | 7.61 | 1.39 | 0.166 | |
| $25,000 to $34,999 | 11.23 | 8.12 | 1.38 | 0.168 | |
| $35,000 to $49,999 | 7.50 | 7.05 | 1.06 | 0.289 | |
| $50,000 to $74,999 | 15.55 | 7.03 | 2.21 | 0.028* | |
| $75,000 to or more | 15.94 | 7.34 | 2.12 | 0.031* | |
| Pack years | .003 | −0.07 | 0.10 | −0.67 | 0.504 |
| Current smoking | .008 | ||||
| No | REF | ||||
| Yes | −3.76 | 4.30 | −0.88 | 0.382 |
F(15, 187) = 0.75, P = 0.709, R2 = 0.06.
P < 0.05.
Discussion
Results of the NLST have created a unique opportunity to reduce the dramatic burden of lung cancer through an evidence-based early detection program paired with effective intervention. However, implementation of LDCT screening for lung cancer is new and complicated.50–53 To address the threats to high-quality implementation, policy makers have established rigorous standards for patient counseling and shared decision making in advance of screening. To support high-quality decision making, new decision support tools regarding LCS are needed to address known gaps in patient and clinician knowledge. As part of a larger program of research, this study explored the impact of a new educational intervention and conjoint valuation survey on decisional conflict scores regarding LCS among a nationally representative sample of individuals at high risk of developing lung cancer.
Results of this observational trial demonstrated that individuals who received a brief introduction to LCS followed by a conjoint valuation survey reported large drops in decisional conflict, including all four decisional conflict subscale scores. Effect sizes ranged from 0.66 to 1.10, suggesting a pattern of (very) large effects within this uncontrolled trial. In part this may be due to limited public awareness and knowledge about LCS, but it also demonstrates that the combination of brief information sharing and in-depth exploration of key factors affecting LCS decisions had a significantly favorable impact on potential screening participants in terms of clarifying values, feeling informed, and helping prepare them to make informed choices. One other published study of a video-based decision aid has shown improvements in LCS knowledge as well as low decisional conflict following exposure to the intervention.27 However, decisional conflict was only assessed after exposure to the intervention, precluding an assessment of change.
There was considerable individual variation in pre and post decisional conflict scores, however. While the overall group effects showed substantial reductions in decisional conflict following the intervention, approximately one quarter of the study sample had decisional conflict total scores of less than 25 (indicating a desirably low level of decisional conflict) prior to the intervention. In addition, approximately 25% of participants continued to have decisional conflict scores above 25 following the intervention. Thus, while clearly providing support for both group-level and individual-level benefits, these results show that a substantial minority of participants continued to experience decisional conflict that could impair informed decision making about LCS participation. Thus, there is likely a need for additional shared decision-making interventions that can help individuals navigate the complexities of this preventive health service choice. In particular, the largest subset of individuals appeared to experience continued uncertainty and a need for additional decision support based on subscale scores. This conclusion also provides support for the policy standard adopted by CMS, requiring documentation of a patient counseling and shared decision-making consultation prior to initiating screening.12
In a preliminary manner, this study supports the value of the brief educational narrative and the conjoint valuation survey in reducing decisional conflict and supporting engagement with the LCS decision. The use of conjoint methods has been previously used in similar settings37,54 to facilitate preference elicitation and consideration of cancer screening although results have not consistently demonstrated their utility.36 In this vein, the conjoint exercise can serve multiple roles: 1) provide information, 2) support deliberation and reflection, and 3) provide preference feedback, if there is a mechanism to return the results directly, which may have the most powerful impact. This study emphasized the information delivery and deliberative functions of conjoint exercises since it did not include a mechanism to provide feedback to respondents regarding the results of the conjoint. The conjoint approach has several potential advantages that support values clarification and preference elicitation. Most prominently, conjoint exercises help individuals explore relevant tradeoffs that are inherent within the potential benefits and harms associated with screening. Given the complexity of the benefit and harm equation for LCS, despite the relatively simple decision architecture (screen v. not screen) as compared to colorectal cancer screening (i.e., colonoscopy v. sigmoidoscopy v. FOBT/FIT v. not screening), the conjoint approach provides an engaging and facilitative method of clarifying values and preferences related to participation in a LCS program.
Study Limitations
Although this study was conducted with a large, nationally representative sample of individuals at high risk for lung cancer, the results should be interpreted in light of some limitations. First, because the conjoint was paired with a brief educational narrative, it is not possible to isolate the effects of the conjoint activity from the brief educational activity, nor is it possible to eliminate the possibility of other confounds. However, conjoint activities require introductory material consistent with the information we presented at the start of the conjoint activity.37 It would be of interest to compare the effect of an educational intervention alone against an educational intervention plus conjoint exercise to gain a better sense of the relative merits of the conjoint activity. However, the data do support the viability of this intervention in the LCS context. Second, not all of the participants would be eligible for LCS based on their age and tobacco use history. However, because the purpose of the LuCaS intervention is to promote informed decision making, the strategy was adopted to educate individuals who would likely find the information of value, regardless of their eligibility. It was also not designed to promote screening; therefore, educating a larger audience, using a broader, public health approach is appropriate. Third, using a conjoint strategy is likely to be too time consuming to be employed in clinical settings, but this type of values clarification exercise could be used in decision support tools designed to prepare individuals for consultation with a clinician or perhaps for post-consultation consideration when an individual remains ambivalent about screening and wishes to continue to explore benefits, harms, and uncertainties in more detail. Fourth, the large sample size created a scenario where the study was likely to overidentify very small changes in decisional conflict as statistically significant. To address this concern, we included effect sizes measures to provide additional analytic information regarding the impact of the intervention.
Conclusions
Given the substantial plausible impact of the brief educational narrative and conjoint exercises on decisional conflict in this study, integrating conjoint approaches into decision aids for LCS may be a viable consideration. Longer administration times likely preclude the use of this particular conjoint in decision support tools in the clinical setting as consultation aids. However, conjoint survey approaches would be a better fit for individuals who are seeking information about LCS and seeking to explore the decision in greater depth before making a choice, even if conjoint results cannot be immediately analyzed and returned. Additionally, more intensive and engaging tools of this nature may help patients prepare for a high-level, yet efficient discussion with clinicians, preparing them to engage in a truly shared decision-making consultation. Conjoint exercises may be particularly helpful in the LCS context, given the complex range of benefits, harms, and uncertainties associated with this recently emerging cancer screening modality.
Supplemental Material
Supplemental material, LCS_-_DCS_Manuscript_FINAL_R2_2019-10-22_CLEAN.rjf_online_supp for Brief Education and a Conjoint Valuation Survey May Reduce Decisional Conflict Regarding Lung Cancer Screening by Jamie L. Studts, Richard J. Thurer, Kory Brinker, Sarah E. Lillie and Margaret M. Byrne in MDM Policy & Practice
Footnotes
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Support for this study was provided by a grant from the National Institutes of Health (R21CA139371) as well as assistance from the Behavioral and Community-Based Research Shared Resource Facility of the University of Kentucky Markey Cancer Center (P30CA177558). The funding agreements ensured the authors’ independence in designing the study, interpreting the data, writing, and publishing the report.
ORCID iD: Jamie L. Studts
https://orcid.org/0000-0003-3922-3597
Supplemental Material: Supplementary material for this article is available on the Medical Decision Making Policy & Practice website at http://journals.sagepub.com/home/mpp.
Contributor Information
Jamie L. Studts, Department of Behavioral Science, University of Kentucky Markey Cancer Center, Lexington, Kentucky; Cancer Prevention and Control Program, University of Kentucky Markey Cancer Center, Lexington, Kentucky; Behavioral and Community-Based Research Shared Resource Facility, University of Kentucky Markey Cancer Center, Lexington, Kentucky.
Richard J. Thurer, Department of Surgery, Division of Cardiothoracic Surgery, and Sylvester Comprehensive Cancer Center, University of Miami Miller School of Medicine, Miami, Florida
Kory Brinker, Behavioral and Community-Based Research Shared Resource Facility, University of Kentucky Markey Cancer Center, Lexington, Kentucky.
Sarah E. Lillie, Center for Chronic Disease Outcomes Research, Minneapolis VA Health Care System, Minneapolis, Minnesota
Margaret M. Byrne, Department of Health Outcomes and Behavior, Moffitt Cancer Center, Tampa, Florida
References
- 1. National Lung Screening Trial Research Team; Aberle DR, Adams AM, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011;365(5):395–409. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Moyer VA; US Preventive Services Task Force. Screening for lung cancer: US Preventive Services Task Force recommendation statement. Ann Intern Med. 2014;160(5):330–8. [DOI] [PubMed] [Google Scholar]
- 3. Bach PB, Mirkin JN, Oliver TK, et al. Benefits and harms of CT screening for lung cancer: a systematic review. JAMA. 2012;307(22):2418–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Harris RP, Sheridan SL, Lewis CL, et al. The harms of screening: a proposed taxonomy and application to lung cancer screening. JAMA Intern Med. 2014;174(2):281–5. [DOI] [PubMed] [Google Scholar]
- 5. Wender R, Fontham ET, Barrera E, Jr, et al. American Cancer Society lung cancer screening guidelines. CA Cancer J Clin. 2013;63(2):107–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. American Lung Association. What do I need to know about lung cancer screening [cited March 1, 2013]. Available from: http://www.lung.org/lung-disease/lung-cancer/lung-cancer-screening-guidelines/lung-cancer-screening.pdf.
- 7. Wood DE, Eapen GA, Ettinger DS, et al. Lung cancer screening. J Natl Compr Canc Netw. 2012;10(2):240–65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Jaklitsch MT, Jacobson FL, Austin JH, et al. The American Association for Thoracic Surgery guidelines for lung cancer screening using low-dose computed tomography scans for lung cancer survivors and other high-risk groups. J Thorac Cardiovasc Surg. 2012;144(1):33–8. [DOI] [PubMed] [Google Scholar]
- 9. American Academy of Family Physicians. Clinical preventive service recommendation: lung cancer [cited September 18, 2017]. Available from: http://www.aafp.org/patient-care/clinical-recommendations/all/lung-cancer.html.
- 10. Bauchner H, Fontanarosa PB, Golub RM. JAMA welcomes the US Preventive Services Task Force. JAMA. 2016;315(4):351–2. [DOI] [PubMed] [Google Scholar]
- 11. Siu AL, Bibbins-Domingo K, Grossman D. Evidence-based clinical prevention in the era of the Patient Protection and Affordable Care Act: the role of the US Preventive Services Task Force. JAMA. 2015;314(19):2021–22. [DOI] [PubMed] [Google Scholar]
- 12. Centers for Medicare & Medicaid Services. Decision memo for screening for lung cancer with low dose computed tomography (LDCT) (CAG-00439N) [cited September 18, 2017]. Available from: https://www.cms.gov/medicare-coverage-database/details/nca-decision-memo.aspx?NCAId=274.
- 13. Ersek JL, Eberth JM, McDonnell KK, et al. Knowledge of, attitudes toward, and use of low-dose computed tomography for lung cancer screening among family physicians. Cancer. 2016;122(15):2324–31. [DOI] [PubMed] [Google Scholar]
- 14. Raz DJ, Wu GX, Consunji M, et al. Perceptions and utilization of lung cancer screening among primary care physicians. J Thorac Oncol. 2016;11(11):1856–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Raz DJ, Wu GX, Consunji M, et al. The effect of primary care physician knowledge of lung cancer screening guidelines on perceptions and utilization of low-dose computed tomography. Clin Lung Cancer. 2018;19:51–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Centers for Medicare & Medicaid Services, Department of Health and Human Services. Medicare coverage of screening for lung cancer with low dose computed tomography (LDCT) [cited September 18, 2017]. Available from: https://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNMattersArticles/Downloads/MM9246.pdf.
- 17. Carter-Harris L, Ceppa DP, Hanna N, Rawl SM. Lung cancer screening: what do long-term smokers know and believe? Health Expect. 2017;20(1):59–68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Duong DK, Shariff-Marco S, Cheng I, et al. Patient and primary care provider attitudes and adherence towards lung cancer screening at an academic medical center. Prev Med Rep. 2017;6:17–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Lewis JA, Petty WJ, Tooze JA, et al. Low-dose CT lung cancer screening practices and attitudes among primary care providers at an Academic Medical Center. Cancer Epidemiol Biomarkers Prev. 2015;24(4):664–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Rajupet S, Doshi D, Wisnivesky JP, Lin JJ. Attitudes about lung cancer screening: primary care providers versus specialists. Clin Lung Cancer. 2017;18:e417-e423. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Byrne MM, Lillie SE, Studts JL. Lung cancer screening in a community setting: characteristics, motivations, and attitudes of individuals being screened. Health Psychol Open. 2019;6(1):2055102918819163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Simmons VN, Gray JE, Schabath MB, Wilson LE, Quinn GP. High-risk community and primary care providers knowledge about and barriers to low-dose computed topography lung cancer screening. Lung Cancer. 2017;106:42–9. [DOI] [PubMed] [Google Scholar]
- 23. Hoffman RM, Sussman AL, Getrich CM, et al. Attitudes and beliefs of primary care providers in New Mexico about lung cancer screening using low-dose computed tomography. Prev Chronic Dis. 2015;12:E108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Mishra SI, Sussman AL, Murrietta AM, et al. Patient perspectives on low-dose computed tomography for lung cancer screening, New Mexico, 2014. Prev Chronic Dis. 2016;13:E108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Lowenstein LM, Richards VF, Leal VB, et al. A brief measure of Smokers’ knowledge of lung cancer screening with low-dose computed tomography. Prev Med Rep. 2016;4:351–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Kanodra NM, Pope C, Halbert CH, Silvestri GA, Rice LJ, Tanner NT. Primary care provider and patient perspectives on lung cancer screening. A qualitative study. Ann Am Thorac Soc. 2016;13(11):1977–82. [DOI] [PubMed] [Google Scholar]
- 27. Volk RJ, Linder SK, Leal VB, et al. Feasibility of a patient decision aid about lung cancer screening with low-dose computed tomography. Prev Med. 2014;62:60–3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Hart K, Tofthagen C, Wang HL. Development and evaluation of a lung cancer screening decision aid. Clin J Oncol Nurs. 2016;20(5):557–9. [DOI] [PubMed] [Google Scholar]
- 29. Lau YK, Caverly TJ, Cao P, et al. Evaluation of a personalized, web-based decision aid for lung cancer screening. Am J Prev Med. 2015;49(6):e125–e129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Lau YK, Caverly TJ, Cherng ST, et al. Development and validation of a personalized, web-based decision aid for lung cancer screening using mixed methods: a study protocol. JMIR Res Protoc. 2014;3(4):e78. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Agency for Healthcare Quality and Research. Lung cancer screening tools for patients and clinicians [cited September 18, 2017]. Available from: https://effectivehealthcare.ahrq.gov/decision-aids/lung-cancer-screening/patient.html.
- 32. Fagerlin A, Pignone M, Abhyankar P, et al. Clarifying values: an updated review. BMC Med Inform Decis Mak. 2013;13(Suppl 2):S8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Llewellyn-Thomas HA. Values clarification. In: Elwyn G, Edwards GEA, eds. Shared Decision Making in Health Care: Achieving Evidence Based Patient Choice. Oxford: Oxford University Press; 2009. p 123–34. [Google Scholar]
- 34. Llewellyn-Thomas HA, Crump RT. Decision support for patients: values clarification and preference elicitation. Med Care Res Rev. 2013;70(1 Suppl):50S–79S. [DOI] [PubMed] [Google Scholar]
- 35. Elwyn G, O’Connor A, Stacey D, et al. ; International Patient Decision Aids Standards (IPDAS) Collaboration. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333(7565):417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Mansfield C, Tangka FK, Ekwueme DU, et al. Stated preference for cancer screening: a systematic review of the literature, 1990–2013. Prev Chronic Dis. 2016;13:E27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Pignone MP, Brenner AT, Hawley S, et al. Conjoint analysis versus rating and ranking for values elicitation and clarification in colorectal cancer screening. J Gen Intern Med. 2012;27(1):45–50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Willis GB. Cognitive Interviewing: A Tool for Improving Questionnaire Design. Thousand Oaks (CA): SAGE; 2005. [Google Scholar]
- 39. Wackowski OA, Delnevo CD. Smokers’ attitudes and support for e-cigarette policies and regulation in the USA. Tob Control. 2015;24(6):543–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Kponee KZ, Siegel M, Jernigan DH. The use of caffeinated alcoholic beverages among underage drinkers: results of a national survey. Addict Behav. 2014;39(1):253–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Moreira T. Understanding the role of patient organizations in health technology assessment. Health Expect. 2015;18(6):3349–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Knowledge Networks. Knowledge Panel® [cited December 10, 2019]. Available from: https://www.ipsos.com/en-us/solutions/public-affairs/knowledgepanel-omnibus.
- 43. Orme BK. Sample size issues for conjoint analysis studies [cited November 19, 2019]. https://www.sawtoothsoftware.com/download/techpap/samplesz.pdf.
- 44. Johnson RM, Orme BK. How many questions should you ask in choice-based conjoint studies [cited November 19, 2019]? Available from: https://www.sawtoothsoftware.com/download/techpap/howmanyq.pdf.
- 45. Linder SK, Swank PR, Vernon SW, Mullen PD, Morgan RO, Volk RJ. Validity of a low literacy version of the Decisional Conflict Scale. Patient Educ Couns. 2011;85(3):521–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. O’Connor AM. Decisional Conflict Scale, updated 2010 [cited February 3, 2012]. Available from: http://decisionaid.ohri.ca/docs/develop/Tools/DCS_LowLiteracy_English.pdf.
- 47. O’Connor AM. Validation of a decisional conflict scale. Med Decis Making. 1995;15(1):25–30. [DOI] [PubMed] [Google Scholar]
- 48. Thompson-Leduc P, Turcotte S, Labrecque M, Legare F. Prevalence of clinically significant decisional conflict: an analysis of five studies on decision-making in primary care. BMJ Open. 2016;6(6):e011490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Byrne MM, Thurer RJ, Studts JL. Individual decision making about lung cancer screening: a conjoint analysis of perspectives among a high-risk national sample. Cancer Med. 2019;8(12):5779–86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. Wiener RS, Gould MK, Arenberg DA, et al. An official American Thoracic Society/American College of Chest Physicians Policy Statement: implementation of low-dose computed tomography lung cancer screening programs in clinical practice. Am J Respir Crit Care Med. 2015;192(7):881–91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Mazzone P, Powell CA, Arenberg D, et al. Components necessary for high-quality lung cancer screening: American College of Chest Physicians and American Thoracic Society Policy Statement. Chest. 2015;147(2):295–303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. National Academies of Sciences Engineering and Medicine. Implementation of Lung Cancer Screening: Proceedings of a Workshop. Washington: National Academies Press; 2017. [PubMed] [Google Scholar]
- 53. Carter-Harris L, Gould MK. Multilevel barriers to the successful implementation of lung cancer screening: why does it have to be so hard? Ann Am Thorac Soc. 2017;14(8):1261–65. [DOI] [PubMed] [Google Scholar]
- 54. Hess LM, Litwiller A, Byron J, Stutsman J, Kasper K, Learman LA. Preference elicitation tool for abnormal uterine bleeding treatment: a randomized controlled trial. Patient. 2015;8(2):217–27. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplemental material, LCS_-_DCS_Manuscript_FINAL_R2_2019-10-22_CLEAN.rjf_online_supp for Brief Education and a Conjoint Valuation Survey May Reduce Decisional Conflict Regarding Lung Cancer Screening by Jamie L. Studts, Richard J. Thurer, Kory Brinker, Sarah E. Lillie and Margaret M. Byrne in MDM Policy & Practice
