Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2013 May 6.
Published in final edited form as: J Health Commun. 2012 Jul 5;17(9):1081–1098. doi: 10.1080/10810730.2012.665420

How Do Perceptions About Cessation Outcomes Moderate the Effectiveness of a Gain-Framed Smoking Cessation Telephone Counseling Intervention?

Amy E Latimer-Cheung 1, Lisa M Fucito 2, Shannon Carlin-Menter 3, Jocelyn Rodriguez 4, Lindsey Raymond 5, Peter Salovey 6, Robert Makuch 7, K Michael Cummings 8, Benjamin A Toll 9
PMCID: PMC3644974  NIHMSID: NIHMS465925  PMID: 22765277

Abstract

The distinction between prevention and detection behaviors provides a useful guideline for appropriately framing health messages in terms of gains or losses. However, this guideline assumes that everyone perceives the outcomes associated with a behavior in a consistent manner, as prevention or detection. Individuals’ perceptions of a behavior vary, and so the effects of framed messages may be optimized by considering individuals’ perceptions rather than the prevention or detection function of the behavior. The authors tested this message-framing paradigm in a secondary analysis of data from a trial evaluating gain-framed smoking cessation counseling delivered through a state quitline (Toll et al., 2010). Smokers (N = 2,032) who called a state quitline received either gain-framed or standard care messages. Smokers’ beliefs about the positive consequences of stopping smoking (outcome expectancies) were evaluated at baseline. Smoking status and self-efficacy were assessed at 3 months. Outcome expectancies moderated the framing effects among men but not among women. Men in the gain-framed counseling condition who had positive outcome expectancies were more likely to quit and had more confidence in their ability to quit or to remain abstinent than men who were uncertain of the positive outcome of smoking cessation. Among men, self-efficacy mediated the moderated framing effects of the intervention on quit status. These findings suggest that it may be useful to consider sex and individual differences in outcome expectancies when delivering gain-framed smoking cessation messages in the context of a state quitline.


Smoking cessation messages can be framed to emphasize the benefits of quitting smoking (gain-framed) or costs of continuing to smoke (loss-framed). Delivering appropriately framed appeals holds promise for enhancing the effectiveness of smoking cessation interventions. The principles for appropriately framing messages are derived from prospect theory (Tversky & Kahneman, 1981), according to which individuals select a risky or uncertain option when considering the losses associated with options and they select a certain or risk-averse option when considering the gains associated with options. These tenets have been supported in classic decision-making experiments in which participants select between two interventions aimed at managing an epidemic. Both interventions have the same outcome, yet one has certain outcomes (i.e., outcomes are presented as the number of people who will be saved or who will die) and one has uncertain or risky outcomes (e.g., outcomes are presented the probability of saving lives or dying). When the intervention is described in terms of gains (i.e., lives saved), participants tend to select the intervention with a certain outcome. When the intervention is described in terms of losses (i.e., number of people who will die), participants tend to select the intervention with an uncertain outcome.

Rothman and Salovey (1997) developed a taxonomy of health behaviors predicated on the tenets prospect theory that guides when to frame messages in terms of gain or loss to persuade health behavior change. The taxonomy categorizes behaviors according to their function in either detecting or preventing disease. Applying the taxonomy, Rothman and Salovey (1997) proposed that detection behaviors (e.g., breast self-exams) are best promoted using loss-framed messages because behaviors in this category have uncertain outcomes and thus typically are perceived as risky (e.g., individuals could find out that they have breast cancer). In contrast, prevention behaviors (e.g., using sunscreen) are best persuaded using gain-framed messages because behaviors in this category have relatively certain outcomes and thus typically are perceived as risk averse (e.g., risk for skin cancer is greatly reduced). The taxonomy has proven to be a relatively useful for promoting detection behaviors (Meyerowitz & Chaiken, 1987; Rivers, Salovey, Pizarro, Pizarro, & Schneider, 2005; Schneider et al., 2001) and prevention behaviors (Detweiler, Bedell, Salovey, Pronin, & Rothman, 1999; Latimer, Rench, et al., 2007; Toll et al., 2010; Toll et al., 2007).

A number of studies support the prevention=detection dichotomy; however, several studies have failed to support this taxonomy (O’Keefe & Jensen, 2007, 2009). In some cases, null findings are the result of study limitations (e.g., small sample sizes, brief message exposure; Latimer, Salovey, & Rothman, 2007). In other cases, the lack of meaningful effects highlights a constraint of using behavioral function as a determinant of the appropriate message frame. The taxonomy fundamentally assumes that everyone has similar outcome expectancies thus perceiving the risk and the level of outcome certainty associated with a behavior in a consistent manner. Although for some behaviors this assumption is correct, for other behaviors individuals’ outcome expectancies may vary. Thus, it may be more effective to provide framed messages consistent with individuals’ outcome expectancies rather than the function of the behavior.

In an experiment examining the effectiveness of framed messages for encouraging vaccination against the West Nile virus, Bartels, Kelly, and Rothman (2010) held the function of the behavior constant and manipulated outcome expectancies by varying the likelihood that an expected outcome would occur. Participants who read a message describing a vaccine with fairly certain outcomes were best persuaded with a gain-framed message; participants who considered a vaccine described as having uncertain outcomes were more persuaded by a loss-framed appeal.

Although this experiment supports the notion of considering individuals’ outcome expectancies when selecting an appropriate message frame, the applicability of these findings to practice are limited. In practice, it would be unethical to provide false outcome information to affect outcome expectancies. An alternate strategy to manipulating outcome expectancies entails matching the frame of a message to be congruent with individuals’ existing outcome expectancies (Rothman, Bartels, Wlaschin, & Salovey, 2006). As such, outcome expectancies would moderate framing effects; individuals with existing positive outcome expectancies would be persuaded by gain-framed messages and individuals with existing negative outcomes expectancies would be persuaded by loss-framed messages. Outcomes expectancies are a suitable moderator to examine because they reflect individuals’ beliefs about the certainty that a behavior will lead to a specific outcome (Ajzen & Fishbein, 2005; Bandura, 1997). Thus, the message recipients’ outcome expectancies account for the outcome certainty component of decision making specified in prospect theory.

Existing evidence supports outcome expectancies as a moderator of framing effects (Apanovitch, McCarthy, & Salovey, 2003; Gerend, Shepherd, & Monday, 2008; Hevey et al., 2010; Kiene, Barta, Zelenski, & Cothran, 2005; O’Connor, Ferguson, & O’Connor, 2005; van’t Riet, Ruiter, Werrij, & De Vries, 2010). In a study evaluating the efficacy of delivering framed smoking cessation messages in conjunction with a pharmacotherapy intervention (Toll et al., 2008), women who expected to experience positive outcomes from quitting and received a gain-framed message had a greater number of days to smoking relapse compared with women in the loss-framed condition. However, there were no framing effects among men regardless of their outcome expectancies for quitting.

When examining outcome expectancies as a moderator of the effects of framed smoking cessation messages, it may be important to consider the sex of the message recipient. Men’s and women’s outcome expectations for quitting differ (Toll et al., 2010). Women tend to perceive greater risk in quitting than do men. These tendencies may affect whether men and women are persuaded differently by a gain- or a loss-framed messages. To explore possibility, we examined outcome expectancies and sex as moderators of a framed smoking cessation intervention.

In addition to identifying moderating factors, researchers also are challenged to identify the factors that mediate the effects of framed messages (Rothman & Updegraff, 2011). In the present study, we examined whether self-efficacy mediated the effects of framed smoking cessation messages that were congruent with men’s and women’s outcome expectancies. In the context of moderated framing effects, the match between the message frame and characteristics of the message recipient may elicit a feeling of fit (i.e., the behavior “just feels right”; Rothman & Updegraff, 2011). This feeling of fit may manifest in a number of ways, including increased self-efficacy to perform a behavior (Higgins, 2000). Sherman, Mann, and Updegraff (2006) demonstrated this relation in their study evaluating framed flossing messages. Participants who received framed messages congruent with their motivational orientation were more confident that they could floss regularly and, in turn, were more likely to floss than participants who received incongruent messages.

With the goal of furthering research examining moderators and mediators of framing effects, in the present study we conducted a secondary analysis of data from a message framing smoking cessation trial (Toll et al., 2010). We examined whether participants’ outcome expectancies of quitting and their sex moderated the effects of a gain-framed intervention delivered through a state quitline. We hypothesized that outcome expectancies would moderate the impact of the framed quitline counseling, especially among women. We also examined self-efficacy as a potential mediator of the moderated framing effects. We hypothesized that the observed moderated framing effects among women would be mediated by self-efficacy.

Method

The data for this study were collected as part of a randomized controlled trial examining whether delivering gain-framed counseling and print materials enhanced the effectiveness of a state quitline service (Toll et al., 2010). The effectiveness of a gain-framed intervention was compared to standard care. Standard care, rather than a loss-framed intervention, was used as the comparison group because the larger trial ascribed to the traditional prevention=detection taxonomy (Rothman & Salovey, 1997). Consistent with this taxonomy, at the population level, gain-framed messages are best for encouraging a prevention behavior such as smoking cessation. Because the moderating variables that would further optimize the effects of the framed counseling were not considered in the larger trial, we conducted the subsequently described secondary analyses.

Participants

Participants were smokers (N = 2,031) who called the New York State Smokers’ Quitline (NYSSQL). Eligible participants in the larger trial were English-speaking New York State residents of at least 18 years of age who were (a) current smokers seeking quitting assistance for themselves, (b) not enrolled in the NYSSQL extended callback program, which was intended for Medicaid beneficiaries or the uninsured, and (c) not enrolled in any other special cessation programs through another source. In the present analyses, self-reported sex (male, female) was an additional inclusion criterion. Participants’ demographic characteristics and smoking history are described in Table 1. Between-group comparisons revealed some differences in participant characteristics. Women in the standard care condition were less likely to have made an attempt to quit smoking in the past, χ2(1, N = 1,153) = 7.27, p = .01, and were more likely to be from an ethnic minority group, χ2(2, N = 1,153) = 8.32, p = .02, compared with women in the gain-framed condition. Men were younger, F(1, 2015) = 21.48, p <.001, and had smoked for fewer years, F(1, 2015) = 9.53, p = .002, but smoked more cigarettes daily than women, F(1, 2015) = 24.88, p <.001. The characteristics that varied between groups were treated as covariates in subsequent analyses.

Table 1.

Participant demographic and smoking history characteristics

Men
Women
Gain framed
(n=331)
Standard
care (n=547)
Gain framed
(n=479)
Standard
care (n=674)
Outcome expectancies (SD) 6.86 (0.46) 6.84 (0.55) 6.87 (0.48) 6.86 (0.53)
Age, years (SD) 45.08 (12.93) 45.15 (13.89) 48.66 (13.53) 47.39 (13.91)
Education (n)
   High school or less 40.4% (131) 39.1% (210) 37.4% (176) 32.1% (210)
   At least some postsecondary education 32.4% (105) 38.7% (208) 40.0% (188) 39.8% (13.1)
   Trade school 25.6% (83) 21.4% (115) 21.7% (102) 26.9% (176)
   Other 0.3% (5) 0.7% (4) 0.2% (4) 1.2% (8)
Race (n)
   White 77.9% (258) 78.2% (428) 80.0% (383)* 72.7% (490)
   Black 11.5% (38) 8.0% (44) 11.3% (54) 14.4% (97)
   Other 10.6% (35) 13.7% (75) 8.8% (42) 12.9% (87)
Number of cigarettes per day 21.09 (11.44) 21.82 (11.50) 19.45 (11.00) 18.80 (10.29)
Years smoked 24.94 (13.83) 24.91 (14.75) 27.92 (13.69) 26.05 (14.36)
Made past quit attempts (n) 88.2% (292) 86.7% (474) 91.9% (440)* 86.8% (585)
Time to first cigarette after waking (n)
   ≤5 min 36.9% (120) 40.9% (217) 42.4% (201) 32.7% (261)
   6–30 min 38.2% (124) 33.5% (178) 35.2% (167) 34.0% (223)
   31–60 min 10.2% (33) 14.1% (75) 10.1% (48) 14.8% (97)
   >60 min 14.8% (48) 11.5% (75) 12.2% (58) 11.3% (74)
**

p < .05 for within group (sex × experimental condition).

Measures

To meet the constraints of conducting research within a busy state quitline, each of our measurement instruments was a single-item scale. Administering multi-item measures would have extended the length of each service call and consequently would have increased caller wait times. Although the psychometric properties of single-item measures have been questioned, research indicates that single-item measures of global constructs related to objects or actions that are easily conceptualized by respondents can be as good as multi-item measures (Bergkvist & Rossiter, 2007; Gardner, Cummings, Dunham, & Pierce, 1998). Because we used a broad operationalization of manipulation effects, outcome expectancies, and self-efficacy and because smoking cessation is a concrete action, the use of single-item measures in this study was appropriate.

Manipulation check items required participants to rate (a) how well the counseling presented the risks of smoking versus the benefits of not smoking (1 = it focused heavily on the costs of continuing to smoke; 5 = it focused heavily on the benefits of quitting smoking) and (b) the tone of the counseling (1 = extremely negative; 5 = extremely positive). These items are sensitive to differences in message framing (e.g., Toll et al., 2007).These items were not correlated, r = .05, p = .026, and thus were treated as separate indicators of the manipulation effects.

Outcome expectancies were measured using an item from the Benefits subscale of the Perceived Risks and Benefits Questionnaire (McKee, O’Malley, Salovey, Krishnan-Sarin, & Mazure, 2005). Participants rated the certainty of the global outcome of achieving health benefits from quitting smoking on a 7-point scale ranging from 1 (no chance) to 7 (certain to happen). A face valid item with a high factor loading was selected from the subscale. This measure correlates with intentions to quit smoking and treatment outcomes (McKee et al., 2005).

Smoking status was measured using a point prevalence abstinence item, a standard definition of quitting for smoking cessation clinical trials (Fiore et al., 2008; Miller et al., 2005). Participants indicated whether they had smoked any cigarettes, even only a puff, in the past 7 days (1 = yes; 2 = no).

Self-efficacy was measured with a single item. Participants rated their confidence to quit smoking or to remain abstinent from smoking on a 10-point scale (1 = not at all confident; 10 = extremely confident). A similar, single item self-efficacy measure has demonstrated predictive validity in smoking cessation studies (Steward, Schneider, Pizarro, & Salovey, 2003).

Procedure

The Yale University and Rosewell Park Cancer Institute Ethics Review Boards approved this study. A full description of the study protocol is available in the original paper (Toll et al., 2010).

At the start of the intake call, callers who consented to participate completed the single-item assessment of outcome expectancies. For the remainder of the intake call participants were exposed to either gain-framed or standard care counseling delivered by a trained NYSSQL information specialist. At the end of the call, participants completed the manipulation check items.

Immediately following the call, clients were mailed the NYSSQL Break Loose! booklet and smoking cessation tip sheets framed in accordance with their experimental condition. Medically eligible clients received a 2-week starter pack of nicotine replacement therapy. Callers then received a standard 2-week follow-up telephone call from a NYSSQL information specialist that included framed counseling. Study outcomes were assessed in a 3-month follow-up telephone interview conducted by an independent survey group blind to the callers’ experimental condition.

Messages

Standard Care Messages

Messages were delivered throughout the intake and the 2-week follow-up call and in print materials including the Break Loose! guide. Before the start of the trial, the message content of standard NYSSQL services was examined (Latimer et al., 2009). A content analysis of the information specialists’ dialogue from six intake calls and six 2-week follow-up calls revealed that approximately one third of the call was dedicated to providing clients with information (e.g., the benefits of quitting, the consequences of secondhand smoke), another third was allocated to information gathering (e.g., how long have you been smoking), and the final third included active listening and collecting demographic information. Only the messages where the information specialist was providing clients with information were amenable to framing. This dialogue did include some gain-framed information (10.2%) and some loss-framed (1.7%) information. The rest of the information had a neutral tone. The print materials included more framed information than the call scripts (21.6% gain framed, 13.8% loss framed) because the primary focus of the print materials was information provision.

Gain-Framed Message Condition

Framed messages were incorporated into standard service. To facilitate message delivery during the intake and 2-week follow-up calls, the standard web forms used to guide the interview and record client information included gain-framed message prompts. These prompts were a series of statements (e.g., “Calling us is a step towards achieving the benefits of a smoke-free lifestyle”) and questions (e.g., “What benefits do you expect to get from quitting smoking?) that the specialist integrated into the interview. Gain-framed messages were integrated into the print material by reframing all loss-framed information and photos in the standard Break Loose! booklet and tip sheets. For example, the loss-framed message included in the standard materials “Smokers are more likely to have shortness of breath and wheezing …” was replaced with “If you quit smoking, you will be more likely to breathe easier …”

Statistical Analyses

Data Treatment

Intention-to-treat principles were applied to the smoking cessation outcome variable. Callers who were not reached at follow-up were considered to be smoking. Given that the dropout rates were similar across experimental conditions (Toll et al., 2010), this was an appropriate approach. Assuming that the intervention was unsuccessful among callers not reached for follow-up is standard in the smoking cessation field and is consistent with smoking cessation randomized controlled trials (Gonzales et al., 2006; Hurt et al., 1997; Jorenby et al., 2006). Self-efficacy data from callers not reached at follow-up were considered missing. We used this approach as opposed to the widely used intention-to-treat method of carrying the last observation forward, which has potential to bias the sample (Lane, 2008). The outcome expectancies variable was zero-centered (Cohen, Cohen, West, & Aiken, 2003), and experimental condition, sex, and smoking status were dummy-coded (standard care = 0, gain-framed condition = 1; men = 0, women = 1; smoking = 0, quit = 1).

Testing Moderated Intervention Effects

We conducted regression analyses to examine the moderated effects of the intervention on the manipulation check items and self-efficacy and quit status at the 3-month follow-up. We conducted separate hierarchical regression analyses for the manipulation check items and self-efficacy. In addition, we conducted binary logistic regression analyses for quit status. In each regression analysis, demographic covariates (smoking and quitting history, age, years smoked, number of cigarettes smoked daily, and race) were entered in the first step of the model. The main effects for experimental condition, outcome expectancies, and sex were entered into the second step of the model. The two-way interaction terms for these predictor variables were entered in the third step. The three-way interaction term for the predictor variables was entered in the final step. These steps are consistent with the protocol for testing interactions using regression models outlined by Cohen and colleagues (2003). Significant three-way interactions were decomposed first by sex (i.e., separate regression models were conducted for men and women). Significant two-way interactions that emerged were then further decomposed by sex and experimental condition.

Testing for Mediation

The analyses examining self-efficacy as a mediator included only male callers because the moderated intervention effects only emerged for men. The meditational model tested is described in Figure 1. As depicted in Figure 1, path a represents the moderated framing effects of the intervention on self-efficacy, and path b represents the predictive relationship between self-efficacy and quit status controlling for the effects of the intervention.

Figure 1.

Figure 1

A schematic diagram of the model testing self-efficacy as a mediator of the moderated framing effects of the intervention on smoking cessation.

We conducted a Sobel test to determine the significance of the mediation effects (Mackinnon, 2000; Mackinnon & Dwyer, 1993). The Sobel test determines statistical significance by dividing the product of the unstandardized regression coefficients of paths a and b by the pooled standard error of paths a and b. The unstandardized regression coefficients for paths a and b were determined in three phases. In the first phase, coefficient a was determined by regressing self-efficacy at 3 months on the two-way experimental condition × outcomes expectancies interaction term, controlling for covariates and the main effects of experimental condition and outcomes expectancies. Coefficient b was determined in the second step. Quit status at 3 months was regressed on self-efficacy at 3 months, controlling for covariates and the main effects of experimental condition and outcomes expectancies and their interaction. In the third phase, we standardized the coefficients because coefficient a was determined using multiple regression and coefficient b was determined using logistic regression. To standardize the coefficients, each coefficient was multiplied by the standard deviation of the predictor variable and divided the standard deviation of the outcome variable. The standard deviation were determined from the regression models used to calculate the coefficient initially. Equations derived from MacKinnon and Dwyer (1993) were used to solve the variance of the variables in the logistic regression used to determine coefficient b.

Results

Manipulation Check

We conducted two hierarchical regression analyses to determine whether outcome expectancies and sex moderated the evaluation of the counseling content, Ftone(12, 1692) = 1.80, p = .043; Femphasis(12, 1700) = 4.06, p<.001. As indicated by Toll and colleagues (2010), participants in the gain-framed condition reported that the counseling had a more positive tone, β = .14, p <.001, and placed more emphasize on the benefits of quitting, β = .16, p <.001, than did participants in the standard care condition. It is interesting that a main effect for sex and a sex × experimental condition interaction emerged for message tone, p < .006. Overall women rated the tone of the counseling more positively than did men regardless of counseling condition, β = .12, p <.001. Separate regression analyses for men and women revealed that men considered the tone of the gain-framed counseling to be more positive than the tone of the standard care counseling, Fmen(6, 738) = 2.39, p = .027, β = .13, p = .001. Women rated the tone of the standard care and the gain-framed counseling as equally positive, Fwomen(6, 975) = 1.00, p = .42, β = .03, p = .93. No additional interactions emerged for either manipulation check item.

Moderated Framing Effects at the 3-Month Follow-Up

We conducted regression analyses to examine outcomes expectancies and sex as moderators of framing effects on self-efficacy and quit status at the 3-month follow-up. The results of these analyses are presented in Tables 2 and 3.

Table 2.

Hierarchical linear regression models predicting self-efficacy and decomposing the three-way Experimental Condition × Outcome Expectancies × Sex interaction

Men
Women
Overall Full Gain Standard Full Gain Standard
Step 1 ΔR2=.015** ΔR2=.031* ΔR2=.06* ΔR2=.06** ΔR2=.015 ΔR2=.04* ΔR2=.01
Race −.02 −.04 −.02 −.08 .002 .07 −.03
Age .09 −.003 .20 −.12 .15* .22* .10
Number of cigarettes per day −.08* −.09* .05 −.21** −.07 −.13* −.03
Number of years smoked −.13* −.12 −.32** −.04 −.13* −.17 −.12
Has tried to quit −.02 −.01 .10 −.09 −.03 −.03 −.02
Step 2 ΔR2=.015** ΔR2=.013* ΔR2=.06** ΔR2=.001 ΔR2=.016** ΔR2=.01 ΔR2=.002
Outcome expectancies .03 .03 .25** .03 .04 .09 .04
Experimental condition .002 .005 .11**
Sex −.12*
Step 3 ΔR2=.010** ΔR2=.02** ΔR2=.001
Outcome expectancies × experimental condition .18** .17* .03
Experimental condition × sex .10
Outcome expectancies × sex .008
Step 4 ΔR2=.003*
Outcome expectancies × −.11*
experimental condition × sex
*

p < .05.

**

p < .01.

Table 3.

Binary logistic regression models predicting smoking status and decomposing the three-way Experimental Condition × Outcome Expectancies × Sex interaction

Men
Women
Overall All Gain Standard All Gain Standard
Step 1 χ2(7)=22.33** χ2(7)=13.70 χ2(7)=7.21 χ2(7)=18.25* χ2(7)=16.40* χ2(7)=8.70 χ2(7)=10.48
Race
   White 1.19 2.13 0.87 0.87 0.90 0.38 1.47
(0.55–2.61) (0.47–9.64) (0.17–4.33) (0.17–4.33) (0.35–2.26) (0.09–1.61) (0.41–5.21)
   Black .76 1.39 0.33 0.33 0.58 0.29 0.80
(0.32–1.81) (0.28–6.99) (0.05–2.21) (0.05–2.22) (0.20–1.64) (0.06–1.47) (0.19–3.33)
   Other 2.01 3.10 1.47 1.47 2.04 0.79 3.36
(0.71–5.67) (0.53–18.32) (0.20–10.60) (0.21–10.60) (0.51–8.06) (0.09–7.06) (0.55–20.61)
Unknown 1.00 1.00 1.00 1.00 1.00 1.00 1.00
Age 1.02 1.02 1.01 1.02 1.01 1.03 1.01
(1.00–1.03)* (1.00–1.04) (0.97–1.05) (1.00–1.05) (0.99–1.03) (0.99–1.06) (0.98–1.03)
Number of cigarettes per day 0.99 0.99 1.02 0.98 0.99 0.99 0.98
(0.98–1.00) (0.98–1.01) (0.99–1.04) (0.96–1.00) (0.97–1.00) (0.97–1.01) (0.96–1.00)
Number of years smoked 0.99 0.98 0.99 0.98 1.00 0.99 1.01
(0.98–1.01) (0.96–1.00) (0.95–1.02) (0.96–1.01) (0.98–1.02) (0.96–1.03) (0.98–1.04)
Has tried to quit 0.52 0.45 0.63 0.31 0.63 0.62 0.64
(0.32–0.84)** (0.23–0.89)* (0.23–1.74) (0.12–0.81)* (0.32–1.22) (0.21–1.85) (0.28–1.47)
Step 2 χ2(3)=9.89* χ2(2)=0.92 χ2(1)=4.54* χ2(1)=4.64* χ2(2)=1.87 χ2(1)=0.006 χ2(1)=0.12
Outcome expectancies 0.69 0.68 2.52 0.67 1.10 0.98 1.09
(0.48–0.98)* (0.48–0.97)* (0.89–7.15) (0.46–0.97)* (0.67–1.81) (0.59–1.63) (0.66–1.80)
Experimental condition 1.07 1.08 1.27
(0.74–1.56) (0.74-1.57) (0.90–1.79)
Sex 0.66
(0.48–0.93)*
Step 3 χ2(3)=3.81 χ2(1)=8.98** χ2(1)=0.10
Outcome expectancies × experimental condition 4.08 3.97 .89
(1.33–12.56)* (1.30–12.10)* (0.44–1.81)
Experimental condition × sex 1.18
(0.71–1.96)
Outcome expectancies × sex 1.61
(0.87–2.96)
Step 4 χ2(1)=6.35*
Outcome expectancies × experimental condition × sex .22
(.06–.81)*
*

p < .05.

**

p < .01.

In the model predicting self-efficacy, F(12, 1113) = 4.19, p < .001, the main effect for sex emerged as a significant predictor, β = −.12, p = .03. Men had greater self-efficacy than women. The two-way experimental condition_outcome expectancies interaction also was significant, β = .18, p = .001. Separate analyses for the gain-framed condition, F(6, 470) = 4.55, p <.001, and standard care condition, F(6, 642) = 2.16, p = .045, revealed that increased outcome expectancies were associated with greater self-efficacy in the gain-framed condition, β = .17, p <.001, but not the standard care condition, β = .03, p = .42. These effects were superseded by a significant the three-way experimental condition × outcome expectancies × sex interaction, β = −.11, p = .047. To decompose the three-way interaction, first we conducted separate regression analyses for men, F(8, 469) = 3.91, p < .001, and women, F(8, 639) = 2.63, p = .008. The experimental condition × outcome expectancies interaction was significant for men only, β = .17, p = .002. To decompose the two-way interaction, next we tested the simple effects for men in the gain-framed condition and men in the standard care condition. These analyses revealed that gain-framed counseling was most effective in enhancing self-efficacy as men’s outcome expectancies became more positive, F(6, 189) = 4.31, p < .001, β = .25, p < .001 (see Figure 2). Outcome expectancies were not a significant predictor in the standard care model. We repeated these final analyses for women as well. Outcome expectancies were not a significant predictor in either model.

Figure 2.

Figure 2

Moderated framing effects on self-efficacy to quit and remain abstinent at the 3-month follow-up. The outcome expectancies variable was dichotomized (high outcome expectancies = 7, low outcome expectancies >7) in this figure. Cohen’s d effects sizes for within groups comparison are reported below each set of bars. Effect sizes of .20, .50, and .80 are considered small, medium, and large, respectively.

In the model predicting smoking status at follow-up, χmodel2 (14, N = 1,848) = 42.38, p < .001, Hosmer and Lemeshow χ2(48, N = 1,848) = 10.66, p = .22, the main effects for sex and outcome expectancies were significant. Men were more likely to quit than were women, odds ratio = .66, 95% CI [0.48, 0.93], p = .016. Higher outcome expectancies were associated with a decreased likelihood of quitting, odds ratio = .69, 95% CI [0.48, 0.93], p = .016. The three-way interaction between experimental condition × outcome expectancies × sex was significant, odds ratio = .22, 95% CI [0.06, 0.81], p = .023. In decomposing the three-way interaction by sex, we determined that the experimental condition × outcome expectancies interaction was only significant for men, χmodel2 (10, n = 791) = 23.60, p = .009, Hosmer and Lemeshow χ2(8, n = 791) = 6.14, p = .63, odds ratio = 4.00, 95% CI [1.30, 12.10], p = .015. The test of simple effects revealed that in the gain-framed counseling condition the likelihood of men quitting increased as their outcome expectancies became more positive, odds ratio = 2.53, p = .08, 95% CI [0.89, 7.15], χmodel2 (8, n = 309) = 11.75, p = .16. In the standard counseling condition, the likelihood of men quitting increased as their outcome expectancies decreased, odds ratio = .67, p = .032, 95% CI [0.46, 0.97], χmodel2 (8, n = 482) = 22.89, p = .004. Quit rates are depicted in Figure 3. The simple effects of the intervention were not significant among the women in the study.

Figure 3.

Figure 3

Quit status at the 3-month follow-up in the intent-to-treat population. The outcome expectancies variable was dichotomized (high outcome expectancies = 7, low outcome expectancies >7) in this figure. *p < .10 and **p < .05 for within-group comparisons.

Mediation

The analyses examining self-efficacy as a mediator only included male callers because the moderated framing effects were significant for men only. Coefficient a was determined from the model regressing men’s self-efficacy at follow-up on the two-way outcome expectancies × experimental condition interaction term. This model was previously described in the “Self-Efficacy Results” section.

Coefficient b was determined from an additional logistic regression analysis. In this model predicting smoking status, self-efficacy, odds ratio = 1.51, p < .001, 95% CI [1.34, 1.70], was a significant predictor after controlling for covariates and the main effects and the interaction of outcome expectancies and experimental condition, χmodel2 (11, n = 791) = 84.51, p < .001, Hosmer and Lemeshow χ2(8, n = 791) = 6.73, p = .57.

The Sobel test was significant indicating that self-efficacy mediated the moderated framing effects on smoking cessation, Sobel value = 2.85, p = .004.

Discussion

We examined whether participants’ outcome expectancies of quitting and sex moderated the effects of quitline-delivered gain-framed smoking cessation counseling and printed materials on their quit behavior and confidence to quit or to remain abstinent. Contrary to existing research (Toll et al., 2008) and our hypotheses, moderated framing effects emerged among men but not among women. In the gain-framed condition men who were more certain that quitting would impart health benefits were more likely to quit and had more confidence in their ability to quit or to remain abstinent than men who were less certain about the outcomes of smoking cessation. These findings support in part the emergent perspective (Bartels et al., 2010; Rothman et al., 2006; Rothman & Updegraff, 2011) that expectancies about the certainty of an outcome should be considered at the individual level rather than only as a property of the behavior itself. This support is limited to gain-framed messages for behavior traditionally classified as having a prevention function. Whether this emergent perspective is supported for behaviors with a detection function and for loss-framed messages requires additional research.

Findings from the present study suggest that this emergent perspective may hold for loss-framed messages. Men in the standard message condition who were less certain about the outcomes of quitting were more likely to quit than men who were more certain. The men also found the tone of the standard service less positive than the gain-framed service. We know from our previous evaluation of message content (Latimer et al., 2010) that the standard care messages include primarily neutral information with some gain-framed messages and some loss-framed messages. Together, these findings suggest that messages with a less positive tone and possibly even a loss-framed tone may be more persuasive for men with lower outcome expectancies.

In addition to affecting quit behavior, the gain-framed counseling led to greater self-efficacy to quit or to remain abstinent among men with positive outcome expectancies. This finding is notable because self-efficacy is an important predictor of initiation and maintenance of quit attempts (Baldwin et al., 2006). Thus, among callers who had not quit at follow-up, having higher self-efficacy increases the likelihood that they will quit in the future. Among callers who had quit, having higher self-efficacy may contribute to behavioral maintenance.

Self-efficacy also emerged as a mediator of the moderated framing effects. Congruency between male callers’ outcome expectancies and the frame of the counseling they received led to increased self-efficacy, which, in turn, led to increased likelihood of quitting. Self-efficacy has been demonstrated as a mediator in previous framing studies (Meyerowitz & Chaiken, 1987; Sherman et al., 2006). It may be that the feeling of fit that results from receiving a congruent message leads to increased self-efficacy and in turn behavior change (Higgins, 2000).

Alternately, the content of the message may have affected self-efficacy and subsequently led to behavior change. By nature framed messages emphasize attitude-related information. Increases in attitudes have been demonstrated to lead to enhanced self-efficacy to quit smoking (Corcoran & Rutledge, 1989). Future research should examine changes in attitudes as a precursor to changes in selfefficacy. Also to consider, the counseling and accompanying materials provided information about how to quit and eligible participants were provided with nicotine patches to aid in quitting. Perhaps this type of self-efficacy enhancing information is more persuasive or attended to more fully when embedded in a framed message congruent with the message recipient’s outcome expectancies.

Contrary to hypothesis, moderated framing effects did not emerge for women. This finding may be attributable to the callers’ perceptions of the counseling. Men tended to be sensitive to the framing whereas women considered the standard and the framed counseling to have a similar tone. Women’s lack of sensitivity to the message tone may have led them to process the gain-framed information with similar depth regardless of their outcome expectancies. Being sensitive to the counseling content, men with positive outcome expectancies may have been cued to process the gain-framed message more thoroughly than men for whom the message was incongruent (Shen & Dillard, 2009).

The absence of moderated framing effects among women is contrary to our findings in a previous smoking cessation trial (Toll et al., 2007). Of note, outcome expectancies where operationalized differently in each study. In our initial study, outcome expectancies were operationalized in terms of the risks associated with quitting (e.g., weight gain, loss of enjoyment) that align with women’s concerns related to smoking cessation (Reid, Pipe, Riley, & Sorensen, 2009). In the present study, outcome expectancies were operationalized in terms of the health benefits associated with quitting. There is some evidence that health effects are endorsed more strongly by men as a reason to quit than by women (Reid et al., 2009). Thus, the moderator in the present study may have been more relevant to men than women. A comprehensive measure that reflects men’s and women’s outcome expectancies of smoking cessation may produce a consistent moderation effect for both sexes.

Study limitations included (a) the use of brief measurement tools as a result of constraints of conducting research in a busy state quitline service, (b) our reliance on self-reported smoking status to accommodate the wide geographic area from which participants were drawn, (c) the concurrent assessment of the mediator and the outcome variable, and (d) the limited generalizability of study finding to the larger population of non–treatment-seeking smokers who potentially could respond very differently to message framing.

Our support for the emerging message framing paradigm emphasizing individuals perceptions was limited by the lack of a loss-framed message condition and our focus on a behavior with a prevention function. To support this paradigm fully, it is necessary to demonstrate that loss-framed messages are more effective for people who perceive greater risk and that the effects can be replicated for other types of behaviors.

Despite these limitations, this field experiment using a novel mode of message delivery and a large participant sample demonstrates the importance of considering characteristics of the message recipient when delivering framed health messages. This study also addresses the gap in our understanding of the mechanisms underlying the effects of framed messages.

Acknowledgments

This work was supported by grants (R21-CA127818, R21-CA127818-02S1, & K12-DA000167 to B.A.T., R01-CA068427 to P.S.) from the National Cancer Institute and National Institute on Drug Abuse, Social Science and Humanities Research Council of Canada, by a contract from the New York State Department of Health, and by the State of Connecticut, Department of Mental Health and Addictions Services.

Footnotes

Publisher's Disclaimer: Full terms and conditions of use: http://www.tandfonline.com/page/terms-and-conditions

This article may be used for research, teaching, and private study purposes. Any substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any form to anyone is expressly forbidden.

The publisher does not give any warranty express or implied or make any representation that the contents will be complete or accurate or up to date. The accuracy of any instructions, formulae, and drug doses should be independently verified with primary sources. The publisher shall not be liable for any loss, actions, claims, proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of this material.

Contributor Information

Amy E. Latimer-Cheung, School of Kinesiology and Health Studies, Queen’s University, Kingston, Ontario, Canada

Lisa M. Fucito, Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA

Shannon Carlin-Menter, Department of Health Behavior, Roswell Park Cancer Institute, Buffalo, New York, USA.

Jocelyn Rodriguez, Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA.

Lindsey Raymond, Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA.

Peter Salovey, Department of Psychology, Yale University, New Haven, Connecticut, USA.

Robert Makuch, Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA.

K. Michael Cummings, Department of Health Behavior, Roswell Park Cancer Institute, Buffalo, New York, USA.

Benjamin A. Toll, Department of Psychiatry, Yale University School of Medicine, and Smilow Cancer Hospital at Yale-New Haven, New Haven, Connecticut, USA

References

  1. Ajzen I, Fishbein M. The influence of attitudes on behavior. In: Albarracin D, Johnson BT, Zanna MP, editors. The handbook of attitudes. Mahwah, NJ: Erlbaum; 2005. pp. 173–222. [Google Scholar]
  2. Apanovitch AM, McCarthy D, Salovey P. Using message framing to motivate HIV testing among low-income, ethnic minority women. Health Psychology. 2003;22(1):60–67. doi: 10.1037//0278-6133.22.1.60. [DOI] [PubMed] [Google Scholar]
  3. Baldwin AS, Rothman AJ, Hertel AW, Linde JA, Jeffery RW, Finch EA, Lando HA. Specifying the determinants of the initiation and maintenance of behavior change: An examination of self-efficacy, satisfaction, and smoking cessation. Health Psychology. 2006;25:626–634. doi: 10.1037/0278-6133.25.5.626. [DOI] [PubMed] [Google Scholar]
  4. Bandura A. Self-efficacy: The exercise of control. New York, NY: Freeman; 1997. [Google Scholar]
  5. Bartels RD, Kelly KM, Rothman AJ. Moving beyond the function of the health behaviour: The effect of message frame on behavioural decision-making. Psychology & Health. 2010:821–838. doi: 10.1080/08870440902893708. [DOI] [PubMed] [Google Scholar]
  6. Bergkvist L, Rossiter J. The predictive validity of multiple-item versus single-item measures of the same constructs. Journal of Marketing Research. 2007;44:175–184. [Google Scholar]
  7. Cohen J, Cohen P, West SG, Aiken LS. Applied and multiple regression / correlation analysis for the behavioral sciences. Mahwah, NJ: Erlbaum; 2003. [Google Scholar]
  8. Corcoran KJ, Rutledge MW. Efficacy expectation changes as a function of hypothetical incentives in smokers. Psychology of Addictive Behaviors. 1989;3:22–28. [Google Scholar]
  9. Detweiler JB, Bedell BT, Salovey P, Pronin E, Rothman AJ. Message framing and sunscreen use: Gain-framed messages motivate beach-goers. Health Psychology. 1999;18:189–196. doi: 10.1037//0278-6133.18.2.189. [DOI] [PubMed] [Google Scholar]
  10. Fiore M, Jaen C, Baker CJ, Baker TB, Bailey WC, Benowitz NL, Healton CG. Treating tobacco use and dependence: Clinical practice guidelines. Rockville, MD: Agency for Healthcare Research and Quality; 2008. [Google Scholar]
  11. Gardner D, Cummings L, Dunham R, Pierce J. Single-item versus multiple-item measurement scales: An empirical comparison. Educational and Psychological Measurement. 1998;58:898. [Google Scholar]
  12. Gerend MA, Shepherd JE, Monday KA. Behavioral frequency moderates the effects of message framing on HPV vaccine acceptability. Annals of Behavioral Medicine. 2008;35:221–229. doi: 10.1007/s12160-008-9024-0. [DOI] [PubMed] [Google Scholar]
  13. Gonzales D, Rennard SI, Nides M, Oncken C, Azoulay S, Billing CB, Reeves KR. Varenicline, an alpha4beta2 nicotinic acetylcholine receptor partial agonist, vs sustained-release bupropion and placebo for smoking cessation: A randomized controlled trial. JAMA. 2006;296(1):47–55. doi: 10.1001/jama.296.1.47. [DOI] [PubMed] [Google Scholar]
  14. Hevey D, Pertl M, Thomas K, Maher L, Craig A, Chuinneagain SN. Body consciousness moderates the effect of message framing on intentions to use sunscreen. Journal of Health Psychology. 2010;15:553–559. doi: 10.1177/1359105309355335. [DOI] [PubMed] [Google Scholar]
  15. Higgins ET. Making a good decision: Value from fit. American Psychologist. 2000;55:1217–1230. [PubMed] [Google Scholar]
  16. Hurt RD, Sachs DP, Glover ED, Offord KP, Johnston JA, Dale LC, Sullivan PM. A comparison of sustained-release bupropion and placebo for smoking cessation. New England Journal of Medicine. 1997;337:1195–1202. doi: 10.1056/NEJM199710233371703. [DOI] [PubMed] [Google Scholar]
  17. Jorenby DE, Hays JT, Rigotti NA, Azoulay S, Watsky EJ, Williams KE, Reeves KR. Efficacy of varenicline, an alpha4beta2 nicotinic acetylcholine receptor partial agonist, vs placebo or sustained-release bupropion for smoking cessation: A randomized controlled trial. JAMA. 2006;296(1):56–63. doi: 10.1001/jama.296.1.56. [DOI] [PubMed] [Google Scholar]
  18. Kiene SM, Barta WD, Zelenski JM, Cothran DL. Why are you bringing up condoms now? The effect of message content on framing effects of condom use messages. Health Psychology. 2005;24:321–326. doi: 10.1037/0278-6133.24.3.321. [DOI] [PubMed] [Google Scholar]
  19. Lane P. Handling drop-out in longitudinal clinical trials: A comparison of the LOCF and MMRM approaches. Pharmaceutical Statistics. 2008;7:93–106. doi: 10.1002/pst.267. [DOI] [PubMed] [Google Scholar]
  20. Latimer AE, Green KE, Schmid K, Tomasone J, Abrams S, Cummings KM, Toll BA. The identification of framed messages in the New York State Smokers’ Quitline materials. Health Education Research. 2010;25(1):54–60. doi: 10.1093/her/cyp041. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Latimer AE, Rench TA, Rivers SE, Katulak NA, Materese SA, Cadmus L, Salovey P. Promoting participation in physical activity using framed messages: An application of prospect theory. British Journal of Health Psychology. 2007 doi: 10.1348/135910707X246186. [DOI] [PubMed] [Google Scholar]
  22. Latimer AE, Salovey P, Rothman AJ. The effectiveness of gain-framed messages for encouraging disease prevention behavior: Is all hope lost? Journal of Health Communication. 2007;12:645–649. doi: 10.1080/10810730701619695. [DOI] [PubMed] [Google Scholar]
  23. Mackinnon DP. Contrasts in multiple mediator models. In: Rose JS, Presson CC, Sherman SJ, editors. Multivariate applications in substance use research: New methods for new questions. Mahwah, NJ: Erlbaum; 2000. pp. 141–160. [Google Scholar]
  24. Mackinnon DP, Dwyer JH. Estimating mediated effects in prevention studies. Evaluation Review. 1993;17:144–158. [Google Scholar]
  25. McKee SA, O’Malley SS, Salovey P, Krishnan-Sarin S, Mazure CM. Perceived risks and benefits of smoking cessation: Gender-specific predictors of motivation and treatment outcome. Addictive Behaviors. 2005;30:423–435. doi: 10.1016/j.addbeh.2004.05.027. [DOI] [PubMed] [Google Scholar]
  26. Meyerowitz BE, Chaiken S. The effect of message framing on breast self-examination attitudes, intentions, and behavior. Journal of Personality and Social Psychology. 1987;52:500–510. doi: 10.1037//0022-3514.52.3.500. [DOI] [PubMed] [Google Scholar]
  27. Miller N, Frieden TR, Liu SY, Matte TD, Mostashari F, Deitcher DR, Bassett MT. Effectiveness of a large-scale distribution programme of free nicotine patches: a prospective evaluation. Lancet. 2005;365:1849–1854. doi: 10.1016/S0140-6736(05)66615-9. [DOI] [PubMed] [Google Scholar]
  28. O’Connor DB, Ferguson E, O’Connor RC. Intentions to use hormonal male contraception: The role of message framing, attitudes and stress appraisals. British Journal of Psychology. 2005;96:351–369. doi: 10.1348/000712605X49114. [DOI] [PubMed] [Google Scholar]
  29. O’Keefe DJ, Jensen JD. The relative persuasiveness of gain-framed and loss-framed messages for encouraging disease detection behaviors: A meta-analytic review. Journal of Communication. 2009;59:296–316. doi: 10.1080/10810730701615198. [DOI] [PubMed] [Google Scholar]
  30. Reid RD, Pipe AL, Riley DL, Sorensen M. Sex differences in attitudes and experiences concerning smoking and cessation: Results from an international survey. Patient Education and Counseling. 2009;76(1):99–105. doi: 10.1016/j.pec.2008.11.001. [DOI] [PubMed] [Google Scholar]
  31. Rivers SE, Salovey P, Pizarro DA, Pizarro J, Schneider TR. Message framing and pap test utilization among women attending a community health clinic. Journal of Health Psychology. 2005;10(1):65–77. doi: 10.1177/1359105305048556. [DOI] [PubMed] [Google Scholar]
  32. Rothman AJ, Bartels RD, Wlaschin J, Salovey P. The strategic use of gain-and loss-framed messages to promote healthy behavior: How theory can inform practice. Journal of Communication. 2006;56:S202–S220. [Google Scholar]
  33. Rothman AJ, Salovey P. Shaping perceptions to motivate healthy behavior: The role of message framing. Psychological Bulletin. 1997;121(1):3–19. doi: 10.1037/0033-2909.121.1.3. [DOI] [PubMed] [Google Scholar]
  34. Rothman AJ, Updegraff J. Specifying when and how gain- and loss-framed messages motivate health behavior: An integrated approach. In: Keren G, editor. Perspectives on framing. New York, NY: Psychology Press; 2011. pp. 257–278. [Google Scholar]
  35. Schneider TR, Salovey P, Apanovitch AM, Pizarro J, McCarthy D, Zullo J, Rothman AJ. The effects of message framing and ethnic targeting on mammography use among low-income women. Health Psychology. 2001;20:256–266. doi: 10.1037//0278-6133.20.4.256. [DOI] [PubMed] [Google Scholar]
  36. Shen L, Dillard JP. Message frames interact with motivational systems to determine depth of message processing. Health Communication. 2009;24:504–514. doi: 10.1080/10410230903104897. [DOI] [PubMed] [Google Scholar]
  37. Sherman DK, Mann T, Updegraff JA. Approach=avoidance motivation, message framing, and health behavior: Understanding the congruency effect. Motivation and Emotion. 2006;30:165–169. doi: 10.1007/s11031-006-9001-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Steward WT, Schneider TR, Pizarro J, Salovey P. Need for cognition moderates responses to framed smoking-cessation messages. Journal of Applied Social Psychology. 2003;33:2439–2464. [Google Scholar]
  39. Toll BA, Martino S, Latimer A, Salovey P, O’Malley S, Carlin-Menter S, Cummings KM. Randomized trial: Quitline specialist training in gain-framed vs standard-care messages for smoking cessation. Journal of the National Cancer Institute. 2010;102:96–106. doi: 10.1093/jnci/djp468. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Toll BA, O’Malley SS, Katulak NA, Wu R, Dubin JA, Latimer A, Salovey P. Comparing gain- and loss-framed messages for smoking cessation with sustained-release bupropion: A randomized controlled trial. Psychology of Addictive Behavior. 2007;21:534–544. doi: 10.1037/0893-164X.21.4.534. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Toll BA, Salovey P, O’Malley SS, Mazure CM, Latimer A, McKee SA. Message framing for smoking cessation: The interaction of risk perceptions and gender. Nicotine and Tobacco Research. 2008;10(1):195–200. doi: 10.1080/14622200701767803. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Tversky A, Kahneman D. The framing of decisions and the psychology of choice. Science. 1981;211:453–458. doi: 10.1126/science.7455683. [DOI] [PubMed] [Google Scholar]
  43. van’t Riet J, Ruiter RA, Werrij MQ, De Vries H. Self-efficacy moderates message-framing effects: The case of skin-cancer detection. Psychology & Health. 2010;25:339–349. doi: 10.1080/08870440802530798. [DOI] [PubMed] [Google Scholar]

RESOURCES