Abstract
Background
Text messaging programs on mobile phones have shown some promise in helping people quit smoking. Text2Quit is an automated, personalized, interactive mobile health program that sends text messages to offer advice, support, and reminders about quitting smoking.
Purpose
To evaluate the effect of Text2Quit on biochemically confirmed repeated point prevalence abstinence in the context of an RCT conducted in the U.S.
Methods
Participants (n=503) were recruited on the Internet and randomized to receive Text2Quit or self-help material. Between 2011 and 2013, participants were surveyed at baseline and at 1, 3, and 6 months post-enrollment to assess smoking status. Saliva was collected from participants who reported not smoking in the past 7 days at the 6-month follow-up. An intent to treat analysis was used, and those lost to follow-up were categorized as smokers. All analyses were completed in 2013.
Results
Biochemically confirmed repeated point prevalence abstinence favored the intervention group, with 11.1% abstinent compared to 5.0% of the control group (relative risk [RR]=2.22, CI=1.16, 4.26, p<0.05). Similarly, self reported repeated point prevalence abstinence was higher in the intervention group (19.9%) than in the control group (10.0%) (p<0.01). Effects were found to be uniform across the analyzed demographic subgroups, although suggestive of a larger effect for non-whites than whites.
Conclusions
These results provide initial support for the relative efficacy of the Text2Quit program.
Introduction
Tobacco use is the leading preventable cause of death, disability, and disease burden in the U.S.1,2 Smoking-cessation programs on mobile phones that use text messaging have been found to be effective for smoking cessation and other health behaviors.3–5 A recent meta-analysis of five studies of text messaging programs for smoking cessation concluded that such programs increase long-term quit rates.3
In the U.S., a number of text messaging programs for smoking cessation are publicly available. These include a national service called SmokefreeTXT, which was launched by the National Cancer Institute (NCI) from Smokefree.gov in 2011. In addition, callers to the national quitline number, 1-800-QUIT-NOW, are offered texting programs in some states. In 2012, 25% of state quitlines offered a texting program in addition to phone counseling.6 In several states, quitline callers are offered a program called Text2Quit. Over 50,000 callers have enrolled in Text2Quit since the service became available in 2011.7
Although the number of people enrolled in text messaging programs for smoking cessation is increasing, few studies of such programs have been conducted in U.S. populations.5 Existing studies of U.S. populations have consisted of pilot-studies with small sample sizes and short-term follow-up,8,9 without a control group,8 and without biochemical verification of self-reported smoking status.8,9 In the formative study of Ybarra and colleagues,9 intervention participants were significantly more likely than control participants to have quit at 4 weeks after their quit date, but findings were not sustained at 3 months.9
This study aimed to build upon an earlier pilot study8 and evaluate whether, for a U.S. sample recruited on the Internet, Text2Quit would be more effective than control material in promoting biochemically confirmed repeated point prevalence abstinence at 6-month follow-up. The results of this study will be informative, as no long-term studies of texting for smoking cessation in the U.S. have been conducted and because Text2Quit is highly subscribed to in the U.S.
Methods
Study Procedures
The study was approved by the George Washington University (GWU) IRB. Recruitment occurred between May 19, 2011 and July 10, 2012. Recruitment and enrollment took place on the Internet. Individuals who were searching on Google with keywords related to quitting smoking saw study ads in conjunction with their search results. Study ads offered help for quitting smoking and the possibility of earning Amazon gift cards in exchange for participation in a research study. Individuals who clicked on a study ad were directed to the study website. Interested participants who took a screening survey and were eligible were asked to provide informed consent, take an online baseline survey, and set a quit date in the next 30 days. Individuals were randomized by the computer system to intervention or control groups following completion of the baseline survey.
To be eligible for the study, participants were required to be: (1) aged ≥18 years; (2) smoke five or more cigarettes a day; (3) have a U.S. mailing address; (4) have an e-mail address; (5) have a cell phone number with an unlimited short messaging service (SMS) plan; (6) have an interest in quitting smoking in the next month; and (7) not be pregnant.
Participants completed online survey follow-ups at 1, 3, and 6 months post-enrollment. For participants who did not return online surveys after repeated e-mail reminders, surveys were conducted by study staff by phone, e-mail, or SMS. Saliva was collected by mail from participants who reported not smoking in the past 7 days at the 6-month follow-up.10,11 For saliva collection, participants were mailed a kit with instructions, a salivette and a pre-paid postage envelope for sample return. Samples that were returned to the research team were kept in a refrigerator until they were mailed in batches to J2 Labs (Tucson AZ) for cotinine analysis. Participants received a $15 Amazon gift card for each completed survey and a $25 Amazon gift card for providing a saliva sample.
The enrollment procedures were modified after a group of enrolled participants was detected to be fraudulent and disqualified (n=57). Following this incident, additional procedures were put in place in August 2011 to discourage fraudulent enrollees. A Completely Automated Public Turing test to tell Computers and Humans Apart (CAPTCHA) code, which required individuals to type the letters or numbers shown in an image, was added to the eligibility form to prevent computer “bots” from enrolling.12 All participants were required to confirm their interest in study participation via SMS following randomization. Finally, study staff manually checked all cell phone numbers and e-mails within 3 days of enrollment. Individuals who were found to have a cell phone or e-mail address that did not work or was registered to someone else were disqualified.
Measures
Follow-up surveys at 1, 3, and 6 months after enrollment included measures of abstinence from smoking, as measured by self-reports of 7- and 30-day past smoking.13 The primary outcome was biochemically confirmed repeated point prevalence abstinence,13 defined as a self-report of no smoking in the past 30 days on the 3- and 6-month surveys and a cotinine level ≤15 ng/mL14,15 at 6 months. Measures of abstinence from the 1-month survey were not included in the measure of repeated point prevalence abstinence because quit dates could be set up to 30 days after enrollment, and some participants who had not reached their quit date might be wrongfully excluded. Secondary outcomes consisted of 7- and 30-day abstinence at 1-, 3-, and 6-month follow-up13 and biochemically confirmed abstinence at the 6-month follow-up.
The baseline survey included items assessing demographic (e.g., age, gender, race/ethnicity, and education) and smoking characteristics of participants (e.g., lives with one or more smokers in the household, cigarettes smoked/day, and past quit attempts). Nicotine dependence was measured with the Fagerstrom Test for Nicotine Dependence (FTND).16 The number of text messages participants sent and received prior to enrolling in the study was assessed on the 1-month follow-up survey because this item was inadvertently omitted from the baseline survey. Additionally, a measure assessed the use of the following recommended smoking–cessation aids since study enrollment17: calling a quitline, getting counseling from a physician or other clinical service, and using any U.S. Food and Drug Administration (FDA)–approved quit-smoking medications. Participants were coded as having used a recommended cessation aid if they replied yes to any of the recommended aids on any of the three follow-up surveys.
For participants in the intervention group, Text2Quit engagement was assessed using records of their interaction with the text messaging computer system and self–reported survey data. The number of text messages a participant sent to the computer system, including replies to Text2Quit programmatic surveys and keywords used, was totaled and averages were calculated across participants. The total did not include use of the keyword STOP, a keyword for unsubscribing from the program. The percentage of participants who used this keyword served as an indicator of program disengagement. Self-reported data from the 1-, 3-, and 6-month surveys were used to assess participant use of the Text2Quit website.
Intervention Group
Participants randomized to the intervention group received Text2Quit. Text2Quit is a facilitated text messaging program designed to help people quit smoking.8 Text2Quit was developed in 20108 by GWU with technical support provided by Voxiva Inc. (Washington DC). The program consists primarily of automated, bidirectional text messages, which comprise the central component of the program. E-mails and a web portal are offered as supportive features.
The text messages are timed around a user’s quit date and provide advice on quitting smoking. Messages are based on social cognitive theory18,8 and are consistent with the U.S. Public Health Service Clinical Practice Guidelines,17 which recommend calling a quitline and considering the use of approved quit-smoking medications. Messages are interactive and prompt users to track smoking, report on cravings, and provide smoking status. Participants who report that they have not quit are routed into a separate relapse message protocol, which includes the option of setting a new quit date. Messages are tailored around several factors including first name, quit date, top three reasons for quitting, money saved by quitting, and use of quit-smoking medications.17
For the study, Text2Quit was offered for 6 months after enrollment, with the first 3 months offering both outgoing messages about quitting smoking and on-demand help through the use of keywords. After the outgoing messages stopped, participants could still text at any time for help through keywords. SMS keywords included the ability to reset a quit date (DATE), get help with a craving with a tip or a trivia game (CRAVE), get a summary of their quitting statistics (STATS), and to indicate that they had smoked (SMOKED).
Outgoing messages peaked in the period just prior to and following the quit date. Participants received five SMSs on their quit date and approximately two SMSs per day in the week after the quit date. Frequency declined in the subsequent weeks to approximately three SMSs per week for the next 2 months and then less than one per week for the remaining portion of the outgoing phase.
The SMSs were supplemented by a personalized web portal (text2quit.com) and e-mails. The website provided access to a participant’s quitting information, tools for changing SMS settings, and general resources for quitting smoking. E-mails were sent weekly in the period around the quit date and then every few weeks for the first 3 months. E-mails generally reiterated and expanded upon key messages from the texts. Participants could not reply to e-mails or update information through e-mails.
Control Group
Participants randomized to the control group initially received a web link to Smokefree.gov, a leading website with quitting smoking information run by the NCI. However, on September 15, 2011, when Smokefree.gov launched its own texting program, SmokefreeTXT, the control group material changed to avoid contamination of the control group with a similar texting program. At this point, 135 (26.8%) participants had been recruited into the study, 66 of whom were in the control group. Although consideration was given to changing to another leading quit-smoking website, there were concerns that other websites might also adopt a text messaging program during the trial period. Therefore, a decision was made to offer future control group participants a guidebook on quitting smoking developed by the NCI that had been used extensively in previous trials as a control material (e.g., Prokhorov et al.19). This guidebook, Clearing the Air, was offered via a web link that led participants to a document containing similar advice and information as Smokefree.gov.20 In addition to the control group materials, the control group also received study-related reminder texts via SMS, particularly in the 2 weeks prior to each follow-up survey.
Data Analysis
Analyses were conducted utilizing an intent to treat approach. Demographic differences between the intervention and control groups were tested with t-tests or chi-square tests. Primary and secondary outcomes were examined after imputation of missing data such that non-responders on the surveys and those who did not return saliva samples were assumed to be smoking.14 Chi-squared analyses were conducted to compare the proportion of participants in the treatment and control groups who reported quitting. Additionally, using logistic regression, the unadjusted and adjusted relative risk (RR) of quitting in the intervention group compared with the control group was calculated for the primary and secondary outcomes. To determine whether smoking outcomes for those in the treatment and control groups differed across predetermined demographic categories, chi-squared analyses were completed and the unadjusted RR was computed for demographic subgroups on the primary outcome. Finally, to identify subgroups of participants who may have benefited more from the intervention than others, exact logistic regression was used to test for condition x subgroup interactions in predicting the primary outcome. A separate logistic model was constructed for each subgroup. Analyses were conducted in 2013 using SAS, version 9.3 (SAS Institute, Inc., Cary, NC).
Results
As shown in Figure 1, 7,247 participants took the eligibility survey. A total of 1,745 individuals consented, filled out the baseline survey, and were randomized. Of these, 503 (n=241 control and n=262 intervention) provided handset verification via SMS and had their phone numbers and e-mails confirmed as valid and working. The remaining 1,242 were excluded because they did not provide handset verification via SMS (n=502), did not have a valid cell phone number (n=460), or the cell phone number given was a wrong number (n=268). Analyses to detect differences between groups among those excluded revealed that they were similar across conditions on all baseline demographic variables, with the exception of race. Participants assigned to the control group and later excluded were more likely to be white (p<0.05).
Follow-up rates for the 1-, 3-, and 6-month surveys were 85.7%, 82.9%, and 75.7% respectively. Follow-up rates were similar between groups except for the 1-month survey, which was slightly lower for the intervention group (p<0.01). Of those eligible to provide a saliva sample (i.e., self-report of no smoking in the past 7 days at the 6-month follow-up, n=133), 86 (64.7%) provided a saliva sample. The proportion of eligible participants who returned a saliva sample did not significantly differ across the two groups. Of these, 21 (24.4%) were found to have high levels of cotinine in their saliva (>15 ng/mL). These participants were coded as smokers in analyses of biochemically confirmed quitting.
Across all time points, the vast majority of participants completed the survey via web (1 month, 91.0%; 3 months, 90.2%; 6 months, 91.1%) with the remaining by phone, text, or e-mail. Mode of survey completion was similar among intervention and control group participants for all follow-up surveys.
Participant Demographics
Participant characteristics are presented in Table 1. Participants were on average 35.70 (SD=10.66) years old and predominantly white (78.5%), female (65.6%), and with at least some college or trade school education (78.1%). On average, participants began smoking when they were 17 (SD=5.60) years old and had been smoking for 18.48 (SD=11.25) years. At the time of enrollment, participants smoked an average of 17.29 (SD=8.08) cigarettes per day and had a FTND nicotine dependence score of 5.33 (SD=2.30). On average, participants sent or received 29.32 (SD=51.20) text messages per day prior to enrolling in the study. Intervention and control group participants were similar across variables except for education (p<0.01).
Table 1.
All (n=503) | Intervention group (n=262) | Control group (n=241) | |
---|---|---|---|
Age, M (SD) Gender (%) | 35.7 (10.7) | 35.9 (10.7) | 35.5 (10.6) |
Male | 172 (34.2%) | 82 (31.3%) | 90 (37.3%) |
Female | 330 (65.6%) | 180 (68.7%) | 150 (62.8%) |
Race/ethnicity (%) | |||
White | 395 (78.5%) | 210 (80.2%) | 185 (76.8%) |
African American | 54 (10.7%) | 24 (9.2%) | 30 (12.5%) |
Latino | 19 (3.8%) | 9 (3.4%) | 10 (4.2%) |
Asian | 12 (2.4%) | 7 (2.7%) | 5 (2.1%) |
Other | 23 (4.6 %) | 12 (4.6%) | 11 (4.6%) |
Education (%) | |||
High school or lower | 110 (21.9%) | 43 (16.4%) | 67 (27.8%) |
Some college or trade school | 254 (50.5%) | 146 (55.7%) | 108 (44.8%) |
College degree or higher | 139 (27.6%) | 73 (27.9%) | 66 (27.4%) |
Presence of ≥1 smoker in household (%) | 233 (46.3%) | 121 (46.2%) | 112 (46.5%) |
Cigarettes/day, M (SD) | 17.29 (8.08) | 17.68 (8.13) | 16.86 (8.02) |
Past quit attempts, M (SD) | 6.09 (12.30) | 5.34 (7.07) | 6.89 (16.14) |
Baseline nicotine dependence (FTND), M (SD) | 5.33 (2.30) | 5.36 (2.28) | 5.30 (2.33) |
Texts sent or received/day, M (SD) | 29.32 (51.20) | 25.09 (46.36) | 33.58 (55.43) |
Note: Boldface indicates statistical significance (p<0.01).
t-tests were utilized to compare means across the intervention and control groups.
Chi-square tests were utilized to compare proportions across the intervention and control groups.
FTND, Fagerstrom Test for Nicotine Dependence
Primary and Secondary Outcomes
Unadjusted and adjusted logistic regression models were conducted to examine outcomes across groups. Models were adjusted for education, the variable found to be significantly different across groups. Because the results were similar for the unadjusted and adjusted models, unadjusted models are presented in Table 2.
Table 2.
Follow-up survey | Measure | Intervention (SE) (n=262) | Control (SE) (n=241) | Relative risk (95% CI) | |
---|---|---|---|---|---|
Primary outcome | Biochemically confirmed repeated point prevalence abstinence | 11.1% (0.02) | 5.0% (0.01) | 2.22 (1.16, 4.26)* | |
Self–reported repeated point prevalence abstinenceb | 19.9% (0.02) | 10.0% (0.02) | 1.99 (1.27, 3.13)** | ||
Biochemically confirmed abstinence | 15.7% (0.02) | 11.2% (0.02) | 1.40 (0.89, 2.20) | ||
Secondary outcomes | 6 months | Not smoked in the past 7 days (%) | 31.7% (0.03) | 20.8% (0.03) | 1.53(1.13, 2.07)** |
Not smoked in the past 30 days (%) | 24.8% (0.03) | 15.8% (0.02) | 1.57 (1.10, 2.26)* | ||
3 months | Not smoked in the past 7 days (%) | 33.2% (0.03) | 19.9% (0.03) | 1.67 (1.23, 2.26)** | |
Not smoked in the past 30 days (%) | 27.5% (0.03) | 16.2% (0.02) | 1.70 (1.20, 2.41)** | ||
1 month | Not smoked in the past 7 days (%) | 30.5% (0.03) | 14.5% (0.02) | 2.10 (1.47, 3.00)*** | |
Not smoked in the past 30 days (%) | 11.8% (0.02) | 7.5% (0.02) | 1.58 (0.91, 2.76) |
Note: Boldface indicates statistical significance
Chi-square analyses were conducted to examine outcomes across the intervention and control groups. Unadjusted risk ratios are presented. Missing data were imputed to indicate smoking.
Self–reported repeated point prevalence abstinence is defined as not smoking in the past 30 days at 3- and 6-month follow-ups.
p<0.05,
p<0.01,
p<0.001.
An examination of the primary smoking–cessation outcome—biochemically confirmed repeated point prevalence abstinence—showed that the intervention group had more than twice the likelihood of quitting compared with the control group. In the intervention group, 11.1% of participants were biochemically confirmed repeated point prevalence abstainers compared with 5.0% of the control group (RR=2.22, 95% CI=1.16, 4.26, p<0.05). A similar result, though with higher overall quit rates, was obtained for self–reported repeated point prevalence abstinence: 19.9% of the intervention group reported abstinence compared with 10.0% of the control group (RR=1.99, 95% CI=1.27, 3.13, p<0.01).
Secondary outcomes were also explored. Although at the 6-month follow-up, self-reported quitting favored the intervention group for past 7-day smoking (RR=1.53, 95% CI=1.13, 2.07, p<0.01), there was no significant difference in the proportion of biochemically confirmed quitters between the intervention (15.7%) and control group (11.2%) (RR=1.40, 95% CI=0.89, 2.20, p=0.15). At the 6-month follow-up, for past 30-day quitting, 24.8% of the intervention group reported not smoking compared with 15.8% of control group participants (RR=1.57, 95% CI=1.10, 2.26, p<0.05).
For all of the subgroups analyzed (Table 3), there were a higher percentage of participants quitting in the intervention group compared with the control group, and RRs were statistically significant for some of the categories within subgroups (e.g., aged <35 years, being female, and FTND score ≤5) (p<0.05). None of the intervention group x subgroup interaction tests reached statistical significance at the p<0.05 level, indicating no clear evidence of differential effectiveness for the examined subgroups. However, there was a trend for non-white participants to benefit more from the intervention than white participants (p=0.06).
Table 3.
Subgroup | Intervention | Control | Subgroup relative risk (95% CI) | |||
---|---|---|---|---|---|---|
n | % quit (SE) | n | % quit (SE) | |||
Age | <35 years | 151 | 14.6% (0.03) | 132 | 5.3% (0.02) | 2.75 (1.21, 6.22) |
≥35 years | 111 | 6.3% (0.02) | 109 | 4.6% (0.02) | 1.38 (0.45, 4.20) | |
Gender | Male | 82 | 4.9% (0.02) | 89 | 3.4% (0.02) | 1.45 (0.33, 6.27) |
Female | 180 | 13.9% (0.03) | 150 | 6.0% (0.02) | 2.32 (1.12, 4.81) | |
Race | Non-white | 52 | 13.5% (0.05) | 56 | 0.0% (0.00) | — |
White | 210 | 10.5% (0.02) | 185 | 6.5% (0.02) | 1.62 (0.82, 3.17) | |
Education | High school or lower | 43 | 7.0% (0.04) | 67 | 3.0% (0.02) | 2.34 (0.41, 13.42) |
Some college or trade school | 146 | 12.3% (0.03) | 108 | 8.3% (0.03) | 1.48 (0.69, 3.17) | |
College degree or higher | 73 | 11.0% (0.04) | 66 | 1.5% (0.02) | 7.23 (0.93, 6.30) | |
Fagerstrom score | ≤5 | 125 | 16.0% (0.03) | 117 | 6.0% (0.02) | 2.67 (1.17, 6.09) |
>5 | 137 | 6.6% (0.02) | 124 | 4.0% (0.02) | 1.63 (0.56, 4.73) | |
Frequency of texting | <25/day | 122 | 13.8% (0.03) | 145 | 4.1% (0.02) | 3.37 (1.30, 8.70) |
≥25/day | 52 | 13.5% (0.05) | 74 | 9.5% (0.03) | 1.42 (0.53, 3.81) | |
Lives with smoker | Lives with smoker | 121 | 12.4% (0.03) | 112 | 2.7% (0.02) | 4.63 (1.38, 15.56) |
Does not live with smoker | 97 | 11.3% (0.03) | 89 | 7.9% (0.03) | 1.44 (0.59, 3.56) | |
Use of cessation aid | Used a recommended cessation aid | 111 | 15.3% (0.03) | 118 | 5.9% (0.02) | 2.58 (1.11, 5.99) |
No use of recommended cessation aid | 62 | 17.7% (0.05) | 59 | 8.5% (0.04) | 2.09 (0.77, 5.66) |
Note: Boldface indicates statistical significance (p<.05).
Chi-square analyses were conducted to examine outcomes across the intervention and control groups. Unadjusted risk ratios are presented. Outcome is biochemically confirmed repeated point prevalence abstinence. Missing data were imputed to indicate smoking.
p-values were not significant for test of the condition x subgroup interaction term in a logistic regression model and are not presented; p-value for study condition x race was marginally significant (p=0.06).
Program Engagement
For participants in the intervention group (n=262), program engagement was assessed. Based on computer records, most participants (85.1%) sent at least one text message to the computer system during the trial (excluding the keyword STOP). Participants who interacted with the system at least once had on average 28.47 (SD=25.81) interactions over the course of the 6 months of the program. Total keyword use was higher among biochemically confirmed repeated point prevalence abstainers (mean=35.21, SD=26.66) than non-abstainers (mean=22.87, SD=25.51) (p<0.05), with abstainers using approximately 12 more keywords.
In addition, 30.1% of participants (n=79) used the keyword STOP to unsubscribe from the program during the 6-month intervention period. For those who unsubscribed, participants unsubscribed an average of 61.22 days after enrollment (SD=58.23). The proportion of biochemically confirmed repeated point prevalence abstainers did not differ significantly between those who used the keyword STOP (n=5, 6%) and those who did not (n=24, 13%) (χ2[1, n=262]=2.58, p=0.11). Intervention group participants were also provided access to the Text2Quit website. Based on self-report, most participants reported that they had not logged onto the website in the past 7 days at the 1- (64%) and 3-month (81%) follow-ups.
Discussion
This study evaluated the efficacy of a facilitated text messaging program aimed at smokers searching for quit-smoking information on the Internet. The study results are encouraging. Participants who were randomized to receive Text2Quit had a greater likelihood of biochemically confirmed repeated point prevalence abstinence at 6 months post-enrollment, the primary outcome of the study. The biochemically confirmed quit rates —11.1% in the intervention group and 5.0% in the control—are roughly similar to those reported previously in other text messaging studies21 and to studies of population-based cessation methods like quitline phone counseling.22 No statistically significant differences among demographic subgroups were found, but there was a trend suggestive of a larger effect for non-whites compared with whites. The results from the secondary outcomes largely support the efficacy of the intervention with self–reported 7- and 30-day point prevalence estimates at 6 months significantly favoring the intervention group. However, although quit rates for biochemically confirmed abstinence at 6 months was higher among the intervention group, the difference was not statistically significant. The lack of a significant finding for this outcome indicates that future studies are warranted for the overall positive results to be conclusive.
This study has several strengths. The study addresses a gap in the literature identified by the Community Preventive Services Task Force regarding the application of mobile technology for smoking cessation in the U.S.5 and represents the first study of text messaging for smoking cessation in the U.S. with long-term follow-up and biochemical confirmation of smoking status. Although self-report is considered an adequate measure in population-based studies with low participant involvement,23–25 the decision to biochemically confirm smoking status was made because of the novel nature of the intervention. Like Free and colleagues,21 biochemical verification of self-reported quitters revealed significant discrepancies between self-reports and biochemically confirmed smoking status, with almost one quarter of those providing a saliva sample misrepresenting their smoking status. Other design strengths include that participants were recruited under real-world conditions with study ads shown in the moment of Google searches for quit-smoking information.26 In addition, with the exception of education, baseline demographic and smoking-related factors were well balanced across groups.
This study is also noteworthy because it tests a program that is widely offered in the U.S. through quitlines in combination with phone counseling.7 Our findings are suggestive that Text2Quit may improve quitting for quitline callers. However, further studies are needed because quitline callers may represent a distinct population from those recruited on the Internet, because text messaging may not confer additional benefits over and above those received through quitline phone counseling, and because Text2Quit was slightly modified for use with quitlines.
That participants were self-enrolled online and randomized by computer to the intervention group represents both a strength and a weakness. It represents a strength in that the automated enrollment procedures were not subjected to recruiter biases and may generalize better to real–world program enrollment conditions. However, given that many people initially expressed interest in the study and later declined to participate while other people enrolled in the study and were subsequently disqualified, self-enrollment on the Internet should be approached with caution. The study eventually benefited from several safeguards that were set up 3 months into the trial, including manually checking each phone number, handset verification, and using a CAPTCHA code. As very little is published on recruitment methods on the Internet (exceptions include Graham et al.27), additional studies are required to advance the science of Internet recruitment. Future studies should consider the use of additional safeguards such as removing information on financial compensation from study ads, using e-mails to verify contact participant information, and having interviewers call and verify participant contact information. It should be noted that although participants suspected to be fraudulent were removed from the study, these removals did not confound the randomization process, and any misrepresentation of participants should be non-differential and not explain our significant results. Furthermore, analyses revealed that those disqualified were largely similar across study groups.
A weakness of the study is that a national texting program became available during the study period. This implies that despite our best efforts, there may have been some contamination of the control group, whereby participants in the control group could have independently signed up for a smoking–cessation texting program. Indeed, 13 participants from the control group (5%) indicated on their 3-month survey that they had used a texting program for smoking cessation since enrolling in the study. This suggests that there was a low level of contamination in the control group with a texting program and that the magnitude of effects may be larger than those reported.
Other limitations include a low response rate (64.7%) among those eligible for providing a saliva sample for biochemical verification, although the response rate did not differ between intervention groups. Additionally, smokers recruited to the study represent a distinct group with specific attributes; therefore, study results may have limited generalizability. Smokers recruited to the study were already motivated to quit smoking and digitally connected, as all had access to the Internet and a working cell phone with unlimited text messaging.
Conclusions
The use of mobile phones is widespread in the U.S. and other parts of the world, with three quarters of adults globally having access to a mobile phone.28 The results from this trial of motivated smokers recruited on the Internet provides preliminary evidence of the relative efficacy of a facilitated text messaging intervention for smoking cessation. Studies are needed that compare text messaging programs to other established smoking–cessation treatments, as well as those that evaluate the efficacy of text messaging programs in the context of health systems, including quitlines where they are currently in use.
Acknowledgments
This research was supported by grant no. 5K07 CA124579-02 and the American Recovery and Reinvestment Act supplement to Dr. Lorien Abroms, from the National Cancer Institute of the NIH. Support also came from an award from the Department of Prevention and Community Health at the George Washington University School of Public Health and Health Services to Dr. Lorien Abroms.
Dr. Abroms would like to thank the research staff at George Washington University for their dedication to the study, including Amanda Davis, MPH and Meenakshi Ahuja, MPH. Dr. Abroms would like to thank Dr. Amanda Graham and colleagues at the Schroeder Institute for Tobacco Research and Policy Studies at Legacy for initial guidance on the conduct of the trial.
Footnotes
The George Washington University/Dr. Lorien Abroms has licensed the Text2Quit program to Voxiva, Inc.; Dr. Lorien Abroms has stock options in Voxiva, Inc.
Ashley L. Boal, Dr. Samuel Simmens, Judith Mendel, and Dr. Richard A. Windsor have no financial disclosures.
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- 1.CDC. The health benefits of smoking cessation: a report of the surgeon general. Rockville MD: USDHHS; 1990. http://profiles.nlm.nih.gov/ps/access/NNBBCV.pdf. [Google Scholar]
- 2.Mokdad AH, Marks JS, Stroup DF, Gerberding JL. Actual causes of death in the U.S 2000. JAMA. 2004;291(10):1238–45. doi: 10.1001/jama.291.10.1238. [DOI] [PubMed] [Google Scholar]
- 3.Whittaker R, McRobbie H, Bullen C, Borland R, Rodgers A, Gu Y. Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev. 2012;11:CD006611. doi: 10.1002/14651858.CD006611.pub3. [DOI] [PubMed] [Google Scholar]
- 4.Free C, Phillips G, Galli L, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med. 2013;10(1):e1001362. doi: 10.1371/journal.pmed.1001362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Task Force on Community Preventive Services. Increasing Tobacco Use Cessation: Mobile Phone-Based Interventions. thecommunityguide.org/tobacco/mobilephone.html.
- 6.North American Quitline Consortium. Results from the 2012 NAQC Annual Survey of Quitlines. naquitline.org/?page=2012Survey.
- 7.Paynter B. Small Business. New York: Bloomberg Businessweek; 2013. Yale startup GoBlue offers a tobacco cessation app. www.businessweek.com/articles/2013-05-16/yale-startup-goblue-offers-a-tobacco-cessation-app. [Google Scholar]
- 8.Abroms LC, Ahuja M, Kodl Y, et al. Text2Quit: Results from a pilot test of a personalized, interactive mobile health smoking cessation program. J Health Commun. 2012;17(1S):S44–S53. doi: 10.1080/10810730.2011.649159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Ybarra ML, Holtrop JS, Prescott TL, Rahbar MH, Strong D. Pilot RCT results of Stop My Smoking USA: a text messaging-based smoking cessation program for young adults. Nicotine Tob Res. 2013;15(8):1388–99. doi: 10.1093/ntr/nts339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Etter JF, Neidhart E, Bertrand S, Malafosse A, Bertrand D. Collecting saliva by mail for genetic and cotinine analyses in participants recruited through the Internet. Eur J Epidemiol. 2005;20(10):833–8. doi: 10.1007/s10654-005-2148-7. [DOI] [PubMed] [Google Scholar]
- 11.Foulds J, Bryant A, Stapleton J, Jarvis MJ, Russell MA. The stability of cotinine in unfrozen saliva mailed to the laboratory. Am J Public Health. 1994;84:1182–1223. doi: 10.2105/ajph.84.7.1182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.von Ahn L, Maurer B, McMillen C, Abraham D, Blum M. reCAPTCHA: human-based character recognition via web security measures. Science. 2008;321(5895):1465–8. doi: 10.1126/science.1160379. [DOI] [PubMed] [Google Scholar]
- 13.Hughes JR, Keely J, Niaura R, Ossip-Klein D, Richmond R, Swan G. Measures of abstinence from tobacco in clinical trials: issues and recommendations. Nicotine Tob Res. 2003;5(1):13–26. [PubMed] [Google Scholar]
- 14.West R, Hajek P, Stead L, Stapleton J. Outcome criteria in smoking cessation trials: proposal for a common standard. Addiction. 2005;100(3):299–303. doi: 10.1111/j.1360-0443.2004.00995.x. [DOI] [PubMed] [Google Scholar]
- 15.Jarvis MJ, Primatesta P, Erens B, Feyerabend C, Bryant A. Measuring nicotine intake in population surveys: comparability of saliva cotinine and plasma cotinine estimates. Nicotine Tob Res. 2003;5(3):349–55. doi: 10.1080/1462220031000094213. [DOI] [PubMed] [Google Scholar]
- 16.Heatherton TF, Kozlowski LT, Frecker RC, Fagerstrom KO. The Fagerstrom Test for nicotine dependence: a revision of the Fagerstrom Tolerance Questionnaire. Br J Addict. 1991;86(9):1119–27. doi: 10.1111/j.1360-0443.1991.tb01879.x. [DOI] [PubMed] [Google Scholar]
- 17.Fiore MC, Jaén CR, Baker TB, et al. Clinical practice guideline. Rockville MD: USDHHS, Public Health Services; 2008. Treating tobacco use and dependence: 2008 update. ncbi.nlm.nih.gov/books/NBK63952/ [Google Scholar]
- 18.Bandura A. Social foundations of thought and action: a social cognitive theory. 1. Englewood Cliffs NJ: Prentice–Hall; 1986. [Google Scholar]
- 19.Prokhorov AV, Kelder SH, Shegog R, et al. Impact of A Smoking Prevention Interactive Experience (ASPIRE), an interactive, multimedia smoking prevention and cessation curriculum for culturally diverse high-school students. Nicotine Tob Res. 2008;10(9):1477–85. doi: 10.1080/14622200802323183. [DOI] [PubMed] [Google Scholar]
- 20.National Cancer Institute, NIH, USDHHS. Clearing the air: quit smoking today. Bethesda MD: National Institutes of Health; 2008. [Google Scholar]
- 21.Free C, Knight R, Robertson S, et al. Smoking cessation support delivered via mobile phone text messaging (txt2stop): a single-blind, randomized trial. Lancet. 2011;378(9785):49–55. doi: 10.1016/S0140-6736(11)60701-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Stead LF, Perera R, Lancaster T. Telephone counselling for smoking cessation. Cochrane Database Syst Rev. 2006;3:CD002850. doi: 10.1002/14651858.CD002850.pub2. [DOI] [PubMed] [Google Scholar]
- 23.Caponnetto P, Polosa R. Common predictors of smoking cessation in clinical practice. J Respir Med. 2008;102:1182–92. doi: 10.1016/j.rmed.2008.02.017. [DOI] [PubMed] [Google Scholar]
- 24.Benowitz NL, Ahijevych K, Hall S, et al. Biochemical verification of tobacco use and cessation. Nicotine Tob Res. 2002;4(2):149–59. doi: 10.1080/14622200210123581. [DOI] [PubMed] [Google Scholar]
- 25.Patrick D, Cheadle A, Thompson D, Diehr P, Koepsell T, Kinne S. The validity of self-reported smoking: a review and meta-analysis. Am J Public Health. 1994;84(7):1086–93. doi: 10.2105/ajph.84.7.1086. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Graham AL, Cobb NK, Papandonatos GD, et al. A randomized trial of internet and telephone treatment for smoking cessation. Arch Intern Med. 2011;171(1):46–53. doi: 10.1001/archinternmed.2010.451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Graham AL, Bock BC, Cobb NK, Niaura R, Abrams DB. Characteristics of smokers reached and recruited to an Internet smoking cessation trial: a case of denominators. Nicotine Tob Res. 2006;8(1S):S49–S57. doi: 10.1080/14622200601042521. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.The World Bank. Mobile Phone Access Reaches Three Quarters of Planet’s Population. worldbank.org/en/news/press-release/2012/07/17/mobile-phone-access-reaches-three-quarters-planets-population.