Abstract
Background
Public safety personnel (PSP) are exposed to traumatic events due to their work environments, which increases the risk of mental health challenges. Providing effective and evidence-based interventions, such as SMS text messaging programs, can improve PSP's overall mental well-being with high user satisfaction rates.
Objective
This study aims to evaluate users’ satisfaction, receptiveness, and perceptions of a cognitive behavioral therapy (CBT)–based supportive SMS text messaging intervention (Text4PTSI).
Methods
Participants self-subscribed to Text4PTSI and received unidirectional cognitive behavioral–based supportive text messages for 6 months. Participants completed a web-based survey delivered via SMS text message at enrollment, and 6 weeks, 3 months, and 6 months post enrollment. Respondents’ perception and receptivity of the program were assessed using a questionnaire measured on a 5-point Likert scale. Data were collected as categorical variables, and overall satisfaction with the Text4PTSI program was measured on a scale from 0 to 100.
Results
There were 131 subscribers to the Text4PTSI program; however, only 81 subscribers responded to the survey, producing 100 survey responses across the 3 follow-up time points. The overall mean score of satisfaction was 85.12 (SD 13.35). More than half of the survey responses agreed or strongly agreed that Text4PTSI helped participants cope with anxiety (79/100 responses, 79%), depressive symptoms (72/100 responses, 72%), and loneliness (54/100 responses, 54%). Similarly, most of the survey responses agreed or strongly agreed that the Text4PTSI program made respondents feel connected to a support system, improved their overall mental well-being (84/100 responses, 84%), felt more hopeful about managing concerns about their mental health or substance use (82 out of responses, 82%), and helped enhance their overall quality of life (77/100 responses, 77%). The available survey responses suggest that the majority always read the supportive text messages (84/100 responses, 84%), took time to reflect on each message (75/100 responses, 75%), and returned to read the text messages more than once (76/100 responses, 76%).
Conclusions
PSP who responded to the follow-up surveys reported high user satisfaction and appreciation for receiving the Text4PTSI intervention during the 6-month program. The reported satisfaction with the service provided could pave the way to ensuring a better uptake of the service with potential effectiveness to end users.
Keywords: public safety personnel, Text4PTSI, text messaging, satisfaction, occupational health, work safety, public safety, digital health intervention, mental health service, user satisfaction
Introduction
Mental well-being is an important issue for public safety personnel (PSP) in Canada, as these individuals often experience high levels of stress and psychological trauma due to their occupations. The definition of PSP advancing includes but is not limited to the paramedic, police, correctional workers, firefighters, and all first responder groups [1]. The stressors at work can lead to various mental health challenges, including depression, anxiety, and posttraumatic stress disorder [2-5].
The challenging and complex nature of PSP’s work is one of the main sources of stress. These individuals are often exposed to traumatic events, such as accidents, natural disasters, and violent crimes [2-5]. These often unpredictable events can significantly negatively affect their mental health, as they may struggle to cope with the emotional impact of these often psychologically traumatic and morally ambiguous events. Additionally, PSP often work long and irregular hours, making it challenging to maintain a healthy lifestyle and work-life balance. Another source of stress for PSP may include the culture of their organizations [6]. Many public safety agencies have a culture of stoicism and toughness, which can discourage employees from seeking help for mental health problems. The workplace environment can make it difficult for PSP to seek out the necessary support they need to cope with the stress and psychological trauma of their work [2-5].
A study among Canadian PSP revealed that about 44.5% self-reported at least 1 mental disorder [7,8]. To address these issues, several initiatives have been aimed at promoting the mental well-being of PSP in Canada. Some of these programs provide training and resources to help PSP cope with the stress and psychological trauma of their work [9]. Additionally, many public safety agencies have employee assistance programs that provide confidential counseling and support to employees struggling with mental health concerns [10].
However, despite these supportive efforts, there is still work to be done to improve the mental well-being of PSP in Canada. The Canadian Institute for Public Safety Research and Treatment reports that 44.5% of PSP in Canada screened positive for 1 or more mental health symptoms [11]. Some of the gaps relate to these personnel’s mental health care–seeking behavior. Another study identified how PSP are hesitant to access mental health services [12]. Despite attempts to reduce the barriers experienced by PSP when they are accessing mental health services, stigma and geographical barriers inhibit demand for and success to care [8].
While several interventions for PSP, ranging from pharmacology to psychotherapies, have been described in the research literature [13], it is essential to deliver accessible, effective, and economic remote access technologies such as supportive text messages, which are evidence-based and practical techniques for reducing and managing mental health conditions [14-21]. The usage of mobile technologies in mental health is relatively new and novel, although other areas of health practice have used text messaging systems [20,22,23]. In community-based studies, individuals with severe mental health conditions possess mobile phones and are willing to use the telephone for recovery support [24,25]. Additionally, interventions delivered via telephone show reduced attrition compared to face-to-face programs, which reduces geographical barriers [26].
When supportive intervention is provided, most studies have demonstrated a decrease in mental health symptoms. For example, in a longitudinal study to assess the effectiveness of an SMS text message intervention, PSP who subscribed to the texting program reported that they were able to manage depression, anxiety, and other psychological symptoms [6]. Similarly, 10 randomized controlled trials providing therapeutic intervention through texting demonstrated a substantial improvement in psychological symptoms compared to conventional treatment [27]. A qualitative analysis of a stakeholder perspectives intervention for PSP revealed that they believe that an internet cognitive behavioral therapy (iCBT) intervention is an appropriate treatment option to address mental health issues among Canadian PSP [28]. In addition, the findings from supportive text messaging programs like Text4Hope and Text4Mood suggested that mental health symptoms among respondents were minimized after receiving the supportive texts compared to respondents’ baseline scores on the self-reported validated scales [14,20]. Beyond the effectiveness of these interventions, services must also be acceptable to those who use them [29]. User satisfaction is known to affect client retention and clinical outcomes of interventions [30]. In this study, we evaluate the satisfaction of PSP with Text4PTSI, an evidence-based intervention to improve the mental well-being and provide support to those experiencing PTSI.
We hypothesize that participants who subscribe to the Text4PTSI program will have high user satisfaction, positive program perceptions, and receptivity, which will remain stable over time. Hence, we propose the following research questions: (1) how satisfied are subscribers with the Text4PTSI program for 6 weeks, 3 months, and 6 months? (2) what are the participants’ perceptions of the Text4PTSI program at 6 weeks, 3 months, and 6 months? and (3) how are the satisfaction rates and subscriber perception of Text4PTSI similar or dissimilar across the 3 time points?
Methods
Study Design
This research was designed as a longitudinal cross-sectional study, which assessed participants’ satisfaction and experiences with the Text4PTSI program at 6 weeks, 3 months, and 6 months post intervention. The sample reported in this study is less than anticipated since PSPs who subscribed to the Text4PTSI program were less than 10% of the projected 5000 subscribers indicated in the published protocol.
Text4PTSI Program and Data Collection
Text4PTSI was launched in July 2021 to support PSP’s mental health in Alberta, Canada [31,32]. The targeted PSP group included emergency department health workers, paramedics, and police and law enforcement agents. This innovative program provides supportive text messages to PSP to prevent and manage posttraumatic stress disorder and other common mental health symptoms. The text messages are based on CBT principles [33]. The messages had a 160-character limit written by cognitive behavioral therapists in partnership with patients and other mental health professionals who addressed the aspects of potential psychological stress, anxiety, and depression. Examples of the text messages sent are:
Trauma can feel like a gloomy cloud over all areas of your life. The first step in treatment is to understand what trauma is, the symptoms, and how and why it is treated.
If you find yourself worrying excessively, make some boundaries with these thoughts. Jot down your worries throughout the day and let them go. Then set a time aside for 20 minutes to review what you wrote down.
Similar programs have demonstrated effectiveness in mitigating mental health symptoms like mood disorders in the general population with high user satisfaction rates. For example, a study on the impact of supportive messages among subscribers of Text4Mood reported that about 82% of the respondents felt hopeful about managing life issues and experienced an overall mental well-being [20].
Data collection procedures used in this study are described in the published study protocol [33]. In summary, PSPs enroll in the program by texting “PTSI” to 1-844-990-4343. From the day of enrollment, participants receive 1 text daily, which is unidirectional computer-programmed supportive text messages. These messages are based on CBT principles. Users are at an advantage similar to CBT sessions, where a therapist helps participants to evaluate and challenge negative thoughts, feelings, and emotions [32]. Participants are also invited to complete a web-based program evaluation at 6 weeks, 3 months, and 6 months after enrolling in the intervention. The survey generally took 5 to 10 minutes to complete using their cell phones.
Participation in the Text4PTSI program was voluntary, with no incentives. Receiving supportive messages was independent of survey completion. Participants could opt out of the program at any time by texting back the word “STOP.”
Satisfaction data were collected between September 7, 2021, and October 27, 2022. Figure 1 illustrates the participants' pathways when completing the surveys at each designated time point.
Figure 1.
Study flowchart.
Ethics Approval
The Text4PTSI study received ethical approval from the University of Alberta Health Research Ethics Board (Pro00108966) [33]. Informed consent was implied by all study participants after they had read the web-based information leaflet, completed the web-based survey, and returned their responses.
Outcome Measures
The primary outcome measure was the participants’ overall satisfaction with the Text4PTSI program, which delivered to subscribers daily supportive text messages designed to support mental health. Responses were calculated by using subscribers’ responses to 1 question “Using any number from 0 (not at all satisfied) to 100 (very satisfied), how would you rate your overall satisfaction with Text4PTSI?”
Secondary outcomes included the perceived impacts of the program on participants’ mental health and feedback of the supportive text messages at 6 weeks, 3 months, and 6 months from enrollment. Text4PTSI participants provided feedback on the text messaging intervention by responding to questions assessing the following two focal areas:
Perception on how participants coped with stress, anxiety, and depression; connection to a support system; quality of life; and overall mental wellness after receiving the daily supportive text messages (6 weeks, 3 months, and 6 months): The questionnaire was measured on a 5-point Likert scale; agree, strongly agree, neutral, disagree, and strongly disagree. For the purpose of analyses, responses were collapsed into 3 points: agree or strongly agree, neutral, and disagree or strongly disagree.
Receptivity of the Text4PTSI program: These questionnaires were assessed on a 5-point Likert scale: always, often, sometimes, rarely, and never.
Although reliability and validity measures for the satisfaction scale have not been assessed, the survey questions have been used in previous studies to evaluate user satisfaction with similar supportive text messaging programs [20,34].
Data Analyses
Data were analyzed using SPSS (version 25; IBM Corp) statistical software for Windows [35]. Participants’ satisfaction data were presented as a continuous variable. We measured participants’ overall satisfaction by rating the program from 0 to 100 (0=very dissatisfied, 50=neutral, and 100=very satisfied). The data were reported as means and SDs.
We summarized the satisfaction and participants’ perception of the program at different time points (6 weeks, 3 months, and 6 months). Satisfaction data were presented as categorical variables and reported as frequency and percentages across all the study participants at all 3 time points. The average percentage of all 3 time points was then tabulated and reported.
A chi-square analysis was run to examine any differences in reporting satisfaction across the 3 time points. There was no imputation for missing data, and the results were based on completed survey responses.
Results
Overview
As illustrated in Figure 1, participating individuals who subscribed to the Text4PTSI program were 131 which produced 100 usable individual survey responses across the 3 follow-up time points (39 at 6 weeks, 23 at 3 months, and 38 at 6 months), of which 81 respondents completed the survey. Since the expectation was that 131×3 respondents would respond to the survey at the 3 time points, the response rate yielded in this study was 25.4% (100/393). Reported demographic data are provided in Table 1. Police and law enforcement agents were the majority of respondents, followed by female (47/81, 58%), White (63/81, 78%), obtained postsecondary education (68/81, 84%), employed (71/81, 88%), in a relationship (58/81, 73%), and own home (57/81, 70%). The majority of the subscribers were between 31 and 45 years of age.
Table 1.
Demographic data of study subscribers.
| Variablea | Participants, n (%) | |
| Public safety personnel | ||
|
|
Emergency department health workers | 8 (12) |
|
|
Paramedics | 19 (30) |
|
|
Police and law enforcement agents | 30 (47) |
|
|
Other | 7 (11) |
| Age groups (years) | ||
|
|
≤30 | 14 (18) |
|
|
31-45 | 31 (39) |
|
|
46-60 | 25 (31) |
|
|
>60 | 10 (12) |
| Gender | ||
|
|
Female | 47 (58) |
|
|
Male | 31 (38) |
|
|
Nonbinary | 3 (4) |
| Ethnicity | ||
|
|
White | 63 (78) |
|
|
Non-White | 18 (22) |
| Education level | ||
|
|
Postsecondary education | 68 (84) |
|
|
Other | 13 (16) |
| Employment status | ||
|
|
Employed | 71 (88) |
|
|
Unemployed | 10 (12) |
| Relationship status | ||
|
|
In a relationship | 58 (73) |
|
|
Not in a relationship | 22 (27) |
| Housing status | ||
|
|
Own a home | 57 (70) |
|
|
Renting | 17 (21) |
|
|
Living with family | 7 (9) |
aNot all participants provided a response.
Participants’ Satisfaction, Perceptions, and Receptivity
Participants rated the program by indicating their overall satisfaction on a scale of 0-100, with zero indicating very dissatisfied, 50 indicating neutral (neither satisfied nor dissatisfied), and 100 representing very satisfied. The total number of participants providing their feedback was 100, with an overall satisfaction mean score of 85.12 (SD 13.35). The descriptive analysis also recorded a mean 95% CI of 82.5-87.8. This result indicates that, overall, respondents were satisfied with the Text4PTSI program.
Table 2 represents the level of agreement regarding the Text4PTSI program and its benefits to users. Table 2 indicates 79 out of 100 (79%) survey responses agreed or strongly agreed that the supportive text messages helped cope with anxiety, 72 responses (72%) reported the messages helped them cope with depression and 54 (54%) reported the messages helped them cope with loneliness. In addition, 84 out of 100 responses (84%) agreed or strongly agreed the Text4PTSI program made participants feel connected to a support system and improved their overall mental well-being. Overall, 82 out of 100 responses (82%) indicated they felt hopeful about managing concerns with their mental health or substance use; and 77 out of 100 responses (77%) agreed or strongly agreed that supportive text messages enhanced their quality of life.
Table 2.
Perceived impact of daily messages postintervention at all 3 time points.
| Perceived impact of Text4PTSI | Six weeks, n (%) | Three months, n (%) | Six months, n (%) | Total, n (%) | |||||
| Helped participants to cope with anxiety | |||||||||
|
|
Agree or strongly agree | 32 (82) | 18 (78) | 29 (76) | 79 (79) | ||||
|
|
Neutral | 6 (15) | 5 (22) | 9 (24) | 20 (20) | ||||
|
|
Disagree or strongly disagree | 1 (3) | 0 (0) | 0 (0) | 1 (1) | ||||
| Helped participants to cope with depression | |||||||||
|
|
Agree or strongly agree | 25 (64) | 17 (74) | 30 (79) | 72 (72) | ||||
|
|
Neutral | 12 (31) | 5 (22) | 7 (18) | 24 (24) | ||||
|
|
Disagree or strongly disagree | 2 (5) | 1 (4) | 1 (3) | 4 (4) | ||||
| Helped participants to cope with loneliness | |||||||||
|
|
Agree or strongly agree | 20 (51) | 14 (61) | 20 (53) | 54 (54) | ||||
|
|
Neutral | 16 (41.) | 7 (30) | 11 (29) | 34 (34) | ||||
|
|
Disagree or strongly disagree | 3 (8) | 2 (9) | 7 (18) | 12 (12) | ||||
| Participants felt connected to a support system | |||||||||
|
|
Agree or Strongly agree | 34 (87) | 18 (78) | 32 (84) | 84 (84) | ||||
|
|
Neutral | 4 (10) | 5 (22) | 4 (11) | 13 (13) | ||||
|
|
Disagree or strongly disagree | 1 (3) | 0 (0) | 2 (5) | 3 (3) | ||||
| Helped participants feel hopeful to manage mental health or substance use concerns | |||||||||
|
|
Agree or strongly agree | 32 (82) | 19 (83) | 31 (82) | 82 (82) | ||||
|
|
Neutral | 7 (18) | 4 (17) | 7 (18) | 18 (18) | ||||
| Helped participants improve their overall mental well-being | |||||||||
|
|
Agree or Strongly agree | 30 (77) | 20 (87) | 34 (89) | 84 (84) | ||||
|
|
Neutral | 9 (23) | 2 (9) | 3 (8) | 14 (14) | ||||
|
|
Disagree or strongly disagree | 0 (0) | 1 (4) | 1 (3) | 2 (2) | ||||
| Helped participants enhance their quality of life | |||||||||
|
|
Agree or strongly agree | 29 (74) | 17 (74) | 31 (82) | 77 (77) | ||||
|
|
Neutral | 9 (23) | 5 (22) | 7 (18) | 21 (21) | ||||
|
|
Disagree or strongly disagree | 1 (3) | 1 (4) | 0 (0) | 2 (2) | ||||
Table 3 shows participants’ perceptions of the supportive text message program 6 weeks, 3 months, and 6 months post intervention. Overall, some of the responses suggested SMS text messages were always positive, affirmative, and succinct. The supportive text messages were always inclusive and relevant to participants’ identity background (eg, age, gender, ethnicity, sexual orientation, and gender identity). Table 3 suggests that more than half of the respondents always read the SMS text messages and took time to reflect on the message while indicating and receiving the supportive text messages once daily. In comparison, 76 out of 100 responses (76%) suggested that at least sometimes they return to read the supportive text messages more than once. The supportive text messages were delivered once daily; 93 out of 100 responses (93%) indicated the majority of participants were satisfied with the frequency.
Table 3.
Participants’ feedback 6 weeks, 3 months, and 6 months after the intervention.
| Feedback | Six weeks, n (%) | Three months, n (%) | Six months, n (%) | Total, n (%) | |||||
| The Text4Hope text messages were positive | |||||||||
|
|
Always | 26 (67) | 15 (65) | 25 (66) | 66 (66) | ||||
|
|
Often | 11 (28) | 8 (35) | 13 (34) | 32 (32) | ||||
|
|
Sometimes | 1 (3) | 0 (0) | 0 (0) | 1 (1) | ||||
|
|
Rarely | 1 (3) | 0 (0) | 0 (0) | 1 (1) | ||||
| The Text4Hope-Addiction text messages were affirmative | |||||||||
|
|
Always | 25 (64) | 15 (65) | 25 (66) | 65 (65) | ||||
|
|
Often | 12 (31) | 8 (35) | 12 (31) | 32 (32) | ||||
|
|
Sometimes | 1 (3) | 0 (0) | 1 (3) | 2 (2) | ||||
|
|
Rarely | 1 (3) | 0 (0) | 0 (0) | 1 (1) | ||||
| The Text4Hope-Addiction text messages were succinct | |||||||||
|
|
Always | 23 (59) | 13 (57) | 22 (58) | 58 (58) | ||||
|
|
Often | 12 (31) | 10 (43) | 14 (37) | 36 (36) | ||||
|
|
Sometimes | 3 (8) | 0 (0) | 2 (5) | 5 (5) | ||||
|
|
Rarely | 1 (3) | 0 (0) | 0 (0) | 1 (1) | ||||
| Inclusive of and relevant to my identity background | |||||||||
|
|
Always | 24 (61) | 15 (65) | 21 (55) | 60 (60) | ||||
|
|
Often | 11 (28) | 8 (35) | 14 (37) | 33 (33) | ||||
|
|
Sometimes | 3 (8) | 0 (0) | 3 (8) | 6 (6) | ||||
|
|
Never | 1 (3) | 0 (0) | 0 (0) | 1 (1) | ||||
| Frequency reading the Text4PTSI text messages | |||||||||
|
|
Always | 31 (79) | 20 (87) | 33 (87) | 84 (84) | ||||
|
|
Often | 7 (18) | 3 (13) | 4 (10) | 14 (14) | ||||
|
|
Sometimes | 1 (3) | 0 (0) | 1 (3) | 2 (2) | ||||
| Action taken after reading text messages | |||||||||
|
|
Read the text and took no action | 6 (15) | 2 (9) | 3 (8) | 11 (11) | ||||
|
|
Read the text and took time to reflect on the message | 26 (67) | 17 (74) | 32 (84) | 75 (75) | ||||
|
|
Read the text and took a positive or beneficial action | 7 (18) | 4 (17) | 3 (8) | 14 (14) | ||||
| Return to reading Text4PTSI text messages more than once | |||||||||
|
|
Always | 3 (8) | 1 (4) | 4 (10) | 8 (8) | ||||
|
|
Often | 7 (18) | 5 (22) | 11 (29) | 23 (23) | ||||
|
|
Sometimes | 17 (44) | 10 (44) | 18 (47) | 45 (45) | ||||
|
|
Rarely | 10 (25) | 4 (17) | 4 (10) | 18 (18) | ||||
|
|
Never | 2 (5) | 3 (13) | 1 (3) | 6 (6) | ||||
| Satisfaction with the frequency of the Text4PTSI text messages | |||||||||
|
|
Satisfied | 34 (87) | 22 (96) | 37 (97) | 93 (93) | ||||
|
|
Neutral | 5 (13) | 1 (4) | 1 (3) | 7 (7) | ||||
| Frequency participants prefer to receive supportive text messages | |||||||||
|
|
Twice daily | 2 (5) | 2 (9) | 4 (11) | 8 (8) | ||||
|
|
Once daily | 30 (77) | 16 (70) | 29 (76) | 75 (75) | ||||
|
|
Once every other day | 5 (13) | 4 (17) | 2 (5) | 11 (11) | ||||
|
|
Once weekly | 2 (5) | 1 (4) | 3 (8) | 6 (6) | ||||
Overall, the chi-square analysis revealed no significant difference in reporting the different satisfaction items among the 3 time points.
Discussion
Principal Findings
This study presents novel findings on how PSP perceived daily supportive text messages and their receptiveness to the Text4PTSI program. The results from the study indicated high respondents’ satisfaction with the program, with a mean score of 85.12 (SD 13.35) that is similar to other studies [34,36]. Overall, the majority of survey responses agreed or strongly agreed with the intervention’s positive effect in helping participants cope with anxiety, depressive symptoms, and loneliness and feel connected to a support system postintervention. The Text4PTSI program helped most respondents feel hopeful about managing their mental health or substance use concerns, improving their overall mental well-being and quality of life.
The survey responses suggested participants were satisfied with the frequency of the messages, and 3 in 4 (75%) responses suggested participants would prefer to receive supportive text messages once daily. Similarly, the majority of responses reported that participants perceived supportive text messages as always positive, affirmative, and succinct. In addition, the supportive text messages were reported as always inclusive and relevant to 60 (60%) of the respondents’ identity background (eg, age, gender, ethnicity, sexual orientation, and gender identity), while respondents always or often read the messages and took time to reflect on the messages.
Reported satisfaction with the Text4PTSI program aligns with satisfaction with other supportive text messaging programs geared toward improving the mental health of subscribers [20,34,37]. For example, an SMS text messaging intervention program delivering a daily supportive text message during the COVID-19 pandemic reported a mean overall participant satisfaction of 8.55 [34], which is consistent with the findings from this study. Similarly, after 12 weeks of a text messaging intervention for smoking cessation, nearly 91% (40/44) of the participants expressed high satisfaction with the program [36]. These findings suggest that respondents are satisfied when supportive messages are incorporated into their care.
High satisfaction with the Text4PTSI intervention implies respondents benefit from the program and highly recommend Text4PTSI to help broadly manage the mental health burden of PSP. A study among first responders, which focused on the usage of telehealth care, reported that out of 38 individuals who were recommended to seek mental health services, about 29 (76%) agreed to adhere to treatment via web-based or telehealth means [38].
PSP often benefit from evidence-based iCBT to assist with mental health symptoms, process emotions, and address potentially traumatic or morally distressing events. Qualitative research reveals that PSP positively perceives iCBT intervention to manage their mental health concerns [28].
Our study results aligned with similar studies focused on other PSP or who use a similar texting service. Another program providing supportive care based on iCBT revealed similar results among PSP [39]. The research team reported that 87% (54/62) of PSP who participated in the iCBT program experienced high confidence in managing their mental health symptoms. Almost all 98% (61/62) agreed that the program was effective [39]. Consistent with the later study, the findings from this study demonstrated how most participants agreed that Text4PTSI helped them to cope with various mental health symptoms albeit with lower proportions. This study’s results are also slightly higher than those of a similar program [34]. The Text4Hope program, which delivered supportive interventions to individuals through texting, reported that, after 6 weeks of providing the intervention, 76% of their study sample reported that they could cope with their anxiety symptoms, 56% could cope with any depression symptoms, while 49% were able to cope with loneliness [34]. Furthermore, the effectiveness of Text4PTSI improved participants’ overall well-being, and participants reported improved quality of life with a follow-up prevalence. Supportive texting programs like Text4PTSI support the growing evidence indicating that iCBT and a supportive text message intervention can potentially improve participants’ addiction, mental health, and quality of life for most PSP [39-41]. Hence, when these supportive messages are delivered to individuals, the messages have the prospect of improving overall well-being.
Text messaging technology can help improve access to health care in an era of inadequate health resources. Six months after the Text4PTSI program, 87.2% of study responses agreed or strongly agreed that they felt connected to a support system. This result aligns with the research literature indicating how supportive text messages can expand one’s perceived support network and increase personal support systems [41]. The findings also correspond with the belief that text message technology has the prospect of delivering remote health care to people [37,42]. This result may reflect PSPs need to connect with a health care system to bridge the gap in using mental health support and services. Notwithstanding, individuals who do not sign up for such supportive text interventions may not benefit.
Recent studies indicate how mental health interventions delivered via mobile phones are positive, affirmative, and relevant [20,34,43,44]. In research where supportive text messages were delivered to manage drug addiction, users felt the messages were positive and positively impacted their way of life [45]. Consistent with our study, 99% of respondents agreed that the content of the supportive text messaging was inclusive of and relevant to their identity background and the supportive text messages addressed potential differences in age, gender, ethnicity, and gender identity. Hence, respondents were satisfied with the SMS text messages they received. These results reflect why study participants agree text messages are positive, affirmative, and relevant sources of mental health support and when these interventions are continuously delivered will positively impact the mental health of individuals.
This study included questions about how participants return to read, reflect, and take action after reading the supportive text messages they received. Reflective and impulsive processes are correlated and intentionally help individuals identify their intentions and activities and develop coping skills [46]. Across the follow-up postintervention, our study recorded a consistent increase in the positive action taken after reading supportive text messages. At 6 weeks, 3 months, and 6 months, 66.7%, 73.9%, and 84.2% of the respondents, respectively, read the text and took time to reflect on the message, while 14% read and took positive action. This is consistent with a similar study from Alberta, Canada, which provided supportive text messages primarily to patients with depressive or anxiety symptoms and others [20]. Another study providing supportive text messages during the pandemic reported that 76% of respondents read and reflected on the text [34]. In a randomized controlled trial to assess the feasibility of health intervention delivered through email or text messages, results revealed that 83% of participants in the text message group read all or almost all the messages [47]. The messages from the Text4PTSI were based on CBT and trauma therapy principles and crafted by mental health professionals along with service users, thus encouraging the participants to read and reflect on the texts. The results also may also explain why 76% at least sometimes read the messages more than once. When an intervention is acceptable and effective, patients are more likely to accept the treatment and desire to continue with the intervention [48]. Participants in our study reported being satisfied with the frequency of text messages (93%). While according to the literature, user ratings of a given service may provide limited evidence about the value of an intervention (eg, social desirability) [49], when individuals are content with the frequency and time they receive text messages, it increases their chance of engaging with the text, with approximately 91% of texts read within the first few minutes of receipt [50].
Limitations
There are several limitations to the study, which need to be considered when interpreting the results. First, the web-based questionnaire to measure the satisfaction and perception of the study participant was not a validated instrument and may limit the confidence of user satisfaction rates. Second, our sample was not randomized; it would have been ideal to include a control group to compare Text4PTSI subscribers’ and nonsubscribers’ satisfaction, perception, and impact of the program on their mental health. Third, the number of first responders who subscribed to the Text4PTSI program was less than 10% of the projected 5000 subscribers indicated in the published protocol [33]. Challenges associated with the adoption and promotion of the program by first responder organizations in Alberta, despite the initiative being a government-funded program, contributed to the low uptake overall.
Fourth, the sample size of participants who completed all follow-up assessments was fairly small, which may be attributed to participants who still needed to complete the survey and those providing incomplete responses. Out of the 131 subscribers, only 81 responded to the survey. A total of 393 responses were expected during the follow-up; however, 100 survey responses were provided by participants. In addition, the low sample size may be a result of the web-based nature of the surveys. Surveys delivered via SMS text messages are less likely to retain participants for follow-up assessment than paper-based surveys [51].
Notwithstanding these limitations, the findings from our study suggest that text-based health interventions designed for PSP have high satisfaction rates and may be beneficial to improve quality of life and help bridge the gap in seeking mental health services.
Conclusions
Our results highlighted findings relating to the rationale for PSP’s desire to subscribe to supportive text messaging programs. The study generated important insights into the self-reported perception of supportive text messages that improved quality of life and overall mental well-being; coping with anxiety, depression, and loneliness; and being connected to a support network. These results are derived from a few samples who completed the follow-up survey; more research is needed to better understand what is happening with nonrespondents. Additionally, future randomized controlled studies are recommended to comprehensively assess the impact, user satisfaction, perception, and receptivity of the SMS text messaging intervention on PSP and can be scaled up to other occupations, and to better understand the reasons why study participants may opt not to respond to the study surveys that could assess their well-being and satisfaction with the service. Furthermore, research needs to explore possible ways that could be used to reach those who do not respond to the surveys. SMS text messages have fewer character limits, which may improve the participants’ desire to read.
The results of this study provide additional evidence for scale up and spread of supportive text message interventions for PSP and other stressful occupations.
Acknowledgments
The study received a grant from the Alberta Labour and Immigration Department, Government of Alberta.
Abbreviations
- CBT
cognitive behavioral therapy
- iCBT
internet cognitive behavioral therapy
- PSP
public safety personnel
Data Availability
Data associated with this study will be made freely available upon reasonable request to the corresponding author.
Footnotes
Authors' Contributions: VIOA conceived, designed, and supervised the study. RS, GO-D, and VIOA analyzed the data. GO-D wrote the initial draft, while VIOA, GO-D, EE, RS, BA, NP, SE, KW, CH, RdLD, CJ, SBP, YZ, and AJG edited and revised the manuscript. All authors contributed to the study design and approval of the manuscript.
Conflicts of Interest: None declared.
References
- 1.Canadian Institute for Public Safety Research and Treatment (CIPSRT) Glossary of terms: a shared understanding of the common terms used to describe psychological trauma. University of Regina. 2019. [2019-12-05]. https://ourspace.uregina.ca/handle/10294/9055 .
- 2.Obuobi-Donkor G, Oluwasina F, Nkire N, Agyapong VIO. A scoping review on the prevalence and determinants of post-traumatic stress disorder among military personnel and firefighters: implications for public policy and practice. Int J Environ Res Public Health. 2022;19(3):1565. doi: 10.3390/ijerph19031565. https://www.mdpi.com/resolver?pii=ijerph19031565 .ijerph19031565 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Haugen PT, McCrillis AM, Smid GE, Nijdam MJ. Mental health stigma and barriers to mental health care for first responders: a systematic review and meta-analysis. J Psychiatr Res. 2017;94:218–229. doi: 10.1016/j.jpsychires.2017.08.001.S0022-3956(17)30510-1 [DOI] [PubMed] [Google Scholar]
- 4.Szeto A, Dobson KS, Knaak S. The road to mental readiness for first responders: a meta-analysis of program outcomes. Can J Psychiatry. 2019;64(1_suppl):18S–29S. doi: 10.1177/0706743719842562. https://journals.sagepub.com/doi/10.1177/0706743719842562 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Carleton RN, Afifi TO, Taillieu T, Turner S, El-Gabalawy R, Sareen J, Asmundson GJG. Anxiety-related psychopathology and chronic pain comorbidity among public safety personnel. J Anxiety Disord. 2018;55:48–55. doi: 10.1016/j.janxdis.2018.03.006. https://linkinghub.elsevier.com/retrieve/pii/S0887-6185(17)30581-9 .S0887-6185(17)30581-9 [DOI] [PubMed] [Google Scholar]
- 6.Obuobi-Donkor G, Shalaby R, Eboreime E, Agyapong B, Phung N, Eyben S, Wells K, Hilario C, da Luz Dias RDL, Jones C, Brémault-Phillips S, Zhang Y, Greenshaw AJ, Agyapong VIO. Text4PTSI: a promising supportive text messaging program to mitigate psychological symptoms in public safety personnel. Int J Environ Res Public Health. 2023;20(5):4215. doi: 10.3390/ijerph20054215. https://www.mdpi.com/resolver?pii=ijerph20054215 .ijerph20054215 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Carleton RN, Afifi TO, Turner S, Taillieu T, Duranceau S, LeBouthillier DM, Sareen J, Ricciardelli R, MacPhee RS, Groll D, Hozempa K, Brunet A, Weekes JR, Griffiths CT, Abrams KJ, Jones NA, Beshai S, Cramm HA, Dobson KS, Hatcher S, Keane TM, Stewart SH, Asmundson GJG. Mental disorder symptoms among public safety personnel in Canada. Can J Psychiatry. 2018;63(1):54–64. doi: 10.1177/0706743717723825. https://journals.sagepub.com/doi/abs/10.1177/0706743717723825?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.McCall HC, Landry CA, Ogunade A, Carleton RN, Hadjistavropoulos HD. Why do public safety personnel seek tailored internet-delivered cognitive behavioural therapy? An observational study of treatment-seekers. Int J Environ Res Public Health. 2021;18(22):11972. doi: 10.3390/ijerph182211972. https://www.mdpi.com/resolver?pii=ijerph182211972 .ijerph182211972 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Mental health and wellness for public safety personnel. Alberta Municipalities Strength in Members. 2021. [2023-05-23]. https://www.abmunis.ca/advocacy-resources/resolutions-library/mental-health-wellness-public-safety-personnel .
- 10.Milot M. The impact of a Canadian external employee assistance program on mental health and workplace functioning: findings from a prospective quasi-experimental study. J Workplace Behav Health. 2019;34(3):167–191. doi: 10.1080/15555240.2019.1609978. [DOI] [Google Scholar]
- 11.Supporting Canada’s public safety personnel: an action plan on post-traumatic stress injuries. Public Safety Canada. 2019. [2023-05-24]. https://www.publicsafety.gc.ca/cnt/rsrcs/pblctns/2019-ctn-pln-ptsi/index-en.aspx .
- 12.Joyce S, Tan L, Shand F, Bryant RA, Harvey SB. Can resilience be measured and used to predict mental health symptomology among first responders exposed to repeated trauma? J Occup Environ Med. 2019;61(4):285–292. doi: 10.1097/JOM.0000000000001526. [DOI] [PubMed] [Google Scholar]
- 13.Winders WT, Bustamante ND, Garbern SC, Bills C, Coker A, Trehan I, Osei-Ampofo M, Levine AC, Global Emergency Medicine Literature Review (GEMLR) Group Establishing the effectiveness of interventions provided to first responders to prevent and/or treat mental health effects of response to a disaster: a systematic review. Disaster Med Public Health Prep. 2021;15(1):115–126. doi: 10.1017/dmp.2019.140.S193578931900140X [DOI] [PubMed] [Google Scholar]
- 14.Agyapong VIO, Hrabok M, Vuong W, Shalaby R, Noble JM, Gusnowski A, Mrklas KJ, Li D, Urichuk L, Snaterse M, Surood S, Cao B, Li XM, Greiner R, Greenshaw AJ. Changes in stress, anxiety, and depression levels of subscribers to a daily supportive text message program (Text4Hope) during the COVID-19 pandemic: cross-sectional survey study. JMIR Ment Health. 2020;7(12):e22423. doi: 10.2196/22423. https://mental.jmir.org/2020/12/e22423/ v7i12e22423 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Agyapong VIO, Hrabok M, Shalaby R, Vuong W, Noble JM, Gusnowski A, Mrklas K, Li D, Urichuck L, Snaterse M, Surood S, Cao B, Li XM, Greiner R, Greenshaw AJ. Text4Hope: receiving daily supportive text messages for 3 months during the COVID-19 pandemic reduces stress, anxiety, and depression. Disaster Med Public Health Prep. 2022;16(4):1326–1330. doi: 10.1017/dmp.2021.27. https://www.cambridge.org/core/journals/disaster-medicine-and-public-health-preparedness/article/text4hope-receiving-daily-supportive-text-messages-for-3-months-during-the-covid19-pandemic-reduces-stress-anxiety-and-depression/268AE5EDB2A8F1F1B2D8ECD07E92D320 .S1935789321000276 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Agyapong VIO, Shalaby R, Hrabok M, Vuong W, Noble JM, Gusnowski A, Mrklas K, Li D, Snaterse M, Surood S, Cao B, Li XM, Greiner R, Greenshaw AJ. Mental health outreach via supportive text messages during the COVID-19 pandemic: improved mental health and reduced suicidal ideation after six weeks in subscribers of Text4Hope compared to a control population. Int J Environ Res Public Health. 2021;18(4):2157. doi: 10.3390/ijerph18042157. https://www.mdpi.com/resolver?pii=ijerph18042157 .ijerph18042157 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Agyapong VIO, Ahern S, McLoughlin DM, Farren CK. Supportive text messaging for depression and comorbid alcohol use disorder: single-blind randomised trial. J Affect Disord. 2012;141(2-3):168–176. doi: 10.1016/j.jad.2012.02.040. https://www.sciencedirect.com/science/article/abs/pii/S0165032712001899?via%3Dihub .S0165-0327(12)00189-9 [DOI] [PubMed] [Google Scholar]
- 18.Agyapong VIO, Juhás M, Ohinmaa A, Omeje J, Mrklas K, Suen VYM, Dursun SM, Greenshaw AJ. Randomized controlled pilot trial of supportive text messages for patients with depression. BMC Psychiatry. 2017;17(1):286. doi: 10.1186/s12888-017-1448-2. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-017-1448-2 .10.1186/s12888-017-1448-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Shalaby R, Agyapong B, Vuong W, Hrabok M, Gusnowski A, Surood S, Greenshaw AJ, Agyapong VIO. Naturalistic randomized controlled trial demonstrating effectiveness of Text4Hope in supporting male population mental health during the COVID-19 pandemic. Front Public Health. 2022;10:1002288. doi: 10.3389/fpubh.2022.1002288. https://www.frontiersin.org/articles/10.3389/fpubh.2022.1002288/full . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Agyapong VIO, Mrklas K, Juhás M, Omeje J, Ohinmaa A, Dursun SM, Greenshaw AJ. Cross-sectional survey evaluating Text4Mood: mobile health program to reduce psychological treatment gap in mental healthcare in Alberta through daily supportive text messages. BMC Psychiatry. 2016;16(1):378. doi: 10.1186/s12888-016-1104-2. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-016-1104-2 .10.1186/s12888-016-1104-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Noble JM, Vuong W, Surood S, Urichuk L, Greenshaw AJ, Agyapong VIO. Text4Support mobile-based programming for individuals accessing addictions and mental health services-retroactive program analysis at baseline, 12 weeks, and 6 months. Front Psychiatry. 2021;12:640795. doi: 10.3389/fpsyt.2021.640795. https://www.frontiersin.org/articles/10.3389/fpsyt.2021.640795/full . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Berrouiguet S, Baca-García E, Brandt S, Walter M, Courtet P. Fundamentals for future mobile-health (mHealth): a systematic review of mobile phone and web-based text messaging in mental health. J Med Internet Res. 2016;18(6):e135. doi: 10.2196/jmir.5066. https://www.jmir.org/2016/6/e135/ v18i6e135 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health. 2015;36:393–415. doi: 10.1146/annurev-publhealth-031914-122855. https://www.annualreviews.org/doi/10.1146/annurev-publhealth-031914-122855 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Ben-Zeev D, Buck B, Meller S, Hudenko WJ, Hallgren KA. Augmenting evidence-based care with a texting mobile interventionist: a pilot randomized controlled trial. Psychiatr Serv. 2020;71(12):1218–1224. doi: 10.1176/appi.ps.202000239. https://ps.psychiatryonline.org/doi/10.1176/appi.ps.202000239 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Ben-Zeev D, Davis KE, Kaiser S, Krzsos I, Drake RE. Mobile technologies among people with serious mental illness: opportunities for future services. Adm Policy Ment Health. 2013;40(4):340–343. doi: 10.1007/s10488-012-0424-x. https://europepmc.org/abstract/MED/22648635 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Jones C, Miguel-Cruz A, Smith-MacDonald L, Cruikshank E, Baghoori D, Kaur Chohan A, Laidlaw A, White A, Cao B, Agyapong V, Burback L, Winkler O, Sevigny PR, Dennett L, Ferguson-Pell M, Greenshaw A, Brémault-Phillips S. Virtual trauma-focused therapy for military members, veterans, and public safety personnel with posttraumatic stress injury: systematic scoping review. JMIR Mhealth Uhealth. 2020;8(9):e22079. doi: 10.2196/22079. https://mhealth.jmir.org/2020/9/e22079/ v8i9e22079 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Wei J, Hollin I, Kachnowski S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J Telemed Telecare. 2011;17(1):41–48. doi: 10.1258/jtt.2010.100322.jtt.2010.100322 [DOI] [PubMed] [Google Scholar]
- 28.McCall HC, Beahm JD, Fournier AK, Burnett JL, Carleton RN, Hadjistavropoulos HD. Stakeholder perspectives on internet-delivered cognitive behavioural therapy for public safety personnel: a qualitative analysis. Can J Behav Sci. 2021;53(3):232–242. doi: 10.1037/cbs0000242. [DOI] [Google Scholar]
- 29.Eboreime E, Ohinmaa A, Rusak B, Cassidy KL, Morrison J, McGrath P, Uher R, Meier S, Fleury MJ, Iyer SN, Rej S, Batchelor F, Levinger P, Dang C, Hopwood M, Acquah FNL, Dzator J, Tomblin Murphy G, Warford J, Wozney L, Vedel I, Gahagan J, Theou O, Koto P, Sampalli T, Kirkland S, Watters N, Agyapong VIO. The Text4HealthyAging program: an evidence-based text messaging innovation to support healthy urban aging in Canada and Australia. Gerontol Geriatr Med. 2022;8:23337214221081378. doi: 10.1177/23337214221081378. https://journals.sagepub.com/doi/abs/10.1177/23337214221081378?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .10.1177_23337214221081378 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Meyer B, Pilkonis PA, Krupnick JL, Egan MK, Simmens SJ, Sotsky SM. Treatment expectancies, patient alliance, and outcome: further analyses from the national institute of mental health treatment of depression collaborative research program. J Consult Clin Psychol. 2002;70(4):1051–1055. [PubMed] [Google Scholar]
- 31.TEXT4PTSI and TEXT4WELL-BEING launched: supporting mental health and wellness of first responders. ResilienceNHope. 2021. [2023-01-11]. https://www.resiliencenhope.org/news/text4ptisi-and-text4well-being-launched .
- 32.Betkowski B. New texting services launched to support first responders’ mental health. University of Alberta. 2021. [2023-01-11]. https://www.ualberta.ca/folio/2021/07/new-texting-services-launched-to-support-first-responders-mental-health.html .
- 33.Obuobi-Donkor G, Eboreime E, Bond J, Phung N, Eyben S, Hayward J, Zhang Y, MacMaster F, Clelland S, Greiner R, Jones C, Cao B, Brémault-Phillips S, Wells K, Li XM, Hilario C, Greenshaw AJ, Agyapong VIO. An E-Mental health solution to prevent and manage posttraumatic stress injuries among first responders in Alberta: protocol for the implementation and evaluation of text messaging services (Text4PTSI and Text4Wellbeing) JMIR Res Protoc. 2022;11(4):e30680. doi: 10.2196/30680. https://www.researchprotocols.org/2022/4/e30680/ v11i4e30680 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Shalaby R, Vuong W, Hrabok M, Gusnowski A, Mrklas K, Li D, Snaterse M, Surood S, Cao B, Li XM, Greiner R, Greenshaw AJ, Agyapong VIO. Gender differences in satisfaction with a text messaging program (Text4Hope) and anticipated receptivity to technology-based health support during the COVID-19 pandemic: cross-sectional survey study. JMIR Mhealth Uhealth. 2021;9(4):e24184. doi: 10.2196/24184. https://mhealth.jmir.org/2021/4/e24184/ v9i4e24184 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.IBM SPSS statistics for Windows, Version 25.0. IBM Corp. 2017. [2023-05-24]. https://clinicaltrials.gov/ProvidedDocs/85/NCT04347785/SAP_000.pdf .
- 36.Cartujano-Barrera F, Sanderson Cox L, Arana-Chicas E, Ramírez M, Perales-Puchalt J, Valera P, Díaz FJ, Catley D, Ellerbeck EF, Cupertino AP. Feasibility and acceptability of a culturally- and linguistically-adapted smoking cessation text messaging intervention for Latino smokers. Front Public Health. 2020;8:269. doi: 10.3389/fpubh.2020.00269. https://www.frontiersin.org/articles/10.3389/fpubh.2020.00269/full . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Agyapong VIO, Milnes J, McLoughlin DM, Farren CK. Perception of patients with alcohol use disorder and comorbid depression about the usefulness of supportive text messages. Technol Health Care. 2013;21(1):31–39. doi: 10.3233/THC-120707.T21472550413R485 [DOI] [PubMed] [Google Scholar]
- 38.Wright HM, Fuessel-Hermann D, Pazdera M, Lee S, Ridge B, Kim JU, Konopacki K, Hilton L, Greensides M, Langenecker SA, Smith AJ. Preventative care in first responder mental health: focusing on access and utilization stepped telehealth care. Front Health Serv. 2022;2:848138. doi: 10.3389/frhs.2022.848138. https://www.frontiersin.org/articles/10.3389/frhs.2022.848138/full . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Hadjistavropoulos HD, McCall HC, Thiessen DL, Huang Z, Carleton RN, Dear BF, Titov N. Initial outcomes of transdiagnostic internet-delivered cognitive behavioral therapy tailored to public safety personnel: longitudinal observational study. J Med Internet Res. 2021;23(5):e27610. doi: 10.2196/27610. https://www.jmir.org/2021/5/e27610/ v23i5e27610 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Beahm JD, McCall HC, Carleton RN, Titov N, Dear B, Hadjistavropoulos HD. Insights into internet-delivered cognitive behavioural therapy for public safety personnel: exploration of client experiences during and after treatment. Internet Interv. 2021;26:100481. doi: 10.1016/j.invent.2021.100481. https://www.sciencedirect.com/science/article/pii/S2214782921001214?via%3Dihub .S2214-7829(21)00121-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Partch M, Dykeman C. Text messaging as a mental health treatment intervention: a corpus-based study. PsyArXiv. doi: 10.31234/osf.io/gt73p. Preprint posted online on February 19, 2019. https://psyarxiv.com/gt73p/ [DOI] [Google Scholar]
- 42.Istepanian RSH, Lacal JC. Emerging mobile communication technologies for health: some imperative notes on m-health. Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439); 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society; September 17-21, 2003; Cancun, Mexico. 2003. pp. 1414–1416. [DOI] [Google Scholar]
- 43.Shalaby R, Vuong W, Eboreime E, Surood S, Greenshaw AJ, Agyapong VIO. Patients' expectations and experiences with a mental health-focused supportive text messaging program: mixed methods evaluation. JMIR Form Res. 2022;6(1):e33438. doi: 10.2196/33438. https://formative.jmir.org/2022/1/e33438/ v6i1e33438 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Obuobi-Donkor G, Shalaby R, Vuong W, Agyapong B, Hrabok M, Gusnowski A, Surood S, Greenshaw AJ, Agyapong VIO. Effects of Text4Hope-addiction support program on cravings and mental health symptoms: results of a longitudinal cross-sectional study. JMIR Form Res. 2023;7:e40440. doi: 10.2196/40440. https://formative.jmir.org/2023//e40440/ v7i1e40440 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Laursen D. Counseling young cannabis users by text message. J Comput-Mediat Comm. 2010;15(4):646–665. doi: 10.1111/j.1083-6101.2009.01510.x. https://academic.oup.com/jcmc/article/15/4/646/4067641 . [DOI] [Google Scholar]
- 46.Presseau J, Johnston M, Heponiemi T, Elovainio M, Francis JJ, Eccles MP, Steen N, Hrisos S, Stamp E, Grimshaw JM, Hawthorne G, Sniehotta FF. Reflective and automatic processes in health care professional behaviour: a dual process model tested across multiple behaviours. Ann Behav Med. 2014;48(3):347–358. doi: 10.1007/s12160-014-9609-8. https://academic.oup.com/abm/article/48/3/347/4562814?login=false . [DOI] [PubMed] [Google Scholar]
- 47.Bendtsen M, Bendtsen P. Feasibility and user perception of a fully automated push-based multiple-session alcohol intervention for university students: randomized controlled trial. JMIR Mhealth Uhealth. 2014;2(2):e30. doi: 10.2196/mhealth.3233. https://mhealth.jmir.org/2014/2/e30/ v2i2e30 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88. doi: 10.1186/s12913-017-2031-8. https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-017-2031-8 .10.1186/s12913-017-2031-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Lohr KN, Zebrack BJ. Using patient-reported outcomes in clinical practice: challenges and opportunities. Qual Life Res. 2009;18(1):99–107. doi: 10.1007/s11136-008-9413-7. [DOI] [PubMed] [Google Scholar]
- 50.Gates A, Stephens J, Artiga S. Profiles of medicaid outreach and enrollment strategies: using text messaging to reach and enroll uninsured individuals into medicaid and CHIP. Age. 2014;18(24):97. http://www.statecoverage.org/files/KFF_Medicaid_outreach_texting.pdf . [Google Scholar]
- 51.Daikeler J, Bošnjak M, Manfreda KL. Web versus other survey modes: an updated and extended meta-analysis comparing response rates. J Surv Stat Methodol. 2020;8(3):513–539. doi: 10.1093/jssam/smz008. https://academic.oup.com/jssam/article/8/3/513/5488703 . [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data associated with this study will be made freely available upon reasonable request to the corresponding author.