Abstract
Background
Major depressive episodes (MDEs) are prevalent in the workplace and affect workers’ health and productivity. Therefore, there is a pressing need for innovation in the prevention of MDEs in the workplace. Electronic mental (e-mental) health programs are a cost-effective approach toward the self-management of stress and emotional issues. E-mental health dropout rate, MDE prevalence, and symptoms greatly vary by sex and age. Thus, the development and implementation of e-mental health programs for the prevention of MDEs need to be examined through a sex and age lens to enhance program use and effectiveness.
Objective
This study aimed to examine design feature preferences based on sex and age for an e-mental health program targeted toward depression prevention.
Methods
Household residents across Canada were contacted using the random digit dialing method. 500 women and 511 men who were 18 years and older and who were at high risk of having MDEs were interviewed. Internet use was assessed using questions from the 2012 Canadian Internet Use Survey conducted by Statistics Canada, and preferred design features of e-mental health program questions were developed by the BroMatters team members. The proportions of likely use of specific features of e-mental health programs in women were estimated and compared with those in men using chi-square tests. The comparisons were made overall and by age groups.
Results
Men (181/511, 35.4%) and women (211/500, 42.2%) differed significantly in their likelihood of using an e-mental health program. Compared with men (307/489, 62.8%), women (408/479, 85.2%) were more likely to use the internet for medical or health-related information. Women were more likely to use the following design features: practices and exercises to help reduce symptoms of stress and depression (350/500, 70.7%), a self-help interactive program that provides information about stress and work problems (302/500, 61.8%), the ability to ask questions and receive answers from mental health professionals via email or text message (294/500, 59.9%), and to receive printed materials by mail (215/500, 43.4%). Men preferred to receive information in a video game format (156/511, 30.7%). Younger men (46/73, 63%) and younger women (49/60, 81%) were more likely to access a program through a mobile phone or an app, and younger men preferred having access to information in a video game format.
Conclusions
Factors such as sex and age influenced design feature preferences for an e-mental health program. Working women who are at high risk for MDEs preferred interactive programs incorporating practice and exercise for reducing stress, quality information about work stress, and some guidance from professionals. This suggests that sex and age should be taken into account when designing e-mental health programs to meet the needs of individuals seeking help via Web-based mental health programs and to enhance their use.
Keywords: occupational health, workplace, mental health, preventive health program, depression, internet
Introduction
Major depressive episodes (MDEs) are prevalent in the workplace and affect workers’ health and productivity. In the United States, workers with depression cost an estimated US $44.01 billion per year in lost productivity [1]. One of the severe consequences of having an MDE is suicide [2]. Given the significant disease burden, there is a pressing need for innovation in the prevention of MDEs in the workplace. A number of approaches have been proposed and investigated to help workers. Studies in the workplace have focused on providing treatment services to employees with depression [3], including cognitive behavioral therapy (CBT) conducted by professionals, diagnosis of depression, enhanced primary care delivery, treatment by medical doctors, integrated care management, and worksite stress reduction [3-6]. At the population level, despite the significant increase in antidepressant use in the past two decades [7], there has been no measurable change in the prevalence of MDEs in different countries [8-11]. A recent systematic review concluded that there is insufficient evidence to determine which individual-based interventions improve depression management in the workplace [12]. In contrast, another recent meta-analysis concluded that secondary interventions involving CBT-based stress management and tertiary interventions with specific focus on work such as exposure therapy and CBT-based and problem-focused return-to-work programs improved both symptoms of common mental disorders and occupational outcomes [13]. To date, most workplace responses to the burden of mental health problems have been reactive, with the implementation of workplace interventions only being considered once a worker is symptomatic or even on sick leave [14]. Evidence suggests that various mental health problems can be prevented [15]. As a result, policy makers and researchers have begun to consider strategies aimed at early prevention [15,16], for example, identifying and treating asymptomatic persons who have already developed risk factors but in whom the condition has not become clinically apparent (high-risk individuals). From a public health perspective, universal interventions are attractive for their ability to reach more working adults and because they have the ability to reach specified groups and individuals without screening them, an exercise that has shown to be costly [17,18]. In terms of depression prevention, one cost-effective strategy for helping those who are at high risk of depression is an electronic mental (e-mental) health program [19,20].
In the past decade, there has been considerable interest in the delivery of e-mental health programs, that is, delivering mental health services through the internet or mobile apps. Web-based interventions and mobile apps can be utilized for self-help or for treatment purposes [21]. E-mental health programs are either guided or unguided and draw on the internet and other media, including video, phone, and apps for mobile phones and tablets [22], and generally address 4 areas of mental health service delivery: (1) information provision; (2) screening, assessment, and monitoring; (3) intervention; and (4) social support (sometimes concurrently) [19]. The wide use of internet and mobile devices has laid a strong foundation for eHealth development. In 2011, 83% of Canadians reported using Web-based services [23], and in 2014, 99% of young Canadians reported having access to the internet outside of school [24]. The number of individuals using the internet to search for medical or health-related information increased from 57.9% in 2005 to 69.9% in 2009 [25]. Over 60% of internet users use wireless handheld devices to access the internet [23]. With such a large portion of Canada’s population online and with many young adults using the internet for health-seeking purposes, e-mental health could be an effective approach toward the self-management of stress and emotional issues and improving service accessibility, geographic barriers, and anonymity [19].
The development and implementation of e-mental health programs for the prevention of MDEs need to be examined through a sex and age lens. The prevalence of MDEs in women is about two times higher than that in men [26]; however, the Canadian national data show that in 2009, 76% of the total number of suicides were committed by men [27]. Due to the existence of gender norms and the desirability of perceived masculinity, men are less likely than women to seek help and to disclose depressive symptoms and often delay seeking help until symptoms become severe [28,29]. Men are socialized to be emotionally stoic and exemplify traditional masculine characteristics such as independence, self-reliance, and dominance [30]. Men are concerned over the perceived negative judgments from family and friends if they access treatment for depression. Furthermore, it has been found that being male significantly increases the risk of treatment dropout for self-guided Web-based interventions for depression, highlighting differences in treatment compliance and willingness to complete Web-based interventions [31]. These sex-related help-seeking behaviors and social norms may influence men’s and women’s preference for the content and design features of e-mental health programs and the likely use of the program to deal with work-related stress. The use of eHealth programs may also be related to age. For instance, some studies have demonstrated that young adults are more likely to use eHealth programs than the elderly [32], and other studies have shown that younger age is related to low treatment adherence [31]. Given the lack of consensus and knowledge regarding the sex and age differences related to preferred design features and the likely use of e-mental health programs, and treatment adherence, it is imperative to explore design features that may increase their use and thereby, their effectiveness.
In 2015, we initiated a research project called BroMatters, which aimed to develop and evaluate an e-mental health program to be used by working men who are at high risk of having an MDE. To guide the development of the e-mental health program, we conducted a national survey in 2015 among working men who were at high risk of having an MDE, regarding their acceptance and preferred design features of e-mental health programs [33]. In 2016, as a separate study, we repeated this survey in working women who were at high risk of having an MDE. The objective of this analysis was to examine the sex and age differences in the acceptance and preferred design features of the e-mental health program in male and female workers who are at high risk of having an MDE.
Methods
Participants
The 2 surveys employed the same methodology as described in a previous publication [33]. The target population for the 2 surveys were individuals who (1) were working at the time of the survey, (2) were aged 18 years or older, (3) did not have an MDE in the past 12 months, (4) had no language barrier to either English or French, and (5) were at high risk of having an MDE based on sex-specific risk prediction algorithms [34]. The random digit dialing method was used to contact household residents across the country. Interviews were conducted by the Bureau d’intervieweurs professionels (BIP) located in Montreal. BIP has access to household telephone and validated cell phone numbers. The household contact was asked to retrieve or provide contact information (eg, the first name) of the household residents who were currently working. If there was more than one potentially eligible individual in the same household, one was randomly selected. Once the participant was fully informed about the objectives and procedures of the study, oral consent and continuation of telephone interview were deemed as adequate consent for participation. Data were collected using computer-assisted telephone interviews, which were completed by trained telephone interviewers in participants’ language of preference (English or French). Data collection occurred over a period of 9 months between March and December 2015. A minimum of 9 callback attempts were spaced over weekdays for the duration of the data collection period. Participants received a Can $20 incentive for each completed interview as a token of appreciation. Detailed call composition for the men’s survey can be found in our previous publication [33]. In the women’s survey, 47,555 phone numbers were called. A majority of the calls (46,300/47,555, 97.36%) were not valid (not in service, fax or modem, answering machine, language barriers, ineligibility, duplications, and refusal before eligibility was assessed). Among 1255 eligible women, 755 (60.1%) were excluded from the study (prolonged absence, incomplete questionnaires, scheduled callbacks not within data collection period, and refusal after eligibility was verified). The data collection for women occurred between January and April 2016. For the 2 surveys, 500 eligible women and 511 eligible men were interviewed. The studies were approved by the Conjoint Health Research Ethics Review Board of the University of Calgary.
Measurement
The sex-specific multivariable risk prediction algorithms for major depression were administered to estimate the risk (probability) of having an MDE in the next 4 years for each participant [34]. The risk prediction models were designed to be used by individuals who did not have an MDE in the past 12 months. On the basis of participant’s exposure to a key set of risk factors (predictors) in the model, the algorithm can generate the absolute risk and probability of having an MDE in the next 4 years, analogous to the Framingham risk prediction algorithm for coronary heart disease [35,36]. The risk prediction algorithms for MDEs were developed and validated using data from 4737 Canadian men and 5864 Canadian women who were aged 18 years or older and who did not have an MDE in the past 12 months [34]. The risk prediction algorithms include age, personal and family history of an MDE, childhood trauma, and ongoing stress and life events. There are also sex-specific predictors in the models (details regarding sex-specific predictors in the models may be found in our previous publication [34]). The predictive power of the risk prediction algorithms was measured by C statistics. The algorithm for men had a C statistic of 0.7953 and the C statistic of the algorithm for women was 0.7667 [34]. The models had excellent calibration with data, as indicated by the Hosmer-Lemeshow test and visual comparison between the predicted and observed risks by decile risk groups [34]. In our study, ≥6.51% and ≥11.19% were defined as high risk for men and women, respectively, which represents the top 2 decile risk groups in the Canadian male and female populations.
Internet use was assessed using questions from the 2012 Canadian Internet Use Survey conducted by Statistics Canada, including use of the internet in the past 12 months, number of hours spent on the internet in the past week, use of the internet to search for medical- and health-related information, and perceived importance of the health information on the internet for decision making.
Preferred design features of e-mental health program questions were developed by the BroMatters team members. Participants were asked “We want to hear your opinion about e-mental health programs for dealing with work and stress issues. Electronic health (eHealth) is defined as...For the following features, please indicate how likely it is that you would use them.” For 17 design features, participants were asked how likely they were to use a feature and answered on a 5-point Likert scale ranging from very likely to very unlikely. Open-ended questions were asked about any other features they may want in an e-mental health program, whether the participant and his or her coworkers would use an e-mental health program to deal with work stress, and what makes it difficult to use an e-mental health program. At the end of this set of questions, the participants were asked “would you or your co-workers use an eHealth program to deal with work stress?” The participants answered yes, maybe, or no. For eligible participants, administering the questions and instruments took an average of 22 min to complete.
Data Analysis
A total of 500 men and 511 women were included in the data analysis. Responses including do not know and refuse to answer were excluded from the data analysis. There were no missing data for demographic characteristics or general and health-related internet usage. The percentage of missing data (ie, do not know and refuse to answer) for items regarding preferred design features of an e-mental health program ranged from 0% to 2%. Demographic and socioeconomic characteristics of participants were tabulated. The proportions of general and health-related internet usage were compared between women and men using a chi-square test. The proportions of likely use of specific features of e-mental health programs in women were estimated and compared with those in men using chi-square tests. The comparisons were made overall and by age groups. As men and women were compared in 17 specific design features, the Bonferroni correction was used, and the significance level was set at .003.
Results
Demographic Characteristics
Table 1 presents the demographic characteristics of the participants included in this study. Compared with men, women were slightly older; were more likely to be divorced, separated, or widowed; and were more likely to have a lower personal annual income, to have a part-time job, and to be from small- or mid-sized organizations. Finally, a higher proportion of women obtained a higher level of education (partial or completed university), as compared with men.
Table 1.
Demographic and socioeconomic characteristics of the participants who were at high risk of major depression classified by sex.
| Variable | Men (n=511) | Women (n=500) | P value | |
| Age (years), mean (SD) | 42.0 (12.2) | 44.3 (15.0) | .002 | |
| Marital status, n (%) | <.001 | |||
|
|
Married or common-law | 389 (76.1) | 342 (69.0) |
|
|
|
Divorced, separated, or widowed | 22 (4.3) | 68 (13.7) |
|
|
|
Single | 100 (19.6) | 86 (17.3) |
|
| Personal income, n (%) | <.001 | |||
|
|
<Can $30,000 | 60 (12.1) | 130 (27.3) |
|
|
|
Can $30,000-<$60,000 | 152 (30.6) | 216 (45.4) |
|
|
|
Can $60,000-<$80,000 | 98 (19.7) | 69 (14.5) |
|
|
|
Can $80,000+ | 187 (37.6) | 61 (12.8) |
|
| Education level, n (%) | <.001 | |||
|
|
<High school | 43 (8.4) | 12 (2.4) |
|
|
|
High school | 107 (20.9) | 81 (16.3) |
|
|
|
College | 167 (32.7) | 188 (37.7) |
|
|
|
University or higher | 194 (38.0) | 217 (43.6) |
|
| Employment, n (%) | .98 | |||
|
|
Employee | 413 (81.5) | 396 (81.0) |
|
|
|
Self-employed | 92 (18.2) | 91 (18.6) |
|
|
|
Family business no pay | 2 (0.4) | 2 (0.4) |
|
| Job type, n (%) | <.001 | |||
|
|
Full time | 434 (84.9) | 340 (68.0) |
|
|
|
Part time | 37 (7.2) | 130 (26.0) |
|
|
|
Seasonal | 18 (3.5) | 10 (2.0) |
|
|
|
Contract | 19 (3.7) | 18 (3.6) |
|
|
|
Other | 3 (0.6) | 2 (0.4) |
|
| Size of company or worksite, n (%) | .01 | |||
|
|
<50 | 276 (54.2) | 290 (59.7) |
|
|
|
50-499 | 149 (29.3) | 148 (30.4) |
|
|
|
>500 | 84 (16.5) | 48 (9.9) |
|
| Provinces, n (%) | .16 | |||
|
|
British Columbia | 33 (7.1) | 58 (13.2) |
|
|
|
Alberta | 52 (11.2) | 51 (11.6) |
|
|
|
Saskatchewan | 18 (3.9) | 15 (3.4) |
|
|
|
Manitoba | 20 (4.3) | 15 (3.4) |
|
|
|
Ontario | 170 (36.6) | 161 (36.7) |
|
|
|
Quebec | 141 (30.4) | 109 (24.8) |
|
|
|
New Brunswick | 12 (2.6) | 8 (1.8) |
|
|
|
Nova Scotia | 12 (2.6) | 13 (2.9) |
|
|
|
Newfoundland | 4 (0.9) | 7 (1.6) |
|
|
|
Prince Edward Island | 2 (0.4) | 2 (0.5) |
|
| Language, n (%) | .31 | |||
|
|
English | 374 (73.2) | 380 (76.0) |
|
|
|
French | 137 (26.8) | 120 (24.0) |
|
| Work function impairment, n (%) | .91 | |||
|
|
None | 314 (62.9) | 296 (61.4) |
|
|
|
Mild | 146 (29.3) | 150 (31.1) |
|
|
|
Moderate | 36 (7.2) | 34 (7.1) |
|
|
|
Severe | 3 (0.6) | 2 (0.4) |
|
General and Health-Related Internet Usage
Table 2 presents the general and health-related internet usage for men and women. Men and women did not differ significantly in terms of the time they spent online or the means by which they accessed the internet. For instance, 35.8% (175/489) of men and 38.0% (182/479) of women indicated that within the past 12 months, they had spent less than 5 hours per week online. Similarly, the majority of men (408/489, 83.4%) and women (413/ 479, 86.2%) accessed the internet using various devices (mobile phone, tablet, etc). Both men (256/307, 83.4%) and women (334/408, 81.9%) believed that being able to access health resources on the internet was important or very important. Women (408/479, 85.2%) compared with men (307/489, 62.8%) were significantly more likely to use the internet for medical or health-related information. Conversely, men (231/307, 75.2%) were significantly more likely to state that the internet was useful in helping them make decisions compared with women (277/408, 67.9%).
Table 2.
General and health-related internet usage during the past 12 months in men and women who were at high risk of major depression.
| Internet use | Men | Women | P value | |||
|
|
n (%) | 95% CI | n (%) | 95% CI |
|
|
| Use internet for personal use (n=1011) | 489 (95.7) | 93.5-97.2 | 479 (95.8) | 93.6-97.2 | .93 | |
| Hours of internet use each week (n=968) | .35 | |||||
|
|
<5 hours | 175 (35.8) | 31.6-40.2 | 182 (38.0) | 33.7-42.4 |
|
|
|
5-9 hours | 137 (28.0) | 24.2-32.2 | 144 (30.1) | 26.1-34.3 |
|
|
|
10-19 hours | 113 (23.1) | 19.6-27.1 | 102 (21.3) | 17.8-25.2 |
|
|
|
20-29 hours | 39 (8.0) | 5.9-10.7 | 35 (7.3) | 5.3-10.1 |
|
|
|
30-39 hours | 11 (2.3) | 1.2-4.0 | 8 (1.7) | 0.8-3.3 |
|
|
|
>40 hours | 14 (2.9) | 1.7-4.8 | 6 (1.3) | 0.6-2.8 |
|
|
|
Do not know | 0 (0) | 0-0 | 2 (0.42) | 0.1-1.7 |
|
| Access internet with a smart phone, tablet, or other device (n=968) | 408 (83.4) | 79.9-86.5 | 413 8(6.2) | 82.8-89.0 | .23 | |
| Used internet for medical or health-related information (n=968) | 307 (62.8) | 58.4-67.0 | 408 (85.2) | 82.1-88.4 | <.001 | |
| How useful was the internet in helping you make a decision (n=715) | .04 | |||||
|
|
Not useful | 32 (10.4) | 7.5-14.4 | 41 (10.1) | 7.5-13.4 |
|
|
|
Unsure | 41 (13.4) | 10.0-17.7 | 88 (21.6) | 17.8-25.8 |
|
|
|
Useful | 231 (75.2) | 70.1-79.8 | 277 (67.9) | 63.2-72.3 |
|
| How important is it for you to be able to access health resources on the internet (n=715) | .22 | |||||
|
|
Not important | 31 (10.1) | 7.2-14.0 | 32 (7.8) | 5.6-10.9 |
|
|
|
Unsure | 20 (6.5) | 4.2-9.9 | 41 (10.1) | 7.5-13.4 |
|
|
|
Important | 256 (83.4) | 78.8-87.2 | 334 (81.9) | 78.0-85.3 |
|
When participants were asked “would you or your co-workers use an eHealth program to deal with work stress?, women were more likely to report yes than men (P=.04). Among 511 men, 35.4% (181) reported yes, 37.2% (190) reported maybe, and 21.9% (112) reported no, whereas among 500 women, 42.2% (211) reported yes, 34.0% (170) reported maybe, and 16.4% (82) reported no.
Preferred Design Features
Table 3 contains the preferred design features in an e-mental health program for men and women. Men and women differed significantly in terms of their e-mental health design feature preferences. Compared with men, a higher proportion of women stated that they were likely to use design features such as practices and exercises to help reduce symptoms of stress and depression (350/495, 70.7%), a self-help interactive program that provides information about stress and work problems (302/489, 61.8%), the ability to ask questions and receive answers from mental health professionals via email or text message (294/491, 59.9%), and to receive printed materials by mail (215/495, 43.4%). Compared with women (104/496, 21.0%), a higher proportion of men (156/509, 30.7%) preferred having some of the program information about ways of dealing with stress and work-related issues to be delivered in a video game format. There were no significant differences between men and women for the remaining design features.
Table 3.
Proportions of preferred design features of e-mental health program in men and women who were at high risk of major depression.
| Feature | Men | Women | P value | ||
|
|
n (%) | 95% CI | n (%) | 95% CI |
|
| Practice and exercise to reduce stress | 303 (59.5) | 55.2-63.7 | 350 (70.7) | 66.5-74.6 | <.001 |
| Information about improving sleep hygiene | 313 (61.3) | 56.9-65.4 | 329 (66.9) | 62.6-70.9 | .09 |
| Educational materials | 295 (57.8) | 53.5-62.1 | 313 (63.8) | 59.4-67.9 | .002 |
| Self-help interactive program | 244 (47.8) | 43.5-52.2 | 302 (61.8) | 57.4-66.0 | <.001 |
| Setting personal goals and tracking them | 277 (54.6) | 50.3-58.9 | 296 (59.9) | 55.5-64.2 | .02 |
| Ask questions and receive answers from mental health professionals | 253 (49.7) | 45.4-54.1 | 294 (59.9) | 55.5-64.1 | .005 |
| Direct referral to health professional to deal with work and stress issues in person | 263 (51.7) | 47.3-56.0 | 292 (59.5) | 55.0-63.7 | .004 |
| Being able to access a program via a smartphone or as an app | 264 (52.0) | 47.6-56.3 | 273 (55.8) | 51.4-60.2 | .39 |
| Watching videos online on how to deal with work and stress issues | 272 (53.3) | 49.0-57.6 | 271 (54.5) | 50.1-58.9 | .58 |
| Receiving printed materials by mail | 167 (32.7) | 28.7-36.9 | 215 (43.4) | 39.1-47.9 | <.001 |
| Chart and track mood | 217 (42.6) | 38.4-47.0 | 237 (48.1) | 43.7-52.5 | .15 |
| Access by phone to a trained coach to help with work stress | 211 (41.3) | 37.1-45.6 | 235 (48.1) | 43.6-52.5 | .02 |
| Information about anger management | 211 (41.5) | 37.2-45.8 | 190 (38.3) | 34.1-42.7 | .17 |
| A risk calculator predicting future risk of having major depression | 215 (42.6) | 38.3-46.9 | 184 (38.1) | 33.9-42.5 | .13 |
| Online chat room | 129 (25.3) | 21.7-29.3 | 124 (25.0) | 21.3-29.0 | .25 |
| Online peer connection | 140 (27.5) | 23.7-31.5 | 136 (27.8) | 24.0-31.9 | .02 |
| Information delivered in a video game format | 156 (30.7) | 26.8-34.8 | 104 (21.0) | 17.6-24.8 | .002 |
Table 4 presents the preferred design features of an e-mental health program for men and women by age group. Age differences were found in 3 design features in men and women. Compared with older men, men in the youngest age group (36/73, 49%) preferred to receive information on how to deal with work and stress issues in video game format. Men aged between 50 and 64 years (61/140, 43.6%) preferred to receive printed materials by mail rather than having to print online materials oneself, compared with younger men and men over the age of 65 years. Younger men also preferred accessing a program through a smartphone or as an app, with 63% (46/73) of 18- to 29-year olds stating that they would likely use this feature. Younger women also preferred accessing a program through a smartphone or as an app (P<.001), considering that of 489 women, 81% (49/60) of 18 to 29 year olds, 64.2% (163/254) of 30 to 49 year olds, 36% (59/162) of 50 to 64 year olds, and 15% (2/13) of women aged 65 years and older said that they were likely to access a program in this manner. There were no other significant age differences in men or women regarding e-mental health design feature preferences.
Table 4.
Proportions of preferred design features of e-mental health program in high-risk men by age groups.
| Feature | 18-29 years | 30-49 years | 50-64 years | >65 years | P value | ||||
|
|
n (%) | 95% CI | n (%) | 95% CI | n (%) | 95% CI | n (%) | 95% CI |
|
| Information delivered in video game format (n=509) | 250 (49.3) | 37.8-60.9 | 151 (29.7) | 24.6-35.3 | 120 (23.7) | 17.3-31.6 | 108 (21.4) | 6.0-54.0 | .001 |
| Print materials by mail (n=511) | 105 (20.6) | 12.6-31.6 | 159 (31.3) | 26.2-37.0 | 222 (43.6) | 35.5-52.0 | 73 (14.3) | 2.9-48.0 | .001 |
| Access program via smartphone or app (n=508) | 320 (63.0) | 51.2-73.5 | 281 (55.3) | 49.4-61.1 | 211 (41.7) | 33.7-50.2 | 145 (28.6) | 9.6-60.1 | .003 |
Sensitivity analyses were conducted in participants who reported likely use of an e-mental health program to deal with work stress and in those with a history of an MDE. In participants who reported likely use of an e-mental health program, information delivered in a video game format and receiving printed materials by mail were still preferred among men (69/179, 38.0%) and women (115/210, 54.8%), respectively. In addition, men preferred to receive information about anger management (98/180, 55%) and women preferred to chart and track mood (133/209, 63.6%). There were no significant differences between men and women for the remaining design features. In participants with a history of an MDE, women were more likely to use a self-help interactive program (139/218, 63.8%), to receive information about improving sleep hygiene (153/216, 70.8%), and to receive printed materials by mail (91/216, 42.1%), and men were more likely to receive information in a video game format (43/130, 33.1%).
Discussion
Principal Findings
The data from the 2 national surveys demonstrate that men and women who were at high risk of developing depression did not differ in terms of their general internet usage. However, women were more likely to use the internet for health- and mental health–related information and demonstrated greater acceptability of the use of e-mental health programs for work stress. Although there were similarities among men and women in terms of preferred e-mental health design features, important sex differences emerged. Women preferred design features that were interactive. The only design feature that was preferred by men, as compared with women, was receiving information in a video game format. Age differences in preferred e-mental health design features were minimal, irrespective of sex.
There were some broad similarities among men and women with respect to design feature preference. Men and women differed significantly in their preference for only 5 of the 17 design features. Information regarding sleep hygiene, information about work stress, and practice and exercise to reduce stress were the top 3 features endorsed by men and women. It is unsurprising that design features, which function to provide health information, were preferred among men and women. Previous research demonstrates that seeking Web-based health information is highly prevalent among internet users [37] and obtaining information is a primary motive for internet use [38].
Notable differences in e-mental health design feature preference were found between men and women. Compared with men, women preferred 5 design features for an e-mental health program including practice and exercise to reduce stress, quality information about work stress, self-help interactive programs, being able to ask questions and receive answers, and receiving printed materials. Men preferred only 1 feature as compared with women—being able to receive information in a game format. These results were replicated in sensitivity analyses among men and women with a history of MDE; men were more likely to use a feature that delivered information in a video game format, whereas women preferred to use a self-help interactive program.
Our findings are in accordance with previous studies, which demonstrate that men and women do not differ in their self-reported general internet usage [39], although women are more likely to use the internet for health-related information [40,41], as compared with men. Previous studies have demonstrated greater acceptability, attitudes, help-seeking, and use of e-mental health programs [30,42] as well as more favorable attitudes toward seeking psychological professional help through face-face, email interaction, and Web-based counseling [43] among women. This study likewise found that women demonstrated greater acceptability of the use of e-mental health programs for work stress.
Comparison and Interpretation
To our knowledge, no studies have examined sex or age differences in specific e-mental health design feature preference. Thus, direct comparisons with previous studies on sex and age differences in preferred design features are not possible. However, previous research examining health-related internet use has demonstrated that women are more likely to be interactive Web-based health users [40], which is consistent with the results of this study. In comparison with women, men preferred to receive information in a video game format, a finding that is consistent with general video game use across genders, as studies show that men play twice as many video games per week as women [44].
These differences may be useful to consider when designing effective eHealth interventions for mental health. For example, low adherence is a significant problem for most eHealth programs, and this issue may be exacerbated among population groups who are at risk for MDEs but are not currently experiencing an episode [1]. The incorporation of interactive features or gamification strategies to increase adherence may be a useful method of increasing adherence among the overall target audience. Gamification may be especially useful for increasing adherence in men, who are receptive to receiving information in a video game format but also face substantial barriers to seeking mental health treatment [45,46].
A number of factors likely contribute to the observed sex differences in patterns of health information seeking, eHealth acceptability, and design feature preference for an e-mental health program. Compared with men, women may be more likely to search for Web-based mental health information because they have stronger positive beliefs regarding the benefits of Web-based health searches [47] and because it is an efficient method of searching [48]. According to some authors, this can be explained from a social role perspective [49-51]. As women often have a multitasking agenda, especially in middle age, efficiency and convenience may be more highly regarded. Fewer men reported that they would use an eHealth program to manage work-related stress. This reflects the tendency for men to be less likely than women to seek either formal or informal help for mental health issues [30]. As some authors have noted, study participants with a history of seeking Web-based health information have overcome some practical and stigma-related barriers in seeking Web-based psychological help [52]. As such, greater acceptability of e-mental health programs among women may be partially attributed to their greater use of the internet for health and mental health information. Women also tend to have greater psychological openness, which describes the ability to acknowledge a psychological problem and a need for help. Conversely, men have more difficulty identifying feelings of distress as emotional problems [53]. In addition, a number of perceived barriers, such as internalized and treatment stigma [45], masculine norms, communication barriers, the role of self-help strategies, and perceptions of mental health, have been shown to prevent men from accessing Web-based health resources [46]. Other barriers, such as privacy; ease of navigation; personal relevance; and lack of personal interaction, time, and knowledge, may prevent men from using eHealth programs for depression [33]. Thus, there are probable barriers other than attitudes toward help seeking that inhibit men from seeking Web-based help.
The majority of design features preferred among women were interactive in nature. Furthermore, women were more likely to use a guided feature in which they could ask questions and receive answers from a mental health professional. This reflects women’s use of eHealth programs for social motives and enjoyment, in addition to information seeking [48], and their willingness to speak to a mental health professional [43]. Men preferred to receive information in a video game format, compared with women. Men enjoy gaming and seek out game-play for social situations more so than women [54]; consequently, they may find eHealth information more interesting and engaging in this format.
Among men and women who were likely to use an e-mental health program for work stress, few differences in design feature preference were evident. Most notably, women no longer preferred interactive features as compared with men. Men who are likely to use an e-mental health program may have greater acceptability of eHealth programs, resulting in a greater likelihood of using a variety of e-mental health features. Factors such as perceived internet skill and perceived credibility of Web-based information predict the use of Web-based interactive features and may also differ among men who are likely to use an e-mental health program for work stress [55].
To our knowledge, there are no studies that have examined specific design feature preferences of e-mental health programs across age; however, the general use of mobile phones and apps is consistent with our findings: younger individuals are more likely to own a mobile phone [56] and to download and use health-related apps [57] than older individuals. Accordingly, tailoring eHealth interventions to participants’ age may improve the efficacy of eHealth interventions.
Limitations
First, the findings from this study are limited by the survey data’s reliance on self-reporting. As such, reporting and recall biases are possible and causal inferences cannot be drawn. Second, the surveys in men and in women were not conducted during the same time. The impact of timing of the survey on the results is not clear. Third, both surveys were conducted in Canada; thus, precautions need to be taken when extrapolating the results to other regions. Fourth, the response rate for women was relatively low, as compared with men. Among 1255 eligible women, 755 (60.1%) were excluded from the study because of prolonged absence, incomplete questionnaires, scheduled callbacks not within data collection period, and refusal after eligibility was verified. This may have reflected systematic bias, wherein females with negative attitudes toward psychological treatment or e-mental health have declined to respond to the survey. Furthermore, income level was used to calculate the risk of depression in women; thus, women with a lower income level may be overrepresented in this sample. Fifth, women showed greater acceptability toward the use of e-mental health programs, which could influence design feature preference. Likewise, previous treatment experience was not examined in this study and may have an effect on e-mental health acceptability [58] as well as design feature preference. Sixth, design feature preference was measured by the use of a single item. The use of more items may have generated a score that is more reliable. Finally, although studies have found that treatment acceptability is important to consider as it may improve both treatment adherence [59] and overall outcome [60], and although intention is believed to be the best proximal predictor of actual behavior, it may not translate directly to the actual use of internet technology use [61].
Conclusions
E-mental health programs can play an important role in the prevention of workplace depression. To enhance the program’s acceptance, adherence, and effectiveness, researchers and program developers should account for patients’ preferences and needs in the design process, including any sex- or age-based differences. This research found that both men and women highly endorsed an intervention containing quality information about stress reduction, work-related stress, and sleep hygiene. However, sex differences emerged. Most notably, women preferred interactive programs that incorporated exercises to reduce stress and Web-based guidance, whereas men preferred receiving information in a video game format. Tailored programs, such as those that involve interactive exercises and guidance or are presented in a video game format, could be beneficial in enhancing e-mental health use in women and men, respectively. Future studies should evaluate the effectiveness of e-mental health programs from sex and age perspectives and identify innovative ways for enhancing the use of e-mental health programs in working men and women at high risk of developing depression.
Acknowledgments
The authors thank E Jones, R Huntley, J Thomas, M Uppal, S McKinney, and NG Tafreshi for their assistance in data collection. This work was supported by the Department of Psychiatry, Faculty of Medicine, University of Calgary, Mathison Centre for Mental Health Research and Education, Hotchkiss Brain Institute, University of Calgary, and HBI-Pfizer Research Award.
Abbreviations
- BIP
Bureau d’intervieweurs professionels
- CBT
cognitive behavioral therapy
- eHealth
electronic health
- e-mental health
electronic mental health
- MDE
major depressive episode
Footnotes
Conflicts of Interest: None declared.
References
- 1.Van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, Riper H. Adherence to Internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One. 2014;9(7):e100674. doi: 10.1371/journal.pone.0100674. http://dx.plos.org/10.1371/journal.pone.0100674 .PONE-D-13-40111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Bostwick JM, Pankratz VS. Affective disorders and suicide risk: a reexamination. Am J Psychiatry. 2000 Dec;157(12):1925–32. doi: 10.1176/appi.ajp.157.12.1925. https://ajp.psychiatryonline.org/doi/abs/10.1176/appi.ajp.157.12.1925 . [DOI] [PubMed] [Google Scholar]
- 3.Lo Sasso AT, Rost K, Beck A. Modeling the impact of enhanced depression treatment on workplace functioning and costs: a cost-benefit approach. Med Care. 2006 Apr;44(4):352–8. doi: 10.1097/01.mlr.0000204049.30620.1e.00005650-200604000-00009 [DOI] [PubMed] [Google Scholar]
- 4.Furukawa TA, Horikoshi M, Kawakami N, Kadota M, Sasaki M, Sekiya Y, Hosogoshi H, Kashimura M, Asano K, Terashima H, Iwasa K, Nagasaku M, Grothaus LC, GENKI Project Telephone cognitive-behavioral therapy for subthreshold depression and presenteeism in workplace: a randomized controlled trial. PLoS One. 2012;7(4):e35330. doi: 10.1371/journal.pone.0035330. http://dx.plos.org/10.1371/journal.pone.0035330 .PONE-D-11-18553 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Mino Y, Babazono A, Tsuda T, Yasuda N. Can stress management at the workplace prevent depression? A randomized controlled trial. Psychother Psychosom. 2006;75(3):177–82. doi: 10.1159/000091775.91775 [DOI] [PubMed] [Google Scholar]
- 6.Martin A, Sanderson K, Cocker F. Meta-analysis of the effects of health promotion intervention in the workplace on depression and anxiety symptoms. Scand J Work Environ Health. 2009 Jan;35(1):7–18. doi: 10.5271/sjweh.1295. http://www.sjweh.fi/show_abstract.php?abstract_id=1295 .1295 [DOI] [PubMed] [Google Scholar]
- 7.Patten SB, Williams JV, Lavorato DH, Fiest KM, Bulloch AG, Wang J. Antidepressant use in Canada has stopped increasing. Can J Psychiatry. 2014 Nov;59(11):609–14. doi: 10.1177/070674371405901107. http://europepmc.org/abstract/MED/25565477 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Jorm AF. Why hasn't the mental health of Australians improved? The need for a national prevention strategy. Aust N Z J Psychiatry. 2014 Sep;48(9):795–801. doi: 10.1177/0004867414546387.48/9/795 [DOI] [PubMed] [Google Scholar]
- 9.Jorm AF, Patten SB, Brugha TS, Mojtabai R. Has increased provision of treatment reduced the prevalence of common mental disorders? Review of the evidence from four countries. World Psychiatry. 2017 Feb;16(1):90–99. doi: 10.1002/wps.20388. doi: 10.1002/wps.20388. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Mojtabai R, Jorm AF. Trends in psychological distress, depressive episodes and mental health treatment-seeking in the United States: 2001-2012. J Affect Disord. 2015 Mar 15;174:556–61. doi: 10.1016/j.jad.2014.12.039.S0165-0327(14)00825-8 [DOI] [PubMed] [Google Scholar]
- 11.Patten SB, Williams JV, Lavorato DH, Bulloch AG, Wiens K, Wang J. Why is major depression prevalence not changing? J Affect Disord. 2016 Jan 15;190:93–97. doi: 10.1016/j.jad.2015.09.002.S0165-0327(15)30474-2 [DOI] [PubMed] [Google Scholar]
- 12.Furlan AD, Gnam WH, Carnide N, Irvin E, Amick BC, DeRango K, McMaster R, Cullen K, Slack T, Brouwer S, Bültmann U. Systematic review of intervention practices for depression in the workplace. J Occup Rehabil. 2012 Sep;22(3):312–21. doi: 10.1007/s10926-011-9340-2. [DOI] [PubMed] [Google Scholar]
- 13.Joyce S, Modini M, Christensen H, Mykletun A, Bryant R, Mitchell PB, Harvey SB. Workplace interventions for common mental disorders: a systematic meta-review. Psychol Med. 2016 Mar;46(4):683–97. doi: 10.1017/S0033291715002408.S0033291715002408 [DOI] [PubMed] [Google Scholar]
- 14.Harvey SB, Henderson M. Occupational psychiatry. Psychiatry. 2009 May;8(5):174–8. doi: 10.1016/j.mppsy.2009.03.011. [DOI] [Google Scholar]
- 15.Cuijpers P, Beekman AT, Reynolds CF. Preventing depression: a global priority. J Am Med Assoc. 2012 Mar 14;307(10):1033–4. doi: 10.1001/jama.2012.271. http://europepmc.org/abstract/MED/22416097 .307/10/1033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Hickie IB. Preventing depression: a challenge for the Australian community. Med J Aust. 2002 Oct 07;177(Suppl):S85–6. doi: 10.5694/j.1326-5377.2002.tb04862.x.hic10375_fm [DOI] [PubMed] [Google Scholar]
- 17.Tan L, Wang MJ, Modini M, Joyce S, Mykletun A, Christensen H, Harvey SB. Preventing the development of depression at work: a systematic review and meta-analysis of universal interventions in the workplace. BMC Med. 2014 May 09;12:74. doi: 10.1186/1741-7015-12-74. https://bmcmedicine.biomedcentral.com/articles/10.1186/1741-7015-12-74 .1741-7015-12-74 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Lynch FL, Hornbrook M, Clarke GN, Perrin N, Polen MR, O'Connor E, Dickerson J. Cost-effectiveness of an intervention to prevent depression in at-risk teens. Arch Gen Psychiatry. 2005 Nov;62(11):1241–8. doi: 10.1001/archpsyc.62.11.1241.62/11/1241 [DOI] [PubMed] [Google Scholar]
- 19.Lal S, Adair CE. E-mental health: a rapid review of the literature. Psychiatr Serv. 2014 Jan 01;65(1):24–32. doi: 10.1176/appi.ps.201300009.1745988 [DOI] [PubMed] [Google Scholar]
- 20.Musiat P, Tarrier N. Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol Med. 2014 Nov;44(15):3137–50. doi: 10.1017/S0033291714000245.S0033291714000245 [DOI] [PubMed] [Google Scholar]
- 21.Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012 Jun;32(4):329–42. doi: 10.1016/j.cpr.2012.02.004.S0272-7358(12)00027-X [DOI] [PubMed] [Google Scholar]
- 22.Kazdin AE, Rabbitt SM. Novel Models for Delivering Mental Health Services and Reducing the Burdens of Mental Illness. Clinical Psychological Science. 2013 Jan 23;1(2):170–191. doi: 10.1177/2167702612463566. [DOI] [Google Scholar]
- 23.Statistics Canada. 2013. [2018-05-31]. Individual Internet use and e-commerce http://www.statcan.gc.ca/daily-quotidien/131028/dq131028a-eng.pdf .
- 24.Steeves V. Media Smarts. 2014. [2018-11-01]. Young Canadians in a Wired World, Phase III: Life Online http://mediasmarts.ca/ycww/life-online .
- 25.Statistics Canada. 2010. [2018-05-31]. Internet use at home, by Internet activity and urban or rural distribution https://www.statcan.gc.ca/tables-tableaux/sum-som/l01/cst01/comm29a-eng.htm .
- 26.Patten SB, Williams JV, Lavorato DH, Wang JL, McDonald K, Bulloch AG. Descriptive epidemiology of major depressive disorder in Canada in 2012. Can J Psychiatry. 2015 Jan;60(1):23–30. doi: 10.1177/070674371506000106. http://europepmc.org/abstract/MED/25886546 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Navaneelan T. Statistics Canada. [2018-05-31]. Suicide rates: An overview https://www.statcan.gc.ca/pub/82-624-x/2012001/article/11696-eng.htm .
- 28.Swami V. Mental health literacy of depression: gender differences and attitudinal antecedents in a representative British sample. PLoS One. 2012;7(11):e49779. doi: 10.1371/journal.pone.0049779. http://dx.plos.org/10.1371/journal.pone.0049779 .PONE-D-12-21685 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Judd F, Komiti A, Jackson H. How does being female assist help-seeking for mental health problems? Aust N Z J Psychiatry. 2008 Jan;42(1):24–9. doi: 10.1080/00048670701732681.787819880 [DOI] [PubMed] [Google Scholar]
- 30.Addis ME, Mahalik JR. Men, masculinity, and the contexts of help seeking. Am Psychol. 2003 Jan;58(1):5–14. doi: 10.1037/0003-066x.58.1.5. [DOI] [PubMed] [Google Scholar]
- 31.Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, Berger T, Botella C, Breton JM, Carlbring P, Christensen H, de Graaf E, Griffiths K, Donker T, Farrer L, Huibers MJ, Lenndin J, Mackinnon A, Meyer B, Moritz S, Riper H, Spek V, Vernmark K, Cuijpers P. Predictors of treatment dropout in self-guided web-based interventions for depression: an 'individual patient data' meta-analysis. Psychol Med. 2015 Oct;45(13):2717–26. doi: 10.1017/S0033291715000665.S0033291715000665 [DOI] [PubMed] [Google Scholar]
- 32.Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res. 2009;11(2):e13. doi: 10.2196/jmir.1194. http://www.jmir.org/2009/2/e13/ v11i2e13 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Wang J, Lam RW, Ho K, Attridge M, Lashewicz BM, Patten SB, Marchand A, Aiken A, Schmitz N, Gundu S, Rewari N, Hodgins D, Bulloch A, Merali Z. Preferred features of e-mental health programs for prevention of major depression in male workers: results from a Canadian national survey. J Med Internet Res. 2016;18(6):e132. doi: 10.2196/jmir.5685. http://www.jmir.org/2016/6/e132/ v18i6e132 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Wang JL, Manuel D, Williams J, Schmitz N, Gilmour H, Patten S, MacQueen G, Birney A. Development and validation of prediction algorithms for major depressive episode in the general population. J Affect Disord. 2013 Oct;151(1):39–45. doi: 10.1016/j.jad.2013.05.045. https://linkinghub.elsevier.com/retrieve/pii/S0165-0327(13)00424-2 .S0165-0327(13)00424-2 [DOI] [PubMed] [Google Scholar]
- 35.D'Agostino RB, Vasan RS, Pencina MJ, Wolf PA, Cobain M, Massaro JM, Kannel WB. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation. 2008 Feb 12;117(6):743–53. doi: 10.1161/CIRCULATIONAHA.107.699579. http://circ.ahajournals.org/cgi/pmidlookup?view=long&pmid=18212285 .CIRCULATIONAHA.107.699579 [DOI] [PubMed] [Google Scholar]
- 36.Lloyd-Jones DM. Cardiovascular risk prediction: basic concepts, current status, and future directions. Circulation. 2010 Apr 20;121(15):1768–77. doi: 10.1161/CIRCULATIONAHA.109.849166. http://circ.ahajournals.org/cgi/pmidlookup?view=long&pmid=20404268 .121/15/1768 [DOI] [PubMed] [Google Scholar]
- 37.Kontos E, Blake KD, Chou WS, Prestin A. Predictors of eHealth usage: insights on the digital divide from the Health Information National Trends Survey 2012. J Med Internet Res. 2014;16(7):e172. doi: 10.2196/jmir.3117. http://www.jmir.org/2014/7/e172/ v16i7e172 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Papacharissi Z, Rubin AM. Predictors of internet use. J Broadcast Electron Media. 2010 Jun 07;44(2):175–96. doi: 10.1207/s15506878jobem4402_2. [DOI] [Google Scholar]
- 39.Powell J, Clarke A. Internet information-seeking in mental health: population survey. Br J Psychiatry. 2006 Sep;189:273–7. doi: 10.1192/bjp.bp.105.017319.S0007125000232613 [DOI] [PubMed] [Google Scholar]
- 40.Kummervold PE, Chronaki CE, Lausen B, Prokosch H, Rasmussen J, Santana S, Staniszewski A, Wangberg SC. eHealth trends in Europe 2005-2007: a population-based survey. J Med Internet Res. 2008;10(4):e42. doi: 10.2196/jmir.1023. http://www.jmir.org/2008/4/e42/ v10i4e42 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Rice RE. Influences, usage, and outcomes of Internet health information searching: multivariate results from the Pew surveys. Int J Med Inform. 2006 Jan;75(1):8–28. doi: 10.1016/j.ijmedinf.2005.07.032.S1386-5056(05)00146-2 [DOI] [PubMed] [Google Scholar]
- 42.Ybarra M, Suman M. Reasons, assessments and actions taken: sex and age differences in uses of Internet health information. Health Educ Res. 2008 Jun;23(3):512–21. doi: 10.1093/her/cyl062. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=16880222 .cyl062 [DOI] [PubMed] [Google Scholar]
- 43.Tsan JY, Day SX. Personality and gender as predictors of online counseling use. J Technol Hum Serv. 2008 Sep 08;25(3):39–55. doi: 10.1300/J017v25n03_03. [DOI] [Google Scholar]
- 44.Greenberg BS, Sherry J, Lachlan K, Lucas K, Holmstrom A. Orientations to video games among gender and age groups. Simul Gaming. 2008 Jul 25;41(2):238–59. doi: 10.1177/1046878108319930. [DOI] [Google Scholar]
- 45.Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, Morgan C, Rüsch N, Brown JS, Thornicroft G. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. 2015 Jan;45(1):11–27. doi: 10.1017/S0033291714000129.S0033291714000129 [DOI] [PubMed] [Google Scholar]
- 46.Ellis LA, Collin P, Hurley PJ, Davenport TA, Burns JM, Hickie IB. Young men's attitudes and behaviour in relation to mental health and technology: implications for the development of online mental health services. BMC Psychiatry. 2013;13:119. doi: 10.1186/1471-244X-13-119. http://www.biomedcentral.com/1471-244X/13/119 .1471-244X-13-119 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Cotten SR, Gupta SS. Characteristics of online and offline health information seekers and factors that discriminate between them. Soc Sci Med. 2004 Nov;59(9):1795–806. doi: 10.1016/j.socscimed.2004.02.020.S0277953604000796 [DOI] [PubMed] [Google Scholar]
- 48.Bidmon S, Terlutter R. Gender differences in searching for health information on the internet and the virtual patient-physician relationship in Germany: exploratory results on how men and women differ and why. J Med Internet Res. 2015;17(6):e156. doi: 10.2196/jmir.4127. http://www.jmir.org/2015/6/e156/ v17i6e156 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Marton C, Wei Choo C. A review of theoretical models of health information seeking on the web. J Doc. 2012 Apr 20;68(3):330–52. doi: 10.1108/00220411211225575. [DOI] [Google Scholar]
- 50.Young R. The household context for women's health care decisions: impacts of UK policy changes. Soc Sci Med. 1996 Mar;42(6):949–63. doi: 10.1016/0277-9536(95)00192-1.0277953695001921 [DOI] [PubMed] [Google Scholar]
- 51.Yoo E, Robbins LS. Understanding middle-aged women's health information seeking on the web: a theoretical approach. J Am Soc Inf Sci. 2008 Feb 15;59(4):577–90. doi: 10.1002/asi.20766. [DOI] [Google Scholar]
- 52.Wallin EE, Mattsson S, Olsson EM. The preference for internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment Health. 2016 Jun 14;3(2):e25. doi: 10.2196/mental.5324. http://mental.jmir.org/2016/2/e25/ v3i2e25 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Mackenzie CS, Gekoski WL, Knox VJ. Age, gender, and the underutilization of mental health services: the influence of help-seeking attitudes. Aging Ment Health. 2006 Nov;10(6):574–82. doi: 10.1080/13607860600641200.M0222V7376P5M826 [DOI] [PubMed] [Google Scholar]
- 54.Lucas K. Sex differences in video game play: a communication-based explanation. Communication Research. 2004 Oct 01;31(5):499–523. doi: 10.1177/0093650204267930. [DOI] [Google Scholar]
- 55.Chung DS. Interactive features of online newspapers: identifying patterns and predicting use of engaged readers. Comput Mediat Commun. 2008;13(3):658–79. doi: 10.1111/j.1083-6101.2008.00414.x. [DOI] [Google Scholar]
- 56.Poushter J. Pew Research Center. 2016. [2019-01-25]. Smartphone Ownership and Internet Usage Continues to Climb in Emerging Economies http://www.pewresearch.org/wp-content/uploads/sites/2/2016/02/pew_research_center_global_technology_report_final_february_22__2016.pdf .
- 57.Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR Mhealth Uhealth. 2015 Nov 04;3(4):e101. doi: 10.2196/mhealth.4924. http://mhealth.jmir.org/2015/4/e101/ v3i4e101 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health--attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry. 2014;14:109. doi: 10.1186/1471-244X-14-109. http://bmcpsychiatry.biomedcentral.com/articles/10.1186/1471-244X-14-109 .1471-244X-14-109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Santana L, Fontenelle LF. A review of studies concerning treatment adherence of patients with anxiety disorders. Patient Prefer Adherence. 2011;5:427–39. doi: 10.2147/PPA.S23439. doi: 10.2147/PPA.S23439.ppa-5-427 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Swift JK, Callahan JL, Cooper M, Parkin SR. The impact of accommodating client preference in psychotherapy: a meta-analysis. J Clin Psychol. 2018 Nov;74(11):1924–37. doi: 10.1002/jclp.22680. [DOI] [PubMed] [Google Scholar]
- 61.Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manag Sci. 1989 Aug;35(8):982–1003. doi: 10.1287/mnsc.35.8.982. [DOI] [Google Scholar]