ABSTRACT
Objective:
The objective of this scoping review was to identify studies combining the concepts of eHealth and work participation for sick-listed employees across diagnostic groups in health care and workplace contexts.
Introduction:
There is an increased demand for better health care services and technologies, and eHealth is proposed as a useful tool to improve efficiency and reduce costs. eHealth functions at the intersection of medical informatics, public health, and business, and may be a promising solution for managing the process of return to work among employees on sick leave. Assessment of work outcomes is essential in evaluating the effectiveness of health services, and there is a need to map the research literature on existing eHealth interventions to facilitate work participation.
Inclusion criteria:
This scoping review considered studies combining two core concepts: eHealth and work participation. It considered studies on eHealth interventions for employees (18 to 65 years of age) on sick leave due to any type of diagnosis or disability, conducted by any stakeholder in workplace or health care contexts and in any country. Empirical data from both quantitative and qualitative studies were included.
Methods:
Published and unpublished studies from January 1, 2008, to August 21, 2020, written in English were included in this review. The search was conducted in MEDLINE, Scopus, Embase, PsycINFO, WHO clinical registry, and ClinicalTrials.gov. A three-step search strategy was followed. Data extraction was performed by two independent reviewers and undertaken using an extraction tool developed specifically for the scoping review objectives.
Results:
This review identified 15 studies eligible for inclusion. Four studies delivered the eHealth intervention by telephone, while 10 interventions were web-based. Of the web-based interventions, five had a blended approach, such as website and email support, or website and social media platforms. One study used an app-based intervention. Only eight studies targeted employees sick-listed due to common sick leave diagnoses, such as common mental disorders and musculoskeletal disorders. The workplace context was the target of the eHealth intervention in seven studies, although the intervention was still delivered by health personnel such as therapists or occupational physicians. Collaboration on individual cases between the health professional, employer, and employee to facilitate work participation seemed to be rare. Four studies reported both a theoretical and an empirical base for the intervention used.
Conclusions:
This review demonstrated that the use of eHealth interventions to facilitate work participation is limited, and there is a need for future studies on the use of eHealth technology for this purpose. Developing eHealth interventions specifically for populations at risk of long-term sick leave, and encouraging collaboration between all relevant stakeholders, may help improve work participation.
Keywords: eHealth, occupational rehabilitation, return to work, sick leave, workplace intervention
Introduction
Health care expenditures are increasing worldwide due to the higher costs of services, technologies, and medicines.1 The World Health Organization (WHO) encourages member states to improve efficiency, and the application of information and communication technology is becoming a useful tool to attain this goal.1 Approximately 50% of all member states have an eHealth strategy (ie, a strategy for the use of information and communication technology in support of health and health-related fields and to promote universal health coverage), and the use of eHealth technology in the delivery of health care services is growing rapidly.2,3 In accordance with the recommendations of the WHO, the European Union has created an eHealth network to support the member states in eHealth-related issues and increase the use of eHealth to improve prevention, diagnosis, treatment, monitoring, and management of health.4 Because eHealth functions at the intersection of medical informatics, public health, and business,5 it may be a promising solution to help manage the process toward work participation for employees during sick leave.6-8 Long-term sick leave and work disability are costly for society and the individual,9 and assessment of work outcomes is needed to evaluate the effectiveness of health services.10
Research on eHealth is growing, and eHealth interventions are offered and examined for different patient groups (eg, patients with anxiety or cancer) and in different health care contexts.11-21 Web-based follow-up interventions have shown promising results in terms of faster return to work (RTW) for employees sick-listed due to common mental disorders,8 and for women after gynecological surgery.22 There is some evidence to suggest that eHealth interventions have been cost-effective in some specialties (eg, teleophthalmology, telecardiology), but there is limited evidence from randomized controlled trials (RCTs).23,24 Lokman et al.6 concluded that an eHealth intervention aimed at improving RTW among sick-listed employees showed a positive cost-benefit for the involved stakeholders, but studies regarding the cost-effectiveness of eHealth interventions for work-related outcomes are few. eHealth interventions were initially developed as a tool for an interaction between health care professionals and patients.25 Still, studies among sick-listed employees seem to focus on health outcomes, rather than work outcomes, and studies on eHealth in occupational health are sparse.26 There is a pertinent gap in the literature regarding how to combine the concepts “eHealth” and “work participation.”
Improvements in health care efficiency and increased labor participation rates serve the interest of governments, health care institutions, organizations, and individuals.9,25 As the conceptualization of work disability has expanded, the number of stakeholders interested in work disability prevention has increased.27 Additionally, recognition of the central role of stakeholder involvement in influencing actions, aims, and successful implementation, as well as optimizing the effect of RTW interventions, has improved across health care and workplace contexts.27-31 The use of eHealth technology to facilitate work participation is an evolving field, and when new services are provided, it is necessary to investigate the delivery of the intervention. This includes examining which stakeholders are involved, as they often reflect the values and goals of the interventions.28 The definition of what enhances success of the intervention may also vary among different stakeholder groups.28 Furthermore, the implementation of new technology may challenge organizations and health care workers, with technological possibilities often in conflict with prevailing service delivery systems and user preferences.32 Successful implementation of eHealth tools depends on cross-disciplinary support and strategies both inside and outside of organizations,33 and on support from the health care providers who acknowledge the benefits for their patients.34 Thus, it is important to investigate which stakeholders are involved in eHealth interventions, as well as in which contexts such interventions are provided. In the current scoping review, the term “stakeholder” refers to all professionals in the workplace and health care contexts.
It is important also to inform practice about when, why, and how interventions might work.35 To answer these questions, a theory-based approach to research is often sought.35,36 In behavioral sciences, theories, such as the theory of planned behavior, provide tentative explanations for why and in which circumstances behavior change is most likely to occur.37 Hence, a theory-based approach brings forth a way of understanding the effect of an intervention or lack thereof.37 The explicit use of a theory offers a generalizable framework for interpreting behavior and evaluating potential causal mechanisms.37 Knowledge about whether an intervention is theory-driven, based on empirical evidence, or both is valuable when assessing intervention implementation. Therefore, this scoping review also explored whether identified interventions were theory-driven or mainly empirically grounded.
The objective of the current scoping review was to identify studies combining the two concepts of “eHealth” and “work participation” for sick-listed employees across diagnostic groups in both health care and workplace contexts. All types of quantitative and qualitative intervention studies were included. This scoping review provides knowledge on eHealth and work participation beyond measures of effect, which is necessary for developing a situational understanding of the active elements and identifying gaps in evidence.35
Based on the preliminary search for existing reviews, we limited the search period to include studies published after 2007. The preliminary search, including studies combining eHealth interventions with reports of work-related outcomes, was conducted in the JBI Database of Systematic Reviews and Implementation Reports, the Cochrane Database of Systematic Reviews, MEDLINE, and Trip Database. Only one systematic review, searching for literature up to and including February 2007, was identified on this topic. This review focused on clinical outcomes where RTW was a secondary outcome in only two of the identified studies.38 Furthermore, eHealth is a relatively young discipline with a constant and rapid change in technology,39 and it is reasonable to assume that recent studies are more relevant for current practice.
Another search was conducted in PROSPERO, revealing 30 ongoing systematic reviews on eHealth interventions. One of these reviews combined the eHealth intervention with a work-related outcome.40 However, the ongoing systematic review by Schumacher et al.40 limited its objective to include only RCTs aimed to facilitate RTW, therefore differing from this scoping review.
Review questions
The scoping review focused on the following questions:
For which populations were eHealth interventions aimed at work participation provided?
In which contexts were eHealth interventions aimed at work participation provided?
By which stakeholders were eHealth interventions aimed at work participation provided?
Were eHealth interventions aimed at work participation theory-driven or based on empirical evidence?
Inclusion criteria
Participants
This scoping review considered studies that included employees of working age (range: 18 to 65 years of age) who were on sick leave (full or partial) due to any type of diagnosis or disability.
Concepts
The scoping review investigated the combination of two core concepts: eHealth and work participation. eHealth is a much-used term, with no clear definition, and the precise meaning may vary with context and among stakeholders.41 We used both the definition from Eysenbach5 and the WHO,42 two broad and widely accepted definitions, to understand and operationalize eHealth. Eysenbach5 defines eHealth as health services and information delivered or enhanced through the internet and related technologies. The WHO defines eHealth as the use of information and communication technology for health.42 In this review, eHealth interventions were operationalized as health services and information delivered through the internet (eg, by a website and/or by email), by a mobile device or telephone, or by a computer program or software. This included studies using terms that are interchangeable with eHealth, such as telecare, telehealth, telemedicine, or mHealth.
Work participation was defined as work-related outcomes operationalized by different outcome measures (eg, work participation, sick leave duration, time to RTW, work productivity) and obtained through both quantitative and qualitative data. Return-to-work is not an isolated event, but rather an evolving process with several phases before and after work re-entry,43-46 and the terminology and measurements of work-related outcomes vary between studies47 depending on the purpose of the study and available data.44,48 Measures of work participation may also be influenced by differences in the legal system, the labor market, and work environments in different countries.47,49 Because of this variation in terminology and available data, we chose to use a broad approach to capture work participation in this scoping review.
Contexts
This review included studies on eHealth interventions that aimed to facilitate work participation for a specified population and were conducted in the workplace or health care contexts (eg, primary or secondary health care).
Types of studies
This review included empirical studies on eHealth interventions aimed at work participation, independent of study design. Exclusion criteria were studies on eHealth interventions offered to unemployed persons and studies focusing on presenteeism (reflecting people working with an injury or illness that impact on their work productivity).
Based on the study aim (ie, to identify studies comprising both an eHealth intervention and outcome measures on work participation), the search for unpublished literature was limited to scientific databases (WHO clinical registry and ClinicalTrials.gov). Book chapters, editorial letters, guidelines, and websites were excluded, in addition to all types of reviews and protocols.
Methods
This scoping review was conducted according to JBI methodology.50 The objectives, inclusion criteria, and methods of analysis were specified in advance and documented in an a priori protocol.51 As recommended by the JBI Manual for Evidence Synthesis and by Levac et al.,52 a stakeholder with specialist expertise in eHealth practice and research was consulted when preparing the study protocol and when discussing the scoping review results.
Search strategy
A comprehensive search strategy was conducted to identify both published and unpublished studies. The following databases were searched: MEDLINE (PubMed), Scopus (Elsevier), Embase (Elsevier), PsycINFO (ProQuest), WHO clinical registry, and ClinicalTrials.gov. A research librarian assisted in refining the search strategy developed for MEDLINE for use in the other electronic databases. A three-step search approach was utilized to identify relevant studies.50 Step 1 involved an initial limited search in MEDLINE using preliminary keywords for study population (patients and employees), content of the intervention (eHealth), context (health care and workplace), and work-related outcomes, followed by an analysis of the index terms and text words from the titles and abstracts. For step 2, an extensive search including all identified index terms and keywords was performed across databases. In step 3, the reference lists of all included papers were searched for additional studies. Articles written in English and published from January 1, 2008, until August 21, 2020 were considered for inclusion. A detailed search strategy is presented in Appendix I.
Study selection
Following the search, all identified citations were uploaded into RefWorks (ProQuest LLC, Ann Arbor, USA). Two reviewers (TJ and IØ) independently reviewed all titles and abstracts. The full texts of studies were retrieved and independently reviewed by two reviewers (TJ and IØ). Full-text studies that did not meet the inclusion criteria were excluded and reasons for their exclusion are provided in Appendix II. Any disagreements that arose between the reviewers were resolved through discussion with a third reviewer (TLJ).
Data extraction
Data were extracted from included studies by teams of two independent reviewers per study (TJ, IØ, TLJ, THT, AMHM, and CVN) using the data extraction tool specified in the review protocol.51 The data extracted included specific details about the population, context, stakeholders, type and content of the intervention, efficacy, theoretical or empirical base of the intervention, and concepts of significance to the specific objective of the scoping review (eHealth and work participation). Any disagreements between the reviewers were resolved through discussion with a third reviewer (TLJ and IØ). For three of the included studies,8,53,54 additional papers such as protocols and cost-benefit articles reporting findings from the same studies were used as supplementary information in the review process. Authors of two papers, Vonk Noordegraaf et al.22 and Bouwsma et al.,53 were contacted to clarify that these two papers were not from the same study.
Data analysis and presentation
The extracted data are presented in both diagrammatic and tabular form as recommended in the scoping review guidelines. The diagrammatic and tabular presentations are accompanied by a narrative summary of results in a figure. The objective of this scoping review was broad, including studies on eHealth interventions for any type of diagnosis, using different outcomes to measure work participation. Therefore, the presentation of results and the discussion are also broad.
Results
Study inclusion
The database search and search of other sources resulted in 2513 studies after duplicates were removed. After screening titles and abstracts, 32 full-text papers were retrieved, 18 of which were excluded based on inclusion criteria (Appendix II). One additional paper was identified through screening of references, which resulted in a total of 15 studies included in the final scoping review (Figure 1).
Figure 1.
Search results and study selection and inclusion process
Characteristics of included studies
Thirteen of the 15 studies were from European countries, eight of which were conducted in the Netherlands (Table 1). Ten studies were RCTs evaluating the effect of eHealth interventions on the duration of sick leave.8,22,26,53-59 One study used qualitative interviews,60 one study used a time-series analysis,61 and one study used a mixed methods design.7 In four studies, the main aim was to explore the feasibility or acceptability of the eHealth intervention.7,60,62,63 The population sizes ranged from 23 to 22,524 patients/employees.
Table 1.
Characteristics of included studies
Author, year | Country | Aims | Type of eHealth intervention | Intervention A: based on theory B: based on empirical evidence | Design | User group | Context | Stakeholders | Work-related outcomes |
De Jong et al. (2009)60 | Netherlands | Examine feasibility of a web-based counseling program | Web-based counseling program, website | B | Semi-structured in-depth interviews | Employees sick-listed due to non-specific back or neck pain | Occupational health care | OPs | Self-reports of whether the program helped the employees RTW faster |
Bee et al. (2010)55 | United Kingdom (England) |
Examine feasibility and pilot testing of telephone-delivered CBT | Telephone-delivered CBT | B | Pilot RCT | Employees sick-listed due to mental health condition | Workplace | CBT therapists | Self-reported actual and effective working hours |
Sullivan et al. (2012)62 | Canada | Examine feasibility of a telephonic occupational rehabilitation program | Telephonic occupational rehabilitation program | B | Matched control study | Patients with chronic musculoskeletal condition | Community of residence | Occupational therapists | Clinician-reported RTW: Not working, modified-, part-time, or full-time work |
Vonk Noordegraaf et al. (2014)22 | Netherlands | Evaluate effectiveness of an eHealth intervention | Web-based program, website | B | Multicenter RCT | Patients scheduled for gynecological surgery | Secondary health care | Clinical OPs and occupational therapist | Duration of sick leave until full sustainable RTW |
Brown et al. (2015)61 | United Kingdom (Scotland) |
Evaluate effectiveness of a telephone-based sick leave management service | Telephone-based sick leave management | B | Time-series analysis | Employees with all type of sick leave diagnoses | Workplace and OHS | Trained staff at the OHS | Percentage reduced sick leave |
Volker et al. (2015)8 | Netherlands | Evaluate effectiveness of a blended eHealth intervention | Blended web-based intervention, Return@Work with email decision aid | B | RCT | Employees sick-listed due to common mental disorder | Occupational health care | OPs | Duration until first RTW, until full RTW, and total number of days on sick leave |
Tamminga et al. (2016)7 | Netherlands | Develop and examine the feasibility of an eHealth intervention to enhance RTW | Internet program Cancer@Work, website | A & B | Mixed-method, semi-structured interviews, telephone interviews, and questionnaires | Cancer survivors | Secondary health care | OPs, GPs, specialized nurses, and employers | Need for support regarding RTW |
Beiwinkel et al. (2017)58 | Germany | Evaluate effectiveness | Interactive web-based program Therapist feedback upon request via email or telephone |
B | Open-label RCT | Employees sick-listed due to depression | Statutory health insurance company and a private integrated care company | Psychologists or other therapists trained in the intervention approach | Information on work absence frequency was retrieved from health insurance records |
Bouwsma et al. (2017)53 | Netherlands | Evaluate effectiveness and cost-effectiveness of an internet-based care program | Interactive web portal | A & B | Step-wedge cluster RCT | Patients scheduled for gynecological surgery | Secondary health care | Gynecologists, GPs, and OPs |
Duration until full sustainable RTW |
Hara et al. (2017)56 | Norway | Evaluate effect of boosted RTW follow-up after occupational rehab | Telephone or videoconference follow-up | A & B | Pragmatic RCT | Patients with musculoskeletal pain, fatigue, and common mental disorder | Secondary health care | RTW coordinators | Full or partial RTW |
Deady et al. (2018)63 | Australia | Evaluate the usability, acceptability, feasibility, and preliminary efficacy | Smartphone app–based intervention, HeadGear |
B | Feasibility and acceptability study | Employees with mental health problems | Workplace | Self-management | Self-reported sick days past month |
Kaldo et al. (2018)54 | Sweden | Evaluate effectiveness of internet-based CBT targeting work-related areas | Internet-based CBT, website | B | RCT | Patients with depression | Primary health care | Clinical psychologist | Employment status and number of full-time sick-leave days per month |
Notenbomer et al. (2018)26 | Netherlands | Evaluate effect of an eHealth intervention | Personalized web-based intervention with feedback and advice | A & B | Three-armed RCT | Employees with frequent sickness absence | Workplace | Employer, GP, or OP | Number of sickness absence episodes and total sickness absence days |
Van der Meij et al. (2018)57 | Netherlands | Evaluate effect of a personalized interactive eHealth-care program | Interactive, tailored eHealth care, with feedback and chat line; website and mobile application with activity tracker | B | Multicenter single-blind RCT | Patients scheduled for abdominal surgery | Hospitals | Health care professional at hospitals | Time until first day of work resumption and days of complete work resumption |
Suman et al. (2019)59 | Netherlands | Assess effectiveness and cost-utility | Multifaceted eHealth strategy including a website, digital monthly newsletters, and social media platforms | B | Stepped-wedge cluster RCT | Patients diagnosed with non-specific low back pain | Primary health care | Self-management Patients were recruited from their GPs, OPs, and physical therapists |
Self-reported mean number of absence days over previous three months |
CBT, cognitive behavioral therapy; GP, general practitioner; OHS, occupational health service; OP, occupational physician; RCT, randomized controlled trial; RTW, return to work
Review findings
Populations
There were six groups of populations identified in this review. Five groups were employees who were sick-listed due to a particular diagnosis or health condition, while the sixth population group included employees who were sick-listed due to various diagnoses. Five eHealth interventions were provided for employees who were sick-listed due to common mental disorders,8,54,55,58,63 two eHealth interventions for employees with gynecological conditions,22,53 three eHealth interventions for employees with musculoskeletal conditions,59,60,62 one eHealth intervention for employees scheduled for abdominal surgery,57 and one eHealth intervention for cancer survivors.7 Three of the identified studies reported on an eHealth intervention for employees sick-listed due to various diagnoses; one of the studies included employees with musculoskeletal pain, fatigue, or common mental disorders,56 and two studies included employees sick-listed due to any type of diagnosis.26,61
Length of sick leave before inclusion varied from less than one week to several years. The shortest sick leave (less than one week) was among employees scheduled for gynecological surgery,22,53 and among employees with new sick leave incidents in a Scottish sick leave program.61 Among employees with depression in a primary care context,54 79% of the employees had no or very few days of full-time sick leave at baseline, whereas 7.8% had full-time or part-time sick leave for the duration of one month or more. In another study,56 56% of the employees participating in occupational rehabilitation had received temporary medical benefits for more than one year. The longest duration of sick leave before inclusion was among employees with chronic musculoskeletal conditions, who had been out of work for an average of 31 months.62
Contexts
The contexts for the eHealth interventions were the following: the workplace8,26,55,60,61,63; the health sector, either primary54,59 or secondary care7,22,53,56,57; the local community (in a clinic or at home)62; and a statutory health insurance company.58 For the studies taking place in an occupational context, the workplace involvement in the intervention varied. In two studies from the Netherlands,8,60 the interventions were delivered through the occupational health services (OHS) without any collaboration from the workplaces. In the intervention in one of the studies from the UK (Scotland), a politically initiated program was delivered by a collaboration between the workplace and the OHS.61 In the other study from the UK (England), the department of human resources in a large company conducted a telephone-delivered intervention to the included employees without any involvement from OHS.55 In a Swedish primary care context, eHealth cognitive behavioral therapy (CBT) was delivered by clinical psychologists engaged in the project without collaboration with ordinary primary care.54 The eHealth programs in the secondary care were delivered through gynecological hospital units7,22,53 or through occupational rehabilitation.56
Stakeholders providing the interventions
Most of the stakeholders providing the interventions were health professionals working in primary or secondary health care, such as physicians, psychologists, or occupational therapists.7,22,53,54,56,57 One or more stakeholders were involved in the delivery of the eHealth intervention (ie, CBT-therapist55; gynecologist, general physician, and occupational physician53; line manager and OHS staff61; employer, occupational physician, and general physician26; RTW coordinators56; psychologists54,58; occupational therapists62; several health professionals7,22,57; and occupational physicians8,60). Studies conducted at the workplace involved mainly occupational physicians from occupational health care or stakeholders from OHS.8,55,60,61 One study had a multi-stakeholder perspective with support from occupational physicians, general physicians, and nurses, as well as employers.7 Two studies were mainly focused on self-management, one with help from relevant stakeholders (employer, general physician, and occupational physician).59,63
The stakeholders’ role and active involvement in the eHealth interventions varied among studies. Some stakeholders used techniques based on cognitive behavioral principles,54-56,58 and some were trained in their therapeutic role and in the purpose and use of the particular program.60-62 A typical task was to suggest individually tailored advice on health and work issues.8,22,53 In the study by van der Meij et al.,57 an alert from the eHealth program advised participants to contact a specific health care professional if a patient's recovery was delayed. Stakeholder involvement could be brief with a single contact61 or comprehensive.,54 In the study by Kaldo et al.,54 the clinical psychologists gave active and individually tailored weekly support through 30 modules.
Type of eHealth interventions
Four studies reported eHealth programs mainly delivered by telephone,55,56,61,62 and 10 programs were web-based.7,8,22,26,53,54,57-60 Of these, five eHealth interventions had a blended approach, such as a web-based program and email or telephone feedback,58 website and email support,8 personalized web-based feedback and email,26 website and social media platforms,59 and website and a mobile application.57 One study used a smartphone app–based intervention.63
In general, the eHealth interventions were tailored and structured according to the individual employee's work- and health-related needs. The eHealth interventions delivered by telephone enabled personal communication and close collaboration between the employee and a stakeholder. For example, in the single telephone call from trained OHS staff in Scotland, the aim was to give the employee early support on the health issue and RTW possibilities, and to deliver information about available services to which the employee could self-refer if necessary.61 In another study, RTW coordinators in Norway telephoned the employees once a month for six months to boost the RTW process after occupational rehabilitation.56 The interventions delivered via the internet consisted of the following: self-help CBT texts tailored to the employee's clinical profile54; health- and work-related information7; an interactive web portal to monitor one's own recovery rate53; web-based modules on work and health8; peri- and post-operative instructions supporting recovery related to daily life and work22; a guided program with therapist contact on request58; personalized web-based feedback and preventive advisory consultation26; a Facebook page where patients could contact health care providers59; customized recovery advice and day-to-day feedback tailored to their personal situation57; and individually tailored interventions based on questionnaire responses.60 The study using a smartphone app provided participants with personalized risk feedback.63
Based on theory or empirical evidence
None of the included interventions appeared to be explicitly theory-based. However, four studies were inspired by theory in combination with empirical evidence to inform the development or design of the eHealth intervention.7,26,53,56 Tamminga et al.7 developed an eHealth intervention for employees with cancer based on the theory of self-management and integrated care management. Bouwsma et al.53 used the theory of planned behavior as a theoretical framework for determinants of behavior change towards recovery and RTW among employees scheduled for gynecological surgery. Acceptance and commitment therapy guided the development of an intervention for a mixed group of employees participating in occupational rehabilitation.56 Notenbomer et al.26 used the job demands-resources model as a theoretical framework for their eHealth intervention. See Figure 2 for a diagrammatic presentation of the results.
Figure 2.
eHealth and work participation: overview of identified contexts with corresponding populations, stakeholders, types of interventions, and theoretical or empirical base for intervention development
Work-related outcomes
Work participation was either a primary or a secondary outcome, and was measured with a variety of work-related outcomes. None of the included sources used exactly the same measure. Five studies collected register-based sick leave data,8,26,56,58,61 one study used clinician-reported RTW rates,62 and seven studies collected self-reported sick leave data.22,53-55,57,59,63 The self-reports were either quantified by actual and effective working hours (work productivity)55; with a single question on the current employment or sick leave status54; self-reported mean number of absence days59; self-reported sick days in the past month63; time until first resumption of work57; or collected by monthly, self-reported electronic calendars.22,53 Two studies measured work participation in a non-standardized way, such as the need for support regarding RTW7 or a question asking whether the eHealth intervention helped the employee to a faster RTW.60
Effect of eHealth interventions on work-related outcomes
All studies, apart from the studies with qualitative data collection,7,60 measured the effect or quality of the eHealth interventions. Half of the studies employing an RCT design showed effect on work participation and RTW,8,22,55-57 while the other half did not.26,53,54,58,59 In the matched control study by Sullivan et al.,62 the control group had higher clinician-rated RTW compared to the eHealth group, whereas in the study by Brown et al.,61 the sick leave rates in the study group were reduced by 21% compared to 9% across the rest of Scotland. The feasibility studies collecting qualitative data found that participants wanted to receive information and support regarding opportunities for RTW and regarding financial and legal aspects of their position.7 Furthermore, few employees reported a faster RTW although they were satisfied with the web-based counseling program.60 The pilot and feasibility study of Deady et al.63 found a reduction in overall past month sick days.
Adherence to eHealth interventions
Few of the included studies reported or discussed adherence and compliance to the eHealth intervention. Low adherence among stakeholders providing the intervention was reported in one study, mainly due to limited access to the employees engaging in the program on a daily basis, but also due to time constraints and low expected value.60 One study reported low adherence to the eHealth tool itself, where a process evaluation revealed that 27% of the participants had not received or fully read the digital advice.26 Two studies reported high adherence among participating employees,53,61 and four studies reported problems with recruitment, drop-out, or loss to follow-up.55,58,59,63
Discussion
The broad literature search between 2008 and 2020 identified 15 studies reporting eHealth interventions aimed to facilitate work participation. The low number of studies retrieved demonstrates that research on eHealth interventions to facilitate work participation is sparse. Although work is the foundation of many important determinants of health,64 RTW is not a main outcome of interest in the health care sector. Generally, the main objective of health care providers is to protect the health of patients. eHealth involves new modes of interaction between health care professionals and patients, and originates from the health care sector,65 which may explain the low number of eHealth interventions focusing on and measuring work participation. Also, the financial interests linked to maintaining a certain level of patient flow and health care utilization may be a consideration when deciding which RTW interventions to support.27,66 Franche et al.27 argued that health care providers may be prone to respond to RTW interventions that improve well-being without reducing health care utilization.
The populations identified in this review ranged from employees with musculoskeletal disorders or common mental disorders to employees with more specific conditions, such as gynecological surgery or cancer. However, more than one-half of the identified eHealth interventions focused on employees sick-listed due to common mental disorders or musculoskeletal disorders. This was not surprising, as these are the most common diagnoses reported for sick leave and are considered a major public health problem with signficant consequences for society.67,68 From a societal perspective, developing effective work-related eHealth interventions for these populations may be beneficial. By providing a platform for communication, eHealth may serve as a useful tool for sick-listed employees to maintain contact with the workplace and to assist in the RTW process. Furthermore, eHealth may be an important asset to target occupational disability in rural or remote communities where face-to-face services are not available.62 However, it should be noted that a strong therapeutic alliance often is an important criterion for successful work-oriented interventions.62 The development of this strong therapeutic alliance may be more challenging through an eHealth intervention than in a face-to-face interaction.62
In their review of the state of RTW research, Pransky et al.43 argue that the greatest opportunities and barriers to achieving improved RTW outcomes exist in the workplace. The results from Brown et al.61 support this statement, showing that telephone-delivered support initiated in the workplace resulted in a significant reduction in sick leave. In line with this, Bee et al.55 claimed that eHealth delivered in the workplace may be an innovative service model helping employees to maintain productivity. This may be achieved through effectively linking health, employment, and OHS.55 There seems to be agreement on the necessity of collaboration between the health care sector and the workplace, but the costs and benefits of work-related eHealth interventions are often separated between the different stakeholders and contexts.53 This inconsistency may be a potential barrier to future implementation of collaborative eHealth interventions.
Stakeholders influence the outcome of interest measured in research studies, and it may be a challenge if eHealth research mainly originates from the environment in which the intervention takes place. For example, a literature review focusing on specific models of RTW for musculoskeletal disorders highlighted that health care providers were predominantly influenced by a biomedical understanding in their professional practice and recovery measurements.69 The causality of work disability is recognized to be multifactorial, and the biomedical approach tends to be too limited to capture all facets of the concept.69 Accordingly, several researchers stress the need for an integrated approach across different policy domains to promote better health and employment outcomes.9,69,70 Work and health are not separate concepts but are closely intertwined; work participation may influence health and health may influence work participation.71,72 Thus, both concepts should be of interest in health and employment policies and actions, but current policies are often delivered in silos, considering only their own sectorial outcomes.73
Ideally, interventions to increase RTW should make sense from the perspective of multiple stakeholders, including health care providers.43 A promising result from this scoping review was that the majority of eHealth interventions that aimed to facilitate work participation were provided in, and included stakeholders from, the health care sector. On the other hand, this also indicates that the use of eHealth technology in the workplace is limited, at least when it comes to involvement from leaders and managers. A recent review concluded that workplace interventions are most effective if multiple stakeholders (eg, from the health care, workplace, and service coordination sectors) support the employees towards work participation.31 We agree with this conclusion, and argue that the quality and effectiveness of eHealth interventions on work participation will increase if stakeholders from multiple areas are simultaneously involved, emphasizing the potentially important role stakeholders such as leaders and managers could have in eHealth interventions.
Reasons for sick leave are often diverse, and Notenbomer et al.26 argue that for health professionals, it may be easier to develop disease-specific interventions rather than interventions targeting sick leave. Despite this, it is important to continue to address sick leave reduction in effectiveness studies.26 Not only is sick leave an objective measurement directly reflecting economic costs, but reductions in future long-term and frequent sick leave is also an approach to prevent disease and ill-health.26 Future developments should consider both the specific health condition or diagnosis together with the nature of the sick leave.26 The nature of sick leave may involve knowledge regarding the length of sick leave, number of sick leave episodes, and whether sick leave is work-related, non-work-related, or a combination. Such specificity in sick leave measures may provide better insight into the effectiveness of interventions.
Only four studies used theory in combination with empirical evidence in developing the content of their eHealth interventions.7,26,53,56 However, none of the studies discussed their results in light of the chosen theory. The use of a theory in intervention development and implementation offers a way to elaborate on the effects of the key elements of the intervention.74 To understand the causal determinants of an outcome, we also need to understand the theoretical mechanisms of change.74 Interventions that are based purely on clinical experience or empirical evidence may not be able to answer such questions. Therefore, use of theoretically informed eHealth interventions may provide practice with better evaluations of when, why, and how interventions work. Furthermore, interventions that are theory-based, and thus indicate an understanding of what works for whom and how, may also provide a basis for developing better theories across different populations, behaviors, and contexts.75
As expected, there was large variability in the measurement of work-related outcomes. None of the included studies used the same measure. Consequently, it may be difficult to generalize the findings on this topic and to summarize the effect of interventions in a future systematic review. As early as 2005, Pransky et al.43 argued that to fully understand the implications of an intervention, future research on RTW should focus on better measures of outcome in terms of multiple and longitudinal observations. Although the process of RTW can be operationalized in a variety of ways, measures of sick leave have the advantage of being relatively objective and available through official or workplace records.43 The stakeholder perspective should also be considered, as failure to measure outcomes in a way that is meaningful to a particular stakeholder may weaken the ability to produce change.43 A solution for future studies may be to use eHealth interventions as a platform for stakeholder collaboration.54 The eHealth intervention and outcome measures must be considered useful by all stakeholders, including participating employees, employers, and the different health care professionals engaged in the delivery. Stakeholder involvement in program development will secure better tailoring to stakeholder needs.60,62
In this review, low adherence was a problem among some stakeholders and employees. To address this, future studies should build in persuasive technology elements to stimulate engagement, motivation, and adherence (eg, personalization, support, feedback, rewards).76 Recent trends in the included studies focused on user friendliness of eHealth interventions to offer a more personalized, individually tailored, and feedback-oriented approach,26,57-59 providing a good model for future interventions. Among participants, perceived acceptability may be crucial to the recruitment process.55 Although most people in developed countries have access to the internet and mobile devices, internet illiteracy is associated with a lower educational level.7 This is an important consideration because low levels of education are also associated with lower RTW rates after sick leave.77-79 Spending enough time and effort to ensure that eHealth interventions to facilitate work participation are easy to use (including for participants with limited internet literacy) could increase participation rates and adherence.7 A combination of screening questions assessing health literacy and technological literacy is recommended to tailor eHealth interventions to different users and needs.80 Among health care professionals, important factors for successful implementation are the development of practical training programs for clinicians33; belief in the eHealth tool, both for themselves and for participants; and the eHealth tool not being time-consuming to use.34,53 In the development of new eHealth interventions, a multi-stakeholder and mixed-method design is therefore highly recommended.7
Strengths and limitations
This scoping review used a systematic approach to search the literature and extract data, including searching for unpublished studies in the WHO clinical registry and ClinicalTrials.gov and reference screening of included studies. Materials from sources, such as guidelines, websites, or book chapters, were not included. This could introduce potential bias to the results. To identify available studies on this topic, we used a broad definition of work participation and included study designs collecting both quantitative and qualitative data. The focus of a scoping review is to provide breadth rather than depth of evidence.50,81 Inherent to this methodology, this review did not address the effectiveness of identified interventions, and the included studies have not been subjected to critical assessment. Given that our objective was to map the evidence on eHealth interventions focusing on RTW, a scoping review was considered to be the appropriate method.
eHealth technology is constantly and rapidly changing. Thus, it was assumed that studies published before 2008 would be less relevant for current practice. Furthermore, the previous review by Kairy et al.38 finalized their search on telerehabilitation in 2007. The possibility remains that evidence from older studies could have informed this scoping review. The review was based on international evidence from Europe, Australia, and North America. No evidence was retrieved from South America, Asia, or Africa. Such evidence may have been excluded by our language limits (English only). Language limitations may also have contributed to the low number of studies meeting the inclusion criteria. Another explanation for the low number of identified sources may be the specific key terms utilized in the search strategy.
Conclusion
This review identified 15 studies with varying designs and evidence reporting on work-related outcomes for sick-listed employees after participation in eHealth interventions. The small number of studies identified indicate that further high-quality primary research is needed to identify the effectiveness of eHealth interventions to facilitate work participation across different contexts and populations. eHealth interventions were conducted across workplace and health care contexts, mainly with health care professionals providing the intervention. Intervention development was mostly based on empirical evidence. Populations varied from employees with the most typical sick leave diagnoses (eg, common mental disorders, musculoskeletal disorders) to smaller, specific diagnostic groups. Generally, person-centeredness appeared to be an important and well-functioning aspect in the delivered eHealth interventions. For the utilization of findings in practice, and in evidence syntheses, studies must clearly report the details of the studied eHealth interventions, collaborating stakeholders, and outcome measures for work participation.
Implications for research
The reviewed literature points to a need for more high-quality primary studies. In particular, eHealth interventions specifically developed for employees sick-listed due to common mental disorders and musculoskeletal disorders are required, as these are the most common causes of sick leave. There is potential for future studies to use eHealth technology for these populations, especially in the workplace, involving collaboration between the workplace and relevant stakeholders from different policy domains. Future studies require larger-scale trials with multiple and longer-term follow-up to examine the effect of relapse on the work-related outcomes. This is crucial to enable systematic reviews about the effectiveness of eHealth interventions to facilitate work participation. Finally, future research should consider the cost-effectiveness of the eHealth delivery on work participation.
Acknowledgments
Research librarian Karen Sigaard, Aarhus University Library, Denmark, for her assistance refining the literature search.
Appendix I: Search strategy
Searches conducted from January 1, 2008 to August 21, 2020
Appendix II: Studies ineligible following full-text review
1. Aaronson NK, Mattioli V, Minton O, Weis J, Johansen C, Dalton SO, et al. Beyond treatment–psychosocial and behavioural issues in cancer survivorship research and practice. EJC Suppl. 2014;12(1):54-64.
Reason for exclusion: Literature review
2. Birney AJ, Gunn R, Russell JK, Ary DV. MoodHacker mobile web app with email for adults to self-manage mild-to-moderate depression: randomized controlled trial. JMIR mHealth and uHealth 2016;4(1):e8.
Reason for exclusion: Ineligible user group
3. den Bakker CM, Huirne JAF, Schaafsma FG, de Geus C, Bonjer HJ, Anema JR. Electronic health program to empower patients in returning to normal activities after colorectal surgical procedures: mixed-methods process evaluation alongside a randomized controlled trial. J Med Internet Res. 2019;21(1):e10674.
Reason for exclusion: No work-related outcome
4. Dorstyn D, Roberts R, Murphy G, Kneebone I, Migliorini C, Craig A, et al. Piloting an email-based resource package for job seekers with multiple sclerosis. Disabil Rehabil 2017;39(9):867-73.
Reason for exclusion: Ineligible user group
5. Duplaga M. Acceptance of internet-based health care services among households in Poland: secondary analysis of a population-based survey. J Med Internet Res. 2012;14(6):e164.
Reason for exclusion: Ineligible user group
6. Ebert DD, Lehr D, Boß L, Riper H, Cuijpers P, Andersson G, et al. Efficacy of aninternet-based problem-solving training for teachers: results of a randomized controlled trial. Scand J Work Environ Health. 2014;40(6):582-96.
Reason for exclusion: Ineligible user group
7. Ebert DD, Kählke F, Buntrock C, Berking M, Smit F, Heber E, et al.A health economic outcome evaluation of an internet-based mobile-supported stress management intervention for employees. Scand J Work Environ Health. 2018;44(2):171-82.
Reason for exclusion: Ineligible scope
8. Filios MS, Storey E, Baron S, Luensman GB, Shiffman RN. Enhancing worker health through clinical decision support (CDS): an introduction to a compilation. J Occup Environ Med. 2017;59(11):e227.
Reason for exclusion: Ineligible scope
9. Geraedts AS, Kleiboer AM, Wiezer NM, Cuijpers P, van Mechelen W, Anema JR. Feasibility of a worker-directed web-based intervention for employees with depressive symptoms. Internet Interventions 2014;1(3):132-40.
Reason for exclusion: Ineligible user group
10. Gussenhoven A, van Wier M, Bosmans J, Dekkers J, van Mechelen W. Cost-effectiveness of a distance lifestyle counselling programme among overweight employees from a company perspective, ALIFE@ Work: a randomized controlled trial. Work. 2013;46(3):337-46.
Reason for exclusion: Ineligible user group
11. Hallgren M, Kraepelien M, Lindefors N, Zeebari Z, Kaldo V, Forsell Y. Physical exercise and internet based cognitive–behavioural therapy in the treatment of depression: randomised controlled trial. Br J Psychiatry 2015;207(3):227-34.
Reason for exclusion: The paper was part of the included study by Kaldo et al. 2017
12. Hange D, Ariai N, Kivi M, Eriksson MC, Nejati S, Petersson E-L. The impact of internet-based cognitive behavior therapy on work ability in patients with depression–a randomized controlled study. Int J Gen Med. 2017;10:151-9.
Reason for exclusion: Ineligible user group
13. Harden SM, You W, Almeida FA, Hill JL, Linnan LA, Allen KC, et al. Does successful weight loss in an internet-based worksite weight loss program improve employee presenteeism and absenteeism? Health Educ Behav. 2015;42(6):769-74.
Reason for exclusion: Ineligible user group
14. Hutting N, Staal JB, Engels JA, Heerkens YF, Detaille SI, Nijhuis-van der Sanden MW. Effect evaluation of a self-management programme for employees with complaints of the arm, neck or shoulder: a randomised controlled trial. Occup Environ Med 2015;72(12):852-61.
Reason for exclusion: Ineligible user group
15. Lokman S, Volker D, Zijlstra-Vlasveld MC, Brouwers EP, Boon B, Beekman AT, et al. Return-to-work intervention versus usual care for sick-listed employees: health-economic investment appraisal alongside a cluster randomised trial. BMJ Open. 2017; 7(10):e016348.
Reason for exclusion: The paper was part of the included study by Volker et al. 2015
16. Milligan-Saville JS, Tan L, Gayed A, Barnes C, Madan I, Dobson M, et al. Workplace mental health training for managers and its effect on sick leave in employees: a cluster randomised controlled trial. Lancet Psychiatry, 2017;4(11):850-8.
Reason for exclusion: Ineligible intervention
17. Proudfoot J, Clarke J, Birch M-R, Whitton AE, Parker G, Manicavasagar V, et al. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry 2013;13(1):312.
Reason for exclusion: No work-related outcome
18. Stansfeld SA, Kerry S, Chandola T, Russell J, Berney L, Hounsome N, et al. Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study. BMJ Open 2015;5(10):e007981.
Reason for exclusion: Ineligible user group
Footnotes
The authors declare no conflict of interest.
References
- 1.World Health Organization. Health systems financing. The path to universal coverage. The World Health Report 2010. Geneva: World Health Organization; 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.World Health Organization. Global diffusion of eHealth: Making universal health coverage achievable. Report of the third global survey on eHealth. Geneva: World Health Organization; 2016. [Google Scholar]
- 3.World Health Organization. Atlas of eHealth country profiles 2015: the use of eHealth in support of universal health coverage. Based on the findings of the 2015 global survey on eHealth. Geneva: World Health Organization; 2016. [Google Scholar]
- 4.European Commission. eHealth: digital health and care [internet]. n.d. [cited 2018 Mar 21]. Available from: https://ec.europa.eu/health/ehealth/home_en. [Google Scholar]
- 5.Eysenbach G. What is e-health? J Med Internet Res 2001;3 (2):E20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Lokman S, Volker D, Zijlstra-Vlasveld MC, Brouwers EP, Boon B, Beekman AT, et al. Return-to-work intervention versus usual care for sick-listed employees: health-economic investment appraisal alongside a cluster randomised trial. BMJ Open 2017;7 (10):e016348. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Tamminga SJ, van Hezel S, de Boer AGEM, Frings-Dresen MHW. Enhancing the return to work of cancer survivors: development and feasibility of the nurse-led eHealth intervention Cancer@Work. JMIR Res Protoc 2016;5 (2):e118. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Volker D, Zijlstra-Vlasveld MC, Anema JR, Beekman AT, Brouwers EP, Emons WH, et al. Effectiveness of a blended web-based intervention on return to work for sick-listed employees with common mental disorders: results of a cluster randomized controlled trial. J Med Internet Res 2015;17 (5):e116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Organisation for Economic Co-operation and Development. Sickness, disability and work: breaking the barriers. A synthesis of findings across OECD countries. Paris: OECD Publishing; 2010. [Google Scholar]
- 10.Amick BCI, Lerner D, Rogers WH, Rooney T, Katz JN. A review of health-related work outcome measures and their uses, and recommended measures. Spine 2000;25 (24):3152–3160. [DOI] [PubMed] [Google Scholar]
- 11.Eccleston C, Palermo TM, Williams ACdC, Lewandowski Holley A, Morley S, Fisher E, et al. Psychological therapies for the management of chronic and recurrent pain in children and adolescents. Cochrane Database Syst Rev 2014; (5):CD003968. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Cuijpers P, van Straten A, Andersson G. Internet-administered cognitive behavior therapy for health problems: a systematic review. J Behav Med 2008;31 (2):169–177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, McGhee EM. The effectiveness of web-based vs. non-web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res 2004;6 (4):e40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Samoocha D, Bruinvels DJ, Elbers NA, Anema JR, van der Beek AJ. Effectiveness of web-based interventions on patient empowerment: a systematic review and meta-analysis. J Med Internet Res 2010;12 (2):e23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Murray E, Burns J, See Tai S, Lai R, Nazareth I. Interactive health communication applications for people with chronic disease. Cochrane Database Syst Rev 2005; (4):CD004274. [DOI] [PubMed] [Google Scholar]
- 16.Grimsbø GH, Finset A, Ruland CM. Left hanging in the air: experiences of living with cancer as expressed through E-mail communications with oncology nurses. Cancer Nurs 2011;34 (2):107–116. [DOI] [PubMed] [Google Scholar]
- 17.Børøsund E, Cvancarova M, Moore SM, Ekstedt M, Ruland CM. Comparing effects in regular practice of e-communication and web-based self-management support among breast cancer patients: preliminary results from a randomized controlled trial. J Med Internet Res 2014;16 (12):e295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kruse CS, Argueta DA, Lopez L, Nair A. Patient and provider attitudes toward the use of patient portals for the management of chronic disease: a systematic review. J Med Internet Res 2015;17 (2):e40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ruland CM, Maffei RM, Borosund E, Krahn A, Andersen T, Grimsbo GH. Evaluation of different features of an eHealth application for personalized illness management support: cancer patients’ use and appraisal of usefulness. Int J Med Inform 2013;82 (7):593–603. [DOI] [PubMed] [Google Scholar]
- 20.Wibe T, Hellesø R, Varsi C, Ruland C, Ekstedt M. How does an online patient-nurse communication service meet the information needs of men with recently diagnosed testicular cancer? ISRN Nurs 2012;2012:260975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev 2015; (3):CD011565. [DOI] [PubMed] [Google Scholar]
- 22.Vonk Noordegraaf A, Anema JR, van Mechelen W, Knol DL, van Baal WM, van Kesteren PJM, et al. A personalised eHealth programme reduces the duration until return to work after gynaecological surgery: results of a multicentre randomised trial. BJOG 2014;121 (9):1127–1136. [DOI] [PubMed] [Google Scholar]
- 23.de la Torre-Díez I, López-Coronado M, Vaca C, Aguado JS, de Castro C. Cost-utility and cost-effectiveness studies of telemedicine, electronic, and mobile health systems in the literature: a systematic review. Telemed J E Health 2015;21 (2):81–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Elbert NJ, van Os-Medendorp H, van Renselaar W, Ekeland AG, Hakkaart-van Roijen L, Raat H, et al. Effectiveness and cost-effectiveness of ehealth interventions in somatic diseases: a systematic review of systematic reviews and meta-analyses. J Med Internet Res 2014;16 (4):e110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.World Health Organization. Global strategy on human resources for health: workforce 2030. Geneva: World Health Organization; 2016. [Google Scholar]
- 26.Notenbomer A, Roelen C, Groothoff J, van Rhenen W, Bültmann U. Effect of an eHealth intervention to reduce sickness absence frequency among employees with frequent sickness absence: randomized controlled trial. J Med Internet Res 2018;20 (10):e10821. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Franche R-L, Baril R, Shaw W, Nicholas M, Loisel P. Workplace-based return-to-work interventions: optimizing the role of stakeholders in implementation and research. J Occup Rehabil 2005;15 (4):525–542. [DOI] [PubMed] [Google Scholar]
- 28.van Gemert-Pijnen JEWC, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, et al. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res 2011;13 (4):e111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Franche R-L, Cullen K, Clarke J, Irvin E, Sinclair S, Frank J, et al. Workplace-based return-to-work interventions: a systematic review of the quantitative literature. J Occup Rehabil 2005;15 (4):607–631. [DOI] [PubMed] [Google Scholar]
- 30.Friesen MN, Yassi A, Cooper J. Return-to-work: the importance of human interactions and organizational structures. Work 2001;17 (1):11–22. [PubMed] [Google Scholar]
- 31.Cullen KL, Irvin E, Collie A, Clay F, Gensby U, Jennings PA, et al. Effectiveness of workplace interventions in return-to-work for musculoskeletal, pain-related and mental health conditions: an update of the evidence and messages for practitioners. J Occup Rehabil 2018;28 (1):1–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Essén A, Conrick M. New e-service development in the homecare sector: beyond implementing a radical technology. Int J Med Inform 2008;77 (10):679–688. [DOI] [PubMed] [Google Scholar]
- 33.Varsi C, Solberg Nes L, Kristjansdottir OB, Kelders SM, Stenberg U, Zangi HA, et al. Implementation strategies to enhance the implementation of ehealth programs for patients with chronic illnesses: realist systematic review. J Med Internet Res 2019;21 (9):e14255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Varsi C, Ekstedt M, Gammon D, Ruland CM. Using the consolidated framework for implementation research to identify barriers and facilitators for the implementation of an internet-based patient-provider communication service in five settings: a qualitative study. J Med Internet Res 2015;17 (11):e262. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Walshe K. Understanding what works—and why—in quality improvement: the need for theory-driven evaluation. Int J Qual Health Care 2007;19 (2):57–59. [DOI] [PubMed] [Google Scholar]
- 36.Wolf C, Floyd SW. Strategic planning research: toward a theory-driven agenda. J Manag 2013;43 (6):1754–1788. [Google Scholar]
- 37.Heath G, Cooke R, Cameron E. A Theory-based approach for developing interventions to change patient behaviours: a medication adherence example from paediatric secondary care. Healthcare (Basel) 2015;3 (4):1228–1242. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Kairy D, Lehoux P, Vincent C, Visintin M. A systematic review of clinical outcomes, clinical process, healthcare utilization and costs associated with telerehabilitation. Disabil Rehabil 2009;31 (6):427–447. [DOI] [PubMed] [Google Scholar]
- 39.Srivastava S, Pant M, Abraham A, Agrawal N. The technological growth in eHealth services. Comput Math Methods Med 2015;2015:894171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Schumacher L, Woods P. Effectiveness of e-Health interventions to support return to work: a systematic review. PROSPERO 2016; CRD42016027086. [Google Scholar]
- 41.Oh H, Rizo C, Enkin M, Jadad A. What is eHealth (3): a systematic review of published definitions. J Med Internet Res 2005;7 (1):e1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.World Health Organization; International Telecommunication Union. National eHealth strategy toolkit. 2012. [Google Scholar]
- 43.Pransky G, Gatchel R, Linton SJ, Loisel P. Improving return to work research. J Occup Rehabil 2005;15 (4):453–457. [DOI] [PubMed] [Google Scholar]
- 44.Wasiak R, Young AE, Roessler RT, McPherson KM, van Poppel MNM, Anema JR. Measuring return to work. J Occup Rehabil 2007;17 (4):766–781. [DOI] [PubMed] [Google Scholar]
- 45.Øyeflaten I, Lie SA, Ihlebæk CM, Eriksen HR. Multiple transitions in sick leave, disability benefits, and return to work. A 4-year follow-up of patients participating in a work-related rehabilitation program. BMC Public Health 2012;12 (1):748. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Young AE. An exploration of alternative methods for assessing return-to-work success following occupational injury. Disabil Rehabil 2014;36 (11):914–924. [DOI] [PubMed] [Google Scholar]
- 47.Hensing G, Alexanderson K, Allebeck P, Bjurulf P. How to measure sickness absence? Literature review and suggestion of five basic measures. Scand J Soc Med 1998;26 (2):133–144. [DOI] [PubMed] [Google Scholar]
- 48.Biering K, Hjøllund NH, Lund T. Methods in measuring return to work: a comparison of measures of return to work following treatment of coronary heart disease. J Occup Rehabil 2013;23 (3):400–405. [DOI] [PubMed] [Google Scholar]
- 49.Young AE, Roessler RT, Wasiak R, McPherson KM, van Poppel MNM, Anema JR. A developmental conceptualization of return to work. J Occup Rehabil 2005;15 (4):557–568. [DOI] [PubMed] [Google Scholar]
- 50.Peters MDJ, Godfrey C, McInerney P, Munn Z, Tricco AC, Khalil H. Chapter 11: Scoping reviews. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis (formerly JBI Reviewer's Manual) [internet]. Adelaide: JBI; 2017 [cited 2019 Aug 19]. Available from: https://synthesismanual.jbi.global. [Google Scholar]
- 51.Øyeflaten I, Johansen T, Nielsen CV, Johnsen TL, Tveito TH, Momsen A-MH. eHealth interventions to facilitate work participation: a scoping review protocol. JBI Database System Rev Implement Rep 2019;17 (6):1026–1033. [DOI] [PubMed] [Google Scholar]
- 52.Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci 2010;5 (1):69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Bouwsma EVA, Huirne JAF, van de Ven PM, Vonk Noordegraaf A, Schaafsma FG, Schraffordt Koops SE, et al. Effectiveness of an internet-based perioperative care programme to enhance postoperative recovery in gynaecological patients: cluster controlled trial with randomised stepped-wedge implementation. BMJ Open 2018;8 (1):e017781. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Kaldo V, Lundin A, Hallgren M, Kraepelien M, Strid C, Ekblom Ö, et al. Effects of internet-based cognitive behavioural therapy and physical exercise on sick leave and employment in primary care patients with depression: two subgroup analyses. Occup Environ Med 2018;75 (1):52–58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Bee PE, Bower P, Gilbody S, Lovell K. Improving health and productivity of depressed workers: a pilot randomized controlled trial of telephone cognitive behavioral therapy delivery in workplace settings. Gen Hosp Psychiatry 2010;32 (3):337–340. [DOI] [PubMed] [Google Scholar]
- 56.Hara KW, Bjørngaard JH, Brage S, Borchgrevink PC, Halsteinli V, Stiles TC, et al. Randomized controlled trial of adding telephone follow-up to an occupational rehabilitation program to increase work participation. J Occup Rehabil 2018;28 (2):265–278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.van der Meij E, Anema JR, Leclercq WKG, Bongers MY, Consten ECJ, Schraffordt Koops SE, et al. Personalised perioperative care by e-health after intermediate-grade abdominal surgery: a multicentre, single-blind, randomised, placebo-controlled trial. Lancet 2018;392 (10141):51–59. [DOI] [PubMed] [Google Scholar]
- 58.Beiwinkel T, Eißing T, Telle N-T, Siegmund-Schultze E, Rössler W. Effectiveness of a web-based intervention in reducing depression and sickness absence: randomized controlled trial. J Med Internet Res 2017;19 (6):e213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Suman A, Schaafsma FG, van Dongen JM, Elders PJM, Buchbinder R, van Tulder MW, et al. Effectiveness and cost-utility of a multifaceted eHealth strategy to improve back pain beliefs of patients with non-specific low back pain: a cluster randomised trial. BMJ Open 2019;9 (12):e030879. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.de Jong T, Heinrich J, Blatter BM, Anema JR, van der Beek AJ. The feasibility of a web-based counselling program for occupational physicians and employees on sick leave due to back or neck pain. BMC Med Inform Decis Mak 2009;9:46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Brown J, Mackay D, Demou E, Craig J, Frank J, Macdonald EB. The EASY (Early Access to Support for You) sickness absence service: a four-year evaluation of the impact on absenteeism. Scand J Work Environ Health 2015; (2):204–215. [DOI] [PubMed] [Google Scholar]
- 62.Sullivan MJL, Simon G. A telephonic intervention for promoting occupational re-integration in work-disabled individuals with musculoskeletal pain. Transl Behav Med 2012;2 (2):149–158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Deady M, Johnston D, Milne D, Glozier N, Peters D, Calvo R, et al. Preliminary effectiveness of a smartphone app to reduce depressive symptoms in the workplace: feasibility and acceptability study. JMIR Mhealth Uhealth 2018;6 (12):e11661. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Marmot M. Social determinants of health inequalities. Lancet 2005;365 (9464):1099–1104. [DOI] [PubMed] [Google Scholar]
- 65.Sjöström J, von Essen L, Grönqvist H. The origin and impact of ideals in ehealth research: experiences from the U-CARE research environment. JMIR Res Protoc 2014;3 (2):e28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Dersh J, Polatin PB, Leeman G, Gatchel RJ. The management of secondary gain and loss in medicolegal settings: strengths and weaknesses. J Occup Rehabil 2004;14 (4):267–279. [DOI] [PubMed] [Google Scholar]
- 67.Trautmann S, Rehm J, Wittchen H-U. The economic costs of mental disorders: do our societies react appropriately to the burden of mental disorders? EMBO Rep 2016;17 (9):1245–1249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Brooks PM. The burden of musculoskeletal disease—a global perspective. Clin Rheumatol 2006;25 (6):778–781. [DOI] [PubMed] [Google Scholar]
- 69.Schultz IZ, Stowell AW, Feuerstein M, Gatchel RJ. Models of return to work for musculoskeletal disorders. J Occup Rehabil 2007;17 (2):327–352. [DOI] [PubMed] [Google Scholar]
- 70.Marmot M, Friel S, Bell R, Houweling TAJ, Taylor S. Closing the gap in a generation: health equity through action on the social determinants of health. Lancet 2008;372 (9650):1661–1669. [DOI] [PubMed] [Google Scholar]
- 71.van der Noordt M, IJzelenberg H, Droomers M, Proper KI. Health effects of employment: a systematic review of prospective studies. Occup Environ Med 2014;71 (10):730–736. [DOI] [PubMed] [Google Scholar]
- 72.Modini M, Joyce S, Mykletun A, Christensen H, Bryant RA, Mitchell PB, et al. The mental health benefits of employment: results of a systematic meta-review. Australas Psychiatry 2016;24 (4):331–336. [DOI] [PubMed] [Google Scholar]
- 73.Organisation for Economic Co-operation and Development. Fit mind, fit job: from evidence to practice in mental health and work. Paris: OECD Publishing; 2015. [Google Scholar]
- 74.Michie S. Designing and implementing behaviour change interventions to improve population health. J Health Serv Res Policy 2008;13:64–69. [DOI] [PubMed] [Google Scholar]
- 75.Michie S, Abraham C. Interventions to change health behaviours: evidence-based or evidence-inspired? Psychol Health 2004;19 (1):29–49. [Google Scholar]
- 76.Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JE. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res 2012;14 (6):e152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Blank L, Peters J, Pickvance S, Wilford J, MacDonald E. A systematic review of the factors which predict return to work for people suffering episodes of poor mental health. J Occup Rehabil 2008;18 (1):27–34. [DOI] [PubMed] [Google Scholar]
- 78.Cornelius LR, van der Klink JJL, Groothoff JW, Brouwer S. Prognostic factors of long term disability due to mental disorders: a systematic review. J Occup Rehabil 2011;21 (2):259–274. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Lund T, Labriola M. Sickness absence in Denmark – research, results, and reflections. Scand J Work Environ Health 2009; (suppl 7): 5–14. [Google Scholar]
- 80.Collins SA, Currie LM, Bakken S, Vawdrey DK, Stone PW. Health literacy screening instruments for eHealth applications: a systematic review. J Biomed Inform 2012;45 (3):598–607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005;8 (1):19–32. [Google Scholar]