Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2019 Apr 24;16(8):1449. doi: 10.3390/ijerph16081449

Improving Working Conditions to Promote Worker Safety, Health, and Wellbeing for Low-Wage Workers: The Workplace Organizational Health Study

Glorian Sorensen 1,2,*, Susan Peters 1, Karina Nielsen 3, Eve Nagler 1,2, Melissa Karapanos 2, Lorraine Wallace 2, Lisa Burke 2, Jack T Dennerlein 4,5, Gregory R Wagner 5
PMCID: PMC6518251  PMID: 31022886

Abstract

This paper addresses a significant gap in the literature by describing a study that tests the feasibility and efficacy of an organizational intervention to improve working conditions, safety, and wellbeing for low-wage food service workers. The Workplace Organizational Health Study tests the hypothesis that an intervention targeting the work organization and environment will result in improvements in workers’ musculoskeletal disorders and wellbeing. This ongoing study is being conducted in collaboration with a large food service company. Formative evaluation was used to prioritize outcomes, assess working conditions, and define essential intervention elements. The theory-driven intervention is being evaluated in a proof-of-concept trial, conducted to demonstrate feasibility and potential efficacy using a cluster randomized design. Ten worksites were randomly assigned to intervention or control conditions. The 13-month intervention uses a comprehensive systems approach to improve workplace policies and practices. Using principles of participatory engagement, the intervention targets safety and ergonomics; work intensity; and job enrichment. The evaluation will provide a preliminary assessment of estimates of the intervention effect on targeted outcomes and inform understanding of the intervention implementation across worksites. This study is expected to provide insights on methods to improve working conditions in support of the safety and wellbeing of low-wage workers.

Keywords: occupational safety and health, prevention and protection, psychological wellbeing, safety culture, job stress, musculoskeletal disorders

1. Introduction

Low-wage workers are often employed in jobs that pose significant health and safety risks [1,2,3]. Defined as work that earns two-thirds or less of the national median gross hourly earnings [4], the prevalence of low-wage work varies by country and is on the rise, notably in Germany, the Netherlands, the United Kingdom, and the U.S. [5,6]. Women, young workers, those with low levels of education, and immigrants are overrepresented in these jobs [4,7,8,9,10]. These positions are often characterized by job insecurity; uncertainty around work hours, contributing to instability in earnings; significant physical work demands; repetitive work; and low job decision latitude and autonomy [11,12,13,14]. Many low-wage workers are employed by contracting agencies or firms that then contract out specific services to “host” employers, thereby creating multiple layers of responsibility for workplace policies and working conditions [15]. These workers, also referred to as distributed workers because they work away from their organization’s central work location at least some of the time [16], may face additional obstacles in accessing company resources and support.

Studies of interventions to improve the working lives of low-wage workers in the U.S. are rare. The study described here was conducted in the U.S. food service industry, which employs 9.5 million workers [17], many of whom work in low-wage jobs with limited access to company resources and support. These workers include a large number of immigrants; approximately 22% of Hispanic immigrants in the U.S. are employed in food service and service-related occupations. In addition, only 1.8% of workers in the food industry are represented by a labor union [5]. A recent study found that among U.S. food preparation and service workers, fewer than one-quarter can use paid sick days due to job tenure requirements [18].

Organizational interventions are receiving increasing attention as a potentially sustainable and effective approach to improving worker safety, health, and wellbeing. Recent studies and reviews have suggested promising results for these organizational interventions [19,20,21,22,23,24], including for low-wage workers [11,25,26]. These interventions have focused on providing workers with greater decision latitude and autonomy, and on enhancing teams and leadership, and have demonstrated improved wellbeing [26,27,28], psychological health [26,29,30,31,32], and reduced sickness absence [29,32].

This paper describes an organizational intervention designed to improve the health, safety, and wellbeing of food service workers, and has implications for the health and wellbeing of low-wage workers in other industries. This intervention employed participatory strategies to engage multiple levels of management as well as employees as active agents in the change process [24,33]. Using this participatory approach, workers and their managers collectively gain resources, knowledge, and skills to identify workplace problems, develop solutions, and implement changes to improve their working conditions. This approach has also been found to increase job control and decision latitude [28,29,34], and enhance team functioning, communication, and leadership [26,35,36].

The objective of this paper is to describe the background, study design, intervention approach, and evaluation methods for the Workplace Organizational Health Study. This study was designed to address a significant gap in the literature regarding the impact of organizational improvements in policies and practices for the health, safety, and wellbeing of low-wage workers. By using a rigorous research design to test a theory-driven model that is further informed by practice and a close collaboration with a large food service company, we expect this study to shape future interventions for low-wage workers by providing a model for reducing disparities in worker safety, health, and wellbeing.

2. Materials and Methods

2.1. Study Design Overview

The Workplace Organizational Health Study was designed to test our a priori central hypothesis that an intervention targeting the work organization and environment, as well as individual safety practices and behaviors, would show promising improvements in the study’s primary outcomes: musculoskeletal disorders (MSDs), including pain and injury; and worker wellbeing, operationalized to include overall wellbeing, work-related wellbeing, and life satisfaction. The study’s specific aims were to: (1) identify working conditions expected to be associated with these study outcomes and which could be feasibly modified through changes in management practices; (2) determine the feasibility and potential efficacy of an organizational intervention designed to improve working conditions, and workers’ MSD symptoms and wellbeing; and (3) understand variations in intervention implementation that in turn influence the outcomes. Baseline data were collected in July–August 2018, and the intervention was launched in October 2018; post-intervention data will be collected November–December 2019.

Figure 1 illustrates the intervention framework and sequence, described in detail below. Because organizational policies and practices are managed across different levels of the organization, we engaged stakeholders at the national, district, and worksite levels within this large company. During the Planning Phase, we collaborated with company representatives at the national and district levels to ensure their support, leverage resources at the national and district levels, and facilitate buy-in from participating worksites. We conducted formative qualitative research to prioritize outcomes, assess working conditions, and formulate essential intervention elements. In the Implementation Phase, we evaluated the worksite-based intervention in a proof-of-concept (PoC) trial. A PoC trial is conducted to demonstrate feasibility or potential efficacy, typically on a small scale as a milestone toward full development of a “concept” [37,38,39,40]. Using a cluster randomized design, 10 worksites were randomly assigned to intervention or control conditions. The worksite-based intervention focused on improving three working conditions: safety and ergonomics; work intensity; and job enrichment. At the time of writing this paper, this study was implementing the intervention. During the Synthesis Phase, the research team and collaborating company will review findings and develop strategies to institutionalize, sustain, and disseminate successful intervention components. Changes related to these intervention processes will be evaluated following methods described in the Evaluation section.

Figure 1.

Figure 1

Intervention Framework.

This study obtained ethics approval through the Harvard T.H. Chan School of Public Health Institutional Review Board (Protocol #IRB16-0488). Participants provided informed consent prior to participating in any data collection.

2.2. Study Population and Sample

This study took place in a large multinational company that provides food service through contractual arrangements with corporate clients. The food service worksites in this study are located in corporate settings in or near Boston, Massachusetts (U.S.). These worksites are organized by district, based on geographical location.

The study design, setting, and sample are illustrated in Figure 2. For both the formative research and PoC trial, eligible worksites employed between 7 and 30 employees. Worksites participating in the formative research were not eligible for the PoC study, to avoid potential contamination arising from exposures to the topics raised in the qualitative research. Worksites eligible to participate in the PoC trial were required to have a contract that was expected to last through the intervention period; agree to the planned data collection efforts; and agree to be randomly assigned to the intervention or control condition following the baseline survey.

Figure 2.

Figure 2

Study design, settings, and samples.

Frontline workers included chefs, cooks, food preparers, servers, dishwashers, and cashiers. Frontline workers in five non-PoC worksites participated in the formative research. In the PoC trial, frontline workers participated in surveys and the intervention. At baseline, approximately half of the participating workforce was female, and the average age of the frontline workers was 43.6 ± 13.07 years (range, 20–72 years). This multi-ethnic workforce included approximately one-third who identified as Hispanic; 16% as Black or African American; 9% as Native American, Asian, Native Hawaiian, or Pacific Islander; and 45% as White.

Two groups of managers were also included. Site managers were responsible for operations at each worksite. Site managers at the formative research worksites were interviewed as part of the planning process. For the PoC trial, site managers at all 10 PoC worksites participated in the site manager survey and were interviewed as part of the safety and ergonomics walkthrough. The five site managers at PoC intervention worksites were central to all phases of the intervention planning and implementation. District management included those with responsibilities across worksites at the district level, including representatives of human resources, health and safety, operations, and those with direct supervision of the participating worksite accounts. District managers were interviewed as part of the formative research, and for the intervention, contributed to planning and implementation of district-level policies and practices.

2.3. Phase 1: Planning

This study was conceptualized jointly by the research team and the collaborating company, with company leadership provided by a national representative who facilitated dialogue with key company stakeholders at the national and district levels. Guided by a conceptual model and formative research, we identified the priorities and needs of frontline workers and the worksites that employed them to inform intervention development.

2.3.1. Formative Research

We used formative research [41] to inform priorities for our research outcomes and intervention methods, including identifying working conditions to be targeted by the intervention [42]. Conducted in Year 1 of the study (2017), we used qualitative methods to address four key questions [42]: (1) What do frontline workers and managers employed by a food service company perceive as priorities for their health, safety, and wellbeing (outcomes of interest)? (2) What are the potential root causes (working conditions) of the health, safety, and wellbeing concerns identified? (3) What mechanisms are likely to facilitate intervention processes and success (intervention working mechanisms)? (4) What does management consider feasible targets of the intervention, including changes in organizational policies, programs, and practices (prioritization)? The formative research also contributed to understanding how cognitive and motivational biases may influence the intervention, allowing us to plan accordingly [43].

The formative research included semi-structured interviews with district and site managers, focus groups with frontline workers using an interview/focus group guide, and observations of the worksites. Findings (published elsewhere [42]) were synthesized to inform the intervention design in collaboration with representatives of the employer as part of an intervention planning and prioritization workshop.

2.3.2. Conceptual Model

To inform intervention development and research planning, we incorporated information from our formative research and an overall conceptual model developed previously by the research team [44]. This model relies on several theoretical perspectives, including the social ecological model [45,46], social contextual model of health behavior change [47,48], hierarchy of controls [49,50,51], and participatory frameworks [52]. Our evaluation approach was based on both the RE-AIM [53] and realist evaluation theoretical frameworks [54]. These theoretical foundations underscore the complex interplay of workers, their work environment, as well as characteristics of the larger contexts in which both the worker and the worksite are embedded. This overall model places working conditions, including physical, organizational, and psychosocial factors at work, as central determinants of health and safety outcomes as well as enterprise/organizational outcomes. Working conditions function as a pathway from policies, programs, and practices to worker and enterprise outcomes.

Maintaining this central focus on working conditions, in this study we operationalized the overall model to focus on this intervention and setting (Figure 3). The model illustrates the essential intervention elements, working conditions, and outcomes specifically targeted within this intervention. Through formative research, workers and managers identified core priorities for their safety, health, and wellbeing. Following the pathways in the conceptual model, we identified working conditions likely to influence these outcomes, and intervention elements essential to improving these working conditions.

Figure 3.

Figure 3

Conceptual Model.

Three working conditions were identified to be targeted by this intervention. Safety and ergonomics included risks associated with slips, trips, and falls and housekeeping; job requirements that included reaching, lifting, pushing, pulling, and carrying demands; sedentary behaviors such as standing for long periods; and equipment use. Work intensity encompassed work flow, workload, and pace of work; organization of job tasks and demands; and decision latitude and decision making associated with completion of job tasks. Job enrichment addressed needs for role clarity and setting clear expectations; opportunities for professional development and career advancement; and supportive practices associated with providing feedback on job performance.

Previous research has confirmed the important contributions of the work organization to worker safety, health, and wellbeing [2,11,19,21,24,55]. We relied on four underlying essential elements in the organizational change process [56]. Through leadership commitment, the aim was to provide necessary resources and support, ensure accountability, and establish health, safety, and wellbeing as an organizational priority. Leadership commitment has been associated with improved outcomes related to job-related wellbeing [57,58], workplace injuries [59,60], and health behaviors [61,62]. Participation includes engaging stakeholders at every level of the organization, including district-level managers, site managers of specific worksites, and frontline workers. This combined approach of using both top-down and bottom-up approaches in the intervention development and implementation builds on assets and resources across multiple levels of the organization [33,63,64,65]. Communication provides a vehicle for building collaborative relationships across the organization, including fostering effective vertical and horizontal communications [33,66]. Tailoring for fit reflects the need to tailor the intervention to the organizational context [56]. Integrating interventions into existing structures and practices may minimize additional burdens arising from implementing new procedures and from changes in the ways work is organized, designed, and managed [56].

2.3.3. Organizational Buy-In and Fit

Throughout the study, the research team met regularly with national representatives of the collaborating company, and engaged district-level leadership in planning the intervention, accessing company resources, and providing feedback to guide decisions about policies and practices. Leadership sets the overall vision for the organization, engages management support at multiple levels, and ensures that necessary resources are available to support targeted changes [55]. In this study, key stakeholders contributed to the design of the intervention, ensured fit with organizational priorities, linked the research team with central resources that are not uniformly accessed in the worksites, and contributed to problem solving and addressing barriers and challenges to intervention implementation. A coordinating committee was established to engage stakeholders at the district and national levels in reviewing relevant policies and practices, ensuring ready access to necessary resources, and coordinating efforts with site managers across the five intervention worksites.

2.4. Phase 2: Intervention Implementation

The intervention model applied the implementation guidelines developed by the Harvard T.H. Chan School of Public Health Center for Work, Health, and Well-being [67]; findings from a scoping review of the literature on prior organizational interventions in low-wage service settings [68]; and systematic formative research, described above and elsewhere [42]. The 13-month intervention used a comprehensive systems approach to improve worker health by targeting workplace policies and practices, focusing here on the essential intervention elements identified in the formative research as critical drivers of the workers’ health, safety, and wellbeing outcomes.

To support the implementation of the intervention, a member of the research team met at least monthly with the site managers of each of the five participating worksites. The intervention was organized around three sequential modules defined by the targeted working conditions: safety and ergonomics, work intensity, and job enrichment. Worksite-specific assessments informed the intervention process. For the safety and ergonomics module, the safety and ergonomics walkthrough assessment identified site-specific hazards and made recommendations to guide priority setting. For the work intensity and job enrichment modules, a standard set of questions guided interviews with site managers to identify current practices, potential challenges, and opportunities and resources. The research team developed a report based on each assessment, which was used in priority setting and as the foundation for action planning. We followed a standard protocol for the intervention process for the three modules, including meetings and regular communications with the site manager to conduct the assessment, identify priority actions needed to address recommendations from the assessment, engage frontline workers, and outline and implement a work plan to determine necessary tactics and timelines.

Following principles of participatory engagement [69,70], the research team worked with site managers and frontline workers at intervention sites to tailor the intervention at each location. The participatory process included collaboration with leadership at all levels; regular meetings with site managers of the individual sites; and communications and brief meetings with frontline workers. The participatory process provided a way to facilitate an open and constructive interaction between managers and employees about the main concerns in their worksite, thereby informing priorities for the intervention. The expectation was that with increasing engagement, communications would be strengthened and the organization itself would have increasing capacity to implement organizational changes. In addition, we used participatory processes for tailoring this intervention to this population of low-wage workers. For example, we developed tools for designing and implementing action plans that considered the time pressures faced by these workers. We also provided guidance and technical assistance to managers on how to facilitate a participatory process, focusing specifically on ways to engage this population of low-wage workers.

2.5. Phase 3: Synthesis

This study is expected to increase understanding of how to improve workplace policies and practices to support the safety and health of low-wage workers effectively and sustainably [71]. The research team will work with the collaborating company to understand the research findings and lessons learned, identify successes and ongoing challenges, and incorporate organizational changes relevant to the work lives of low-wage workers, as part of system-wide changes. Together, we will identify opportunities for institutionalizing the intervention approach and lessons learned into sustainable organizational policies, programs, and practices. This collaboration with a leading employer of low-wage workers promises to provide a generalizable approach for dissemination of lessons learned both within the company and across this industry sector, with significant implications for other low-wage settings.

2.6. Evaluation of the Intervention

The evaluation will: (1) provide a preliminary assessment of estimates of the effect of the intervention on targeted outcomes, and (2) inform understanding of the intervention implementation across worksites and identify possible contextual factors that may explain variations [24,72,73].

Intervention effectiveness assessed in the PoC study—Does it work? We used the cluster randomized controlled trial design to achieve the first aim. As illustrated in Figure 2, following completion of a baseline survey, worksites were blocked on size (fewer than 15 employees versus 15 or more employees), and randomly assigned to intervention or control conditions, with five sites per group. We will evaluate changes in primary outcomes between the baseline and final surveys and compare observed changes between intervention and control sites. Baseline surveys were conducted with site managers and frontline workers using well-established measures from our prior research and the broader literature; these procedures will be followed again post-intervention. All data were collected by trained evaluation staff who are independent from intervention delivery.

All frontline workers were eligible to participate in the worker survey. This 30-minute interviewer-administered survey was conducted on-site during work time in English or Spanish. The baseline survey included 119 workers (response rate = 91.5%). Wellbeing was operationalized as general wellbeing [74], including overall life satisfaction [74,75]; work-related wellbeing, adapted from a measure of flourishing [76]; and job satisfaction, measured using a standard single item measure [77]. MSD symptoms were measured using standard validated measures of pain [78], reported injuries [79], and functional limitations [80]. We assessed two secondary outcomes: turnover intention [81] and employee engagement [82]. We also measured workers’ self-reports of working conditions, including supervisor support [83], involvement of employees [83], decision-making latitude at work [83], possibilities for career development, safety practices [84], quantitative job demands [85], physical activity at work [86], and ergonomic practices [84]. The survey also assessed job characteristics and demographics.

Site managers were surveyed at baseline and follow-up in all 10 PoC sites to evaluate changes in implementation of policies and practices. This survey included the Workplace Integrated Safety and Health Assessment [55], which measures six key organizational characteristics contributing to intervention success that are well-aligned with the study’s essential intervention elements: leadership commitment; participation; policies, programs, and practices fostering worker safety, health, and wellbeing; comprehensive and collaborative strategies; adherence; and data-driven change. Additional measures included measures in parallel with the worker survey.

We also conducted a safety and ergonomics assessment in the ten PoC worksites at baseline and follow-up using a qualitative tool to identify specific risks in the physical work environment, including housekeeping and other factors that contribute to slips, trips, and falls; and physical work demands such as lifting, bending, or stooping, awkward postures, standing for long periods, and repetitive or forceful tasks [87]. The pre-intervention assessment in intervention sites was used to inform an action planning process as part of the intervention.

We will estimate the changes in the outcomes between baseline and follow-up surveys using mixed effect linear modeling methods with time (baseline or follow-up) and intervention condition (intervention or control). In addition, we will further compare changes in the work organization and environment using data from the walkthrough assessments, manager interviews, and frontline worker surveys.

Understanding variations in intervention implementation—What works for whom in which circumstances? To complement assessments of intervention effectiveness, we will use principles of realist evaluation to design an evaluation of what works for whom in which circumstances [54]. The evaluation aims to identify contextual factors that are likely to trigger the intervention’s mechanisms to bring about the intended outcomes. Contextual factors include existing policies, practices, and relationships, as well as events, such as changes in leadership, which may facilitate or hinder the change process [26]. These factors will be examined in relation to outcomes, collected through the baseline and follow-up surveys as described above and supplemented with a parallel mixed methods data collection approach [88]. As illustrated in Figure 3, we will track implementation of the essential elements of the intervention (leadership commitment, participation, communication, and tailoring for fit), as well as intervention content focusing on the working conditions targeted by the intervention (safety and ergonomics, work intensity, and job enrichment) [54]. By assessing implementation of these components, we will be able to assess the feasibility of the intervention, including the extent to which interventions are delivered as planned and in which dose, following principles of process evaluation [89]. Data are being collected from the five intervention worksites at multiple levels, at multiple time points, and through different modalities using a mix of qualitative and quantitative methodologies, thereby enabling us to triangulate data and understand variations in intervention implementation.

The process evaluation includes quantitative and qualitative data. Quantitative data include checklists tracking meetings with site managers and the district-level coordinating committee and documenting key intervention activities. Qualitative meeting minutes from these and other intervention-related meetings and communications provide information on the wider context of the intervention. Tracking the extent to which action plans are being implemented as planned and tailored to the worksite context enable us to assess mechanisms in the process of change. We also monitor participation in brief meetings with workers and site managers and explore whether engagement in these meetings enables participation and supports implementation of action plans. Members of the research team observe meetings and record reflections on process mechanisms, such as the extent to which workers are able to influence the intervention through participatory processes. Qualitative data also include interviews with key stakeholders, including interviews with national and district representatives conducted during and at the end of the intervention, to explore the impact of contextual factors on the implementation of the intervention [90,91,92]. In parallel, we will conduct focus groups with workers in the five intervention sites using an open-ended moderator guide to explore their perceptions of the acceptability and feasibility of the intervention process.

All qualitative data, such as audio-taped and transcribed individual interviews and focus groups, and meeting data collection materials, will be analyzed using the software program NVivo(QSR International Pty Ltd. Melbourne, Australia). [93]. Data will be coded using template analysis [94], including using themes based on the intervention content (i.e., working conditions—safety and ergonomics, work intensity and job enrichment), process mechanisms (i.e., essential intervention elements—leadership commitment, participation, communication, and tailoring for fit), and contextual factors. Quantitative process tracking data will be analyzed using SPSS (IBM, Armonk, NY, USA) to allow for integrative analyses with the site manager and worker surveys [93,94]. Assessment of the relationships among the intervention content, context, mechanisms, and outcomes will be tested using mixed methods analysis [95] and integrative statistical analyses (e.g., multi-group structural equation modeling) [96].

3. Discussion

Low-wage workers often encounter both organizational and physical risks in their work environments. The Workplace Organizational Health Study is expected to contribute to improved understanding of the intervention mechanisms, feasibility, and potential benefits of modifications in the work organization that may contribute to improvements in safety and wellbeing for low-wage workers. This study was guided by a conceptual model that identifies working conditions as pathways to protecting and promoting worker health [44]. This innovative focus on improvements in working conditions holds significant promise for employers and their employees alike.

This mixed methods study used formative research to inform intervention priorities and approaches. We collected qualitative and quantitative data from managers and workers to provide a broad-based perspective of factors in the work organization that were targeted by this intervention [42]. Managers, at both the site and district levels, are central to making improvements in the work organization, and significantly influence the implementation of policies and practices [97]. Furthermore, workers’ perspectives of the work organization, including policies, how they are implemented, and the working conditions of most relevance to them, are central to planning effective interventions.

This study explores the feasibility and potential efficacy of the intervention through a PoC trial as a step in the process of intervention development and testing. Preliminary testing in the relatively small scale of a PoC trial provides important advantages, although ultimately, it will be important to demonstrate efficacy and effectiveness in a full-scale cluster randomized controlled trial (RCT), adequately powered across multiple worksites. Launching a full-scale RCT requires sufficient preliminary data to document potential efficacy of the intervention, data provided through this design. The randomized controlled design used in the PoC will provide estimates of the size of intervention effect, allow us to isolate the effect of the intervention on observed changes relative to the control group, and provide information on the feasibility of these organizational changes. This study also benefits from the application of principles of realist evaluation [54,98]; within the intervention group, we will explore what works for whom in which circumstances. As illustrated in our conceptual model, we will explore the process mechanisms influencing these outcomes, including the role of essential intervention elements (leadership commitment, participation, communication, and tailoring for fit), and identify the extent to which working conditions (ergonomics and safety, job enrichment, and work intensity) improve as a result of these changes.

This study is based on a collaboration with a large employer with significant global reach and a willingness to support changes in the work organization as part of this collaboration. This has meant that we have had strong leadership commitment in the intervention development phases. Although implementing this study with a single employer limits generalizability, this collaboration provides an opportunity for designing and testing this organizational intervention in an employment setting representative of that experienced by many low-wage workers (e.g., type of work common in the service sector, low unionization rates, contracting employer) [5]. In this early stage research, we believe it is appropriate to restrict our sample to this single setting in order to minimize extraneous factors contributing to observed outcomes while also leveraging the potential impact of strong partnership engagement. In addition, these results will have potential applicability to the large number of food service workers employed by this company across multiple countries, and to other work settings that employ low-wage workers that share similar characteristics with regard to organizational policies supportive of worker health outcomes.

The distributed nature of this work setting, based on contractual relationships between the collaborating company and contracting clients where the food services are operated, provides a view into the “fissured workplace” [15]. This setting illustrates the complex nature of these relationships [99,100]. As part of a large multi-national organization, site managers must balance the demands of the parent organization and the local demands of their clients. In addition, these worksites face significant competition for maintaining the contracts with their client, contributing to ongoing pressures to deliver optimal service at minimal cost. The work pace and hours of operation set by the client also may contribute to work intensity. These multiple sources of stress contribute to the overall working climate, not only for low-wage workers but also across all hierarchical levels [101]. The contract between the service-providing organization and the client likely specifies who is responsible for compliance with occupational health and safety laws as well as food safety and other regulations. Assuring compliance with these laws and regulations is the joint responsibility of the employer and the organization contracting for their services [102]; nonetheless, ensuring adequate worker protections can be challenging in the context of such “non-traditional” employment relationships.

4. Conclusions

This paper describes the study design, intervention process, and evaluation plans for the Workplace Organizational Health Study, which includes a proof-of-concept trial to test the feasibility and potential efficacy of organizational approaches to improve the health, safety, and wellbeing of low-wage frontline food service workers. This research also systematically explores mechanisms influencing intervention implementation in order to understand what works for whom in which circumstances [54]. This study is expected to provide innovative insights into methods to improve working conditions in support of the safety, health, and wellbeing of low-wage workers. The collaboration described here may allow us to identify strategies for maximizing fit between the intervention and the organization in order to incorporate changes in working conditions relevant to the lives of low-wage workers. Improving working conditions for low-wage workers may help to create an environment where workers can thrive, where safety practices are facilitated, and where health and safety behaviors are supported by a culture of health [19,44].

Acknowledgments

The authors appreciate the participation of Sodexo LLC in the study, and in particular the contributions of Rachel Permuth, Colleen Conklin, Jennifer Madden, Katie Gauvin, Stuart Howser, Joe Ganci, John Higgins, Michael Heneghan, Adriana Raposo, Emerson Foster, and Executive Sponsor of the Project, Sylvia Metayer. The authors additionally thank Michael Grant, Daniel Gunderson, Pia Markkanen, and Anna Revette for their contributions to the study planning process, and Linnea Benson-Whelan for support in the preparation of this manuscript.

Author Contributions

Conceptualization: G.S., S.P., K.N., E.N., G.R.W.; Methodology: G.S., L.W., S.P., J.T.D.; Investigation: G.S., S.P., E.N., K.N., J.T.D.; Resources: G.S.; Writing—Original Draft Preparation: G.S., S.P., K.N., E.N.; Writing—Review and Editing: G.S., S.P., K.N., E.N., M.K., L.W., L.B., J.T.D., G.R.W.; Visualization: M.K., E.N.; Supervision: G.S.; Project Administration: L.W., M.K.; Funding Acquisition: G.S., L.W.

Funding

Funding for this project was provided by the US Centers for Disease Control and Prevention (CDC), National Institute for Occupational Safety and Health grant R01 OH010811 (G. Sorensen, principal investigator).

Conflicts of Interest

The authors declare no conflict of interest. The funding sponsors had no role in the design, execution, interpretation, or writing of the study.

References

  • 1.Bureau of Labor Statistics Workplace Injuries and Illnesses—2010. [(accessed on 22 October 2018)]; Available online: https://www.bls.gov/news.release/archives/osh_10202011.pdf.
  • 2.Baron S.L., Beard S., Davis L.K., Delp L., Forst L., Kidd-Taylor A., Liebman A.K., Linnan L., Punnett L., Welch L.S. Promoting integrated approaches to reducing health inequities among low-income workers: Applying a social ecological framework. Am. J. Ind. Med. 2014;57:539–556. doi: 10.1002/ajim.22174. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Steege A.L., Baron S.L., Marsh S.M., Menendez C.C., Myers J.R. Examining occupational health and safety disparities using national data: A cause for continuing concern. Am. J. Ind. Med. 2014;57:527–538. doi: 10.1002/ajim.22297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Eurostat. Statistics Explained Earnings Statistics. [(accessed on 27 December 2018)]; Available online: https://ec.europa.eu/eurostat/statistics-explained/index.php/Earnings_statistics.
  • 5.Bureau of Labor Statistics Industries at a Glance: Food Services and Drinking Places: NAICS 722. [(accessed on 23 April 2019)]; Available online: http://www.bls.gov/iag/tgs/iag722.htm.
  • 6.Appelbaum E., Schmitt J. Review article: Low-wage work in high-income countries: Labor-market institutions and business strategy in the US and Europe. Hum. Relat. 2009;62:1907. doi: 10.1177/0018726709349200. [DOI] [Google Scholar]
  • 7.Institute for Women’s Policy Research Undervalued and Underpaid in America: Women in Low-Wage, Female-Dominated Jobs. [(accessed on 10 December 2018)]; Available online: https://iwpr.org/publications/undervalued-and-underpaid-in-america-women-in-low-wage-female-dominated-jobs/
  • 8.Bureau of Labor Statistics How Should We Define “Low-Wage” Work? An Analysis Using the Current Population Survey. [(accessed on 7 December 2018)]; Available online: https://www.bls.gov/opub/mlr/2016/article/how-should-we-define-low-wage-work.htm.
  • 9.Brinkmann U., Dorre K., Robenack S. Prekare Arbeit [Precarious Work] Friedrich-Ebert-Stiftung; Bonn, Germany: 2006. [Google Scholar]
  • 10.Kirkcaldy B., Wittig U., Furnham A. Health and migration: Psychosocial determinants. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2006;49:873–883. doi: 10.1007/s00103-006-0021-9. [DOI] [PubMed] [Google Scholar]
  • 11.Busch C., Koch T., Clasen J., Winkler E., Vowinkel J. Evaluation of an organizational health intervention for low-skilled workers and immigrants. Hum. Relat. 2017;70:994–1016. doi: 10.1177/0018726716682308. [DOI] [Google Scholar]
  • 12.Marmot M., Bell R. Challenging health inequalities—Implications for the workplace. Occup. Med. 2010;60:162–164. doi: 10.1093/occmed/kqq008. [DOI] [PubMed] [Google Scholar]
  • 13.Bauer G.F., Huber C.A., Jenny G.J., Muller F., Hammig O. Socioeconomic status, working conditions and self-rated health in Switzerland: Explaining the gradient in men and women. Int. J. Public Health. 2009;54:23–30. doi: 10.1007/s00038-008-7077-2. [DOI] [PubMed] [Google Scholar]
  • 14.Borrell C., Muntaner C., Benach J., Artazcoz L. Social class and self-reported health status among men and women: What is the role of work organisation, household material standards and household labour? Soc. Sci. Med. 2004;58:1869–1887. doi: 10.1016/S0277-9536(03)00408-8. [DOI] [PubMed] [Google Scholar]
  • 15.Weil D. The Fissured Workplace: Why Work Became So Bad for So Many and What Can Be Done to Improve It. Harvard University Press; Cambridge, MA, USA: 2014. p. 424. [Google Scholar]
  • 16.Ryan S., Shirer M. Worldwide Mobile Worker Population 2009–2013 Forecast. Doc IDC 221309E. International Data Corporation (IDC); Framingham, MA, USA: 2010. [Google Scholar]
  • 17.U.S. Bureau of Labor Statistics Occupational Employment Survey. [(accessed on 23 April 2019)];2009 Available online: https://www.bls.gov/news.release/archives/ocwage_05142010.pdf.
  • 18.Williams C., Drago R., Miller K. 44 Million U.S. Workers Lacked Paid Sick Days in 2010: 77 Percent of Food Service Workers Lacked Access. Institute for Women’s Policy Research Publication. [(accessed on 16 May 2014)]; Available online: http://www.iwpr.org/publications/pubs/44-million-u.s.-workers-lacked-paid-sick-days-in-2010-77-percent-of-food-service-workers-lacked-access/at_download/file.
  • 19.Montano D., Hoven H., Siegrist J. Effects of organisational-level interventions at work on employees’ health: A systematic review. BMC Public Health. 2014;14:135. doi: 10.1186/1471-2458-14-135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.LaMontagne A.D., Martin A., Page K.M., Reavley N.J., Noblet A.J., Milner A.J., Keegel T., Smith P.M. Workplace mental health: Developing an integrated intervention approach. BMC Psychiatry. 2014;14:131. doi: 10.1186/1471-244X-14-131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Landsbergis P. Interventions to reduce job stress and improve work organization and worker health. In: Schnall P., Dobson M., Rosskam E., editors. Unhealthy Work: Causes, Consequences, Cures. Baywood Publishing Company; Amityville, NY, USA: 2009. Chapter 11. [Google Scholar]
  • 22.Stephan U., Patterson M., Kelly C., Mair J. Organizations Driving Positive Social Change: A Review and an Integrative Framework of Change Processes. J. Manag. 2016;42:1250–1281. doi: 10.1177/0149206316633268. [DOI] [Google Scholar]
  • 23.Anonymous. Genetic risk and screening techniques for epithelial ovarian cancer. ACOG Committee Opinion: Committee on Gynecologic Practice. Number 117–December 1992. Int. J. Gynaecol. Obstet. 1993;41:321–323. doi: 10.1016/0020-7292(93)90567-G. [DOI] [PubMed] [Google Scholar]
  • 24.Nielsen K., Abildgaard J.S. Organizational interventions: A research-based framework for the evaluation of both process and effects. Work Stress. 2013;27:278–297. doi: 10.1080/02678373.2013.812358. [DOI] [Google Scholar]
  • 25.Abildgaard J.S., Nielsen K., Sverke M. Can the job insecurity be managed? A mixed method evaluation study of an organizational level intervention addressing the negative effects of restructuring. Work Stress. 2018;32:105–123. doi: 10.1080/02678373.2017.1367735. [DOI] [Google Scholar]
  • 26.Nielsen K., Fredslund H., Christensen K., Albertsen K. Success or failure? Interpreting and understanding the impact of interventions in four similar worksites. Work Stress. 2006;20:272–287. doi: 10.1080/02678370601022688. [DOI] [Google Scholar]
  • 27.Holman D.J., Axtell C.M., Sprigg C.A., Totterdell P., Wall T.D. The mediating role of job characteristics in job redesign interventions: A serendipitous quasi-experiment. J. Organ. Behav. 2010;31:84–105. doi: 10.1002/job.631. [DOI] [Google Scholar]
  • 28.Holman D., Axtell C. Can job redesign interventions influence a broad range of employee outcomes by changing multiple job characteristics? A quasi-experimental study. J. Occup. Health Psychol. 2016;21:284. doi: 10.1037/a0039962. [DOI] [PubMed] [Google Scholar]
  • 29.Bond F.W., Flaxman P.E., Bunce D. The influence of psychological flexibility on work redesign: Mediated moderation of a work reorganization intervention. J. Appl. Psychol. 2008;93:645–654. doi: 10.1037/0021-9010.93.3.645. [DOI] [PubMed] [Google Scholar]
  • 30.Bourbonnais R., Brisson C., Vinet A., Vezina M., Lower A. Development and implementation of a participative intervention to improve the psychosocial work environment and mental health in an acute care hospital. Occup. Environ. Med. 2006;63:326–334. doi: 10.1136/oem.2004.018069. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Innstrand S., Espnes G., Mykletun R. Job stress, burnout and job satisfaction: An intervention study for staff working with people with intellectual disabilities. J. Appl. Res. Intellect. Disabil. 2004;17:119–126. doi: 10.1111/j.1360-2322.2004.00189.x. [DOI] [Google Scholar]
  • 32.Dahl-Jorgensen C., Saksvik P.O. The impact of two organizational interventions on the health of service sector workers. Int. J. Health Serv. 2005;35:529–549. doi: 10.2190/P67F-3U5Y-3DDW-MGT1. [DOI] [PubMed] [Google Scholar]
  • 33.Nielsen K., Randall R. The importance of employee participation and perceptions of changes in procedures in a teamworking intervention. Work Stress. 2012;26:91–111. doi: 10.1080/02678373.2012.682721. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Boumans N.P., van den Berg A.A. Job innovation for direct caregivers in the care of persons with mental retardation. A system of personal caregiving. Scand. J. Caring Sci. 2000;14:216–223. doi: 10.1080/028393100300006807. [DOI] [PubMed] [Google Scholar]
  • 35.Elo A.L., Ervasti J., Kuosma E., Mattila P. Evaluation of an organizational stress management program in a municipal public works organization. J. Occup. Health Psychol. 2008;13:10–23. doi: 10.1037/1076-8998.13.1.10. [DOI] [PubMed] [Google Scholar]
  • 36.Hammer L.B., Johnson R.C., Crain T.L., Bodner T., Kossek E.E., Davis K.D., Kelly E.L., Buxton O.M., Karuntzos G., Chosewood L.C., et al. Intervention effects on safety compliance and citizenship behaviors: Evidence from the Work, Family, and Health Study. J. Appl. Psychol. 2016;101:190–208. doi: 10.1037/apl0000047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Audeh M.W., Carmichael J., Penson R.T., Friedlander M., Powell B., Bell-McGuinn K.M., Scott C., Weitzel J.N., Oaknin A., Loman N., et al. Oral poly(ADP-ribose) polymerase inhibitor olaparib in patients with BRCA1 or BRCA2 mutations and recurrent ovarian cancer: A proof-of-concept trial. Lancet. 2010;376:245–251. doi: 10.1016/S0140-6736(10)60893-8. [DOI] [PubMed] [Google Scholar]
  • 38.Litz B.T., Engel C.C., Bryant R.A., Papa A. A randomized, controlled proof-of-concept trial of an Internet-based, therapist-assisted self-management treatment for posttraumatic stress disorder. Am. J. Psychiatry. 2007;164:1676–1683. doi: 10.1176/appi.ajp.2007.06122057. [DOI] [PubMed] [Google Scholar]
  • 39.Elble R.J., Biondi D.M., Ascher S., Wiegand F., Hulihan J. Carisbamate in essential tremor: Brief report of a proof of concept study. Mov. Disord. 2010;25:634–638. doi: 10.1002/mds.22872. [DOI] [PubMed] [Google Scholar]
  • 40.Steinberg M.L., Lu S.-E., Williams J.M. Varenicline for smoking reduction in smokers not yet ready to quit: A double-blind, proof-of-concept randomized clinical trial. Addict. Behav. 2018;84:20–26. doi: 10.1016/j.addbeh.2018.03.026. [DOI] [PubMed] [Google Scholar]
  • 41.Tessmer M. Planning and Conducting Formative Evaluations, Improving the Quality of Education and Training. Routledge; Oxon, UK: 1993. p. 160. [Google Scholar]
  • 42.Peters S.E., Nielsen K., Nagler E., Revette A., Sorensen G. Using an employer-centered approach to inform a participatory organizational intervention to improve food service workers’ health and wellbeing. (in review) [DOI] [PubMed]
  • 43.Montibeller G., von Winterfeldt D. Cognitive and Motivational Biases in Decision and Risk Analysis. Risk Anal. 2015;35:1230–1251. doi: 10.1111/risa.12360. [DOI] [PubMed] [Google Scholar]
  • 44.Sorensen G., McLellan D.L., Sabbath E.L., Dennerlein J.D., Nagler E.M., Hurtado D.A., Pronk N.P., Wagner G.R. Integrating Worksite Health Protection and Health Promotion: A Conceptual Model for Intervention and Research. Prev. Med. 2016;91:188–196. doi: 10.1016/j.ypmed.2016.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.McElroy K., Bibeau D., Steckler A., Glanz K. An ecological perspective on health promotion programs. Health Educ. Q. 1988;15:351–377. doi: 10.1177/109019818801500401. [DOI] [PubMed] [Google Scholar]
  • 46.Stokols D. Translating social ecological theory into guidelines for community health promotion. Am. J. Health Promot. 1996;10:282–298. doi: 10.4278/0890-1171-10.4.282. [DOI] [PubMed] [Google Scholar]
  • 47.Sorensen G., Barbeau E., Hunt M.K., Emmons K. Reducing social disparities in tobacco use: A social contextual model for reducing tobacco use among blue-collar workers. Am. J. Public Health. 2004;94:230–239. doi: 10.2105/AJPH.94.2.230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Sorensen G., Emmons K., Hunt M.K., Barbeau E., Goldman R., Peterson K., Kuntz K., Stoddard A., Berkman L. Model for incorporating social context in health behavior interventions: Applications for cancer prevention for working-class, multiethnic populations. Prev. Med. 2003;37:188–197. doi: 10.1016/S0091-7435(03)00111-7. [DOI] [PubMed] [Google Scholar]
  • 49.Levy B.S., Wegman D.H., Baron S.L., Sokas R.K., editors. Occupational and Environmental Health: Recognizing and Preventing Disease and Injury. 5th ed. Lippincott Williams & Wilkins; Philadelphia, PA, USA: 2006. [Google Scholar]
  • 50.Office of Technology Assessment . Preventing Illness and Injury in the Workplace. Office of Technology Assessment, Congressional Board of the 99th Congress, US Government Printing Office; Washington, DC, USA: 1985. [Google Scholar]
  • 51.Roelofs C., Barbeau E., Moure-Eraso R., Ellenbecker M.J. Prevention strategies in industrial hygiene: A critical literature review. Am. J. Ind. Hygiene Assoc. J. 2003;64:62–67. doi: 10.1080/15428110308984788. [DOI] [PubMed] [Google Scholar]
  • 52.Abildgaard J.S., Hasson H., von Thiele Schwarz U., Løvseth L.T., Ala-Laurinaho A., Nielsen K. Forms of participation: The development and application of a conceptual model of participation in work environment interventions. Econ. Ind. Democr. 2018 doi: 10.1177/0143831X17743576. [DOI] [Google Scholar]
  • 53.Gaglio B., Shoup J.A., Glasgow R.E. The RE-AIM Framework: A Systematic Review of Use Over Time. Am. J. Public Health. 2013;103:e38–e46. doi: 10.2105/AJPH.2013.301299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Nielsen K., Miraglia M. What works for whom in which circumstances? On the need to move beyond the ‘what works?’ question in organizational intervention research. Hum. Relat. 2017;70:40–62. [Google Scholar]
  • 55.Sorensen G., Sparer E., Williams J.A.R., Gundersen D., Boden L.I., Dennerlein J.T., Hashimoto D., Katz J.N., McLellan D.L., Okechukwu C.A., et al. Measuring Best Practices for Workplace Safety, Health, and Well-Being: The Workplace Integrated Safety and Health Assessment. J. Occup. Environ. Med. 2018;60:430–439. doi: 10.1097/JOM.0000000000001286. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Nielsen K., Noblet A. Organizational interventions: Where are we, where do we go from here? In: Nielsen K., Noblet A., editors. Organizational Interventions for Health and Well-Being: A Handbook for Evidence-Based Practice. Routledge; Oxon, UK: 2018. pp. 1–23. [Google Scholar]
  • 57.Kuoppala J., Lamminpaa A., Liira J., Vainio H. Leadership, job well-being, and health effects—A systematic review and a meta-analysis. J. Occup. Environ. Med. 2008;50:904–915. doi: 10.1097/JOM.0b013e31817e918d. [DOI] [PubMed] [Google Scholar]
  • 58.Skakon J., Nielsen K., Borg V., Guzman J. Are leaders’ wellbeing, behaviours and style associated with the affective wellbeing of their employees? A systematic review of three decades of research. Work Stress. 2010;24:107–139. doi: 10.1080/02678373.2010.495262. [DOI] [Google Scholar]
  • 59.Kelloway E.K., Mullen J., Francis L. Divergent effects of transformational and passive leadership on employee safety. J. Occup. Health Psychol. 2006;11:76–86. doi: 10.1037/1076-8998.11.1.76. [DOI] [PubMed] [Google Scholar]
  • 60.Mullen J.E., Kelloway E.K. Safety leadership: A longitudinal study of the effects of transformational leadership on safety outcomes. J. Occup. Organ. Psychol. 2009;82:253–272. doi: 10.1348/096317908X325313. [DOI] [Google Scholar]
  • 61.Bamberger P.A., Bacharach S.B. Abusive supervision and subordinate problem drinking: Taking resistance, stress and subordinate personality into account. Hum. Relat. 2006;59:723–752. doi: 10.1177/0018726706066852. [DOI] [Google Scholar]
  • 62.Whiteman J.A., Snyder D.A., Ragland J.J. The value of leadership in implementing and maintaining a successful health promotion program in the Naval Surface Force, U.S. Pacific Fleet. Am. J. Health Promot. 2001;15:437–440. doi: 10.4278/0890-1171-15.6.437. [DOI] [PubMed] [Google Scholar]
  • 63.Nielsen K., Stage M., Abildgaard J.S., Brauer C.V. Participatory intervention from an organizational perspective: Employees as active agents in creating a healthy work environment. In: Bauer G.F., Jenny G.J., editors. Salutogenic Organizations and Change: The Concepts Behind Organizational Health Intervention Research. Springer; Dordrecht, The Netherlands: 2013. pp. 327–350. [Google Scholar]
  • 64.Nielsen K. How can we make organizational interventions work? Employees and line managers as actively crafting interventions. Hum. Relat. 2013;66:1029–1050. doi: 10.1177/0018726713477164. [DOI] [Google Scholar]
  • 65.Rasmussen K., Glasscock D.J., Hansen O.N., Carstensen O., Jepsen J.F., Nielsen K.J. Worker participation in change processes in a Danish industrial setting. Am J. Ind. Med. 2006;49:767–779. doi: 10.1002/ajim.20350. [DOI] [PubMed] [Google Scholar]
  • 66.Sparer E.H., Catalano P.J., Herrick R.F., Dennerlein J.T. Improving safety climate through a communication and recognition program for construction: A mixed methods study. Scand. J. Work Environ. Health. 2016;42:329–337. doi: 10.5271/sjweh.3569. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.McLellan D., Moore W., Nagler E., Sorensen G. Implementing an Integrated Approach: Weaving Worker Health, Safety, and Well-Being into the Fabric of Your Organization. Dana-Farber Cancer Institute; Boston, MA, USA: 2017. [Google Scholar]
  • 68.Peters S.E., Nagler E., McNamara K., Wagner G., Sorensen G. Participatory organizational interventions for improving the psychosocial work environment and work organization in low wage service workers: A scoping review. 2019. (in preparation)
  • 69.Richard L., Piper D., Weavell W. Advancing engagement methods for trials: The CORE study relational model of engagement for a stepped wedge cluster randomised controlled trial of experience-based co-design for people living with severe mental illnesses. Trials. 2017;18 doi: 10.1186/s13063-017-1878-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Shippee N.D., Domecq Garces J.P., Prutsky Lopez G.J., Wang Z., Elraiyah T.A., Nabhan M., Brito J.P., Boehmer K., Hasan R., Firwana B., et al. Patient and service user engagement in research: A systematic review and synthesized framework. Health Expect. 2015;18:1151–1166. doi: 10.1111/hex.12090. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Goldenhar L.M., LaMontagne A.D., Katz T., Heaney C., Landsbergis P. The intervention research process in occupational safety and health: An overview for the National Occupational Research Agenda Intervention Effectiveness Research Team. J. Occup. Environ. Med. 2001;43:616–622. doi: 10.1097/00043764-200107000-00008. [DOI] [PubMed] [Google Scholar]
  • 72.Spradley J. The Ethnographic Interview. Holt, Rinehart and Winston; New York, NY, USA: 1979. [Google Scholar]
  • 73.Steckler A., Linnan L. Process Evaluation for Public Health Interventions and Research. 1st ed. Jossey-Bass; San Francisco, CA, USA: 2002. [Google Scholar]
  • 74.World Health Organization . Info Package: Mastering Depression in Primary Care, Version 2.2. WHO, Regional Office for Europe, Psychiatric Research Unit; Frederiksborg, Denmark: 1998. [Google Scholar]
  • 75.Kottke T.E., Gallagher J.M., Rauri S., Tillema J.O., Pronk N.P., Knudson S.M. New Summary Measures of Population Health and Well-Being for Implementation by Health Plans and Accountable Care Organizations. Prev. Chronic Dis. 2016;13:E89. doi: 10.5888/pcd13.160224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Diener E., Wirtz D., Tov W., Kim-Prieto C., Choi D., Oishi S., Biswas-Diener R. New measures of well-being: Flourishing and positive and negative feelings. Soc. Indic. Res. 2009;39:247–266. [Google Scholar]
  • 77.Quinn R.P., Shepard L.G. The 1972–1973 Quality of Employment Survey. Institute for Social Research, University of Michigan; Ann Arbor, MI, USA: 1974. pp. 90–97. [Google Scholar]
  • 78.Daniels C., Huang G.D., Feuerstein M., Lopez M. Self-report measure of low back-related biomechanical exposures: Clinical validation. J. Occup. Rehabil. 2005;15:113–128. doi: 10.1007/s10926-005-1214-z. [DOI] [PubMed] [Google Scholar]
  • 79.Oregon Department of Comsumer and Business Services Workplace Injuries and Workers’ Compensation Claim Filing: Results from the 2004 Oregon Population Survey. [(accessed on 11 December 2018)]; Available online: https://www.oregon.gov/dcbs/reports/Documents/archive/arc-general/survey/wcresults04.pdf.
  • 80.Kuorinka I., Jonsson B., Kilbom A., Vinterberg H., Biering-Sorensen F., Andersson G., Jorgensen K. Standardized Nordic Questionnaires for the analysis of musculoskeletal symptoms. Appl. Ergon. 1987;18:233–237. doi: 10.1016/0003-6870(87)90010-X. [DOI] [PubMed] [Google Scholar]
  • 81.Boroff K., Lewin D. Loyalty, voice, and intent to exit a union: A conceptual and empirical analysis. Ind. Labor Relat. Rev. 1997;51:50–63. doi: 10.1177/001979399705100104. [DOI] [Google Scholar]
  • 82.Aon Hewitt . AON Hewitt Employee Engagement Questionnaire. Aon Hewitt; Chicago, IL, USA: 2016. [Google Scholar]
  • 83.General Social Survey and NORC at the University of Chicago Quality of Working Life Module, 1972–2014 Cumulative Codebook. [(accessed on 23 April 2019)];2017 Available online: http://gss.norc.org/Documents/codebook/QWL%20Codebook.pdf.
  • 84.Amick B.C., Habeck R.V., Hunt A., Fossel A.H., Chapin A., Keller R.B., Katz J.N. Measuring the impact of organizational behaviors on work disability prevention and management. J. Occup. Rehabil. 2000;10:21–38. doi: 10.1023/A:1009437728024. [DOI] [Google Scholar]
  • 85.Clausen T., Madsen I., Christensen K., Bjorner J., Poulsen O., Maltesen T., Borg V., Rugulies R. The Danish Psychosocial Work Environment Questionnaire (DPQ): Development, content, reliability and validity. Scand. J. Work Environ. Health. 2018 doi: 10.5271/sjweh.3793. [DOI] [PubMed] [Google Scholar]
  • 86.Reis J.P., DuBose K.D., Ainsworth B.E., Macera C.A., Yore M.M. Reliability and validity of the occupational physical activity questionnaire. Med. Sci. Sports Exerc. 2005;37:2075–2083. doi: 10.1249/01.mss.0000179103.20821.00. [DOI] [PubMed] [Google Scholar]
  • 87.National Research Council. Institute of Medicine . Musculoskeletal Disorders and the Workplaces: Low Back and Upper Extremities. National Academy Press; Washington, DC, USA: 2001. [Google Scholar]
  • 88.Teddlie C., Tashakkori A. Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences. Sage; Thousand Oaks, CA, USA: 2009. [Google Scholar]
  • 89.Linnan L., Steckler A. Process Evaluation in Public Health Interventions and Research. Jossey-Bass Publishers; San Francisco, CA, USA: 2002. Process evaluation and public health interventions: An overview; pp. 1–23. [Google Scholar]
  • 90.Plano Clark V.L. The Adoption and Practice of mixed methods: US trends in federally funded health-related research. Qual. Inq. 2010;16:428–440. doi: 10.1177/1077800410364609. [DOI] [Google Scholar]
  • 91.Palinkas L.A., Aarons G.A., Horwitz S., Chamberlain P., Hurlburt M., Landsverk J. Mixed method designs in implementation research. Adm. Policy Ment. Health. 2011;38:44–53. doi: 10.1007/s10488-010-0314-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Glasgow R.E., Klesges L.M., Dzewaltowski D.A., Estabrooks P.A., Vogt T.M. Evaluating the impact of health promotion programs: Using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ. Res. 2006;21:688–694. doi: 10.1093/her/cyl081. [DOI] [PubMed] [Google Scholar]
  • 93.QSR International Pty Ltd. NVivo Qualitative Data Analysis Program, Version 1.3. QSR International Pty Ltd.; Melbourne, Australia: 2000. [Google Scholar]
  • 94.King N. Doing template analysis. In: Symon G., Cassell C., editors. Qualitative Organizational Research: Core Methods and Current Challenges. Sage; Thousand Oaks, CA, USA: 2012. pp. 426–450. [Google Scholar]
  • 95.Creswell J.W., Plano Clark V.L. Designing and Conducting Mixed Methods Research. 3rd ed. Sage Publications, Inc.; Thousand Oaks, CA, USA: 2011. Collecting data in mixed methods research; pp. 171–202. [Google Scholar]
  • 96.Von Thiele Schwarz U., Nielsen K.M., Stenfors-Hayes T., Hasson H. Using kaizen to improve employee well-being: Results from two organizational intervention studies. Hum. Relat. 2017;70:966–993. doi: 10.1177/0018726716677071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Hurtado D., Nelson C.C., Hashimoto D., Sorensen G. Supervisors’ support for nurses’ meal breaks and mental health. Workplace Health Saf. 2015;63:107–115. doi: 10.1177/2165079915571354. [DOI] [PubMed] [Google Scholar]
  • 98.Pawson R., Tilley N. Realistic Evaluation. SAGE; Thousand Oaks, CA, USA: London, UK: 1997. [Google Scholar]
  • 99.Dekker S., Cilliers P., Hofmeyr J.-H. The complexity of failure: Implications of complexity theory for safety investigations. Saf. Sci. 2011;49:939–945. doi: 10.1016/j.ssci.2011.01.008. [DOI] [Google Scholar]
  • 100.Schneider M., Somers M. Organizations as complex adaptive systems: Implications of Complexity Theory for leadership research. Leadersh. Q. 2006;17:351–365. doi: 10.1016/j.leaqua.2006.04.006. [DOI] [Google Scholar]
  • 101.Helbing D. Globally networked risks and how to respond. Nature. 2013;497:51–59. doi: 10.1038/nature12047. [DOI] [PubMed] [Google Scholar]
  • 102.National Institute for Occupational Safety and Health Protecting Temporary Workers. [(accessed on 18 April 2019)]; Available online: https://www.osha.gov/temp_workers/

Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES