Abstract
Purpose
Implementation of employer sun safety actions was assessed in a 2-year follow-up to an occupational sun protection policy intervention.
Design
2-year follow-up assessment in a randomized pretest-posttest controlled design.
Setting
Local government organizations with workers in public safety, public works, and parks and recreation.
Subjects
63 local government organizations (participation=64%) and 330 frontline supervisors and 1,454 workers.
Intervention
Sun Safe Workplaces (SSW) intervention promoting occupational sun safety policy and education.
Measures
Observations of SSW messages and sun safety items and surveys on organizations’ communication and actions on sun safety.
Analysis
Comparison between SSW and control groups were conducted using regression models and adjusting for clustering where appropriate, with alpha criterion set at p=0.05 (two-tailed).
Results
At intervention worksites, more SSW messages (p<0.001) and sun safety items (p=0.025) were observed; more frontline supervisors reported organizations provided free/reduced price sunscreen (p=0.005) and communicated about sun safety (p<0.001); and more workers recalled receiving sun safety messages (p<0.001) and sun safety training (p<0.001) compared to control organizations. Implementation was greater at larger than smaller intervention organizations for wide-brimmed hats (p=0.009), long work pants (p=0.017), and shade structures (p=0.036). Older workers received the most written messages (p=0.015).
Conclusions
SSW appeared to produce actions by organizations to support employee sun safety. Large organizations may have processes, communication channels, and slack resources to achieve more implementation.
Keywords: skin cancer, prevention, implementation, occupational
Purpose
Outdoor workers are regularly exposed to high doses of solar ultraviolet radiation1–4 (UVR) increasing their risk for skin cancer,5–11 especially keratinocyte skin cancers (i.e., basal and squamous cell cancers) and to a lesser extent melanoma.12–14 Many outdoor workers are inadequately protected from UVR5,15–22 and U.S., Canadian, and Australian health agencies recommend that employers adopt comprehensive approaches to occupational sun protection that include administrative policies, environmental controls, and employee education23–32 to reduce the risk of skin cancer. Programs with policies that integrate disease prevention (i.e., improving safety of the work environment) and health promotion (i.e., wellness and chronic disease management) are considered optimal.33
The development of policy is critical in improving chronic disease prevention and has been successful in increasing tobacco control,34–38 and improving physical activity and diet.39–41 Based on social ecological models,42 comprehensive worksite sun safety policies are expected to have a positive impact on occupational sun protection by motivating employers to provide training in skin cancer prevention; personal protection equipment such as sunscreen, protective clothing, and hats; sun protective environments such as temporary shade; and regular reminders to take precautions and have skin cancer screenings. Unfortunately, most studies of occupational sun protection have focused on education promoting workers’ personal sun protection practices rather than implementation of other protection practices.43–52
Limited evidence is available on whether occupational sun protection policy affects skin cancer prevention in the work environment over both the short and long-term.48,53,54 The authors documented that few local government organizations in a western U.S. state have sun safety policies and existing policies mainly promote personal protection.55 Another study in Australia found that slightly over half of workplaces had a sun safety policy in place but workers’ sun protection improved only when the policy was consistently enforced. A knowledge gap also exists between the development of successful evidence-based policies and their effective implementation, critical to realizing the intended effects of occupational sun protection policies.56
This paper reports on a two-year follow-up of a trial evaluating the Sun Safe Workplaces (SSW) occupational sun protection intervention in a sample of local government organizations. Assessment at the end of the intervention showed that SSW increased the number of organizations with formal written sun safety policies and senior managers’ reports of providing wide-brimmed hats to employees.57 The research questions explored in this analysis of the follow-up assessment were whether SSW increased implementation of workplace sun safety actions by employers two years post-intervention and if SSW’s effect on implementation was moderated by organizational characteristics (i.e., size of employer and employee demographics).
Methods
Design
Local government organizations were enrolled in a randomized pretest-posttest controlled design in 2010–2011. Half of the organizations were randomly selected to receive the SSW intervention for 24 months with the remaining organizations assigned to an attention control condition by the project biostatistician using a customized computer program. Organizations’ written workplace policies were assessed and senior managers completed surveys immediately before and after the intervention. Two years after the intervention was completed, the organizations were contacted for a second follow-up in 2015–2016. Key contact managers identified frontline supervisors, (i.e., managers/supervisors who have direct responsibility for outdoor employees and implementation of health and safety actions for their employees) and employees who worked outdoors and worked with study staff to distribute self-administered surveys to them. Project staff visited each employer, audited the workplace for sun protection messages and items, and conducted semi-structured interviews with key managers (results will be reported elsewhere). All protocols were approved by the Western Institutional Review Board (WIRB PRO NUM: 20141217).
Sample
Cities, counties, and special districts in Colorado (n=98) were enrolled in the SSW trial.57 Local government organizations were eligible if they had employees who worked outdoors in at least one of the following areas: public works, public safety, and parks and recreation. Also, they had to provide copies of formal written policies and have five or more senior managers complete a baseline survey to participate. Two years after the intervention concluded, key contact managers were re-contacted and invited to participate in a second follow-up assessment. Sample size was designed to provide 80% power to detect changes in policy implementation by organizations and sun safety behaviors by frontline supervisors and employees. See CONSORT diagram in Figure 1.
Figure 1:
CONSORT diagram for randomized trial and two-year follow-up assessment testing the effect of the SSW intervention compared to an attention control condition.
Measures
The measures reported in this paper include the policy measure from the baseline and first follow-up assessment and implementation measures in the second follow-up assessment: observation of sun safety messages and items by project staff and implementation of sun safety actions reported by frontline supervisors and employees.
Workplace policy adoption measure.
In the first follow-up assessment in the SSW trial, the primary outcome was adoption of a sun protection policy. Presence and content of policies from local government organizations were assessed by trained research assistants blind to experimental condition, using a coding protocol published previously.55 It measured 15 content categories in environmental controls (shade, outdoor work schedule), administrative procedures (risk assessment, training of employees and managers/supervisors, policy monitoring, resource allocation, communication with clients/patrons, compliance by contractors/subcontractors, and posting of UV Index) and personal protection practices (use of UV-protective clothing [i.e., long-sleeved shirt and long pants/skirt], hats, protective eyewear, and sunscreen, and regular skin cancer screening). Summed scores indicating the presence of any sun protection policy and of best-practice sun protection policy were analyzed.55
Policy implementation measures.
Implementation of sun safety actions, the primary outcome of this follow-up study, was measured in three ways. Project staff inspected the workplaces for sun protection messages provided in the SSW or created by the employer and personal sun protection items (i.e., sunscreen; shade structures). Frontline supervisors reported whether the organization provided personal sun protection equipment for employees, i.e., sunscreen, wide-brimmed hats, sunglasses, long-sleeved shirts, long pants, or outdoor shade,57 the organization or themselves communicated with employees about sun safety,47,50–52 and the organization had unwritten standard operating procedures on sun safety. Employees reported whether they had received any sun safety messages in written or electronic (email or website) formats from the local government organization, training on sun safety at the workplace, or messages on sun safety from a coworker. Employees also indicated if they were aware of any changes in the workplace to promote sun safety. Frontline supervisors and employees also reported their personal sun protection practices; analyses of these outcomes are reported elsewhere.58
Intervention
Sun Safe Workplaces (SSW) intervention.
The SSW program advocated for adoption of occupational sun safety policies and provided training in personal sun protection for outdoor workers. SSW was guided by Diffusion of Innovations Theory (DIT)59 and two relationship development models: Social Penetration Theory60 and Stages of Relational Development.61 Based on DIT, SSW promoted sun safety policy and training by increasing the perceived need for workplace sun safety and fit with workplaces’ safety mission/procedures. Accordingly, the SSW program bundled occupational sun safety with worksite safety goals and assisted managers in identifying ways to alter the policies/education and/or the workplace to improve fit. SSW also provided managers with communication strategies to clarify these changes to other managers and employees.62 Based on the relationship theories, project staff developed working relationships with managers and engaged in involved communication about policies and education on sun safety to reduce their uncertainty63 about sun safety. Occupational sun safety advice from national authorities (e.g., CDC and NIOSH) was highlighted for credibility/trust, and public commitment from managers to adopt and implement policy and training was encouraged.64
The intervention included meetings with managers and provision of online and printed materials. Staff met with the key contact manager at each organization and introduced SSW; advocated for sun safety policy adoption, reinforcement, and maintenance; presented the SSW website; and reviewed the Sun Safety Tool Box, worksite audit, policy-writing tool, and fact sheets on sun safety on the website. The contact manager scheduled the SSW Sun Safety Training by project staff with various employee groups, which was based on DIT and Social Cognitive Theory65 and designed to fit into workplace safety. Workplace Sun Safety Materials were sent in four sets (twice a year over two years) to the contact manager (i.e., 10 posters, six tip cards, a sticker, a sunscreen discount coupon, and a CD on total skin self-examination). Project staff made monthly follow-up contacts with the contact manager to support decisions to write policies and train employees and problem solve barriers. See Buller et al.57 for more information.
Attention-control intervention.
Local government organizations in the control group received printed information on occupational sun safety twice a year to create an attention-control condition, i.e., posters with personal sun protection and skin cancer incidence rates, risk assessment brochures, worksite guide, total skin self-examination CD, the American Academy of Dermatology SPOT bookmark, and a sun safety tip card from the Occupational Safety and Health Administration. Presentations on general sun safety topics, not policy, were made at state professional conferences.
Analysis of Two-Year Follow-up Assessment
Observed total number of SSW materials and of sun protection items in the workplace were analyzed at the organizational level using PROC GENMOD in SAS, fitting Poisson regression models. Analyses tested the differences between experimental conditions (SSW intervention v. control) and the relationship of the observed materials and items and the presence of occupational sun protection policy. Also, frontline supervisors’ reports of sun protection actions and communication about sun safety and employees’ reports of communication about sun safety were modeled using multilevel analysis. In these analyses, differences between experimental conditions and association with the presence of occupational sun protection policy assessed in main trial were examined. PROC MIXED in SAS was employed for continuous outcomes and PROC GLIMMIX in SAS was used for binary outcomes with employer characteristics and employee demographics included as covariates using stepwise model selection at p<0.15, two-tailed. Moderators of the impact of experimental conditions and presence of policy were also tested by examining two-way interactions with size of employer (based on number of employees) and employees’ age and tenure in the workplace (in years) in the multilevel models. Alpha criterion levels were set at 0.05 (two-tailed) for all tests.
Results
Profile of the Samples
A total of 63 of the original 98 local government organizations in the trial (64%) agreed to participate in the two-year follow-up (Table 1). Half were municipal governments; 10% were county governments; and two-fifths were special districts. Most were located in the Denver metropolitan area or southern and western Colorado. Organizations averaged 226 employees overall. There were no statistically significant differences in employer characteristics between organizations in the original trial and those followed up.
Table 1:
Profile of local government organizations, frontline supervisor, and employee samples
| Local Government Organizations (n=63) | |
|---|---|
| Characteristics | |
| Type of organization | |
| City | 50.8% |
| County | 9.5% |
| Special taxing district | 39.7% |
| Size of organization (number of employees; mean (std dev) | 225.94 (419.77) |
| Percentage of female senior managers (mean [SD]) | 22.0% (20.6%) |
| Household income (in dollars) of weighted county population (mean [SD]) | 78,034.50 (18,882.29) |
| Percentage residents with bachelor degrees or higher of weighted county population (mean [SD]) | 37.3% (12.7%) |
| Distance (in miles) from urban Front Range of Colorado (mean [SD]) | 87.16 (97.79) |
| Frontline Supervisors (n=330) | |
| Characteristics | % |
| Length of time working for employer | |
| 0–4 years | 21.5 |
| 5–14 years | 29.3 |
| 15–20 years | 24.0 |
| 21 years or more | 25.2 |
| Type of position | |
| Public works | 29.0 |
| Public safety | 32.8 |
| Parks and recreation | 23.4 |
| Other | 14.8 |
| Work outdoors or indoors | |
| Mostly outdoors | 21.6 |
| Outdoors and indoors about equally | 40.7 |
| Mostly indoors | 37.7 |
| Hours work outdoors in a typical week | |
| In Summer: 0 hours | 4.4 |
| 1–5 hours | 28.4 |
| 6–10 hours | 22.7 |
| 11–20 hours | 16.7 |
| 21 hours or more | 27.8 |
| In Winter: 0 hours | 8.5 |
| 1–5 hours | 38.3 |
| 6–10 hours | 18.7 |
| 11–20 hours | 17.1 |
| 21 hours or more | 17.4 |
| Age | |
| 18–34 | 12.8 |
| 35–44 | 29.2 |
| 45–54 | 33.8 |
| 55 or older | 24.2 |
| Hispanicity | |
| Not Hispanic | 92.4 |
| Hispanic | 7.6 |
| Race | |
| American Indian/Alaska Native | 1.4 |
| Asian | 0.3 |
| Native Hawaiian/Other Pacific Islander | 0.0 |
| Black/African American | 1.4 |
| White | 95.5 |
| More than one race | 1.4 |
| Skin type | |
| Always burns and is unable to tan | 7.2 |
| Usually burns but can tan if I work at it | 24.0 |
| Sometimes mildly burn and then tans easily | 42.9 |
| Rarely burns and tans easily | 25.9 |
| History of skin cancer | |
| No | 90.1 |
| Yes | 9.9 |
| Education | |
| Less than high school graduate | 1.3 |
| High school graduate | 14.5 |
| Trade, technical, or vocational education beyond high school | 6.2 |
| Some college | 22.4 |
| 4-year college graduate or postgraduate degree | 55.6 |
| Marital status | |
| Never married | 7.6 |
| Widow/separated/divorced | 12.9 |
| Married or living with a partner | 79.5 |
| Children under 18 living in the home | |
| No | 56.0 |
| Yes | 44.0 |
| Gender | |
| Female | 16.0 |
| Male | 84.0 |
| Employees (n=1,454) | |
| Characteristics | % |
| Length of time working for employer | |
| 0–4 years | 46.4 |
| 5–14 years | 31.9 |
| 15–20 years | 11.3 |
| 21 years or more | 10.4 |
| Type of position | |
| Public works | 36.4 |
| Public safety | 17.0 |
| Parks and recreation | 23.4 |
| Other | 23.2 |
| Work outdoors or indoors | |
| Mostly outdoors | 54.5 |
| Outdoors and indoors about equally | 24.8 |
| Mostly indoors | 20.7 |
| Hours work outdoors in a typical week | |
| In Summer: 0 hours | 6.1 |
| 1–5 hours | 12.6 |
| 6–10 hours | 16.7 |
| 11–20 hours | 13.3 |
| 21–30 hours | 14.7 |
| 31 hours or more | 36.6 |
| In Winter: 0 hours | 15.6 |
| 1–5 hours | 18.3 |
| 6–10 hours | 16.1 |
| 11–20 hours | 15.7 |
| 21–30 hours | 13.7 |
| 31 hours or more | 20.6 |
| Age | |
| 18–24 | 13.4 |
| 25–34 | 20.6 |
| 35–44 | 24.4 |
| 45–54 | 20.4 |
| 55 or older | 21.2 |
| Hispanicity | |
| Not Hispanic | 89.0 |
| Hispanic | 11.0 |
| Race | |
| American Indian/Alaska Native | 1.8 |
| Asian | 0.6 |
| Native Hawaiian/Other Pacific Islander | 0.4 |
| Black/African American | 1.1 |
| White | 93.5 |
| More than one race | 2.6 |
| Skin T]type | |
| Always burns and is unable to tan | 4.5 |
| Usually burns but can tan if I work at it | 21.6 |
| Sometimes mildly burn and then tans easily | 44.8 |
| Rarely burns and tans easily | 29.1 |
| History of skin cancer | |
| No | 92.0 |
| Yes | 8.0 |
| Education | |
| Less than high school graduate | 1.4 |
| High school graduate | 20.4 |
| Trade, technical, or vocational education beyond high school | 10.6 |
| Some college | 30.9 |
| 4-year college graduate or postgraduate degree | 36.7 |
| Marital status | |
| Never married | 23.1 |
| Widow/separated/divorced | 10.6 |
| Married or living with a partner | 66.3 |
| Children under 18 living in the home | |
| No | 61.4 |
| Yes | 38.6 |
| Gender | |
| Female | 20.4 |
| Male | 79.6 |
Three hundred thirty frontline supervisors completed the follow-up survey (Table 1). Half had worked at the employer 15 years or more and more were employed in public safety. Over three-fifths reported working mostly outdoors or outdoors and indoors equally but less than 5% reported not working outside at all in the summer (<9% in the winter). The average number of hours worked per week outdoors was 15.53 (sd=14.05) in the summer and 11.68 (sd=12.20) in the winter. Frontline supervisors were predominately male and most were white, with 31% having the highest-risk skin types (Type I or II) and nearly 10% having been diagnosed with skin cancer. Frontline supervisors at intervention organizations tended to be longer-tenured in their jobs (p<0.001), to be in public safety jobs (p<0.001), and male (p=0.039) than those at control organizations.
One thousand, four hundred fifty-four employees completed the survey. By comparison to supervisors, employees had less tenure in the workplace (78% working less than 15 years) and the largest number of employees were employed in public works. Also, four-fifths of employees worked mostly outdoors or outdoors and indoors equally (mean= 23.11 [sd=15.77] hours in the summer and 17.14 [sd=15.40] hours in the winter per week). Like supervisors, employees were mostly male and white, with 26% having Type I or II skin at highest risk for skin cancer and 8% having been diagnosed with skin cancer. Employees at intervention organizations were longer-tenured (p=0.003), more often worked in public works jobs (p<0.001), worked outside for about two hours less (p=0.003), were older (p<0.001), and married (p=0.005) compared to those at control organizations.
Effect of Sun Safe Workplaces Intervention
Observed use of SSW sun protection messages and of sun protection items (e.g., sunscreen; shade structures) was higher at local government organizations in the intervention than the control group at the two-year follow-up (Table 2). Survey responses from frontline supervisors and employees regarding sun protection messages were consistent with these observations. Frontline supervisors in the intervention organizations reported more communication about sun protection to employees, more standard operating procedures on sun safety, and more free/reduced cost sunscreen than in the control organizations (Table 3). Compared to control organizations, employees at intervention organizations confirmed that they received more written and electronic sun safety messages from the employer and from coworkers, and more training on sun protection (Table 3). The proportion of frontline supervisors reporting that the organization communicated to employees about sun safety was significantly correlated with proportion of employees who reported receiving written communication (r=0.41, p=0.003) and training (r=0.32, p=0.020; electronic communication r=0.07, p=0.607; coworker communication r=0.20, p=0.160). However, the proportion of frontline supervisors reporting that they communicated about sun safety with employees was not related to employees’ reports about communication (written communication r=0.03, p=0.845; electronic communication r=−0.13, p=0.357; coworker communication r=−0.05, p=0.727; and training, r=−0.04, p=0.751).
Table 2:
Comparison of observed SSW messages and sun protection items in the workplaces by experimental condition and occupational sun protection policy
| Experimental Condition | |||
|---|---|---|---|
| Messages and Items | Control | Intervention | p |
| Sun Safe Workplaces messages (range=0 to 14) | 0.93 | 3.09 | <0.001 |
| Other sun protection messages (range=0 to 3) | 0.17 | 0.15 | 0.880 |
| Sun protection items (range=0 to 9) | 1.50 | 2.27 | 0.025 |
| All sun protection messages and items (range=0 to 20) | 2.60 | 5.52 | <0.001 |
| Occupational Sun Protection Policy (general score) | |||
| Messages and Items | Coefficient | p | |
| Sun Safe Workplaces messages (range=0 to 14) | 1.16 | <0.001 | |
| Other sun protection messages (range=0 to 3) | 1.10 | 0.339 | |
| Sun protection items (range=0 to 9) | 1.11 | <0.001 | |
| All sun protection messages and items (range=0 to 20) | 1.13 | <0.001 | |
| Occupational Sun Protection Policy (best-practice score) | |||
| Messages and Items | Coefficient | p | |
| Sun Safe Workplaces messages (range=0 to 14) | 1.19 | <0.001 | |
| Other sun protection messages (range=0 to 3) | 1.07 | 0.558 | |
| Sun protection items (range=0 to 9) | 1.14 | <0.001 | |
| All sun protection messages and items (range=0 to 20) | 1.16 | <0.001 | |
Table 3:
Differences in frontline supervisors’ and employees’ reports on local government organizations’ sun safety actions and communication by experimental condition
| Frontline Supervisors (n=330) | |||
|---|---|---|---|
| Experimental Condition | |||
| Sun Safety Action | Control | Intervention | p |
| Free/reduced price sunscreen with SPF 15+ | 64.2% | 89.4% | 0.005 |
| Wide-brimmed hats | 25.3% | 29.3% | 0.644 |
| Sunglasses | 21.0% | 28.2% | 0.385 |
| Long-sleeved work or uniform shirts | 67.4% | 78.8% | 0.217 |
| Long work or uniform pants | 54.5% | 64.3% | 0.446 |
| Temporary or permanent shade structures | 36.2% | 43.8% | 0.441 |
| Composite number of sun safety actions, mean (std dev) | 2.34 (0.22) | 2.76 (0.30) | 0.161 |
| Organization communicated sun safety messages to employees | 67.5% | 93.8% | <0.001 |
| I communicated sun safety messages to employees | 73.8% | 82.4% | 0.166 |
| Unwritten standard operating, administrative, or training procedure to improve employee sun safety | 36.7% | 63.5% | <0.001 |
| Employees (n=1,454) | |||
| Experimental Condition | |||
| Sun Safety Action | Control | Intervention | p |
| Seen/received written sun safety messages | 49.8% | 70.3% | <0.001 |
| Seen/received electronic sun safety messages by email or on website | 26.3% | 36.4% | 0.037 |
| Received a sun safety message from coworkers | 56.0% | 69.9% | 0.010 |
| Received any training on sun safety | 45.3% | 70.0% | <0.001 |
| Aware of any changes in sun safety practices or procedures at your workplace | 23.3% | 28.1% | 0.242 |
Moderation of Effect of Treatment Group
Organization size based on the number of employees moderated the effect of the treatment. Larger local government organizations in the intervention group took more sun safety actions than smaller organizations. Specifically, the total sun protection messages and items observed was highest in larger intervention organizations (control: 100 employees – M=2.76, 200 employees – M=2.62, 300 employees – M=2.50, 400 employees – M=2.37, 500 employees – M=2.26, 600 employees – M=2.15; intervention: 100 employees – M=5.32, 200 employees – M=5.48, 300 employees – M=5.65, 400 employees – M=5.82, 500 employees – M=6.00, 600 employees – M=6.18). Likewise, more frontline supervisors in larger intervention organizations reported that the employer had provided wide-brimmed hats, long pants, and temporary or permanent shade to protect employees from the sun than in smaller intervention organizations (Table 5). Reports on implementation of these actions in control workplaces which were lower than in intervention organizations did not differ by size of employer.
Table 5:
Moderation of differences in frontline supervisors’ and employees’ reports on local government organizations’ sun safety actions and communication by employer size and employee age and length of tenure at the workplace
| Frontline Supervisors (n=330) | ||||||
|---|---|---|---|---|---|---|
| Sunscreen | Wide-brimmed Hats | Sunglasses | Long-sleeved shirts | Long pants | Shade | |
| Number of Employees | ||||||
| Control | ||||||
| 100 | 51.2% | 36.4% | 10.6% | |||
| 200 | 52.2% | 35.6% | 10.4% | |||
| 300 | 53.1% | 34.9% | 10.2% | |||
| 400 | 54.1% | 34.1% | 10.0% | |||
| 500 | 55.0% | 33.3% | 9.8% | |||
| 600 | 56.0% | 32.5% | 9.6% | |||
| Intervention | ||||||
| 100 | 50.7% | 38.5% | 11.3% | |||
| 200 | 63.0% | 52.7% | 15.0% | |||
| 300 | 73.8% | 66.5% | 19.7% | |||
| 400 | 82.4% | 78.0% | 25.3% | |||
| 500 | 88.6% | 86.4% | 32.0% | |||
| 600 | 92.8% | 91.9% | 39.5% | |||
| p=0.009 | p=0.017 | p=0.036 | ||||
| Number of Employees | ||||||
| No Policy | ||||||
| 100 | 13.1% | |||||
| 200 | 12.7% | |||||
| 300 | 12.3% | |||||
| 400 | 12.0% | |||||
| 500 | 11.6% | |||||
| 600 | 11.3% | |||||
| Policy | ||||||
| 100 | 5.8% | |||||
| 200 | 8.0% | |||||
| 300 | 11.0% | |||||
| 400 | 14.8% | |||||
| 500 | 19.7% | |||||
| 600 | 25.6% | |||||
| p=0.024 | ||||||
| Employees (n=1,454) | ||||||
| Written Message | Electronic Message | Message from Coworker | Training | Aware of Changes in Sun Safety Practices | ||
| Age of Employee | ||||||
| Control | ||||||
| 20 | 53.8% | 26.4% | 27.5% | 18.4% | ||
| 30 | 50.5% | 21.1% | 23.3% | 15.0% | ||
| 40 | 47.2% | 16.7% | 19.6% | 12.2% | ||
| 50 | 43.9% | 13.0% | 16.4% | 9.8% | ||
| 60 | 40.7% | 10.0% | 13.6% | 7.9% | ||
| 70 | 37.5% | 7.7% | 11.2% | 6.3% | ||
| Intervention | ||||||
| 20 | 63.6% | 20..4% | 39.1% | 14.0% | ||
| 30 | 66.3% | 21.8% | 39.6% | 14.4% | ||
| 40 | 68.9% | 23.3% | 40.1% | 14.8% | ||
| 50 | 71.4% | 24.9% | 40.6% | 15.3% | ||
| 60 | 73.7% | 26.5% | 41.1% | 15.8% | ||
| 70 | 75.9% | 28.2% | 41.6% | 16.2% | ||
| p=0.015 | p<0.001 | p=0.035 | p=0.012 | |||
| Age of Employee | ||||||
| No Policy | ||||||
| 20 | 24.7% | |||||
| 30 | 20.6% | |||||
| 40 | 17.0% | |||||
| 50 | 13.9% | |||||
| 60 | 11.3% | |||||
| 70 | 9.2% | |||||
| Policy | ||||||
| 20 | 24.6% | |||||
| 30 | 24.7% | |||||
| 40 | 24.9% | |||||
| 50 | 25.0% | |||||
| 60 | 25.2% | |||||
| 70 | 25.3% | |||||
| p=0.017 | ||||||
| Length of Tenure of Employee | ||||||
| Control | ||||||
| <1 | 20.2% | 24.1% | ||||
| 5 | 19.5% | 24.1% | ||||
| 10 | 18.8% | 24.0% | ||||
| 15 | 18.2% | 23.9% | ||||
| 20 | 17.5% | 23.8% | ||||
| 25 | 16.9% | 23.7% | ||||
| Intervention | ||||||
| <1 | 24.4% | 39.4% | ||||
| 5 | 26.3% | 44.3% | ||||
| 10 | 28.3% | 50.5% | ||||
| 15 | 30.4% | 56.7% | ||||
| 20 | 32.5% | 62.6% | ||||
| 25 | 34.8% | 68.3% | ||||
| p=0.040 | p=0.003 | |||||
| Length of Tenure of Employees | ||||||
| No Policy | ||||||
| <1 | 32.2% | |||||
| 5 | 33.1% | |||||
| 10 | 34.1% | |||||
| 15 | 35.0% | |||||
| 20 | 35.9% | |||||
| 25 | 36.9% | |||||
| Policy | ||||||
| <1 | 34.0% | |||||
| 5 | 39.3% | |||||
| 10 | 45.0% | |||||
| 15 | 50.7% | |||||
| 20 | 56.5% | |||||
| 25 | 62.1% | |||||
| p=0.024 | ||||||
| Marital Status | ||||||
| Control | ||||||
| Other | 54.2% | 33.0% | 65.4% | 29.4% | ||
| Married | 48.4% | 22.5% | 52.0% | 19.8% | ||
| Intervention | ||||||
| Other | 62.2% | 28.1% | 64.2% | 22.6% | ||
| Married | 75.4% | 40.7% | 72.6% | 30.6% | ||
| p=0.002 | p<0.001 | p=0.001 | p=0.003 | |||
Age, length of tenure, and marital status moderated the effect of treatment on employees’ reports on sun safety messages and workplace actions. In control organizations, fewer older employees reported receiving sun protection communications and training in sun safety or were aware of changes in the workplace to support sun protection than younger employees (Table 5). In intervention organizations, age did not affect reports of communication and awareness of such changes. By contrast, in intervention organizations, longer-tenured employees were more likely to report receiving electronic messages and training promoting sun safety than shorter-tenured employees. Reports on these actions in control organizations did not differ by tenure. Finally, married employees in intervention organizations reported more communication (written, electronic, or from coworkers) and changes in the workplace to support sun safety while married employees in control organizations reported less communication and changes related to sun safety (Table 5).
Effect of Presence of a Sun Protection Policy
Local government organizations with a sun protection policy also implemented more communication about sun safety and provided more items to help employees protect themselves than organizations without these policies (Table 2). Frontline supervisors and employees also reported more communication on sun safety at organizations with a policy than without a policy (Table 4).
Table 4:
Differences in frontline supervisors’ and employees’ reports on local government organizations’ sun safety actions and communication by occupational sun protection policy
| Frontline Supervisors (n=330) | ||
|---|---|---|
| Occupational Sun Protection Policy (general score) | ||
| Sun Safety Action | Odds Ratio1 (95% CI) | p |
| Free/reduced price sunscreen with SPF 15+ | 1.23 (1.02, 1.49) | 0.029 |
| Wide-brimmed hats | 1.03 (0.90, 1.18) | 0.652 |
| Sunglasses | 1.00 (0.86, 1.15) | 0.974 |
| Long-sleeved work or uniform shirts | 1.02(0.88, 1.19) | 0.788 |
| Long work or uniform pants | 1.03(0.86, 1.22) | 0.771 |
| Temporary or permanent shade structures | 0.97(0.85, 1.11) | 0.688 |
| Composite sun safety actions | 0.502 | 0.444 |
| Organization communicated sun safety messages to employees | 1.21 (1.003, 1.47) | 0.047 |
| I communicated sun safety messages to employees | 1.18 (1.04, 1.34) | 0.009 |
| Unwritten standard operating, administrative, or training procedure to improve employee sun safety | 1.02 (0.92, 1.13) | 0.694 |
| Occupational Sun Protection Policy (best-practice score) | ||
| Sun Safety Action | Odds Ratio1 (95% CI) | p |
| Free/reduced price sunscreen with SPF 15+ | 1.33 (1.06, 1.68) | 0.015 |
| Wide-brimmed hats | 1.02 (0.87, 1.20) | 0.786 |
| Sunglasses | 1.02 (0.86, 1.20) | 0.840 |
| Long-sleeved work or uniform shirts | 1.01 (0.85, 1.21) | 0.897 |
| Long work or uniform pants | 1.04 (0.85, 1.28) | 0.699 |
| Temporary or permanent shade structures | 0.98 (0.84, 1.14) | 0.757 |
| Composite sun safety actions | 0.502 | 0.381 |
| Organization communicated sun safety messages to employees | 1.26 (0.99, 1.60) | 0.051 |
| I communicated sun safety messages to employees | 1.19 (1.02, 1.38) | 0.027 |
| Unwritten standard operating, administrative, or training procedure to improve employee sun safety | 1.02 (0.91, 1.14) | 0.775 |
| Employees (n=1,454) | ||
| Presence of a Policy (general score) | ||
| Sun Safety Action | Odds Ratio1 (95% CI) | p |
| Seen/received written sun safety messages | 1.09 (1.001, 1.18) | 0.047 |
| Seen/received electronic sun safety messages by email or on website | 1.08 (1.01, 1.16) | 0.033 |
| Received a sun safety message from a coworkers | 1.09 (1.01, 1.18) | 0.024 |
| Received any training on sun safety | 1.08 (0.98, 1.19) | 0.138 |
| Aware of any changes in sun safety practices or procedures at your workplace | 1.01 (0.95, 1.08) | 0.717 |
| Presence of a Policy (best-practice score) | ||
| Sun Safety Action | Odds Ratio1 (95% CI) | p |
| Seen/received written sun safety messages | 1.09 (0.98, 1.20) | 0.099 |
| Seen/received electronic sun safety messages by email or on website | 1.09 (1.00, 1.18) | 0.057 |
| Received a sun safety message from a coworkers | 1.10 (1.01, 1.21) | 0.033 |
| Received any training on sun safety | 1.09 (0.97, 1.23) | 0.146 |
| Aware of any changes in sun safety practices or procedures at your workplace | 1.02 (0.95, 1.11) | 0.552 |
Odds of providing sun safety actions/communication versus not providing
Coefficient
Moderators of the Effect of Sun Protection Policy
The effect of the presence of a sun protection policy on organizations’ sun safety actions was also moderated by employer size and employees’ age and tenure. At organizations with sun protection policies, more frontline supervisors at larger organizations reported the provision of temporary or permanent shade than at smaller organizations, with no change in reports at organizations without sun protection policies by employer size (Table 5). Compared to younger and shorter-tenured employees, older employees reported more electronic messages promoting sun safety at organizations with a sun protection policy while longer-tenured employees reported more training in sun safety at organizations with a sun protection policy (Table 5).
Discussion
Two years following the SSW intervention, local government organizations appeared to be taking several actions to communicate and support sun safety by employees. This was evident both in observed use of SSW messages and sun safety items in the workplace (e.g., sunscreen; shade structures) and in reports by frontline supervisors and employees two-years post-intervention. Immediately after the intervention, senior managers at intervention organizations had reported that the organizations provided more wide-brimmed hats for employees.57 After two years, it appears that organizations were taking a wider range of actions, including a variety of communications promoting sun safety both from the organization and among coworkers and providing free/reduced-cost sunscreen. These findings are consistent with research on other health behaviors, such as tobacco use, physical activity, and diet,34–41 that showed benefits from policy interventions. Multi-component interventions that combine environmental and individual components has changed diet and physical activity.66
Policy adoption may be a way to create sustained implementation of occupational sun safety over time, which can be challenging67–70 but necessary to achieve real changes in employee sun protection practices. It has been argued that sustained implementation is an evolving process of mutual adaptation of the organization and innovation,67 and this may have been the case in this study. For instance, evolution of policy implementation was identified in one study of a workplace smoke-free policy, where employee education increased staff support for the policy and new actions arose after one year (e.g., a smoke-free hiring policy).71 In the present study, local government organizations seemed to allocate more resources to purchase sun protection items, generated staff support for the sun safety policy, and found further opportunities to promote sun protection to employees in the two years after receiving SSW than reported immediately following the intervention.57 While cost can be a barrier, the results suggested that overtime, these organizations were able to identify funds to support providing sun protection items. It may be that the policy helped convince leaders setting the organizations’ budgets that employee sun protection was a priority and needed resources. Stimulating implementation of preventive actions (i.e., sun protection actions for workers) by the employers over several years witnessed in both in the SSW intervention group and among organizations adopting a sun safety policy may explain how combining workplace education and policy has succeeded in producing positive outcomes in employee health and well-being.33,72–75 However, how long implementation will continue without active support from outside change agents is unknown, although it is hoped that written policy has permanence and persisting influence on organizations’ actions. Policy is likely to be an external motivation for employees’ to change sun safety practices; future research should compare the SSW intervention to interventions that create internal motivation for employee behavior such as providing incentives.76
The influence of the intervention and policy may have been greater in larger rather than smaller organizations, as has been seen in past research on local government innovation.77–82 Larger organizations may have more existing processes to enable sun safety actions. For instance, larger organizations may provide work uniform allowances that could be used to purchase long pants or wide-brimmed hats. They may have many more formalized communication channels and training programs or staff with skills to communicate effectively to deliver sun safety messages.83 Also, larger organizations may have more slack resources to devote to items to support employee sun safety than smaller organizations,78,84 especially costly equipment like temporary or permanent shade, although analyses of the sun safety policies at baseline in this study found no association with local government budgets.83 Finally, larger organizations also may have been in more urbanized, cosmopolite communities85–87 where managers have more external connections and are more attuned to news and current affairs. Cosmopoliteness has predicted innovation by local governments,77 including in our analysis of sun safety policies at baseline in this trial.83,88 However, the SSW intervention seemed to close the gap in adoption of sun safety policy between local government organizations farther or closer to the urban Front Range in Colorado at the immediate posttest.57
The effectiveness of SSW may be increased by including ways of supporting sun protection that are easy to deploy and/or inexpensive to help smaller, resource-challenged organizations. It might distribute ready-made messages for employees, information to educate employees on selecting their own sun safe work clothing when uniforms are not provided, or training employees how to find shade provided by existing equipment such as sitting in the shade cast by a truck while taking a break or eating lunch. It must be noted that in most cases smaller organizations in the intervention group or with sun safety policy appeared to increase their sun safety actions beyond those in the control group or without policies. Smaller organizations may actually have had flexibility to innovate,89 possibly from having less formalized structures and fewer external demands. This suggests that employer size altered the extent of sun safety actions, but SSW convinced organizations of all sizes to take steps to support employee sun safety.
The patterns of moderation from employee reports about sun safety communication, training, and workplace changes suggested that SSW and sun protection policies had beneficial effects on older and longer-tenured employees who seemed to be more aware of efforts to promote and support occupational sun protection. These employees may be more integrated into the work culture and more attuned to health issues, given their life experiences. SSW appeared to close a pre-existing gap among older and longer-tenured employees in communication about sun safety at baseline. Before SSW, older/longer-tenured employees may have felt that they already knew from experience how to work safely or believed there is little they could do to reverse years of sun damage, but the increased communication and support for sun safety provoked by SSW captured the attention of these older/longer-tenured employees. One of the presumed benefits of policy is to eliminate differences that exist when employees are left to their own decision-making about disease prevention.
The original randomized trial and the two-year follow-up had some limitations. The generalizability of the results may be best in high-elevation states in the western United States and with local government organizations, but we have improved sun protection in a private outdoor recreation workforce. The two-year follow-up data are limited by the loss of 36% of the original sample of organizations; however, the lack of differences by follow-up status and treatment group implied that the follow-up sample well represented the original sample of organizations. The assessment of sun safety actions included observations at the workplace using established procedures, but the frontline supervisors and employees provided self-reports that are open to social desirability and demand biases, and a Hawthorne effect, although randomization should have equalized these biases across experimental conditions. Frontline supervisors’ reports of their own communication with other employees may be most susceptible to these biases, as these reports did not correlate with employees’ recall of communication. Their reports of communication by the organization were associated with employees’ recall of written communication and training, providing evidence of concurrent validity. Temporal trends, such as increased media attention to sun safety, may have impacted the outcomes but again randomization should have balanced this bias. Frontline supervisors and employees were self-selected, working with senior workplace managers, rather than randomly selected from employee roles, so selection bias was possible (i.e., longer-tenured, older, married, and male workers). Finally, replicability is a concern even in randomized trials and in this case it was strengthened by grounding the SSW in well-established theories and designing samples to provide sufficient statistical power.90 Also, we reported exact p-values to allow the application of lower p-values91 to increase replicability, i.e., p=0.01 or p=0.00592 (although this method is controversial93). Several of the effects of SSW remain statistically significant at these lower p-values, instilling confidence that SSW truly increased implementation of sun safety actions by local government organizations.
Outdoor work continues to be a risk factor for skin cancer for a sizable number of adults. Formal policies on sun protection along with training appear to be an essential component of occupational sun protection efforts. It is critical to note that the SSW intervention appeared to stimulate local government organizations’ actions overtime to promote occupational sun safety.
So What? Implications for Health Promotion Practitioners and Researchers.
What is already known on this topic?
Outdoor workers are exposed routinely to high doses of ultraviolet radiation and are at risk for skin cancer. Workplace interventions typically have promoted sun protection behavior by employees, with only a few promoting occupational policies. The authors’ Sun Safe Workplaces intervention convinced managers at local government organizations to adopt sun safety policies addressing workplace environments and administrative procedures and promoting personal protection for workers.
What does the article add?
This article reports the results of a two-year follow-up assessment of implementation of sun protection policies adopted by local government organizations as a result of the Sun Safe Workplaces intervention. At the two-year follow-up, more sun safety messages and items were observed, frontline supervisors reported more free/reduced cost sunscreen and communication about sun safety to employees, and employees said they received more messages and training on sun protection at intervention compared to control organizations. Larger organizations were more likely to provide communication on sun protection and personal protection items such as wide-brimmed hats, long pants, and shade. Similar although smaller differences were seen when comparing organizations with and without occupational sun protection policies.
What are the implication for health promotion practice or research?
Occupational policies on sun protection will only be effective if they result in employers taking steps to promote and support sun protection by employees. The occupational sun protection policies promoted by the Sun Safe Workplaces intervention succeeded in increasing communication about sun safety and provision of personal sun protection items. Occupational sun protection policies appear to be an essential tool for meeting national goals in the U.S. Surgeon General’s Call to Action to Prevent Skin Cancer.
Acknowledgments
This research was funded by the National Cancer Institute (CA187191), which had no role in the design of the study and collection, analysis, and interpretation of data. The authors thank the managers and employees at the local government organizations that participated in the study for their support of the research.
Trial Registration: Clinicaltrials.gov identifier—NCT021824289
Footnotes
Declaration of Conflicting Interests
Dr. Buller and Dr. Walkosz receive a salary from Klein Buendel, Inc. Ms. Mary Buller is an owner of Klein Buendel, Inc. Dr. Cutter serves on data and safety monitoring boards for AMO Pharmaceuticals, Apotek, Biolinerx Horizon Pharmaceuticals, Modigenetech/Prolor, Merck, Merck/Pfizer, Opko Biologics, Neurim, Sanofi-Aventis, Reata Pharmaceuticals, Receptos/Celgene, Teva pharmaceuticals, NHLBI (Protocol Review Committee), and NICHD (OPRU oversight committee). He is a consultant or member of advisory boards for Atara Biotherapeutics, Argenix, Genzyme, Genentech, GW Pharma, Klein-Buendel Incorporated, Medimmune, Medday, Novartis, Opexa Therapeutics, Roche, Savara Inc., Sciflour, Somahlution, Teva pharmaceuticals, and TG Therapeutics. He is President of Pythagoras, Inc. a private consulting company. Dr. Wallis, Dr. Andersen, Dr. Scott, and Dr. Meenan have no conflicts to declare.
References
- 1.Godar DE. UV doses worldwide. Photochem Photobiol 2005;81(4):736–749. [DOI] [PubMed] [Google Scholar]
- 2.Peters CE, Nicol A-M, Demers PA. Prevalence of exposure to solar ultraviolet radiation (UVR) on the job in Canada. Can J Public Health 2012;103(3):223–226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Hammond V, Reeder AI, Gray A. Patterns of real-time occupational ultraviolet radiation exposure among a sample of outdoor workers in New Zealand. Public Health 2009;123(2):182–187. [DOI] [PubMed] [Google Scholar]
- 4.Diepgen TL, Fartasch M, Drexler H, Schmitt J. Occupational skin cancer induced by ultraviolet radiation and its prevention. Br J Dermatol 2012;167 Suppl 2:76–84. [DOI] [PubMed] [Google Scholar]
- 5.Marlenga B The health beliefs and skin cancer prevention practices of Wisconsin dairy farmers. Oncol Nurs Forum 1995;22(4):681–686. [PubMed] [Google Scholar]
- 6.Vishvakarman D, Wong JC. Description of the use of a risk estimation model to assess the increased risk of non-melanoma skin cancer among outdoor workers in Central Queensland, Australia. Photodermatol, Photoimmunol Photomed 2003;19(2):81–88. [DOI] [PubMed] [Google Scholar]
- 7.Surdu S, Fitzgerald EF, Bloom MS, et al. Occupational exposure to ultraviolet radiation and risk of non-melanoma skin cancer in a multinational European study. PLoS ONE 2013;8(4):e62359. doi: 10.1371/journal.pone.0062359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Marehbian J, Colt JS, Baris D, et al. Occupational and keratinocyte cancer risk: a population based case-control study. Cancer Causes Control 2007;18(8):895–908. [DOI] [PubMed] [Google Scholar]
- 9.Fartasch M, Diepgen TL, Schmitt J, Drexler H. The relationship between occupational sun exposure and non-melanoma skin cancer: clinical basics, epidemiology, occupational disease evaluation, and prevention. Dtsch Ärztebl Int 2012;109(43):715. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lichte V, Dennenmoser B, Dietz K, et al. Professional risk for skin cancer development in male mountain guides--a cross-sectional study. J Eur Acad Dermatol Venereol 2010;24(7):797–804. [DOI] [PubMed] [Google Scholar]
- 11.Bauer A, Diepgen TL, Schmitt J. Is occupational solar ultraviolet irradiation a relevant risk factor for basal cell carcinoma? A systematic review and meta-analysis of the epidemiological literature. Br J Dermatol 2011;165(3):612–625. [DOI] [PubMed] [Google Scholar]
- 12.MacKie RM, Aitchison T. Severe sunburn and subsequent risk of primary cutaneous malignant melanoma in Scotland. Br J Cancer 1982;46(6):955–960. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Goodman KJ, Bible ML, London S, Mack TM. Proportional melanoma incidence and occupation among white males in Los Angeles County (California, United States). Cancer Causes Control 1995;6(5):451–459. [DOI] [PubMed] [Google Scholar]
- 14.Walter SD, King WD, Marrett LD. Association of cutaneous malignant melanoma with intermittent exposure to ultraviolet radiation: results of a case-control study in Ontario, Canada. Int J Epidemiol 1999;28(3):418–427. [DOI] [PubMed] [Google Scholar]
- 15.Green A, Battistutta D, Hart V, Leslie D, Weedon D. Skin cancer in a subtropical Australian population: incidence and lack of association with occupation. The Nambour Study Group. Am J Epidemiol 1996;144(11):1034–1040. [DOI] [PubMed] [Google Scholar]
- 16.Stepanski BM, Mayer JA. Solar protection behaviors among outdoor workers. J Occup Environ Med 1998;40(1):43–48. [DOI] [PubMed] [Google Scholar]
- 17.Parrott R, Steiner C, Goldenhar L. Georgia’s harvesting healthy habits: a formative evaluation. J Rural Health 1996;12(4 Suppl):291–300. [DOI] [PubMed] [Google Scholar]
- 18.Rosenman KD, Gardiner J, Swanson GM, Mullan P, Zhu Z. Use of skin-cancer prevention strategies among farmers and their spouses. Am J Prev Med 1995;11(5):342–347. [PubMed] [Google Scholar]
- 19.Lewis KG, Weinstock MA, Weaver AL, Otley CC. Adjuvant local irradiation for Merkel cell carcinoma. Arch Dermatol 2006;142(6):693–700. [DOI] [PubMed] [Google Scholar]
- 20.Pichon LC, Mayer JA, Slymen DJ, Elder JP, Lewis EC, Galindo GR. Ethnoracial differences among outdoor workers in key sun-safety behaviors. Am J Prev Med 2005;28(4):374–378. [DOI] [PubMed] [Google Scholar]
- 21.Salas R, Mayer JA, Hoerster KD. Sun-protective behaviors of California farmworkers. J Occup Environ Med 2005;47(12):1244–1249. [DOI] [PubMed] [Google Scholar]
- 22.Duffy SA, Choi SH, Hollern R, Ronis DL. Factors associated with risky sun exposure behaviors among operating engineers. Am J Ind Med 2012;55(9):786–792. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.The Cancer Council of New South Wales, Union Safe; The Cancer Council of New South Wales and Union Safe. Sun safety at work: policy on protection from ultraviolet radiation for outdoor workers Sydney: The Cancer Council of New South Wales and Union Safe; 2008. [Google Scholar]
- 24.The Cancer Council of Victoria. Skin cancer and outdoor work: a guide for employers. 2007 Carelton South, VIC, Australia: The Cancer Council of Victoria; 2007. [Google Scholar]
- 25.The Cancer Council of Australia; The Cancer Council of Australia. Position statement: sun protection in the workplace Canberra, ACT, Australia: The Cancer Council of Austrlia; December 2005. [Google Scholar]
- 26.Alberta Cancer Board, Alberta Cancer Foundation; Alberta Cancer Board and Alberta Cancer Foundation. Sunright: Sun Safety Policy Guide for Outdoor Workers Calgary, AB, Canada: Alberta Cancer Board and Alberta Cancer Foundation; 2004. [Google Scholar]
- 27.Canadian Centre for Occupational Health and Safety. Skin cancer and sunlight Ottawa, ON, Canada: Canadian Centre for Occupational Health and Safety; 2008. [Google Scholar]
- 28.Treasury Board of Canada Secretariat. Occupational health and safety directive: part XII, personal and protective equipment and clothing Ottawa, ON, Canada: Treasury Board of Canada Secretariat; National Joint Council; 2008. [Google Scholar]
- 29.Workers Compensation Board of Prince Edward Island. WCB and the Canadian Cancer Society issue sun safety message for workers Charlottetown, PE, Canada: Government of Prince Edward Island, Workers Compensation Board; 2008 [Google Scholar]
- 30.California Department of Public Health. Outdoor-based business: sun protection policy guidelines Sacramento: California Department of Public Health and the Skin Cancer Prevention Program; 2008. [Google Scholar]
- 31.California Department of Public Health. Sun safety: what outdoor-based employees should know Sacramento: California Department of Public Health, Skin Cancer Prevention Program; 2008. [Google Scholar]
- 32.Safety Occupational & Administration Health. Protecting yourself in the sun Washington, D.C.: Occupational Safety and Health Administration;2003. OSHA 3166–06R. [Google Scholar]
- 33.Hymel PA, Loeppke RR, Baase CM, et al. Workplace health protection and promotion: a new pathway for a healthier- and safer- workforce. J Occup Environl Med 2011;53(6):695–702. [DOI] [PubMed] [Google Scholar]
- 34.Bauer JE, Hyland A, Quiang L, Steger C, Cummings KM. A longitudinal assessment of the impact of smoke-free worksite policies on tobacco use. Am J Public Health 2005;95(6):1024–1029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Fichtenberg CM, Glantz SA. Effect of smoke-free workplaces on smoking behaviour: systematic review. BMJ 2002;325(7357):188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Moskowitz JM, Lin Z, Hudes ES. The impact of workplace smoking ordinances in California on smoking cessation. Am J Public Health 2000;90(5):757–761. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Shelley D, Yerneni R, Hung D, Das D, Fahs M. The relative effect of household and workplace smoking restriction on health status among Chinese Americans living in New York City. J Urban Health 2007;84(3):360–371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Green LW, Orleans CT, Ottoson JM, Cameron R, Pierce J, Bettinghaus EP. Inferring strategies for disseminating physical activity policies, programs, and practices from the successes of tobacco control. Am J Prev Med 2004;31(4):66–81. [DOI] [PubMed] [Google Scholar]
- 39.Engbers LH, van Poppel MN, Chin A Paw MJ, van Mechelen W. Worksite health promotion programs with environmental changes: a systematic review. Am J Prev Med 2005;29(1):61–70. [DOI] [PubMed] [Google Scholar]
- 40.Kahn EB, Ramsey LT, Brownson RC, et al. The effectiveness of interventions to increase physical activity. A systematic review. Am J Prev Med 2002;22(4 Suppl):73–107. [DOI] [PubMed] [Google Scholar]
- 41.Zaza S, Briss PA, Harris KW, et al. The Guide to Community Preventive Services: What Works to Promote Health? New York, NY: Oxford University Press; 2005. [Google Scholar]
- 42.Sallis J, Owen N. Ecological models of health behavior. In: Glanz K, Lewis FM, Rimer BK, eds. Health Behavior and Health Education: Theory, Research and Practice San Francisco, CA: Jossey-Bass; 1997:406–424. [Google Scholar]
- 43.Glanz K, Buller DB, Saraiya M. Reducing ultraviolet radiation exposure among outdoor workers: state of the evidence and recommendations. Environ Health 2007;6(1):22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Walkosz BJ, Buller DB, Andersen PA, Scott MD, Cutter GR. The sustainability of an occupational skin cancer prevention program. J Occup Environ Med 2015;57(11):1207–1213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Rye S, Janda M, Stoneham M, et al. Changes in outdoor workers’ sun-related attitudes, beliefs, and behaviors: a pre-post workplace intervention. J Occup Environ Med 2014;56(9):e62–e72. doi: 10.1097/JOM.0000000000000244. [DOI] [PubMed] [Google Scholar]
- 46.Horsham C, Auster J, Sendall MC, et al. Interventions to decrease skin cancer in outdoor workers: update to 2007 systematic review. BMC Res Notes 2014;7:10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Buller DB, Andersen PA, Walkosz BJ, et al. Randomized trial testing a worksite sun protection program in an outdoor recreation industry. Health Educ Behav 2005;32(4):514–535. [DOI] [PubMed] [Google Scholar]
- 48.Hall DM, McCarty F, Elliott T, Glanz K. Lifeguards’ sun protection habits and sunburns: association with sun-safe environments and skin cancer prevention program participation. Arch Dermatol 2009;145(2):139–144. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Reinau D, Weiss M, Meier CR, Diepgen TL, Surber C. Outdoor workers’ sun-related knowledge, attitudes and protective behaviours: a systematic review of cross-sectional and interventional studies. Br J Dermatol 2013;168(5):928–940. [DOI] [PubMed] [Google Scholar]
- 50.Andersen PA, Buller DB, Voeks JH, et al. Testing the long term effects of the Go Sun Smart worksite sun protection program: a group-randomized experimental study. J Commun 2008;58(3):447–471. [Google Scholar]
- 51.Buller DB, Walkosz BJ, Andersen PA, Scott MD, Cutter GR. Sustained use of an occupational sun safety program in a recreation industry: follow-up to a randomized trial on dissemination strategies. Transl Behav Med 2015;5(4):361–371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Buller DB, Andersen PA, Walkosz BJ, et al. Enhancing industry-based dissemination of an occupational sun protection program with theory-based strategies employing personal contact. Am J Health Promot 2012;26(6):356–365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Hammond V, Reeder AI, Gray AR, Bell ML. Are workers or their workplaces the key to occupational sun protection? Health Promot J Austr 2008;19(2):97–101. [DOI] [PubMed] [Google Scholar]
- 54.Woolley T, Lowe J, Raasch B, Glasby M, Buettner PG. Workplace sun protection policies and employees’ sun-related skin damage. Am J Health Behav 2008;32(2):201–208. [DOI] [PubMed] [Google Scholar]
- 55.Walkosz BJ, Buller DB, Andersen PA, Wallis A, Buller MK, Scott MD. Factors associated with occupational sun-protection policies in local government organizations in Colorado. JAMA Dermatol 2015;151(9):991–997.Pmc4565754 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.MacDonald M, Pauly B, Wong G, et al. Supporting successful implementation of public health interventions: protocol for a realist synthesis. Syst Rev 2016;5:54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Buller DB, Walkosz BJ, Buller MK, et al. Results of a randomized trial on an intervention promoting adoption of occupational sun protection policies. Am J Health Promot 2018;32(4):1042–1053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Walkosz BJ, Buller DB, Buller MK, et al. Sun safe workplaces: Effect of an occupational skin cancer prevention program on employee sun safety practices. J Occup Environ Med In press [DOI] [PMC free article] [PubMed]
- 59.Rogers EM. Diffusion of Innovations 5th ed. New York, NY: Free Press; 2003. [Google Scholar]
- 60.Taylor DA, Altman I. Communication in interpersonal relationships: social penetration processes. In: Roloff ME, Miller GR, eds. Interpersonal Processes: New Directions in Communication Research Vol 14 Thousand Oaks, CA: Sage Publications, Inc; 1987:257–277. [Google Scholar]
- 61.Scott MD, Powers WG. Interpersonal Communication: A Question of Needs Boston, MA: Houghton Mifflin; 1978. [Google Scholar]
- 62.Dutton JE, Ashford SJ, O’Neill RM, Lawrence KA. Moves that matter: issue selling and organizational change. Acad Manag J 2001;44(4):716–736. [Google Scholar]
- 63.Kramer MW. Uncertainty Reduction: Managing Uncertainty in Organizational Communication Philadelphia, PA: Lawrence Erlbaum; 2004. [Google Scholar]
- 64.Cialdini RB. Influence: Science and Practice New York: Harper Collier; 1988. [Google Scholar]
- 65.Bandura A Social Foundations of Thought and Action: A Social Cognitive Theory Englewood Cliffs NJ: Prentice Hall; 1986. [Google Scholar]
- 66.Schröer S, Haupt J, Pieper C. Evidence-based lifestyle interventions in the workplace--an overview. Occup Med (Lond) 2014;64(1):8–12. [DOI] [PubMed] [Google Scholar]
- 67.Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci 2013;8:117. doi: 10.1186/1748-5908-8-117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Frieden TR. Six components necessary for effective public health program implementation. Am J Public Health 2014;104(1):17–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Neta G, Glasgow RE, Grimshaw JM, Rabin BA, Fernandez ME, Brownson RC. A framework for enhancing the value of research for dissemination and implementation. Am J Public Health 2015;105(1):49–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health 2011;101(11):2059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Correa-Fernandez V, Wilson WT, Shedrick DA, et al. Implementation of a tobacco-free workplace program at a local mental health authority. Transll Behav Med 2017;7(2):204–211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.White JC, Hartley S, Ozminkowski RJ. Association between corporate wellness program participation and changes in health risks. J Occup Environ Med 2015;57(10):1119–1126. [DOI] [PubMed] [Google Scholar]
- 73.Goetzel RZ, Shechter D, Ozminkowski RJ, Marmet PF, Tabrizi MJ, Roemer EC. Promising practices in employer health and productivity management efforts: findings from a benchmarking study. J Occup Environ Med 2007;49(2):111–130. [DOI] [PubMed] [Google Scholar]
- 74.Hartwell TD, Steele P, French MT, Potter FJ, Rodman NF, Zarkin GA. Aiding troubled employees: the prevalence, cost, and characteristics of employee assistance programs in the United States. Am J Public Health 1996;86(6):804–808. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Stokols D, Pelletier KR, Fielding JE. The ecology of work and health: research and policy directions for the promotion of employee health. Health Educ Q 1996;23(2):137–158. [DOI] [PubMed] [Google Scholar]
- 76.van Scheppingen AR, de Vroome EM, ten Have KC, Zwetsloot GI, Bos EH, van Mechelen W. Motivations for health and their associations with lifestyle, work style, health, vitality, and employee productivity. J Occup Environ Med 2014;56(5):540–546. [DOI] [PubMed] [Google Scholar]
- 77.Holden SH, Norris DF, Fletcher PD. Electronic government at the local level: progress to date and future issues. Public Perform Manag Rev 2003:325–344.
- 78.Moon MJ. The evolution of e-government among municipalities: rhetoric or reality? Public Admin Rev 2002;62(4):424–433. [Google Scholar]
- 79.Smith AC, Taebel DA. Administrative innovation in municipal government. Int J Public Admin 1985;7(2):149–177. [Google Scholar]
- 80.Kimberly JR. Organizational size and the structuralist perspective: a review, critique, and proposal. Admin Sci Q 1976:571–597.
- 81.Agnew JA, Brown LA, Herr P. The community innovation process: a conceptual and empirical analysis. Urban Affairs Rev 1979;14(1):13–30. [Google Scholar]
- 82.Mohr LB. Determinants of innovation in organizations. Am Political Sci Rev 1969;63(1):111–126. [Google Scholar]
- 83.Wallis A, Andersen PA, Buller DB, et al. Adoption of sun safe workplace practices by local governments. J Public Health Manag Pract 2014;20(6):608–616. doi: 10.1097/phh.0000000000000026.PMC4019714 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Bingham RD, McNaught TP. The Adoption Of Innovation By Local Government Lexington, Mass: Lexington Books; 1976. [Google Scholar]
- 85.Bracken CC, Jeffres LW, Neuendorf KA, Kopfman J, Moulla F. How cosmopolites react to messages: America under attack. Commun Res Rep 2005;22(1):47–58. [Google Scholar]
- 86.Needham RD. The cosmopolite-localite model: newspaper types and natural hazard information potentials. Environ Manag 1986;10(2):271–284. [Google Scholar]
- 87.Jeffres LW. The communicative city: conceptualizing, operationalizing, and policy making. J Planning Literature 2010;25(2):99–110. [Google Scholar]
- 88.Reddick CG. The adoption of centralized customer service systems: a survey of local governments. Government Information Q 2009;26(1):219–226. [Google Scholar]
- 89.Hage J, Aiken M. Program change and organizational properties a comparative analysis. Am J Sociol 1967:503–519. [DOI] [PubMed]
- 90.Ioannidis JP. Why most published research findings are false. PLoS Med 2005;2(8):e124. doi: 10.1371/journal.pmed.0020124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Ioannidis JPA. The proposal to lower p value thresholds to .005. JAMA 2018. April 10;319(14):1429–1430. [DOI] [PubMed] [Google Scholar]
- 92.Benjamin DJ, Berger JO, Johannesson M, et al. Redefine statistical significance. Nature Human Behav 2018;2(1):6–10. [DOI] [PubMed] [Google Scholar]
- 93.Lakens D, Adolfi FG, Albers CJ, et al. Justify your alpha. Nature Human Behav 2018;2(3):168–171. [Google Scholar]

