Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2013 Jul 1.
Published in final edited form as: Am J Health Promot. 2012 Jul;26(6):356–365. doi: 10.4278/ajhp.110113-QUAN-22

Enhancing Industry-based Dissemination of an Occupational Sun Protection Program with Theory-based Strategies Employing Personal Contact

David B Buller 1, Peter A Andersen 2, Barbara J Walkosz 3, Michael D Scott 4, Gary R Cutter 5, Mark B Dignan 6, Ilima L Kane 7, Xiao Zhang 8
PMCID: PMC3390757  NIHMSID: NIHMS377113  PMID: 22747318

Abstract

Purpose

Industry-based strategies for dissemination of an evidence-based occupational sun protection program, Go Sun Smart (GSS), were tested.

Design

Two dissemination strategies were compared in a randomized trial in 2004 – 2007.

Setting

The North American ski industry.

Subjects

Ski areas in the United States and Canada (n=69) and their senior managers (n=469).

Intervention

Employers received GSS through a Basic Dissemination Strategy (BDS) from the industry’s professional association which included conference presentations and free starter kits. Half of the areas also received the Enhanced Dissemination Strategy (EDS), in which project staff met face-to-face with managers and made ongoing contacts to support program use.

Measures

Observation of program materials in use and managers’ reports on communication about sun protection.

Analysis

The effects of two alternative dissemination strategies were compared on program use using PROC MIXED in SAS, adjusted for covariates using 1-tailed p-values.

Results

Ski areas receiving the EDS used more GSS materials (M=7.36) than those receiving the BDS (M=5.17; F=7.82, p<.01). Managers from more areas receiving the EDS reported communicating about sun protection in employee newsletters/flyers (M=0.97, p=.04), in guest email messages (M=0.75, p=.02), and on ski area websites (M=0.38, p=.02) than those receiving the BDS (M=0.84, 0.50, 0.15, respectively).

Conclusion

Industry professional associations play an important role in disseminating prevention programs; however, active personal communication may be essential to ensure increased implementation fidelity.

Keywords: sun protection, dissemination, implementation, occupational

Purpose

Outdoor workers constitute a large group that can benefit from sun protection to prevent melanoma and non-melanoma skin cancer (NMSC) caused by solar ultraviolet radiation (UV).1 Career outdoor workers, many with vulnerable fair skin,1,2 receive excessive doses of UV38 over their worklife.8,9 Reducing chronic UV exposure through sun protection is critical for reducing NMSC1015 and probably melanoma.10,16,17

Go Sun Smart (GSS)18 is an occupational sun protection program developed in collaboration with the North American ski industry, whose employees receive substantial UV exposure.19 It contained signage (posters and signs for indoor and outdoor use) and brochures, a training program, and short messages for use in communication with employees (e.g., in newsletters). In a randomized controlled effectiveness trial, GSS significantly reduced sunburning among employees in the short term and improved sun protection over the longer term.20,21 GSS also benefited guests (both adults and children) while skiing and snowboarding.2224

Safety and health programs, like GSS, are often distributed to individual ski areas through their membership in industry professional associations such as the National Ski Areas Association (NSAA). In this study, we were interested in comparing the basic industry-based dissemination strategy (BDS) to an active, enhanced dissemination strategy (EDS) based primarily on Diffusion of Innovation Theory (DIT) in which the program was distributed free of charge to employers. In DIT, it is posited that organizational diffusion has two phases – adoption and implementation 25. Adoption includes agenda-setting (recognition of a problem and search for innovations to solve it), matching (evaluating fit between problem and innovation), and adoption decision. Once the adoption decision occurs, organizations engage in the stages of redefining/restructuring (adapting the innovation or changing the organization to improve the innovation’s fit), clarifying (communicating changes to employees), and routinizing (making innovation part of organization’s regular activities, i.e., institutionalizing it). Through organized efforts, external change agents have successfully promoted adoption of disease prevention programs to diverse organizations 25.

To enhance adoption and implementation, active strategies by program purveyors are needed to maximize program use when health and safety programs from external sources such as industry associations or research groups are distributed.2628 Because such programs are often loosely-bundled and give wide discretion in implementation and program adjustment,25,2931 managers may find it irresistible to adopt only some or partial program components to conform to the organization’s needs, context, and culture.3035 Active strategies (such as in-person visits, recommendations and training for program implementation, and periodic reminders) can enhance program fidelity and implementation and reduce re-invention or the reconstruction of the program by organizations. This approach is particularly relevant for GSS, since the effectiveness trial revealed that higher program use was associated with greater employee sun protection.20 In this paper, the primary findings from the dissemination trial regarding GSS adoption and implementation are presented.

Methods

Intervention

Go Sun Smart Program

GSS was prepared for dissemination through review of intervention items by the authors based on the effectiveness trial. The goal was to distribute GSS materials with a level of clarity and feasibility that would forestall the need to alter GSS during implementation.27,36,37 This review was performed using a Delphi Method,38,39 in which program items were rated on scales assessing graphic design, message, impact, and ease of use. Items with mean scores less than 5.0 (out of 10) on all of these items were eliminated and 23 program items were selected for distribution: large and small posters, small decals, magnets, outdoor signage, signage for ski/snowboard schools, brochures for employees and guests, a training program for use by managers with their work groups, newsletter articles, brief messages for use in email, grooming reports, and other ski area communication. All materials carried the GSS logo.

Dissemination Strategies

Two dissemination strategies were compared. First, the BDS, used by NSAA to distribute safety programs to its members, was applied to all member ski areas and served as the comparison condition. NSAA designated GSS as an industry “partner program” and it was promoted at informational booths at annual and regional NSAA trade shows (provided free of charge by NSAA), where project staff displayed sample GSS messages and distributed promotional materials, including magnets, lip balm, and post-it notes with the GSS logo and a 1-page informational tip sheet (see below). All ski areas received, free of cost, two starter kits of selected program materials each year over three years (6 free starter kits in total). NSAA and the project shared the cost of mailing the starter kits. In Year 1, ski areas received 9 posters (3 posters-3 ea.), 3 static clings, 3 base stake signs, 1 employee training CD-ROM, 1 CD-ROM with newsletters and other messaging recommendations, and 100 employee risk brochures. Year 2 starter kits included 12 posters (4 posters – 3 ea.), 3 base stake signs, 1 set of training CD-ROMs, 100 guest brochures, and 1 updated newsletter CD-ROM. In Year 3, 12 posters (4 posters-3ea), 3 static clings, 3 base stake signs, and 100 ski school brochures were distributed. All resorts, regardless of size, received the same amount of items. In addition to program materials, the first kit each year (at beginning of ski season in October/November) contained a letter from the senior author and NSAA President, a GSS Guidebook, and a catalog of GSS materials (also available the NSAA website). The second kit, mailed in January, contained 1-page informational tip sheets (also distributed at trade shows) based on DIT principles and providing advice on implementation, addressing barriers, highlighting program success, and emphasizing leadership for sun safety. All starter kits contained a packing list, describing intended use of the included program items. If managers wanted more GSS materials, they could order them from NSAA for only the price of printing them.

Second, the EDS augmented the BDS with largely face-to-face contact between project staff and ski areas’ senior managers. It was intended to maximize program adoption and use, based on well-documented principles deduced from DIT,25 literature on dissemination of prevention programs,26 and experience gained from the effectiveness trial. The enhanced strategies included one personal visit to each ski areas during November through January by project staff. In meetings and presentations, project staff (1) attempted to reduce managers’ uncertainty about GSS by noting the need for sun safety, reviewing its effectiveness, and describing how well it fit into extant ski area operations;25,40,41 (2) highlighted endorsements by industry professional associations to build credibility for GSS and program staff;42,43 (3) coached managers in skills for overcoming organizational barriers and resistance from coworkers to enhance public commitment from the managers responsible for using GSS;4446 and (4) recruited internal champions to leverage support for GSS based on champions’ interest in health and safety, tenure at the ski area, and/or ability to “get things done” (a few had a personal history of skin cancer).25,47 Project staff personally met with the manager responsible for GSS and/or CEO, made a presentation to senior managers, met individually with other managers as needed, and introduced GSS to groups of employees if requested (project staff only announced the program; managers were responsible for delivering sun protection education). A small number of the promotional materials including hats, magnets, lip balm, and post-it notes with the program logo were distributed to managers, which were intended to boost managers’ commitment and remind them to use GSS. These items were not used to promote sun safety to employees and were not included as part of the program evaluation. Finally, (5) follow-up contacts by telephone and email with the responsible manager were made at least once a month through March designed to maintain commitment to GSS, support its use, and nourish interpersonal relationships between staff and managers.48,49

Design

All ski areas in the NSAA membership received GSS through the BDS. The BDS began in May 2004 at the annual NSAA conference, where the NSAA President announced GSS as the newest partner program. Booths featured GSS at the annual national and the mid-year regional tradeshows in 2004, 2005, and 2006. Free GSS starter kits were mailed to the entire NSAA membership during the 2004–05, 2005–06, and 2006–07 ski seasons (two starter kits per season).

Beginning in 2004, ski areas were recruited to participate in the randomized trial comparing the BDS and EDS. Ultimately 69 ski areas were enrolled in the trial in three waves over three ski seasons (n=28 ski areas in 2004–05, 20 in 2005–06, and 21 in 2006–07). In each wave, the EDS began in October or November at half of the ski areas in the trial (n=33 ski areas; 12 in 2004, 11 in 2005 and 10 in 2006), randomly assigned by the project statistician after pretesting. The EDS ended in April of each year, when the ski areas closed. Thus, half of the ski areas in the trial received the BDS plus EDS and the other half, the BDS only.

Both on-site observations and surveys were performed assessing GSS use in the ski season when the ski areas were enrolled in the trial (ski areas enrolled in 2004–05 were observed in 2005 and managers were surveyed in 2004 and 2005 at the start and end of the season; those enrolled in 2005–06 were observed in 2006 and surveyed in 2005 and 2006; those enrolled in 2006–07 were observed in 2007 and surveyed in 2006 and 2007). Surveys of employees, guests, and parents were performed and will be reported elsewhere. Senior managers completed a pretest survey in October – December and pretested managers were posttested in March – April. Survey invitations indicated that the chief executive officer (CEO) had agreed to have the ski area participate, participation was voluntary and confidential, and that managers could decline without harm. Surveys were performed online. In all years, non-respondents in both the BDS group and the EDS group were followed-up by telephone and in the third year, with mailed surveys. To increase posttest response, a $5 gift card was included in the second and third years. Managers provided implied consent by completing the pretest survey. Posttest only observational procedures were conducted by trained project staff visiting each ski area once between February and April. All procedures were approved by the Institutional Review Boards of the authors’ research firm and universities.

Sample

Worksites were recruited from NSAA member ski areas. Eligible ski areas were defined as those with a) two or more aerial chair lifts with ride times of at least five minutes (to interview guests); b) 100 or more employees (to survey at least 50 employees); c) summit elevation of 2500 feet or higher (to have increased UV levels); and d) a full-time general manager or equivalent (for recruitment). Ski areas in the previous effectiveness trial were ineligible. A total of 129 ski areas in 24 U.S. states and 4 Canadian provinces were eligible. An invitation letter signed by the senior author and President of NSAA was sent to each manager listed as the “NSAA contact” (usually the CEO) in August and investigators completed recruitment by telephone. Reasons for not enrolling were lack of time and interest or failure to be reached. A final sample of 69 ski areas (53%; n=28 in 2004, 20 in 2005, and 21 in 2006) enrolled (see Figure 1).

Figure 1.

Figure 1

CONSORT diagram for trial

The NSAA contact at each ski area provided a list of senior managers responsible for area operations, workplace policies and work procedures (e.g., human resources, risk management, ski and snowboard school, ski patrol, mountain host, lift operations, mountain operations, marketing, lift maintenance, and base operations), and designated a manager to be responsible for implementing GSS. Senior managers (n=664) were contacted by mail and invited to complete baseline and follow-up surveys online in October – December and March – April, respectively. Managers who did not respond online were contacted by telephone or mail to complete the survey.

Measures

Observation of Use of Go Sun Smart

The primary outcome variable was a measure of the use of GSS collected through on-site observations by trained project staff, using a protocol from the effectiveness trial.20 Each ski area was visited over two days and all printed GSS materials on display (i.e., 15 posters/signs, 3 brochures, 2 static clings and 1 logo magnet) and any other sun protection messages (e.g., commercial advertising) were recorded. Staff searched in all locations, including locations accessible only to employees (e.g., administrative offices, locker rooms, garages, chair lift shacks, ski patrol rooms). Staff noted where each item was located and whether it was in an employee-only area.

Two scores were calculated. A dichotomous measure of adoption was based on whether any GSS items were in use or not (yes v. no). All but four ski areas had adopted GSS (2 in EDS and 2 in BDS), so this measure was not analyzed. Instead, the primary outcome measure was the extent of use, i.e., number of GSS items observed (observed range=0 to 26 items).

The observational measure was validated in the 2005–06 ski season by having independent trained observers visit 14 ski areas unannounced, one week prior to the scheduled observation. There was high correspondence between project staff and the unannounced observer assessments on the number of materials in use (r=0.87, p<.05; discrepancies ranged from +2 to −2, F=0.44, p=.52, staff mean=3.8, observer mean=4.6), confirming the validity of the project staff’s observations.

Go Sun Smart Use Measured in Manager Surveys

The posttest surveys of managers included items assessing elements of program use that were difficult to observe. Managers were asked if they had communicated with employees about sun protection by publishing a message in employee newsletter, sending an email message, linking the GSS website to the ski area’s website, or providing training or if they had communicated with guests about sun protection by publishing a message in a snow or grooming report, guest newsletter, flyer, whiteboard or electronic sign or sending a message by email or on the resort website (yes/no/don’t remember). Managers’ reports were validated by correlation with employees’ reports of receiving sun protection messages at posttest (Table 1). That all correlations were positive suggested some degree of validity to managers’ reports. However, the correlations varied from moderate to small and not all reached statistical significance. These findings may reflect variability with which each type of communication occurred and in employee’s exposure to different workplace channels.

Table 1.

Spearman Rank correlation of manager’s reported use of Go Sun Smart with employee recall of receiving messages on sun protection on the job (n=65 ski areas)

Employee Recall of Sun Protection Message
Managers Reported Use of GSS: Written Spoken Electronic Training
Placed article in newsletter or flyer 0.19 0.03 0.36 0.23*
Sent message by email 0.23* 0.11 0.48 0.29
Provided training 0.20 0.44 0.13 0.52
*

p<.10

p<.05

p<.01

Process Measures on Enhanced Dissemination Strategy

Project staff completed a checklist assessing fidelity of dissemination activities during the in-person visits. They recorded number of meetings (with whom, duration, and topics), distribution and review of materials, managers’ enthusiasm for GSS and willingness to implement and verbally support it, project staff’s effectiveness, presence of internal champions, and meetings with employees.

Measures of Potential Covariates

Ski area characteristics were provided by the senior manager at the time of enrollment (see Table 2). Also, the mean number of hours of sunshine at each of the ski areas was obtained by consulting maps prepared by the National Weather Service. These variables were used as potential covariates in the comparison of BDS and EDS.

Table 2.

Characteristics of participating ski areas (n=68)

Characteristic Total % BDS % EDS %

Region (states):
 North West (Idaho, Oregon, Washington, and British Columbia; n=9) 13 7 6
 West (California; n=8) 12 6 6
 Northern Rocky Mountains (Montana, South Dakota, Wyoming, and Alberta; n=6) 8 1 7
 South West (Arizona, Colorado, New Mexico, and Utah; n=20) 30 15 15
 North East (Maine, Maryland, New Hampshire, New York, Pennsylvania, and Vermont; n=19) 28 16 12
 South East (North Carolina, Virginia, and West Virginia; n=6) 9 3 6

Ski Area Size (number of employees):
 Less than 250 (n=22) 33 15 18
 250–499 (n=26) 38 22 16
 500–999 (n=15) 22 7 15
 1000 or more (n=5) 8 4 3

Percentage of Females in Key Manager Positions:
 0–24% (n=32) 48 48 49
 25–49% (n=30) 45 46 42
 50% or more (n=5) 7 6 9

Ownership Type:
 Individual Privately Owned Ski Area (n=52) 76 38 38
 Multi-resort Corporate Ownership (n=16) 24 10 13

Analysis

The overall goal of the analysis was to compare the GSS use measures between the BDS and EDS from the ski areas that completed follow-up assessments. Analyses were conducted using Proc Mixed in SAS. Since only one ski area was lost to follow-up due to lack of snow, non-response bias was considered minimal and intent-to-treat analyses and imputation for the one missing ski area were not done. There were no missing data in the observational measure, beyond the one ski area that was lost. Managers’ reports of use of GSS from the posttest surveys were compared between conditions adjusting for clustering within ski area, using responses collected from managers successfully followed up (i.e., no imputation was made for missing values), as this was a secondary measure. Finally, backwards stepwise regression was used to explore the influence of various aspects of the EDS (from process measurement) on program use.

Initially, BDS and EDS were compared without adjustments for year or any potential covariates. Next, a mixed-model analysis was performed with two between-subjects factors – dissemination strategy (EDS v. BDS) and year of participation (Year 1 v. 2 v. 3). No interactions between dissemination strategy and year were statistically significant so the reduced model was used for the remaining analyses. Three covariates were included that demonstrated large univariate relationships with GSS use, i.e., number of employees in the ski area (a measure of size), proportion of female senior managers, and mean annual number of hours of sunshine obtained from the National Oceanic and Atmospheric Administration.50 The comparison between conditions was performed using a 1-tailed p-value of 0.05.

The sample size was planned using a 1-tailed test. While 1-tailed tests are not standard, we planned and tested a directional hypothesis that that EDS would be superior to BDS. We opted not to plan on interpreting any results indicative of the inferiority of EDS because failure to reject the null hypothesis in the 1-tailed test would lead to the same recommendation as in a 2-tailed test: recommend employing the BDS. Also, the 1-tailed test helped to control project costs by reducing the number of ski areas that needed to be enrolled, treated, and assessed.

Results

Profile of Participating Ski Areas

Table 2 describes the characteristics of the participating ski areas. They were located in all regions except Midwestern United States and eastern Canada (due to low summit elevations) and ranged from 200 to over 1000 employees. Most were privately owned. Four ski areas did not complete the trial in their initial year due to lack of snow, but continued the next year when on-site observations and manager posttests occurred. Only one ski area dropped out completely due to lack of snow (Figure 1).

Profile of Participating Managers

Of the 469 managers (226 at EDS and 243 at BDS areas) who completed the pretest (response rate=72%; 72% EDS, 69% BDS), 334 completed the posttest (171 in EDS and 163 in BDS; follow-up rate=71%; 74% EDS, 66% BDS) (Figure 1) and reported on their use of GSS. Most managers were middle aged, educated beyond high school, male, and non-Hispanic White (the ethnic group with the highest risk for developing skin cancer16,51). Most managers also had a long history of working in the ski areas (10 years or more) and worked outdoors, with a third experiencing a sunburn and 10% having a history of skin cancer (Table 3).

Table 3.

Profile of sample of participating managers at pretest (n=469)

Characteristics Total % BDS % EDS %

Age (Mean = 45.1, Std dev = 10.2):
 18–24 1.3 0.8 1.8
 25–34 14.9 18.3 11.4
 35–44 26.8 28.1 25.4
 45–54 40.0 40.0 39.9
 55–64 15.1 11.9 18.4
 65 or older 1.9 0.9 3.1

Education:
 High school graduate or less 9.0 8.4 9.7
 Trade, technical, or vocational education beyond high school or some college 31.4 30.8 32.0
 College graduate or postgraduate degree 59.6 60.8 58.3

Hispanic Ethnicity:
 Not Hispanic/Latino 97.4 97.4 97.4
 Hispanic/Latino 2.6 2.6 2.6

Race:
 Other or Mixed Race 3.6 3.8 3.5
 White 96.4 96.2 96.5

Gender:
 Male 74.2 75.1 73.2
 Female 25.8 24.9 26.8

Years Working in Ski Industry:
 1 year or less 1.7 1.7 1.7
 2–3 years 3.6 5.0 2.2
 4–10 years 20.1 18.9 21.3
 11 or more years 74.6 74.4 74.8

Work Environment:
 Mostly indoors 37.1 37.9 36.3
 Mostly outdoors or equal indoors and outdoors 62.9 62.1 63.7

History of Skin Cancer:
 No 90.2 90.3 90.0
 Yes 9.8 9.7 10.0

Number of Sunburns in Previous Ski Season (Mean = 1.6; Std dev = 3.3):
 None 54.7 54.7 54.8
 1 15 13.8 16.2
 2–5 24.1 25.5 22.6
 6–10 4.2 5.2 3.2
 More than 10 2.0 0.8 3.2

Comparison of Observed Program Use by Dissemination Strategy

Ski areas randomized to receive the EDS had more use of GSS (unadjusted M=7.36 GSS items in use, sd=5.58) compared to ski areas in the BDS condition (unadjusted M=5.17 GSS items in use, sd=4.67), Z=1.78, p=.04 (1-tailed, unadjusted), F=7.82, p<.0001 (1-tailed, adjusted for year of participation, number of employees, ratio of female to male senior managers, and mean annual number of hours of sunshine) (Figure 2). Number of employees (Spearman Rank r=0.25, p=0.04), ratio of female to male managers (r=0.29, p=0.02), and mean number of hours of sunshine (r=0.26, p=0.03) had moderate positive associations with use of GSS (r=0.26, p=.03) so they were included as covariates.

Figure 2.

Figure 2

Observed number of Go Sun Smart items in use by Basic and Enhanced Dissemination Strategy

Managers’ Reported Use of Go Sun Smart at Posttest

Examining reported use by any manager at a ski area, GSS training was performed more at more ski areas receiving the EDS than the BDS to communicate about sun protection with employees and guests (Table 4). Also, more managers reported linking to the GSS website in the EDS than BDS dissemination strategy.

Table 4.

Proportion (and standard deviation*) of managers who reported use of Go Sun Smart by Basic and Enhanced Dissemination Strategy

Managers Reported Use of GSS: BDS EDS p
N 32 32
Placing an article in an employee newsletter or flyer 0.544 (0.33) 0.620 (0.28) 0.159
Sending a message to employees by email or on ski area website 0.366 (0.29) 0.350 (0.25) 0.407
Providing any sort of training to employees 0.621 (0.28) 0.774 (0.20) 0.006
Placing an article or message for guests in a snow or grooming report, guest newsletter, flyer, whiteboard or supersign. 0.329 (0.27) 0.389 (0.29) 0.197
Sending a message to guests by email or on ski area website 0.166 (0.23) 0.255 (0.23) 0.058
Linked GSS website to ski area website 0.036 (0.10) 0.111 (0.19) 0.023
*

Standard deviations of the proportions are presented for simplicity.

1-tailed p-values.

Process Analysis on Personal Visit in Enhanced Dissemination Strategy

Given the success of the EDS, analyses were performed within the EDS condition to determine which components of this strategy most accounted for improved use of GSS. Several actions during the visit were associated with improved use of GSS at posttest, including total number of meetings at ski area, Spearman Rank r=0.40, p=.01 [1-tailed]; meetings with key contact manager, r=0.35, p=.02; and meetings with key contact manager and general manager plus presentation to key managers (r=0.44, p=.005). Distribution of more of the materials created for the EDS throughout the ski areas (both materials distributed, r=0.37, p=.02, and reviewed, r=0.41, p=.005) also was positively correlated with GSS use. Finally, ski areas where the general manager appeared to support GSS more enthusiastically during the project staff’s visit had greater use of GSS (r=0.48, p<.0001). A backwards stepwise multiple regression analysis with number of female senior managers as a covariate (criteria for elimination p>.10) revealed that two actions during the visit most predicted increased use of GSS – total number of meetings (regression coefficient=0.13, p=.01) and meetings with the key contact manager (regression coefficient=0.002, p=.03; model F[3,28]=6.46, p<.0001, R2=0.41).

Discussion

The EDS was effective in increasing overall use of GSS in ski area compared to the BDS or industry-based dissemination strategy. While the EDS, on average, increased program use by only two GSS items in the observational measure, it did activate managers to deliver more sun protection messages by conducting formal training of employees and linking to the GSS website. Further, analyses of the surveys of employees showed that exposure to messages on sun safety at the workplace increased when there were between six and nine GSS items observed in use at the ski areas (depending on whether they were in employee-only areas or anywhere in the ski areas). Exposure, in turn, was associated with improvements in sun protection 52. As shown in Table 3, nearly three times as many ski areas reached the 9 or more GSS items threshold when receiving the EDS (n=11; 33% of EDS ski areas) than merely the BDS (n=4; 11% of BDS ski areas). If EDS had been used to disseminate GSS to all of NSAA’s approximately 350 members, over 100 ski areas would have used GSS with sufficient fidelity to improve employees’ sun safety.

A recent systematic review of dissemination of cancer prevention programs concluded that multi-model strategies incorporating active contact worked best.53 Process analyses in the present study showed that the number of meetings with managers most influenced program implementation. The personal contact in EDS may have raised the profile of the program and the NSAA sponsorship. In-person visits may have made it more difficult to ignore occupational sun protection and GSS than NSAA mailings or displays at industry tradeshow booths.54 Discussions with managers may have corrected misunderstandings about workplace sun safety and GSS.54 These interactions could have clarified and given meaning to the communication about workplace sun safety by elevating need for such a program,25 placing it in the context of similar industry-sponsored workplace safety efforts,55,56 and helping to translate this need into action by managers (i.e., use of GSS), a process referred to as social representation.57,58 Staff also sought public commitment for using the program during in-person visits, which should have made the decision to use GSS more difficult to reverse.4446 The EDS may have reduced managers’ uncertainty about implementing GSS by creating plans and working through potential barriers. The presence of an internal champion for GSS also should have helped reduce resistance among employees as it was implemented,25,47 although the number of champions identified at a ski area did not improve implementation. Perhaps, champions are more influential on whether a program continues rather than whether it is initially used. Finally, the personal visit, which many managers saw as an extension of the NSAA, created pressure to use GSS in exchange for the effort by program staff to spend time assisting managers (i.e., a reciprocity effect).48,49 Unfortunately, it was not possible to discern exactly which of these processes resulted in greater program use, but incorporation of active communication in dissemination efforts appears to be an essential means of improving program use.

Granted, the active dissemination strategy represented by the EDS had additional costs relative to the more passive BDS (roughly $1700 versus $150 per ski area). This cost may be justified if it yields greater safety for three times as many employees. There may be ways to reduce its cost when taken to scale by, for example, providing training in group settings such as at industry conferences or utilizing web-based training and social networking technology instead of personal visits to each ski area.

Program dissemination to employers through a loosely-affiliated industry network created by the professional associations had both advantages and limitations. On the positive side of the ledger, these associations can be important intermediaries in dissemination.35 Dues-paying members may expect professional associations to identify new safety issues (i.e., establish a need, in DIT terms25), reduce their liability, and evaluate and endorse suppliers and programs that meet these needs (i.e., fit in and are feasible with members’ operations, in DIT terms25). Professional associations also have established communication channels to which members routinely attend and expect to receive credible and useful information. However, the effectiveness of NSAA’s traditional methods of disseminating a safety program as operationalized in the BDS produced only modest program use, although most member ski areas adopted it at least minimally. The extent to which managers identified with NSAA may have influenced program implementation but the strength of this tie was not measured and should be explored in future research.

On the other hand, program use was highly variable, with four ski areas using no items and one area using 26 items. Given the autonomy of employers, we were only able to operationalize two core implementation components described by Fixsen and colleagues in the EDS:26,36 training and ongoing coaching and support. Research staff did attempt to obtain commitment for GSS and worked with managers to fit GSS into existing work procedures, part of the facilitative administration implementation component.26,36 Variation in program use may have been reduced if more core implementation components were operationalized (i.e., efforts to align GSS with the organization, input on managers selected to implement GSS, and/or provision of performance feedback).

There were several notable strengths and limitations to this study. Among the most prominent strengths was the participation of a large number of employers across most of North America that improved generalizability, the use of observational measures that avoided self-report biases, and the partnership with leading professional associations that provided a realistic context for testing the dissemination strategies. However, the study was limited to a single industry providing winter outdoor recreation, and employers in eastern, southern and western North America. UV radiation was low for part of the winter dissemination period at northern latitudes and in cloudy climates where some ski areas were located. However, the EDS remained more effective when adjusting for mean annual hours of sunshine. Future studies should examine the success of dissemination strategies for sun safety programs in summer recreation when UV is more intense.

Partnering with an industry professional association to disseminate an evidence-based worksite disease prevention program can be a successful strategy. Practitioners and funders should take advantage of their unique intermediary role. Still, the influence of professional associations alone may not achieve high program use. Personal communication and support of the end-users of these programs (in this case, managers) by experts who created the program and have experience with deploying it may be needed to ensure that prevention programs are well implemented and achieve the intended behavior change to promote health and deter disease.

SO WHAT?

What is already known on this topic?

Outdoor workers are at risk for developing skin cancer and could benefit from sun protection. Go Sun Smart is one of a very few effective occupational sun protection programs. Active strategies may be needed to achieve high program fidelity when it is disseminated industry-wide.

What does this article add?

Findings are presented from a randomized trial enrolling 69 employers from a North American outdoor recreation industry. Industry professional association has some success when distributing Go Sun Smart, but program use was variable and relatively low. Active dissemination strategies by experts familiar with the program appeared to achieve greater use, perhaps by increasing attention to and decreasing uncertainty about the program, achieving commitment to use it, and helping overcome barriers to use.

What are the implications for health promotion practice or research?

Partnerships with professional associations may be essential for introducing evidence-based prevention programs into industries but normal communication channels may not achieve high use. Personal contacts by program experts may assist managers in seeing benefits from the program, planning for its use, and increasing actually use.

Acknowledgments

This project was supported by a grant from the National Cancer Institute (CA104876). The findings, views, and opinions expressed here are those of the authors. The authors wish to thank the industry professional associations and the senior managers at 69 ski areas in North America who supported the project and made their operations available to us.

Contributor Information

David B. Buller, Email: dbuller@kleinbuendel.com, Klein Buendel, Inc., 1667 Cole Boulevard, Suite 225, Golden, CO 80401, USA, 303.565.4340, 303.565.4320 (fax)

Peter A. Andersen, Email: peterand@mail.sdsu.edu, School of Communication, San Diego State University, 5500 Campanile Drive, San Diego, CA 29182, USA, 619.669.2809

Barbara J. Walkosz, Email: bwalkosz@kleinbuendel.com, Klein Buendel, Inc., 1667 Cole Boulevard, Suite 225, Golden, CO 80401, USA, 303.565.4356, 303.565.4320 (fax)

Michael D. Scott, Email: michaelscott780@yahoo.com, Mikonics, Inc., 683 Oak Haven Road, Auburn, CA 95603, USA, 530.888.8234

Gary R. Cutter, Email: cutterg@uab.edu, Department of Biostatistics, J. Ryals Public Health Building, University of Alabama, 1665 University Boulevard, Birmingham, AL 35294, USA, 205.975.5048

Mark B. Dignan, Email: mbdign2@email.uky.edu, Department of Internal Medicine, Markey Cancer Center, Room CC444, University of Kentucky, 800 Rose Street, Lexington, KY 40536, USA, 859.323.4708, 859.257.0017 (fax)

Ilima L. Kane, Email: ikane@kleinbuendel.com, Klein Buendel, Inc., 1667 Cole Boulevard, Suite 225, Golden, CO 80401, USA, 303.565.4345, 303.565.4320 (fax)

Xiao Zhang, Email: XZhang@ms.soph.uab.edu, Department of Biostatistics, J. Ryals Public Health Building, University of Alabama, 1665 University Boulevard, Birmingham, AL 35294, USA, 205.975.9239

Reference List

  • 1.Hanrahan PF, Hersey P, Watson AB, Callaghan TM. The effect of an educational brochure on knowledge and early detection of melanoma. Aust J Public Health. 1995;19(3):270–274. doi: 10.1111/j.1753-6405.1995.tb00442.x. [DOI] [PubMed] [Google Scholar]
  • 2.Stepanski BM, Mayer JA. Solar protection behaviors among outdoor workers. J Occup Environ Med. 1998;40(1):43–48. doi: 10.1097/00043764-199801000-00009. [DOI] [PubMed] [Google Scholar]
  • 3.Broadstock M, Borland R, Gason R. Effects of suntan on judgment and healthiness and attractiveness in adolescents. J Appl Soc Psychol. 1992;22(2):157–172. [Google Scholar]
  • 4.Goodman KJ, Bible ML, London S, Mack TM. Proportional melanoma incidence and occupation among white males in Los Angeles County (California, United States) Cancer Causes Control. 1995;6(5):451–459. doi: 10.1007/BF00052186. [DOI] [PubMed] [Google Scholar]
  • 5.Rosso S, Zanetti R, Martinez C, et al. The multicentre south European study ‘Helios’ II: Different sun exposure patterns in the aetiology of basal cell and squamous cell carcinomas of the skin. Br J Cancer. 1996;73(11):1447–1454. doi: 10.1038/bjc.1996.275. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Geller AC, Miller DR, Lew RA, Clapp RW, Wenneker MB, Koh HK. Cutaneous melanoma mortality among the socioeconomically disadvantaged in Massachusetts. Am J Public Health. 1996;86(4):538–543. doi: 10.2105/ajph.86.4.538. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kirkpatrick CS, Lee JA, White E. Melanoma risk by age and socio-economic status. Int J Cancer. 1990;46(1):1–4. doi: 10.1002/ijc.2910460102. [DOI] [PubMed] [Google Scholar]
  • 8.Marlenga B. The health beliefs and skin cancer prevention practices of Wisconsin dairy farmers. Oncol Nurs Forum. 1995;22(4):681–686. [PubMed] [Google Scholar]
  • 9.Vishvakarman D, Wong JC. Description of the use of a risk estimation model to assess the increased risk of non-melanoma skin cancer among outdoor workers in Central Queensland, Australia. Photodermatol Photoimmunol Photomed. 2003;19(2):81–88. doi: 10.1034/j.1600-0781.2003.00012.x. [DOI] [PubMed] [Google Scholar]
  • 10.Beral V, Robinson N. The relationship of malignant melanoma, basal and squamous skin cancers to indoor and outdoor work. Br J Cancer. 1981;44(6):886–891. doi: 10.1038/bjc.1981.288. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Cummings SR, Tripp MK, Herrmann NB. Approaches to the prevention and control of skin cancer. Cancer Metastasis Rev. 1997;16(3–4):309–327. doi: 10.1023/a:1005804328268. [DOI] [PubMed] [Google Scholar]
  • 12.Elwood JM, Koh HK. Etiology, epidemiology, risk factors, and public health issues of melanoma. Curr Open Oncol. 1994;6(2):179–187. doi: 10.1097/00001622-199403000-00011. [DOI] [PubMed] [Google Scholar]
  • 13.Woodward A, Boffetta P. Environmental exposure, social class, and cancer risk. IARC Sci Publ. 1997;(138):361–367. [PubMed] [Google Scholar]
  • 14.Lear JT, Tan BB, Smith AG, et al. A comparison of risk factors for malignant melanoma, squamous cell carcinoma and basal cell carcinoma in the UK. Int J Clin Pract. 1998;52:145–149. [PubMed] [Google Scholar]
  • 15.Freedman DM, Dosemeci M, McGlynn K. Sunlight and mortality from breast, ovarian, colon, prostate, and non-melanoma skin cancer: A composite death certificate based case-control study. Occup Environ Med. 2002;59(4):257–262. doi: 10.1136/oem.59.4.257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Weiss J, Bertz J, Jung EG. Malignant melanoma in southern Germany: Different predictive value of risk factors for melanoma subtypes. Dermatologica. 1991;183(2):109–113. doi: 10.1159/000247648. [DOI] [PubMed] [Google Scholar]
  • 17.Espinosa A, Sanchez Hernandez JJ, Bravo FB, et al. Cutaneous malignant melanoma and sun exposure in Spain. Melanoma Res. 1999;9(2):199–205. doi: 10.1097/00008390-199904000-00013. [DOI] [PubMed] [Google Scholar]
  • 18.Scott MD, Buller DB, Walkosz BJ, Andersen PA, Cutter GR, Dignan MB. Go sun smart. Commun Educ. 2008;57(4):423–433. doi: 10.1080/03634520802047378. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Rigel EG, Lebwohl MG, Rigel AC, Rigel DS. Ultraviolet radiation in alpine skiing: Magnitude of exposure and importance of regular protection. Arch Dermatology. 2003;139(1):60–62. doi: 10.1001/archderm.139.1.60. [DOI] [PubMed] [Google Scholar]
  • 20.Buller DB, Andersen PA, Walkosz BJ, et al. Randomized trial testing a worksite sun protection program in an outdoor recreation industry. Health Educ Behav. 2005;32(4):514–535. doi: 10.1177/1090198105276211. [DOI] [PubMed] [Google Scholar]
  • 21.Andersen PA, Buller DB, Voeks JH, et al. Testing the long term effects of the Go Sun Smart worksite sun protection program: A group-randomized experimental study. Journal of Communication. 2008;68:447–471. [Google Scholar]
  • 22.Walkosz BJ, Buller DB, Andersen PA, et al. Increasing sun protection in winter outdoor recreation: A theory-based health communication program. Am J Prev Med. 2008;34(6):502–509. doi: 10.1016/j.amepre.2008.02.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Andersen PA, Buller DB, Walkosz BJ, et al. Testing a theory-based health communication program: A replication of Go Sun Smart in outdoor winter recreation. Journal of Health Communication. 2009;14:346–365. doi: 10.1080/10810730902873117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Walkosz BJ, Voeks J, Andersen P, et al. Randomized trial on sun safety education at ski and snowboard schools in western North America. Pediatric Dermatology. 2007;24(3):222–229. doi: 10.1111/j.1525-1470.2007.00390.x. [DOI] [PubMed] [Google Scholar]
  • 25.Rogers EM. Diffusion of Innovations. 5. New York: Free Press; 2003. [Google Scholar]
  • 26.Fixsen DL, Blase KA, Naoom SF, Wallace F. Core implementation components. Res Soc Work Pract. 2009;19(5):531–540. [Google Scholar]
  • 27.Belig AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M. Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH behavior change consortium. Healthy Psychology. 2004;23:443–451. doi: 10.1037/0278-6133.23.5.443. [DOI] [PubMed] [Google Scholar]
  • 28.Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Rice R, Rogers EM. Re-invention in the innovation process. Knowledge. 1980;1:499–514. [Google Scholar]
  • 30.Whitten P. The diffusion of telemedicine. Science Communication. 1997;19(1):21–40. [Google Scholar]
  • 31.Douthwaite B, Keating JDH, Park JR. Learning selection: An evolutionary model for understanding, implementing and evaluating participatory technology development. Agricultural Systems. 2002;72:109–131. [Google Scholar]
  • 32.Dearing JW, Larson RS, Randall LM, Pope RS. Local reinvention of the CDC HIV preventional community planning initiative. J Community Health. 1998;23:113–26. doi: 10.1023/a:1018709423879. [DOI] [PubMed] [Google Scholar]
  • 33.Dearing JW, Rogers EM, Meyer G, et al. Social marketing and diffusion-based strategies for communicating with unique populations: HIV prevention in San Francisco. Journal of Health Communication. 1996;1(4):343–363. doi: 10.1080/108107396127997. [DOI] [PubMed] [Google Scholar]
  • 34.Leonard-Barton D. Implementation as mutual adaptation of technology and organization. Research Policy. 1988;17:251–67. [Google Scholar]
  • 35.Dearing JW, Maibach E, Buller D. A convergent diffusion and social marketing approach for disseminating proven approaches to physical activity promotion. Am J Prev Med. 2006;31(Suppl 4):S11–S23. doi: 10.1016/j.amepre.2006.06.018. [DOI] [PubMed] [Google Scholar]
  • 36.Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231); 2005. [Google Scholar]
  • 37.Brekke K, Phillips E, Pancake L, Anne O, Lewis J, Duke J. Implementation practice and implementation research: A report from the field. Research on Social Work Practice. 2009;19(5):592–601. [Google Scholar]
  • 38.Dalkey NC. [Accessed: 6-4-2010];The Delphi method: An experimental study of group opinion. 1969 http://www.rand.org/pubs/research_memoranda/2005/RM5888.pdf.
  • 39.Linstone HA, Turoff M. The Delphi Method: Techniques and Applications. Newark, NJ: New Jersey Institute of Technology, Information Systems Department; 1975. electronic version of book 2002. [Google Scholar]
  • 40.Kramer M. Uncertainty Reduction: Managing Uncertainty in Organizational Communication. Philadelphia, PA: Lawrence Erlbaum; 2004. [Google Scholar]
  • 41.Reid SA, Hogg MA. Uncertainty reduction, self-enhancement, and ingroup identification. Personality and Social Psychology Bulletin. 2005;31(6):804–817. doi: 10.1177/0146167204271708. [DOI] [PubMed] [Google Scholar]
  • 42.Eastin MS. Credibility assessments of online health information: The effects of source expertise and knowledge of content. Journal of Computer-Mediated Communication. 2006;4(1) [Google Scholar]
  • 43.Hong T. Contributing factors to the use of health-related websites. Journal of Health Communication. 2006;11(2):149–165. doi: 10.1080/10810730500526679. [DOI] [PubMed] [Google Scholar]
  • 44.Cialdini R. Influence: Science and Practice. New York: Harper Collier; 1988. [Google Scholar]
  • 45.Grant AM, Dutton JE, Rosso S. Giving commitment: Employee support programs and the prosocial sensemaking process. Academy Management Journal. 2008;51(5):898–918. [Google Scholar]
  • 46.Berger C. Interpersonal communication: Theoretical perspectives, future perspectives. Journal of Communication. 2006;55(3):415–447. [Google Scholar]
  • 47.Howell JM, Higgins CA. Champions of technological innovations. Adm Sci Q. 1990;35(2):317–341. [Google Scholar]
  • 48.Allen VL, Wilder DA. Social comparison, self evaluation, and conformity to the group. In: Suls JM, Miller RL, editors. Social Comparison Processes: Theoretical and Empirical Perspectives. New York: Hemisphere; 1977. pp. 187–208. [Google Scholar]
  • 49.Lomas J. The in-between world of knowledge brokering. Br Med J. 2007;334(7585):129–132. doi: 10.1136/bmj.39038.593380.AE. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.National Oceanic and Atmospheric Administration Satellite and Information Service. Climate Atlas of the United States: Lower 48 Mean Total Sunshine Hours. Washington, D.C: National Oceanic and Atmospheric Administration; 2009. [Google Scholar]
  • 51.Bakos L, Wagner M, Bakos RM, et al. Sunburn, sunscreens, and phenotypes: Some risk factors for cutaneous melanoma in southern Brazil. Int J Dermatol. 2002;41(9):557–562. doi: 10.1046/j.1365-4362.2002.01412.x. [DOI] [PubMed] [Google Scholar]
  • 52.Buller DB, Andersen P, Walkosz BJ, et al. The effect of program implementation on occupational sun protection when disseminating an evidence-based occupational sun protection program. Abstract presented at the annual meeting of the Society of Behavioral Medicine; April 2011. [Google Scholar]
  • 53.Rabin BA, Glasgow RE, Kerner JF, Klump MP, Brownson RC. Dissemination and implementation research on community-based cancer prevention: A systematic review. Am J Prev Med. 2010;38(4):443–456. doi: 10.1016/j.amepre.2009.12.035. [DOI] [PubMed] [Google Scholar]
  • 54.Harrison TR, Morgan SE, King AJ, et al. Promoting the Michigan organ donor registry: Evaluating the impact of a multi-faceted intervention utilizing media priming and communication design. Health Communication. 2010;25(8):700–708. doi: 10.1080/10410236.2010.521912. [DOI] [PubMed] [Google Scholar]
  • 55.Dutton JE, Ashford SJ, O’Neill RM, Lawrence KA. Moves that matter: Issue selling and organizational change. Academy Management Journal. 2001;44:716–736. [Google Scholar]
  • 56.Dutton JE, Ashford SJ. Selling issues to top management. Acad Manage Rev. 1993:397–428. [Google Scholar]
  • 57.Castro P. Applying social psychology to the study of environmental concern and environmental worldviews: Contributions from the social representations approach. J Community Appl Soc Psychol. 2006;16:247–266. [Google Scholar]
  • 58.Morgan S. The interaction of conversation, cognitions, and campaigns: The social representation of organ donation. Communication Theory. 2009;19:29–48. [Google Scholar]

RESOURCES