Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 May 21.
Published in final edited form as: AIDS Behav. 2008 Mar 11;12(3):374–383. doi: 10.1007/s10461-008-9369-1

Common Processes in Evidence-Based Adolescent HIV Prevention Programs

Barbara L Ingram 1, Diane Flannery 2, Amy Elkavich 3, Mary Jane Rotheram-Borus 4,
PMCID: PMC4028968  NIHMSID: NIHMS536503  PMID: 18330687

Abstract

Dissemination of evidence-based HIV prevention programs for adolescents will be increased if community interventionists are able to distinguish core, essential program elements from optional, discretionary ones. We selected five successful adolescent HIV prevention programs, used a qualitative coding method to identify common processes described in the procedural manuals, and then compared the programs. Nineteen common processes were categorized as structural features, group management strategies, competence building, and addressing developmental challenges of adolescence. All programs shared the same structural features (goal-setting and session agendas), used an active engagement style of group management, and built cognitive competence. Programs varied in attention to developmental challenges, emphasis on behavioral and emotional competence, and group management methods. This qualitative analysis demonstrated that successful HIV programs contain processes not articulated in their developers’ theoretical models. By moving from the concrete specifics of branded interventions to identification of core, common processes, we are consistent with the progress of “common factors” research in psychotherapy.

Keywords: Evidence-based adolescent HIV prevention interventions, Common processes, Core elements, HIV, Structural and procedural practices, Qualitative analysis


The implementation of effective HIV prevention programs for adolescents is an urgent public health goal. Because the average duration from HIV infection to the development of AIDS is 10 years, most adults living with AIDS today were likely infected as adolescents or young adults. The proportion of adolescents and young adults in the U.S. with an AIDS diagnosis has grown to over 4% (National Institute of Allergy and Infectious Diseases [NIAID] 2006). Adolescents and young adults account for 50% of new HIV infections worldwide and fewer than 50% of this age group are able to identify ways of preventing HIV (UNAIDS 2006).

Fortunately, there are many available evidence-based (EB) prevention programs designed specifically for adolescents: Advocates for Youth (2003, 2006) identified 24 EB prevention “Programs that Work.” The availability of effective programs, however, does not guarantee penetration of the interventions into the population at risk (Rotheram-Borus et al. 2000). The current challenge for HIV prevention is not the design of new effective programs, but rather the creation of strategies to assure that the benefits of existing effective HIV prevention programs reach every single adolescent.

To achieve the goal of disseminating EB HIV prevention programs, the Centers for Disease Control and Prevention (CDC) have created several integrated projects: (a) Prevention Research Synthesis project to identify “best-evidence” programs (PRS; see http://www.cdc.gov/hiv/topics/research/prs/index.htm; Lyles et al. 2007); (b) Replicating Effective Programs to package programs (REP; see http://www.cdc.gov/hiv/projects/rep/default.htm), (c) Diffusion of Effective Behavioral Interventions to provide training for diffusing programs (DEBI; see http://effectiveinterventions.org/), and (d) Technical Assistance Resources, Guidance, Education and Training Center to provide ongoing training and consultation (TARGET; see http://careacttarget.org/). Despite the best efforts of these projects, there is still a gap between the availability of a program and community implementation. For example, of the 162 agencies that sent a staff member to be trained to implement a single-session, 45 min HIV prevention intervention, only 38% implemented the program within the expected time frame (Harshbarger et al. 2006).

Broad implementation of EB programs is a difficult challenge even when encouraged by administrative policies and funding bodies (Rotheram-Borus et al. 2004). Program protocols written for a research project are designed to have fidelity with specific theoretical models (Green and Glasgow 2006; Schoenwald and Hoagwood 2001), not for attractiveness, acceptability, convenience, and needs of community providers (Kelly and Kalichman 2002; Rotheram-Borus and Duan 2003; Rotheram-Borus et al. 2004). Kraft et al. (2000), taking the perspective of providers, mentioned barriers to program adoption such as the high cost of programs, staff constraints, infrastructure and organizational character of the agency, lack of practical information provided in research reports, and lack of interest or support from the target population. Community agencies have difficulties knowing which EB program to select for the specific population and cost constraints (Collins et al. 2006; Kelly et al. 2000b; Lyles et al. 2006). To remedy this problem, the CDC created guidelines for a step-by-step selection process (McKleroy et al. 2006). However, the 23 action steps required to assess available programs may be daunting rather than helpful for community decision makers.

When communities do adopt an EB program for implementation, they invariably modify the program (McKleroy et al. 2006; Rebchook et al. 2006; Rohrbach et al. 2006; Stanton et al. 2005), believing that they are appropriately customizing the program to the needs of their clients. In contrast to academic researchers, community interventionists believe that flexibility is more important than “replication with fidelity” (Kelly et al. 2000a; Kraft et al. 2000; Solomon et al. 2006). Community providers may prefer using their “homegrown” program to an “intervention in a box” (Collins et al. 2006), and may resist implementing a program of which they have no ownership. Community agencies brand themselves by providing unique services, and compete for funding from private foundations by demonstrating the distinctiveness of their programs. Thus, providing replications of someone else’s program limits their ability to attract funding from any source except state and federal governments.

To promote effective adaptation of EB programs, it is necessary to distinguish crucial, robust program elements that must be retained from those that can be modified or eliminated without detracting from the program’s efficacy (Kelly et al. 2000a; Neumann and Sogolow 2000; Rohrbach et al. 2006; Rotheram-Borus and Duan, 2003; Sogolow et al. 2000; Solomon et al. 2006). An analogy is frequently drawn between prevention programs and medication (e.g., Jensen 2003). We need to distinguish the intervention’s core efficacious elements (similar to the molecules of chemicals in a drug), which need to be replicated with fidelity, from its delivery vehicles (analogous to pill, liquid, injection, patch, or suppository), which can be modified or eliminated. In behavior change interventions, however, the delivery vehicles (the procedures and processes, as distinct from the content) have an important impact on whether participants stay or drop out, leave with beneficial behavior change, and maintain this change over time. Therefore, there are two types of core efficacious elements—essential content and necessary processes—to be contrasted with optional tailoring adaptations.

The methods for defining core elements fall into two categories: using the same principles that guided the design of the original EB intervention (e.g., theoretical bases and internal logic of the intervention (Eke et al. 2006)) or conducting independent research. Research approaches include a componential analysis (e.g., Rotheram-Borus et al. 1998), using feedback from participants and facilitators (e.g., Kelly et al. 2000a), and process evaluation methods applied to successful programs (e.g., Janz et al. 1996).

Those different strategies resulted in diversity rather than consensus in the lists of core elements. The REP project identified a list of 3–4 short-term goals or activities as the core elements for each of the programs it certified (Solomon et al. 2006). For a one-session intervention (VOICES/VOCES), a “culturally specific” video was included as a core element (Harshbarger et al. 2006). The creators of the Mpowerment Project identified nine core elements, including informal outreach, a particular dedicated meeting space, and peer-led groups with specific activities (Rebchook et al. 2006). In their quantitative and qualitative study of 37 AIDS prevention programs, Janz and colleagues (1996) found the three most important elements to be small group discussions, outreach, and trained community peers. There is a need for further research to develop a systematic model of core elements that would apply to all EB programs and provide usable guidance to community practitioners.

The present study joined the search for core elements by using qualitative research methods to examine what is actually occurring in a set of successful EB HIV prevention programs for adolescents. Our research program had two separate goals: (1) to develop a comprehensive lexicon of processes and procedures in order to distinguish those that are essential for all programs (core elements) from those that are optional and discretionary and (2) to identify “core principles” and “content” imbedded in successful programs. The study of core principles is reported elsewhere. In this paper we first describe our method for developing a classification system of processes and then report our comparison of five programs. For the remainder of this paper, we ignore the content of the programs only for purposes of clarity and because that topic is discussed elsewhere (Ingram et al. 2007). It must be stressed that the practitioner must first be knowledgeable about the content from EB prevention programs before tailoring the processes to the needs of the target population.

Method

A four-step procedure was followed to identify common process elements in adolescent HIV prevention programs: (1) selecting successful evidence-based prevention programs for adolescents; (2) developing categories through an iterative open coding approach; (3) having trained raters code each manual; and (4) comparing programs across the identified process elements.

Evidence-Based Program Selection

The following criteria were used to identify eligible programs: (1) the CDC had identified the program as efficacious, or a program that works, based on published empirical studies; (2) the program had been used for over five years; and (3) the program’s manual clearly presented program parameters, strategies and procedures. Five programs were selected based on these criteria and their key characteristics are summarized in Table 1: (1) Be Proud! Be Responsible! (Jemmott et al. 1992); (2) Becoming A Responsible Teen (St. Lawrence et al. 1995); (3) Focus on Kids (Stanton et al. 1996); (4) Safer Choices (Coyle et al. 2001); and (5) Street Smart (Rotheram-Borus et al. 1991; Rotheram-Borus et al. 2003).

Table 1.

Key characteristics of five adolescent, evidence-based HIV prevention interventions

Intervention Ethnicity Gender Ages Settings Format Sessions Theory
Be Proud! Be Responsible! (BPBR) African- American Males 13–18 Multiple urban Small group 6 @ 50-min, Weekly Social cognitive (Bandura 1986)
Reasoned action/planned behavior (Ajzen 1991)
Becoming a Responsible Teen (BART) African- American Separate groups 14–18 Community- based urban Small group 8 @ 1.5–2 h, Weekly Social learning (Bandura 1977)
Self-efficacy (Bandura 1986)
Focus on Kids (FK) African- American Separate groups 9–15 Friendship networks urban Small group 7 @ 1.5 h, Weekly 1 one-day retreat Protection motivation (Rogers 1983)
Safer Choices (SC) Multiethnic Mixed groups 14–17 Schools urban & suburban Classroom 20 @ 45–min Social cognitive (Bandura 1986)
Social influences & school change
Street Smart (SS) Multiethnic Mixed groups 11–18 Community- based urban Small group 8 @ 1.5–2 h
1 Individual follow-up
1 Community visit
Social learning (Bandura 1977)

As shown on Table 1, the programs were similar in a number of ways. Each program: (1) targeted adolescents or preadolescents; (2) focused on reduction of sexual risk behavior; 3) was delivered in small group formats from 5–30 adolescents; (4) was delivered with ethnic minority populations; and (5) included multiple sessions (from 7–20 sessions). All programs were skill-focused and utilized cognitive-behavioral principles. Because we wanted to choose a highly-regarded school-based program, we selected one (SC) in which HIV prevention is secondary to pregnancy prevention in its emphasis.

Category Development

The first stage in category development was the process of “open coding” as described by Strauss and Corbin (1990). We examined the manuals of the five efficacious HIV prevention programs to identify the processes that would actually occur during program implementation, without biasing our observations by our knowledge of theory, research articles, or the introductory theoretical sections of the intervention manuals. One of the authors and a psychology graduate student independently reviewed the activities, scripts, time allocations, and instructions for two prevention programs to develop a preliminary list of concepts.

For the next stage of category development, the authors introduced concepts from our expertise in cognitive behavioral interventions, adolescent development, group dynamics and group therapy, and pedagogy, making sure to stay close to the data from the manuals that were displayed from the first round of coding. We then compared our categories, revised the wording, and agreed on a list of 21 processes. We selected examples that clearly reflected the meaning of each category and devised a 4-point rating scale: 0 (absent), 1 (possibly present), 2 (explicitly present, minor), and 3 (major emphasis in session). For instance, the process label “fun” would be used for games, role plays that introduced humor, and refreshments. The process label “teacher role” would be applied when the leader lectured on facts or myths, used charts and statistics, assigned homework, or gave a quiz.

Two master’s level psychology students were trained in the category system and were tested by being asked to match codes with 21 examples. They reached over 90% agreement on rating codes. Through discussion, the students and one author resolved the disagreements over some items by making changes in definitions. For example, the process label “focus on future” initially referred to mobilizing dreams of a positive adulthood but was expanded to include more immediate short-term future goals. By combining absent and possibly present into one category, we reduced the major source of disagreements. The revised category was called none/low. We noticed redundancy in two different pairs of categories and combined them, thus reducing the number of categories to 19. For instance, an original category “democratic interactions” was recognized as a subset of “active engagement.”

Coding the Manuals

The two raters divided the five programs between them and then completed a rating sheet for each session of each program. Next to each process label the rater entered a rating score and, if the process was present, provided at least one concrete example of instructions in the manual that illustrated that process. Because the categories were not mutually exclusive, a single group activity could receive multiple codes and, therefore, be used as an example of multiple process elements. For instance, the use of behavioral rehearsal for learning to insist on condom use would be an example of active engagement, behavioral skill building, and set social rules.

Comparing Programs Across Process Elements

The authors examined the examples and, through discussion, developed a set of four domains into which we sorted the 19 processes: (1) Structural Features; (2) Group Management Strategies; (3) Competence Building; and (4) Addressing Developmental Challenges. The numerical rating data for the programs were entered into Excel spreadsheets. The next step was to develop a summary statistic for each process to answer the question: How strongly was this process emphasized in the entire program? We decided that only the highest category—major emphasis—would signify a core efficacious element. Had we combined the top two out of three categories on the rating scale, the differences between programs might have been obscured. Examining the spreadsheet, we counted the number of sessions in which a process received the highest rating, and then computed the percentage. The summary percentages allowed us to compare the relative emphasis of the 19 processes across the five programs.

Results

Categories of Process Elements

The 19 process elements sorted into four categories are presented in Table 2 with definitions and examples.

Table 2.

Description of 19 processes

Process elements Description Examples
Structural features
 Goal-setting Objectives for the program and the session are clearly stated Goals for session stated at beginning; participants are asked to set personal goals
 Agenda-setting Specific agenda, rules and rituals Agenda with time allotment for each item; opening and closing rituals; rule to avoid “put downs”
 Teacher role Instructional methods which use teacher’s authority and expertise Lecture on facts and myths, use of charts and statistics, question and answer, use of homework. Give a quiz and have group correct together
Group management strategies
 Supportive Efforts to create a safe, comfortable and accepting group environment Leader gives compliments and avoids judgment and criticism; rules dictate acceptance, respect, confidentiality; use of tokens for appreciation of cooperative behavior
 Cohesiveness Promotion of group spirit, mutual support and a sense of “we-ness” Requests for participants to exchange compliments; “Getting to know you” activity; graduation ceremony
 Fun Encouragement of enjoyment through humor, refreshments, or games Game to demonstrate how AIDS is transmitted; role plays are treated as games
 Self-disclosure Promotion of personal sharing of values, feelings, and experiences Leader models or requests; Leader asks “what are advantages of abstinence to you?’ and writes answers on board
 Active engagement Information disseminated through participation in activities; cooperative team learning where leader functions as coach or consultant Role plays, games, contests; preparing a skit and videotaping; leader promotes participation
 Cultural sensitivity Customizing session to specific cultural group Use of leaders and guests from same ethnic group; Adapting role play script to fit participants’ ethnic background; inclusive language regarding same gender partners; acknowledgement of religious members’ opposition to condom use
 Application of behavioral management strategies Use of reinforcement to shape norms and behaviors; modeling desired behaviors; teaching how to recognize and avoid triggers to undesired behavior Teaching how alcohol use and being alone in bedroom are triggers to poor impulse control; Giving rewards to members for completion of field assignments; use of tokens in session; use of “emotional thermometer”
Competence building
 Behavioral skill building Activities to build verbal and nonverbal actions that can be observed Role plays to develop social skills and assertiveness; using penile model to teach condom use; practicing negotiation skills
 Cognitive change strategies Recognizing and changing beliefs and self-talk; learning self-instructions methods; developing problem-solving and decision-making skills “You can say no and still maintain positive relationship.” “You have the right to delay and think before making a choice.” Teach structured problem solving skills; brainstorm low-risk alternatives to high risk sexual behavior; activities that challenge “myths” and teach facts; teach how to identify self-defeating thought and switch to enhancing one
 Use of positive affect Methods to enhance positive emotional states as part of learning process Identify feelings during role plays and learn to reduce anxiety; teach emotional management skills; identify feelings of pride after successful actions; give praise and compliments
 Use of negative affect Increasing negative emotional states to increase motivation to change Watching video that increases sense of vulnerability; Choosing a guest speaker with AIDS who they identify with to increase fear arousal
Addressing developmental challenges
 Social identity Presenting new social roles; building resistance to peer pressure Encouragement to become health advocate; assignment to listen to parents; role play to resist peer pressure
 Sense-of-self Increase self-worth, self-efficacy, empowerment, self-care, and inner ideals “The ability to say no gives us power over our lives”; Facilitator states at end of session “Each one of you is worthwhile and unique.” Treating members like experts who can give advice to others
 Promote moral values Direct efforts to change morals, to build sense of social responsibility or to encourage altruism Focus on advantage of abstinence; importance of notifying partner of HIV status; Creating norms of respect; persuasion to build sense of responsibility to community
 Set social rules Recommend and advocate concrete rules for social behavior Don’t watch pornography in a group, don’t go to private place without condom, discuss HIV status with partner, don’t exchange needles
 Focus on future Direct attention to application of learning in real life setting Ask how they will use skills in next week; brainstorm ways of handling obstacles to condom use; assignment to talk to counselor in place that does HIV testing; describing dreams for positive future
  1. Structural features. Three process elements were included in this group: Goal-setting, Agenda-setting, and the Teacher role.

  2. Group management strategies. This category comprises seven process elements. Three relate to the creation of positive emotional experiences in the group: Support, Cohesiveness, and Fun. Two refer to styles of participation and involvement in the group: Self-disclosure, and Active engagement. The final two elements are Cultural sensitivity and Application of behavioral management strategies.

  3. Competence-building includes behavioral, cognitive, and affective components. The names of processes in this category are: Behavioral skill building, Cognitive change strategies, Use of positive affect, and Use of negative affect.

  4. Addressing developmental challenges. HIV prevention depends on the capacities of an individual to resist powerful internal impulses and emotions and intense external peer pressure. Those complex capacities evolve during adolescence and include the exercise of self-control and delay of gratification, development of an internal moral code, creation of a vision of the desired future, and a greater sense of responsibility in social relationships. The names of the process elements in this group reflect a higher level of abstraction: Social identity, Sense-of-self, Promote moral values, Set social rules, and Focus on future.

Comparison of Programs

Table 3 presents the five programs with a summary statistic for each process element. For each program, the percentage of sessions in which a specific process received a “major emphasis” is indicated. A figure of “0%” does not mean that the process was absent; it could have been present with minor emphasis in every session.

Table 3.

Descriptive summary of 5 adolescent HIV prevention programsa

Becoming a Responsible Teen BART (%) Be Proud be Responsible BPBR (%) Focus on Kids FK (%) Safer Choices SC (%) Street Smart SS (%)
Structural features
 Goal setting 100 100 100 100 100
 Agenda setting 100 100 100 100 100
 Teacher role 50 100 25 25 62.5
Group management strategies
 Safety & support 50 16.7 25 5 100
 Group cohesiveness 12.5 0 12.5 10 100
 Fun 37.5 0 12.5 30 87.5
 Self-disclosure 50 0 0 5 0
 Active engagement 100 83.3 87.5 90 100
 Cultural sensitivity 62.5 16.7 12.5 0 0
 Behavioral management strategies 12.5 83.3 50 10 100
Competence building
 Behavioral skill building 50 33.3 50 35 100
 Cognitive change strategies 100 100 100 80 100
 Use of positive affect 50 16.7 0 15 100
 Use of negative affect 12.5 33.3 0 10 0
Addressing developmental challenges
 Social identity 62.5 33.3 25 20 12.5
 Sense-of-self 25 33.3 25 25 12.5
 Promote moral values 37.5 16.7 0 0 12.5
 Set social rules 0 0 0 35 50
 Focus on future 25 0 12.5 30 25
a

The percentage of sessions with that process rated as 3 (major emphasis in session); using this method, 0% does not mean that the element was absent but that it received medium or lower emphasis

Structural Features

For all five of the interventions, 100% of the sessions stated clear goals for the entire program, for each segment of the session, and for the period following termination of the group. 100% of the programs set a clear agenda for each session, providing a structured framework. These findings are not surprising because these are manualized programs, designed to be replicated faithfully. There was considerable variability in how much emphasis was given to the use of a traditional teacher role, ranging from 25% of sessions with a major emphasis (Focus on Kids) to 100% of sessions (Be Proud! Be Responsible!).

Group Management Strategies

For the seven process variables in this category, only Active Engagement received major emphasis in a high percentage of sessions, ranging from 83% to 100%. Methods to engage the participants included using small groups for role plays and discussion, offering competitive games as a way to assure mastery of facts, and having participants put condoms on penile models. Only one of the interventions (Becoming a Responsible Teen) gave Cultural Sensitivity a major emphasis in a majority of sessions: 62.5% compared to a maximum of 17% in the other programs. However, other programs showed high awareness of cultural issues by using specific subpopulations for their program development and using cultural competence as a requirement in selecting trainers, information that was not available for coding (e.g., Be Proud! Be Responsible!).

Every program instructed leaders to create a safe supportive group environment; however, the degree to which a major emphasis on support was recognized in the procedural guide for each session varied greatly, from 5% to 100% of sessions. In all programs, clear norms were set in the beginning of the program to assure that members could speak up and participate in activities without fear of overt ridicule. The programs differed in whether the manual reminded the group leader to emphasize these norms and rules in each session. Street Smart demonstrated the highest emphasis on support and cohesiveness by implementing a specific behavioral management strategy in every session: the use of token exchange by all members to “catch each other doing something well.” Safer Choices, the only one of the five programs implemented within the school curriculum, gave high emphasis to support in only 5% of sessions. Only one program gave a high emphasis to self-disclosure: Becoming a Responsible Teen highly emphasized this style of interaction in 50% of its sessions whereas the other programs had ratings of 5% or lower.

Competence-Building

All five programs gave higher emphasis to cognitive competence than to behavioral skills. For four of the five programs, Cognitive Change Strategies received a major emphasis in every session, while in the fifth program it had major emphasis in 80%. The role of affect in the learning process varied greatly among the programs. One program (Focus on Kids) did not highly emphasize emotion in any sessions. Only one program (Be Proud! Be Responsible!) had a greater emphasis on negative than positive affect, stirring feelings of fear and vulnerability to strengthen motivation toward self-protection.

Addressing Developmental Challenges

This category relates to the special challenges of the stage of adolescence when individuals are searching for identity, defining their sense of self, struggling with values and morals, trying to figure out the rules to follow, and living very much in the present. The program that was designed for a specific cultural group (Becoming a Responsible Teen) had the highest emphasis on Social Identity (62.5% of sessions) and Promote Moral Values (37.2% of sessions). Every program gave a major emphasis to Sense-of-Self and Social Identity in at least one session. Only two programs made Set Social Rules a major emphasis in some of its sessions (Street Smart in 50% of sessions and Safer Choices in 35% of sessions); the other three programs had scores of 0% for this process.

Discussion

Community providers need guidance to distinguish core elements from optional elements so that when they modify EB programs to meet the needs of their target population, they do not undermine the program’s successful outcomes. Our cross-intervention analysis of successful adolescent HIV prevention programs found common core processes that are highly emphasized in all successful programs, as well as factors that varied greatly from program to program. The variations represent adaptations to specific contexts and populations, as well as preferences of the program designers.

This discussion focuses on those principles, practices, and discoveries that stand out as being the most useful for our goal—helping real-world interventionists develop programs that draw from, yet do not faithfully replicate, empirically-based programs.

  1. Clear goals are essential for prevention programs. The participants must set and attain goals to reduce their risky behavior; the interventionists must set and meet goals for delivering an effective program.

  2. Active engagement should be viewed as a mandatory process. This process was emphasized in every program, even those that emphasized the use of the traditional teacher role for leaders. Active engagement of members may or may not involve personal self-disclosure.

  3. A direct focus on cognitive change is an essential ingredient. Every program gave major emphasis to the cognitive domain. Examples of cognitive change processes included developing self-efficacy, increasing perceived vulnerability, encouraging values around self-protection, identifying triggers for risk situations, building cognitive control over strong passions, teaching facts about the transmission and outcome of infection, and building problem solving skills for managing specific risk situations. The strategies and techniques from social cognitive theories, therefore, appear to be robust elements of all prevention programs and should be incorporated in future interventions.

  4. Efficacious interventions are more comprehensive than their underlying theories would lead us to expect. All designers of successful HIV prevention interventions articulate the theoretical foundations of their programs, yet we found that there are processes that contribute to program effectiveness that were not addressed by the underlying theory. We discovered that cognitive skill building was a key element in all programs, although the theoretical basis for Focus on Kids (Rogers 1983) never mentions that process. Be Proud! Be Responsible! is grounded in the Theory of Planned Behavior (Ajzen 1991), a social cognitive model. However, many of the activities in that program are aimed at building social identity and sense-of-self. The developers of Street Smart describe their theoretical foundation as social learning theory (Bandura 1977), yet in 50% of the sessions there is a major emphasis on setting social rules, consistent with the views of Rotheram-Borus and Phinney (1987) on the need for interventionists to focus on multiple levels to achieve consolidation of behavior change (e.g., behaviors, social rules, social roles, identities). The differences among the programs did not match differences in theoretical models, and no single program is a pure distillation of the ideas of the developer’s cited theory.

  5. The potency of group cohesiveness as a facilitator of change is not reflected in program manuals. Cohesiveness was not explicitly emphasized at all in two programs; two other programs emphasized it in only one-eighth of the sessions; and only one program emphasized it explicitly in every session. Yet, professionals who work with groups understand the power of a cohesive group to influence its members and counteract negative group pressures from the outside environment. A leader without expertise in group processes who dutifully followed the manual would neglect opportunities to build cohesiveness. Skilled leaders no doubt foster group morale and cohesiveness in ways that were not described in the manual. One program, Focus on Kids, requires that participants in a program are members of a pre-existing friendship group, thereby assuring that cohesiveness is present, without having to encourage it too frequently in the manual.

There are several limitations of our methodology in these analyses. Educators know that a single session may be sufficient to achieve a learning objective. In our analyses, the impact on the learner was not addressed, only the quantity of sessions that highly emphasized a process. Because the programs differ in length, the numerical summary ratings have different meaning: 10% would represent 1 session in a 10-session program but 2 sessions in a 20-session program. Thus, it is important to emphasize that we are using the percentage statistic to illustrate variability and similarity, and not for quantitative analysis.

Our analysis produced some results that were surprising and counterintuitive: How could a behaviorally-based program not rate high in application of behavioral management strategies? Only one program (Street Smart) used tokens for positive reinforcement, yet we know that positive reinforcement is present in all learning contexts. The presence of anomalous findings strengthens the argument that the words in a manual do not describe all of the change processes occurring in an intervention.

Developers of the five programs may feel that their intentions were not accurately represented in Table 3, and we invite their reactions to this discovery: Not only do their manuals include ideas and methods that go beyond the principles of their specified theoretical model, but the efficacious components of their intervention programs go beyond what is explicitly stated in the manual.

Conclusions

The current analyses challenge existing notions of the diffusion process of EB programs. Currently, one theoretical model typically underlies each EB prevention program; this theory leads to the design of an intervention and the production of a manual. Then practitioners are asked to replicate the program with fidelity in their local sites, following the manuals. The present study suggests that there are processes and elements that are not articulated in the theoretical model. Planners, providers, and interventionists can benefit from understanding the structural features, group management strategies, approaches to building competence, and methods for addressing developmental challenges that are used in empirically-validated HIV prevention programs for adolescents.

The search for core elements in prevention interventions is parallel to the identification of “common factors” in a large body of psychotherapy research (Lambert and Oglesk 2004) and other mental health interventions (e.g., Arnold et al. 2008), as well as consistent with the study of levels of change by a National Institute of Mental Health taskforce (NIMH; NIMH Intervention Workgroup 2001). By focusing on the common processes that occur in successful interventions, rather than on their theoretical explanations or idiosyncratic packaging, we are making an empirically-validated knowledge base more accessible to community interventionists.

Acknowledgments

This paper was completed with the support of National Institute of Mental Health grants #1ROI MH49958-04, K-23 MH02050-03, and P30MH58107. We wish to acknowledge Pepperdine graduate students Arlene Cruz, Angel Duncan, and James M. Keener for coding the manuals.

Contributor Information

Barbara L. Ingram, Graduate School of Education and Psychology, Pepperdine University, Los Angeles, CA, USA

Diane Flannery, Semel Institute for Neuroscience and Human Behavior, Center for Community Health, University of California at Los Angeles, 10920 Wilshire Blvd., Suite 350, Los Angeles, CA 90024-6521, USA.

Amy Elkavich, Semel Institute for Neuroscience and Human Behavior, Center for Community Health, University of California at Los Angeles, 10920 Wilshire Blvd., Suite 350, Los Angeles, CA 90024-6521, USA.

Mary Jane Rotheram-Borus, Email: Rotheram@ucla.edu, Semel Institute for Neuroscience and Human Behavior, Center for Community Health, University of California at Los Angeles, 10920 Wilshire Blvd., Suite 350, Los Angeles, CA 90024-6521, USA.

References

  1. Advocates for Youth. Science and success: Sex education and other programs that work to prevent teen pregnancy. HIV & sexually transmitted infections. 2003 Retrieved June 5, 2007, from http://www.advocatesforyouth.org/publications/ScienceSuccess.pdf.
  2. Advocates for Youth. Science and success: Supplement I: Additional sex education and other programs that work to prevent teen pregnancy. HIV & sexually transmitted infections. 2006 Retrieved June 5, 2007, from http://www.advocatesforyouth.org/publications/sciencesuccess_supplement.pdf.
  3. Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991;50:179–211. [Google Scholar]
  4. Arnold EM, Rice E, Flannery D, Rotheram-Borus MJ. HIV disclosure among adults living with HIV. AIDS Care. 2008;20(1):80–92. doi: 10.1080/09540120701449138. [DOI] [PubMed] [Google Scholar]
  5. Bandura A. Social learning theory. Englewood Cliffs, NJ: Prentice Hall; 1977. [Google Scholar]
  6. Bandura A. Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall; 1986. [Google Scholar]
  7. Collins C, Harshbarger C, Sawyer R, Hamdallah M. The diffusion of effective behavioral interventions project: Development, implementation, and lessons learned. AIDS Education and Prevention. 2006;18(4 Suppl A):5–20. doi: 10.1521/aeap.2006.18.supp.5. [DOI] [PubMed] [Google Scholar]
  8. Coyle K, Basen-Engquist K, Kirby D, Parcel G, Banspach S, Collins J, et al. Safer choices: Reducing teen pregnancy, HIV, and STDs. Public Health Reports. 2001;116:82–93. doi: 10.1093/phr/116.S1.82. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Eke AN, Neumann MS, Wilkes AL, Jones PL. Preparing effective behavioral interventions to be used by prevention providers: The role of researchers during HIV prevention research trials. AIDS Education and Prevention. 2006;18(4 Suppl A):44–58. doi: 10.1521/aeap.2006.18.supp.44. [DOI] [PubMed] [Google Scholar]
  10. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: Issues in external validity and translation methodology. Evaluation and the Health Professions. 2006;29(1):126–153. doi: 10.1177/0163278705284445. [DOI] [PubMed] [Google Scholar]
  11. Harshbarger C, Simmons G, Coelho H, Sloop K, Collins C. An empirical assessment of implementation, adaptation, and tailoring: The evaluation of CDC’s national diffusion of VOICES/VOCES. AIDS Education and Prevention. 2006;18(4 Suppl A):184–197. doi: 10.1521/aeap.2006.18.supp.184. [DOI] [PubMed] [Google Scholar]
  12. Ingram BL, Rotheram-Borus MJ, Elkavich A. Ten core principles of effective HIV prevention programs for adolescents. Poster presented at the meeting of the American Psychological Association; San Francisco, CA. 2007. Aug, [Google Scholar]
  13. Janz NK, Zimmerman MA, Wren PA, Israel BA, Freudenberg N, Carter RJ. Evaluation of 37 AIDS prevention projects: Successful approaches and barriers to program effectiveness. Health Education Quarterly. 1996;23(1):80–97. doi: 10.1177/109019819602300106. [DOI] [PubMed] [Google Scholar]
  14. Jemmott JB, Jemmott LS, Fong GT. Reductions in HIV risk-associated sexual behaviors among black male adolescents: effects of an AIDS prevention intervention. American Journal of Public Health. 1992;82(3):372–377. doi: 10.2105/ajph.82.3.372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Jensen PS. Commentary: The next generation is overdue. Journal of the American Academy of Child and Adolescent Psychiatry. 2003;42(5):527–530. doi: 10.1097/01.CHI.0000046837.90931.A0. [DOI] [PubMed] [Google Scholar]
  16. Kelly JA, Heckman TG, Stevenson LY, Williams PN, Ertl T, Hays RB, et al. Transfer of research based HIV prevention interventions to community service providers: Fidelity and adaptation. AIDS Education and Prevention. 2000a;12(5 Suppl):87–98. [PubMed] [Google Scholar]
  17. Kelly JA, Kalichman SC. Behavioral research in HIV/AIDS primary and secondary prevention: Recent advances and future directions. Journal of Consulting and Clinical Psychology. 2002;70(3):626–639. [PubMed] [Google Scholar]
  18. Kelly JA, Sogolow ED, Neumann MS. Future directions and emerging issues in technology transfer between HIV prevention researchers and community-based service providers. AIDS Education and Prevention. 2000b;12(5 Suppl):126–141. [PubMed] [Google Scholar]
  19. Kraft JM, Mezoff JS, Sogolow ED, Neumann MS, Thomas PA. A technology transfer model for effective HIV/AIDS interventions: Science and practice. AIDS Education and Prevention. 2000;12(5 Suppl):7–20. [PubMed] [Google Scholar]
  20. Lambert MJ, Oglesk BM. The efficacy and effectiveness of psychotherapy. In: Lambert MJ, editor. Bergin and Garfield’s handbook of psychotherapy and behavior change. 5th ed. Hoboken, NJ: Wiley; 2004. pp. 139–193. [Google Scholar]
  21. Lyles CM, Crepaz N, Herbst JH, Kay LS HIV/AIDS Prevention Research Synthesis Team. Evidence-based HIV behavioral prevention from the perspective of the CDC’s HIV/AIDS Prevention Research Synthesis Team. AIDS Education and Prevention. 2006;18(4 Suppl A):21–31. doi: 10.1521/aeap.2006.18.supp.21. [DOI] [PubMed] [Google Scholar]
  22. Lyles CM, Kay LS, Crepaz N, Herbst JH, Passin WF, Kim AS, et al. Best-evidence interventions: Findings from a systematic review of HIV behavioral interventions for US populations at high risk, 2000–2004. American Journal of Public Health. 2007;97(1):133–143. doi: 10.2105/AJPH.2005.076182. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. McKleroy VS, Galbraith JS, Cummings B, Jones P, Harshbarger C, Collins C, et al. Adapting evidence-based behavioral interventions for new settings and target populations. AIDS Education and Prevention. 2006;18(4 Suppl A):59–73. doi: 10.1521/aeap.2006.18.supp.59. [DOI] [PubMed] [Google Scholar]
  24. Neumann MS, Sogolow ED. Replicating effective programs: HIV/AIDS prevention technology transfer. AIDS Education and Prevention. 2000;12(5 Suppl):35–48. [PubMed] [Google Scholar]
  25. NIAID. HIV infection in adolescents and young adults in the US. 2006 Retrieved January 23, 2007 from http://www.niaid.nih.gov/factsheets/hivadolescent.htm.
  26. NIMH Intervention Workgroup (Bellack A, Elkin I, Flay B, et al.) An integrated framework for preventive and treatment interventions. Presented at the National Institute of Mental Health Intervention Workgroup Meeting; Washington, DC. 2001. Nov, [Google Scholar]
  27. Rebchook GM, Kegeles SM, Huebner D, the TRIP Research Team Translating research into practice: The dissemination and initial implementation of an evidence-based HIV prevention program. AIDS Education and Prevention. 2006;18(4 Suppl A):119–136. doi: 10.1521/aeap.2006.18.supp.119. [DOI] [PubMed] [Google Scholar]
  28. Rogers RW. Cognitive and physiological processes in fear appeals, attitude change: A revised theory of protection motivation. In: Cacioppo J, Petty R, editors. Social psychophysiology. New York: Guilford Press; 1983. [Google Scholar]
  29. Rohrbach LA, Grana R, Sussman S, Valente TW. Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation and the Health Professions. 2006;29(3):302–333. doi: 10.1177/0163278706290408. [DOI] [PubMed] [Google Scholar]
  30. Rotheram-Borus MJ, Duan N. Next generation of preventive interventions. Journal of the American Academy of Child & Adolescent Psychiatry. 2003;42(5):518–526. doi: 10.1097/01.CHI.0000046836.90931.E9. [DOI] [PubMed] [Google Scholar]
  31. Rotheram-Borus MJ, Duan N, Flannery D. Interventions that are CURRES: Cost-effective, useful, realistic, robust, evolving, and sustainable. In: Remschmidt H, Belfer ML, Goodyer I, editors. Facilitating pathways: Care, treatment, and prevention in child and adolescent mental health. Heidelberg, Germany: Springer-Verlag Telos; 2004. [Google Scholar]
  32. Rotheram-Borus MJ, Gwadz M, Fernandez MI, Srinivasan S. Timing of HIV interventions on reductions in sexual risk among adolescents. American Journal of Community Psychology. 1998;26(1):73–96. doi: 10.1023/a:1021834224454. [DOI] [PubMed] [Google Scholar]
  33. Rotheram-Borus MJ, Koopman C, Haignere C, Davies M. Reducing HIV sexual risk behaviors among runaway adolescents. Journal of the American Medical Association. 1991;266(9):1237–1241. [PubMed] [Google Scholar]
  34. Rotheram-Borus MJ, Phinney J. Ethnic behavior patterns as an aspect of identity. In: Phinney J, Rotheram-Borus MJ, editors. Children’s ethnic socialization: Pluralism and development. Thousand Oaks, CA: Sage Publications; 1987. pp. 201–218. [Google Scholar]
  35. Rotheram-Borus MJ, Rebchook GM, Kelly JA, Adams J, Neumann MS. Bridging research and practice: Community-researcher partnerships for replicating effective interventions. AIDS Education and Prevention. 2000;12(5):49–61. [PubMed] [Google Scholar]
  36. Rotheram-Borus MJ, Song J, Gwadz M, Lee MB, Van Rossem R, Koopman C. Reductions in HIV risk among runaway youth. Prevention Science. 2003;4(3):173–187. doi: 10.1023/a:1024697706033. [DOI] [PubMed] [Google Scholar]
  37. Schoenwald SK, Hoagwood K. Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services. 2001;52(9):1190–1197. doi: 10.1176/appi.ps.52.9.1190. [DOI] [PubMed] [Google Scholar]
  38. Sogolow ED, Kay LS, Doll LS, Neumann MS, Mezoff JS, Eke AN, et al. Strengthening HIV prevention: Application of a research-to-practice framework. AIDS Education and Prevention. 2000;12(5 Suppl):21–32. [PubMed] [Google Scholar]
  39. Solomon J, Card JJ, Malow RM. Adapting efficacious interventions: Advancing translational research in HIV prevention. Evaluation and the Health Professions. 2006;29(2):162–194. doi: 10.1177/0163278706287344. [DOI] [PubMed] [Google Scholar]
  40. St Lawrence JS, Brasfield TL, Jefferson KW, Alleyne E, O’Bannon RE, Shirley A. Cognitive-behavioral intervention to reduce African American adolescents’ risk for HIV infection. Journal of Consulting and Clinical Psychology. 1995;63(2):221–237. doi: 10.1037//0022-006x.63.2.221. [DOI] [PubMed] [Google Scholar]
  41. Stanton B, Guo J, Cottrell L, Galbraith J, Li X, Gibson C, et al. The complex business of adapting effective interventions to new populations: An urban to rural transfer. Journal of Adolescent Health. 2005;37(2):163. doi: 10.1016/j.jadohealth.2004.10.005. [DOI] [PubMed] [Google Scholar]
  42. Stanton BF, Li X, Ricardo I, Galbraith J, Feigelman S, Kaljee L. A randomized, controlled effectiveness trial of an AIDS prevention program for low-income African-American youths. Archives of Pediatrics and Adolescent Medicine. 1996;150(4):363–372. doi: 10.1001/archpedi.1996.02170290029004. [DOI] [PubMed] [Google Scholar]
  43. Strauss AL, Corbin J. Basics of qualitative research: Grounded theory procedures and techniques. Newbury Park, CA: Sage; 1990. [Google Scholar]
  44. UNAIDS. Report on the global AIDS epidemic: Executive summary. 2006 Retrieved June 9, 2007, from http://data.unaids.org/pub/GlobalReport/2006/2006_GR-ExecutiveSummary_en.pdf.

RESOURCES