Results from the Data & Democracy Initiative to Enhance Community-Based Organization Data and Research Capacity

Abstract

Objectives

In an era of community-based participatory research and increased expectations for evidence-based practice, we evaluated an initiative designed to increase community-based organizations' data and research capacity through a 3-day train-the-trainer course on community health assessments.

Methods

We employed a mixed method pre–post course evaluation design. Various data sources collected from 171 participants captured individual and organizational characteristics and pre–post course self-efficacy on 19 core skills, as well as behavior change 1 year later among a subsample of participants.

Results

Before the course, participants reported limited previous experience with data and low self-efficacy in basic research skills. Immediately after the course, participants demonstrated statistically significant increases in data and research self-efficacy. The subsample reported application of community assessment Skills to their work and increased use of data 1 year later.

Conclusions

Results suggest that an intensive, short-term training program can achieve large immediate gains in data and research self-efficacy in community-based organization staff. In addition, they demonstrate initial evidence of longer-term behavior change related to use of data and research skills to support their community work.

The data needs of community-based organizations (CBOs) have increased in recent years as a result of funders' interest in more formalized program accountability and evaluations^1–3 and evidence-based decision-making.^4–6 Moreover, there is a growing emphasis on community-based participatory research (CBPR) approaches in which CBOs partner with academic or other investigators on research.^7,8 Indeed, building CBO research capacity is a core principle of CBPR.^9–15 Community organizations are better equipped to participate equitably and with shared control over research processes in their community if they possess adequate knowledge and skills related to research terminology and methodologies.⁹ Emerging evidence also suggests that there are increases in the quality of research when investigators partner with the communities being studied.^15–17 For example, a 2001 review of 60 published CBPR studies found greater participation rates, strengthened external validity, and decreased loss to follow-up as a result of community partnerships.¹⁵

Community organizations also have a need for data that will inform their programs, service delivery, and advocacy. Yet CBOs in underserved communities that are rapidly changing because of immigration, residential mobility, and other demographic shifts have difficulty finding secondary data sources that accurately capture the characteristics and experiences of the communities they serve.^18–22

Despite these clear needs, little is known about the data or research capacity of CBOs. Initial evidence suggests that CBOs and local health departments fall short of the data and research skills required for service delivery,^23,24 program evaluation,¹ community assessment,²⁵ or partnering effectively with public health researchers,²⁶ although there is variability in these skills among nonprofits.²⁷ Overall, however, the evidence suggests that their capacity is not keeping pace with increased demand.

Innovative programs that aim to increase CBO research capacity are growing in frequency,^28–34 although published evaluations of such capacity-building programs are limited and often appear in the literature as program descriptions or evaluations of program implementation. Moreover, there are few community research capacity programs that focus on the general research capacity of participants independent of a specific health topic (e.g., environmental health^35–37) or the aims of a concurrent CBPR or other research project.¹⁵

We present evaluation data from Data & Democracy, a community capacity building initiative of the Health DATA (Data. Advocacy. Training. Assistance.) program of the University of California Los Angeles Center for Health Policy Research. The goal of Data & Democracy was to increase the data and research capacity of community-based health organizations by increasing the knowledge and skills of CBO staff to plan and conduct a community health assessment. By “research capacity,” we refer to skills related to the design and methods of collecting primary data. In CBOs this may involve a community needs assessment, program evaluation, or other type of community placed research. We distinguish that from “data capacity,” or a subset of research skills related to finding and using secondary data, as well as data management, analysis, and reporting.

Data & Democracy employed 4 strategies: (1) strong community partnerships that led to trusted endorsements supporting outreach and recruitment of prospective participants; (2) a comprehensive curriculum organized around core data and research skills using adult learning theory and popular education methods³⁸; (3) a train-the-trainer model to ensure diffusion of innovation³⁹ into the community and increase retention of course knowledge and skills for participants as they teach others; and (4) extensive technical assistance and follow-up.

Data & Democracy courses were offered to representatives of CBOs, nonprofits, advocacy networks, and coalitions serving underserved communities, such as low-income, immigrant, homeless, and racial/ethnic minority populations. The purpose of inclusion criteria was to provide capacity-building opportunities to organizations with fewer research training opportunities and limited research infrastructure.

The course curriculum focused on 6 steps for planning and conducting a community health assessment,⁴⁰ using the assessment framework to teach the terminology and skills of a participatory research process. The first step addressed identifying and engaging key partners to plan and conduct a community assessment, pooling resources and skills, and partnering with researchers. The second step, determining an assessment focus, was designed to assist participants, who were more accustomed to writing program goals and objectives, to choose a focal issue(s) and develop clear research questions and assessment goals and objectives. The course's third step guided participants to determine the data needed to answer their research questions, starting first with identifying appropriate secondary data. The fourth step provided an introduction to data collection methods for collecting primary data when adequate existing data are not available. The fifth step reviewed strategies for basic descriptive analysis of quantitative and qualitative data, including the creation and interpretation of graphs and tables. The sixth step covered communicating data and findings in a strategic way to various audiences. Course material was taught through a combination of didactic learning, interactive exercises, homework, and real-world simulations in which participants applied research terms and methods to a community assessment partnership planning process.

After an initial pilot phase, Data & Democracy was funded for 2 cycles. This article combines evaluation findings from the first cycle (2005–2007), implemented in 6 California counties, and the second cycle (2008–2010), implemented in 4 counties. Program efforts in these 10 cohorts reached a total of 171 course participants (108 in cycle 1 and 63 in cycle 2). Sixty-four percent (n = 105) of participants went on to teach 993 coworkers, community partners, and community members as part of the train-the-trainer model, a proportion considerably higher than previous public health train-the-trainer programs.⁴¹

To better understand the broader context of data and research capacity building in which the Data & Democracy training initiative lies, we present a conceptual model in Figure 1, adapted from Kirkpatrick's hierarchical model of training effectiveness.⁴² As can be seen in the figure, this is a straightforward model containing 4 stages of capacity building: reaction, learning, behavior, and results. Kirkpatrick's theory was first developed in 1959 and has arguably become the most widely used model for the evaluation of training and learning.

Figure 1.

Conceptual model of community-based organization data and research capacity building: Data & Democracy training initiative, University of California, Los Angeles Health DATA (Data. Advocacy. Training. Assistance.) Program.

Source. Conceptual model based on Kirkpatrick's hierarchical model of training effectiveness.⁴²

We focused on components of stages 2 (learning) and 3 (behavior) of the model. The learning stage focuses on increases in capacity, and the behavior stage focuses on the extent of applied learning or implementation back on the job. This study first aims to demonstrate whether a capacity-building program can increase the self-efficacy of CBO staff related to data and research knowledge and skills. The second aim takes a longer-term view with the second cycle of participants to determine if new knowledge and skills were translated into changes in behavior, such as the increased use of data and research in their work and the work of their organization.

Methods

The Data & Democracy evaluation employed a mixed-method, pre–post course evaluation design. Capacity change was the primary outcome of the learning stage. Drawing from Bandura's social learning theory, we operationalized capacity change as increases in self-efficacy. Bandura stresses that self-efficacy to use knowledge, rather than knowledge alone, is a necessary precursor of action and sustained changes in behavior.^43–45 A recent study from a similar capacity-building program tailored to community leaders (in this case focused on policy) demonstrated that a 4-session training was able to foster increases in self-efficacy for policy advocacy.⁴⁶ Previous studies have also shown that increased self-efficacy following training predicts behavior among health professionals.^47,48

Thus, we measured participants' self-rated self-efficacy,⁴⁹ or participants' belief in their capacity to apply and execute the core course skills in their prospective work and community context. The core skills covered in the 6-step course and curriculum (Table 1) consisted of 7 training skills (e.g., understanding adult learning theory and training needs), 11 data and research skills (e.g., identifying good sources of community health data, pros and cons of data collection methods), and 1 skill drawing from both (i.e., training others how to plan and conduct a community assessment).

Table 1. Participants' Changes in Training and Research Capacity Measured as Self-Rated Self-Efficacy in 19 Course Skills: Data & Democracy Surveys, California, Cycle 1 (2005–2007) and Cycle 2 (2008–2010).

Confidence Measurement Item	Ratingsa
	Precourse, Mean (SD)	Postcourse, Mean (SD)	Pre–Post Change
Training capacity mean scale	3.12 (0.79)	4.27 (0.61)	+1.14 (0.81)*
Understanding characteristics of an effective trainer	3.44 (0.94)	4.42 (0.76)	+0.98 (1.14)*
Understanding adult learning theory and training needs	2.84 (1.04)	4.40 (0.69)	+1.56 (1.09)*
Identifying and using effective training methods	3.05 (0.96)	4.30 (0.74)	+1.25 (1.16)*
Tailoring new material to a training audience	3.05 (1.05)	4.17 (0.74)	+1.13 (1.01)*
Using audiovisual aids for training purposes	3.40 (1.03)	4.20 (0.81)	+0.80 (1.04)*
Developing a workshop training plan	2.96 (1.00)	4.15 (0.87)	+1.19 (1.09)*
Conducting a community training	3.14 (1.10)	4.25 (0.78)	+1.11 (1.08)*
Research capacity mean scale	2.77 (0.81)	4.16 (0.68)	+1.38 (0.83)*
Developing a community partnership to conduct a community assessment	2.96 (1.16)	4.18 (0.92)	+1.21 (1.11)*
Developing goals and objectives to focus a community assessment	2.87 (0.95)	4.32 (0.76)	+1.45 (1.04)*
Identifying good sources of health data for community advocacy purposes	2.77 (1.06)	4.16 (0.82)	+1.39 (1.13)*
Determining when to collect new health data	2.47 (1.08)	3.93 (1.01)	+1.46 (1.12)*
Identifying pros and cons of various data collection methods	2.65 (1.05)	4.22 (0.83)	+1.56 (1.18)*
Identifying appropriate data analysis methods for quantitative and qualitative data	2.40 (1.15)	4.13 (0.86)	+1.73 (1.25)*
Communicating community assessment findings to targeted audiences	2.94 (1.05)	4.30 (0.81)	+1.35 (1.18)*
Developing a community assessment plan	2.56 (1.06)	4.22 (0.79)	+1.67 (1.15)*
Conducting a community assessment	2.56 (1.09)	4.21 (0.75)	+1.65 (1.17)*
Working with other researchers	3.29 (1.05)	4.04 (0.90)	+0.75 (1.11)*
Telling my community's story in a compelling way to funders and policymakers	3.03 (1.31)	4.04 (0.99)	+1.01 (1.30)*
Training and research capacity: training others how to plan and conduct a community assessment	2.58 (1.27)	4.12 (0.79)	+1.54 (1.28)*

Note. From pre- and postcourse surveys, n = 142 matched pairs.

^a“How confident you feel today in this skill?” (scale from 0 to 5, where 5 = “extremely confident”).

^*Wilcoxon Sign Rank Test P < .001.

We utilized data from 3 evaluation data collection methods. The first was a brief application survey, taken online via SurveyMonkey (SurveyMonkey.com LLC, Palo Alto, CA) by each applicant to the Data & Democracy course. In addition to questions used to determine applicant course eligibility, further items gathered information about applicants' organizational characteristics (i.e., target population(s), number of staff, annual budget) and previous research and data experience (i.e., accessing, collecting, and using health data; conducting community assessments).

The second data collection method was a precourse survey administered in person to course participants at the beginning of the course's first day, and a postcourse survey administered at the end of the third (last) day of the course. Participants' self-efficacy in the 19 core course skills was measured via 19 identical items in both surveys asking, “Please circle the number that indicates how confident you feel today in this skill.” Each item used a 6-point response scale from 0 to 5, where 5 is “extremely confident” and 0 is “not at all confident.” (We used a 6-point scale to eliminate a neutral option and force respondents to attribute a positive or negative rating to the question. Although there are 6 options, the maximum rating is a 5.)

The third data collection method included 2 follow-up surveys administered via SurveyMonkey at 4 months (wave 1) and 1 year (wave 2) after course completion. Course participants were e-mailed invitations with links to participate in the survey. To maximize response rates, Health DATA staff sent at least 2 e-mailed reminders to each of the course participants, as well as a third or fourth contact via e-mail or phone call. Most wave 1 follow-up survey items were related to the implementation, process, and perceived outcomes of trainers' community workshops, and thus are not presented here. This survey had an 81% response rate. Wave 2 follow-up survey items explored behavior change, measured as the longer-term use and application of course skills and data by both the course participants and their organizations. By the wave 2 survey, the respondent sample had decreased to 36 of the 63 participants (57% response rate) because of attrition. The follow-up data are presented here.

Pre- and postcourse surveys were kept anonymous by using randomly generated participant IDs for matching them to each other. Anonymity was also protected for the follow-up surveys. It was important to the evaluation that participants felt comfortable being candid about the course experience and their workshop completion, despite the fact that Health DATA staff were their trainers, technical assistance providers, and also those requesting evaluative feedback. However, because of this anonymity, data collected from the pre–post surveys could not be linked to application survey or follow-up survey data.

For aim 1, we used univariate analyses to describe the course participants and calculate precourse, postcourse, and pre–post difference scores for each of the participants in each of the 19 course capacities. Participants for whom pre- and postcourse survey data could not be matched were deleted from further analysis. Twenty-nine cases were thus deleted, yielding a sample of 142 course participants for capacity change analysis. (These participants' pre–post surveys could not be matched because of late arrival, early departure, or unmatchable survey numbers occurring as a result of administrator or respondent error.) An additional 29 participants were missing a pre- or postcourse response for at least 1 of the 19 items. (We conducted a sensitivity analysis to determine if missing responses differed in a systematic way from nonmissing responses, and detected no significant differences in item responses among nonmatched individuals.) We imputed missing values by using the corresponding pre- or postcourse value from the same item. In other words, in these cases, the amount of change would be equal to zero. This served to maintain a larger sample size while having a conservative effect on results.

Because of the nonparametric and dependent nature of the 2 pre- and postcourse scores, we used Wilcoxon signed rank tests to test differences in pre–post capacity (matched Likert scores).⁵⁰ We created mean scales of the 7 training skills and the 11 data and research skills to determine if there were differences in course participants' capacity and pre–post capacity change in these 2 areas, as well as to create a more reliable multiitem measure of capacity change.⁵¹ To evaluate scale internal consistency, we explored interitem correlations and calculated Cronbach's α.⁵² Cronbach's α for both scales were greater than or equal to 0.9 (not shown), indicating excellent internal consistency.⁵³

For aim 2, we restricted the analytic sample to 36 of the 63 participants of the second cycle of Data & Democracy who completed the wave 2 follow-up survey because wave 2 surveys were first implemented in this second cycle's evaluation. Simple univariate and bivariate descriptive statistics were conducted to evaluate reported behavior change.

Results

Maximum enrollment for each course was set at 30 to maximize interaction and personalized attention. There were 238 total applicants for the 6 courses of cycle 1 (averaging 27 waitlisted applicants per course), and 247 applicants for the 4 courses of cycle 2 (averaging 37 waitlisted applicants per course). Priority for admission was given to applicant staff at nonprofit CBOs working in underserved California communities.

Of the 171 total course participants, 144 (84%) completed an application survey. Table 2 demonstrates that participants came to the course with more experience with training than with data. Forty-two percent had previously trained groups “many times.” Yet only 22% reported “a lot of experience” collecting data, and 16% reported “a lot of experience” analyzing data and using it to inform organizational, programmatic, or advocacy decisions. Participants reported more direct experience with conducting a community assessment, as 45% had previously worked on a community assessment. Participants came from organizations typical of those representing and serving underserved communities (i.e., nonprofit, community-based, service delivery, and advocacy organizations). The organizations ranged in size of budget and staff. The participants themselves were a diverse group, as 42% were bilingual, speaking more than 5 languages.

Table 2. Participants' Previous Training and Data Experience and Organizational Characteristics: Data & Democracy Application Survey, California, Cycle 1 (2005–2007) and Cycle 2 (2008–2010).

Characteristics	Valid %
Participant characteristics
Previous training experience
I have trained groups many times	42
I have trained groups a few times	40
I do not have training experience	15
Previous experience collecting data
A lot of experience	22
Some experience	56
Little or no experience	21
Previous experience analyzing data
A lot of experience	16
Some experience	59
Little or no experience	23
Previous experience using data in community work
A lot of experience	16
Some experience	59
Little or no experience	24
Previous experience with community assessments
Worked on one myself	45
Had contact with one conducted by others	26
Little or no experience	28
Language capacitya
English only	59
Spanish only	20
English–Spanish bilingual	13
English–other language bilingual	7
Organizational characteristics
Organization type b,c
501(c)3 status nonprofit	73
Community-based or grassroots	46
Municipal or county health or other department	16
Hospital, clinic, or other service provider	14
State health or other department	7
Private or incorporated	4
Academic institution	4
Other	21
Organizational size, no. staff
1–5	17
6–10	14
11–20	15
> 20	53
Organizational budget, $/y
< 100 000	13
100 000–1 000 000	34
> 1 000 000	49
Organization focus b,c
Health outreach, promotion, or education	86
Advocacy or public policy	66
Program planning or implementation	59
Care or service delivery	45
Research or evaluation	32
Volunteer	23
Consulting	14
Other	18
Target population(s)b
Spanish monolingual	69
Low-income	92
Immigrant	71
Homeless	56
African American	65
American Indian	46
Asian/Pacific Islander	60
Latino	80
Other	32

Note. The total sample size was n = 144.

^aCollected from cycle 1 only (n = 88).

^bMultiple replies allowed.

^cCollected from cycle 2 only (n = 56).

Capacity Change

Table 1 summarizes pre–post course capacity on the 19 training and research skills taught in the course. Precourse capacity scores ranged from 2.40 to 3.44 on the scale of 0 to 5, with 5 being “extremely confident.” Participants reported more confidence in training skills than in data and research skills before the course began. In the postcourse survey, average self-efficacy ratings on the 19 course skills ranged from 3.93 to 4.42. This time the difference in the mean scores on the training scale and data and research scale was smaller.

Pre–post change scores for each of the 19 course skills were positive, on average, demonstrating a statistically significant increase in self-efficacy for each of the skill areas covered in the course. Pre–post changes in the 2 capacity scales showed a 1.14 average improvement in training capacity and a 1.38 average improvement in data and research capacity (both P< .001). Although a single item rather than a scale, the course skill that incorporated both training and research skills (“training others how to plan and conduct a community assessment”) demonstrated the largest improvement (mean = 1.54) as a result of the course.

Behavior Change

At the wave 2 follow-up survey (1 year after training), the majority of respondents reported applications of the community assessment skills taught in the course to their work. The most frequently mentioned skills used most in their work since the course (Table 3) included developing goals and objectives to focus a community assessment, identifying good sources of health data for community advocacy, communicating findings to targeted audiences, and identifying the pros and cons of various data collection methods. The majority reported that the course gave them skills that enhanced their current work on community assessments. In addition, 1 in 3 reported that the course taught them skills they have applied to other research activities, and nearly a quarter expected to apply the skills to future community assessments. Only a small proportion (6%) reported no change in their approach to community assessment since the course.

Table 3. Participants' Frequency of Use of Data and Application of Community Assessment Skills: Data & Democracy Wave 2 Follow-Up Survey, California, Cycle 2 (2008–2010).

Participant Skill	No. (Valid %)
Community assessment skills used most since coursea
Developing a community partnership to conduct assessment	6 (17)
Developing goals and objectives to focus a community assessment	17 (48)
Identifying good sources of health data for community advocacy	12 (34)
Determining when to collect new health data	5 (14)
Identifying pros and cons of various data collection methods	10 (29)
Identifying appropriate data analysis methods	6 (17)
Communicating assessment findings to targeted audiences	10 (29)
Developing community assessment plan	2 (6)
Working with other researchers	9 (26)
Telling my community's story to funders and policymakers	8 (23)
Planning or implementing program or policy change	8 (23)
Changes in approach to assessments since courseb
Approach not changed	2 (6)
Enhanced current work on community assessments	20 (56)
Will apply skills to future community assessments	8 (22)
Applied skills to other research processes	11 (31)
Frequency of use of data since course
Much more frequently	4 (11)
More frequently	11 (31)
About the same frequency	16 (44)
Less frequently	3 (8)
Don't use data in work	2 (6)
Frequency of presenting data since course
More often than before	11 (31)
With about the same frequency	20 (56)
Less frequently	3 (8)
Have not presented data	0
Organization's frequency of use of data for funding since course
Yes, more often than before	15 (42)
No, frequency the same	15 (42)
Not tried to use data for funding since course	5 (14)
Organization's frequency of use of data for advocacy since course
Yes, more often than before	15 (42)
No, frequency the same	19 (53)
Not tried to use data for advocacy since course	0
Organization's frequency of use of data for program or policy development since course
Yes, more often than before	14 (40)
No, frequency the same	13 (37)
Not tried to use data for program or policy since course	6 (17)

Note. The sample size was n = 36.

^aRespondents could check up to 3 responses.

^bRespondents could check all that apply.

About a third of course participants reported using data “more frequently” in their work since taking the course, with an additional 11% using data “much more frequently.” Forty-four percent reported no change in use, and 8% reported decreased frequency. Nearly one third reported an increase in their use of data they present to others, such as in grant proposals, newsletters, and presentations.

Table 3 also summarizes reported changes in the use of data in the course participants' organizations to determine whether there is evidence of an increase in organizational, not just participant, behavior change since the course. Approximately 4 in 10 reported that their organization had used data more frequently to develop funding, advocacy, or for policy or program development activities.

Discussion

Proficient use of data is increasingly seen as essential for heightening awareness of health problems and informing strategies to improve health, especially in underserved communities experiencing persistent disparities.^1–8 However, little research has focused on understanding how CBOs acquire and use health data or collect primary data within the populations they serve.^23–27 Importantly, CBOs have limited opportunities to build their capacity to actively participate in research processes, and few studies have evaluated the capacity-building programs that do exist.

Results from our Data & Democracy program and evaluation demonstrate that there was a high demand for this course, suggesting a need among CBO staff to enhance these skills. Furthermore, the Data & Democracy course was successful in demonstrating evidence of the “learning” phase of capacity building according to our conceptual model: increasing participants' self-efficacy related to core data and research skills. Before participating in the course, participants had limited previous experience collecting, analyzing, and using health data. Although they reported more experience with community assessments before the course, they nonetheless reported low baseline self-efficacy in the actual skills used in the community assessment process. After course participation, however, participants reported greater improvements in their data and research capacity, and the gap between their perceived training and data capacity narrowed by the end of the course.

Although our wave 2 sample was relatively small, results provide initial evidence of the behavior phase of capacity building: application of data and research capacity to participants' community work. Our results demonstrate that, a year after the course, the majority of participants did increase their engagement in the research process, reporting use of the data and research skills taught in the course, as well as application of those skills to community assessments. Approximately 40% were using and presenting data more frequently in their work, and their organizations were using data for funding, advocacy, and program or policy development more frequently since the course. These results suggested that participants were closer to reaching the longer-term “results” stage of capacity building than we had expected.

The application of Kirkpatrick's model to a capacity-building framework is critical because it acknowledges and articulates important measures of the process of taking in and adopting new capacities, regardless of where along the capacity spectrum a trainee begins and ends. In the field of community capacity building, where audiences range significantly in former training, background, and expertise, evaluation of trainee progress must keep in mind this learning progression. Indeed, these results provide evidence that these participants moved forward along a continuum of data and research self-efficacy. Research self-efficacy is important for CBOs using health data to support their work and working in partnership with researchers. Knowledge of terminology and methods is important, but will only go so far in the deliberative process of research design. The community representative must also have the confidence to design or partner in a research process appropriate to their community contexts and organizational needs.

This study had several strengths. First, it included a large sample that participated in courses over a 5-year period, representing diverse communities, organizations, and geographic regions of California. Second, although the change in capacity was not positive for every course participant in every skill area (as might be expected), our analysis yielded significant pre–post capacity changes for both individual items and scaled skill areas. Our main limitation was our inability to link any surveys, except for the pre- and postcourse surveys to each other, because of a priority to maintain survey confidentiality. This meant that we were unable to explore individual or organizational determinants of self-efficacy, or the role of self-efficacy in behavior a year later. Another limitation was that the application process and our limited evaluation resources did not allow us to randomly assign CBO staff to a course and comparison group. As a result, our follow-up survey questions relied on participant self-report of what had changed in their work as a result of their participation in Data & Democracy.

Nonetheless, our results suggest that an intensive, short-term training program can achieve large immediate gains in data and research self-efficacy in community-based organization staff. In addition, they demonstrate initial evidence of behavior change related to use of data and research skills to support their community work a year later. We argue that providing data and research capacity-building opportunities and resources to CBOs working in community health is both an essential piece of building infrastructure for these organizations' growing data needs, and a facilitator of more equitable and effective partnerships with researchers. Although the purpose of this 3-day course was not to create researchers, CBOs that are better “consumers” of health data and empowered participants in research processes are more effective in assessing their community's health needs, advocating and planning for needed programs and services, and employing evidence-based practice.

The community research capacity literature has identified the need for validated measures of research capacity to truly understand the impact capacity-building efforts have on CBOs and the community at large.³⁴ Although we did not set out to create validated measures, we hope that these results will inform that effort by providing a conceptual model of the community research capacity–building process, and providing a case study of how this sample of CBOs experienced learning and behavior change. Future research should attempt to capture all stages of community research capacity development to better understand the process and the outcomes of such research capacity–building efforts.