Skip to main content
Implementation Science : IS logoLink to Implementation Science : IS
. 2019 Jan 28;14:9. doi: 10.1186/s13012-019-0855-9

Study protocol: a pragmatic, stepped-wedge trial of tailored support for implementing social determinants of health documentation/action in community health centers, with realist evaluation

Rachel Gold 1,2,, Arwen Bunce 2, Erika Cottrell 2,3, Miguel Marino 3, Mary Middendorf 2, Stuart Cowburn 2, Dagan Wright 2, Ned Mossman 2, Katie Dambrun 2, Byron J Powell 4, Inga Gruß 1, Laura Gottlieb 5, Marla Dearing 2, Jason Scott 1, Nadia Yosuf 1, Molly Krancari 2
PMCID: PMC6348649  PMID: 30691480

Abstract

Background

National leaders recommend documenting social determinants of health and actions taken to address social determinants of health in electronic health records, and a growing body of evidence suggests the health benefits of doing so. However, little evidence exists to guide implementation of social determinants of health documentation/action.

Methods

This paper describes a 5-year, mixed-methods, stepped-wedge trial with realist evaluation, designed to test the impact of providing 30 community health centers with step-by-step guidance on implementing electronic health record-based social determinants of health documentation. This guidance will entail 6 months of tailored support from an interdisciplinary team, including training and technical assistance. We will report on tailored support provided at each of five implementation steps; impact of tailored implementation support; a method for tracking such tailoring; and context-specific pathways through which these tailored strategies effect change. We will track the competencies and resources needed to support the study clinics’ implementation efforts.

Discussion

Results will inform how to tailor implementation strategies to meet local needs in real-world practice settings. Secondary analyses will assess impacts of social determinants of health documentation and referral-making on diabetes outcomes. By learning whether and how scalable, tailored implementation strategies help community health centers adopt social determinants of health documentation and action, this study will yield timely guidance to primary care providers. We are not aware of previous studies exploring implementation strategies that support adoption of social determinants of action using electronic health and interventions, despite the pressing need for such guidance.

Trial registration

clinicaltrials.gov, NCT03607617, registration date: 7/31/2018—retrospectively registered

Electronic supplementary material

The online version of this article (10.1186/s13012-019-0855-9) contains supplementary material, which is available to authorized users.

Keywords: Social determinants of health, Electronic health records, Community health centers, Implementation, Implementation strategies

Background

“Social determinants of health” impact health risks and outcomes [112]. For example, adverse social determinants (e.g., chronic stress, poverty, lack of access to healthy foods/safe exercise) create barriers to acting on diabetes care recommendations, increasing risks of poor diabetes outcomes [1321]. Through such mechanisms, social determinants contribute to health disparities, hamper efforts to implement guideline-based care, and break the link between care quality and health outcomes [3, 2225]. A small but growing body of research shows that documenting patients’ social determinants of health in healthcare settings leads to improved receipt of social services and improved health outcomes [2629]. Social determinants documentation in electronic health records can also improve care teams’ ability to track and respond to patients’ social needs systematically [3033].

Thus, numerous national leaders now recommend documenting social determinants of health in electronic health records, and taking action to address social determinants of health (e.g., referring patients to social service agencies; adapting care plans as needed) [31, 3440]. Since such documentation/action may become required for some care providers, especially those in Accountable Care Organizations [41], many health care delivery systems are exploring ways to incorporate social determinants of health screening/action into routine care [28, 4244], including through more routine documentation of patient-reported social determinants of health in electronic health records [32, 33, 45, 46].

Systematic electronic health record documentation of patients’ social determinants of health needs could help care teams understand potential impacts on their patients’ health and ability to act on care recommendations [28, 40, 4751] and adjust care plans accordingly (e.g., prescribe medications that do not require refrigeration if a patient is homeless) [29, 52], or intervene to address social determinants of health (e.g., through referrals to community resources) [29, 5257]. Well-documented social determinants of health could also identify needed social service resources [47] and inform health care payment structures that account for the social vulnerability of a clinic’s patient population [5860]. And, while emergent research suggests the health benefits of social determinants documentation/action, improving such documentation in electronic health records will enable further scientific assessment of which social determinants most impact specific patients’ health, and how clinical teams can intervene to address these impacts.

These benefits cannot accrue without effective strategies for implementing social determinants of health data documentation/action, but little evidence yet exists to guide integrating social determinants of health documentation into standard practice [28, 42, 6164]. The need for such guidance is especially urgent in primary care community health centers, which serve patients whose health risks are high, and whose exposure to social determinants of health are profound [17, 20, 21, 6567]. Although community health centers have long sought to understand and address the social factors that impact health, their efforts have typically been ad hoc and rarely documented in electronic health records [15, 24, 25, 65, 6875].

Some efforts to help community health centers and other primary care settings adopt systematic social determinants of health documentation in electronic health records are underway. The National Association of Community Health Centers’ “Protocol for Responding to and Assessing Patient Assets, Risks, and Experiences” (PRAPARE) [76] outlines how community health centers can collect patient-reported social determinants of health data and suggests electronic health record-based social determinants of health data documentation tools.

Our team built on PRAPARE in a recent pilot study (R18DK105463) that sought to optimize the documentation and presentation of social determinants of health data within standard electronic health record functions. (We believe this was the first US study on documenting standardized social determinants of health data using electronic health record-based tools in community health centers) [45, 46]. We developed a suite of electronic health record-based social determinants of health data tools [45, 77] and activated them in a network of > 500 community health centers with a shared electronic health record in June 2016. These tools are described elsewhere [46, 77]. Three pilot study clinics were also given electronic health record tools to facilitate referring patients with social determinants of health needs to community resources. These tools enable staff to give patients information about local services; provide “internal” referrals to social workers, community health workers, etc.; and help patients make appointments with those services. The tools’ lists of available community resources must be manually updated by clinic staff.

Our pilot study demonstrated the feasibility of developing electronic health record tools for social determinants of health documentation/action. It also revealed myriad implementation barriers. Some barriers were similar to those associated with implementing other patient-reported data collection [7884], such as difficulties with optimizing workflows/minimizing logistical burdens; staff turnover; adequately training relevant staff; billing for staff time spent collecting and acting on these data; knowing which patient-reported measures are most important; having resources for addressing identified needs; and ensuring that the right staff see the needed data at the right workflow step and can respond to these data [78, 79, 8190]. Barriers specific to adoption of social determinants of health documentation/action included the need to change perceptions of healthcare teams’ responsibilities; lack of clarity about how to make social determinants of health-related “referrals”; clinic staff concerns about collecting data on social determinants of health needs when no “action” could be taken to address those needs; limited knowledge of how to use the electronic health record for this purpose; false-positive screening results (e.g., patient has food insecurity, but already accesses a food bank); the initial lack of a method for documenting whether patients want help; and inadequate infrastructure, incentives, and decision support for effective social determinants of health screening/action.

Such barriers could substantially hamper implementation of social determinants of health documentation, thus impeding community health centers’ (and others’) ability to use social determinants of health data. The “ASCEND” trial (1R18DK114701-01, ApproacheS to Community Health Center ImplEmeNtation of Social Determinants of Health Data Collection and Action), described here, will test whether and how providing tailored, scalable, pragmatic implementation support helps community health centers adopt social determinants of health screening documentation/action using electronic health record tools. To our knowledge, no previous trials have formally tested implementation strategies targeting electronic health record-based social determinants of health documentation/action [91]. Secondary analyses will assess impacts of social determinants of health documentation and action on care quality and biomarkers in patients with/at risk for diabetes (an expected subset of screened patients); only a few previous studies have assessed such impacts [2628, 57]. Study results could inform diverse national efforts to increase social determinants of health documentation and action.

This study will directly address dissemination and implementation science priorities by evaluating the impact of providing tailored implementation strategies [9296], and demonstrating a method for tracking such tailoring [97100]. Through this method, we will report on how support was tailored at each implementation step. To augment this information, our realist evaluation will identify context-specific pathways through which these tailored strategies effect change [101, 102]. This study was approved by the Kaiser Permanente Northwest Institutional Review Board.

Methods

This 5-year study began in September 2017. It is being conducted at OCHIN (not an acronym), a non-profit health center-controlled network that hosts and centrally manages an Epic© electronic health record for > 500 primary care community health centers located in 18 states, as of July 2018 [103105]. OCHIN’s electronic health record is shared by its member community clinics, making it the nation’s largest community health center network on a single electronic health record instance. Table 1 shows the characteristics of OCHIN community health centers’ patients seen between June 2016 and May 2018. The table shows that OCHIN community health centers’ patients’ socioeconomic risks are reflected in social determinants of health data already collected per federal requirements: 21% are uninsured and 63% are publicly insured; only 37% are white; 31% are of Hispanic ethnicity, 28% primarily non-English speakers, and 62% are from households < 138% of the federal poverty level.

Table 1.

Demographic characteristics of OCHIN patients with an ambulatory visit/office encounter, 6/24/2016–5/17/2018

N %
Total 1,739,812 100
Sex
 Female 972,929 55.9
 Male 766,733 44.1
 No information 150 0.0
Race/ethnicity
 Hispanic 545,346 31.3
 Missing 100,472 5.8
 Non-Hispanic Black 298,095 17.1
 Non-Hispanic other 158,067 9.1
 Non-Hispanic White 637,832 36.7
Language
 English 1,234,791 71.0
 Spanish 353,289 20.3
 Other 123,515 7.1
 No information 28,217 1.6
Age at first encounter in study period
 0–9 259,146 14.9
 10–19 247,443 14.2
 20–29 282,537 16.2
 30–39 269,013 15.5
 40–49 220,378 12.7
 50–59 225,785 13.0
 60–69 154,131 8.9
 > = 70 81,377 4.7
 No information 2 0.0
Household income as % of federal poverty level
 <= 138% 1,078,603 62.0
 > 138% 265,644 15.3
 No information 395,565 22.7
Current insurance status
 Medicaid 897,582 51.6
 Medicare 156,719 9.0
 Other public 42,906 2.5
 Private 270,515 15.5
 Uninsured 372,090 21.4

The social determinants of health data tools in OCHIN’s electronic health record are the “innovation” whose adoption is targeted in this study. The tools were fine-tuned for the current study, based on lessons from the pilot study and formative analyses (described below), and to ensure their alignment with the Epic© electronic health record’s 2018 social determinants of health module. They include options for clinic staff to document social determinants of health data directly into the electronic health record, or for patients to do so through the patient portal or a tablet at the clinic. If patients complete social determinants of health screenings on paper, the data must be entered into the electronic health record by clinic staff. Social determinants of health screening results and past social determinants of health-related referrals are shown in an social determinants of health summary, with positive screening results highlighted visually (Fig. 1). The social determinants of health questions in the tools align with those recommended by several national groups [30, 45, 76, 77].

Fig. 1.

Fig. 1

Social determinants of health summary view

We will provide step-by-step tailored implementation support to the 30 study community health centers (details below) and evaluate how effectively this intervention supports such clinics’ adoption of social determinants of health screening/action, as documented in the electronic health record. This is a mixed-methods, pragmatic, stepped-wedge, cluster-randomized trial, with a hybrid type 3 implementation-effectiveness design: we focus on adoption of electronic health record documentation of social determinants of health data and processes, and also consider the health impacts of this adoption [106109]. Primary outcomes are adoption of electronic health record-based social determinants of health documentation/action; secondary outcomes are the impact of such adoption on the health of adults with/at risk for diabetes. (Study clinics will decide which patients they want to screen; we will conduct secondary analyses among those with diabetes.) Cluster randomization enables controlling for clinic-level characteristics, appropriate to our primary outcomes of clinic-level changes. The stepped-wedge design, with six wedges, enables us to provide the intervention to five community health centers at a time while ensuring that all study clinics eventually receive the intervention, which will help with participation and retention and has advantages over parallel cluster-randomized trials in terms of statistical power [110] (Table 2).

Table 2.

Stepped-wedge design

Study step Study months
1–6 7–12 13–18 19–24 25–30 31–36 37–42 43–48 49–54
Wedge 1 (CHCs 1–5) C C, BL I FU FU FU FU FU FU
Wedge 2 (CHCs 6–10) C C C, BL I FU FU FU FU FU
Wedge 3 (CHCs 11–15) C C C C, BL I FU FU FU FU
Wedge 4 (CHCs 16–20) C C C C C, BL I FU FU FU
Wedge 5 (CHCs 21–25) C C C C C C, BL I FU FU
Wedge 6 (CHCs 26–30) C C C C C C C, BL I FU

C, control period; I, intervention period; BL, baseline survey; FU, follow-up

Conceptual guide

This study is guided by the “building blocks of primary care” [111], which outlines components essential to high-performing primary care practices, building on Starfield’s four pillars of primary care practice, and elements of the Joint Principles and Primary Care Medical Home recognition standards [112]. Its foundational “building blocks” are (1.) engaged leadership; (2.) data-driven improvement using electronic health records; (3.) empanelment; (4.) team-based care. The intervention directly addresses these four building blocks as they relate to social determinants of health screening/action using electronic health record tools (Tables 3 and 4). A realist evaluation framework will guide our evaluation of the causal processes that lead to intervention outcomes [113]. Measurement of implementation success is guided by the RE-AIM framework [114]. Analysis details are given below.

Table 3.

Characteristics of study implementation strategies, per Proctor et al. [116]

Implementation strategies Proctor et al. categories for reporting on implementation strategies
Target Actor Action Outcome Temporality Dose
1. The clinic action plan (CAP) SDH operational/clinical champions Implementation support team (IST) Providing the strategy/materials/training to the clinic Champion understands and tracks needed tasks At the beginning of wedge Once
2. Technical assistance—implementing SDH screening Champion has needed tools to make decisions about SDH implementation (workflows; rollout plans) When clinic is ready to develop workflow and rollout plans Once, although revisited as needed
3. Technical assistance—using the EHR Champion has the information needed to train clinic staff in the EHR’s SDH tools When the champion is ready to train staff on the tools Once, although revisited as needed
4. Ongoing technical assistance, tailored problem-solving
4a. Bi-monthly hour-long webinars/office hours/peer support Champions learn about each implementation step and seek expert/peer advice related to that step Throughout the 6-month intervention Twice monthly
4b. Monthly hour-long coaching call Champions receive one-on-one coaching to address their clinic’s needs Throughout the 6-month intervention Once monthly
4c. Email questions All clinics’ champions receive information about implementation processes and problem-solving at all wedge sites Throughout the 6-month intervention Once monthly

Table 4.

Implementation support components

CAP step Tasks for this step Format of support Specifics of implementation support strategy Implementation strategy type, per ERIC categorization scheme [128]
Step 1. Create an “SDH team.” Obtain leadership support (BBPC #1).
Identify, orient clinic champion/study contact.
Materials For clinic leaders: benefits of SDH documentation/action; leaders’ role in supporting SDH process adoption Recruit, designate, train for leadership; orientation materials
Clinician champion orientation, task summary materials
Project champion orientation, task \summary materials
Draft email from leadership to clinic staff alerting staff to SDH plan Technical assistance
Office hours Covering: (1) orienting champions; (2) goal setting Identify/prepare champions; recruit, designate, train for leadership; orientation materials; peer-to-peer learning
Call With implementation support team: orientation Technical assistance
Step 2. Identify clinic goals. Identify clinic’s goals for SDH screening, and which patients will be screened for which SDH measures. Materials Decision tools: why do you want to collect SDH data? What do you hope to accomplish? What do you plan to do with the SDH data? Which patients do you want to screen? How often? For which SDH? Goal identification/implementation blueprint
Written recommendations/key considerations for selecting clinic goals Goal identification; technical assistance
Summary of the clinic’s stated goals Goal identification
Office hours Covering: (1) goal setting; (2) learning the EHR tools Goal identification/implementation blueprint; peer-to-peer learning
Call With implementation support team: identify goals Goal identification/implementation blueprint
Step 3. Create an “SDH plan.” Create a workflow plan for SDH documentation, and (if desired) SDH data review and action (BBPC #3, 4).
Create a rollout plan.
Materials Planning tools: SDH documentation workflow; SDH data review/action workflow; workflow implementation rollout Technical assistance
Resource list (PRAPARE, HealthLeads, etc.)
Guides to using EHR’s SDH data tools: in workflows; in SDH documentation, on site or via patient portal; to review SDH; for SDH referral-making (with guidance on creating a social service resource list)
Written materials: pros and cons of different SDH documentation workflow options; key considerations based on other CHCs’ experience
Summary of the clinic’s stated workflow plan Goal identification/implementation blueprint; technical assistance
Call With implementation support team: workflow development, use of workflow planning tools, rollout plan Technical assistance
Office hours Covering: (1) workflow planning; (2) EHR tools within workflows Peer-to-peer learning; technical assistance
Step 4. Train clinic staff in the “SDH plan.” Orient staff: staff meeting.
If SDH plan changes, orient staff. Train new staff as needed.
Materials Orientation webinar for clinic staff; review clinic’s goals and workflow plan; include staff discussion of potential barriers/how to address them. Educational meeting/materials; goal identification
Written materials: how to orient clinic staff to SDH documentation and action, based on other CHCs’ experiences Educational meeting
Template slides/handouts for updating staff and/or training new staff Educational meeting; technical support
Call With implementation support team: how to train staff
Office hours Covering: (1) how to train staff; (2) how to create target population reports and adoption reports Peer-to-peer learning; technical assistance
Step 5. Roll out the “SDH plan.” Review adoption rates on a regular basis (BBPC #2).
Iterate/revise rollout, workflows as needed.
Materials Guides: using SDH data tools to review SDH documentation/action data; using SDH documentation data to track progress; testing workflows Audit and feedback
Call With implementation support team: develop strategy for testing workflows, addressing barriers, rollout, review of adoption progress; how to track SDH adoption progress using data tools; how to revise workflows, rollout plan as needed Audit and feedback; technical assistance; practice facilitation/small tests of change; tailor strategies
Tools Provide monthly adoption reports Audit and feedback; tools for quality monitoring
Office hours Covering: how to iterate and refine workflows; other topics identified as needed by the clinics or the IST Peer-to-peer learning; technical assistance; ongoing consultation

Abbreviations: SDH social determinants of health; IST implementation support team; Q&A questions and answers; BBPC building blocks of primary care

Recruitment and randomization

We recruited eight community health center organizations from OCHIN’s membership for formative interviews with clinic staff, targeting clinics with prior social determinants of health documentation in the electronic health record’s social determinants of health data tools. Thirty additional OCHIN member community health centers will be recruited in two waves for the trial portion of the study, targeting those who want to initiate or improve their social determinants of health documentation/action efforts. The first wave of 15 practices was recruited in the spring of 2018 and block-randomized to wedges 1–3 with 5 clinics per wedge. The second wave of 15 practices will be recruited in 2019 and randomized to wedges 4–6 as in wave 1. This two-wave process ensures that no recruited clinics will wait more than a year to receive the intervention, important both for recruitment and because the rapidly changing social determinants of health screening landscape means clinics’ needs and interests may change between recruitment periods. As our primary outcomes can be derived historically from the electronic health record, we will obtain pre-intervention data at all time points as required to evaluate stepped-wedge trials. All study clinics will receive the same intervention; randomization staggers the timing of when the intervention starts (Table 2).

Study clinics will be asked to identify a clinician champion and/or a “Social determinants of health Operational Champion” to oversee the clinic’s social determinants of health implementation efforts, and take part in the intervention’s implementation support activities. The clinics will receive a description of the tasks involved with each role and may select staff for these roles as they deem appropriate.

The implementation support intervention

Implementation support will be provided to one “wedge” of five community health centers at a time by a multi-disciplinary implementation support team, for 6 months per wedge (Tables 3 and 4). Implementation support team members have expertise in social determinants of health, clinic workflows and practice change implementation, and electronic health record use. (If any needed competencies are identified that the implementation support team does not have, we will bring in the needed expertise and document the skills needed to support community health centers’ social determinants of health screening/action adoption.) We expect that implementation support team members will spend approximately 1 h/month in calls with each study clinic, 2 h/month on office hours, 1–2 h/week to discuss the clinics’ progress and needs internally, and 1–2 h/week to respond to clinic emails, for a total of 15–23 h per month to support five clinics. We will document whether more or less time is needed.

The tailored support uses implementation strategies selected for their demonstrated effectiveness at supporting practice change [98, 115126], results from our pilot study, and potential scalability. They include staff training, technical assistance, audit and feedback, goal identification, leadership engagement, practice coaching, peer-to-peer learning, orientation materials, and implementation guides. This approach is based on evidence that practice change is best supported by a combination of implementation strategies, e.g., “change toolkits” are more likely to be adopted if guidance for their use is also provided. Table 3 shows characteristics of each implementation strategy, as per Proctor et al.’s implementation strategy reporting recommendations [117].

In each implementation step, these strategies will be supported by specific materials and interactions with the study clinics (Table 4). This “lesson plan” approach, in which the implementation support team provides each clinic with just the materials needed for their next implementation step (although all materials will be available on a learning management system), is designed to avoid overwhelming the clinics with too much information at once [127].

Implementation strategies 1–4

  1. The clinic action plan. This step-by-step guide to implementing social determinants of health data documentation/action (first two columns, Table 4) was developed based on findings from our pilot study.

  2. Technical assistance—implementing social determinants of health screening. We will provide written materials to support each clinic action plan step. These were informed by social determinants of health implementation guides developed by national groups (e.g., PRAPARE, HealthLeads) [76, 128] with input from these groups and by learnings from our pilot study [46, 77]. The materials include recommendations and decision tools for each step. Figures 2 and 3 are examples of these decision tools. The entire implementation guide is in Additional file 1.

  3. Technical assistance—using the electronic health record. We found no existing social determinants of health implementation guides that emphasize use of electronic health record data tools. Our team developed training materials on the use of the electronic health record’s tools for social determinants of health documentation/action. They include tips on using the social determinants of health tools in workflows; illustrated guides to using the electronic health record tools for social determinants of health screening/action and for monitoring the clinic’s tool use adoption; and information on how to identify community social service agencies to which patients can be referred.

  4. Ongoing technical assistance, tailored problem-solving:
    1. Bi-monthly hour-long webinars/office hours/peer support: The implementation support team will hold “office hours” via webinar every 2 weeks; study clinics will be encouraged to attend and submit questions in advance. Each webinar will focus on one aspect of social determinants of health adoption, determined by clinic request/the coach’s knowledge of the clinics’ progress. To support peer-to-peer learning, we will ask clinics that have made progress in a given step to present on their success, and encourage discussion across sites.
    2. Monthly hour-long coaching call: A member of the implementation support team will meet with each clinic’s champion by phone to review the clinic’s progress, ask about barriers/facilitators to social determinants of health documentation/action implementation, and help as needed.
    3. Email questions: Study clinics will be encouraged to email the implementation support team with questions; the implementation support team will respond within two workdays. Content from these emails and the monthly webinars will be summarized and shared with all clinics in a given wedge via a monthly email.
Fig. 2.

Fig. 2

Decision tool: which patients does the clinic want to target for social determinants of health screening?

Fig. 3.

Fig. 3

Social determinants of health workflow planning tool

Tailoring

A growing body of research [9799] supports tailoring implementation support to meet local needs, i.e., customizing implementation support rather than providing a one-size-fits-all strategy. We will tailor implementation support to each clinic’s specific needs and track this customization. The implementation support team will first review each clinic’s baseline data, consider what might address each clinic’s needs, and tailor the implementation support plan as feasible. For example, if a given clinic does not have experience using their own data to drive improvement efforts, the implementation support team will plan to offer additional training on how to do so. During the intervention period, clinics will complete a bi-monthly web-based survey describing their progress. We will track which support strategies the clinics needed at each clinic action plan step, and if a clinic is stuck at a certain step, the implementation support team will identify additional implementation support that might help. For example, if a clinic gets stuck on step 2 after receiving the support listed in Table 4, we might provide additional calls, trainings, or materials to help with specific encountered barriers. We will document the precise implementation steps where study clinics faced barriers, the support provided to address those barriers, and whether that support helped. Thus, the clinic action plan is a pragmatic tool for guiding and tracking the provision of tailored implementation support.

Data collection and analysis

Formative data collection and analysis (year 1; completed)

At time of writing, we are at the start of study year 2. In study year 1, we measured social determinants of health data collection among all OCHIN community health centers, using extracted electronic health record data. We recruited eight community health center organizations with high social determinants of health documentation rates (as identified in these formative analyses) to take part in exploratory semi-structured interviews. Clinics were asked to identify six staff members who played different roles related to social determinants of health documentation. The interviews explored barriers/facilitators to electronic health record-based social determinants of health data collection/use, and experiences with the electronic health record’s social determinants of health data tools. Results were used to identify needed improvements to the social determinants of health data tools and informed development of the implementation support intervention. Formative data analysis results will be reported in a future publication.

Implementation data collection and analysis (years 2–5)

Quantitative evaluation

All quantitative data will be extracted from study clinics’ shared electronic health record. Outcome measures are guided by the RE-AIM framework [114] (Table 5). Outcomes will be measured monthly in all study clinics at every period. Each wedge provides data points in both control and intervention conditions.

Table 5.

Study outcomes

RE-AIM
component
Outcome measures
Reach • Rate of clinic encounters where SDH is documented: among any patients and targeted patients
Effectiveness—secondary outcome
(among patients with/at risk for diabetes, a subset of study CHC patients)
Rate of all/targeted patients seen that month who have:
 • Controlled diabetes risks (BP < 140/80; A1c < 7.0%; BMI < 30; LDL < 100 mg/dL)
 • Incident comorbidities, e.g., retinopathy, neuropathy
 • Up-to-date diabetes tests (lipid panel, HbA1c, eye/foot exams)
Adoption—primary outcome Rate of
 • All patients seen for whom SDH data are documented
 • Targeted patients seen for whom SDH data are documented
 • Patients with an identified SDH need with documented referrals to community agencies: overall; among those who requested clinic assistance; and according to reported SDH needs
Implementation • Participation in implementation support activities
• Realist evaluation results
Maintenance • All measures over time
• Change in diabetes risks/measures over time

To compare the effect of the intervention with usual practice on social determinants of health outcome measures in a stepped-wedge design, we will utilize generalized linear mixed models with random effects for clinic. Random effects for state will be considered to account for clustering of practices within states. This model will incorporate independent variables, take into account the general time trend, and allow for the intervention effect to grow over time. We will estimate the intervention effect with the within-site difference between social determinants of health collection rates pre- and post-intervention, averaging across practices and accounting for possible secular trends which might confound results. As our statistical tests are specified a priori and our proposed social determinants of health outcome measures are highly related, we will report p values rather than adjust for multiple comparisons [129, 130]. If significant differences in key clinic characteristics between wedges remain post-randomization, we will use propensity score methods to reduce observed bias and thereby minimize external threats to validity [131, 132].

In secondary analyses focused on a diabetes population, we will measure intervention-associated changes in clinical measures reflecting diabetes risk management (blood pressure, hemoglobin A1c, body mass index, lipids, etc.), rates of incident comorbidities, and rates of patients up-to-date on key diabetes tests (lipid panel annually, hemoglobin A1c within 6 months, eye/foot exams). We hypothesize that patients at intervention clinics for whom social determinants of health data are collected will have significant improvements in these measures by the end of the study period, compared to those at control clinics. Data for these analyses will be extracted from OCHIN’s electronic health record. A similar model will be considered as in the primary analysis.

Realist evaluation

A key priority for implementation science is identifying the mechanisms by which implementation strategies exert their effects [101, 102]. Realist evaluation clarifies which components of a multifaceted intervention work, for whom, and under what conditions [133], to produce change. Assuming that interactions between contextual and mechanistic factors are key to effective cross-setting translation of interventions [134], realist evaluation conceptualizes intervention outcomes as resulting from a relationship between context and mechanism: context + mechanism = outcome. We will disaggregate “mechanism” into resources and reasoning; thus, mechanism (resources) + contextmechanism (reasoning) = outcome [135]. The goal is to identify context-mechanism-outcome configurations that explain the pathways through which the intervention (tailored implementation support) impacts the systematic collection of social determinants of health data, and the integration of such data into care. This framework will guide data collection and analyses, as below and in Fig. 4.

Fig. 4.

Fig. 4

Realist evaluation model—factors influencing intervention impact on outcomes [135, 136, 162]

In this evaluation, the intervention is the tailored implementation support (not shown in Fig. 4) and the mechanism (resources) are the electronic health record-based data tools. Context can include characteristics of individuals (e.g., roles, attitudes, knowledge), teams (e.g., relationships, team functioning), organizations (e.g., staffing, culture, leadership, resources), and environment (e.g., payor policies, political structures) [134, 136]. Here, context will be measured through (i) a brief baseline survey and (ii) analysis of the exchanges between the clinics and the implementation support team. People (in this case, clinic staff) respond to available resources (mechanism: resources) in different ways [134]. This “response to resources,” or mechanism (reasoning), will be assessed through (i) analysis of interactions between study clinics and the implementation support team (as above) and (ii) a condition-specific card study.

Data collection

To limit burden on clinics, and mitigate potential Hawthorne effects [137], our realist evaluation will primarily use data collected by the implementation support team in the course of its regular activities. The card study (see below) is the one exception.

Baseline survey

Shortly before each wedge of community health centers starts the intervention, the operational champion at each clinic will complete a baseline survey. Lacking validated, easily implemented methods for assessing clinics’ readiness to adopt practice changes, we developed a brief baseline survey specifically designed to assess some aspects of readiness as related to adoption of social determinants of health documentation/action. Informed by the building blocks of primary care, it assesses the clinics’ status in empanelment and team-based care, as well as their access to community health workers/social workers/behaviorists; external policies/incentives that might impact results; recent major disruptive events; other clinic initiatives; and payment models. The survey is available in Additional file 2.

Content of community health center interaction with implementation team

As noted earlier, during each study wedge clinical and/or operational champions from each clinic (as well as any other staff member that is interested in attending) will participate in monthly organization-specific coaching calls and bi-monthly webinars/peer support conversations. With permission, these discussions will be recorded and transcribed. We will track which community health center staff attended these discussions. At monthly calls with each study clinic, we will evaluate each clinic’s progress per the clinic action plan and ask which intervention components were used that month and by whom. We will also document additional support that the study clinics request. We will collect relevant email exchanges between the implementation team and the study clinics, as well as “trouble-tickets” about the social determinants of health tools, as submitted to OCHIN’s member support system. When each wedge ends, we will record a debrief session with the implementation support team to capture their understanding of implementation at each community health center in that wedge.

As shown in Fig. 4, data from the implementation team interactions with study clinics, primarily in the form of monthly check-ins and office hours, are a key data source for measurement of both context and mechanism: reasoning. The monthly check-ins are a particularly important data source for the evaluation, as the majority of rich back and forth between the implementation team and clinic staff (questions, conversations, talking through challenges the clinics are facing them and brainstorming ways to address those challenges) happens during these organization-specific interactions.

Card study

We will measure the impact of social determinants of health data on point-of-care decision-making via an electronic health record-embedded card study focused on clinical action (care decisions/referrals) at encounters with patients in each clinic’s target population. Two providers at each study clinic, identified based on how often they see patients that the clinic is targeting for social determinants of health screening, will be recruited by the clinic’s operational champion to complete a < 1 min survey on all patients in the target population seen in a 3-week period. The provider will complete a “card” after the encounter with a targeted patient, which will ask (1) whether/how social determinants of health data informed clinical decisions/actions; (2) how the social determinants of health data was obtained, e.g., via the electronic health record tools?; (3) whether any desired social determinants of health data were unavailable; and (4) estimated time spent looking up social determinants of health data. The questions will not ask for any patient data, and the survey answers will not be saved in the patient chart. We will associate each card with the following information: provider type (MD, SO, PA, NFP, behavioral health), whether the patient was seen by their assigned primary care provider, encounter chief complaint, and whether a completed social determinants of health screen was in the patient’s chart at the time of encounter. These data will be collected ≈ 5 months into the 6-month intervention period.

Realist evaluation analysis

We will conduct a mixed-methods convergent comparative “case analysis” [138] in which qualitative and quantitative data will be collected concurrently and used to build understanding of the change process in each case (clinic). Data from each case will be “merged” for analysis, then compared within and across clinics to confirm, expand on, or challenge each site’s findings [116, 138]. Data collection and analysis will be parallel and iterative; analysis will begin at the end of the first wedge and continue as data from each wedge are collected. A grounded theory approach [139141] and immersion-crystallization process [142] will be used to engage deeply with the data and identify emergent themes [143] that will be categorized into context, mechanism, or outcome. Potential configurations of data in these categories will be proposed, then refined as data collection continues, to identify context-specific intervention components that enable effective implementation of social determinants screening documentation/action [144, 145].

Discussion

Myriad national initiatives are underway to begin clinic-based social determinants of health documentation/action. These efforts will likely encounter barriers similar to those associated with adoption of any practice change involving new workflows/electronic health record functionalities, plus barriers specific to social determinants of health activities [77]. However, little empirical evidence guides this implementation; to our knowledge, no previous studies have examined the implementation strategies needed to support adoption of social determinants of health-related practice changes in any setting [91]. Even the Centers for Medicare and Medicaid Services’ innovative Accountable Healthcare Communities initiative [146], designed to test “… whether systematically identifying and addressing the health-related social needs … will impact health care costs and reduce health care utilization,” does not focus on the support needs associated with implementing these activities. The study described here will identify strategies for helping community health centers adopt electronic health record-based documentation of patient-reported social determinants of health needs and actions to address those needs [28, 47, 63, 64]. We will document how this support can be tailored to meet local needs and the resources and competencies needed to do so. We chose to test support from a centralized, remote team for its scalability.

Using rigorous methods, the study will also yield important knowledge to dissemination and implementation science as follows:

  • We will test the effectiveness of a set of evidence-based implementation strategies which have helped community health centers adopt new workflows/tools in prior research [4, 20, 98, 115126, 147157], but that have not been assessed in the context of electronic health record-based social determinants of health documentation/action, either in isolation or in combination. We are not aware of other formal studies of implementation strategies needed to support adoption of this important practice change, despite the need for such guidance.

  • We will assess how interdisciplinary implementation teams support practice change [158]. We will track the competencies that the team uses to help the study clinics (e.g., knowledge of electronic health record systems), plus any competencies that the team identifies as needed, and how those needs were met. We recognize that with our tailored strategy, some clinics will need and receive more intensive support. We will document this carefully on our process evaluation by tracking what strategies are needed and provided, and how much time the implementation team spends on each clinic, and overall, to provide the support that is needed.

  • This study will yield information on how to tailor implementation support strategies to meet local needs [96, 98, 100, 116]. The step-by-step clinic action plan is designed to be a focused, pragmatic tool that both guides study clinics’ change implementation and enables tracking the specific implementation supports provided at each step, and how this support is tailored. Such detail about tailoring of implementation strategies is rarely reported [117, 159, 160]. Rather than estimating implementation barriers a priori, this approach focuses on the implementation strategy changes that are needed in practice. By documenting where a given clinic gets stuck within an overall shared approach, and the subsequent impact of additional support provided, our findings could have relevance both for specific social determinants of health-related implementation approaches and for other implementation efforts involving tailored support.

  • The realist evaluation approach is increasingly used to evaluate complex interventions [135, 136, 161] and is well-suited to pragmatic implementation research due to its emphasis on the impact of context. The focus on identifying the context-specific causal mechanisms through which the tailored support impacts clinic uptake will facilitate appropriate adaptation of successful support strategies to other settings. Furthermore, identifying such causal mechanisms is an implementation science priority, as such mechanisms are infrequently reported.

Conclusion

Despite the known health impacts of social determinants of health, and a national movement urging healthcare providers to identify and act on patients’ social determinant-related needs, little is known about how to help community health centers adopt social determinants of health documentation/action. By learning whether and how scalable, tailored implementation strategies help community health centers adopt these changes, the proposed study will yield timely guidance to community clinics nationwide.

Additional files

Additional file 1: (4MB, pdf)

Guide to social determinants of health screening and referral-making using the electronic health record. (PDF 4124 kb)

Additional file 2: (23.2KB, docx)

Baseline survey. (DOCX 23 kb)

Acknowledgements

The authors deeply appreciate the contributions of Arvin Garg, Jen Devoe, Carly Hood Ronick, Laura-Mae Baldwin, Zach Goldstein, Matthew Stiefel, Thomas Schuch, Danielle Hessler-Jones, Christian Hill, Michelle Proser, Nancy Gordon, and Ranu Pandey. We also want to thank the Oregon Primary Care Association (OPCA) for contributing to the design of the implementation guide.

Funding

This publication was supported by a grant from the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), 1R18DK114701–01.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available because they are from a privately-hosted ERH system, but are available from the corresponding author on reasonable request.

Abbreviations

OCHIN

[Not an acronym]

PRAPARE

Protocol for Responding to and Assessing Patient Assets, Risks, and Experiences

RE-AIM

Reach, Effectiveness, Adoption, Implementation, Maintenance

Authors’ contributions

RG, EC, MM, and AB designed the study. RG and EE directed the project. MM led all quantitative data aspects of the study. AB and IG led all qualitative data collection and analysis. SC and DW extracted all study data. MM created the social determinants of health tools in EPIC. MD managed all EPIC-related parts of the study. KD recruited formative study clinics and managed all study aspects at OCHIN. RG, NM, NY, MK, and KD developed the implementation guide. KD, JS, NY, and MK managed all study implementation aspects. LG and BP informed all implementation materials. RG wrote the manuscript with input from all authors. All authors read and approved the final manuscript.

Ethics approval and consent to participate

This study was approved by the Kaiser Permanente Northwest Institutional Review Board.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Rachel Gold, Phone: 503-528-3902, Email: rachel.gold@kpchr.org.

Arwen Bunce, Email: buncea@ochin.org.

Erika Cottrell, Email: cottrelle@ochin.org.

Miguel Marino, Email: marinom@ohsu.edu.

Mary Middendorf, Email: middendorfm@ochin.org.

Stuart Cowburn, Email: cowburns@ochin.org.

Dagan Wright, Email: wrightd@ochin.org.

Ned Mossman, Email: mossmann@ochin.org.

Katie Dambrun, Email: dambrunk@ochin.org.

Byron J. Powell, bjpowell@email.unc.edu

Inga Gruß, Email: inga.gruss@kpchr.org.

Laura Gottlieb, Email: laura.gottlieb@ucsf.edu.

Marla Dearing, Email: dearingm@ochin.org.

Jason Scott, Email: Jason.L.Scott@kpchr.org.

Nadia Yosuf, Email: Nadia.M.Yosuf@kpchr.org.

Molly Krancari, Email: krancarim@ochin.org.

References

  • 1.Commission on Social Determinants of Health . Closing the gap in a generation: health equity through action on the social determinants of health: Commission on Social Determinants of Health final report. Geneva: World Health Organization; 2008. [Google Scholar]
  • 2.World Health Organization. Social determinants of health: About social determinants of health. 2017; http://www.who.int/social_determinants/sdh_definition/en/. Accessed 11/29/2017, 2017.
  • 3.U. S. Department of Health & Human Services (DHHS). Healthy People 2010, 2nd Edition. Washington: US Government Printing Office; 2000. [Google Scholar]
  • 4.Frieden TR. A framework for public health action: the health impact pyramid. Am J Public Health. 2010;100(4):590–595. doi: 10.2105/AJPH.2009.185652. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Fenton. Health Care’s Blind Side: The Overlooked Connection between Social Needs and Good Health: Robert Wood Johnson Foundation; 2011.
  • 6.Woolf SH, Johnson RE, Phillips RL, Jr, Philipsen M. Giving everyone the health of the educated: an examination of whether social change would save more lives than medical advances. Am J Public Health. 2007;97(4):679–683. doi: 10.2105/AJPH.2005.084848. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Hammig O, Bauer GF. The social gradient in work and health: a cross-sectional study exploring the relationship between working conditions and health inequalities. BMC Public Health. 2013;13:1170. doi: 10.1186/1471-2458-13-1170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Krieger N, Kosheleva A, Waterman PD, Chen JT, Beckfield J, Kiang MV. 50-year trends in US socioeconomic inequalities in health: US-born Black and White Americans, 1959-2008. Int J Epidemiol. 2014;43(4):1294–1313. doi: 10.1093/ije/dyu047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Lahiri S, Moure-Eraso R, Flum M, Tilly C, Karasek R, Massawe E. Employment conditions as social determinants of health. Part I: the external domain. New Solut. 2006;16(3):267–288. doi: 10.2190/U6U0-355M-3K77-P486. [DOI] [PubMed] [Google Scholar]
  • 10.Moure-Eraso R, Flum M, Lahiri S, Tilly C, Massawe E. A review of employment conditions as social determinants of health part II: the workplace. New Solut. 2006;16(4):429–448. doi: 10.2190/R8Q2-41L5-H4W5-7838. [DOI] [PubMed] [Google Scholar]
  • 11.Lahelma E, Laaksonen M, Aittomaki A. Occupational class inequalities in health across employment sectors: the contribution of working conditions. Int Arch Occup Environ Health. 2009;82(2):185–190. doi: 10.1007/s00420-008-0320-6. [DOI] [PubMed] [Google Scholar]
  • 12.Kawachi I, Berkman LF. Neighborhoods and Health. New York: Oxford University Press; 2003.
  • 13.[No authors listed.] Social disadvantage linked to diabetes through chronic inflammation. BMJ. 2013;347:f4368. [DOI] [PubMed]
  • 14.Hsu CC, Lee CH, Wahlqvist ML, et al. Poverty increases type 2 diabetes incidence and inequality of care despite universal health coverage. Diabetes Care. 2012;35(11):2286–2292. doi: 10.2337/dc11-2052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Jackson CA, Jones NR, Walker JJ, et al. Area-based socioeconomic status, type 2 diabetes and cardiovascular mortality in Scotland. Diabetologia. 2012;55(11):2938–2945. doi: 10.1007/s00125-012-2667-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Lipton RB, Liao Y, Cao G, Cooper RS, McGee D. Determinants of incident non-insulin-dependent diabetes mellitus among blacks and whites in a national sample. The NHANES I epidemiologic follow-up study. Am J Epidemiol. 1993;138(10):826–839. doi: 10.1093/oxfordjournals.aje.a116786. [DOI] [PubMed] [Google Scholar]
  • 17.Lysy Z, Booth GL, Shah BR, Austin PC, Luo J, Lipscombe LL. The impact of income on the incidence of diabetes: a population-based study. Diabetes Res Clin Pract. 2013;99(3):372–379. doi: 10.1016/j.diabres.2012.12.005. [DOI] [PubMed] [Google Scholar]
  • 18.Muller G, Kluttig A, Greiser KH, et al. Regional and neighborhood disparities in the odds of type 2 diabetes: results from 5 population-based studies in Germany (DIAB-CORE consortium) Am J Epidemiol. 2013;178(2):221–230. doi: 10.1093/aje/kws466. [DOI] [PubMed] [Google Scholar]
  • 19.Sacerdote C, Ricceri F, Rolandsson O, et al. Lower educational level is a predictor of incident type 2 diabetes in European countries: the EPIC-InterAct study. Int J Epidemiol. 2012;41(4):1162–1173. doi: 10.1093/ije/dys091. [DOI] [PubMed] [Google Scholar]
  • 20.Stringhini S, Sabia S, Shipley M, et al. Association of socioeconomic position with health behaviors and mortality. JAMA. 2010;303(12):1159–1166. doi: 10.1001/jama.2010.297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Espelt A, Kunst AE, Palencia L, Gnavi R, Borrell C. Twenty years of socio-economic inequalities in type 2 diabetes mellitus prevalence in Spain, 1987-2006. Eur J Pub Health. 2012;22(6):765–771. doi: 10.1093/eurpub/ckr158. [DOI] [PubMed] [Google Scholar]
  • 22.Hill J, Nielsen M, Fox MH. Understanding the social factors that contribute to diabetes: a means to informing health care and social policies for the chronically ill. Permanente J. 2013;17(2):67–72. doi: 10.7812/TPP/12-099. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Clark ML, Utz SW. Social determinants of type 2 diabetes and health in the United States. World J Diabetes. 2014;5(3):296–304. doi: 10.4239/wjd.v5.i3.296. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Behforouz HL, Drain PK, Rhatigan JJ. Rethinking the social history. N Engl J Med. 2014;371(14):1277–1279. doi: 10.1056/NEJMp1404846. [DOI] [PubMed] [Google Scholar]
  • 25.Hughes LS. Social determinants of health and primary care: intentionality is key to the data we collect and the interventions we pursue. J Am Board Fam Med. 2016;29(3):297–300. doi: 10.3122/jabfm.2016.03.160120. [DOI] [PubMed] [Google Scholar]
  • 26.Gottlieb LM, Hessler D, Long D, et al. Effects of social needs screening and in-person service navigation on child health: a randomized clinical trial. JAMA Pediatr. 2016;170(11):e162521. doi: 10.1001/jamapediatrics.2016.2521. [DOI] [PubMed] [Google Scholar]
  • 27.Berkowitz SA, Hulberg AC, Standish S, Reznor G, Atlas SJ. Addressing unmet basic resource needs as part of chronic Cardiometabolic Disease Management. JAMA Intern Med. 2017;177(2):244–252. doi: 10.1001/jamainternmed.2016.7691. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gottlieb LM, Wing H, Adler NE. A systematic review of interventions on Patients' social and economic needs. Am J Prev Med. 2017;53(5):719–729. doi: 10.1016/j.amepre.2017.05.011. [DOI] [PubMed] [Google Scholar]
  • 29.Garg A, Toy S, Tripodis Y, Silverstein M, Freeman E. Addressing social determinants of health at well child care visits: a cluster RCT. Pediatrics. 2015;135(2):e296–e304. doi: 10.1542/peds.2014-2888. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Institute of Medicine. Recommended social and behavioral domains and measures for electronic health records. 2014. http://nationalacademies.org/HMD/Activities/PublicHealth/SocialDeterminantsEHR.aspx. Accessed 2018.
  • 31.Committee on the Recommended S, Behavioral D, Measures for Electronic Health Records - Board on Population H, Public Health P . Capturing Social and Behavioral Domains and Measures in Electronic Health Records PHASE 2. Washington: National Academies Press; 2014. [Google Scholar]
  • 32.Gottlieb LM, Tirozzi KJ, Manchanda R, Burns AR, Sandel MT. Moving electronic medical records upstream: Incorporating social determinants of health. Am J Prev Med. 2015;48(2):215-18. [DOI] [PubMed]
  • 33.Pinto AD, Glattstein-Young G, Mohamed A, Bloch G, Leung FH, Glazier RH. Building a foundation to reduce health inequities: routine collection of sociodemographic data in primary care. J Am Board Fam Med. 2016;29(3):348–355. doi: 10.3122/jabfm.2016.03.150280. [DOI] [PubMed] [Google Scholar]
  • 34.Billioux AV, K.; Anothony, S.; Alley, D. Standardized screening for health-related social needs in clinical settings. The Accountable Health Communities Screening Tool 2017; https://nam.edu/wp-content/uploads/2017/05/Standardized-Screening-for-Health-Related-Social-Needs-in-Clinical-Settings.pdf. Accessed 2018.
  • 35.Centers for Disease Control and Prevention. CMS Timeline of Important MU Dates. Meaningful Use 2016; https://www.cdc.gov/ehrmeaningfuluse/timeline.html. Accessed 02/28/2017.
  • 36.Tagalicod RR, Jacob. Progress on Adoption of Electronic Health Records. 2015; https://www.cms.gov/eHealth/ListServ_Stage3Implementation.html. Accessed 2018.
  • 37.Health Information Technology Advisory Committee (HITAC). Meaningful Use Stage 3 Final Recommendations. 2014. https://www.cdc.gov/ehrmeaningfuluse/index.html. Accessed 2018.
  • 38.Centers for Medicare & Medicaid Services. CMS Quality Strategy 2016. 2016. https://www.cms.gov/medicare/quality-initiatives-patient-assessment-instruments/qualityinitiativesgeninfo/downloads/cms-quality-strategy.pdf. Accessed 2018.
  • 39.The Office of the National Coordinator for Health Information Technology (ONC). Federal Health IT Strategic Plan. 2016; https://www.healthit.gov/sites/default/files/9-5-federalhealthitstratplanfinal_0.pdf. Accessed 2018.
  • 40.Adler NE, Stead WW. Patients in context—EHR capture of social and behavioral determinants of health. N Engl J Med. 2015;372(8):698–701. doi: 10.1056/NEJMp1413945. [DOI] [PubMed] [Google Scholar]
  • 41.Centers for Medicare & Medicaid Services. Accountable Care Organizations (ACOs). 2018; https://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/ACO/. Accessed 6/7/2018.
  • 42.Thomas-Henkl C, Schulman M. Screening for social determinants of health in populations with complex needs: implementation Considerations. 2017. https://www.chcs.org/media/SDOH-Complex-Care-Screening-Brief-102617.pdf. Accessed 2018.
  • 43.Institute for Alternative Futures. Community Health Centers Leveraging the Social Determinants of Health. In: Alexandria, VA2012: http://www.altfutures.org/pubs/leveragingSDH/IAF-CHCsLeveragingSDH.pdf. Accessed 2018.
  • 44.https://www.commonwealthfund.org/sites/default/files/documents/___media_files_publications_fund_report_2014_may_1749_bachrach_addressing_patients_social_needs_v2.
  • 45.LaForge K, Gold R, Cottrell E, et al. How 6 organizations developed tools and processes for social determinants of health screening in primary care: an overview. J Ambul Care Manage. 2018;41(1):2–14. doi: 10.1097/JAC.0000000000000221. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Gold R, Cottrell E, Bunce A, et al. Developing electronic health record (EHR) strategies related to health center patients’ social determinants of health. J Am Board Fam Med. 2017;30(4):428–447. doi: 10.3122/jabfm.2017.04.170046. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.DeVoe JE, Bazemore AW, Cottrell EK, et al. Perspectives in primary care: a conceptual framework and path for integrating social determinants of health into primary care practice. Ann Fam Med. 2016;14(2):104–108. doi: 10.1370/afm.1903. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Daniel H, Bornstein SS, Kane GC. Addressing social determinants to improve patient care and promote health equity: an American College of Physicians Position Paper. Ann Intern Med. 2018;168(8):577–578. doi: 10.7326/M17-2441. [DOI] [PubMed] [Google Scholar]
  • 49.Byhoff E, Freund KM, Garg A. Accelerating the implementation of social determinants of health interventions in internal medicine. J Gen Intern Med. 2018;33(2):223–225. doi: 10.1007/s11606-017-4230-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Pinto AD, Bloch G. Framework for building primary care capacity to address the social determinants of health. Can Fam Physician. 2017;63(11):e476–e482. [PMC free article] [PubMed] [Google Scholar]
  • 51.Tong ST, Liaw WR, Kashiri PL, et al. Clinician experiences with screening for social needs in primary care. J Am Board Fam Med. 2018;31(3):351–363. doi: 10.3122/jabfm.2018.03.170419. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Gottlieb L, Sandel M, Adler NE. Collecting and applying data on social determinants of health in health care settings. JAMA Intern Med. 2013;173(11):1017–1020. doi: 10.1001/jamainternmed.2013.560. [DOI] [PubMed] [Google Scholar]
  • 53.Knowles M, Khan S, Palakshappa D, et al. Successes, challenges, and considerations for integrating referral into food insecurity screening in pediatric settings. J Health Care Poor Underserved. 2018;29(1):181–191. doi: 10.1353/hpu.2018.0012. [DOI] [PubMed] [Google Scholar]
  • 54.Alderwick HAJ, Gottlieb LM, Fichtenberg CM, Adler NE. Social prescribing in the U.S. and England: emerging interventions to address Patients' social needs. Am J Prev Med. 2018;54(5):715–718. doi: 10.1016/j.amepre.2018.01.039. [DOI] [PubMed] [Google Scholar]
  • 55.Pruitt Z, Emechebe N, Quast T, Taylor P, Bryant K. Expenditure reductions associated with a social service referral program. Popul Health Manag. 2018;21(6):469-76. 10.1089/pop.2017.0199. Epub 2018 Apr 17. [DOI] [PMC free article] [PubMed]
  • 56.Berkowitz SA, Terranova J, Hill C, et al. Meal delivery programs reduce the use of costly health care in dually eligible Medicare and Medicaid beneficiaries. Health Aff (Millwood). 2018;37(4):535–542. doi: 10.1377/hlthaff.2017.0999. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.McClintock HF, Bogner HR. Incorporating patients’ social determinants of health into hypertension and depression care: a pilot randomized controlled trial. Community Ment Health J. 2017;53(6):703–710. doi: 10.1007/s10597-017-0131-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Bachrach DG, J.; Meier, S.; Meerschaert, J.; Brandel, S. Enabling Sustainable Investment in Social Interventions: A Review of Medicaid Managed Care Rate-Setting Tool. 2018; http://www.commonwealthfund.org/publications/fund-reports/2018/jan/social-inteventions-medicaid-managed-care-rate-setting. Accessed 06/05/2018.
  • 59.National Academies of Sciences E, Medicine, National Academies of Sciences E, Medicine . A Proposed Framework for Integration of Quality Performance Measures for Health Literacy, Cultural Competence, and Language Access Services: Proceedings of a Workshop Accounting for Social Risk Factors in Medicare Payment. Washington: The National Academies Press; 2018. [PubMed] [Google Scholar]
  • 60.Gottlieb L, Tobey R, Cantor J, Hessler D, Adler NE. Integrating social and medical data to improve population health: opportunities and barriers. Health Aff. 2016;35(11):2116–2123. doi: 10.1377/hlthaff.2016.0723. [DOI] [PubMed] [Google Scholar]
  • 61.Cantor MN, Thorpe L. Integrating data on social determinants of health into electronic health records. Health Aff (Millwood) 2018;37(4):585–590. doi: 10.1377/hlthaff.2017.1252. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Beck AF, Cohen AJ, Colvin JD, et al. Perspectives from the Society for Pediatric Research: interventions targeting social needs in pediatric clinical care. Pediatr Res. 2018;84(1):10–21. doi: 10.1038/s41390-018-0012-1. [DOI] [PubMed] [Google Scholar]
  • 63.Cottrell E, Gold R, Likumahuwa S, al. e. Using health information technology to bring social determinants of health into primary care: a conceptual framework to guide research. Journal of Health Care for the Poor and Underserved. 2018. (In Press). [DOI] [PMC free article] [PubMed]
  • 64.Gottlieb L, Cottrell EK, Park B, Clark KD, Gold R, Fichtenberg C. Advancing social prescribing with implementation science. J Am Board Fam Med. 2018;31(3):315–321. doi: 10.3122/jabfm.2018.03.170249. [DOI] [PubMed] [Google Scholar]
  • 65.Arvantes J. Affordable Care Act Creates Greater Health Care Role for CHCs - Number of Health Centers Expected to Double by 2015. 2010; http://www.aafp.org/news/government-medicine/20101117hcreformchcs.html. Accessed 06/05/2017.
  • 66.Muennig P, Franks P, Jia H, Lubetkin E, Gold MR. The income-associated burden of disease in the United States. Soc Sci Med. 2005;61(9):2018–2026. doi: 10.1016/j.socscimed.2005.04.005. [DOI] [PubMed] [Google Scholar]
  • 67.Marmot M, Wilkinson R, editors. Social Determinants of Health. 2nd ed. Oxford: Oxford University Press; 2006.
  • 68.Garg A, Jack B, Zuckerman B. Addressing the social determinants of health within the patient-centered medical home: lessons from pediatrics. JAMA. 2013;309(19):2001–2002. doi: 10.1001/jama.2013.1471. [DOI] [PubMed] [Google Scholar]
  • 69.Garg A, Sarkar S, Marino M, Onie R, Solomon BS. Linking urban families to community resources in the context of pediatric primary care. Patient Educ Couns. 2010;79(2):251–254. doi: 10.1016/j.pec.2009.10.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Garg A, Butz AM, Dworkin PH, Lewis RA, Thompson RE, Serwint JR. Improving the management of family psychosocial problems at low-income children's well-child care visits: the WE CARE project. Pediatrics. 2007;120(3):547–558. doi: 10.1542/peds.2007-0398. [DOI] [PubMed] [Google Scholar]
  • 71.Page-Reeves J, Kaufman W, Bleecker M, et al. Addressing social determinants of health in a clinic setting: the WellRx pilot in Albuquerque, New Mexico. J Am Board Fam Med. 2016;29(3):414–418. doi: 10.3122/jabfm.2016.03.150272. [DOI] [PubMed] [Google Scholar]
  • 72.Matthews KA, Adler NE, Forrest CB, Stead WW. Collecting psychosocial “vital signs” in electronic health records: why now? What are they? What’s new for psychology? Am Psychol. 2016;71(6):497–504. doi: 10.1037/a0040317. [DOI] [PubMed] [Google Scholar]
  • 73.Giuse NB, Koonce TY, Kusnoor SV, et al. Institute of medicine measures of social and behavioral determinants of health: a feasibility study. Am J Prev Med. 2017;52(2):199–206. doi: 10.1016/j.amepre.2016.07.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Muller G, Hartwig S, Greiser KH, et al. Gender differences in the association of individual social class and neighbourhood unemployment rate with prevalent type 2 diabetes mellitus: a cross-sectional study from the DIAB-CORE consortium. BMJ Open. 2013;3(6). [DOI] [PMC free article] [PubMed]
  • 75.Unequal treatment: confronting racial and ethnic disparities in health care. Washington: National Academy Press; 2005. [PubMed]
  • 76.National Association of Community Health Centers. PRAPARE. 2016; http://www.nachc.org/research-and-data/prapare/. Accessed 02/23/2017.
  • 77.Gold R. Annals of Family Medicine. 2018. Learnings from Community Health Centers’ Adoption of Social Determinants of Health EHR tools. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Bryan S, Davis J, Broesch J, et al. Choosing your partner for the PROM: a review of evidence on patient-reported outcome measures for use in primary and community care. Healthcare Policy. 2014;10(2):38–51. [PMC free article] [PubMed] [Google Scholar]
  • 79.Spertus J. Barriers to the use of patient-reported outcomes in clinical care. Circ Cardiovasc Qual Outcomes. 2014;7(1):2–4. doi: 10.1161/CIRCOUTCOMES.113.000829. [DOI] [PubMed] [Google Scholar]
  • 80.Nelson EC, Eftimovska E, Lind C, Hager A, Wasson JH, Lindblad S. Patient reported outcome measures in practice. BMJ. 2015;350:g7818. doi: 10.1136/bmj.g7818. [DOI] [PubMed] [Google Scholar]
  • 81.Boyce MB, Browne JP, Greenhalgh J. The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ quality & safety. 2014;23(6):508–518. doi: 10.1136/bmjqs-2013-002524. [DOI] [PubMed] [Google Scholar]
  • 82.Hostetter MK, Klein S. Using patient-reported outcomes to improve health care quality: The Commonwealth Fund; 2012.
  • 83.Ivanova JI, Birnbaum HG, Schiller M, Kantor E, Johnstone BM, Swindle RW. Real-world practice patterns, health-care utilization, and costs in patients with low back pain: the long road to guideline-concordant care. Spine J. 2011;11(7):622–632. doi: 10.1016/j.spinee.2011.03.017. [DOI] [PubMed] [Google Scholar]
  • 84.Ridgeway JL, Beebe TJ, Chute CG, et al. A brief Patient-Reported Outcomes Quality of Life (PROQOL) instrument to improve patient care. PLoS Med. 2013;10(11):e1001548. doi: 10.1371/journal.pmed.1001548. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Jensen RE, Rothrock NE, DeWitt EM, et al. The role of technical advances in the adoption and integration of patient-reported outcomes in clinical care. Med Care. 2015;53(2):153–159. doi: 10.1097/MLR.0000000000000289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Campbell RJ. The five rights of clinical decision support: CDS tools helpful for meeting meaningful use. J AHIMA. 2013;84(10):42–47. [PubMed] [Google Scholar]
  • 87.McCullagh LJ, Sofianou A, Kannry J, Mann DM, McGinn TG. User centered clinical decision support tools: adoption across clinician training level. Appl Clin Inform. 2014;5(4):1015–1025. doi: 10.4338/ACI-2014-05-RA-0048. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Heisey-Grove D, Danehy LN, Consolazio M, Lynch K, Mostashari F. A national study of challenges to electronic health record adoption and meaningful use. Med Care. 2014;52(2):144–148. doi: 10.1097/MLR.0000000000000038. [DOI] [PubMed] [Google Scholar]
  • 89.Rittenhouse DR, Ramsay PP, Casalino LP, McClellan S, Kandel ZK, Shortell SM. Increased health information technology adoption and use among small primary care physician practices over time: a national cohort study. Ann Fam Med. 2017;15(1):56–62. doi: 10.1370/afm.1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Stehlik J, Rodriguez-Correa C, Spertus JA, et al. Implementation of real-time assessment of patient-reported outcomes in a heart failure clinic: a feasibility study. J Card Fail. 2017;23(11):813–816. doi: 10.1016/j.cardfail.2017.09.009. [DOI] [PubMed] [Google Scholar]
  • 91.Pescheny JV, Pappas Y, Randhawa G. Facilitators and barriers of implementing and delivering social prescribing services: a systematic review. BMC Health Serv Res. 2018;18(1):86. doi: 10.1186/s12913-018-2893-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Eccles MP, Armstrong D, Baker R, et al. An implementation research agenda. Implement Sci. 2009;4:18. doi: 10.1186/1748-5908-4-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Institute of Medicine . Initial national priorities for comparative effectiveness research. Washington: The National Academies Press; 2009. [Google Scholar]
  • 94.Newman K, Van Eerd D, Powell BJ, et al. Identifying priorities in knowledge translation from the perspective of trainees: results from an online survey. Implement Sci. 2015;10:92. doi: 10.1186/s13012-015-0282-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Powell BJ, Garcia K, Fernandez ME. Optimizing the cancer control continuum: advancing the science of implementation across the cancer continuum. In: Chambers D, Vinson CA, Norton WE, editors. Advancing the science of implementation across the cancer continuum. New York: Oxford University Press; 2018. [Google Scholar]
  • 96.Bunger AC, Powell BJ, Robertson HA, MacDowell H, Birken SA, Shea C. Tracking implementation strategies: a description of a practical approach and early findings. Health Res Policy Syst. 2017;15(1):15. doi: 10.1186/s12961-017-0175-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N, Wensing M, Fiander M, Eccles MP, Godycki-Cwirko M, van Lieshout J, Jäger C. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev. 2015;(4). Art. No.: CD005470. 10.1002/14651858.CD005470.pub3. [DOI] [PMC free article] [PubMed]
  • 98.Powell BJ, Beidas RS, Lewis CC, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–194. doi: 10.1007/s11414-015-9475-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Wensing M. The tailored implementation in chronic diseases (TICD) project: introduction and main findings. Implement Sci. 2017;12(1):5. doi: 10.1186/s13012-016-0536-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100.Boyd MR, Powell BJ, Endicott D, Lewis CC. A method for tracking implementation strategies: an exemplar implementing measurement-based care in community behavioral health clinics. Behav Ther. 2018;49(4):525–537. doi: 10.1016/j.beth.2017.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Lewis CC, Klasnja P, Powell BJ, et al. From classification to causality: advancing understanding of mechanisms of change in implementation science. Front Public Health. 2018;6:136. doi: 10.3389/fpubh.2018.00136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102.National Institutes of Health. 2016; http://grants.nih.gov/grants/guide/pa-files/PAR-16-238.html. Accessed 2018.
  • 103.DeVoe JE, Wallace LS, Fryer GE., Jr Measuring patients’ perceptions of communication with healthcare providers: do differences in demographic and socioeconomic characteristics matter? Health Expect. 2009;12(1):70–80. doi: 10.1111/j.1369-7625.2008.00516.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104.DeVoe JE, Gold R, Cottrell E, et al. The ADVANCE network: accelerating data value across a national community health center network. J Am Med Inform Assoc. 2014;21(4):271–278. doi: 10.1136/amiajnl-2014-002744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.OCHIN. Collaboration and innovation through research. 2018; https://ochin.org/ochin-research/. Accessed 2018.
  • 106.Thorpe KE, Zwarenstein M, Oxman AD, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009;62(5):464–475. doi: 10.1016/j.jclinepi.2008.12.011. [DOI] [PubMed] [Google Scholar]
  • 107.Patsopoulos NA. A pragmatic view on pragmatic trials. DialoguesClin Neurosci. 2011;13(2):217–224. doi: 10.31887/DCNS.2011.13.2/npatsopoulos. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108.Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003;290(12):1624–1632. doi: 10.1001/jama.290.12.1624. [DOI] [PubMed] [Google Scholar]
  • 109.Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 110.Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–191. doi: 10.1016/j.cct.2006.05.007. [DOI] [PubMed] [Google Scholar]
  • 111.Bodenheimer T, Ghorob A, Willard-Grace R, Grumbach K. The 10 building blocks of high-performing primary care. Ann Fam Med. 2014;12(2):166–171. doi: 10.1370/afm.1616. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 112.National Committee for Quality Assurance. Patient-Centered Medical Home (PCMH) Recognition. 2016; http://www.ncqa.org/programs/recognition/practices/patient-centered-medical-home-pcmh. Accessed 06/05/2018.
  • 113.Pawson RT, N. Realistic evaluation. London: SAGE Publications; 1997. [Google Scholar]
  • 114.RE-AIM framework. 2018; http://www.re-aim.org/. Accessed 2018.
  • 115.Powell BJ, McMillen JC, Proctor EK, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–157. doi: 10.1177/1077558711430690. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 116.Powell BJ, Proctor EK, Glisson CA, et al. A mixed methods multiple case study of implementation as usual in children's social service organizations: study protocol. Implement Sci. 2013;8:92. doi: 10.1186/1748-5908-8-92. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 117.Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139. doi: 10.1186/1748-5908-8-139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118.Godley SH, Garner BR, Smith JE, Meyers RJ, Godley MD. A large-scale dissemination and implementation model for evidence-based treatment and continuing care. Clin Psychol (New York) 2011;18(1):67–83. doi: 10.1111/j.1468-2850.2011.01236.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 119.Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 120.Massoud MR, Nielson GA, Nolan K, Schall MW, Sevin C. A Framework for Spread: From Local Improvements to System-Wide Change. IHI Innovation Series white paper. Cambridge: Institute for Healthcare Improvement; 2006. [Google Scholar]
  • 121.Paina L, Peters DH. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 2012;27(5):365–373. doi: 10.1093/heapol/czr054. [DOI] [PubMed] [Google Scholar]
  • 122.Lukas CV, Meterko MM, Mohr D, et al. Implementation of a clinical innovation: the case of advanced clinic access in the Department of Veterans Affairs. J Ambul Care Manage. 2008;31(2):94–108. doi: 10.1097/01.JAC.0000314699.04301.3e. [DOI] [PubMed] [Google Scholar]
  • 123.Solberg LI. Improving medical practice: a conceptual framework. Ann Fam Med. 2007;5(3):251–256. doi: 10.1370/afm.666. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 124.Janovsky K, Peters DH, Arur A, Sundaram S. Improving health services and strengthening health systems: adopting and implementing innovative strategies. Making health systems work, working paper no. 5. Geneva: World Health Organization, Evidence and Information for Policy; 2006. [Google Scholar]
  • 125.Taylor EF, Machta RM, Meyers DS, Genevro J, Peikes DN. Enhancing the primary care team to provide redesigned care: the roles of practice facilitators and care managers. Ann FamMed. 2013;11(1):80–83. doi: 10.1370/afm.1462. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 126.Munoz M, Pronovost P, Dintzis J, et al. Implementing and evaluating a multicomponent inpatient diabetes management program: putting research into practice. Jt Comm J Qual Patient Saf. 2012;38(5):195–206. doi: 10.1016/S1553-7250(12)38025-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 127.Chung GH, Choi JN, Du J. Tired of innovations? Learned helplessness and fatigue in the context of continuous streams of innovation implementation. J Organ Behav. 2017;38(7):1130–1148. doi: 10.1002/job.2191. [DOI] [Google Scholar]
  • 128.Health Leads Screening Toolkit. 2018; https://healthleadsusa.org/tools-item/health-leads-screening-toolkit/. Accessed 2018.
  • 129.Rothman KJ. No adjustments are needed for multiple comparisons. Epidemiology. 1990;1(1):43–46. doi: 10.1097/00001648-199001000-00010. [DOI] [PubMed] [Google Scholar]
  • 130.Perneger TV. What's wrong with Bonferroni adjustments. BMJ. 1998;316(7139):1236–1238. doi: 10.1136/bmj.316.7139.1236. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 131.Xu Z, Kalbfleisch JD. Propensity score matching in randomized clinical trials. Biometrics. 2010;66(3):813–823. doi: 10.1111/j.1541-0420.2009.01364.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 132.Little RJ, Rubin DB. Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches. Annu Rev Public Health. 2000;21(1):121–145. doi: 10.1146/annurev.publhealth.21.1.121. [DOI] [PubMed] [Google Scholar]
  • 133.McHugh S, Tracey ML, Riordan F, O'Neill K, Mays N, Kearney PM. Evaluating the implementation of a national clinical programme for diabetes to standardise and improve services: a realist evaluation protocol. Implement Sci. 2016;11:107. doi: 10.1186/s13012-016-0464-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 134.Van Belle S, Wong G, Westhorp G, et al. Can "realist" randomised controlled trials be genuinely realist? Trials. 2016;17(1):313. doi: 10.1186/s13063-016-1407-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 135.Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implement Sci. 2015;10:49. doi: 10.1186/s13012-015-0237-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 136.Lacouture A, Breton E, Guichard A, Ridde V. The concept of mechanism from a realist approach: a scoping review to facilitate its operationalization in public health program evaluation. Implement Sci. 2015;10:153. doi: 10.1186/s13012-015-0345-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 137.Hawthorne effect. 2018; https://en.wikipedia.org/wiki/Hawthorne_effect. Accessed 12/26/2018.
  • 138.Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs-principles and practices. Health Serv Res. 2013;48(6 Pt 2):2134–2156. doi: 10.1111/1475-6773.12117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 139.Glaser BG, Strauss AL. The discovery of grounded theory: strategies for qualitative research. New York: Aldine de Gruyter; 1999. [Google Scholar]
  • 140.Strauss A, Corbin J. Basics of qualitative research: techniques and procedures for developing grounded theory (2 nd ed.) Thousand Oaks: Sage; 1998. [Google Scholar]
  • 141.Charmaz K. Grounded Theory Methods in Social Justice Research. In: Denzin NK, Lincoln YS, editors. The SAGE Handbook of Qualitative Research, 4 th ed. Thousand Oaks: Sage Publications, Inc.; 2011. pp. 359–380. [Google Scholar]
  • 142.Borkan J. Immersion/crystallization. In: Crabtree BF, Miller WL, editors. Doing qualitative research. Vol 2nd ed. Thousand Oaks: Sage Publications, Inc.; 1999. pp. 179–194. [Google Scholar]
  • 143.Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–1772. doi: 10.1111/j.1475-6773.2006.00684.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 144.Byng R, Norman I, Redfern S, Jones R. Exposing the key functions of a complex intervention for shared care in mental health: case study of a process evaluation. BMC Health Serv Res. 2008;8:274. doi: 10.1186/1472-6963-8-274. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 145.Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health. 2011;101(11):2059–2067. doi: 10.2105/AJPH.2011.300193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 146.U.S. Centers for Medicare & Medicaid Services. Accountable Health Communities Model. 2018; https://innovation.cms.gov/initiatives/ahcm. Accessed 6/7/18.
  • 147.Yu JG, Kruszynska YT, Mulford MI, Olefsky JM. A comparison of troglitazone and metformin on insulin requirements in euglycemic intensively insulin-treated type 2 diabetic patients. Diabetes. 1999;48(12):2414–2421. doi: 10.2337/diabetes.48.12.2414. [DOI] [PubMed] [Google Scholar]
  • 148.Frieden TR. Forward: CDC health disparities and inequalities report-United States, 2011. MMWR Surveill Summ. 2011;60(Suppl):1–2. [PubMed] [Google Scholar]
  • 149.Barnett E, Casper M. A definition of “social environment”. Am J Public Health. 2001;91(3):465. doi: 10.2105/ajph.91.3.465a. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 150.Palloni A, Palloni G. Education, earnings, and diabetes. Health Aff (Millwood). 2012;31(5):1126. doi: 10.1377/hlthaff.2012.0373. [DOI] [PubMed] [Google Scholar]
  • 151.van Lenthe FJ, Borrell LN, Costa G, et al. Neighbourhood unemployment and all cause mortality: a comparison of six countries. J Epidemiol Community Health. 2005;59(3):231–237. doi: 10.1136/jech.2004.022574. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 152.Puig-Barrachina V, Malmusi D, Martenez JM, Benach J. Monitoring social determinants of health inequalities: the impact of unemployment among vulnerable groups. Int J Health Serv. 2011;41(3):459–482. doi: 10.2190/HS.41.3.d. [DOI] [PubMed] [Google Scholar]
  • 153.Mete C. Predictors of elderly mortality: health status, socioeconomic characteristics and social determinants of health. Health Econ. 2005;14(2):135–148. doi: 10.1002/hec.892. [DOI] [PubMed] [Google Scholar]
  • 154.McCarthy M. Social determinants and inequalities in urban health. Rev Environ Health. 2000;15(1–2):97–108. doi: 10.1515/reveh.2000.15.1-2.97. [DOI] [PubMed] [Google Scholar]
  • 155.Marmot M. Social determinants of health inequalities. Lancet. 2005;365(9464):1099–1104. doi: 10.1016/S0140-6736(05)74234-3. [DOI] [PubMed] [Google Scholar]
  • 156.Kreatsoulas C, Anand SS. The impact of social determinants on cardiovascular disease. Can J Cardiol. 2010;26 Suppl C:8C–13C. doi: 10.1016/S0828-282X(10)71075-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 157.Institute of Medicine: Board on Population Health and Public Health Practice: Committee on the Recommended Social and Behavioral Domains and Measures for Electronic Health Records . Capturing Social and Behavioral Domains in Electronic Health Records: Phase 1. Washington: National Academies Press (US); 2014. [PubMed] [Google Scholar]
  • 158.Lessard LN, Alcala E, Capitman JA. Pollution, poverty, and potentially preventable childhood morbidity in Central California. J Pediatr. 2016;168:198–204. doi: 10.1016/j.jpeds.2015.08.007. [DOI] [PubMed] [Google Scholar]
  • 159.Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40. doi: 10.1186/1748-5908-4-40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 160.Hoffmann TC, Glasziou PP, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. doi: 10.1136/bmj.g1687. [DOI] [PubMed] [Google Scholar]
  • 161.Moore GF, Audrey S, Barker M, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. doi: 10.1136/bmj.h1258. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 162.Westhorp G. Realist impact evaluation: an introduction. London: Overseas Development Institute; 2014. pp. 1–12. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1: (4MB, pdf)

Guide to social determinants of health screening and referral-making using the electronic health record. (PDF 4124 kb)

Additional file 2: (23.2KB, docx)

Baseline survey. (DOCX 23 kb)

Data Availability Statement

The datasets generated and/or analyzed during the current study are not publicly available because they are from a privately-hosted ERH system, but are available from the corresponding author on reasonable request.


Articles from Implementation Science : IS are provided here courtesy of BMC

RESOURCES