Abstract
Objectives
This quasi-experimental pilot study aimed to implement and evaluate a sustainable, rural community-based patient outreach model for preventive care provided through primary care practices located in a rural county in Oklahoma. A Wellness Coordinator (WC) working with primary care practices (PCPs), the county health department, the county hospital, and a health information exchange (HIE) organization helped county residents receive evidence-based preventive services.
Methods
The WC used a community wellness registry connected to electronic medical records via HIE and called patients at the county level based on PCP-prioritized and tailored protocols. The registry flagged patient-level preventive care gaps, tracked outreach efforts, and documented the delivery of preventive services throughout the community. Return on investment (ROI) for prioritized preventive services was estimated in participating organizations.
Results
Six of the seven primary care practices in the county expressed interest in the project. Three of these practices fully implemented the 1-year outreach program starting in mid-2015. The regional HIE supplied periodic data updates for 9,138 county residents to help the coordinators address care gaps using the community registry. A total of 5,034 outreach calls were made by the WC in the first year and 7,776 prioritized recommendations were offered when care gaps were detected. Of the 5,034 distinct patients who received a call, 1146 (22%) were up-to-date on all prioritized services, while 3,888 (78%) were due for at least one of the selected services. Healthcare organizations in the county significantly improved the delivery of selected preventive services (mean increase: 35% across 10 services; p= 0.004; range: 3% to 215%) and realized a mean ROI of 80% for these services (range: 32% to 122%). The health system that employed the WC earned an estimated revenue of $52,000 realizing a 40% ROI for the coordinator position.
Conclusions
Although more research is needed, our pilot study suggests that it may be feasible and cost-effective to implement an innovative, county-level patient outreach program for improving preventive care in rural settings.
Keywords: prevention, community health, primary care, wellness coordinator, outreach
Introduction
It has been shown that optimizing the delivery and receipt of six key preventive measures would save about 100,000 lives a year in the United States (aspirin prophylaxis; smoking cessation; influenza vaccination; and colorectal, breast, and cervical cancer screening). 1 However, primary care practices (PCPs) continue to fall short of providing preventive services to all patients who could benefit. 1–4 There are several reasons for this problem. Yarnall and colleagues calculated that it would take primary care clinicians over 21 hours per day to provide high-evidence primary and secondary preventive services recommended by the U.S. Preventive Services Task Force (USPSTF) and tertiary preventive care to patients with chronic illnesses recommended by disease-specific guidelines. 5, 6 The diversity of electronic health records that are not interoperable and the decreasing margin of resiliency of primary care practices, especially in rural areas, may also contribute to suboptimal care delivery. 7, 8
More recently, hospitals have become more engaged in prevention, providing immunizations for patients with pneumonia, smoking cessation counseling and referrals for tobacco-related illnesses, and low-dose aspirin or beta blockers for patients with heart attacks. County health departments (CHDs) are also committed, particularly to primary prevention. However, large segments of the population rarely visit hospitals or health departments and only about half of recommended preventive services are received by the adult population in the U.S. 9
Efforts of these three potential partners (PCPs, hospitals, and CHDs) are often not well aligned. For example, primary care practices are frustrated by the adverse health effects of physical inactivity and obesity, perceiving that these are public health problems, which they are expected to address. They are also frustrated that when many low-income children are immunized at the CHD, they may not present to their well-child visits. A significant portion of reimbursements for the time and resources required by PCPs to make sure patients get referred screening tests go to the sub-specialists and hospitals. When immunizations are given in the hospital or CHD, the information may often not make it back to the PCP records. CHDs have trouble getting practices and hospitals to use immunization registries, and they would like to see more patients referred to them for immunizations.
Rural populations suffer from both poorer health and decreased access to quality care than their urban and suburban counterparts. 10 They are older on average and have lower income, less education, and higher rates of smoking and obesity. Rates of hypertension, diabetes, and cardiovascular disease are also higher in rural counties. 11 Despite greater health care needs, fewer than half as many physicians per capita work in rural counties as in urban and suburban counties in Oklahoma. 12 Therefore, new models of healthcare delivery in rural America are needed.
A 2012 Institute of Medicine (IOM) report entitled, “Integrating Primary Care and Public Health,” indicated renewed interest in collaborative models. 13 The IOM Committee pointed to the need for “neutral convener” organizations that bring together primary care and public health professionals. Hospitals must adjust their business plans to the changing epidemiology of illness and efforts to reduce admissions, early readmissions, and emergency department visits. Non-profit hospitals that accept Medicare are now required to construct and carry out community health improvement plans. Accountable care organizations (ACOs) are forging new relationships between PCPs and hospitals.
Based on these trends and needs, we initiated a 4-year study to implement, evaluate, and disseminate a sustainable, rural community-based patient outreach model to improve preventive care provided through 20 primary care practices located in 3 rural counties in Oklahoma. Wellness Coordinators (WCs) working with PCPs, CHDs, local hospitals, and Health Information Exchange (HIE) organizations helped county residents receive evidence-based preventive services. A quasi-experimental implementation pilot study that was part of the 4-year initiative and what we describe in this paper evaluated the impact of the community-level preventive services outreach program in the first of the three consecutively engaged rural counties.
Methods
Partnerships and Program Design
Collaborating with the academic study team, the regional health system-owned county hospital hired a full-time WC in the pilot intervention county. To alleviate the financial risk of the initial experiment, the WC’s first year salary was paid through a research grant from the Agency for Healthcare Research and Quality (AHRQ). The hospital contract delineated that after the first year, the burden of WC support would transition to the hospital, contingent upon sufficient revenues generated from some of the preventive services referred from participating practices (e.g., colonoscopies, mammograms, and bone density scans). Six of the seven practices operating in the county were recruited into the study in mid-2014. Three of these fully implemented the outreach program starting in mid-2015, while the other three achieved partial implementation. They received a full-time Practice Enhancement Assistant (PEA), also called practice facilitator,14, 15 to help them prioritize 3–4 preventive services, create patient outreach protocols, and accelerate the implementation of improved care delivery processes. In addition to practice-based priorities, participating healthcare organizations chose to focus on smoking cessation and physical activity improvement through consensus building.
The collaboration was overseen by a local nonprofit County Health Improvement Organization (CHIO) that acted as an “umbrella”, in order to ensure transparency, create mutual trust, and align the activities of individual organizations with the goals of the community. The regional HIE entered into a service contract with the study team and also with healthcare organizations in the county to supply interoperable clinical records (Continuity of Care Documents) for county residents whose primary care home was in participating practices. Data on these individuals included not only information from the county, but also from regional hospitals, diagnostic laboratories, imaging facilities, and specialty clinics. These data connections and the quality of data have evolved significantly in the course of the pilot project. The CHD was also engaged and participated by providing immunizations and facilitating the community health assessment process. A map of the county partnership and information flow are represented in Figure 1.
Through meetings with the CHIO and by leveraging their connections in the community, the project was advertised as a health and wellness campaign for the county (“Healthier Together Campaign”) via media outlets, community meetings, schools, and faith-based organizations. The project team also attempted to bring additional, scarce resources into the county (e.g., counseling services, diabetes train-the-trainer programs, and screening opportunities) and worked with state and national organizations to establish more effective tobacco cessation services by linking patients directly to the Oklahoma Tobacco Help Line.
Community Intervention
Outreach calls were tracked systematically by a secure community registry (Preventive Services Reminder System) that the investigators developed earlier. 16 The registry included a preventive care forecasting function that recommended person-tailored services based on HIE data, USPSTF guidelines (A and B), personal risk factors, and seasonal variations of need. The WC called county residents in their birth month annually, based on overlaps between personal care gaps flagged by the registry and a list of high-priority services determined by the practices and the local community working through the CHIO. Calls followed practice-tailored protocols and organization-approved scripts with branching logic.
Outcomes and Analyses
Rates of preventive service delivery for selected services were calculated for a pre-implementation baseline year and for the intervention year for each participating practice and the hospital using a combination of population-level HIE records and practice-level patient records and by generating representative samples of patients who were due for specific services based on USPSTF guidelines each year. Pre- and post-implementation service rates were compared as correlated proportions using the McNemar’s test.
The investigators partnered with the University of Missouri Office of Social and Economic Data Analysis (OSEDA) to guide econometric data collection and analyses. To conduct return on investment (ROI) analyses, the team created an analytical database organized by intervention and provider type. Data collected across analytic dimensions were normed by prioritizing the use of common codes and billing data to calculate revenue as well as standard cost indicators, such as salaries and benefits, materials and supplies, and overhead for each priority preventive service. To establish a baseline, financial data were also collected for a year preceding the intervention in each practice and for each service. The discount rate for the base year was applied to intervention year projections and additional organizational investments were also considered. Incremental costs and revenues were calculated for the delivery of selected preventive services by practice and compared to those in the baseline year to calculate ROI estimates.
The PEA took detailed field notes on observations pertaining to the implementation process in each practice and the study team maintained project-level progress notes on the development of the program. CHIO stakeholder meeting agenda and minutes were also collected to record community-level discussions on the prevention outreach program, including meeting dates, topics discussed, barriers identified, and interventions suggested or tried. These documents were later mined using content analytic techniques to construct a rich description of the community environment, the participants, emerging facilitators and barriers, solutions, and lessons learned from building the experimental system in the county.
The study was approved and monitored by the University of Oklahoma Health Sciences Center Institutional Review Board (IRB).
Results
In a 12-month period starting in June, 2015, the regional HIE supplied monthly data updates for 9,138 patients who were seen by participating practices. A demographic profile of the patient population reached by WCs is provided in Table 1. On average, 6 evidence-based preventive recommendations were suggested per person by the community registry. Of these, typically, 1–3 recommendations were offered by the WC per person that overlapped with practice or community priorities. Across all participating practice sites, 10 preventive services were offered, including: colonoscopy, mammography, bone density scans, diabetes checkups, HbA1c management, flu shots, pneumococcal vaccinations, physical activity counseling, smoking cessation counseling, and well-child visits.
Table 1.
Demographic Parameter | Outreach Effort Outcome | County Population Reference |
---|---|---|
Number of Individuals | 9,138 | ~15,000 |
Age (years) | Mean (SD): 38 (21) | Mean: 38 |
Gender (female) | 50.5% | 52.1% |
Race/Ethnicity | Insufficient data available in health records | 84% White 12.4% Hispanic/Latino |
Spatial Distribution of Population (by town) | Town A (62%) Town B (8%) Town C (7%) |
Town A (30%) Town B (15%) Town C (3%) |
Median Household Income | Data not available in health records | $37,000 |
Quantitative Outcomes
A total of 5,034 outreach calls were made in the first year and 7,776 prioritized recommendations were offered based on care gaps. The WC spent about 660 hours on the phone performing direct outreach activities. Of the 5,034 patients who received one call over the implementation year, 1146 (22%) were up-to-date on all prioritized services, while 3,888 (78%) were due for at least one service. In the implementation year, 35% more preventive services were delivered to patients in the county across 10 services compared to the baseline year, ranging from a 3% to a 215% increase in the delivery of services (p=0.004). Improvements by service are summarized in Table 2. Practices realized a mean ROI of 80% on these services ranging from 32% to 122%. The health system that owned the county hospital and employed the WC earned $52,000 in estimated revenues from improvements in service delivery compared to a baseline year, which offset the cost of the WC and generated a 40% ROI for the hospital on the WC’s employment cost. Seventy five percent of the hospital’s revenue came from an increase in the provision of three referred screening tests, including colonoscopies, mammograms, and bone density scans, while another 25% came from laboratory tests, immunizations, and well child visits provided by the hospital’s outpatient clinic.
Table 2.
Preventive Service Type | Baseline Service Rate* | Intervention Service Rate* | p | Share of Total ROI† |
---|---|---|---|---|
Primary Care Practice Domain | ||||
Smoking Cessation Counseling | 33% | 71% | <0.01 | 14% |
Adult Immunizations (influenza and pneumococcal vaccine) | 63% | 78% | <0.05 | 3% |
Diabetes Management (diabetes checkup visits & HbA1c measurement) | 48% | 75% | <0.01 | 18% |
Well Child Visits | 51% | 60% | <0.05 | 13% |
Physical Activity Counseling | 27% | 38% | <0.01 | 14% |
All Practice-Based Services | 44% | 64% | <0.01 | 62% |
County Hospital and Health System Domain | ||||
Colonoscopy (referred) | 38% | 43% | 0.07** | 31% |
Mammography (referred) | 55% | 63% | <0.05 | 6% |
Bone Density Screening (referred) | 24% | 30% | <0.05 | 1% |
All Referred Services | 39% | 45% | 0.05 | 38% |
County Healthcare Domain | ||||
All Services Combined | 42% | 57% | <0.01 | 100% |
Service rates were measured by combining Health Information Exchange (HIE) record analyses and medical record abstractions. HIE records and health system-level service reports were essential to estimate the rate of referred services (mammography, colonoscopy, and bone density screening).
Although this trend did not reach statistical significance across the county, there was an increase in the absolute number of colonoscopies that were referred to the health system that employed the wellness coordinator during the intervention period compared to the baseline period. Most of these patients received a call from the wellness coordinator.
Total Return on Investment (ROI) includes all returns generated across the project, including all organizations and services.
Qualitative and Process Outcomes
Based on these results, the county hospital and its health system leadership decided to continue funding the WC position from their own resources after the first year. However, achieving this outcome was not easy. The study team had to spend an excessive amount of time with negotiating and executing contracts and agreements, struggling with technology vendors to establish data interfaces in a timely fashion, and working with competing health systems. In particular, legal agreements that satisfied multiple entities regarding health data protection, ensuring proper patient attribution to practices in HIE records, and technology vendor idiosyncrasies required substantial unanticipated time, effort, and resources. Numerous workarounds and many adaptations of the original project plan had to be instituted to respond to emerging challenges and the constantly changing healthcare environment. Health information technology vendors requested the payment of various, sometimes arbitrary fees for establishing and maintaining data interfaces, most of which were unknown at the time of project initiation. Service fees showed a 5–10 fold variation across vendors and there was a significant difference between vendors in their willingness to negotiate the cost.
The ongoing turmoil in small, rural primary care practices, even in one year and in one county, was remarkably high, including disruptive ownership changes, electronic medical record replacements, retirement or death of providers, loss and turnover of clinicians and key staff, and significant financial difficulties. Most of these rural practices were new to systematic quality improvement which required extra PEA time to build some organizational capacity for change. These challenges resulted in a 6-month implementation delay compared to the original project timeline.
Despite the struggle, all practices benefitted from participating by improving the delivery of preventive care, receiving new resources that helped them reach meaningful use requirements, gaining access to care quality improvement support, and generating return on investment on specific services. The county benefitted from instituting a community-wide wellness outreach program, attracting funding and healthcare resources into the county (e.g., CHIO support), incentivizing the local hospital to invest into scarce services (e.g., colonoscopy), and linking the community to a state-wide network of professional healthcare expertise through the study team.
Discussion
Although more research is needed, our pilot study suggests that it may be feasible and cost-effective to implement an innovative, county-level patient outreach program for improving preventive care in rural settings. Through partnerships with various local health organizations, a shared infrastructure can be built that may accelerate the improvement of population health in rural communities.
The purpose of the study was to create an experimental rural environment in which at least some of the misaligned incentives for promoting and providing prospective care may be corrected. Although PCPs provide the lion’s share of the work to promote and deliver preventive services, historically, they have not received commensurate support for these activities, while subspecialists have benefitted considerably from referrals originating from primary care. Capturing and re-distributing some of these revenues at the community level to support highly needed healthcare services (e.g., patient outreach) may help align the participation of community partners, and, as the results suggests, it may also facilitate improved population health in rural settings more effectively.
Employing the WC by an entity that was most likely to benefit and making sure that the generated value remained transparent and accessible to the community through the CHIO helped trust building and gathering otherwise less willing partners around the table. The partners understood that while the WC called on behalf and with the instructions of individual clinicians, her work was coordinated and supported at the county level for better effectiveness and scale of economy. Ongoing networking of county partners through the CHIO made it possible to align the efforts of each partner with community goals. In fact, one of the criteria for selecting the intervention county was the presence of an active CHIO, which is the building block of the primary healthcare extension system in Oklahoma. 17–19
Although grant funding for the work of the PEA was continued beyond the pilot study, practices were able to build capacity to improve care delivery processes which allowed them to taper facilitation support over the intervention period. This is consistent with the practice facilitation literature. 20 However, initial assistance was essential to help practices select high-priority preventive services, design outreach protocols, enhance their prevention workflow, learn how to track their progress, and align their activities with the goals of the community.
Perhaps the greatest challenge of this study was to work with health information technology vendors that provided electronic medical record access and data exchange services across heterogeneous organizations. This study and other large national initiatives (e.g., AHRQ’s ongoing EvidenceNOW project) have consistently found that a significant mismatch exists between the intent of evolving federal programs for health technology development and what actually transpires in the field. The perception of many healthcare providers is that the certification of health IT products and services may not mean much in reality, due to vendor attempts to circumvent the requirements by preventing meaningful access to health information (“data blocking”), or providing some of the required features to users only if they pay more. These discrepancies burden especially small, independent rural practices that will have to bridge technology gaps from their own resources. A much stricter regulatory oversight should be in place to prevent these serious problems and effective means should be offered to providers to request remediation when products and services fall short of what was advertised or promised. Numerous technical and legal aspects of interoperability remain ill-conceptualized, may be constantly changing or are not clearly defined. Since quality data are in the center of modern healthcare, there is an urgent need to address this situation on a national scale. Problems with the accessibility and quality of healthcare data may undermine large-scale efforts to improve healthcare in the United States. Driven by our team’s determination to advance data access and interoperability, the quality and depth of integrated patient records continued improving throughout the study, albeit not without major frustrations. Table 3 lists the most frequent data availability and quality problems seen in this study.
Table 3.
HIE Data Quality Problem Type | Frequency of Data Quality Problem in HIE Records | Consequences of Data Quality Problem & ▶Mitigation Strategies |
---|---|---|
Patient is not attributed to a PCP (no PCP listed) | Decreased from 94% to 80% over the pilot | Services & quality metrics can’t be linked to PCP ▶Additional patient matching using EHR data |
Low actionable* data contribution from PCPs | Decreased from 89% to 66% over the pilot | Less information on PCP services ▶ Improving data interfaces & manual extractions from EHRs |
Missing or wrong patient phone numbers | Decreased from 49% to 38% over the pilot | Patient reach barriers ▶ Better documentation & additional data extraction from billing records |
Risk factor rate lower or higher than expected † | Smoker (5% vs. 16%#) Diabetic (21% vs. 10%#) |
Inaccurate care gap predictions ▶ Better chart documentation and calibrating data interfaces |
Preventive service rates are lower than expected † | Mammography (5% vs. 11%#; increased to13% over time) | Inaccurate care gap predictions ▶ Better chart documentation and calibrating data interfaces |
Race or ethnicity information not available | About 98–99% of records (remained unchanged) | Less tailored care recommendations ▶ Improve documentation of race in patient chart |
Skewed data contribution among organizations | 30% of HIE records are over-concentrated in SE of county | Some organizations dominate as data source ▶ Oversample records in northern county region |
HIE: Health Information Exchange (patient records aggregated regionally)
PCP: Primary Care Practice
EHR: Electronic Health Record
Actionable data include health risk factors (e.g., smoking status), reports and laboratory findings pertinent to prevention, and history of preventive services. Low-value data include administrative visit information and free text notes that often “bloat” interoperable records causing excessive transmission and processing times.
Rate means the frequency of the occurrence of health risk factors or preventive services in HIE datasets relative to the known prevalence of these factors in the population
State of the State’s Health Report 2014, Oklahoma State Department of Health
The study also suggests that legal professionals employed by healthcare organizations may need specific training and experience in working with community-wide, multi-stakeholder initiatives. The study team invested a substantial amount of time to advance innovations in organizations that formerly adopted an aggressive legal risk-minimizing approach, which made it more difficult to change the status quo. Our findings demonstrate the need for experiential training of legal and administrative personnel on best practices for supporting healthcare innovations while remaining confident that they can protect their institution.
Similarly, academic institutions tend to support basic science and traditional clinical research, but they may not always have the infrastructure to facilitate patient and community-centered research that includes non-profit entities, community organizations, and under-resourced stakeholders. Long administrative and contracting procedures, delays in payments, issues with perceiving conflicts of interest when faculty are also active in the community, and the complexity of navigating research processes often represent significant barriers for community partners to interface with research.
Lessons learned from this pilot study will allow our team to extend the implementation of the wellness outreach program to two other rural counties in Oklahoma. Lessons included the approach to convening the health community of an entire county around prevention, setting up shared procedures, service contracts and legal agreements, building a community-level data infrastructure, establishing a county-wide patient outreach program, and aligning outreach operations with financial benefits generated across organizations. At the end of 2016, a second county has initiated the program with improvements and adaptations and the implementation is being planned in a third county. The outcomes of the project will be used to create and disseminate a toolkit that will help others replicate the outreach program in their environment.
Conclusions
Although disparate healthcare entities in rural counties can be brought together to improve the health of the community through an organized wellness outreach program, the fragmentation and misalignment of the healthcare system makes it challenging to build such collaborations across the boundaries of organizations and their diverging interests. However, when these partnerships are established successfully, they may be able to achieve and economically sustain community-wide health improvement by creating a win-win situation for all partners.
Acknowledgments
The authors express their sincere appreciation to primary care practices, community partners, technology service providers, and patients, who participated in this study. Their support has been essential to the success of the community wellness program.
Support: Agency for Healthcare Research and Quality (AHRQ Grant # 1R18HS023237)
Footnotes
Author Disclosure Statement for Conflict of Interest
The authors declare no conflicts of interest with respect to the research, authorship, and/or publication of this article. The study was funded by a research grant from the Agency for Healthcare Research and Quality (AHRQ) Grant # 1R18HS023237.
Contributor Information
Dr. Zsolt J. Nagykaldi, University of Oklahoma Health Sciences Center, College of Medicine, Department of Family and Preventive Medicine, 900 NE 10th Street, Oklahoma City, OK 73104, Telephone: (405) 271-2370, Fax: (405) 271-2784.
Dewey Scheid, University of Oklahoma Health Sciences Center, College of Medicine, Department of Family and Preventive Medicine, 900 NE 10th Street, Oklahoma City, OK 73104, Telephone: (405) 271-2370, Fax: (405) 271-2784.
Daniel Zhao, University of Oklahoma Health Sciences Center, College of Public Health, Department of Biostatistics and Epidemiology, 801 NE 13th St, Room 327, Oklahoma City, OK 73104, Telephone: (405) 271-2229 x47837.
Mr. Bhawani Mishra, University of Missouri, Division of Applied Social Sciences, Office of Social and Economic Data Analysis, 240 Heinkel Building, Columbia, MO 65211, Telephone: (573) 882-7396
Tracy Greever-Rice, University of Missouri, Division of Applied Social Sciences, Office of Social and Economic Data Analysis, 240 Heinkel Building, Columbia, MO 65211, Telephone: (573) 882-7396.
References
- 1.Partnership P. Preventive Care: A national profile on use, disparitities, and health benefits. Washington DC: National Commission on Prevention Priorities; 2007. [Google Scholar]
- 2.Surveillance Summaries. MMWR. 2010;59:1–220. [PubMed] [Google Scholar]
- 3.McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348(26):2635–45. doi: 10.1056/NEJMsa022615. [DOI] [PubMed] [Google Scholar]
- 4.Pham HH, Schrag D, Hargraves JL, Bach PB. Delivery of preventive services to older adults by primary care physicians. JAMA. 2005;294(4):473–81. doi: 10.1001/jama.294.4.473. [DOI] [PubMed] [Google Scholar]
- 5.Yarnall KS, Pollak KI, Ostbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health. 2003;93(4):635–41. doi: 10.2105/ajph.93.4.635. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Yarnall KS, Ostbye T, Krause KM, Pollak KI, Gradison M, Michener JL. Family physicians as team leaders: “time” to share the care. Prev Chronic Dis. 2009;6(2):A59. [PMC free article] [PubMed] [Google Scholar]
- 7.Krist AH, Beasley JW, Crosson JC, Kibbe DC, Klinkman MS, Lehmann CU, et al. Electronic health record functionality needed to better support primary care. J Am Med Inform Assoc. 2014;21(5):764–71. doi: 10.1136/amiajnl-2013-002229. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ruhe M, Gotler RS, Goodwin MA, Stange KC. Physician and staff turnover in community primary care practice. J Ambul Care Manage. 2004;27(3):242–8. doi: 10.1097/00004479-200407000-00008. [DOI] [PubMed] [Google Scholar]
- 9.Shires DA, Stange KC, Divine G, Ratliff S, Vashi R, Tai-Seale M, et al. Prioritization of evidence-based preventive health services during periodic health examinations. Am J Prev Med. 2012;42(2):164–73. doi: 10.1016/j.amepre.2011.10.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.ORHP. Rural Healthy People 2010 - “Healthy People 2010: A companion document for rural areas”. Texas A&M Health Sciences Center; 2010. [Google Scholar]
- 11.Bennett KJ, Bankole O, Probst JC. Health disparities: A rural-urban chartbook. South Carolina: Rural Health Research and Policy Centers; 2008. [Google Scholar]
- 12.State of the State’s Rural Health. Stillwater, OK: Okahoma State University Center for Health Sciences; 2008. [Google Scholar]
- 13.IOM. Primary care and public health - Exploring integration to improve population health. Washinton DC: Institute of Medicine; 2012. Mar, [PubMed] [Google Scholar]
- 14.Nagykaldi Z, Mold JW, Aspy CB. Practice facilitators: a review of the literature. Fam Med. 2005;37(8):581–8. [PubMed] [Google Scholar]
- 15.Nagykaldi Z, Mold JW, Robinson A, Niebauer L, Ford A. Practice Facilitators and Practice-based Research Networks. J Am Board Fam Med. 2006;19(5):506–10. doi: 10.3122/jabfm.19.5.506. [DOI] [PubMed] [Google Scholar]
- 16.Nagykaldi Z, Mold JW. The Role of Health Information Technology In The Translation of Research Into Practice. J Am Board Fam Med. 2007 doi: 10.3122/jabfm.2007.02.060084. In Press. [DOI] [PubMed] [Google Scholar]
- 17.Grumbach K, Mold JW. A health care cooperative extension service: transforming primary care and community health. JAMA. 2009;301(24):2589–91. doi: 10.1001/jama.2009.923. [DOI] [PubMed] [Google Scholar]
- 18.Mold JW. A cooperative extension service for primary care in Oklahoma. J Okla State Med Assoc. 2011;104(11–12):414–8. [PubMed] [Google Scholar]
- 19.Phillips RL, Jr, Kaufman A, Mold JW, Grumbach K, Vetter-Smith M, Berry A, et al. The primary care extension program: a catalyst for change. Ann Fam Med. 2013;11(2):173–8. doi: 10.1370/afm.1495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Mold JW, Aspy CB, Smith PD, Zink T, Knox L, Lipman P, et al. Leveraging practice-based research networks to accelerate implementation and diffusion of chronic kidney disease guidelines in primary care practices: a prospective cohort study. Implement Sci. 2014;9(1):169. doi: 10.1186/s13012-014-0169-x. [DOI] [PMC free article] [PubMed] [Google Scholar]