Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2017 Feb 1.
Published in final edited form as: J Am Board Fam Med. 2015 Sep-Oct;28(5):658–662. doi: 10.3122/jabfm.2015.05.140353

Practice-based research networks (PBRNs) in the era of integrated delivery systems

Timothy S Carey 1,2, Jacqueline R Halladay 1,3, Katrina E Donahue 1,3, Samuel Cykert 1,2,4
PMCID: PMC5287053  NIHMSID: NIHMS788329  PMID: 26355138

Abstract

Practice based research networks (PBRN's) have been in existence for several decades, and provide one mechanism to conduct research outside of academic research centers. Two transformative changes to the practice environment pose significant challenges to the manner in which PBRN's have functioned in the past and require changes to their current activities. The widespread introduction of electronic health records and the organization of practices into often hospital-dominated integrated delivery systems change the manner in which medicine is practiced, administered, and financed. Research funders are committed to extending research into communities, although we have yet to learn how to conduct these activities efficiently. We describe a number of operational challenges to this transformation, and also propose ways to address these challenges and improve the quality and efficiency through which research is conducted. PBRN's can assure their relevance in the research environment by adapting to this new era.


Practice based research networks (PBRN's) have been used for over a quarter century to conduct research on processes and outcomes of care in community practices.1 Clinicians, researchers and funders such as the National Institutes of Health (NIH) and the Agency for Healthcare Research and Quality (AHRQ) recognize that PBRN's may be the best way to examine patterns of care in generalizable practices.2,3 In addition, patients seeking care in community practices differ from those seen in tertiary care settings in important ways. They may have fewer comorbidities, may be more likely to be from racial and ethnic minorities, and more geographically diverse. In the past several years, both NIH and the Patient Centered Outcomes Research Institute (PCORI) have prioritized pragmatic clinical trials as an efficient method to conduct comparative effectiveness research in generalizable populations. These pragmatic trials seem ideally suited to PBRNs, since they minimally disrupt the functioning of the clinical care setting. Such trials also focus on collection of data, when feasible, from the practice's electronic health record.4,5

Historically, PBRNs have been moderate in size (50-150 practices) and have been characterized by their heterogeneity.6,7 Many involve both academic and community practices, and they frequently involve safety-net practices such as community health centers. Study methods, originally observational, have broadened to include intervention studies.8 In the past, much of the data collection involved chart abstraction, primary data from patient reports, and assembly of limited data from aggregated claims or electronic health information. The use of these aggregated secondary data has in the past been limited by difficulty in harmonizing data definitions across disparate platforms, and the restricted number of variables available. However, in the past 10 years, two major factors are transforming how PBRNs function. The research and practice communities are now challenged to respond to the rising expectations of funders and the public to conduct clinical and health services research in a manner that is both more timely and less costly on a per-participant basis than the work we have conducted in the past.9 These two factors are the spread of electronic health records (EHRs) and integrated delivery systems (IDSs).

The widespread introduction of electronic health records was advanced by multiple federal initiatives. These include the HITECH act, part of the American Recovery and Reinvestment Act initiatives that started in 2009. The Office of the National Coordinator for Health Information Technology (ONC) and other federal units provided technical support and financial incentives for hospitals and practices to adopt EHRs and use them to enhance patient care. Through these initiatives, the proportion of office-based practices with an EHR has increased to 78% in 2013, although only half have functionality for a ‘basic’ EHR. Larger delivery systems lead in both their uptake and functionality of their EHRs.10 At the same time, the market of electronic health record vendors has undergone rapid consolidation. Ten years ago, providers chose from one of dozens of systems. Currently a handful of vendors dominate the market. The smaller number of vendors has the potential to enhance interoperability, although many challenges remain in terms of health information exchange, the use of aggregated EHR derived data for research and the issues of data use and storage agreements.

A second and related transformation in clinical practice is the rise of the integrated delivery system (IDS) as a method of organizing health care in the US. Many physicians are now employed by large, often hospital-dominated health care delivery systems, or they may be under various types of management contracts;11 the structure and governance of these systems is formative and likely to change over time.12 These organizations employing salaried providers are now no longer solely the province of staff model HMOs such as the Kaiser Permanente system. Community hospitals, extended academic health center care systems and some provider led organizations are increasingly employing providers and/or managing their practices.13 In the past, discussions with practices regarding participation in a given research project generally involved the lead physician(s) and the practice manager. When a practice is owned or managed by an IDS, the discussions become more complex, with involvement by an administrator from the parent organization who may or may not view research as part of the system's organizational mission. Additionally, research projects may be perceived as competing with clinical revenue generating missions and internal and external quality improvement initiatives. These changes in the health care delivery environment pose a challenge to current PBRNs. In order to fulfill their missions to improve care through engaged research, they need to adapt to this changed delivery system. Our views in this paper reflect our experience with a large PBRN in North Carolina and our experience with the national NIH-sponsored Clinical and Translational Science Award (CTSA) consortium, conducting practice based research and pragmatic trials.

These two changes in the organization and delivery of primary care are linked in some ways. Choice and management of electronic health records is complex, and many practices are challenged by the complexity of system choice and installation, as well as by the modifications in team roles, organization and workflows demanded by meaningful use health information technology criteria. Large IDSs can assist with these issues, and can also decrease EHR installation costs and management through their economies of scale. What are the implications of this increasingly organized and corporate approach to care delivery for PBRNs? Like most transformational changes, some of the implications will be positive and others will necessitate changes in PBRN management.

PBRNs are not static, even practices in long-standing networks may move in and out of a network, and practices may merge or change leadership. In addition, practices appropriately pick and choose which studies they want to participate in. Reasons why a practice may opt in or out of a given project include personal and professional interest, number of ongoing studies, and competing activities such as computer upgrades, staff turnover or Patient Centered Medical Home (PCMH) certifications. With the rise of research studies designed specifically for single EHRs, some practices even within PBRNs may be ineligible simply due to the inability of their EHR to configure a specific prompt or order, or to export certain information. PBRNs have varying internal policies for committing to research, but in the past planning discussions were generally with the lead practice physician and the practice manager regarding the topics, logistics and financing of a given project.

When practices are owned or managed by a health care system, the system generally employs an administrator, often at a Vice President level, over all of the owned or managed practices. The administrator may or may not be a physician. The IDS may then become the entity with which subcontracts are conducted. In order to conduct system-wide quality improvement and population health management, delivery systems often flow their electronic health record data into a clinical data warehouse, which transforms electronic health record data into a searchable, analyzable database.14 These data aggregations facilitate quality improvement work and research, allowing analyses and data transfer from dozens of practices. Data warehouses are of course much simpler if all of the component practices use the same electronic health record, and are evolving in their governance policies regarding data access and use for research. The researcher, however, is then tasked with convincing yet another administrator or committee of the worth of the project, although a single point of approval may add significant efficiency in terms of enhanced sample size and generalizability.

Factors such as integrated ownership and clinical data harmonized and aggregated within a data warehouse are likely to facilitate PBRN activities in several ways if the practices are all within a single IDS. The unified administrative structure of the IDS can simplify contracting and enhance consistency of interventions. However, potential problems may include the complexity of decision making when more levels of bureaucracy are involved, and employed providers may feel increased productivity pressure. Even ‘light touch’ research in the office may be perceived by administrators as distracting from productivity goals often measured in relative value units (RVUs) delivered. PBRNs will need to modify their organization and their processes in this new environment, and our goal is to stimulate discussion regarding these issues. Table 1 specifies some of the challenges and potential solutions in this new era of PBRN management. Some of these changes will be positive for the conduct of community based observational research and pragmatic trials, but other challenges may interfere with the goals of the PBRNs.

Table 1. Challenges and potential solutions to PBRN research mission in the changed practice environment of integrated delivery systems and EHRs.

IDS Supports IDS Challenges PBRN Solutions and Strategies
  • Provides consistent administrative policies for research participation across practices.

  • Presence of an additional bureaucratic layer that requires negotiation (e.g. need for subcontracts versus simple invoicing).

  • Develop standard governance agreements to share data across systems (e.g. business agreements).

  • Clinical initiatives can align with practice based research questions (e.g. meaningful use, patient centered home certification, maintenance of certification).

  • Practice interest is lessened due to pressure from the IDS to maximize their clinical output.

  • Build grant budget justification to compensate practice expenses incurred.

  • Build in Continuing Medical Education (CME), Maintenance of Certification.

  • Priorities may support a philosophy of rapid dissemination and implementation.

  • Practices at the IDS geographic periphery suffer neglect regarding system integration, support of usual services and administrative consideration of projects not related to the system as a whole.

  • Package research with practice support services (e.g. EHR support, patient education, mHealth, practice facilitation, purchase and maintenance of data mapping/harmonization products).

  • Increased interest in research from the IDS, through the lens of a ‘learning health care organization’

  • Adjacent IDSs may compete with each other for clinical market share. This competition could potentially have the unintended effect of reducing collaboration on research projects.

  • IDSs may be in direct competition with PBRNs; may not see the worth of PBRN work when they are already connected and have data.

  • Engage patients and other stakeholders with the idea of existing in a continuously learning health system and how all may benefit from this approach.

  • Engage providers and staff in publications, presentations, and pursuit of better outcomes for patients based upon sound science.

  • Initially avoid topics that might be ‘hot button’ for administrators.

  • Look for win-win grants and contracts that require collaboration with multiple systems; PBRNs bring a primary care focus and insight, and IDSs bring a hospital focus

EHR and data warehouse
  • Allows data collection and analysis consistency.

  • Reduced presence of safety net practices, since community health centers may not be part of the IDS, and use a different EMR. This risks reducing the presence of low socioeconomic status and minority research participants.

  • Fragmentation of safety net clinic PBRN's as unique entities that are not included in studies that include other practice types

  • Harmonize diagnostic, test, treatment and utilization variables and codes across IDSs, including community health centers.

  • Standardization of interoperability methods (data transfer among EHR systems) across IDS's.

  • Provides an additional research tool for recruitment and quality improvement interventions.

  • Limited staff availability, even with funding, to program EMR modifications or extract data from CDW.

  • Lack of responsiveness to providing requested data in a timely fashion.

  • Assure the ability of commercial EHR's to provide prompts to enroll patients in studies, as well as adjust the care process through order sets and targeted and evidence-based educational materials.

  • Budget programmer time for all projects.

  • Joint governance of data warehouse by care delivery and academic components of IDS.

  • Consistent roll out of quality improvement and regulatory practice enhancements

  • May be reactive to external forces, may inhibit innovative solutions

  • Can test novel interventions in practices that are early adopters

  • External grant funds may partially support such innovation.

Promoting PBRN survival

How can the research community accentuate the positives of this accelerating process and minimize the negatives? Maintaining and expanding robust clinical, quality improvement and health services research with diverse practices and populations will take active effort on the part of researchers, clinicians and administrators, as well as the active support of funders including AHRQ, NIH and PCORI.

Some practices, particularly federally qualified health centers and small rural practices that care for underserved populations may remain unaffiliated with IDSs due to geography and/or programmatic funding and goals. Preserving the research mission in these practices will likely require alignment of support services with research in a manner that helps these chronically stressed organizations achieve some of their educational and patient care goals. For example, an agriculture extension model providing shared services for multiple rural practices would not only serve as a hub for research activity but could provide practice consultation regarding quality improvement and redesign activities.15 Such services could include continuing education including Maintenance Of Certification (MOC) credit for physicians and routine continuing education for nurses and other staff, EHR and data analytic support, patient education (in person and electronically), virtual monitoring, and other services in the mobile or internet based health care arena.16, 17 MOC IV and continuing education could provide desirable incentives.18 Dissemination and implementation science for the “learning health system” can rapidly spread comparative effectiveness findings and organizational priorities.

For practices that become owned or affiliated with large IDSs the need for alignment remains but the target then encompasses system goals in addition to those of individual practices. PBRNs will need to leverage IDS informatics and administrative processes when feasible so as to enhance research efficiency and align organizational goals when possible. When an IDS has its own quality improvement or internal research organization, the PBRN needs to be fully engaged with these endeavors. In-kind assistance to IDS administrators may be useful, although a time commitment. The IDS can learn from the often years-long relationship the PBRN has with practitioners and their communities, potentially enhancing adoption of quality improvement initiatives. Avoiding controversial ‘hot button’ topics until the organizations have developed good working relationships may be appropriate. The PBRN's research and quality improvement experience can then benefit the integrated delivery system functioning. A particular challenge will occur when a current PBRN incorporates practices from more than one IDS. For some projects, the PBRN practices may need to be stratified by IDS so as to avoid administrative problems and the perception of interfering with clinical competition.

In order to continue their mission, PBRNs must adapt to the changing reality of practice organization and delivery. Our recommendations above involve engaging the practice community, integrated delivery systems, and funders. However, equally important will be the demonstration of the value of PBRN's to the integrated delivery systems. The experience of PBRNs in rapid planning and execution of research and quality improvement, and their collaboration across sites will provide needed infrastructure to these learning delivery systems.19 Critical as well will be collaboration across integrated delivery systems in order to achieve needed sample size for research, and well as to assess the applicability of delivery system interventions across sites. We need much more information regarding how these very large integrated delivery systems implement evidence based care, and PBRNs can be an important component in evaluating and improving this increasingly important component of the US delivery system.

Acknowledgments

Funding: The project described was supported by the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through Grant Award Number 1UL1TR001111. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Footnotes

Conflict of Interest: None.

References

  • 1.Green LA, Hickner J. A short history of primary care practice-based research networks: from concept to essential research laboratories. J Am Board Fam Med. 2006;19:1–10. doi: 10.3122/jabfm.19.1.1. [DOI] [PubMed] [Google Scholar]
  • 2.Heintzman J, Gold R, Krist A, Crosson J, Likumahuwa S, DeVoe JE. Practice-based research networks (PBRNs) are promising laboratories for conducting dissemination and implementation research. J Am Board Fam Med. 2014 Nov-Dec;27(6):759–62. doi: 10.3122/jabfm.2014.06.140092. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Fagnan LJ, Davis M, Deyo RA, Werner JJ, Stange KC. Linking practice-based research networks and Clinical and Translational Science Awards: new opportunities for community engagement by academic health centers. Acad Med. 2010 Mar;85(3):476–83. doi: 10.1097/ACM.0b013e3181cd2ed3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Concannon TW, Guise JM, Dolor RJ, Meissner P, Tunis S, Krishnan JA, Pace WD, Saltz J, Hersh WR, Michener L, Carey TS. A national strategy to develop pragmatic clinical trials infrastructure. Clin Transl Sci. 2014 Apr;7(2):164–71. doi: 10.1111/cts.12143. Epub 2014 Jan 28. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Chalkidou K, Tunis S, Whicher D, Fowler R, Zwarenstein M. The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research. Clin Trials. 2012 Aug;9(4):436–46. doi: 10.1177/1740774512450097. Epub 2012 Jul 2. [DOI] [PubMed] [Google Scholar]
  • 6.Westfall JM, Mold J, Fagnan L. Practice-based research--“Blue Highways” on the NIH roadmap. JAMA. 2007;297:403–6. doi: 10.1001/jama.297.4.403. [DOI] [PubMed] [Google Scholar]
  • 7.Peterson K, Lipman PD, Lange CJ, Cohen RA, Durako S. Supporting Better Science in Primary Care: A Description of Practice-based Research Networks (PBRNs) in 2011. JABFM. 2012;25(5):565–71. doi: 10.3122/jabfm.2012.05.120100. [DOI] [PubMed] [Google Scholar]
  • 8.Sloane PD, Dolor RJ, Halladay J. Increasing the role of practice networks in medical research. J Am Board Fam Med. 2009;22:348–51. doi: 10.3122/jabfm.2009.04.090107. [DOI] [PubMed] [Google Scholar]
  • 9.Reith C, Landray M, Devereaux PJ, Bosch J, Granger CB, Baigent C, Califf RM, Collins R, Yusuf S. Randomized clinical trials--removing unnecesrsary obstacles. N Engl J Med. 2013 Sep 12;369(11):1061–5. doi: 10.1056/NEJMsb1300760. [DOI] [PubMed] [Google Scholar]
  • 10.Furukawa MF, King J, Patel V, Hsiao CJ, Adler-Milstein J, Jha AK. Despite substantial progress In EHR adoption, health information exchange and patient engagement remain low in office settings. Health Aff (Millwood) 2014 Sep;33(9):1672–9. doi: 10.1377/hlthaff.2014.0445. Epub 2014 Aug 7. [DOI] [PubMed] [Google Scholar]
  • 11.Welch WP, Cuellar AE, Stearns SC, Bindman AB. Proportion of physicians in large group practices continued to grow in 2009-11. Health Aff (Millwood) 2013 Sep;32(9):1659–66. doi: 10.1377/hlthaff.2012.1256. [DOI] [PubMed] [Google Scholar]
  • 12.Piña IL, Cohen PD, Larson DB, Marion LN, Sills MR, Solberg LI, Zerzan J. A Framework for Describing Health Care Delivery Organizations and Systems. Am J Public Health. 2014 Jun;12:e1–e10. doi: 10.2105/AJPH.2014.301926. [Epub ahead of print] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Adler KG. Making sense of the trend toward hospital employment. Fam Pract Manag. 2013 Jul-Aug;20(4):5. [PubMed] [Google Scholar]
  • 14.Holmes JH, Elliott TE, Brown JS, Raebel MA, Davidson A, Nelson AF, Chung A, La Chance P, Steiner JF. Clinical research data warehouse governance for distributed research networks in the USA: a systematic review of the literature. J Am Med Inform Assoc. 2014 Jul-Aug;21(4):730–6. doi: 10.1136/amiajnl-2013-002370. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Mold JW. A cooperative extension service for primary care in Oklahoma. J Okla State Med Assoc. 2011 Nov-Dec;104(11-12):414–8. [PubMed] [Google Scholar]
  • 16.Arora S, Kalishman S, Dion D, et al. Quality profile: Partnering urban academic medical centers and rural primary care clinicians to provide complex chronic disease care. Health Aff. 2011;30(6):1176–1184. doi: 10.1377/hlthaff.2011.0278. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health. 2015 Mar 18;36:393–415. doi: 10.1146/annurev-publhealth-031914-122855. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Puffer JC, Bazemore AW, Phillips RL, Beebe DK. Certification status of family physicians in the initial cohort entering maintenance of certification. J Am Board Fam Med. 2014 Sep-Oct;27(5):581–2. doi: 10.3122/jabfm.2014.05.140098. [DOI] [PubMed] [Google Scholar]
  • 19.IOM (Institute of Medicine) Best care at lower cost: The path to continuously learning health care in America. Washington, DC: The National Academies Press; 2013. [PubMed] [Google Scholar]

RESOURCES