Skip to main content
BJGP Open logoLink to BJGP Open
. 2021 Feb 17;5(2):BJGPO.2020.0152. doi: 10.3399/BJGPO.2020.0152

Developing measures to capture the true value of primary care

Tim C olde Hartman 1,*, Andrew Bazemore 2, Rebecca Etz 3, Ryuki Kassai 4, Michael Kidd 5, Robert L Phillips Jr 6, Martin Roland 7, Kees van Boven 8, Chris van Weel 9, Felicity Goodyear-Smith 10
PMCID: PMC8170610  PMID: 33563701

Abstract

Primary care (PC) is an essential building block for any high quality healthcare system, and has a particularly positive impact on vulnerable patients. It contributes to the overall performance of health systems, and countries that reorient their health system towards PC are better prepared to achieve universal health coverage. Monitoring the actual performance of PC in health systems is essential health policy to support PC. However, current indicators are often too narrowly defined to account for quality of care in the complex populations with which PC deals. This article reviews a number of conceptual frameworks developed to capture PC values in robust measures and indicators that can inform policy and practice performance. Each have benefits and limitations. Further work is needed to develop meaningful primary health care (PHC) and PC measures to inform strategic action by policymakers and governments for improved overall performance of health systems.

How this fits in

PC is an essential building block for any high quality healthcare system. Key measures are needed to assess the high value functions of PC and how these translate into reliable, regular indicators of care to inform health policy. A number of conceptual frameworks have been developed to monitor the actual performance of PC in health systems to inform health policy.

Introduction

Decades of evidence has demonstrated the importance of PC to the health of individuals, populations, and health systems. As an essential building block for any high quality healthcare system,1 PC contributes positively to health for all in society, and improves equity in access and outcome.25 Capable of meeting 80–90% of individuals’ healthcare needs across a lifetime,6 PC has a particularly positive impact on vulnerable patients, including those with multiple health problems, people from socially deprived backgrounds, and those with poorly defined illnesses or limited health literacy.7,8 A strong PC workforce is associated with lower mortality.9 Given ageing populations where multimorbidity becomes the norm, the importance of investing in PC will further increase.2,10

PC contributes to the overall performance of health systems through improvements in equity, patient-centredness, access, continuity, coordination, comprehensiveness, quality, and efficiency of care.6,11,12 PC is a critical bridge between personal and population health,13 and has been the largest source of any care for most people for the past 50 years.3,14 Even when health systems with better developed PC are slightly more expensive, as demonstrated in some European contexts,15 subsequent reduction of societal costs still present savings.

To implement health policy supportive of PC, it is essential to monitor its actual performance in health systems. And here arises a major problem: health system performance is mainly based on indicators that focus in a disease-specific way on mortality, life expectancy, and management. However, PC is responsible for tending to the large majority of health problems,16,17 often not captured in a specific diagnosis, and/or leading to preventive and self-management options. This results in a bias towards secondary care focused on individual diagnoses that are too narrowly defined to account for total quality of care in complex populations with multimorbidity and poor care access.18,19

Relationship between primary care and primary health care

While PHC and PC are often used interchangeably, the World Health Organization (WHO) defines PHC as an approach to health policy and service provision that includes both individual-based care and population-level public health and policy.20 Population health includes health promotion, disease prevention, public health, and rehabilitation services. PHC also incorporates wide multi-sectorial functions including community-based social services.

PC involves first contact with patients and their families in their pursuit of health care and health. Individual care involves the health and wellbeing of the whole person and their family throughout all ages and stages of life. Family medicine is the medical discipline providing first contact, and often leadership of a modern PC team. Family doctors can address a patient’s multiple medical issues, and integrate care for individuals and families across the broadest span of PHC.21 However, the success of modern family doctors depends on a range of other health professionals in the PC team, including nurses, midwives, pharmacists, mental health workers, and others, depending on setting and context. PC teams with good communication lines between, and close collaboration with, different professionals increase the effectiveness of PC.22

In practice, the relationship between PC and PHC is complex. Family medicine may provide both individual and population-level care, such as providing screening and vaccination services for their patient population. PHC as a construct is less associated with individual care, and more on the health of communities and populations, with more explicit incorporation of social, environmental, and public health interventions such as sanitation, water availability and quality, nutrition, and disease epidemic prevention and management. Ideally, PC and PHC work together to address a community’s health needs.

PC services need to be context-dependent with responsive, flexible, and adaptable interventions tailored to specific settings and populations. Individuals or groups with the same health problem may have different needs (control of disease sequelae versus performing daily life tasks); therefore, multiple variables (disease-specific markers versus functional status) are needed to assess outcomes. This makes decisions on what to measure challenging, but the priority measures come back to the essential functions of PC.

Assessing PC using disease-specific measures acts as though the sum of some of its many parts is an indication of its value.23,24 This has been referred to as the ‘paradox of primary care’.19 While disease-specific measures may suggest that a generalist family doctor might provide a lesser quality of care for a specific disease than a specialist, overall, systems based on PHC can produce healthier populations, use fewer resources, and have less health inequity. Additional measures are required to monitor the impacts of change from strengthening PHC. Recent efforts demonstrate that essential functions of PC can be ‘measured’ and related to important outcomes that matter to patients, clinicians, and insurance companies.2527 Similar core measures of PHC are needed to integrate PC functions, as well as the broader context that PHC offers.

In order for the state of health system quality in low-income and middle-income countries to be assessed and improved, the Lancet Global Health Commission on High Quality Health Systems suggests that the core metrics of health system performance should be competent and respectful care, better health, and health system trust, and that other health system components such as finance, management, or organisation are a function of high quality, equitable, efficient care.28

A review was conducted of current conceptual frameworks aimed at measuring PC to inform policy and practice performance, based on the authors' collective knowledge of existing tools (Table 1).

Table 1. Dimensions and data sources of tools used for measuring the strength of primary care.

Dimension of care PCAT QOF PHCPI EPCM PCPCM
Structure or system Governance  X
Economic factors  X  X
Workforce  X
Process or service delivery Accessibility  X  X  X  X
Continuity  X  X  X  X
Coordination  X  X  X  X
Comprehensiveness  X  X  X  X
Family or patient-centredness  X  X
Community orientation  X  X
Outcomes or outputs Quality  X  X  X  X
Efficiency  X  X
Equity  X  X
Data sources Existing datasets  X  X  X
Stakeholder survey  X  X  X  X
Health provider records  X

PCAT = Primary Care Assessment Tool.31 QOF = Quality and Outcomes Framework.33 PHCPI = Primary Health Care Performance Initiative.14 EPCM = European Primary Care Monitor Framework from Primary Health Care Activity Monitor for Europe (PHAMEU).48 PCPCM = Person-Centered Primary Care Measure.25

Primary Care Assessment Tool

The Primary Care Assessment Tool (PCAT), developed in the 1990s, was subsequently extended and validated by Barbara Starfield and colleagues to evaluate service delivery processes across countries.2931 PCAT is designed to measure the extent and quality of PC services from consumer and provider perspectives, and involves a set of three self-report survey instruments (child patient, adult patient, provider). It has been used extensively in some countries, particularly Brazil.32 However, each survey can take 40 minutes to complete, which may reduce usability, and the tool focuses largely on processes, not the structure or outcomes of PHC. A further limitation is its US heritage, which transfers poorly to some other countries. However, for developing countries where national datasets are lacking, these self-report surveys may provide a means to assess some components of PHC service delivery.

Quality and Outcomes Framework

In 2004, the UK NHS introduced the world’s largest healthcare-related pay-for-performance scheme into PC, the Quality and Outcomes Framework (QOF).33 Family doctors were paid up to 25% more if they met a complex set of clinical and organisational indicators. The successes of the scheme included an acceleration of previous trends towards systematic management of chronic disease by multidisciplinary teams and widespread introduction of electronic medical records. The QOF did produce improvements in quality of care,3436 but these were modest, against a background of national quality improvement programmes, including national standards for the major chronic diseases, annual appraisal of all doctors, and widespread use of clinical audits to compare practices, sometimes with public release of data. There were reductions in inequities in delivery of care for the major chronic diseases in QOF, with practices in socioeconomically deprived areas catching up with the performance of practices in more affluent areas.37 The scheme may have limited increase in emergency admissions for incentivised conditions,38 but has not reduced mortality.39,40

QOF has almost certainly had some negative consequences, for example, the progressive decline in the ability of patients to see a family doctor of their choice is probably an unintended consequence of a relentless focus by government on incentives for broad and immediate access to care. Similar experience is emerging from the US’s singular attention to open access as a part of Patient-Centered Medical Home transformation. There is also concern that schemes that focus on single-condition guidelines and indicators lead to overtreatment of increasing numbers of older patients, a failure to effectively address multimorbidity in the population, and the potential neglect of aspects of care that are not readily measured and, hence, not included in these schemes. Although initially popular, family doctors have become increasingly disenchanted with the administrative workload of the QOF scheme. In 2017, Scotland dropped QOF entirely in favour of incentives for family doctors to work in quality circles (groups of family doctors working together to improve quality).41 However, there has also been concern that removing indicators from the incentive scheme may result in reductions in quality of care.42

Overall, the experience with QOF is consistent with evidence from other parts of the world; for example, financial incentives are often less effective than expected and they can have unintended consequences, particularly if the true high value functions are not part of the measure and incentive policy.43 Challenges for those introducing incentive schemes include: determining that they genuinely meet the health needs of the population; ensuring they assess and incentivise the most important behaviours; and respecting that population health needs change.

Primary Health Care Performance Initiative

The World Bank, Bill & Melinda Gates Foundation, and the WHO formed the Primary Health Care Performance Initiative (PHCPI) to strengthen measures, specifically in low- and middle-income countries (LMIC).14

The PHCPI conceptual framework looks at system, input, service delivery, output and outcome factors addressing issues related to PHC financing, capacity, performance, and equity, and more recently management of services, including team-based approaches and community engagement.44 The indicators used by PHCPI have recently been revised to focus greater attention on those areas expected to have the greatest impact in supporting countries to attain universal health coverage (UHC).45 The Vital Signs Profile was designed to provide a comprehensive snapshot of the performance of a country’s PHC system, but is limited by availability of existing data sources. While PHCPI provides a robust and systematic system for measuring PHC performance, there remain gaps.46,47 While adequate measures have been identified for topics, such as PHC spending, access, quality, service coverage, and health outcomes, these have been lacking for assessing the components of PHC that impact overall performance and outcomes.

PHCPI has recently developed the PHC Progression Model with a mixed-method assessment tool for more comprehensive and systematic measurement of PHC capacity.46 While this tool shows promise in enabling countries to track their progress over time and make cross-country comparisons, the assessment requires investment in time and other resources.

European Primary Care Monitor Framework

Kringos and colleagues provide a conceptual framework incorporating structural (governance, economic conditions, and workforce development), service delivery processes (accessibility, comprehensiveness, continuity, and coordination), and outcome (quality, efficiency, and equity of care) dimensions of PC.3 Their work was developed across the relatively high income European countries, although it included the Eastern European ‘transition’ countries.48 They operationalised the ‘European Primary Care Monitor’, with a set of 99 indicators, as weak, medium, or strong PC, enabling overall totals of each dimension to be calculated.49

The Primary Health Care Activity Monitor for Europe (PHAMEU) project used these indicators to compare secondary data from 31 European countries sourced from national and international databases and the scientific literature, augmented by national experts who accessed grey literature to fill in the gaps.48 They found that countries either had strong PC structures (good financial coverage and resources, and adequate workforce) or few of these structures in place. They found no correlation between performance on the four dimensions of accessibility, comprehensiveness, continuity, and coordination. However, strong PC was associated with better population health, lower rates of unnecessary hospitalisation, and relatively lower socioeconomic disparities. These authors have also found that countries with stronger health structures have overall higher health expenditures.15 This may be because they have a greater investment in health overall, not necessarily that PHC is more expensive than hospital-based services. Those systems with comprehensive PC were also associated with slower growth in healthcare spending.

Person-Centered Primary Care Measure

When conducting patient assessment of PC delivery, it is essential to acknowledge PC’s complexity: it addresses the whole person while integrating experience, prioritising needs, and personalising care. The purpose of measuring is to focus attention on what matters, but the current measures focused on disease-specific processes and clinical outcomes point in the wrong direction. Their selective focus institutionalises fragmentation and enacts a basic misalignment between what is measured and what is valued.25 This takes the focus away from what is important to PC, which is why a person seeks care, and what help can be provided.24 A conceptual PC framework should include high quality clinical care and interpersonal communication. Measures are needed that are capable of assessing PC’s complexity; for example, in addressing professionalism, aligning with the experience of patients and clinicians, eliminating fragmentation, and including the social and relational aspects known to contribute to its success.25

A first requirement is to find language to describe the work PC does, and to define criteria for its assessment. That is the purpose of the newly developed Person-Centered Primary Care Measure (PCPCM). The first phase of development started with a crowdsourced survey of what patients and clinicians felt represented good PC, resulting in 18 identified quality indicator areas.25 The second phase occurred at the Starfield Summit III: Meaningful Measures for Primary Care (international conference in Washington DC, October 2017), during which the 18 quality indicator areas were shared with 70 expert stakeholders, including patients, providers, payers, and measure creators, and were reduced to 11 main indicator areas (that is, accessibility, comprehensiveness, continuity, integration, coordination, relationship, advocacy, family context, community context, health promotion, and goal-oriented care). Each main indicator area was captured in a single written item using the language found in the crowdsourcing and conference data.

PCPCM has been shown to have good reliability and construct validity.25 Crowdsourced and Starfield III findings support its alignment with clinician-identified aspects of professionalism, and the overlap of quality areas surveyed between patients and clinicians. PCPCM is robust and capable of capturing the essential functions through which PC operates. Further studies regarding the measure’s performance and its potential use globally are underway.

Conclusion

Strong health systems require government commitment to provision of UHC, alignment of partners and stakeholders to support national strategies and policies, and individuals and communities empowered to enhance their own health and wellbeing. Health systems vary widely across different countries. PC is different from, but essentially overlapping with, PHC. PC’s high value functions are universal, but their translation into services provided are context-specific and depend on population needs, the health professionals available to provide care, population socioeconomic factors, and a political commitment to PHC. Describing and measuring the nature and quality of both PC and PHC services enables comparison between national health systems, the ability to identify best practice, and can inform strategic action by policymakers and governments. The frameworks summarised above are innovative steps towards better evaluation of the foundational aspects of PC and PHC. However, only the systematic application in performance measurement of PC and PHC around the world — in different health systems and socioeconomic and cultural settings — will clarify their true strengths and limitations.

Measurement needs to be meaningful to those who deliver care. They need a sense of ownership of the processes of change, and the indicators needed to guide this. Key measures need to address the high-value functions of PC and how these translate into reliable, regular indicators of care; the patient experience of PHC; the weight to be given to clinical measures as indicators of practice and health systems, to reduce or avoid perverse effects; and how the international PC community can best work with WHO, the Bill & Melinda Gates Foundation, and others to support person-centred and population-centred care through PHC. Meaningful PHC and PC measurement is essential to improve overall performance of health systems in the move towards achieving UHC.

Funding

There are no funders to report for this article.

Ethical approval

Not applicable.

Provenance

Freely submitted; externally peer reviewed.

Acknowledgements

Competing interests

The authors declare that no competing interests exist.

References

  • 1.Lawn JE, Rohde J, Rifkin S, et al. Alma-Ata 30 years on: revolutionary, relevant, and time to revitalise. Lancet. 2008;372(9642):917–927. doi: 10.1016/S0140-6736(08)61402-6. [DOI] [PubMed] [Google Scholar]
  • 2.Caley M. Remember Barbara Starfield: primary care is the health system's bedrock. BMJ. 2013;347:f4627. doi: 10.1136/bmj.f4627. [DOI] [PubMed] [Google Scholar]
  • 3.Kringos D, Boerma W, Hutchinson A, et al. Building primary care in a changing Europe. Copenhagen: World Health Organization on behalf of the European Observatory on Health Systems and Policies; 2015. [PubMed] [Google Scholar]
  • 4.Starfield B. Is primary care essential? Lancet. 1994;344(8930):1129–1133. doi: 10.1016/S0140-6736(94)90634-3. [DOI] [PubMed] [Google Scholar]
  • 5.Gulliford MC. Availability of primary care doctors and population health in England: is there an association? J Public Health Med. 2002;24(4):252–254. doi: 10.1093/pubmed/24.4.252. [DOI] [PubMed] [Google Scholar]
  • 6.Kringos DS, Boerma WGW, Hutchinson A, et al. The breadth of primary care: a systematic literature review of its core dimensions. BMC Health Serv Res. 2010;10(1):65. doi: 10.1186/1472-6963-10-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.McWhinney IR. A Textbook of Family Medicine. Oxford: Oxford University Press; 1989. [Google Scholar]
  • 8.Nutting PA, Goodwin MA, Flocke SA, et al. Continuity of primary care: to whom does it matter and when? Ann Fam Med. 2003;1(3):149–155. doi: 10.1370/afm.63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Basu S, Berkowitz SA, Phillips RL, et al. Association of primary care physician supply with population mortality in the United States, 2005–2015. JAMA Intern Med. 2019;179(4):506–514. doi: 10.1001/jamainternmed.2018.7624. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.The Lancet The Astana declaration: the future of primary health care? Lancet. 2018;392(10156):1369. doi: 10.1016/S0140-6736(18)32478-4. [DOI] [PubMed] [Google Scholar]
  • 11.Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457–502. doi: 10.1111/j.1468-0009.2005.00409.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Macinko J, Starfield B, Shi L. The contribution of primary care systems to health outcomes within organization for economic cooperation and development (OECD) countries, 1970–1998. Health Serv Res. 2003;38(3):831–865. doi: 10.1111/1475-6773.00149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Sweeney SA, Bazemore A, Phillips RL, et al. A reemerging political space for linking person and community through primary health care. Am J Public Health. 2012;102(Suppl 3):S336–S341. doi: 10.2105/AJPH.2011.300553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Bitton A, Ratcliffe HL, Veillard JH, et al. Primary health care as a foundation for strengthening health systems in low- and middle-income countries. J Gen Intern Med. 2017;32(5):566–571. doi: 10.1007/s11606-016-3898-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kringos DS, Boerma W, van der Zee J, Groenewegen P. Europe’s strong primary care systems are linked to better population health but also to higher health spending. Health Aff. 2013;32(4):686–694. doi: 10.1377/hlthaff.2012.1242. [DOI] [PubMed] [Google Scholar]
  • 16.Green LA, Fryer GE, Yawn BP, et al. The ecology of medical care revisited. N Engl J Med. 2001;344(26):2021–2025. doi: 10.1056/NEJM200106283442611. [DOI] [PubMed] [Google Scholar]
  • 17.Johansen ME, Kircher SM, Huerta TR. Reexamining the ecology of medical care. N Engl J Med. 2016;374(5):495–496. doi: 10.1056/NEJMc1506109. [DOI] [PubMed] [Google Scholar]
  • 18.van Weel C, Kidd MR. Why strengthening primary health care is essential to achieving universal health coverage. CMAJ. 2018;190(15):E463–E466. doi: 10.1503/cmaj.170784. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Stange KC, Ferrer RL. The paradox of primary care. Ann Fam Med. 2009;7(4):293–299. doi: 10.1370/afm.1023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Muldoon LK, Hogg WE, Levitt M. Primary care (PC) and primary health care (PHC). What is the difference? Can J Public Health. 2006;97(5):409–411. doi: 10.1007/BF03405354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.WONCA Europe Ljubljana: World Organization of Family Doctors; 2011. The European definition of general practice / family medicine. [Google Scholar]
  • 22.World Health Organization Primary health care, including health system strengthening. Sixty-Second World Health Assembly A62/8. Provisional agenda item 12.4, 9 April 2009. https://apps.who.int/gb/ebwha/pdf_files/A62/A62_8-en.pdf. [26 Jan 2021];2009
  • 23.Roland M, Campbell S. Successes and failures of pay for performance in the United Kingdom. N Engl J Med. 2014;370(20):1944–1949. doi: 10.1056/NEJMhpr1316051. [DOI] [PubMed] [Google Scholar]
  • 24.Stange KC, Etz RS, Gullett H, et al. Metrics for assessing improvements in primary health care. Annu Rev Public Health. 2014;35(1):423–442. doi: 10.1146/annurev-publhealth-032013-182438. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Etz RS, Zyzanski SJ, Gonzalez MM, et al. A new comprehensive measure of high-value aspects of primary care. Ann Fam Med. 2019;17(3):221–230. doi: 10.1370/afm.2393. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Bazemore A, Petterson S, Peterson LE, et al. Higher primary care physician continuity is associated with lower costs and hospitalizations. Ann Fam Med. 2018;16(6):492–497. doi: 10.1370/afm.2308. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Bazemore A, Petterson S, Peterson LE, Phillips RL. More comprehensive care among family physicians is associated with lower costs and fewer hospitalizations. Ann Fam Med. 2015;13(3):206–213. doi: 10.1370/afm.1787. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Kruk ME, Gage AD, Arsenault C, et al. High-quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Health. 2018;6(11):e1196–e1252. doi: 10.1016/S2214-109X(18)30386-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Safran DG, Kosinski M, Tarlov AR, et al. The primary care assessment survey: tests of data quality and measurement performance. Med Care. 1998;36(5):728–739. doi: 10.1097/00005650-199805000-00012. [DOI] [PubMed] [Google Scholar]
  • 30.Crampton P, Dowell A, Woodward A. Third sector primary care for vulnerable populations. Soc Sci Med. 2001;53(11):1491–1502. doi: 10.1016/S0277-9536(00)00438-X. [DOI] [PubMed] [Google Scholar]
  • 31.Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract. 2001;50(2):161 [Google Scholar]
  • 32.D'Avila OP, Pinto LF, Hauser L, et al. The use of the primary care assessment tool (PCAT): an integrative review and proposed update. Cien Saude Colet. 2017;22(3):855–865. doi: 10.1590/1413-81232017223.03312016. [DOI] [PubMed] [Google Scholar]
  • 33.Roland M. Linking physicians' pay to the quality of care — a major experiment in the United Kingdom. N Engl J Med. 2004;351(14):1448–1454. doi: 10.1056/NEJMhpr041294. [DOI] [PubMed] [Google Scholar]
  • 34.Campbell SM, Reeves D, Kontopantelis E, et al. Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009;361(4):368–378. doi: 10.1056/NEJMsa0807651. [DOI] [PubMed] [Google Scholar]
  • 35.Forbes LJ, Marchand C, Doran T, Peckham S. The role of the Quality and Outcomes Framework in the care of long-term conditions: a systematic review. Br J Gen Pract. 2017;67(664):e775–e784. doi: 10.3399/bjgp17X693077. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Langdown C, Peckham S. The use of financial incentives to help improve health outcomes: is the quality and outcomes framework fit for purpose? A systematic review. J Public Health. 2014;36(2):251–258. doi: 10.1093/pubmed/fdt077. [DOI] [PubMed] [Google Scholar]
  • 37.Doran T, Fullwood C, Kontopantelis E, Reeves D. Effect of financial incentives on inequalities in the delivery of primary clinical care in England: analysis of clinical activity indicators for the quality and outcomes framework. Lancet. 2008;372(9640):728–736. doi: 10.1016/S0140-6736(08)61123-X. [DOI] [PubMed] [Google Scholar]
  • 38.Harrison MJ, Dusheiko M, Sutton M, et al. Effect of a national primary care pay for performance scheme on emergency hospital admissions for ambulatory care sensitive conditions: controlled longitudinal study. BMJ. 2014;349:g6423. doi: 10.1136/bmj.g6423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Roland M. Does pay-for-performance in primary care save lives? Lancet. 2016;388(10041):217–218. doi: 10.1016/S0140-6736(16)00550-X. [DOI] [PubMed] [Google Scholar]
  • 40.Ryan AM, Krinsky S, Kontopantelis E, Doran T. Long-term evidence for the effect of pay-for-performance in primary care on mortality in the UK: a population study. Lancet. 2016;388(10041):268–274. doi: 10.1016/S0140-6736(16)00276-2. [DOI] [PubMed] [Google Scholar]
  • 41.Beyer M, Gerlach F, Flies U, et al. The development of quality circles/peer review groups as a method of quality improvement in Europe. Results of a survey in 26 European countries. Fam Pract. 2003;20(4):443–451. doi: 10.1093/fampra/cmg420. [DOI] [PubMed] [Google Scholar]
  • 42.Minchin M, Roland M, Richardson J, et al. Quality of care in the United Kingdom after removal of financial incentives. N Engl J Med. 2018;379(10):948–957. doi: 10.1056/NEJMsa1801495. [DOI] [PubMed] [Google Scholar]
  • 43.Eijkenaar F, Emmert M, Scheppach M, Schöffski O. Effects of pay for performance in health care: a systematic review of systematic reviews. Health Policy. 2013;110(2-3):115–130. doi: 10.1016/j.healthpol.2013.01.008. [DOI] [PubMed] [Google Scholar]
  • 44.Ratcliffe HL, Schwarz D, Hirschhorn LR, et al. PHC progression model: a novel mixed-methods tool for measuring primary health care system capacity. BMJ Glob Health. 2019;4(5):e001822. doi: 10.1136/bmjgh-2019-001822. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Veillard J, Cowling K, Bitton A, et al. Better measurement for performance improvement in low- and middle-income countries: the primary health care performance initiative (PHCPI) experience of conceptual framework development and indicator selection. Milbank Q. 2017;95(4):836–883. doi: 10.1111/1468-0009.12301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Goodyear-Smith F, Bazemore A, Coffman M, et al. Primary care research priorities in Low-and middle-income countries. Ann Fam Med. 2019;17(1):31–35. doi: 10.1370/afm.2329. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Goodyear-Smith F, Bazemore A, Coffman M, et al. Research gaps in the organisation of primary healthcare in low-income and middle-income countries and ways to address them: a mixed-methods approach. BMJ Glob Health. 2019;4(Suppl 8):e001482. doi: 10.1136/bmjgh-2019-001482. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Kringos D, Boerma W, Bourgueil Y, et al. The strength of primary care in Europe: an international comparative study. Br J Gen Pract. 2013;63(616):e742–e750. doi: 10.3399/bjgp13X674422. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Kringos DS, Boerma WGW, Bourgueil Y, et al. The European primary care monitor: structure, process and outcome indicators. BMC Fam Pract. 2010;11(1):81. doi: 10.1186/1471-2296-11-81. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from BJGP Open are provided here courtesy of Royal College of General Practitioners

RESOURCES