Abstract
Background
The aim of our study was to describe variability in process quality in family medicine among 31 European countries plus Australia, New Zealand, and Canada. The quality of family medicine was measured in terms of continuity, coordination, community orientation, and comprehensiveness of care.
Methods
The QUALICOPC study (Quality and Costs of Primary Care in Europe) was carried out among family physicians in 31 European countries (the EU 27 except for France, plus Macedonia, Iceland, Norway, Switzerland, and Turkey) and three non-European countries (Australia, Canada, and New Zealand). We used random sampling when national registers of practitioners were available. Regional registers or lists of facilities were used for some countries.
A standardized questionnaire was distributed to the physicians, resulting in a sample of 6734 participants. Data collection took place between October 2011 and December 2013. Based on completed questionnaires, a three-dimensional framework was established to measure continuity, coordination, community orientation, and comprehensiveness of care. Multilevel linear regression analysis was performed to evaluate the variation of quality attributable to the family physician level and the country level.
Results
None of the 34 countries in this study consistently scored the best or worst in all categories. Continuity of care was perceived by family physicians as the most important dimension of quality. Some components of comprehensiveness of care, including medical technical procedures, preventive care and health care promotion, varied substantially between countries. Coordination of care was identified as the weakest part of quality. We found that physician-level characteristics contributed to the majority of variation.
Conclusions
A comparison of process quality indicators in family medicine revealed similarities and differences within and between countries. The researchers found that the major proportion of variation can be explained by physicians’ characteristics.
Electronic supplementary material
The online version of this article (doi:10.1186/s12875-015-0386-7) contains supplementary material, which is available to authorized users.
Keywords: Family physician, Process quality, Country, Comparison
Background
Primary healthcare (PHC) is the foundation of healthcare systems in many parts of the world [1, 2]. Family physicians (FPs) are crucial stakeholders in delivering national health policy through primary care [3–6].
Although the World Health Organization (WHO) definition of primary healthcare is widely accepted, there are differences between countries [2]. A recent WHO World Health Report emphasized the importance of measuring health system performance [7]. Variation in performance occurs in the structure, processes, and outcomes of care; causes of variation include systemic factors, reimbursement, service organization and capacity, cultural factors, and disease epidemiology [8, 9]. Studies at the international level [10, 11] revealed striking differences between practice systems in terms of incentives, practice information capacity, access, the use of teams in quality policy, detection of quality and safety problems, staff and patient safety, inclusion of patients’ perspectives, and the length of consultations [12].
Much is known about specific parameters, such as specific disease management [13–15], guidelines, and outcomes of treatment [16], and researchers have insight into the workload [17, 18], but there is a lack of complex multilevel comparisons between countries. Analyses usually focus on secondary and tertiary care [19, 20]. An important development is also extending the scope of reporting particularly into primary care [21].
The broad concept of quality in healthcare [22, 23] can be divided into the features of structure, process, and outcome. Four dimensions are specially addressed: continuity, coordination, comprehensiveness of care, and community orientation [23–26]. Continuity of care includes informational, relational, and management continuity. Coordination reflects the organization of services between different levels of care. Comprehensiveness is defined by the scope of practice and a wide range of services provided by FPs [27]. Community orientation is important for a feasible and sustainable health system [28].
This study describes the variability in process quality in family medicine among 31 European countries plus Australia, New Zealand, and Canada.
Methods
Study design
The Quality and Costs of Primary Care in Europe study (QUALICOPC) was a descriptive cross-sectional study designed to collect information about the practice setting, the services provided, patient values, and patient experience. This study presents the results of participating FPs. The detailed rationale, design, and methods of QUALICOPC have been previously described [29, 30].
Setting
The study was held among FPs in 31 European countries (the EU 27 except for France, plus Macedonia, Iceland, Norway, Switzerland, and Turkey) and three non-European countries (Australia, Canada, and New Zealand). All 10 provinces in Canada participated. In the United Kingdom, the study took place only in England. At the beginning of the project, we also included France. Due to various setbacks, we did not succeed in collecting data and therefore France was excluded from the study.
Participants
At the coordinators’ meeting, we decided that the number of FPs sampled should be large enough to obtain a response from at least 220 FPs in each country (one FP per practice). Thus, the size of the sample depended on the expected participation of FPs. For example, if the national coordinator expected 25 % of the FPs contacted to participate, the original sample size had to include at least 880 FPs. In countries with a very small population, the desired number of FPs surveyed was smaller (80 to 100). FPs were invited to participate using various methods: e-mail, letters, telephone calls, personal contacts, and advertisements.
We aimed for a nationally representative sample of FPs. If national registers of practitioners were available, we used random sampling to select practitioners. In countries with only regional registers, random samples were drawn from regions that represented the national setting. If no registers existed, but only lists of facilities in a country, a random selection was made from such lists [29, 31, 32]. The sampling and recruitment procedures with response rates per country are presented in Appendix A: Table 6.
Questionnaire
The original English version of the questionnaire was translated into the various national languages. A professional translator created an independent back-translation (the final questionnaire is available in Additional file 1). FPs answered questions related to the primary care process (i.e., continuity, coordination, community orientation, and comprehensiveness of care). Ethical approvals were acquired in line with the legal requirements in each country. Dimensions (Table 1) were composed from indicators based on a literature review [6, 30]. This review also contributed to different scales of a specific indicator. Higher values on the score indicated a higher level of process quality.
Table 1.
Selected indicators and dimensions of process quality in primary healthcare
| Dimension | Definition of indicator | Scale |
|---|---|---|
| Continuity of care | Medical recordkeeping: inclusion of important health information | 0 to 1 |
| Medical recordkeeping: regularity of keeping medical files | 0 to 1 | |
| Informational continuity of care with primary care: receiving records from previous doctor | 1 to 3 | |
| Informational continuity of care with secondary care: receiving discharge report | 1 to 5 | |
| Coordination of care | Skill mix: disciplines in practice | 0 to 1 |
| Integration of primary and secondary care: asking other specialists for advice | 1 to 3 | |
| Collaboration with other providers | 1 to 3 | |
| Community orientation | Reporting potential repeated accidents in an industry, frequent respiratory problems in patients living near a particular industry, and repeated cases of food poisoning among people living in a certain district to an authority | 1 to 4 |
| Comprehensiveness of care | Medical equipment available | 0 to 1 |
| First contact for common health problems | 1 to 4 | |
| Treatment and follow-up diseases | 1 to 4 | |
| Medical technical procedures and preventive care | 1 to 4 | |
| Healthcare promotion | 0 to 1 |
Data collection and analysis
Data collection took place between October 2011 and December 2013. The FP questionnaire was completed by 6734 FPs. Statistical analyses were performed using IBM SPSS Statistics for Windows (Version 21.0, Released 2012. Armonk, NY: IBM Corp). The confidence level was set at p < 0.05. All indicators were rescaled to a common scale (a z-score) with an average of zero and a standard deviation of one.
Standardized scores were used for inter-indicator comparisons and calculation of the composites for each dimension. The composite score of a dimension was defined as the mean of z-scores for relevant indicators. The Pearson correlation of each dimension in relation to the corresponding composite was also examined. We computed the means and standard deviations of all indicators at the country level and for the entire sample to determine discriminative power. To gain more insight into country patterns, the 34 countries were plotted on a graph using the composite scores for continuity, coordination, community orientation, and comprehensiveness. We used linear mixed models to decompose the variance of the composites into two components: the FP level and the country level. We estimated null and random intercept models by using variance component as the covariance structure and maximum likelihood. The indicators of process quality were defined as dependent variables. To assess the proportion of variance by country, we computed the interclass correlations (ICC).
Ethics approval
Ethics approval was acquired in accordance with the legal requirements in each country. We listed the full name of every ethics committee which approved the study protocol in Additional file 2. There are 6 countries where there was no requirement to go through the ethics procedure. The explanation for those countries is given in the same additional file, for example the national coordinator of Slovakia consulted with the Council of the Slovak Society of General Practice. It was confirmed that there is no statutory requirement for ethical approval for this study.
Depending on the national requirements, written or oral informed consent was requested. The general procedure was that FPs were invited via letter, e-mail or telephone and gave their consent to participate in the study. Patients were invited by the fieldworker or practice staff to complete a questionnaire. All participants were informed about the study and participation was voluntary.
Results
Demographic characteristics
We received completed questionnaires from 6734 FPs. The average age of an FP was 50.3 ± 9.7 years. FPs were predominantly female in 15 countries (91.6 % in Estonia, followed by Lithuania, Latvia, Romania, Macedonia, and Slovenia). The least female workforces were observed in Switzerland, the Netherlands, Iceland, Austria, Malta, and Ireland. Greece had the youngest FPs (average 43.3 years), and Italy the oldest (57.0 years). A total of 2534 FPs (38.0 %) were 55 or older, ranging from 5.4 % (n = 15) in Turkey to 73.4 % (n = 149) in Italy. The largest proportion of FPs continuing to work after age 65 was in Hungary (14.9 %) and Slovakia (11.3 %).
Continuity and coordination of care by country
Belgium, Germany, Norway, Slovenia, Sweden, Switzerland, England, Australia, and New Zealand stand out as excellent for continuity of care, with positive scores for all four indicators. Cyprus, Greece, and Malta had negative z-scores for the same four indicators (Fig. 1).
Fig. 1.
Standardized performance of continuity of care indicators by country. Notes: In Figs. 1 and 2, indicators were rescaled to a common scale with an average of zero and standard deviation of one (i.e., z-scores). If a z-score was positive, its corresponding raw score was above the mean. If a z-score was negative, its corresponding raw score was below the mean
Variation of coordination of care indicators by country are presented in Fig. 2. Skill mix, integration, and collaboration differ from country to country. On the other hand, countries are grouped differently here than in Fig. 1. The highest scores for collaboration with other providers were reported in Sweden, the Netherlands, Finland, Poland, and Greece.
Fig. 2.
Standardized performance on coordination of care indicators by country
Variation of dimensions between countries
The dimensions were calculated as composites and are composed of individual indicators; they show the general state of continuity, coordination, community orientation, and comprehensiveness of care in a specific country. Composite scores make it possible to assess which dimension is the most variable in the group of 34 countries (Table 2). Community orientation, with an absolute range of 1.825, was the most variable dimension, followed by continuity of care (1.798), coordination (1.683), and comprehensiveness of care (1.565).
Table 2.
Composite scores of process quality dimensions by country by mean and standard deviation
| Country | Continuity of care | Coordination of care | Community orientation | Comprehensiveness of care |
|---|---|---|---|---|
| Europe | ||||
| Austria | −0.149 (0.465) | −0.468 (0.524) | 0.066 (0.905) | 0.126 (0.589) |
| Belgium | 0.170 (0.427) | −0.339 (0.563) | −0.017 (0.888) | 0.001 (0.402) |
| Bulgaria | −0.401 (0.605) | 0.106 (0.637) | 0.050 (0.927) | −0.237 (0.492) |
| Cyprus | −0.678 (0.669) | 0.441 (0.506) | −1.284 (1.685) | −0.827 (0.464) |
| Czech Republic | 0.282 (0.321) | −0.398 (0.453) | −0.050 (0.813) | −0.766 (0.404) |
| Denmark | 0.288 (0.377) | −0.649 (0.387) | −0.058 (0.840) | 0.423 (0.311) |
| England | 0.513 (0.225) | 0.561 (0.475) | 0.204 (0.854) | 0.692 (0.409) |
| Estonia | −0.158 (0.451) | −0.149 (0.480) | −1.159 (1.293) | −0.184 (0.342) |
| Finland | 0.075 (0.433) | 1.034 (0.511) | 0.051 (0.706) | 0.372 (0.522) |
| Germany | 0.371 (0.316) | −0.574 (0.468) | −0.364 (0.917) | 0.263 (0.391) |
| Greece | −1.085 (0.905) | 0.194 (0.542) | 0.325 (1.011) | 0.045 (0.590) |
| Hungary | 0.066 (0.467) | −0.276 (0.437) | −0.728 (1.635) | −0.440 (0.462) |
| Iceland | −0.139 (0.373) | 0.702 (0.532) | 0.191 (0.734) | 0.093 (0.468) |
| Ireland | 0.197 (0.328) | −0.026 (0.453) | −0.055 (0.855) | 0.476 (0.424) |
| Italy | −0.394 (0.534) | −0.617 (0.546) | 0.304 (0.819) | −0.601 (0.359) |
| Latvia | −0.020 (0.516) | 0.175 (0.509) | −0.326 (1.105) | −0.410 (0.413) |
| Lithuania | −0.073 (0.436) | 0.896 (0.650) | 0.049 (0.987) | 0.021 (0.476) |
| Luxembourg | 0.038 (0.362) | −0.537 (0.597) | −0.023 (0.966) | −0.303 (0.471) |
| Macedonia | −0.221 (0.516) | −0.259 (0.516) | 0.083 (0.960) | −0.362 (0.428) |
| Malta | −0.840 (0.588) | −0.101 (0.547) | 0.085 (0.935) | −0.410 (0.442) |
| Netherlands | 0.305 (0.264) | 0.657 (0.502) | 0.247 (0.843) | 0.574 (0.393) |
| Norway | 0.273 (0.318) | −0.019 (0.475) | 0.542 (0.814) | 0.627 (0.300) |
| Poland | −0.306 (0.509) | 0.211 (0.648) | 0.053 (1.115) | −0.546 (0.396) |
| Portugal | 0.227 (0.433) | −0.175 (0.392) | −0.306 (0.978) | −0.216 (0.386) |
| Romania | −0.065 (0.502) | −0.368 (0.548) | 0.024 (1.285) | −0.532 (0.489) |
| Spain | 0.189 (0.456) | 0.170 (0.544) | 0.236 (0.761) | 0.369 (0.403) |
| Slovakia | −0.576 (0.781) | −0.468 (0.485) | 0.093 (1.007) | −0.770 (0.528) |
| Slovenia | 0.248 (0.323) | 0.187 (0.484) | 0.087 (0.847) | 0.294 (0.431) |
| Sweden | 0.317 (0.319) | 0.665 (0.473) | −0.258 (0.993) | 0.738 (0.296) |
| Switzerland | 0.368 (0.333) | −0.367 (0.459) | −0.039 (0.843) | 0.490 (0.390) |
| Turkey | −1.194 (0.617) | −0.447 (0.494) | 0.477 (0.868) | −0.748 (0.444) |
| Non-European | ||||
| Australia | 0.363 (0.344) | −0.0620 (0.527) | −0.146 (0.910) | 0.351 (0.418) |
| Canada | 0.239 (0.327) | 0.25 (0.659) | −0.104 (0.852) | 0.131 (0.465) |
| New Zealand | 0.604 (0.199) | 0.129 (0.480) | 0.122 (0.736) | 0.736 (0.372) |
Notes: Composite scores of dimensions are calculated as the mean values of standardized indicators. A positive score indicates that the average value is above the mean, and a negative score indicates below the mean. The minimum and maximum values in Table 2 are the lowest and highest scores recorded for each dimension. The range is the measure of the absolute difference between the minimum and maximum values
Clusters of countries
Countries were combined into clusters according to their rankings based on composite scores. Table 3 shows which countries were grouped into the top and bottom five positions. The ranks of Australia, Canada, and New Zealand are also shown separately because they are non-European countries. The country with best “top five” positions was the Netherlands, and Cyprus and Slovakia shared the worst place among “bottom five” countries.
Table 3.
Range of composite scores with country rankings by process quality dimensions
| Continuity of care | Coordination of care | Community orientation | Comprehensiveness of care | |
|---|---|---|---|---|
| Minimum | −1.194 | −0.649 | −1.284 | −0.827 |
| Maximum | 0.604 | 1.034 | 0.542 | 0.738 |
| |Range| | 1.798 | 1.683 | 1.825 | 1.565 |
| Top five countries | New Zealand | Finland | Norway | Sweden |
| England | Lithuania | Turkey | New Zealand | |
| Germany | Iceland | Greece | England | |
| Switzerland | Sweden | Italy | Norway | |
| Australia | Netherlands | Netherlands | Netherlands | |
| Bottom five countries | Turkey | Denmark | Cyprus | Cyprus |
| Greece | Italy | Estonia | Slovakia | |
| Malta | Germany | Hungary | Czech Republic | |
| Cyprus | Luxembourg | Germany | Turkey | |
| Slovakia | Slovakia | Latvia | Italy | |
| Non-European | ||||
| Australia | 5th | 18th | 27th | 11th |
| Canada | 12th | 8th | 26th | 14th |
| New Zealand | 1st | 14th | 10th | 2nd |
Contribution of FP characteristics and country characteristics to total variability in quality
In addition to country rankings, this study sought to estimate how much variability in process quality indicators stems from within-group differences (i.e., individual level) how much from between-group differences (i.e., country level; Table 4).
Table 4.
Multilevel model, which includes variance in individual FP level and country-system level
| Dimension | Indicator | Constant | FP-level variance | Country-level variance | ICC (%) |
|---|---|---|---|---|---|
| Continuity of care | Inclusion of important health information in medical records | 0.887 | 0.016 | 0.007 | 28.8 |
| Regularity of keeping medical record files | 0.773 | 0.135 | 0.038 | 22.2 | |
| Receiving records from previous primary care doctor | 2.430 | 0.308 | 0.250 | 44.8 | |
| Receiving discharge reports from secondary care | 3.767 | 1.012 | 0.434 | 30.0 | |
| Coordination of care | Skill mix: disciplines in practice | 0.223 | 0.006 | 0.036 | 84.9 |
| Asking other specialists for advice | 1.688 | 0.185 | 0.029 | 13.7 | |
| Collaboration with other providers | 1.917 | 0.060 | 0.025 | 29.3 | |
| Community orientation | Reporting potential public health threats in a particular district to an authority | 3.255 | 0.295 | 0.043 | 12.7 |
| Comprehensiveness of care | Medical equipment available | 0.534 | 0.018 | 0.040 | 68.3 |
| First contact for common health problems | 2.904 | 0.175 | 0.087 | 33.2 | |
| Treatment and follow-up of diseases | 3.268 | 0.169 | 0.077 | 31.3 | |
| Medical technical procedures and preventive care | 2.114 | 0.199 | 0.452 | 69.4 | |
| Healthcare promotion | 0.193 | 0.019 | 0.009 | 30.8 |
Notes: Multilevel models were estimated using raw data. Tests of significance for all models showed that the average (constant) statistically differed from zero (p = 0.000 < 0.05). ICC values were calculated as percentage of country level variance in total observed variance
The main share of the total variation is explained by individual FP characteristics. The ICC values in 10 out of 13 indicators show that the majority of total variability is based on the variability between the FPs.
In addition, the overall contribution of FP characteristics to variation of quality related to the four dimensions was estimated (Table 5). The ICC values revealed that the main part of the total variation is explained by country characteristics only in the case of the comprehensiveness of care dimension. The other three dimensions (i.e. continuity, coordination, community orientation) show that majority of total variability stems from the variability between FPs. The smallest overall contribution of country-system features to variation in quality was assessed for the community orientation dimension.
Table 5.
Multilevel model based on composite scores for quality dimensions
| Dimension | Constant | FP-level variance | Country-level variance | ICC (%) |
|---|---|---|---|---|
| Continuity of care | −0.034 | 0.216 | 0.185 | 46.2 |
| Coordination of care | 0.002 | 0.279 | 0.199 | 41.7 |
| Community orientation | −0.045 | 0.906 | 0.132 | 12.7 |
| Comprehensiveness of care | −0.015 | 0.190 | 0.227 | 54.5 |
Notes: ICC values were calculated as the percentage of country-level variance in total observed variance
Discussion
The advantage of the study lies in the fact that it is a comparison between 34 countries, which is a much larger number compared to other international studies [33, 34], which usually do not have an accurate inventory selection of physicians in individual countries and their response rates [33–35].
A previous study of this group assessed dimensions of PC and indicators for these dimensions [19]. This study sought to comprehensively evaluate primary care systems by perceptions of FPs (FP questionnaire). Compared to QUALICOPC, PHAMEU (Primary Health Care Activity Monitor for Europe) was more oriented toward the system and structure of primary care, and this is why we cannot draw direct parallels between the two studies. The PHAMEU countries with the strongest primary care structure were Denmark, Finland, Italy, the Netherlands, Portugal, Romania, Slovenia, Spain, and the United Kingdom. Countries with a relatively weak primary care structure in all three dimensions were Bulgaria, Cyprus, the Czech Republic, Greece, Iceland, Luxembourg, Poland, and Slovakia [36].
Continuity
Continuity of care is strongly related to the organization of primary care, which should not be fragmented and should have few entry points into the overall healthcare system [21].
Composite scores of continuity of care were ranked as unfavourable in Turkey and Greece, Malta, Cyprus, and Slovakia. The best continuity composite scores were calculated in New Zealand and England. This diversity might be a consequence of different conditions of primary care delivery. Our results confirm the results of Kringos et al., who already pointed out problems of continuity in Turkish general practice, suggesting reductions in list size [37, 38] and discussions about the future of FPs in Greece, which have resulted in proposals to increase quality and efficiency [39].
Coordination
Well-coordinated care is important for patients with chronic illnesses, especially those with multiple conditions. Patients with chronic illnesses do better in countries with strong primary care infrastructures, even if deficiencies exist in all countries [40], especially in the transition after hospital discharge, with inadequate coordination between various physicians and in weak efforts engaging or supporting patients to manage their own health.
In our study, Dutch, Finish, Lithuanian, Icelandic, and Swedish FPs reported positive experiences with coordination of care. Coordination in Germany, Denmark, Italy, Luxembourg, and Slovakia was not assessed as good. Schoen et al. [26] found a different situation. Physicians in Germany did not believe that their patients experience coordination problems. German doctors reported the lowest rates of concern on three out of four coordination questions. The differences between the results published by Schoen and our results can be explained by different measurement instruments. Whereas Schoen’s assessment of coordination primarily applied to the timely transfer of diagnoses between the FP and other specialists, our survey also included questions about integration between various levels and the frequency of direct consultations between FPs and specialists.
Small private practices in Denmark may impede coordination of care and lead to a “culture of individualism.” Recent Danish initiatives are trying to improve coordination between the primary and secondary healthcare sectors [41].
Community orientation
Community orientation is considered one of the key features of good PHC [42–44].
Nevertheless, this showed the most variation between countries. This probably reflects the differences in health systems in the countries studied and the historical background against which the systems were shaped in the past.
Comprehensiveness
In this study, FPs from Sweden, New Zealand, England, Norway, and the Netherlands evaluated comprehensiveness of care as very good. The opposite situation was found in Cyprus, Slovakia, the Czech Republic, Turkey, and Italy. Schäfer et al. [32] found a high need for improvement in comprehensiveness in Cyprus and Malta, and a medium need in Turkey.
Overall
Overall, none of the 34 countries in this study consistently scored the best or worst in all categories of quality measured. The Netherlands was the only country that achieved the best average ranks in all four dimensions. New Zealand placed in the “top five” position for continuity and comprehensiveness of care, but was not as good for coordination of care and community orientation. Cyprus and Slovakia placed in the “bottom five” position three times. Another study found that “within a given health care system, doctors’ personal and practice characteristics explained only a small part of the variance in attitudes toward the provision of personal continuity of care” [45]. We found that that more than half of the variance was explained by physicians’ characteristics and not the characteristics of the country healthcare system. The results seem reasonable because the FPs in our study primarily evaluated their own practices and not general national health services. Future intervention to improve the quality of primary care should focus on the FP-level characteristics identified in this study.
Strengths and limitations
We believe that the 6734 participating FPs, selection criteria, and response rates are important achievements of this study. The respondents were considered representative of the national FP population. However, the target of 220 FPs was not reached in some smaller countries (e.g., Cyprus, Iceland, Luxembourg, and Malta). In a large country like Canada, GPs were sampled from a nationally representative region [31]. We sought to acquire a qualitatively and quantitatively sufficient response in each country. The variation in response rates between countries was partly due to structural challenges. In fact, in many participating countries there is not a national central register of FPs and this is why we had to approach the FPs individually [31]. In any case, we tried to maximize the responsiveness of FPs and we considered recommendations to increase the response rates [46].
The limitations of this study lie in self-reporting of FPs. We do not know whether the FPs in all countries were equally critical of their primary care situation. It is possible that physicians in some countries that have high-quality primary healthcare are more critical of their own work than physicians in countries with less optimal quality of care. Important information about the quality of primary healthcare can also be obtained from patients’ assessments of their own care. An analysis based on this data will be presented in subsequent studies and articles.
There were also limitations in the data set. The specific set of variables used in this analysis was selected based on the initial reduction of all variables by NIVEL (the Netherlands Institute for Health Services Research). Additional issues in the FP questionnaire could have been included to broaden the dimension of community orientation. On the other hand, doctors that inform the community about possible health threats usually also coordinate processes that protect the community.
Another limitation may have been in the way composite scores were weighted. Composites summarize data from many quality indicators to aid in understanding complex processes [47]. We are aware that weighting systems are arbitrary. On the other hand, composite measures are increasingly used to assess the universal quality of healthcare.
Conclusions
There is broad variation in the perception of process quality in family practice. The greatest variation is in community orientation. The main factor in variability seems to be physicians’ characteristics as defined in this study. This is useful in formulating recommendations for health policy because it has implications for doctors’ training and other policy measures.
Acknowledgments
The authors thank their partners in the QUALICOPC project for their role throughout the study and their coordination of the data collection: W Boerma, P Groenewegen, W Schäfer, F Schellevis, P Spreeuwenberg, D Kringos (the Netherlands, NIVEL, coordinator); J De Maeseneer, E De Ryck, L Hanssens, A Van Pottelberge, S Willems (Belgium); S Greß, S Heinemann (Germany); G Capitani, S De Rosis, AM Murante, S Nuti, C Seghieri, M Vainieri (Italy); M Van den Berg, and T Van Loenen (the Netherlands). The authors would like to thank the coordinators of the data collection in each country: L Jorm, I McRae (Australia); K Hoffmann, M Maier (Austria); P Salchev (Bulgaria); W Wodchis, W Hogg (Canada); G Samoutis (Cyprus); B Seifert, N Šrámková (Czech Republic); J Reinholdt Jensen, P Vedsted (Denmark); M Lember, K Põlluste (Estonia); E Kosunen (Finland); K Stavric (Macedonia); C Lionis (Greece), I Rurik (Hungary); J Heimisdóttir, O Thorgeirsson (Iceland); C Collins (Ireland); G Ticmane (Latvia); S Macinskas (Lithuania), M Aubart, J Leners, R Stein (Luxembourg); G Bezzina, P Sciortino (Malta); T Ashton, R McNeill (New Zealand); T Bjerve Eide, H Melbye (Norway); M Oleszczyk, A Windak (Poland); L Pisco (Portugal), D Farcasanu (Romania); T Dedeu (Spain); E Jurgova (Slovakia); C Björkelund, T Faresjö (Sweden); T Bisschoff, N Senn (Switzerland); M Akman (Turkey); C Sirdifield, and N Siriwardena (UK). We would like to thank the GPs that participated in the QUALICOPC study. Thanks are due to John Yaphe for editorial assistance and to John Boyd for linguistic corrections in preparing this paper.
This article is based on the QUALICOPC project, co-funded by the European Commission under the Seventh Framework Programme (FP7/2007–2013) under grant agreement 242141. Financial support was provided by national institutes. The contribution of European Commission was € 2,198,877.00. The financial officer Baiba Hermanns-Vagule of NIVEL developed contracts for national organisations and coordinators.
Abbreviations
- FP
family physician
- ICC
interclass correlation
- NIVEL
Netherlands Institute for Health Services Research
- PHAMEU
Primary Health Care Activity Monitor for Europe
- PHC
primary healthcare
- QUALICOPC
Quality and Costs in Primary Care
- WHO
World Health Organization
Appendix A
Table 6.
Sampling and recruitment procedures with response rates per country
| Country | Sampling procedurea | Recruitment methods | FPs invited | FPs participated | Response rate |
|---|---|---|---|---|---|
| Europe | |||||
| Austria | B | E-mail, personal contact | 3050 | 173 | 6% |
| Belgium | B | Letter, telephone, e-mail | 5000 | 382 | 8% |
| Bulgaria | B | Telephone, face-to-face | 350 | 209 | 60% |
| Cyprus | A | Letter, telephone | 90 | 67 | 74% |
| Czech Republic | B | Letter, telephone, personal contact | 520 | 205 | 39% |
| Denmark | B | 2000 | 199 | 10% | |
| England | C | Letter, e-mail | 1508 | 160 | 11% |
| Estonia | A | Letter, telephone, e-mail | 802 | 121 | 15% |
| Finland | D | Letter, e-mail, telephone, personal contact | 1000 | 270 | 27% |
| Germany | B | Letter | 3825 | 223 | 6% |
| Greece | D | Telephone, letter | 300 | 206 | 69% |
| Hungary | B | E-mail and personal contact | 400 | 209 | 52% |
| Iceland | A | Letter and personal contact | 95 | 75 | 79% |
| Ireland | D | Letter, e-mail, personal contact, advertisement | 2515 | 158 | 6% |
| Italy | E | Telephone | Not known | 204 | Not known |
| Latvia | B | Telephone, e-mail | 545 | 205 | 38% |
| Lithuania | B | Personal contact, telephone | 508 | 211 | 42% |
| Luxembourg | A | Telephone | 120 | 73 | 61% |
| Macedonia | B | Letter, e-mail | 240 | 134 | 56% |
| Malta | B | Telephone | 78 | 65 | 83% |
| Netherlands | B | Letter, e-mail, telephone | 1400 | 224 | 16% |
| Norway | E | Letters, telephone, conferences | 500 | 185 | 37% |
| Poland | C | Letter, telephone, e-mail | 665 | 206 | 31% |
| Portugal | B | Letter, e-mail, telephone | 800 | 203 | 25% |
| Romania | B | Letter, telephone, e-mail, personal contact | 399 | 206 | 52% |
| Spain | C | E-mail, telephone | 500 | 402 | 80% |
| Slovakia | B | Letter, telephone, personal contact | 1000 | 206 | 21% |
| Slovenia | B | Letter, telephone, e-mail | 1173 | 194 | 17% |
| Sweden | B | Letter | 1000 | 91 | 9% |
| Switzerland | B | Letter, telephone | 2027 | 186 | 9% |
| Turkey | C | Letter and personal contact | 1300 | 281 | 22% |
| Non-European | |||||
| Australia | D | Letter | 3201 | 142 | 4% |
| Canada | B | Letter, e-mail, telephone | 23,671 | 502 | 2% |
| New Zealand | B | Letter | 1371 | 157 | 11% |
Notes: aSampling procedures codes: A) almost entire FP population; B) random national sample (stratified or not); C) random sample in pre-selected regions; D) mixed procedure (random procedure plus selected FPs); E) opportunity sampling and volunteers
Additional files
Questionnaire for FPs. (DOC 120 kb)
(DOCX 19 kb)
Footnotes
Competing interests
The authors declare that they have no competing interests. The QUALICOPC project was co-funded by the European Commission as part of its Seventh Framework Programme (FP7/2007–2013) under a grant agreement.
Authors’ contributions
DRP was the main coordinator on behalf of the QUALICOPC group of the work package Structure of Primary Care Related to Quality of Service Provision. She contributed to the conception and design of the study and data acquisition. She drafted the manuscript. MS was the primary person responsible for statistical data analysis. ZKK participated in analysing and interpreting the data, and helped draft the manuscript. IS participated in data acquisition at the regional level and reviewed the manuscript. All of the authors read and approved the final manuscript.
Contributor Information
Danica Rotar Pavlič, Phone: +386 1 363 4177, Email: danica.rotar@guest.arnes.si.
Maja Sever, Email: maja.sever1@gmail.com.
Zalika Klemenc-Ketiš, Email: zalika.klemenc.ketis@gmail.com.
Igor Švab, Email: igor.svab@mf.uni-lj.si.
References
- 1.American College of Physicians. Reform of the dysfunctional healthcare payment and delivery system. A position paper. 2006. http://www.acponline.org/advocacy/current_policy_papers/assets/dysfunctional_payment.pdf. Accessed 23 Feb 2015.
- 2.World Health Organization. Declaration of Alma-Ata. International conference on primary health care: Alma-Ata, 6–12 September 1978. In http://www.who.int/publications/almaata_declaration_en.pdf. Accessed 23 Feb 2015.
- 3.Evans P, ed. The European definition of general practice / family medicine. 2002. http://www.aile.net/sunum/dersnot/fame/module1/pres1/pres1europeandef.pdf. Accessed 23 Feb 2015.
- 4.Allen J, ed. The European definition of general practice / family medicine. 2005. http://www.woncaeurope.org/sites/default/files/documents/Definition%20EURACTshort%20version.pdf. Accessed 23 Feb 2015.
- 5.Pirkis JE, Blashki GA, Murphy AW, Hickie IB, Ciechomski L. The contribution of general practice based research to the development of national policy: case studies from Ireland and Australia. Aust New Zealand Health Policy. 2006;3:4. doi: 10.1186/1743-8462-3-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kringos D, Boerma WGW, Hutchinson A, van der Zee J, Groenwegen P. The breadth of primary care: a systematic literature review of its core dimensions. BMC Health Serv Res. 2010;10:65. doi: 10.1186/1472-6963-10-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.World Health Organization. Quality of care: a process for making strategic choices in health systems. 2006. http://www.who.int/management/quality/assurance/QualityCare_B.Def.pdf. Accessed 23 Feb 2015.
- 8.Richards M. Extent and causes of international variations in drug usage. 2010. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/216249/dh_117977.pdf. Accessed 23 Feb 2015.
- 9.Smith PC. Measuring health system performance. Eur J Health Econ. 2002;3:145–8. doi: 10.1007/s10198-002-0138-1. [DOI] [PubMed] [Google Scholar]
- 10.Groenewegen P, Heinemann S, Greß S, Schäfer W. Primary care practice composition in 34 countries. Health Pol. 2015 doi: 10.1016/j.healthpol.2015.08.005. [Epub ahead of print] [DOI] [PubMed]
- 11.Engels Y, Campbell S, Dautzenberg M, van den Hombertgh P, Brinkmann H, Szécsényi J. Developing a framework of, and quality indicators for, general practice management in Europe. Fam Pract. 2005;22:215–22. doi: 10.1093/fampra/cmi002. [DOI] [PubMed] [Google Scholar]
- 12.Deveugele M, Derese A, van den Brink-Muinen A, Bensing J, De Maesener J. Consultation length in general practice: cross sectional study in six European countries. BMJ. 2002;325:472–8. doi: 10.1136/bmj.325.7362.472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Gensichen J, Beyer M, Muth C, Gerlach FM, von Korff M, Ormel J. Case management to improve major depression in primary health care: a systematic review. Psychol Med. 2006;1:7–14. doi: 10.1017/S0033291705005568. [DOI] [PubMed] [Google Scholar]
- 14.Kourtney J, Davis KJ, Landis SH, Oh Y-M, Mannino DM, Han MK, et al. Continuing to confront COPD international physician survey: physician knowledge and application of COPD management guidelines in 12 countries. Int J Chron Obstruct Pulmon Dis. 2015;10:39–55. doi: 10.2147/COPD.S70162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Cleland JGF, Cohen-Solal A, Cosin Aguilar J, Dietz R, Eastaugh J, Follath F, et al. Management of heart failure in primary care (the IMPROVEMENT of Heart Failure Programme): an international survey. Lancet. 2002;360(9346):1631–9. doi: 10.1016/S0140-6736(02)11601-1. [DOI] [PubMed] [Google Scholar]
- 16.Matthys J, De Meyere M, van Driel ML, De Sutter A. Differences among international pharyngitis guidelines: not just academic. Ann Fam Med. 2007;5(5):436–43. doi: 10.1370/afm.741. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Leibowitz R, Susan Day S, Dunt D. A systematic review of the effect of different models of after-hours primary medical care services on clinical outcome, medical workload, and patient and GP satisfaction. Fam Pract. 2003;20(3):311–7. doi: 10.1093/fampra/cmg313. [DOI] [PubMed] [Google Scholar]
- 18.Deveugele M, Derese A, van den Brink-Muinen A, Bensing J, De Maeseneer J. Consultation length in general practice: cross sectional study in six European countries. BMJ. 2002;325:472. doi: 10.1136/bmj.325.7362.472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Hussey PS, Anderson GF, Osborn R, Feek C, McLaughlin V, Millar J, et al. How does the quality of care compare in five countries? Health Aff. 2004;23(3):89–99. doi: 10.1377/hlthaff.23.3.89. [DOI] [PubMed] [Google Scholar]
- 20.Coello R, Gastmeier P, de Boer AS. Surveillance of hospital-acquired infection in England, Germany, and the Netherlands. Will international comparison of rates be possible? Infect Control Hosp Epidemiol. 2001;22(6):393–7. doi: 10.1086/501923. [DOI] [PubMed] [Google Scholar]
- 21.Appleby J, Raleigh V, Frosini F, Bevan G, Gao H, Lyscom T. Variations in health care. The good, the bad and the inexplicable. 2011. http://www.kingsfund.org.uk/sites/files/kf/Variations-in-health-care-good-bad-inexplicable-report-The-Kings-Fund-April-2011.pdf.
- 22.Kringos DS, Boerma WGW, Bourgueil Y, Caartier T, Hasvold T, Hutchinson A. The European primary care monitor: structure, process and outcome indicators. BMC Fam Pract. 2010;11:81. doi: 10.1186/1471-2296-11-81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Hansen J, Groenewegen PP, Boerma WGW, Kringos DS. Living In A Country With A Strong Primary Care System Is Beneficial To People With Chronic Conditions. Health Aff. 2015;34(9):1531-1537 [DOI] [PubMed]
- 24.Saltman RB, Rico A, Boerma WGW. Primary care in the driver’s seat? Organisational reform in European primary care. New York: Open University Press; 2006. Mapping primary care across Europe. [Google Scholar]
- 25.Mant J. Process versus outcome indicators in the assessment of quality of health care. Int J Qual Health Care. 2001;13:475–80. doi: 10.1093/intqhc/13.6.475. [DOI] [PubMed] [Google Scholar]
- 26.Laberge M, Pang J, Walker K, Wong S, Hogg W, Wodchis WP. QUALICOPC (Quality and Costs of Primary Care) Canada. A focus on the aspects of primary care most highly rated by current patients of primary care practices. Ottawa: Canadian Foundation for Healthcare Improvement; 2014. [Google Scholar]
- 27.Cave AJ, Parameswaran L. Comprehensiveness of care by family physicians in Edmonton. Adv Med Educ Pract. 2011;2:127–38. doi: 10.2147/AMEP.S18747. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Gofin J, Foz G. Training and application of community-oriented primary care (COPC) through family medicine in Catalonia, Spain. Fam Med. 2008;40(3):196–202. [PubMed] [Google Scholar]
- 29.Schäfer WLA, Boerma WGW, Kringos DS, De Maeseneer J, Greß S, Heinemann S, et al. QUALICOPC, a multi-country study evaluating quality, costs and equity in primary care. BMC Fam Pract. 2011;12:115. doi: 10.1186/1471-2296-12-115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Schäfer WLA, Boerma WGW, Kringos DS, De Evelyne R, Greß S, Heinemann S, et al. Measures of quality, costs and equity in primary health care: instruments developed to analyse and compare primary health care in 35 countries. Qual Prim Care. 2013;21(2):67–79. [PubMed] [Google Scholar]
- 31.Wong ST, Chau LW, Hogg W, Teare GF, Miedema B, Breton M, et al. An international cross-sectional survey on the quality and costs of primary care (QUALICO-PC): recruitment and data collection of places delivering primary care across Canada. BMC Fam Pract. 2015;16:20. doi: 10.1186/s12875-015-0236-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Schäfer WLA, Boerma WGW, Murante AM, Sixma HJM, Schellevis FG, Groenewegen PP. Assessing the potential for improvement of primary care in 34 countries: a cross-sectional survey. Bull World Health Organ. 2015;93(3):161–8. doi: 10.2471/BLT.14.140368. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Soler JK, Okke I, Oskam S, van Boven K, Zivotic P, Jevtic M, et al. An international comparative family medicine study of the Transition Project data from the Netherlands, Malta and Serbia. Is family medicine an international discipline? Comparing diagnostic odds ratios across populations. Fam Pract. 2012;29(3):299–314. doi: 10.1093/fampra/cmr099. [DOI] [PubMed] [Google Scholar]
- 34.Alemayehu E, Molloy DW, Guyatt GH, Singer J, Penington G, Basile J, et al. Variability in physicians’ decisions on caring for chronically ill elderly patients: an international study. Can Med Assoc J. 1991;144(9):1133–8. [PMC free article] [PubMed] [Google Scholar]
- 35.Piñeiro R, Brotons C, Bulc M, Ciurana R, Drenthen T, Durrer D, et al. Healthy diet in primary care: views of general practitioners and nurses from Europe. Eur J Clin Nutr. 2005;59(Suppl 1):S77–80. doi: 10.1038/sj.ejcn.1602177. [DOI] [PubMed] [Google Scholar]
- 36.Kringos DS. The strength of primary care in Europe. Dissertation. 2012. http://dspace.library.uu.nl/handle/1874/256373. Accessed 23 Feb 2015.
- 37.Kringos DS, Boerma WGW, Spaan E, Pellny M. A snapshot of the organization and provision of primary care in Turkey. BMC Health Serv Res. 2011;11:90. doi: 10.1186/1472-6963-11-90. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.OECD Publishing: OECD Reviews of Health Care Quality: Turkey 2014 Raising Standards. 2014 http://www.oecd-ilibrary.org/social-issues-migration-health/oecd-reviews-of-health-care-quality-turkey-2013_9789264202054-en. Accessed 20 Oct 2014.
- 39.Lionis C. Primary care in Greece. 2011. http://www.euprimarycare.org/column/primary-care-greece. Accessed 21 Feb 2015.
- 40.Schoen C, Osborn R, How SKH, Doty MM, Peugh J. In chronic condition: experiences of patients with complex health care needs in eight countries. Health Aff. 2008;28:w1–16. doi: 10.1377/hlthaff.28.1.w1. [DOI] [PubMed] [Google Scholar]
- 41.Wadmann S, Strandberg-Larsen M, Vrangbæk K. Coordination between primary and secondary healthcare in Denmark and Sweden. Int J Integr Care. 2009;9:e04. doi: 10.5334/ijic.302. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Frenk J. Reinventing primary health care: the need for systems integration. Lancet. 2009;374(9684):170–3. doi: 10.1016/S0140-6736(09)60693-0. [DOI] [PubMed] [Google Scholar]
- 43.Gillam S. Is the declaration of Alma Ata still relevant to primary health care? BMJ. 2008;336(7643):536–8. doi: 10.1136/bmj.39469.432118.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.De Maeseneer J, van Weel C, Egilman D, Mfenyana K, Kaufman A, Sewankambo N. Strengthening primary care: addressing the disparity between vertical and horizontal investment. Br J Gen Pract. 2008;58(546):3–4. doi: 10.3399/bjgp08X263721. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Stokes T, Tarrant C, Mainous AG, Schers H, Freeman G, Baker R. Continuity of care: is the personal doctor still important? A survey of general practitioners and family physicians in England and Wales, the United States, and the Netherlands. Ann Fam Med. 2005;3:353–9. doi: 10.1370/afm.351. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.VanGeest JB. Methodologies for improving response rates in surveys of physicians. A systematic review. Eval Health Prof. 2007;30(4):303–21. doi: 10.1177/0163278707307899. [DOI] [PubMed] [Google Scholar]
- 47.Guthrie G. Measuring the quality of healthcare systems using composites. BMJ. 2008;337:a639. doi: 10.1136/bmj.a639. [DOI] [PubMed] [Google Scholar]