Abstract
Introduction
A new form of family practices was introduced in 2011 through a pilot project introducing nurse practitioners as members of team and determining a set of quality indicators. The aim of this article was to assess the quality of diabetes and hypertension management.
Methods
We included all family medicine practices that were participating in the project in December 2015 (N=584). The following data were extracted from automatic electronic reports on quality indicators: gender and specialisation of the family physician, status (public servant/self-contracted), duration of participation in the project, region of Slovenia, the number of inhabitants covered by a family medicine practice, the name of IT provider, and levels of selected quality indicators.
Results
Out of 584 family medicine practices that were included in this project at the end of 2015, 568 (97.3%) had complete data and could be included in this analysis. The highest values were observed for structure quality indicator (list of diabetics) and the lowest for process and outcome quality indicators. The values of the selected quality indicators were independently associated with the duration of participation in the project, some regions of Slovenia where practices were located, and some IT providers of the practices.
Conclusion
First, the analysis of data on quality indicators for diabetes and hypertension in this primary care project pointed out the problems which are currently preventing higher quality of chronic patient management at the primary health care level.
Keywords: family practices, healthcare quality indicator, diabetes mellitus, hypertension, Slovenia
Izvleček
Uvod
Pilotni projekt na področju družinske medicine v Sloveniji je leta 2011 uvedel novo metodo dela v družinski medicini, pri čemer je nov član tima postala diplomirana medicinska sestra, prav tako pa se je uvedel nadzor kakovosti s pomočjo kazalnikov kakovosti. Namen tega članka je bil oceniti kakovost vodenja bolnikov s sladkorno boleznijo in hipertenzijo.
Metode
V analizo smo vključili vse ambulante družinske medicine, ki so sodelovale v projektu konec decembra 2015. Iz avtomatične baze poročil smo izluščili in analizirali naslednje podatke: spol in specializacijo zdravnika, status zdravnika (javni uslužbenec, koncesionar), trajanje sodelovanja v projektu, regijo, v kateri je ambulanta, število prebivalcev na območju, ki ga pokriva ambulanta, računalniško hišo, ki nudi program, in raven izbranih kazalnikov kakovosti.
Rezultati
Od 584 ambulant družinske medicine jih je imelo 568 (97,3%) popolne podatke in so bile vključene v analizo. Najvišja vrednost kazalnikov kakovosti je bila opazovana pri kazalnikih kakovosti pogojev (register diabetikov), najnižja pa pri kazalnikih procesa in izida. Vrednosti izbranih kazalnikov kakovosti so bile neodvisno povezane s trajanjem sodelovanja v projektu, nekaterimi regijami Slovenije in nekaterimi računalniškimi hišami, ki nudijo elektronsko podporo.
Zaključek
Prva analiza podatkov kazalnikov kakovosti za diabetes in arterijsko hipertenzijo je pokazala na probleme, ki trenutno onemogočajo doseganje višje kakovosti obravnave bolnikov na primarni ravni zdravstvenega varstva.
1. Introduction
Assessing quality of care with quality indicators is paramount (1) and has already become a standard for working in family practice in several countries (2-5). Various quality indicators are being used (6) and in some countries performance-related-pay based on quality indicators has been introduced (7-9).
In Slovenia, quality assurance at the primary health care level is formally a priority, but the legislation that would ensure quality in this area is proceeding very slowly. External quality assessment and inspections commissioned by the Ministry of Health are rarely used. Supervision of quality in primary care is fragmented and poorly coordinated. Family physicians (FPs) are more involved in unofficial and ad hoc forms of quality improvement than in formalised procedures. There are formal instruments for assessing quality, such as attestation of physicians, voluntary certification and accreditation, and mandatory licensing of physicians or nurses, but quality of primary health care has not yet been systematically assessed by quality indicators (10), despite the fact that a set of quality indicators was developed for cardiovascular prevention (11, 12) and that there is ample scientific evidence in this field in the literature (1, 5-7, 13-17)
In 2011, an ongoing pilot project at the primary care level in Slovenia was launched with the support of the Ministry of Health. It introduced a new model of family medicine practice where the family physicians’ working team (consisting of one FP and one nurse with a baccalaureate degree – a practice nurse) was extended by a nurse practitioner working four hours a day or 0.5 full-time equivalents. The nurse practitioner is responsible for preventive activities (screening for and counselling on cardiovascular risk factors, diabetes, depression, chronic obstructive pulmonary disease (COPD), hypertension, and smoking and management of smoking and risky alcohol consumption) and routine management of patients with stable chronic diseases (COPD, asthma, hypertension, diabetes, benign enlargement of prostate, depression, osteoporosis and coronary heart disease) (18, 19). Preventive activities can also be carried out by physicians in terms of a comprehensive approach to the patients, but in this model of family medicine practice they are mainly performed by the nurse practitioners.
As part of this project, a list of quality indicators was introduced in order to monitor the work of family medicine practices participating in the project. The list included 35 quality indicators, of which nine were structure quality indicators, 23 were process quality indicators, and three were outcome quality indicators (1, 20).
The electronic database for collecting quality indicators was established at the beginning of 2015. Before that, data entry was manual and carried out by each practice itself into the Excel spreadsheets. There are five IT providers for family practices in Slovenia with their own data extraction systems, and data had to be gathered in one electronic database, which presented some problems at the start.
Hypertension and diabetes were among eight chronic diseases which were monitored by quality indicators, and are at the same time among the most common chronic diseases encountered in family medicine.
The aim of this article was to assess the differences in the values of the selected quality indicators between new model family medicine practices with different characteristics. The objective of this article was to conduct a relationship analysis between values of two selected indicators and some important characteristics of practices.
2. Methods
We included all family medicine practices that were participating in the project in December 2015 as the source of data. The data were gathered from automatic electronic reports on quality indicators provided monthly by each individual family medicine practice. The data are stored in a common electronic database which can be used by project managers. For the purpose of the analysis, the following data were extracted: gender and specialisation of the family physician, status (public servant/self-contracted), duration of participation in the project, region of Slovenia, number of inhabitants covered by the family physician, name of the information technology (IT) provider, and quality indicators. The units of observation were family medicine practices with their staff (a physician, a practice nurse and a nurse practitioner).
At the end of 2015, there were 35 different quality indicators that family medicine practices reported on (20). For the purpose of this study, we chose one quality indicator from each different type (structure, process and outcome quality indicator (1) (Table 1).
Table 1.
Quality indicator | Calculation formula | Type of quality indicator | Quality standard | Mean value (SD) | Median |
---|---|---|---|---|---|
List of patients with diabetes | Number of diabetic patients/(Number of registered patients * 0.061) * 100 | Structure | 0 | 84.2 (53.6) | 84.0 |
Percentage of patients with diabetes with measured HbA1C once a year | Number of patients with diabetes with measured HbA1C at least once a year/number of registered diabetic patients2 * 100 | Process | 80 | 25.6 (22.3) | 21.2 |
Percentage of patients with hypertension with a systolic blood pressure 140/90 mmHg or lower | Number of patients with hypertension with blood pressure 140/90 mmHg or lower/number of registered3 patients with hypertension * 100 | Outcome | 50 | 18.2 (16.3) | 14.3 |
1Prevalence of diabetes in Slovenia which is 6% (21)
The expression “registered” describes the number of patients with diabetes/hypertension on the patient list of each family medicine practice
Statistical analysis was carried out using IBM SPSS Statistics version 22.0 (Armonk, NY: IBM Corp.). We performed multivariate analysis with general linear models. We set p<0.05 as the limit for statistical significance.
We used the observed outcome variables and explanatory factors in the analyses. The observed outcome variables were: 1) the value of the quality indicator “List of patients with diabetes”; 2) the value of the quality indicator “Percentage of patients with diabetes with measured HbA1C once a year” (continuous variable); and 3) the value of the quality indicator “Percentage of patients with hypertension with a systolic blood pressure 140/90 mmHg or lower” (continuous variable). Higher levels of observed outcome variables indicated a higher quality of work.
The explanatory factors were: 1) gender (nominal variable: male/female); 2) specialisation of family physician (nominal variable: has specialisation in family/general medicine/does not have specialisation in family/general medicine; 3) status of family medicine practice (nominal variable: public servant/self-contracted); 4) duration of participation in the project (continuous variable); 5) region of Slovenia (nominal variable: Celje, Koper, Krsko, Kranj, Ljubljana, Maribor, Murska Sobota, Nova Gorica, Novo Mesto, Ravne na Koroskem); 6) area covered by the practice (nominal variable: urban/rural); and 7) name of IT provider (nominal variable: IT No. 1, IT No. 2, IT No. 3, IT No. 4, IT No. 5). The variable “Urban/rural area” was determined according to the definition of rural areas in Slovenia provided by the Statistical Office of Slovenia, which defines rural areas as those with less than 5,000 inhabitants.
The dummy variables created for the multivariate analyses were gender (reference category: male gender), the region of Slovenia (reference category: Ravne na Koroskem), the IT provider (reference category: IT provider No. 5), specialisation (reference category: no specialisation), area (reference category: urban), and status (reference category: public servant) and were created by a simple coding.
3. Results
3.1. Sample Description
Out of 584 family medicine practices that were included in this project at the end of 2015, 568 (97.3%) had complete data and could be included in this analysis (Table 2). The mean duration of participation in the project was 28.7±18.7 months, with a median of 33.0 months. The mean age of the family physicians was 51.4±9.0 years, median 53.0.
Table 2.
Characteristic | Number (%) |
---|---|
Region | |
Celje | 71 (12.5) |
Koper | 34 (6.0) |
Krsko | 20 (3.5) |
Kranj | 63 (11.1) |
Ljubljana | 148 (26.1) |
Maribor | 84 (14.8) |
Murska Sobota | 37 (6.5) |
Nova Gorica | 44 (7.7) |
Novo Mesto | 37 (6.5) |
Ravne na Koroskem | 30 (5.3) |
Gender of the physician | |
Male | 132 (23.2) |
Female | 436 (76.8) |
Specialisation of the physician | |
General medicine | 313 (55.1) |
Family medicine | 195 (34.3) |
Other specialities | 1 (0.2) |
No specialisation | 59 (10.4) |
Status | |
Public servant | 426 (75.0) |
Self-contractor | 142 (25.0) |
IT provider | |
No. 1 | 159 (28.0) |
No. 2 | 6 (1.1) |
No. 3 | 210 (37.0) |
No. 4 | 90 (15.8) |
No. 5 | 97 (17.1) |
Area | |
Urban | 459 (80.8) |
Rural | 109 (19.2) |
3.2. Quality Indicator ‘List of Patients with Diabetes’
The mean value of this quality indicator was 84.2±53.6, with a median of 84.0 (Table 1).
The results of a multivariate analysis showed that the variables ‘IT provider No. 1 and 4’ and ‘Duration of participation in the project’ were significantly correlated with a higher value of this quality indicator, and ‘Working in the Maribor region’ was significantly correlated with a lower value of this quality indicator (Table 3).
Table 3.
Explanatory variables | Regression coefficient | Standard Error | Upper and lower 95% confidence Interval | p |
---|---|---|---|---|
Gender | ||||
Female | 0.17 | 4.66 | -8.97, 9.30 | 0.972 |
Male | reference | |||
Status | ||||
Self-contractor | 6.47 | 5.22 | -3.76, 16.70 | 0.215 |
Public servant | reference | |||
IT provider | ||||
No. 1 | 19.03 | 8.13 | 3.10, 34.96 | 0.019 |
No. 2 | 12.18 | 19.57 | -26.18, 50.55 | 0.534 |
No. 3 | 8.88 | 6.53 | -3.92, 21.67 | 0.174 |
No. 4 | 21.85 | 7.79 | 6.57, 37.12 | 0.005 |
No. 5 | reference | |||
Area | ||||
Rural | -2.61 | 5.17 | -12.74, 7.52 | 0.614 |
Urban | reference | |||
Specialisation | ||||
General Practice | -2.92 | 6.99 | -16.62, 10.78 | 0.676 |
Family Medicine | -0.46 | 7.00 | -14.17, 13.26 | 0.948 |
No specialisation | reference | |||
Region | ||||
Celje | -8.32 | 11.03 | -29.94, 13.31 | 0.451 |
Koper | -1.99 | 11.92 | -25.36, 21.38 | 0.868 |
Krsko | 11.18 | 14.45 | -17.14, 39.49 | 0.439 |
Kranj | 4.02 | 10.70 | -16.95, 24.99 | 0.707 |
Ljubljana | -4.58 | 9.42 | -23.05, 13.88 | 0.627 |
Maribor | -35.92 | 10.97 | -57.42, -14.42 | 0.001 |
Murska Sobota | -17.34 | 11.32 | -39.52, 4.85 | 0.126 |
Nova Gorica | -0.40 | 11.00 | -21.95, 21.15 | 0.971 |
Novo Mesto | 0.37 | 11.45 | -22.07, 22.80 | 0.975 |
Ravne na Koroskem | Reference | |||
Age (years) | -0.17 | 0.22 | -0.61, 0.26 | 0.435 |
Duration of participation in the project | 1.47 | 0.11 | 1.24, 1.69 | < 0.001 |
For continuous variables regression coefficients indicate the change of the observed variable with each increasing unit of explanatory variable.
For categorical variables regression coefficients indicate the changes of the observed variable in comparison to a reference category.
3.4. Quality Indicator “Percentage of Patients with Diabetes with Measured HbA1C Once a Year”
The mean value of this quality indicator was 25.6±22.3, with a median of 21.2.
The results of a multivariate analysis showed that the variable ‘Duration of participation in the project’ was significantly correlated with a higher value of this quality indicator, and ‘IT provider No. 3 and 4’ were significantly correlated with a lower value of this quality indicator (Table 4).
Table 4.
Explanatory variables | Regression coefficient | Standard Error | Upper and lower 95% confidence Interval | p |
---|---|---|---|---|
Gender | ||||
Female | 1.60 | 2.11 | -2.53, 5.74 | 0.447 |
Male | Reference | |||
Status | ||||
Self-contractor | 1.03 | 2.37 | -3.61, 5.66 | 0.664 |
Public servant | reference | |||
provider | ||||
No. 1 | -6.27 | 3.68 | -13.49, 0.95 | 0.089 |
No. 2 | -12.00 | 8.87 | -29.38, 5.38 | 0.176 |
No. 3 | -6.05 | 2.96 | -11.85, -0.25 | 0.041 |
No. 4 | -14.58 | 3.53 | -21.50, -7.66 | < 0.001 |
No. 5 | reference | |||
Area | ||||
Rural | -0.73 | 2.34 | -5.32, 3.86 | 0.757 |
Urban | reference | |||
Specialisation | ||||
General Practice | 5.13 | 3.17 | -1,07, 11.34 | 0.105 |
Family Medicine | 3.34 | 3.17 | -2.87, 9.55 | 0.292 |
No specialisation | ||||
Region | -9.28 | 5.00 | -19.07, 0.52 | 0.063 |
Celje | -6.55 | 5.40 | -17.14, 4.04 | 0.225 |
Koper | -4.37 | 6.54 | -17.19, 8.46 | 0.505 |
Krsko | -6.37 | 4.85 | -15.87, 3.13 | 0.189 |
Kranj | 0.85 | 4.27 | -7.51, 9.22 | 0.842 |
Ljubljana | 3.88 | 4.97 | -5.86, 13.62 | 0.435 |
Maribor | 7.20 | 5.13 | -2.85, 17.25 | 0.160 |
Murska Sobota | -9.18 | 4.98 | -18.94, 0.58 | 0.065 |
Nova Gorica | -0.40 | 5.18 | -10.56, 9.76 | 0.939 |
Novo Mesto | reference | |||
Ravne na Koroskem | ||||
Age (years) | -0.11 | 0.10 | -0.31, 0.08 | 0.265 |
Duration of participation in the project | 0.30 | 0.05 | 0.20, 0.40 | < 0.001 |
For continuous variables regression coefficients indicate the change of the observed variable with each increasing unit of explanatory variable.
For categorical variables regression coefficients indicate the changes of the observed variable in comparison to a reference category.
3.3. Quality Indicator ‘Percentage of Patients with Hypertension with a Systolic Blood Pressure 140/90 mmHg or Lower’
The mean value of this quality indicator was 18.2±14.3, with a median of 16.3 (Table 1).
The results of a multivariate analysis showed that the variables ‘Duration of participation in the project,’ ‘Female gender,’ ‘Self-contractor,’ ‘Working in the Maribor region’ and ‘Having IT No. 2’ were significantly correlated with a higher value of this quality indicator. Variables ‘IT provider No. 3’ and ‘IT provider No. 4’ were significantly correlated with lower values of this quality indicator (Table 5).
Table 5.
Explanatory variables | Regression coefficient | Standard Error | Upper and lower 95% confidence Interval | p |
---|---|---|---|---|
Gender | ||||
Female | 3.36 | 1.48 | 0.47, 6.25 | 0.023 |
Male | Reference | |||
Status | ||||
Self-contractor | 3.44 | 1.65 | 0.20, 6.68 | 0.037 |
Public servant | reference | |||
IT provider | ||||
No. 1 | -0.77 | 2.57 | -5.82, 4.27 | 0.764 |
No. 2 | 17.59 | 6.20 | 5.45, 29.74 | < 0.001 |
No. 3 | -6.64 | 2.07 | -10.69, -2.58 | 0.001 |
No. 4 | -10.58 | 2.47 | -15.42, -5.74 | < 0.001 |
No. 5 | reference | |||
Area | ||||
Rural | -1.65 | 1.64 | -4.86, 1.56 | 0.314 |
Urban | reference | |||
Specialisation | ||||
General Practice | 2.05 | 2.21 | -2.29, 6.39 | 0.354 |
Family Medicine | -0.95 | 2.22 | -5.29, 3.39 | 0.668 |
No specialisation | reference | |||
Region | ||||
Celje | -2.48 | 3.49 | -9.32, 4.37 | 0.478 |
Koper | 1.78 | 3.78 | -5.62, 9.18 | 0.637 |
Krsko | -1.15 | 4.57 | -10.11, 7.82 | 0.802 |
Kranj | -3.76 | 3.39 | -10.40, 2.88 | 0.267 |
Ljubljana | 1.65 | 2.98 | -4.19, 7.50 | 0.579 |
Maribor | 10.77 | 3.47 | 3.96, 17.57 | 0.002 |
Murska Sobota | 5.33 | 3.58 | -1.69, 12.36 | 0.137 |
Nova Gorica | -1.65 | 3.48 | -8,47, 5.18 | 0.636 |
Novo Mesto | -0.43 | 3.62 | -7.54, 6.67 | 0.905 |
Ravne na Koroskem | reference | |||
Age (years) | -0.06 | 0.07 | -0.20, 0.07 | 0.368 |
Duration of participation in the project | 0.15 | 0.04 | 0.08, 0.23 | < 0.001 |
For continuous variables regression coefficients indicate the change of the observed variable with each increasing unit of explanatory variable.
For categorical variables regression coefficients indicate the changes of the observed variable in comparison to a reference category.
4. Discussion
This study showed that the structure quality indicator was achieved for diabetes (list of diabetic patients). However, it also showed that the values of the process and outcome indicators were low, which indicates that the quality of management of patients with diabetes and hypertension could be improved. The levels of the selected quality indicators were associated with several features, most commonly with the duration of participation in the project, the region of Slovenia where the practice was located, and the IT provider used by the practice.
4.1. The Assessment of Quality of the Management of Patients with Diabetes and Hypertension
High values of structure quality indicators are an important sign that the conditions for measuring quality have been established. On the other hand, lower levels of process quality indicators were found and could be attributed to several reasons. The lack of continuous quality control with feedback could be one of them; the project continued without continuous data analysis, feedback to practices on the quality of their work, or benchmarking (22), and no staff were employed to carry out these tasks.
It is also possible that adherence to the guidelines was low. A recent study from Slovenia showed that the introduction of this different model of chronic patient management in family medicine improved the process of quality of care, but the desired level of quality has not yet been achieved (23), which probably points to low adherence to the guidelines. Other studies have also shown that primary care physicians’ adherence to hypertension and diabetes guidelines is low (24-27). For example, adherence to hypertension guidelines was found to be between 10 and 50% (24, 25). On the other hand, another study showed that HbA1C was measured in almost all the patients (26).
It is also possible that the selection and development of the quality indicators themselves was not optimal. The development of quality indicators must be based on a systematic evidence-based approach, and expert consensus and guidelines should be considered. The indicators should be acceptable, feasible, reliable, sensitive to change, and valid (16). The quality indicators in our project have not yet been evaluated according to these features, and therefore it could be possible that the low levels of quality indicators are associated with their suboptimal nature.
4.2. Associations between Quality Indicators and Characteristics of Providers
The most important variable that was shown to be associated with higher levels of quality indicators was the duration of participation in the project. This indicates that the practical introduction of quality indicators in the everyday work of practices might be associated with some problems that could influence the quality. These problems are yet to be recognised. The region of practices was also recognised as important. Some previous data from Slovenia indicate that there are differences between regions in terms of quality (10). Which factors contribute to that is unknown and a subject for further studies. In addition, IT providers proved important in our research. Ensuring quality of data during electronic data capture is always a problem, and several ways of reducing errors must be applied (28, 29). There are no reports about the quality of data gathering in this project, and it therefore seems that there are some problems which still need to be recognised and addressed.
The quality indicator ‘List of patients with diabetes’ indicates the prevalence of diabetes in registered patients of family medicine practices in Slovenia. It should be mentioned here that its value could also be affected by the actual prevalence of diabetes in the region of Slovenia (30), and does not only depend on the quality of work.
Other factors can also contribute to the quality management of chronic patients and were not included in this study. These might include systemic factors, reimbursement, service organisation and capacity, cultural factors, disease epidemiology, practice systems in terms of incentives, practice information capacity, access, the use of teams in quality policy, detection of quality and safety problems, staff and patient safety, inclusion of patients’ perspectives, and the length of consultations (31-34). These factors should be considered when studying this topic further.
4.3. Limitations of the Study
We chose only a few quality indicators because we focused on the management of chronic diseases and not on their prevention. This was done to ensure the clarity and focus of the study. It could, however, be possible that by excluding some quality indicators we overlooked some other differences.
The other problem is the quality of the data, as the electronic database was only established in 2015; our analysis was carried out at the end of 2015, and we can, therefore, anticipate that some technical problems had not yet been resolved. Therefore, the reliability of the data might not be as good as if we had done the research later.
Our study did not include other factors that could influence the quality of management of chronic diseases, especially the characteristics of other team members, particularly nurse practitioners. Since nurse practitioners are very involved in the management of chronic patients, the inclusion of their characteristics could have helped us to build a more comprehensive view of this matter, and produced more reliable statistical models. Other limitations are the exclusion of patient data, and the cross-sectional nature of this study, which prevents us from detecting causality. This would further increase the comprehensibility of the results.
In our study, we did not analyse the characteristics of those family medicine practices that did not participate in the project. Therefore, we do not know if they differ significantly from those included in the study.
4.4. Theoretical and Practical Implications of the Study
The study showed that the quality assessment was a challenge, because the values of the quality indicators were set empirically while preparing the new model of family medicine practices in Slovenia. The quality indicators should be re-evaluated and changed if necessary according to the established methodology (16). It was also recognised that expert supervision at the location is necessary to assess the process of work of the family medicine team at different levels (e.g. following protocols, regularly measuring the parameters of chronic diseases, recording them in the electronic database, and their reporting and analysis), and to discuss the obstacles directly with care providers. Continuous quality control and benchmarking should be established in order to improve the quality of chronic patient management in Slovenian family medicine practices. The study also indicated the need for collaboration between different professionals (e. g. IT specialists and health care providers) to adopt the IT system to fully support patient management. The quality indicators should be a basis for financing the practices according to quality standards. It may also be important to inform each team about their quality results every month, and ask for their feedback.
4.5. Suggestions for Future Research in the Field
The regional differences in quality which emerged from our analysis should be further explored. Other possible factors that could contribute to quality should be studied. The quality indicators should be reviewed each year, which would allow a comparison of indicators between two points in time in the same practice, or between practices using the new approach and those using the classical approach, and to observe the trend of change according to the existing circumstances.
5. Conclusion
The first analysis of data on quality indicators for diabetes and hypertension in this primary care project pointed out the problems which are currently preventing higher quality of chronic patient management at the primary health care level. There are problems with the quality of data, especially with the IT support, which should be recognised and eliminated.
Acknowledgements
We thank Barbara Šturm and Sara Peklaj from the project office for helping us in gathering the data.
Footnotes
Conflicts of interest: The authors declare that no conflicts of interest exist.
Funding: The authors acknowledge the financial support from the Slovenian Research Agency (research core funding No. P3 0339).
Ethical approval: Ethical approval was not sought as no patients were involved in the study. The values of quality indicators were extracted from the whole pool of data and other data were gathered from the project database. The data on providers were anonymous.
References
- 1.Mainz J.. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15:523–30. doi: 10.1093/intqhc/mzg081. [DOI] [PubMed] [Google Scholar]
- 2.Kringos D, Boerma W, Bourgueil Y, Cartier T, Dedeu T, Hasvold T. et al. Hasvoldhe strength of primary care in Europe: an international comparative study. Br J Gen Pract. 2013;63:e742–e50. doi: 10.3399/bjgp13X674422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Reid RO, Friedberg MW, Adams JL, McGlynn EA, Mehrotra A.. Associations between physician characteristics and quality of care. Arch Intern Med. 2010;170:1442–9. doi: 10.1001/archinternmed.2010.307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Rushforth B, Stokes T, Andrews E, Willis TA, McEachan R, Faulkner S. et al. Faulknereveloping ‘high impact’ guideline-based quality indicators for UK primary care: a multi-stage consensus process. BMC Fam Pract. 2015;16:156. doi: 10.1186/s12875-015-0350-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Seddon ME, Marshall MN, Campbell SM, Roland MO.. Systematic review of studies of quality of clinical care in general practice in the UK, Australia and New Zealand. Qual Health Care. 2001;10:152–8. doi: 10.1136/qhc.0100152... [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Simou E, Pliatsika P, Koutsogeorgou E, Roumeliotou A.. Quality indicators for primary health care: a systematic literature review. J Public Health Manag Pract. 2015;21:E8–16. doi: 10.1097/PHH.0000000000000037. [DOI] [PubMed] [Google Scholar]
- 7.Campbell S, Reeves D, Kontopantelis E, Middleton E, Sibbald B, Roland M.. Quality of primary care in England with the introduction of pay for performance. N Engl J Med. 2007;357:181–90. doi: 10.1056/NEJMsr065990. [DOI] [PubMed] [Google Scholar]
- 8.Buetow S.. Pay-for-performance in New Zealand primary health care. J Health Organ Manag. 2008;22:36–47. doi: 10.1108/14777260810862399. [DOI] [PubMed] [Google Scholar]
- 9.Van Herck P, De Smedt D, Annemans L, Remmen R, Rosenthal MB, Sermeus W.. Systematic review: effects, design choices, and context of pay-for-performance in health care. BMC Health Serv Res. 2010;10:247. doi: 10.1186/1472-6963-10-247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Boerma W, Kringos D, Verschuuren M, Pellny M, Bulc M. Primary care quality management in Slovenia. Copenhagen: WHO; 2008. [Google Scholar]
- 11.Petek D, Campbell S, Serec M, Kersnik J.. Quality indicators of cardiovascular disease prevention for primary care in Slovenia. Zdrav Vestn. 2012;81:687–98. [Google Scholar]
- 12.Petek D, Kersnik J.. Management of cardiovascular risk factors in high risk patients: correlates of quality of care. Zdr Varst. 2013;52:263–74. [Google Scholar]
- 13.Pavlic DR, Sever M, Klemenc-Ketis Z, Svab I.. Process quality indicators in family medicine: results of an international comparison. BMC Fam Pract. 2015;16:172. doi: 10.1186/s12875-015-0386-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Schafer WL, Boerma WG, Kringos DS, De Maeseneer J, Gress S, Heinemann S. et al. Heinemann, a multi-country study evaluating quality, costs and equity in primary care. BMC Fam Pract. 2011;12:115. doi: 10.1186/1471-2296-12-115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Marshall MN, Shekelle PG, McGlynn EA, Campbell S, Brook RH, Roland MO.. Can health care quality indicators be transferred between countries? Qual Saf Health Care. 2003;12:8–12. doi: 10.1136/qhc.12.1.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Campbell SM, Braspenning J, Hutchinson A, Marshall MN.. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326:816–9. doi: 10.1136/bmj.326.7393.816. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Campbell SM, Hann M, Hacker J, Burns C, Oliver D, Thapar A. et al. Thapardentifying predictors of high quality care in English general practice: observational study. BMJ. 2001;323:784–7. doi: 10.1136/bmj.323.7316.784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Poplas-Susic T, Svab I, Kersnik J.. The project of model practices in family medicine in Slovenia. Zdrav Vestn. 2013;82:635–47. [Google Scholar]
- 19.Klemenc-Ketis Z, Kravos A, Poplas-Susič T, Svab I, Kersnik J.. New tool for patient evaluation of nurse practitioner in primary care settings. J Clin Nurs. 2014;23:1323–31. doi: 10.1111/jocn.12377. [DOI] [PubMed] [Google Scholar]
- 20.Poročilo o kazalnikih kakovosti. Ljubljana: MZ; 2015. Anon. [Google Scholar]
- 21.Nerat T, Kos M.. Burden of type 2 diabetes from the healthcare payer perspective in Slovenia. Zdr Varst. 2013;52:162–80. [Google Scholar]
- 22.Ettorchi-Tardy A, Levif M, Michel P.. Benchmarking: a method for continuous quality improvement in health. Healthc Policy. 2012;7:e101–19. [PMC free article] [PubMed] [Google Scholar]
- 23.Petek D, Mlakar M.. Quality of care for patients with diabetes mellitus type 2 in ‘model practices’ in Slovenia – first results. Zdr Varst. 2016;55:179–84. doi: 10.1515/sjph-2016-0023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Heneghan C, Perera R, Mant D, Glasziou P.. Hypertension guideline recommendations in general practice: awareness, agreement, adoption, and adherence. Br J Gen Pract. 2007;57:948–52. doi: 10.3399/096016407782604965. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Midlov P, Ekesbo R, Johansson L, Gerward S, Persson K, Nerbrand C. et al. Nerbrandarriers to adherence to hypertension guidelines among GPs in southern Sweden: a survey. Scand J Prim Health Care. 2008;26:154–9. doi: 10.1080/02813430802202111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Rao DT, Sunio LK, Lo YJ, Gossain VV.. Comparison of the adherence to the American Diabetes Association guidelines of diabetes care in primary care and subspecialty clinics. J Diabetes Metab Disord. 2015;14:35. doi: 10.1186/s40200-015-0158-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Seidu S, Khunti K.. Non-adherence to diabetes guidelines in primary care – the enemy of evidence-based practice. Diabetes Res Clin Pract. 2012;95:301–2. doi: 10.1016/j.diabres.2012.01.015. [DOI] [PubMed] [Google Scholar]
- 28.Ohmann C, Kuchinke W, Canham S, Lauritsen J, Salas N, Schade-Brittinger C. et al. Brittingertandard requirements for GCP-compliant data management in multinational clinical trials. Trials. 2011;12:85. doi: 10.1186/1745-6215-12-85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Kumar AM, Naik B, Guddemane DK, Bhat P, Wilson N, Sreenivas AN. et al. Sreenivasfficient, quality-assured data capture in operational research through innovative use of open-access technology. Public Health Action. 2013;3:60–2. doi: 10.5588/pha.13.0004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Jelić J, Drinovec J, Mrhar A.. Burden of type 2 diabetes. Farm Vestn. 2006;57:315–24. [Google Scholar]
- 31.Smith PC.. Measuring health system performance. Eur J Health Econ. 2002;3:145–8. doi: 10.1007/s10198-002-0138-1. [DOI] [PubMed] [Google Scholar]
- 32.Groenewegen P, Heinemann S, Gress S, Schafer W.. Primary care practice composition in 34 countries. Health Policy. 2015;119:1576–83. doi: 10.1016/j.healthpol.2015.08.005. [DOI] [PubMed] [Google Scholar]
- 33.Engels Y, Campbell S, Dautzenberg M, van den Hombergh P, Brinkmann H, Szecsenyi J. et al. Szecsenyieveloping a framework of, and quality indicators for, general practice management in Europe. Fam Pract. 2005;22:215–22. doi: 10.1093/fampra/cmi002. [DOI] [PubMed] [Google Scholar]
- 34.Deveugele M, Derese A, van den Brink-Muinen A, Bensing J, De Maeseneer J.. Consultation length in general practice: cross sectional study in six European countries. BMJ. 2002;325:472. doi: 10.1136/bmj.325.7362.472. [DOI] [PMC free article] [PubMed] [Google Scholar]