Skip to main content
PMC home page
BMC Health Services Research logoLink to BMC Health Services Research
. 2010 Apr 8;10:91. doi: 10.1186/1472-6963-10-91

Is the Kaiser Permanente model superior in terms of clinical integration?: a comparative study of Kaiser Permanente, Northern California and the Danish healthcare system

Martin Strandberg-Larsen 1,✉, Michaela L Schiøtz 1, Jeremy D Silver 2, Anne Frølich 3, John S Andersen 4, Ilana Graetz 5, Mary Reed 5, Jim Bellows 6, Allan Krasnik 1, Thomas Rundall 7, John Hsu 7,8,9
PMCID: PMC2907761  PMID: 20374667

Abstract

Background

Integration of medical care across clinicians and settings could enhance the quality of care for patients. To date, there is limited data on the levels of integration in practice. Our objective was to compare primary care clinicians' perceptions of clinical integration and three sub-aspects in two healthcare systems: Kaiser Permanente, Northern California (KPNC) and the Danish healthcare system (DHS). Further, we examined the associations between specific organizational factors and clinical integration within each system.

Methods

Comparable questionnaires were sent to a random sample of primary care clinicians in KPNC (n = 1103) and general practitioners in DHS (n = 700). Data were analysed using multiple logistic regression models.

Results

More clinicians in KPNC perceived to be part of a clinical integrated environment than did general practitioners in the DHS (OR = 3.06, 95% CI: 2.28, 4.12). Further, more KPNC clinicians reported timeliness of information transfer (OR = 2.25, 95% CI: 1.62, 3.13), agreement on roles and responsibilities (OR = 1.79, 95% CI: 1.30, 2.47) and established coordination mechanisms in place to ensure effective handoffs (OR = 6.80, 95% CI: 4.60, 10.06). None of the considered organizational factors in the sub-country analysis explained a substantial proportion of the variation in clinical integration.

Conclusions

More primary care clinicians in KPNC reported clinical integration than did general practitioners in the DHS. Focused measures of clinical integration are needed to develop the field of clinical integration and to create the scientific foundation to guide managers searching for evidence based approaches.

Background

Within recent years the US managed care organisation Kaiser Permanente (KP) has started to influence the mindsets and policy development within many European healthcare systems [1,2]. The reason for this interest being that KP has been highlighted as a successful model of integrated and cost effective care with high quality services to their enrolees [3-5]. In the influential article by Feachem et al. the costs and performance of the United Kingdom's National Health Service (NHS) were compared with those in KP in California [3]. The authors concluded that KP provided much better value for money, largely by using only a third of the acute bed days used in the NHS. Taken at face value the benefit of the KP model was substantial. However, the claim was subsequently disputed and several serious criticisms were levelled at the methods used [6,7]. To investigate further, Ham et al. undertook a more detailed study of the KP model [4]. The findings were again in the favour of KP, with much lower hospital admission rates and overall length of stay than those of the NHS. Ham et al. indicated several factors potentially explaining the findings, including integration of funding with provision of care and integration of inpatient care with outpatient care and prevention [4]. Several commentators further indicated the importance of highly coordinated medical care and the use of clinical protocols as a driver of KP's performance [5,8-10]. However, the evidence base is far from conclusive.

KP is by definition an integrated delivery system, as an organization that unites a financing group with all providers - from hospital, clinics, and physicians through home care and long-term care facilities to pharmacies [11,12]. However, it has never been shown how this translates into delivery of integrated services at the clinical level, where it means most for the quality of care to benefit the recipients [13]. Therefore, we aim to quantify clinical integration at the primary healthcare level in KP and compare it with the level in the Danish healthcare system (DHS), a public integrated healthcare system similar to the NHS. The Danish healthcare system has been shown to be somewhat comparable to KP in terms of budget, benefits and entitlements [14]. A recent European Union Survey (PROCARE) of integrated care approaches across member states depicts Denmark and the United Kingdom as the most developed EU countries regarding implementation and testing of coordination of care strategies [15]. The Danish healthcare system is therefore a suitable comparator when attempting to benchmark the clinical integration results of Kaiser Permanente. Furthermore, we aim to examine the association between specific organizational factors and clinical integration within each system.

Systemic conditions for clinical integration in the healthcare system settings

To set the stage for the comparative analysis we briefly present the key elements of the two healthcare systems involved (Table 1). The main focus is on the primary healthcare sector and differences between the two systems.

Table 1.

Key elements of Kaiser Permanente, Northern California (KPNC) and the Danish healthcare system (DHS)

KPNC DHS
Coverage Coverage according to employer enlisted or individual health plans, through Kaiser Foundation Health Plan, ranging from low coverage health plans with relatively high co-payments to plans providing extensive coverage with minimal co-payments. Tax-based universal coverage for all residents.
Uninsured individuals constitute 5% of total hospital admissions. 3.5% of Kaiser members are from California's Medicaid programme Medi-Cal. Medicare members can choose to obtain healthcare from Kaiser.
Providers The Kaiser Foundation Hospitals and the Permanente Medical Groups provide all clinical services. Reliance on regional and local government for financing and delivery of healthcare services.
The Medical Centre has a range of outpatient facilities available incl. paediatricians, internal medicine physicians, geriatricians, nurses, health educators, in-house access to advanced medical equipment, a pharmacy and an emergency department. GPs are gatekeepers who work in private practices and are remunerated by the regions through a mix of capitation payment and fee-for-service.
Post-hospital care is administered outside the hospitals at independent Skilled Nursing Facilities contracting with KP. 98 Municipalities are responsible for prevention and rehabilitation, home healthcare and care for the elderly.
Physicians are paid a salary, including 5%-10% in financial incentives Five Regions are responsible for secondary care delivered by practising specialist in private practice working under fee-for service and hospitals with physicians working for a fixed salary.
Health Information Technology (HIT) The operational KP Health Connect allows for extensive information exchange across providers and settings. KP Health Connect allows for multiple patient panel management and two way patient contacts. Widespread use of HIT but limited possibilities of information exchange across settings. To an increasing extent, GPs are using HIT for two way patient contacts. There is no common national record system.
Open in a new tab

Source: [1,14,19]

Organization, financing and primary healthcare in KPNC

KP is an integrated managed care organization founded in 1945 [16]. KP operates in nine states and Washington DC and is the largest not-for-profit managed care organization in the United States, with 8.2 million members [1]. In this study we used data from KP in Northern California (KPNC), the largest of the regional entities providing comprehensive care for 3.2 million members [1]. KPNC is a consortium of three separate but interdependent groups of entities: the Kaiser Foundation Health Plan and its regional operating organizations, Kaiser Foundation Hospitals and the Permanente Medical Groups. Kaiser Foundation Health Plan and Hospitals are integrated with legally separate physician group practices called Permanente Medical Groups. The health plan is the insurance part of the organisation, while the hospitals and medical group provide all clinical services [1,2]. To the public these hospitals and GP-type facilities are seen as one organisation, which is commonly referred to as Kaiser. The health plan and hospitals operate under state and federal not-for-profit tax status, while the medical groups operate as for-profit partnerships or professional corporations in their respective regions.

Within KP, comprehensive health services are provided, including hospital admission, sub-acute care, ambulatory and preventive care, accident and emergency, optometry, rehabilitation, and home healthcare [3]. A typical patient in need of primary care, e.g. due to a chronic condition, will, in KPNC, be treated and cared for solely in an out-patient medical centre. The medical centre will have all necessary outpatient facilities available, including paediatricians, internal medicine physicians, geriatricians, specialists, nurse practitioners, nurses, health educators, administrative personnel, a pharmacy, and an emergency department. The physicians have access to in-house laboratory facilities and other advanced medical equipment. When necessary, patients are admitted to a hospital, and subsequent care and some rehabilitation will be administered outside the hospital at a skilled nursing facility (SNIF). KP contracts with SNIFs that function as independent facilities. Integrated patient pathways are made possible by a team-based approach, multi-speciality medical centres, and information exchange across providers. The information exchange is facilitated through the operational electronic health record KP HealthConnect. This system also allows for multiple patient panel management and two way patient contact [16]. KPNC initiated a staggered implementation of KP HealthConnect in December 2004.

The Danish primary healthcare sector

The DHS is funded mainly through taxation and belongs to the same family of healthcare systems as those of the other Scandinavian countries and the United Kingdom [17,18]. The DHS covers all inhabitants (app. 5.4 million) and the comprehensive benefit package [19] is produced largely by public providers at the regional and local level [18]. An important exception is the General Practitioners (GP) who are self-employed, but their activities are highly regulated through agreements between their professional organization and the regional authorities. The GPs are reimbursed for their services by the regional authorities through a combination of capitation and fee-for-service. In Denmark a patient is assigned a specific GP operating in solo or multiple group practices. As of 2007, 3655 GPs were licensed to practice in Denmark. According to the Danish Association of General practitioners 37% of all GPs were organized in solo or group practices in 2007. In a solo practice the general practitioner has the sole responsibility for the patients assigned to the practice. In a group practice, a number of general practitioners share the premises and certain facilities; nevertheless, patients are still assigned to a specific GP. The remaining Danish GPs are organized in a partnership practice where two or more GPs share the responsibility for the patients as well as the economy of the practice. The GPs function as gate-keepers to the Danish healthcare system, which implies that they are the patients' first contact with the healthcare system and are expected to guide patients through the system as it relates to access to specialized care and to ensure follow-up after hospitalization. GPs have an in-house electronic health record linked to pharmacies and laboratories. Patients with a chronic condition will often need additional care provided by outpatient departments at hospitals or private practicing specialists.

Methods

Data on KPNC

We used data from the IMPACT2 survey. The development of this survey was based on a literature review and when possible items were derived from previously validated surveys (California Healthcare Organization Technology Adoption Survey, CMI Diabetes Survey, National Study of Physician Organizations and the Management of Chronic Illness Survey, Quality Improvement Implementation Survey II, and ULTRA Study Practice Staff Questionnaire). The IMPACT2 survey instrument was designed to measure organizational characteristics and care management practices among primary care clinicians. In autumn 2006 the survey was posted to all 1103 primary healthcare workers representing the 18 medical centers of the northern Californian region. A postal reminder followed by a telephone call was decided upon to increase the response rate. This reminder procedure was repeated up to three times. The response rate was 61% and we limited the data to the 550 respondents who indicated that they were primary care clinicians. The Kaiser Foundation Research Institute Institutional Review Board (IRB) approved the study protocol and the data were double keyed-in using Captiva Formware. Because this was a self-administered questionnaire, the IRB waived informed concent requirements, as is common practice.

Data on DHS

We used the three-stage process stated by Fayers et al. [20] to translate the IMPACT2 survey into Danish. This process was used to improve face and content validity [20]. First, forward-backward translations were made using two independent professional translators (from English to Danish) and an expert group of health-services researchers. Inconsistencies were discussed until consensus was reached. Second, the survey underwent a peer review process among health-services researchers outside the research group, and finally we performed a field test among GPs. Special attention was given to reach conceptual and semantic equivalence [21] and ambiguous items were excluded. In Denmark the comparable profession to KPNC's primary care clinicians is GPs. In spring 2007, a Danish translation of the survey was mailed to a random sample of 700 GPs, which corresponds to app. 20% of the number of GPs in the country (n = 3655). In case of lack of response, we prepared two postal reminders. The response rate was 61% as 426 of the GPs returned the survey. Data were double keyed-in using EPIDATA http://www.epidata.dk/. Under Danish law no ethical review process was required.

Clinical integration

Several researchers have developed models and frameworks for categorizing and assessing vertically integrated health systems [22-25]. However, few methods are validated and even fewer are validated across system settings [26-28]. In this paper we build on the theoretical framework developed by Gillies et al., in which clinical integration is identified as the most important form of integration in systems with per capita payment as in KP and DHS [18,24,29]. In this theoretical framework clinical integration is defined as:

"The extent to which patient care services are coordinated across various functions, activities, and operating units of a given system". (Gillies R.R. et al. 1993)

To operationalize clinical integration we chose three core aspects of the concept: timeliness of information transfer, agreement on roles and responsibilities, and established coordination mechanisms [28]. The clinicians' perceptions of these aspects were examined by asking how often these three aspects occurred when care was transferred across clinicians (e.g. from a specialist to the primary care team). The answers were given on a 5-step Likert scale (Never - Always). We dichotomized these variables assigning 0 (never, rarely, or sometimes) or 1 (usually, always). By combining the three dichotomized variables using a summated score (0, 1, 2, 3), we gained a scale measure of clinical integration. We used Cronbach's coefficient, αCronbach, to determine the internal consistency of the scale [30]. Cronbach's coefficient is useful to examine how well a set of items (or variables) measures a single unidimensional latent construct which in this case is 'clinical integration'. The observed value of αCronbach for the three dichotomous response variables was 0.71 which is considered acceptable for psychometric scales [20] and an observed value >0.60 has been suggested to be sufficient for non-validated scales [31].

Explanatory variables

The following explanatory variables were included in the analyses when comparing the two healthcare systems: system setting (DHS, KPNC), years of experience treated as a continuous variable, sex (female, male), working hours per week (full-time, KPNC at least 40 and DHS at least 37; part-time, KPNC <40 and DHS <37). In the system specific analyses, we included the aforementioned variables and in addition we included system specific covariates. In the KPNC analyses we added ethnicity (non-White, White), and implemented health information technology (HIT). To obtain the HIT variable we first considered the number of the following eight HIT features reported to be used for 81-100% of all consultations: viewing lab results, viewing the patient's current medication list, viewing patient's current drug allergies, entering orders for new prescriptions or refills, sending or receiving messages to or from other providers or staff, requesting referrals or consultations, writing free text notes, using standard note templates. This sum took values 0, 1,..., 8 and a factor variable was created as follows: limited (0-4 HIT features); some (5-6 HIT features); and extensive (7-8 HIT features). In the DHS analyses we added number of professions employed as support staff from nurses, medical secretaries, lab technicians, and dieticians (0, 1, 2, 3, 4); practice type (company practice, group practice, solo practice); number of patients used as a continuous variable with incremental steps of 100 patients. To create the HIT variable we first considered the number of the following 11 HIT features that the respondent reported to have access to in the general practice: viewing lab results, ordering new lab tests, viewing the patient's full medication list of patients, viewing the patient's medical allergies, ordering prescriptions or repeat prescriptions, communicating with health professionals outside the practice, communicating with patients, having reminders sent to patients with special health care needs, sending automatic reminders patients, booking consultations, reminders of important tests during a consultation). This sum took values 0, 1,..., 11 and a factor variable was created as follows: limited (0-5 HIT features); some (6-8 HIT features); and extensive (9-11 HIT features)

Statistical methods

We applied a logistic regression model to estimate the association between healthcare system setting and each of the binary response variables (timeliness of information transfer; clear roles and responsibilities; established coordination mechanisms). We analyzed the ordinal scale of clinical integration using a proportional odds logistic regression model. Proportional odds logistic regression models were made for the healthcare system setting analyses as well as for each of the separate systems. Analyses were limited to respondents with complete information on all the included explanatory variables.

In the Danish setting we included an interaction term between practice size (in terms of no. of patients) and practice type. For all tests we did corrections for multiple testing, with a correction procedure based on a 5% false discovery rate (FDR). However, the presented 95% confidence intervals were not adjusted for multiple testing.

We conducted a test for non-response bias in both settings using a binominal test of proportions and a 5% significance level. In KPNC we had full information from automated registries on sex, years of experience, and ethnicity on both respondents and non-respondents. In DHS we had no information on non-respondents; accordingly, we tested whether the surveyed group of GPs was representative of their group on a national level using information on sex, regional setting, and practice type provided by the Danish General Practitioners Association. All statistical analysis was done using the statistical computer environment R [32]. The Design Package was used to fit the regression models [33].

Results

In both system settings higher proportions of male respondents and full-time employee's respondents were found, especially in the DHS setting (Table 2). Among the respondents in the KPNC setting, we had fewer women, fewer experienced respondents, and fewer White respondents than expected. In the Danish setting the distributions on sex and practice type were similar to the distributions among all GPs in Denmark. However, we had fewer respondents in the Capital Region, more surveyed in the Central Region, and more surveyed in the Zealand Region than expected (data not shown).

Table 2.

Frequencies of the observed variables according to the total population, the population in Kaiser Permanente, Northern California (KPNC), and the Danish healthcare system (DHS)

Total population KPNC DHS
N % N % N %
Total population 976 100 550 56.4 426 43.6
Sex
Male 541 55.4 279 50.7 262 61.5
Female 430 44.1 268 48.8 162 38.0
Missing 5 0.5 3 0.5 2 0.5
Working hours*
Full-time 639 65.5 276 50.2 363 85.2
Part-time 248 25.4 191 34.7 57 13.4
Missing 89 9.1 83 15.1 6 1.4
Timeliness of information transfer
Yes 544 55.7 338 61.5 206 48.4
No 411 42.1 193 35.1 218 51.2
Missing 21 2.2 19 3.5 2 0.5
Agreement on roles and responsibilities
Yes 492 50.4 307 55.8 185 43.4
No 456 46.7 219 39.8 237 55.6
Missing 28 2.9 24 4.4 4 0.9
Established coordination mechanisms
Yes 330 33.8 273 49.6 57 13.4
No 616 63.1 252 45.8 364 85.4
Missing 30 3.1 25 4.5 5 1.2
The combined score on clinical integration
0 269 27.6 132 24.0 137 32.2
1 245 25.1 87 15.8 158 37.1
2 173 17.7 87 15.8 86 20.1
3 252 25.8 215 39.1 37 8.7
Missing 37 3.8 29 5.3 8 1.9
Open in a new tab

* In KPNC full-time is at least 40 working hours per week and in DHS at least 37 working hours per week. Part-time is below 40 hours per week in KPNC and below 37 hours per week in DHS

Comparing clinical integration across the system settings

More primary care clinicians in KPNC experience to be part of an environment with clinical integration and in all of the three measured sub-aspects of clinical integration than did GPs in DHS (Figure 1), even when taking into account differences in years of experience, sex, and working hours as well as corrections for multiple testing. The adjusted odds ratios of perception of clinical integration for primary care clinicians in KPNC relative to GPs in DHS was 3.06, 95% CI: 2.28, 4.12. The adjusted odds ratio of a KPNC respondent giving a positive response to the item on timeliness of information transfer was 2.25 (OR = 2.25, 95% CI: 1.62, 3.13) compared to GPs in DHS. In other words, consider the example of a male respondent in the KPNC system with 15 years' of experience and working full-time - the logistic regression predicts with a probability of 68% (95% CI: 61% - 74%) that he usually or always finds information transfer timely. The analogous probability for a Danish male GP with at 15 years' of experience and working full-time was 48% (95% CI: 42%-54%). For the other two sub-aspects of clinical integration: agreement on roles and responsibilities (OR = 1.79, 95% CI: 1.30, 2.47) and established mechanisms in place to ensure effective handoffs (OR = 6.80, 95% CI: 4.60, 10.06) system setting has a significant effect.

Figure 1.

Figure 1

Open in a new tab

Odds-ratios and the corresponding 95% confidence intervals for the effect of system setting (Kaiser Permanente, Northern California vs. the Danish healthcare system) on clinical integration and sub-aspects of clinical integration adjusted for differences in years of experience, sex, and working hours per week.

System specific analysis of clinical integration

The results for the system specific analysis of clinical integration in KPNC and the DHS are presented in Table 3 and 4. As the effect of practice size on clinical integration did not differ greatly between practice types, results are shown for a regression without the interaction term. In both settings none of the explanatory variables considered, health information technology (HIT) included, could account for a substantial proportion of the system specific variation in clinical integration, especially when including corrections for multiple testing.

Table 3.

Odds-ratios for the associations between organizational factors and clinical integration in Kaiser Permanente, Northern California

Odds-ratio 95% CI p-value FDR p-value**
Sex
Female 1.00 Reference
Male 0.87 (0.59, 1.28) 0.47 0.73
Working hours*
Full-time 1.00 Reference
Part-time 0.98 (0.66, 1.46) 0.93 0.93
Years experience 0.99 (0.97, 1.02) 0.61 0.73
Race
Non-White 1.00 Reference
White 1.14 (0.75, 1.76) 0.54 0.73
Implemented health information technology (HIT)
Limited 1.00 Reference
Some 1.21 (0.73, 2.00) 0.46 0.73
Extensive 1.56 (0.95, 2.56) 0.08 0.49
Open in a new tab

* In KPNC full-time is at least 40 working hours per week and in DHS at least 37 working hours per week. Part-time is below 40 hours per week in KPNC and below 37 hours per week in DHS

**p-values, which are corrected for multiple testing. The correction procedure is based on a 5% false-discovery rate

Table 4.

Odds-ratios for the associations between organizational factors and clinical integration in the Danish healthcare system

Odds-ratio 95% CI p-value FDR p-value**
Sex
Female 1.00 Reference
Male 1.12 (0.74, 1.70) 0.60 0.84
Working hours*
Full-time 1.00 Reference
Part-time 0.86 (0.48, 1.53) 0.60 0.84
Years experience 1.01 (0.99, 1.03) 0.46 0.84
Support staff
0 professions 1.00 Reference
1 professions 1.32 (0.28, 6.19) 0.73 0.84
2 professions 0.78 (0.16, 3.71) 0.73 0.84
3 professions 0.65 (0.13, 3.29) 0.60 0.84
4 professions 1.40 (0.15, 12.76) 0.77 0.84
Available health information technology (HIT)
Limited 1.00 Reference
Some 0.68 (0.42, 1.09) 0.11 0.84
Extensive 0.92 (0.46, 1.84) 0.81 0.84
Practice type
Company 1.00 Reference
Group 1.25 (0.63, 2.49) 0.52 0.84
Solo 0.94 (0.53, 1.68) 0.84 0.84
Number of patients*** 1.00 (1.00, 1.00) 0.48 0.84
Open in a new tab

* In KPNC full-time is at least 40 working hours per week and in DHS at least 37 working hours per week. Part-time is below 40 hours per week in KPNC and below 37 hours per week in DHS

** p-values, which are corrected for multiple testing. The correction procedure is based on a 5% false-discovery rate

*** Every incremental step of 1 reflects 100 patients

Discussion

In this study we found that more KPNC primary care clinicians reported being part of a clinical integrated environment compared with an equivalent group of GPs in the DHS. It is noteworthy that a recent European Union Survey (PROCARE) of integrated care approaches across EU member states depicted Denmark and the United Kingdom as the most developed EU countries regarding implementation and testing of coordination of care strategies [15]. This study thereby contributes to the literature by bringing empirical evidence on that KPNC does have established a clinical integrated environment, and thereby supporting earlier studies that indicated the importance of highly coordinated primary care services as a driver of the performance of KPNC [4,5,8-10].

In both healthcare systems the intra-system variations in how many care clinicians reported clinical integration could not be explained by differences in sex, working hours, and years of experience. In KPNC, differences in ethnicity, and implemented health information technology (HIT) could similarly not account for intra-system variation. In the DHS the same was true for the number of professions employed as support staff, the available HIT, practice type and the number of patients assigned to a practice.

We hypothesized HIT to be a facilitating factor for clinical integration but were unable to confirm this. The findings in this study might be explained by the limited sample size and the limited variation regarding HIT in both settings. Of the 521 respondents in KPNC who provided sufficient information to calculate the 'clinical integration' variable 22% were in the 'limited' HIT category, 29% were in the 'some' HIT category and 35% were in the 'extensive' HIT category (14% had missing information on HIT). Of the 418 respondents in DHS who provided sufficient information to calculate the 'clinical integration' variable 18% were in the 'limited' HIT category, 67% were in the 'some' HIT category and 11% were in the 'extensive' HIT category (4% had missing information on HIT).

Strengths and weaknesses

Comparative analysis is a powerful tool to highlight strengths and weaknesses in healthcare delivery systems [34,35]. When conducting comparative research one must however be aware that the specific configuration of any healthcare system depends on the historical and cultural context of health and healthcare that varies across and within countries - this complicates comparisons [36-38]. When engaging in a cross-sectional, comparative study there are therefore potential lessons to be learned but also methodological challenges and results should therefore be interpreted with care. This is the first study that quantifies clinical integration in KPNC and compares the findings to a European healthcare system. Because of the lack of valid measurement tools within the field, we consider it to be a strength of this study that we used a measurement tool on clinical integration based on a theoretical framework and that we were able to demonstrate an acceptable internal consistency of the scale (αCronbach = 0.71) [26,28]. This indicates that the three items used to measure clinical integration do in fact measure a unidimensional latent structure. In the theoretical work on coordination by Alter and Hage, the authors state that perceptions of the stakeholders involved are highly important for coordination processes to take place [39] we therefore considered it to be reasonable that the measurement method used in this study uses self-reported data. Postal surveys tend to have low response rates especially among physicians. A response rate of 61% in both settings is in line with or even higher than comparable surveys [40-42], although this rate means that the possible impact of selection bias must be considered. In both settings the groups of respondents differed on some or all of the tested background variables from the non-respondents or the background population. However, adjustments for these variables had very limited impact on the estimates, and we therefore find it unlikely that the presented results are affected by selection bias to an extent that would change the estimates significantly. We have selected Danish general practitioners as the most comparable profession to primary care clinicians in KPNC. That this is a reasonable choice is a basic assumption of the present study, and we are aware that there is no perfect solution when comparing health care professionals across system settings. It was a limiting factor that the survey used to collect data in the US setting was not constructed to be used in a comparative analysis. We tried to remedy this by conducting a thorough translation process and by intensive field testing of the survey instrument in the Danish setting.

Previous studies on the association between clinical integration and organisational factors have found little evidence of widespread clinical integration [24,43-47]. Due to differences in the measurement methods, the results of these studies cannot be directly compared with this study, but it is interesting that the previous studies were conducted mainly using data from the 1990s, where the health information technology was less developed that it is today.

Directions for future research

Additional work is needed to be carried out to obtain a fuller picture of the extent of clinical integration achieved in KPNC, DHS and other healthcare systems. The theoretical frameworks available should be further developed and tested empirically. Measurement methods should be refined and different approaches, both quantitative and qualitative, should be applied to triangulate results. Future studies should examine clinical integration based on a wider range of care professionals and should use follow-up designs that are more potent when investigating facilitating factors for clinical integration. Finally, further research needs to be conducted on the nature of integration, and on its effect on costs and benefits to healthcare delivery systems and most importantly to the patients.

Conclusions

More primary care clinicians in KPNC reported being part of a clinical integrated environment compared to GPs in the DHS. The preferred strategy to improve clinical integration between clinicians and between settings must be based on evidence on the current level of clinical integration, intra-system variations and a clear understanding of facilitating factors and approaches to improve clinical integration. Focused measures of clinical integration are needed to develop the field of clinical integration and to create the scientific foundation to guide managers searching for evidence based approaches.

Abbreviations

CI: confidence interval; OR: Odds Ratio; IRB: Institutional Review Board; KPNC: Kaiser Permanente, Northern California; DHS: the Danish Healthcare System; NHS: National Health Service; HIT: Health Information Technology.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MSL designed the concept and conducts of the study, collected analysed and interpreted data, drafted the manuscript. MLS collected, analysed, and interpreted data and helped to draft the manuscript. JDS analyzed and interpreted data and commented on the manuscript. AF, JSA and AK assisted in study design, data analysis and interpretation, and critical revision of the manuscript for important intellectual concepts. IG and MR collected and interpreted data and commented on the manuscript. JB and TR were substantially involved in the concept and design of the data collection, and commented on the manuscript. JH analysed and interpreted data, contributed substantially to drafting the manuscript and completed critical revisions for important intellectual concepts. All authors have approved of the final submitted manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/10/91/prepub

Contributor Information

Martin Strandberg-Larsen, Email: m.strandberg-larsen@ifsv.ku.dk.

Michaela L Schiøtz, Email: m.schiotz@ifsv.ku.dk.

Jeremy D Silver, Email: j.silver@biostat.ku.dk.

Anne Frølich, Email: a.frolich@dadlnet.dk.

John S Andersen, Email: j.sahl@gpmed.ku.dk.

Ilana Graetz, Email: ilana.p.graetz@kp.org.

Mary Reed, Email: mary.e.reed@nsmtp.kp.org.

Jim Bellows, Email: Jim.Bellows@kp.org.

Allan Krasnik, Email: a.krasnik@ifsv.ku.dk.

Thomas Rundall, Email: trundall@berkeley.edu.

John Hsu, Email: jhsu2000@gmail.com.

Acknowledgements

We thank the Danish Graduate School in Public Health Science, Faculty of Health Sciences, University of Copenhagen; the Health Insurance Foundation, and the Rockwool Foundation who funded this study. We also thank: Augustinus Fonden, Frimodt-Heineke Fonden, Julie von Müllens Fond, Knud Højgaards Fond, Oticon Fonden, and the Faculty of Health Sciences, University of Copenhagen for providing funding for a research stay at the School of Public Health, University of California, Berkeley. Thanks to the Agency for Healthcare Research and Quality (AHRQ), who funded the collection of data in KPNC. A final thanks to Research Assistant, Mikkel B. Nielsen, MScPH who contributed to the questionnaire construction and data collection in the Danish setting and Associate Professor Thomas Alexander Gerds for biostatistical advice.

References

  1. Strandberg-Larsen M, Schiøtz ML, Frølich A. Kaiser Permanente revisited - can European health care systems learn? Eurohealth. 2007;13(4):24–6. [Google Scholar]
  2. Towill DR. Viewing Kaiser Permanente via the logistician lens. International Journal of Health Care Quality Assurance Incorporating Leadership in Health Services. 2006;19(4-5):296–315. doi: 10.1108/09526860610671364. [DOI] [PubMed] [Google Scholar]
  3. Feachem RG, Sekhri NK, White KL. Getting more for their dollar: a comparison of the NHS with California's Kaiser Permanente. British Medical Journal. 2002;324(7330):135–41. doi: 10.1136/bmj.324.7330.135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Ham C, York N, Sutch S, Shaw R. Hospital bed utilisation in the NHS, Kaiser Permanente, and the US Medicare programme: analysis of routine data. British Medical Journal. 2003;327(7426):1257. doi: 10.1136/bmj.327.7426.1257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Light D, Dixon M. Making the NHS more like Kaiser Permanente. British Medical Journal. 2004;328(7442):763–5. doi: 10.1136/bmj.328.7442.763. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Evans DA. Hospital bed utilisation in the NHS and Kaiser Permanente: debate about Kaiser needs transparency and hard evidence. British Medical Journal. 2004;328(7439):583. doi: 10.1136/bmj.328.7439.583-a. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Talbot-Smith A, Gnani S, Pollock AM, Gray DP. Questioning the claims from Kaiser. British Journal of General Practice. 2004;54(503):415–21. [PMC free article] [PubMed] [Google Scholar]
  8. Badrinath P. Hospital bed utilisation in the NHS and Kaiser Permanente: do not throw the baby out with the bath water. British Medical Journal. 2004;328(7439):583. doi: 10.1136/bmj.328.7439.583. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Black S, Proudlove N. Hospital bed utilisation in the NHS and Kaiser Permanente: bed management in the NHS can be improved easily. British Medical Journal. 2004;328(7439):582–3. doi: 10.1136/bmj.328.7439.582-c. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Crosson FJ. Improving the doctor-manager relationship. Kaiser Permanente: a propensity for partnership. British Medical Journal. 2003;326(7390):654. doi: 10.1136/bmj.326.7390.654. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Coddington DC, Moore KD, Fischer EA. Integrated health care: reorganizing the physician, hospital and health plan relationship. 2. Englewood, Colorado: Center for Research in Ambulatory Health Care Administration; 1995. [Google Scholar]
  12. Gröne O, Garcia-Barbero M. Integrated Care - A Position Paper of the WHO European Office for Integrated Health Care Services. International Journal of Integrated Care. 2001;1:e21. [PMC free article] [PubMed] [Google Scholar]
  13. Shortell SM, Gillies RR, Anderson DA, Erickson KM, Mitchell JB. Remaking health care in America: building organized delivery systems. San Francisco: Jossey-Bass; 1996. [PubMed] [Google Scholar]
  14. Frølich A, Schiøtz ML, Strandberg-Larsen M, Hsu J, Krasnik A, Diderichsen F, Bellows J, Søgaard J, White K. A Retrospective Analysis of health Systems in Denmark and Kaiser Permanente. BMC Health Services Research. 2008;8(1):252. doi: 10.1186/1472-6963-8-252. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. MacAdam M. Framework of Integrated Care for the Elderly: A Systematic Review. Ontario: Canadian Policy Research Networks Inc; 2008. [Google Scholar]
  16. Scott JT, Rundall TG, Vogt TM, Hsu J. Kaiser Permanente's experience of implementing an electronic medical record: a qualitative study. British Medical Journal. 2005;331(7528):1313–6. doi: 10.1136/bmj.38638.497477.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Zee J van der, Kroneman MW. Bismarck or Beveridge: a beauty contest between dinosaurs. BMC Health Services Research. 2007;7:94. doi: 10.1186/1472-6963-7-94. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Strandberg-Larsen M, Nielsen MB, Vallgarda S, Krasnik A, Vrangbaek K, Mossialos E. Denmark: Health system review. Health System in Transition, World Health Organization, on behalf of the European Observatory on Health Systems and Policies. 2007;9(6):1–164. http://www.euro.who.int/Document/E91190.pdf [Google Scholar]
  19. Bilde L, Ankjaer-Jensen A, Danneskiold-Samsoe B. The "Health Benefit Basket" in Denmark: a description of entitlements, actors, and decision-making processes in the curative health sector. European Journal of Health Economics. 2005. pp. 11–7. [DOI] [PMC free article] [PubMed]
  20. Fayers P, Machin D. Quality of Life: assessment, analysis and interpretation. Chichester: John Wiley & Sons, Ltd; 2001. [Google Scholar]
  21. Streiner D, Norman G. Health measurement scales: a practical guide to their development and use. 3. Oxford: Oxford University Press; 2005. [Google Scholar]
  22. Ackerman FK III. The movement toward vertically integrated regional health systems. Health Care Management Review. 1992;17(3):81–8. [PubMed] [Google Scholar]
  23. Brown M, McCool BP. Vertical integration: exploration of a popular strategic concept. Health Care Management Review. 1986;11(4):7–19. doi: 10.1097/00004010-198601140-00002. [DOI] [PubMed] [Google Scholar]
  24. Gillies RR, Shortell SM, Anderson DA, Mitchell JB, Morgan KL. Conceptualizing and measuring integration: findings from the health systems integration study. Hospital and Health Services Administration. 1993;38(4):467–89. [PubMed] [Google Scholar]
  25. Shortell SM, Gillies RR, Anderson DA, Mitchell JB, Morgan KL. Creating organized delivery systems: the barriers and facilitators. Hospital and Health Services Administration. 1993;38(4):447–66. [PubMed] [Google Scholar]
  26. Ahgren B, Axelsson R. Evaluating integrated health care: a model for measurement. International Journal of Integrated Care. 2005;5:e01. doi: 10.5334/ijic.134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Browne G. Commentary: "Evaluating integrated health care: a system of measurement". International Journal of Integrated Care. 2005;5:1. doi: 10.5334/ijic.134. http://www.ijic.org/index.php/ijic/article/view/131/262 [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. McDonald KM, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft SA, McKinnon M, Paguntala H, Owens DK. Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. 2005. Report No.: AHQR Publication No. 04(07)-0051-7. [PubMed]
  29. Shortell SM, Gillies RR, Anderson DA, Erickson KM, Mitchell JB. Remaking health care in America: The evolution of organized delivery systems. 2. San Francisco: Jossey-Bass; 2000. [Google Scholar]
  30. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:289–300. [Google Scholar]
  31. Nunnally J. Psychometric Theory. New York: McGraw-Hill; 1978. [Google Scholar]
  32. R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria; 2008. http://www.R-project.org [Google Scholar]
  33. Harrell FE. , JrDesign. Design Package. R package version 2.1-2. 2008. http://biostat.mc.vanderbilt.edu/rms
  34. Blank RH, Burau V. Comparative Health Policy. Houndsmills, Basingstoke, Hampshire: Palgrave MacMillan; 2004. [Google Scholar]
  35. World Health Organization. Health systems: Improving performance. Geneva: World Health Organization; 2000. [Google Scholar]
  36. Babazono A, Hillman AL. A comparison of international health outcomes and health care spending. International Journal of Technology Assessment in Health Care. 1994;10(3):376–81. doi: 10.1017/S0266462300006619. [DOI] [PubMed] [Google Scholar]
  37. Collins C, Green A, Hunter D. Health sector reform and the interpretation of policy context. Health Policy. 1999;47(1):69–83. doi: 10.1016/S0168-8510(99)00003-2. [DOI] [PubMed] [Google Scholar]
  38. Murray CJL, Frenk J. A WHO framework for health system performance assessment. Geneva, Switzerland: World Health Organization; 1999. [Google Scholar]
  39. Alter C, Hage J. Organizations Working Together. Newbury Park, London, Delhi: SAGE Publications; 1993. [Google Scholar]
  40. Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. Journal of Clinical Epidemiology. 1997;50(10):1129–36. doi: 10.1016/S0895-4356(97)00126-1. [DOI] [PubMed] [Google Scholar]
  41. Cartwright A. Professionals as responders: variations in and effects of response rates to questionnaires, 1961-77. British Medical Journal. 1978;2(6149):1419–21. doi: 10.1136/bmj.2.6149.1419. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. McAvoy BR, Kaner EF. General practice postal surveys: a questionnaire too far? British Medical Journal. 1996;313(7059):732–3. doi: 10.1136/bmj.313.7059.732. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Burns L, Walston SL, Alexander JA, Zuckerman HS, Andersen RM, Torrens PR. Just how integrated are integrated delivery systems? Results from a national survey. Health Care Management Review. 2001;26(1):20–39. doi: 10.1097/00004010-200101000-00003. [DOI] [PubMed] [Google Scholar]
  44. Casalino L, Gillies RR, Shortell SM, Schmittdiel JA, Bodenheimer T, Robinson JC. External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. Journal of the American Medical Association. 2003;289(4):434–41. doi: 10.1001/jama.289.4.434. [DOI] [PubMed] [Google Scholar]
  45. Devers KJ, Shortell SM, Gillies RR, Anderson DA, Mitchell JB, Erickson KL. Implementing organized delivery systems: an integration scorecard. Health Care Management Review. 1994;19(3):7–20. [PubMed] [Google Scholar]
  46. Rundall TG, Shortell SM, Wang MC, Casalino L, Bodenheimer T, Gillies RR. As good as it gets? Chronic care management in nine leading US physician organisations. British Medical Journal. 2002;325(7370):958–61. doi: 10.1136/bmj.325.7370.958. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Schmittdiel JA, Shortell SM, Rundall TG, Bodenheimer T, Selby JV. Effect of primary health care orientation on chronic care management. Annals of Family Medicine. 2006;4(2):117–23. doi: 10.1370/afm.520. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from BMC Health Services Research are provided here courtesy of BMC

RESOURCES