ABSTRACT
BACKGROUND
Effective doctor communication is critical to positive doctor–patient relationships and predicts better health outcomes. Doctor communication is the strongest predictor of patient ratings of doctors, but the most important aspects of communication may vary by specialty.
OBJECTIVE
To determine the importance of five aspects of doctor communication to overall physician ratings by specialty.
DESIGN
For each of 28 specialties, we calculated partial correlations of five communication items with a 0–10 overall physician rating, controlling for patient demographics.
PATIENTS
Consumer Assessment of Healthcare Providers and Systems Clinician and Group (CG-CAHPS®) 12-month Survey data collected 2005–2009 from 58,251 adults at a 534-physician medical group.
MAIN MEAsURES
CG-CAHPS includes a 0 (“Worst physician possible”) to 10 (“Best physician possible”) overall physician rating. Five doctor communication items assess how often the physician: explains things; listens carefully; gives easy-to-understand instructions; shows respect; and spends enough time.
KEY RESULTS
Physician showing respect was the most important aspect of communication for 23/28 specialties, with a mean partial correlation (0.27, ranging from 0.07 to 0.44 across specialties) that accounted for more than four times as much variance in the overall physician rating as any other communication item. Three of five communication items varied significantly across specialties in their associations with the overall rating (p < 0.05).
CONCLUSIONS
All patients valued respectful treatment; the importance of other aspects of communication varied significantly by specialty. Quality improvement efforts by all specialties should emphasize physicians showing respect to patients, and each specialty should also target other aspects of communication that matter most to their patients. The results have implications for improving provider quality improvement and incentive programs and the reporting of CAHPS data to patients. Specialists make important contributions to coordinated patient care, and thus customized approaches to measurement, reporting, and quality improvement efforts are important.
KEY WORDS: doctor–patient relationship, specialty care, quality improvement, patient satisfaction
INTRODUCTION
Effective doctor communication is critical in establishing and maintaining positive doctor–patient relationships.1–4 Good communication skills, including taking time to listen and providing clear explanations, are among the qualities that patients most desire in physicians.5,6 Consequently, patients’ reports of doctor communication are the strongest predictor of overall doctor ratings, for both primary care physicians7–9 and specialists.10,11
Effective doctor–patient communication predicts better health outcomes12,13 such as symptom resolution, physiologic measures (e.g. blood pressure, blood sugar level), pain control (e.g. cancer pain, dental pain), and physical functioning.14–18 Accordingly, medical groups, purchasers, and governmental payors increasingly use doctor–patient communication measures for quality improvement (QI) and in pay-for-performance systems.19,20
The Consumer Assessment of Healthcare Providers and Systems (CAHPS®) surveys are the national standard for evaluating patients’ health care experiences.7,21–25 CAHPS surveys focus on aspects of care (1) that patients have identified as important, and (2) for which patients are the best or only source of information. The CAHPS Clinician and Group survey (CG-CAHPS) focuses on ambulatory care and is intended to provide comparative performance information on individual clinicians, practice sites, and medical groups to facilitate consumer choice, and to inform and guide QI. The CG-CAHPS survey includes an overall rating of the physician plus four multi-item composites: access to care, coordination of care, doctor communication, and office staff courteousness and helpfulness.26,27 The five doctor communication items assess how often the physician: explains things; listens carefully; gives easy-to-understand instructions; shows respect; and spends enough time.
Pay-for-performance programs have focused on primary care physicians (PCPs) to assure that preventive services are delivered.28 Although many organizations are eager to develop a pay-for-performance system for specialists, logistics have been difficult,29–31 and the use of patient-experience-of-care measures in specialty care remains rare.20,32 However, pay-for-performance programs and QI must begin to engage more specialists, because specialists are responsible for a large and growing proportion of patient care.33
Understanding whether patients value aspects of doctor communication differently depending on the type of specialist seen may inform the design of QI interventions. If patients value similar aspects of doctor communication, then a uniform QI approach may be best, but if the importance varies by specialty, programs tailored to the most valued aspects for a given specialty may be appropriate. While pay-for-performance approaches may need to be consistent across specialties, knowing which aspects of communication are most important overall may inform pay-for-performance design.
This paper examines variation in the relationships between different aspects of communication and patients’ ratings of their physicians, across a wide range of medical and surgical specialties. Given the emotional nature of showing respect in a relationship compared to the procedural aspect of providing information (listens carefully, instructions easy to understand, explains things),34 we hypothesize that showing respect will be more important than the three aspects of communication which focus on information exchange and spending enough time.
METHODS
Data
The CG-CAHPS survey includes a 0 (“Worst physician possible”) to 10 (“Best physician possible”) overall physician rating, and multiple items assessing four care domains: access (three items), courteous/helpful office staff (two items), care coordination (three items), and physician communication (five items). The five doctor communication items assess how often the physician: explains things; listens carefully; gives easy-to-understand instructions; shows respect; and spends enough time. The response options are: Never, Almost never, Sometimes, Usually, Almost always, and Always. All items ask patients about their experience with a specified physician in the last 12 months. The survey includes patient characteristics that are used for case-mix adjustment.
The data analyzed here represents five administrations of the CG-CAHPS survey over 3 years (April 2006; August 2006; Feb 2007; Feb 2008; Jan 2009) from one large medical group with numerous specialists. At each administration, 100 patients were sampled from every physician who had seen 100 or more unique patients in the prior 12 months, exceeding the 45 patients per physician recommended for acceptable reliability (0.70) at the physician level.26,35
The survey instrument named the reference physician and asked the respondent to confirm having had at least one visit with that physician in the past year; only such surveys were retained for analysis. The survey was administered by mail, with a second survey sent by mail after 14 days to those who had not responded. No telephone follow-up was used. Response rates of 36–45 % across five administrations yielded 63,441 respondents.
After excluding those not providing an overall physician rating (3,597), not responding to at least one composite (1,346), or ineligible via their psychiatric or pediatric status (247), 58,251 cases remained for analysis (92 %). Respondents saw 534 physicians:100 primary care physicians, 227 non-surgical specialists, and 207 surgical specialists (Table 1).
Table 1.
28 Specialties and Service Line with Number of Physicians and Patients Analyzed
| Specialty | Service line | Number of physicians | Number of patients |
|---|---|---|---|
| Primary care physicians | |||
| Internal medicine | Medical | 54 | 3,638 |
| Geriatric medicine | Medical | 12 | 1,033 |
| Family practice | Medical | 34 | 1,781 |
| Non-surgical specialists | |||
| Oncology-hematology | Medical | 37 | 4,695 |
| Rheumatology | Medical | 25 | 2,958 |
| Endocrinology | Medical | 19 | 1,873 |
| Cardiology | Medical | 27 | 3,728 |
| Pulmonary disease | Medical | 21 | 2,565 |
| Infectious disease | Medical | 10 | 969 |
| Nephrology | Medical | 10 | 865 |
| Neurology | Medical | 37 | 4,531 |
| Radiation oncology | Medical | 5 | 474 |
| Pain management-int med | Medical | 7 | 622 |
| Gastroenterology | Medical | 24 | 2,603 |
| Dermatology | Medical | 25 | 2,162 |
| Allergy & immunology | Medical | 5 | 396 |
| Surgical specialists | |||
| Ophthalmology | Surgical | 36 | 5,160 |
| Surgical oncology | Surgical | 7 | 1,175 |
| Urology | Surgical | 21 | 3,197 |
| Radiology-interventional | Surgical | 4 | 310 |
| Obstetrics/gynecology | Surgical | 29 | 2,938 |
| Otolaryngology | Surgical | 12 | 1,807 |
| Neurological surgery | Surgical | 12 | 1,507 |
| Vascular surgery | Surgical | 6 | 877 |
| Plastic surgery | Surgical | 5 | 534 |
| Orthopedic surgery | Surgical | 24 | 3,146 |
| Thoracic/cardiac surgery | Surgical | 7 | 810 |
| Surgery general | Surgical | 19 | 1,897 |
Construction of 28 Specialty Groups
To examine associations between specific aspects of communication and the overall physician rating, we defined 28 specialties by pooling groups of similar physician specialties that contained fewer than 300 patients. We used three factors to guide definition of the specialty groups: (1) 2-digit customized specialty code based on the April 2003 version of the Centers for Medicare and Medicaid Services health care provider taxonomy physician codes (effective July 1, 2004); (2) service line (medical vs. surgical, which includes obstetrics); and (3) PCP vs. specialist. These 28 categories of specialties and the number of physicians and patients in the analytic data set appear in Table 1.
Analytic Approach
For ease of comparison, we rescaled all CAHPS measures to a 0–100 possible range. CAHPS scores are comparable across physicians only after case-mix adjusting for patient characteristics that are generally beyond a physician’s control and affect CAHPS scores. We used case-mix adjustors similar to those used by O’Malley et al.36 and Martino et al.37: age, education, self-reported general and mental health, and gender in all analyses (see Table 2 for details). All standard errors were corrected for clustering of patients within physicians.38,39
Table 2.
Patient Characteristics
| Characteristic | N | Percent of sample (N = 58,251) |
|---|---|---|
| Age | ||
| 18–24 | 1,028 | 2 |
| 25–34 | 4,374 | 8 |
| 35–44 | 6,106 | 11 |
| 45–54 | 9,046 | 16 |
| 55–64 | 12,480 | 21 |
| 65–74 | 12,434 | 21 |
| 75–84 | 9,213 | 16 |
| 85+ | 3,570 | 6 |
| Female | 34,419 | 59 |
| Race/ethnicity | ||
| White, non-Hispanic | 40,122 | 69 |
| Asian/Pacific Islander | 6,264 | 11 |
| Hispanic | 5,796 | 10 |
| Black | 3,014 | 5 |
| Native American | 155 | 0 |
| Other and multiracial | 1,923 | 3 |
| Unknown/missing | 977 | 2 |
| Education | ||
| 8th grade or less | 1,117 | 2 |
| Some high school but did not graduate | 1,582 | 3 |
| High school graduate/GED only | 6,258 | 11 |
| Some college but no 4-year degree | 15,745 | 27 |
| Four-year college degree only | 12,860 | 22 |
| More than 4-year college degree | 20,689 | 36 |
| Self-rated general health | ||
| Excellent | 7,580 | 13 |
| Very good | 17,619 | 30 |
| Good | 19,002 | 33 |
| Fair | 10,694 | 18 |
| Poor | 3,357 | 6 |
| Self-rated mental health | ||
| Excellent | 18,175 | 31 |
| Very good | 19,119 | 33 |
| Good | 14,280 | 25 |
| Fair | 5,597 | 10 |
| Poor | 1,080 | 2 |
| Service line | ||
| Surgery (including obstetrics) | 23,358 | 40 |
| Medical | 34,893 | 60 |
| Primary care physician | 6,452 | 11 |
| Time period visit dates | ||
| 1: Visit dates 5/05–4/06 | 10,284 | 18 |
| 2: Visit dates 10/05–8/06 | 9,360 | 16 |
| 3: Visit dates 3/06–2/07 | 10,030 | 17 |
| 4: Visit dates 3/07–2/08 | 14,250 | 24 |
| 5: Visit dates 2/08–1/09 | 14,327 | 25 |
In order to compare overall ratings and patient-reported communication by specialty, we calculated case-mix adjusted means of the overall physician rating and five doctor communication items for each of the 28 specialties, testing each adjusted mean against the mean of all other specialties.
Our primary aim was to measure the extent to which each aspect of doctor communication item was associated with the overall physician rating. We were also interested in whether the “key drivers” of these ratings differed by specialty.
We used a single linear regression model to address these primary aims. This model predicted the overall physician rating from (a) five doctor communication items; (b) 27 specialty indicators; (c) interactions of (a) and (b); (d) main effects of the access, coordination of care, and office staff composites; and (e) wave of administration and case-mix variables. Variable sets (a–c) are the primary independent variables and variable sets (d–e) are our control variables. To more easily compare the strength of association between communication items and overall physician ratings, we present regression results as partial correlation coefficients. These correlations may range from −1 to +1, with 0.00 meaning no association, and values of 0.02, 0.15, and 0.35 (positive or negative) corresponding to small, medium, and large effect sizes, respectively.40 To test whether these correlations varied across specialties, we applied partial F-tests to the regression results.
RESULTS
Patients
Patient characteristics appear in Table 2. The mean age was 60 (SD = 16.9), and 59 % of patients were female. A majority was non-Hispanic White (69 %), with many who were Asian/Pacific Islander (11 %), Hispanic (10 %), or Black (5 %). Over half of patients (58 %) had a 4-year college degree. Forty percent of patients saw a physician for surgical care (including obstetrics) and 11 % of patients saw a primary care physician.
Mean Patient Experience Scores by Specialty
Table 3 reports the case-mix adjusted means of the overall physician rating and five doctor communication items for the 28 specialties. The adjusted mean overall physician rating was 90 out of 100. CAHPS overall ratings are often similarly skewed,41 but these ratings are nonetheless reliable (able to distinguish groups, plans, and hospitals) and support tests of means and correlations42 at recommended sample sizes.43 The mean physician-level reliabilities of the overall rating and the five communication items were 0.88 to 0.92 at the observed sample sizes, indicating high reliability.44
Table 3.
Case-Mix Adjusted Means for Global Physician Rating and Five Communication Composite Items
| Global physician rating† | Show respect | Listen carefully | Instructions easy to understand | Spend enough time | Explain things | |
|---|---|---|---|---|---|---|
| Overall | 90 | 92 | 91 | 90 | 88 | 91 |
| Primary care physicians | ||||||
| Internal medicine | 91** | 93*** | 93*** | 92*** | 89** | 93*** |
| Geriatric medicine | 90 | 94* | 94*** | 92*** | 91*** | 93*** |
| Family practice | 88 | 92 | 90 | 90 | 87 | 91 |
| Non-surgical specialists | ||||||
| Oncology-hematology | 91** | 94** | 92* | 91* | 89* | 92* |
| Rheumatology | 92* | 95*** | 94*** | 93** | 94*** | 94*** |
| Endocrinology | 88 | 91 | 90 | 90 | 89 | 90 |
| Cardiology | 90 | 93 | 92 | 91* | 89 | 92* |
| Pulmonary disease | 90 | 93 | 91 | 91 | 89 | 91 |
| Infectious disease | 95*** | 97*** | 96*** | 96*** | 95*** | 96*** |
| Nephrology | 87 | 89 | 87 | 87 | 83** | 87 |
| Neurology | 88 | 92 | 91 | 89 | 90* | 91 |
| Radiation oncology | 88 | 93 | 91 | 91* | 87 | 91 |
| Pain management-int med | 86 | 93 | 90 | 90 | 87 | 90 |
| Gastroenterology | 86** | 90 | 89 | 88 | 86 | 89 |
| Dermatology | 86* | 91 | 90 | 90 | 86 | 90 |
| Allergy & immunology | 82 | 86 | 85 | 85 | 85 | 85 |
| Surgical specialists | ||||||
| Ophthalmology | 91** | 91 | 90 | 91 | 87 | 90 |
| Surgical oncology | 91** | 91 | 90 | 90 | 87 | 90 |
| Urology | 88 | 90 | 88 | 88 | 84* | 89 |
| Radiology-interventional | 92 | 93 | 92 | 93 | 91 | 91 |
| Obstetrics/gynecology | 88 | 91 | 89 | 88 | 85 | 88 |
| Otolaryngology | 87 | 88** | 87** | 86* | 83** | 88* |
| Neurological surgery | 91 | 91 | 90 | 89 | 86 | 90 |
| Vascular surgery | 90 | 92 | 91 | 90 | 87 | 91 |
| Plastic surgery | 89 | 91 | 91 | 90 | 89 | 91 |
| Orthopedic surgery | 83** | 84*** | 83*** | 82*** | 78*** | 84*** |
| Thoracic/cardiac surgery | 91* | 91 | 90 | 89 | 86 | 90 |
| Surgery general | 90 | 91 | 91 | 89 | 87 | 91 |
†Physician level standard deviation of 5, root error variance of 17. Physician level SD is square root of physician variance component from model predicting global physician rating from case-mix adjustors and specialty indicators. Root error variance is from same model
*p < 0.05, **p < 0.01, ***p < 0.001 for test of whether mean for designated specialty differs from mean for all other specialties, adjusting for case mix
As a sensitivity test for influential outliers, we set three standard deviations below and three standard deviations above the overall means on overall ratings and communication items as our outer limits, and recoded individual responses outside those limits to those boundary values. Only negative outliers were observed, 2–4 % of observations across items, and recoded results were very similar to the primary results presented here.
Significantly higher-than-average means for the overall physician rating were found for six specialties (three non-surgical: infectious disease, oncology-hematology, and rheumatology; and three surgical: surgical oncology, ophthalmology, and thoracic/cardiac surgery), with infectious disease specialty physicians having the highest mean (95). Dermatology, gastroenterology, and orthopedic surgery had significantly lower-than-average mean overall ratings.
Infectious disease, oncology-hematology, and rheumatology had significantly higher-than-average adjusted means on all five doctor communication items. Infectious disease had the highest means, 5–7 points above average. Orthopedic surgery and otolaryngology had significantly below-average adjusted means on all five items; the lowest means were in orthopedic surgery, 7–10 points below average. Two of the three types of PCPs—geriatric medicine and internal medicine—also had significantly higher-than-average adjusted means on all five communication items.
Partial Correlations of Communication with Overall Rating, by Specialty
Table 4 presents partial correlations of communication items with the overall rating by specialty from a linear regression model predicting the overall physician rating from case-mix adjustors, specialty, five communication items, their interactions, and adjustor variables [R2 = 0.71, F (191, 533) = 50,670, p < 0.0001].
Table 4.
Correlation† of Communication Composite Items with Global Physician Rating for 28 Specialties
| Show respect | Listen carefully | Instructions easy to understand | Spend enough time | Explain things | ||||||||
| Simple correlation | 0.77 | 0.77 | 0.75 | 0.73 | 0.73 | |||||||
| Average partial correlation across 28 specialties | 0.27 | 0.13 | 0.13 | 0.11 | 0.09 | |||||||
| Partial F test of interaction with specialty | 1.62 | 1.28 | 1.90 | 2.86 | 1.42 | |||||||
| P-value for partial F test | p = 0.03 | p = 0.16 | p = 0.004 | p < 0.001 | p = 0.08 | |||||||
| N | Partial correlation | Partial R from Items | ||||||||||
| Primary care physicians | ||||||||||||
| Internal medicine | 3,369 | 0.21 | p < 0.001 | 0.14 | p < 0.001 | 0.14 | p < 0.001 | 0.16 | p < 0.001 | 0.06 | p = 0.08 | 0.33 |
| Geriatric medicine | 959 | 0.19 | p = 0.005 | 0.14 | p = 0.03 | 0.26 | p < 0.001 | 0.08 | p = 0.04 | 0.10 | p < 0.001 | 0.37 |
| Family practice | 1,606 | 0.29 | p < 0.001 | 0.18 | p < 0.001 | 0.06 | p = 0.04 | 0.13 | p < 0.001 | 0.12 | p < 0.001 | 0.38 |
| Non-surgical specialists | ||||||||||||
| Oncology-hematology | 4,409 | 0.28 | p < 0.001 | 0.12 | p < 0.001 | 0.10 | p = 0.002 | 0.13 | p < 0.001 | 0.09 | p = 0.008 | 0.36 |
| Rheumatology | 2,843 | 0.22 | p < 0.001 | 0.29 | p < 0.001 | 0.10 | p < 0.001 | 0.13 | p < 0.001 | 0.04 | p = 0.24 | 0.40 |
| Endocrinology | 1,729 | 0.26 | p < 0.001 | 0.09 | p = 0.09 | 0.17 | p < 0.001 | 0.14 | p < 0.001 | 0.11 | p = 0.009 | 0.37 |
| Cardiology | 3,470 | 0.23 | p < 0.001 | 0.14 | p < 0.001 | 0.14 | p < 0.001 | 0.07 | p = 0.07 | 0.13 | p < 0.001 | 0.34 |
| Pulmonary disease | 2,447 | 0.18 | p < 0.001 | 0.17 | p < 0.001 | 0.21 | p < 0.001 | 0.16 | p < 0.001 | 0.05 | p = 0.28 | 0.36 |
| Infectious disease | 908 | 0.33 | p < 0.001 | 0.18 | p = 0.004 | 0.14 | p = 0.001 | 0.01 | p = 0.93 | 0.03 | p = 0.59 | 0.41 |
| Nephrology | 787 | 0.27 | p < 0.001 | 0.09 | p = 0.14 | 0.10 | p = 0.07 | 0.06 | p = 0.02 | 0.12 | p = 0.01 | 0.32 |
| Neurology | 4,246 | 0.28 | p < 0.001 | 0.12 | p < 0.001 | 0.18 | p < 0.001 | 0.15 | p < 0.001 | 0.05 | p = 0.13 | 0.39 |
| Radiation oncology | 434 | 0.26 | p < 0.001 | 0.08 | p = 0.26 | −0.02 | p = 0.69 | 0.20 | p = 0.09 | 0.09 | p = 0.25 | 0.35 |
| Pain management-int med | 589 | 0.24 | p = 0.04 | −0.03 | p = 0.71 | 0.16 | p = 0.01 | 0.20 | p < 0.001 | 0.21 | p = 0.03 | 0.41 |
| Gastroenterology | 2,451 | 0.28 | p < 0.001 | 0.12 | p < 0.001 | 0.21 | p < 0.001 | 0.09 | p = 0.001 | 0.08 | p = 0.03 | 0.39 |
| Dermatology | 1,888 | 0.28 | p < 0.001 | 0.10 | p = 0.01 | 0.14 | p < 0.001 | 0.15 | p < 0.001 | 0.14 | p < 0.001 | 0.38 |
| Allergy & immunology | 385 | 0.36 | p < 0.001 | 0.20 | p = 0.007 | 0.11 | p = 0.07 | 0.09 | p = 0.003 | 0.14 | p < 0.001 | 0.46 |
| Surgical specialists | ||||||||||||
| Ophthalmology | 4,538 | 0.23 | p < 0.001 | 0.08 | p = 0.01 | 0.10 | p < 0.001 | 0.11 | p < 0.001 | 0.11 | p < 0.001 | 0.30 |
| Surgical oncology | 1,031 | 0.40 | p < 0.001 | 0.03 | p = 0.72 | 0.08 | p = 0.22 | 0.13 | p < 0.001 | −0.03 | p = 0.45 | 0.43 |
| Urology | 2,920 | 0.26 | p < 0.001 | 0.12 | p < 0.001 | 0.14 | p < 0.001 | 0.08 | p = 0.04 | 0.12 | p < 0.001 | 0.35 |
| Radiology-interventional | 286 | 0.07 | p = 0.24 | 0.23 | p = 0.03 | 0.19 | p = 0.002 | 0.35 | p < 0.001 | 0.04 | p = 0.25 | 0.47 |
| Obstetrics/gynecology | 2,745 | 0.31 | p < 0.001 | 0.11 | p = 0.002 | 0.13 | p < 0.001 | 0.17 | p < 0.001 | 0.08 | p = 0.06 | 0.39 |
| Otolaryngology | 1,663 | 0.27 | p < 0.001 | 0.16 | p = 0.003 | 0.15 | p = 0.002 | 0.08 | p = 0.007 | 0.11 | p = 0.005 | 0.37 |
| Neurological surgery | 1,406 | 0.26 | p < 0.001 | 0.17 | p < 0.001 | 0.11 | p < 0.001 | 0.02 | p = 0.76 | 0.14 | p = 0.009 | 0.36 |
| Vascular surgery | 789 | 0.18 | p < 0.001 | 0.23 | p = 0.009 | 0.14 | p = 0.006 | 0.14 | p = 0.03 | −0.03 | p = 0.71 | 0.36 |
| Plastic surgery | 500 | 0.44 | p < 0.001 | 0.24 | p = 0.01 | 0.04 | p = 0.48 | 0.02 | p = 0.86 | 0.10 | p = 0.22 | 0.51 |
| Orthopedic surgery | 2,899 | 0.33 | p < 0.001 | 0.14 | p = 0.001 | 0.09 | p < 0.001 | 0.07 | p = 0.009 | 0.16 | p < 0.001 | 0.41 |
| Thoracic/cardiac Surgery | 747 | 0.38 | p < 0.001 | 0.01 | p = 0.90 | 0.07 | p = 0.29 | 0.07 | p = 0.06 | 0.15 | p < 0.001 | 0.42 |
| Surgery general | 1,763 | 0.32 | p < 0.001 | 0.10 | p = 0.07 | 0.12 | p = 0.006 | 0.08 | p = 0.05 | 0.15 | p < 0.001 | 0.39 |
†Simultaneous partial correlations are from a model that included patient-level control variables (time period of doctor visit, gender, age, education, general health, mental health, access to care, coordination of care, and helpfulness of office staff)
R2 = 0.71
Cells for which p < 0.05 appear in boldface
Showing respect was the item most strongly related to the overall physician rating. Its average partial correlation with the overall physician rating (0.27; range: 0.07–0.44, largest correlation for 23/28 specialties) was a medium-to-large40 effect size that was more than twice as large and uniquely explained more than four times as much of the variance in overall ratings as any other aspect of communication. The other four items had small-medium average partial correlations with the overall rating (0.09–0.13); physician explaining things was the least correlated.
The relative importance of specific aspects of communication varied significantly by specialty for three communication measures: physician showing respect, giving easy-to-understand instructions, and spending enough time (p < 0.05). For example, spending enough time was the most important communication dimension for interventional radiology (r = 0.35), but mattered little for infectious diseases (r = 0.01). Providing easy-to-understand instructions was the most important dimension for both geriatric medicine (r = 0.26) and pulmonary disease (r = 0.21), but mattered little for radiation oncology (r = −0.02). Physician showing respect was especially important for plastic surgery (r = 0.44), but much less so for interventional radiology (r = 0.07).
DISCUSSION
While specialty care is sometimes viewed as purely technical, there is evidence that doctor communication strongly predicts patients’ overall ratings of specialists.10,11,45,46 This study extends these findings in demonstrating that the aspect of communication most strongly related to the overall physician rating for most specialties was the physician showing respect.
We also found that three of the five measured aspects of doctor communication—shows respect, easy-to-understand instructions, and spends enough time—vary by specialty in the extent to which they predict overall physician ratings, suggesting that patients value these aspects of communication differently depending on the type of specialty care they are seeking.
The patterns of variation are consistent with the nature of the specialty care. For example, the especially high importance of respect for plastic surgery patients may reflect vulnerability that such patients feel in that setting. Easy-to-understand instructions may be especially important in geriatric medicine because of cognitive limitations of some older patients and in pulmonary disease because of the inherent complexity of the necessary instructions. Interventional radiology involves very specialized procedures and requires that extensive information be conveyed to patients; accordingly, we see greater importance of time than respect in this setting. The substantial importance of showing respect, listening carefully, and spending enough time for rheumatology may reflect that specialty’s long-term doctor–patient relationships.
These results have different implications for clinical practice, QI, and for improving the measurement and reporting of patient ambulatory experience with specialists. QI initiatives by physician practices must understand and work with underlying care processes that influence CAHPS scores, whereas for simplicity and optimal measurement, pay-for-performance systems and other external measurement systems only need to focus on the CAHPS domains themselves. These analyses suggest that specialist pay-for-performance initiatives should focus on showing patients respect.
For QI efforts by physician practices, the varying importance of specific aspects of communication also suggests that specialists should target the aspects of communication that are most important for that specialty, given the daunting number of physician communication interventions vying for specialists’ limited time.47 Nevertheless, the consistent importance of physicians showing respect across all specialties suggests that it should be a QI target for all specialties. Physicians showing respect in ways that patients understand may have additional benefits, such as increasing patient comfort with disclosing sensitive information and greater patient adherence to treatment.
Hardee et al. (2008) suggested that physicians foster respect by reinforcing a patient’s dignity and notes that physicians should be sensitive to patients’ perspectives and health beliefs and express genuine curiosity about them as individuals. Providers can demonstrate respect for what the patient has to say by eliciting the patient’s perspective (“habit 2” of the Four Habits model48):
Ask for the patient’s ideas about his or her illness (“What do you think might be causing this problem?” “What worries you the most about this?”)
Elicit specific requests from the patient (“How might you and I work together to solve this problem?” “I see you’ve been downloading information from the Internet. Tell me what you’ve come up with so far, and I’ll share my thoughts with you.”)
Explore the impact on the patient’s life (“How is this affecting your ability to get through your day?”)
With regards to the aspects of communication whose importance varies more across specialties, practices need to understand the workflow and care processes that influence the important aspects of doctor–patient communication for their specialty. Care delivery interventions and training aimed at influencing communication with the patient (including all physicians, nurses and other clinical staff) should emphasize the most influential and relevant aspects of communication for that specialty. For example, easy-to-understand instructions may need particular emphasis for geriatric medicine (r = 0.26), pulmonary disease (r = 0.21), gastroenterology (r = 0.21), and interventional radiology (r = 0.19).
Since what patients perceive as good physician communication and respectful treatment may vary by patient demographics,9 physician training should take a multicultural perspective,49 especially given that institutional commitment to cultural sensitivity is associated with better overall performance and smaller disparities in patient experience.50
Reporting CG-CAHPS survey results as composites assumes that items within composites have similar relevance to different patient subgroups and recognizes the need to minimize cognitive burden in top-level data presentations. Our findings suggest that providing an optional drill-down that emphasizes the doctor communication items that are most important to a particular specialty might lead to better matching of patients to specialists. It may not be obvious to patients, for example, that their experiences with a pulmonologist or gastroenterologist might depend on these specialists’ ability to provide easy-to-understand instructions. Further research could explore the value of item-level reporting to consumers.
This study has several limitations. While the response rates are similar to those for other surveys of outpatient and inpatient experience,51,52 and response rates are only weakly associated with non-response bias in well-conducted probability samples,53 the possibility of non-response bias remains. Non-respondents tend to be less healthy and less positive in their evaluations of health care.54,55 Nonetheless, such bias tends to be minimized in CAHPS surveys when case-mix adjustment is employed,55,56 and while overall mean ratings may be overestimated, bias that differently affects the partial correlations by specialty that are the focus of this work is especially unlikely. Similarly, patient reports about care are potentially subject to social desirability pressures; this tendency is greater for interviewer-administration than the self-administered mode used in this study. There is also no reason to expect socially desirable responding to differentially affect the individual CAHPS communication items in a way that varies by specialty and thus biases the reported correlations.
In addition, the observed patterns may to some extent reflect demographic differences in the physicians practicing various specialties, rather than differences inherent in the specialties themselves; nevertheless, such demographic differences are more likely to affect mean scores by specialties than the correlations of communication with the overall physician rating. Because we studied only a single medical group, our findings may in some way be specific to the location or culture of that group. Nevertheless, the medical group studied is very large, with numerous specialties and specialists, and serves a very ethnically diverse international patient population. Finally, caution is warranted in inferring causal direction from this cross-sectional data.
Despite these limitations, these results have clear implications for QI efforts, pay-for-performance initiatives, and improving CAHPS reporting of experiences with specialists. Interventions should emphasize respectful treatment of patients for all specialists, and tailored interventions should focus on the particular aspects of communication most valued by those seeking a given form of specialty care. In addition, these findings highlight the potential to better inform patients in their physician choices by focusing their attention on the aspects of communication that may matter most to patients seeking similar care.
The importance of provider respect for patients suggests a need for additional research to identify provider behaviors that convey respect to patients, such as qualitative interviews with patients of both PCPs and a variety of specialists and interviews with their physicians about their specific communication behaviors.57 A randomized longitudinal test of a communication intervention might follow.
Acknowledgements
This study was supported by a cooperative agreement from the Agency for Healthcare Research and Quality (U18 HS016980). Ron D. Hays was also supported in part by grants from the NIA (P30-AG021684) and the NIMHD (P20MD000182). The authors would like to thank Aneetha Ramadas, AB, Daisy Montfort, AB, and Fergal McCarthy, MPhil, for assistance with the preparation of the manuscript.
Conflict of Interest
The authors declare that they do not have a conflict of interest.
REFERENCES
- 1.Hulsman RL, Ros WJ, Winnubst JA, Bensing JM. Teaching clinically experienced physicians communication skills. A review of evaluation studies. Med Educ. 1999;33(9):655–668. doi: 10.1046/j.1365-2923.1999.00519.x. [DOI] [PubMed] [Google Scholar]
- 2.Beck R, Daughtridge R, Sloane P. Physician-patient communication in the primary care office: a systematic review. J Am Board Fam Med. 2002;15(1):25–38. [PubMed] [Google Scholar]
- 3.Epstein RM, Franks P, Fiscella K, Shields CG, Meldrum SC, Kravitz RL, et al. Measuring patient-centered communication in patient-physician consultations: theoretical and practical issues. Soc Sci Med. 2005;61(7):1516–1528. doi: 10.1016/j.socscimed.2005.02.001. [DOI] [PubMed] [Google Scholar]
- 4.Beach M, Inui T. Relationship-centered care: a constructive reframing. J Gen Intern Med. 2006;21(S1):S3–S8. doi: 10.1111/j.1525-1497.2006.00302.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Roter DL. Patient participation in the patient-provider interaction: the effects of patient question asking on the quality of interaction. Satisfaction and compliance. Health Educ Monogr. 1977;5(4):281–315. doi: 10.1177/109019817700500402. [DOI] [PubMed] [Google Scholar]
- 6.Bartlett E, Grayson M, Barker R, Levine D, Golden A, Libber S. The effects of physician communications skills on patient satisfaction; recall, and adherence. J Chronic Dis. 1984;37(9–10):755–764. doi: 10.1016/0021-9681(84)90044-4. [DOI] [PubMed] [Google Scholar]
- 7.Hargraves JL, Hays RD, Cleary PD. Psychometric properties of the Consumer Assessment of Health Plans Study (CAHPS) 2.0 adult core survey. Health Serv Res. 2003;38(6 Pt 1):1509–1527. doi: 10.1111/j.1475-6773.2003.00190.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Tallman K, Janisse T, Frankel RM, Sung SH, Krupat E, Hsu JT. Communication practices of physicians with high patient-satisfaction ratings. Perm J. 2007;11(1):19–29. doi: 10.7812/TPP/06-106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Wilkins V, Elliott MN, Richardson A, Lozano P, Mangione-Smith R. The association between care experiences and parent ratings of care for different racial, ethnic, and language groups in a Medicaid population. Health Serv Res. 2011;46(3):821–839. doi: 10.1111/j.1475-6773.2010.01234.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ruiz-Moral R, Perez Rodriguez E, Perula de Torres LA, de la Torre J. Physician-patient communication: a study on the observed behaviours of specialty physicians and the ways their patients perceive them. Patient Educ Couns. 2006;64(1–3):242–248. doi: 10.1016/j.pec.2006.02.010. [DOI] [PubMed] [Google Scholar]
- 11.Sofaer S, Crofton C, Goldstein E, Hoy E, Crabb J. What do consumers want to know about the quality of care in hospitals? Health Serv Res. 2005;40(6 Pt 2):2018–2036. doi: 10.1111/j.1475-6773.2005.00473.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Greenfield S, Kaplan SH, Ware JE, Jr, Yano EM, Frank HJ. Patients’ participation in medical care: effects on blood sugar control and quality of life in diabetes. J Gen Intern Med. 1988;3(5):448–457. doi: 10.1007/BF02595921. [DOI] [PubMed] [Google Scholar]
- 13.Roter D, Hall JA. Doctors talking with patients/patients talking with doctors : improving communication in medical visits. Westport, Conn: Auburn House; 1992. [Google Scholar]
- 14.Franks P, Jerant AF, Fiscella K, Shields CG, Tancredi DJ, Epstein RM. Studying physician effects on patient outcomes: physician interactional style and performance on quality of care indicators. Soc Sci Med. 2006;62(2):422–432. doi: 10.1016/j.socscimed.2005.05.027. [DOI] [PubMed] [Google Scholar]
- 15.Stewart MA. Effective physician-patient communication and health outcomes: a review. Can Med Assoc J. 1995;152(9):1423–1433. [PMC free article] [PubMed] [Google Scholar]
- 16.Stewart M, Brown JB, Boon H, Galajda J, Meredith L, Sangster M. Evidence on patient-doctor communication. Cancer Prev Control. 1999;3(1):25–30. [PubMed] [Google Scholar]
- 17.Di Blasi Z, Harkness E, Ernst E, Georgiou A, Kleijnen J. Influence of context effects on health outcomes: a systematic review. Lancet. 2001;357(9258):757–762. doi: 10.1016/S0140-6736(00)04169-6. [DOI] [PubMed] [Google Scholar]
- 18.Nagy V. Clinician–patient communication: its big impact on health. Perm J. 2001;5(4):45–47. [Google Scholar]
- 19.Murphy KM, Nash DB. Nonprimary care physicians’ views on office-based quality incentive and improvement programs. Am J Med Qual. 2008;23(6):427–439. doi: 10.1177/1062860608324557. [DOI] [PubMed] [Google Scholar]
- 20.Rodriguez HP, von Glahn T, Chang H, Rogers WH, Safran DG. Measuring patients’ experiences with individual specialist physicians and their practices. Am J Med Qual. 2009;24(1):35–44. doi: 10.1177/1062860608326418. [DOI] [PubMed] [Google Scholar]
- 21.Collier DA, Collier CE, Kelly TM. Benchmarking physician performance, part 1. J Med Pract Manage. 2006;21(4):185–189. [PubMed] [Google Scholar]
- 22.Darby C, Hays RD, Kletke P. Development and evaluation of the CAHPS hospital survey. Health Serv Res. 2005;40(6 Pt 2):1973–1976. doi: 10.1111/j.1475-6773.2005.00490.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Goldstein E, Farquhar M, Crofton C, Darby C, Garfinkel S. Measuring hospital care from the patients’ perspective: an overview of the CAHPS hospital survey development process. Health Serv Res. 2005;40(6 Pt 2):1977–1995. doi: 10.1111/j.1475-6773.2005.00477.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hays RD, Shaul JA, Williams VS, Lubalin JS, Harris-Kojetin LD, Sweeny SF, et al. Psychometric properties of the CAHPS 1.0 survey measures. Consumer assessment of health plans study. Med Care. 1999;37(3 Suppl):MS22–MS31. doi: 10.1097/00005650-199903001-00003. [DOI] [PubMed] [Google Scholar]
- 25.Keller S, O’Malley AJ, Hays RD, Matthew RA, Zaslavsky AM, Hepner KA, et al. Methods used to streamline the CAHPS hospital survey. Health Serv Res. 2005;40(6 Pt 2):2057–2077. doi: 10.1111/j.1475-6773.2005.00478.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Hays RD, Chong K, Brown J, Spritzer KL, Horne K. Patient reports and ratings of individual physicians: an evaluation of the doctor guide and consumer assessment of health plans study provider-level surveys. Am J Med Qual. 2003;18(5):190–196. doi: 10.1177/106286060301800503. [DOI] [PubMed] [Google Scholar]
- 27.Solomon LS, Hays RD, Zaslavsky AM, Ding L, Cleary PD. Psychometric properties of a group-level Consumer Assessment of Health Plans Study (CAHPS) instrument. Med Care. 2005;43(1):53–60. [PubMed] [Google Scholar]
- 28.Friedberg MW, Safran DG, Coltin K, Dresser M, Schneider EC. Paying for performance in primary care: potential impact on practices and disparities. Health Aff (Millwood) 2010;29(5):926–932. doi: 10.1377/hlthaff.2009.0985. [DOI] [PubMed] [Google Scholar]
- 29.Freed GL, Uren RL. Pay-for-performance: an overview for pediatrics. J Pediatr. 2006;149(1):120–124. doi: 10.1016/j.jpeds.2006.03.023. [DOI] [PubMed] [Google Scholar]
- 30.Kahn JM, Scales DC, Au DH, Carson SS, Curtis JR, Dudley RA, et al. An official American Thoracic Society Policy statement: pay-for-performance in pulmonary, critical care, and sleep medicine. Am J Respir Crit Care Med. 2010;181(7):752–761. doi: 10.1164/rccm.200903-0450ST. [DOI] [PubMed] [Google Scholar]
- 31.Podratz KC. Quality improvement in gynecologic surgery: the new frontier. Am J Obstet Gynecol. 2006;195(4):891–895. doi: 10.1016/j.ajog.2006.08.012. [DOI] [PubMed] [Google Scholar]
- 32.Audet AM, Davis K, Schoenbaum SC. Adoption of patient-centered care practices by physicians: results from a national survey. Arch Intern Med. 2006;166(7):754–759. doi: 10.1001/archinte.166.7.754. [DOI] [PubMed] [Google Scholar]
- 33.Greenberg JO, Dudley JC, Ferris TG. Engaging specialists in performance-incentive programs. N Engl J Med. 2010;362(17):1558–1560. doi: 10.1056/NEJMp1000650. [DOI] [PubMed] [Google Scholar]
- 34.Sledge WH, Feinstein AR. A clinimetric approach to the components of the patient-physician relationship. JAMA: J Am Med Assoc. 1997;278(23):2043–2048. doi: 10.1001/jama.1997.03550230019007. [DOI] [PubMed] [Google Scholar]
- 35.Safran DG, Karp M, Coltin K, Chang H, Li A, Ogren J, et al. Measuring patients’ experiences with individual primary care physicians. Results of a statewide demonstration project. J Gen Intern Med. 2006;21(1):13–21. doi: 10.1111/j.1525-1497.2005.00311.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.O’Malley AJ, Zaslavsky AM, Elliott MN, Zaborski L, Cleary PD. Case-mix adjustment of the CAHPS hospital survey. Health Serv Res. 2005;40(6 Pt 2):2162–2181. doi: 10.1111/j.1475-6773.2005.00470.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Martino SC, Elliott MN, Cleary PD, Kanouse DE, Brown JA, Spritzer KL, et al. Psychometric properties of an instrument to assess medicare beneficiaries’ prescription drug plan experiences. Health Care Financ Rev. 2009;30(3):41–53. [PMC free article] [PubMed] [Google Scholar]
- 38.White H. A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica. 1980;48(4):817–838. doi: 10.2307/1912934. [DOI] [Google Scholar]
- 39.Williams RL. A note on robust variance estimation for cluster-correlated data. Biometrics. 2000;56(2):645–646. doi: 10.1111/j.0006-341X.2000.00645.x. [DOI] [PubMed] [Google Scholar]
- 40.Cohen J. A power primer. Psychol Bull. 1992;112(1):155–159. doi: 10.1037/0033-2909.112.1.155. [DOI] [PubMed] [Google Scholar]
- 41.Elliott MN, Haviland AM, Kanouse DE, Hambarsoomian K, Hays RD. Adjusting for subgroup differences in extreme response tendency in ratings of health care: impact on disparity estimates. Health Serv Res. 2009;44(2 Pt 1):542–561. doi: 10.1111/j.1475-6773.2008.00922.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Chen L. Testing the mean of skewed distributions. J Am Stat Assoc. 1995;90(430):567–576. doi: 10.1080/01621459.1995.10476571. [DOI] [Google Scholar]
- 43.Elliott MN, Lehrman WG, Goldstein E, Hambarsoomian K, Beckett MK, Giordano LA. Do hospitals rank differently on HCAHPS for different patient subgroups? Med Care Res Rev. 2010;67(1):56–73. doi: 10.1177/1077558709339066. [DOI] [PubMed] [Google Scholar]
- 44.Adams J, Mehrotra A, Thomas JW, McGlynn EA. Physician cost profiling—reliability and risk of misclassification. N Engl J Med. 2010;362(11):1014–1021. doi: 10.1056/NEJMsa0906323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Elliott MN, Kanouse DE, Edwards CA, Hilborne LH. Components of care vary in importance for overall patient-reported experience by type of hospitalization. Med Care. 2009;47(8):842–849. doi: 10.1097/MLR.0b013e318197b22a. [DOI] [PubMed] [Google Scholar]
- 46.Kutney-Lee A, McHugh MD, Sloane DM, Cimiotti JP, Flynn L, Neff DF, et al. Nursing: a key to patient satisfaction. Health Aff (Millwood) 2009;28(4):w669–w677. doi: 10.1377/hlthaff.28.4.w669. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Leigh JP, Tancredi D, Jerant A, Kravitz RL. Annual work hours across physician specialties. Arch Intern Med. 2011;171(13):1211–1213. doi: 10.1001/archinternmed.2011.294. [DOI] [PubMed] [Google Scholar]
- 48.Hardee JT, Kasper IK. A clinical communication strategy to enhance effectiveness and CAHPS scores: the ALERT model. Perm J. 2008;12(3):70–74. doi: 10.7812/tpp/07-066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Ngo-Metzger Q, Telfair J, Sorkin D, Weidmer B, Weech-Maldonado R, Hurtado M, et al. Cultural competency and quality of care: obtaining the patient’s perspective. New York, NY: Commonwealth Fund 2006 Contract No.: 963.
- 50.Weech-Maldonado R, Elliott M, Pradhan R, Schiller C, Hall A, Hays RD. Can hospital cultural competency reduce disparities in patient experiences with care? Med Care. 2012;50(Suppl):S48–S55. doi: 10.1097/MLR.0b013e3182610ad1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Goldstein E, Elliott MN, Lehrman WG, Hambarsoomian K, Giordano LA. Racial/ethnic differences in patients’ perceptions of inpatient care using the HCAHPS survey. Med Care Res Rev. 2010;67(1):74–92. doi: 10.1177/1077558709341066. [DOI] [PubMed] [Google Scholar]
- 52.Roland M, Elliott M, Lyratzopoulos G, Barbiere J, Parker RA, Smith P, et al. Reliability of patient responses in pay for performance schemes: analysis of national general practitioner patient survey data in England. BMJ. 2009;339:b3851. doi: 10.1136/bmj.b3851. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Groves R, Peytcheva E. The impact of nonresponse rates on nonresponse bias: a meta-analysis. Public Opin Q. 2008;72(2):167–189. doi: 10.1093/poq/nfn011. [DOI] [Google Scholar]
- 54.Klein DJ, Elliott MN, Haviland AM, Saliba D, Burkhart Q, Edwards C, et al. Understanding nonresponse to the 2007 Medicare CAHPS survey. The Gerontologist. 2011;51(6):843–855. doi: 10.1093/geront/gnr046. [DOI] [PubMed] [Google Scholar]
- 55.Elliott MN, Zaslavsky AM, Goldstein E, Lehrman W, Hambarsoomians K, Beckett MK, et al. Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. Health Serv Res. 2009;44(2 Pt 1):501–518. doi: 10.1111/j.1475-6773.2008.00914.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Elliott MN, Edwards C, Angeles J, Hambarsoomians K, Hays RD. Patterns of unit and item nonresponse in the CAHPS hospital survey. Health Serv Res. 2005;40(6 Pt 2):2096–2119. doi: 10.1111/j.1475-6773.2005.00476.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Quigley DD, Martino SC, Brown JA, Hays RD. Evaluating the content of the communication items in the CAHPS(®) clinician and group survey and supplemental items with what high-performing physicians say they do. Patient. 2013;6(3):169–177. doi: 10.1007/s40271-013-0016-1. [DOI] [PubMed] [Google Scholar]
