A Multilevel Analysis of Patient Engagement and Patient-Reported Outcomes in Primary Care Practices of Accountable Care Organizations

Abstract

Background

The growing movement toward more accountable care delivery and the increasing number of people with chronic illnesses underscores the need for primary care practices to engage patients in their own care.

Objective

For adult primary care practices seeing patients with diabetes and/or cardiovascular disease, we examined the relationship between selected practice characteristics, patient engagement, and patient-reported outcomes of care.

Design

Cross-sectional multilevel observational study of 16 randomly selected practices in two large accountable care organizations (ACOs).

Participants

Patients with diabetes and/or cardiovascular disease (CVD) who met study eligibility criteria (n = 4368) and received care in 2014 were randomly selected to complete a patient activation and PRO survey (51% response rate; n = 2176). Primary care team members of the 16 practices completed surveys that assessed practice culture, relational coordination, and teamwork (86% response rate; n = 411).

Main Measures

Patient-reported outcomes included depression (PHQ-4), physical functioning (PROMIS SF12a), and social functioning (PROMIS SF8a), the Patient Assessment of Chronic Illness Care instrument (PACIC-11), and the Patient Activation Measure instrument (PAM-13). Patient-level covariates included patient age, gender, education, insurance coverage, limited English language proficiency, blood pressure, HbA1c, LDL-cholesterol, and disease comorbidity burden. For each of the 16 practices, patient-centered culture and the degree of relational coordination among team members were measured using a clinician and staff survey. The implementation of shared decision-making activities in each practice was assessed using an operational leader survey.

Key Results

Having a patient-centered culture was positively associated with fewer depression symptoms (odds ratio [OR] = 1.51; confidence interval [CI] 1.04, 2.19) and better physical function scores (OR = 1.85; CI 1.25, 2.73). Patient activation was positively associated with fewer depression symptoms (OR = 2.26; CI 1.79, 2.86), better physical health (OR = 2.56; CI 2.00, 3.27), and better social health functioning (OR = 4.12; CI 3.21, 5.29). Patient activation (PAM-13) mediated the positive association between patients’ experience of chronic illness care and each of the three patient-reported outcome measures—fewer depression symptoms, better physical health, and better social health. Relational coordination and shared decision-making activities reported by practices were not significantly associated with higher patient-reported outcome scores.

Conclusions

Diabetic and CVD patients who received care from ACO-affiliated practices with more developed patient-centered cultures reported lower PHQ-4 depression symptom scores and better physical functioning. Diabetic and CVD patients who were more highly activated to participate in their care reported lower PHQ-4 scores and better physical and social outcomes of care.

Electronic supplementary material

The online version of this article (doi:10.1007/s11606-016-3980-z) contains supplementary material, which is available to authorized users.

INTRODUCTION

Forty-six million Americans have diagnosed cardiovascular disease (CVD), diabetes, or both, representing a combined annual healthcare cost of $354 billion.^{1 – 3} It is increasingly recognized that greater efforts to engage patients in their care are needed to improve outcomes for these populations.^{4 – 9} While there is a growing body of literature on patient engagement and patient-reported outcomes of care,^{10 – 13} little is known about what practices can do to encourage greater patient engagement and how such engagement might be associated with better patient-reported outcomes of care.^{14 – 16}

To address this gap in knowledge, we studied 16 primary care practices belonging to two large ACOs that implemented a variety of patient engagement initiatives for patients with cardiovascular disease (CVD), diabetes, or both. We hypothesized that patients receiving care from practices that made greater efforts to engage them, that were more patient-centered, that better coordinated their work with one another, and for which patients reported better experiences in receiving care would be associated with higher patient-reported outcomes of care. We also hypothesized that the relationship between patient experience of care and patient-reported outcomes would be mediated by the degree of patient activation.

METHODS

Study Design and Data Sources

We had the opportunity to study naturally occurring differences in the rate of implementation of patient engagement initiatives in two large ACOs—Advocate Health Care (AHC) in Chicago, IL, and DaVita HealthCare Partners (DHCP) in Los Angeles, CA. Key background characteristics of the two ACOs are shown in Table 1. Each is a large and long-established healthcare organization participating in the Medicare Shared Savings Program and in other risk-bearing contracts that create incentives to increase patient involvement in their care in order to achieve better outcomes and to reduce the costs associated with emergency department visits and preventable hospital admissions and re-admissions.

Table 1.

Summary of Key Characteristics of the Two Participating ACOs

	Advocate Health Care ACO	DaVita HealthCare Partners ACO
ACO established
Medicare Shared Savings Program (MSSP)	2012	2014
Commercial	2011	2013
Location
MSSP	Illinois	California, Florida, and Nevada
Commercial	Illinois	Greater Los Angeles (CA) and Nevada
Contracted enrollees
MSSP	106,000	56,689
Commercial	370,000	65,739
Patient race/ethnicity
African American	22%	12%
American Indian/Alaska Native	1%	0%
Asian/Pacific Islander	3%	∼8%
Eastern Indian	1%	1%
Latino	8%	∼30%
Middle Eastern	1%	1%
Non-Latino white	57%	∼48%
Other/multiracial	5%	0%
Unknown/declined	2%	0%
Payer mix
Commercial	70%	68%
Employee	5%	0%
Medicaid	0%	13%
Medicare Advantage	5%	0%
Medicare ACO	20%	19%
ACO risk arrangement	Shared savings (no risk)	Shared savings (no risk)

Based on the existing literature, we developed a baseline survey of 39 patient activation and engagement activities (available online, Appendix 1). The survey was completed by a clinical or operational leader from each of the 44 AHC and 27 DHCP practices. Practices were scored based on their responses to the 39-item instrument indicating the extent of implementation of each activity within their practice. From each ACO, we randomly sampled four practices from the top quartile and four from the bottom quartile of the score distribution in order to maximize the baseline variance in patient activation and engagement activities of the study sites. This yielded a total of 16 practices for analysis—eight scoring in the highest quartile and eight in the lowest quartile of implementation of patient engagement activities (see Table 2 for descriptive characteristics of the 16 practice sites). The eight from the highest quartile scored an average of 79.1 (range 71.8–100) of the 100 possible points for each of the questions on the baseline survey, and those in the lowest quartile scored an average of 30.6 (range 5.1–42.0) out of the 100 possible points for each question.

Table 2.

Descriptive Characteristics of the 16 Practice Sites

	Advocate Health Care ACO practices		DaVita HealthCare Partners ACO practices
	Mean	Range	Mean	Range
Practice staff full-time equivalents (mean, range)
Primary care physicians	9.1	4–17	4.5	1–12
Specialist physicians	2.1	0–6	6.7	0–20
Nurse practitioners	0		2	0–3
Physician assistants	0		1	0–1
Other health professionals	31.8	9–68	43.6	4–114
Panel size per practice site	9733.8	2031–19,247	6859.6	992–13,764
Total patient visits in 2014	39,900.3	4969–114,068	43,274.3	2367–109,067
Compensation arrangements	Base salary + P4P		Base salary + P4P
Revenue sources
% Commercial insurance	68.6	52–84	49.4	45–50
% Medicare	18.6	11–28	39.4	35–40
% Medicaid	8.6	0–17	6.3	5–15
% Uninsured/other	3.2	0–15	5	5–5
Years practice has been in existence	21.5	3–40	13.6	5–23

P4P pay for performance

We based sample size power calculations on the detection of clinically meaningful changes in PROMIS physical function scores¹⁷ and on blood pressure, assuming a 50% rate of response to the patient survey. This resulted in sampling 273 adult patients with CVD and/or diabetes who had at least one visit in 2014 from each practice using the inclusion criteria shown in Table 3. From the electronic health record we collected data on blood pressure, glycated hemoglobin (HbA1c) levels, low-density lipoprotein (LDL) cholesterol levels, comorbid conditions, sociodemographic characteristics, and insurance status on each patient. We collected data on patient-reported outcomes of care (PROs), patient assessment of the chronic illness care that they received (PACIC), and patient-reported activation and engagement (PAM) from a mailed survey administered in both English and Spanish, as needed, with telephone follow-up, obtaining a 51% completion rate (n = 2176). We also collected survey data from adult primary care team members at each of the 16 practices regarding the extent to which the practice exhibited a patient-centered culture and the degree of relational coordination existing among the people occupying different roles on the team, including primary care physicians, nurses, medical assistants, diabetic nurse educators, nutritionists, and receptionists.^{18 , 19} We obtained an overall 86% response rate from the team members (n = 411). The study was approved by the institutional review board (IRB) of the University of California, Berkeley, prior to data collection.

Table 3.

Inclusion Criteria for Patient Survey Sampling Frame

Age 18–82 years as of 12/31/14

Patient language preference of English, Spanish, or not known

Patient receiving care at one of eight primary care practice sites selected for participation at each ACO (at least one visit to the practice in 2014)

Patient has at least one of the following ICD-9-CM diagnosis codes in the electronic health record or has filled a prescription within the past year for a medication used to treat diabetes or cardiovascular disease (ref: NCQA)

Diabetes, 250.xx

Ischemic heart disease, 410–414

Other forms of heart disease, 426–429

Cerebrovascular disease, 430–438

ICD-9-CM International Classification of Diseases, Ninth Revision, Clinical Modification; NCQA National Committee for Quality Assurance

Patient-Reported Outcomes

PROs included the validated 12-item Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function form (Short Form 12a), the validated eight-item PROMIS Social Function form (Short Form 8a), and the validated four-item Patient Health Questionnaire for Depression and Anxiety (PHQ-4) emotional health screening tools^{17 , 20 , 21} (available online, Appendix 2). The Cronbach alpha internal consistency reliability coefficients were 0.92, 0.95, and 0.87, respectively.²²

Practice-Level Independent Variables

Practice-reported patient engagement in decision-making activities was measured by a seven-item subscale (α = 0.89) based on factor analysis of the 39-item baseline survey. The items included in the subscale were as follows: “clinicians encourage patients to discuss their work, home life, and social situation”; “staff note patient preferences for treatment in the patient’s record”; “clinicians consistently involve patients in developing treatment goals”; “physicians have follow-up discussions with patients regarding their treatment options and preferences”; “ clinicians discuss the importance of patient advance directives”; “clinicians discuss the hospice care options with patients”; and “clinicians discuss the availability of hospital-based and community-based palliative care”. The response categories included the following: “Yes, fully implemented”; “Yes, partially implemented”; “Yes, but not regularly”; and “No”. This measure was calculated as a continuous score from 0 to 7. We hypothesized that the efforts of practices to better engage patients would be positively associated with better patient-reported outcomes of care through the increased motivation and participation of patients in achieving treatment goals.^{6 , 16}

Patient centeredness was measured by a five-item scale (α = 0.92) used in previous research,²³ composed of each team member’s degree of agreement with the following statements: 1) the practice does a good job of assessing current patient needs and expectations; 2) staff promptly resolve patient complaints; 3) patients’ complaints are studied to identify patterns and to prevent the same problems from recurring; 4) the organization uses data from patients to improve services; and 5) the organization uses data on customer expectations and/or satisfaction/experiences when designing new services (available online, Appendix 4). We hypothesized that these types of patient-responsive practice behaviors would be associated with better patient-reported outcomes of care given that existing research has found them to be positively associated with greater use of evidence-based care management processes.²³

The seven-item between-role relational coordination measure α = 0.87 used in previous research^{18 , 19 , 24 , 25} asked each team member to assess the frequency, timeliness, accuracy, and problem-solving focus of communication with each other team member with whom they interacted, in addition to the degree of shared goals, shared knowledge, and mutual respect among team members (available online, Appendix 3). For example, each team member was asked, “How frequently do people in each of these groups communicate with you about patients with diabetes and/or cardiovascular disease?” With regard to shared knowledge, each team member was asked, “Do people in each of these groups know about the work you do with patients with diabetes and/or cardiovascular disease?” For purposes of these analyses, we restricted the role relationships to those involving the patient’s primary care physician, the nurse, and the medical assistant, as they most frequently interacted with each other and with the patient. Based on existing research, we hypothesized that greater within-group relational coordination would be positively associated with better patient-reported outcomes.^{17 , 18}

Patient-Reported Independent Variables

Patients’ perceptions of their chronic illness care were assessed by the 11-item Patient Assessment of Chronic Illness Care (PACIC) scale used in previous research^{26 – 28} (α = 0.93). Sample items included the following: “Over the past six months, when I received care for my chronic condition, how often was I: given choices about treatments to think about; helped to set specific goals to improve my eating or exercise; and helped to plan ahead so I could take care of my condition even in hard times”. Response categories included “never”, “sometimes”, “usually”, and “always”. We hypothesized that patients who reported that they were more satisfied with their chronic illness care would report better patient-reported outcomes.²⁷

We measured patient activation using the 13-item Patient Activation Measure (PAM) developed by Hibbard et al.²⁹ (α = 0.90). Sample questions completed by all surveyed patients included “When all is said and done, I am the person who is responsible for managing my health condition;” “I am confident that I can take actions that will help prevent or minimize some symptoms or problems associated with my health condition” and “I am confident that I can follow through on medical treatments I need to do at home”. Response categories were “strongly disagree”, “disagree”, “agree”, and “strongly agree”. The PAM has been associated with positive health behaviors such as aerobic exercise and receiving preventive cancer screenings as well as more favorable emotional health and lower costs of care.^{6 , 16 , 30} In addition to a continuous measure, the response scores were summarized into four quartiles representing different categories of activation levels. An individual in the lowest level is a passive participant in healthcare decisions. An individual in the second level of activation has the knowledge and confidence to take a more active role in their healthcare, but has not yet done so. In the third level of activation, the patient plays an active role in making healthcare decisions with their providers. In the highest level of activation, the patient has the knowledge and confidence to take action concerning their own healthcare, even during times of stress.³⁰ Extending previous research noted above, we hypothesized that PAM would be positively associated with PROs of physical function, social function, and depression symptoms, and would largely mediate the positive association of better patient experiences of chronic care and better patient-reported outcomes of care.

Control Variables

From the electronic health record, we collected data on the presence or absence of up to 13 co-morbid medical conditions, including other forms of heart failure, atherosclerosis, aortic aneurysm, aortocoronary bypass, hypertension, asthma, emphysema, chronic obstructive pulmonary disease (COPD), mood disorders, other nonorganic psychoses, anxiety, adjustment reaction, and depression.

We controlled for the patient’s latest reported blood pressure <140/90 mmHg; LDL-C ≤ 100 mg/dl, and HbA1c ≤8.0%. We also adjusted for patient age, sex, education, insurance status, and limited English language proficiency.

Statistical Methods

To account for the clustering of patients within the 16 practices, we used hierarchical linear models (HLM), with patients as the first-level analysis and practices as the second level³¹ to estimate the association between predictors and each PRO. Given the relative skewness of the PROs toward more positive outcomes, and for ease of interpretation, we report logistic regression results dichotomizing patients’ scores above or below the median on each of the PHQ-4 depression symptom, physical, and social outcome measures. For these analyses, the results are reported as odds ratios (ORs). We also estimated multilevel linear regression models using continuous PRO measures, and obtained nearly identical results (data not shown). We tested for the mediating effect of PAM on each of the patient-reported PHQ-4 depression, physical, and social outcomes by running multilevel mediation tests³² to estimate the direct and indirect effect of PAM on PROs.

We conducted a number of sensitivity analyses involving different measures of disease burden, including 2+ comorbid conditions, 3+ comorbid conditions, and whether the patient had one or more mental health conditions or at least one physical plus at least one mental health condition.^{33 – 36} We also examined the effect of including a broader number of patient care team roles in the measure of relational coordination, including diabetes nurse educators, social workers, and receptionists. We tested for a number of potential moderating interaction effects involving disease burden and the PAM to see whether the effects might be greatest for the sickest patients. We also tested for an interaction effect of patient-reported shared decision-making and PAM to see whether shared decision-making mattered most for patients who were very highly activated or were very disengaged. The intraclass correlation coefficient in all models supported model assumptions (p < 0.001). We analyzed the data using Stata language 14.0 (StataCorp LP, College Station, TX) and considered the regression coefficients significant at a level of ≤ 0.05.

RESULTS

Table 4 shows the descriptive statistics for key study variables. Tables 5 and 6 show the logistic regression results with and without the PAM included, respectively. The intraclass correlation coefficient (p < 0.001) supported model assumptions. As indicated in Table 5, patients receiving care from teams with more developed patient-centered cultures were significantly more likely to score above the median on the PHQ-4 on having fewer depression symptoms (OR 1.56; 1.08–2.25 CI) and above the median on better physical health scores (OR 1.85; 1.27–2.72 CI). Also, patients reporting better assessment of their chronic illness care were significantly more likely to score above the median on the PHQ-4 reporting fewer depression symptoms (OR 1.24; 1.11–1.38 CI), and to have above-median physical health scores (OR 1.26; 1.12–1.41 CI) and above-median social health scores (OR 1.26; 1.13–1.40 CI). Relational coordination was not significantly associated with patient-reported outcomes, while practice site reporting efforts to engage patients was slightly negatively associated with the PHQ-4 depression symptoms (OR 0.96; 0.92–0.99 CI), and physical (OR 0.95; 0.91–0.99 CI) and social (OR 0.96; 0.92–0.99 CI) patient-reported outcomes.

Table 4.

Descriptive Statistics for Key Study Variables

	N = 2176
PHQ-4 (Depression), median (range)	3.8 (1–4)
Physical functioning, median (range)	4.2 (1-5)
Social functioning, median (range)	3.8 (1-5)
Relational coordination, median (range)	4.1 (3.5, 4.4)
Patient centeredness, median (range)	4.2 (3.5, 4.5)
Practice-reported shared decision-making, median (range)	3.0 (0, 7)
Patient Assessment of Chronic Illness Care (PACIC), median (range) (N = 2138)	2.7 (1, 4)
Age, years, no. (%)
18–24	12 (0.6%)
25–44	153 (7.0%)
45–64	839 (39%)
65+	1172 (54%)
Sex, no. (%)
Male	985 (45%)
Female	1191 (55%)
Education, no. (%) (N = 2134)
Grade 8 or less	254 (12%)
GED or some high school	613 (29%)
Four-year college degree or some college	989 (46%)
More than 4-year college degree	278 (13%)
Insurance, no. (%) (N = 1992)
Commercial	778 (39%)
Medicare	1171 (59%)
Medicaid	43 (2.2%)
Disease burden – no. of co-morbid conditions, median (range)	1.6 (0, 8)
English proficiency, no. (%) (N = 2151)
Good	1777 (83%)
Poor	374 (17%)

Table 5.

Multilevel Linear Regression Model Results of Patient-Reported Outcomes for PHQ-4 Depression Symptoms, and Physical and Social Domains, Excluding PAM

	PHQ-4 (Depression) median+ (n = 2075)		Physical: median+ (n = 2081)		Social: median+ (n = 2073)
	OR (95% CI)	p value	OR (95% CI)	p value	OR (95% CI)	p value
Relational coordination	0.92 (0.56, 1.52)	0.7	1.10 (0.65, 1.86)	0.7	1.00 (0.60, 1.66)	1
Patient centeredness	1.56 (1.08, 2.25)	0.019	1.85 (1.27, 2.72)	0.002	1.18 (0.82, 1.71)	0.4
Practice-reported shared decision-making	0.96 (0.92, 0.99)	0.038	0.95 (0.91, 0.99)	0.010	0.96 (0.92, 0.99)	0.029
Patient Assessment of Chronic Illness Care	1.24 (1.11, 1.38)	0.0001	1.26 (1.12, 1.41)	<0.0001	1.26 (1.13, 1.40)	<0.0001
Age, years (vs. 18–24)
25–44	2.34 (0.57, 9.58)	0.2	0.93 (0.18, 4.74)	0.9	0.96 (0.23, 3.98)	1
45–64	3.18 (0.80, 12.62)	0.10	0.46 (0.09, 2.27)	0.3	0.52 (0.13, 2.08)	0.4
65+	4.65 (1.17, 18.53)	0.029	0.33 (0.07, 1.62)	0.2	0.55 (0.14, 2.21)	0.4
Female sex (vs. male)	0.72 (0.60, 0.86)	0.0004	0.70 (0.58, 0.84)	0.0002	0.85 (0.71, 1.02)	0.082
Education (vs. less than high school)
GED or some high school	1.19 (0.79, 1.78)	0.4	1.21 (0.80, 1.83)	0.4	0.70 (0.47, 1.05)	0.085
Four-year college degree or some college	1.71 (1.11, 2.62)	0.014	1.65 (1.06, 2.57)	0.026	0.89 (0.58, 1.37)	0.6
More than 4-year college degree	2.01 (1.24, 3.25)	0.005	3.42 (2.07, 5.64)	<0.0001	1.20 (0.74, 1.94)	0.5
Disease burden	0.69 (0.64, 0.75)	<0.0001	0.59 (0.54, 0.65)	<0.0001	0.66 (0.61, 0.72)	<0.0001
Poor English proficiency (vs. good)	0.78 (0.55, 1.12)	0.2	1.03 (0.71, 1.48)	0.9	1.08 (0.76, 1.55)	0.7
Akaike information criterion	2745.64	N/A	2584.53	N/A	2728.05
Bayesian information criterion	2830.20	N/A	2669.14	N/A	2812.60
Intraclass correlation coefficient (SE)	0.000 (0.000)	N/A	0.000 (0.000)	N/A	0.000 (0.000)

Table 6.

Hierarchical Linear Models of Patient-Reported Outcomes for PHQ-4 Depression Symptoms, and Physical and Social Domains, Including PAM

	PHQ-4 (Depression) median+ (n = 2065)		Physical: median+ (n = 2072)		Social: median+ (n = 2071)
	OR (95% CI)	p value	OR (95% CI)	p value	OR (95% CI)	p value
Relational coordination	0.91 (0.54, 1.51)	0.7	1.07 (0.63, 1.82)	0.8	0.96 (0.57, 1.63)	0.9
Patient centeredness	1.51 (1.04, 2.19)	0.032	1.85 (1.25, 2.73)	0.002	1.15 (0.79, 1.69)	0.5
Practice-reported shared decision-making	0.96 (0.93, 1.00)	0.080	0.95 (0.91, 0.99)	0.025	0.96 (0.92, 1.00)	0.070
Patient Assessment of Chronic Illness Care	1.02 (0.90, 1.15)	0.8	1.00 (0.87, 1.13)	0.9	0.90 (0.79, 1.02)	0.094
Patient Activation Measure (PAM)	2.26 (1.79, 2.86)	<0.0001	2.56 (2.00, 3.27)	<0.0001	4.12 (3.21, 5.29)	<0.0001
Age, years (vs. 18–24)
25–44	2.67 (0.64, 11.15)	0.2	1.05 (0.20, 5.54)	1	1.17 (0.27, 5.08)	0.8
45–64	3.54 (0.88, 14.34)	0.076	0.49 (0.10, 2.49)	0.4	0.58 (0.14, 2.43)	0.5
65+	5.26 (1.30, 21.32)	0.020	0.35 (0.07, 1.75)	0.2	0.61 (0.15, 2.55)	0.5
Female sex (vs. male)	0.69 (0.57, 0.82)	<0.0001	0.66 (0.54, 0.80)	<0.0001	0.79 (0.65, 0.95)	0.014
Education (vs. less than high school)
GED or some high school	1.13 (0.75, 1.71)	0.6	1.15 (0.75, 1.76)	0.5	0.63 (0.41, 0.95)	0.028
Four-year college degree or some college	1.61 (1.04, 2.48)	0.033	1.54 (0.98, 2.42)	0.062	0.77 (0.49, 1.20)	0.2
More than 4-year college degree	1.79 (1.09, 2.91)	0.020	3.02 (1.81, 5.03)	<0.0001	0.96 (0.59, 1.59)	0.9
Disease burden	0.70 (0.64, 0.76)	<0.0001	0.59 (0.54, 0.65)	<0.0001	0.66 (0.61, 0.72)	<0.0001
Poor English proficiency (vs. good)	0.77 (0.54, 1.11)	0.2	1.03 (0.71, 1.50)	0.9	1.08 (0.74, 1.56)	0.7
Akaike information criterion	2687.64		2516.43		2591.38
Bayesian information criterion	2777.77		2606.61		2681.55
Intraclass correlation coefficient (SE)	0.000 (0.000)		0.000 (0.000)		0.000 (0.000)

As shown in Table 6, the association of patients’ perception of their chronic illness care was mediated by patient activation, with more highly activated patients more than twice as likely to score above the median on having fewer PHQ-4 depression symptoms (OR 2.26; 1.79–2.86 CI) and having above-median better physical health scores (OR 2.56; 2.00–3.27 CI), and more than four times as likely to be above the median (OR 4.12; 3.21–5.29 CI) on the measure of social health. The formal mediation tests indicated that all association of patients’ perception of their chronic illness care was mediated by the PAM (all p < 0.0001).³² Patients receiving care from more patient-centered teams continued to be significantly more likely to be above the median in being less depressed (OR 1.51; 1.04–2.19 CI) and have above-median better physical health scores (OR 1.85; 1.24–2.73 CI).

When adjusting for diagnosed mental health conditions instead of overall disease burden, we found nearly identical results to those reported above, with the association between patients’ perception of their chronic illness care and patient-reported outcomes being entirely mediated by the PAM (data not shown).

Among the control variables, women reported lower outcome scores than men; those with a post-baccalaureate degree reported higher outcome scores than those with less education, and those with greater disease burden experienced lower outcome scores. Limited English language proficiency had no significant relationship with any of the outcome scores. Diabetic and CVD patients aged 65 and older reported significantly lower depression scores, consistent with national data indicating that those over age 65 report being in better mental health than other age groups.³⁷

Additional sensitivity analyses (not shown) did not change the main results reported in Tables 5 and 6. None of the interaction effects were statistically significant. In other analyses (not shown), we also controlled for blood pressure, HbA1c, and LDL levels, and found no associations between these intermediate outcomes and any of the PROs.

DISCUSSION

As hypothesized, patients receiving care from practices with a more patient-centered culture as reported by primary care team members were less likely to report depression symptoms and more likely to report better physical health outcomes. It is important to note that the patient-centered culture measure is based on primary care team members who have direct daily contact with patients. This is in contrast to the high-level aggregated 39-item measure reported by the practice administrator, which was found to be slightly negatively associated with patient-reported outcomes. The implication of this seeming contradiction for clinical leaders is to focus improvement efforts on a culture that actively uses patient data and feedback to meet patient needs and expectations. The cultural dimension may be more important than simply increasing the number of activities the practice uses in patient engagement efforts. This finding holds true even when patient activation levels are taken into account.

Also, as hypothesized, patients’ experiences of chronic illness care were positively associated with fewer depression symptoms and better physical and social functioning. As predicted, and consistent with a recent Australian study,³⁸ these associations were mediated by more highly activated and engaged patients. The relationships among patient chronic illness care experiences, the PAM, and patient-reported outcomes of care suggest that actions or interventions to better engage patients may have a dual benefit. More engaged patients rate the care they receive more highly and they report better outcomes of care. This may be because more highly activated, engaged patients ask more questions to have their concerns addressed and, as a result, are more satisfied with their care experience and more motived to achieve desired outcomes.

Contrary to the hypothesized relationship, greater coordination among team members was not associated with better patient-reported outcomes. Including patient reports of relational coordination among team members in future research may yield different results.^{39 – 41}

Limitations

These findings should be considered within the context of certain limitations. There were relatively small but, due to the large sample size, statistically significant differences between respondents and non-respondents to the patient survey for a few sociodemographic characteristics. The response percentage was higher among female than male patients (54.7% vs. 49.0%, p < 0.0001) and among those 65 years of age or older than under age 65 (53.8% vs. 46.2%, p < 0.0001), and those with only diabetes or only CVD had somewhat lower response rates (49.12% and 47.69%, respectively) than those with both diabetes and CVD (56.53%; p = 0.0002).

Since the findings are based on cross-sectional data, we cannot conclude that having a more patient-centered practice culture will result in better patient-reported outcomes of care, or that having more highly activated patients will automatically result in better patient-reported outcomes of care. Longitudinal studies are needed to build on these analyses. Where feasible, randomized controlled trials of specific practice culture interventions and/or specific patient activation interventions can extend the current analysis.

Finally, our findings cannot be generalized to the larger population of patients receiving care from ACO primary care practices across the country, particularly those serving a higher percentage of safety-net and Medicaid patients, given that the results are based on just two non-randomly selected ACOs who were specifically interested in the research collaboration.

CONCLUSION

Overall, the findings suggest the importance of having a patient-centered culture that enables primary care team members to actively engage their patients in care that is associated with achieving outcomes important to patients.⁴² The importance and use of patient-reported outcome measures is likely to grow with their inclusion as quality measures in the Medicare Access and CHIP Reauthorization Act of 2015 (MACRA) legislation that, by 2019, will reward physicians who choose to practice in ACO-like arrangements with a 5% bonus, or they can remain on a fee schedule with a smaller percentage increase in compensation for achieving predetermined cost and quality metrics.⁴³ Private sector value-based payment arrangements incorporating patient-reported outcome measures are also emerging.⁴⁴

There are a number of challenges to incorporating the use of patient-reported outcome measures into everyday practice, including how best to integrate them into the electronic health record and the overall flow of clinical work, how to most efficiently collect the information from patients, and how to decide when the information obtained is likely to alter treatment or provide useful insights for focusing on patients that may require greater attention.^{45 – 48} Nevertheless, a number of organizations are successfully addressing these challenges.⁴⁹ Aggregated across patients over time, patient-reported outcomes can also provide an important baseline for conducting population-based research, working toward achieving improvements in overall population health.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Compliance with Ethical Standards

Funding

Research reported in this publication was funded through a Patient-Centered Outcomes Research Institute (PCORI) Award (IHS-1310-06821) and from grant no. RFA-HS-14-011 from the Agency for Healthcare Research and Quality (AHRQ), Centers of Excellence Award.

Conflict of Interest

The authors declare that they do not have a conflict of interest.

Disclaimer

The statements presented in this publication are solely the responsibility of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute (PCORI), its Board of Governors, or Methodology Committee.