Skip to main content
VA Author Manuscripts logoLink to VA Author Manuscripts
. Author manuscript; available in PMC: 2024 Sep 1.
Published in final edited form as: Int J Nurs Stud. 2023 May 22;145:104532. doi: 10.1016/j.ijnurstu.2023.104532

“Low-value” glycemic outcomes among older adults with diabetes cared for by primary care nurse practitioners or physicians: a retrospective cohort study

Linnaea Schuttner 1,2,*, Claire Richardson 1,2, Toral Parikh 1,3, Edwin S Wong 1,4
PMCID: PMC10760981  NIHMSID: NIHMS1949092  PMID: 37315453

Abstract

Background:

“Low-value” healthcare is care without benefit to patients. Overly intensive glycemic control (i.e., HgbA1C < 7%) can cause harm to patients at high risk of hypoglycemia, particularly among older adults with co-morbidities. It is unknown whether overly intensive glycemic control differs among patients with diabetes and at high-risk of hypoglycemia cared for by primary care nurse practitioners versus physicians.

Objective:

This study examined patients with diabetes at high risk of hypoglycemia receiving primary care between Jan 2010-Jan 2012, comparing patients reassigned to nurse practitioners to those reassigned to physicians after their previous physician separated from practice in an integrated United States health system.

Design:

This was a retrospective cohort study. Study outcomes were collected at two years after reassignment to a new primary care provider. Outcomes were predicted probabilities of HgbA1C < 7% using two-stage residual inclusion instrumental variable models, controlling for baseline confounders.

Setting:

Primary care clinics within the United States Veterans Health Administration.

Participants:

38,543 patients with diabetes at increased risk for hypoglycemia (age ≥ 65 years with renal disease, dementia, or cognitive impairment), who had their primary care physician leave the Veterans Health Administration and who were reassigned to a new primary care provider in the following year.

Results:

Cohort patients were on average 76y and 99% men. Of these, 33,700 were reassigned to physicians and 4,843 to nurse practitioners. After two years with their new provider, in adjusted models, patients reassigned to nurse practitioners had a −20.4 percentage-point [95% CI −37.9 to −2.8] lower probability of two-year HgbA1C < 7%.

Conclusions:

Aligned with prior studies on care quality, rates of overly intensive glycemic control may be appropriately lower among older patients with diabetes at high-risk of hypoglycemia, cared for by nurse practitioners than physicians.

Keywords: Diabetes mellitus, low-value care, nurse practitioners, primary health care, health workforce

Tweetable abstract:

Primary care nurse practitioners deliver equivalent or better rates of low-value diabetes care for older patients, compared to physicians.

Background

“Low-value” care is considered poor quality healthcare, and occurs when treatment offers no clinical benefit or has potential harms that outweigh the benefits.1 Among patients with diabetes, overly intensive glycemic management can increase the frequency of adverse health outcomes and becomes low value among patients at highest risk for hypoglycemia. Intensive glycemic management (i.e., glycated hemoglobin test or HgbA1C < 7%) in older adults has no macrovascular and limited microvascular benefits, but triples the risk of severe hypoglycemia.2,3 Increasing clinical evidence about the harms from glycemic overtreatment, including increased mortality, was shown across several large trials in 2008.35 Recommendations to ease glycemic control (e.g., an HgbA1C < 8%) to avoid hypoglycemia in higher-risk adults (e.g., older adults or those with greater co-morbidity burdens) subsequently followed in national clinical practice guidelines from the Veterans Health Administration/Department of Defense (2010)6 and American Diabetes Association (2012),7 and amplified in international campaigns (for example, Choosing Wisely in the United States (US)).8,9

Primary care providers are the frontline of care for patients with diabetes. Nurse practitioners, one group of advanced practice registered nurses, represent a growing proportion of primary care providers worldwide, and made up one-fifth of primary care providers in the US in 2010.10 It has been well documented that nurse practitioners and physicians provide comparable clinical care quality for chronic diseases,11,12 and nurse practitioner-provided care has equivalent or superior outcomes for mortality, patient satisfaction, and patient communication.13,14 However, in describing ambulatory low-value care, a few studies have found no differences between outpatient nurse practitioners and physicians in rates of low-value imaging for uncomplicated back pain or headache, or in antibiotic prescriptions for viral respiratory infection - or related referrals for these conditions.15,16 No studies have yet compared low-value care for diabetes between these clinician groups. Identifying practice differences in delivery of low-value diabetic care has widespread relevance to health systems seeking to determine equivalence between nurse practitioners and physicians for delivery of high-quality care, identifying opportunities for tailored provider interventions to reduce low-value practices, and to patients choosing primary care providers. Care comparability, including low-value practices, is increasingly important as nurse practitioners are a growing solution to primary care workforce shortages and to expanding demand for primary care as populations with chronic disease age globally.10,17,18

The Veterans Health Administration is one of the largest employers of nurse practitioners in the US, and is an integrated health system utilizing a patient-centered medical home model of care delivery across over 900 outpatient clinics nationally.19 Patients are empaneled to primary care providers providing ongoing primary care and care coordination. In this team-based model, nurse practitioners or physicians (and less frequently, Physician’s Assistants) serve as primary care providers. Nurse practitioners in the Veterans Health Administration have full practice authority as primary care providers, and do not require the supervision of a physician except within state licensure restrictions on controlled substances.2022 primary care providers are supported by a registered nurse care manager, clinical associate, and an administrative assistant. With primary care provider role equivalence between physicians and nurse practitioners, this system provides an opportunity to examine practice differences with less bias from nurse practitioner roles without independent practice privileges, such as Medicare or fee-for-service practice environments that require physician supervision.23 With an objective to understand differences in low-value glycemic control for diabetes, this study leveraged a natural quasi-experimental condition of primary care patients who experienced reassignment to either a physician or a nurse practitioner after their original primary care provider left the Veterans Health Administration. To improve causal inference using observational data, an instrumental variable approach was used based on existing variation in facility staffing levels of nurse practitioners to reduce endogenous confounding from differences in patient- and facility-level characteristics. Clarifying these provider practice differences in low-value diabetes care provides evidence for policy makers and health systems interested in establishing if nurse practitioners provide comparable care to physicians – knowledge with international utility as workforce shortages compound and for justifying scope-of-practice policy expansions of independent practice authority.

Methods

1. Study overview

This research examines the difference in glycemic overtreatment of patients with diabetes at risk of hypoglycemia, comparing patients assigned to primary care physicians or nurse practitioners in an integrated health system in the US. This study conceptually built from published validated recommendations on ambulatory practices to de-intensify (i.e., reduce). We selected a definition of diabetes overtreatment for patients at risk of hypoglycemia as HgbA1C < 7% as established by these validated recommendations and as a conservative threshold for overtreatment; other clinical practice guidelines further liberalize HgbA1C targets goals for high-risk populations.2426 These recommendations define patients at highest risk of hypoglycemia as adults ≥ 65 years with a diagnosis of chronic kidney disease stage 3 or higher, cognitive impairment, or dementia.24 Empirical analyses were conducted using detailed Veterans Health Administration administrative data capturing information on national clinical encounters. To estimate differences in glycemic overtreatment, the study compared patients who were reassigned to primary care physicians and nurse practitioners, respectively, after being managed by a primary care physician who left the practice. To address potential selectivity in the reassignment of patients to physicians compared to nurse practitioners, an instrumental variable approach was applied, which seeks to isolate the component of provider reassignment attributable to pseudo-random variation in facility staffing.

2. Data sources and patient sample

The primary data source was the national Veterans Health Administration Corporate Data Warehouse.27 Within this, patients were identified using the Primary Care Management Module, a comprehensive longitudinal record tracking the assignment of patients to providers in primary care. The sample for this study was derived from a previously defined cohort of Veterans Health Administration-enrolled patients whose primary care was reassigned to the management of either a new primary care provider as a nurse practitioner or a physician (due to low proportions, Physician’s Assistants were not included as primary care providers the original dataset). The original study cohort has been previously described.28 In brief, the initial cohort (n=806,434) was formed by first identifying physician primary care providers who departed primary care between Jan 1, 2010 and Jan 1, 2012, then identifying their assigned patients who had been subsequently reassigned to a new primary care provider (either a physician or nurse practitioner).

From this original cohort, patients at risk for hypoglycemia were identified. Patients were included (n=117,133) if they were ≥ 65 years old, enrolled in primary care, and had a diagnosis of type II diabetes mellitus in the baseline year (the year prior to primary care provider reassignment). Patients were excluded if without a high-risk baseline year comorbidity for hypoglycemia (n=78,590), defined as ≥ 1 of: a) renal failure; b) dementia; c) cerebrovascular disease; or d) neurologic disorders. Comorbidities were defined by the International Classification of Diseases-9 codes, based on the validated Gagne comorbidity index.29 The final cohort was 38,543 patients. Outcomes were collected at two years (24 months) after primary care provider re-assignment.

3. Instrumental variable models

Instrumental variable models were applied to account for unobserved confounding affecting patient reassignment to either a new physician or nurse practitioner primary care provider. An instrumental variable approach aims to isolate the component of patient reassignment that is due to pseudo-random variation from an external variable.30 Consistent with prior instrumental variable modeling approaches using these data, pseudo-random variation in nurse practitioner staffing at primary care facilities in 2010 was used as a binary variable above or below the median proportion of primary care provider nurse practitioners, divided by total nurse practitioners + physicians in primary care at the facility.28

Instrumental variable approaches rely on two key requirements. First, the instrumental variable must be highly correlated with the exposure (i.e., primary care provider reassignment). Second, the instrumental variable must not directly relate to the outcome of interest (i.e., HgbA1C < 7%). The study hypothesized that the instrumental variable (facility nurse practitioner staffing) would meet the first requirement because, all other aspects equal, greater availability of facility nurse practitioners is likely to increase the probability of patient reassignment to a nurse practitioner. The study hypothesized the instrumental variable would satisfy the second requirement because nurse practitioner availability is a function of natural variation in state scope-of-practice laws (i.e., more nurse practitioners practice where state law is less restrictive) and location (rural locations have a greater proportional supply of nurse practitioners by county, while urban practices tend to have more proportional physician providers).17,18 After controlling for observed confounders, nurse practitioner assignment therefore should be related to differences in availability of nurse practitioners at a facility – represented by the instrumental variable – but should not relate to variation in underlying patient- or facility-level unobserved factors that might otherwise affect patient glycemic outcomes.30 To help validate these two instrumental variable requirements, instrumental variable strength was confirmed using the partial F-statistic using a previously established minimum threshold of 10 and the balance of covariates levels was examined across the instrumental variable.31

There are regional geographic patterns to state scope-of-practice laws (e.g., proportionately more full-practice states are in the west, while more reduced/restricted states are in the southern US).14 Historically, more proportionate nurse practitioners than physicians serve rural patients.17,18 In contrast, more total nurse practitioners overall serve at hospital-affiliated medical centers, which are more often urban, than often rural community-based outpatient clinics.28,32 These structural characteristics may result in differences between the respective groups of patients reassigned to physicians or nurse practitioners across those facilities. However, importantly, after adjustment these facility characteristics are unlikely to be systematically associated with the individual patient characteristics related to glycemic control that would influence provider group assignment, other than through the instrumental variable mechanism.

4. Outcome and predictors

The primary predictor was reassignment to a new nurse practitioner vs. physician primary care provider. Primary care physicians who left the health system from 2010–2012 were identified as those without a patient panel for two consecutive quarters. Their empaneled patients were then identified if reassigned to a nurse practitioner or physician primary care provider via taxonomy codes.

The primary outcome was the proportion of patients with HgbA1C < 7 % in the second year (i.e., 12–24 months) after the index date of reassignment to their new primary care provider. For multiple lab measures in a single year, the most recent (furthest from reassignment date) was used.

5. Covariates

Models were adjusted for characteristics that may influence the outcome and provider reassignment. Patient baseline covariates included age, sex, marital status (married vs. other), race and ethnicity (Black non-Hispanic, Hispanic, other/missing, or White non-Hispanic), non-Veterans Health Administration insurance (any Medicaid/Medicare vs. Veterans Health Administration-only), new primary care provider relationship length (≤ 90, 91–180, 181–270, 271–365, or > 365 days), primary care copay exemption status (exempt due to disability, low-income, or nonexempt), primary care visit count, if average HgbA1C was < 7.0% (as binary), high-risk comorbidity diagnosis, high total comorbidity score (Gagne score ≥ 3), and drive distance to their primary care clinic (< 40 vs. ≥ 40 miles). Clinic covariates included US Census region of the primary care clinic, facility-level hospital or community-outpatient clinic affiliation, and geographic location (urban or rural).

6. Statistical analysis

Unadjusted and multivariable regression models assumed logit links with a binomial family based on goodness-of-fit tests (i.e., modified Park, Pregibon’s link, Pearson’s correlation, and Hosmer-Lemeshow tests). Models accounted for patients clustering in facilities (heteroskedastic cluster-robust standard errors) with the Iteratively Reweighted Least Squares algorithm.

The primary analysis was an instrumental variable approach. Balancing was assessed by standardized mean differences with correlation matrices to confirm non-collinearity between selected covariates before model inclusion. The analysis then applied a two-stage residual inclusion (i.e., 2SRI) estimator. The first stage estimated the probability of nurse practitioner reassignment as a function of the instrumental variable (facility-level nurse practitioner staffing) and covariates using a generalized linear model with logit link and binomial family. Using the fitted first stage model, generalized residuals were calculated using a logistic density function that served as explanatory variables in the second stage. Two-stage residual inclusion has been favored for nonlinear probability models with binary outcomes.33,34 Prior work also demonstrated two-stage residual inclusion instrumental variable methods with generalized residuals minimize bias in estimating average treatment effects for non-rare outcomes (probabilities > 5%).35 Goodness-of-fit tests were also conducted to support model fit. Patients with missing data were excluded, except if levels could be recoded as missing. Standard errors were estimated using a bootstrap procedure (1,000 repetitions) and accounted for patient clustering by facility.

7. Sensitivity analysis

To improve the theoretical link between provider active treatment practices and glycemic outcomes, a sensitivity analysis was conducted among patients receiving prescriptions for diabetic medications from the Veterans Health Administration. For this, patients who were not prescribed either an oral or injectable diabetic medication that lowers blood sugar (a hypoglycemic) starting ≥ 90 days after the switch to a new primary care provider were excluded. This subgroup was n=1,025. As the sample size was reduced with fewer patients per facility, facility-level variance was accounted for by including facilities as fixed effects, rather than clustering by facility. Goodness-of-fit, instrumental variable tests, estimator selection, and standard errors were otherwise as above.

8. Ethical approval

This study was approved by the Veterans Health Administration Puget Sound Institutional Review Board (MIRB #00765). Individual informed consent was waived for this retrospective data analysis.

Results

1. Description of cohort

A total of 38,543 patients with diabetes ≥ 65 years at risk for hypoglycemia were reassigned to a physician versus nurse practitioner primary care provider after their initial primary care provider left (Table 1). On average, these patients were 75.9 years old, mostly male (98.7%) and non-Hispanic White (74.7%). Among all patients, 87.4% (n=33,700) were reassigned to a physician primary care provider and 12.6% (4,843) were reassigned to a nurse practitioner primary care provider. Those reassigned to a new nurse practitioner primary care provider versus a physician were slightly older (76.4 vs. 75.8 years), more proportionately non-Hispanic White (77.1% vs. 74.3%) and more rural residents (26.2% vs. 16.2%) living further from their primary care clinics (22.7% vs. 19.3% with distance to clinic ≥ 40 miles).

Table 1.

Patients with diabetes ≥ 65 years at risk for hypoglycemia reassigned to a new primary care physician vs. nurse practitioner (NP). Mean (SD) shown, except as noted.

Total
N=38,543
Reassigned to physician
n=33,700
Reassigned to NP
n=4,843
SMD
Age, years 75.9 (7.6) 75.8 (7.6) 76.4 (7.6) 0.08
Female, n (%) 500 (1.3) 426 (1.3) 74 (1.5) 0.02
Race, n (%)
 Black, non-Hispanic 5,138 (13.3) 4,581 (13.6) 557 (11.5) 0.06
 Hispanic 2,012 (5.2) 1,830 (5.4) 182 (3.8) 0.08
 Other/missing 2,605 (6.8) 2,236 (6.6) 369 (7.6) 0.04
 White, non-Hispanic 28,788 (74.7) 25,053 (74.3) 3,735 (77.1) 0.06
Married, n (%) 25,463 (66.1) 22,270 (66.1) 3,193 (65.9) 0.003
Rural, n (%) 6,722 (17.4) 5,453 (16.2) 1,269 (26.2) 0.27
Copay exemption, n (%)
 Due to disability 15,297 (39.7) 13,427 (39.8) 1,870 (38.6) 0.03
 Due to income 15,111 (39.2) 13,200 (39.2) 1,911 (39.5) 0.01
 Nonexempt 8,135 (21.1) 7,073 (21.0) 1,062 (21.9) 0.02
Other insurance, n (%) 34,530 (89.6) 30,123 (89.4) 4,407 (91.0) 0.05
Relationship length, days 0.08
 0 – 90 8,121 (21.1) 7,129 (21.2) 992 (20.5) 0.02
 91 – 180 4,367 (11.3) 3,652 (10.8) 715 (14.8) 0.12
 181 – 270 3,936 (10.2) 3,357 (10.0) 579 (12.0) 0.06
 271 – 365 3,578 (9.3) 3,141 (9.3) 437 (9.0) 0.01
 > 365 18,541 (48.1) 16,421 (48.7) 2,120 (43.8) 0.10
Community clinic, n (%) 16,809 (43.6) 14,725 (43.7) 2,084 (43.0) 0.01
United States Region, n (%)
 West 7,549 (19.6) 6,484 (19.2) 1,065 (22.0) 0.07
 Midwest 8,367 (21.7) 6,837 (20.3) 1,530 (31.6) 0.26
 South 19,130 (49.6) 17,394 (51.6) 1,736 (35.9) 0.32
 Northeast 3,497 (9.1) 2,985 (8.9) 512 (10.6) 0.06
Distance to clinic ≥ 40 miles, n (%) 7,612 (19.8) 6,513 (19.3) 1,099 (22.7) 0.08
Baseline PC visits 6.1 (6.5) 6.1 (6.3) 5.9 (7.2) 0.04
High total comorbidity, n (%) 22,539 (58.5) 19,683 (58.4) 2,856 (59.0) 0.01
Renal failure, n (%) 21,109 (54.8) 18,498 (54.9) 2,611 (53.9) 0.02
Dementia, n (%) 2,602 (6.8) 2,243 (6.7) 359 (7.4) 0.03
Neurologic disease, n (%) 10,061 (26.1) 8,721 (25.9) 1,340 (27.7) 0.04
Cerebrovascular disease, n (%) 17,274 (44.8) 15,132 (44.9) 2,142 (44.2) 0.01
Baseline HgbA1C 7.16 (1.29) 7.16 (1.28) 7.15 (1.31) 0.01
Baseline HgbA1C < 7%, n (%) 16,563 (51.1) 14,530 (51.1) 2,033 (51.1) 0.001
2-year HgbA1C 7.11 (1.24) 7.11 (1.24) 7.11 (1.27) 0.01
2-year HgbA1C < 7%, n (%) 16,901 (54.2) 14,858 (54.2) 2,043 (53.8) 0.01

PC = primary care. SMD = Standardized Mean Difference.

At baseline, the unadjusted mean proportion of patients with HgbA1C < 7% was 51.1% (n=15,852 with HgbA1C ≥ 7%; n=16,563 with HgbA1C < 7%). The mean baseline HgbA1C was 7.16 (SD=1.29, IQR 6.3–7.8). For those reassigned to a physician primary care provider, 51.1% (n=14,530) had a baseline HgbA1C < 7% [mean 7.16, SD=1.28]; among those reassigned to a nurse practitioner primary care provider, 51.1% (n=2,033) had a baseline HgbA1C < 7% [mean 7.15, SD=1.31].

After two years of follow-up, the mean proportion of patients with a HgbA1C < 7% was 54.2%, with an average HgbA1C of 7.11 (SD=1.24, IQR 6.3–7.7). Of these, 54.2% (n=14,858) of patients reassigned to physicians had a follow-up HgbA1C < 7% [mean A1C=7.11 (SD=1.24)], and 53.8% (n=2,043) nurse practitioner patients had a follow-up HgbA1C < 7% [mean A1C=7.11, (SD=1.27)].

2. Logistic Regression Models

Unadjusted, the predicted probability of having a low HgbA1C (< 7%) at two years of follow-up was not statistically significantly different between those reassigned to a physician versus nurse practitioner primary care provider (difference, −0.004 percentage points, 95% CI −0.02 to +0.01, P=0.65) (Table 2). After adjusting for observed patient and clinic characteristics, there was also no statistically significant difference in the groups at two years of follow-up (difference −0.004 percentage points (−0.02 to + 0.01), P=0.62).

Table 2.

Estimated predicted probability of HgbA1C < 7% after 2 years in older patients with diabetes reassigned to primary care physicians (MD) vs. nurse practitioners (NP), adjusting for clinic and patient baseline differences.

MD NP Difference (95% CI) P
Logistic regression 53.26 52.81 +0.45 (−2.19 to +1.30) 0.62
2SRI instrumental variable 55.56 35.59 −20.38 (−37.92 to −2.83) 0.02
2SRI, among patients on medications only 50.55 28.75 −23.85 (−92.60 to +44.91%) 0.50

2SRI = Two-stage residual inclusion. MD = Medical Doctor. NP = Nurse practitioner.

3. Instrumental variable results

In the first stage model, the selected instrumental variable had an F-statistic of 17.9, above the threshold defining a strong instrumental variable (> 10).31 Balancing by the instrumental variable was also assessed (Supplemental Appendix 1). Standardized mean differences between patient characteristics were mostly < 0.1, indicating similarly between instrumental variable levels. Some differences remained after rebalancing; more patients seen in facilities with a higher proportion of nurse practitioners were hospital-affiliated (63% vs. 49%), and facilities with a higher proportion of nurse practitioners were less common in the South (38% vs. 61%). First stage model results are shown in Supplemental Appendix 2.

Table 2 shows main model results. Those who were reassigned to a nurse practitioner had a 20.38 percentage-point lower average predicted probability (95% CI −37.92 to −2.83, P=0.02) of having a HgbA1C < 7% at two years than those reassigned to a physician.

Using the adjusted instrumental variable approach among those prescribed a hypoglycemic medication for diabetes at ≥90 days after primary care provider reassignment, the average predicted probability of a HgbA1C < 7% at two-year follow-up was 23.85 percentage-points lower among those reassigned a nurse practitioner than a physician (95% CI, −92.60 to +44.91 percentage-points, P=0.50).

Discussion

This study examined a cohort of older patients with diabetes and medical comorbidities to compare if reassignment to a new nurse practitioner primary care provider resulted in greater risk of overly intensive glycemic control, relative to patients reassigned to new physician primary care providers. Leveraging an instrumental variable approach allowed further accounting for potential unobserved factors influencing patient primary care provider reassignment. At two years, those reassigned to a nurse practitioner primary care provider had an over 20% lower probability of a HgbA1C < 7.0%. While not statistically significant, among patients on hypoglycemic prescriptions at follow-up, those assigned to a nurse practitioner had a similar 24% lower probability of HgbA1C < 7%.

There are several explanations for these findings. These study data were collected at a time of increasing awareness of the threat of hypoglycemia and growing consensus on less-restrictive glycemic targets in select populations.68,36,37 Older patients at risk for hypoglycemia assigned to nurse practitioners may have experienced greater liberalization of glycemic targets, or conversely, physicians may have been able to safely achieve lower glycemic ranges in these patients. While a comparison of prescribing differences between physicians and nurse practitioners was beyond this study’s scope, the sensitivity analysis of patients with system-prescribed hypoglycemic medications supports that active treatment differences may account for findings. Knowledge of clinical practice guidelines or recognition of organizational efforts to de-escalate glycemic control may have been different between nurse practitioners and physicians.8,34,35 Alternatively, nurse practitioners may have systematic practice patterns beyond prescribing that lead to higher HgbA1Cs. This may occur due to differences in panel sizes or workload from physicians. This study was unable to adjust for patient panel size among providers in this dataset; however, Veterans Health Administration panel sizes are approximately 15–25% larger for physicians than nurse practitioners.28 Appointment length and other organizational components were identical, but smaller nurse practitioner panel sizes may reduce the workload from other demands and permit nurse practitioners to individualize glycemic goals or better accommodate patient needs around treatment regimens. Relatedly, physicians with comparably larger panel sizes may be more likely to suffer from competing demands for time or perpetuate prior treatments (even when not appropriate).38 Supporting this possibility, prior literature suggests patients seeing nurse practitioners for primary care have better satisfaction and perceive longer visits with providers.39,40

Residual differences after balancing by instrumental variable remained in facility and geographic distribution where this cohort sought care, which may influence findings. Patient characteristics were generally well balanced, as expected with the pseudo-randomized instrumental variable approach. However, as anticipated, the instrumental variable had artifactual residue from a) state scope-of-practice laws affecting local hiring availability with fewer nurse practitioners in facilities in restricted-practice states, and b) staffing patterns at Veterans Health Administration hospital-affiliated clinics, as more commonly urban-based and with proportionately more nurse practitioners per facility than rural locations. These imbalances are inherent to the instrumental variable, but are unlikely to systematically affect the assignment of an individual patient to an available nurse practitioner or a physician at a facility after controlling for facility characteristics, other than through the instrumental variable mechanism.

These findings add to the literature on practice patterns between primary care physicians versus nurse practitioners, with increased relevance given implications for diabetic care quality. Low HgbA1C < 7% among older patients with diabetes can indicate overtreatment and increases the risk of hypoglycemic events without corresponding benefit.25 As awareness of the potential harms of diabetic overtreatment has increased over the past two decades, individualizing or liberalizing HgbA1C targets is supported by organizational guidelines with increasing understanding of the patients at highest-risk of hypoglycemia, such as older adults, those with chronic kidney disease, underlying existing cognitive impairment, or limited life expectancy.24,41,42 Our findings suggest that after rigorously accounting for differences in patient assignment, there may be variation in diabetic care administered by nurse practitioners compared to physicians. While a handful of studies have looked at clinician differences in other areas of low-value care,15,16 this may be the first examining diabetes.

These findings have clinical and policy implications. As of early 2023, 27 US states have provided full practice authority to nurse practitioners. However, scope-of-practice debates involving the care provided by nurse practitioners versus physicians are ongoing.43,44 This study adds to the current evidence demonstrating nurse practitioners have equivalent, or better, chronic disease management quality to physicians for some populations.11,12,45 This study in particular also supports that nurse practitioners may provide more individualized care among older patients with diabetes at highest risk for hypoglycemia. Given the increasingly importance of nurse practitioners to augmenting primary care capacity,10 findings reinforce state expansion of nurse practitioner scope-of-practice laws. At the clinic level, panel composition and size (“caseload” or workload) determinants are complex, but rarely incorporate evidence-based patient and system outcomes associated with nurse practitioner care.46,47 This study supports the ability of nurse practitioners to provide quality care of older, complex patients with diabetes. Our work adds to evidence suggesting health systems, including both non-Veterans Health Administration systems in the US and internationally, may improve the flexibility of their workforce by removing precedents on the limited size (e.g., 75% of a physician panel size is used in the Veterans Health Administration), composition, and complexity (e.g., allocation of more complex patients to physicians in some health centers) of nurse practitioner patient panels.4648 Given the broad implications to the primary care workforce, patient safety, and clinical care quality, future research should extend to non-Veterans Health Administration settings and additional health conditions.

Limitations:

This study has several limitations. This dataset, while historic, has unique strengths and disadvantages. These data provide exceptional insight into care patterns, leveraging the natural experiment of following a patient after their primary care provider left the system, when combined with an instrumental variable approach, improves causal inference within an observational study design. Inferences from these data retain relevance to contemporary policy debate about scope-of-practice laws,43,44 yet predate the significant confounding from the Veterans Access, Choice and Accountability Act (i.e., “Choice Act”, 2014) and Maintaining Internal Systems and Strengthening Integrated Outside Networks (i.e., “MISSION Act”, 2018), which led to growth in the proportion of care delivered by non-Veterans Health Administration providers, care fragmentation, and risk of differential care patterns for higher-risk and geographically remote (rural, highly rural) subgroups.4951 We note the instrumental variable approach has drawbacks, such as the imbalances inherent to the instrumental variable, as discussed above. The discrepancy between the multivariate regression model findings, adjusting only for observed differences, and the more rigorous instrumental variable findings, illustrates the importance of controlling for endogenous confounding.

Several other limitations exist. First, the limited sample of patients receiving Veterans Health Administration-administered prescriptions diminished the power of the sensitivity analysis and ability to clarify the role of prescribing in the findings. This small number of patients prescribed system medications may be secondary to patients filling prescriptions outside the system (e.g., via Medicare). Secondly, this study occurred in the Veterans Health Administration, which has several differences compared to outside settings in the US and globally. For example, this system provides integrated care only to veterans of US military service. However, prior research has found Veterans Health Administration enrollees are highly comparable to Medicare enrollees within the US.52 In addition, the Veterans Health Administration is one of the largest employers of nurse practitioners and provides an unrestricted licensure allowing nurse practitioners to practice at any system facility.20,21 Differences from non-veteran, and non-US settings should be considered when applying findings from this study. Finally, the study used validated comorbidity indices based on administrative data as hypoglycemia risk markers, which are potentially overly conservative for identifying patients. For example, Gagne-defined chronic kidney disease is limited to stage 5 kidney disease/renal failure.29

Conclusions

In a population of older adults with diabetes receiving primary care from the Veterans Health Administration, assignment to a nurse practitioner led to lower rates of diabetes overtreatment in patients at greater risk of hypoglycemia. These findings suggest at least equivalent (and potentially superior) care outcomes versus physicians for specific older patients with diabetes, with policy implications supporting expanded state scope-of-practice regulations in context of growing presence of nurse practitioners among the primary care workforce and for promoting beneficial diabetes care practices among high-risk patients.

Supplementary Material

Supplementary Appendix 1
Supplementary Appendix 2

What is known:

  • Nurse practitioners (advanced practice registered nurses) comprising a growing part of the United States’ primary care workforce and have independent practice authority in the integrated Veterans Health Administration.

  • Overly intensive glycemic control among patients with diabetes at high risk of hypoglycemia (e.g., older adults) may cause harms that outweighing benefits.

  • It is not known how primary care nurse practitioners, compared to physicians, vary in delivery of overly intensive glycemic outcomes for patients with diabetes at high risk of hypoglycemia.

What this paper adds:

  • After accounting for differences between the patient populations, patients at high risk of hypoglycemia assigned to primary care nurse practitioners had appropriately lower rates of overly intensive glycemic control, compared to those assigned to physicians.

  • This study contributes to understanding of practice differences between physicians and nurse practitioners related to low-value care delivery for diabetes.

Acknowledgements:

We thank Christine Sulc and Johnny Mao for their assistance in helping obtain study data access. Support for VA/CMS data provided by the Department of Veterans Affairs, VA Health Services Research and Development Service, VA Information Resource Center (Project Numbers SDR 02–237 and 98–004).

Funding:

The primary study from which these data were drawn was funded by the Veterans Health Administration (VHA) Investigator Initiated Grant (HSR&D IIR 14–054). Dr. Schuttner was supported by grant number K12HS026369 from the Agency for Healthcare Research and Quality. The funders had no role in the design, conduct, or interpretation of these findings. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the United States Government, the Department of Veterans Affairs, or the University of Washington.

Footnotes

Conflict of interests:

The Authors declare there are no conflicts of interest.

Data Sharing: No new datasets were generated in this secondary analysis. Statistical analysis plans and analytic code may be made available on reasonable request from the corresponding author.

References:

  • 1.Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century National Academies Press (US); 2001. Accessed January 24, 2022. http://www.ncbi.nlm.nih.gov/books/NBK222274/ [PubMed] [Google Scholar]
  • 2.Lipska KJ, Krumholz H, Soones T, Lee SJ. Polypharmacy in the aging patient: A review of glycemic control in older adults with type 2 diabetes. JAMA 2016;315(10):1034. doi: 10.1001/jama.2016.0299 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.The Action to Control Cardiovascular Risk in Diabetes Study Group. Effects of intensive glucose lowering in type 2 diabetes. N Engl J Med 2008;358(24):2545–2559. doi: 10.1056/NEJMoa0802743 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.The ADVANCE collaborative group. Intensive blood glucose control and vascular outcomes in patients with type 2 diabetes. N Engl J Med 2008;358(24):2560–2572. doi: 10.1056/NEJMoa0802987 [DOI] [PubMed] [Google Scholar]
  • 5.Duckworth W, Abraira C, Moritz T, et al. Glucose control and vascular complications in veterans with type 2 diabetes. N Engl J Med 2009;360(2):129–139. doi: 10.1056/NEJMoa0808431 [DOI] [PubMed] [Google Scholar]
  • 6.U.S. Department of Veterans Affairs/Department of Defense. VA/DoD Clinical Practice Guideline: Management of Diabetes Mellitus Published online 2010. Accessed October 7, 2022. https://www.healthquality.va.gov/guidelines/CD/diabetes/DM2010_FUL-v4e.pdf
  • 7.Standards of Medical Care in Diabetes—2012. Diabetes Care 2012;35(Supplement_1):S11–S63. doi: 10.2337/dc12-s011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Cassel CK, Guest JA. Choosing Wisely: Helping physicians and patients make smart decisions about their care. JAMA 2012;307(17):1801–1802. doi: 10.1001/jama.2012.476 [DOI] [PubMed] [Google Scholar]
  • 9.American Geriatrics Society. Choosing Wisely: avoid using medications other than metformin to achieve hemoglobin A1c<7.5% in most older adults. Choosing Wisely Published February 21, 2013. Accessed October 7, 2022. https://www.choosingwisely.org/clinician-lists/american-geriatrics-society-medication-to-control-type-2-diabetes/
  • 10.Health Resources & Services Administration, U.S. Department of Health and Human Services. Primary Care Workforce Projections Published September 2021. Accessed December 16, 2021. https://bhw.hrsa.gov/data-research/projecting-health-workforce-supply-demand/primary-health
  • 11.Swan M, Ferguson S, Chang A, Larson E, Smaldone A. Quality of primary care by advanced practice nurses: a systematic review. Int J Qual Health Care 2015;27(5):396–404. doi: 10.1093/intqhc/mzv054 [DOI] [PubMed] [Google Scholar]
  • 12.Jackson GL, Smith VA, Edelman D, et al. Intermediate diabetes outcomes in patients managed by physicians, nurse practitioners, or physician assistants. Ann Intern Med 2018;169(12):825–835. doi: 10.7326/M17-1987 [DOI] [PubMed] [Google Scholar]
  • 13.Laurant M, Harmsen M, Wollersheim H, Grol R, Faber M, Sibbald B. The impact of nonphysician clinicians. Med Care Res Rev 2009;66(6_suppl):36S–89S. doi: 10.1177/1077558709346277 [DOI] [PubMed] [Google Scholar]
  • 14.Kurtzman ET, Barnow BS. A comparison of nurse practitioners, physician assistants, and primary care physicians’ patterns of practice and quality of care in health centers. Med Care 2017;55(6):615–622. doi: 10.1097/MLR.0000000000000689 [DOI] [PubMed] [Google Scholar]
  • 15.Mafi JN, Wee CC, Davis RB, Landon BE. Comparing use of low-value health care services among U.S. advanced practice clinicians and physicians. Ann Intern Med 2016;165(4):237–244. doi: 10.7326/M15-2152 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.O’Reilly-Jacob M, Perloff J, Buerhaus P. Comparing the rates of low-value back images ordered by physicians and nurse practitioners for Medicare beneficiaries in primary care. Nurs Outlook 2019;67(6):713–724. doi: 10.1016/j.outlook.2019.05.005 [DOI] [PubMed] [Google Scholar]
  • 17.Barnes H, Richards MR, McHugh MD, Martsolf G. Rural and nonrural primary care physician practices increasingly rely on nurse practitioners. Health Aff (Millwood) 2018;37(6):908–914. doi: 10.1377/hlthaff.2017.1158 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Xue Y, Smith JA, Spetz J. Primary care nurse practitioners and physicians in low-income and rural areas, 2010–2016. JAMA 2019;321(1):102. doi: 10.1001/jama.2018.17944 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Rosland AM, Nelson K, Sun H, et al. The patient-centered medical home in the Veterans Health Administration. Am J Manag Care 2013;19(7):e263–272. [PubMed] [Google Scholar]
  • 20.Huang PY, Yano EM, Lee ML, Chang BL, Rubenstein LV. Variations in nurse practitioner use in Veterans Affairs primary care practices. Health Serv Res 2004;39(4p1):887–904. doi: 10.1111/j.1475-6773.2004.00263.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.McCleery E, Christensen V, Peterson K, Humphrey L, Helfand M. Evidence Brief: The Quality of Care Provided by Advanced Practice Nurses U.S. Department of Veterans Affairs; 2014. https://www.ncbi.nlm.nih.gov/books/NBK384613/ [PubMed] [Google Scholar]
  • 22.U.S. Department of Veterans Affairs. VHA Directive 1350: Advance Practice Registered Nurse Full Practice Authority Published online September 13, 2017. Accessed May 16, 2022. https://www.va.gov/VHAPUBLICATIONS/ViewPublication.asp?pub_ID=5464
  • 23.Morgan PA, Smith VA, Berkowitz TSZ, et al. Impact of physicians, nurse practitioners, and physician assistants on utilization and costs for complex patients. Health Aff Proj Hope 2019;38(6):1028–1036. doi: 10.1377/hlthaff.2019.00014 [DOI] [PubMed] [Google Scholar]
  • 24.Kerr EA, Klamerus ML, Markovitz AA, et al. Identifying recommendations for stopping or scaling back unnecessary routine services in primary care. JAMA Intern Med 2020;180(11):1500. doi: 10.1001/jamainternmed.2020.4001 [DOI] [PubMed] [Google Scholar]
  • 25.Kirkman MS, Briscoe VJ, Clark N, et al. Diabetes in Older Adults. Diabetes Care 2012;35(12):2650–2664. doi: 10.2337/dc12-1801 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Leung E, Wongrakpanich S, Munshi MN. Diabetes Management in the Elderly. Diabetes Spectr 2018;31(3):245–253. doi: 10.2337/ds18-0033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Price LE, Shea K, Gephart S. The Veterans Affairs’ Corporate Data Warehouse: uses and implications for nursing research and practice. Nurs Adm Q 2015;39(4):311–318. doi: 10.1097/NAQ.0000000000000118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Liu C, Hebert PL, Douglas JH, et al. Outcomes of primary care delivery by nurse practitioners: Utilization, cost, and quality of care. Health Serv Res 2020;55(2):178–189. doi: 10.1111/1475-6773.13246 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Gagne JJ, Glynn RJ, Avorn J, Levin R, Schneeweiss S. A combined comorbidity score predicted mortality in elderly patients better than existing scores. J Clin Epidemiol 2011;64(7):749–759. doi: 10.1016/j.jclinepi.2010.10.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Pizer SD. Falsification testing of instrumental variables methods for comparative effectiveness research. Health Serv Res 2016;51(2):790–811. doi: 10.1111/1475-6773.12355 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Staiger D, Stock JH. Instrumental variables regression with weak instruments. Econometrica 1997;65(3). [Google Scholar]
  • 32.Mengeling M, Charlton M. Rural Veterans’ Use of CBOCs for Primary Care [Issue Brief]. VHA Office of Rural Health; 2012:6. Accessed January 10, 2022. http://www.ruralhealth.va.gov/publications.asp
  • 33.Blundell R, Powell J. Endogeneity in semiparametric binary response models. Rev Econ Stud 2004;71:655–679. [Google Scholar]
  • 34.Terza J, Basu A, Rathouz PJ. Two-stage residual inclusion estimation: Addressing endogeneity in health econometric modeling. J Health Econ 2008;27(3):531–543. doi:DOI: 10.1016/j.jhealeco.2007.09.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Basu A, Coe N, Chapman. 2SLS Versus 2SRI: Appropriate Methods for Rare Outcomes and/or Rare Exposures Department of Medical Ethics and Health Policy; 2018. https://repository.upenn.edu/cgi/viewcontent.cgi?article=1008&context=mehp [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Pogach L, Aron D. The other side of quality improvement in diabetes for seniors: A proposal for an overtreatment glycemic measure. Arch Intern Med 2012;172(19):1510–1512. doi: 10.1001/archinternmed.2012.4392 [DOI] [PubMed] [Google Scholar]
  • 37.Wright SM, Hedin SC, McConnell M, et al. Using shared decision-making to address possible overtreatment in patients at high risk for hypoglycemia: The Veterans Health Administration’s Choosing Wisely Hypoglycemia Safety Initiative. Clin Diabetes 2018;36(2):120–127. doi: 10.2337/cd17-0060 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Parchman ML, Pugh JA, Romero RL, Bowers KW. Competing demands or clinical inertia: The case of elevated glycosylated hemoglobin. Ann Fam Med 2007;5(3):196–201. doi: 10.1370/afm.679 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Horrocks S Systematic review of whether nurse practitioners working in primary care can provide equivalent care to doctors. BMJ 2002;324(7341):819–823. doi: 10.1136/bmj.324.7341.819 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Laurant M, van der Biezen M, Wijers N, Watananirun K, Kontopantelis E, van Vught AJ. Nurses as substitutes for doctors in primary care. Cochrane Effective Practice and Organisation of Care Group, ed. Cochrane Database Syst Rev 2018;2019(2). doi: 10.1002/14651858.CD001271.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.American Diabetes Association. Standards of medical care in diabetes 2021. Clin Diabetes 2021;39(1):14–43. doi: 10.2337/cd21-as01 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Conlin PR, Colburn J, Aron D, Pries RM, Tschanz MP, Pogach L. Synopsis of the 2017 U.S. Department of Veterans Affairs/U.S. Department of Defense clinical practice guideline: Management of type 2 diabetes mellitus. Ann Intern Med 2017;167(9):655–663. doi: 10.7326/M17-1362 [DOI] [PubMed] [Google Scholar]
  • 43.American Association of Nurse Practitioners. Utah’s New Law Will Improve Patients’ Health Care Access. AANP News https://www.aanp.org/news-feed/utahs-new-law-will-improve-patients-health-care-access. Published March 16, 2023. Accessed April 12, 2023.
  • 44.Sternstein M Scope of practice and patient safety Published online November 11, 2021. Accessed April 12, 2023. https://www.ama-assn.org/practice-management/scope-practice/scope-practice-and-patient-safety-michaela-sternstein-jd
  • 45.Wright WL, Bachmann JP, Murphy N, Gifford L, Strowman S, White P. Evaluating quality metrics of patients with type 2 diabetes managed by nurse practitioners in two family nurse practitioner-owned clinics. J Am Assoc Nurse Pract 2019;31(7):413–419. doi: 10.1097/JXX.0000000000000195 [DOI] [PubMed] [Google Scholar]
  • 46.Martin-Misener R, Kilpatrick K, Donald F, et al. Nurse practitioner caseload in primary health care: Scoping review. Int J Nurs Stud 2016;62:170–182. doi: 10.1016/j.ijnurstu.2016.07.019 [DOI] [PubMed] [Google Scholar]
  • 47.Shekelle P, Paige NM, Apaydin E, et al. What Is the Optimal Panel Size in Primary Care? A Systematic Review U.S. Department of Veterans Affairs; 2019. Accessed April 12, 2023. https://www.ncbi.nlm.nih.gov/books/NBK553672/ [PubMed] [Google Scholar]
  • 48.Ku L, Frogner BK, Steinmetz E, Pittman P. Community Health Centers Employ Diverse Staffing Patterns, Which Can Provide Productivity Lessons For Medical Practices. Health Aff (Millwood) 2015;34(1):95–103. doi: 10.1377/hlthaff.2014.0098 [DOI] [PubMed] [Google Scholar]
  • 49.Rosen AK, Wagner TH, Pettey WBP, et al. Differences in Risk Scores of Veterans Receiving Community Care Purchased by the Veterans Health Administration. Health Serv Res 2018;53:5438–5454. doi: 10.1111/1475-6773.13051 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Isakson J VA MISSION Act of 2018; 2018. https://www.congress.gov/bill/115th-congress/senate-bill/2372/text
  • 51.Rogers H Veterans Access, Choice, and Accountability Act of 2014; 2013. https://www.congress.gov/bill/113th-congress/house-bill/3230
  • 52.Wong ES, Wang V, Liu CF, Hebert PL, Maciejewski ML. Do Veterans Health Administration enrollees generalize to other populations? Med Care Res Rev 2016;73(4):493–507. doi: 10.1177/1077558715617382 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Appendix 1
Supplementary Appendix 2

RESOURCES