Impact of Patient Access to Online VA Notes on Healthcare Utilization and Clinician Documentation: a Retrospective Cohort Study

Abstract

Background

In an effort to foster patient engagement, some healthcare systems provide their patients with open notes, enabling them to access their clinical notes online. In January 2013, the Veterans Health Administration (VA) implemented online access to clinical notes (“VA Notes”) through the Blue Button feature of its patient portal.

Objective

To measure the association of online patient access to clinical notes with changes in healthcare utilization and clinician documentation behaviors.

Design

A retrospective cohort study.

Patients

Patients accessing My HealtheVet (MHV), the VA’s online patient portal, between July 2011 and January 2015.

Main Measures

Use of healthcare services (primary care clinic visits and online electronic secure messaging), and characteristics of physician clinical documentation (readability of notes).

Key Results

Among 882,575 unique portal users, those who accessed clinical notes (16.2%; N = 122,972) were younger, more racially homogenous (white), and less likely to be financially vulnerable. Compared with non-users, Notes users more frequently used the secure messaging feature on the portal (mean of 2.6 messages (SD 7.0) v. 0.87 messages (SD 3.3) in January–July 2013), but their higher use of secure messaging began prior to VA Notes implementation, and thus was not temporally related to the implementation. When comparing clinic visit rates pre- and post-implementation, Notes users had a small but significant increase in rate of 0.36 primary care clinic visits (2012 v. 2013) compared to portal users who did not view their Notes (p = 0.01). At baseline, the mean reading ease of primary care clinical notes was 53.8 (SD 10.1) and did not improve after implementation of VA Notes.

Conclusions

VA Notes users were different than patients with portal access who did not view their notes online, and they had higher rates of healthcare service use prior to and after VA Notes implementation. Opportunities exist to improve clinical note access and readability.

BACKGROUND

Effectively managing chronic diseases requires both high-quality healthcare and ongoing patient engagement.^1,2 Patients living with chronic diseases need support for a range of self-management tasks, including accessible, understandable information about their condition and treatment.³ Since meaningful use requirements have incentivized the use of health information technology, electronic health records (EHRs) with tethered patient portals have increased.^4,5 Such portals provide patients with access to their personal health information. Portal features vary, and can include logging and tracking of health information, transactions with the health system such as refilling prescriptions or scheduling appointments, and communicating with healthcare teams through asynchronous, secure messaging.⁶ Some patient portals provide patients with access to additional information from the EHR, such as the clinical notes authored by providers.^7,8

In 2000, the Veterans Health Administration (VA) became the first healthcare system to pilot test patient access to all clinical notes authored by providers through their online patient portal.^9,10 Outside of VA, similar trends have evolved. OpenNotes, an initiative to offer patients access to their clinical notes online, was first implemented in 2010 as an exploratory study at three medical centers.^11–13 It has since expanded to include other healthcare institutions, an estimated 40 million patients now having online access to their clinical notes.¹⁴ In January 2013, the VA implemented full national deployment of open clinical notes, which we hereon refer to as “VA Notes”, with patients. VA Notes include progress and consult notes from primary care, specialty care, mental health, social work, nursing, and patient-clinical-team secure messaging exchanges that have been saved as notes.^15,16 Patients with a premium authenticated account (which affords access to all portal features following an identity verification process) through the VA’s patient portal, My HealtheVet, have the ability to view and download their notes. As of May 2020, there are 5.4 million registered users, 3.3 million of whom have premium accounts with access to VA Notes.

Veterans represent a unique patient population¹⁷ with high medical complexity,¹⁸ including multiple chronic diseases^19,20 and mental health disorders.²¹ Clinical notes have the potential to assist veterans in chronic disease management in various ways, including making the details of previous visits readily accessible and informing preparations for future visits. A survey of experiences among Veterans who were early adopters of reading their clinical notes¹⁵ revealed that the notes helped them understand (91.8%) and manage aspects of their chronic diseases, such as taking medications as prescribed (80.1%), being prepared for clinic visits (88.6%), and remembering their care plan (91.9%).²² While some early adopters reported reaching out to contact their provider or healthcare team after reading the notes (11.9%), the impact of viewing clinical notes on subsequent healthcare utilization remains unknown.

Following on this earlier survey,¹⁵ this analysis focuses on access to notes in a national cohort of VA patients. This analysis leverages the availability of data from the Veterans Health Administration (VHA), the largest integrated healthcare system in the USA, providing care at 170 medical centers and 1074 outpatient sites of care, and serving nine million veterans each year.²³ We addressed three research questions. First, who uses notes? We hypothesized (H1a) that consistent with recent literature on OpenNotes, a digital divide may exist, with older and lower income patients less likely to access their notes,^24–26 as well as racial minority patients and patients with less than high school education as less likely to access their notes.^26,27 Additionally, we hypothesized (H1b) those with chronic disease would be more likely to access notes due to their greater clinical need and more frequent interactions with the healthcare system. Second, are notes users more likely to subsequently contact their clinical team (online and in-person) than non-users? We hypothesized (H2a) that accessing clinical notes would stimulate patient questions or sharing of new health information, thus increasing online patient portal secure messaging compared to non-users. Additionally, we hypothesized (H2b) that notes users would have a higher rate of primary care service utilization than non-users. The impact of access to notes on utilization is largely unknown,²⁸ with some reports of increased use of healthcare services related to access.^29,30 Third, was there a difference in how clinicians wrote their notes, compared with notes written pre-notes? We hypothesized (H3) an increase in clinical note readability post-notes given provider knowledge of their patients having access to their clinical notes.

METHODS

Study Design

We conducted a retrospective, longitudinal cohort study of 4,235,380 patients who received VA care (had at least one visit annually) between January 2011 and January 2015. This time window was selected to best examine the immediate impact of VA Notes implementation, early-on after becoming nationally available. Among this cohort, we examined patients who used the portal (N = 882,575), comparing patients who accessed notes through the portal (notes users) and those who did not (non-users).

We examined the impact of VA Notes on communication with providers via secure messaging and primary care utilization, comparing differences between notes users and non-users before and after January 2013. We further explored the readability of clinical notes before and after January 2013. This study was reviewed and approved by the Edith Nourse Rogers Memorial Veterans Hospital and the University of Massachusetts Medical School Institutional Review Boards.

Data Sources and Measures

Data for the variables of interest (demographic characteristics, use of the portal, use of healthcare services, text of clinical notes, frequency of viewing notes and secure messages, number of primary care visits) were extracted from the VA corporate data warehouse for the time period from January 2011 to January 2015. As noted above, notes first became available to all patients in January 2013, and data on patient viewing of notes became available in July 2013. The “Pre-notes” (i.e., before implementation) time period was defined as July 2011–January 2013 and the “Post-notes” (i.e., after implementation) time period was defined as July 2013–January 2015.

Analytic Plan

To address the first research question, we examined demographic and clinical characteristics of all VA patients and compared them with patients with portal accounts who did and did not access notes. Accessing notes was defined as a patient viewing or downloading their clinical notes online using the portal between July 2013 and January 2015. Demographic characteristics included age, gender, race, a marker of financial vulnerability (defined as eligibility for free care based on an annual VA financial assessment), marital status, distance from the nearest facility, residing in an urban or rural setting, and smoking status. Clinical characteristics included indicators for high priority chronic diseases in VA. We examined differences in characteristics between notes users and non-users using chi-square tests.

The second research question explored the relationship between patients accessing notes, and utilization of secure messaging and clinical services. Utilization was measured by the counts of secure messages and the number of primary care visits in time periods of 6 months and 1 year, respectively, between June 2011 and January 2015. We report the mean and median of these counts in 6-month intervals between these dates, with the difference between notes users and non-users for each time period. We conducted interrupted time series analyses, implemented using a segmented regression method, comparing the change in utilization of secure messaging and primary care provider appointments among those who did or did not access notes. The model was implemented using a generalized estimating equation appropriate for repeated measures (annual rates per year) within individuals, and using an auto-regressive correlation structure. Variables were included in the model to represent group (notes users and non-users), study time, pre-post implementation, and interaction terms to test change in slope within groups, as well as the difference of differences in slopes (group by time). We chose not to adjust for number of chronic conditions because we conceptualized them as part of the causal pathway driving the association between access to notes and increased utilization of services. In this large sample, we recognize that even small differences in slope of change may be significant. Thus, in addition to reporting statistical significance, we identified prior work that demonstrated a change in visits, and use a change of 0.7 clinic visits per year as a meaningful cutoff.³⁰

The final research question examined the readability of notes before and after they became available to patients. To accomplish this, a purposeful sample of VA primary care providers (PCPs) with the highest rates of patients accessing their notes under their care was identified (top 1% nationally). Our rationale for targeting this sample was that clinicians with a higher proportion of patients who accessed their notes may be more likely to alter their documentation behaviors. Among the 40 PCPs who had the highest percentage of portal users in their panel, we randomly selected 100 patients who had accessed notes. From each of these patients, we pulled 3 notes pre-implementation and 3 notes post-implementation, and examined them for readability. Readability was assessed using universally accepted scales for evaluating readability of medical information:³¹ the Flesch reading ease scores (FRES) and the Flesch-Kincaid grade level (FKGL).^32,33 The FRES quantifies how easy text is to read on a scale from 0 to 100 with a higher score indicating easier to read text and the FKGL estimates the grade level of text by assessing word count, words per sentence, and average number of syllables per word. The number and frequency of abbreviations were also assessed. These metrics were assessed for the entire note, and its subcomponents, including the history of present illness, the assessment, and the plan. These subcomponents were selected based on relevance to chronic disease management and because they are least likely to be influenced by copy-and-paste templates, unlike physical exam notes. Readability metrics were calculated using Microsoft Office Word 2016 built-in calculator. Changes in readability statistics from pre- to post-VA Notes implementation were determined using paired t tests. Analyses were performed in STATA software version 13.1 (StataCorp, College Station, TX).

RESULTS

Among patients in our longitudinal cohort (N = 4,235,380), N = 882,575 (21%) had accessed the portal in 2013. Among these patient portal users, 14% (N = 122,972) were notes users and had accessed their VA Notes online at least once in 2013.

Research Question 1: Who Uses VA Notes?

The 122,972 notes users were more likely to be white (80.2% v. 75.1%) and less likely to qualify for free care based on income (16.5% v. 19.2%) than non-users(Table 1). Additionally, notes users were more likely to be women (11.5% v. 10.2%) and married (64.6% v. 60.6%). As hypothesized (H1b), notes users were more likely to have a chronic condition than those who did not access them.

Table 1.

Demographic and Health Characteristics of All Patients Accessing VA Care, Portal Users Who Accessed VA Notes, and Those Who Did Not Access Notes

Demographic characteristics	All Veterans*, N = 4,235,380	Portal users†, N = 882,575
		Did not access Notes, N = 759,603	Accessed Notes‡, N = 122,972
Average age, m (SD)	63.4 (15.1)	58.3 (14.7)	57.9 (12.4)
Gender (%)
Female	5.1	10.2	11.5
Male	95.0	89.8	88.5
Race (%)
White	71.3	75.1	80.2
African American	14.7	11.8	9.1
Unknown	11.1	10.0	8.0
Other	2.9	3.1	2.7
Marker of economic need§	25.5	19.2	16.5
Marital status (%)
Married	57.3	60.6	64.6
Divorced	21.9	21.1	20.4
Never married	10.9	11.2	9.5
Separated/single	3.0	2.7	2.3
Unknown	6.9	4.4	3.2
Miles from nearest facility, m (SD)	45.4 (86.0)	44.7 (93.1)	43.7 (84.5)
Environment (%)
Isolated	6.6	5.0	5.3
Small rural	7.5	6.0	6.4
Large rural	13.7	12.1	12.6
Urban	72.3	76.8	75.6
Smoking status (%)
Current	22.5	20.6	20.5
Former	26.9	26.2	27.1
Never	29.5	31.8	30.9
Unknown	21.1	21.4	21.5
Clinical characteristics (%)|
Hyperlipidemia	63.3	59.3	62.7
Hypertension	63.1	62.4	67.1
Diabetes	27.6	28.0	29.6
Depression	26.9	33.9	40.9
Coronary artery disease	22.6	18.5	19.3
Post-traumatic stress disorder	14.6	19.4	19.8
Chronic obstructive pulmonary disease	14.2	12.6	14.2
Stroke	3.5	2.9	2.8
Traumatic brain injury	1.4	2.2	2.4
Spinal cord injury	0.3	0.6	0.6

*Between June 2011 and January 2015. †Premium authenticated account. ‡Patients who accessed clinical notes in their electronic health record, including notes from physicians, nurses, and other healthcare personnel, following the VA Notes implementation. §Means test: a marker of economic need defined as eligibility for free care based on an annual VA financial assessment. These are the percent of Veterans below the “means test” financial threshold. ^|Total N for clinical characteristics varies slightly (< 1.5%) due to missing administrative data. Differences between portal users who did access clinical notes and those who did not access clinical notes were all significant. Calculated p values for the majority of differences were a p of < 0.001, with the exceptions of Veterans with stroke (p = 0.005) and spinal cord injury (p = 0.002)

Research Question 2: Was VA Notes Use Associated with Change in Online Electronic Secure Messaging and In-person Healthcare Utilization?

Patients who accessed their notes between July 2013 and January 2015 were already using secure messaging more frequently at the time of VA Notes implementation in January 2013 (mean 2.6 v. 0.9 messages among non-users) (Fig. 1). Between-group differences in rates of secure messaging had begun to widen over time prior to the implementation, and this trend continued after January 2013. Consistent with the visual in Figure 1, we found a small, yet significant, increase in slope pre-notes versus post-notes (the small coefficient from the interrupted time series favored non-users; difference of differences, p = 0.000).

Figure 1.

Average number of secure messages sent: VA Notes users versus non-users pre- and post-VA Notes implementation. VA Notes users are patients who accessed clinical notes in their electronic health record, including notes from physicians, nurses, and other healthcare personnel, following the VA Notes implementation.

Notes users had more primary care clinical appointments per year pre-notes compared with those who did not access their notes, and their visits increased over time (from 3.09 visits in 2012 to 3.77 visits in 2013) (Fig. 2). The increase in clinic visits was greater than for non-users, revealing a difference in increase of 0.36 clinical visits (users = .29 visits, non-users: − .07 visits) between the two groups directly before (in 2012) and after (2013) implementation. We noted a significant, yet minimal, difference in the slope of increase in clinic appointments between those who accessed and those who did not access their notes pre-and post-implementation (difference of differences, p = 0.01).

Figure 2.

Average number of primary care appointments: VA Notes users versus non-users pre- and post-VA Notes implementation. VA Notes users are patients who accessed clinical notes in their electronic health record, including notes from physicians, nurses, and other healthcare personnel, following the VA Notes implementation.

Research Question 3: Did Clinical Documentation Change After VA Notes Implementation?

The average clinical note was written with a reading ease of 53.8 (SD 10.1) (on a scale of 1 to 100, with a higher number indicating greater ease) pre-notes and readability did not improve post-notes(Table 2). In fact, some measures suggested an increase in complexity post-notes, with an increase in words per sentence (mean difference 1.0; SD 1.5; p < 0.001) and grade level (mean difference 0.7; SD 1.3; p < 0.01), and a decrease in reading ease (mean difference − 3.1; SD 9.0; p = 0.04) for the entire note. In the history of present illness portion of the note, however, there was a decrease in words per sentence (mean difference − 2.0; SD 6.9; p = 0.08) and grade level (mean difference − 1.3; SD 4.0; p = 0.05), while the readability in the assessment and plan was unchanged. The number and frequency of abbreviations used were unchanged pre- and post-notes.

Table 2.

Clinical Note Documentation, Pre- and Post-VA Notes Implementation

	Entire clinical note				Clinical note
					Assessment and plan				History of present illness
	Pre Mean (SD)	Post Mean (SD)	Mean Diff (SD)	p value	Pre Mean (SD)	Post Mean (SD)	Mean Diff (SD)	p value	Pre Mean (SD)	Post Mean (SD)	Mean Diff (SD)	p value
Word count	885.7 (458.1)	923.6 (457.5)	37.9 (180.8)	0.19	109.9 (86.7)	116.5 (99.1)	6.7 (44.2)	0.35	97.2 (65.8)	103.5 (69.8)	6.3 (34.9)	0.26
Words per sentence	5.6 (0.7)	6.7 (1.5)	1.0 (1.5)	< 0.001*	11.2 (6.4)	11.5 (8.7)	0.3 (6.4)	0.78	14.9 (9.1)	12.9 (8.2)	− 2.0 (6.9)	0.08
Reading ease	53.8 (10.1)	50.8 (9.9)	− 3.1 (9.0)	.04*	37.5 (19.0)	35.5 (20.7)	− 2.0 (12.4)	0.32	45.0 (22.2)	46.6 (24.4)	1.6 (21.1)	0.64
Grade level	7.1 (1.4)	7.7 (1.7)	0.7 (1.3)	<0.01*	8.6 (3.7)	8.8 (4.1)	0.2 (3.1)	0.69	8.8 (4.1)	7.5 (4.0)	− 1.3 (4.0)	0.05*
Frequency of abbreviations	26.4 (18.2)	24.9 (15.7)	− 1.6 (8.5)	0.26	5.3 (5.1)	5.1 (5.2)	− 0.2 (2.3)	0.65	3.0 (2.8)	2.9 (2.8)	− 0.1 (1.8)	0.82
Number of abbreviations	14.3 (7.9)	13.5 (6.8)	− 0.8 (3.6)	0.17	4.2 (3.6)	4.2 (3.8)	− 0.1 (1.5)	0.69	2.6 (1.9)	2.6 (2.3)	− 0.01 (1.4)	0.96

*100 patients were randomly selected from 40 primary care providers who had the highest percentage of portal users on their panel. We examined their clinical note documentation pre- and post-VA Notes implementation

DISCUSSION

We found those who accessed their notes differed socio-demographically from those who did not. While recent OpenNotes literature suggests racial minority and less educated patients are more likely to value and benefit from access to clinical notes online,^26,27 white patients are more likely to access portals^24,34,35 and to view their notes online.²⁵ Older patients, men, and those socio-economically disadvantaged are less likely to use portals.^35,34 Although the digital divide has narrowed in recent years for the elderly and lower income patients, who are among the fastest growing subset of Internet users,^36,37 our work has further confirmed a digital divide even among portal-using patients.

Consistent with the literature,³⁴ we found that patients with chronic conditions were more likely to access their notes. Of those who have used OpenNotes, patients with fair or poor health more often describe experiencing higher levels of coordination of care and self-care than those with excellent health.³⁸ Due to veterans’ complex healthcare needs, leveraging notes for increased efficiency and effectiveness of care coordination through sharing downloaded notes with family or caregivers and non-VA healthcare providers is possible. Due to high interest from portal users,³⁹ VA is currently piloting a delegation feature for patients to authorize others to access their information within the portal.

Reviewing clinical notes may stimulate patient information seeking or engagement. We noted a difference in increase of 0.36 clinical visits between notes users and non-users (an increase of 0.29 clinical visits for users alone). Relative to other reports, this is a small change, as Kaiser Permanente patient users of “My Health Manager” increased 0.7 visits per year after implementation.³⁰ Note that patients who viewed notes had a greater disease burden, compared to those who did not view notes. It may be that already high utilization (due to a higher number of chronic conditions) may have prompted notes access and thus resulted in even greater service utilization. In addition, reading the notes may have prompted increased adherence to or scheduling of new appointments. Furthermore, it is important to note the overall high disease burden in our Veteran cohort. The high chronic disease burden Veterans experience may have limited their ability to increase their utilization to the same degree the general population, or that the frequency of utilization was closer to optimal for their condition severity—more so than the general population. More detailed mixed-methods analyses are needed to understand reasons for this change in slope early after VA Notes launch. Additionally, notes users were more likely to secure message providers than non-users. This may be, in part, because patients who accessed their notes were already high users of secure messaging pre-notes implementation. Access to notes may be another marker of willingness to adopt new technology.

Finally, there is no evidence clinicians are altering their note-writing behavior to improve the overall readability of their notes. This is a novel contribution to the literature. In the original OpenNotes quasi-experimental study of 105 PCPs who self-reported documentation changes after 1 year, 3% to 36% of doctors reported changing documentation content.¹³ Our readability metrics did not detect any substantial objective change, yet subtle changes may not have been picked up with our methods. To improve the level of reading ease,^33,40 solutions such as a web-based course for VA clinicians⁴¹ and embedded tools in the notes to provide lay definitions of medical terminology for patients⁴² are being developed.

Limitations

There are several limitations of this study. Like all non-experimental studies, these associations are observational and, thus, causality cannot be directly known. For example, there may be an effect of clinic use on viewing notes, since it is possible that patients were referred to view their portal during a clinic visit. A longitudinal analysis examining the timing of note access and scheduling of clinical visits would further enhance understanding. Note that this analysis is retrospective, and only represents the immediate impact of open notes over the first 4 years of implementation. Thus, our findings do not reflect the longer term impact of notes. We can only speculate, based on the fact that the change in visits was small and relatively flat after 2 years, that it is possible that these trends have continued. Certainly, the total number of Veterans using My HealtheVet has continued to increase, and likely the overall use of notes as well.

Future Implications

Access to clinical notes is a Federal mandate for all patients as of November 2020.⁴³ Our results on the impact of the national rollout of VA Notes may provide insight for other healthcare organizations considering the potential impact of OpenNotes on their organization, as unintended consequences associated with new innovations are often seen early post-implementation. In the VA, viewing notes coincided with a short-term trend of increased clinical visits; however, VA Notes did not substantially change clinician’s note-writing behavior as assessed by reading ease. Additional tools and resources may also assist patients in understanding their notes for enhanced self-management.⁴⁴

Funding

This study was funded by the Department of Veteran Affairs (grant VA241-12-D-0224).

Compliance with Ethical Standards

This study was reviewed and approved by the Edith Nourse Rogers Memorial Veterans Hospital and the University of Massachusetts Medical School Institutional Review Boards.

Conflict of Interest

The authors declare that they do not have a conflict of interest.