Abstract
Background
Offering patients online access to medical records, including doctors’ visit notes, holds considerable potential to improve care. However, patients may worry about loss of privacy when accessing personal health information through Internet-based patient portals. The OpenNotes study provided patients at three US health care institutions with online access to their primary care doctors’ notes and then collected survey data about their experiences, including their concerns about privacy before and after participation in the intervention.
Objective
To identify patients’ attitudes toward privacy when given electronic access to their medical records, including visit notes.
Methods
The design used a nested cohort study of patients surveyed at baseline and after a 1-year period during which they were invited to read their visit notes through secure patient portals. Participants consisted of 3874 primary care patients from Beth Israel Deaconess Medical Center (Boston, MA), Geisinger Health System (Danville, PA), and Harborview Medical Center (Seattle, WA) who completed surveys before and after the OpenNotes intervention. The measures were patient-reported levels of concern regarding privacy associated with online access to visit notes.
Results
32.91% of patients (1275/3874 respondents) reported concerns about privacy at baseline versus 36.63% (1419/3874 respondents) post-intervention. Baseline concerns were associated with non-white race/ethnicity and lower confidence in communicating with doctors, but were not associated with choosing to read notes or desire for continued online access post-intervention (nearly all patients with notes available chose to read them and wanted continued access). While the level of concern among most participants did not change during the intervention, 15.54% (602/3874 respondents, excluding participants who responded “don’t know”) reported more concern post-intervention, and 12.73% (493/3874 respondents, excluding participants who responded “don’t know”) reported less concern.
Conclusions
When considering online access to visit notes, approximately one-third of patients had concerns about privacy at baseline and post-intervention. These perceptions did not deter participants from accessing their notes, suggesting that the benefits of online access to medical records may outweigh patients’ perceived risks to privacy.
Keywords: electronic medical records, patient access to records, patient portals, privacy, consumer health informatics, personal health records
Introduction
Secure patient portals—tethered Web-based applications that enable patients to access their health information online—can give patients more control over their personal health information by improving their access to medical records [1-9]. A Markle Foundation survey of 1580 US adults in 2008 found that nearly half were interested in using an online patient portal and among those not interested, concern for privacy was the main deterrent to adoption [10]. While patients want easy access to their health information, including their doctors’ visit notes, concerns about the privacy of online medical data could limit the utility of patient portals [3,10,11]. Understanding patients’ views toward privacy is especially important in the case of visit notes, which often contain detailed personal information about patients’ medical, social, and family histories.
Despite calls for more discussion of patients’ privacy concerns in primary care settings [12-16], little research has addressed the concerns that arise when patients are given online access to their health information. Existing studies are primarily qualitative or opinion-based [8,17-19] or limited to a single health care institution [2,3,20,21]. Most have examined issues of privacy related to health information exchange or personal health information in general. None discuss privacy in the context of providing patients with electronic access to their visit notes.
This paper describes patient-reported concerns about privacy prior to and after participation in OpenNotes, a 1-year quasi-experimental study in which patients were offered online access to the outpatient clinic notes written by their primary care doctors (“visit notes”). Study procedures are fully described in prior publications and briefly summarized in the next section for context [22-25]. A priori, we generated several research questions to guide our analyses: What percentage of patients report concerns about privacy at baseline, and what are the characteristics of patients according to their level of concern? Did their attitudes change during participation in OpenNotes, and if so, in what direction? Were concerns about privacy at baseline associated with their use of visit notes, their likelihood of showing or discussing notes with others, or their desire for continued online access to notes after the intervention concluded?
Methods
Setting
We surveyed primary care doctors and their patients in three locations: Beth Israel Deaconess Medical Center (BIDMC), a teaching hospital of Harvard Medical School, and community practices affiliated with BIDMC in urban and suburban Boston, MA; Geisinger Health System (GHS), a rural integrated health services organization serving patients in central and northeastern Pennsylvania; and the adult medicine and HIV/AIDS clinics at Harborview Medical Center (HMC), a county hospital affiliated with the University of Washington that serves primarily safety-net populations in Seattle, WA. Each participating institution received approval for the study from its Institutional Review Board.
Study Design
To be eligible for OpenNotes, patients at BIDMC and GHS had to be current users of their sites’ patient portals, through which they could message their doctors, schedule appointments, and view components of their medical records (such as medication lists and test results). OpenNotes patients at HMC gained first-time access to their hospital’s patient portal when they enrolled in the study. At all three sites, study participants gained first-time access to notes written by their doctors following the clinic visits that occurred during the intervention.
We surveyed patients both before and after the year-long OpenNotes study to gauge their attitudes toward and experiences with gaining online access to their visit notes. We used portal tracking data to confirm whether notes were generated for each participant during the intervention and whether participants chose to view notes that were available.
Study Participants
For this report, we examined data from patients who completed the OpenNotes intervention, responded to both the baseline and 1-year post-intervention surveys, and completed the privacy questions on the surveys. We did not include patients who were excluded from participation (ie, denied online access to notes) by their doctors, who withdrew from the study, who moved or died during the intervention, or whose portal accounts became inactive during the study period. Information about the differences among patients by participation status and site has been published previously [22-25].
As described previously [23,25], 13,564 patients who completed the study had one or more notes made available during the year-long intervention period. Among those, 41.05% (5568/13,564) submitted a post-intervention survey. Further, 28.56% (3874/13,564) submitted both a baseline and a post-intervention survey with privacy questions completed; they constitute the study sample for this analysis.
Patient Survey
Before developing the patient surveys, we conducted focus groups and individual interviews at the study sites to ensure that the surveys encompassed the major worries, expectations, and perceived benefits of online access to visit notes. Concern for the privacy of individual information was voiced by some patients during these focus groups and was particularly prevalent among patients at HMC [26]. The concerns about “privacy” that patients identified included login security, accessing their information in a public location (eg, library or hospital resource center), privacy breaches (eg, hackers or unauthorized hospital employees reading their medical information), and provision of their medical information to external organizations such as insurance companies and governmental agencies [26].
Based on focus group findings, we included an item addressing concerns about privacy in the baseline and post-intervention surveys, with responses on a 5-point Likert scale (baseline survey question: “If I could read my doctor’s notes, I would be concerned about my privacy: Agree, Somewhat Agree, Somewhat Disagree, Disagree, Don’t Know” and post-intervention survey question: “As a result of reading/having access to my doctor’s notes, I am concerned about my privacy: Agree, Somewhat Agree, Somewhat Disagree, Disagree, Don’t Know”).
In the baseline and post-intervention surveys, we also used the validated Ambulatory Care Experiences Survey (ACES) [27] and Perceived Efficacy in Patient-Physician Interactions (PEPPI) [28] instruments to assess participants’ level of trust in and interactions with their providers. The ACES instrument addresses patients’ self-reported quality of interaction and communication with their doctors, and PEPPI addresses levels of self-efficacy in communicating with doctors. Patients were also asked in the surveys to self-report demographic information including age, sex, race/ethnicity, education level, employment status, Internet use, and health status.
In the post-intervention survey, we asked patients a series of questions about whether or not they accessed their doctors’ notes (ie, “Did you look at any of your visit notes [on the secure patient portal]?”: Yes; No; I did not have any notes to look at because I did not see my doctor since notes were made available”), whether they would like OpenNotes to continue (ie, “I would like to continue to be able to see my doctor’s notes online: Yes, No”), and whether they shared their notes with others (ie, “Did you show or discuss your visit notes with other people? Yes, No, Don’t Know/Don’t Remember”).
As described in previous publications, we pre-tested the survey questions with patients for clarity and incorporated changes based on the patient feedback received. We conducted additional testing of online versions of the surveys prior to administering the surveys to participating patients [25]. See Multimedia Appendices 1 and 2 for the baseline and post-intervention survey instruments.
Statistical Analysis
To assess patient characteristics associated with concerns about privacy, we performed a chi-square analysis on categorical variables, with age, race/ethnicity, employment, and self-reported health variables dichotomized for analytic purposes. To evaluate perceived confidence in doctor-patient communication and trust in doctors, we report quartile scores of the ACES and PEPPI summary measures. We also performed logistic regression models to determine whether age, sex, education, race/ethnicity, frequency of Internet use, and PEPPI scores were independently associated with the likelihood of having concerns about privacy at baseline. We performed McNemar’s test for paired data to determine whether patient attitudes toward privacy changed or persisted over the course of the intervention.
We analyzed data at both aggregated binary categories (collapsed categories into “Agree/Somewhat Agree” and “Disagree/Somewhat Disagree”) and disaggregated levels (“Agree”, “Somewhat Agree”, “Somewhat Disagree”, and “Disagree”). Unless otherwise stated, “concern for privacy” is reported as an aggregated percentage of both “Agree” and “Somewhat Agree” survey responses for improved clarity, and the findings were similar. For data that yielded significantly different results in the aggregate vs disaggregate, we report the findings separately. We used a confidence interval (CI) of 95% and defined statistical significance as a P value less than .05. All statistical analyses were conducted using SAS software, version 9.3.
Results
Privacy Concerns by Demographics
At baseline, about one-third of participants reported concerns about privacy related to online access to visit notes (Table 1). Compared to participants without such worries, they were more likely to be non-white, have fewer years of education (high school/GED or less), attend BIDMC, and report lower levels of trust and confidence in communication with their doctor. More modest associations were found according to age and sex (women worried more than men, under age 55 worried more than age 55 or older). We found no difference in levels of concern according to self-reported health status.
Table 1.
Characteristics | Agree, %a | Somewhat agree, %a |
Somewhat disagree, %a |
Disagree, %a | Don’t know, %a |
Total, n | ||
Totals, n (%) | 413 (10.66) | 862 (22.25) | 565 (14.58) | 1853 (47.83) | 181 (4.67) | 3874 (100) | ||
Demographics | ||||||||
|
Age | |||||||
|
|
≥55 years old | 11.89c | 20.97 | 14.39 | 46.91 | 5.84 | 2036 |
|
|
<55 years old | 9.30 | 23.67 | 14.80 | 48.86 | 3.37 | 1838 |
|
Sex | |||||||
|
|
Female | 11.12b | 23.36 | 13.29 | 46.94 | 5.30 | 2303 |
|
|
Male | 9.99 | 20.62 | 16.49 | 49.14 | 3.76 | 1571 |
|
Race/Ethnicity | |||||||
|
|
White | 9.94c | 22.18 | 14.69 | 48.62 | 4.58 | 3540 |
|
|
Non-Whitee | 19.57 | 22.46 | 13.77 | 39.49 | 4.71 | 276 |
|
Education | |||||||
|
|
High school/GED or less | 15.90c | 19.20 | 12.89 | 45.85 | 6.16 | 698 |
|
|
Some college | 10.53 | 21.59 | 14.29 | 48.01 | 5.59 | 931 |
|
|
College graduate | 9.09 | 23.44 | 15.24 | 48.40 | 3.83 | 2244 |
|
Employment | |||||||
|
|
Employed | 10.05b | 22.99 | 15.13 | 48.01 | 3.81 | 2518 |
|
|
Not employed | 11.80 | 20.87 | 13.57 | 47.49 | 6.27 | 1356 |
|
Internet use | |||||||
|
|
Daily or almost daily | 9.63c | 22.34 | 15.02 | 48.91 | 4.11 | 3335 |
|
|
>2 times per week | 18.40 | 23.60 | 12.00 | 39.60 | 6.40 | 250 |
|
|
Once per week | 17.39 | 17.39 | 14.13 | 44.57 | 6.52 | 92 |
|
|
Once every 2 weeks or less | 16.79 | 19.71 | 11.68 | 40.88 | 10.95 | 137 |
|
|
Not at all | 14.71 | 20.59 | 5.88 | 50.00 | 8.82 | 34 |
|
Site | |||||||
|
|
Beth Israel Deaconess Medical Center | 11.93c | 25.44 | 14.71 | 43.36 | 4.55 | 2087 |
|
|
Geisinger Health System | 8.84 | 18.56 | 14.83 | 52.79 | 4.98 | 1686 |
|
|
Harborview Medical Center | 14.85 | 17.82 | 7.92 | 57.43 | 1.98 | 101 |
Health & Health Care Experiences | ||||||||
|
Perceived confidence in communicating with physician (PEPPI) d | |||||||
|
|
Q1 (Lowest confidence communicating with physician) | 12.04c | 26.54 | 16.71 | 39.56 | 5.16 | 814 |
|
|
Q2 | 9.83 | 25.03 | 16.51 | 42.86 | 5.78 | 987 |
|
|
Q3 | 10.70 | 22.56 | 16.37 | 46.38 | 3.99 | 953 |
|
|
Q4 (Highest confidence communicating with physician) | 10.34 | 16.28 | 9.80 | 59.62 | 3.96 | 1112 |
|
Perceived trust in physician score (ACES) | |||||||
|
|
<4.00 (Least trust in physician) | 12.26c | 28.42 | 16.52 | 38.54 | 4.26 | 563 |
|
|
4.00-4.99 | 12.55 | 27.26 | 17.54 | 37.92 | 4.72 | 741 |
|
|
5.00-5.99 | 9.65 | 21.33 | 15.00 | 48.56 | 5.47 | 1627 |
|
|
6.00 (Greatest trust in physician) | 10.03 | 15.55 | 10.47 | 60.75 | 3.20 | 907 |
|
Self-rated health status | |||||||
|
|
Good or excellent | 10.74 | 22.55 | 14.46 | 47.71 | 4.55 | 3362 |
|
|
Fair or poor | 10.27 | 19.71 | 15.61 | 49.28 | 5.13 | 487 |
aRow percentages total 100%.
bChi-square test for between group difference result P<.001.
cChi-square test for between group difference result P<.01.
dQuartiles of PEPPI score (Perceived Efficacy in Patient-Physician Interactions); lower score indicates less self-confidence about communicating with their doctor [28].
eNon-White race/ethnicity categorized as aggregate of Black or African American; American Indian or Alaska Native; Asian; Native Hawaiian or Pacific Islander; Other.
Following multivariable adjustment, differences according to gender, race/ethnicity, and confidence in communication remained significant (Table 2). Women were more likely to be concerned about privacy than men (adjusted OR 1.18, 95% CI 1.03-1.36). Non-white patients had greater concerns than white patients (adjusted OR 1.56, 95% CI 1.21-2.01). Patients who had less self-confidence about communicating with their doctors, based on their PEPPI scores, were more concerned about privacy than others who had more self-confidence about communication (adjusted OR 1.72, 95% CI 1.41-2.09 comparing lowest quartile to highest quartile of PEPPI score).
Table 2.
Variable | Odds ratio | 95% CI | |
Age |
|
|
|
|
Under 55 years old | 1.00 |
|
|
55 years old or older | 1.04 | (0.90-1.19) |
Sex |
|
|
|
|
Male | 1.00 |
|
|
Female | 1.18 | (1.03-1.36) |
Race/Ethnicity |
|
|
|
|
White | 1.00 |
|
|
Non-White | 1.56 | (1.21-2.01) |
Education |
|
|
|
|
College graduate | 1.00 |
|
|
Some college | 0.93 | (0.79-1.10) |
|
High School/GED or less | 1.07 | (0.89-1.30) |
Frequency of Internet use |
|
|
|
|
|
|
|
|
Daily | 1.00 |
|
|
Biweekly | 1.53 | (1.17-2.00) |
|
Once per week | 1.12 | (0.72-1.75) |
|
Every 2 weeks | 1.18 | (0.82-1.70) |
|
Not at all | 1.09 | (0.53-2.24) |
PEPPI b |
|
|
|
|
Q4 (Highest confidence communicating with doctor) | 1.00 |
|
|
Q3 | 1.40 | (1.15-1.69) |
|
Q2 | 1.51 | (1.25-1.83) |
|
Q1 (Lowest confidence communicating with doctor) | 1.72 | (1.41-2.09) |
aAdjusted odds ratios from multivariable adjusted logistic regression models including all of the variables in the table; model estimates odds of patient responding “agree” or “somewhat agree” with statement: “If I could read my doctors’ notes, I would be concerned about my privacy” on the baseline survey.
bQuartiles of PEPPI score (Perceived Efficacy in Patient-Physician Interactions) [28].
Privacy Concerns and Use/Perception of OpenNotes
Baseline concerns about privacy were not associated with whether or not patients reported that they accessed their notes during the intervention or shared their notes with others (Table 3). Similarly, 99% of patients wanted continued access to their notes after the intervention concluded, regardless of concerns about privacy at baseline. At the end of the study, only 27 patients (1%) disagreed with the statement “having online access to my doctor’s notes is a good idea.” Among this very small subgroup, 8 patients (30%) were concerned about privacy.
Table 3.
|
Total, n (%) | Agree/ Somewhat agree, n (%) | Disagree/ Somewhat disagree, n (%) | Don’t know, n (%) | P a | |
Baseline survey privacy concerns | 3874 (100) | 1275 (32.91) | 2418 (62.42) | 181 (4.67) |
|
|
Post-survey question/ statement |
|
|
|
|
|
|
OpenNotes is a good idea | ||||||
|
Agree/Somewhat agree | 3828 (98.81) | 1264 (99.14) | 2387 (98.72) | 177 (97.79) | .40 |
|
Disagree/Somewhat disagree | 27 (0.70) | 8 (0.63) | 17 (0.70) | 2 (1.10) |
|
|
Don’t know | 19 (0.49) | 3 (0.23) | 14 (0.58) | 2 (1.10) |
|
Did you look at your visit notes? | ||||||
|
Yes | 3832 (98.91) | 1258 (98.67) | 2394 (99.01) | 180 (99.45) | .70 |
|
No | 41 (1.06) | 17 (1.33) | 23 (0.95) | 1 (0.55) |
|
|
Don’t know | 1 (0.03) | 0 (0.0) | 1 (0.04) | 0 (0.0) |
|
Did you share or discuss your notes with others? | ||||||
|
Yes | 796 (20.55) | 240 (18.82) | 520 (21.51) | 36 (19.89) | .22 |
|
No | 3018 (77.90) | 1017 (79.76) | 1861 (76.96) | 140 (77.35) |
|
|
Don’t know | 60 (1.55) | 18 (1.41) | 37 (1.53) | 5 (2.76) |
|
Do you want OpenNotes to continue? | ||||||
|
Yes | 3834 (98.97) | 1266 (99.29) | 2389 (98.80) | 179 (98.90) | .36 |
|
No | 40 (1.03) | 9 (0.71) | 29 (1.20) | 2 (1.10) |
|
a P values derived from chi-square test.
Privacy Concerns at Baseline and Post-Intervention
We found a modest increase in reported concerns about privacy following the intervention, with 32.91% (1275/3874) of patients concerned at baseline, and 36.63% (1419/3874) concerned after the intervention (χ2 stat=436.4; P<.001; Figure 1).
For most patients, individual responses regarding privacy concern did not change over the course of the study period: 19% (750/3874) of patients reported concern at both baseline and post-intervention, and 45% (1757/3874) consistently reported none or little concern at baseline and post-intervention (Figure 2).
However, 28% (1095/3874) of patients reported changes in their level of concern from the beginning to the end of the study (see Multimedia Appendix 3 for individual patient responses at baseline versus their responses post-intervention). Patients who were concerned about privacy at baseline but not concerned post-intervention (12.73%, 493/3874) were slightly more likely to be younger or female compared to those whose level of concern remained unchanged (χ2 stat=7.50; P=.006; χ2 stat=8.63; P=.003; data not shown). In contrast, those whose attitudes shifted from being not concerned at baseline to being concerned post-intervention (15.54%, 602/3874) were slightly more likely to be older than those whose level of concern remained constant (χ2 stat=16.66; P<.001; data not shown). Other attitudes and behaviors—for example, whether or not patients read their notes, wanted continued access to their notes, thought online access was a good idea, or shared their notes with others—were not significantly associated with changes in patients’ attitudes toward privacy (data not shown).
Discussion
Principal Findings
Overall, approximately one-third of patients at baseline reported concerns about privacy when considering gaining online access to their doctors’ visit notes. Nevertheless, this did not deter patients from accessing their notes and other medical information. Rather, nearly all patients wanted access to continue after the intervention despite the fact that nearly a third continued to worry about privacy. These findings are consistent with prior literature suggesting that patients want easy online access to their health information, despite concerns that might accompany such access [1,11,15,17,29].
The advancement of technologies such as patient portals carries the potential for a digital divide [30-36]. In our study sample that largely comprised experienced portal users, baseline concerns about privacy were more likely among individuals of non-white race/ethnicity, people reporting lower levels of self-confidence in communication, and those with less trust in their doctors. Lower education levels were also modestly associated with concerns about privacy. These associations are consistent with prior literature indicating that patients in these sociodemographic groups are, on the whole, less likely to enroll in patient portals and share personal health information [1,16,20,30-32,37,38]. Future research should consider whether worries regarding privacy might increase barriers to enrollment in patient portals among vulnerable populations, what factors associated with these sociodemographic groups contribute to privacy concerns, and how such concerns can be addressed.
Our study describes patients’ attitudes toward privacy before and after gaining online access to their doctors’ notes; however, it does not explore the reasons behind their concerns. The word “privacy” in itself carries different meanings for different people, and it may matter more to those who feel well than to individuals who are chronically or emergently ill [3,11]. But why did some patients become more concerned about privacy after a year’s experience with OpenNotes, while others became less concerned? Did their mode of access (eg, home computer, mobile device, shared computer in a library or other public space) influence levels of concern about privacy? As patient portals become more prevalent, doctors’ notes may become a common record component included in the information available to patients online. As such, how can doctors, administrators, and policy makers better address the future portal needs of patients, and how can they ensure that patients feel safe and secure logging on to read what the doctor has written?
Limitations
While this research study gathered perspectives from 3874 patients at three diverse sites and included highly vulnerable patients, several limitations should be highlighted. First, participants at two sites (BIDMC and GHS) had been using patient portals before the study began and may be considered early and experienced adopters of such technology. Other literature demonstrates that individuals who use patient portals are typically less worried about privacy than nonusers [6,10], suggesting that the levels of concern reported by a substantial proportion of our respondents may not represent the general population. Nonetheless, while HMC patients received access to online health records for the first time through OpenNotes, they reported levels of concern on par with the average level of concern of registered portal users across study sites (approximately 33%; see Table 1).
In addition, the percentage of participants responding to both the pre- and post-intervention surveys was low, albeit consistent with other Internet-based surveys of patients [3]. And finally, while the topic of privacy was addressed in focus groups with patients before developing our survey [26] (a finding consistent with other focus group research on patient portals [39]) and the survey questions were vetted prior to administration, it is important to reiterate that the phrasing of the privacy question was used for the first time in the OpenNotes survey. Patients may not distinguish between the privacy risks of digitizing their health records (eg, hospital breaches of data security) and the risks of accessing those records online (eg, forgetting to log off a public computer, printing sensitive information). As a result, self-reported concerns about privacy may reflect diverse interpretations of potential associated risks.
Conclusions
As patient portals and shared medical records proliferate, health professionals need to be aware of patients’ feelings about privacy. Our findings suggest that concerns about privacy among portal users do not deter them from accessing their visit notes and health information online. However, our findings also highlight the need to identify and address such concerns among specific demographic groups, particularly racial and ethnic minorities, patients with lower levels of education, and those with less trust in their doctors and lower confidence in their ability to communicate with them. If efforts to involve patients more actively in their care through Internet-based technologies are to move ahead, we need a far deeper understanding of the complex nature of “privacy” and how it interacts with the transparency that open visit notes represent.
Acknowledgments
The primary funding sources for this project were Robert Wood Johnson Foundation’s Pioneer Portfolio, Drane Family Fund, Koplow Charitable Foundation, and National Cancer Institute grant K05CA104699 (J Elmore).
Abbreviations
- ACES
Ambulatory Care Experiences Survey
- BIDMC
Beth Israel Deaconess Medical Center
- GED
General Educational Development test of high-school level academic skills
- GHS
Geisinger Health System
- HMC
Harborview Medical Center
- OR
odds ratio
- PEPPI
Perceived Efficacy in Patient-Physician Interactions score
Multimedia Appendix 1
Baseline survey instrument.
Multimedia Appendix 2
Post-intervention survey instrument.
Multimedia Appendix 3
Individual patient matched baseline and post-intervention response to survey question: "I am concerned about my privacy" (N=3874).
Footnotes
Conflicts of Interest: None declared.
References
- 1.Wen KY, Kreps G, Zhu F, Miller S. Consumers' perceptions about and use of the internet for personal health records and health information exchange: analysis of the 2007 Health Information National Trends Survey. J Med Internet Res. 2010;12(4):e73. doi: 10.2196/jmir.1668. http://www.jmir.org/2010/4/e73/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Zulman DM, Nazi KM, Turvey CL, Wagner TH, Woods SS, An LC. Patient interest in sharing personal health record information: a web-based survey. Ann Intern Med. 2011 Dec 20;155(12):805–10. doi: 10.7326/0003-4819-155-12-201112200-00002. [DOI] [PubMed] [Google Scholar]
- 3.Hassol A, Walker JM, Kidder D, Rokita K, Young D, Pierdon S, Deitz D, Kuck S, Ortiz E. Patient experiences and attitudes about access to a patient electronic health care record and linked web messaging. J Am Med Inform Assoc. 2004;11(6):505–13. doi: 10.1197/jamia.M1593. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=15299001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ralston JD, Hirsch IB, Hoath J, Mullen M, Cheadle A, Goldberg HI. Web-based collaborative care for type 2 diabetes: a pilot randomized trial. Diabetes Care. 2009 Feb;32(2):234–9. doi: 10.2337/dc08-1220. http://europepmc.org/abstract/MED/19017773. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Simon SR, Evans JS, Benjamin A, Delano D, Bates DW. Patients' attitudes toward electronic health information exchange: qualitative study. J Med Internet Res. 2009;11(3):e30. doi: 10.2196/jmir.1164. http://www.jmir.org/2009/3/e30/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Undem T. California HealthCare Foundation. Oakland, CA: 2010. Apr, [2012-03-06]. Consumers and Health Information Technology: A National Survey http://www.chcf.org/~/media/MEDIA%20LIBRARY%20Files/PDF/C/PDF%20ConsumersHealthInfoTechnologyNationalSurvey.pdf. [Google Scholar]
- 7.Patel VN, Abramson E, Edwards AM, Cheung MA, Dhopeshwarkar RV, Kaushal R. Consumer attitudes toward personal health records in a beacon community. Am J Manag Care. 2011 Apr;17(4):e104–20. http://www.ajmc.com/pubMed.php?pii=48672. [PubMed] [Google Scholar]
- 8.Woods SS, Schwartz E, Tuepker A, Press NA, Nazi KM, Turvey CL, Nichol W. Patient experiences with full electronic access to health records and clinical notes through the My HealtheVet Personal Health Record Pilot: qualitative study. J Med Internet Res. 2013;15(3):e65. doi: 10.2196/jmir.2356. http://www.jmir.org/2013/3/e65/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Agarwal R, Anderson C, Zarate J, Ward C. If we offer it, will they accept? Factors affecting patient use intentions of personal health records and secure messaging. J Med Internet Res. 2013;15(2):e43. doi: 10.2196/jmir.2243. http://www.jmir.org/2013/2/e43/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Markle Foundation. 2008. Jun 01, [2012-02-21]. Americans overwhelmingly believe electronic personal health records could improve their health http://www.markle.org/sites/default/files/ResearchBrief-200806.pdf.
- 11.Walker J, Ahern DK, Le LX, Delbanco T. Insights for internists: "I want the computer to know who I am". J Gen Intern Med. 2009 Jun;24(6):727–32. doi: 10.1007/s11606-009-0973-1. http://europepmc.org/abstract/MED/19412641. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Fontaine P, Ross SE, Zink T, Schilling LM. Systematic review of health information exchange in primary care practices. J Am Board Fam Med. 2010;23(5):655–70. doi: 10.3122/jabfm.2010.05.090192. http://www.jabfm.org/cgi/pmidlookup?view=long&pmid=20823361. [DOI] [PubMed] [Google Scholar]
- 13.Kaelber DC, Jha AK, Johnston D, Middleton B, Bates DW. A research agenda for personal health records (PHRs) J Am Med Inform Assoc. 2008;15(6):729–36. doi: 10.1197/jamia.M2547. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=18756002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Reti SR, Feldman HJ, Ross SE, Safran C. Improving personal health records for patient-centered care. J Am Med Inform Assoc. 2010;17(2):192–5. doi: 10.1136/jamia.2009.000927. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=20190063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kahn JS, Hilton JF, Van Nunnery T, Leasure S, Bryant KM, Hare CB, Thom DH. Personal health records in a public hospital: experience at the HIV/AIDS clinic at San Francisco General Hospital. J Am Med Inform Assoc. 2010;17(2):224–8. doi: 10.1136/jamia.2009.000315. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=20190069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Teixeira PA, Gordon P, Camhi E, Bakken S. HIV patients' willingness to share personal health information electronically. Patient Educ Couns. 2011 Aug;84(2):e9–12. doi: 10.1016/j.pec.2010.07.013. http://europepmc.org/abstract/MED/20724095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Chhanabhai P, Holt A. Consumers are ready to accept the transition to online and electronic records if they can be assured of the security measures. MedGenMed. 2007;9(1):8. http://www.medscape.com/viewarticle/549468. [PMC free article] [PubMed] [Google Scholar]
- 18.Powell J, Fitton R, Fitton C. Sharing electronic health records: the patient view. Inform Prim Care. 2006;14(1):55–7. doi: 10.14236/jhi.v14i1.614. [DOI] [PubMed] [Google Scholar]
- 19.Halamka JD, Mandl KD, Tang PC. Early experiences with personal health records. J Am Med Inform Assoc. 2008;15(1):1–7. doi: 10.1197/jamia.M2562. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=17947615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Wagner PJ, Dias J, Howard S, Kintziger KW, Hudson MF, Seol YH, Sodomka P. Personal health records and hypertension control: a randomized trial. J Am Med Inform Assoc. 2012;19(4):626–34. doi: 10.1136/amiajnl-2011-000349. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=22234404. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Ralston JD, Martin DP, Anderson ML, Fishman PA, Conrad DA, Larson EB, Grembowski D. Group health cooperative's transformation toward patient-centered access. Med Care Res Rev. 2009 Dec;66(6):703–24. doi: 10.1177/1077558709338486. [DOI] [PubMed] [Google Scholar]
- 22.Delbanco T, Walker J, Darer JD, Elmore JG, Feldman HJ, Leveille SG, Ralston JD, Ross SE, Vodicka E, Weber VD. Open notes: doctors and patients signing on. Ann Intern Med. 2010 Jul 20;153(2):121–5. doi: 10.7326/0003-4819-153-2-201007200-00008. [DOI] [PubMed] [Google Scholar]
- 23.Delbanco T, Walker J, Bell SK, Darer JD, Elmore JG, Farag N, Feldman HJ, Mejilla R, Ngo L, Ralston JD, Ross SE, Trivedi N, Vodicka E, Leveille SG. Inviting patients to read their doctors' notes: a quasi-experimental study and a look ahead. Ann Intern Med. 2012 Oct 2;157(7):461–70. doi: 10.7326/0003-4819-157-7-201210020-00002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Walker J, Leveille SG, Ngo L, Vodicka E, Darer JD, Dhanireddy S, Elmore JG, Feldman HJ, Lichtenfeld MJ, Oster N, Ralston JD, Ross SE, Delbanco T. Inviting patients to read their doctors' notes: patients and doctors look ahead: patient and physician surveys. Ann Intern Med. 2011 Dec 20;155(12):811–9. doi: 10.7326/0003-4819-155-12-201112200-00003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Leveille SG, Walker J, Ralston JD, Ross SE, Elmore JG, Delbanco T. Evaluating the impact of patients' online access to doctors' visit notes: designing and executing the OpenNotes project. BMC Med Inform Decis Mak. 2012;12:32. doi: 10.1186/1472-6947-12-32. http://www.biomedcentral.com/1472-6947/12/32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Dhanireddy S, Walker J, Reisch L, Oster N, Delbanco T, Elmore JG. The urban underserved: attitudes towards gaining full access to electronic medical records. Health Expect. 2012 Jun 28; doi: 10.1111/j.1369-7625.2012.00799.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Safran DG, Karp M, Coltin K, Chang H, Li A, Ogren J, Rogers WH. Measuring patients' experiences with individual primary care physicians. Results of a statewide demonstration project. J Gen Intern Med. 2006 Jan;21(1):13–21. doi: 10.1111/j.1525-1497.2005.00311.x. http://europepmc.org/abstract/MED/16423118. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Maly RC, Frank JC, Marshall GN, DiMatteo MR, Reuben DB. Perceived efficacy in patient-physician interactions (PEPPI): validation of an instrument in older persons. J Am Geriatr Soc. 1998 Jul;46(7):889–94. doi: 10.1111/j.1532-5415.1998.tb02725.x. [DOI] [PubMed] [Google Scholar]
- 29.Nazi KM, Hogan TP, McInnes DK, Woods SS, Graham G. Evaluating patient access to Electronic Health Records: results from a survey of veterans. Med Care. 2013 Mar;51(3 Suppl 1):S52–6. doi: 10.1097/MLR.0b013e31827808db. [DOI] [PubMed] [Google Scholar]
- 30.Lyles CR, Harris LT, Jordan L, Grothaus L, Wehnes L, Reid RJ, Ralston JD. Patient race/ethnicity and shared medical record use among diabetes patients. Med Care. 2012 May;50(5):434–40. doi: 10.1097/MLR.0b013e318249d81b. [DOI] [PubMed] [Google Scholar]
- 31.Weingart SN, Rind D, Tofias Z, Sands DZ. Who uses the patient internet portal? The PatientSite experience. J Am Med Inform Assoc. 2006;13(1):91–5. doi: 10.1197/jamia.M1833. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=16221943. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Sarkar U, Karter AJ, Liu JY, Adler NE, Nguyen R, Lopez A, Schillinger D. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system-results from the diabetes study of northern California (DISTANCE) J Health Commun. 2010;15 Suppl 2:183–96. doi: 10.1080/10810730.2010.499988. http://europepmc.org/abstract/MED/20845203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Fowles JB, Kind AC, Craft C, Kind EA, Mandel JL, Adlis S. Patients' interest in reading their medical record: relation with clinical and sociodemographic characteristics and patients' approach to health care. Arch Intern Med. 2004 Apr 12;164(7):793–800. doi: 10.1001/archinte.164.7.793. [DOI] [PubMed] [Google Scholar]
- 34.Ammenwerth E, Schnell-Inderst P, Hoerbst A. The impact of electronic patient portals on patient care: a systematic review of controlled trials. J Med Internet Res. 2012;14(6):e162. doi: 10.2196/jmir.2238. http://www.jmir.org/2012/6/e162/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Yamin CK, Emani S, Williams DH, Lipsitz SR, Karson AS, Wald JS, Bates DW. The digital divide in adoption and use of a personal health record. Arch Intern Med. 2011 Mar 28;171(6):568–74. doi: 10.1001/archinternmed.2011.34. [DOI] [PubMed] [Google Scholar]
- 36.Horvath M, Levy J, L'Engle P, Carlson B, Ahmad A, Ferranti J. Impact of health portal enrollment with email reminders on adherence to clinic appointments: a pilot study. J Med Internet Res. 2011;13(2):e41. doi: 10.2196/jmir.1702. http://www.jmir.org/2011/2/e41/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Lyles CR, Sarkar U, Ralston JD, Adler N, Schillinger D, Moffet HH, Huang ES, Karter AJ. Patient-provider communication and trust in relation to use of an online patient portal among diabetes patients: The Diabetes and Aging Study. J Am Med Inform Assoc. 2013 May 15; doi: 10.1136/amiajnl-2012-001567. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Goel MS, Brown TL, Williams A, Cooper AJ, Hasnain-Wynia R, Baker DW. Patient reported barriers to enrolling in a patient portal. J Am Med Inform Assoc. 2011 Dec;18 Suppl 1:i8–12. doi: 10.1136/amiajnl-2011-000473. http://jamia.bmj.com/cgi/pmidlookup?view=long&pmid=22071530. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Luque AE, van Keken A, Winters P, Keefer MC, Sanders M, Fiscella K. Barriers and Facilitators of Online Patient Portals to Personal Health Records Among Persons Living With HIV: Formative Research. JMIR Res Protoc. 2013;2(1):e8. doi: 10.2196/resprot.2302. [DOI] [PMC free article] [PubMed] [Google Scholar]