Summary
The US government allocated $30 billion to implement electronic health records (EHRs) in hospitals and provider practices through policy addressing Meaningful Use (MU). Most small, rural hospitals, particularly those designated as Critical Access Hospitals (CAHs), comprising nearly a quarter of US hospitals, had not implemented EHRs before. Little is known about implementation in this setting. Socio-technical factors differ between larger hospitals and CAHs, which continue to lag behind other hospitals in EHR adoption.
Objective
The main objective is to provide EHR implementation advice for CAHs from a spectrum of experts with an emphasis on recommendations from their peers at CAHs that have undertaken the process. The secondary objective is to begin to identify implementation process differences at CAHs v. larger hospitals.
Methods
We interviewed 41 experts, including 16 CAH staff members from EHR teams at 10 CAHs that recently implemented EHRs. We qualitatively analyzed the interviews to ascertain themes and implementation recommendations.
Results
Nineteen themes emerged. Under each theme, comments by experts provide in-depth advice on all implementation stages including ongoing optimization and use. We present comments for three top themes as ranked by number of CAH peer experts commenting – EHR System Selection, EHR Team, and Preparatory Work – and for two others, Outside Partners/Resources and Clinical Decision Support (CDS)/Knowledge Management (KM). Comments for remaining themes are included in tables.
Discussion
CAH experts rank the themes differently from all experts, a likely indication of the differences between hospitals. Comments for each theme indicate the specific difficulties CAHs encountered. CAH staffs have little or no EHR experience before implementation. A factor across themes is insufficient system and process knowledge, compounded by compressed implementation schedules. Increased, proactive self-education, via available outside partners and information resources, will mitigate difficulties and aid CAHs in meeting increased CDS requirements in MU Stages 2 and 3.
Key words: Electronic health records, rural hospitals, critical access hospitals, qualitative research, medical informatics
Introduction
In 2010, the US began its national rollout of certified, integrated electronic health record systems (EHRs) through which hospitals and providers adopt and use EHRs according to reporting criteria known as Meaningful Useful (MU), mandated and funded by the 2009 HITECH Act portion of the American Recovery and Reinvestment Act [1]. Before 2010, “Only 11.9% of US hospitals had basic or comprehensive EHRs, and most were larger, urban academic hospitals, which can mandate use by providers.8 Although 86% of US hospitals are community hospitals,9 only 6.9% of them had even a basic clinical information system.10” [2] The US government wants all smaller hospitals, including the 1,328 Critical Access Hospitals (CAHs) [3], which comprise nearly a quarter of US hospitals [4], to implement integrated EHRs so that clinical quality improvements from such systems would benefit all sections of the population, including the 21% that are rural [5]. CAH is a special US federal designation; CAHs are certified to receive cost per service plus 1% reimbursement from Medicare, as opposed to the prospective payment that other hospitals receive [3]. CAHs must be located in rural areas and meet the following criteria: be located greater than 35 miles from another hospital – 15 miles in mountainous terrain or areas with only secondary roads; provide 24-hour emergency services, with medical staff on-site or an on-call staff available on-site within 30 minutes, 60 minutes if certain frontier area criteria are met; have a maximum of 25 acute care and swing beds; and maintain an annual average length of stay of 96 hours or less for acute care patients [3].
Rural and small hospitals have been adopting EHRs to meet MU, receive reimbursements for system costs and avoid Medicare reimbursement penalties, but “they are lagging behind larger and urban hospitals. In 2012, 66.5% of all rural and 61.7% of small hospitals still had no EHR” [6]. In 2011, only 113 CAHs had completed attestation reporting for MU Stage 1 [7]. According to the Office of the National Coordinator for Health Information Technology (ONC), a combined total of 591 CAHs and other small rural hospitals received MU incentive payments in 2012 [8]. The authors conducted a comparison of lists of current CAHs [9] and all hospitals as of December 31, 2012 to receive MU incentive payments [10]. The results show that 228 (± 4) CAHs have received incentive payments. This does not include those CAHs that attested to MU Stage 1 by the Nov. 30, 2012, deadline but have yet to receive incentive payments.
Even if 200 more CAHs attested to MU Stage 1 in November 2012, this would indicate that approximately 900 of the 1,328 CAHs are in process or have yet to begin EHR implementation. One of two main conclusions in a Robert Wood Johnson Foundation-funded study (July 2013), Early Results from the Electronic Health Record Incentive Programs, is that “Lower rates of participation among smaller hospitals and Critical Access Hospitals merit close monitoring to ensure that broad adoption is achieved” [11]. Although CAHs are the focus here, it is of international importance that in the coming years many similarly small, rural hospitals will undertake EHR implementation to meet the World Health Organization (WHO) health information technology (HIT) adoption recommendations for member states [12].
As EHRs were adopted in larger hospitals, two consensus studies [13, 14] and some multi-hospital field studies on implementation processes were conducted [15, 16], along with many case reports [17, 18]. Socio-technical factors, which drive and impact implementation processes, are emerging as the determinants of successful HIT adoption [19].
Many factors differ between larger hospitals and CAHs, which have smaller facility and staff sizes; limited services; fewer beds; few hospitalists; many part-time nursing staff, “prn” nurses who are scheduled only occasionally; flat management structures; and much lower total margins [20]. Advice about implementing an EHR in CAHs and similar small, rural hospitals might be different from what has been learned from larger hospitals [13–16, 21] or focus on specific aspects. Therefore, as part of a larger, ongoing study examining EHR implementation planning and preparation processes at CAHs, we interviewed 41 key informants to learn what aspects of implementation they have the most concerns about and gather the advice they would give to CAHs. The aim here is translational: To disseminate evidence-based findings from the informatics research realm to frontline staff at CAHs and other small, rural hospitals, who are or soon will be implementing EHRs. Of necessity, these staff must rapidly become knowledgeable about applied clinical informatics. Although this study and the larger work of which it is a part begin to identify differences between implementation processes at CAHs and larger hospitals, the primary objective of this study is to distill expert implementation advice for CAHs with an emphasis on peer experts from CAHs, whose input is new within informatics discussions. The primary goal is to inform and benefit frontline staff at small, rural hospitals and other stakeholders who participate in and influence their implementation processes.
Methods
Other studies have included interviews with operational experts but often rely on a single category of expert, and the focus has been larger hospitals [21]. We selected 41 experts from across a wide spectrum of categories and included newly minted operational informatics peer experts – those staff at CAHs who have recently implemented EHRs. These experts represented multiple stakeholders familiar with all facets of the implementation process. The spectrum of experts included:
Sixteen peer experts (seven Chief Executive Officers, one Chief Operating Officer, three Directors of Nursing, three IT Directors, one HIM Director, one Registered Nurse) from ten CAHs (in Kansas [one], Minnesota [three], Missouri [two], Nebraska [three], and North Dakota [one]) who have recently participated on EHR teams and implemented EHRs;
Three vendor representatives from companies with large CAH market shares (at CPSI, Health-land, Quadramed);
Seven implementation experts from vendors of systems for community and larger hospitals (at Allscripts, Cerner, Siemens);
Six consultants working in the EHR market (at Deloitte Consulting, LLP; Collaborative Health Systems, LLC; Clinical Information Systems Consulting, LLC; SISU Medical Solutions, LLC; Quammen Healthcare Consultants);
Three staff members working with CAHs at Regional Extension Centers for HIT (RECs) (in Illinois, Kansas, Tennessee);
Two people in positions to affect national EHR policy (ONC’s Deputy National Coordinator for Programs and Policy; National Quality Forum’s Vice President for HIT);
Four internationally recognized researchers in clinical informatics and health information technology policy (at Harvard Medical School, Oregon Health and Science University, University of Pennsylvania).
Our project used qualitative research methods. Each expert was interviewed individually via telephone and the conversation was recorded. Each was asked two questions:
What are the things you’d want to know most about the planning and preparation processes for EHR implementation at CAHs? Name two.
What advice would you give CAHs on the planning and preparation processes for EHR implementation?
In addition, demographic questions were asked regarding the participants’ current positions, years of experience, and educational background. Peer experts were asked additional questions regarding their role in EHR implementation at their CAH, when implementation occurred, with which vendor, and whether or not the CAH had attested successfully to MU Stage 1. These questions were asked primarily to verify experience. There were no pre-determined prompts for the two main questions, but rather the interviewing author (CC) probed areas of importance to participants as they arose, and after main responses, areas not mentioned.
Phone interviews were conducted during two periods, December 2011-June 2012 and January 2013. An initial analysis was conducted on interviews from the first period, which resulted in 19 themes [22]. During the second period, ten additional people were interviewed to ensure data saturation from those directly involved in implementation at CAHs: Nine more peer experts and a consultant working with CAHs. We wanted to see if additional themes were generated, if the ordering of themes’ importance by numbers of respondents commenting would change, and if additional recommendations were brought forth.
Transcripts were prepared from each interview, and methods standard for grounded theory were followed for qualitative coding analysis [23]. The first author (CC) manually conducted in vivo coding on the transcripts to extract experts’ comments in their own words, and a second author (MS) reviewed the coding to reach agreement [24]. A second round of focused coding by these authors produced themes that emerged from the data and allowed grouping of comments by theme [24]. University of Missouri’s Health Sciences Institutional Review Board approved the study.
Results
Nineteen themes were generated from expert comments:
EHR Team;
Communication;
Clinician/Physician Buy-in/Ownership;
Budget/Financial Resources;
EHR System Selection;
Preparatory Work;
Technology;
Optimization/Ongoing Work;
Outside Partners/Information Resources;
EHR Training/Go-live Support;
Workflow/Productivity;
Project Management;
Purpose/Goals;
Leadership;
Change/Encouragement;
Policy/Meaningful Use;
Governance;
System Install/Go-live;
Clinical Decision Support/Knowledge Management.
▶ Table 1 presents, by category, the number of experts who made comments that comprise each theme. No new themes arose from the second round of interviews and analysis; however, the overall ordering of the themes shifted. What is most striking is the difference between how the themes are ranked by number of all experts commenting versus a breakout of how themes are ranked by number of CAH peer experts who commented. See ▶ Table 2 for a full comparison of these theme rankings before and after the second round of data collection and analysis.
Table 1.
The 19 themes generated in order by total number of commenters (total number of commenters in parentheses) | Total number of commenters (41) | CAH Peer Experts (16) | CAH Vendor Staff (3) | Community and Larger Hospital Vendor Staff (7) | Consultants (6) | REC Staff (3) | National Policy Experts (2) | Informatics and HIT Policy Researchers (4) |
---|---|---|---|---|---|---|---|---|
1. EHR Team | 18 | 6 | 2 | 3 | 3 | 2 | 1 | 1 |
2. Communication | 16 | 6 | 1 | 6 | 1 | 1 | 0 | 1 |
3. Clinician/Physician Buy-in/Ownership | 12 | 2 | 2 | 0 | 4 | 1 | 1 | 2 |
4. EHR System Selection | 11 | 7 | 0 | 1 | 2 | 0 | 1 | 0 |
5. Preparatory Work | 11 | 5 | 2 | 3 | 1 | 0 | 0 | 0 |
6. Budget/Financial Resources | 11 | 4 | 1 | 2 | 3 | 1 | 0 | 0 |
7. Technology | 10 | 5 | 1 | 1 | 1 | 1 | 0 | 1 |
8. Outside Partners/Information Resources | 9 | 4 | 0 | 0 | 2 | 1 | 0 | 2 |
9. Optimization/Ongoing Work | 9 | 2 | 1 | 1 | 1 | 0 | 2 | 2 |
10. EHR Training/Go-live Support | 8 | 4 | 1 | 1 | 0 | 0 | 0 | 2 |
11. Workflow/Productivity | 8 | 3 | 1 | 0 | 1 | 0 | 1 | 2 |
12. Project Management | 8 | 2 | 0 | 2 | 2 | 0 | 0 | 2 |
13. Purpose/Goals | 8 | 1 | 2 | 2 | 2 | 0 | 1 | 0 |
14. Leadership | 8 | 1 | 1 | 2 | 2 | 0 | 0 | 2 |
15. Change/Encouragement | 6 | 3 | 0 | 1 | 1 | 0 | 0 | 1 |
16. Policy/Meaningful Use | 6 | 3 | 0 | 0 | 1 | 1 | 1 | 0 |
17. System Install/Go-live | 4 | 2 | 1 | 1 | 0 | 0 | 0 | 0 |
18. Governance | 4 | 0 | 1 | 2 | 1 | 0 | 0 | 0 |
19. Clinical Decision Support/Knowledge Management | 2 | 0 | 0 | 0 | 0 | 0 | 1 | 1 |
Table 2.
Results after First Round of Interviews | Results after Second Round of Interviews | ||||||
---|---|---|---|---|---|---|---|
Themes ordered by no. of all commenters | Total no. of commenters (31) |
Themes ordered by no. of CAH peer expert commenters | No. of CAH peers (7) | Themes ordered by no. of all commenters | Total no. of commenters (41) | Themes ordered by no. of CAH peer expert commenters | No. of CAH peers (16) |
1. EHR Team | 14 | 1. Preparatory Work | 3 | 1. EHR Team | 18 | 1. EHR System Selection | 7 |
2. Communication | 11 | 2. EHR System Selection | 3 | 2. Communication | 16 | 2. EHR Team | 6 |
3. Clinician/Physician Buy-in/Ownership | 10 | 3. Technology | 3 | 3. Clinician/Physician Buy-in/Ownership | 12 | 3. Communication | 6 |
4. Preparatory Work | 9 | 4. EHR Team | 2 | 4. EHR System Selection | 11 | 4. Preparatory Work | 5 |
5. Optimization/Ongoing Work | 8 | 5. Budget/Financial Resources | 2 | 5. Preparatory Work | 11 | 5. Technology | 5 |
6. Budget/Financial Resources | 8 | 6. Outside Partners /Information Resources | 2 | 6. Budget/Financial Resources | 11 | 6. Budget/Financial Resources | 4 |
7. EHR System Selection | 7 | 7. Communication | 1 | 7. Technology | 10 | 7. Outside Partners/Information Resources | 4 |
8. Leadership | 7 | 8. Clinician /Physician Buy-in/Ownership | 1 | 8. Outside Partners/Information Resources | 9 | 8. EHR Training/Go-live Support | 4 |
9. Outside Partners/ Information Resources | 7 | 9. Optimization /Ongoing Work | 1 | 9. Optimization/Ongoing Work | 9 | 9. Workflow/Productivity | 3 |
10. Purpose/Goals | 7 | 10. Workflow/Productivity | 1 | 10. EHR Training/Go-live Support | 8 | 10. Change/Encouragement | 3 |
11. Technology | 7 | 11. EHR Training/Go-live Support | 1 | 11. Workflow/Productivity | 8 | 11. Policy/Meaningful Use | 3 |
12. Workflow/Productivity | 6 | 12. Change/Encouragement | 1 | 12. Project Management | 8 | 12. Clinician/Physician Buy-in/Ownership | 2 |
13. EHR Training/ Go-live Support |
5 | 13. Policy/Meaningful Use | 1 | 13. Purpose/Goals | 8 | 13. Optimization/Ongoing Work | 2 |
14. Project Management | 5 | 14. System Install/Go-live | 1 | 14. Leadership | 8 | 14. Project Management | 2 |
15. Governance | 4 | 15. Leadership | 0 | 15. Change/Encouragement | 6 | 15. System Install/Go-live | 2 |
16. Change/Encouragement | 4 | 16. Purpose/Goals | 0 | 16. Policy/Meaningful Use | 6 | 16. Purpose/Goals | 1 |
17. Policy/Meaningful Use | 3 | 17. Project Management | 0 | 17. System Install/Go-live | 4 | 17. Leadership | 1 |
18. System Install/Go-live | 3 | 18. Governance | 0 | 18. Governance | 4 | 18. Governance | 0 |
19. Clinical Decision Support/ Knowledge Management |
2 | 19. Clinical Decision Support/ Knowledge Management |
0 | 19. Clinical Decision Support/ Knowledge Management |
2 | 19. Clinical Decision Support/ Knowledge Management |
0 |
Although each theme includes interesting, useful comments, space limitations do not allow for all to be presented. Therefore, results presented below are for five selected themes: The first, second, and fourth themes as ranked by number of CAH peer experts who commented; the theme they ranked seventh, which is an intersection of peer experts and the other key informants on the value of outside expertise; and one theme important for ongoing MU stages on which no peers commented but other experts commented significantly. ▶ Table 3 (a-f) contains comments made for the remaining 14 themes. In this way, implementation suggestions for CAHs and small, rural hospitals from their own peers is emphasized in order of importance to those peers, followed by areas for discussion that peer experts might not realize yet will be of increasing importance. All distinct comments from all experts are included in the results to provide maximum input on these key themes. Comments comprise in-depth advice on multiple aspects of various implementation stages. All statements in the results section are direct quotes or closely paraphrased comments made by experts. A glossary of term definitions for frontline staff new to EHRs and their implementation is provided in ▶ Table 4.
Table 3a.
3. Communication |
---|
|
|
Table 3b.
5. Technology |
---|
|
|
6. Budget/Financial Resources |
|
|
Table 3c.
8. EHR Training/Go-live Support |
---|
|
|
9. Workflow/Productivity |
|
|
Table 3d.
10. Change/Encouragement |
---|
|
|
11. Policy/Meaningful Use |
|
|
12. Clinician/Physician Buy-in /Ownership |
|
|
Table 3e.
13. Optimization/Ongoing Work |
---|
|
|
14. Project Management |
|
|
15. System Install/Go-live |
|
|
Table 3f.
16. Purpose/Goals |
---|
|
|
17. Leadership |
|
|
18. Governance |
No CAH peer experts made comments for this theme. |
|
Table 4.
Build | A broad term covering work that the CAH staff must do for the vendor so that the EHR system can be finalized for installation and use. Some of the build process involves providing CAH-specific data in a vendor-requested format (e.g. putting the charge master and pharmacy formulary into spreadsheets). Other activities include creating electronic templates for nursing documentation or physician order entry within the EHR. These templates capture the work steps represented on the paper forms that the CAH staff currently uses. Which forms the CAH builds and how these connect will affect the look and navigation of the final EHR for role-specific tasks and the overall workflow as each type of patient moves through the system. |
Clinical Decision Support (CDS) | Is “HIT functionality that builds upon the foundation of an EHR to provide persons involved in care processes with general and person-specific information, intelligently filtered and organized, at appropriate times, to enhance health and health care.” [26] CDS, which is most often integrated into the CPOE module, can include the following: links to evidence-based reference sources; order templates updated with the latest best-practice treatments; alerts for drug-drug interactions, patient allergies and other reminders; relevant data presentation; and situation-specific flow sheets, and dashboards. [27] |
Go-Live | Date when the new system is turned on and CAH staff begins to use it. |
Integrated System | Is one in which the component modules effectively interact with each other to exchange data smoothly, without need for purchasing additional third-party interfaces to allow the components to interact. |
Interface | Software that allows two systems to “talk” to each other so that data can move between them. An interface is necessary between each of a vendor’s system modules, but these are usually built in. Additional interfaces are necessary between the vendor’s EHR system and any systems you already have (e.g. picture archiving and communication “PACS” or financial systems from other vendors). |
Interoperability | The ability of two or more systems or subcomponents to work together to exchange data correctly and smoothly. |
Knowledge Management (KM) | Is “the process of capturing, distributing, and effectively using knowledge,” [28] KM encompasses CDS components, and the KM questions for the vendor become how much responsibility for, access to, and control over these does the CAH team have, who will update these, how, and when? [29] |
Modules | Component parts of a system, such as the “nursing documentation” or “physician order entry” or “pharmacy” clinical applications within an integrated EHR system. Vendors also refer to subcomponents of a financial system, such as “accounts payable” or “third-party billing clearinghouse,” as modules. |
Network Drop | Places where there is a physical connection for a computer to connect with the network. The CAH will need to determine where additional drops might need to be installed for computer workstations to access the EHR, and when and where staff will use wireless devices and a wireless network to do so. |
Real-Time Dashboard | A type of automated reporting feature built into a user interface within a system that pulls in data from various modules in real time, so that the information displayed is up to date. Real-time dashboards can feature clinical or financial and other operations data. |
Super Users | CAH staff members trained by the vendor on the EHR system, or a specific module, in advance of others and usually in more depth. Super users then help train other staff members and serve as go-to resources when others have questions. |
Theme 1: EHR System Selection
CAH peer experts (7/16)
Take advantage of EHR selection assistance offered by your state’s Regional Extension Centers for HIT (RECs), state hospital associations, or other groups of hospitals.
Create a realistic, strategic decision matrix that is hospital-specific to evaluate each vendor considered.
Look at multiple systems; many CAHs default to the vendor that already provides their financial modules because it seems like the cheapest option, and they assume the clinical modules will integrate seamlessly with the financial modules.
Understand the difference between interfacing, and integrating with a single system, then make the case justifying the approach to take; one Missouri CEO said,
“We decided to scrap a clinical system we’d gotten the previous year in order to integrate and avoid more interfacing.”
Don’t assume that systems are box-ready. Ask vendors what must be “built” and what that means.
Ask vendors to show how a system does what they say it will do.
As part of the selection process, take a group of staff from various departments to visit one or more CAHs that use the system under consideration, observe how the system works, and ask about the staff’s stories of system “build,” installation, go-live and ongoing use.
Verify which stages of MU each module will help meet. As a Missouri IT Director said,
“Seeing it on paper or in a webinar is one thing; seeing it in the environment gives you an idea of how it’s really going to work.”
A Nebraska CEO said,
“It can be hard to pry people from their desks, but it paid off in the long run. We took 20 people on the road.”
Involve a physician in the selection process if possible.
All involved must understand and vet how the ordering process within CPOE (computerized provider/physician order entry) will work.
Ask if the ER system is the same as the inpatient system – will they have to re-enter any orders entered on the ER side if the patient is admitted? This issue makes physicians unhappy and can cause billing problems.
Others
Other respondents included one from the larger vendors, two consultants, and one policy expert.
Include in the selection process all stakeholders who will use the system.
Be aware that sales people are purposefully not trained in all functionality details because that would defeat the company’s sales purpose.
Find out how much flexibility is actually being offered regarding configurations, content, design options and user interfaces.
Ask the vendor what reports and real-time dashboards are offered to automate data currently collected and tracked for regulatory and internal reporting; this can help you find a return on investment in addition to meeting MU.
Theme 2: EHR Team
CAH peer experts (6/16)
It’s critical to form a strong EHR team including staff from across all hospital areas (e.g. financial, IT, Director of Nursing, surgery, lab, social services, quality assurance, radiology, health information management [HIM]).
You must have the IT Director and CEO on the team.
Include more people upfront who know processes, not just department heads, and include those who know the backend of clinical data flow, such as HIM.
Financial people must be on the team, even if the hospital chooses the same vendor that has provided the existing financial modules; the data flow into the financial modules will change, so the financial processes will be affected. As a Nebraska Director of IT noted, they experienced this, even though
“We’d had the same vendor’s financial system since 1996!”
Also, if there are project proponents, “cheerleaders,” on the team from various areas, these voices can express the same messages: Some staff might hear those voices better than the CEO’s.
More than one team member needs to learn key things, such as how to access the vendor’s predesigned order sets and tailor those. As a Missouri Director of Nursing said,
“If you don’t have backup, and someone leaves – they’re in the National Guard and have to head to Kandahar -- you’ll have a knowledge deficit.”
Get a commitment from a physician to participate at least in meetings about CPOE.
The whole team must meet regularly and frequently, weekly or more, as the process progresses.
Others
Other respondents included two from CAH vendors, three from larger vendors, three consultants, two REC staff, one policy expert, and one researcher.
Have a large, diversified team with CEO, managers, senior clinicians, and broad representation from each department including those who know work processes.
The team must explicitly identify who from the team is the project leader and who will be the “owner” of each module, who makes sure that module gets built correctly and staff are properly trained; the IT Director is not the owner of all of these. Include backup owners for each module, too.
Include staff who will do build work and those who will be super users.
Consider appointing a designated partial FTE-person besides the IT or Nursing Directors, who will continue to troubleshoot and oversee EHR issues after go-live, even if that position is part time; often this is a nursing staff member other than the Director of Nursing, who is an integral team member but wishes to delegate such duties after go-live.
From the start, meet regularly and frequently as a whole team, not sporadically, set expectations for each member, and empower him or her.
Theme 4: Preparatory Work
CAH Peer Experts (5/16)
It’s important to get details from vendors on what “build” entails for each module and report. A Nebraska Chief Nursing Officer said,
“Get more details on how much time it will take, like for the pharmacy module, at least a week, and on what information will be needed – all the medications – and ask why.”
Another Nebraska CEO gave this example:
“There’s a great report for MU reporting, but it has to be built from the ground up and not onsite. We had a 2-hour webinar, and we must have gone through that five times to make it.”
A North Dakota Director of Nursing said,
“Find three hospitals that are using your vendor’s system already, and visit them before you build. Talk to them about their documentation build. Really find out what it means to build and how your choices affect what the end-product looks like and works before you do it.”
Avoid duplicating electronic forms as you create them.
Prior to go-live, as many staff from each department as possible should make use of the test system to really test regular and atypical but possible scenarios in what’s been built.
If staff needs them, conduct basic computer skills training prior to EHR-specific training; one way for them to continue to practice is using hospital email regularly.
A Nebraska CEO offered this caution to vendors:
“Staff at CAHs wear a lot of hats regularly and during implementation, so be mindful of overscheduling, overlapping scheduling. We had people building forms and at the same time they needed to be trained as super users.”
Be aware that the skills and knowledge levels of the vendor’s build-training and go-live team members will vary significantly. Explicitly ask how experienced these vendor staff members are prior to their arrival onsite at the hospital, and insist that experienced members, rather than brand new staff, participate.
Others
Other respondents included two from CAH vendors, three from larger vendors, and one consultant.
Pay attention to vendors, and take their advice (e.g. thoroughly clean up data files before data conversion).
Assess staff’s basic computer skills and do necessary training early. A larger vendor staff member emphasized making use of a system’s training environment, if your vendor offers one:
“Training should not start right before go-live. No, no, no! What happens is chaos. Users don’t buy in and metrics are skewed. This can start up to six months before go-live.”
Have a meeting space ready for when the vendor sends people onsite and for user training.
Make sure all lab accreditations, nursing and physician licensing, and DEA numbers, state licenses, etc., are updated in advance of this process.
Theme 7: Outside Partners and Information Resources
CAH Peer Experts (4/16)
Create and/or participate in existing user groups for the vendor and system within the state and region for ideas and to share best practices for implementation and adoption. One Nebraska CEO said,
“More partnering, less competition!”
The EHR team should build a partnering relationship, a buddy system, with hospitals visited during selection: You can check back with them after go-live on how to change the system and work together to troubleshoot issues when the vendor doesn’t know the answer.
Ask for assistance from your REC or another regional organization for help in understanding policies such as MU.
Others
Other respondents included two consultants, one REC staff, and two researchers.
The EHR team must go beyond what the vendor says and have a mind of their own. Don’t try to do it alone.
Find a credible source to help you navigate the waters. Reach out to colleagues and sister hospitals; if your hospital is truly freestanding, partner with others even if you’re not merging or combining. One consultant said,
“Get past the okay-but-you-show-me-yours-first issue. Don’t reinvent the wheel!”
A REC staff member said,
“Use me, your REC staff person, I am your liaison to ONC, CMS and Medicaid and this state for required in-state reporting!”
Find and rely on validated materials on implementation: Learn from the past and look at published papers and books to see what others’ experiences have been. One researcher said,
“Check out the 2003 Ash et al. national consensus paper on implementation! I’ve been bowled over by the number of papers now giving credit to that paper as the reason for an implementation success.”
Another said,
“The ONC website has a link to an online guide on ‘Unintended Consequences of Electronic Health Records,’ prepared by the Rand Corporation for the Agency for Healthcare Research and Quality. Use this: www.ucguide. org/index.html.”
Theme 19: Clinical Decision Support and Knowledge Management
No peer experts commented. Two others commented.
One national policy expert said,
“Understand what is your evidence-based knowledge-management practice – everything from structured terminology on up to evidence-based guidelines – and know where these live within the system.”
A researcher with significant national policy influence said,
“CPOE is really important and foundational, and the key is what sort of clinical decision support is put into place: Start low and go slow, then ramp up.”
Discussion
The inclusion of CAH peer experts who have undertaken EHR implementation brings new voices and operational informatics experiences from small, rural hospitals to informatics discussions to an extent not possible before. That no new themes resulted from the second round of interviews to include additional CAH peer experts demonstrates that data saturation may have been reached and that the advice provided here for other CAHs – the primary study objective – is well supported. However, foci have emerged that have implications for CAHs and small, rural hospitals that have yet to implement EHRs, as well as for other stakeholders directly involved in or having potential impact on implementation processes.
Only 17 of 19 themes generated include comments by CAH peer experts (▶ Table 1), which points towards potential gaps in CAH peer expert knowledge. When themes are ranked by the number of all experts who commented on each versus the number of CAH peer experts who commented (▶ Table 2), there are differences regarding areas of most concern, based on actual difficulties that CAH peers experienced as members of their EHR implementation teams. These differences also point to a possible lack of understanding about CAHs by other experts. The top five themes from all experts are as follows:
EHR Team,
Communication,
Clinical/Physician Buy-in/Ownership,
EHR System Selection,
Preparatory Work.
The top theme ranked by CAH peers only, however, is EHR System Selection. Major regrets include automatically going with their lowest bidder, often the same vendor as their existing financial system; incorrectly assuming EHRs are turnkey systems and interoperability among a vendor’s modules is seamless; and not visiting other CAHs to see prospective systems in use and ask their counterparts in-depth questions. Starting such visits during selection would be highly valuable for self-education about live system functionality versus sales demonstrations, and as the foundation for cooperative knowledge building. This crucial investment would be worth travel costs and staff time.
The theme ranked first by all experts and second by CAH peers is EHR Team. CAHs recognize the importance of EHR teams, too. They are forming teams comprising six to nine members. Due to CAHs’ small staff sizes (e.g. 100–150 people), teams include the CEO, CFO, and most managers, of whom there are usually a half dozen total, most of whom are also clinicians, a strength and potential advantage over larger hospitals. Major regrets include not meeting frequently enough as a whole or not including, from the start, enough non-managerial staff who know daily processes.
The theme ranked second by all commenters but third by CAH peers is Communication. Communication is important to implementation at CAHs as it is in other settings. However, unlike comments that peer experts made for other themes, their comments on communication were mainly about successful efforts rather than difficulties. As such, the comments are in ▶ Table 3 to meet space limits. CAH peers did express one regret: They should have communicated more from the EHR team outward to other staff.
The theme ranked third by all experts is Clinician/Physician Buy-in/Ownership. Notably, this theme is ranked 12th by CAH peers, which indicates that other experts may not understand factors at CAHs: Few CAHs employ hospitalists, so physicians are often not at the CAH, do not play major roles in operations, and are not EHR team members. Their buy-in is necessary but usually accomplished through the Board and CEO explicitly setting priorities with medical staff and via CPOE training and, more rarely, build. Nurses and ancillary staff are the primary clinical leaders in operations and implementation. The Nursing Director plays as critical a role on the EHR team as the IT Director.
The fifth ranked theme for all experts, Preparatory Work, was ranked fourth by CAH peers. A major peer expert regret is not knowing enough going into the build process. They advise others to ask specifics of vendors, e.g. work hours required for each module at the last several CAHs, and have build teams visit other CAHs using the same EHR to see the system in action, ask questions, and hear their build stories. CAHs are implementing in compressed, MU- and vendor-driven timelines much more quickly than larger hospitals have in the past, sometimes in as little as six months rather than over multiple years; the “test” phase of building is often just a few days, if it happens at all, before go-live [20], so understanding as much as possible beforehand is especially important for preventing stressful realizations and frustration at go-live, and the need to redo forms/orders-sets.
The next theme included in the results, Outside Partners/Information Resources, is an area of agreement between peer and other experts and encapsulates a major factor underlying the CAH peer regrets expressed across their top ranked themes: CAHs are going in blind and don’t understand as much as they should before or during implementation. In hindsight, peer experts realized they should have made more use of outside resources - and that there are resources other than consulting firms, which CAHs often cannot afford. Many CAH managers and staff have never worked anywhere with an EHR. CAH IT staff is often new to healthcare. Having little or no prior experience using EHRs and no validated information about implementation beyond vendor instructions is the team norm at CAH kickoff meetings, unlike at larger hospitals. The team then is so consumed by preparation work in a highly compressed timeframe that they are unlikely to look for other resources even if the thought occurs, much less across multiple websites (e.g. AHRQ, CMS, HRSA, RECs, ONC).
Peer experts emphasize the importance of partnering more with other CAHs and seeking more REC assistance. However, RECs vary in how much help they offer, not all provide links on their websites to authoritative resources, and EHR team member knowledge about what they offer varies. ONC has recognized the need for more educational resources and has ramped up links on its website to include many implementation resources. However, none of the peer experts mentioned using or seemed aware of these ONC resources. When asked explicitly, no one at the four CAHs in the larger onsite study knew of the existence of ONC website resources [20]. When shown a printout of Meaningful Use and Critical Access Hospitals: A Primer on HIT Adoption in the Rural Health Care Setting published online in December 2010 [25] only one person, an IT Director, “thought” he had seen it somewhere [20]. No one was aware of the peer-reviewed literature on implementation and adoption [20].
To foster success, policy makers should consider supplying an online repository of validated resources, including citations and PDFs for peer-reviewed studies, and tying meaningful use of these implementation-related educational resources into an HIT adoption program’s registration and reporting stages. In this manner, they can ensure that stakeholders are more uniformly aware of and learning from such resources upfront and in stages as their EHR knowledge grows and information needs evolve. Other countries forming national eHealth strategies to meet WHO goals should consider this, especially if decisions are centralized, and as a result, few or no small, rural hospital staff members will take part in the vendor/system selection process, and when the timeline for implementation is compressed.
Clinical decision support (CDS)/knowledge management (KM), the final theme included in the results, is one for which no CAH peer experts made comments but nationally recognized experts influencing MU policy did. In the second round of interviews, the authors purposefully probed CAH peer knowledge of these areas. Some had heard of CDS. None knew what these are. See ▶ Table 4 for definitions. For MU Stage 1, CAHs only need to incorporate one CDS rule, which their vendors take care of with little explicit discussion [20]. CAHs must incorporate increased CDS to meet MU Stages 2 and 3 requirements. CDS/KM relate strongly to ongoing EHR optimization and build-out, about which CAH peers have little knowledge. Their usual assumption is that once initial post-go-live troubleshooting is completed, the system is done. In reality, the work of EHR owners is perpetual. Their lack of knowledge about optimization and build-out, particularly via increased CDS, is a major gap. A study limitation is the lack of second-round interviews with CAH-market vendors and REC staff working with CAHs to probe their points of view about this gap. ONC did contract with experts to create a free CDS toolkit for providers and CAHs, available online as of October 2013. ▶ Table 5 includes citations for this and other resources that CAHs will find useful for proactive education on implementation- and EHR-related topics.
Table 5.
No. | Reference | Annotation | Available from |
---|---|---|---|
1. | U.S. Department of Health and Human Services, Health Resources and Service Administration. Meaningful Use and Critical Access Hospitals: a primer on HIT adoption in the rural health care setting. December 2010. | An excellent, comprehensive online booklet that includes a framework for implementation planning, with links to other resources that drill down into details about considerations at various stages. | www.hrsa.gov/ruralhealth/pdf/meaningfuluseprimer.pdf. for free |
2. | U.S. Department of Health and Human Services. Office of the National Coordinator for HIT (ONC). Implementation support for Critical Access Hospitals and other small rural hospitals. | Webpage including links to many resources and tools related to implementation, as well as federal funding opportunities targeted to assist rural health care providers in building the infrastructure needed for rural health IT adoption and implementation. | http://www.healthit.gov/providers-profes sionals/implementation-support-critical-ac-cess-hospitals-and-other-small-rural for free |
3. | Ash J, Stavri PZ, Kuperman GJ. A consensus statement on considerations for a successful CPOE implementation. J Am Med Inform Assoc 2003; 10(3): 229-234. | This is about CPOE implementation, but the nine considerations covered, which each have up to 14 detailed subpoints, are applicable to the integrated EHR as a whole; this is filled with great advice from national experts. | http://jamia.bmj.com/content/by/year for free (content older than 12 months) |
4. | Osheroff J, Teich J, Levick D, et al. Improving Outcomes with Clinical Decision Support: An Implementers Guide. 2nd ed. HIMSS, Scottsdale Institute, SHM, AMIA, AMDIS; February 2012. | An updated version of the 2005 clinical decision support (CDS) guidebook; completely reorganized and substantially revised with input from over 100 individuals and organizations. Contains recommendations for diverse care delivery organizations and practices, EHR/HIT vendors, and others. Awarded “HIMSS Book of the Year.” | https://marketplace.himss.org/default.aspx?tabid=56&category=CLIND for purchase |
5. | U.S. Department of Health and Human Services. Office of the National Coordinator for HIT (ONC) and experts under contract. Care Delivery Improvement/ Clinical Decision Support (CDS) Toolkit. | A collection of tools and resources designed to help providers, hospitals, RECs and others improve care processes and outcomes. Includes modules covering what CDS is, the notion of the 5 Rights of CDS, guidance on CDS and Meaningful Use, building capacity to allow you to enable many CDS interventions, and implementing CDS programs to improve target-focused performance improvement. Includes templates, tools, activities, other key considerations, tasks, lessons, and other resources to help you achieve concrete results. | http://www.healthit.gov/policy-researchers-implementers/cds-implementation for free |
6. | Jones SS, Koppel R, Ridgely MS, Palen TE, Wu S, and Harrison MI. Guide to Reducing Unintended Consequences of Electronic Health Records. Prepared by RAND Corporation under Contract No. HHSA290200600017I, Task Order #5. Agency for Healthcare Research and Quality (AHRQ). Rockville, MD. August, 2011. | An online resource designed to help hospitals and provider practices anticipate, avoid, and address problems that can occur when implementing and using an electronic health record (EHR). The guide’s purpose is to provide practical, troubleshooting knowledge and resources. | http://www.healthit.gov/unintended-consequences/ for free |
7. | Leviss J, ed. HIT or Miss: Lessons Learned from Health Information Technology. AMIA/AHIMA Press; 2013. | Combines the 17 case studies from the first edition, which highlighted specific failures in health information technology projects, with 17 new cases, including examples of hospitals and practices pursuing Meaningful Use objectives. The causes of failure in the de-identified cases originate from leadership missteps, technical problems, planning mistakes, failure to engage clinicians effectively, and other errors that can be avoided. Each case has accompanying expert insights about key obstacles that must be overcome to leverage IT and modernize and transform healthcare. | https://www.ahimastore.org/ProductDetailBooks.aspx?ProductlD=16291 for purchase |
8. | National Rural Health Resource Center. Health information exchange (HIE) toolkit. | An online resource that includes an assessment guide detailing what to consider before forming or joining a health information exchange; a spreadsheet to calculate an organization’s return-on-investment from HIE; a guide to understanding the federally developed Direct protocol for basic peer-to-peer records exchange; a primer on health information exchange policies; and an overview of privacy and security issues under the Health Insurance Portability and Accountability Act of 2009. | http://www.ruralcenter.org/rhitnd/hie-toolkit for free |
Conclusion
EHR implementations will always be complex projects. They do not have to be painful odysseys into the complete unknown. Through connecting more closely with peers to share lessons learned and EHR knowledge, and by seeking the existing collective implementation expertise, CAHs and small hospitals can avoid recreating the wheel and ensure their own successful EHR implementations and adoption. Now that the pool of CAH peer experts has increased and their experience continues to deepen, vendors and other stakeholders should learn from the experiences of these newly minted experts. From what CAH peer experts and others explicitly stated and what can be inferred here, all stakeholders can improve their own processes and tailor approaches specifically for small, rural hospitals and other CAHs.
Acknowledgements
This study was funded in part by US NIH NLM Grant # 5T15LM007087–17. The authors wish to thank the following organizations and individuals without whom this study would not be possible: the study participants; additional staff at the Regional Extension Centers for HIT in Arkansas, Illinois, Kansas, Minnesota and North Dakota, Missouri, Nebraska, and Tennessee; Russell B. Left-wich, MD, Chief Medical Informatics Officer, State of Tennessee Office of eHealth Initiatives; Paul Kleeberg, MD, Chief Medical Informatics Officers, Stratus Health and Clinical Director, Regional Extension Assistance Center for HIT (REACH) for Minnesota and North Dakota; and EHR team members and staff at four CAHs in Arkansas, Kansas, and Tennessee, who are participants of the larger field study of which this work is a part.
Footnotes
Clinical Relevance Statement
Critical Access Hospitals (CAHs) can improve their electronic health record system (EHR) implementation processes by following specific points of advice presented here from multiple types of implementation experts. Recommendations especially from peer experts, CAH staff who serve on EHR teams and have recently implemented EHRs, will guide other CAHs and similar small, rural hospitals through areas in which they learned key lessons. From what CAH peer experts and others explicitly state, and what can be inferred, stakeholders who have vested interests in small, rural hospital EHR implementation and adoption success to meet health care goals can improve their own processes and tailor approaches specifically for these small hospitals.
Conflicts of Interest
The authors declare that they have no conflicts of interest in this research.
Protection Of Human And Animal Subjects
The study did not involve humans (exempt status) or animals, and the study was reviewed and approved by the University of Missouri Health Sciences Institutional Review Board.
References
- 1.US Congress American Recovery and Reinvestment Act of 2009. 2009[cited 2012 August 8]; Available from:http://www.gpo.gov/fdsys/pkg/BILLS-111hr1enr/pdf/BILLS-111hr1enr.pdf [Google Scholar]
- 2.Ash JS, McCormack JL, Sittig DF, Wright A, McMullen C, Bates DW.Standard practices for computerized clinical decision support in community hospitals: a national survey. J Am Med Inform Assoc 2012; 19(6): 980–987 Epub 2012/06/19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Flex Monitoring Team [Internet] About Flex Monitoring Team and Critical Access Hospitals. [updated 2010 May 26; cited 2013 July 16]; Available from:http://www.flexmonitoring.org/aboutcahflex.shtml [Google Scholar]
- 4.American Hospital Association Fast Facts on US Hospitals From 2011 Annual Survey, AHA Hospital Statistics, 2013 edition. [updated 2013 Jan 3; cited 2013 March]; Available from:http://www.aha.org/research/rc/stat-studies/fast-facts.shtml [Google Scholar]
- 5.US Census Bureau. Urban/Rural and Metropolitan/Nonmetropolitan Population: 2000 – United States – Urban/Rural and Inside/Outside Metropolitan Areas. Census 2000 Summary File (SF 1)http://factfinder2.census.gov/faces/tableservices/jsf/pages/product-view.xhtml?pid=DEC_00_SF1_GCTP1.US93&prodType=table [cited 2012 March 13]; Available from: [Google Scholar]
- 6.Desroches CM, Charles D, Furukawa MF, Joshi MS, Kralovec P, Mostashari F, Worzala C, Jha AK.Adoption of electronic health records grows rapidly, but fewer than half Of US hospitals had at least a basic system. Health Aff (Millwood). 2013; 32(8): 1478–1485 doi: 10.1377/hlthaff.2013.0308. Epub 2013 Jul 9 [DOI] [PubMed] [Google Scholar]
- 7.Wenzlow L.Meaningful Use attestations in 2011: CMS/ONC raw dataset tells hospital story. In: Wisconsin Office of Rural Health online blog, Rural Health IT: What “Meaningful Use” Means to Rural. 2012 January 11 – [cited 2013 March]. Available from:http://www.worh.org/hit/2012/01/meaningful-use-attestations-in-2011-cmsonc-raw-dataset-tells-hospital-story/ [Google Scholar]
- 8.Leily S.Resources for Critical Access Hospitals and small rural hospitals [Internet]. Office of the National Coordinator for Health Information Technology. Weekly Digest Bulletin 2013 March 18 [Google Scholar]
- 9.Flex Monitoring Team Universities of Minnesota, North Carolina-Chapel Hill, and Southern Maine: Flex Program; [updated 30 June 2013; cited March 2013]. Complete list of Critical Access Hospitals (1,331 CAH hospitals, current as of December 31, 2012). Available from:http://www.flexmonitoring.org/cahlis tRA.cgi [Google Scholar]
- 10.Centers for Medicare & Medicaid Services Baltimore: CMS; [updated 6 November 2013; cited March 2013] EH recipients of Medicare EHR incentive program payments 2012. ProvidersPaidByEHRProgram_Dec2012_FINAL_HOSPiTAL.csv. Available from:http://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/DataAndReports.html [Google Scholar]
- 11.Adler-Milstein J, Furukawa M F, King J, Jha AK.Early results from the hospital electronic health record incentive programs. Am J Manag Care 2013; 19(7): e273–e284 Epub July 10, 2013 [PubMed] [Google Scholar]
- 12.World Health Organization Geneva: WHO; c 2013 – [cited 20 April 2013]. Directory of eHealth Policies. Keeping Promises, Measuring Results 2011. Available from:http://www.who.int/goe/policies/en/index.html [Google Scholar]
- 13.Ash JS, Stavri PZ, Kuperman GJ.A consensus statement on considerations for a successful CPOE implementation. J Am Med Inform Assoc 2003; 10(3): 229–234 Epub 2003/03/11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Brender J, Ammenwerth E, Nykanen P, Talmon J.Factors influencing success and failure of health informatics systems - a pilot Delphi study. Methods Inf Med 2006; 45(1): 125–136 Epub 2006/02/17 [PubMed] [Google Scholar]
- 15.Aarts J.Understanding implementation: a socio technical appraisal on the introduction of computerized physician order entry systems in Dutch and American hospitals. Rotterdam (Netherlands): Erasmus University; 2005 [Google Scholar]
- 16.Ash JS, Stavri PZ, Dykstra R, Fournier L.Implementing computerized physician order entry: the importance of special people. Int J Med Inform 2003; 69(2–3): 235–250 Epub 2003/06/18 [DOI] [PubMed] [Google Scholar]
- 17.Leviss J, editor.H.I.T. or miss: lessons learned from health information technology implementations. Chicago: AHIMA Press; 2010 [Google Scholar]
- 18.Miller J, editor.Implementing the electronic health record: case studies and strategies for success. Chicago: HIMSS Press; 2005 [Google Scholar]
- 19.Kaplan B, Harris-Salamone KD.Health IT success and failure: recommendations from literature and an AMIA workshop. J Am Med Inform Assoc 2009; 16(3): 291–299 Epub 2009/03/06 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Craven CK.Implementation planning processes in Critical Access Hospitals. Columbia, Mo. (USA): University of Missouri; Forthcoming; 2014 [Google Scholar]
- 21.Poon EG, Blumenthal D, Jaggi T, Honour MM, Bates DW, Kaushal R.Overcoming barriers to adopting and implementing computerized physician order entry systems in U.S. hospitals. Health Aff (Millwood) 2004; 23(4): 184–190 Epub 2004/08/21. [DOI] [PubMed] [Google Scholar]
- 22.Craven CK, Sievert MC, Hicks LL, Alexander GL, Hearne LB, Holmes JH.Experts speak: advice from key informants to small, rural hospitals on implementing the electronic health record system. In: Lehmann CU, Ammenwerth E, Nøhr C, Conducting medical informatics by converging technologies, conveying sciences and connecting people. MEDINFO 2013; Proceedings of the 14th World Congress on Medical and Health Informatics. Series: Studies in Health Technology and Informatics, Vol. 192; 2013 Aug 19–25; Copenhagen, Denmark. Amersterdam: IOS Press; 2013. p. 608–612 [PubMed] [Google Scholar]
- 23.Ash JS, Smith AC, Stavri PZ.Performing subjectivist studies in the qualitative traditions responsive to users. In: Friedman CP, Wyatt JC, Evaluation methods in biomedical informatics. 2nd ed New York: Springer-Verlag; 2006. p. 267–300 [Google Scholar]
- 24.Saldana J.The coding manual for qualitative researchers. Los Angeles: Sage; 2009 [Google Scholar]
- 25.Health Resources and Service Administration. Washington: 2010. [cited 2013 May] HRSA Office of Rural Health Policy. Meaningful Use and Critical Access Hospitals: a primer on HIT adoption in the rural health care setting. Available from:http://www.hrsa.gov/ruralhealth/pdf/meaningfuluseprimer.pdf [Google Scholar]
- 26.Centers for Medicare & Medicaid Services Baltimore: CMS; [cited 2013 March 10] Stage 1 vs. Stage 2 comparison table for eligible hospitals and CAHs (2012). Available from:http://www.cms.gov/Regu lations-and-Guidance/Legislation/EHRIncentivePrograms/Stage_2.html [Google Scholar]
- 27.Osheroff JK, Kleeberg P, Shank T.Clinical decision support-enabled quality improvement for Meaningful Use. Washington DC: Office of the National Coordinator for HIT Annual Meeting; 2012 Dec 13 [Google Scholar]
- 28.Davenport T, Prusak L.Working knowledge: how organizations manage what they know. Boston, Mass.: Harvard Business School Press; 1998 [Google Scholar]
- 29.Davenport TH, Glaser J.Just-in-time delivery comes to knowledge management. Harv Bus Rev 2002; 80(7): 107–111, 126. Epub 2002/07/27 [PubMed] [Google Scholar]