Abstract
OBJECTIVES
Documentation of interventions by pharmacists has become a standard of practice in clinical practice sites. Pharmacists' interventions in pediatric practice settings for short periods of time have been reported in the literature. A single study has described faculty and student interventions in the pediatric setting. The objective of this study was to characterize 4 years of interventions by faculty and students of a school of pharmacy that occurred at various pediatric practice sites throughout a state.
METHODS
Pharmacy practice faculty and fourth year student pharmacists are required to document clinical interventions during advanced pharmacy practice experiences. Interventions are documented in a single, commercially available, Web-based system. Reports of interventions with cost avoidance at pediatric inpatient and outpatient practice sites throughout a state from 2011 to 2014 were collected and analyzed. Data were sorted based on year, practice site, type, and number of activities and interventions, and estimated cost avoidance.
RESULTS
Two full-time faculty members practiced in pediatrics and, on average, 25 students entered interventions at pediatric sites each year. A total of 12,784 interventions were documented by faculty and students over the 4-year period, with students entering 81.8% of the interventions and 69% occurring in the inpatient setting. Total cost avoidance for all 4 years was $1,684,609. The most frequent interventions were patient medication history, patient counseling, allergy information clarified, drug therapy adjusted, and drug information.
CONCLUSIONS
Pharmacy faculty and students documented various types of clinical interventions in the inpatient and outpatient pediatric settings and demonstrated a positive impact at pediatric practice sites throughout a state, as well as cost avoidance in the associated healthcare systems.
Keywords: adverse drug reactions, faculty, interventions, pediatrics, pharmacist students
Introduction
Documentation of interventions by pharmacists has become a standard of practice in clinical practice sites. Schools of pharmacy may require or request practice faculty and students document patient interventions to demonstrate their value at their clinical practice sites.1,2 Characteristics of interventions made by pharmacists in various pediatric clinical practice settings for a short period of time have been reported in the literature.3–8 One 8-month study described interventions by a single faculty member in a pediatric intensive care unit (PICU).9 However, only one study, published in 2004, reported faculty and student interventions over a 1-year period in the pediatric setting.10 Studies that evaluate the impact of faculty and student interventions over a long-term period are lacking. In addition, most studies evaluate a single center or institution. The objective of this study was to characterize 4 years of interventions documented by full-time faculty and students of a school of pharmacy that occurred at multiple pediatric clinical practice sites throughout the state.
Materials and Methods
In this school of pharmacy, pharmacy practice faculty and fourth year student pharmacists are required to document clinical interventions at their practice site during advanced pharmacy practice experiences (APPEs) with full-time and affliate faculty. Interventions are documented in a single, commercially available, Web-based, password-protected system, Pharmacy One-Source/Quantifi (Pharmacy One Source, Bellevue, WA; www.pharmacyonesource.com). This system captures both hard and soft cost for interventions. All fourth year student pharmacists are trained on using the software and the process of documenting interventions prior to the start of the APPEs. Full-time faculty members review the intervention process with the students at the beginning of each APPE. APPEs are 5 weeks in length with full-time faculty taking on average 12 students per year. Students have a 1-week break in July, a 2-week break in December/January, and a 4-week break between a class starting and finishing APPEs in April/May; thus, students are not on service all year long. Faculty members are traditionally in practice Monday through Friday most weeks of the year, except for 2 weeks during the December/January holiday break. Faculty members are expected to enter their interventions during months without APPE students. However, during months with students, full-time faculty members rely on students to enter the clinical interventions. Students may enter their interventions continuously during the APPE or prior to completing the APPE. The students' entry of interventions is verified by the full-time faculty member as part of the mid-point and final student evaluation, but individual interventions are not reviewed in detail. Affliate faculty vary in the number of APPE students per year. The school's director of experiential learning verifies students' entry of interventions at the end of each APPE as affliate faculty do not have access to the documentation system.
Reports of clinical interventions at APPE pediatric clinical practice sites (inpatient and outpatient) throughout the state of Alabama from 2011 to 2014 were collected. Practice sites in this study included one stand-alone pediatric hospital (380 beds), two women and children hospitals (150 beds and 198 beds), and one general pediatric clinic (1110 patient visits per month during the study period). The hospitals were all public, not-for profit, located in urban areas, and serve as academic teaching sites for schools of medicine, nursing, and pharmacy. Two full-time faculty members are employed by the school of pharmacy and practice at different pediatric sites in the state. One faculty member practiced in the PICU for all years of the study. The other faculty member practiced in the inpatient general pediatric setting then transitioned to an outpatient general pediatric clinic in July 2012 and stopped practicing in April 2014. Full-time faculty members practiced five half days a week at the clinical site, seeing patients with a medical team but did not have order entry or verification responsibilities. Both full-time faculty members' salaries are solely supported by the university. One faculty member completed a post-graduate year two residency in pediatrics, the other faculty member completed a pediatric fellowship, and both have been practicing for more than 15 years. Affliate faculty preceptors practiced in the inpatient pediatric setting in various practice areas. All affliate faculty members have affliate appointments with the school of pharmacy and have varying training experience and years in practice. Affliate faculty do not document interventions in the school's database system.
Pharmacy One Source provides cost avoidance data for the database system. These data are available for clients but not published publically. The calculation used for determining a potential cost avoidance is a conservative estimate. It takes into consideration the possibility of a preventable adverse drug event (ADE) occurring in combination with an average cost of a ADE reported in studies, as well as an estimated healthcare inflation rate factor. Based upon the calculations, most interventions are calculated at $153 per intervention. Not all interventions are associated with a cost avoidance, such as medication reconciliation. Interventions that were a result of automatic conversion or protocols are not entered into the database system. Data were analyzed quantitatively and qualitatively in Microsoft Excel. All interventions were further classified as “activities” or “interventions.” The “inpatient chart review/rounding,” “outpatient chart review,” “patient visit initial- 99605,” and “patient visit reassess- 99606” interventions were classified as “activities” in this study as the faculty and student spend time on the activity/visit but a direct intervention in patient care may not occur. “Interventions” were defined as immediate changes or impact in patient care (e.g., drug therapy initiated or allergy information clarified). Using Microsoft Excel, the data were sorted based on the user (faculty or student), year, practice site, type of intervention and activity (e.g., inpatient chart review/rounding or patient counseling), number of activities and interventions, and associated estimated cost avoidance. This study received Institutional Review Board approval.
Results
Two full-time faculty members practice in pediatrics at the school of pharmacy and on average, 25 students training with full-time and affliate faculty preceptors entered interventions at multiple pediatric practice sites each year. Data entered from a total of 100 students on 121 rotations were included in this study. A total of 12,784 interventions and activities were documented by faculty and students over the 4-year period, with students entering 81.8% (n = 10,467) (Table 1). During the study period, the average number of interventions and activities per a 5-week APPE entered by a student was 86. The average number of interventions and activities per faculty member over the study period was 1163. Sixty-nine percent of the interventions and activities occurred in the inpatient setting. Ninety-one percent of the student interventions and activities were documented on a full-time faculty member's clerkship. There were only six interventions documented that were not accepted by the physician.
Table 1.
Annual Summary of Interventions and Estimated Cost Avoidance

The most frequent interventions for faculty and students were patient medication history, patient counseling-brief, clarification of allergy information, adjustment of drug therapy, and drug information-brief (Table 2). Specifically evaluating interventions documented by faculty, medication reconciliation, antibiotic recommendations, and drug therapy consultations were the three most common interventions. Patient medication history, patient counseling-brief, and clarification of allergy information were the three most common student interventions. Intervention with less than 20 entries included: clarification of orders; adverse drug reaction (ADR) prevented; inpatient-anticoagulation consult/follow-up; over-the-counter (OTC) recommendation; drug interaction (disease/drug/food/lab); continuity of care; drug serum concentration avoided; evaluation of a chemotherapy regimen; evaluation of renal dosing; non-formulary medication processed; medication error; group patient education; avoidance of therapeutic duplication; initiate of deep vein thrombosis prophylaxis; prevention of an allergic reaction; inpatient-nutrition consult (non-total parenteral nutrition [TPN]); poison information; recommendation of therapeutic interchange; and patient's own medication evaluation.
Table 2.
Details of Selected Interventions with Associated Cost Avoidance *

Table 2.
Details of Selected Interventions with Associated Cost Avoidance * (cont)

Thirteen ADRs were prevented and four medication errors occurred reaching the patient yet fortunately no harm occurred. The most common cause of medication errors was prescribing. Individual medications corresponding with each ADR prevented and medication error were reviewed. Examples include acetaminophen, ketorolac, dantrolene, lansoprazole, nitric oxide, topiramate, furosemide, aspirin, ketoconazole, albuterol, enalapril, cefdinir, azithromycin, and polyethylene glycol. Two medications were antibiotics and two were classified as a pain medication.
When entering an intervention, there is an optional field to enter the name of the medication related to the intervention. Specific medications were cited in only 1928 interventions (15%). The most common medications listed were antibiotics: clindamycin (n = 120, 6.2%), vancomycin (n = 97, 5%), and amoxicillin (n = 90, 4.7%). Table 3 delineates the top 20 medications cited in interventions, which was 55% of the interventions with medications listed. Each medication was associated with a variety of interventions (e.g., antibiotic recommendations, drug therapy changes, patient counseling, etc.). Specifically, in evaluating only faculty interventions, the top three medications cited were vancomycin (n = 61), clindamycin (n = 49), and acetaminophen (n = 34). The top three medications cited in student interventions were prednisolone (n = 73), clindamycin (n = 71), and albuterol (n = 69).
Table 3.
Top 20 Medications Cited in 1928 Interventions

The total cost avoidance for all 4 years was $1,684,609 (Table 1). This equated to a potential cost avoidance of $11,567 per student per APPE and $142,487 per faculty member for the study period. The intervention with the highest estimated cost avoidance was patient medication history at $108,171 (Table 2). Patient counseling-brief and clarification of allergy information were the next largest cost avoidances at $54,621 and $52,173, respectively. Antibiotic recommendations at $42,800 and drug therapy consultation at $26,163 completed the top five cost avoidances.
Discussion
Pharmacy practice faculty and student pharmacists documented a variety of interventions at different pediatric practice sites. This study is the first to describe an impact at multiple pediatric clinical practice sites, inpatient and outpatient and not within the same health-system, but throughout a state. In addition, this study evaluates the longest period of time published at this time, 4 years of interventions.
As students are required to document during APPEs in our school, we anticipated students to enter the majority of the interventions. The full-time faculty primarily practiced in the inpatient setting and all affliate faculty rotations were conducted at inpatient facilities, thus the majority of interventions occurred in the inpatient setting. Condren et al10 found drug therapy change, pharmacokinetic monitoring, drug information, and medication histories/patient education to be the most common interventions for faculty and students in their 1-year period study. Combining our faculty and student data, this study found similar results with patient medication history, patient counseling, adjustment of drug therapy, and drug information being the top four out of five interventions.
The faculty primarily documented interventions related to medication reconciliation and drug therapy recommendations. However, they also initiated, discontinued, and adjusted drug therapy, as well as conducted pharmacokinetic consults or follow-ups and intravenous to oral (IV-to-PO) conversions. Students primarily document interventions related to the intake of patient information and patient counseling. These interventions aligned with daily practice activities of the faculty and student pharmacists at the clinical practice sites. However, there were many high-level interventions by student pharmacists, such as initiating drug therapy and adjusting drug therapy (e.g., dose, frequency). Student pharmacists recommended and administered vaccines, as well as conducted Joint Commission Core Measures Chart reviews. Students conducted pharmacokinetics and anticoagulation consults and follow-ups. All of these interventions provided patient care and assisted the pharmacy department of the practice site. Institutions that have student pharmacists on APPEs should evaluate the interventions and activities that students are conducting and expand these when possible.
Only 13 ADRs were prevented and four medication errors were documented in the system. Additional ones likely occurred or were prevented but not documented. Students may have not been educated well on identifying and documenting the prevention of ADRs and medication errors. Faculty may have poorly documented these as well. The most common type of error was prescribing, which was similar to results from the Cunningham et al4 study focused on medication errors in a pediatric hospital. Our school needs to re-educate on documenting and identifying ADRs and medication errors in the pediatric setting.
When evaluating specific medications that were documented in the intervention, it is not surprising that antibiotics were the top three medications when combining faculty and student data. LaRochelle et al9 found this similar outcome as 34.4% of his interventions in the PICU were related to antibiotics. Antibiotics are commonly prescribed in the pediatric population and pharmacists frequently assist patient care with recommendations, monitoring, and counseling.
There are other benefits to documenting interventions besides cost avoidance. Faculty may use intervention data to justify their role, salary funding, and/or placement in a practice institution. Intervention data may also be used to develop outreach or service portfolios for faculty promotion. The documentation of activities and interventions can assist students in developing a practice portfolio to present at residency and job interviews. Students may also use the detailed data when describing APPE activities on their curricula vitae.
Limitations to the study include that all interventions and activities may not have been documented even though students were required to document on APPEs. Students and faculty may not have documented interventions that were not accepted by the physician/team even though these should have been documented and noted on the submission form that the intervention was not accepted. In this study, almost all interventions were accepted. The database default is marked to select accept; thus, students and faculty may not have changed this to the alternative. In addition, full-time faculty may not have documented personal interventions while students were on rotations with them, relying solely on the students to document all patient interventions. For the years 2011 and 2014, only one full-time faculty member entered interventions, thus potentially resulting in a lower number of interventions than actually occurred. This could be due to the faculty member having APPE students all year. All ADR preventions were not detailed in the database; thus, further information could not be provided. Specific disease states, medications, significance, and rate of acceptance were not consistently gathered in interventions. Although challenging to predict or determine, patient specific outcomes, such as improvement in health, absence from work/school, or decreased length of stay of these interventions, are unknown.
Disagreement may exist on the specific cost-avoidance values assigned to the activities and interventions by the database. A large number of interventions were classified as activities, defined as the review of a patient chart or patient visit in the inpatient or outpatient setting. In this study, outpatient chart review had a cost avoidance due to built-in interventions accounting for medication history, lab evaluation, and patient counseling; when in actuality some may have not occurred. Several interventions in the database were not assigned a cost avoidance and potentially could increase the total estimated cost avoidance. For example, medication reconciliation, initiating deep vein thrombosis prophylaxis, therapeutic interchange, discontinuing drug therapy, and adjusting drug therapy have no associated cost avoidance in the current database. However, as practitioners we know these could impact costs for the institution. For example, Gardner et al8 determined that 89% of the medication reconciliation interventions at a children's hospital resulted in a change in therapy. These subsequent interventions and cost-avoidance estimates may not have been documented in our system. Although it would be challenging to nationally agree on the cost value of specific patient interventions, it would assist with providing a standard for associated costs. In addition, this database does not differentiate cost avoidance for an adult or pediatric patient or practice setting (inpatient, outpatient, intensive care unit, etc.), which likely varies in the healthcare system. Lastly, this study was conducted in multiple health systems throughout a single state within the United States. Its application to the healthcare system in the United States may not be extrapolated internationally.
Conclusions
Pharmacy faculty and students document various types of clinical interventions in the inpatient and outpatient pediatric setting. High-level interventions were documented by both faculty and students at the pediatric practice sites. The quality and quantity of interventions in this study support why faculty and students should be involved in the care of patients at pediatric practice sites. The documentation of clinical interventions by pharmacy school faculty and students demonstrate a positive impact at pediatric practice sites throughout a state, as well as contribute to cost avoidance of the healthcare systems. Pharmacy departments of health systems should allow students and associated faculty to document activities and interventions within their intervention documentation system or request the data if the faculty and students document within their own system. These data can assist in supporting the presence of faculty and students in clinical practice sites and positively impacting patient care. Additional economic data supporting these types of healthcare partnerships are needed.
Acknowledgments
These data were presented in poster form at the Pediatric Pharmacy Advocacy Group Annual Meeting, Atlanta, Georgia, April 29, 2016.
Abbreviations
- ADE
adverse drug event
- ADR
adverse drug reaction
- APPE
advanced pharmacy practice experience
- DVT
deep vein thrombosis
- IV-to-PO
intravenous to oral
- OTC
over-the-counter
- PA
prior authorization
- PICU
pediatric intensive care unit
- PK
pharmacokinetic
- TPN
total parenteral nutrition
Footnotes
Disclosure The author declares no conflicts or financial interest in any product or service mentioned in the manuscript, including grants, equipment, medications, employment, gifts, and honoraria. The author had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Copyright Published by the Pediatric Pharmacy Advocacy Group. All rights reserved. For permissions, email matthew.helms@ppag.org
REFERENCES
- 1. Stevenson TL, Fox BI, Andrus M, . et al. Implementation of a school-wide clinical intervention documentation system. Am J Pharm Educ. 2011; 75( 5): 90. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Divall MV, Zikaras B, Copeland D, . et al. School-wide clinical intervention system to document pharmacy students' impact on patient care. Am J Pharm Educ. 2010; 74( 1): 14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Krupicka MI, Bratton SL, Sonnenthal K, . et al. Impact of a pediatric clinical pharmacist in the pediatric intensive care unit. Crit Care Med. 2002; 30( 4): 919– 921. [DOI] [PubMed] [Google Scholar]
- 4. Cunningham KJ. . Analysis of clinical interventions and the impact of pediatric pharmacists on medication error prevention in a teaching hospital. J Pediatr Pharmacol Ther. 2012; 17( 4): 365– 373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Ramadaniati HU, Lee YP, Hughes JD. . The difference in pharmacists' interventions across the diverse settings in a children's hospital. PLoS ONE. 2014; 9: e110168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Fernández-Llamazares CM, Calleja-Hernandez MA, Manrique-Rodriguez S, . et al. Impact of clinical pharmacist interventions in reducing paediatric prescribing errors. Arch Dis Child. 2012; 97( 6): 564– 568. [DOI] [PubMed] [Google Scholar]
- 7. Virani A, Crown N. . The impact of a clinical pharmacist on patient and economic outcomes in a child and adolescent mental health unit. Can J Hosp Pharm. 2003; 56: 158– 162. [Google Scholar]
- 8. Gardner B, Graner K. . Pharmacists' medication reconciliation-related clinical interventions in a children's hospital. Jt Comm J Qual Patient Saf. 2009; 35: 278– 282. [DOI] [PubMed] [Google Scholar]
- 9. Larochelle JM, Ghaly M, Creel AM. . Clinical pharmacy faculty interventions in a pediatric intensive care unit: an eight-month review. J Pediatr Pharmacol Ther. 2012; 17( 3): 263– 269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Condren ME, Haase MR, Luedtke SA, . et al. Clinical activities of an academic pediatric pharmacy team. Ann Pharmacother. 2004; 38( 4): 574– 578. [DOI] [PubMed] [Google Scholar]
