Abstract
Background: Background: An investigational pharmacy is responsible for all tasks related to receiving, storing, and dispensing of any investigational drugs. Traditional methods of inventory and protocol tracking on paper binders are very tedious and could be error-prone. Objective: To evaluate the utilization of the IDS to efficiently manage the inventory within an investigational Pharmacy. We hypothesize that the IDS will reduce the drug processing time. Methods: Our pharmacy tracked the drug processing time before and after using the IDS including the receiving, dispensing, and inventory. As part of the receiving the study drug pharmacists tracked the time it took a pharmacist to complete the tasks of logging the study drug before and after the implementation of the IDS system. In addition, the pharmacy also timed the process for drug dispensing and a full investigational drug inventory check. Wilcoxon signed-rank test was used to compare the difference in the meantime of total processing before and after the IDS. Results: Utilization of the IDS system showed significant reduction in processing time, and improvement of efficiency in inventory management. Additionally, the usability survey of the IDS demonstrated that the IDS system helped pharmacists capture data consistently across every clinical trial. Conclusion: Our results demonstrates how technology helps pharmacists to focus on their actual day to day medication-related tasks rather than worrying about other operational aspects. Informatics team continues to further enhance the features such as monitor portal, and features related to finance – generation of invoices, billing reconciliation, etc.
Keywords: Investigational Drug System, investigational pharmacy, clinical trials, informatics, database, integration
Introduction
A clinical research office (CRO) is a department that manages clinical trials focused on preventing or treating diseases across various fields of medicine. A CRO oversees each clinical trial from start to finish,1 most commonly, the clinical trials that are treatment based utilize a centralized investigational pharmacy to assure safe and efficient conduct of clinical trials regarding the management of drugs being studied. These functions may include receiving, storing, preparing, and dispensing the drugs in an appropriate manner to ensure subject safety and protocol compliance. Aside from drug procurement and handling, an extensive amount of effort stems from maintaining and organizing the protocol information in a manner that is easy for the pharmacy team to follow. Much of the required documentation such as adverse effects, dosage, patient compliance, and pill count are submitted to the Food and Drug Administration for review and approval release into the market. Ultimately, the goal of the pharmacy when conducting clinical trials is to provide documentation to prove that the drug is effective and safe for human consumption.
There are rules and regulations set by the Food and Drug Administration that CROs must comply with related to clinical trials.2 Furthermore, sponsors for each clinical trial enforce specific protocol guidelines that a CRO must also adhere to. The complexity and the effort of study drug management, along with conforming to the regulations and standards, varies depending on the phase of the trial, sample size, and the class of drug that is being studied. Many investigational pharmacies use a paper-based approach in maintaining the documentation and protocols. Traditionally, these documents are kept in binders on shelves.3 The volume of these documents can be substantial, and it is common that they require a large amount of space, which pharmacies do not have.
From 2009, there has been an increasing trend in the number of investigational clinical trials being performed.4 As the number of clinical trials increases, so too does the time and effort to maintain them. The University of Kansas Medical Center’s (KUMC) investigational drug pharmacy has 8 full-time pharmacists and 5 full-time pharmacy technicians to ensure daily operations are smooth and compliant with regulations and standards, including activities such as follow-up of adverse event data collection from participants in these trials.
As processes shift with technological advancement, so should our investigational pharmacy from a paper-based method to an electronic inventory tracking method. The Biostatistics and Informatics Shared Resource (BISR) at KUMC has adopted a software product known as the Investigational Drug System (IDS) to streamline each transaction performed in handling the investigational drug.5 The purpose of this article to describe and evaluate the IDS for more efficient management of the drug inventory system at KUMC.
Methods
IDS Technology
The front end of the IDS application has been developed using a Java framework. The back end is housed in an Oracle database. The application supports Oracle XE as well as a free version of the Oracle database. The requirement for the hardware is relatively minimal. There is a requirement of 16 GB of memory and 120 GB of disk space along with 4-core processors.
IDS Build
The IDS is a web-based software product that can be accessed from any of the 3 KUMC investigational pharmacy sites. IDS is a role-based system, which provides system administrators a way to manage and attach roles to appropriate job descriptions and locations. The system was developed with appropriate security that allows only the users who are provisioned with access. The IDS can be integrated with any authentication system such as Light-weight Directory Access Protocol or Security Assertion Markup Language. This improves data security and enables access rights to be centrally maintained.
Integration
All the protocols and relevant patient information flows into the IDS via the Clinical Trial Management System while it is being captured in real time. The link between both systems is the participant study identification, which is the unique identifier assigned by the sponsor. This is particularly important due to the possible threat of a breach of the information.6 Maintaining safety for the participants involved in the studies is a top priority. The centralized database can be accessed at each of the 3 locations helping the pharmacy staff organize the trials they are managing. By utilizing the medication catalog, pharmacy staff can build the drug into the IDS database during the trial start-up phase by supplying the name, strength/concentration, and unit of measurement. It is then associated with the protocol in which it is being studied. This allows the pharmacist to easily select the appropriate drug during the dispensing period.
Workflow
Regarding the dispensing of the treatment drug, the electronic process, unlike the paper format, automatically ensures that the drug information is accurate and is associated with the correct patient before the medication can be dispensed. Due to the possibility of human error, having to manually check these fields can be slow, inefficient, and more error-prone, a potential concern with the traditional paper-based approach. The system alerts the user if the medication is expired or will expire before the patient finishes the prescription and provides specific instructions relative to the protocol. In a single step, a prescription label is generated, and the inventory and accountability logs are updated resulting in a more efficient workflow.7
With the use of this new technology, the electronic method has proven to be a more efficient and more precise way of handling inventory.8 The technicians can review inventory in real time. This assists in maintaining adequate drug stock for current and potential patients to avoid delays in enrolling and treating a research participant. The system also provides pharmacy staff the exact storage location and condition along with the ability to quarantine drug, which has been deemed to no longer acceptable for use. This is beneficial for bigger operations where multiple pharmacists are working on the same clinical trial.9 Finding solutions to problems concerning medical inventory is nothing new as medical professionals have been trying to tackle these issues for decades.10 With advancement in technology, there are new solutions to old problems.
As shown in Figure 1, the IDS is a comprehensive system for an investigational pharmacy’s duties and responsibilities. A pharmacist can track the chain of custody and maintain a perpetual inventory of the study drug. Since the information is continuously recorded, various reports from multiple sites can be generated from centralized locations that help with operations, regulatory compliance, audit processes, and study monitoring. Drug accountability reports are exportable in various formats to support study monitors. Export options include the NCI formats, columns for patient return tracking, and one-click de-identified reports to prevent cumbersome manual redaction. There is also increased accuracy as IDS prevents transcribing errors, illegibility issues, and errors in data entry through less manual manipulation.
Figure 1.
Investigational pharmacy workflow.
Evaluation
To observe the efficiency of the IDS, our pharmacy timed the process of receiving study drug into the system once it has arrived in the pharmacy (this was done across 10 studies individually) and a pharmacist must label a container and record the transaction in a log to inventory. The time it took to complete this process was recorded before and after the implementation of the IDS. Then, Wilcoxon signed rank test was used to compare the mean time of drug processing during receiving, dispensing, and inventory.
Before the implementation of the IDS, pharmacists and technicians recorded the amount of time it took to receive a shipment, to dispense a drug, and to complete a full investigational drug inventory check. The receiving process began when the shipment of investigational drugs arrives at its respective investigational pharmacy and was prepped to be logged into inventory. With each shipment came a set of tasks that had to be completed. Some of the tasks included, but not limited to, communicating with the sponsor, logging the investigational drug into inventory, and placing them in their designated location.
About the dispensing process, there are many laborious tasks. Some of the tasks include counting the amount of the drugs, labeling, verifying the order, and logging out of the inventory. The inventory process was for all studies and involved retrieving each study binder, looking at each accountability log, counting drugs, and confirming that inventory matched the accountability logs.
After the implementation of IDS with an adjustment period, the pharmacists and technicians recorded the times for receiving the receipts, dispensing, and inventory repeatedly. Across the same studies the respective tasks were timed. However, the IDS would replace the binders with electronic accountability logs, labeling processes, and digital inventory tracking processes.
Results
Ever since the system went live in July 2018, it has been accessed by 8 pharmacists and 5 technicians across 3 different sites. Collectively, they have been able to access the central IDS to dispense medications for more than 400 clinical trials, which consists of both cancer and noncancer trials, with more than 900 different medications. Table 1 demonstrates that there is a notable amount of time saved for the pharmacists and technicians. Because of the small sample, we used the nonparametric Wilcox signed rank test11 to compare the mean of the time spent before and after implementation of the IDS. There is a marginally significant mean change in saving the time of around 3 minutes for dispensing when IDS is utilized.
Table 1.
Time Saved After Implementation of the IDS System (Areas Specifically to Receiving Drugs, Dispensing Drugs, and Overall Inventory Management).
Study | Before (Minutes) | After (Minutes) | Change (Minutes) |
---|---|---|---|
Dispensing | |||
TCD14678 | 14.05 | 4.07 | 9.98 |
20110203 | 15.00 | 6.10 | 8.90 |
CLN-PXT3003-03 | 24.58 | 18.62 | 5.96 |
CAPI015A2201J | 11.02 | 8.12 | 2.90 |
RA101495-02.201 | 6.38 | 3.80 | 2.58 |
H8A-MC-LZAZ | 8.88 | 6.57 | 2.31 |
M15-566 | 5.55 | 4.93 | 0.62 |
RRAD | 16.75 | 16.42 | 0.33 |
221AD301 | 8.13 | 8.93 | −0.80 |
INCB50465 | 3.28 | 6.38 | −3.10 |
Mean | 11.36 | 8.39 | 2.97 |
Mean change with 95% confidence interval = −2.97 (−0.024 to 5.96) | |||
Receiving | |||
RRAD | 15.00 | 7.63 | 7.37 |
SGN22E-002 | 26.53 | 10.90 | 15.63 |
H8A-MC-LZAZ | 29.78 | 24.42 | 5.36 |
Mean | 23.77 | 14.32 | 9.45 |
Mean change with 95% confidence interval = 9.45 (−4.07 to 22.97) | |||
Inventory | Before (h:min:s) | After (h:min:s) | Change (h:min:s) |
07:38:46 | 03:05:15 | 04:33:31 |
Abbreviation: IDS, Investigational Drug System.
Table 1 documents the time saved across 10 different studies for the drug receiving process and across 3 different studies for the drug dispensing activities—before and after implementation. Most of these studies handled multiple containers of their respective study drug to process, so the average time to perform these tasks of receiving and dispensing for each one was tracked. Depending on the sample size of the study, the time saved to complete these tasks is substantial. Additionally, a complete inventory check is done, which is also documented in Table 1. After implementation, the time to complete the inventory check was less than half the time spent before implementation. The complete inventory check for investigational drugs is performed at least twice a year. Since Table 1 only represent time savings for individual drug received per study and time saved to dispense single drug per participant per visit, when we generalize the time saving across multiple studies and multiple participants across longitudinal data points the time saving is significant. Since all the information is centralized, report generation or a spot audit could easily be performed. Figure 2 displays the benefits of IDS within each of these individual processes.
Figure 2.
Comparison of drug receiving, drug dispensing, and inventory check processes.
Additionally, all the users who have been using the IDS (which included 7 pharmacists and 2 technicians) were given a 19-question survey to evaluate IDS usability. The usability survey was developed by the BISR team at KUMC based on the IBM Computer Usability Satisfaction Questionnaire (https://garyperlman.com/quest/quest.cgi) developed by Lewis12 to capture how the pharmacists feel about using the IDS such as effectiveness, user-friendliness, efficiency, interface, and so on. Research Electronic Data Capture (REDCap) web application13 was used as the data capture tool. Overall, the responses were exceptionally positive. Out of the 10 users, 9 responded with 8 giving positive responses. The positive responses expressed that IDS was easy to use, effective, increased productivity, and overall satisfactory (Figure 3). In an open-ended question, pharmacists mentioned that the IDS “reduced dispensing times immediately,” “added security,” and “[made it] easy to generate logs.”
Figure 3.
Usability survey response.
Discussion
It is evident that the IDS has been very helpful to the pharmacists in their day-to-day operations. Additionally, the informatics and pharmacy teams have been collaborating to enhance further features that make the processes for pharmacists more effective and time-efficient. Between each study, there are different tasks that might require more time than others due to different protocol methods. From one pharmacist’s feedback, the 2 studies in which the time was not saved mentioned that there could have been other variables that slowed down the process that was unrelated to IDS. Overall, the feedback was positive in that time for dispensing and receiving would be saved whether the time was subjectively minor or significant. From the previously mentioned survey, the pharmacists were asked what the negative aspects of the IDS were. It was mentioned that the user interface layout is not “the most fluid or intuitive” and that there is a “lack of study monitor (CRA) access.” These and other design issues are a priority for improvement in the next update. There are also additional features such as financial tracking and metrics dashboard, which are on the product roadmap for the near future.
Conclusions
By modernizing the methods in which our investigational pharmacies organize and maintain relevant clinical trial information, among other benefits, there is a noticeable improvement in the efficiency and time saved in receiving and dispensing drugs. Over time, with more feedback from the pharmacists that use the system, IDS will continue to improve, and there will be more ease when it comes to handling the information vital to each unique clinical trial.
Supplemental Material
Supplemental material, Supplement_File_01_-_Survey_Instrument_3 for Utilization of Technology to Improve Efficiency in Investigational Drug Management Processes by Dinesh Pal Mudaranthakam, Colin Cernik, Leslie Curtis, Blake Griffith, Jinxiang Hu, Jo Wick, Jeffrey Thompson, Byron Gajewski, Devin Koestler, Roy A. Jensen and Matthew S. Mayo in Journal of Pharmacy Technology
Supplemental material, Supplement_File_02_-_Survey_Response_2 for Utilization of Technology to Improve Efficiency in Investigational Drug Management Processes by Dinesh Pal Mudaranthakam, Colin Cernik, Leslie Curtis, Blake Griffith, Jinxiang Hu, Jo Wick, Jeffrey Thompson, Byron Gajewski, Devin Koestler, Roy A. Jensen and Matthew S. Mayo in Journal of Pharmacy Technology
Acknowledgments
We want to extend our gratitude to the University of Kansas Cancer Center for their support during the implementation phase of IDS. We also want to recognize Jordan Baker’s effort in formatting the manuscript for submission. Additionally, we thank nCoup Inc for contributing the software platform underlying IDS.
Footnotes
Author Contributions: DPM and CC oversaw all aspects of drafting, revision, and final approval of the manuscript. LC and BG lead the process of drafting and revising the manuscript, along with tracking all the metrics before and after implementation of the IDS. LC and BG also led the effort on collecting all the survey responses. JH, JW, and BG contributed to the IDS usability survey and participated in the drafting and revising of the manuscript. JT and DCK participated in the drafting and revising of the manuscript. RAJ and MSM provided advice on design, development, and operational issues related to IDS implementation and participated in the drafting and revising of the manuscript.
Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by the National Cancer Institute (NCI) Cancer Center Support Grant P30 CA168524 and used the Biostatistics and Informatics Shared Resource (BISR).
ORCID iD: Dinesh Pal Mudaranthakam
https://orcid.org/0000-0001-9767-1158
Blake Griffith
https://orcid.org/0000-0002-4531-4244
Supplemental Material: Supplemental material for this article is available online.
References
- 1. Russell D. Centralizing your clinical trials office. pfsclinical.com/article-centralizing-your-clinical-trials-office/. Accessed January 3, 2020.
- 2. American Society of Health System Pharmacists. ASHP guidelines for the management of investigational drug products. https://www.ashp.org/-/media/assets/policy-guidelines/docs/guidelines/management-investigational-drug-products.ashx. Accessed February 16, 2019. [DOI] [PubMed]
- 3. Phan A. An experiment in IDS. www.pharmacist.com/article/experiment-ids. Published July 23, 2014. Accessed January 3, 2020.
- 4. US National Library of Medicine, ClinicalTrials.gov. Trends, charts, and maps. clinicaltrials.gov/ct2/resources/trends. Accessed February 16, 2019.
- 5. KU Medical Center, The University of Kansas. BISR services. http://www.kumc.edu/school-of-medicine/department-of-biostatistics/shared-resources-and-cores/biostatistics-and-informatics-shared-resource-university-of-kansas-cancer-center/bisr-services.html. Accessed February 16, 2019.
- 6. Buckley GJ, Gostin LO, eds. Weaknesses in the drug distribution chain. In: Current Neurology and Neuroscience Reports. Washington, DC: National Academies Press; 2013. www.ncbi.nlm.nih.gov/books/NBK202523/. [Google Scholar]
- 7. Rogers S. Automating investigational drug service operations. www.pppmag.com/article/554. Published June 2009. Accessed February 18, 2019.
- 8. Ayad KA. Inventory management in pharmacy practices: a review of the literature. Arch Pharm Pract. 2011;2:151-156. [Google Scholar]
- 9. Park YR, Yoon YJ, Koo H, et al. Utilization of a clinical trial management system for the whole clinical trial process as an integrated database: system development. J Med Internet Res. 2018;20(4):e103. doi: 10.2196/jmir.9312 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Abramowitz PW. Controlling financial variables—purchasing, inventory control, and waste reduction. Am J Hosp Pharm. 1984;41:309-317. doi: 10.1093/ajhp/41.2.309 [DOI] [PubMed] [Google Scholar]
- 11. Kim TK. T test as a parametric statistic. Korean J Anesthesiol. 2015;68:540-546. doi: 10.4097/kjae.2015.68.6.540 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Lewis JR. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Human Comp Interact. 1995;7:57-78. [Google Scholar]
- 13. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377-381. doi: 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplemental material, Supplement_File_01_-_Survey_Instrument_3 for Utilization of Technology to Improve Efficiency in Investigational Drug Management Processes by Dinesh Pal Mudaranthakam, Colin Cernik, Leslie Curtis, Blake Griffith, Jinxiang Hu, Jo Wick, Jeffrey Thompson, Byron Gajewski, Devin Koestler, Roy A. Jensen and Matthew S. Mayo in Journal of Pharmacy Technology
Supplemental material, Supplement_File_02_-_Survey_Response_2 for Utilization of Technology to Improve Efficiency in Investigational Drug Management Processes by Dinesh Pal Mudaranthakam, Colin Cernik, Leslie Curtis, Blake Griffith, Jinxiang Hu, Jo Wick, Jeffrey Thompson, Byron Gajewski, Devin Koestler, Roy A. Jensen and Matthew S. Mayo in Journal of Pharmacy Technology