Summary
Clinical research is burdened by complex pathways, tedious steps, numerous inefficiencies, and a poor track record of trial completion. The CTSA Program’s consortium supports a unified national effort that has become, in effect, a virtual national laboratory designed to identify, implement, evaluate, and continue process improvement across all the steps required to design, approve, initiate, and complete clinical trials. If it is properly supported by academic centers, industry, and funding agencies, the virtual national laboratory could succeed in advancing and maintaining major improvements in clinical trial conduct and efficiency.
Translational research is the process of taking biomedical laboratory findings through preclinical and clinical testing into treatments in the community and ultimately into improved population health. It encompasses all of the research steps required to support the entire continuum from discovery to standard clinical practice and measures of effectiveness. The translational process has become sufficiently complex, slow, and frustrating that it constitutes a major challenge facing science and society in the early 21st century1-5. Indeed, impaired translation of biomedical research, threatens the pharmaceutical industry, which underwent a substantial reduction in licensing of new molecular entities over the last two decades6. Pharmaceutical products ready for clinical testing have failure rates in excess of 80% and development costs of over $1.2 billion per drug. In addition, years of drawn out processes encumber clinical trials7-10. Until recently, no concerted effort to streamline performance in biomedical product development in the United States has been undertaken, in marked contrast to the automotive and other industries which reduced their production times by 41% in the decade from 1995 to 200411.
While there are a number of definable phases in the translational pipeline 12, one of the most critical involves the management of clinical research itself, especially the rapid incorporation of the best available science and technology on behalf of patients and consumers 13. Lack of sufficient institutional commitment to streamline clinical research management has challenged efforts to improve the efficiency of this phase. Additional challenges include lengthy and highly variable protocol and contract processing times, duplicative, multi-site IRB review of identical multi-site clinical protocols, delayed study start-up, and closure of an inordinate number of trials without sufficient accruals to arrive at a meaningful research conclusion. These factors add greatly to the time and cost of developing new translational therapeutics. Recently reported observational studies attest to the severity of the need for change. In oncology, the most studied disease area, for example, the development of NCI-sponsored Phase III protocols required a median of 2.5 years14 with between 25-38% of such trials failing due to accrual issues 15, 16. Lengthy development time, from initial submission to final approval, correlated with low accrual success15. These and similar findings in other studies led to a call to reinvigorate the national cancer clinical trials system17.
Improvement in clinical research efficiency at academic health centers (AHCs) across the United States became a top priority of the recipients of the Clinical and Translational Science Awards (CTSAs). Designed to create an academic home for clinical and translational research, in 2006 the CTSAs set their sights on a number of goals, including making clinical research more efficient. Although each site identified its own set of challenges in process management, the 12 initial awardees focused on protocol approval and contract execution times as short term goals; they proposed studies that would enable individual sites to learn to track project completion times, develop performance metrics, analyze protocol processing data, and implement improvements based on the findings. Utilizing tools proven successful in other industries, a number of CTSAs have developed protocol processing improvement activities and have instituted continuous process improvement across a broad range of clinical research management issues. As additional CTSA sites were added to the Consortium in each subsequent year until 2011, they were invited to join the effort to improve clinical research management as a high priority. As a consequence, the CTSA Consortium was able to mount a large, nationwide effort to improve clinical research management for an annually increasing number of sites as reflected by the data in Table I.
Table I.
CTSA Site Participation in Consortium Process Improvement Strategies In Clinical Research Management
| CTSA Site Participation in Consortium Process Improvement Strategies | |||
|---|---|---|---|
| Identified Challenges | Strategic Intervention Team | Intervention | Participation (No. of Sites / Total Sites at time of intervention (%)) |
| Lack of institutional commitment to efficient clinical research management |
Appoint Champions of Change | Implement Process Improvement as guided by Consortium wide studies, data, analysis, and recommendations |
51/55 CTSA sites (93%) |
| Lengthy Protocol processing | Protocol Review Committee | Two Consortium wide studies of Protocol processing times |
50/55 CTSA sites (91%) |
| Lengthy Contract negotiation | Contract Review Committee | Two Consortium wide studies of Contract negotiation times |
42/46 CTSA sites (91%) |
| Multi-site IRB review of identical multi-site clinical protocols |
Reliance IRB Agreements Groups | Regional agreements member CTSA site (No. of institutions) that signed agreement: Harvard (10), University of Wisconsin, Medical College of Wisconsin (Milwaukee)(5), The University of Texas (15), The University of California(4), Case Western (4) University of Rochester(16) University of Colorado(5), several other sites(2-3) |
>20/60 |
| Delayed study start-up, inadequate enrollment of study participants |
Recruitment Group | Recruitment model demonstrations
|
N/A |
| Web-Based Recruitment | ResearchMatch | 54/55 CTSA sites (98%) | |
| Delayed completion of studies | Feasibility Group | Pending | |
| Research Participant Survey | A quality and research experience assessment | 13/38 sites (34%) | |
However, implementation of local improvements will do little to change our national performance of biomedical translation, which requires synchronous completion of clinical trials to move products through the pipeline. Understanding this, the National Center for Research Resources (NCRR) and Yale Center for Clinical Investigation instituted a series of national information sharing meetings. The fourth annual such meeting, completed in June 2011, provided a forum for the current 60 CTSA sites to note the progress in confronting the challenges the CTSA Consortium had previously identified as high priority. As noted in Table I, 91% of the active sites participated in a voluntary process analysis study for protocol approval and contract execution times, and 93% appointed Champions of Change to direct and implement process improvements. Additionally, participants in reliance IRB agreements reported hundreds of single site IRB reviews of multi-site protocols; model recruitment programs with prospective recruitment planning and dedicated staff exceeded expectations in registering participants. Also, by mid-2011, a web-based, nationwide recruitment program, ResearchMatch, which was developed through the CTSAs with NCRR funding, facilitated registration of participants in over 250 studies.
While these are all worthwhile initiatives, it is time to pool these efforts to create a community of practice so that individual institutional efforts can be evaluated using national performance data and the execution of multi-institutional efforts can be fostered. At this juncture, the taskforces are staffed and positioned to use the accumulating data; an advisory group has identified barriers to process completion as reflected in its analysis of process streams. Informed of achievable goals and motivated by the visibility of the data, the CTSA sites have organized a Process Excellence Group to test methodologies and teach each other how to significantly streamline approaches to the often “invisible” barriers to clinical research 18. Thus, much like the basic sciences who can share experiences to develop national level laboratory results, the CTSAs are combining their efforts to create a virtual national laboratory for clinical translational research. This structure allows for the sharing of successful programs, positive changes, and lessons learned along the way.
What more is needed? The organization that must do the work has formed. Participants at the ground level accept the central concepts of process mapping, project tracking, analysis, implementation of change, and systematic re-evaluation. It remains for national leadership, government, academic, and the private sector to support the fledgling virtual national laboratory of CTSAs as it begins the task of building on these initial efforts into process improvement. What the Consortium has learned is that there are no easy fixes, no simple solutions, no universal remedies for the inefficiencies in US health care research which now includes over 9,700 active, interventional studies and trials in Phases I – III supported by NIH and industry19. The key process engineering methodologies have been piloted and refined, but, as with all change, not every process refinement will succeed. Indeed, even if process changes do succeed, downstream effects may at times impede overall completion times. With leadership and industrial support, adequate allocation of resources, and a CTSA Consortium committed to facilitating the clinical and translational science process, the virtual national laboratory is positioned to provide an environment where each proposed improvement can be systematically tested, so that the successful ones may be retained and the failures rejected quickly. The expectation is that this incremental evolution will move progressively toward making clinical research more efficient. The initial results suggest that significant improvements in clinical translation are being translated into reality.
It is time to make these changes as there is an ever increasing need for more complex clinical trials that combine ever more “omic” information, coupled with a decreasing level of resources available to complete such studies, an increasing level of international competition, and an increasing number of patients who need better answers sooner. Improving time and quality are of the essence in clinical research if America is to remain world-class and not fall into the difficulties that faced many other U.S. industries that were “too-big-too-fail” 20, 21 To implement the necessary changes will require a sustained, prolonged, consistent effort more similar to a marathon than a sprint. Such a sustained effort is underway both locally and in the virtual national laboratory of the CTSAs.
Acknowledgements
The authors gratefully acknowledge the careful review and valuable suggestions made by Barbara Alving, MD, Philip Cola, PhD, Anthony Hayward, MD, PhD, Royce Sampson, MSN, RN, Jeff Silverstein, MD, and Jane Strasser PhD.
This research was supported in part by funding from the following grants: NIH/ NCRR Institutional Clinical and Translational Science Awards. NIH Grant #s: 1 UL1 RR024996 (Oregon Clinical and Translational Research Institute), 1 UL1 RR024996 (CTSA at Weill Cornell Medical College), and UL1 RR024139 and UL13 RR025975 (Yale Center for Clinical Investigation).
The information and opinions expressed in this publications are those of the authors and do not reflect the policies of the United States Government.
References
- 1.Balas EA, Boren SA. Yearbook of Medical Informatics. Schattauer Verlagsgesellschaft mbH; Stuttgart , Germany: 2000. Managing Clinical Knowledge for Healthcare Improvement. [PubMed] [Google Scholar]
- 2.Birmingham K. What is translational research? Nat Med. 2002;8:647. doi: 10.1038/nm0702-647. [DOI] [PubMed] [Google Scholar]
- 3.Contopoulos-Ioannidis DG, Alexiou GA, Gouvias TC, Ioannidis JP. Medicine. Life cycle of translational research for medical interventions. Science. 2008;321:1298–9. doi: 10.1126/science.1160622. [DOI] [PubMed] [Google Scholar]
- 4.Westfall JM, Mold J, Fagnan L. Practice-based research--“Blue Highways” on the NIH roadmap. Jama. 2007;297:403–6. doi: 10.1001/jama.297.4.403. [DOI] [PubMed] [Google Scholar]
- 5.Zerhouni E. Medicine. The NIH Roadmap. Science. 2003;302:63–72. doi: 10.1126/science.1091867. [DOI] [PubMed] [Google Scholar]
- 6.Kaitin KI. Obstacles and opportunities in new drug development. Clin Pharmacol Ther. 2008;83:210–2. doi: 10.1038/sj.clpt.6100462. [DOI] [PubMed] [Google Scholar]
- 7.Collins FS. Reengineering Translational Science: The Time is Right. Sci Transl Med. 2011;6:1–6. doi: 10.1126/scitranslmed.3002747. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Dimasi JA. New drug development in the United States from 1963 to 1999. Clin Pharmacol Ther. 2001;69:286–96. doi: 10.1067/mcp.2001.115132. [DOI] [PubMed] [Google Scholar]
- 9.Munos B. Lessons from 60 years of pharmaceutical innovation. Nat Rev Drug Discov. 2009;8:959–68. doi: 10.1038/nrd2961. [DOI] [PubMed] [Google Scholar]
- 10.Paul SM, Mytelka DS, Dunwiddie CT, et al. How to improve R&D productivity: the pharmaceutical industry’s grand challenge. Nat Rev Drug Discov. 2010;9:203–14. doi: 10.1038/nrd3078. [DOI] [PubMed] [Google Scholar]
- 11.Adams M, Boike D. PDMA Foundatoin CPAS Study reveals new trends. PDMA Visions. 2004;XXVIII:26–9. [Google Scholar]
- 12.Trochim W, Kane C, Graham MJ, Pincus HA. Evaluating Translational Research: A Process Marker Model. Clin Transl Sci. 2011;4:153–62. doi: 10.1111/j.1752-8062.2011.00291.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hamburg MA. Advancing regulatory science. Science. 2011;331:987. doi: 10.1126/science.1204432. [DOI] [PubMed] [Google Scholar]
- 14.Dilts DM, Cheng SK, Crites JS, Sandler AB, Doroshow JH. Phase III clinical trial development: a process of chutes and ladders. Clin Cancer Res. 2010;16:5381–9. doi: 10.1158/1078-0432.CCR-10-1273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Cheng SK, Dietrich MS, Dilts DM. A sense of urgency: evaluating the link between clinical trial development time and the accrual performance of cancer therapy evaluation program (NCI-CTEP) sponsored studies. Clin Cancer Res. 2010;16:5557–63. doi: 10.1158/1078-0432.CCR-10-0133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Korn EL, Freidlin B, Mooney M, Abrams JS. Accrual experience of National Cancer Institute Cooperative Group phase III trials activated from 2000 to 2007. J Clin Oncol. 2010;28:5197–201. doi: 10.1200/JCO.2010.31.5382. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Nass SJ, Moses HL. A national cancer clinical trials system for the 21st century: reinvigorating the NCI Cooperative Group Program: Natl Academy Pr. 2010. [PubMed]
- 18.Dilts DM, Sandler AB. Invisible barriers to clinical trials: the impact of structural, infrastructural, and procedural barriers to opening oncology clinical trials. J Clin Oncol. 2006;24:4545–52. doi: 10.1200/JCO.2005.05.0104. [DOI] [PubMed] [Google Scholar]
- 19.ClinicalTrials.Gov. [Accessed July 13, 2011]. 2011. at.
- 20.Dilts DM. Early warning: an ailing canary in the mine. J Clin Oncol. 2010;28:3799–800. doi: 10.1200/JCO.2010.29.8810. [DOI] [PubMed] [Google Scholar]
- 21.Dilts D. US cancer trials may go the way of the Oldsmobile. Nat Med. 2010;16:632. doi: 10.1038/nm0610-632. [DOI] [PubMed] [Google Scholar]
