Long-term disabilities suffered by patients with severe traumatic brain injury (TBI) are a continuous challenge for health care systems and a burden for patients, their families, and the community in terms of suffering, disability, and monetary cost.[13,19] Approximately 50% of TBI comatose patients with an abnormal computed tomography (CT) scan also have high intracranial pressure (ICP).[22] Death, vegetative state, and severe disability are the expected outcomes in patients with persistent high ICP not controlled by medical and/or surgical treatment. As high ICP cannot be estimated reliably by clinical examination or even sequential imaging, ICP monitoring has been considered a necessary tool for its diagnosis and management.
After decades of ongoing debate about how and when to monitor ICP, a consensus was finally reached in 1995 with the publication of the first evidence-based guidelines (EBGs) for the management of severe TBI in adults, developed under the sponsorship of the Brain Trauma Foundation (BTF).[3] Three consecutive versions of these guidelines have established–as a level II recommendation–that ICP should be monitored in “all salvageable patients with a severe TBI and an abnormal CT scan”.[3,30] BTF guidelines are endorsed by most scientific societies worldwide and they have been translated into many languages and disseminated and applied in the United States, Europe, South America, China, and Japan, thus defining the core principles for managing severe TBI. In keeping with the guidelines, care centered on ICP management is the standard for patients with severe TBI in both developed countries and those developing countries that can afford their costly management. A few studies have shown that good adherence to the BTF guidelines improve outcomes and reduce the cost of the acute care.[12,16,24,26]
The recent publication of the Benchmark Evidence from South American Trials: Treatment of Intracranial Pressure (BEST TRIP) trial in the New England Journal of Medicine (NEJM) changed this calm scenario unexpectedly, particularly because some of the investigators coauthoring the paper were also active contributors to recent versions of the BTF guidelines.[7] This randomized clinical trial (RCT), which enrolled 324 patients in 6 hospitals in Bolivia and Ecuador, reported as its main conclusion that ICP-based management increased the 6-month favorable outcome only by a marginal and nonsignificant 5% difference when compared with patients for whom care was guided with serial CTs and clinical examination.[7] Despite some clarifications by the principal investigator,[6] the main message conveyed by this trial is that ICP monitoring does not make an outcome difference when managing TBI.[14] Consequently, the debate of whether or not ICP should be monitored has been effectively resuscitated and it is receiving wide media coverage and generating more heat than light among clinicians.[14] Some neurosurgeons and intensivists would even like to have a moratorium until class I evidence is obtained for ICP monitoring.
BEST TRIP is a good example of research that has no practical relevance to the health needs of the host country, but it is apparently important to the foreign sponsors and researchers and therefore it provides a good opportunity to raise the issues of double standards, external validity, exploitation of vulnerable populations, the role of personal and clinical equipoise, and the value of biomedical research itself. There is a growing ethical concern for the obvious and hidden risks of conducting certain clinical trials in poor and low-income countries. These trials are frequently funded by pharmaceutical or medical device companies and approved by prestigious regulatory bodies that are based in Western Europe or the United States, countries where some of the trial designs and medical practices employed in these poorer countries would never be permissible.[8]
HOW MUCH EVIDENCE IS SUFFICIENT TO DEFEND, SUPPORT, OR CHANGE CURRENT CLINICAL PRACTICE?
The answer to this question depends on whether a fundamentalist, conservative, or liberal view of the EBM principles is taken.[20] For busy clinicians, EBGs are a convenient way to cope with information overload syndrome, to remain updated in their fields of interest, and to build a common framework for mutual understanding when patients are managed by different specialists.[10] Policy-makers and payers may use some reproducible results to formulate guidelines for implementing legitimate cost-control strategies in a health care scenario with finite resources. However, RCTs–the cornerstone of EBM–were designed to test the effectiveness of new treatments, rather than the accuracy of any diagnostic or monitoring tool, and it is becoming increasingly apparent that extrapolating RCT methodology to the study of these tools is, at the very least, controversial and most likely inappropriate.[27,32] A rigid application of the EBM rules would force us to abandon all monitoring methods, even harmless pulse oximetry, as well as most therapeutic strategies used in neurocritical patients, because no RCT has proven that certain monitoring methods or treatments improve long-term outcome.[1]
While we may remove the few monitors that are being used in low-income countries, we could never do this in developed countries, where any anesthesiologist or intensivist not using, for example, pulse oximetry, may face a malpractice claim should an unexpected adverse event occur, even if no robust evidence exists to show that pulse oximetry positively affects outcome. The BTF guidelines support ICP monitoring in severe TBI, even if the available evidence is less than perfect. In this scenario, is it necessary to raise the evidentiary bar for ICP monitoring? Many of us are satisfied with the level of certainty obtained so far and, as a direct consequence of the BTF's strong commitment to disseminate clinical practice standards, there is lack of clinical equipoise worldwide regarding the need for research on this topic. Most ethical review boards in developed countries would consider it unethical to conduct such a trial.
The wave of discussions generated by the BEST TRIP trial raises legitimate questions about who defines evidence, as well as who benefits from the findings. Why did different stakeholders decide to design and fund this controversial trial? In the case of the sponsoring company, it is obvious that a positive trial would have increased the sales of ICP probes in emerging economies and, therefore, would have increased company profits. However, what were the motives of the National Institutes of Health and the academic investigators for conducting such a trial? Should we accept that their main interest lay only in raising the level of evidence? We strongly see this as a naïve conclusion, which, for many of us, produces a certain amount of skepticism.
In a recent paper discussing who assigns value to the biomedical research enterprise and how that value is assigned, Dresser remarks that lobbying, politics, and commercial interests have too much influence over what is studied and why.[11] Dresser also emphasized that investigator conflicts of interest–whether declared or not–may distort the goals of biomedical research. Most physicians conducting clinical research and participating in research agendas (ourselves included) are employed by institutions where research projects are encouraged. In these institutions, research achievement and scientific output measured by different metrics (i.e., papers published in journals with high impact factors, citations, etc.) are mandatory for academic and clinical promotion, and sometimes help to increase investigator salaries. Participation in a multicenter, multinational RCT is a potential source of research funding in developed countries and sometimes a personal source of income for clinical investigators worldwide, because physicians in many industry-sponsored clinical trials are rewarded financially to enroll patients. Under these circumstances, can physicians maintain their independence and avoid the conscious or unconscious biases that can seduce them to participate in industry-funded clinical trials?
THE ELASTIC CONCEPT OF CLINICAL EQUIPOISE
Genuine uncertainty regarding the benefit or harm involved in a certain treatment among clinicians or within a community of specialists–in other words, personal and clinical equipoise–is a necessary ethical condition to enroll patients in a RCT in which treatment is selected by chance.[4] Clinical equipoise is a disagreement among the community of expert clinicians and is a much more robust concept than personal or individual equipoise defined as the legitimate, honest certainty, or the lack of it, of the treating physician.[15] When there is a lack of clinical equipoise, is it acceptable to conduct an RCT with practitioners who are in personal equipoise in another country? BEST TRIP's investigators, claimed that “the identification of a group of intensivists in Latin America who managed severe TBI without using available monitors and for whom there was equipoise regarding its efficacy”, eliminated this ethical constraint.[6] We consider this statement debatable, to say the least. In a globalized world, in which complex relationships exist between domestic and global research production, clinical equipoise must be also a global concept. What is the reason for conducting a particular clinical trial in a low-income country, when the same trial design is considered unacceptable in a developed country?
Apart from the issue of equipoise, the author's justification might be that, either in Bolivia or Ecuador, patients with a severe TBI would have not received ICP monitoring anyway, so the BEST TRIP investigators were only observing the outcome of patients that had never been monitored in the absence of any clinical trial. The investigators can argue that, as an added value, the patients in the control group received a well-designed, protocol-based management. However, this flawed argument was also used for the justification of a controversial RCT conducted in Africa to test the efficacy of a short-course of zidovudine in hopes of reducing perinatal transmission of human immunodeficiency virus (HIV). This trial raised considerable public awareness and expert concern after its publication in the NEJM.[2,21] The design and implementation of the zidovudine trial (an antiretroviral drug used for the treatment of HIV) has been criticized by many authors with strong scientific and ethical arguments. One of the strongest arguments was raised by Marcia Angell, former editor of the NEJM.[2] The main ethical issue regarding the NIH- and CDC-sponsored short-course zidovudine trial was the fact that 15 of the 16 trials used placebo controls, when long-term zidovudine treatment had been accepted already as the standard of care for HIV-infected pregnant women in the US, and evidence existed that this treatment significantly reduces the birth of children with HIV. The use of placebos would have been denied by any ethical committee if the trial had been conducted in any developed country, but the anticipated benefits of the study caused NIH and CDC officers to consider it ethically acceptable to conduct it in third-world countries. Many have compared this trial to the Tuskeegee trial, in which African American men from rural Alabama were not treated for syphilis–when penicillin was already available–in a study designed to understand the natural evolution of the disease.[2] We face a double-standard scenario when a clinical trial is unacceptable in the sponsor's country but is encouraged and funded in developing countries, where trial costs are at least 50% less, the legislation controlling human research is less strict, and research protocols are seemingly accepted and implemented more easily and more quickly. As Angell remarked, in this setting, neither informed consent nor institutional review approval is a guarantee for patient protection.[2]
In the case of BEST TRIP, randomizing one-half of the patients to a control group without ICP monitoring would not have been approved by any EU country or by the US. As an ethical imperative, research conducted in vulnerable countries and populations must follow the recommendations published by the Council for International Organizations of Medical Sciences (CIOMS), which establishes that participants in clinical research must receive the same protection they would receive in the sponsoring country. CIOMS explicitly states that populations and communities with limited resources participating in clinical research “…are, or may be, vulnerable to exploitation by sponsors and investigators from the relatively wealthy countries and communities”.[5,17] An alternative and more ethically robust design for the BEST TRIP trial may have involved some of the US Level I and Level II trauma centers that do not routinely monitor ICP in severe TBI patients.
WE HAVE THE DATA, NOW WHAT? THE NEGLECTED ISSUE OF EXTERNAL VALIDITY
When new data challenging the current clinical standards of the most developed countries have been obtained, even if the ethical approach is questionable, what should be done? Most papers concentrate on evaluating the internal validity to verify that the methodology is sufficiently robust and that systematic bias has been avoided. However, less has been said about the external validity, that is, to what extent the results of a trial can be extrapolated to a population of patients in another setting.[9,25] Concerns about the internal validity of BEST TRIP have been discussed already by others, and we fully agree with their analysis.[18] However, the extreme health care inequalities between the sponsor and host countries raise serious concerns about this trial's external validity and, therefore, its scientific value. The trial was conducted in Ecuador, a country with a per annum (p.a.) health expenditure per capita (HEPC) of US $616 in 2013, and in Bolivia, with an even lower p.a. HEPC (US $250).[31] The 2013 infant mortality rate (IMR)–the best estimator to reflect the quality of health care–was 18.5 per 1000 live births in Ecuador and 39.8 per 1000 live births in Bolivia, the latter of which is comparable to that in many Sub-Saharan African countries.[23,31]
Can the results of a trial conducted in poor countries be generalized to the US or to any developed country? The US has the highest HEPC in the world–US$ 8608 p.a.–and an IMR of 5.9 per 1000 live births,[31] and mortality for severe TBI is 21% higher in middle- and low-income countries compared with high-income countries.[8] The last figure is based only on those patients who arrive alive to hospital, and does not include the unknown number of victims who experience a TBI but are never admitted to a hospital. To implement complex management schemes, can we generalize data from trials conducted in countries with an inadequate or nonexistent emergency transportation system, where patients are managed in general intensive care units, in trauma centers with limited resources and a staff of doctors trained for a few months only? Can the results be compared with those from patients managed in specialized neurocritical units with high-tech medical equipment? We believe the answer is plain: The only way to determine whether these results can be generalized to different health care settings is to replicate the study in accredited trauma centers–or equivalent settings–in a developed country, although, paradoxically, these countries would never allow such a trial to be conducted.
POTENTIAL SOLUTIONS. THE NEED TO RAISE THE BAR OF INTERNATIONAL ETHICAL STANDARDS
As recently remarked, the health care industry-manufacturers of drugs, devices, and medical equipment and its associated political and lobbying power, heavily influence strategic directions in clinical research. They may intervene, through experts with disclosed or silenced financial industry ties, in clinical guideline formation and dissemination, and may ultimately affect daily clinical practice.[29] The industry's interests are not necessarily aligned with the interests of patients and society[29] and may lead to study participant injury or harm and also reduce the public's trust and confidence in clinical research. So what is the solution to the issues we have raised in this essay? It is obvious that the growing number of clinical trials conducted in vulnerable countries requires commitment from all stakeholders to ensure adherence to a core of internationally accepted ethical principles that reflect one of the basic ethical premises of the Declaration of Helsinki; that is, that the interests of science and society are not an excuse to conduct clinical trials in vulnerable countries. Transnational clinical research should be controlled by internationally accredited ethical review boards, and research protocols rejected in one country should not be given permission to proceed elsewhere.[21] In addition, international human research monitoring agencies should have “…the power to sanction corporations and research groups that fail to respect universal standards”.[28]
While these mechanisms are implemented, the role of major journals publishing the results of RCTs is crucial. This is because, as Smith emphasizes, when results are published in a major journal, the study receives “…the journal's stamp of approval”, the published results carry a kind of professional approbation, and the paper becomes more attractive to both the readers and media, who may amplify the real value of the results.[28] Traditional peer-review processes used by journal editors to aid in deciding which papers are worth publishing is not capable of filtering some of the more sophisticated techniques of covered marketing and conflicts of interest. The incorporation of ethicists in the peer review process would likely help to raise red flags and to properly consider the routine statement that the study was accepted by the “human review board” of some prestigious university. By rejecting suspicious ethical studies, editors may not be able to help make the world a fairer place, but they will help in building a healthier scientific community and sending a clear message, to both scientists and the industry, that it is unacceptable to exploit and potentially harm a few people for the sake of many.
Footnotes
Available FREE in open access from: http://www.surgicalneurologyint.com/text.asp?2014/5/1/86/133993
Contributor Information
Juan Sahuquillo, Email: sahuquillo@neurotrauma.net.
Alberto Biestro, Email: mapibies@adinet.com.uy.
REFERENCES
- 1.Andrews PJ, Citerio G, Longhi L, Polderman K, Sahuquillo J, Vajkoczy P. NICEM consensus on neurological monitoring in acute neurological disease. Intensive Care Medicine. 2008;34:1362–70. doi: 10.1007/s00134-008-1103-y. [DOI] [PubMed] [Google Scholar]
- 2.Angell M. The ethics of clinical research in the Third World. N Engl J Med. 1997;337:847–9. doi: 10.1056/NEJM199709183371209. [DOI] [PubMed] [Google Scholar]
- 3.Bullock R, Chesnut RM, Clifton G, Ghajar J, Marion D, Narayan R, et al. The Brain Trauma Foundation, Inc; 1995. Guidelines for the Management of Severe Head Injury. [DOI] [PubMed] [Google Scholar]
- 4.Cook C, Sheets C. Clinical equipoise and personal equipoise: Two necessary ingredients for reducing bias in manual therapy trials. J Man Manip Ther. 2011;19:55–7.5. doi: 10.1179/106698111X12899036752014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Geneva: CIOMS; 2002. Council for International Organizations of Medical Sciences WHO. International ethical guidelines for biomedical research involving human subjects. [PubMed] [Google Scholar]
- 6.Chesnut RM. Intracranial pressure monitoring: headstone or a new head start. The BEST TRIP trial in perspective. Intensive Care Med. 2013;39:771–4. doi: 10.1007/s00134-013-2852-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Chesnut RM, Temkin N, Carney N, Dikmen S, Rondina C, Videtta W, et al. A trial of intracranial-pressure monitoring in traumatic brain injury. N Engl J Med. 2012;367:2471–81. doi: 10.1056/NEJMoa1207363. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.De Silva MJ, Roberts I, Perel P, Edwards P, Kenward MG, Fernandes J, et al. Patient outcome after traumatic brain injury in high-, middle- and low-income countries: Analysis of data on 8927 patients in 46 countries. Int J Epidemiol. 2009;38:452–8. doi: 10.1093/ije/dyn189. [DOI] [PubMed] [Google Scholar]
- 9.Dekkers OM, von Elm E, Algra A, Romijn JA, Vandenbroucke JP. How to assess the external validity of therapeutic trials: A conceptual approach. Int J Epidemiol. 2010;39:89–94. doi: 10.1093/ije/dyp174. [DOI] [PubMed] [Google Scholar]
- 10.Del Mar C, Glasziou P, Mayer D. Teaching evidence based medicine. BMJ. 2004;329:989–90. doi: 10.1136/bmj.329.7473.989. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Dresser R. Alive and well: The research imperative. J Law Med Ethics. 2012;40:915–21. doi: 10.1111/j.1748-720X.2012.00720.x. [DOI] [PubMed] [Google Scholar]
- 12.Fakhry SM, Trask AL, Waller MA, Watts DD. Management of brain-injured patients by an evidence-based medicine protocol improves outcomes and decreases hospital charges. J Trauma. 2004;56:492–9. doi: 10.1097/01.ta.0000115650.07193.66. [DOI] [PubMed] [Google Scholar]
- 13.Fearnside MR, Simpson DA. Epidemiology. In: Reilly P, Bullock R, editors. Head Injury. Pathophysiology and Management of Severe Closed Injury. London, UK: Chapman and Hall; 1997. [Google Scholar]
- 14.Fitzgerald S. ICP monitoring may not make a difference in managing TBI. Neurol Today. 2013;13:16–9. [Google Scholar]
- 15.Freedman B. Equipoise and the ethics of clinical research. N Engl J Med. 1987;317:141–5. doi: 10.1056/NEJM198707163170304. [DOI] [PubMed] [Google Scholar]
- 16.Gerber LM, Chiu YL, Carney N, Hartl R, Ghajar J. Marked reduction in mortality in patients with severe traumatic brain injury. J Neurosurg. 2013;119:1583–90. doi: 10.3171/2013.8.JNS13276. [DOI] [PubMed] [Google Scholar]
- 17.Hawkins JS, Emanuel EJ. Princeton, N.J: Princeton University Press; 2008. Exploitation and developing countries: the ethics of clinical research. [Google Scholar]
- 18.Hutchinson PJ, Kolias AG, Czosnyka M, Kirkpatrick PJ, Pickard JD, Menon DK. Intracranial pressure monitoring in severe traumatic brain injury. BMJ. 2013;346:f1000. doi: 10.1136/bmj.f1000. [DOI] [PubMed] [Google Scholar]
- 19.Langlois JA, Rutland-Brown W, Wald MM. The epidemiology and impact of traumatic brain injury: A brief overview. J Head Trauma Rehabil. 2006;21:375–8. doi: 10.1097/00001199-200609000-00001. [DOI] [PubMed] [Google Scholar]
- 20.Links M. Analogies between reading of medical and religious texts. BMJ. 2006;333:1068–70. doi: 10.1136/bmj.38966.487350.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Lurie P, Wolfe SM. Unethical trials of interventions to reduce perinatal transmission of the human immunodeficiency virus in developing countries. N Engl J Med. 1997;337:853–6. doi: 10.1056/NEJM199709183371212. [DOI] [PubMed] [Google Scholar]
- 22.Narayan RK, Kishore PR, Becker DP, Ward JD, Enas GG, Greenberg RP, et al. Intracranial pressure: To monitor or not to monitor? A review of our experience with severe head injury. J Neurosurg. 1982;56:650–9. doi: 10.3171/jns.1982.56.5.0650. [DOI] [PubMed] [Google Scholar]
- 23.Newland K. Washington, D.C: Worldwatch Institute; 1981. Infant mortality and the health of societies. Worldwatch paper. [Google Scholar]
- 24.Palmer S, Bader MK, Qureshi A, Palmer J, Shaver T, Borzatta M, et al. The impact on outcomes in a community hospital setting of using the AANS traumatic brain injury guidelines. J Trauma. 2001;50:657–64. doi: 10.1097/00005373-200104000-00010. [DOI] [PubMed] [Google Scholar]
- 25.Rothwell PM. External validity of results of randomized trials: Disentangling a complex concept (Commentary) Int J Epidemiol. 2010;39:94–6. doi: 10.1093/ije/dyp305. [DOI] [PubMed] [Google Scholar]
- 26.Rusnak M, Janciak I, Majdan M, Wilbacher I, Mauritz W. Severe traumatic brain injury in Austria VI: Effects of guideline-based management. Wien Klin Wochenschr. 2007;119:64–71. doi: 10.1007/s00508-006-0765-0. [DOI] [PubMed] [Google Scholar]
- 27.Sahuquillo J. Does multimodality monitoring make a difference in neurocritical care? Eur J Anaesthesiol Suppl. 2008;42:83–6. doi: 10.1017/S0265021507003353. [DOI] [PubMed] [Google Scholar]
- 28.Smith R. Medical journals are an extension of the marketing arm of pharmaceutical companies. PLoS Med. 2005;2:e138. doi: 10.1371/journal.pmed.0020138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Stamatakis E, Weiler R, Ioannidis JP. Undue industry influences that distort healthcare research, strategy, expenditure and practice: A review. Eur J Clin Investig. 2013;43:469–75. doi: 10.1111/eci.12074. [DOI] [PubMed] [Google Scholar]
- 30.The Brain Trauma Foundation. Guidelines for the Management of Severe Traumatic Brain Injury (3rd edition) J Neurotrauma. 2007;24:S1–106. doi: 10.1089/neu.2007.9999. [DOI] [PubMed] [Google Scholar]
- 31.The Central Intelligence Agency. The World Factbook Journal. 2013. https://www.cia.gov/library/publications/the-world-factbook .
- 32.Vincent JL, Pinsky MR, Sprung CL, Levy M, Marini JJ, Payen D, et al. The pulmonary artery catheter: In medio virtus. Crit Care Med. 2008;36:3093–6. doi: 10.1097/CCM.0b013e31818c10c7. [DOI] [PubMed] [Google Scholar]