Abstract
Randomized controlled trials often suffer from two major complications, i.e., noncompliance and missing outcomes. One potential solution to this problem is a statistical concept called intention-to-treat (ITT) analysis. ITT analysis includes every subject who is randomized according to randomized treatment assignment. It ignores noncompliance, protocol deviations, withdrawal, and anything that happens after randomization. ITT analysis maintains prognostic balance generated from the original random treatment allocation. In ITT analysis, estimate of treatment effect is generally conservative. A better application of the ITT approach is possible if complete outcome data are available for all randomized subjects. Per-protocol population is defined as a subset of the ITT population who completed the study without any major protocol violations.
Keywords: Intention-to-treat analysis, per-protocol analysis, randomized controlled trials
INTRODUCTION
Randomized controlled trials (RCTs) often suffer from two major complications, i.e., noncompliance and missing outcomes. One potential solution to this problem is a statistical concept called intention-to-treat (ITT) concept. The objective of this article is to give a basic understanding of the ITT concept to the beginners in the field of clinical research. With this objective in mind, this article will review the ITT principle, with special emphasis on need and application of this concept and its pros and cons.
DEFINITION OF ITT CONCEPT
According to Fisher et al. (1990), the ITT analysis includes all randomized patients in the groups to which they were randomly assigned, regardless of their adherence with the entry criteria, regardless of the treatment they actually received, and regardless of subsequent withdrawal from treatment or deviation from the protocol.[1]
In other words, ITT analysis includes every subject who is randomized according to randomized treatment assignment. It ignores noncompliance, protocol deviations, withdrawal, and anything that happens after randomization.[2–5] ITT analysis is usually described as “once randomized, always analyzed”.[6,7]
ITT analysis avoids overoptimistic estimates of the efficacy of an intervention resulting from the removal of non-compliers by accepting that noncompliance and protocol deviations are likely to occur in actual clinical practice.[4]
NEED FOR SUCH A POPULATION
RCTs are the ideal design in assessing the efficacy and safety of medicine. In an RCT, the study subjects is randomly allocated to receive one of the treatments under study after assessment of eligibility but before the intervention is administered. Randomization in clinical trials reduces bias. The purpose of the RCT is to ensure that the groups differ only with respect to the interventions being compared.[8]
In an ideal scenario, every subject enrolled in RCT would follow instructions and complete their allocated treatment as described in the protocol and thus contribute data which were complete in all respects.[9] But unfortunately, one practical problem that investigators usually come across in RCT is that subjects do not always follow instructions. Moreover, in some studies, drop out of the subjects is a problem. Hence, RCTs often suffer from two major complications, i.e., noncompliance and missing outcomes. One potential solution to this problem is a statistical concept called ITT analysis.[10,11]
PROS OF USING ITT ANALYSIS
ITT is better regarded as a complete trial strategy for design, conduct and analysis rather than as an approach to analysis alone.[9,12] Full reporting of any deviations from random allocation and missing response is essential in the assessment of the necessity and appropriateness of an ITT approach, as emphasized in the Consolidated Standards of Reporting Trials (CONSORT) guidelines on the reporting of RCTs.[12] The CONSORT statement for improving the quality of reports of RCTs states that number of participants in each group should be analyzed by “intention-to-treat” principle.[13]
ITT analysis reflects the practical clinical scenario because it admits noncompliance and protocol deviations. ITT analysis maintains prognostic balance generated from the original random treatment allocation. It gives an unbiased estimate of treatment effect.[3,4,14] If noncompliant subjects and dropouts are excluded from the final analysis, it might create important prognostic differences among treatment groups. Moreover, subjects may be noncompliant or may drop out from the study due to their response of treatment.[3]
ITT analysis preserves the sample size because if noncompliant subjects and dropouts are excluded from the final analysis, it might significantly reduce the sample size, leading to reduced statistical power.[3]
ITT analysis limits inferences based on arbitrary or ad hoc subgroups of patients in the trial and emphasizes greater accountability for all patients enrolled in the study. Also, it minimizes type I error due to cautious approach and allows for the greatest generalizability.[15]
CONS OF USING ITT ANALYSIS
Many arguments against ITT analysis appear valid. To begin with, if a subject who actually did not receive any treatment is included as a subject who received treatment, then it indicates very little about the efficacy of the treatment. In ITT analysis, estimate of treatment effect is generally conservative because of dilution due to noncompliance. Also, heterogeneity might be introduced if noncompliants, dropouts and compliant subjects are mixed together in the final analysis. Moreover, end-point data will differ markedly among noncompliant, dropouts and compliant subjects, and interpretation might become difficult if a large proportion of participants cross over to opposite treatment arms.[3,4,12,16,17] ITT analysis has been criticized for being too cautious and thus being more susceptible to type II error.[12,15]
WHO SHOULD USE ITT?
A better application of the ITT approach is possible if complete outcome data are available for all randomized subjects. Care must always be taken to minimize missing responses and to continue to follow up those who withdraw from treatment.[4,18,19] Anyone who follows these principles intelligently and has a vision to minimize bias should not worry further about “intention to treat”.[9] However, in most cases, missing data could also be dealt by using the last observation carried forward (LOCF) method, whereby the last available measurement for each individual at the time point prior to withdrawal from the study is retained in the analysis.[20,21]
US Food and Drug Administration (FDA) guidelines for “The Format and Content of the Clinical and Statistical Sections of Applications” state that as a general rule, even if the applicant's preferred analysis is based on a reduced subset of the patients with data, there should be an additional “intent-to-treat” analysis using all randomized patients. The FDA guideline further explains that the results of a clinical trial should be assessed not only for the subset of patients who completed the study, but also for the entire patient population randomized (the ITT analysis).[22,23]
Committee for Proprietary Medicinal Products (CPMP) note for guidance “Biostatistical Methodology in Clinical Trials for Marketing Authorisations for Medicinal Products” states that decisions concerning the analysis population should be guided by the principles underlying the “intention-to-treat” and the “per-protocol” strategies. When the ITT and per-protocol (PP) analyses come to essentially the same conclusions, confidence in the study results is increased.[22,24]
The International Conference on Harmonisation (ICH) E9 guideline on “Statistical Principles for Clinical Trials” uses the term “full analysis set” to describe the analysis set which is as complete as possible and as close as possible to the ITT ideal of including all randomized subjects.[22,25]
One of the alternatives of ITT analysis is the PP analysis. It is defined as a subset of the ITT population who completed the study without any major protocol violations.[26] PP analyses exclude all protocol violators, including anyone who did not adhere to treatment, switched groups, or missed measurements.[27] ITT tends to make the two treatments look similar, whereas the PP removes patients who do not complete treatment and is more able to reflect treatment differences.[28]
CPMP guideline states that for a superiority trial, the ITT analysis should be considered primary and the PP supportive.[29] It is often argued that the ITT analysis tends to dilute the treatment difference of interest.[30] Whereas the importance of the ITT population analysis in superiority designs has been well accepted, however there is no consensus about its role in non-inferiority trials.[31]
It has been argued that protocol violations and poorly conducted trials may cause the results obtained from two different treatment groups to appear similar. Hence, ITT analysis alone is not preferred for noninferiority trial. A possible alternative is to conduct the PP analysis where only subjects meeting the inclusion criteria are considered. But the conservative effect of the PP analysis on noninferiority and equivalence trials has not been thoroughly explored. Therefore, it has been suggested that noninferiority should be concluded only if both ITT and PP analyses permit that.[28,31–36] CPMP guideline states that in a noninferiority trial, the full analysis set based on the ITT principle and the PP analysis set have equal importance and their use should lead to similar conclusions for a robust interpretation.[29]
MODIFIED ITT CONCEPT
It is a subset of the ITT population and allows the exclusion of some randomized subjects in a justified way (such as patients who were deemed ineligible after randomization or certain patients who never started treatment). However, the definition given to the modified ITT (mITT) in randomized controlled trial has been found to be irregular and arbitrary because there is a lack of consistent guidelines for its application. The mITT analysis allows a subjective approach in entry criteria, which may lead to confusion, inaccurate results and bias.[27,37,38] It is mostly used in anti-infective trials where multiple mITT populations can be defined for a single study such as clinical mITT and microbiological mITT.[39,40]
SUMMARY AND CONCLUSION
One practical problem that investigators usually come across in RCT is that subjects do not always follow instructions. Moreover, in some studies, drop out of the subjects is a problem. Hence, RCT often suffers from two major complications, i.e., noncompliance and missing outcomes. One potential solution to this problem is a statistical concept called ITT analysis. ITT analysis includes every subject who is randomized according to randomized treatment assignment. It ignores noncompliance, protocol deviations, withdrawal, and anything that happens after randomization. ITT analysis is usually described as “once randomized, always analyzed”. But in ITT analysis, estimate of treatment effect is generally conservative because of dilution due to noncompliance. Also, heterogeneity might be introduced if noncompliants, dropouts and compliant subjects are mixed together in the final analysis. Moreover, end-point data will differ markedly among noncompliant, dropouts and compliant subjects, and interpretation might become difficult if a large proportion of participants cross over to opposite treatment arms. A better application of the ITT approach is possible if complete outcome data are available for all randomized subjects. Care must always be taken to minimize missing responses and to continue to follow up those who withdraw from treatment. Anyone who follows these principles intelligently and has a vision to minimize bias should not worry further about “intention to treat”.
DISCLAIMER
The views and opinions expressed in this article are those of the author and do not necessarily reflect the official policy or position of his employer.
Acknowledgments
I gratefully acknowledge the help of anonymous reviewers for helpful comments and suggestions.
Footnotes
Source of Support: Nil.
Conflict of Interest: None declared.
REFERENCES
- 1.Fisher LD, Dixon DO, Herson J, Frankowski RK, Hearron MS, Peace KE. Intention to treat in clinical trials. In: Peace KE, editor. Statistical issues in drug research and development. New York: Marcel Dekker; 1990. pp. 331–50. [Google Scholar]
- 2.Newel DJ. Intention-to-treat analysis: Implications for quantitative and qualitative research. Int J Epidemiol. 1992;21:837–41. doi: 10.1093/ije/21.5.837. [DOI] [PubMed] [Google Scholar]
- 3.Wertz RT. Intention to treat: Once randomized, always analyzed. Clin Aphasiol. 1995;23:57–64. [Google Scholar]
- 4.Heritier SR, Gebski VJ, Keech AC. Inclusion of patients in clinical trial analysis: The intention-to-treat principle. Med J Aust. 2003;179:438–40. doi: 10.5694/j.1326-5377.2003.tb05627.x. [DOI] [PubMed] [Google Scholar]
- 5.LaValley MP. Intent-to-treat analysis of randomized clinical trials. 2003. [Last accessed on 2011 Jan 12]. Available from: http://people.bu.edu/mlava/ITT%20Workshop.pdf .
- 6.Hennekens CH, Buring JE, Mayrent SL. Boston: Little, Brown; 1987. Epidemiology in Medicine; p. 207. [Google Scholar]
- 7.Kruse RL, Alper BS, Reust C, Stevermer JJ, Shannon S, Williams RH. Intention-to-treat analysis: Who is in. Who is out? J Fam Pract. 2002;51:969–71. [PubMed] [Google Scholar]
- 8.Bubbar VK, Kreder HJ. The intention-to-treat principle: A primer for the orthopaedic surgeon. J Bone Joint Surg Am. 2006;88:2097–9. doi: 10.2106/JBJS.F.00240.top. [DOI] [PubMed] [Google Scholar]
- 9.Lewis JA, Machin D. Intention to treat--who should use ITT? Br J Cancer. 1993;68:647–50. doi: 10.1038/bjc.1993.402. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Feinman RD. Intention-to-treat. What is the question? Nutr Metab (Lond) 2009;6:1. doi: 10.1186/1743-7075-6-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Frangakis CE, Rubin DB. Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika. 1999;86:365–79. [Google Scholar]
- 12.Hollis S, Campbell F. What is meant by intention to treat analysis. Survey of published randomised controlled trials? BMJ. 1999;319:670–4. doi: 10.1136/bmj.319.7211.670. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Moher D, Schulz KF, Altman DG. CONSORT GROUP (Consolidated Standards of Reporting Trials). The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001;134:657–62. doi: 10.7326/0003-4819-134-8-200104170-00011. [DOI] [PubMed] [Google Scholar]
- 14.Montori VM, Guyatt GH. Intention-to-treat principle. CMAJ. 2001;165:1339–41. [PMC free article] [PubMed] [Google Scholar]
- 15.Fergusson D, Aaron SD, Guyatt G, Hébert P. Post-randomisation exclusions: The intention to treat principle and excluding patients from analysis. BMJ. 2002;325:652–4. doi: 10.1136/bmj.325.7365.652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Moncur RA, Larmer JC. Clinical applicability of intention-to-treat analyses. MUMJ. 2009;6:39–41. [Google Scholar]
- 17.Sheiner LB. Is intent-to-treat analysis always (ever) enough? Br J Clin Pharmacol. 2002;54:203–11. doi: 10.1046/j.1365-2125.2002.01628.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Soares I, Carneiro AV. Intention-to-treat analysis in clinical trials: Principles and practical importance. Rev Port Cardiol. 2002;21:1191–8. [PubMed] [Google Scholar]
- 19.Porta N, Bonet C, Cobo E. Discordance between reported intention-to-treat and per protocol analyses. J Clin Epidemiol. 2007;60:663–9. doi: 10.1016/j.jclinepi.2006.09.013. [DOI] [PubMed] [Google Scholar]
- 20.Sabin CA, Lepri AC, Phillips AN. A practical guide to applying the intention-to-treat principle to clinical trials in HIV infection. HIV Clin Trials. 2000;1:31–8. doi: 10.1310/e9yd-7caa-p7a0-g1j7. [DOI] [PubMed] [Google Scholar]
- 21.Streiner D, Geddes J. Intention to treat analysis in clinical trials when there are missing data. Evid Based Ment Health. 2001;4:70–1. doi: 10.1136/ebmh.4.3.70. [DOI] [PubMed] [Google Scholar]
- 22.Day S. Analysis Issues, ITT, Post-Hoc, and Subgroups. Johns Hopkins University. 2008. [last accessed on 2010 Jan 17]. Available from: http://ocw.jhsph.edu/courses/BiostatMedicalProductRegulation/biomed_lec7_day.pdf .
- 23.Guideline for the Format and Content of the Clinical and Statistical Sections of Applications, Center for Drug Evaluation and Research, Food and Drug Administration, Department of Health and Human Services, 5600 Fishers Lane Rockville, Maryland 20857 (301) 443-4330. 1988 Jul [Google Scholar]
- 24.Biostatistical Methodology In Clinical Trials. London, UK: 1993. May, Committee for Proprietary Medicinal Products Note for Guidance. [Google Scholar]
- 25.International Conference on Harmonisation. Guidance E9: Statistical Principles for Clinical Trials, recommended for adoption to the regulatory bodies of the European Union, Japan and USA. 1988 Feb [Google Scholar]
- 26.Matilde Sanchez M, Chen X. Choosing the analysis population in non-inferiority studies: Per protocol or intent-to-treat. Stat Med. 2006;25:1169–81. doi: 10.1002/sim.2244. [DOI] [PubMed] [Google Scholar]
- 27.Sainani KL. Making sense of intention-to-treat. PM R. 2010;2:209–13. doi: 10.1016/j.pmrj.2010.01.004. [DOI] [PubMed] [Google Scholar]
- 28.D’Agostino RB, Sr, Massaro JM, Sullivan LM. Non-inferiority trials: Design concepts and issues - the encounters of academic consultants in statistics. Stat Med. 2003;22:169–86. doi: 10.1002/sim.1425. [DOI] [PubMed] [Google Scholar]
- 29.London, UK: 2000. Jul, Committee for Proprietary Medicinal Products. Points to Consider on Switching between Superiority and Non-Inferiority. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Brittain E, Lin D. A comparison of intent-to-treat and per-protocol results in antibiotic non-inferiority trials. Stat Med. 2005;24:1–10. doi: 10.1002/sim.1934. [DOI] [PubMed] [Google Scholar]
- 31.Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJ CONSORT Group. Reporting of noninferiority and equivalence randomized trials: An extension of the CONSORT statement. JAMA. 2006;295:1152–60. doi: 10.1001/jama.295.10.1152. [DOI] [PubMed] [Google Scholar]
- 32.Le Henanff A, Giraudeau B, Baron G, Ravaud P. Quality of reporting of noninferiority and equivalence randomized trials. JAMA. 2006;295:1147–51. doi: 10.1001/jama.295.10.1147. [DOI] [PubMed] [Google Scholar]
- 33.Wiens BL, Zhao W. The role of intention to treat in analysis of noninferiority studies. Clin Trials. 2007;4:286–91. doi: 10.1177/1740774507079443. [DOI] [PubMed] [Google Scholar]
- 34.Dasgupta A, Lawson KA, Wilson JP. Evaluating equivalence and noninferiority trials. Am J Health Syst Pharm. 2010;67:1337–43. doi: 10.2146/ajhp090507. [DOI] [PubMed] [Google Scholar]
- 35.Blackwelder WC. Current issues in clinical equivalence trials. J Dent Res. 2004;83:C113–5. doi: 10.1177/154405910408301s23. [DOI] [PubMed] [Google Scholar]
- 36.Zee BC. Planned equivalence or noninferiority trials versus unplanned noninferiority claims: Are they equal? J Clin Oncol. 2006;24:1026–8. doi: 10.1200/JCO.2005.04.9684. [DOI] [PubMed] [Google Scholar]
- 37.Iosief A, Alessandro M, Carlo R. Modified intention to treat: Frequency, definition and implication for clinical trials. 15th Cochrane Colloquium, Sao Paulo. 2007. Oct 23-27, [Last accessed on 2011 Jan 17]. Available from: http://www.imbi.unifreiburg. de/OJS/cca/index.php/cca/article/view/5036 .
- 38.Abraha I, Montedori A. Modified intention to treat reporting in randomised controlled trials: Systematic review. BMJ. 2010;340:c2697. doi: 10.1136/bmj.c2697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Deng CQ. Intention-to-Treat and modified Intention-to-Treat Analyses in Clinical Trials. PPD Development Research Triangle Park, NC 27560. [Last accessed on 2011 Jan 17]. Available from: http://webspace.webring.com/people/eu/um_3826/ITT_mITT_JSM2004.ppt .
- 40.Ten Have TR, Normand SL, Marcus SM, Brown CH, Lavori P, Duan N. Intent-to-Treat vs. Non-Intent-to-Treat Analyses under Treatment Non-Adherence in Mental Health Randomized Trials. Psychiatr Ann. 2008;38:772–83. doi: 10.3928/00485713-20081201-10. [DOI] [PMC free article] [PubMed] [Google Scholar]