We recently published a meta-analysis on vitamin C and the length of intensive care unit [ICU] stay [1] and so were interested to read Hill et al.’s meta-analysis on randomized trials of vitamin C for cardiac surgery patients published in Nutrients in September 2019 [2]. However, we have some methodological concerns.
The abstract states that “vitamin C significantly decreased … ventilation time (p < 0.00001)” [2]. We believe that this conclusion is incorrect based on the evidence presented. This particularly small p-value from Figure 6 [2] is associated with the test of heterogeneity, not with the test of overall effect (p = 0.02, Z = 2.27). In the abstract, this same error occurs for ICU length of stay and hospital length of stay in that the reported p-values are from the heterogeneity tests, not from the tests of overall effect.
Furthermore, Hill states in Figure 6 that the ventilation time in the Safaei trial [3] was 15.1 h with 1.0 h standard deviation (SD) in the vitamin C group and 22.9 h (SD 3.8 h) in the control group. These dispersion estimates were published by Safaei, however, as standard errors (SE) and not SDs: “All continuous variables are expressed as mean ± standard error of mean” [3] (p. 47) and “Values are mean ± SEM” [3] (Table 2). Thus, the use of SE in Figure 6 led to an erroneous p-value for the vitamin C effect [2]. Hill made the same error (using SE from the Safaei trial) in their meta-analysis on ICU length of stay. This same error (using SE instead of SD) was repeated in Figures 6, 8, 12, 14, 18, and 20 [2]. Consequently, they are incorrect.
Hill states that “Analyses were carried out on an intention-to-treat [ITT] basis for all outcomes, as far as possible” [2] (p. 3). The ITT principle means that investigators include in the analysis all participants who underwent randomization in the groups to which they were originally allocated [4,5,6]. However, Hill’s Figure 6 includes the Sadeghpour trial [7], which recruited 500 participants, but reported only 113 vitamin C participants and 177 placebo participants [1] (p. 3). The 42% dropout rate was very high and there were significant differences in the dropout rates between the treatment groups. Therefore, the Sadeghpour trial [7] should not be included in a meta-analysis that intends to follow the ITT principle.
Excluding the Sadeghpour trial [7] and using the SD values for the Safaei trial [3] (calculated from the published SE values), the p-value for the overall effect of vitamin C on ventilation time remained at 0.02; however, the heterogeneity disappeared (from p < 0.00001 to p = 0.39), see Figure S3 in the supplementary file. Several other concerns with the Hill meta-analysis [2] are described in the supplementary file.
Supplementary Materials
The following are available online at https://www.mdpi.com/2072-6643/12/2/586/s1, Supplementary file describing further concerns in the Hill meta-analysis [2].
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- 1.Hemilä H., Chalker E. Vitamin C can shorten the length of stay in the ICU: A meta-analysis. Nutrients. 2019;11:708. doi: 10.3390/nu11040708. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Hill A., Clasen K.C., Wendt S., Majoros Á.G., Stoppe C., Adhikari N.K.J., Heyland D.K., Benstoem C. Effects of vitamin C on organ function in cardiac surgery patients: A systematic review and meta-analysis. Nutrients. 2019;11:2103. doi: 10.3390/nu11092103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Safaei N., Babaei H., Azarfarin R., Jodati A.R., Yaghoubi A., Sheikhalizadeh M.A. Comparative effect of grape seed extract (vitis vinifera) and ascorbic acid in oxidative stress induced by on-pump coronary artery bypass surgery. Ann. Cardiac. Anaesth. 2017;20:45–51. doi: 10.4103/0971-9784.197834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.McCoy C.E. Understanding the intention-to-treat principle in randomized controlled trials. West. J. Emerg. Med. 2017;18:1075–1078. doi: 10.5811/westjem.2017.8.35985. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.DeMets D.L., Cook T. Challenges of non-intention-to-treat analyses. JAMA. 2019;321:145–146. doi: 10.1001/jama.2018.19192. [DOI] [PubMed] [Google Scholar]
- 6.CONSORT 2010 Explanation and Elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. doi: 10.1136/bmj.c869. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Sadeghpour A., Alizadehasl A., Kyavar M., Sadeghi T., Moludi J., Gholizadeh F., Totonchi Z., Ghadrdoost B. Impact of vitamin C supplementation on post-cardiac surgery ICU and hospital length of stay. Anesth. Pain Med. 2015;5:e25337. doi: 10.5812/aapm.25337. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.