See corresponding article on page 1340.
The relation between sugar-sweetened beverages (SSBs), obesity, and related health outcomes has increasingly attracted public and scientific interest. Since the late 1970s, intake of SSBs has increased more than 2-fold (1), and currently they are now the primary source of added sugar in the US diet (2). On average, SSBs contain 140–150 kcal and 35–37.5 g sugar per 12-oz serving. The prevailing mechanisms linking SSB intake to weight gain are low satiety of liquid calories and incomplete compensatory reduction in energy intake at subsequent meals, leading to an increase in total energy intake (3). SSBs also induce independent metabolic effects through their contribution to a high dietary glycemic load, leading to inflammation, insulin resistance, and impaired β cell function (3, 4). In addition, regular consumption of SSBs is associated with high blood pressure and accumulation of visceral adipose tissue and dyslipidemia through increased hepatic de novo lipogenesis.
Numerous epidemiologic studies have examined the relations between SSBs, obesity, and related cardiometabolic diseases. Whereas most studies have found positive associations, some have yielded inconsistent results, sparking controversy in the field. In general, associations are strongest and most consistent in large prospective cohort studies with long durations of follow-up and repeated measures of intake that capture long-term dietary patterns. Studies that do not adjust for the potential mediating effect of total energy intake in analyses tend to yield stronger associations; adjustment for total energy is equivalent to removing any effect of SSBs on body weight that occurs through energy intake and may thus attenuate the association (5). Furthermore, studies funded by the food industry tend to report significantly weaker associations than do non–industry-funded studies (6).
A number of reviews have been conducted to summarize the current evidence in an effort to guide clinicians, public health experts, and policymakers. However, individual reviews may be prone to bias and may vary in terms of quality. For these reasons, rigorous evaluation of published reviews can be useful for guiding public health decisions, especially for controversial topics with far-reaching implications.
In this issue of the Journal, Weed et al (7) conducted a systematic review to assess the methodologic quality of reviews or meta-analyses published in the past decade that examined the relation between SSB and health outcomes. However, rather than shedding more light on this pressing public health issue, the report obscured important relations between SSB consumption and harmful health consequences.
To assess study quality, Weed et al used the Assessment of Multiple Systematic Reviews (AMSTAR) tool to assess the quality of the studies. AMSTAR is a validated scoring system based on 11 questions specifically designed to evaluate the methodologic quality of systematic reviews (8). Systematic reviews, which include meta-analyses, use a comprehensive and criterion-based selection of relevant evidence with methods clearly stated and reproducible by others, an appraisal of validity, and an objective or quantitative summary of the evidence. In contrast, narrative reviews (including position statements by professional organizations), often written by experts in the field, are usually broader in scope but do not necessarily state criteria relevant to assessing the methodologic quality of systematic reviews (9). For example, narrative reviews typically do not include a comprehensive literature search strategy, detailed tabulation of study characteristics, data extraction methods, or an assessment of publication bias. For this reason, some studies that use AMSTAR for quality appraisal of systematic reviews have excluded narrative reviews (10).
The maximum AMSTAR score a review can receive is 11 (11 for meta-analyses and 10 for systematic reviews), with scores of 0–4 indicating low quality, 5–8 moderate quality, and 9–11 high quality (9). Overall, 17 reviews of obesity, diabetes, metabolic syndrome, and coronary heart disease were included in the report and found to be of moderate to low quality on the basis of AMSTAR scoring (mean = 4.4, median = 4, range 1–8.5) (7). Of the 17 reviews, 7 were narrative and thus did not possess many of the components relevant to the AMSTAR score. By applying the AMSTAR instrument equally to narrative and systematic reviews, the authors underestimated the quality of the reviews on SSBs and health, leading to a spurious conclusion. Not surprisingly, the studies that used a systematic or meta-analysis approach received high scores, whereas the nonsystematic narrative reviews received low scores. By lumping these 2 types of studies together, the authors created a distorted view of the state of the literature on SSBs and health outcomes.
In addition, although the authors indicated that AMSTAR scores did not improve with year of publication or overall conclusion, older reviews are superseded as new evidence accumulates, most of which has been published in the past several years and which forms the basis of multiple health recommendations and policy initiatives (11). Thus, older reviews may be methodologically sound but irrelevant given newer data.
Other methodologic concerns also raise doubts about the validity of Weed et al's analysis. For example, the meta-analysis of SSBs and BMI in children and adolescents by Forshee et al (12), which was supported by the beverage industry, was one of the few reviews to receive an AMSTAR score ≥7, despite having gross errors that fundamentally changed the findings (5). In addition, Weed et al misreported the results from the meta-analysis by Malik et al (13) by stating that only extreme categories of SSB intake were analyzed, when in actuality a dose-response analysis that used data from all categories was included. A systematic review of reviews, like the individual reviews themselves, should be of sufficiently high quality and methodologic rigor so that reliable conclusions can be drawn.
Although more research is needed, the weight of the evidence based on previous systematic reviews and meta-analyses of prospective studies shows clear and consistent associations between SSBs and obesity and related cardiometabolic diseases. This evidence is also supported by findings from mechanistic and experimental studies. Systematic reviews have been widely used to summarize the best available evidence for clinical and public health policy and decision making. Statements from the American Heart Association, the American Academy of Pediatrics, and the US 2010 Dietary Guidelines technical review committee (14) all call for reductions in intake of SSBs to prevent obesity and improve health. These recommendations are based on previous systematic reviews and meta-analyses. Despite attempts from the beverage industry to obfuscate the issue by funding biased analyses and reviews, and by providing misleading information to consumers, many regulatory strategies to reduce intake of SSBs are already in place (11). Some states are considering taxation (11) as a means of reducing SSB intake and as a method of offsetting some of the high health care costs attributed to regular consumption of these beverages. These measures have a great potential to reduce SSB consumption and their adverse health consequences.
Acknowledgments
We thank Dr Walter Willett, Dr Eric Ding, and Ms Vanessa Boulanger for helpful comments.
Neither of the authors had a conflict of interest to declare.
REFERENCES
- 1.Popkin BM. Patterns of beverage use across the lifecycle. Physiol Behav 2010;100:4–9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Johnson RK, Appel LJ, Brands M, et al. Dietary sugars intake and cardiovascular health: a scientific statement from the American Heart Association. Circulation 2009;120:1011–20 [DOI] [PubMed] [Google Scholar]
- 3.Malik VS, Popkin BM, Bray GA, Despres JP, Hu FB. Sugar-sweetened beverages, obesity, type 2 diabetes mellitus, and cardiovascular disease risk. Circulation 2010;121:1356–64 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Aeberli I, Gerber PA, Hochuli M, et al. Low to moderate sugar-sweetened beverage consumption impairs glucose and lipid metabolism and promotes inflammation in healthy young men: a randomized controlled trial. Am J Clin Nutr 2011;94:479–85 [DOI] [PubMed] [Google Scholar]
- 5.Malik VS, Willett WC, Hu FB. Sugar-sweetened beverages and BMI in children and adolescents: reanalyses of a meta-analysis. Am J Clin Nutr 2009;89:438–9, author reply 439-40 [DOI] [PubMed] [Google Scholar]
- 6.Vartanian LR, Schwartz MB, Brownell KD. Effects of soft drink consumption on nutrition and health: a systematic review and meta-analysis. Am J Public Health 2007;97:667–75 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Weed DL, Althuis MD, Mink PJ. Quality of reviews on sugar-sweetened beverages and health outcomes: a systematic review. Am J Clin Nutr 2011;94:1340–7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Shea BJ, Grimshaw JM, Wells GA, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007;7:10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Cook DJ, Mulrow CD, Haynes RB. Systematic reviews: synthesis of best evidence for clinical decisions. Ann Intern Med 1997;126:376–80 [DOI] [PubMed] [Google Scholar]
- 10.Braga LH, Pemberton J, Demaria J, Lorenzo AJ. Methodological concerns and quality appraisal of contemporary systematic reviews and meta-analyses in pediatric urology. J Urol 2011;186:266–71 [DOI] [PubMed] [Google Scholar]
- 11.Chaloupka FJ, Powell LM, Chriqui JF. Sugar-sweetened beverages and obesity: the potential impact of public policies. J Policy Anal Manage 2011;30:645–55 [DOI] [PubMed] [Google Scholar]
- 12.Forshee RA, Anderson PA, Storey ML. Sugar-sweetened beverages and body mass index in children and adolescents: a meta-analysis.. Am J Clin Nutr 2008;87:1662–71 [DOI] [PubMed] [Google Scholar]
- 13.Malik VS, Popkin BM, Bray GA, Despres JP, Willett WC, Hu FB. Sugar-sweetened beverages and risk of metabolic syndrome and type 2 diabetes: a meta-analysis. Diabetes Care 2010;33:2477–83 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Yale Rudd Center Sugar-sweetened beverage taxes and sugar intake: policy statements, endorsements and recommendations. Available from: http://www.yaleruddcenter.org/resources/upload/docs/what/policy/SSBtaxes/SSBTaxStatements.pdf (cited 10 September 2011)