Abstract
Malnutrition contributes to an estimated 45% of deaths among children under 5 years of age in developing countries, predominantly due to infections. Malnourished children therefore stand to benefit hugely from vaccination, but malnutrition has been described as the most common immunodeficiency globally, suggesting that they may not be able to respond effectively to vaccines. The immunology of malnutrition remains poorly characterized, but is associated with impairments in mucosal barrier integrity, and innate and adaptive immune dysfunction. Despite this, the majority of malnourished children can mount a protective immune response following vaccination, although the timing, quality and duration of responses may be impaired. This paper reviews the evidence for vaccine immunogenicity in malnourished children, discusses the importance of vaccination in prevention of malnutrition and highlights evidence gaps in our current knowledge.
Keywords: children, vaccination, developing countries, malnutrition, immunology
1. Introduction
Malnutrition encompasses a broad spectrum of nutritional impairments, including intrauterine growth restriction, stunting, wasting, suboptimal breastfeeding and deficiencies of micronutrients such as vitamin A and zinc [1]. It has been estimated that, together, these conditions underlie 45% of deaths among children under 5 years of age globally [1]. As each of these manifestations is associated with an increased risk and/or severity of infections, malnutrition has been described as the most common immunodeficiency globally [2]. This raises two important questions: first, what is the nature of the apparent immunodeficiency in these children and, second, can malnourished children respond effectively to vaccinations?
2. Definitions of malnutrition
The manifestations of malnutrition described above are highly inter-related. For example, around 20% of stunting has intrauterine origins and manifests at birth as low birth weight due to intrauterine growth restriction or prematurity [3]; stunting and wasting share common risk factors and are often apparent in the same child [4]; and children with severe acute malnutrition (a form of wasting) are likely to have various micronutrient deficiencies [1]. This review will focus specifically on stunting, wasting and underweight—the most common clinical manifestations of undernutrition for which children are screened in developing countries by anthropometry.
Stunting (linear growth failure) affects an estimated 165 million (or 26%) children under 5 years of age and is defined as a height-for-age Z-score (HAZ) below −2 (i.e. more than 2 s.d. below the population median) [1]. Wasting is assessed by comparing a child's weight to their height and tends to reflect short-term growth failure: moderate acute malnutrition (MAM) is defined as a weight-for-height Z-score (WHZ) below −2 and severe acute malnutrition (SAM) as WHZ below −3. SAM presents as two major syndromes: marasmus, characterized by muscle wasting and loss of subcutaneous fat but without oedema; or kwashiorkor, a syndrome characterized by oedema, together with skin and hair changes, hepatomegaly and irritability. Although the prevalence of wasting is difficult to capture because of its more acute and reversible nature, an estimated 52 million (or 8%) children below 5 years of age are wasted at any point in time [1]. Children with low weight-for-age Z-score (WAZ < −2) are categorized as underweight, but since low WAZ can reflect either stunting or wasting, there is a tendency to move away from underweight as a metric of malnutrition, although the target for Millennium Development Goal 1 is reduction in underweight (http://www.un.org/millenniumgoals/). The nomenclature and categorization of malnutrition has changed over time and many older studies describe ‘protein energy malnutrition’, a term that may encompass several different forms of undernutrition and is no longer routinely used.
3. Malnourished children are at risk of infections
Malnutrition is associated with increased morbidity and mortality from infections [5–8]. In a recent large analysis of data derived from 10 prospective studies in Asia, Africa and South America, stunting, wasting and underweight were each associated with excess mortality; even at Z-scores between −1 and −2, children had an excess risk of death from pneumonia and diarrhoea [7]. There was a clear dose–response relationship between the degree of malnutrition and mortality, with the risk among those with wasting greater than among those with stunting. Children with the most profound anthropometric defects had an elevated risk of death from a variety of infections, including sepsis, meningitis, measles and tuberculosis. Although some datasets in this analysis were not adjusted for all potential confounders, and undernutrition may to some degree reflect general socioeconomic disadvantage, nevertheless the body of evidence indicates that malnourished children have a clear excess risk of infectious morbidity and mortality.
4. The immunology of malnutrition
It has been recognized for many decades that infection and malnutrition overlap and interact. Scrimshaw et al. [9] first described a vicious cycle of infection and undernutrition, whereby infections predispose to malnutrition, through reduced intake and absorption and diversion of nutrients away from growth, while malnutrition reduces immune function and increases the risk and/or severity of infections. Various iterations of this cycle have been proposed over the years, with more recent versions recognizing that subclinical infection, enteropathy, changes in the composition and function of the gut microbiota and systemic inflammation are likely to be important in the pathogenesis of malnutrition, in addition to overt infections [10–12]. Children hospitalized for severe acute malnutrition are extremely sick, with physiological dysfunction such as reduced respiratory muscle mass, impaired cardiac function and electrolyte disturbance, in addition to micronutrient deficiencies, inflammation, clinical infection and mucosal barrier breakdown. The internal milieu of a severely malnourished child is therefore enormously perturbed, making it difficult to distinguish the precise factors that lead to immune impairment in this setting.
Studies describing the immunology of malnutrition have recently been brought together in an excellent systematic review [12]. This review highlights the fact that the majority of studies were conducted several decades ago using old immunological techniques, making interpretation difficult. Most published observations are cross-sectional studies of hospitalized children, using varying definitions of undernutrition (with generally no distinction between stunting, underweight and wasting), and frequently without control groups or longitudinal follow-up. There is therefore an urgent need for further, larger studies of well-characterized cohorts of children with varying degrees of malnutrition, categorized according to current criteria, and followed longitudinally to probe immune function using modern laboratory techniques. Nevertheless, certain consistent findings from prior studies of immune function can be drawn from the literature, as comprehensively reviewed by Rytter et al. [12]. The current paper will provide only a brief summary of these findings, before focusing on vaccination in the context of malnutrition. A search was conducted on PubMed using the terms: (malnutrition OR undernutrition OR malnourished OR undernourished OR underweight OR stunt* OR wast* OR kwashiorkor OR marasmus) AND (vaccin* OR immunis* OR immuniz*). This review will focus only on injectable vaccines; other papers in this issue focus specifically on the underperformance of oral vaccines in developing countries.
(a). Mucosal barrier dysfunction
Malnourished children have mucosal barrier dysfunction. Compromise of the skin barrier is the most clinically evident defect in children with oedematous malnutrition, classically described as the ‘peeling paint’ dermatosis of kwashiorkor [13]. Histologically, this is characterized by atrophy and effacement of the skin layers, hyperkeratosis and a pronounced cutaneous inflammatory response [14–16], providing a potential portal of entry for pathogens. An extensive enteropathy has long been recognized in children with severe malnutrition, characterized by mucosal inflammatory infiltrate, villous atrophy and compromised intestinal barrier function [17]. It has also been noted since the 1960s that a small intestinal abnormality, originally termed tropical enteropathy, is almost universally seen among apparently healthy people living in developing countries [18,19], but it is only relatively recently that attention has refocused on this condition. A series of studies from the Gambia [20,21] showed a relationship between enteropathy and impaired linear growth in infants, and recent studies [22–24] have further highlighted the role that this gut pathology, now renamed environmental enteric dysfunction (EED) [25], may have in stunting malnutrition. The impact of enteropathy on mucosal immune function remains unclear, because of the difficulties in obtaining gut biopsies from young children, but EED may be one of the factors underlying the poor performance of oral vaccines in developing countries, as discussed in another paper in this issue [26]. The intestinal barrier dysfunction that occurs in the context of enteropathy enables translocation of organisms or microbial products to the systemic circulation, which may be particularly important for three major reasons. First, translocation of organisms may partly explain the elevated risk of Gram-negative bacteraemia in hospitalized children with SAM [27]; second, elevated levels of lipopolysaccharide impair maturation of dendritic cells, which are therefore unable to effectively support T cell proliferation [28]; and, third, microbial products stimulate innate immune cells, leading to a pro-inflammatory environment in malnourished children, which may impair effector functions.
(b). Innate immune dysfunction
Total numbers of white blood cells are preserved (or even elevated) in malnourished children, while the number of dendritic cells, which are required to present antigens to adaptive immune cells, tends to be reduced compared with well-nourished children [12]. The majority of studies show some functional impairment of neutrophils and reduced levels of complement proteins [12], both of which are critical components of innate defence against bacterial infections. Malnourished children are able to mount a robust acute phase response to infection; in fact, some studies have reported that, even in the absence of infection, malnutrition is generally a pro-inflammatory disease [12].
(c). Adaptive immune dysfunction
Malnutrition does not appear to reduce the number of lymphocytes or, specifically, the number of circulating T cells [12]. However, the thymus gland, where T cell ‘education’ occurs, is particularly targeted even among children who are mildly undernourished, with thymic involution well recognized as a hallmark of malnutrition [12]. Although the number of circulating B cells is reduced in the context of malnutrition, levels of the major immunoglobulins (IgG and IgM) are not affected, and IgA levels tend to be elevated compared with well-nourished children [12]. This may be related to the cytokine milieu in malnutrition, which is skewed towards Th2-promoting cytokines (such as IL-4 and IL-10) and away from Th1-promoting cytokines (such as IL-2, IL-12 and interferon-γ).
(d). Animal studies
In addition to the human literature summarized by Rytter et al. [12], emerging data from animal models provide insights into immune function in malnutrition and highlight mechanisms that should be investigated further in humans [29–31]. For example, when mice are fed a very low-protein diet and infected with influenza, they have reduced influenza-specific antibody and CD8+ T cell responses compared with mice fed an adequate protein diet, but immune responses are restored after feeding the undernourished mice an adequate protein diet [31]. In an elegant series of experiments in protein-restricted mice, Iyer et al. [30] showed that memory maintenance within the CD8+ T cell population is reduced in the context of malnutrition due to impaired homoeostatic proliferation and that recall responses following pathogen challenge are impaired in malnourished mice. Given the importance of a long-lived and functional CD8+ T cell memory population for effective recall responses to vaccination, these data suggest that long-term vaccine-specific immunity may be impaired in the context of malnutrition.
5. Vaccination in the context of malnutrition
Savy et al. [32] exhaustively reviewed the literature on the interactions between nutrition and vaccine responses in children in 2009. The current paper will highlight key findings from that landscape analysis, focusing on the studies that evaluated children with ‘protein energy malnutrition’, and will discuss several studies that have been published subsequently to provide an overview of vaccine responses among malnourished children (summarized in table 1).
Table 1.
Summary of vaccine responses in malnourished children.
| vaccine | responses in malnourished children | references |
|---|---|---|
| diphtheria, tetanus, pertussis (DTP) | most studies report good seroconversion rates; affinity or titre of vaccine responses may be affected | [33–37] |
| hepatitis B (HepB) | good seroconversion; conflicting data on antibody titres | [38,39] |
| rabies | no relationship between measures of malnutrition and response to vaccine | [40] |
| typhoid (killed) | similar antibody response to well-nourished children, although generation of vaccine response may be delayed in two trials, antibody responses to typhoid vaccine reported to be augmented following dietary interventions |
[34,41–45] |
| pneumococcal | responses to plain polysaccharide vaccine not associated with nutritional status no studies have specifically evaluated conjugate pneumococcal vaccines in malnourished children |
[40,46] |
| meningococcal | conflicting results from old studies of meningococcal polysaccharide vaccine no studies have specifically evaluated conjugate meningococcal vaccines in malnourished children |
[34,42,47,48] |
| Haemophilus influenzae B (HiB) | good responses to conjugated HiB vaccine in malnourished children | [39] |
| bacille Calmette–Guérin (BCG) | reduced delayed-type hypersensitivity responses (e.g. Mantoux test) following BCG no studies have characterized BCG-specific T cell responses in malnourished children |
[49–53] |
| measles | old studies suggest adequate response to measles vaccine (measured by haemagglutination) in malnourished children, but may be delayed newer study reported only 75% Ugandan children had protective measles responses (measured by ELISA) at 1 year of age |
[34,54–62] |
(a). Protein vaccines
Malnourished children generally appear to respond adequately to protein vaccines, such as diphtheria and tetanus [33–36]. For example, among 45 Nigerian children who were given a single subcutaneous dose of tetanus toxoid vaccine, seroconversion rates and titres were not significantly different between children with kwashiorkor, marasmus, marasmic-kwashiorkor and healthy controls at 3, 10 and 21 days post-vaccination [36]. Similarly, among children from nine villages in Punjab, India, whose antibody responses to tetanus were measured by indirect haemagglutination 45 and 90 days post-DTP vaccination, there was no difference in antibody titre by weight-for-age category [35]. In Nigeria, there were no significant correlations between immune responses to a range of vaccines, including tetanus, and the child's nutritional status at the time of vaccination [34].
By contrast, a more recent cross-sectional study of 1553 Ecuadorian children below 5 years of age, who had received three documented doses of DTP, showed reduced IgG antibody ELISA titres to tetanus toxoid (but not diphtheria toxoid) among children with stunting or underweight, compared with well-nourished controls; however, there was no difference in seroconversion rates to either vaccine [33]. There have been few studies of pertussis vaccine responses due to historical difficulties in pertussis-specific antibody measurement. However, a recent study from Senegal, which followed 203 children from four villages over one calendar year and measured pertussis toxin IgG antibodies by commercial ELISA, reported an effect of both birth season and nutritional status on pertussis titres [37]. Children born in October–December, which is the harvest season in Senegal, had higher pertussis-specific titres compared with those born at other times of year. There was also an interaction between birth season and the child's weight-for-age Z-score, such that underweight was associated with reduced pertussis responses among those children born in the harvest season, while responses among children born at other times (the so-called hungry season) were not influenced by the child's current weight. There was also an effect of geography, with differences in pertussis response depending on the village the child lived in, showing the complex environmental, seasonal and nutritional interactions that appear to influence immune responses in developing countries.
Taken together, studies indicate that malnourished children (including those hospitalized for severe acute malnutrition) are likely to seroconvert adequately to protein vaccines and therefore be protected, although malnutrition may have a subtle impact on affinity or titre of the antibody response, the clinical significance of which is uncertain.
(b). Subunit vaccines
Hepatitis B is a subunit vaccine based on recombinant surface antigen from the virus. In a small Egyptian study, children with SAM had similar rates of seroconversion but lower antibody titres following hepatitis B vaccination, compared with healthy controls [38]. In a more recent study from Guatemala [39], a similar proportion of healthy and malnourished infants (defined on the basis of WAZ, HAZ or WHZ below −2) mounted protective humoral responses to hepatitis B vaccination. In contrast to the Egyptian study, geometric mean concentrations of antibody were higher among malnourished than well-nourished infants [39].
(c). Killed vaccines
A large Gambian study evaluated responses to human diploid-cell rabies vaccine in older children (6.5–9.5 years old), with moderate to severe malnutrition and a range of micronutrient deficiencies, but found no consistent associations between any of these measures of undernutrition and seroconversion [40]. Several studies have evaluated responses to killed typhoid vaccine in malnourished children [34,41–43]. Two of these studies, from Nigeria, found similar antibody responses to a single dose of killed typhoid vaccine among malnourished and well-nourished groups, despite children in one of these studies [42] being strikingly unwell, with persistent measles rash, a high frequency of co-infections, severe malnutrition and 50% inpatient mortality. Two smaller studies [41,43] found lower typhoid antibody titres shortly (8–10 days) after vaccination, although in the Thai study [43] responses were similar between groups when measured later after vaccination (25 days).
Typhoid is one of the few vaccines to have been evaluated within the context of randomized controlled trials in children with malnutrition. In a 1962 South African trial [63], 30 infants with kwashiorkor received a high-protein diet and antibiotics and were then randomized to receive intramuscular pyridoxine or not. A control group comprised 15 patients with adequate nutritional status, following recovery from malnutrition or other illnesses. Infants were given typhoid and paratyphoid A and B endotoxoid intradermally, and antibody responses were evaluated by the Widal test 10 days later. Responses to vaccination were not significantly different between the three groups of infants, suggesting that infants with oedematous malnutrition can mount good antibody responses and that pyridoxine had no additive benefit. A study from India in 1964 [44] suggested that children with kwashiorkor receiving a higher protein diet (50 g d−1 compared to 30 g d−1) had better antibody responses to killed typhoid vaccine but, as noted by Savy et al. [32], the paper does not state whether dietary allocation was randomized or not. A 1972 study in New Guinea randomized children who were apparently healthy but had ‘retarded growth’ in the context of poor diets to either 25 g d−1 of protein supplement (as skim-milk powder) or usual diet [45]. Seven months later, children were vaccinated subcutaneously with flagellin from Salmonella adelaide, and total anti-flagellin antibody titres (though not specific IgG antibody titres) were reported to be higher in the supplemented group at two and six weeks post-vaccination when measured by haemagglutination.
Taken together, even children with severe malnutrition seem able to respond to killed vaccines, although generation of an immune response may be delayed. There is some intriguing evidence from old studies of killed typhoid vaccines that dietary interventions have the potential to improve responses to vaccination, although there have been no subsequent trials of nutritional interventions that have assessed vaccine outcomes.
(d). Polysaccharide vaccines
Pneumococcal plain polysaccharide vaccine (PPV) was evaluated in a cohort of 472 Gambian children aged 6.5–9.5 years, with a high prevalence of underweight (28.6%) and moderate prevalence of stunting (11.6%) [40]. After adjustment for seasonality, gender and age, there was no relationship between any measure of anthropometry and IgG responses to four vaccine serotypes measured by ELISA 14 days after vaccination, similar to findings from an older study of PPV in Ghana [46]. Pneumococcal conjugate vaccines (PCVs) are now recommended for use globally, particularly in low-income countries with high child mortality [64]. Surveillance data from South Africa show that rates of invasive pneumococcal disease (IPD) fell substantially among children following introduction of the 7-valent vaccine (PCV7) in 2009, then the 13-valent vaccine (PCV13) in 2011 [65]. Although no studies have specifically evaluated the efficacy of PCV in the context of malnutrition, there is a suggestion from a case–control study of IPD in South Africa that PCV7 vaccine efficacy may be lower in malnourished compared with well-nourished children; however, the number of children in this subgroup analysis was small and the findings not statistically significant [66].
Four studies evaluating responses to meningococcal vaccines in Nigeria have conflicting findings, with two [42,47] reporting lower vaccine responses among malnourished compared with well-nourished children, and two [34,48] reporting no impact of nutritional status on vaccine responses. One of the studies [42] reporting impaired meningococcal vaccine responses enrolled hospitalized children with SAM, persistent measles infection and high rates of other co-infections; this group had an inpatient mortality of 50%, marking them out as particularly sick children who are not representative of the majority of children who would be vaccinated in an EPI programme.
Guatemalan infants categorized as malnourished (WAZ, WHZ or HAZ <−2), who were vaccinated against Haemophilus influenzae B (HiB) as part of a combined DTwP–HepB/HiB vaccine at two, four and six months of age, were all protected by vaccination and showed higher geometric mean antibody titres than well-nourished children evaluated at the same ages [39]. Taken together, polysaccharide vaccines generally appear to generate adequate immune responses in children with malnutrition, although there are limited data from the conjugate vaccine era; however, roll-out of these vaccines in countries with high prevalence of underweight and stunting has been highly effective, with substantial reductions in morbidity and mortality.
(e). Live vaccines
One of the most widely used vaccines globally is BCG, and several studies have evaluated delayed-type hypersensitivity (DTH) responses following vaccination, by skin testing with purified protein derivative. Most are small, observational, cross-sectional studies conducted 20–40 years ago; the majority report reduced DTH responses in malnourished compared with well-nourished children [49–53] although, in some studies, children with less severe forms of malnutrition appeared to have normal DTH responses [67,68]. No studies to date have evaluated BCG-specific T cell responses in malnourished children using modern immunological techniques. Dissemination of live attenuated BCG has been described following vaccination of infants with HIV infection [69] or primary immunodeficiency [70], but does not appear to have been reported in HIV-uninfected malnourished infants. However, mice submitted to 10 days of dietary restriction prior to intradermal inoculation with BCG showed a higher frequency of BCG dissemination to lymph nodes and thymus than well-fed mice [71] and, interestingly, mycobacterial dissemination to the thymus has been shown to drive tolerance when pathogen-specific T cell responses are assessed in murine models [72]. This raises a theoretical concern that, if thymic BCG dissemination does occur in malnourished infants, they may fail to mount an effective T cell response to the vaccine; this warrants investigation in humans.
Measles infection and malnutrition have long been known to interact in a vicious cycle that can lead to protracted morbidity and high mortality [42], and measles vaccination remains a cornerstone of management of SAM [73]. Several old studies confirm that even severely malnourished children can mount an adequate immune response to measles vaccination, as assessed by haemagglutination [34,54–59], although generation of the immune response may be delayed compared with well-nourished children [60,61]. However, a recent study of 711 mother–child pairs recruited to a trial in Entebbe, Uganda, reported that only 75% of infants had protective measles-specific antibody levels measured by ELISA at 1 year of age; lower antibody responses were associated with infant wasting, after adjusting for HIV, malaria and maternal gravidity [62].
(f). Summary
Although several studies have evaluated responses to vaccination in the context of malnutrition, the evidence base remains relatively weak because most are small, old studies, using laboratory techniques and definitions of malnutrition that are now outdated; there is an urgent need to better understand the fundamental immunology of malnutrition. Despite these limitations, it appears that malnourished children can generally mount protective responses to protein, subunit, killed and polysaccharide vaccines, although titres are sometimes lower than in well-nourished children. T cells appear to be particularly affected by malnutrition [12] and responses to live vaccines such as BCG may be suboptimal, as assessed by DTH testing; further ex vivo studies are needed to clarify this. Animal data suggest that memory maintenance is impaired in malnutrition, which has important implications for long-term protection from vaccination.
It has been highlighted by Savy et al. [32] that there is an apparent paradox in malnutrition, because malnourished children die of infections, which suggests immune impairment, yet appear capable of generally mounting adequate immune responses to vaccination. There are probably several reasons for this [32]: first, vaccines are highly adjuvanted and designed to generate robust immune responses, which may overcome any immune impairment due to malnutrition; second, most vaccine studies have focused on short-term antibody responses, so may have underestimated the impact malnutrition has on the quality or longevity of the immune response generated; third, much of the infectious morbidity and mortality associated with malnutrition may arise due to impaired mucosal barrier function and innate immune defects, while humoral responses to vaccination remain fairly robust.
6. Malnutrition in the context of vaccination
As recurrent infections contribute to the pathogenesis of malnutrition [74], it seems logical that vaccination may play an important role in preventing malnutrition. The 10 best evidence-based nutrition-specific interventions are estimated to reduce stunting by only 20%, meaning that adjunctive interventions, including infection control, are probably required to prevent growth faltering in early life [75]. The most successful reductions in stunting prevalence have been achieved through multi-sectoral approaches [76,77], but dissecting out the specific contribution of vaccination is difficult. Vaccines against single pathogens are unlikely to have a substantial impact on growth; it is increasingly recognized that packages of interventions are the key to reducing malnutrition [74]. For example, a recent study undertook anthropometry in 1033 Bangladeshi children 1 year after enrolment to a placebo-controlled trial of rotavirus vaccination and found no differences in underweight, wasting or stunting between randomized groups [78]. However, it would have been surprising to see a major effect on nutritional status following administration of a single vaccine, given the range of pathogens that cause enteric infections in this setting.
Observational analyses across countries show an association between coverage of vaccination and prevalence of wasting [79] and stunting [80], but there is potential for ecological bias in these findings. Anekwe et al. [81] evaluated the impact of India's Universal Immunization Program, which was phased in over a 5-year period, on child anthropometry and found that it reduced the height-for-age deficit among children below 4 years of age by 22–25%, and reduced the weight-for-age deficit by 15%. Whether these growth benefits were due to vaccination, or to other factors associated with introduction of the programme, is unknown, but the authors remark that these findings support the notion of vaccination programmes being ‘high-return investments' for child heath [81]. In summary, vaccination is an important component of malnutrition prevention programmes, as part of an integrated bundle of interventions in early life; introduction of new vaccines is likely to yield even greater gains in disease prevention and further promote healthy growth.
7. Conclusion
There remain critical gaps in our knowledge of the relationship between infection, immunity and malnutrition, despite estimates that undernutrition is responsible for 45% of child deaths globally [1]. Compared to other fields, there has been very little recent progress in defining the pathogenesis of malnutrition, which is not simply due to lack of food, but is rather a complex interaction between infection, inflammation, mucosal barrier dysfunction, immune dysregulation and nutritional status [10]. In particular, our knowledge of the immunology of malnutrition is predominantly derived from studies conducted several decades ago, using old laboratory techniques and clinical definitions that have changed over time; the majority of studies have focused on hospitalized children with the most severe forms of malnutrition, and we have little understanding of how milder but more highly prevalent forms of malnutrition (such as stunting, which affects one-third of children globally) affect the immune system. There is therefore a need for contemporary studies of nutritional immunology, selecting populations of children based on current definitions of undernutrition (specifically, stunting (HAZ < −2), severe stunting (HAZ < −3), MAM (WHZ < −2) and severe acute malnutrition (WHZ < −3)), and comparing these children to well-nourished, age-matched controls using the same anthropometric measures. Studies should ideally be longitudinal, especially in children with moderate and severe acute malnutrition, to evaluate the impact of nutritional rehabilitation on immune recovery. Immunological techniques that assess functionality of the innate immune system (e.g. response to pathogen stimulation, neutrophil function) and adaptive immune system (e.g. T cell proliferation, cytokine elaboration, polyfunctionality and cytotoxicity) are long overdue, and it is important to understand how nutrient sensing pathways affect cellular function in the context of a dysregulated metabolic milieu, and how the quality and longevity of vaccine-specific responses may be influenced by undernutrition.
Vaccination is a cornerstone of child health interventions to reduce morbidity and mortality in developing countries and the majority of studies, despite the caveats above, suggest that malnourished children can mount adequate protective responses to vaccines. It is well recognized that the thymus is particularly targeted during malnutrition and that the cytokine milieu is skewed towards Th2 differentiation of CD4+ T cells, which support generation of humoral immune responses, and away from Th1 differentiation, required for defence against intracellular pathogens. Together, these findings may explain why antibody responses to vaccination are generally robust, while T cell responses to vaccination (e.g. BCG vaccine) appear to be diminished. Better understanding the phenotype and function of T cells in the context of malnutrition is therefore critical, particularly given the increasing interest in developing new T cell-based vaccines against pathogens such as HIV, hepatitis C and tuberculosis.
Whether the quality and duration of immune responses among malnourished children are equivalent to those of well-nourished children is unclear. Animal studies would indicate that malnutrition has a substantial impact on generation and maintenance of an effective immune response, but that nutritional interventions can ameliorate these defects; more longitudinal studies in humans are needed to evaluate changes in immune responses after nutritional, antimicrobial and/or anti-inflammatory interventions.
It is reassuring that vaccines are generally immunogenic in the context of malnutrition, as malnourished children are a high-risk group with elevated risk of infectious morbidity and mortality and therefore stand to benefit from vaccination even more than well-nourished children. Furthermore, vaccination in likely to be one of the key tools within a multi-sectoral package of interventions aimed at preventing malnutrition in early life.
Acknowledgements
Thanks to James Church for his help with the literature search conducted for this review.
Funding Statement
A.J.P. is funded by the Wellcome Trust (093768/Z/10/Z).
Conflict of interests
I have no competing interests.
References
- 1.Black RE, et al. 2013. Maternal and child undernutrition and overweight in low-income and middle-income countries. Lancet 382, 427–451. ( 10.1016/S0140-6736(13)60937-X) [DOI] [PubMed] [Google Scholar]
- 2.Katona P, Katona-Apte J. 2008. The interaction between nutrition and infection. Clin. Infect. Dis. 46, 1582–1588. ( 10.1086/587658) [DOI] [PubMed] [Google Scholar]
- 3.Christian P, et al. 2013. Risk of childhood undernutrition related to small-for-gestational age and preterm birth in low- and middle-income countries. Int. J. Epidemiol. 42, 1340–1355. ( 10.1093/ije/dyt109) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Emergency Nutrition Network. 2014. Review of the links between wasting and stunting. ENN. See http://www.ennonline.net/ourwork/reviews/wastingstunting (accessed 25 August 2014).
- 5.Black RE, Allen LH, Bhutta ZA, Caulfield LE, de Onis M, Ezzati M, Mathers C, Rivera J. 2008. Maternal and child undernutrition: global and regional exposures and health consequences. Lancet 371, 243–260. ( 10.1016/S0140-6736(07)61690-0) [DOI] [PubMed] [Google Scholar]
- 6.Kossmann J, Nestel P, Herrera MG, El Amin A, Fawzi WW. 2000. Undernutrition in relation to childhood infections: a prospective study in the Sudan. Eur. J. Clin. Nutr. 54, 463–472. ( 10.1038/sj.ejcn.1600998) [DOI] [PubMed] [Google Scholar]
- 7.Olofin I, McDonald CM, Ezzati M, Flaxman S, Black RE, Fawzi WW, Caulfield LE, Danaei G. 2013. Associations of suboptimal growth with all-cause and cause-specific mortality in children under five years: a pooled analysis of ten prospective studies. PLoS ONE 8, e64636 ( 10.1371/journal.pone.0064636) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Pelletier DL, Frongillo EA, Jr, Schroeder DG, Habicht JP. 1995. The effects of malnutrition on child mortality in developing countries. Bull. World Health Organ. 73, 443–448. [PMC free article] [PubMed] [Google Scholar]
- 9.Scrimshaw NS, Taylor CE, Gordon AJE. 1968. Interactions of nutrition and infection. Geneva, Switzerland: WHO; Monograph series no. 57. [Google Scholar]
- 10.Jones KD, Thitiri J, Ngari M, Berkley JA. 2014. Childhood malnutrition: toward an understanding of infections, inflammation, and antimicrobials. Food Nutr. Bull. 35, S64–S70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Prendergast A, Kelly P. 2012. Enteropathies in the developing world: neglected effects on global health. Am. J. Trop. Med. Hyg. 86, 756–763. ( 10.4269/ajtmh.2012.11-0743) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Rytter MJ, Kolte L, Briend A, Friis H, Christensen VB. 2014. The immune system in children with malnutrition: a systematic review. PLoS ONE 9, e105017 ( 10.1371/journal.pone.0105017) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cox JA, Beachkofsky T, Dominguez A. 2014. Flaky paint dermatosis. Kwashiorkor. JAMA Dermatol. 150, 85–86. ( 10.1001/jamadermatol.2013.5520) [DOI] [PubMed] [Google Scholar]
- 14.Freyre EA, Chabes A, Poemape O. 1973. Abnormal Rebuck skin window response in kwashiorkor. J. Pediatr. 82, 523–526. ( 10.1016/S0022-3476(73)80137-4) [DOI] [PubMed] [Google Scholar]
- 15.Sims RT. 1968. The ultrastructure of depigmented skin in kwashiorkor. Br. J. Dermatol. 80, 822–832. ( 10.1111/j.1365-2133.1968.tb11952.x) [DOI] [PubMed] [Google Scholar]
- 16.Thavaraj V, Sesikeran B. 1989. Histopathological changes in skin of children with clinical protein energy malnutrition before and after recovery. J. Trop. Pediatr. 35, 105–108. ( 10.1093/tropej/35.3.105) [DOI] [PubMed] [Google Scholar]
- 17.Burman D. 1965. The jejunal mucosa in kwashiorkor. Arch. Dis. Child. 40, 526–531. ( 10.1136/adc.40.213.526) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Desai HG, Borkar AV, Pathare SM, Dighe PK, Jeejeebhoy KN. 1969. ‘Flat’ jejunal mucosa in the tropics. Indian J. Med. Sci. 23, 1–5. [PubMed] [Google Scholar]
- 19.Schenk EA, Samloff IM, Klipstein FA. 1968. Morphology of small bowel biopsies. Am. J. Clin. Nutr. 21, 944–961. [DOI] [PubMed] [Google Scholar]
- 20.Campbell DI, Elia M, Lunn PG. 2003. Growth faltering in rural Gambian infants is associated with impaired small intestinal barrier function, leading to endotoxemia and systemic inflammation. J. Nutr. 133, 1332–1338. [DOI] [PubMed] [Google Scholar]
- 21.Lunn PG, Northrop-Clewes CA, Downes RM. 1991. Intestinal permeability, mucosal injury, and growth faltering in Gambian infants. Lancet 338, 907–910. ( 10.1016/0140-6736(91)91772-M) [DOI] [PubMed] [Google Scholar]
- 22.Kosek M, et al. 2013. Fecal markers of intestinal inflammation and permeability associated with the subsequent acquisition of linear growth deficits in infants. Am. J. Trop. Med. Hyg. 88, 390–396. ( 10.4269/ajtmh.2012.12-0549) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Lin A, et al. 2013. Household environmental conditions are associated with enteropathy and impaired growth in rural Bangladesh. Am. J. Trop. Med. Hyg. 89, 130–137. ( 10.4269/ajtmh.12-0629) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Prendergast AJ, et al. 2014. Stunting is characterized by chronic inflammation in Zimbabwean infants. PLoS ONE 9, e86928 ( 10.1371/journal.pone.0086928) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Keusch GT, et al. 2013. Implications of acquired environmental enteric dysfunction for growth and stunting in infants and children living in low- and middle-income countries. Food Nutr. Bull. 34, 357–364. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Gilmartin JA, Petri WA., Jr 2015. Exploring the role of environmental enteropathy in malnutrition, infant development and oral vaccine response. Phil. Trans. R. Soc. B 370, 20140143 ( 10.1098/rstb.2014.0143) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Berkley JA, et al. 2005. Bacteremia among children admitted to a rural hospital in Kenya. N. Engl. J. Med. 352, 39–47. ( 10.1056/NEJMoa040275) [DOI] [PubMed] [Google Scholar]
- 28.Hughes SM, Amadi B, Mwiya M, Nkamba H, Tomkins A, Goldblatt D. 2009. Dendritic cell anergy results from endotoxemia in severe malnutrition. J. Immunol. 183, 2818–2826. ( 10.4049/jimmunol.0803518) [DOI] [PubMed] [Google Scholar]
- 29.Chatraw JH, Wherry EJ, Ahmed R, Kapasi ZF. 2008. Diminished primary CD8 T cell response to viral infection during protein energy malnutrition in mice is due to changes in microenvironment and low numbers of viral-specific CD8 T cell precursors. J. Nutr. 138, 806–812. [DOI] [PubMed] [Google Scholar]
- 30.Iyer SS, Chatraw JH, Tan WG, Wherry EJ, Becker TC, Ahmed R, Kapasi ZF. 2012. Protein energy malnutrition impairs homeostatic proliferation of memory CD8 T cells. J. Immunol. 188, 77–84. ( 10.4049/jimmunol.1004027) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Taylor AK, et al. 2013. Protein energy malnutrition decreases immunity and increases susceptibility to influenza infection in mice. J. Infect. Dis. 207, 501–510. ( 10.1093/infdis/jis527) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Savy M, Edmond K, Fine PE, Hall A, Hennig BJ, Moore SE, Mulholland K, Schaible U, Prentice AM. 2009. Landscape analysis of interactions between nutrition and vaccine responses in children. J. Nutr. 139, 2154S–2218S. ( 10.3945/jn.109.105312) [DOI] [PubMed] [Google Scholar]
- 33.Brussow H, Sidoti J, Dirren H, Freire WB. 1995. Effect of malnutrition in Ecuadorian children on titers of serum antibodies to various microbial antigens. Clin. Diagn. Lab. Immunol. 2, 62–68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Greenwood BM, Bradley-Moore AM, Bradley AK, Kirkwood BR, Gilles HM. 1986. The immune response to vaccination in undernourished and well-nourished Nigerian children. Ann. Trop. Med. Parasitol. 80, 537–544. [DOI] [PubMed] [Google Scholar]
- 35.Kielmann AA, Uberoi IS, Chandra RK, Mehra VL. 1976. The effect of nutritional status on immune capacity and immune responses in preschool children in a rural community in India. Bull. World Health Organ. 54, 477–483. [PMC free article] [PubMed] [Google Scholar]
- 36.Salimonu LS, Johnson AO, Williams AI, Adeleye GI, Osunkoya BO. 1982. Lymphocyte subpopulations and antibody levels in immunized malnourished children. Br. J. Nutr. 48, 7–14. ( 10.1079/BJN19820082) [DOI] [PubMed] [Google Scholar]
- 37.Gaayeb L, et al. 2014. Immune response to Bordetella pertussis is associated with season and undernutrition in Senegalese children. Vaccine 32, 3431–3437. ( 10.1016/j.vaccine.2014.03.086) [DOI] [PubMed] [Google Scholar]
- 38.el-Gamal Y, Aly RH, Hossny E, Afify E, el-Taliawy D. 1996. Response of Egyptian infants with protein calorie malnutrition to hepatitis B vaccination. J. Trop. Pediatr. 42, 144–145. ( 10.1093/tropej/42.3.144) [DOI] [PubMed] [Google Scholar]
- 39.Asturias EJ, et al. 2009. Differences in the immune response to hepatitis B and Haemophilus influenzae type b vaccines in Guatemalan infants by ethnic group and nutritional status. Vaccine 27, 3650–3654. ( 10.1016/j.vaccine.2009.03.035) [DOI] [PubMed] [Google Scholar]
- 40.Moore SE, Goldblatt D, Bates CJ, Prentice AM. 2003. Impact of nutritional status on antibody responses to different vaccines in undernourished Gambian children. Acta Paediatr. 92, 170–176. ( 10.1111/j.1651-2227.2003.tb00522.x) [DOI] [PubMed] [Google Scholar]
- 41.Coovadia HM, et al. 1974. An evaluation of factors associated with the depression of immunity in malnutrition and in measles. Am. J. Clin. Nutr. 27, 665–669. [DOI] [PubMed] [Google Scholar]
- 42.Dossetor J, Whittle HC, Greenwood BM. 1977. Persistent measles infection in malnourished children. Br. Med. J. 1, 1633–1635. ( 10.1136/bmj.1.6077.1633) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Suskind R, et al. 1976. Immunoglobulins and antibody response in children with protein-calorie malnutrition. Am. J. Clin. Nutr. 29, 836–841. [DOI] [PubMed] [Google Scholar]
- 44.Reddy V, Srikantia SG. 1964. Antibody response in Kwashiorkor. Indian J. Med. Res. 52, j1154–j1158. [PubMed] [Google Scholar]
- 45.Mathews JD, Mackay IR, Whittingham S, Malcolm LA. 1972. Protein supplementation and enhanced antibody-producing capacity in New Guinean school-children. Lancet 2, 675–677. ( 10.1016/S0140-6736(72)92086-7) [DOI] [PubMed] [Google Scholar]
- 46.Neumann CG, et al. 1975. Immunologic responses in malnourished children. Am. J. Clin. Nutr. 28, 89–104. [DOI] [PubMed] [Google Scholar]
- 47.Mohammed I, Damisah MM. 1982. The immunological response to polyvalent meningococcal vaccine in Bauchi State, Nigeria. Trans. R. Soc. Trop. Med. Hyg. 76, 351–353. ( 10.1016/0035-9203(82)90188-2) [DOI] [PubMed] [Google Scholar]
- 48.Greenwood BM, Bradley AK, Blakebrough IS, Whittle HC, Marshall TF, Gilles HM. 1980. The immune response to a meningococcal polysaccharide vaccine in an African village. Trans. R. Soc. Trop. Med. Hyg. 74, 340–346. ( 10.1016/0035-9203(80)90095-4) [DOI] [PubMed] [Google Scholar]
- 49.Abbassy AS, et al. 1974. Studies of cell-mediated immunity and allergy in protein energy malnutrition. I. Cell-mediated delayed hypersensitivity. J. Trop. Med. Hyg. 77, 13–17. [PubMed] [Google Scholar]
- 50.Harland PS. 1965. Tuberculin reactions in malnourished children. Lancet 2, 719–721. ( 10.1016/S0140-6736(65)90457-5) [DOI] [PubMed] [Google Scholar]
- 51.McMurray DN, Loomis SA, Casazza LJ, Rey H, Miranda R. 1981. Development of impaired cell-mediated immunity in mild and moderate malnutrition. Am. J. Clin. Nutr. 34, 68–77. [DOI] [PubMed] [Google Scholar]
- 52.McMurray DN, Watson RR, Reyes MA. 1981. Effect of renutrition on humoral and cell-mediated immunity in severely malnourished children. Am. J. Clin. Nutr. 34, 2117–2126. [DOI] [PubMed] [Google Scholar]
- 53.Seth V, Kukreja N, Sundaram KR, Malaviya AN. 1981. Delayed hypersensitivity after BCG in preschool children in relation to their nutritional status. Indian J. Med. Res. 74, 392–398. [PubMed] [Google Scholar]
- 54.Ekunwe EO. 1985. Malnutrition and seroconversion following measles immunization. J. Trop. Pediatr. 31, 290–291. ( 10.1093/tropej/31.6.290) [DOI] [PubMed] [Google Scholar]
- 55.Halsey NA, Boulos R, Mode F, Andre J, Bowman L, Yaeger RG, Toureau S, Rohde J, Boulos C. 1985. Response to measles vaccine in Haitian infants 6 to 12 months old. Influence of maternal antibodies, malnutrition, and concurrent illnesses. N. Engl. J. Med. 313, 544–549. ( 10.1056/NEJM198508293130904) [DOI] [PubMed] [Google Scholar]
- 56.Idris S, El Seed AM. 1983. Measles vaccination in severely malnourished Sudanese children. Ann. Trop. Paediatr. 3, 63–67. [DOI] [PubMed] [Google Scholar]
- 57.Ifekwunigwe AE, Grasset N, Glass R, Foster S. 1980. Immune responses to measles and smallpox vaccinations in malnourished children. Am. J. Clin. Nutr. 33, 621–624. [DOI] [PubMed] [Google Scholar]
- 58.Marshall R, Habicht JP, Landrigan PJ, Foege WH, Delgado H. 1974. Effectiveness of measles vaccine given simultaneously with DTP. J. Trop. Pediatr. Environ. Child Health 20, 126–129. ( 10.1093/tropej/20.3.126) [DOI] [PubMed] [Google Scholar]
- 59.McMurray DN, Loomis SA, Casazza LJ, Rey H. 1979. Influence of moderate malnutrition on morbidity and antibody response following vaccination with live, attenuated measles virus vaccine. Bull. Pan. Am. Health Organ. 13, 52–57. [PubMed] [Google Scholar]
- 60.Powell GM. 1982. Response to live attenuated measles vaccine in children with severe kwashiorkor. Ann. Trop. Paediatr. 2, 143–145. [DOI] [PubMed] [Google Scholar]
- 61.Wesley A, Coovadia HM, Watson AR. 1979. Immunization against measles in children at risk for severe disease. Trans. R. Soc. Trop. Med. Hyg. 73, 710–715. ( 10.1016/0035-9203(79)90026-9) [DOI] [PubMed] [Google Scholar]
- 62.Kizito D, et al. 2013. Factors affecting the infant antibody response to measles immunisation in Entebbe-Uganda. BMC Public Health 13, 619 ( 10.1186/1471-2458-13-619) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Pretorius PJ, De Villiers LS. 1962. Antibody response in children with protein malnutrition. Am. J. Clin. Nutr. 10, 379–383. [DOI] [PubMed] [Google Scholar]
- 64.WHO Publication 2012. Pneumococcal vaccines WHO position paper – recommendations. Vaccine 30, 4717–4718. ( 10.1016/j.vaccine.2012.04.093) [DOI] [PubMed] [Google Scholar]
- 65.von Gottberg A, et al. 2014. Effects of vaccination on invasive pneumococcal disease in South Africa. N. Engl. J. Med. 371, 1889–1899. ( 10.1056/NEJMoa1401914) [DOI] [PubMed] [Google Scholar]
- 66.Cohen C, et al. 2014. Effectiveness of 7-valent pneumococcal conjugate vaccine against invasive pneumococcal disease in HIV-infected and -uninfected children in South Africa: a matched case-control study. Clin. Infect. Dis. 59, 808–818. ( 10.1093/cid/ciu431) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Satyanarayana K, Bhaskaram P, Seshu VC, Reddy V. 1980. Influence of nutrition on postvaccinial tuberculin sensitivity. Am. J. Clin. Nutr. 33, 2334–2337. [DOI] [PubMed] [Google Scholar]
- 68.Heyworth B. 1977. Delayed hypersensitivity to PPD-S following BCG vaccination in African children: an 18-month field study. Trans. R. Soc. Trop. Med. Hyg. 71, 251–253. ( 10.1016/0035-9203(77)90019-0) [DOI] [PubMed] [Google Scholar]
- 69.Azzopardi P, Bennett CM, Graham SM, Duke T. 2009. Bacille Calmette-Guerin vaccine-related disease in HIV-infected children: a systematic review. Int. J. Tuberc. Lung Dis. 13, 1331–1344. [PubMed] [Google Scholar]
- 70.Patel SY, Doffinger R, Barcenas-Morales G, Kumararatne DS. 2008. Genetically determined susceptibility to mycobacterial infection. J. Clin. Pathol. 61, 1006–1012. ( 10.1136/jcp.2007.051201) [DOI] [PubMed] [Google Scholar]
- 71.Ishikawa LL, et al. 2012. Is the BCG vaccine safe for undernourished individuals? Clin. Dev. Immunol. 2012, 673186 ( 10.1155/2012/673186) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Nobrega C, Roque S, Nunes-Alves C, Coelho A, Medeiros I, Castro AG, Appelberg R, Correia-Neves M. 2010. Dissemination of mycobacteria to the thymus renders newly generated T cells tolerant to the invading pathogen. J. Immunol. 184, 351–358. ( 10.4049/jimmunol.0902152) [DOI] [PubMed] [Google Scholar]
- 73.World Health Organization. 1999. Management of severe malnutrition: a manual for physicians and other senior health workers. Geneva, Switzerland: WHO. [Google Scholar]
- 74.Prendergast AJ, Humphrey JH. 2014. The stunting syndrome in developing countries. Paediatr. Int. Child Health 34, 250–265. ( 10.1179/2046905514Y.0000000158) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Bhutta ZA, Das JK, Rizvi A, Gaffey MF, Walker N, Horton S, Webb P, Lartey A, Black RE. 2013. Evidence-based interventions for improvement of maternal and child nutrition: what can be done and at what cost? Lancet 382, 452–477. ( 10.1016/S0140-6736(13)60996-4) [DOI] [PubMed] [Google Scholar]
- 76.Pronyk PM, et al. 2012. The effect of an integrated multisector model for achieving the millennium development goals and improving child survival in rural sub-Saharan Africa: a non-randomised controlled assessment. Lancet 379, 2179–2188. ( 10.1016/S0140-6736(12)60207-4) [DOI] [PubMed] [Google Scholar]
- 77.Victora CG, Aquino EM, do Carmo Leal M, Monteiro CA, Barros FC, Szwarcwald CL. 2011. Maternal and child health in Brazil: progress and challenges. Lancet 377, 1863–1876. ( 10.1016/S0140-6736(11)60138-4) [DOI] [PubMed] [Google Scholar]
- 78.Feller AJ, Zaman K, Lewis KD, Hossain I, Yunus M, Sack DA. 2012. Malnutrition levels among vaccinated and unvaccinated children between 2 and 3 years of age following enrollment in a randomized clinical trial with the pentavalent rotavirus vaccine (PRV) in Bangladesh. Vaccine 30, A101–A105. ( 10.1016/j.vaccine.2011.09.065) [DOI] [PubMed] [Google Scholar]
- 79.Frongillo EA, Jr, de Onis M, Hanson KM. 1997. Socioeconomic and demographic factors are associated with worldwide patterns of stunting and wasting of children. J. Nutr. 127, 2302–2309. [DOI] [PubMed] [Google Scholar]
- 80.Milman A, Frongillo EA, de Onis M, Hwang JY. 2005. Differential improvement among countries in child stunting is associated with long-term development and specific interventions. J. Nutr. 135, 1415–1422. [DOI] [PubMed] [Google Scholar]
- 81.Anekwe TD, Kumar S. 2012. The effect of a vaccination program on child anthropometry: evidence from India's Universal Immunization Program. J. Public Health 34, 489–497. ( 10.1093/pubmed/fds032) [DOI] [PubMed] [Google Scholar]
