Skip to main content
Public Health Nutrition logoLink to Public Health Nutrition
. 2012 Oct 9;16(2):256–266. doi: 10.1017/S1368980012004491

Diet–obesity associations in children: approaches to counteract attenuation caused by misreporting

Claudia Börnhorst 1, Inge Huybrechts 2,3, Antje Hebestreit 1, Barbara Vanaelst 2,4, Dénes Molnár 5, Silvia Bel-Serrat 6, Theodora Mouratidou 6, Luis A Moreno 6, Valeria Pala 7, Marge Eha 8, Yiannis A Kourides 9, Alfonso Siani 10, Gabriele Eiben 11, Iris Pigeot 1,*, on behalf of the IDEFICS consortium
PMCID: PMC10271438  PMID: 23046605

Abstract

Objective

Measurement errors in dietary data lead to attenuated estimates of associations between dietary exposures and health outcomes. The present study aimed to compare and evaluate different approaches of handling implausible reports by exemplary analysis of the association between dietary intakes (total energy, soft drinks, fruits/vegetables) and overweight/obesity in children.

Design

Cross-sectional multicentre study.

Setting

Kindergartens/schools from eight European countries participating in the IDEFICS Study.

Subjects

Children (n 5357) aged 2–9 years who provided one 24 h dietary recall and complete covariate information.

Results

The 24 h recalls were classified into three reporting groups according to adapted Goldberg cut-offs: under-report, plausible report or over-report. In the basic logistic multilevel model (adjusted for age and sex, including study centre as random effect), the dietary exposures showed no significant association with overweight/obesity (energy intake: OR=0·996 (95 % CI 0·983, 1·010); soft drinks: OR = 0·999 (95 % CI 0·986, 1·013)) and revealed even a positive association for fruits/vegetables (OR = 1·009 (95 % CI 1·001, 1·018)). When adding the reporting group (dummy variables) and a propensity score for misreporting as adjustment terms, associations became significant for energy intake as well as soft drinks (energy: OR = 1·074 (95 % CI 1·053, 1·096); soft drinks: OR = 1·015 (95 % CI 1·000, 1·031)) and the association between fruits/vegetables and overweight/obesity pointed to the reverse direction compared with the basic model (OR = 0·993 (95 % CI 0·984, 1·002)).

Conclusions

Associations between dietary exposures and health outcomes are strongly affected or even masked by measurement errors. In the present analysis consideration of the reporting group and inclusion of a propensity score for misreporting turned out to be useful tools to counteract attenuation of effect estimates.

Keywords: Adjustment, Cross-sectional, Propensity score, Reporting group, 24 h Dietary recall


Measurement errors in dietary variables pose a challenge for epidemiologists when investigating associations between dietary intakes and health outcomes( 1 ). Problems in particular emerge from misreporting, which comprises under-reporting and over-reporting. Several studies have revealed that misreporting is characteristic to specific individuals and results in differential errors( 2 4 ). Differential errors are related to the outcome of interest and induce bias such that associations between dietary factors and health outcomes may be attenuated, exaggerated or hidden( 5 ), whereas non-differential (random) errors tend to attenuate associations. Various procedures have been proposed to screen out implausible dietary recalls( 6 , 7 ) but the question how to handle recalls identified as implausible is still open.

Researchers commonly refer to validation studies that confirm the accuracy/reliability of their assessment instruments but do not consider misreporting in the later analyses, although there are different procedures that could be applied( 8 , 9 ): (i) exclusion of inaccurate recalls; (ii) adjustment for the reporting group (under-report, plausible report, over-report); (iii) stratified analysis by reporting group; and (iv) propensity score adjustment.

Despite several studies having found that exclusion of under-reports strengthened diet–obesity relationships( 3 , 10 , 11 ), data exclusions may introduce a source of unknown bias and has not been recommended( 12 ). Adjusting for the reporting group seems an appropriate alternative to data exclusions and was shown to yield consistent results compared with those obtained from plausible reports in stratified analyses( 10 ). Although not applied in this context yet, the propensity score is a common tool to reduce bias by equating groups based on selected covariables. A propensity score reflects the conditional probability of assignment to a particular group given a vector of observed covariables( 13 ). Construction of a propensity score based on variables previously found to be related to misreporting could be another option to account for implausible recalls.

Studies in adults investigating the handling of implausible recalls are rare( 8 , 9 , 14 ). To the authors’ knowledge, no study to date has addressed this issue in children. As dietary recalls in young children often rely on proxy reports( 15 ), it is likely that misreporting is triggered by different factors compared with adults (e.g. unintentional under-reporting due to lack of parental control). The present study aimed to evaluate the four different approaches to account for misreporting in the statistical analysis mentioned above and finally to give recommendations on how to handle the problem of inaccurate reports in future studies on dietary behaviour in children.

Materials and methods

Study population

IDEFICS (Identification and prevention of Dietary- and lifestyle-induced health EFfects In Children and infantS) is a multicentre, setting-based study aiming to prevent and investigate the causes of diet- and lifestyle-related diseases like overweight and obesity in European children aged 2–9 years. The baseline survey was conducted from September 2007 to June 2008; more than 31 500 children were contacted, out of whom finally 16 220 participated and fulfilled the inclusion criteria of the IDEFICS Study. Children were recruited through kindergartens/schools. In addition to self-completion questionnaires, interviews with parents concerning lifestyle habits and dietary intakes as well as anthropometric measurements and examinations of the children were conducted in examination centres, which were the settings in most countries. All measurements were taken by trained study personnel using standardised procedures in all eight study centres (Belgium, Cyprus, Estonia, Germany, Hungary, Italy, Spain and Sweden). Details on the design and objectives of the study are given elsewhere( 16 , 17 ).

Ethics approval

Applicable institutional and governmental regulations regarding the ethical use of human volunteers were followed during this research. Approval of the appropriate ethics committees was obtained by each of the eight participating centres carrying out the fieldwork (Belgium: Ethics Committee, University Hospital, Ghent; Cyprus: Cyprus National Bioethics Committee; Estonia: Tallinn Medical Research Ethics Committee; Germany: Ethics Committee, Universtiy of Bremen; Hungary: Egészségügyi Tudományos Tanács, Pécs; Italy: Comitato Etico, Avellino; Spain: Comité Ético de Investigación, Clínica de Aragón (CEICA); Sweden: Regional Ethics Review Board, University of Gothenburg).

Parents provided written informed consent for all examinations. Each child was informed orally about the modules by field workers and asked for his/her consent immediately before examination( 17 ). Study children did not undergo any procedure before both they and their parents gave consent for examinations, collection of samples, subsequent analysis and storage of personal data and collected samples. Participants and their parents could consent to single components of the study while abstaining from others.

Anthropometry

Height (centimetres) of the children was measured to the nearest 0·1 cm with a calibrated statiometer (Seca 225; Seca, Birmingham, UK); body weight (kilograms) was measured in light underwear on a calibrated scale accurate to 0·1 kg (Tanita BC 420 SMA; Tanita Europe GmbH, Sindelfingen, Germany). BMI was calculated as weight divided by height squared and the children were categorised according to the International Obesity Taskforce criteria( 18 , 19 ). According to these criteria, centile curves corresponding to a BMI of 25 kg/m2 and 30 kg/m2 at age 18 years are chosen as extrapolation into childhood of the well-accepted adult cut-offs to define overweight/obesity, respectively. Thin and normal-weight children, as well as overweight and obese children, were combined into one category each to construct a binary outcome measure to be included in the logistic model.

Dietary data

Dietary data were assessed using the computerised 24 h dietary recall (24-HDR) SACINA (Self-Administered Children and Infants Nutrition Assessment), which is based on the previously designed and validated HELENA-DIAT( 20 ) instrument that was originally developed for Flemish adolescents( 21 ). SACINA is structured according to six meal occasions (breakfast, morning snack, lunch, afternoon snack, dinner, evening snack) related to a range of chronological daily activities. For each food item the participant selects the consumed quantity by means of pictures with increasing portion sizes (based on predefined standard amounts) that are displayed on the screen to facilitate estimation of portion sizes. The intake of the food item is calculated then as the product of the reported quantity and the standard amount (e.g. 4 spoons of sauce at 15 g = 60 g). Proxies, mainly the parents, completed the 24-HDR under supervision of field personnel which lasted 20–30 min. In case the child had lunch at school on weekdays, school meals were additionally assessed by means of direct observation. Trained observers, teachers or caregivers entered portion sizes of all consumed foods and drinks on predefined assessment sheets. The uniquely coded food items were linked to country-specific food composition tables. Missing quantities for single food items as well as obviously implausible data entries were imputed by country-, food group- and age-specific median intakes (0·01 % of the entries) to avoid excessive recall exclusions. Incomplete interviews were excluded, e.g. if the proxy did not know about at least one main meal or in the case of missing school meal information (n 2518). Furthermore, intakes of energy >16 736 kJ/d (>4000 kcal/d) which seemed to be a result of computer or data-entry errors rather than of misreporting (e.g. several repeated entries for the same food item) were excluded (n 10). Although up to six repeated 24-HDR were carried out in a smaller sample, only the first recall day was included in the current analysis (including weekdays and weekend days) to obtain an equal number of 24-HDR for each child. The assessment procedure was slightly different in the Hungarian study centre, where dietary recalls were not performed via the standardised SACINA software but via paper-and-pencil 24-HDR registrations that were entered in the SACINA software afterwards. As this increased data heterogeneity and further seemed to affect the misreporting behaviour, data from Hungary were not considered in the present analyses. A study sample based on equal procedures and standardised assessment instruments was needed for this exploratory methodological study.

Energy intake (EI; kJ/d), fruit/vegetable intake and soft drink intake (as a percentage of total daily EI; %EI) were used as exposure measures in the different models as these were repeatedly proposed to be associated with overweight/obesity( 22 24 ).

Statistical methods

Classification of 24 h dietary recalls

The BMR was estimated from the equations published by Schofield( 25 ) and recommended by the FAO/WHO/United Nations University (1985) taking into account age, sex, body height and weight. To determine whether reported EI was consistent with energy requirements, the ratio of proxy-reported EI to predicted BMR was used to classify the 24-HDR into under-reports (UdR), plausible reports (PR) and over-reports (OvR) according to Goldberg et al.( 6 ). Since the original Goldberg cut-offs were developed for adults and do not consider differences in EI due to age and sex, cut-off values were re-calculated for application in children as suggested previously( 2 , 26 ) using the formula:

graphic file with name S1368980012004491_eqnU1.jpg

where

graphic file with name S1368980012004491_eqnU2.jpg

The within-subject CV for EI (CVwEI), the within-subject CV for BMR (CVwBMR) and the CV for physical activity (CVPA) were replaced by age- and sex-specific values as given in Nelson et al.( 27 ) and Black et al.( 28 ). Goldberg's overall physical activity level (PAL) of 1·55 was substituted by age- and sex-dependent levels of light physical activity (2–5 years: 1·45; 6–10 years: males 1·55, females 1·50) according to Torun et al.( 29 ). The number of days (d) was set to 1 (one 24-HDR per child) to account for the large day-to-day variation in diet. Cut-off limits need to be wider if only one or few recall days are available as these may not reflect usual intakes but exceptional days. The resulting age- and sex-specific cut-off values to define UdR, PR and OvR are given in Table 1, which were then used to classify the recalls accordingly.

Table 1.

Lower and upper cut-off limits to classify 1 d 24-HDR as UdR or OvR based on EI:BMR

Lower cut-off Upper cut-off
Age (years) Sex (UdR) (OvR)
2–<6 Boys 0·74 2·85
2–<6 Girls 0·78 2·69
6–<10 Boys 0·92 2·61
6–<10 Girls 0·93 2·43

24-HDR, 24 h dietary recall; UdR, under-report; OvR, over-report; EI, energy intake.

PR (plausible report) has EI:BMR within the cut-offs.

Calculation of the propensity score

In a previous study based on the IDEFICS data( 30 ), backward elimination in the course of multilevel logistic regression analysis was applied to identify factors significantly related to misreporting in proxy reports for young children. The covariables that turned out to be significantly associated with misreporting were used in the construction of the propensity score: age and sex of the child( 31 , 32 ), net household income (dummy: high v. medium/low), number of persons below 18 years of age in the household and day of the interview (dummy: weekday v. Saturday/Sunday). The following information on parental concerns and perception of their child's weight status obtained from a self-administered proxy questionnaire was included: ‘How concerned are you about your child… (i) becoming overweight?’; (ii) becoming underweight?’ (response categories were ‘unconcerned’, ‘a little concerned’, ‘concerned’ and ‘very concerned’); ‘Do you think your child is… (i) ‘much too underweight?’; (ii) ‘slightly too underweight?’; (iii) ‘proper weight?’; (iv) ‘slightly too overweight’; (v) ‘much too overweight?’ (response categories were ‘yes’ and ‘no’). Further intakes from the following food items commonly perceived to be healthy/unhealthy were considered as predictors for misreporting: chocolate products, other sugary products (e.g. cakes, biscuits, ice cream), soft drinks, fruits/vegetables, milk (all as %EI) and water (g/d). Although BMI is a repeatedly shown predictor of misreporting, it was not included in the construction of the propensity score as the weight status is the outcome variable in the present analysis.

The conditional probability (propensity score) of being classified as UdR given the mentioned covariables was calculated applying a logistic multilevel regression model including all covariates mentioned above as fixed effects and the study centre as random effect:

graphic file with name S1368980012004491_eqnU3.jpg

Fruit/vegetable intake was not included as a covariable in the propensity score calculation when investigating diet–obesity models using fruit/vegetable intake as exposure variable. Analogously, soft drink intake was not considered in the construction of the propensity score when investigating models using soft drink intake as exposure.

Model building

Associations between overweight/obesity and dietary intakes were exemplarily analysed to investigate different procedures of handling implausible dietary recalls. Logistic multilevel regression analyses were conducted using a dummy indicating overweight/obesity as outcome and the three dietary variables as exposure measures: EI in kJ/d (models labelled with ‘a’), %EI from fruits/vegetables (labelled with ‘b’) and %EI from soft drinks (labelled with ‘c’).

The first model (basic model) included only adjustment terms for age and sex and a random effect for the study centre to account for the clustered study design (Model 1a–c). The basic model was also run adding all variables used in the calculation of the propensity score as potential confounders (Model 2a–c). Model 3 was identical to the basic model but here recalls classified as UdR and OvR were excluded. Further, the basic model was run adjusting additionally for the reporting group (Model 4a–c), for the propensity score (Model 5a–c) or for both (Model 6a–c). In addition, the basic model was analysed stratified by reporting group (Model 7a–c) as well as stratified by reporting group and at the same time adjusted for the propensity score (Model 8a–c).

The current analysis includes only children with 24-HDR and complete covariate information (n 5962). All analyses were performed using the statistical software package SAS version 9·1.

Results

Descriptive analyses of the study population and all covariables used for the construction of the propensity score are presented in Table 2 (categorical variables) and Table 3 (continuous variables). Regarding the total study group, 6·7 % (n 402) of the proxy reports were classified as UdR and 4·0 % (n 241) as OvR. Both UdR and OvR were slightly higher in girls compared with boys and higher in the low/medium compared with the high income group. Percentages of UdR were higher in overweight/obese children, in the older age group (6 to <10 years), on weekend days and if proxies were concerned about their child becoming overweight or perceived their child to be slightly/much too overweight. OvR, on the other hand, was higher in thin/normal-weight children, on weekend days or if proxies were concerned about their child becoming underweight. %EI from fruits/vegetables was highest in UdR whereas %EI from chocolate and other sugary products were highest in OvR. Soft drink consumption was slightly lower in the OvR group compared with the UdR and PR groups.

Table 2.

Descriptive analyses of categorical covariables stratified by reporting group (total numbers and row percentages): children aged 2–9 years, IDEFICS Study

Total UdR PR OvR
n n % n % n %
All 5962 402 6·7 5319 89·2 241 4·0
Sex of the child
Male 3029 187 6·2 2747 90·7 95 3·1
Female 2933 215 7·3 2572 87·7 146 5·0
Age groups
2–<6 years 2625 120 4·6 2388 91·0 117 4·5
6–<10 years 3337 282 8·5 2931 87·8 124 3·7
Weight status*
Thin/normal weight 4721 249 5·3 4263 90·3 209 4·4
Overweight/obese 1241 153 12·3 1056 85·1 32 2·6
Study centre
Belgium 310 29 9·4 274 88·4 7 2·3
Cyprus 403 63 15·6 335 83·1 5 1·2
Estonia 602 35 5·8 537 89·2 30 5·0
Germany 1504 159 10·6 1290 85·8 55 3·7
Italy 1492 68 4·6 1320 88·5 104 7·0
Spain 525 7 1·3 492 93·7 26 5·0
Sweden 1126 41 3·6 1071 95·1 14 1·2
Income
Low/medium 4304 322 7·5 3786 88·0 196 4·6
High 1658 80 4·8 1533 92·5 45 2·7
Day of the interview
Weekday 4925 319 6·5 4415 89·6 191 3·9
Saturday/Sunday 1037 83 8·0 904 87·2 50 4·8
Concerned: child becoming underweight
Unconcerned 3109 230 7·4 2796 89·9 83 2·7
A little concerned 923 57 6·2 825 89·4 41 4·4
Concerned 863 52 6·0 751 87·0 60 7·0
Very concerned 1067 63 5·9 947 88·8 57 5·3
Concerned: child becoming overweight
Unconcerned 3299 182 5·5 2996 90·8 121 3·7
A little concerned 1001 73 7·3 879 87·8 49 4·9
Concerned 878 70 8·0 774 88·2 34 3·9
Very concerned 784 77 9·8 670 85·5 37 4·7
Health: child's weight
Much too underweight 77 6 7·8 66 85·7 5 6·5
Slightly too underweight 944 48 5·1 836 88·6 60 6·4
Proper weight 4204 234 5·6 3812 90·7 158 3·8
Slightly too overweight 679 100 14·7 564 83·1 15 2·2
Much too overweight 58 14 24·1 41 70·7 3 5·2

UdR, under-report; PR, plausible report; OvR, over-report.

*Weight categories according to International Obesity Taskforce criteria( 18 , 19 ).

Table 3.

Descriptive analyses of continuous covariables stratified by reporting group (means and standard deviations): children aged 2–9 years, IDEFICS Study

Total group UdR PR OvR
(n 5962) (n 402) (n 5319) (n 241)
Mean sd Mean sd Mean sd Mean sd
Age (years) 6·06 1·82 6·64 1·54 6·02 1·84 5·96 1·76
BMI Z-score* 0·31 1·34 0·82 1·60 0·29 1·31 −0·01 1·24
EI (kJ/d) 6602 2218 3197 1021 6632 1807 11 590 1833
EI (kcal/d) 1578 530 764 244 1585 432 2770 438
Water intake (g/d) 319 357 284 346 317 352 419 462
%EI from chocolate 3·2 5·9 2·7 6·5 3·2 5·9 3·5 6·7
%EI from milk 10·1 9·4 8·5 11·3 10·3 9·2 7·9 8·7
%EI from soft drinks 2·7 5·7 2·7 6.7 2·7 5·7 2·2 4·0
%EI from sugary products 9·8 11·7 7·4 11·8 9·8 11·6 12·7 12·4
%EI from fruits/vegetables 8·5 8·2 11·1 13·0 8·4 7·7 6·7 6·0

UdR, under-report; PR, plausible report; OvR, over-report; EI, energy intake; %EI, percentage of energy intake.

*According to Cole et al.( 31 , 32 ).

Tables 4 and 5 show the odds ratios and 95 % confidence intervals obtained from the different models for the association between overweight/obesity and the three dietary exposures. Effects of continuous variables are assessed as 1-unit offsets from the mean; e.g. the OR for the association between overweight/obesity and %EI from fruits/vegetables indicates the increase in risk when increasing %EI from fruits/vegetables by 1 % compared with the mean of the total study population.

In the basic model (Table 4, Models 1a–c), odds ratios were not significant for EI and soft drink intake and indicated even a significant positive association between overweight/obesity and fruit/vegetable intake (OR = 1·009, 95 % CI 1·001, 1·018). Adjustment for covariables (Models 2a–c) revealed similar results, but the association between fruits/vegetables and overweight/obesity was rendered insignificant here (OR = 1·009 (95 % CI 0·998, 1·020)). When excluding UdR and OvR (Models 3a–c), a significantly positive association between EI and overweight/obesity was observed (OR = 1·057, 95 % CI 1·038, 1·076). Adjustment for the reporting group (Models 4a–c) also revealed a significantly positive association between EI and overweight/obesity that was even slightly more pronounced compared with the model excluding misreports. When adjusting for the propensity score, all associations were strengthened (Models 5a–c) with the association between overweight/obesity and fruit/vegetable intake being reversed compared with the basic model. Significant associations were found between overweight/obesity and EI as well as soft drink intake. Finally, adjustment for the reporting group and propensity score at the same time strengthened the association between overweight/obesity and EI whereas the other associations remained nearly unchanged (Models 6a–c) compared with the model adjusting only for the propensity score.

Table 4.

OR and 95 % CI for the associations between overweight/obesity and EI (Model 1a to 6a), %EI from fruits/vegetables (Model 1b to 6b) and %EI from soft drinks (Model 1c to 6c) in different models: children aged 2–9 years, IDEFICS Study

Basic model Basic model adjusted for covariables Exclusion of misreports Adjustment for reporting group Adjustment for propensity score Adjustment for reporting group and propensity score
OR 95 % CI OR 95 % CI OR 95 % CI OR 95 % CI OR 95 % CI OR 95 % CI
Model 1a* Model 2a† Model 3a‡ Model 4a§ Model 5a∥ Model 6a¶
EI (1 unit = 418·4 kJ (100 kcal)) 0·996 0·983, 1·010 1·013 0·995, 1·031 1·057 1·038, 1·076 1·068 1·049, 1·086 1·019 1·005, 1·034 1·074 1·054, 1·095
PR v. UdR 0·205 0·155, 0.271 0·390 0·280, 0·542
OvR v. UdR 0·041 0·023, 0·073 0·076 0·041, 0·142
Propensity score 1·222 1·202, 1·243 1·217 1·038, 1·402
Model 1b* Model 2b† Model 3b‡ Model 4b§ Model 5b∥ Model 6b¶
%EI from fruits/vegetables 1·009 1·001, 1·018 1·009 0·998, 1·020 1·007 0·998, 1·017 1·006 0·997, 1·014 0·994 0·985, 1·003 0·993 0·984, 1·002
PR v. UdR 0·365 0·289, 0·461 0·710 0·532, 0·948
OvR v. UdR 0·154 0·099, 0·242 0·298 0·181, 0·491
Propensity score 1·250 1·227, 1·274 1·245 1·222, 1.269
Model 1c* Model 2c† Model 3c‡ Model 4c§ Model 5c∥ Model 6c¶
%EI from soft drinks 0·999 0·986, 1·013 0·996 0·982, 1·011 0·996 0·982, 1·011 1·001 0·988, 1·015 1·016 1·000, 1·031 1·015 1·000, 1·031
PR v. UdR 0·359 0·285, 0·453 0·692 0·520, 0·921
OvR v. UdR 0·151 0·097, 0·237 0·307 0·188, 0·504
Propensity score 1·231 1·210, 1·253 1·226 1·205, 1·248

EI, energy intake; %EI, percentage of energy intake; PR, plausible report; UdR, under-report; OvR, over-report.

Effects of continuous variables are assessed as 1-unit offsets from the mean. Due to the small scale of the propensity score, 0.01-unit offsets from mean were chosen here.

*Basic model: logistic multilevel regression model; OR for the association between overweight/obesity and food intake adjusted for age and sex and including the study centre as random effect (n 5962).

†Basic model additionally adjusted for net household income (dummy: high v. medium/low), number of persons below 18 years of age in the household, day of the interview (dummy: weekday v. Saturday/Sunday), information on parental concerns and perception regarding their child's weight status and reported intakes from food groups associated with misreporting.

‡Basic model, but excluding UdR and OvR (n 5319).

§Basic model adjusted for the reporting group (UdR, PR, OvR).

∥Basic model adjusted for a propensity score for misreporting.

¶Basic model adjusted for the reporting group and for the propensity score for misreporting.

When stratifying the basic model by the reporting group (Table 5, Model 7a–c), only EI was significantly related to overweight/obesity in all three strata. Additional adjustment for the propensity score (Model 8a–c) strengthened associations between all three dietary exposures and overweight/obesity. Here a significant reverse association between fruit/vegetable intake and overweight/obesity was observed in OvR and a positive association was found between soft drinks and overweight/obesity in UdR. The relationship between overweight/obesity and EI was much stronger in the UdR and OvR groups compared with PR.

Table 5.

OR and 95 % CI for the association between overweight/obesity and EI (Model 7a, 8a), %EI from fruits/vegetables (Model 7b, 8b) and %EI from soft drinks (Model 7c, 8c) in different models stratified by reporting group (UdR, PR, OvR): children aged 2–9 years, IDEFICS Study

Stratification Stratification and adjustment for propensity score
UdR PR OvR UdR PR OvR
OR 95 % CI OR 95 % CI OR 95 % CI OR 95 % CI OR 95 % CI OR 95 % CI
Model 7a* Model 8a†
EI (1 unit = 4184 kJ (100 kcal)) 1·422 1·237, 1·634 1·057 1·038, 1·076 1·268 1·142, 1·407 1·521 1·291, 1·793 1·064 1·043, 1·085 1·310 1·167, 1·470
Propensity score 1·147 1·108, 1·188 1·242 1·217, 1·268 1·208 1·093, 1·336
Model 7b* Model 8b†
%EI from fruits/vegetables 1·006 0·988, 1·024 1·007 0·998, 1·017 0·921 0·845, 1·003 0·995 0·976, 1·014 0·993 0·983, 1·004 0·895 0·814, 0·983
Propensity score 1·180 1·133, 1·229 1·267 1·240, 1·295 1·218 1·101, 1·348
Model 7c* Model 8c†
%EI from soft drinks 1·027 0·993, 1·061 0·996 0·982, 1·011 1·010 0·896, 1·139 1·042 1·004, 1·081 1·010 0·993, 1·027 1·039 0·914, 1·182
Propensity score 1·150 1·110, 1·191 1·250 1·224, 1·276 1·189 1·085, 1·303

EI, energy intake; %EI, percentage of energy intake; UdR, under-report; PR, plausible report; OvR, over-report.

Effects of continuous variables are assessed as 1-unit offsets from the mean. Due to the small scale of the propensity score, 0·01-unit offsets from mean were chosen here.

*Basic model: logistic multi-level regression model stratified by reporting group (UdR, PR, OvR); OR for the association between overweight/obesity and dietary intakes adjusted for age and sex and including the study centre as random effect.

†Basic model adding the propensity score as adjustment term.

Discussion

To the authors’ knowledge, the present study is the first one in children applying and comparing several statistical approaches to counteract attenuation of risk estimates caused by misreporting of dietary information. Negligence of misreporting in the statistical model revealed insignificant or even (unexpected) reversed diet–obesity associations. Consistent with previous findings on differential misreporting by weight status( 33 ), the UdR group had higher mean BMI Z-scores but reported lower (implausible) EI compared with PR. The opposite was true for the OvR group. Such reporting bias may obscure positive relationships between diet and weight status. Researchers should be aware that results may differ strongly depending on the statistical model selected and that the choice of an adequate model needs to be taken thoroughly. Consideration of misreporting in any way yielded results more consistent with hypotheses relating food intake to overweight/obesity( 34 , 35 ). However, the true effects remained unknown due to the lack of validation data. A recent study reported that not excluding implausible reports resulted in weak, non-significant or even misleading associations between BMI and diet( 9 ), whereas Nielsen and Adair stated that examining all data but stratifying by level of intake may be more informative for population nutrient intake than exclusion of misreports( 8 ). Savage et al. found a significant association between BMI and reported EI in the PR of pre-adolescent girls, but neither in the total study group nor when analysing only misreports (combining UdR and OvR into one group)( 36 ). This agrees with our results for the total study group (basic model). Nevertheless, our stratified analysis revealed statistically significant associations between overweight/obesity and EI in all three reporting groups, being even stronger in UdR and OvR compared with PR. This may be explained by either: (i) differences in the mean intake levels to which the effects are put into relation (mean EI: 3197 kJ/d (764 kcal/d) in UdR, 6632 kJ/d (1585 kcal/d) in PR, 11 590 kJ/d (2770 kcal/d) in OvR); or (ii) differences between the reporting groups in terms of participants’ characteristics (e.g. prevalence of overweight/obesity: 38·0 % in UdR, 19·9 % in PR, 13·2 % in OvR). Our results argue against combining UdR and OvR into one group in stratified analyses as determinants of misreporting and participants' characteristics are likely to differ( 30 ). Moreover, the differences between the groups of UdR, PR and OvR suggest that data exclusions may actually introduce a selection bias, so that exclusion of misreports is not recommended. However, the reduced sample sizes resulting from both data exclusions and stratification go along with limited statistical power especially in the (smaller) groups of UdR and OvR. Adjustment for the reporting group does not affect the statistical power to such a degree and shifted associations between overweight/obesity and all three dietary exposures to the expected directions (Models 4a–c). These results agree with those from a study by Mendez et al.( 10 ) where associations between different food groups and overweight/obesity became stronger after inclusion of dummy variables identifying under- and over-reports. In that study, dummy adjustment revealed results similar to those obtained when limiting the analysis sample to plausible reports, as observed in our study. However, this approach has the disadvantage of misclassifications of single recalls being quite likely, which may again bias the results( 37 ).

After adjustment for the propensity score, which combined various indicators for misreporting into one summary measure, associations between overweight/obesity and soft drink as well as fruit/vegetable intakes increased markedly. To correct for selective reporting of single food items, also dietary variables commonly associated with misreporting were included when constructing the propensity score. This approach strived for an effect similar to regression calibration( 38 ) although both procedures differ. The idea of calibration in general is the replacement of exposures measured with error by ‘adjusted’ values using additional information obtained from biomarker measurements or from a second dietary assessment instrument. Common calibration approaches assume (non-differential) linear measurement error with constant variance or linear random within-person error in the case of replicate measurements (e.g. repeated 24-HDR)( 38 40 ) – assumptions that are often violated due to differential misreporting( 4 , 41 ). Moreover, error structures were found to be correlated when assessing dietary information via different assessment methods (e.g. FFQ and 24-HDR)( 42 ). Although the use of two complementary dietary assessment methods is recommended e.g. when investigating usual intakes( 43 , 44 ), the benefit of a second assessment instrument to correct for misreporting is questionable( 45 ). Further studies are needed to explore and compare the calibration and propensity score approach. However, it can be suspected that statistical adjustment of relative risks based on biomarker data with independent error structures (e.g. doubly labelled water for EI) incorporating characteristics of misreporters should be preferred if such data exist( 1 , 39 , 46 ). In the absence of validation data, the propensity score seems to be a useful, cost-effective alternative to account for misreporting.

In our models, intakes from soft drinks and fruits/vegetables were examined in relation to total daily intake of energy (expressed as %EI) instead of including absolute amounts (g/d). Use of absolute amounts would result in lower effects in high energy consumers compared with low energy consumers( 3 , 47 ). To overcome this problem, different energy adjustment models have been proposed next to the one applied here( 48 ). But again energy adjustment cannot eliminate differential biases( 3 ) and is therefore not sufficient to correct for subject-specific and selective misreporting of certain foods/macronutrients( 45 , 49 ). The advantage of additional incorporation of the propensity score over simple energy-adjustment methods is that the propensity score is a comprehensive approach to account for several covariables related to misreporting instead of considering only the level of EI. Under-reporting is difficult to distinguish from undereating (defined as eating less than required to maintain body weight, accompanied by weight loss) but both are treated equally in energy-adjustment models, while it can be hypothesised that subject characteristics and therefore propensity scores differ between undereaters and under-reporters. Nevertheless, in the case of non-differential errors energy-adjustment methods were shown to be a good approach to counteract underestimation of relative risks and reduction of statistical power( 1 ).

Several sensitivity analyses were carried out (e.g. including only children with two repeated 24-HDR (n 904), excluding OvR (n 241), excluding UdR (n 402), excluding 24-HDR with at least one imputed value (n 69), excluding thin (n 556) or obese children (n 430)). When including only children with two repeated 24-HDR, model estimates became unstable due to the reduction in sample size. In all other cases, results remained nearly unchanged compared with the results given here. Details can be obtained from the author on request.

The present analysis is based on data in children relying on proxy reports. Here misreporting may result not only from intentional misreporting, e.g. caused by social desirability or parental concerns about their child's weight status, but also from unintentional misreporting due to lack of parental control (out-of-home meals). Our discussion mainly refers to studies in adolescents/adults as related studies are lacking in children. Although determinants for misreporting may differ between children and adolescent/adult populations, previous studies and the present one reveal similar results concerning the statistical approaches of data exclusions, stratification or adjustment for the reporting group. Nevertheless, results of the newly applied propensity score approach should not simply be transferred. When applying the propensity score approach in future studies, variables for the construction of the score should be selected depending on the study population under investigation, which may require a pre-study to identify the relevant determinants of misreporting. The analysis of the usefulness of the propensity score adjustment in adolescent/adult populations is a task for future research.

Limitations and strengths

Only one recall day per child was used in the present analysis which does not reflect usual intakes due to the day-to-day variation that characterises dietary data in general( 50 ). Day-to-day variation results in random (non-differential) errors that may have weakened associations between dietary factors and overweight/obesity. In addition, extreme intakes may not necessarily reflect misreporting but rather specific diets (e.g. energy restricted) or exceptional days (e.g. the child was ill or extremely physically active). Reverse causation cannot be precluded as obesity may even cause low intakes due to dieting or change in eating behaviour. Causal inference is limited owing to the cross-sectional study design.

Sensitivity of the cut-off technique to correctly classify UdR and OvR is limited as it aims only to identify misreports resulting in physiologically implausibly low/high EI( 6 ). By application of the cut-off technique distinction between varying degrees of misreporting is not feasible; e.g. under-reporting from a high intake level may not be detected as the reported intake may still be such high that EI:BMR does not fall below the cut-off. Furthermore, not considering individual physical activity levels of the children when classifying the 24-HDR is a limitation. Physically inactive children may have a very low daily energy expenditure making even low reported intakes plausible, whereas physically active children have an increased likelihood to be misclassified as OvR. Child-specific reference PAL were used in the calculation of the cut-offs to compensate for the lack of sufficient individual information on physical activity.

The study was a first exploratory approach to investigate the usefulness of propensity scores in the context of dietary misreporting in children. The authors are aware that there are several different ways to construct a propensity score by inclusion of additional/different variables, e.g. physical activity, number of daily meals, etc. The rather exploratory character of the paper should be underlined here. However, the application of the new propensity score approach, along with the large sample size, the variety of covariables and the standardised assessment procedures suggest that the present study provides important knowledge on methods to handle misreporting in future research, while also highlighting gaps in knowledge as starting points for further analyses.

Conclusions

Associations between dietary exposures and health outcomes are strongly affected or even masked or reversed by measurement errors. Instead of data exclusions that may result in unknown bias, misreporting should rather be addressed in the model building process including adjustment terms for misreporting. Dummy adjustment for the reporting group revealed associations more consistent with expectations, which was most pronounced considering the association between EI and overweight/obesity. However, more sophisticated adjustments seem to be necessary to counteract the effect of selective misreporting of other food groups. In this respect, the propensity score adjustment turned out to be a useful tool to correct for subject-specific misreporting as it combines various variables associated with misreporting into one scalar and should be further investigated in future studies.

Acknowledgements

Sources of funding: This work was done as part of the IDEFICS Study (www.idefics.eu) and is published on behalf of its European Consortium. Financial support was provided by the European Community within the Sixth RTD Framework Programme Contract No. 016181 (FOOD). S.B.-S. was funded by a grant from the Aragón's Regional Government (Diputación General de Aragón, DGA). B.V. was funded by the Research Foundation–Flanders (FWO). Conflict of interest: All the authors declare that there are no conflicts of interest. Authors’ contributions: All authors contributed to conception and design, acquisition of data, analysis or interpretation of data. Each author has seen and approved the contents of the submitted manuscript. Final approval of the version published was given by all authors.

References

  • 1. Freedman LS, Schatzkin A, Midthune D et al. (2011) Dealing with dietary measurement error in nutritional cohort studies. J Natl Cancer Inst 103, 1086–1092. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Lioret S, Touvier M, Balin M et al. (2011) Characteristics of energy under-reporting in children and adolescents. Br J Nutr 105, 1671–1680. [DOI] [PubMed] [Google Scholar]
  • 3. Livingston MB & Black AE (2003) Markers of the validity of reported energy intake. J Nutr 133, Suppl. 3, 895S–920S. [DOI] [PubMed] [Google Scholar]
  • 4. Black AE & Cole TJ (2001) Biased over- or under-reporting is characteristic of individuals whether over time or by different assessment methods. J Am Diet Assoc 101, 70–80. [DOI] [PubMed] [Google Scholar]
  • 5. Shai I, Rosner BA, Shahar DR et al. (2005) Dietary evaluation and attenuation of relative risk: multiple comparisons between blood and urinary biomarkers, food frequency, and 24-hour recall questionnaires: the DEARR study. J Nutr 135, 573–579. [DOI] [PubMed] [Google Scholar]
  • 6. Goldberg GR, Black AE, Jebb SA et al. (1991) Critical evaluation of energy intake data using fundamental principles of energy physiology: 1. Derivation of cut-off limits to identify under-recording. Eur J Clin Nutr 45, 569–581. [PubMed] [Google Scholar]
  • 7. McCrory MA, Hajduk CL & Roberts SB (2002) Procedures for screening out inaccurate reports of dietary energy intake. Public Health Nutr 5, 873–882. [DOI] [PubMed] [Google Scholar]
  • 8. Nielsen SJ & Adair L (2007) An alternative to dietary data exclusions. J Am Diet Assoc 107, 792–799. [DOI] [PubMed] [Google Scholar]
  • 9. Huang TT, Roberts SB, Howarth NC et al. (2005) Effect of screening out implausible energy intake reports on relationships between diet and BMI. Obes Res 13, 1205–1217. [DOI] [PubMed] [Google Scholar]
  • 10. Mendez MA, Wynter S, Wilks R et al. (2004) Under- and overreporting of energy is related to obesity, lifestyle factors and food group intakes in Jamaican adults. Public Health Nutr 7, 9–19. [DOI] [PubMed] [Google Scholar]
  • 11. Howarth NC, Huang TT, Roberts SB et al. (2005) Dietary fiber and fat are associated with excess weight in young and middle-aged US adults. J Am Diet Assoc 105, 1365–1372. [DOI] [PubMed] [Google Scholar]
  • 12. Gibson RS (2005) Principles of Nutritional Assessment, 2nd ed. New York: Oxford University Press. [Google Scholar]
  • 13. Rosenbaum PR & Rubin DB (1983) The central role of the propensity score in observational studies for causal effects. Biometrika 70, 41–55. [Google Scholar]
  • 14. Mendez MA, Popkin BM, Buckland G et al. (2011) Alternative methods of accounting for underreporting and overreporting when measuring dietary intake–obesity relations. Am J Epidemiol 173, 448–458. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Livingstone MB & Robson PJ (2000) Measurement of dietary intake in children. Proc Nutr Soc 59, 279–293. [DOI] [PubMed] [Google Scholar]
  • 16. Ahrens W, Bammann K, de Henauw S et al. (2006) Understanding and preventing childhood obesity and related disorders – IDEFICS: a European multilevel epidemiological approach. Nutr Metab Cardiovasc Dis 16, 302–308. [DOI] [PubMed] [Google Scholar]
  • 17. Ahrens W, Bammann K, Siani A et al. (2011) The IDEFICS cohort: design, characteristics and participation in the baseline survey. Int J Obes (Lond) 35, Suppl 1, S3–S15. [DOI] [PubMed] [Google Scholar]
  • 18. Cole TJ, Bellizzi MC, Flegal KM et al. (2000) Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ 320, 1240–1243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Cole TJ, Flegal KM, Nicholls D et al. (2007) Body mass index cut offs to define thinness in children and adolescents: international survey. BMJ 335, 194. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Vereecken CA, Covents M, Sichert-Hellert W et al. (2008) Development and evaluation of a self-administered computerized 24-h dietary recall method for adolescents in Europe. Int J Obes (Lond) 32, Suppl. 5, S26–S34. [DOI] [PubMed] [Google Scholar]
  • 21. Vereecken CA, Covents M, Matthys C et al. (2005) Young adolescents’ nutrition assessment on computer (YANA-C). Eur J Clin Nutr 59, 658–667. [DOI] [PubMed] [Google Scholar]
  • 22. Zurriaga O, Perez-Panades J, Quiles Izquierdo J et al. (2011) Factors associated with childhood obesity in Spain. The OBICE study: a case–control study based on sentinel networks. Public Health Nutr 14, 1105–1113. [DOI] [PubMed] [Google Scholar]
  • 23. O'Connor TM, Yang SJ & Nicklas TA (2006) Beverage intake among preschool children and its effect on weight status. Pediatrics 118, e1010–e1018. [DOI] [PubMed] [Google Scholar]
  • 24. Alinia S, Hels O & Tetens I (2009) The potential association between fruit intake and body weight – a review. Obes Rev 10, 639–647. [DOI] [PubMed] [Google Scholar]
  • 25. Schofield WN (1985) Predicting basal metabolic rate, new standards and review of previous work. Hum Nutr Clin Nutr 39, Suppl. 1, 5–41. [PubMed] [Google Scholar]
  • 26. Sichert-Hellert W, Kersting M & Schoch G (1998) Underreporting of energy intake in 1 to 18 year old German children and adolescents. Z Ernahrungswiss 37, 242–251. [DOI] [PubMed] [Google Scholar]
  • 27. Nelson M, Black AE, Morris JA et al. (1989) Between- and within-subject variation in nutrient intake from infancy to old age: estimating the number of days required to rank dietary intakes with desired precision. Am J Clin Nutr 50, 155–167. [DOI] [PubMed] [Google Scholar]
  • 28. Black AE (2000) Critical evaluation of energy intake using the Goldberg cut-off for energy intake:basal metabolic rate. A practical guide to its calculation, use and limitations. Int J Obes Relat Metab Disord 24, 1119–1130. [DOI] [PubMed] [Google Scholar]
  • 29. Torun B, Davies PS, Livingstone MB et al. (1996) Energy requirements and dietary energy recommendations for children and adolescents 1 to 18 years old. Eur J Clin Nutr 50, Suppl.1, S37–S80. [PubMed] [Google Scholar]
  • 30. Börnhorst C, Huybrechts I, Ahrens W et al. (2012) Prevalence and determinants of misreporting among European children in proxy-reported 24-hour dietary recalls. Br J Nutr (Epublication ahead of print version). [DOI] [PubMed] [Google Scholar]
  • 31. Cole TJ, Freeman JV & Preece MA (1998) British 1990 growth reference centiles for weight, height, body mass index and head circumference fitted by maximum penalized likelihood. Stat Med 17, 407–429. [PubMed] [Google Scholar]
  • 32. Cole TJ, Freeman JV & Preece MA (1995) Body mass index reference curves for the UK, 1990. Arch Dis Child 73, 25–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Heitmann BL, Lissner L & Osler M (2000) Do we eat less fat, or just report so? Int J Obes Relat Metab Disord 24, 435–442. [DOI] [PubMed] [Google Scholar]
  • 34. Tohill BC, Seymour J, Serdula M et al. (2004) What epidemiologic studies tell us about the relationship between fruit and vegetable consumption and body weight. Nutr Rev 62, 365–374. [DOI] [PubMed] [Google Scholar]
  • 35. Rolls BJ, Drewnowski A & Ledikwe JH (2005) Changing the energy density of the diet as a strategy for weight management. J Am Diet Assoc 105, 5 Suppl. 1, S98–S103. [DOI] [PubMed] [Google Scholar]
  • 36. Savage JS, Mitchell DC, Smiciklas-Wright H et al. (2008) Plausible reports of energy intake may predict body mass index in pre-adolescent girls. J Am Diet Assoc 108, 131–135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Greenland S & Robins JM (1985) Confounding and misclassification. Am J Epidemiol 122, 495–506. [DOI] [PubMed] [Google Scholar]
  • 38. Spiegelman D, McDermott A & Rosner B (1997) Regression calibration method for correcting measurement-error bias in nutritional epidemiology. Am J Clin Nutr 65, 4 Suppl., 1179S–1186S. [DOI] [PubMed] [Google Scholar]
  • 39. Freedman LS, Midthune D, Carroll RJ et al. (2011) Using regression calibration equations that combine self-reported intake and biomarker measures to obtain unbiased estimates and more powerful tests of dietary associations. Am J Epidemiol 174, 1238–1245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Kaaks R, Riboli E & van Staveren W (1995) Calibration of dietary intake measurements in prospective cohort studies. Am J Epidemiol 142, 548–556. [DOI] [PubMed] [Google Scholar]
  • 41. Livingstone MB, Robson PJ, Black AE et al. (2003) An evaluation of the sensitivity and specificity of energy expenditure measured by heart rate and the Goldberg cut-off for energy intake: basal metabolic rate for identifying mis-reporting of energy intake by adults and children: a retrospective analysis. Eur J Clin Nutr 57, 455–463. [DOI] [PubMed] [Google Scholar]
  • 42. Kipnis V, Subar AF, Midthune D et al. (2003) Structure of dietary measurement error: results of the OPEN biomarker study. Am J Epidemiol 158, 14–21. [DOI] [PubMed] [Google Scholar]
  • 43. Carroll RJ, Midthune D, Subar AF et al. (2012) Taking advantage of the strengths of 2 different dietary assessment instruments to improve intake estimates for nutritional epidemiology. Am J Epidemiol 175, 340–347. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. de Boer EJ, Slimani N, van't Veer P et al. (2011) The European Food Consumption Validation Project: conclusions and recommendations. Eur J Clin Nutr 65, Suppl.1, S102–S107. [DOI] [PubMed] [Google Scholar]
  • 45. Westerterp KR & Goris AH (2002) Validity of the assessment of dietary intake: problems of misreporting. Curr Opin Clin Nutr Metab Care 5, 489–493. [DOI] [PubMed] [Google Scholar]
  • 46. Freedman LS, Tasevska N, Kipnis V et al. (2010) Gains in statistical power from using a dietary biomarker in combination with self-reported intake to strengthen the analysis of a diet–disease association: an example from CAREDS. Am J Epidemiol 172, 836–842. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Willett W & Stampfer MJ (1986) Total energy intake: implications for epidemiologic analyses. Am J Epidemiol 124, 17–27. [DOI] [PubMed] [Google Scholar]
  • 48. Kipnis V, Freedman LS, Brown CC et al. (1997) Effect of measurement error on energy-adjustment models in nutritional epidemiology. Am J Epidemiol 146, 842–855. [DOI] [PubMed] [Google Scholar]
  • 49. Lafay L, Mennen L, Basdevant A et al. (2000) Does energy intake underreporting involve all kinds of food or only specific food items? Results from the Fleurbaix Laventie Ville Sante (FLVS) study. Int J Obes Relat Metab Disord 24, 1500–1506. [DOI] [PubMed] [Google Scholar]
  • 50. Nielsen SB, Montgomery C, Kelly LA et al. (2008) Energy intake variability in free-living young children. Arch Dis Child 93, 971–973. [DOI] [PubMed] [Google Scholar]

Articles from Public Health Nutrition are provided here courtesy of Cambridge University Press

RESOURCES