Abstract
Traditional food frequency questionnaires (FFQs) are influenced by systematic error, but web-based FFQ (WEB-FFQs) may mitigate this source of error. The objective of this study was to compare the accuracy of interview-based and web-based FFQs to assess energy requirements (mERs). The mER was measured in a series of controlled feeding trials in which participants daily received all foods and caloric drinks to maintain stable body weight over 4 to 6 weeks. FFQs assessing dietary intakes and hence mean energy intake were either interviewer-administered by a registered dietitian (IA-FFQ, n = 127; control method) or self-administered using a web-based platform (WEB-FFQ, n = 200; test method), on a single occasion. Comparison between self-reported energy intake and mER revealed significant under-reporting with the IA-FFQ (−9.5%; 95% CI, −12.7 to −6.1) and with the WEB-FFQ (−11.0%; 95% CI, −15.4 to −6.4), but to a similar extent between FFQs (p = 0.62). However, a greater proportion of individuals were considered as accurate reporters of energy intake using the IA-FFQ compared with the WEB-FFQ (67.7% vs. 48.0%, respectively), while the prevalence of over-reporting was lower with the IA-FFQ than with the WEB-FFQ (6.3% vs. 17.5%, respectively). These results suggest less accurate prediction of true energy intake by a self-administered WEB-FFQ than with an IA-FFQ.
Keywords: food frequency questionnaire, dietary assessment, web, under-reporting, over-reporting, energy intake
1. Introduction
Dietary assessment is central to nutritional epidemiology, which forms the basis of dietary guidelines [1,2]. Twenty-four-hour recalls (24HRs) and food frequency questionnaires (FFQs) are common instruments to collect self-reported dietary intakes [3]. However, the validity of self-reported data obtained via such memory-based dietary assessment methods, and hence the whole value of nutrition epidemiology, is being challenged based on their purported inability to correctly reflect true food and nutrient consumption [4,5,6,7]. However, others have argued that despite recognized limitations, relying on self-reported dietary intake data in epidemiological studies has been instrumental in developing impactful dietary guidelines and recommendations over the years [1,2,7,8,9,10]. One of the fundamental issues in this heated debate relates to whether 24HRs and FFQs can measure true energy intake, due among other factors to significant random and systematic errors [1,11,12,13,14].
New methods of dietary assessment using recent technologies are being developed and examined [15,16,17] and there is growing interest in the ability of web-based alternatives to improve the efficiency of data collection. Web-based tools increase the efficiency of the data processing; they can be completed at any time or location, they offer unique advantage regarding portion size presentation and food recognition, and they are cost-effective [16,18]. However, the extent to which web-based delivery methods may mitigate some of the errors seen with more traditional interview-administered (IA) methods such as FFQs remains uncertain. Previous data have suggested that web-based 24HRs may be less prone to social desirability bias compared with IA tools [18,19,20]. The use of digital pictures in a web-based 24HR has also been proposed to facilitate portion size estimation compared with an IA-24HR [21]. A recent review of Canadian epidemiological studies reported that web-based dietary assessment instruments have not yet been used [22]. Thus, the value of web tools needs to be examined carefully for robustness, validity and reproducibility before their use can be expanded in large epidemiological studies.
To the best of our knowledge, no study has yet compared the accuracy of an IA-FFQ and self-administered web-based FFQ (WEB-FFQ) to predict an objective measure of energy requirements (mERs). The primary objective of this study was therefore to compare the accuracy of an IA-FFQ and a WEB-FFQ to assess the mER. Our hypothesis was that the WEB-FFQ is more accurate in assessing the mER than the IA-FFQ.
2. Materials and Methods
2.1. Study Design and Population
As a secondary analysis, subjects included in this study were participants from a series of nine randomized and fully controlled feeding trials (six published to date) conducted at the Institute of Nutrition and Functional Foods in Quebec City and at the Richardson Centre For Functional Foods and Nutraceuticals in Winnipeg from 2008 to 2017. All trials were devised to test the impact of different diets and nutrients on cardiometabolic risk factors [23,24,25,26,27,28]. Briefly, participants in these trials were between 18 and 65 years of age, were non-smokers, and had no history of cardiovascular disease, type 1 or type 2 diabetes, monogenic dyslipidemia, or uncontrolled endocrine disorder. Participants had to have maintained a stable body weight (within 2.5 kg) for at least 3 months before the onset of the interventions. All trials considered in the present study were conducted in weight-stable participants. All participants gave their informed consent for inclusion before they participated in the trials included in the present study, which were approved by local ethic boards.
2.2. Anthropometric Assessment
Body weight, waist and hip circumference were measured according to standardized procedures after a 12-hour overnight fast before and after each intervention period [29]. In addition, body weight was measured continuously throughout all feeding phases, three to five times per week [23,24,25,26,27,28].
2.3. Reported Energy Intake (rEI)
The IA- and WEB-FFQs were previously validated for use in French-speaking adults and details have been published elsewhere [15,30]. Briefly, the IA-FFQ is a face-to-face interviewer-administered FFQ designed to reflect dietary intakes of the past 30 days. The questionnaire is based on typical food items available in the province of Quebec with a special focus on components of the Mediterranean diet in a North-American context, which was required for the trials conducted at the time. The IA-FFQ has 91 items and food models were used in the interviews to facilitate portion size estimation. Administration of the IA-FFQ by a registered dietitian took approximately 30–45 min using standardized language across all participants.
The WEB-FFQ is a self-administered web-based questionnaire also designed to reflect dietary intakes over the past 30 days. Participants completed the WEB-FFQ on-site or at home, using Internet. The questionnaire has 136 questions which were based on the Willet FFQ and the previously validated IA-FFQ [30]. Several serving sizes based on the Supplementation en Vitamines et Mineraux Antioxydants (SU.VI.MAX) Food atlas [31] were digitally photographed using standardized dinnerware. Participants completed either the IA-FFQ or the WEB-FFQ, once during the run-in period (i.e., 0 to 4 weeks) preceding the first phase of each controlled feeding trial.
2.4. Measured Energy Requirement (mER)
Energy expenditure for each participant was first estimated with validated equations [32] and from the results of the IA- or WEB-FFQ prior to undertaking the intervention phases of the trials. During all phases, participants were asked to come to the laboratory of participating centers at least three times a week in order to pick up meals and snacks and for body weight measurement. Participants were instructed to consume all and only the foods and caloric drinks provided. Dietetic technicians prepared all meals and snacks in the metabolic kitchen of participating centers to the nearest 0.1 g. Participants received all foods and caloric drinks on a daily basis under isoenergetic conditions to maintain body weight constant over feeding phases of 4 to 6 weeks. Food provision was adjusted when body weight fluctuated by more than 2 kg over one week or with any major change in reported hunger or fullness. Participants were instructed to maintain their usual physical activity habits.
mER is considered as a valid estimate of true energy expenditure because energy intake during the feeding trials was adjusted constantly to achieve body weight stability [23,24,25,26,27,28]. Furthermore, controlled feeding studies conducted at the Institute of Nutrition and Functional Foods have been previously used to assess the validity of another web-based instrument [33]. Only the first phase of each trial was considered in the present study due to temporal proximity with the completion of either FFQ. The mER was the mean daily total energy provided to each participant during the fourth week of all feeding phases. Compliance with the dietary intervention was assessed using various approaches. Self-reported compliance assessed using checklists was high across all interventions (>98%) with a large proportion of the prescribed diets (between 30–40%) consumed on-site under direct supervision of the research staff [23,24,25,26,27,28]. Subjects included in the analyses were also in weight stable conditions throughout the various isoenergetic protocols. Changes in main cardiometabolic outcomes (mostly plasma lipids) in the trials were consistent with expected changes from other studies in the literature [34,35,36]. Finally, changes in plasma fatty acid profiles were also consistent with the dietary intervention [26]. Post- vs. pre-intervention differences in body weight were examined to further confirm body weight stability and hence isoenergetic feeding conditions. Based on the post- vs. pre-intervention body weight difference of all participants, an arbitrary cut-off of ±1.5 SD (0 ± 1.85 kg) change in body weight was chosen to exclude subjects with a large body weight variation after the intervention. A change within ±1.85 kg most likely reflects normal day-to-day variation in body weight, of which most is due to body water fluctuation [37].
2.5. Statistical Analyses
The statistical software package SAS® Studio (v3.6, Cary, NC, USA) was used for all analyses. Extreme values of rEI were excluded on the basis of the Outlier Labeling Rule [38]. Outliers are individual values above Q3 + 2 × (Q3 − Q1) or below Q1 − 2 × (Q3 − Q1) where Q1 and Q3 represent the 25th and 75th percentiles of the rEI distribution, respectively. Baseline characteristics of the participants were compared using two-sided Student t tests and chi-square tests, where appropriate.
Mean rEI and mER were compared using MIXED models with self-report flag (indicator variable for rEI or mER), age, sex, body mass index (BMI), ethnicity, trial and post vs. pre-intervention body weight difference as fixed effects, and subject as a random effect. Potential statistical differences between the IA- and WEB-FFQ were assessed with addition of the interaction term FFQ method (IA- or WEB-FFQ) × self-report flag to the MIXED models. Spearman correlations (rs) were used to examine the association between rEI and mER with adjustment for age, sex, BMI, ethnicity, trial and post vs. pre-intervention body weight.
Participants were also classified as under-reporters, accurate reporters, or over-reporters on the basis of their ratio of rEI to mER (i.e., a ratio of 1.00 would indicate exact correspondence between both measures). Confidence limits (CL) were calculated around the rEI:mER ratio based on the coefficient of variation (CV) for rEI and mER to account for measurement errors and normal variation in energy expenditure:
(1) |
The CVrEI (29.3%) is the within-individual CV in rEI obtained from the WEB-FFQ [15]. Repeated measurement data for the IA-FFQ were unavailable and the same CVrEI was used for both FFQs. The CVrEI was subsequently divided by the number of days (d) recalled by the FFQs (i.e., 30 days). The CVmER is obtained from regression equations of doubly labelled water studies and corresponds to measurement error and variation in energy expenditure (i.e., 9.1%) over a time span of 8 weeks [39]. This specific time span was chosen to account for the length of both the dietary intervention and the run-in period of all trials in the present study, as rEI and mER were not measured concurrently. A multiplicative factor of 2 was applied to the combined CV to obtain 95% confidence limits. Thus, individuals were classified as under-reporters or over-reporters if their rEI:mER ratio was below 0.79 or above 1.21, respectively.
Log-binomial regression models were used to assess the association between BMI and sex and the likelihood of under-reporting. Covariates included in the adjusted models, where appropriate, were sex, BMI, ethnicity, trial and post vs. pre-intervention body weight difference. A two-sided alpha level of less than 0.05 was used to assess statistical significance.
3. Results
3.1. Participants
Data from a total of 448 men and women were considered for this study. Twenty-four were excluded because they did not complete the first phase of the feeding trials, one participant was excluded because pre-intervention body weight was missing, 12 participants were considered outliers on the basis of their rEI (n = 5 for the WEB-FFQ and n = 7 for the IA-FFQ) and 84 participants were excluded because of a post- vs. pre-intervention body weight difference greater than ± 1.85 kg (n = 54 for the WEB-FFQ and n = 30 for the IA-FFQ; Figure 1).
Characteristics of the participants included in the analyses are presented for the IA-FFQ (n = 127) and WEB-FFQ (n = 200) in Table 1. Participants in the IA-FFQ group were slightly younger, had a lower body weight, waist circumference, and BMI, and included more women than participants in the WEB-FFQ group (all p values ≤ 0.02). The median (interquartile range) time for completion of the WEB-FFQ was 42.9 (34.0–59.3) min. Mean post- vs. pre-intervention body weight difference was −0.4 kg (95%CI, −0.6 to −0.3) in men and −0.6 kg (95%CI, −0.8 to −0.5) in women (both p values < 0.0001), which is within expected range (Table S1).
Table 1.
IA-FFQ | WEB-FFQ | p 2 | |
---|---|---|---|
N = 127 | N = 200 | ||
Sex, n (%) | 0.01 | ||
Men | 51 (40.2) | 108 (54.0) | |
Women | 76 (59.8) | 92 (46.0) | |
Ethnicity, n (%) | 0.01 | ||
Caucasian | 121 (95.3) | 172 (86.0) | |
Other | 6 (4.7) | 28 (14.0) | |
Age 3, mean (SD) years | 40.9 (16.8) | 44.5 (15.4) | 0.04 |
19–34, n (%) | 58 (45.7) | 67 (33.5) | |
35–49, n (%) | 14 (11.0) | 44 (22.0) | |
50–70, n (%) | 55 (43.3) | 89 (44.5) | |
Time to completion, minutes | - | 42.9 (34.0 to 59.3) | |
Body weight, mean (SD) kg | 72.8 (16.6) | 84.6 (15.8) | <0.0001 |
Body mass index, mean (SD) kg/m2 | 25.8 (5.4) | 29.7 (4.4) | <0.0001 |
Normal, n (%) | 69 (54.3) | 27 (13.5) | |
Overweight, n (%) | 31 (24.4) | 81 (40.5) | |
Obese, n (%) | 27 (21.3) | 92 (46.0) | |
Waist circumference, mean (SD) cm | 88.4 (14.8) | 100.6 (11.8) | <0.0001 |
1 Values are means (SD) for continuous variables except for time to completion which is median (interquartile range). FFQ: food frequency questionnaire; IA: interviewer-administered. 2 p values indicate differences between the IA-FFQ and the WEB-FFQ, determined by Student’s t test or Chi-squared test. 3 Analyses were performed on log-transformed data.
3.2. Reported Energy Intake Compared with Measured Energy Requirements
Mean differences between rEI and mER and rEI:mER ratios are presented by FFQ method and subgroups in Table 2. Results were similar either expressed as the absolute (in kcal) or relative (in %) difference between rEI and mER for both FFQs in all subgroups. Among all participants, the rEI derived from the IA-FFQ was significantly lower than the mER, by −229 kcal (95% CI, −324 to −133; p < 0.0001). The rEI derived from the WEB-FFQ was also significantly lower than mER (−166 kcal; 95% CI, −292 to −39; p < 0.0001). The mean differences between rEI and mER were similar between FFQs (p = 0.62). The IA-FFQ underestimated mean mER in men and women, as well as in non-obese and obese participants. The WEB-FFQ underestimated mean mER only in men and in obese individuals. Analyses stratified by sex and body weight classification revealed similar rEI to mER differences between the IA- and the WEB-FFQ (all p values > 0.30).
Table 2.
n | rEI, kcal | mER, kcal | ∆ rEI-mER, kcal | ∆ rEI-mER, % * | Spearman CC | |
---|---|---|---|---|---|---|
IA-FFQ | ||||||
All | 127 | 2413 ± 602 | 2642 ± 558 | −229 (−324 to −133) † | −9.5 (−12.7 to −6.1) | 0.50 ‡ |
Sex | ||||||
Men | 51 | 2744 ± 605 | 3161 ± 467 | −417 (−600 to −234) † | −14.3 (−19.6 to −8.6) | 0.23 |
Women | 76 | 2191 ± 491 | 2294 ± 265 | −102 (−197 to −8) † | −6.1 (−9.9 to −2.0) | 0.63 ‡ |
BMI | ||||||
Non-obese | 100 | 2415 ± 610 | 2594 ± 546 | −179 (−282 to −76) † | −7.8 (−11.5 to −4.0) | 0.51 ‡ |
Obese | 27 | 2409 ± 582 | 2822 ± 573 | −413 (−649 to −176) † | −15.3 (−21.9 to −8.1) | 0.13 |
WEB-FFQ | ||||||
All | 200 | 2519 ± 962 | 2684 ± 536 | −166 (−292 to −39) † | −11.0 (−15.4 to −6.4) | 0.34 ‡ |
Sex | ||||||
Men | 108 | 2764 ± 991 | 3056 ± 414 | −292 (−469 to −116) † | −14.9 (−20.5 to −8.9) | 0.40 ‡ |
Women | 92 | 2231 ± 845 | 2248 ± 265 | −17 (−198 to 163) | −6.3 (−13.1 to 1.1) | 0.20 |
BMI | ||||||
Non-obese | 108 | 2583 ± 1021 | 2543 ± 520 | 40 (−132 to 212) | −4.1 (−10.4 to 2.7) | 0.39 ‡ |
Obese | 92 | 2443 ± 888 | 2850 ± 508 | −407 (−585 to −230) † | −18.5 (−24.3 to −12.3) | 0.27 ‡ |
1 Values are means (SD) or means (95% CI). BMI: body mass index; CC: correlation coefficient; FFQ: food frequency questionnaire; IA: interviewer-administered; mER: measured energy requirement; rEI: reported energy intake; ∆: delta. * Mean percentage differences between rEI and mER were calculated as 100× exponential (mean of log rEI − mean log mER value) – 100; † Indicates a significant difference with mean rEI as determined by mixed models, p < 0.05. Analyses were performed on log-transformed data. ‡ Indicates a significant correlation, p < 0.05.
Spearman correlations between rEI and mER are presented in Table 2. Among all participants, the correlation was stronger with the IA-FFQ (rs = 0.50; p < 0.0001) than with the WEB-FFQ (rs = 0.34, p < 0.0001). In men, the correlation between rEI and mER was significant with the WEB-FFQ (rs = 0.40; p = 0.0001), but not the IA-FFQ (rs = 0.23; p = 0.12). Inversely, in women, the correlation between the rEI and mER was significant with the IA-FFQ (rs = 0.63; p < 0.0001), but not with the WEB-FFQ (rs = 0.20; p = 0.06).
3.3. Under-Reporting and Over-Reporting
Prevalence and likelihood of under-reporting and over-reporting are shown in Table 3 and Figure 2 respectively. Among all participants, under-reporting was more prevalent with the WEB-FFQ than with the IA-FFQ (34.5% vs. 26.0%) but the difference did not reach statistical significance. The prevalence of under-reporting among obese participants was similar with the WEB-FFQ and the IA-FFQ (46.7% vs. 33.3%; p = 0.24) and also among non-obese participants (24.1% vs. 24.0% respectively). Obese individuals were more likely to under-report rEI than non-obese individuals with the WEB-FFQ (prevalence ratio, 1.97; 95% CI, 1.32 to 2.95), but not with the IA-FFQ (prevalence ratio, 0.75; 95% CI, 0.34 to 1.66; Figure 2). The prevalence of under-reporting was similar between the WEB-FFQ and the IA-FFQ among women (30.4% vs. 21.1%, respectively) and men (38.0% vs. 33.3%, respectively). Data presented in Figure 2 suggest that women were similarly likely to under-report rEI compared with men with both FFQs (IA-FFQ: prevalence ratio, 0.66; 95% CI, 0.29 to 1.50; WEB-FFQ: prevalence ratio, 0.95; 95% CI, 0.62 to 1.45). Finally, over-reporting was more prevalent with the WEB-FFQ than the IA-FFQ among all participants (p = 0.0005), while subgroup differences were statistically significant only in non-obese participants (Table 3).
Table 3.
FFQ Method | n | Under-Reporters | Accurate Reporters | Over-Reporters | p * | |
---|---|---|---|---|---|---|
All | IA | 127 | 26.0 (18.6 to 34.5) | 67.7 (58.9 to 75.7) | 6.3 (2.8 to 12.0) | 0.0005 |
WEB | 200 | 34.5 (27.9 to 41.5) | 48.0 (40.9 to 55.2) | 17.5 (12.5 to 23.5) | ||
Sex | ||||||
Men | IA | 51 | 33.3 (20.8 to 47.9) | 60.8 (46.1 to 74.2) | 5.9 (1.2 to 16.2) | 0.12 |
WEB | 108 | 38.0 (28.8 to 47.8) | 46.3 (36.7 to 56.2) | 15.7 (9.5 to 24.0) | ||
Women | IA | 76 | 21.1 (12.5 to 31.9) | 72.4 (60.9 to 82.0) | 6.6 (2.2 to 14.7) | 0.0063 |
WEB | 92 | 30.4 (21.3 to 40.9) | 50.0 (39.4 to 60.6) | 19.6 (12.0 to 29.2) | ||
BMI | ||||||
Non-obese | IA | 100 | 24.0 (16.0 to 33.6) | 69.0 (59.0 to 77.9) | 7.0 (2.9 to 13.9) | 0.0019 |
WEB | 108 | 24.1 (16.4 to 33.3) | 51.9 (42.0 to 61.6) | 24.1 (16.4 to 33.3) | ||
Obese | IA | 27 | 33.3 (16.5 to 54.0) | 63.0 (42.4 to 80.6) | 3.7 (0.1 to 19.0) | 0.24 |
WEB | 92 | 46.7 (36.3 to 57.4) | 43.5 (33.2 to 54.2) | 9.8 (4.6 to 17.8) |
1 Values are percentages (95% CI). Accurate reporters are individuals of which their corresponding rEI:mER ratio are within the 95% confidence limits of an agreement ratio of 1.00. Under-reporters and over-reporters had a ratio below 0.79 and above 1.21, respectively. BMI: body mass index; CI: confidence intervals; FFQ: food frequency questionnaire; IA: interviewer-administered; mER: measured energy requirements; rEI: self-reported energy intake. * p values indicate at least one significant difference between the IA-FFQ and the WEB-FFQ as determined by the Chi-squared test.
4. Discussion
The aim of this study was to compare the accuracy of IA- and WEB-FFQ to assess an objective measure of energy requirements. Consistent with previous investigations [11], we found that both FFQs resulted in significant under-reporting of mER by −11.0% (WEB-FFQ) and −9.5% (IA-FFQ). In general, and contrary to our hypothesis, results indicated that the IA-FFQ performs slightly better than the WEB-FFQ in attenuating the prevalence of under-reporting and over-reporting in most subgroups based on sex and body weight classification.
Web-based tools such as the WEB-FFQ are being increasingly used in research for several reasons, including greater efficiency in administration process and facilitated data management [15,16,17]. However, studies that have compared the accuracy of traditional IA- and WEB-FFQs in predicting energy and nutrient intake are scarce to date. Park et al. [40] have recently conducted a large study comparing self-reported intakes using self-administered web-based instruments, including a FFQ, against recovery biomarkers. Energy was significantly under-reported by −29 to −34% on average compared with the doubly labeled water technique, the gold standard reference. The degree of under-reporting in the study by Park et al. was greater than in the current study (−11% for the WEB-FFQ), possibly due to different methodologies. Nonetheless, the results by Park et al. are consistent with results in the present study revealing systematic error when estimating energy intakes with a WEB-FFQ.
Kato et al. [41] compared two self-administered FFQs that differed only by their format (paper- vs. web-based) in their ability to accurately predict energy intake, using weighted 12-day food records as reference for “true” energy intake. Energy intake derived from the WEB-FFQ correlated weakly with energy intake derived from the food records, but the correlation was slightly higher among men than among women (Spearman’s deattenuated correlation coefficients = 0.42 and 0.18, respectively). This observation is somewhat consistent with our results as the correlation between rEI and mER for the WEB-FFQ was significant in men, but not in women. Of note, the use of an objective reference method to assess ER in our study may have yielded weaker correlation between rEI and mER than those observed in this study by Kato et al. [41]. These authors also found that energy intakes derived from the WEB-FFQ were within acceptable limits of agreement in men (Bland-Altman method, 54–178%), and were slightly overestimated in women (Bland-Altman method, 55–220%) compared with the energy intakes derived from food records. Results from the present study showed that women had a similar likelihood to under-report energy intake compared with men when using the WEB-FFQ. The weaker correlation between rEI and mER in women when using the WEB-FFQ may be due to over-reporting being more prevalent in women than in men, which is consistent with the overestimation observed by Kato et al. [41]. Nonetheless, these observations contradict previous IA-24HR data that showed greater under-reporting in women [6]. Future studies should provide additional insight on potential sex-based differences on the accuracy of web-based tools in predicting energy requirements.
Another recent study used the doubly labeled water technique to examine the accuracy with which a WEB-FFQ (i.e., MiniMeal-Q) and a web-based 4 days food record (i.e., Riksmaten method) predict energy intake [42]. Pearson’s correlations between rEI and mER were 0.28 (non-significant) for the WEB-FFQ and 0.40 (p < 0.05) for the food records. The WEB-FFQ resulted in a higher prevalence of under-reporters compared with the foods records (57.5% vs. 40%, respectively) and also a higher prevalence of over-reporters (15% vs. 5%, respectively). Although this study compared two web-based dietary assessment tools, the results support that current WEB-FFQ may not be better than other dietary assessment tool to estimate true energy intake. This observation is consistent with results from our study in that the WEB-FFQ produced weaker correlation between rEI and mER and a greater prevalence of under- and over-reporters compared with the IA-FFQ.
The rather large number of participants in this study compared with previous studies along with measured energy requirements are important strengths. Potential limitations also need to be considered. Firstly, the WEB-FFQ and the IA-FFQ have notable differences including the number of food items (greater with the WEB-FFQ) as well as different approaches to present serving sizes (food models vs. digital images), which could explain, at least partly, differences in the accuracy of mER prediction. Secondly, different study participants completed the IA- or WEB-FFQ. Therefore, differences observed in this study may not solely be due to the administration technique per se (i.e., IA vs. WEB) but could also reflect differences among study participants, although analyses were adjusted for these differences (i.e., age, sex, BMI, ethnicity). Thirdly, the controlled feeding phases were conducted in free-living conditions and some of the foods and beverages provided may not have been entirely consumed. However, the high self-reported compliance combined with the fact that a large proportion of the foods provided were consumed in the presence of study coordinators, the consistency of the cardiometabolic changes induced by the interventions and analysis of plasma biomarkers suggest that the risk of noncompliance in these studies is low. Finally, the significantly lower post- vs. pre-intervention body weight may suggest insufficient food provision (mER) in the feeding phases, but the weight difference was small and also added as a covariate in the analyses.
5. Conclusions
In conclusion, results from this study suggest that an IA-FFQ slightly attenuates the prevalence of under- and over-reporting of mER compared with a WEB-FFQ. Accordingly, the use of the WEB-FFQ resulted in accurate reporting of energy intake in 48% of all participants compared with 68% with the IA-FFQ. Considering the efficiency of web-based questionnaires and the importance of dietary assessment for population-based nutrition studies, our results support the urge to increase the quality of web-based dietary assessment tools and to further develop objective and innovative assessment techniques. Future studies should also examine if specific foods or nutrients are more likely to be under- or over-reported in web-based compared with traditional tools. The use of metabolomics and passive measure of one’s food intake through digital imaging and video also have the potential to improve our ability to assess dietary intake [17,43].
Acknowledgments
We express our gratitude to the study participants, without whom the trials would not have been possible.
Supplementary Materials
The following are available online at http://www.mdpi.com/2072-6643/10/9/1292/s1. Table S1: Anthropometric characteristics before and after controlled feeding phases of 4 to 6 weeks in men and women.
Author Contributions
Conceptualization, D.B. and B.L.; Data curation, D.B.; Formal analysis, D.B.; Funding acquisition, P.C., B.L., S.L.; Project administration, A.C. and P.C.; Software, M.-È.L., B.L.; Supervision, B.L.; Writing—original draft, D.B.; Writing—review and editing, S.L., A.C., A.L., P.C., M.-È.L. and B.L.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Hébert J.R., Hurley T.G., Steck S.E., Miller D.R., Tabung F.K., Peterson K.E., Kushi L.H., Frongillo E.A. Considering the value of dietary assessment data in informing nutrition-related health policy. Adv. Nutr. 2014;5:447–455. doi: 10.3945/an.114.006189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Labonté M., Kirkpatrick S.I., Bell R.C., Boucher B.A., Csizmadi I., Koushik A., L’Abbé M.R., Massarelli I., Robson P.J., Rondeau I., et al. Dietary assessment is a critical element of health research-Perspective from the Partnership for Advancing Nutritional and Dietary Assessment in Canada. Appl. Physiol. Nutr. Metab. 2016:1–4. doi: 10.1139/apnm-2016-0146. [DOI] [PubMed] [Google Scholar]
- 3.Thompson F.E., Kirkpatrick S.I., Subar A.F., Reedy J., Schap T.E., Wilson M.M., Krebs-Smith S.M. The National Cancer Institute’s Dietary Assessment Primer: A Resource for Diet Research. J. Acad. Nutr. Diet. 2015;115:1986–1995. doi: 10.1016/j.jand.2015.08.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Archer E., Marlow M.L., Lavie C.J. Controversy and debate: Memory based methods paper 1: The fatal flaws of food frequency questionnaires and other memory-based dietary assessment methods. J. Clin. Epidemiol. 2018 doi: 10.1016/j.jclinepi.2018.08.003. [DOI] [PubMed] [Google Scholar]
- 5.Archer E., Marlow M.L., Lavie C.J. Controversy and debate: Memory-based dietary assessment methods paper #3. J. Clin. Epidemiol. 2018 doi: 10.1016/j.jclinepi.2018.07.013. [DOI] [PubMed] [Google Scholar]
- 6.Archer E., Hand G.A., Blair S.N. Validity of U.S. nutritional surveillance: National health and nutrition examination survey caloric energy intake data, 1971–2010. PLoS One. 2013;8 doi: 10.1371/annotation/c313df3a-52bd-4cbe-af14-6676480d1a43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Subar A.F., Freedman L.S., Tooze J.A., Kirkpatrick S.I., Boushey C., Neuhouser M.L., Thompson F.E., Potischman N., Guenther P.M., Tarasuk V., et al. Addressing current criticism regarding the value of self-report dietary data. J. Nutr. 2015;145:2639–2645. doi: 10.3945/jn.115.219634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Willett W.C., Rimm E.B., Hu F.B. Reply to E Archer. Am. J. Clin. Nutr. 2017;106:950–951. doi: 10.3945/ajcn.117.160234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Martín-Calvo N., Martínez-González M. Controversy and Debate: Memory based methods paper 2. J. Clin. Epidemiol. 2018 doi: 10.1016/j.jclinepi.2018.08.005. [DOI] [PubMed] [Google Scholar]
- 10.Martín-Calvo N., Martínez-González M. Controversy and Debate: Memory based methods paper 4: Please, no more idle talk on memory-based methods in science. J. Clin. Epidemiol. 2018 doi: 10.1016/j.jclinepi.2018.08.004. [DOI] [PubMed] [Google Scholar]
- 11.Freedman L.S., Commins J.M., Moler J.E., Arab L., Baer D.J., Kipnis V., Midthune D., Moshfegh A.J., Neuhouser M.L., Prentice R.L., et al. Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for energy and protein intake. Am. J. Epidemiol. 2014;180:172–188. doi: 10.1093/aje/kwu116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Livingstone M.B., Black A.E. Markers of the validity of reported energy intake. J. Nutr. 2003;133(Suppl. 3):895S–920S. doi: 10.1093/jn/133.3.895S. [DOI] [PubMed] [Google Scholar]
- 13.Subar A.F., Kipnis V., Troiano R.P., Midthune D., Schoeller D.A., Bingham S., Sharbaugh C.O., Trabulsi J., Runswick S., Ballard-Barbash R., et al. Using intake biomarkers to evaluate the extent of dietary misreporting in a large sample of adults: the OPEN study. Am. J. Epidemiol. 2003;158:1–13. doi: 10.1093/aje/kwg092. [DOI] [PubMed] [Google Scholar]
- 14.Freedman L.S., Commins J.M., Moler J.E., Willett W., Tinker L.F., Subar A.F., Spiegelman D., Rhodes D., Potischman N., Neuhouser M.L., et al. Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for potassium and sodium intake. Am. J. Epidemiol. 2015;181:473–487. doi: 10.1093/aje/kwu325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Labonté M., Cyr A., Baril-Gravel L., Royer M.M., Lamarche B. Validity and reproducibility of a web-based, self-administered food frequency questionnaire. Eur J. Clin. Nutr. 2012;66:166–173. doi: 10.1038/ejcn.2011.163. [DOI] [PubMed] [Google Scholar]
- 16.Illner A.K., Freisling H., Boeing H., Huybrechts I., Crispim S.P., Slimani N. Review and evaluation of innovative technologies for measuring diet in nutritional epidemiology. Int. J. Epidemiol. 2012;41:1187–1203. doi: 10.1093/ije/dys105. [DOI] [PubMed] [Google Scholar]
- 17.Stumbo P.J. New technology in dietary assessment: A review of digital methods in improving food record accuracy. Proc. Nutr. Soc. 2013;72:70–76. doi: 10.1017/S0029665112002911. [DOI] [PubMed] [Google Scholar]
- 18.Touvier M., Kesse-Guyot E., Méjean C., Pollet C., Malon A., Castetbon K., Hercberg S. Comparison between an interactive web-based self-administered 24 h dietary record and an interview by a dietitian for large-scale epidemiological studies. Br. J. Nutr. 2011;105:1055–1064. doi: 10.1017/S0007114510004617. [DOI] [PubMed] [Google Scholar]
- 19.Probst Y.C., Faraji S., Batterham M., Steel D.G., Tapsell L.C. Computerized dietary assessments compare well with interviewer administered diet histories for patients with type 2 diabetes mellitus in the primary healthcare setting. Patient Educ. Couns. 2008;72:49–55. doi: 10.1016/j.pec.2008.01.019. [DOI] [PubMed] [Google Scholar]
- 20.Kesse-Guyot E., Assmann K., Andreeva V., Castetbon K., Méjean C., Touvier M., Salanave B., Deschamps V., Péneau S., Fezeu L., et al. Lessons Learned From Methodological Validation Research in E-Epidemiology. JMIR Public Health Surveill. 2016;2 doi: 10.2196/publichealth.5880. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Kirkpatrick S.I., Potischman N., Dodd K.W., Douglass D., Zimmerman T.P., Kahle L.L., Thompson F.E., George S.M., Subar A.F. The use of digital images in 24-hour recalls may lead to less misestimation of portion size compared with traditional interviewer-administered recalls. J. Nutr. 2016;146:2567–2573. doi: 10.3945/jn.116.237271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Kirkpatrick S.I., Vanderlee L., Raffoul A., Stapleton J., Csizmadi I., Boucher B.A., Massarelli I., Rondeau I., Robson P.J. Self-report dietary assessment tools used in canadian research: A scoping review. Adv. Nutr. 2017;8:276–289. doi: 10.3945/an.116.014027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Motard-Bélanger A., Charest A., Grenier G., Paquin P., Chouinard Y., Lemieux S., Couture P., Lamarche B. Study of the effect of trans fatty acids from ruminants on blood lipids and other risk factors for cardiovascular disease. Am. J. Clin. Nutr. 2008;87:593–599. doi: 10.1093/ajcn/87.3.593. [DOI] [PubMed] [Google Scholar]
- 24.Richard C., Couture P., Desroches S., Charest A., Lamarche B. Effect of the mediterranean diet with and without weight loss on cardiovascular risk factors in men with the metabolic syndrome. Nutr. Metab. Cardiovasc. Dis. 2011;21:628–635. doi: 10.1016/j.numecd.2010.01.012. [DOI] [PubMed] [Google Scholar]
- 25.Lacroix E., Charest A., Cyr A., Baril-Gravel L., Lebeuf Y., Paquin P., Chouinard P.Y., Couture P., Lamarche B. Randomized controlled study of the effect of a butter naturally enriched in trans fatty acids on blood lipids in healthy women. Am. J. Clin. Nutr. 2012;95:318–325. doi: 10.3945/ajcn.111.023408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Senanayake V.K., Pu S., Jenkins D.A., Lamarche B., Kris-Etherton P.M., West S.G., Fleming J.A., Liu X., McCrea C.E., Jones P.J. Plasma fatty acid changes following consumption of dietary oils containing n-3, n-6, and n-9 fatty acids at different proportions: preliminary findings of the Canola Oil Multicenter Intervention Trial (COMIT) Trials. 2014;15 doi: 10.1186/1745-6215-15-136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Drouin-Chartier J.P., Gagnon J., Labonté M., Desroches S., Charest A., Grenier G., Dodin S., Lemieux S., Couture P., Lamarche B. Impact of milk consumption on cardiometabolic risk in postmenopausal women with abdominal obesity. Nutr. J. 2015;14 doi: 10.1186/1475-2891-14-12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Brassard D., Tessier-Grenier M., Allaire J., Rajendiran E., She Y., Ramprasath V., Gigleux I., Talbot D., Levy E., Tremblay A., et al. Comparison of the impact of SFAs from cheese and butter on cardiometabolic risk factors: A randomized controlled trial. Am. J. Clin. Nutr. 2017;105:800–809. doi: 10.3945/ajcn.116.150300. [DOI] [PubMed] [Google Scholar]
- 29.Lohman T., Roche A., Martorell R. The Airlie (VA) Consensus Conference. Anthropometric Standardization Reference Manual. Human Kinetics; Champaign, IL, USA: 1988. pp. 39–80. [Google Scholar]
- 30.Goulet J., Nadeau G., Lapointe A., Lamarche B., Lemieux S. Validity and reproducibility of an interviewer-administered food frequency questionnaire for healthy French-Canadian men and women. Nutr. J. 2004;3 doi: 10.1186/1475-2891-3-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Le Moullec N., Deheeger M., Preziosi P., Monteiro P., Valeix P., Rolland-Cachera M.-F., Potier De Courcy G., Christides J.-P., Chevrouvrier F., Galan P., et al. Validation of photographic document used to estimate the amounts of foods eaten by subjects in the SU.VI.MAX study. Cah. Nutr. Diet. 1996;31:158–164. [Google Scholar]
- 32.Roza A.M., Shizgal H.M. The Harris Benedict equation reevaluated: Resting energy requirements and the body cell mass. Am. J. Clin. Nutr. 1984;40:168–182. doi: 10.1093/ajcn/40.1.168. [DOI] [PubMed] [Google Scholar]
- 33.Lafrenière J., Lamarche B., Laramée C., Robitaille J., Lemieux S. Validation of a newly automated web-based 24-hour dietary recall using fully controlled feeding studies. BMC Nutr. 2017;3 doi: 10.1186/s40795-017-0153-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Mensink R.P., Zock P.L., Kester A.D., Katan M.B. Effects of dietary fatty acids and carbohydrates on the ratio of serum total to HDL cholesterol and on serum lipids and apolipoproteins: A meta-analysis of 60 controlled trials. Am. J. Clin. Nutr. 2003;77:1146–1155. doi: 10.1093/ajcn/77.5.1146. [DOI] [PubMed] [Google Scholar]
- 35.Siri-Tarino P.W., Chiu S., Bergeron N., Krauss R.M. Saturated fats versus polyunsaturated fats versus carbohydrates for cardiovascular disease prevention and treatment. Annu. Rev. Nutr. 2015;35:517–543. doi: 10.1146/annurev-nutr-071714-034449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Shen J., Wilmot K.A., Ghasemzadeh N., Molloy D.L., Burkman G., Mekonnen G., Gongora M.C., Quyyumi A.A., Sperling L.S. Mediterranean Dietary Patterns and Cardiovascular Health. Annu. Rev. Nutr. 2015;35:425–449. doi: 10.1146/annurev-nutr-011215-025104. [DOI] [PubMed] [Google Scholar]
- 37.Bhutani S., Kahn E., Tasali E., Schoeller D.A. Composition of two-week change in body weight under unrestricted free-living conditions. Physiol. Rep. 2017;5 doi: 10.14814/phy2.13336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Hoaglin D.C., Iglewicz B. Fine-tuning some resistant rules for outlier labeling. J. Am. Stat. Assoc. 1987;82:1147–1149. doi: 10.1080/01621459.1987.10478551. [DOI] [Google Scholar]
- 39.Black A.E., Cole T.J. Within- and between-subject variation in energy expenditure measured by the doubly-labelled water technique: implications for validating reported dietary energy intake. Eur. J. Clin. Nutr. 2000;54:386–394. doi: 10.1038/sj.ejcn.1600970. [DOI] [PubMed] [Google Scholar]
- 40.Park Y., Dodd K.W., Kipnis V., Thompson F.E., Potischman N., Schoeller D.A., Baer D.J., Midthune D., Troiano R.P., Bowles H., et al. Comparison of self-reported dietary intakes from the Automated Self-Administered 24-h recall, 4-d food records, and food-frequency questionnaires against recovery biomarkers. Am. J. Clin. Nutr. 2018;107:80–93. doi: 10.1093/ajcn/nqx002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Kato E., Takachi R., Ishihara J., Ishii Y., Sasazuki S., Sawada N., Iwasaki M., Shinozawa Y., Umezawa J., Tanaka J., et al. Online version of the self-administered food frequency questionnaire for the Japan Public Health Center-based Prospective Study for the Next Generation (JPHC-NEXT) protocol: Relative validity, usability, and comparison with a printed questionnaire. J. Epidemiol. 2017 doi: 10.1016/j.je.2016.08.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Nybacka S., Bertéus Forslund H., Wirfält E., Larsson I., Ericson U., Warensjö Lemming E., Bergström G., Hedblad B., Winkvist A., Lindroos A.K. Comparison of a web-based food record tool and a food-frequency questionnaire and objective validation using the doubly labelled water technique in a Swedish middle-aged population. J. Nutr. Sci. 2016;5 doi: 10.1017/jns.2016.29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Guasch-Ferré M., Bhupathiraju S.N., Hu F.B. Use of metabolomics in improving assessment of dietary intake. Clin. Chem. 2017 doi: 10.1373/clinchem.2017.272344. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.