Abstract
Objective
First, to evaluate the ability of a short dietary questionnaire (SDQ) to estimate energy intake (EI) on group and individual levels compared with total energy expenditure (TEE) measured by the doubly labelled water method. Second, to compare the SDQ's performance in estimating energy, nutrient and food intakes with a sixty-six-item FFQ used in large-scale Swedish epidemiological research.
Design
Cross-sectional.
Setting
Umeå, Sweden.
Subjects
In total, sixty-five non-pregnant women, of whom thirty-one were overweight or obese, and twenty-five pregnant, normal-weight women completed the protocol.
Results
On average, the SDQ captured 78 % and 79 % of absolute TEE in the non-pregnant and pregnant normal-weight women, respectively. Furthermore, the SDQ captured an average of 57 % of TEE in the overweight/obese non-pregnant women. The Spearman correlation of EI and TEE was significant in the overweight and obese women only (ρ = 0·37, 95 % CI 0·02, 0·64). There was no significant difference between the SDQ and the more extensive FFQ in the ability to assess EI when compared with TEE. Intakes of most nutrients and foods were significantly higher when assessed with the SDQ compared with the FFQ.
Conclusions
A new short dietary questionnaire with an alternative design underestimated EI of non-pregnant and pregnant, overweight and obese women on a group level but was able to rank the overweight/obese women according to EI. Furthermore, the short questionnaire captured as much or more of the energy, nutrient and food intakes of non-pregnant normal-weight and overweight/obese women on the group level as a traditional, more extensive FFQ.
Keywords: Body weight, Dietary intake, Doubly labelled water, FFQ, Non-pregnant and pregnant women, Validity
There is a need for quick and easy-to-administer dietary assessment tools with low respondent burden that give valid intake data in large-scale population studies and that are able to rank participants according to intake. The FFQ method is most often used in epidemiological studies( 1 ), since it is easy to administer at a relatively low cost and estimates habitual dietary intake over an extended time period( 2 ). A valid FFQ can be used to rank individuals according to reported intake and, if it includes portion size estimations, to assess absolute individual intakes( 3 ). However, a problem with all self-report dietary assessment methods is the misreporting of energy intake (EI)( 4 ). Dietary intake in young, weight-conscious women can be especially difficult to assess accurately, and previous studies in women show underestimation of EI when assessed using FFQ by comparison with total energy expenditure (TEE) measured by the doubly labelled water (DLW) method( 5 , 6 ). Furthermore, it has repeatedly been shown that for overweight and obese individuals EI is underestimated to a higher extent than for their normal-weight counterparts( 6 – 9 ). One biomarker study suggested that the FFQ worked better in detecting the higher EI in obese women when compared with the 24 h recall( 10 ).
In a review of 227 different FFQ the number of items queried ranged from five to 350, with a mean of eighty-eight items( 11 ). The review included FFQ aimed at assessing the whole diet or parts of the diet, e.g. intake of fruits and vegetables. On average, study participants take 15–30 min to complete a typical FFQ( 12 ), suggesting a need for shorter and less burdensome dietary questionnaires for use in large epidemiological studies. Shorter versions of established FFQ, retaining the same design, have been developed and validated, e.g. a short version of the Block questionnaire, which showed lower absolute values and correlation coefficients than the original FFQ for macronutrients when compared with food records( 13 ). In a meta-analysis, correlation coefficients for most nutrients were higher for FFQ of 200 items than for FFQ of 100 items when compared with reference methods( 14 ). However, although more extensive FFQ generally perform better, this may increase the risk of non-compliance. Most FFQ query the frequency of consumption with given response alternatives (e.g. ‘never’ to ‘4 times per day’) and use standard portion sizes for calculation of energy and nutrient intakes. Questionnaires with an alternative design are less common( 15 ). Integrating the amounts of food consumed with the frequencies of consumption in the FFQ could possibly make it easier for the participants to validly report their intakes and improve the estimation of consumed amounts.
There has been limited research validating alternative methods in younger female populations who are known to be prone to under-reporting. Moreover, study subgroups of overweight and pregnant women are seldom recruited specifically, in addition to normal-weight, non-pregnant subjects.
Therefore, the primary aim of the present study was to evaluate the ability of a short dietary questionnaire (SDQ) to assess EI in normal-weight/overweight/obese non-pregnant women, on group and individual levels compared with objectively measured TEE. A secondary aim was to compare the SDQ's performance in estimating energy, nutrient and food intakes with a sixty-six-item FFQ used in large-scale Swedish epidemiological research among normal-weight/overweight/obese non-pregnant women.
Materials and methods
Participants and setting
In previous work we have shown that a sample size of thirty to fifty subjects is sufficient to allow the statistical comparisons between Actiheart (or uniaxial accelerometry) and DLW estimates of energy expenditure( 16 , 17 ). Recognizing that nutritional questionnaires are more error prone than objective physical activity measures, because we were interested in testing additional hypotheses and because our study design and setting differed from the earlier studies( 16 , 17 ), we sought to recruit >100 women for the current study.
In 2008–2009, seventy-three non-pregnant normal-weight or overweight/obese women born in 1973–1988 and living in the county of Västerbotten, northern Sweden, were recruited through advertisements in local media and by word of mouth. Normal-weight, overweight and obese women were defined as having a BMI corresponding to <25·0, 25·0–29·9 and ≥30·0 kg/m2, respectively( 18 ). In addition, thirty-five pregnant women with similar demographic characteristics (i.e. age, region of residence, income level and education level) were recruited at 8–16 weeks of gestation through local antenatal clinics with the help of midwives. The pregnant women participated in the study at 28–32 weeks of gestation. Exclusion criteria were recent cardiovascular events, recent physically debilitating surgical procedures, unmanaged serious psychiatric disorders, dependency on illicit drugs and an inability to commit fully to the study protocol. The study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects were approved by the Regional Ethical Review Board in Umeå, Sweden. Written informed consent was obtained from all participants.
An SDQ was completed unsupervised by the participants during a visit to the Clinical Research Center, Umeå University hospital, and a sixty-six-item FFQ was completed at home after a 10 d DLW method measurement period. Both questionnaires assess dietary intake as well as intake of dietary supplements; however, the dietary supplement data were not included in the present study since these questions were not comparable between the SDQ and the FFQ. Since the FFQ refers to the period of the previous 12 months it was not included in the analysis of the pregnant women whose diet can be assumed to have been unstable during this period. The SDQ, however, refers to the period of the previous 3 months, thereby reflecting the intake during pregnancy, and was therefore used in the analyses of the pregnant women.
The short dietary questionnaire
The SDQ was developed with the aim to be short, fit on one A4-page and take less than 10 min to complete, but still capture the majority of an individual's dietary intake and make it possible to calculate energy and nutrient intakes. The SDQ was developed to be easier and quicker for all participants to complete regardless of weight status or pregnancy. The questionnaire was tested in a pilot study of women with nutrition as professional background and thereafter was revised (C Larsson, unpublished results) before it was used in the present study. The reason for choosing women with nutrition as profession to participate in the pilot study was to obtain relevant and qualified feedback on the design and questions of the SDQ. The design of the SDQ (see online supplementary material) differs from that of a traditional FFQ and consists of questions about frequency and portion size/amount of intake of thirty-nine foods/food groups/dishes, including beverages, as well as dietary supplements during the previous 3 months. The thirty-nine foods/food groups/dishes are representative of a mixed Swedish diet and contribute significantly to intakes of energy, Ca, Fe, Se and Zn according to a Swedish national diet survey( 19 ). These micronutrients were selected to guide the development of the SDQ since it was shown in the national diet survey that Swedish women do not reach the recommended intakes of Fe and Se, and intake of Ca is especially important in younger ages when bone formation peaks. The selected foods were also shown to contribute to a majority of the Zn intake. Standard weight and portion sizes of food/food groups/dishes were estimated through weighing of several food items and portions of dishes as well as by using standard portions from weight tables developed by the National Food Agency( 20 ). Energy and nutrient contents of the thirty-nine foods/food groups/dishes were obtained by aggregating and calculating mean contents of representative foods from the Swedish Food Database (version 2009-05-19); e.g. the energy and nutrient contents of ‘white bread’ in the SDQ were obtained by calculation of the mean energy and nutrient contents of five different types of white bread from the food database. Average values of the thirty-nine foods were entered as new foods in the nutrition calculation software Dietist XP version 3·1 (Kost och Näringsdata AB, Bromma, Sweden), which uses the Swedish Food Database (version 2009-05-19), and used for calculation of assessed energy and nutrient intake of the SDQ.
FFQ
The FFQ has previously been validated in the same general population to which participants in the present study belong( 21 , 22 ). The FFQ initially included eighty-four food items, but was later shortened by merging or removing foods. Therefore, the FFQ used in the present study consists of sixty-six listed foods/food groups/dishes, including beverages, and queries dietary intake during the previous year. The nine frequencies of consumption are ‘never’, ‘a few times per year’, ‘1–3 times per month’, ‘once a week’, ‘2–3 times a week’, ‘4–6 times a week’, ‘once a day’, ‘2–3 times a day’ and ‘4 or more times per day’. Reported frequencies were converted to the number of intakes per day and multiplied by a portion size value. The assessment of portion size is reported separately for (i) potatoes, rice and pasta, (ii) meat and fish and (iii) vegetables, and is aided by four colour photographs showing plates with increasing amounts. Other portion size values were natural portion sizes (e.g. an apple) or age- and sex-specific averages obtained from a national survey( 20 , 23 ). Energy and nutrient intakes were calculated by using the nutrition calculation software Stor MATs (Rudans Lättdata, Västerås, Sweden) which uses the Swedish Food Database version 1994 (for macronutrients) and 2009 (for micronutrients).
Doubly labelled water method
The DLW method was used to determine TEE. Participants were invited to the Clinical Research Center at Umeå University hospital in the morning following an 8 h overnight fast. Their weight was measured to the nearest 0·1 kg using a calibrated digital scale, height to the nearest 0·5 cm using a wall-mounted stadiometer and BMI (kg/m2) was calculated. Subsequently, a pre-dose urine sample was collected following which the participants were given an individually prepared oral dose of stable-isotope-enriched water (0·07 g 2H2O and 0·174 g H2 18O per kg body weight). Further urine samples were collected for each of the following 10 d, of which the samples from days 1–3 and 8–10 were analysed. The participant noted the time for each sample in a log. Urine samples were kept in plastic vials at +4–8°C until returned and then frozen at −20°C pending analysis. Isotopic enrichments of dose and urine samples were analysed at MRC Human Nutrition Research, Cambridge, UK, using methods described in detail elsewhere( 24 ).
Exclusions
All 108 recruited women filled out the SDQ, 106 filled out the FFQ and 102 successfully underwent DLW measurements. The SDQ was developed to assess a traditional mixed Swedish diet; thus, six women who were vegetarians or did not eat red meat were excluded from the analyses, together with two women who did not fully complete the SDQ. Ten women not fully completing the FFQ were excluded from the analyses involving the FFQ. Furthermore, three of the pregnant women were obese. Considering that this group was too small to be analysed separately, they were excluded from the analysis. Some of the women had missing data with more than one of the methods. In total, ninety women were included in analyses: sixty-one non-pregnant women with different weight status who had a complete set of data from SDQ, FFQ and DLW measurements; an additional four non-pregnant women who had complete SDQ and DLW measurements but lacked complete FFQ; and twenty-five normal-weight pregnant women who had complete SDQ and DLW measurements.
Statistical analysis
Statistical analyses were performed in IBM SPSS Statistics version 20 and P values of ≤0·05 (two-sided) were considered significant. The variables were checked for normality of distribution by using the Shapiro–Wilk test. All foods and several nutrients and participant characteristics were non-normally distributed and non-parametric statistics were therefore principally used. Data are presented as medians, interquartile ranges, percentage proportions, Spearman correlation coefficients, means and standard deviations.
Differences in characteristics between normal-weight non-pregnant women and overweight/obese non-pregnant women and normal-weight pregnant women, respectively, were analysed using the Mann–Whitney U test.
Validity of assessed EI was analysed using three different approaches:
-
1.
Bland–Altman analyses of the agreement of EI assessed with the SDQ (for the non-pregnant and pregnant women) and the FFQ (only for the non-pregnant women) with TEE obtained from DLW.
-
2.
One-sample Wilcoxon signed-rank tests were used to analyse accuracy of assessment on the group level (EISDQ – TEE and EIFFQ – TEE, respectively, for the non-pregnant women, and EISDQ – TEE for the pregnant women). In the non-pregnant women, differences in accuracy between normal-weight and overweight/obese women were analysed using the Mann–Whitney U test.
-
3.
Spearman correlation coefficients were calculated between EISDQ and TEE for the non-pregnant and pregnant women and between EIFFQ and TEE for the non-pregnant women. For the non-pregnant women, results for normal-weight and overweight/obese women were calculated separately.
In the non-pregnant women, within-subject difference in accuracy of assessed EI between the SDQ and the FFQ was analysed using the Wilcoxon signed-rank test. The Spearman correlation coefficient was calculated between EISDQ – TEE and EIFFQ – TEE in order to investigate the association of errors of the two questionnaires.
Differences between the SDQ and FFQ in the ability to assess foods and nutrients in the non-pregnant women were analysed using the Wilcoxon signed-rank test. Spearman correlation coefficients were also calculated.
Results
Participant characteristics
Characteristics, EI and TEE of the participants are shown in Table 1. The pregnant women were normal weight at the time of recruitment (8–16 weeks of gestation; data not shown).
Table 1.
Non-pregnant | Pregnant | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
All (n 65) | Normal weight* (n 34) | Overweight/obese* (n 31) | Normal weight* (n 25) | |||||||
Median or n or ρ | IQR or % or 95 % CI | Median or n or ρ | IQR or % or 95 % CI | Median or n or ρ | IQR or % or 95 % CI | P value† | Median or n or ρ | IQR or % or 95 % CI | P value‡ | |
Group characteristics, median and IQR | ||||||||||
Age (years) | 29·2 | 6·6 | 28·7 | 5·4 | 30·0 | 8·9 | 0·70 | 31·5 | 3·8 | 0·03 |
Weight (kg) | 74·2 | 28·8 | 60·1 | 10·9 | 88·4 | 18·4 | <0·001 | 70·3 | 8·1 | <0·001 |
Height (cm) | 168·0 | 8·8 | 167·8 | 12·4 | 168·5 | 8·5 | 0·83 | 165·5 | 9·8 | 0·71 |
BMI (kg/m2) | 24·7 | 8·8 | 22·3 | 2·6 | 31·0 | 5·8 | <0·001 | 25·2 | 3·6 | <0·001 |
Educational level, n and % | ||||||||||
Vocational training | 1 | 1·5 | 1 | 2·9 | 0 | 0 | N/A | 1 | 4·0 | N/A |
Upper secondary school | 26 | 40·1 | 9 | 26·5 | 17 | 54·8 | N/A | 4 | 16·0 | N/A |
University/college | 37 | 56·9 | 23 | 67·7 | 14 | 45·2 | N/A | 19 | 76·0 | N/A |
Missing data | 1 | 1·5 | 1 | 2·9 | 0 | 0 | N/A | 1 | 4·0 | N/A |
Energy variables, median and IQR | ||||||||||
TEEDLW (kJ/d) | 10 647 | 2042 | 10 301 | 1266 | 11 969 | 1899 | <0·001 | 11 133 | 1599 | 0·02 |
EISDQ (kJ/d) | 7553 | 3315 | 8118 | 2839 | 6788 | 3770 | 0·37 | 8502 | 4368 | 0·35 |
EIFFQ (kJ/d)§ | 6872 | 2425 | 7121 | 2075 | 6686 | 2378 | 0·06 | N/A | N/A | N/A |
EISDQ – TEEDLW (kJ/d) | −3379 | 3894 | −2304 | 3133 | −4800 | 3573 | 0·01 | −2224 | 4063 | 0·91 |
EIFFQ – TEEDLW (kJ/d)§ | −4002 | 3423 | −2840 | 2227 | −5189 | 3520 | <0·001 | N/A | N/A | N/A |
EISDQ:TEEDLW | 0·70 | 0·33 | 0·78 | 0·31 | 0·57 | 0·33 | 0·02 | 0·79 | 0·39 | 0·83 |
EIFFQ:TEEDLW§ | 0·66 | 0·22 | 0·71 | 0·21 | 0·54 | 0·26 | 0·001 | N/A | N/A | N/A |
Correlations, ρ and 95 % CI | ||||||||||
EISDQ and TEEDLW | 0·14 | −0·11, 0·37 | 0·13 | −0·21, 0·45 | 0·37 | 0·02, 0·64 | N/A | −0·007 | −0·40, 0·39 | N/A |
EIFFQ and TEEDLW§ | −0·05 | −0·30, 0·20 | 0·08 | −0·28, 0·42 | 0·17 | −0·20, 0·50 | N/A | N/A | N/A | N/A |
EISDQ and EIFFQ§ | 0·48 | 0·25, 0·65 | 0·49 | 0·17, 0·72 | 0·43 | 0·08, 0·68 | N/A | N/A | N/A | N/A |
ρ, Spearman correlation; IQR, interquartile range; SDQ, short dietary questionnaire; FFQ, Swedish sixty-six-item FFQ; N/A, not applicable
Data are presented as median and interquartile range, number and percentage proportion, or Spearman correlation and 95 % confidence interval.
*According to cut-off values defined by the WHO( 18 ).
†Differences in characteristics between normal-weight and overweight/obese participants analysed using the Mann–Whitney U test.
‡Differences in characteristics between non-pregnant and pregnant normal-weight participants analysed using the Mann–Whitney U test.
§Sixty-one participants with available FFQ data.
Ability of the short dietary questionnaire to assess energy intake
The agreement between EISDQ and TEE in the non-pregnant women is displayed in a Bland–Altman plot in Fig. 1(a). The SDQ underestimated EI by 30 % on the group level (P < 0·001), corresponding to −3379 (median) and −3434 (mean) kJ/d (Table 1, Fig. 1). Three women were outside the limits of agreement (−8382, 1514 kJ/d) and three women had a reported EI within ±5 % of their individually measured TEE. Reported EI of four women was >5 % and of fifty-eight women was <5 % of individually measured TEE. The underestimation of EI was higher in those with higher energy expenditure.
As shown in Table 1, the SDQ underestimated EI of overweight/obese women to a greater extent than EI of normal-weight women, 43 % compared with 22 % (P = 0·02). However, the correlation between EISDQ and TEE was statistically significant (P = 0·04) in the overweight/obese women but not in the normal-weight women.
Figure 2 illustrates the agreement between EISDQ and TEE in the pregnant women. In comparison with TEE, EISDQ was underestimated by 21 % (P = 0·002), corresponding to –2224 (median) and –2415 (mean) kJ/d. Two women were outside the limits of agreement (−4044, 8873 kJ/d) and one woman had a reported EI within ±5 % of her individually measured TEE. Reported EI of three women was >5 % and of twenty-one women was <5 % of individually measured TEE. The underestimation of EI was higher in those with higher energy expenditure. The correlation between EISDQ and TEE was not statistically significant (P = 0·97; Table 1).
Ability of the short dietary questionnaire to assess intakes in comparison with the sixty-six-item FFQ
Comparison of agreement between EI assessed with SDQ and FFQ, respectively, and TEE is displayed in Bland–Altman plots in Figs 1(a) and 1(b). EI assessed with the SDQ was 70 % of the TEE, while EI assessed with the FFQ was 66 % of the TEE (Table 1). However, the difference in underestimation between the two questionnaires (n 61) was not statistically significant (P = 0·21). The Spearman correlation coefficient between EISDQ – TEE and EIFFQ – TEE was 0·62 (P < 0·001), indicating a correlated error structure.
Intakes of five out of eight nutrients (protein, carbohydrate, Ca, Se and Zn) adjusted for EI (amount per MJ) were significantly higher when assessed with the SDQ than with the FFQ, while the intakes of fat and Fe were significantly lower (P < 0·001; Table 2). This was true also when the analyses were performed with unadjusted intakes (data not shown). Spearman correlations for the eight nutrients assessed with the SDQ and the FFQ ranged from 0·37 to 0·66 (P < 0·01).
Table 2.
SDQ | FFQ | ||||
---|---|---|---|---|---|
Median | IQR | Median | IQR | P value* | |
Nutrients for which the SDQ gave a higher estimated intake compared with the FFQ | |||||
Protein (g/MJ per d) | 10·4 | 2·0 | 9·0 | 1·9 | <0·001 |
Carbohydrate (g/MJ per d) | 28·8 | 4·1 | 26·9 | 4·9 | <0·001 |
Ca (mg/MJ per d) | 105·9 | 45·9 | 82·9 | 41·3 | <0·001 |
Se (μg/MJ per d) | 4·6 | 2·1 | 3·6 | 1·4 | <0·001 |
Zn (mg/MJ per d) | 1·4 | 0·3 | 1·1 | 0·3 | <0·001 |
Nutrients for which the FFQ gave a higher estimated intake compared with the SDQ | |||||
Fat (g/MJ per d) | 7·9 | 1·7 | 10·2 | 2·2 | <0·001 |
Fe (mg/MJ per d) | 1·2 | 0·3 | 1·6 | 0·3 | <0·001 |
Nutrient for which no statistically significant difference in intake between the SDQ and the FFQ was found | |||||
Alcohol (g/MJ per d)† | 0·3 | 0·5 | 0·4 | 0·4 | 0·73 |
IQR, interquartile range.
Data are presented as median and interquartile range of energy-adjusted intakes.
*P value derived from the Wilcoxon signed-rank test for the difference in intakes assessed with the two questionnaires.
†For the fifty-eight women who reported to consume alcohol.
In total, twenty-six of the foods/food groups included in the SDQ were also found in the FFQ (Table 3). Intakes of fifteen out of these were significantly higher for the SDQ compared with the FFQ and for nine of the foods/food groups there were no statistically significant differences in intakes. For two foods/food groups (‘Milk/sour milk/yoghurt 3 % fat’ and ‘Chips and other snacks’) the FFQ assessed significantly higher amounts than the SDQ. Spearman correlations for foods assessed with the SDQ and the FFQ ranged from 0·47 to 0·81 (P < 0·001), except high-fat milk/sour milk/yoghurt for which the correlation was 0·28 (P = 0·03).
Table 3.
SDQ (g/d) | FFQ (g/d) | ||||
---|---|---|---|---|---|
Median | IQR | Median | IQR | P value* | |
Foods/food groups for which the SDQ gave a higher estimated intake compared with the FFQ | |||||
Bread | 90 | 90 | 47 | 43 | <0·001 |
Butter/margarine on bread, 40 % fat | 0 | 7 | 0 | 3 | 0·003 |
Cheese, 17 % fat | 0 | 10 | 2 | 7 | 0·01 |
Cheese, 28 % fat | 10 | 29 | 6 | 12 | <0·001 |
Milk/sour milk/yoghurt, 1–1·5 % fat | 60 | 200 | 22 | 112 | 0·002 |
Fruits and berries | 206 | 138 | 127 | 138 | <0·001 |
Rice | 47 | 47 | 25 | 31 | 0·003 |
Pasta | 103 | 103 | 72 | 43 | <0·001 |
Fish | 24 | 32 | 21 | 19 | 0·004 |
Poultry | 36 | 42 | 21 | 39 | 0·008 |
Cream/crème fraîche | 14 | 22 | 5 | 10 | <0·001 |
Biscuits/cookies/buns/cake | 12 | 16 | 9 | 12 | 0·04 |
Chocolate and sweets | 14 | 22 | 7 | 13 | 0·004 |
Juice/syrup/soft drinks | 100 | 143 | 32 | 72 | <0·001 |
Spirits† | 0 | 7 | 0 | 4 | <0·001 |
Foods/food groups for which the FFQ gave a higher estimated intake compared with the SDQ | |||||
Milk/sour milk/yoghurt, 3 % fat | 0 | 21 | 33 | 121 | <0·001 |
Chips and other snacks | 1 | 2 | 2 | 2 | <0·001 |
Foods/food groups for which no statistically significant difference in intake between the SDQ and the FFQ was found | |||||
Butter/margarine on bread, 60–80 % fat | 2 | 6 | 3 | 9 | 0·13 |
Milk/sour milk/yoghurt, 0·5 % fat | 30 | 150 | 33 | 207 | 0·36 |
Vegetables | 71 | 76 | 90 | 114 | 0·08 |
Boiled potatoes | 50 | 44 | 58 | 64 | 0·23 |
Fried potatoes/pommes frites | 0 | 20 | 11 | 12 | 0·39 |
Meat | 70 | 75 | 78 | 52 | 0·47 |
Ice cream | 5 | 13 | 6 | 6 | 0·55 |
Beer† | 7 | 25 | 2 | 29 | 0·73 |
Wine† | 14 | 27 | 18 | 17 | 0·95 |
IQR, interquartile range.
Data are presented as median and interquartile range.
*P value derived from the Wilcoxon signed-rank test for the difference in intakes assessed with the two questionnaires.
†For the fifty-eight women who reported to consume alcohol.
Discussion
The SDQ underestimated the EI of non-pregnant and pregnant, normal-weight and overweight/obese women compared with objectively measured TEE, but it was able to rank the overweight/obese women reasonably well according to EI. The FFQ underestimated EI to a similar extent as the SDQ and was not able to rank the participants’ EI. Intakes of certain macronutrients and minerals, as well as intakes of most foods, were significantly higher when assessed with the SDQ compared with the FFQ. However, since no criterion measure for these variables was used in the present study, it is not possible to determine which instrument is more accurate for assessing foods and nutrients. The results suggest that the shorter SDQ is as accurate as a traditionally designed and more extensive FFQ in estimating EI, nutrients and foods.
There has been some discussion about whether women generally under-report more than men, but evidence points to no consistent differences in reporting accuracy between the sexes( 4 , 25 , 26 ). However, a number of previous validation studies of FFQ in women have reported underestimation of EI when compared with TEE measured by the DLW method( 5 , 6 , 26 , 27 ). In one study, EI assessed using a 180-item FFQ was underestimated by 10 % among Norwegian women( 5 ), and in a large study, conducted in the USA, the underestimation of EI was 34 % using a 124-item FFQ( 26 ). The results of the present study showed that the women who were overweight or obese underestimated their EI to a greater extent than the normal-weight women using both the SDQ and the FFQ, which is consistent with previous results of studies relating misreporting of EI to body weight( 28 , 29 ). The trend of higher underestimation of EI with higher energy needs seen in both normal-weight and overweight/obese women in the present study has also been shown previously( 27 ). In line with our recruitment goals, almost half of the non-pregnant participants were overweight or obese in the present study, and therefore presumably more prone to under-reporting than had the sample been representative of the general population.
In a previous study, the evaluated FFQ was able to rank women according to EI when compared with TEE measured using the DLW method( 27 ). In another study, which also used TEE measured using the DLW method for comparison, the evaluated FFQ was not able to rank women according to EI( 5 ). In the present study, EI assessed with the SDQ correlated significantly with TEE, but only in the overweight/obese women. The FFQ was not able to rank the participants according to EI in any of the groups. The inability to rank participants’ EI using questionnaires is a concern since FFQ are often used in epidemiological studies with the aim to investigate diet–disease relationships. However, it is possible that we would have been able to find significant correlations if the sample had been larger.
We are not aware of any studies that have evaluated FFQ in pregnant women against TEE measured with the DLW method. However, in a study by Brantsaeter et al., a 255-item FFQ assessing EI among pregnant women was able to capture on average 96 % of the TEE calculated from resting energy expenditure and physical activity measured by a motion sensor, but was not able to rank participants according to EI( 30 ). We recognize the problems of evaluating assessed EI against the DLW method in pregnant women, who are in a positive energy balance. The extra energy required in pregnancy has been estimated to be 1200 kJ/d in the second trimester, for women with a mean gestational weight gain of 12·0 kg( 31 ). However, this does not take into account the decreased physical activity during mid- to late pregnancy. In the present study, EI assessed with the SDQ was on average 862 kJ/d higher in the pregnant women compared with the non-pregnant normal-weight women.
More comprehensive questionnaires presumably ought to result in a more complete assessment of intakes, because of their greater level of detail, but this was not the case in the present study. Examples of food items included in the FFQ that are not present as separate food items in the SDQ are eggs, cereals, beans and cooking oil; however, the extra items in the FFQ did not compensate for the lower estimated intakes of the foods/food groups that were included in both the FFQ and the SDQ when it comes to EI. A possible reason why the SDQ captured as much of the intake as the more comprehensive FFQ is that the design of the questions in the SDQ made it easier for the participants to more accurately report their dietary intake, even though it comprised fewer food items. A previous study showed that the design of the FFQ is more important than its length when it comes to response rate and data quality( 32 ). Furthermore, using a very long questionnaire can result in an overestimation of intake( 33 ) or careless or incomplete questionnaire responses. Subar et al. have shown that using a longer questionnaire does not correspond with a more accurate estimation of EI( 26 ). However, other studies have shown that the strength of the correlations for nutrient intakes between reference methods is positively related to the length of the questionnaire( 13 , 14 ). To include all foods eaten is obviously not feasible and there must be a trade-off between the level of detail and feasibility of the questionnaire. The intakes of two food groups were lower when assessed with the SDQ than the FFQ, i.e. snacks and high-fat milk products. The low correlation and the fact that the FFQ captured more of the intake of these food items suggest that the SDQ could be improved with regard to these foods.
The order of the questionnaires could possibly have affected the results of the present study; the participants could be assumed to be able to fill out the second questionnaire better because of learning or less well because of fatigue. However, the questionnaires were completed at least 10 d apart, which makes it less likely that the completion of the two questionnaires affected each other. Furthermore, the time frame of the SDQ, which goes three months back in time, could have better reflected the current diet and have made it easier for the participants to be able to accurately recall their food intake compared with the FFQ, which asks for the intake over the last twelve months.
A limitation to the present study is that there was no reference method used other than the FFQ with which to compare the intakes of foods and nutrients assessed with the SDQ. A comparison with e.g. 24 h recalls or weighed food intakes would have been more suitable to determine the relative validity of the SDQ regarding food and nutrient intakes. Another limitation is the seasonal differences and real changes in intakes that could have occurred between the different time periods covered by the SDQ and the FFQ; however, most seasonal foods are not included in the questionnaires. Furthermore, different foods chosen to represent common food groups in the two questionnaires could have biased the comparative results. Moreover, the SDQ and the FFQ do not use the same estimation of portion size, although both questionnaires used weight tables from the National Food Agency to estimate some of the foods( 20 ). Both questionnaires used the Swedish Food Database for calculation of energy and nutrients; however, they did not use the same version of the database for the calculation of macronutrients. A limitation to the SDQ is that it is based on foods common in a traditional Swedish diet, and for this reason a decision was made to exclude vegetarians from the main analysis. However, a sensitivity analysis was performed with the vegetarians included and the underestimation of EI was then 31 % (from 30 %) in the non-pregnant women and 22 % (from 21 %) in the pregnant women when compared with TEE. Furthermore, the correlation between EISDQ and TEE in the overweight/obese was reduced from 0·37 to 0·28 when one vegetarian was included. Although it was encouraging that the results were only slightly weaker when including vegetarians, these findings suggest that the SDQ method should be further adapted before using in samples where vegetarianism is common.
A strength of the present study is the use of the DLW method to validate assessed EI in all ninety participants. An advantage of the SDQ is that it is based on intakes from a national dietary survey( 19 ) and thus the questionnaire is suitable for assessment of a mixed Swedish diet. It is therefore likely that the items included in the SDQ will make up a considerable part of the respondents’ diet. The SDQ could possibly be used in countries with similar dietary culture as the Swedish. The design of the SDQ could also form the basis for new questionnaires that aim to assess dietary intake in other countries or focus on intakes of certain foods or nutrients. Furthermore, the SDQ was designed to be used on one single A4 paper sheet, which can be advantageous in some studies, e.g. in field studies with limited computer and Internet facilities. A potential application of the SDQ is when time is limited but the majority of the dietary intake is still of interest. It can for example be used as a rapid assessment tool in clinical settings. However, the underestimation of EI may limit its applications in studies and clinical settings where more precise information of intake at the individual level is needed. Due to the findings of the present study, future studies validating the SDQ against 24 h recalls/food diaries or nutrient biomarkers would further clarify its ability to estimate intake of different foods and nutrients. Further studies are also needed before the SDQ can be reliably used in demographic groups other than young pregnant and non-pregnant women (e.g. men and elderly people).
Conclusion
The SDQ, carefully designed with the aim to make it easier and more time efficient to report dietary intake, underestimated EI of non-pregnant and pregnant, overweight and obese women on a group level but was able to rank the overweight/obese women according to EI. Furthermore, the short questionnaire captured as much or more of the energy, nutrient and food intakes of non-pregnant normal-weight and overweight/obese women on a group level as a traditional, more extensive FFQ.
Acknowledgements
Sources of funding: The study was a preparatory project for the LifeGene Study (www.lifegene.se) and was funded by Torsten & Ragnar Söderberg's Foundation (via LifeGene), Fredrik and Ingrid Thuring's Foundation, and Västerbotten regional health authority (grants to P.W.F.). The funders had no role in the design, analysis or writing of this article. Conflicts of interest: The authors declare that they have no conflicts of interest with respect to this research. Authors’ contributions: P.W.F., F.R. and C.L. designed the study and C.L. developed the SDQ; F.R. and P.W.F. collected data; C.L. and L.L. co-supervised the data analysis and interpretation of results; L.B. conducted the DLW analysis; and Å.S. conducted data analysis and drafted the manuscript. All authors read and helped revise the manuscript and approved of the final version. Acknowledgements: The authors would like to thank the participants in this study, A. Wright for assistance with DLW analysis and M. Holmgren for assistance with data collection.
Supplementary material
For supplementary material accompanying this paper visit https://doi.org/10.1017/ S1368980013003042.
References
- 1. Rothman KJ, Greenland S & Lash TL (2008) Modern Epidemilogy, 3d ed. Philadelphia: Lippincott Williams & Wilkins. [Google Scholar]
- 2. Tucker KL (2007) Assessment of usual dietary intake in population studies of gene–diet interaction. Nutr Metab Cardiovasc Dis 17, 74–81. [DOI] [PubMed] [Google Scholar]
- 3. Block G, Hartman AM, Dresser CM et al. (1986) A data-based approach to diet questionnaire design and testing. Am J Epidemiol 124, 453–469. [DOI] [PubMed] [Google Scholar]
- 4. Westerterp KR & Goris AHC (2002) Validity of the assessment of dietary intake: problems of misreporting. Curr Opin Clin Nutr Metab Care 5, 489–493. [DOI] [PubMed] [Google Scholar]
- 5. Andersen LF, Tomten H, Haggarty P et al. (2003) Validation of energy intake estimated from a food frequency questionnaire: a doubly labelled water study. Eur J Clin Nutr 57, 279–284. [DOI] [PubMed] [Google Scholar]
- 6. Scagliusi FB, Ferriolli E, Pfrimer K et al. (2008) Underreporting of energy intake in Brazilian women varies according to dietary assessment: a cross-sectional study using doubly labeled water. J Am Diet Assoc 108, 2031–2040. [DOI] [PubMed] [Google Scholar]
- 7. Prentice AM, Black AE, Coward WA et al. (1986) High levels of energy expenditure in obese women. Br Med J (Clin Res Ed) 292, 983–987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Lafay L, Basdevant A, Charles MA et al. (1997) Determinants and nature of dietary underreporting in a free-living population: the Fleurbaix Laventie Ville Santé (FLVS) Study. Int J Obes Relat Metab Disord 21, 567–573. [DOI] [PubMed] [Google Scholar]
- 9. Weber JL, Reid PM, Greaves KA et al. (2001) Validity of self-reported energy intake in lean and obese young women, using two nutrient databases, compared with total energy expenditure assessed by doubly labeled water. Eur J Clin Nutr 55, 940–950. [DOI] [PubMed] [Google Scholar]
- 10. Lissner L, Troiano RP, Midthune D et al. (2007) OPEN about obesity: recovery biomarkers, dietary reporting errors and BMI. Int J Obes (Lond) 31, 956–961. [DOI] [PubMed] [Google Scholar]
- 11. Cade JE, Burley VJ, Warm DL et al. (2004) Food-frequency questionnaires: a review of their design, validation and utilisation. Nutr Res Rev 17, 5–22. [DOI] [PubMed] [Google Scholar]
- 12. Gibson RS (2005) Principles of Nutritional Assessment, 2nd ed. New York: Oxford University Press. [Google Scholar]
- 13. Block G, Hartman AM & Naughton D (1990) A reduced dietary questionnaire: development and validation. Epidemiology 1, 58–64. [DOI] [PubMed] [Google Scholar]
- 14. Molag ML, de Vries JH, Ocké MC et al. (2007) Design characteristics of food frequency questionnaires in relation to their validity. Am J Epidemiol 166, 1468–1478. [DOI] [PubMed] [Google Scholar]
- 15. Wolk A, Ljung H, Vessby B et al. (1998) Effect of additional questions about fat on the validity of fat estimates from a food frequency questionnaire. Study Group of MRS SWEA. Eur J Clin Nutr 52, 186–192. [DOI] [PubMed] [Google Scholar]
- 16. Brage S, Brage N, Ekelund U et al. (2006) Effect of combined movement and heart rate monitor placement on physical activity estimates during treadmill locomotion and free-living. Eur J Appl Physiol 96, 517–524. [DOI] [PubMed] [Google Scholar]
- 17. Pomeroy J, Brage S, Curtis J et al. (2011) Between-monitor differences in step counts are related to body size: implications for objective physical activity measurement. PloS One 27, e18942. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. World Health Organization (1995) Physical Status: The Use and Interpretation of Anthropometry. Report of a WHO Expert Committee. WHO Technical Report Series no. 854. Geneva: WHO. [PubMed] [Google Scholar]
- 19. Becker W & Pearson M (2002) Riksmaten 1997–98. Dietary habits and nutrient intake in Sweden 1997–98. The second national food consumption survey. Uppsala: Livsmedelsverket; (in Swedish). [Google Scholar]
- 20. Livsmedelsverket (1999) Weight Tables. Uppsala: Livsmedelsverkets repro; (in Swedish). [Google Scholar]
- 21. Johansson I, Hallmans G, Wikman A et al. (2002) Validation and calibration of food-frequency questionnaire measurements in the Northern Sweden Health and Disease cohort. Public Health Nutr 5, 487–496. [DOI] [PubMed] [Google Scholar]
- 22. Winkvist A, Hörnell A, Hallmans G et al. (2009) More distinct food intake patterns among women than men in northern Sweden: a population-based survey. Nutr J 8, 12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Johansson G, Wikman A, Ahrén AM et al. (2001) Underreporting of energy intake in repeated 24-hour recalls related to gender, age, weight status, day of interview, educational level, reported food intake, smoking habits and area of living. Public Health Nutr 4, 919–927. [DOI] [PubMed] [Google Scholar]
- 24. Bluck LJC (2008) Doubly labelled water for the measurement of total energy expenditure in man – progress and applications in the last decade. Nutr Bull 33, 80–90. [Google Scholar]
- 25. Livingstone MBE & Black AE (2003) Markers of the validity of reported energy intake. J Nutr 133, Suppl. 3, 895S–920S. [DOI] [PubMed] [Google Scholar]
- 26. Subar AF, Kipnis V, Troiano RP et al. (2003) Using intake biomarkers to evaluate the extent of dietary misreporting in a large sample of adults: the OPEN study. Am J Epidemiol 158, 1–13. [DOI] [PubMed] [Google Scholar]
- 27. Kroke A, Klipstein-Grobusch K, Voss S et al. (1999) Validation of a self-administered food-frequency questionnaire administered in the European Prospective Investigation into Cancer and Nutrition (EPIC) Study: comparison of energy, protein, and macronutrient intakes estimated with the doubly labeled water, urinary nitrogen, and repeated 24-h dietary recall methods. Am J Clin Nutr 70, 439–447. [DOI] [PubMed] [Google Scholar]
- 28. Lutomski JE, van den Broeck J, Harrington J et al. (2011) Sociodemographic, lifestyle, mental health and dietary factors associated with direction of misreporting of energy intake. Public Health Nutr 14, 532–541. [DOI] [PubMed] [Google Scholar]
- 29. Yannakoulia M, Panagiotakos DB, Pitsavos C et al. (2007) Low energy reporting related to lifestyle, clinical, and psychosocial factors in a randomly selected population sample of Greek adults: the ATTICA Study. J Am Coll Nutr 26, 327–333. [DOI] [PubMed] [Google Scholar]
- 30. Brantsaeter AL, Haugen M, Alexander J et al. (2008) Validity of a new food frequency questionnaire for pregnant women in the Norwegian Mother and Child Cohort Study (MoBa). Matern Child Nutr 4, 28–43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Butte NF & King JC (2005) Energy requirements during pregnancy and lactation. Public Health Nutr 8, 1010–1027. [DOI] [PubMed] [Google Scholar]
- 32. Subar AF, Ziegler RG, Thompson FE et al. (2001) Is shorter always better? Relative importance of questionnaire length and cognitive ease on response rates and data quality for two dietary questionnaires. Am J Epidemiol 153, 404–409. [DOI] [PubMed] [Google Scholar]
- 33. Krebs-Smith SM, Heimendinger J, Subar AF et al. (1994) Estimating fruit and vegetable intake using food frequency questionnaires: a comparison of instruments. Am J Clin Nutr 59, 283S. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
For supplementary material accompanying this paper visit https://doi.org/10.1017/ S1368980013003042.