Skip to main content
American Journal of Epidemiology logoLink to American Journal of Epidemiology
. 2009 Nov 18;170(12):1563–1570. doi: 10.1093/aje/kwp299

Validity of Adolescent Diet Recall 48 Years Later

Jorge E Chavarro *, Bernard A Rosner, Laura Sampson, Carol Willey, Paula Tocco, Walter C Willett, Wm Cameron Chumlea, Karin B Michels
PMCID: PMC2800269  PMID: 19923106

Abstract

Few studies have evaluated the validity of adolescent diet recall after many decades. Between 1943 and 1970, yearly diet records were completed by parents of adolescents participating in an ongoing US study. In 2005–2006, study participants who had been 13–18 years of age when the diet records were collected were asked to complete a food frequency questionnaire regarding their adolescent diet. Food frequency questionnaires and diet records were available for 72 participants. The authors calculated Spearman correlation coefficients between food, food group, and nutrient intakes from the diet records and food frequency questionnaire and deattenuated them to account for the effects of within-person variation measured in the diet records on the association. The median deattenuated correlation for foods was 0.30, ranging from −0.53 for a beef, pork, or lamb sandwich to 0.99 for diet soda. The median deattenuated correlation for food groups was 0.31 (range: −0.48 for breads to 0.70 for hot beverages); for nutrient intakes, it was 0.25 (range: −0.08 for iron to 0.82 for vitamin B12). Some dietary factors were reasonably recalled 3–6 decades later. However, this food frequency questionnaire did not validly measure overall adolescent diet when completed by middle-aged and older adults on average 48 years after adolescence.

Keywords: adolescent, diet, mental recall, nutrition assessment, questionnaires, validation studies


Adolescent diet may be an important determinant of adult disease risk. For example, mathematical (13) and animal (4) models of breast carcinogenesis, as well as specific events in mammary gland development and differentiation (57), suggest that the period between menarche and first full-term pregnancy is a susceptible time window in the pathogenesis of this malignancy. Ideally, hypotheses regarding adolescent diet and adult disease risk should be evaluated in prospective studies with thorough assessments of diet during adolescence. However, it will take decades for ongoing studies of this nature (8, 9) to accrue enough cases to evaluate these hypotheses. Furthermore, it may be necessary to expand some of these studies or pool data across studies to obtain sufficient statistical power to detect significant associations between dietary exposures during adolescence and possible endpoints.

Although not ideal, the use of retrospectively assessed dietary data from adults in large ongoing cohorts could provide more timely and less expensive answers. Using this strategy, some investigators have reported associations of specific dietary factors during adolescence, such as intake of soy foods, red meat, vegetable fat, and vitamin E, with risk of breast cancer (1013). The usefulness of this approach, however, hinges on the validity of dietary recall from the distant past.

We previously designed a food frequency questionnaire (FFQ), the high school FFQ, aimed at assessing diet during the high school years as recalled by middle-aged individuals and evaluated its validity in 2 ways. We compared the responses to the high school FFQ by middle-aged women with those provided by their mothers (14), and we also compared the responses to the high school FFQ by young adults with prospectively collected 24-hour recalls of their diet during adolescence, approximately 10 years earlier (15). Results from these studies suggest that the high school FFQ can adequately represent adolescent diet, but it remains unclear how diet recalls of middle-aged individuals using the high school FFQ compare with prospectively collected diet records and whether the apparently good validity of recall previously observed extends to longer recall times. Here, we evaluate the validity of the high school FFQ by comparing the responses of middle-aged and older adults to this questionnaire with diet records collected between the 1940s and 1970s as part of the Fels Longitudinal Study, an ongoing US study of growth, development, and aging.

MATERIALS AND METHODS

Study participants

Study subjects were active participants of the Fels Longitudinal Study. The Fels Study was established in 1929 and is the oldest ongoing study of growth, development, and aging in the world (16). Participant recruitment is still ongoing, mostly through recruitment of children born to active participants, and approximately 1,300 people are currently under active follow-up. Each participant is followed from enrollment (usually birth) until death, regardless of changes in health. Scheduled examinations are not performed when transient medical conditions that could affect data collection occur. At each visit, extensive age-appropriate growth, body composition, and other health-related data are collected. Since study inception, the data collection protocol has specified that participant visits occur at birth and at 3, 6, 9, and 12 months of age; then every 6 months at half-birthdays and birthdays until age 18 years; and every 2–5 years afterward.

The current study was approved by the institutional review boards of the Fels Research Institute (Yellow Springs, Ohio), Wright State University (Kettering, Ohio), and Brigham and Women's Hospital (Boston, Massachusetts).

Study design and dietary assessments

Between 1929 and 1970, parents of study participants completed one 7-day diet record every year from their child's birth until age 18 years. The diet records were distributed to participants’ parents at their regularly scheduled visits. Parents were instructed to keep a record of all foods eaten by their child during 7 consecutive days, including details of portion size, and to return the records after completion. The records were almost always completed by the mother. Diet records were not checked for completeness upon return. In a subsequent review of the records, it was found that 97% of the diet records were completed for all 7 days and were returned to the investigators (17).

In total, 477 study participants were 13–18 years of age when the diet records were collected between 1943 and 1970. Between September 2005 and January 2006, we contacted by mail all surviving participants who remained under active follow-up (n = 96) and asked them to complete the previously described 125-item high school FFQ (13). Seventy-six of them returned a completed high school FFQ. One or more diet records for the relevant time period were located for 72 of these participants; one diet record was available for 24 participants, 2 diet records were available for 15 participants, and 3 or more diet records were available for 33 participants.

The high school FFQ was developed to retrospectively assess diet during adolescence among members of an ongoing cohort study (13). It focuses on foods commonly consumed by adolescents in the United States during the target historical period. For the current validation study, participants were asked to report how often, on average, they had consumed a range of foods, specifying brand names for some food items, and to provide details about fats and oils used in food preparation at home while they were in high school, approximately between the ages of 13 and 18 years. For each food, 9 frequency categories were offered, ranging from never or less than once per month to 6 or more times per day. Portion sizes were provided for each food as “natural” units (e.g., 1 apple, 1 egg, 1 slice of bread) whenever possible and otherwise were based on the most common serving size reported on the 1977–1978 US Department of Agriculture Nationwide Food Consumption Survey (18), the earliest available, nationally representative data on portion sizes for individuals per eating occasion.

To estimate nutrient intakes from the FFQ, a nutrient database pertaining to the relevant time period was developed by a team of research dietitians (L. S., P. T., and C. W.) based on data from the US Department of Agriculture (1925) and was complemented as necessary by other published sources (2634). Nutrient intakes were calculated by summing the nutrient contributions of each food and nutrient supplement in the high school FFQ. To account for changes in food composition and fortification over time, the participants’ year of birth was used to assign different nutrient contents to specific foods. Because we were unable to find modern diet record analysis software that supported a nutrient database for the target historical period, diet records were analyzed by using the 1986 version of the CBORD Diet Analyzer System (The CBORD Group, Ithaca, New York). This package uses the 1986 version of the ESHA nutrient database (ESHA, Salem, Oregon), which is based on data from the US Department of Agriculture between 1975 and 1981 (24, 35).

Statistical analyses

Intakes of 4 food items included in the high school FFQ (diet soda without caffeine, seeds, Pop Tarts (Kellogg Company, Battle Creek, Michigan), alcoholic beverages) were not reported in any diet record, and an additional 5 food items (English muffins, tortillas, raw spinach, multivitamins, vitamin C supplements) were reported by too few people and therefore were not included in the analysis of food-specific validity of recall. Since food groups may be recalled better than individual food items (36, 37), we categorized all individual food items into 16 food groups. Nutrient intakes were log-transformed, adjusted for total energy intake by using the nutrient residual method (38) to account for extraneous variation in intakes, and subsequently back-transformed to the original scale for analysis. When more than one diet record was available for a participant, the average across all available diet records was considered the “gold standard” intake measure for the individual.

To evaluate validity of recall, we calculated Spearman correlation coefficients and their 95% confidence intervals (39) between food, food group, and nutrient intakes reported on the diet records and the corresponding intakes reported on the high school FFQ. We used an extension of the methods by Rosner and Glynn (39) and Perisic and Rosner (40) to correct Spearman rank correlation coefficients for measurement error in the presence of unbalanced data with a varying number of diet records (k) available for individual subjects. Specifically, for the subset of subjects for whom k weeks of diet record were available, we computed ranks for FFQ intake separately for each week of diet record intake and converted ranks to probit scores given by Hi = ϕ−1 [Ri/(nk + 1)], where Ri is the rank for the ith subject, nk is the number of subjects with k weeks of diet record, and ϕ−1 is the inverse normal (or probit) transformation. We then computed the Pearson correlation between the FFQ probit scores and the average of k diet record weekly probit scores (ρoh,k). Next, we corrected ρoh,k for measurement error using standard methods (41), thus obtaining ρth,k, and transformed ρth,k using Fisher's z transformation to obtain zth,k. We then computed a weighted average of zth,k, k = 1, 2, 3 using weights of nk − 3 and obtained an overall estimate of zth,average using the sib-mean estimator described by Perisic and Rosner (40). Next, we calculated a 95% confidence interval for zth,average using variance estimates from Rosner and Willett (41) and used the inverse Fisher z transform to obtain the corresponding 95% confidence interval for ρth,average = (ρth(1), ρth(2)). The corresponding 95% confidence interval for the deattenuated rank correlation coefficient is given by (ρts(1), ρts(2)), where ρts(q) = (6/π) sin−1th(q)/2), q = 1,2.

The rationale for the approach described above is that the relation between a rank and Pearson correlation coefficient for a normally distributed scale (such as the probit scale) is given by ρs = (6/π) sin−1 (ρ/2) (39). Furthermore, ranks are invariant in the probit and original scales. To obtain estimates of the intraclass correlation coefficient (ICC) for ranks of multiple weeks of diet record (ICCs), we computed the ICC for weekly diet record probit scores (ICCh) using random-effects analysis of variance and estimated ICCs by (6/π) sin−1(ICCh/2). ICCs can be interpreted as the correlation in ranks of intakes for a given dietary factor between any 2 random weeks over the 5-year period within the same subject.

RESULTS

High school FFQs were completed, on average, 48 years (range: 36–61 years) after diet records were collected. At the time of completion, the mean age of participants was 63 years (range: 49–76 years). Of the 72 respondents, 35 were female and 37 were male.

Figure 1 shows the distribution of the observed and deattenuated Spearman correlation coefficients between FFQ and diet record for individual food items. Correlations for each specific food item are presented in Web Table 1 (this supplementary table is posted on the Journal’s website (http://aje.oupjournals.org/)).

Figure 1.

Figure 1.

Distribution of A) observed and B) deattenuated Spearman correlation coefficients between food intakes assessed by diet record (1943–1970) and by food frequency questionnaire (2005–2006), United States. The values of the Spearman correlation coefficients for individual food items are presented in Web Table 1 (this supplementary table is posted on the Journal’s website (http://aje.oupjournals.org/)).

The median observed correlation was 0.15 and ranged from −0.32 for a beef, pork, or lamb sandwich to 0.73 for beef liver. We did not calculate deattenuated correlations for foods with an estimated ICC of less than 0. For the remaining 104 foods, as expected, correcting for the effects of random within-person variation improved the correlations overall. The median deattenuated correlation was 0.30, ranging from −0.53 to 0.99. Because the degree of correction depends on the ratio of within- to between-person variation, the degree of correction for foods with very high within-person variation (reflected in a low ICC) was large, leading to very high or very low deattenuated correlations. Furthermore, the wide confidence intervals for some of these foods suggested that the deattenuated estimate for foods with a low ICC was not informative. For example, the correlation for green peppers (ICC = 0.02) varied from 0.27 (95% confidence interval: 0.04, 0.47) to 0.91 (95% confidence interval: −1.00, 1.00). When foods with an ICC of less than 0.20 (i.e., when the within-person variation in intake was 4 times greater than the between-person variation) were excluded, the median deattenuated correlation remained 0.30, with a range of −0.53 for a beef, pork, or lamb sandwich to 0.93 for hot breakfast cereal.

We also categorized all individual food items into 16 food groups. The validity of recall for food groups closely resembled that for individual food items (Table 1). The median observed correlation was 0.19 and ranged from −0.13 for breads to 0.44 for hot beverages, and the median deattenuated correlation was 0.31 (range: −0.48 to 0.70).

Table 1.

Observed and Deattenuated Spearman Correlation Coefficients (r) and 95% Confidence Intervals Between Food Group Intakes Assessed by Diet Record (1943–1970) and Food Frequency Questionnaire (2005–2006), United States

Food Group Observed r 95% CI Deattenuated r 95% CI ICCa
Cold beveragesb 0.24 0.00, 0.44 0.38 −0.01, 0.67 0.35
Hot beveragesc 0.44 0.23, 0.61 0.70 −0.13, 0.96 0.33
Milk and dairy foodsd 0.22 −0.02, 0.43 0.25 −0.02, 0.48 0.56
Eggs 0.39 0.17, 0.57 0.51 0.19, 0.74 0.41
Poultrye 0.24 0.01, 0.45 0.39 0.00, 0.67 0.35
Red and processed meatsf 0.14 −0.10, 0.36 0.20 −0.13, 0.50 0.32
Fish and seafoodg 0.20 −0.03, 0.41 0.37 −0.12, 0.71 0.16
Breadsh −0.13 −0.35, 0.10 −0.48 −0.99, 0.96 0.21
Bakery productsi 0.16 −0.08, 0.38 0.20 −0.14, 0.49 0.39
Potatoesj 0.29 0.07, 0.49 0.54 −0.28, 0.91 0.37
Breakfast cerealk 0.30 0.07, 0.49 0.45 0.03, 0.73 0.51
Other starchesl 0.07 −0.16, 0.30 0.11 −0.20, 0.41 0.35
Fruits and fruit juicesm 0.18 −0.06, 0.39 0.39 −0.25, 0.80 0.15
Vegetablesn 0.07 −0.17, 0.30 0.10 −0.22, 0.39 0.36
Snacks and dessertso 0.09 −0.15, 0.31 0.12 −0.32, 0.51 0.21
Frozen dessertsp 0.12 −0.12, 0.34 0.20 −0.15, 0.50 0.32
Median 0.19 0.31 0.36

Abbreviations: CI, confidence interval; ICC, intraclass correlation coefficient.

a

Estimated by using the repeated 7-day diet records for each person between 13 and 18 years of age.

b

Diet soda, regular soda, soda without caffeine, diet soda without caffeine, iced tea.

c

Hot tea, coffee.

d

Milk, chocolate milk, instant breakfast drink, yogurt, cottage or ricotta cheese; cheese, cream cheese, butter, margarine.

e

Chicken or turkey main dish, chicken or turkey sandwich.

f

Bacon, hot dogs, other processed meats, hamburger, meat loaf, beef or lamb main dish, pork main dish, beef, pork or lamb sandwich, beef liver, chicken liver.

g

Canned tuna, dark-meat fish, breaded fish, other fish, shrimp/lobster/scallops.

h

White bread, dark bread, cornbread, biscuits/rolls, English muffins, tortillas.

i

Danish/sweet rolls, doughnuts, snack cakes, cake, cookies, brownies, pie, pancakes/waffles, muffins.

j

French fries, baked/boiled/mashed potatoes, potato salad, potato chips.

k

Cold breakfast cereal, hot breakfast cereal.

l

Pasta, pizza, rice.

m

Raisins, grapes, bananas, apples, applesauce, cantaloupe/melons, pears, orange/grapefruit, strawberries, peaches/plums/apricots, pineapple, orange juice, apple juice, other fruit juice.

n

Tomatoes, tomato sauce, string beans, beans/lentils, broccoli, cauliflower, corn, peas/lima beans, mixed vegetables, cooked spinach, mustard/kale/greens, green peppers, eggplant/zucchini/squash, yams/sweet potatoes, cooked carrots, raw carrots, celery, radish, lettuce, cabbage, onions (garnish), onions (rings or soup), raw spinach.

o

Corn chips, popcorn, pretzels, peanuts, other nuts, graham crackers, crackers; chocolate bar, other candy bar, candy without chocolate, seeds, Pop Tarts (Kellogg Company, Battle Creek, Michigan).

p

Sherbet, ice cream, milk shake, Popsicles (Good Humor-Breyers Ice Cream Company, Green Bay, Wisconsin).

Correlations for nutrients intakes derived from diet records and the FFQ were slightly weaker than those for individual foods and food groupings (Table 2). The median observed correlation coefficient was 0.17, with a range of 0.03 for carbohydrates to 0.35 for cholesterol. Calorie adjustment did not change the overall results. The median calorie-adjusted correlation was also 0.17 (range: −0.05 to 0.45). Deattenuation of the calorie-adjusted correlations improved the correlation between diet-record and FFQ-estimated nutrient intakes. The median deattenuated correlation was 0.25 and ranged from −0.08 for iron to 0.82 for vitamin B12. When we excluded saturated fat (the only nutrient with an ICC below 0.20) and vitamin B12 (whose confidence interval suggested that the estimate was uninformative) from the analyses, the median deattenuated correlation remained unchanged.

Table 2.

Observed and Deattenuated Spearman Correlation Coefficients (r) and 95% Confidence Intervals Between Nutrient Intakesa Assessed by Diet Record (1943–1970) and Food Frequency Questionnaire (2005–2006), United States

Nutrient Observed r 95% CI Energy-adjusted r 95% CI Deattenuated Energy-adjusted r 95% CI ICCb
Calories 0.13 −0.09, 0.34
Protein 0.20 −0.03, 0.40 0.19 −0.05, 0.40 0.28 −0.07, 0.57 0.38
Total fat 0.17 −0.05, 0.38 0.10 −0.13, 0.33 0.15 −0.25, 0.51 0.21
Carbohydrates 0.03 −0.19, 0.25 0.10 −0.13, 0.33 0.17 −0.19, 0.48 0.28
Fiber 0.06 −0.17, 0.28 0.11 −0.13, 0.33 0.17 −0.17, 0.48 0.30
Saturated fat 0.20 −0.03, 0.40 0.19 −0.04, 0.40 0.47 −0.38, 0.89 0.10
Monounsaturated fat 0.15 −0.07, 0.36 0.19 −0.05, 0.40 0.29 −0.06, 0.58 0.32
Polyunsaturated fat 0.16 −0.06, 0.37 0.11 −0.12, 0.34 0.18 −0.16, 0.48 0.34
Cholesterol 0.35 0.13, 0.53 0.45 0.24, 0.62 0.70 0.00, 0.94 0.33
Vitamin A 0.17 −0.05, 0.38 0.17 −0.06, 0.39 0.25 −0.07, 0.52 0.43
Vitamin B1 0.03 −0.20, 0.25 0.22 −0.02, 0.43 0.35 −0.09, 0.67 0.20
Vitamin B2 0.29 0.07, 0.48 0.17 −0.07, 0.38 0.25 −0.07, 0.52 0.44
Niacin 0.05 −0.18, 0.27 0.04 −0.20, 0.27 0.03 −0.26, 0.32 0.39
Vitamin B6 0.07 −0.15, 0.29 0.13 −0.10, 0.35 0.17 −0.19, 0.48 0.28
Folate 0.25 0.03, 0.45 0.31 0.08, 0.51 0.50 0.01, 0.80 0.34
Vitamin B12 0.31 0.10, 0.50 0.35 0.13, 0.54 0.82 −1.00, 1.00 0.23
Vitamin C 0.22 −0.01, 0.42 0.30 0.07, 0.49 0.30 0.08, 0.56 0.56
Vitamin E 0.13 −0.10, 0.34 0.08 −0.16, 0.30 0.15 −0.19, 0.45 0.34
Calcium 0.29 0.07, 0.48 0.22 −0.01, 0.43 0.31 −0.01, 0.58 0.44
Iron 0.05 −0.18, 0.27 −0.05 −0.28, 0.18 −0.08 −0.39, 0.24 0.31
Median 0.17 0.17 0.25 0.33

Abbreviations: CI, confidence interval; ICC, intraclass correlation coefficient.

a

Nutrient intakes include contributions from foods, food fortification, and nutrient supplements.

b

Estimated by using the repeated 7-day diet records for each person between 13 and 18 years of age.

DISCUSSION

The availability of stored diet records from the Fels Longitudinal Study provided us with the unique opportunity to evaluate the validity of adolescent diet recall 48 years later. Some dietary factors, such as folate, vitamin C, and important contributors to intake of trans fatty acids (margarine and French fries), were reasonably recalled, with deattenuated correlations within the range reported in previous validation studies of widely used FFQs measuring current diet (4247). However, the high school FFQ did not validly assess overall adolescent diet when completed, on average, 48 years after adolescence by free-living, middle-aged and older adults. Our results suggest that it may not be useful to retrospectively assess diet in epidemiologic studies when the recall time is as long as that in this study.

FFQs measure current diet in adults (4447), and past diet when the recall time is relatively short, with adequate validity (48). In general, the validity of recall decreases as the recall time becomes longer, with average correlations between FFQs and original records of diet between 0.50 and 0.75 for recall times up to 10 years and between 0.35 and 0.55 for recall times of 10–15 years (4855) (reviewed by Friedenreich et al. (55)). Longer recall times or recall of diet during adolescence could be of interest in epidemiologic studies of middle-aged and older adults, but few studies have assessed the validity of recalled adolescent diet, mainly because of the unavailability of original records of diet many decades in the past.

To date, we know of only one study that has evaluated whether diet during adolescence can be validly recalled after several decades. Dwyer et al. (36, 56) asked middle-aged individuals to complete a 46-item FFQ to recall, after 32 years, their diet at age 18 years, and they compared the recalled food intakes with those recorded in prospectively collected diet records. The median Pearson correlation between diet-record and FFQ-reported food intakes was 0.12 and was better for food groups (median r = 0.22) than for individual foods (36, 56). These authors’ study design closely parallels that of the current study, with some differences. First, in Dwyer et al.’s study (36, 56), the subjects themselves provided the original record of adolescent diet; in the current study, the subjects’ mothers completed the original record of diet. Second, in Dwyer et al.’s study (36, 56), the recall period was different (age 18 years) than in our study (ages 13–18 years), and our questionnaire included nearly 3 times as many food items. Third, the average recall time was 16 years longer in our study. Despite these differences, the median observed correlations for recalled food and food group intakes, as well as the correlations for many specific foods and food groupings, are similar. Taken together, the data from these 2 studies suggest acceptable validity of recall for some selected foods and food groups but poor ability to recall overall diet after several decades.

We previously evaluated the validity of the high school FFQ in 2 settings. In one study (15), we asked a group of young adults (aged 23–29 years) to recall their diet during adolescence by using the high school FFQ, and we compared their responses with 3 prospectively collected 24-hour recalls completed 10 years earlier. The mean correlation for nutrient intakes between the three 24-hour recalls and the high school FFQ was 0.45 (range: 0.16–0.68) (15). In a separate study (14), we compared food and nutrient intakes derived from the responses to the high school FFQ by adult women (aged 34–53 years; recall time: 15–35 years) with the responses to the high school FFQ provided by their mothers 4 years later. The mean daughter-mother correlations for nutrient intakes were 0.40 (range: 0.13–0.59). The correlations between prospectively collected diet records and recalled adolescent diet using the high school FFQ in the present study (ages 50–76 years; recall: 36–61 years) were lower, and their range was wider than those in our previous evaluations. Taken together, these studies suggest that the high school FFQ provides a reasonable measure of adolescent diet for adults in their twenties, thirties, and forties when recall time does not exceed 35 years but is of limited use when people completing the questionnaire are older or recall time is substantially longer. Therefore, hypotheses regarding the role of adolescent diet on risk of adult onset of disease should be evaluated in studies with prospective assessments of adolescent diet or, if recall is necessary, studies of adults with the minimum possible recall time.

Some limitations of our study could have attenuated the correlations between diet records and the high school FFQ. First, diet records were completed by the mothers of the study participants rather than the participants themselves. This approach may have introduced some error regarding foods consumed away from home (which can contribute considerably to total energy intake in adolescents) and foods or beverages with negative social connotations. In an extreme example, alcohol intake was not reported in any of the 154 diet records analyzed, but 18% of participants reported in their FFQs that they consumed one or more alcoholic beverages per week between 13 and 18 years of age. Whether alcohol intake was unknown to mothers or was unreported because of other circumstances is unknown. Whether similar situations arose with other food items is also unknown but could also have attenuated our estimates of validity of recall.

Second, the nutrient databases used to analyze the high school FFQ and the diet records did not completely represent the same historical time period and included only a limited number of nutrients. Although a specific nutrient database was designed for the high school FFQ, which allowed for changes in food composition and micronutrient fortification over time, the diet record nutrient database may not have reflected the true nutrient composition of the target historical period since it did not allow for changes in food composition over time. This limitation in the diet record nutrient database may have added some error to estimation of diet record nutrient intake, leading to attenuation of the correlation coefficients, as suggested by the lower correlations observed for nutrients overall when compared with the correlations observed for foods and food groupings. An additional limitation was our small sample size. This problem precluded us from performing stratified analyses by recall time, gender, or age. In addition, the small sample size resulted in very broad confidence intervals, often including zero, for several foods and nutrients.

Strengths of our study include availability of prospectively collected diet records, which has proved to be the main limitation to adequately evaluating the validity of FFQs during early periods of life. In addition, multiple diet records were collected during the period of interest, which allowed estimation of within-person variability of diet during adolescence and deattenuation of the correlation coefficients.

In summary, our results suggest that the validity of recall of a few foods and nutrients is reasonable and may allow evaluation of hypotheses focused on these dietary factors. However, the high school FFQ does not validly measure overall adolescent diet when completed by middle-aged and older adults on average 48 years after adolescence. Since our previous evaluations of this questionnaire suggest that it can validly represent overall adolescent diet when completed by adults in their twenties, thirties, and forties, investigators interested in evaluating the role of adolescent diet in adult disease risk should assess adolescent diet retrospectively only if recall time is not excessive.

Acknowledgments

Author affiliations: Channing Laboratory, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts (Jorge E. Chavarro, Karin B. Michels, Bernard A. Rosner, Walter C. Willett); Obstetrics and Gynecology Epidemiology Center, Department of Obstetrics, Gynecology and Reproductive Biology, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts (Karin B. Michels); Department of Nutrition, Harvard School of Public Health, Boston, Massachusetts (Laura Sampson, Carol Willey, Paula Tocco, Walter C. Willett); Department of Epidemiology, Harvard School of Public Health, Boston, Massachusetts (Walter C. Willett, Karin B. Michels); Department of Biostatistics, Harvard School of Public Health, Boston, Massachusetts (Bernard A. Rosner); and Lifespan Health Research Center, Department of Community Health, Boonshoft School of Medicine, Wright State University, Kettering, Ohio (Wm. Cameron Chumlea).

This work was supported by grants R03 CA115235 (K. M.), T32 DK007703 (W. W.), and R01 HD12252 (W. C.) and the Yerby Postdoctoral Fellowship Program (J. C.).

The authors thank Dr. Sheherazadh Ishaq for her assistance with data collection and management and Rong Chen for her assistance with statistical programming.

Preliminary findings of this study were presented at the 42nd Annual Meeting of the Society for Epidemiologic Research, Anaheim, California, June 23–26, 2009.

Conflict of interest: none declared.

Glossary

Abbreviations

FFQ

food frequency questionnaire

ICC

intraclass correlation coefficient

References

  • 1.Pike MC, Krailo MD, Henderson BE, et al. ‘Hormonal’ risk factors, ‘breast tissue age’ and the age-incidence of breast cancer. Nature. 1983;303(5920):767–770. doi: 10.1038/303767a0. [DOI] [PubMed] [Google Scholar]
  • 2.Rosner B, Colditz GA, Willett WC. Reproductive risk factors in a prospective study of breast cancer: the Nurses’ Health Study. Am J Epidemiol. 1994;139(8):819–835. doi: 10.1093/oxfordjournals.aje.a117079. [DOI] [PubMed] [Google Scholar]
  • 3.Rosner B, Colditz G. Nurses’ Health Study: log-incidence mathematical model of breast cancer incidence. J Natl Cancer Inst. 1996;88(6):359–364. doi: 10.1093/jnci/88.6.359. [DOI] [PubMed] [Google Scholar]
  • 4.Wolff MS, Collman GW, Barrett JC, et al. Breast cancer and environmental risk factors: epidemiological and experimental findings. Annu Rev Pharmacol Toxicol. 1996;36(1):573–596. doi: 10.1146/annurev.pa.36.040196.003041. [DOI] [PubMed] [Google Scholar]
  • 5.Russo J, Moral R, Balogh GA, et al. The protective role of pregnancy in breast cancer. Breast Cancer Res. 2005;7(3):131–142. doi: 10.1186/bcr1029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Russo J, Lynch H, Russo IH. Mammary gland architecture as a determining factor in the susceptibility of the human breast to cancer. Breast J. 2001;7(5):278–291. doi: 10.1046/j.1524-4741.2001.21033.x. [DOI] [PubMed] [Google Scholar]
  • 7.Russo J, Balogh GA, Russo IH. Full-term pregnancy induces a specific genomic signature in the human breast. Cancer Epidemiol Biomarkers Prev. 2008;17(1):51–66. doi: 10.1158/1055-9965.EPI-07-0678. [DOI] [PubMed] [Google Scholar]
  • 8.Rockett HR, Colditz GA. Assessing diets of children and adolescents. Am J Clin Nutr. 1997;65(suppl):1116s–122s. doi: 10.1093/ajcn/65.4.1116S. [DOI] [PubMed] [Google Scholar]
  • 9.Golding J. Children of the nineties. A longitudinal study of pregnancy and childhood based on the population of Avon (ALSPAC) West Engl Med J. 1990;105(3):80–82. [PMC free article] [PubMed] [Google Scholar]
  • 10.Wu AH, Wan P, Hankin J, et al. Adolescent and adult soy intake and risk of breast cancer in Asian-Americans. Carcinogenesis. 2002;23(9):1491–1496. doi: 10.1093/carcin/23.9.1491. [DOI] [PubMed] [Google Scholar]
  • 11.Linos E, Willett WC, Cho E, et al. Red meat consumption during adolescence among premenopausal women and risk of breast cancer. Cancer Epidemiol Biomarkers Prev. 2008;17(8):2146–2151. doi: 10.1158/1055-9965.EPI-08-0037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Frazier AL, Ryan CT, Rockett H, et al. Adolescent diet and risk of breast cancer. Breast Cancer Res. 2003;5(3):R59–R64. doi: 10.1186/bcr583. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Frazier AL, Li L, Cho E, et al. Adolescent diet and risk of breast cancer. Cancer Causes Control. 2004;15(1):78–82. doi: 10.1023/B:CACO.0000016617.57120.df. [DOI] [PubMed] [Google Scholar]
  • 14.Maruti SS, Feskanich D, Colditz GA, et al. Adult recall of adolescent diet: reproducibility and comparison with maternal diet. Am J Epidemiol. 2005;161(1):89–97. doi: 10.1093/aje/kwi019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Maruti SS, Feskanich D, Rockett HR, et al. Validation of adolescent diet recalled by adults. Epidemiology. 2006;17(2):226–229. doi: 10.1097/01.ede.0000198181.86685.49. [DOI] [PubMed] [Google Scholar]
  • 16.Roche AF. Growth, Maturation and Body Composition: The Fels Longitudinal Study 1929–1991. Cambridge, United Kingdom: Cambridge University Press; 1992. [Google Scholar]
  • 17.Chumlea WC, Guo SS. CERIN Symposium: Nutrition and personnes âgées au-delà des apports recommandés. Paris, France: Centre de Recherche et d'Information Nutritionnelles; 1997. Milk consumption in childhood and bone mineral density in adulthood: The Fels Longitudinal Study; pp. 125–134. [Google Scholar]
  • 18.Pao EM, Mickle SJ. Burk MC. One-day and 3-day nutrient intakes by individuals—Nationwide Food Consumption Survey findings, spring 1977. J Am Diet Assoc. 1985;85(3):313–324. [PubMed] [Google Scholar]
  • 19.US Department of Agriculture. Composition of Foods: Agricultural Handbook 8. Washington, DC: Government Printing Office; 1950. [Google Scholar]
  • 20.US Department of Agriculture. Composition of Foods: Agricultural Handbook 8. Washington, DC: Government Printing Office; 1963. [Google Scholar]
  • 21.US Department of Agriculture. Nutritive Value of Foods. Washington, DC: US Government Printing Office; 1964. (Home and garden bulletin no. 72) [Google Scholar]
  • 22.US Department of Agriculture. Nutritive Value of Foods. Washington, DC: US Government Printing Office; 1970. (Home and garden bulletin no. 72) [Google Scholar]
  • 23.US Department of Agriculture. Nutritive Value of Foods. Washington, DC: US Government Printing Office; 1971. (Home and garden bulletin no. 72) [Google Scholar]
  • 24.Adams CF. Nutritive Value of American Foods. Washington, DC: US Department of Agriculture; 1975. (Handbook no. 456) [Google Scholar]
  • 25.US Department of Agriculture. Nutritive Value of Foods. Washington, DC: US Government Printing Office; 1978. (Home and garden bulletin no. 72) [Google Scholar]
  • 26.Rice EE, Weiss TJ, Mattil KF. Composition of modern margarines. J Am Diet Assoc. 1962;41(4):319–322. [PubMed] [Google Scholar]
  • 27.Bowes A, Church CF, Church HN. Food Values of Portions Commonly Used. 9th ed. Philadelphia, PA: Lippincott; 1963. [Google Scholar]
  • 28.Physicians’ Desk Reference. 21st ed. Oradell, NJ: Medical Economics, Inc; 1966. [Google Scholar]
  • 29.Bowes A, Church CF, Church HN. Food Values of Portions Commonly Used. 10th ed. Philadelphia, PA: Lippincott; 1966. [Google Scholar]
  • 30.Kudelko NM. Composition of commercial oleomargarines. Ann Allergy. 1969;27(12):622–623. [PubMed] [Google Scholar]
  • 31.Bowes A, Church CF, Church HN. Food Values of Portions Commonly Used. 11th ed. Philadelphia, PA: Lippincott; 1970. [Google Scholar]
  • 32.Bowes A, Church CF, Church HN. Food Values of Portions Commonly Used. 12th ed. Philadelphia, PA: Lippincott; 1975. [Google Scholar]
  • 33.Physicians’ Desk Reference. 32nd ed. Oradell, NJ: Medical Economics, Inc; 1978. [Google Scholar]
  • 34.Bowes A, Church HN, Pennington JAT. Bowes’ and Church's Food Values of Portions Commonly Used. 13th ed. Philadelphia, PA: Lippincott; 1980. [Google Scholar]
  • 35.US Department of Agriculture. Nutritive Value of Foods. Washington, DC: US Government Printing Office; 1981. (Home and garden bulletin no. 72) [Google Scholar]
  • 36.Dwyer JT, Gardner J, Halvorsen K, et al. Memory of food intake in the distant past. Am J Epidemiol. 1989;130(5):1033–1046. doi: 10.1093/oxfordjournals.aje.a115404. [DOI] [PubMed] [Google Scholar]
  • 37.Chavarro JE, Michels KB, Ishaq S, et al. Validity of maternal recall of preschool diet after 43 years. Am J Epidemiol. 2009;169(9):1148–1157. doi: 10.1093/aje/kwp012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Willett WC, Stampfer MJ. Total energy intake: implications for epidemiologic analyses. Am J Epidemiol. 1986;124(1):17–27. doi: 10.1093/oxfordjournals.aje.a114366. [DOI] [PubMed] [Google Scholar]
  • 39.Rosner B, Glynn RJ. Interval estimation for rank correlation coefficients based on the probit transformation with extension to measurement error correction of correlated ranked data. Stat Med. 2007;26(3):633–646. doi: 10.1002/sim.2547. [DOI] [PubMed] [Google Scholar]
  • 40.Perisic I, Rosner B. Comparisons of measures of interclass correlations: the general case of unequal group size. Stat Med. 1999;18(12):1451–1466. doi: 10.1002/(sici)1097-0258(19990630)18:12<1451::aid-sim142>3.0.co;2-k. [DOI] [PubMed] [Google Scholar]
  • 41.Rosner B, Willett WC. Interval estimates for correlation coefficients corrected for within-person variation: implications for study design and hypothesis testing. Am J Epidemiol. 1988;127(2):377–386. doi: 10.1093/oxfordjournals.aje.a114811. [DOI] [PubMed] [Google Scholar]
  • 42.Block G, Woods M, Potosky A, et al. Validation of a self-administered diet history questionnaire using multiple diet records. J Clin Epidemiol. 1990;43(12):1327–1335. doi: 10.1016/0895-4356(90)90099-b. [DOI] [PubMed] [Google Scholar]
  • 43.Block G, Thompson FE, Hartman AM, et al. Comparison of two dietary questionnaires validated against multiple dietary records collected during a 1-year period. J Am Diet Assoc. 1992;92(6):686–693. [PubMed] [Google Scholar]
  • 44.Willett WC, Sampson L, Stampfer MJ, et al. Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol. 1985;122(1):51–65. doi: 10.1093/oxfordjournals.aje.a114086. [DOI] [PubMed] [Google Scholar]
  • 45.Salvini S, Hunter DJ, Sampson L, et al. Food-based validation of a dietary questionnaire: the effects of week-to-week variation in food consumption. Int J Epidemiol. 1989;18(4):858–867. doi: 10.1093/ije/18.4.858. [DOI] [PubMed] [Google Scholar]
  • 46.Rimm EB, Giovannucci EL, Stampfer MJ, et al. Reproducibility and validity of a expanded self-administered semiquantitative food frequency questionnaire among male health professionals. Am J Epidemiol. 1992;135(10):1114–1126. doi: 10.1093/oxfordjournals.aje.a116211. [DOI] [PubMed] [Google Scholar]
  • 47.Feskanich D, Rimm EB, Giovannucci EL, et al. Reproducibility and validity of food intake measurements from a semiquantitative food frequency questionnaire. J Am Diet Assoc. 1993;93(7):790–796. doi: 10.1016/0002-8223(93)91754-e. [DOI] [PubMed] [Google Scholar]
  • 48.Willett WC, Sampson L, Browne ML, et al. The use of a self-administered questionnaire to assess diet four years in the past. Am J Epidemiol. 1988;127(1):188–199. doi: 10.1093/oxfordjournals.aje.a114780. [DOI] [PubMed] [Google Scholar]
  • 49.Lindsted KD, Kuzma JW. Reliability of eight-year diet recall in cancer cases and controls. Epidemiology. 1990;1(5):392–401. doi: 10.1097/00001648-199009000-00010. [DOI] [PubMed] [Google Scholar]
  • 50.Lindsted KD, Kuzma JW. Long-term (24-year) recall reliability in cancer cases and controls using a 21-item food frequency questionnaire. Nutr Cancer. 1989;12(2):135–149. doi: 10.1080/01635588909514012. [DOI] [PubMed] [Google Scholar]
  • 51.Byers TE, Rosenthal RI, Marshall JR, et al. Dietary history from the distant past: a methodological study. Nutr Cancer. 1983;5(2):69–77. doi: 10.1080/01635588309513781. [DOI] [PubMed] [Google Scholar]
  • 52.Byers T, Marshall J, Anthony E, et al. The reliability of dietary history from the distant past. Am J Epidemiol. 1987;125(6):999–1011. doi: 10.1093/oxfordjournals.aje.a114638. [DOI] [PubMed] [Google Scholar]
  • 53.Sobell J, Block G, Koslowe P, et al. Validation of a retrospective questionnaire assessing diet 10–15 years ago. Am J Epidemiol. 1989;130(1):173–187. doi: 10.1093/oxfordjournals.aje.a115310. [DOI] [PubMed] [Google Scholar]
  • 54.Wu ML, Whittemore AS, Jung DL. Errors in reported dietary intakes. II. Long-term recall. Am J Epidemiol. 1988;128(5):1137–1145. doi: 10.1093/oxfordjournals.aje.a115056. [DOI] [PubMed] [Google Scholar]
  • 55.Friedenreich CM, Slimani N, Riboli E. Measurement of past diet: review of previous and proposed methods. Epidemiol Rev. 1992;14:177–196. doi: 10.1093/oxfordjournals.epirev.a036086. [DOI] [PubMed] [Google Scholar]
  • 56.Dwyer JT, Coleman KA. Insights into dietary recall from a longitudinal study: accuracy over four decades. Am J Clin Nutr. 1997;65(4 suppl):1153S–1158S. doi: 10.1093/ajcn/65.4.1153S. [DOI] [PubMed] [Google Scholar]

Articles from American Journal of Epidemiology are provided here courtesy of Oxford University Press

RESOURCES