Dear Editors,
The report Puppyhood diet as a factor in the development of owner‐reported allergy/atopy skin signs in adult dogs in Finland, which appeared in the September/October issue of the Journal of Veterinary Internal Medicine (JVIM), suggests that “puppyhood exposure to raw animal‐based foods,” “human meal leftovers” and other “real foods” might have a protective influence against canine atopic dermatitis (CAD) while “heat‐processed foods” might increase later occurrence of CAD. We are concerned that the results of this study likely represent residual bias in data collection and analysis rather than the actual influence of specific dietary components on the risk of CAD.
Common recognized sources of bias in research studies include a priori beliefs on the part of researchers, recall and selection bias in survey respondents, 1 funding bias, 2 and a large number of researcher degrees of freedom in the design, conduct, and analysis of the study. 3 All of these are present in this study.
Dr. Hielm‐Björkman and the Dog Risk research group have expressed strong beliefs about the health benefits of raw diets and the dangers of conventional commercial pet foods in previous research reports and popular media. 4 , 5
The main source of data in this study is an online survey available only in Finnish. Previous publications regarding validation of this data source have identified low response rates to validation questions and important proportions of duplicate, automated, and discordant responses. 6 , 7 Asking owners to remember in detail what they fed their puppy between 2 and 8 months of age and then trying to associate that with health outcomes years later is, in our view, a questionable strategy. Self‐reporting of diet and health information are unreliable in humans, and we believe that it is unlikely to be more reliable among dog owners. 1 Dog owners consistently misperceive even straightforward measures such as body condition score despite formal training in this assessment, so their assessment of signs of CAD is, in our view, likely to be equally unreliable. 8 The survey responses are expressions of the perceptions and beliefs of the owners who participated, not necessarily the true nutritional and environmental exposures nor health outcomes experienced by the dogs.
Dr. Hielm‐Björkman has previously cited funding bias as a problem in the study of raw diets, stating that raw foods are “not really researched in universities. Most universities get sponsored by these big billion‐dollar companies, and you don't really want to step on their toes, I guess.” 5 In light of the recognized problem of funding bias it could be relevant that disclosed funding sources for this research include companies selling raw pet foods.
The authors also report accepting funding from Dr. Joseph Mercola. Dr. Mercola's organization advocates for raw pet diets and argues against conventional pet foods on its web site. 9 , 10 , 11 We believe that he is also a consistent promoter of unapproved medical practices and medical product claims, as evidenced by multiple warning letters from the Food and Drug Administration and a lawsuit by the Federal Trade Commission related to therapeutic claims that violate the U.S. Food, Drug, and Cosmetic Act. 12 , 13 , 14 , 15 , 16 Such an affiliation is at least as relevant to assessing potential bias as accepting funding from an organization with a commercial interest in raw or conventional pet foods. Bias in scientific research is as likely to arise from ideological as financial factors.
We believe that the results of the analysis and how they are reported also suggest the influence of bias. Many comparisons are listed only in supplemental materials, and those reported in the main article tend to be those which support the authors' hypotheses. This creates the appearance of consistency when, in fact, the associations identified are often inconsistent and do not logically support the claims in the conclusions. For example, why would raw tripe and organ meats be protective against CAD but raw red meat, eggs, and poultry not be? If cooking is the key risk factor, why would cook vegetables be protective and raw vegetables would not or why would both cooked and raw eggs be protective while neither cooked nor raw poultry is associated with the likelihood of CAD? If exposure to bacteria is the main variable, why is eating dirt, sticks or carcasses protective but eating clay and grass is not and drinking from puddles is actually associated with increased risk? If excessive processing is the issue, why was there no association with eating processed meats or canned foods and only a marginal association with dry food when it was the only food offered?
Dogs with CAD were reportedly more likely to be eating no raw food at all than controls, and dogs without CAD were more likely to be fed 20% or 90% raw, but there were no statistically significant differences at any other ratio of the 2 foods. Similarly, allergic dogs were more likely to be fed 80% dry than controls, but there was no significant difference in CAD risk if they were fed more than 80% dry. Control dogs were more likely to be fed 50% or less than 10% dry, but there was no difference at intermediate ratios. It is easier to see cherry picking and researcher degrees of freedom than a consistent dose‐response in these results.
While the authors do acknowledge the potential for recall bias and misclassification, and they do state that their findings cannot prove causal relationships, the overall message of the paper is that uncooked foods and human meal leftovers likely have health benefits, and this is inconsistent with the methodological limitations and potential for residual bias of this study.
Given the importance of CAD, in terms of both prevalence and the negative impacts on pet and owner quality of life, we agree that identification of protective factors is warranted. However, considering the significant risks of illnesses and death that have been consistently associated with the feeding of raw animal products, rigorous and well‐designed research methodology, objectivity, and full reporting of results are needed to explore if any benefits exist for this practice, and certainly are required before this practice can be confidently recommended.
CONFLICT OF INTEREST DECLARATION
Jennifer Larsen declares the following conflicts:
Investigator in clinical trials and other research partly or fully sponsored by Royal Canin, Nature's Variety Instinct, and Nestle Purina PetCare.
Develops educational materials for Mark Morris Institute and HealthyPet magazine.
Serves as advisory group consultant for Elanco Animal Health.
Participates in continuing education events, as a speaker & as an attendee, sponsored/organized by Royal Canin, Nestle Purina PetCare, Nature's Variety Instinct, and Hill's Pet Nutrition.
A resident of the Nutrition Service received funds through the Hill's Pet Nutrition Resident Clinical Study Grants program.
The Veterinary Medical Teaching Hospital at the University of California, Davis receives funds from Nestlé Purina PetCare to partially support a nutrition technician.
Brennen McKenzie declares no conflict of interest.
REFERENCES
- 1. Ravelli MN, Schoeller DA. Traditional self‐reported dietary instruments are prone to inaccuracies and new approaches are needed. Front Nutr. 2020;7:90. doi: 10.3389/fnut.2020.00090 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Resnik DB, Elliott KC. Taking financial relationships into account when assessing research. Account Res. 2013;20(3):184‐205. doi: 10.1080/08989621.2013.788383 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Simmons JP, Nelson LD, Simonsohn U. False‐positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci. 2011;22(11):1359‐1366. doi: 10.1177/0956797611417632 [DOI] [PubMed] [Google Scholar]
- 4. Fredriksson‐Ahomaa M, Heikkilä T, Pernu N, Kovanen S, Hielm‐Björkman A, Kivistö R. Raw meat‐based diets in dogs and cats. Vet Sci. 2017;4(4):33. doi: 10.3390/vetsci4030033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. R Habib, K Becker. The Dog Cancer Series: Rethinking the Cancer. Epidemic. Vol 1. Transcript; 2018:73 (Chapter 4). Planet Paws Media, LLC. Dartmouth, Nova Scotia, Canada.
- 6. Hemida M, Vuori KA, Salin S, Moore R, Anturaniemi J, Hielm‐Björkman A. Identification of modifiable pre‐ and postnatal dietary and environmental exposures associated with owner‐reported canine atopic dermatitis in Finland using a web‐based questionnaire. PLoS One. 2020;15(5):e0225675. doi: 10.1371/journal.pone.0225675 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Roine J, Uusitalo L, Hielm‐Björkman A. Validating and reliability testing the descriptive data and three different disease diagnoses of the internet‐based DOGRISK questionnaire. BMC Vet Res. 2016;12(1):30. doi: 10.1186/s12917-016-0658-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Eastland‐Jones RC, German AJ, Holden SL, Biourge V, Pickavance LC. Owner misperception of canine body condition persists despite use of a body condition score chart. J Nutr Sci. 2014;3:e45. doi: 10.1017/jns.2014.25 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Becker K. 4 Hidden Hazards of Dry Pet Food . https://healthypets.mercola.com/sites/healthypets/archive/2021/08/22/4‐hidden‐hazards‐of‐dry‐pet‐food.aspx. Accessed June 13, 2022.
- 10. Becker K. Still Buying Kibble? Please Heed this Safety Warning . https://healthypets.mercola.com/sites/healthypets/archive/2018/01/09/dry‐pet‐food‐health‐problems.aspx. Accessed June 13, 2022.
- 11. Becker K. Should You Heed Your Vet's Warnings About Raw Food? https://healthypets.mercola.com/sites/healthypets/archive/2020/09/26/feeding‐your‐pet‐raw‐food.aspx. Accessed June 13, 2022.
- 12. Walker SJ. U.S. Food and Drug Administration. Warning Letter Identifying Therapeutic Claims Violating the Federal Food, Drug, and Cosmetic Act. Ref. No. CL‐04‐HFS‐810‐134; February 16, 2005. https://web.archive.org/web/20160829201656/http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/EnforcementActivitiesbyFDA/CyberLetters/ucm059189.gov. Accessed June 13, 2022.
- 13. Mactire SJ. U.S. Food and Drug Administration. Warning Letter CHI‐7‐06 Identifying Therapeutic Claims Violating the Federal Food, Drug, and Cosmetic Act; September 21, 2006. https://web.archive.org/web/20140829062422/https://www.fda.gov/ICECI/EnforcementActions/WarningLetters/2005/ucm076069.htm. Accessed June 13, 2022.
- 14. Silverman S. U.S. Food and Drug Administration. Warning Letter Identifying Therapeutic Claims Violating the Federal Food, Drug, and Cosmetic Act; March 22, 2011. https://web.archive.org/web/20111208202236/http:/www.fda.gov/ICECI/EnforcementActions/WarningLetters/2011/ucm250701.htm. Accessed June 13, 2022.
- 15. Federal Trade Commission . FTC Providing Full Refunds to Mercola Brand Tanning System Purchasers ; February 7, 2017. https://www.ftc.gov/news‐events/news/press‐releases/2017/02/ftc‐providing‐full‐refunds‐mercola‐brand‐tanning‐system‐purchasers. Accessed June 13, 2022.
- 16. Correll WA. U.S. Food and Drug Administration. Warning Letter Identifying Therapeutic Claims Violating the Federal Food, Drug, and Cosmetic Act; February 18, 2021. https://www.fda.gov/inspections‐compliance‐enforcement‐and‐criminal‐investigations/warning‐letters/mercolacom‐llc‐607133‐02182021. Accessed June 13, 2022.
