We thank Dr. Levy for his insightful, helpful comments regarding this methodologic change with Behavioral Risk Factor Surveillance Survey weighting from post-stratification to raking. We are grateful for the opportunity to consider how it may have impacted our findings and their interpretation,1,2 and we agree even a minor adjustment to sampling and survey weights can result in differences in estimates, even for small effects. In this case, it may have had little impact on our primary conclusions, given that the shape of trend lines in screening mammography adherence and initiation were relatively stable over time and within-year trends were consistent across 2010 (before the changes) and 2012 (after the changes) (Appendix Figure 1 and Appendix Table 2 in the manuscript present these results in detail). Further, the pattern of mammography utilization found in our study is consistent with findings from other data sets, including Medicare data analyses.3 Thus, it seems unlikely that our findings would be simply attributed to minor changes in sampling weights applied in the Behavioral Risk Factor Surveillance Survey.
Nonetheless, we fully understand the importance of accurately representing the data. Future analyses with the Behavioral Risk Factor Surveillance Survey and similar population-based data sets should carefully account for evolving methodologic issues and complex sampling designs. We also acknowledge that limitations with surveillance data exist more generally and are also necessary to consider in interpreting population trends in health behaviors and outcomes, particularly as we monitor such a major policy impact such as the Affordable Care Act.
Footnotes
VKD is a paid expert witness for Bayer in current litigation. No other financial disclosures were reported by the authors of this letter.
Contributor Information
Soudabeh Fazeli Dehkordy, Department of Graduate Medical Education, St. John Providence Hospital, Southfield, Michigan.
Kelli S. Hall, Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, Atlanta, Georgia.
Allison L. Roach, Department of Statistics, University of Michigan, Ann Arbor, Michigan.
Edward D. Rothman, Department of Statistics, University of Michigan, Ann Arbor, Michigan.
Vanessa K. Dalton, Department of Obstetrics and Gynecology, University of Michigan School of Medicine, Ann Arbor, Michigan. University of Michigan Institute for Healthcare Policy and Innovation, Ann Arbor, Michigan.
Ruth C. Carlos, Department of Radiology, University of Michigan School of Medicine, Ann Arbor, Michigan. University of Michigan Institute for Healthcare Policy and Innovation, Ann Arbor, Michigan.
References
- 1.Pieranuzzi C, Town M, Garvin W, Shaw F, Balluz L. Methodologic changes in the Behavioral Risk Factor Surveillance System in 2011 and potential effects on prevalence estimates. MMWR Morb Mortal Wkly Rep. 2012;61(22):410–413. [PubMed] [Google Scholar]
- 2.Pennsylvania Health Statistics. [Accessed September 3, 2015];Changes in the BRFSS weighting methodology: an explanation of the effects of the introduction of raked weighting on BRFSS data in Pennsylvania. www.statistics.health.pa.gov/MyHealthStatistics/BehavioralStatistics/BehavioralRisksSub-State/Documents/BRFSS_Weighting_Methodology%282012%29.pdf. Published 2012.
- 3.Sharpe RE, Jr, Levin DC, Parker L, Rao VM. The effect of the controversial U.S. Preventive Services Task Force recommendations on the use of screening mammography. J Am Coll Radiol. 2013;10(1):21–24. doi: 10.1016/j.jacr.2012.07.008. http://dx.doi.org/10.1016/j.jacr.2012.07.008. [DOI] [PubMed] [Google Scholar]
