Hossein Poustchi and colleagues1 reported SARS-CoV-2 antibody seroprevalence in the general population and high-risk occupational groups across 18 cities in Iran. However, there are several major concerns regarding their study design, analysis, and results.
First, although appendix 2 of the Article mentions cities as clusters, it is unclear how these clusters were selected. The inverse of the selection probability of individuals, which is a function of probability of cluster selection and unknown here, should be used as weights in the analyses.2
Second, the sample size calculation has errors. In the design effect formula, n is calculated as ∑m2 / ∑m = 1180·2 (where m is the cluster size)3 but not the number of clusters (n=18), as mentioned in appendix 2. Also, the intracluster correlation (δ) of 0·05 is too high for large clusters (such as those encountered in the study by Poustchi and colleagues), without any supporting references. Furthermore, it is unclear whether the seroprevalence (p) of 0·15 refers to the general population or high-risk groups, and again no references are given on the reported value.
Third, the bootstrap procedure described in appendix 2 mimics simple random sampling and does not consider clustering in the design, leading to too narrow confidence intervals (CIs). In fact, the appropriate bootstrapping procedure for cluster designs would draw the cluster units rather than individual units with replacement. Alternatively, one can use cluster-robust standard errors.4 The CIs are also narrow due to uncertainties in the sensitivity and specificity estimates. A Monte-Carlo bias analysis from an appropriate probability distribution of sensitivity and specificity can be used for overcoming this problem.5
Fourth, a seroprevalence of 72·6% for Rasht city seems to be an overestimate and inconsistent with the results of other studies, which reported estimates of about 23·7% for Rasht and 27·5% for Guilan province in April and mid-June, respectively.5, 6 This difference cannot be attributed to the different design and analysis of those studies. Moreover, a SARS-CoV-2 seropositive status seems to be durable (at least up to 8 months after infection)7 and can probably protect people from reinfection.8 The alarming (red) status of Rasht during the previous months9 is not consistent with Poustchi and colleagues' estimated seroprevalence, which is higher than the presumed threshold of COVID-19 herd immunity (50–67%).10
Finally, as seroepidemiological studies can affect decisions related to immunisation programmes and pandemic control measures, we believe that the results of Poustchi and colleagues' study should be more carefully interpreted, and we hope for studies with more robust design and analysis.
Acknowledgments
We declare no competing interests.
References
- 1.Poustchi H, Darvishian M, Mohammadi Z, et al. SARS-CoV-2 antibody seroprevalence in the general population and high-risk occupational groups across 18 cities in Iran: a population-based cross-sectional study. Lancet Infect Dis. 2020 doi: 10.1016/S1473-3099(20)30858-6. published online Dec 15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Mansournia MA, Altman DG. Inverse probability weighting. BMJ. 2016;352:i189. doi: 10.1136/bmj.i189. [DOI] [PubMed] [Google Scholar]
- 3.Armitage P, Berry G, Matthews JNS. 4th edn. John Wiley & Sons; New York, NY: 2001. Statistical methods in medical research; p. 656. [Google Scholar]
- 4.Mansournia MA, Nazemipour M, Naimi AI, Collins GS, Campbell MJ. Reflections on modern methods: demystifying robust standard errors for epidemiologists. Int J Epidemiol. 2020 doi: 10.1093/ije/dyaa260. published online Dec 22. [DOI] [PubMed] [Google Scholar]
- 5.Shakiba M, Nazemipour M, Salari A, et al. Seroprevalence of SARS-CoV-2 in Guilan province, Iran, April 2020. Emerg Infect Dis. 2020 doi: 10.3201/eid2702.201960. published online Dec 21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ghafari M, Kadivar A, Katzourakis A. Excess deaths associated with the Iranian COVID-19 epidemic: a province-level analysis. medRxiv. 2020 doi: 10.1101/2020.12.07.20245621. published online Dec 8. (preprint). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Choe PG, Kim K-H, Kang CK, et al. Antibody responses 8 months after asymptomatic or mild SARS-CoV-2 infection. Emerg Infect Dis. 2020 doi: 10.3201/eid2703.204543. published online Dec 22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lumley SF, O'Donnell D, Stoesser NE, et al. Antibody status and incidence of SARS-CoV-2 infection in health care workers. N Engl J Med. 2020 doi: 10.1056/nejmoa2034545. published online Dec 23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Islamic Republic News Agency The four cities of Gilan turned red and Rasht turned orange. Dec 7, 2020. https://bit.ly/2M5TKsm
- 10.Omer SB, Yildirim I, Forman HP. Herd immunity and implications for SARS-CoV-2 control. JAMA. 2020;324:2095–2096. doi: 10.1001/jama.2020.20892. [DOI] [PubMed] [Google Scholar]