Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Jun 26;15(6):e0235460. doi: 10.1371/journal.pone.0235460

COVID-19 symptoms predictive of healthcare workers’ SARS-CoV-2 PCR results

Fan-Yun Lan 1,2, Robert Filler 1,3, Soni Mathew 3, Jane Buley 3, Eirini Iliaki 3,4, Lou Ann Bruno-Murtha 4, Rebecca Osgood 5,6, Costas A Christophi 1,7, Alejandro Fernandez-Montero 1,8, Stefanos N Kales 1,3,*
Editor: Muhammad Adrish9
PMCID: PMC7319316  PMID: 32589687

Abstract

Background

Coronavirus 2019 disease (COVID-19) is caused by the virus SARS-CoV-2, transmissible both person-to-person and from contaminated surfaces. Early COVID-19 detection among healthcare workers (HCWs) is crucial for protecting patients and the healthcare workforce. Because of limited testing capacity, symptom-based screening may prioritize testing and increase diagnostic accuracy.

Methods and findings

We performed a retrospective study of HCWs undergoing both COVID-19 telephonic symptom screening and nasopharyngeal SARS-CoV-2 assays during the period, March 9—April 15, 2020. HCWs with negative assays but progressive symptoms were re-tested for SARS-CoV-2. Among 592 HCWs tested, 83 (14%) had an initial positive SARS-CoV-2 assay. Fifty-nine of 61 HCWs (97%) who were asymptomatic or reported only sore throat/nasal congestion had negative SARS-CoV-2 assays (P = 0.006). HCWs reporting three or more symptoms had an increased multivariate-adjusted odds of having positive assays, 1.95 (95% CI: 1.10–3.64), which increased to 2.61 (95% CI: 1.50–4.45) for six or more symptoms. The multivariate-adjusted odds of a positive assay were also increased for HCWs reporting fever and a measured temperature ≥ 37.5°C (3.49 (95% CI: 1.95–6.21)), and those with myalgias (1.83 (95% CI: 1.04–3.23)). Anosmia/ageusia (i.e. loss of smell/loss of taste) was reported less frequently (16%) than other symptoms by HCWs with positive assays, but was associated with more than a seven-fold multivariate-adjusted odds of a positive test: OR = 7.21 (95% CI: 2.95–17.67). Of 509 HCWs with initial negative SARS-CoV-2 assays, nine had symptom progression and positive re-tests, yielding an estimated negative predictive value of 98.2% (95% CI: 96.8–99.0%) for the exclusion of clinically relevant COVID-19.

Conclusions

Symptom and temperature reports are useful screening tools for predicting SARS-CoV-2 assay results in HCWs. Anosmia/ageusia, fever, and myalgia were the strongest independent predictors of positive assays. The absence of symptoms or symptoms limited to nasal congestion/sore throat were associated with negative assays.

Introduction

Coronavirus 2019 disease (COVID-19) has become pandemic since being first reported in China [1]. COVID-19 can present along a clinical spectrum from asymptomatic, mild symptoms (e.g. cold-like) [24], influenza-like (e.g. fever, malaise and myalgia) to severe lower respiratory disease with dyspnea and pneumonia [35]. Evidence supports person-to-person transmission, including from asymptomatic patients [69]. Severe acute respiratory syndrome coronavirus-2’s (SARS-CoV-2) environmental persistence suggests transmission may also result from hand contact with contaminated surfaces [10] followed by facial self-contamination.

Healthcare workers (HCWs) potentially experience greater risks for emerging infectious diseases [1113] due to occupational exposure to sick patients and virus-contaminated surfaces [14]. Contagious HCWs may infect patients, co-workers and family members. Moreover, the removal of ill HCWs from duty can threaten essential healthcare staffing during an epidemic [15]. Therefore, infection prevention and quick, accurate diagnosis of potential COVID-19 in HCWs are crucial to maintaining hospital operations [16].

Testing HCWs with early/mild symptoms has been approved and prioritized [17,18]. Because they are more likely to be tested, characterization of HCWs’ presentations and viral assays provide valuable clinical and epidemiologic perspectives on COVID-19, to compare with hospitalized patients generally representing more severe cases [19]. There is no reference diagnostic test for COVID-19. Currently available tools are symptom reports and a reverse transcriptase polymerase chain reaction (RT-PCR) assay that detects SARS-CoV-2 RNA from naso-/oropharyngeal specimens [20], but whose test characteristics are not established at this time [21]. Because of limited testing capacities, and potential latency of up to 14 days in illness onset from exposure [22], HCW testing is largely restricted to persons reporting compatible symptoms [17,18]. Nonetheless, many HCWs and other first responders desire wider testing because of potential exposures, often without symptoms. Therefore, we investigated the presenting symptoms most predictive of positive/negative SARS-CoV-2 RT-PCR results among HCWs.

Methods

Study population and setting

Since March 9, 2020, the occupational health service of a Massachusetts community healthcare system has implemented a staff “hotline” system to maintain a viable/healthy workforce and operational continuity during the pandemic. Accordingly, the service was re-configured to perform telephonic triage of HCWs for COVID-19-related concerns; electronically document related clinical information; manage and communicate pandemic-related testing results; and oversee HCWs’ safe return to work.

Reasons for contacting the COVID-19 hotline have included: a) travel; b) potential contact with a COVID-19-positive/suspect person; and/or c) possible viral symptoms. A standard triage form (S1 File) was completed by occupational nursing and medical personnel based on contemporaneous telephonic interviews with each HCW. The form contains demographics, administrative information, potential exposure history, and eleven potential viral symptoms: fever (subjective, as well as highest measured temperature), cough (new or worse), shortness of breath (new or worse), myalgia, malaise, sore throat, nasal symptoms (including runny nose, sneezing, congestion, and sinus symptoms), gastrointestinal symptoms (including nausea, vomiting, and diarrhea), rash, anosmia/ageusia (i.e. loss of smell/loss of taste), and headache. Headache and anosmia/ageusia were added to a revised form after several HCW reports.

In accordance with expert guidelines [17,18], symptomatic HCWs were referred for SARS-CoV-2 testing (see below). Employees tested elsewhere forwarded their RT-PCR results to the occupational health service and were triaged via a telephonic visit. In this retrospective cohort study, we included all adult employees/personnel or contractors of the hospital who had undergone both COVID-19-related triage and a SARS-CoV-2 PCR assay between March 9 and April 15, 2020.

Specimen collection and testing

SARS-CoV-2 assays were performed at designated sites, where trained healthcare system staff collected nasopharyngeal swabs and transferred each specimen to a 3ml vial with viral transport media (VTM), Universal Transport Media (UTM) or saline. After collection, specimens were refrigerated at 2–8°C, unless transported immediately, and refrigerated at 2–8°C during transport. HCWs samples were sent to one of three laboratories (the Massachusetts Department of Public Health (MADPH), a commercial lab, or a tertiary hospital partner), whichever offered the fastest turnaround-time on the day of testing. All three laboratories used real-time, reverse-transcriptase–polymerase-chain-reaction (RT-PCR) diagnostic panels for the qualitative detection of nucleic acid from the 2019 SARS-CoV-2 (MADPH, CDC 2019-Novel RT-PCR; commercial laboratory, Roche Cobas SARS-CoV-2; and hospital partner, Abbott Real Time SARS-CoV-2). The limit of detection at the laboratories testing the majority of our samples was 100 copies of viral RNA/ml. Positive assay results represented detection of SARS-CoV2 RNA, while for negative results, the virus was not detected. In case of an invalid or indeterminate result, a repeat sample is requested.

Data collection

For operational needs, the occupational health service maintains data from the triage encounters, PCR results and clinical/work status on a secure “live” spreadsheet. The presence/absence of the eleven possible symptoms, travel, and exposure history in the spreadsheet entries were verified from triage forms by an occupational medicine physician for every HCW undergoing a RT-PCR assay. For body temperature, we recorded the highest value before testing as self-reported by each HCW. SARS-CoV-2 PCR assay results for HCWs tested outside of the healthcare system were verified and entered in the database.

Because there is no reference diagnostic test, we considered false negative SARS-CoV-2 assays as occurring when the initial test was negative, but symptoms had progressed/persisted at telephonic follow-up and a repeat assay was subsequently SARS-CoV-2 positive.

Human subjects

The Institutional Review Board of the healthcare system reviewed the study protocol, determined it to be exempt and waived informed consent based on the use of existing, HIPAA-deidentified data. Prior to statistical analyses, all data were deidentified and transferred to a spreadsheet without linkages to the “live” database.

Statistical analysis

Continuous characteristics were presented as means and standard deviations and compared between groups with the parametric t-test. Categorical variables were presented as counts and percentages and compared between groups using the chi-square test of independence with the Yates’ continuity correction or the Fisher’s exact test, as appropriate. No imputations were made for missing data.

Principal component analysis (PCA) was utilized to identify dominant symptoms (those contributing more than 5% variability to the identified principal component explaining most data variability). Logistic regression models were then fit to evaluate symptom association with the probability of having a positive SARS-CoV-2 assay, after age-, sex- and other symptom adjustment. Regression results are provided as odds ratios (ORs) and corresponding 95% confidence intervals (CIs). The Hosmer-Lemeshow goodness of fit test with 15 groups was also performed to check the model fit. Additionally, the C-statistic was calculated to assess each model’s predictive accuracy.

The clinical COVID-19 attack rate during the study period was calculated as: (the number of initial positive SARS-CoV-2 assays + the number of false negatives) divided by the system’s estimated total HCW population (n = 4600). COVID-19 complication rates were calculated as HCWs who required an emergency room visit or hospitalization before the end of the study period (April 15, 2020) and/or had intubation or death before the end of follow-up (April 20, 2020); divided by the number of total COVID-19-diagnosed HCWs.

Statistical analyses were conducted using the R software (version 3.6.3). All tests were two-sided and a P-value < 0.05 was considered statistically significant.

Results

Demographic and clinical characteristics

During the study period, we identified 592 unique HCWs who underwent triage and SARS-CoV-2 RT-PCR. Eighty-three (14.0%) had positive SARS-CoV-2 RT-PCR results on the initial assay. The cohort’s presentation at triage is summarized in Table 1. The average age was 43.6 ± 12.9 years old, with no significant difference between HCWs testing positive or negative (P = 0.84). The proportion of men with positive tests (27.7%) was non-significantly higher than among those with negative tests (20.0%) (P = 0.15).

Table 1. Symptom and body temperature distributions at time of triage among healthcare workers (HCWs) by SARS-CoV-2 test results.

Overall (N = 592) Positive (N = 83) Negative (N = 509) P value
Age 43.6 (12.9) 43.9 (12.7) 43.6 (12.9) 0.843
Female 467 (78.9%) 60 (72.3%) 407 (80.0%) 0.149
Fever 182 (30.7%) 46 (55.4%) 136 (26.7%) <0.001
Measured Temperature (°C) 37.68 (0.71) (n = 161) 37.95 (0.69) (n = 40) 37.60 (0.69) (n = 121) 0.006
Temperature ≥ 37.5°C 102 (63.4%) (102/161) 34 (85.0%) (34/40) 68 (56.2%) (68/121) 0.002
Cough 365 (61.7%) 59 (71.1%) 306 (60.1%) 0.074
Shortness of breath 111 (18.8%) 14 (16.9%) 97 (19.1%) 0.747
Myalgia 225 (38.0%) 47 (56.6%) 178 (35.0%) <0.001
Malaise 274 (46.3%) 47 (56.6%) 227 (44.6%) 0.055
Sore throat 320 (54.1%) 38 (45.8%) 282 (55.4%) 0.131
Nasal symptoms (runny, sneezing, congestion, sinus) 293 (49.5%) 29 (34.9%) 264 (51.9%) 0.006
Gastrointestinal symptoms (nausea/ vomiting/ diarrhea) 151 (25.5%) 20 (24.1%) 131 (25.7%) 0.856
Rash 10 (1.7%) 3 (3.6%) 7 (1.4%) 0.154a
Anosmia/Ageusia 27 (4.6%) 13 (15.7%) 14 (2.8%) <0.001
Headache 175 (29.6%) 34 (41.0%) 141 (27.7%) 0.020

Mean (SD) for age and body temperature, count (percentage) for all other variables.

a Based on Fisher’s exact test.

SARS-CoV-2 positive HCWs self-reported several symptoms more frequently than those with negative assays: fever (55% vs. 27%), myalgia (57% vs. 35%), headache (41% vs. 28%), and anosmia/ageusia (16% vs. 3%) (all P<0.05). Nasal symptoms (runny, sneezing, congestion, sinus) were more frequently associated with negative assays (52% vs. 35%) (P = 0.006) (Table 1, Fig 1).

Fig 1. Symptom distributions among HCWs with initial SARS-CoV-2 (the virus causing COVID-19) testing results.

Fig 1

The symptoms shaded in salmon-red are the symptoms more frequently seen with positive tests, and the symptoms shaded in blue-green are more frequently seen with negative tests. GI symptom denotes a gastrointestinal symptom (nausea/ vomiting/ diarrhea). Nasal symptom includes runny nose, sneezing, congestion, and sinus symptoms. No/mild symptom denotes no symptom or only sore throat and/or nasal symptoms. The asterisks above the bars denote different statistically significance levels when comparing HCWs with positive assays and HCWs with negative assays (*: P<0.05, **: P<0.01, ***: P<0.001).

Among HCWs reporting fever, 87% (40/46) of those testing SARS-CoV-2 positive and 89% (121/136) of those testing negative had measured their body temperature. The mean peak temperature reported was higher in HCWs with a positive assay (38.0 ± 0.7°C) compared to those with negative assays (37.6 ± 0.7°C) (P = 0.006). Dichotomizing the peak temperature (≥ or <37.5°C), the measured temperature exceeded the threshold in 85% of HCWs with positive RT-PCR, compared to 56% of those with negative assays (P = 0.002).

Symptoms and probabilities of positive SARS-CoV-2 assay

Assay results for asymptomatic or mildly symptomatic HCWs are shown in Table 2. None of the HCWs with only sore throat and/or nasal symptoms had a positive SARS-CoV-2 assay (0%), while all 34 (100%) had a negative PCR (P = 0.009). When we combined asymptomatic and mildly symptomatic HCWs, 59/61 (97%) had negative initial assays (P = 0.006).

Table 2. SARS-CoV-2 test results in asymptomatic healthcare workers (HCWs) and HCWs with only nasal/throat symptoms.

Positive (N = 83) Negative (N = 509) P value a
No symptom 2 (2.4%) 25 (4.9%) 0.406
Only sore throat 0 (0%) 12 (2.4%) 0.390
Only nasal symptoms 0 (0%) 7 (1.4%) 0.601
Only sore throat and/or nasal symptoms 0 (0%) 34 (6.7%) 0.009
No symptom or Only sore throat and/or nasal symptoms 2 (2.4%) 59 (11.6%) 0.006

a Fisher’s exact test

Total symptoms at triage ranged from zero to ten, with only 40 (7%) HCWs reporting seven or more symptoms. Table 3 shows the counts and percentages of HCWs with positive and negative assays, and age- and sex-adjusted odds ratios for increasing numbers of total reported symptoms. HCWs workers reporting three or more symptoms had an increased likelihood of a positive SARS-CoV-2 assay (OR = 1.95 (95% CI: 1.10–3.64). The odds ratio of a positive RT-PCR generally increased with additional symptoms and reached 2.61 (95% CI: 1.50–4.45) for six or more symptoms.

Table 3. SARS-CoV-2 test results by number of symptoms reported at triage a.

Positive (N = 83) Negative (N = 509) Age and sex adjusted OR (95% CI)
< 2 symptoms 7 (8.4%) 71 (13.9%) 0.57 (0.23–1.20)
≥ 2 symptoms 76 (91.6%) 438 (86.1%) 1.77 (0.83–4.36)
≥ 3 symptoms 68 (81.9%) 357 (70.1%) 1.95 (1.10–3.64)
≥ 4 symptoms 53 (63.9%) 238 (46.8%) 2.00 (1.24–3.28)
≥ 5 symptoms 35 (42.2%) 152 (29.9%) 1.72 (1.06–2.77)
≥ 6 symptoms 24 (28.9%) 69 (13.6%) 2.61 (1.50–4.45)

Abbreviations: OR, odds ratio; CI, confidence interval.

a The whole list of symptoms reported were fever, cough, shortness of breath, myalgia, malaise, sore throat, nasal symptoms (runny, sneezing, congestion, sinus), gastrointestinal symptoms (nausea/ vomiting/ diarrhea), rash, anosmia/ageusia (i.e. loss of smell/loss of taste), and headache.

Further multivariate logistic regression analyses of PCA-determined dominant symptoms are shown in Table 4. HCWs reporting fever had an age- and sex-adjusted odds ratio of 3.34 (95% CI: 2.07–5.41) of having a positive SARS-CoV-2 assay, which remained significant after additional adjustment for other symptoms (OR = 2.88, 95% CI: 1.66–5.01). When measured body temperature ≥37.5°C was considered together with reported fever, the odds of a positive SARS-CoV-2 assay increased to 4.47 (95% CI: 2.66–7.48) in the age- and sex-adjusted model and to 3.49 (95% CI: 1.95–6.21) in the all-symptom-adjusted model. The odds ratios remained similar when the body temperature threshold changed to 38°C (OR = 4.45, 95% CI: 2.30–8.44 in the age- and sex-adjusted model; OR = 2.85, 95% CI: 1.36–5.86 in the full model).

Table 4. Odds ratios of a positive SARS-CoV-2 assay by triage symptom.

Positive (N = 83) Negative (N = 509) Age and sex adjusted OR (95% CI) Area under ROC curve Multivariate Adjusted OR (95% CI) b
Fever 46 (55.4%) 136 (26.7%) 3.34 (2.07–5.41) 0.663 2.88 (1.66–5.01)
Fever plus temperature ≥ 37.5°C a 33 (39.8%) 65 (12.8%) 4.47 (2.66–7.48) 0.660 3.49 (1.95–6.21)c
Myalgia 47 (56.6%) 178 (35.0%) 2.41 (1.50–3.89) 0.625 1.83 (1.04–3.23)
Malaise 47 (56.6%) 227 (44.6%) 1.58 (0.99–2.55) 0.575 1.08 (0.60–1.92)
Shortness of breath 14 (16.9%) 97 (19.1%) 0.85 (0.44–1.54) 0.539 0.66 (0.32–1.28)
Nasal symptoms (runny, sneezing, congestion, sinus) 29 (34.9%) 264 (51.9%) 0.51 (0.31–0.82) 0.601 0.40 (0.23–0.68)
Gastrointestinal symptoms (nausea/ vomiting/ diarrhea) 20 (24.1%) 131 (25.7%) 0.91 (0.52–1.54) 0.538 0.54 (0.28–1.00)
Headache 34 (41.0%) 141 (27.7%) 1.84 (1.13–2.96) 0.572 1.43 (0.82–2.47)
Anosmia/ageusia 13 (15.7%) 14 (2.8%) 6.50 (2.89–14.51) 0.588 7.21 (2.95–17.67)

Abbreviations: OR, odds ratio; CI, confidence interval; ROC curve, receiver operating characteristic curve.

a HCWs not measuring their temperature were assumed to not have elevated body temperature as a sensitivity analysis

b Adjusted for age, sex, and all symptoms, i.e. fever, cough, shortness of breath, myalgia, malaise, sore throat, nasal symptom (runny, sneezing, congestion, sinus), gastrointestinal symptom (nausea/ vomiting/ diarrhea), rash, anosmia/ageusia (i.e. loss of smell/loss of taste), and headache

c Adjusted for all variables as above except fever

HCWs reporting anosmia/ageusia had an increased age- and sex- adjusted odds ratio of 6.50 (95% CI: 2.89–14.51), and multivariate odds ratio of 7.21 (95% CI: 2.95–17.67) of having a positive SARS-CoV-2 assay. Myalgia was also associated with increased odds ratios of having a positive SARS-CoV-2 assay in both models: OR = 2.41 (95% CI: 1.50–3.89) and OR = 1.83 (95% CI: 1.04–3.23), respectively. Headache was a significant predictor in the age- and sex-adjusted model: OR = 1.84 (95% CI: 1.13–2.96), but not in the all-symptom-adjusted model.

Nasal congestive symptoms were a significant negative predictor in both multivariate models: OR = 0.51 (95% CI: 0.31–0.82) and OR = 0.40 (95% CI: 0.23–0.68), respectively.

The Hosmer-Lemeshow goodness of fit test for all models demonstrated no evidence of poor fit. Therefore, we also present C statistics (i.e. area under the curve) for each symptom in Table 4. After age- and sex-adjustment, fever had the best discrimination between HCWs with positive and negative SARS-CoV-2 assays (C-statistic = 0.663).

Estimated false negatives, negative predictive value, attack and complication rates

Nine HCWs with symptom progression after an initial negative SARS-CoV-2 assay are described in S1 Table. Upon re-testing, all nine had positive RT-PCR for SARS-CoV-2. These cases represent 1.8% of originally negative HCWs (9/509), yielding an estimated negative predictive value of 98.2% (95% CI: 96.8–99.0%) for excluding clinically relevant COVID-19 disease.

The cumulative attack rate for clinically symptomatic COVID-19 during the study period (March 9-April 15, 2020) was 92 incident cases among an estimated employee cohort of 4600 or 2.0% (95% CI: 1.6–2.5%). A total of nine among the 92 incident HCW COVID-19 cases (9.8%) (all nine diagnosed with the initial PCR assay) experienced a complication during the study period: four required an emergency room visit, five needed hospitalization, two of the hospitalized required intubation, and one of those died (1.1%).

Discussion

This original investigation describes initial symptoms and their associations with SARS-CoV-2 RT-PCR assays among all 592 HCWs in our system tested between March 9 and April 15, 2020. Overall, we tested 13% of our workforce, which is a testing rate 6.7-fold greater than that of the Massachusetts population during the same period [23]. We found that a total of 16% (including 14% with initial positive assays and 2% with initial false negative assays) of these HCWs were diagnosed with clinical COVID-19, yielding a cumulative attack rate of 2% for our workforce.

The absence of symptoms or those limited to the throat/nose (excluding anosmia/ageusia) were significantly associated with having negative SARS-CoV-2 assays. In contrast, HCWs reporting three or more symptoms had 2-fold greater age- and sex-adjusted odds of having positive assays. These odds generally increased for each additional symptom reported, reaching 2.6-fold for six or more symptoms. Our results are consistent with previous reports suggesting that RT-PCR results correlate with viral shedding, COVID-19 symptom onset and clinical severity [24,25]. In multivariate adjustment models, HCWs with anosmia/ageusia had higher than seven-fold odds of having positive RT-PCR; those with fever and a measured temperature ≥ 37.5°C had almost 3.5-fold odds of having positive RT-PCR; and those with myalgia had almost 2-fold odds of having positive assays, while nasal symptoms were associated with a 60% reduced risk of a positive assay.

Studies support varying clinical manifestations among COVID-19 patients [25]. An investigation of critically ill cases found half presenting with temperature ≥ 38°C during their ICU stay, while more than 80% had cough and/or shortness of breath, accompanied by tachypnea [19]. In contrast, a study of subclinical COVID-19 patients showed 40% of cases initially presented fever and non-specific symptoms, such as cough and sore throat, but none exhibited dyspnea [4]. Regarding HCWs, it is useful to compare our results with two recent HCW series, which reported average ages (42–43 years-old) and female predominance (73–77%) similar to ours. In the large US national series, 78% of HCWs with COVID-19 had cough, 68% had fever, 66% reported myalgia, and 41% presented shortness of breath [26]. In the second smaller series from King County, WA (USA), the most common initial symptoms were cough (50%), fever (42%) and myalgias (35%) [27]. In general agreement, our HCW COVID-19 cases commonly reported fever (55%), myalgia (57%) and cough (71%), but only 17% reported dyspnea. However, only our investigation collected data on those testing negative as well, demonstrating that cough is a very non-specific symptom that was also reported by 60% of those testing negative. On the other hand, fever (particularly if measured) and myalgia were independent predictors of positive SARS-CoV-2 assays, as were anosmia/ageusia in HCWs symptomatic for longer periods. Regarding the latter findings, they are in accordance with a cross-sectional study of the general population, which reported adjusted odds ratios for COVID-19 of 6.6 and 3.1 for anosmia/ageusia and fever, respectively [28], similar to our findings of fully-adjusted odds of 7.2 and 3.5 for the same symptoms. In our study, anosmia/ageusia was reported less frequently (16%) as compared to 59% in the cross-sectional study, most likely because our symptoms reports were captured early in the course of illness.

Our results are also comparable to a Dutch study examining the point prevalence of positive SARS-CoV-2 RT-PCRs among HCWs with mild respiratory symptoms, during the early outbreak in the Netherlands, finding 4% of HCWs across nine hospitals positive, ranging from 0–10% for each individual hospital [14]. We found an overall positive initial test rate of 14% during a five-week period, which overlapped early spread with a later surge in community transmission and hospital COVID-19 traffic. We have observed that the proportion of positive tests increased along with epidemic’s progression in our region.

False negative results of SARS-CoV-2 RT-PCR have been reported at rates from 10–30% [21,29]. We did find nine HCWs who initially tested negative, developed progressive symptoms and had subsequent positive RT-PCR. None of these likely false-negatives were among the HCWs with the most severe cases requiring emergency/hospital care. Further study of symptomatic patients, their household contacts and of random population samples with both RT-PCR and serologies [30] are needed to better elucidate the true prevalence of asymptomatic carriers as well as the frequency of false negative RT-PCRs. Nonetheless, our estimated negative predictive value of 98% for excluding clinically relevant COVID-19 disease is very reassuring regarding the test’s performance when done properly.

Our findings have potential implications for HCW COVID-19 surveillance. First, HCWs with no symptoms or mild symptoms limited to sore throat/nasal congestion and a measured body temperature lower than 37.5°C, have a low probability of a positive RT-PCR and COVID-19. Thus, many HCWs with no symptoms or symptoms more compatible with allergy or a common cold could refrain from testing and continue to self-monitor symptoms and body temperature. In contrast, early systemic symptoms, especially fever and myalgia are predictive of possible clinical COVID-19, while anosmia/ageusia are fairly specific later findings. Our results support expert guidelines for temperature monitoring [18], which should not be limited to healthcare settings, and that a measured temperature ≥ 37.5°C may be predictive of a positive SARS-CoV-2 RT-PCR result.

Our study does have some limitations. First, the HCWs tested were not a random or convenience sample, but rather all HCWs who self-reported COVID-19-related concerns. Thus, our results do not necessarily reflect total cumulative incidence of COVID-19 among HCWs in our healthcare system. However, our triage and testing process were conducted in accordance with expert guidelines [3,17,18], and therefore, our results can inform other healthcare systems employing comparable protocols. Second, because there is no reference diagnostic test for COVID-19, the test performance characteristics of the RT-PCR are not established [21]. Potentially corroborating serology tests were not available during the study period, but may be helpful in the future to identify additional infections that occurred with mild or no symptoms [30].

Our study also has several strengths. First, HCWs generally reported their symptoms at triage before their SARS-CoV-2 PCR test results were available, eliminating recall bias. Second, all symptoms reports were validated by occupational medicine physicians, strengthening their accuracy. Third, all HCWs had complete symptom and testing data. Moreover, unlike other HCW studies, we used identical methods to collect data on persons testing negative and were able to compare these two groups. In addition, all HCWs tested had telephonic follow-up visits, allowing us to identify and re-test HCWs with potential false negative results. Finally, our present study included all eligible employees in the healthcare system. The study population comprised not only healthcare professionals but also staff/contractors such as maintenance or IT (Information Technology) persons. Therefore, our results may be generalized to other working populations during the pandemic.

Conclusions

Among HCWs, systemic symptoms/signs (fever, body temperature ≥ 37.5°C, myalgia, and headache) and anosmia/ageusia were predictive of positive SARS-CoV-2 assays, with fever, anosmia/ageusia, and myalgia being the strongest independent predictor. In contrast, no symptoms or isolated sore throat/nasal congestion were associated with negative SARS-CoV-2 assays.

Supporting information

S1 File. The healthcare system’s occupational health COVID-19/Influenza like illness triage form.

(PDF)

S1 Table. Presentation of HCWs with initial negative assays but repeat positive assays (i.e. presumed initial false negative assays).

(DOCX)

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Ebrahim SH, Ahmed QA, Gozzer E, Schlagenhauf P, Memish ZA. Covid-19 and community mitigation strategies in a pandemic. BMJ. 2020;368:m1066 10.1136/bmj.m1066 [DOI] [PubMed] [Google Scholar]
  • 2.Scott SE, Zabel K, Collins J, Hobbs KC, Kretschmer MJ, Lach M, et al. First Mildly Ill, Non-Hospitalized Case of Coronavirus Disease 2019 (COVID-19) Without Viral Transmission in the United States—Maricopa County, Arizona, 2020. Clin Infect Dis. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.American College of Occupational and Environmental Medicine [Internet]. Coronavirus (COVID-19); c2020 [cited 2020 June 12]. Available from: https://info.mdguidelines.com/wp-content/uploads/2020/04/ACOEM-COVID-19-April-8-2020v2.pdf
  • 4.Song JY, Yun JG, Noh JY, Cheong HJ, Kim WJ. Covid-19 in South Korea—Challenges of Subclinical Manifestations. N Engl J Med. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Cao Y, Liu X, Xiong L, Cai K. Imaging and Clinical Features of Patients With 2019 Novel Coronavirus SARS-CoV-2: A systematic review and meta-analysis. J Med Virol. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Bai Y, Yao L, Wei T, Tian F, Jin DY, Chen L, et al. Presumed Asymptomatic Carrier Transmission of COVID-19. JAMA. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Rothe C, Schunk M, Sothmann P, Bretzel G, Froeschl G, Wallrauch C, et al. Transmission of 2019-nCoV Infection from an Asymptomatic Contact in Germany. N Engl J Med. 2020;382:970–971. 10.1056/NEJMc2001468 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Ghinai I, McPherson TD, Hunter JC, Kirking HL, Christiansen D, Joshi K, et al. First known person-to-person transmission of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in the USA. Lancet. 2020;395:1137–1144. 10.1016/S0140-6736(20)30607-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Hu Z, Song C, Xu C, Jin G, Chen Y, Xu X, et al. Clinical characteristics of 24 asymptomatic infections with COVID-19 screened among close contacts in Nanjing, China. Sci China Life Sci. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.van Doremalen N, Bushmaker T, Morris DH, Holbrook MG, Gamble A, Williamson BN, et al. Aerosol and Surface Stability of SARS-CoV-2 as Compared with SARS-CoV-1. N Engl J Med. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lan FY, Wei CF, Hsu YT, Christiani DC, Kales SN. Work-related COVID-19 transmission in six Asian countries/areas: A follow-up study. PLoS One. 2020;15(5):e0233588 10.1371/journal.pone.0233588 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Selvaraj SA, Lee KE, Harrell M, Ivanov I, Allegranzi B. Infection Rates and Risk Factors for Infection Among Health Workers During Ebola and Marburg Virus Outbreaks: A Systematic Review. J Infect Dis. 2018;218(suppl_5):S679–S689. 10.1093/infdis/jiy435 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Offeddu V, Yung CF, Low MSF, Tam CC. Effectiveness of Masks and Respirators Against Respiratory Infections in Healthcare Workers: A Systematic Review and Meta-Analysis. Clin Infect Dis. 2017;65(11):1934–1942. 10.1093/cid/cix681 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Reusken CB, Buiting A, Bleeker-Rovers C, Diederen B, Hooiveld M, Friesema I, et al. Rapid assessment of regional SARS-CoV-2 community transmission through a convenience sample of healthcare workers, the Netherlands, March 2020. Euro Surveill. 2020;25(12). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Fraher EP, Pittman P, Frogner BK, Spetz J, Moore J, Beck AJ, et al. Ensuring and Sustaining a Pandemic Workforce. N Engl J Med. 2020. [DOI] [PubMed] [Google Scholar]
  • 16.Lan FY, Fernandez-Montero A, Kales SN. COVID-19 and healthcare workers: emerging patterns in Pamplona, Asia and Boston. Occup Med (Lond). 2020;kqaa089. [Google Scholar]
  • 17.Massachusetts Department of Public Health [Internet]. Testing of Persons with Suspect COVID-19; c2020 [cited 2020 June 12]. Available from: https://www.mass.gov/doc/covid-19-pui-criteria/download
  • 18.Centers for Disease Control and Prevention (CDC) [Internet]. Interim U.S. Guidance for Risk Assessment and Public Health Management of Healthcare Personnel with Potential Exposure in a Healthcare Setting to Patients with Coronavirus Disease (COVID-19); c2020 [cited 2020 June 12]. Available from: https://www.cdc.gov/coronavirus/2019-ncov/hcp/guidance-risk-assesment-hcp.html
  • 19.Bhatraju PK, Ghassemieh BJ, Nichols M, Kim R, Jerome KR, Nalla AK, et al. Covid-19 in Critically Ill Patients in the Seattle Region—Case Series. N Engl J Med. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DKW, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2020;25(3). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Marcotte LM, Liao JM. Incorporating Test Characteristics Into SARS-CoV-2 Testing Policy—Sense and Sensitivity. JAMA Health Forum. 2020; 1(4):e200448. [DOI] [PubMed] [Google Scholar]
  • 22.Lauer SA, Grantz KH, Bi Q, Jones FK, Zheng Q, Meredith HR, et al. The Incubation Period of Coronavirus Disease 2019 (COVID-19) From Publicly Reported Confirmed Cases: Estimation and Application. Ann Intern Med. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Massachusetts Department of Public Health [Internet]. Coronavirus Disease 2019 (COVID-19) Cases in MA: As of April 15, 2020; c2020 [cited 2020 June 12]. Available from: https://www.mass.gov/doc/covid-19-cases-in-massachusetts-as-of-april-15-2020/download
  • 24.He X, Lau EHY, Wu P, Deng X, Wang J, Hao X, et al. Temporal dynamics in viral shedding and transmissibility of COVID-19. Nat Med. 2020. [DOI] [PubMed] [Google Scholar]
  • 25.Liu Y, Yan LM, Wan L, Xiang TX, Le A, Liu JM, et al. Viral dynamics in mild and severe cases of COVID-19. Lancet Infect Dis. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.CDC COVID-19 Response Team. Characteristics of Health Care Personnel with COVID-19—United States, February 12-April 9, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(15):477–481. 10.15585/mmwr.mm6915e6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Chow EJ, Schwartz NG, Tobolowsky FA, Zacks RLT, Huntington-Frazier M, Reddy SC, et al. Symptom Screening at Illness Onset of Health Care Personnel With SARS-CoV-2 Infection in King County, Washington. JAMA. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Menni C, Valdes A, Freydin MB, Ganesh S, El-Sayed Moustafa J, Visconti A, et al. Loss of smell and taste in combination with other symptoms is a strong predictor of COVID-19 infection. medRxiv. 2020:2020.04.05.20048421. [Google Scholar]
  • 29.West C, Montori V, Sampathkumar P. COVID-19 testing: the threat of false-negative results. Mayo Clin Proc. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Petherick A. Developing antibody tests for SARS-CoV-2. Lancet. 2020;395(10230):1101–1102. 10.1016/S0140-6736(20)30788-1 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Muhammad Adrish

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

10 Jun 2020

PONE-D-20-13207

COVID-19 Symptoms Predictive of Healthcare Workers’ SARS-CoV-2 PCR Results

PLOS ONE

Dear Dr. Stefanos Kales,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I have received the comments of the reviewers on your manuscript. The specific comments of the reviewers are included below. Please provide point by point response in your revised manuscript.

Please submit your revised manuscript by due date. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Muhammad Adrish

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses.

For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dr. Lan et al. has presented a retrospective observational study in which they investigated the presenting symptoms most predictive of positive/negative SARS-CoV-2 RT-PCR results among healthcare workers. Although the manuscript is well written and the methods are adequate, the observations made have already been described in the general population. HCWs should not be an exception.

Reviewer #2: This manuscript concerns a study among health care workers (HCW) and factors that are associated with testing positive for SARS-2 coronavirus. The data are sound and interesting and may be helpful to determine efficient testing strategies.

Some points need to be considered and adjusted before this paper is suitable for publication in PlosOne.

General comments:

-The Discussion section is rather long and may be shortened by removing redundant statements. For example page 22, second paragraph: this overlaps with other statements in the Discussion.

-In the conclusions of the abstract and at the end of the manuscript, is stated that anosmia/ageusia and fever were the two strongest predictors of positive assays. In Table 1 and Table 4 however, it is clear that also myalgia is significantly associated with positive SARS-2 test results. This is also mentioned in the discussion. Why is this not mentioned in the conclusions in both abstract and discussion?

-In addition: please mention as early as possible in the manuscript that ‘anosmia/ageusia’ means ‘smell/taste’ since these are medical terms with which not all readers are familiar.

-Could the authors speculate on the usefulness of their data for the general population? So would these indicators for a positive SARS-2 test also be true for non-HCW?

Specific comments

Abstract

-Page 3, 5th line: please insert ‘was’ between ’but’ and ‘associated’.

Methods

-Page 7/8: here the RT-PCR assays are mentioned and it is stated that results were either ‘positive’ or ‘negative’. Does this mean that there were no ‘indeterminate’ results? That is a bit hard to believe. If there were indeed ‘indeterminate’ results, how were these dealt with?

-Page 8, Data collection, second paragraph: please replace ‘Absence of a gold standard’ by ‘Because there is no reference diagnostic test’, since the term ‘gold standard’ is not appropriate. The same point for page 24, second paragraph, in the Discussion.

Results

Table 3, legend: here ‘loss of smell/taste’ is mentioned instead of ‘anosmis/ageusia’. Please be consistent (but also adjust according to the general comment above). Same comment for Table 4, legend.

Supplementary Table 1: Two columns ‘Initial test result’ and ‘Repeat test result’ seem superfluous, since for all HCW in this S1 Table the initial test results were negative and the ‘Repeat test results’ were positive, since this was the objective of this Table. I suggest removing these 2 columns and to provide a legend for this Table in which is indicated that for all HCW initial test results were negative and the repeat test results were positive.

-Page 19, last sentence of the Results: please replace ‘requiring’ by ‘required’ (twice), ‘needing’ by ‘needed’ and ‘dying’ by ‘died’.

Discussion

Page 19, last sentence: a total of 16% is mentioned, but in the abstract this is 14%. Probably the ‘false negatives’ are involved here. Please mention this more explicitly.

Reviewer #3: The authors present the study for HCWs with progressive symptoms and the SARS-CoV-2 test. Initial symptoms and their associations with SARS-CoV-2 RT PCR assay among 592 patients in 19 days were studied. Authors found 16% of HCW were diagnosed with clinical COVID-19, accruing a risk of 2% of their workforce.

The most significant symptoms associated with positive SARS-Cov-2 Assay remains spike in fever, with additional signs such as anosmia and myalgia. Specially HCW with anosmia/ageusia had higher odds (seven-fold) for having positive PCR, followed by a temperature of >-37.5 °C had 3.5-fold odds of having a positive PCR test.

In my opinion, the nine patients with a negative test (False Negative group) with symptom progression are the most exciting finding. As data from this group emphasizes the critical time point, where now the amount of viral load in the host is in the detection limit of PCR, and it also corresponds to showing symptoms in the host. Considering that the virus has 15 days of the incubation period, the critical question to be asked is, which is the most optimal time a health worker should go for testing? Or how often a health worker should get tested considering they show mild symptoms.

What titer of the virus from the host (after being symptomatic) is detectable by PCR?

Do symptoms and viral load depend on other independent variables like prior health issues/male/stress at work for HCW work.

I feel this study also emphasizes that measuring temp is vital for HCW, and such measures can be expanded across the hospitals and other institutes to limit the spread of the virus.

Comments :

How many groups were selected for fitting the Hosmer and Lemeshow test should be mentioned in the manuscript for clarity.

Finally, considering this unique collection of this HCW data, this dataset can be further explored by employing a predictive machine learning algorithm. A logistic regression model with R-square or may be softmax regression to predict the odds for the asymptotic individual or individual with one or more symptoms, to have a positive RT test, can be used.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Sylvia Bruisten

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Comments_Kales_etal_Pone_June-2020.doc

PLoS One. 2020 Jun 26;15(6):e0235460. doi: 10.1371/journal.pone.0235460.r002

Author response to Decision Letter 0


14 Jun 2020

Journal Requirements/Editorial Comments:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Response: Thank you. We have revised the format/file names according to PLOS ONE’s requirements throughout the paper and associated files.

2. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses.

For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information.

Response: Thank you. We have attached the HCW triage form we used for telephonic triage as Supporting Information and mention this explicitly in our methods.

S1 File. The healthcare system’s occupational health COVID-19/Influenza like illness triage form

Response to Reviewers:

Reviewer #1:

1. Dr. Lan et al. has presented a retrospective observational study in which they investigated the presenting symptoms most predictive of positive/negative SARS-CoV-2 RT-PCR results among healthcare workers. Although the manuscript is well written and the methods are adequate, the observations made have already been described in the general population. HCWs should not be an exception.

Response: Thank you for your comments. Although the findings have been reported in the general population, SARS-CoV-2 testing was prioritized for HCWs per US CDC and other professional guidelines. During our study period, the HCWs in our healthcare system actually had a 6.7-fold propensity of being tested as compared to citizens of the Massachusetts general population. As a result, our population was considerably younger and tended to exhibit less symptoms than previous studies. In particular, according to the guidelines in place in March and April, asymptomatic persons were specifically blocked from testing. Second, to the best of our knowledge, previous observations in the general population were mostly based on cross-sectional studies that measured subjects’ symptoms and SARS-CoV-2 RT-PCR results at the same time or after receipt of test results, using self-reported surveys [1,2]. In our present study, however, we assessed HCWs’ symptoms at telephonic triage, which took place before they were referred to SARS-CoV-2 RT-PCR testing. Therefore, our symptom assessments were largely free of recall bias. Furthermore, the triage symptoms were validated by medical personnel for each HCW, and such validation had not been done in the research investigating the general population. Finally, focusing on HCWs helps to make decisions on not only prioritizing workers’ SARS-CoV-2 RT-PCR testing in healthcare settings, but also planning HCWs’ return-to-work, especially when the testing capacity is limited. Mildly symptomatic persons who were not HCWs were simply told to self-isolate.

References:

1. Menni C, Valdes A, Freydin MB, Ganesh S, El-Sayed Moustafa J, Visconti A, et al. Loss of smell and taste in combination with other symptoms is a strong predictor of COVID-19 infection. medRxiv. 2020:2020.04.05.20048421.

2. Menni C, Valdes AM, Freidin MB, Sudre CH, Nguyen LH, Drew DA, et al. Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat Med. 2020.

Reviewer #2:

1. This manuscript concerns a study among health care workers (HCW) and factors that are associated with testing positive for SARS-2 coronavirus. The data are sound and interesting and may be helpful to determine efficient testing strategies. Some points need to be considered and adjusted before this paper is suitable for publication in PlosOne.

Response: Thank you for this very positive assessment. Please find the point-by-point responses below to each specific comment.

General comments:

2. The Discussion section is rather long and may be shortened by removing redundant statements. For example page 22, second paragraph: this overlaps with other statements in the Discussion.

Response: Thank you for your comments. We have removed that paragraph and streamlined other areas of the discussion.

3. In the conclusions of the abstract and at the end of the manuscript, is stated that anosmia/ageusia and fever were the two strongest predictors of positive assays. In Table 1 and Table 4 however, it is clear that also myalgia is significantly associated with positive SARS-2 test results. This is also mentioned in the discussion. Why is this not mentioned in the conclusions in both abstract and discussion?

Response: Thank you for your suggestions. Indeed, myalgia is a significant predictor associated with SARS-CoV-2 PCR assays. We have added myalgia into the conclusions of both the abstract and the discussion.

4. In addition: please mention as early as possible in the manuscript that ‘anosmia/ageusia’ means ‘smell/taste’ since these are medical terms with which not all readers are familiar.

Response: Thank you for your suggestions. We have added an explanation in the parenthesis after the first appearance of “anosmia/ageusia” appearing in both abstract and the manuscript body that these terms mean “lack/loss of smell and taste”, respectively.

5. Could the authors speculate on the usefulness of their data for the general population? So would these indicators for a positive SARS-2 test also be true for non-HCW?

Response: Thank you for this suggestion. We have some text as our study strengths in the discussion to further elaborate the generalizability of our research:

“… Finally, our present study included all eligible employees in the healthcare system. The study population comprised not only healthcare professionals but also staff/contractors such as maintenance or IT (Information Technology) persons. Therefore, our results may be generalized to other working populations during the pandemic.”

Specific comments:

Abstract

6. Page 3, 5th line: please insert ‘was’ between ’but’ and ‘associated’.

Response: Thank you for your suggestions. We have revised the sentence as per below:

“Anosmia/ageusia (i.e. loss of smell/loss of taste) was reported less frequently (16%) than other symptoms by HCWs with positive assays, but was associated with more than a seven-fold…”

Methods

7. Page 7/8: here the RT-PCR assays are mentioned and it is stated that results were either ‘positive’ or ‘negative’. Does this mean that there were no ‘indeterminate’ results? That is a bit hard to believe. If there were indeed ‘indeterminate’ results, how were these dealt with?

Response: Thank you for your comments. The laboratories used during the study period reported results only qualitatively as either “positive” or “negative”. In theory, a result can also return as “invalid” and a repeat sample is requested. This case is rare (~1 out of every 30,000 tests), and did not occur in this population. We added to the methods: “In case of an invalid or indeterminate result, a repeat sample is requested.”

8. Page 8, Data collection, second paragraph: please replace ‘Absence of a gold standard’ by ‘Because there is no reference diagnostic test’, since the term ‘gold standard’ is not appropriate. The same point for page 24, second paragraph, in the Discussion.

Response: Thank you for your suggestions. We have revised the sentences accordingly.

Results

9. Table 3, legend: here ‘loss of smell/taste’ is mentioned instead of ‘anosmia/ageusia’. Please be consistent (but also adjust according to the general comment above). Same comment for Table 4, legend.

Response: Thank you for your suggestions. We have revised ‘loss of smell/taste’ to ‘anosmia/ageusia (i.e. loss of smell/loss of taste)’ in the legends of both Table 3 and Table 4.

10. Supplementary Table 1: Two columns ‘Initial test result’ and ‘Repeat test result’ seem superfluous, since for all HCW in this S1 Table the initial test results were negative and the ‘Repeat test results’ were positive, since this was the objective of this Table. I suggest removing these 2 columns and to provide a legend for this Table in which is indicated that for all HCW initial test results were negative and the repeat test results were positive.

Response: Thank you for your suggestions. We have removed the two columns of S1 Table and revised its title as below.

“S1 Table. Presentation of HCWs with initial negative assays but repeat positive assays (i.e. presumed initial false negative assays)”

11. Page 19, last sentence of the Results: please replace ‘requiring’ by ‘required’ (twice), ‘needing’ by ‘needed’ and ‘dying’ by ‘died’.

Response: Thank you for your suggestions. We have revised the sentence as below.

“A total of nine among the 92 incident HCW COVID-19 cases (9.8%) (all nine diagnosed with the initial PCR assay) experienced a complication during the study period: four required an emergency room visit, five needed hospitalization, two of the hospitalized required intubation, and one of those died (1.1%).”

Discussion

12. Page 19, last sentence: a total of 16% is mentioned, but in the abstract this is 14%. Probably the ‘false negatives’ are involved here. Please mention this more explicitly.

Response: Thank you for your comment. We have revised the last sentence of Page 19 as below.

“We found that a total of 16% (including 14% with initial positive assays and 2% with initial false negative assays) of these HCWs were diagnosed with clinical COVID-19, yielding a cumulative attack rate of 2% for our workforce.”

Reviewer #3:

1. The authors present the study for HCWs with progressive symptoms and the SARS-CoV-2 test. Initial symptoms and their associations with SARS-CoV-2 RT PCR assay among 592 patients in 19 days were studied. Authors found 16% of HCW were diagnosed with clinical COVID-19, accruing a risk of 2% of their workforce.

The most significant symptoms associated with positive SARS-Cov-2 Assay remains spike in fever, with additional signs such as anosmia and myalgia. Specially HCW with anosmia/ageusia had higher odds (seven-fold) for having positive PCR, followed by a temperature of >-37.5 °C had 3.5-fold odds of having a positive PCR test.

In my opinion, the nine patients with a negative test (False Negative group) with symptom progression are the most exciting finding. As data from this group emphasizes the critical time point, where now the amount of viral load in the host is in the detection limit of PCR, and it also corresponds to showing symptoms in the host. Considering that the virus has 15 days of the incubation period, the critical question to be asked is, which is the most optimal time a health worker should go for testing? Or how often a health worker should get tested considering they show mild symptoms.

Response: Thank you for your nice summary of our work and good questions. According to our study results and experience, a healthcare worker should undergo a SARS-CoV-2 testing when he/she develops systemic symptoms/signs (fever, body temperature ≥ 37.5°C, myalgia, and headache) and/or anosmia/ageusia. In contrast, if a healthcare worker has no symptoms or isolated sore throat/nasal congestion, he/she can usually forego testing, continue usual precautions and wait to see if they improve or worsen. Therefore, intensive self-monitoring of symptom progression would be crucial to determine when to go for a repeated test.

2. What titer of the virus from the host (after being symptomatic) is detectable by PCR?

Response: Thank you for this question. The limit of detection at the laboratory testing the majority of our samples is 100 copies of viral RNA/ml. We added a mention of this limit in the lab methods section.

3. Do symptoms and viral load depend on other independent variables like prior health issues/male/stress at work for HCW work?

Response: Thank you. We did not collect past medical history information or stress routinely. Regarding the HCWs’ age and sex, we included these variables in our models. Neither were significant predictors in univariate (Table 1) or in the multivariate models (Table 3, Table 4).

4. I feel this study also emphasizes that measuring temp is vital for HCW, and such measures can be expanded across the hospitals and other institutes to limit the spread of the virus.

Response: Thank you for your suggestions. We have modified the statement on temperature monitoring in the discussion to read as follows:

“… Our results support expert guidelines for temperature monitoring [18], which should not be limited to healthcare settings, and that a measured temperature ≥ 37.5°C may be predictive of a positive SARS-CoV-2 RT-PCR result.

Comments :

5. How many groups were selected for fitting the Hosmer and Lemeshow test should be mentioned in the manuscript for clarity.

Response: Thank you for your comments. We have added selected group number of the Hosmer-Lemeshow goodness of fit test in “Methods” as below.

“…The Hosmer-Lemeshow goodness of fit test with 15 groups was also performed to check the model fit.”

6. Finally, considering this unique collection of this HCW data, this dataset can be further explored by employing a predictive machine learning algorithm. A logistic regression model with R-square or may be softmax regression to predict the odds for the asymptotic individual or individual with one or more symptoms, to have a positive RT test, can be used.

Response: Thank you for this suggestion. We agree it is an interesting approach. However, after some preliminary exploration with our limited sample, we concluded that it would be more fruitful to investigate this possibility with a much larger data set in the future.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Muhammad Adrish

17 Jun 2020

COVID-19 Symptoms Predictive of Healthcare Workers’ SARS-CoV-2 PCR Results

PONE-D-20-13207R1

Dear Dr. Kales,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Muhammad Adrish

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Thank you for revising the manuscript. You have satisfactorily answered all reviewer queries.

Reviewers' comments:

Acceptance letter

Muhammad Adrish

19 Jun 2020

PONE-D-20-13207R1

COVID-19 Symptoms Predictive of Healthcare Workers’ SARS-CoV-2 PCR Results

Dear Dr. Kales:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Muhammad Adrish

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. The healthcare system’s occupational health COVID-19/Influenza like illness triage form.

    (PDF)

    S1 Table. Presentation of HCWs with initial negative assays but repeat positive assays (i.e. presumed initial false negative assays).

    (DOCX)

    Attachment

    Submitted filename: Comments_Kales_etal_Pone_June-2020.doc

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES