A recent independent audit (https://error.reviews/reviews/lades‐2020/) of our 2020 paper made us aware of four issues with this paper:
i) The line that referred to the multiple comparisons should have made clear that these were additional to the main analysis in the paper to avoid confusion. Table S2 in the Supporting Information (which is presented again below as Table 2) is transparent about the use of the Benjamini‐Hochberg adjustments.
ii) Alongside our fixed effects, random effects, and fixed effects with multiple comparisons tables, we could have included a fixed effects model clustering for standard errors at the individual level. While we think it is not unconventional or misleading to present fixed effects and random effects models in the way we did, we agree that clustering has analytical advantages and would have been preferable. We added the regression table from a fixed effects model with standard errors clustered at the individual level below in this letter as Table 1. To facilitate the direct comparison between the regression table in the Supplementary Information of our paper and the regression table with clustered standard errors, we present both tables below as Table 1 and Table 2.
Table 1.
Separate within‐person estimates of the relationship between: (A) activities, (B) locations, (C) personal interactions and (D) remote interactions and affect levels. These are fixed‐effects models with standard errors clustered at the individual level.
| Positive affect a | Negative affect b | Positive affect a | Negative affect b | ||
|---|---|---|---|---|---|
| b (SE) | b (SE) | b (SE) | b (SE) | ||
| Activities | Locations (Base = At home) | ||||
| Exercising | 0.461***† (0.0720) | −0.266***† (0.0599) | Outdoors / nature | 0.593***† (0.0516) | −0.249***† (0.0485) |
| Going for a walk | 0.333***† (0.0581) | −0.0750 (0.0541) | Other | 0.0511 (0.109) | 0.0442 (0.0730) |
| Gardening | 0.292***† (0.103) | −0.0947 (0.0724) | At other people's home | 0.0310 (0.152) | 0.00677 (0.102) |
| Pursuing a hobby | 0.225***† (0.0831) | −0.223***† (0.0670) | At work | −0.160** (0.0741) | 0.237***† (0.0728) |
| Taking care of children | 0.208***† (0.0576) | −0.186***† (0.0561) | At a shop | −0.196**† (0.0914) | 0.0878 (0.0649) |
| Socialising | 0.145**† (0.0568) | −0.0579 (0.0449) | |||
| Eating | 0.131***† (0.0376) | −0.0458 (0.0324) | In‐person interactions | ||
| Drinking alcoholic beverages | 0.110 (0.0780) | 0.138* (0.0750) | Friends | 0.337***† (0.110) | −0.144* (0.0826) |
| Pray/worship/meditate | 0.107 (0.165) | −0.180 (0.118) | Pets | 0.218***† (0.0782) | −0.0562 (0.0657) |
| Internet | 0.0697 (0.0523) | −0.0617 (0.0461) | My children | 0.125** (0.0619) | −0.0378 (0.0482) |
| Commuting to work | 0.0644 (0.0892) | 0.169** (0.0810) | Parents/relatives | −0.0303 (0.0874) | 0.00310 (0.0747) |
| Other | 0.0542 (0.0488) | 0.0167 (0.0439) | Nobody | −0.136** (0.0616) | 0.108* (0.0566) |
| Resting/relaxing | 0.0312 (0.0480) | −0.0511 (0.0446) | Other | −0.164** (0.0808) | 0.0455 (0.0633) |
| Doing housework | 0.00593 (0.0412) | 0.0891** (0.0358) | Spouse / significant other | −0.169***† (0.0567) | 0.0900** (0.0445) |
| Preparing food | −0.00287 (0.0409) | −0.0865** (0.0339) | Work interactions | −0.406***† (0.0830) | 0.303***† (0.0699) |
| Drinking | −0.0284 (0.0562) | 0.0104 (0.0448) | |||
| Watching TV, Netflix or similar | −0.0484 (0.0418) | 0.0575 (0.0364) | Over‐distance interactions | ||
| Listening to the radio | −0.0832 (0.0596) | 0.104** (0.0471) | Pets | 0.200* (0.108) | −0.0960 (0.144) |
| Doing nothing | −0.119 (0.143) | 0.143 (0.118) | Other | 0.0832 (0.0962) | −0.135* (0.0692) |
| Using social media | −0.153***† (0.0489) | 0.112**† (0.0435) | My children | 0.0645 (0.0780) | 0.0756 (0.0537) |
| Schooling children | −0.166* (0.0972) | 0.305***† (0.0856) | Nobody | 0.0406 (0.0527) | −0.0970** (0.0463) |
| Shopping | −0.226***† (0.0791) | 0.0874 (0.0591) | Parents/relatives | 0.0321 (0.0526) | 0.0590 (0.0454) |
| Working/studying | −0.264***† (0.0574) | 0.171***† (0.0503) | Friends | −0.00181 (0.0561) | −0.00890 (0.0458) |
| Informing myself abt. Covid‐19 | −0.285***† (0.0497) | 0.267***† (0.0447) | Spouse / significant other | −0.0803 (0.0643) | −0.0116 (0.0500) |
| Sleeping | −0.344***† (0.0722) | −0.0332 (0.0706) | Work interactions | −0.271***† (0.0566) | 0.257***† (0.0533) |
Standardized relationships are presented. *** p < 0.01, ** p < 0.05, * p < 0.1, † p < 0.05 after Benjamini‐Hochberg adjustment. All models are based on 2795 observations from 604 individuals.
Positive affect is estimated as the average of the calm and happy affect items.
Negative affect is estimated as the average of overwhelmed, sad, bored, frustrated, lonely, and worried affect items.
TABLE 2.
Separate within‐person estimates of the relationship between: (A) activities, (B) locations, (C) personal interactions and (D) remote interactions and affect levels. As presented in the Supplementary Information of the paper.
| Positive affect a | Negative affect b | Positive affect a | Negative affect b | ||
|---|---|---|---|---|---|
| b (SE) | b (SE) | b (SE) | b (SE) | ||
| Activities | Locations (Base = At home) | ||||
| Exercising | 0.46***† (0.07) | −0.27***† (0.06) | Outdoors / nature | 0.59***† (0.05) | −0.25***† (0.05) |
| Going for a walk | 0.33***† (0.06) | −0.07 (0.05) | Other | 0.05 (0.08) | 0.04 (0.07) |
| Gardening | 0.29***† (0.09) | −0.09 (0.07) | At other people's home | 0.03 (0.15) | 0.01 (0.12) |
| Pursuing a hobby | 0.23**† (0.09) | −0.22***† (0.08) | At work | −0.16** (0.07) | 0.24***† (0.06) |
| Taking care of children | 0.21***† (0.06) | −0.19***† (0.05) | At a shop | −0.2**† (0.08) | 0.09 (0.07) |
| Socialising | 0.15**† (0.06) | −0.06 (0.05) | |||
| Eating | 0.13***† (0.04) | −0.05 (0.03) | In‐person interactions | ||
| Drinking alcoholic beverages | 0.11 (0.1) | 0.14 (0.08) | Friends | 0.34***† (0.1) | −0.14* (0.08) |
| Pray/worship/meditate | 0.11 (0.13) | −0.18* (0.11) | Pets | 0.22***† (0.08) | −0.06 (0.07) |
| Internet | 0.07 (0.05) | −0.06 (0.05) | My children | 0.13** (0.05) | −0.04 (0.05) |
| Commuting to work | 0.06 (0.09) | 0.17** (0.08) | Parents/relatives | −0.03 (0.08) | 0 (0.07) |
| Other | 0.05 (0.05) | 0.02 (0.05) | Nobody | −0.14** (0.06) | 0.11** (0.05) |
| Resting/relaxing | 0.03 (0.05) | −0.05 (0.04) | Other | −0.16** (0.07) | 0.05 (0.06) |
| Doing housework | 0.01 (0.04) | 0.09** (0.04) | Spouse / significant other | −0.17***† (0.05) | 0.09** (0.04) |
| Preparing food | 0 (0.04) | −0.09** (0.04) | Work interactions | −0.41***† (0.08) | 0.3***† (0.07) |
| Drinking | −0.03 (0.05) | 0.01 (0.04) | |||
| Watching TV, Netflix or similar | −0.05 (0.04) | 0.06 (0.04) | Over‐distance interactions | ||
| Listening to the radio | −0.08 (0.06) | 0.1** (0.05) | Pets | 0.2 (0.16) | −0.1 (0.13) |
| Doing nothing | −0.12 (0.13) | 0.14 (0.11) | Other | 0.08 (0.08) | −0.13* (0.07) |
| Using social media | −0.15***† (0.05) | 0.11**† (0.04) | My children | 0.06 (0.07) | 0.08 (0.05) |
| Schooling children | −0.17**† (0.08) | 0.3***† (0.07) | Nobody | 0.04 (0.06) | −0.1** (0.05) |
| Shopping | −0.23***† (0.07) | 0.09 (0.06) | Parents/relatives | 0.03 (0.06) | 0.06 (0.05) |
| Working/studying | −0.26***† (0.05) | 0.17***† (0.04) | Friends | 0 (0.06) | −0.01 (0.05) |
| Informing myself abt. Covid‐19 | −0.29***† (0.05) | 0.27***† (0.04) | Spouse / significant other | −0.08 (0.06) | −0.01 (0.05) |
| Sleeping | −0.34***† (0.07) | −0.03 (0.06) | Work interactions | −0.27***† (0.06) | 0.26***† (0.05) |
Standardized relationships are presented. *** p < 0.01, ** p < 0.05, * p < 0.1, † p < 0.05 after Benjamini‐Hochberg adjustment. All models are based on 2795 observations from 604 individuals.
Positive affect is estimated as the average of the calm and happy affect items.
Negative affect is estimated as the average of overwhelmed, sad, bored, frustrated, lonely, and worried affect items.
iii) Table S2 in the Supplementary Information of the paper does include an error (also highlighted in red below in Table 2). We included a significance flag “†” indicating that the association between “Schooling children” and “Positive affect” is significant after Benjamini‐Hochberg adjustment, which it is not. We are grateful to the external reviewers for highlighting this error.
iv) The external reviewers noticed six duplicate ids (essentially three cases in which two people were assigned the same participant id) in the raw data‐file. The external panel provider gave us the data with these duplicate ids. Basic demographics that we got directly from the panel provider are the same across these sets of observations, but they differ in the demographic data we elicited ourselves. We believe it is correct to include all 6 observations and assume they are independent of each other in the analysis.
We appreciate the opportunity to reflect on potential improvements to our analysis and the presentation of the results. None of the above issues change the substantive conclusions of the paper.