Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Sep 11;15(9):e0238613. doi: 10.1371/journal.pone.0238613

Measuring Italian citizens’ engagement in the first wave of the COVID-19 pandemic containment measures: A cross-sectional study

Guendalina Graffigna 1,2,3, Serena Barello 1,2,*, Mariarosaria Savarese 1,3, Lorenzo Palamenghi 1,3, Greta Castellini 1,3, Andrea Bonanomi 4, Edoardo Lozza 2
Editor: Wen-Jun Tu5
PMCID: PMC7485890  PMID: 32915822

Abstract

Background

In January 2020, the coronavirus disease 2019 (COVID-19) started to spread in Italy. The Italian government adopted urgent measures to slow its spread. Enforcing compliance with such measures is crucial in order to enhance their effectiveness. Engaging citizens in the COVID-19 preventive process is urgent today both in Italy and around the world. However, to the best of our knowledge, no previous studies have investigated the role of health engagement in predicting citizens’ compliance with health emergency containment measures.

Method

An online survey was administered between February 28 and March 4, 2020 on a representative sample of 1000 Italians. The questionnaire included a measure of health engagement (Patient Health Engagement Scale), a 5-item Likert scale ranging from 1 to 7, resulting in 4 positions that describe the psychological readiness to be active in one’s own health management, and a series of ad hoc items intended to measure citizens’ perceived susceptibility and severity of the disease, orientation towards health management, trust in institutional bodies, health habits and food consumption. To investigate the relationship between health engagement and these variables, ANOVA analysis, logistic regression and contingency tables with Pearson’s chi-squared analysis have been carried out.

Results

Less engaged people show higher levels of perceived susceptibility to the virus and severity of the disease; they are less trustful of scientific and healthcare authorities, they feel less self-effective in managing their own health—both in normal conditions and under stress—and are less prone to cooperate with healthcare professionals. Low levels of health engagement also are associated with a change in the usual purchase behavior.

Conclusions

The Patient Health Engagement model (PHE) provides a useful framework for understanding how people will respond to health threats such as pandemics. Therefore, intervention studies should focus on raising their levels of engagement to increase the effectiveness of educational initiatives intended to promote preventive behaviors.

Introduction

In January 2020, the coronavirus disease 2019 (COVID-19) started to spread in Italy. The virus and its associated disease were given the designation of coronavirus disease 2019 (COVID-19) in February 2020, distinguishing this syndrome from the acute respiratory syndromes associated with 2 other betacoronaviruses (SARS-CoV and Middle East respiratory syndrome corona-virus) that caused earlier outbreaks of severe disease [1,2]. As of March 17, 2020, a total of 31,506 COVID-19 cases with 2503 deaths and 2941 recovered had been reported in Italy (updated Italian situation available at http://www.salute.gov.it/portale/nuovocoronavirus/dettaglioContenutiNuovoCoronavirus.jsp?area=nuovoCoronavirus&id=5351&lingua=italiano&menu=vuoto).

On Jan 30, 2020, the World Health Organization (WHO) declared the coronavirus outbreak a public health emergency of international concern (PHEIC). Starting March 7, 2020, the Italian government adopted very urgent and restrictive measures to slow the virus spread and reduce its potential impact on the population (available at https://www.gazzettaufficiale.it/eli/id/2020/03/08/20A01522/sg). Several cities—identified as “red areas”—have been put under quarantine, hoping to stop the disease from spreading to other parts of the country. This situation is globally unprecedented at least for two main reasons. First, to control the COVID-19 outbreak, governmental authorities have suddenly adopted very extreme public measures such as locking down cities, deeply reorganizing healthcare services to cope with the rapid increasing demand for acute care, imposing school and university closures, suggesting—where possible—smart-working solutions and transportation restrictions, deploying thousands of healthcare workers to more heavily affected regions, and running wide public health messaging campaigns for consumers’ education. Second, consumers are overwhelmed by rather mixed and confounding information, partly because scientific discovery related to COVID-19 disease is constantly evolving with the course of the disease outbreak, and partly due to the rapid increase in misleading or false news. Therefore, all these measures are currently having a deep impact on Italian people’s attitudes, daily habits and consumption behaviors [3].

As in other similar situations, prior to the availability of an effective vaccination therapy, strategies to mitigate and control the impact of the pandemic typically involve “non pharmacological” interventions [4,5], and rely on citizens’ autonomous responses to public health preventive measures. In particular, past literature suggested that people appear to respond to an epidemic by voluntarily undertaking specific behaviors in order to protect themselves [6,7]. However, in some cases, these behaviors may not correspond to an objective evaluation of risk [8,9], but depend on individual subjective evaluations, thus becoming potentially counterproductive. For this reason, there has been a rapid rise of interest in understanding the determinants of people’s behavioral change that may influence the adequacy of the response to health emergencies [10,11]. People dealing with these situations, indeed, may experience negative attitudes, feelings of uncertainties and alarmism [12]. These reactions might potentially end in risky habits and inadequate and disorganized behaviors, both for individuals and the community [13,14], affecting public health outcomes. Therefore, to study the subjective factors implied in such reactions is of much relevance to effectively sensitize the general public and identify high-risk targets [15]. Along with structural and immutable factors such as socio-demographics, scholars have previously attempted to understand the subjective determinants of citizens’ changing attitudes and behaviors in a pandemic emergency. In particular, authors identified risk perception as one of the most relevant variables in determining citizens’ response to global pandemic disease [16,17], among a series of factors such as the perception of economic impact [18]; efficacy beliefs related to health [19]; level of literacy and knowledge elaboration [20,21]. Another important factor identified is the level of subjective anxiety, which influences both citizens’ attitudes towards the emergency disease and consequent preventive behaviors [2224]. Other subjective factors accounting for the changes in peoples’ habits in pandemic emergencies include those related to the perceived effect of one’s individual behavior, such as perceived costs and benefits of preventive behaviors on the disease spread [25,26] or perceived impact of an individual's behavior on other individuals’ outcomes [24,27].

Among other variables accounting for a change in citizens’ attitudes, habits and behaviors, scholars recently have shown the role of health engagement in affecting health-related behaviors and preventive habits [2834]. More specifically, people with high levels of health engagement have been identified as more likely to adopt behavioral change suggestions and to adhere to medical prescriptions [3539]. However, previous literature has also demonstrated how individuals may be in different phases of their process of engagement [29,31,40,41], thus being more or less ready to enact a change in the way they cope with a critical event and comply with prescribed preventive conduct [4245].

In the current COVID-19 outbreak in Italy–as well as in other countries–citizens are experimenting with a life-threatening situation, leading to profound changes in attitudes, habits and behaviors, which also are potentially negative for consumers’ health and virus containment. Making citizens aware of their crucial role in avoiding the rapid spread of the virus and engaging them in the COVID-19 disease preventive process is urgent today both in Italy and around the world.

However, to the best of our knowledge, no previous studies have investigated the role of people’s health engagement in determining citizen attitudes, habits and compliance with containment measures in the event of an health emergency; moreover, previous literature has highlighted the need to apply a validated theoretical framework to the study of these phenomena in order to effectively predict people’s responses to the event and adherence to prescriptions [11].

For these reasons, we conducted a study aimed at understanding citizens’ attitudes and behavioral responses to the current spread of COVID-19 disease in Italy and determining how they changed their daily habits and behaviors according to their level of health engagement. Results of this study will contribute to informing public health communication and targeted consumer education activities.

Theoretical background

The Patient Health Engagement model [29,46] is a recently developed psychological framework that theorizes how individual health engagement results from a continuous emotional and motivational reframing of an individual’s own role perception in the management of a disease (i.e. from passive user of services to active partner of the healthcare system). According to this model, to become engaged means to be emotionally resilient and able to adjust to the health risks and specific requirements. This model also features unique ways of coping with a health crisis, which the Covid-19 disease can be considered today, with the necessary adaptation to the specific context. In particular, the model features four positions: the first position (“Blackout”) is complete disengagement, typically occurring when people feel vulnerable and without control over the perceived risk, psychologically frozen and behaviorally paralyzed. In the case of COVID-19 disease, this position can explain the psychological reaction of all the citizens to the very initial moment of pandemic spread, where the sudden recognition of the uncontrollable disease diffusion changed people’s lives in the most hit countries. Moreover, the sense of helplessness also exposed the citizens to a psychological vulnerability and risk. Next follows the psychological position of “Arousal,” in which people have acquired an initial awareness about their actual situation of health risk but don’t yet have enough knowledge and skills to manage it. They do not accept the impact of preventive requirements on the modification of their daily habits and appear hyper-vigilant over their body signals, disorganized and confused when seeking information on the health situation. In the situation here described, each unexpected news or change in the epidemic situation causes emotional alert and overwhelming emotional response, with disorganized actions and behaviors that can be dysfunctional for health prevention. When individuals succeed in the process of emotional regulation and coping with the stressful condition, they achieve a position of “Adhesion.” In this phase, patients have developed a good psychological adaptation to the critical situation and appear able to manage their psychological distress connected–in this case—to the COVID-19 health emergency. They appear more motivated to comply with medical and preventive prescriptions. In this phase, moreover, patients acquire further skills to effectively manage their risk condition. Finally, when people achieve a complete awareness of the characteristics and consequences of the critical situation, and assume a more responsible position in their behaviors and risk management, they reach the “Eudaimonic project” phase, which features a better, positive and optimistic approach to the situation, with an increased ability to deal with the uncertainty of the moment and a strong motivation to psychologically achieve the sense of a “new normality” (Fig 1), to overcome the current emergency. The model has been translated into a psychometric scale used to measure Patient Health Engagement level (PHE-S), which has been validated in different countries [4749]. The PHE-S also has been cited by different research and clinical groups [34,50,51].

Fig 1. The patient health engagement model.

Fig 1

Methods

Study design and participants

The study here described is a part of a broader project (entitled: “Italian citizens’ food habits monitoring from a consumer psychology perspective”) aimed at monitoring Italian consumers’ habits. In particular, food consumption behaviors, health behaviors, information gathering and trust towards institutions are tracked over time. It is delivered through online surveys repeated and adjusted over time to track changes in consumers’ orientations in relation to the evolving socio-economic situation of the country. In this case, we adapted the survey to explore people’s reactions to the COVID-19 disease emergency and how different levels of health engagement correspond to unique patterns of behaviours. The survey is based on a cross-sectional design and was carried out between February 28 and March 4, 2020. A panel provider company. Norstat s.r.l. (https://norstat.it/), was in charge of the participants’ selection through stratified random sampling, a sampling method that splits the population in smaller groups (strata) based on sociodemographic characteristics and then samples from these subgroups in order to obtain a sample with the same proportions of, for instance, genders as in the general population [52]. To become part of the panel, people are usually first contacted using random digit dialing that is a technique for drawing a sample of households from the frame or set of telephone numbers. Respondents were rewarded through the Norstat system. A sample of 1000 Italians was involved and weighed to be representative of the Italian population for gender, age, employment, geographical area and dimension of urban center of residence, residents from all the different regions of Italy. To be included in the survey, participants are over 18 years old, are able to read and understand Italian and live in Italy. The percentages relating to the Italian population were taken from the website of ISTAT[53]. People belonging to the online panel were carefully screened for authenticity and legitimacy via digital fingerprint and geo-IP-validation from the panel provider. In this study, in order to guarantee data quality, respondents were asked to confirm their demographics. From the 1000 recruited subjects, 32 were excluded because demographic data provided by the respondent and those provided from the panel were inconsistent (there were discrepancies between reported and known gender and/or age). Statistical analyses were hence carried out on a dataset composed of the answers of 968 respondents. All analyses have been carried out with IBM SPSS 23 (release 23.0.0.0).

Ethical statement

Each participant was instructed about the aims of the research and gave written informed consent before starting the questionnaire. By agreeing to start the compilation, participants accepted the informed consent. They were also allowed to drop out from the compilation at any time. As a part of a panel, the GDPR compliance for the participants here involved is guaranteed by Norstat s.r.l. We received the anonymous database for analysis. No participants’ identification detail was provided to researchers. This study has been performed in accordance with the Declaration of Helsinki and has been approved by an independent ethics committee of Università Cattolica del Sacro Cuore in Milan (CERPS—IRB#02–20).

Study measures

As a part of a broader study (see section 2.1), the survey is composed of a core of fixed measures and a pull of ad-hoc items that change according to the contingency occurring during the specific data collection period. In the wave of data collection we report on in this article, ad hoc items related to individuals’ affective and behavioral responses to the COVID-19 pandemic were added. Following are the specific measures:

  • Health engagement: we adopted a revised version of the Patient Health Engagement Scale (PHE-s®) to measure this construct. This measure, developed according to the Patient Health Engagement model [46], assesses the consumers health engagement level, defined as the “people’s psychological readiness and sense of mastery to become active players in their own health management and health risk prevention.” Previous studies demonstrated its robust psychometric proprieties [29], also in other languages [4749]. This scale features five ordinal items reflecting the continuum of engagement described in the four levels of the PHE model. According to the ordinal nature of the PHE-s®, the median score is considered the more reliable index to calculate the final patients’ scoring [29]. According to the score obtained, each respondent result is in one of the four levels of health engagement as described in the PHE model (i.e. blackout, arousal, adhesion, eudaimonic project). The scale is based on the assumption that the score obtained by the person should reflect his/her actual health engagement level. For this study purposes, the PHE- s® was slightly revised in order to adapt the items’ formulation to the specific context of the health emergency. The incipit was revised in order to adapt coherently to the Covid-19 emergency (from “thinking about your health” to “thinking about your health in this emergency”; the formulation of the fifth item was also revised to adapt it to the nature of the subject. For this reason, the psychometric characteristics of the revised version were tested.

  • Attitudinal response towards to the COVID-19 health emergency. In particular, in light of studies on risk processing [54], two elements of risk judgment were measured: (a) risk severity (the perceived potential severity of COVID-19 infection for their own health) on a scale from 1 (not concerned at all) to 10 (very concerned); and (b) risk susceptibility (the perceived likelihood to get COVID-19) on a scale from 1 (very little) to 5 (a lot). Moreover, participants were asked to rate their agreement (from 1, completely disagree, to 5, completely agree) with a series of statements regarding their self-responsibility, self-efficacy in health management, self-efficacy in stress management, the value of partnership in healthcare, trust in science, trust in the National Healthcare System (NHS) and media reliability.

  • Behavioral responses: involving frequency of information seeking from various different medias (TV, newspapers, social networks, scientific journals etc.) on a scale from 1 (never) to 5 (usually). An average was then calculated, in order to obtain an indicator of how much a certain subject was searching for information regarding the virus. Moreover, a series of dichotomous, yes/no questions were asked regarding changes in consumer habits and, in particular, asking whether they had reduced restaurant meals, ethnic restaurant meals, and the purchase of products coming from “red” zones. They were also asked if they “stockpiled” food and first need products. Finally, they were asked a series of questions surveying whether the buying of different products (i.e., fresh food, frozen food, canned food, products for personal disinfection and care, and products for house disinfection) had diminished/remained the same/increased.

A list of all the items included in the present study has been made available in both English and original language in the Supplementary Information along with the dataset.

Statistical analysis

The revised form of PHE scale evaluation

To evaluate the psychometric properties of the revised PHE-s® scale, a Partial Credit Rasch Model (PCM) was performed to check uni-dimensionality and the fit of each item at the construct of interest [55]. In the family of Rasch Models, PCM was chosen because the revised PHE-s® items had more than two response options and they showed different patterns of usage [56,57]. It is reasonable to assume that since the thresholds are different for all the items, i.e., each item has its own unique rating scale structure, the PCM appears the most appropriate model. The parameters of the model are estimated by the maximum likelihood method [58]. Then, the Person Separation Index (PSI) was calculated to evaluate the reliability in the Rasch Model. The PSI is an indicator of the quality of measures and refers to the reproducibility of the measured location of the persons. PSI indicates the degree to which study participants can be differentiated into certain groups (range 0–1). Values for PSI superior to 0.8 are acceptable [59,60].

In particular, to check whether the items fitted the expected model, two items fit mean square (MNSQ) statistics (Infit and Outfit) were computed. If the data fit the Rasch model, the fit statistics should be between 0.6 and 1.4 [61]. Analyses of difficulty and step parameters were conducted to guarantee a sufficient ranking of the different categories of response and to respect the monotonic order. The internal consistency of the items of the revised PHE-s® was assessed using Ordinal Alpha via Empirical Copula Index [62] due to the ordinal nature of the items. A reliability index superior to 0.7, 0.8, 0.9 can be interpreted as acceptable, good and excellent, respectively [63].

Finally, a Confirmatory Factor Analysis (CFA) was performed. Goodness-of-fit indexes (i.e. comparative fit index CFI, root mean square residual RMR and root mean square error of approximation RMSEA) were evaluated. A CFI > .90 was considered a good model fit [64], a RMR < .05 was desirable [65], whereas a RMSEA < .08 indicated an acceptable fit [66].

Attitudinal response towards the COVID-19 health emergency

To explore differences in the perceived Risk Severity and Risk Susceptibility between different health engagement groups, two factorial ANOVA with Risk Severity and Risk Susceptibility as dependent variables and health engagement and “Coming from red zones” as independent variables were carried out, followed by Tuckey HSD post-hoc tests. Tukey HSD post-hoc test was preferred since it is conservative when there are unequal sample sizes.

To explore the difference in self-responsibility, self-efficacy in health management, self-efficacy in stress management, the value of partnership in healthcare, trust in science, trust in the National Healthcare System (NHS) and perceived media reliability among different health engagement groups, a series of univariate Welch’s ANOVA with health engagement as independent variable was carried out followed by Games-Howell post-hoc comparisons. Welch’s ANOVA and G-H post-hoc comparisons were preferred over a classic ANOVA approach to provide a more robust method for data analysis [67] since some dependent variables were violating the assumption of homoscedasticity.

Behavioral responses

A Welch’s ANOVA with Health Engagement as independent variable and Information Seeking as dependent was carried out, followed by Games-Howell post-hoc comparisons to investigate whether people in different health engagement positions show different amounts of media access.

Dichotomous variables were used as dependent variables in a series of multi-variable logistic regressions, with Health Engagement, Risk Susceptibility and Risk Severity as independent variables Wald forward method was selected to automatically exclude non-significant predictors. Health Engagement was used as a categorical variable and hence dummy coded: Eudaimonic Project was used as the 0, the baseline of comparison, for the other two levels. Dependent variables were coded so that “No” was used as the comparison level for “Yes”. Hence, an Odds Ratio > 1 should be interpreted as “more likely to answer yes” and vice-versa.

To assess the association between change in consumer purchase behaviors and different health engagement levels, a series of contingency tables was created. Pearson’s chi-square and Fisher’s exact tests were also carried out to reject the null hypothesis that data are randomly distributed across health engagement levels. As post-hoc, standardized residuals were inspected: standardized residuals are calculated as the difference between observed and expected counts of a cell divided by an estimate of its standard deviation. Since they are asymptotically normally distributed with a mean of 0 and standard deviation of 1 under the null hypothesis of independence, as a general rule of thumb, cells with an absolute value of standard residuals above 2 can be considered to significantly contribute to the general chi-square value [68]. For stockpiling behavior, groups were way too unbalanced to proceed with a logistic regression (Yes = 5.6%); hence, an approach based on contingency tables was preferred.

Results

Sample

Male participants were 473 (48.9%). Mean age was 44 years (SD = 14; range 18–70). For a more detailed description of the study sample, see Table 1.

Table 1. Demographic profiles of the sample (N = 968).

n % study sample % Italian population n % study sample % Italian population
Gender Having a chronic disease
Male 473 48.9 49.3 Yes 174 18.0 -
Female 495 51.1 50.7 No 794 82.0 -
Age Geographical area
18–24 99 10.1 10.0 North-West 253 26.0 26.3
25–34 156 16.1 16.3 North-East 178 18.4 18.6
35–44 209 21.6 21.5 Center 194 20 19.7
45–54 215 22.2 22.7 South and Islands 343 35.4 35.5
55–59 106 11.0 10.8
60–70 183 19.0 18.8
Education Coming from “red zones” of the virus
Middle school or lower 142 14.6 - Yes 294 30.3 -
High school 586 60.6 - No 674 69.7 -
University degree 240 24.8 -
Employment Living centre’s size
Entrepreneur / freelancer 119 12.3 12.4 Up to 10,000 inhabitants 313 32.3 32.1
Manager / official / middle manager 36 3.7 3.8 10,001/100,000 inhabitants 430 44.4 44.0
Employee / teacher / military 170 17.6 19.2 100,001/500,000 inhabitants 102 10.6 10.9
Worker / shop assistant / apprentice 202 20.9 21.0 More than 500,000 inhabitants 117 12.1 12.9
Housewife 146 15.1 15.0 Missing 6 0.6
Student 54 5.5 5.3
Retired 77 7.9 7.9
Unoccupied 147 15.2 15.4
Other 17 1.8

Descriptive statistics

There were no missing data in our dataset. For dichotomous and multiple-choice questions, answer frequencies and “I don’t know” answers are reported -where provided- in Table 2. However, in the following analyses, “I don’t know” was considered as a missing value. For other variables, descriptive statistics are reported in Table 3. Since very few participants resulted being in “Blackout” position, they were grouped together with participants in “Arousal” to facilitate statistical analyses.

Table 2. Frequency distribution of items.

n % n %
Health engagement level Products from the “red zones”
Blackout 11 1.1 Yes 498 51.1
Arousal 207 21.4 No 182 18.8
Adherence 595 61.5 I don’t know (missing) 288 29.7
Eudaimonic Project 155 16.0
Reduced restaurant meals Stockpiling
Yes 323 33.3 Yes 52 5.3
No 645 66.7 No 916 94.7
Reduced ethnic restaurant meals Fresh food
Yes 332 34.2 Diminished 15 1.4
No 636 65.8 Unchanged 872 90.1
Increased 76 7.9
Not buying (missing) 5 .6
Frozen food Personal care
Diminished 13 1.2 Diminished 10 1.0
Unchanged 867 89.6 Unchanged 848 87.6
Increased 69 7.2 Increased 91 9.4
Not buying (missing) 19 1.9 Not buying (missing) 19 2.0
Canned food Personal disinfection
Diminished 17 1.7 Diminished 9 .8
Unchanged 821 84.9 Unchanged 735 76.0
Increased 98 10.1 Increased 185 19.2
Not buying (missing) 32 3.3 Not buying (missing) 39 4.1
House disinfection
Diminished 12 1.3
Unchanged 780 80.6
Increased 142 14.7
Not buying (missing) 34 3.4

Table 3. Descriptive statistics for items.

Variable name Min Max Mean SD Skewness Kurtosis
Risk severity 1 10 6.04 2.48 -.440 -.626
Risk susceptibility 1 5 2.96 1.05 .054 -.511
Self-responsibility 1 5 3.74 .920 -.621 .418
Information seeking 1 5 2.50 .732 .520 -.039
Self-efficacy in health management 1 5 3.77 .719 -.428 .920
Self-efficacy in stress management 1 5 3.76 .763 -.586 .843
Value of partnership in healthcare 1 5 4.06 .732 -.610 .825
Trust in science 1 5 4.09 .874 -.929 .949
Trust in the National Health System 1 5 3.66 .934 -.570 .275
Media reliability 1 5 2.86 1.14 .081 -.662

SD = Standard Deviation.

Psychometric proprieties of the PHE-s® revised version

Table 4 shows the results of the Rasch Analysis to test the psychometric properties of the PHE-s® revised version.

Table 4. Partial credit model and item fit statistics.

Item Location Step 1 Step 2 Step 3 Outfit MSNQ Infit MSNQ
Health Engagement 1 2.462 -1.754 2.008 7.135 1.187 1.085
Health Engagement 2 1.369 -3.139 1.282 5.963 0.682 0.721
Health Engagement 3 0.547 -2.785 1.172 3.254 0.616 0.674
Health Engagement 4 1.075 -2.186 1.081 4.331 0.773 0.728
Health Engagement 5 0.991 -2.531 -0.086 5.591 0.642 0.699

The item statistics ranged from .674 to 1.085 for the infit MSQ and from .616 to 1.187 for the outfit MSQ. These values indicate an acceptable fit of the Rasch Model. The distances between subsequent thresholds showed acceptable distinction between the response options and measurement model fit. The PSI for revised PHE-s® was equal to .851. Rasch Model confirmed the unidimensionality of the revised PHE-s® scale and the fit of each item of the scale to the data.

The revised PHE-s® had a quite good internal consistency, since the value of the Ordinal Alpha via Empirical Copula was equal to .788. Each item contributed significantly to the revised PHE-s® scale score. So, the internal consistency of the revised PHE-s® was satisfactory.

CFA showed reasonable goodness of fit indices. The fit indices met the criteria of fit for the hypothesized one-factor structure. All goodness of fit indices (CFI = 0.994, RMR = 0.008, RMSEA = 0.066) suggested that the model is coherent with the data. The analysis of modification indices did not find any relation between the error covariance of the items. All the standardized to factor loadings ranged from .532 to .820.

Attitudinal response towards to the COVID-19 health emergency

Risk severity

ANOVA results show a significative main effect of Health Engagement on Risk Susceptibility [F(2, 1048) = 185.709; p < .001; η2p = .262]. No other significant main effect or interaction was found. Tukey post-hoc comparisons show that the Arousal group (M = 8.00; SD = 1.71) was more concerned than either the Adhesion group (M = 5.98; SD = 2.09) or the Eudaimonic Project group (M = 3.51; SD = 2.39) with a significance level of 99.9%. Also, the means difference of Adhesion and Eudaimonic Project groups was found to be statistically significant with p < .001.

Risk susceptibility

Results show a significative main effect of Health Engagement on Risk Susceptibility [F(2, 1040) = 150.890; p < .001; η2p = .225]. No other significant main effect or interaction was found. Tukey post-hoc comparisons revealed that the Arousal group (M = 3.73; SD = .87) perceived themselves as more at risk than either the Adhesion group (M = 2.94; SD = .92) or the Eudaimonic Project group (M = 1.97; SD = .906) with a significance of 99.9%. Also the means difference of Adhesion and Eudaimonic Project groups was found to be statistically significant with p < .001.

Orientation towards health management and trust in authorities

ANOVA results show a significant main effect of Health Engagement on Self-Responsibility [F(2, 322.257) = 3.700; p = .026; η2 = .009], Self-Efficacy in Health Management [F(2, 339.819) = 57.382; p < .001; η2 = .113], Self-Efficacy in Stress Management [F(2, 355.911) = 16.497; p < .001; η2 = .032], Value of Partnership in Healthcare [F(2, 344.585) = 9.568; p < .001; η2 = .022], Trust in Science [F(2, 335.022) = 8.158; p = .001; η2 = .018], Trust in NHS [F(2, 337.641) = 9.575; p < .001; η2 = .021] and Media Reliability [F(2, 344.288) = 28.664; p < .001; η2 = .060]. Results of Games-Howell comparisons are reported in Table 5.

Table 5. Results of Games-Howell comparisons.
Dependent variables Engagement Level Comparison
Arousal-Adhesion Arousal-Eudaimonic Adhesion-Eudaimonic
Self-responsibility -.162 (.073) -.274 (.110)* -.112 (.095)
Self-efficacy in health management -.326 (.057)*** -.791 (.074)*** -.465 (.060)***
Self-efficacy in stress management -.122 (.059) -.434 (.077)*** -.312 (.066)***
Value of partnership in healthcare -.205 (.062)** -.335 (.078)*** -.130 (.062)
Trust in science -.218 (.071)** -.378 (.099)** -.160 (.081)
Trust in the National Health System -.245 (.072)** -.425 (.104)** -.181 (.091)
Media -.352 (.084)*** -.911 (.120)*** -.559 (.107)***

values in cells are differences in means. Standard errors are reported in brackets. Significance in marked with asterisks

(* sig. at p < .05

** sig. at p < .01

***sig at p < .001).

Behavioral responses

Information seeking

ANOVA results show a significant main effect of Health Engagement on Information Seeking [F(2, 334.095) = 29.344; p < .001; η2 = .064]. G-H comparisons showed that the amount of Information Seeking differed significantly among all the different levels: in particular, results showed that people in Arousal search significantly more information (M = 2.79; SD = .74) than people in either Adhesion (M = 2.47; SD = .68) or Eudaimonic project (M = 2.20; SD = .77). The comparison between Adhesion and Eudaimonic project was significantly different as well.

Consumer habits and purchasing behaviors

Results of the logistic regressions are reported in Table 6. In particular, results show that higher levels of Risk Severity and Risk Susceptibility are associated with a higher probability of having reduced meals outside in both generic and ethnic restaurants. Perceived Risk Severity is also a predictor of the willingness to buy products coming from “red zones” (higher perceived Severity increases the probability of not being willing to buy). Results also show that Health Engagement (HE) levels predict having reduced meals outside (lower levels of engagement have a higher probability) and of being willing to buy “red zone” products (lower engagement, lower probability).

Table 6. Results of logistic regressions.
Behaviors Variables B S.E. Wald P Odds Ratio
Reduced restaurant meals Nagelkerke’s R2 = .232 Correctly predicted: 72.0% Chi-square = 174.63 (d.f. = 4), p < .001 Health Engagement 15.176 .001
Health Engagement (Arousal) .823 .321 6.579 .010 2.277
Health Engagement (Adhesion) .110 .275 .161 n.s.
Risk Severity .244 .047 27.441 < .001 1.276
Risk Susceptibility .285 .097 8.526 .004 1.329
Reduced ethnic restaurant meals Nagelkerke’s R2 = .170 Correctly predicted: 70.1% Chi-square = 124.92 (d.f. = 4), p < .001 Health Engagement 11.449 .003
Health Engagement (Arousal) .799 .309 6.703 .010 2.223
Health Engagement (Adhesion) .210 .260 .651 n.s.
Risk Severity .195 .044 19.638 < .001 1.216
Risk Susceptibility .221 .094 5.029 .025 1.235
Products from the “red zones” Nagelkerke’s R2 = .146 Correctly predicted: 75.5% Chi-square = 70.954 (d.f. = 3), p < .001 Health Engagement 12.032 .002
Health Engagement (Arousal) -1.313 .408 10.372 .001 .269
Health Engagement (Adhesion) -.681 .349 3.808 .051 .506
Risk Severity -.190 .047 16.365 < .001 .827

df = degrees of freedom; HE = Health Engagement; S.E. = Standard Error; P = p-value.

Results of contingency tables are reported in Table 7. Pearson’s chi-squared analysis and the inspection of standardized residuals show that different levels of Health Engagement are associated with different consumer behaviors: in particular, our results show that lower levels of engagement are more frequently associated with stockpiling, and with an increased consumption of fresh, canned and frozen food, and with products for disinfection when compared with average and high levels of engagement.

Table 7. Results of contingency tables.
Variables Answers Cell Health Engagement level Row Total
Arousal Adhesion Eudaimonic project
Stockpiling Chi-square = 23.659(df = 2), p < .001 Fisher = 20.989, p < .001 No Observed 192 570 153 915
Expected 205.5 562.6 146.8
Std res. -.9 .3 .5
Yes Observed 25 24 2 51
Expected 11.5 31.4 8.2
Std res. 4.0 -1.3 -2.2
CT 217 594 155
Fresh food Chi-square = 23.562(df = 4), p < .001 Fisher = 20.419, p < .001 Diminished Observed 3 10 1 14
Expected 3.1 8.6 2.2
Std res. -.1 .5 -.8
Unchanged Observed 179 547 145 871
Expected 195.1 538.0 137.9
Std res. -1.2 .4 -.6
Increased Observed 33 36 6 75
Expected 16.8 46.3 11.9
Std res. 4.0 -1.5 -1.7
CT 215 593 152
Canned food Chi-square = 44.238(df = 4), p < .001 Fisher = 39.352, p < .001 Diminished Observed 4 7 5 16
Expected 3.6 9.9 2.5
Std res. .2 -.9 1.6
Unchanged Observed 159 526 136 821
Expected 183.7 508.1 129.2
Std res. -1.8 .8 .6
Increased Observed 46 45 6 95
Expected 21.7 60.0 15.3
Std res. 5.2 -1.9 -2.4
CT 212 580 146
Frozen food Chi-square = 41.970(df = 4), p < .001 Fisher = 36.015, p < .001 Diminished Observed 4 6 2 12
Expected 2.7 7.4 1.9
Std res. .8 -.5 .1
Unchanged Observed 173 549 145 867
Expected 195.5 533.5 138.0
Std res. -1.6 .7 .6
Increased Observed 37 29 4 70
Expected 15.8 43.1 11.1
Std res. 5.3 -2.1 -2.1
CT 214 584 151
Personal disinfection Chi-square = 61.148(df = 4), p < .001 Fisher = 57.087, p < .001 Diminished Observed 3 3 2 8
Expected 1.8 4.9 1.3
Std res. .9 -.9 .7
Unchanged Observed 127 477 131 735
Expected 166.1 452.6 116.3
Std res. -3.0 1.1 1.4
Increased Observed 80 92 14 186
Expected 42 114.5 29.4
Std res. 5.9 -2.1 -2.8
CT 210 572 147
Home disinfection Chi-square = 73.370(df = 4), p < .001 Fisher = 64.274, p < .001 Diminished Observed 4 7 2 13
Expected 2.9 8.0 2.0
Std res. .6 -.4 .0
Unchanged Observed 137 509 134 780
Expected 176.9 480.5.6 122.6
Std res. -3.1 1.4 1.0
Increased Observed 71 60 11 142
Expected 32.3 87.5 22.3
Std res. 6.8 -2.9 -2.4
CT 214 576 144
Personal care Chi-square = 54.049(df = 4), p < .001 Fisher = 46.845, p < .001 Diminished Observed 3 5 2 10
Expected 2.3 6.2 1.5
Std res. .5 -.5 .4
Unchanged Observed 164 544 139 847
Expected 192.1 524.5 130.4
Std res. -2.0 .9 .7
Increased Observed 48 38 5 91
Expected 20.6 56.3 14.0
Std res. 6.0 -2.4 -2.4
CT 215 587 146

CT = Column Total; Std res = standard residues¸ df = degrees of freedom. Cells with an absolute value of std. res >2 are marked in bold.

Discussion

By the end of February 2020, the diffusion of the COVID-19 epidemics in northern Italy had forced health authorities to embrace restrictive preventive measures that impacted Italian citizens’ daily habits and consumption behaviors. Enforcing compliance with such measures was crucial at that time in order to enhance their effectiveness and to sustain the sustainability of the healthcare system. However, this sudden change caused huge reactions by Italian citizens: many of them experienced panic and enacted maladaptive behaviors (for example the migration from north to south Italy immediately after the Lombardy region lockdown, which was initially considered a “red zone”; also, food stockpiling happened soon after the first cases of Covid-19 disease came out, which created negative consequences for the food chain organization). In this scenario, the Italian citizens’ reactions to the COVID-19 emergency measures, from the scientific perspective, is an interesting and unique platform to demonstrate the value of making citizens engaged as actual partners of the healthcare system to safeguard both individual and collective health. Therefore, we consider the current COVID-19 outbreak in Italy as a valuable “testing ground” for consumer education initiatives aimed at sustaining their health engagement and compliance with the prescribed behavioral changes. Existing research has focused on demographic and immutable and subjective factors that influence how people are likely to behave in a pandemic [6971]. Furthermore, previous research on responses to pandemics has been largely a-theoretical [11]. Therefore, all these studies provide valuable insights into how different segments of the population are likely to respond, but do not tell us why they respond in this way. The current study adopted the theoretical lens of the Patient Health Engagement Model (PHE) to explain–from a psychosocial perspective—people’s responses through the first wave of the COVID-19 pandemic in Italy. This theory states that individuals are more or less likely to change their behaviors according to their own subjective perceptions about the role (more or less active) they might play in their health and care [46].

The Patient Health Engagement Model (PHE) provides a potentially useful framework for understanding how people will respond to health threats such as pandemics and related prescribed preventive measures imposed by healthcare authorities. The PHE model proposes that people’s adaptive behavioral and emotional responses to protect themselves from a health threat are influenced by their level of health engagement–that is a progressive reframing of individuals’ own roles within the healthcare system (i.e. from passive users of services to active partners of the healthcare system) [46]. In this study, we employed and evaluated the psychometric properties of a revised version of the PHE-s® to measure citizens’ health engagement. This revised version showed good psychometric properties for our representative sample.

According to the study results, Italian citizens seems to be more concerned about the health emergency than not, even though not extremely worried (on a scale from 1 to 10, the average is around 6) and not feeling exceedingly at risk of being infected (the 5-point Likert shows a normaloid distribution with mean around the central point), confirming previous studies in other similar settings [9,72,73]. Nevertheless, it is important to notice how different health engagement profiles are associated with different levels of both perceived risk severity and susceptibility: indeed, less engaged people (rated as in “Blackout” and “Arousal”) show significantly higher levels of perceived susceptibility to and perceived risk of the infection when compared with highly engaged ones (rated as in “Adhesion” and “Eudaimonic Project”), regardless of the geographical area of origin (“red zone” or not), which surprisingly wasn’t found to be associated with different levels of susceptibility and severity. This seems to support that people differ in their ability to psychologically master their worries related to the COVID-19 epidemic, and this explains the consequent more or less adherence to the change in behaviors imposed by the health authorities. This interpretation is confirmed also by the fact that people with different levels of health engagement show different attitudinal responses to the emergency: in particular, when compared to people with higher levels of health engagement, less engaged people are less trusting of scientific and healthcare authorities, they feel less self-effective in managing their own health—both in normal conditions and under stress—and are less prone to cooperate with healthcare professionals [74]. These results confirm previous studies on Influenza A (H1N1), which demonstrated that if perceived severity and susceptibility are high but response and self-efficacy are low, maladaptive responses (e.g. denying the existence of a threat) are likely to ensue [75]. The perceived self-efficacy in health management and a sentiment of mistrust towards authorities may actually help in understanding why a less engaged person feels more concerned and worried about the new COVID-19 emergency: they seek more information, potentially exposing themselves to fake or over-hyped news, since they are also prone to feel that news regarding the emergency is reliable; nevertheless, they mistrust scientific research and the capacity of the NHS to cope with the pandemic and feel less capable of taking care of themselves. Furthermore, low levels of health engagement may demonstrate that people do not consider themselves ready to be active partners of the healthcare systems, being more focused on their own health interests and need and not inclined to collaborate and trust the healthcare system to achieve a common public health goal.

The health engagement construct also seems to be a predictor of behavioral responses to the emergency. Generally speaking, a substantial part of our sample reported a change in their habits: one out of three Italian citizens reported having fewer meals outside and/or meals in ethnic restaurants, while 20% declared that they would not buy products coming from “red zones.” Indeed, while risk severity and risk susceptibility are clearly strong predictors, logistic models show that people with lower levels of health engagement are more than twice as likely as people with higher level of health engagement to have reduced either meals or ethnic meals outside their home. It’s important to notice that data have been collected at a moment when the emergency was still away from its peak and guidelines were not forbidding people from moving freely or from having meals in restaurants. These results could be interpreted as in line with previous studies underlining that when unknown diseases are thought to be lethal, people are inclined to blame the outbreaks on someone, or some group of people, who live outside of their own social sphere, as a mechanism to cope with fear and risk perception [76]. In this research, it appears clear that this form of “moral panic” [77] had a halo effect also on products and restaurants people naively thought were guilty in the Covid-19 disease spread, or that were related to the “infected zone.” Such lay interpretation of disease transmission, together with the difficulty of finding reliable information in a first phase of health emergency, has an impact on people’s habits and consumptions, and clear consequences for the local enterprises’ economy. A similar case occurred with the H5N1 Avian Influenza on food consumption, when the poultry industry suffered severe losses due to a sort of “halo effect” in consumer perception of risk, even after the emergency was over [78,79].

Despite these results, with respect to buying behaviours, our data show that generally, most people didn’t actually change their habits, in line with other studies [80]: most people didn’t stockpile goods or increase the purchase of the goods we considered in our survey. Nevertheless, crosstabs show that amongst those who stockpiled goods and increased the purchase of food (fresh, frozen or canned) and disinfection products (in particular regarding home disinfection), there is a significantly higher presence of lower engaged consumers. This evidence is in line with other studies [8183] that showed how personal reaction to the critical event can feed behavioral changes, with many people making significant changes in their consumption behaviors like anticipating the purchasing of goods [84,85]. As food consumption is recognized as a primary need for individuals, it is strongly influenced by the subjective interpretation of risk and the possible scarcity [86]. For this reason, these results appear interesting in giving a sense of how people orient their food purchase in the case of emergency in relation to their engagement level [87,88]. Furthermore, it appears evident that people with a low level of health engagement, not being psychologically ready to consider the social and public health consequences of their conduct, appear more focused on their own health interests and less keen to rely on health authorities’ guidelines to orient their behaviors [3,89]. For instance, the behavior of stockpiling goods carried out by the less engaged Italian citizens had a negative organizational impact on food supplies, which further compromised the delicate situation of the Italian population. Furthermore, the overcrowding at superstores in the situation of the COVID-19 epidemic was highly counterproductive and contributed to spreading the risk of contagion.

Limitations and future studies

The study measured a specific population’s views at a specific point in time; their beliefs and attitudes reflect the information available at the time and therefore are not stable. Second, results were self-reported and data were collected through a broader continuative online-based survey: measurement errors, unreliable answers and social desirability bias may have partially altered results, as is generally the case in these kinds of studies. Finally, this study relies on several ad hoc items, specifically developed for our research questions but not validated; regardless of our effort to make them clear and non-ambiguous, it is still possible that some participants may have misinterpreted them. Two items in particular (those regarding reduced meals in restaurants and ethnic restaurants) may raise some concerns as participants were not given the option to answer that they never go to (ethnic) restaurants.

Future research should test the Patient Health Engagement Model as a predictor of particular preventive behaviors in different socio-cultural contexts. This model is indeed relatively young and current evidence about its applicability has been carried out mainly by the same research group who developed it. Further studies are needed to consolidate it and to confirm the reliability of the results on the larger Italian population. In addition, it is important to carry out further behavioral research where actual behavior can be measured, not only self-reported.

Practical implications

This study has provided evidence about the role of health engagement as a determinant of citizens’ behavioral change, which is key for controlling the spread of pandemic disease, and has described a conceptual framework–i.e. the Patient Health Engagement Model—in which to better understand these behaviors [90]. In sum, the study shows that health engagement levels are predictive of different responses, both affective and behavioral: playing an active role in health management is associated with a higher chance of performing specific behaviors. In particular, the psychological readiness to assume a proactive role in their own health prevention depends on the individuals’ tendency to be more or less able to comply with health authorities’ prescriptions and to perceive themselves as mainly responsible for their own health and the health of their community. Furthermore, the psychological readiness to engage in health is a crucial factor for explaining the different way in which individuals can cope with their worries about a health emergency. The findings suggest that intervention studies should focus on particular groups and on raising their levels of engagement to increase the effectiveness of educational initiatives designed to promote preventive behaviors. Communication strategies should maximize their impact by targeting messages according to the health engagement levels of citizens. For instance, in order to improve the levels of engagement of citizens in a “psychological blackout,” reassuring messages aimed at sustaining the emotional elaboration of the emergency and related worries would be particularly needed. For those citizens, psychological counselling and positive emotions facilitated by a social campaign also are suggested. To enhance the motivation to stay engaged, citizens in a situation of “psychological adherence” would need positive stories of other persons who succeeded in adhering to the prescribed containment measures. For instance, video testimony of peers able to describe how they successfully coped with the emergency, sharing tips and advice. Finally, people in the position of “Eudaimonic Project,” who were able to develop a new sense of normality despite the serious emergency, can be involved in peer-to-peer communication initiatives, becoming advocates for the correct engagement in adhering to the prescribed measures to face the COVID-19 epidemic. Furthermore, this target group could be further engaged in an open and accountable debate with healthcare authorities to better understand the rationale of some decisions about containment measures and to contribute raising their voice to orient them. Furthermore, fostering the psychological readiness to get engaged in health prevention appears to be a crucial goal for educational and communication initiatives in the event of a health emergency. Carrying out this work now will be invaluable in preparing for this and future pandemics. Listening to consumers’ concerns and expectations in an emergency situation is the base for building a collaborative space where health authorities and civic communities can all contribute to the best management of the situation. Measuring the levels of health engagement of citizens may be considered as a vital parameter for healthcare authorities in order to best orient educational initiatives and supports able to sustain citizens’ adherence to the preventative measures.

Supporting information

S1 Appendix. Survey coronavirus Eng.

Study survey–English version,

(DOCX)

S2 Appendix. Survey coronavirus ITA.

Study survey–Italian version.

(DOCX)

S3 Appendix

(PDF)

S1 File. Coronavirus Eng.

Study original dataset.

(SAV)

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This study was conducted within the CRAFT project, funded by Fondazione Cariplo & Regione Lombardia.

References

  • 1.Cao J, Hu X, Cheng W, Yu L, Tu WJ, Liu Q. Clinical features and short-term outcomes of 18 patients with corona virus disease 2019 in intensive care unit. Intensive Care Medicine. 2020. 10.1007/s00134-020-05987-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Cao J, Tu WJ, Cheng W, Yu L, Liu YK, Hu X, et al. Clinical Features and Short-term Outcomes of 102 Patients with Corona Virus Disease 2019 in Wuhan, China. Clin Infect Dis. 2020. 10.1093/cid/ciaa243 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Barello S, Nania T, Dellafiore F, Graffigna G, Caruso R. ‘Vaccine hesitancy’ among university students in Italy during the COVID-19 pandemic. Eur J Epidemiol. 2020. 10.1007/s10654-020-00670-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Godoy P, Castilla J, Delgado-Rodríguez M, Martín V, Soldevila N, Alonso J, et al. Effectiveness of hand hygiene and provision of information in preventing influenza cases requiring hospitalization. Prev Med (Baltim). 2012;54: 434–439. 10.1016/j.ypmed.2012.04.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Ferguson NM, Cummings DAT, Fraser C, Cajka JC, Cooley PC, Burke DS, et al. Strategies for mitigating an influenza pandemic. Nature. 2006. 10.1038/nature04795 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Fenichela EP, Castillo-Chavezb C, Ceddiac MG, Chowellb G, Gonzalez Parrae PA, Hickling GJ, et al. Adaptive human behavior in epidemiological models. Proc Natl Acad Sci U S A. 2011. 10.1073/pnas.1011250108 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Funk S, Salathé M, Jansen VAA. Modelling the influence of human behaviour on the spread of infectious diseases: A review. Journal of the Royal Society Interface. 2010. 10.1098/rsif.2010.0142 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Fenichel EP, Kuminoff N V., Chowell G. Skip the Trip: Air Travelers’ Behavioral Responses to Pandemic Influenza. PLoS One. 2013;8 10.1371/journal.pone.0058249 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Leppin A, Aro AR. Risk perceptions related to SARS and avian influenza: Theoretical foundations of current empirical research. Int J Behav Med. 2009;16: 7–29. 10.1007/s12529-008-9002-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Kass NE, Otto J, O’Brien D, Minson M. Ethics and severe pandemic influenza: Maintaining essential functions through a fair and considered response. Biosecurity and Bioterrorism. 2008. 10.1089/bsp.2008.0020 [DOI] [PubMed] [Google Scholar]
  • 11.Bish A, Michie S. Demographic and attitudinal determinants of protective behaviours during a pandemic: A review. Br J Health Psychol. 2010;15: 797–824. 10.1348/135910710X485826 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Jin Y, Pang A, Cameron GT. Toward a Publics-Driven, Emotion-Based Conceptualization in Crisis Communication: Unearthing Dominant Emotions in Multi-Staged Testing of the Integrated Crisis Mapping (ICM) Model. J Public Relations Res. 2012. 10.1080/1062726X.2012.676747 [DOI] [Google Scholar]
  • 13.Zhang Y, Yang H, Cheng P, Luqman A. Predicting consumers’ intention to consume poultry during an H7N9 emergency: an extension of the theory of planned behavior model. Hum Ecol Risk Assess. 2020. 10.1080/10807039.2018.1503931 [DOI] [Google Scholar]
  • 14.Mossong J, Hens N, Jit M, Beutels P, Auranen K, Mikolajczyk R, et al. Social contacts and mixing patterns relevant to the spread of infectious diseases. PLoS Med. 2008. 10.1371/journal.pmed.0050074 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Lau JTF, Griffiths S, Au DWH, Choi KC. Changes in knowledge, perceptions, preventive behaviours and psychological responses in the pre-community outbreak phase of the H1N1 epidemic. Epidemiol Infect. 2011;139: 80–90. 10.1017/S0950268810001925 [DOI] [PubMed] [Google Scholar]
  • 16.Brug J, Aro AR, Richardus JH. Risk perceptions and behaviour: Towards pandemic control of emerging infectious diseases: Iional research on risk perception in the control of emerging infectious diseases. Int J Behav Med. 2009;16: 3–6. 10.1007/s12529-008-9000-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Poletti P, Ajelli M, Merler S. The effect of risk perception on the 2009 H1N1 pandemic influenza dynamics. PLoS One. 2011. 10.1371/journal.pone.0016460 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Smith RD. Responding to global infectious disease outbreaks: Lessons from SARS on the role of risk perception, communication and management. Soc Sci Med. 2006;63: 3113–3123. 10.1016/j.socscimed.2006.08.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.De Zwart O, Veldhuijzen IK, Elam G, Aro AR, Abraham T, Bishop GD, et al. Perceived threat, risk perception, and efficacy beliefs related to SARS and other (emerging) infectious diseases: Results of an international survey. Int J Behav Med. 2009. 10.1007/s12529-008-9008-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Brug J, Aro AR, Oenema A, De Zwart O, Richardus JH, Bishop GD. SARS risk perception, knowledge, precautions, and information sources, the Netherlands. Emerg Infect Dis. 2004. 10.3201/eid1008.040283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Vartti AM, Oenema A, Schreck M, Uutela A, De Zwart O, Brug J, et al. SARS knowledge, perceptions, and behaviors: A comparison between finns and the dutch during the SARS outbreak in 2003. Int J Behav Med. 2009. 10.1007/s12529-008-9004-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Cowling BJ, Ng DMW, Ip DKM, Liao Q, Lam WWT, Wu JT, et al. Community Psychological and Behavioral Responses through the First Wave of the 2009 Influenza A(H1N1) Pandemic in Hong Kong. J Infect Dis. 2010;202: 867–876. 10.1086/655811 [DOI] [PubMed] [Google Scholar]
  • 23.Jones JH, Salathé M. Early assessment of anxiety and behavioral response to novel swine-origin influenza a(H1N1). PLoS One. 2009;4: 2–9. 10.1371/journal.pone.0008032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Rubin GJ, Amlôt R, Page L, Wessely S. Public perceptions, anxiety, and behaviour change in relation to the swine flu outbreak: Cross sectional telephone survey. BMJ. 2009;339: 156 10.1136/bmj.b2651 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Chapman GB, Coups EJ. Predictors of influenza vaccine acceptance among healthy adults. Prev Med (Baltim). 1999. 10.1006/pmed.1999.0535 [DOI] [PubMed] [Google Scholar]
  • 26.Ritvo P, Wilson K, Willms D, Upshur R. Vaccines in the public eye. Nature Medicine. 2005. 10.1038/nm1220 [DOI] [PubMed] [Google Scholar]
  • 27.Ibuka Y, Chapman GB, Meyers LA, Li M, Galvani AP. The dynamics of risk perceptions and precautionary behavior in response to 2009 (H1N1) pandemic influenza. BMC Infect Dis. 2010. 10.1186/1471-2334-10-296 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Coulter A. Patient engagement-what works? J Ambul Care Manage. 2012. 10.1097/JAC.0b013e318249e0fd [DOI] [PubMed] [Google Scholar]
  • 29.Graffigna G, Barello S, Bonanomi A, Lozza E. Measuring patient engagement: Development and psychometric properties of the patient health engagement (PHE) scale. Front Psychol. 2015;6: 1–10. 10.3389/fpsyg.2015.00274 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Barello S, Graffigna G, Vegni E. Patient Engagement as an Emerging Challenge for Healthcare Services: Mapping the Literature. Nurs Res Pract. 2012. 10.1155/2012/905934 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Gruman J, Rovner MH, French ME, Jeffress D, Sofaer S, Shaller D, et al. From patient education to patient engagement: Implications for the field of patient education. Patient Educ Couns. 2010. 10.1016/j.pec.2010.02.002 [DOI] [PubMed] [Google Scholar]
  • 32.Tzeng H-M, Pierson JM. What are the highly important and desirable patient engagement actions for self-care as perceived by individuals living in the southern United States? Patient Prefer Adherence. 2017;Volume 11: 181–191. 10.2147/PPA.S127519 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Al-Tannir M, AlGahtani F, Abu-Shaheen A, Al-Tannir S, AlFayyad I. Patient experiences of engagement with care plans and healthcare professionals’ perceptions of that engagement. BMC Health Serv Res. 2017;17: 853 10.1186/s12913-017-2806-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Pekonen A, Eloranta S, Stolt M, Virolainen P, Leino-Kilpi H. Measuring patient empowerment–A systematic review. Patient Educ Couns. 2020;103: 777–787. 10.1016/j.pec.2019.10.019 [DOI] [PubMed] [Google Scholar]
  • 35.Graffigna G, Barello S, Bonanomi A. The role of Patient Health Engagement model (PHE-model) in affecting patient activation and medication adherence: A structural equation model. PLoS One. 2017;12 10.1371/journal.pone.0179865 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Graffigna G, Barello S, Bonanomi A, Riva G. Factors affecting patients’ online health information-seeking behaviours: The role of the Patient Health Engagement (PHE) Model. Patient Educ Couns. 2017. 10.1016/j.pec.2017.05.033 [DOI] [PubMed] [Google Scholar]
  • 37.Hill AM, Etherton-Beer C, Haines TP. Tailored Education for Older Patients to Facilitate Engagement in Falls Prevention Strategies after Hospital Discharge-A Pilot Randomized Controlled Trial. PLoS One. 2013. 10.1371/journal.pone.0063450 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Woehrle H, Arzt M, Graml A, Fietze I, Young P, Teschler H, et al. Effect of a patient engagement tool on positive airway pressure adherence: analysis of a German healthcare provider database. Sleep Med. 2018;41: 20–26. 10.1016/j.sleep.2017.07.026 [DOI] [PubMed] [Google Scholar]
  • 39.Zullig LL, Bosworth H. Engaging Patients to Optimize Medication Adherence. NEJM Catal. 2017;14: 1–14. Available: https://catalyst.nejm.org/optimize-patients-medication-adherence/ [Google Scholar]
  • 40.Hibbard JH, Mahoney E. Toward a theory of patient and consumer activation. Patient Educ Couns. 2010. 10.1016/j.pec.2009.12.015 [DOI] [PubMed] [Google Scholar]
  • 41.Laforge RG, Rossi JS, Prochaska JO, Velicer WF, Levesque DA, McHorney CA. Stage of regular exercise and health-related quality of life. Prev Med (Baltim). 1999. 10.1006/pmed.1998.0429 [DOI] [PubMed] [Google Scholar]
  • 42.McDonald EM, Frattaroli S, Edsall Kromm E, Ma X, Pike M, Holtgrave D. Improvements in health behaviors and health status among newly insured members of an innovative health access plan. J Community Health. 2013. 10.1007/s10900-012-9615-3 [DOI] [PubMed] [Google Scholar]
  • 43.Harvey L, Fowles JB, Xi M, Terry P. When activation changes, what else changes? The relationship between change in patient activation measure (PAM) and employees’ health status and health behaviors. Patient Educ Couns. 2012. 10.1016/j.pec.2012.02.005 [DOI] [PubMed] [Google Scholar]
  • 44.Fowles JB, Terry P, Xi M, Hibbard J, Bloom CT, Harvey L. Measuring self-management of patients’ and employees’ health: Further validation of the Patient Activation Measure (PAM) based on its relation to employee characteristics. Patient Educ Couns. 2009. 10.1016/j.pec.2009.02.018 [DOI] [PubMed] [Google Scholar]
  • 45.Lubetkin EI, Lu WH, Gold MR. Levels and correlates of patient activation in health center settings: Building strategies for improving health outcomes. J Health Care Poor Underserved. 2010. 10.1353/hpu.0.0350 [DOI] [PubMed] [Google Scholar]
  • 46.Graffigna G, Barello S. Spotlight on the patient health engagement model (PHE model): A psychosocial theory to understand people’s meaningful engagement in their own health care. Patient Preference and Adherence. 2018. 10.2147/PPA.S145646 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Zhang Y, Graffigna G, Bonanomi A, Choi K, Barello S, Mao P, et al. Adaptation and Validation of a Chinese Version of Patient Health Engagement Scale for Patients with Chronic Disease. Front Psychol. 2017;8 10.3389/fpsyg.2017.00104 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Magallares A, Graffigna G, Barello S, Bonanomi A, Lozza E. Spanish adaptation of the Patient Health Engagement scale (S.PHE-s)in patients with chronic diseases. Psicothema. 2017;29: 408–413. 10.7334/psicothema2017.75 [DOI] [PubMed] [Google Scholar]
  • 49.Usta D, Korkmaz F, Akyar İ, Bonanomi A. Hasta Katılımı Ölçeği: Kronik hastalığı olan hastalarda Türkçe geçerlik ve güvenirlik çalışması. Cukurova Med J. 2019;44: 1055–1063. 10.17826/cumj.482420 [DOI] [Google Scholar]
  • 50.Kondylakis H, Bucur A, Crico C, Dong F, Graf N, Hoffman S, et al. Patient empowerment for cancer patients through a novel ICT infrastructure. J Biomed Inform. 2020. 10.1016/j.jbi.2019.103342 [DOI] [PubMed] [Google Scholar]
  • 51.Golubinski V, Oppel E-M, Schreyögg J. A systematic scoping review of psychosocial and psychological factors associated with patient activation. Patient Educ Couns. 2020. 10.1016/j.pec.2020.05.005 [DOI] [PubMed] [Google Scholar]
  • 52.Parsons VL. Stratified Sampling. Wiley StatsRef: Statistics Reference Online. Chichester, UK: John Wiley & Sons, Ltd; 2017. pp. 1–11. 10.1002/9781118445112.stat05999.pub2 [DOI] [Google Scholar]
  • 53.ISTAT. No Title.
  • 54.Griffin RJ, Dunwoody S, Neuwirth K. Proposed model of the relationship of risk information seeking and processing to the development of preventive behaviors. Environmental Research. 1999. 10.1006/enrs.1998.3940 [DOI] [PubMed] [Google Scholar]
  • 55.Andrich D. A structure of index and causal variables. Rasch Measurement Transactions. 2014. pp. 1475–1477. [Google Scholar]
  • 56.Masters GN. A rasch model for partial credit scoring. Psychometrika. 1982;47: 149–174. 10.1007/BF02296272 [DOI] [Google Scholar]
  • 57.Bonanomi A, Osmetti SA. THE RASCH MODEL FOR VICTIMIZATION ANALYSIS: A PROPOSAL OF AN INSECURITY PERCEPTION INDEX. Electron J Appl Stat Anal Decis Support Syst Serv Eval. 2012;3: 75–85. 10.1285/i2037-3627v3n1p75 [DOI] [Google Scholar]
  • 58.Andrich D, Sheridan B, Lyne A, Luo G. RUMM: A windows-based item analysis program employing Rasch unidimensional measurement models. Perth, Australia: Murdoch University. Perth, WA; 2000. [Google Scholar]
  • 59.Wright BD, Masters GN. Rating Scale Analysis. Advances in Measurement in Educational Research and Assessment. Chicago, IL: MESA Press; 1982. [Google Scholar]
  • 60.Prieto L, Alonso J, Lamarca R. Classical Test Theory versus Rasch analysis for quality of life questionnaire reduction. Health Qual Life Outcomes. 2003;1: 27 10.1186/1477-7525-1-27 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Wright BD, Linacre JM, Gustafson JE, Martin-Lof P. Reasonable mean-square fit values. Rasch Meas Trans. 1994;8: 370. [Google Scholar]
  • 62.Bonanomi A, Cantaluppi G, Nai Ruscone M, Osmetti SA. A new estimator of Zumbo’s Ordinal Alpha: a copula approach. Qual Quant. 2015;49: 941–953. 10.1007/s11135-014-0114-8 [DOI] [Google Scholar]
  • 63.Gliem JA, Gliem RR. Calculating, Interpreting, and Reporting Cronbach’s Alpha Reliability Coefficient for Likert-Type Scales. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education. Columbus, OH, USA: The Ohio State University press; 2003.
  • 64.Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107: 238. [DOI] [PubMed] [Google Scholar]
  • 65.Jöreskog KG, Sörbom D, Lisrel VI. Analysis of linear structural relationship by maximum likelihood. Chicago: Scientific Software; 1984. [Google Scholar]
  • 66.MacCallum RC, Browne MW, Sugawara HM. Power analysis and determination of sample size for covariance structure modeling. Psychol Methods. 1996;1: 130. [Google Scholar]
  • 67.Delacre M, Leys C, Mora YL, Lakens D. Taking Parametric Assumptions Seriously: Arguments for the Use of Welch’s F-test instead of the Classical F-test in One-Way ANOVA. Int Rev Soc Psychol. 2019. 10.5334/irsp.198 [DOI] [Google Scholar]
  • 68.Haberman SJ. The Analysis of Residuals in Cross-Classified Tables. Biometrics. 1973. 10.2307/2529686 [DOI] [Google Scholar]
  • 69.F J., S P., K. MC. Gender, race, and perception of environmental health risks. Risk Anal. 1994. [DOI] [PubMed] [Google Scholar]
  • 70.Balinska M, Rizzo C. Behavioural responses to influenza pandemics. PLoS Currents. 2009. 10.1371/currents.RRN1037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Tooher R, Collins JE, Street JM, Braunack-Mayer A, Marshall H. Community knowledge, behaviours and attitudes about the 2009 H1N1 Influenza pandemic: A systematic review. Influenza Other Respi Viruses. 2013. 10.1111/irv.12103 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Kristiansen IS, Halvorsen PA, Gyrd-Hansen D. Influenza pandemic: Perception of risk and individual precautions in a general population. Cross sectional study. BMC Public Health. 2007. 10.1186/1471-2458-7-48 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Balkhy HH, Abolfotouh MA, Al-Hathlool RH, Al-Jumah MA. Awareness, attitudes, and practices related to the swine influenza pandemic among the Saudi public. BMC Infect Dis. 2010. 10.1186/1471-2334-10-42 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Barello S, Palamenghi L, Graffigna G. The Mediating Role of the Patient Health Engagement Model on the Relationship Between Patient Perceived Autonomy Supportive Healthcare Climate and Health Literacy Skills. Int J Environ Res Public Health. 2020;17: 1741 10.3390/ijerph17051741 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Barello S, Palamenghi L, Graffigna G. Burnout and somatic symptoms among frontline healthcare professionals at the peak of the Italian COVID-19 pandemic. Psychiatry Res. 2020. 10.1016/j.psychres.2020.113129 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.McCauley M, Minsky S, Viswanath K. The H1N1 pandemic: Media frames, stigmatization and coping. BMC Public Health. 2013;13: 1–16. 10.1186/1471-2458-13-1116 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Muzzatti SL. Bits of falling sky and global pandemics: Moral panic and Severe Acute Respiratory Syndrome (SARS). Illness Crisis and Loss. 2005. 10.1177/105413730501300203 [DOI] [Google Scholar]
  • 78.Akben E, Özertan G, Spaulding AD, Saghaian SH. Consumer responses of the H5N1 Avian Influenza: The case of Turkey. Econ Bull. 2008;4. [Google Scholar]
  • 79.de Krom MPMM Mol APJ. Food risks and consumer trust. Avian influenza and the knowing and non-knowing on UK shopping floors. Appetite. 2010;55: 671–678. 10.1016/j.appet.2010.09.022 [DOI] [PubMed] [Google Scholar]
  • 80.Van D, McLaws ML, Crimmins J, MacIntyre CR, Seale H. University life and pandemic influenza: Attitudes and intended behaviour of staff and students towards pandemic (H1N1) 2009. BMC Public Health. 2010;10 10.1186/1471-2458-10-130 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Goodwin R, Haque S, Neto F, Myers LB. Initial psychological responses to Influenza A, H1N1 (“Swine flu”). BMC Infect Dis. 2009;9: 166 10.1186/1471-2334-9-166 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Bults M, Beaujean DJMA, De Zwart O, Kok G, Van Empelen P, Van Steenbergen JE, et al. Perceived risk, anxiety, and behavioural responses of the general public during the early phase of the Influenza A (H1N1) pandemic in the Netherlands: Results of three consecutive online surveys. BMC Public Health. 2011. 10.1186/1471-2458-11-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Kamate SK, Agrawal A, Chaudhary H, Singh K, Mishra P, Asawa K. Public knowledge, attitude and behavioural changes in an Indian population during the Influenza A (H1N1) outbreak. J Infect Dev Ctries. 2010. 10.3855/jidc.501 [DOI] [PubMed] [Google Scholar]
  • 84.Fischhoff B, De Bruin WB, Perrin W, Downs J. Travel risks in a time of terror: Judgments and choices. Risk Anal. 2004. 10.1111/j.0272-4332.2004.00527.x [DOI] [PubMed] [Google Scholar]
  • 85.Kim HK, Niederdeppe J. The Role of Emotional Response during an H1N1 Influenza Pandemic on a College Campus. J Public Relations Res. 2013;25: 30–50. 10.1080/1062726X.2013.739100 [DOI] [Google Scholar]
  • 86.Gstraunthaler T, Day R. Avian influenza in the UK: Knowledge, risk perception and risk reduction strategies. Br Food J. 2008;110: 260–270. 10.1108/00070700810858673 [DOI] [Google Scholar]
  • 87.Jribi S, Ben Ismail H, Doggui D, Debbabi H. COVID-19 virus outbreak lockdown: What impacts on household food wastage? Environ Dev Sustain. 2020;22: 3939–3955. 10.1007/s10668-020-00740-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Addo PC, Jiaming F, Kulbo NB, Liangqiang L. COVID-19: fear appeal favoring purchase behavior towards personal protective equipment. Serv Ind J. 2020;40: 471–490. 10.1080/02642069.2020.1751823 [DOI] [Google Scholar]
  • 89.Nania T, Dellafiore F, Caruso R, Barello S. Risk and protective factors for psychological distress among Italian university students during the COVID-19 pandemic: The beneficial role of health engagement. Int J Soc Psychiatry. 2020; 20764020945729. 10.1177/0020764020945729 [DOI] [PubMed] [Google Scholar]
  • 90.Graffigna G, Barello S, Riva G, Corbo M, Damiani G, Iannone P, et al. Italian consensus statement on patient engagement in chronic care: Process and outcomes. Int J Environ Res Public Health. 2020. 10.3390/ijerph17114167 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Wen-Jun Tu

20 May 2020

PONE-D-20-11202

Measuring Italian Citizens’ Engagement in the First Wave of the COVID-19 Pandemic Containment Measures: A Cross-sectional Study

PLOS ONE

Dear Dr. Barello,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Jul 04 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Wen-Jun Tu

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent.

In the ethics statement in the Methods and online submission information, please ensure that you have specified (a) whether consent was informed and (b) what type you obtained (for instance, written or verbal).

If your study included minors, state whether you obtained consent from parents or guardians.

If the need for consent was waived by the ethics committee, please include this information.

3. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses.

For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information. Moreover, please include more details on how the questionnaire was pre-tested, and whether it was validated.

4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

5. Thank you for stating the following in the Declarations Section of your manuscript:

'Funding

This study was conducted was conducted within the CRAFT project, funded by Fondazione Cariplo & Regione Lombardia'

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

'The authors received no specific funding for this work'

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

6. Your ethics statement must appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please also ensure that your ethics statement is included in your manuscript, as the ethics section of your online submission will not be published alongside your manuscript.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript by Barello et al presents the results of online survey administered between February 28th and March 4th 2020 among 1000 persons in Italy. It has several interesting and potentially important findings, however, the manuscript should be substantially revised to overcome numerous pitfalls listed below.

1. The manuscript requires correction of English, since sometimes there are expressions which hard to understand. The manuscript should be checked for the vocabulary, and some non-existing words like “iperactive” should be corrected.

2. In the “Abstract” the description of statistical methods “To investigate the relationship between Health Engagement and these variables, a series of ANOVAs, Logistic regressions and crosstabs have been carried out” should be changed to avoid plural form of analyses, and clarify what does the “crosstabs” mean.

3. The “Abstract” should include a brief characteristic of the “Health Engagement (PHE-S)” metric.

4. The authors cite their own previously published papers to support the patient health engagement importance, and in general it is normal if not excessive. However, the “patient health engagement” search in PubMed returns over 30,000 results, and more equilibrated balance between self-citation and citation of other research groups would be much better.

5. The only two references supporting the detailed explanations of the “Patient Health Engagement model” at line 116 present the papers published by the authors. If this model is unique and has not been applied by others, this should be stated explicitly. The lack of validating studies for this model from independent research groups (if this is a case) should also be indicated.

6. Moreover, the description of the model itself at lines 116-140 is not very clear and should be revised. The consequences of four model positions should be provided. The description of the first “blackout” phase (in the authors’ terminology) as “psychologically frozen and behaviorally paralyzed” is not very compliant with the current epidemic, since many persons continued to follow their routine life style soon after the initial epidemic. The overall details provided for the model is very scarce.

7. The statement at line 201 “For this study purposes the PHE- s® was slightly revised in order to adapt the items formulation to the specific contest of the health emergency” indicates the modification of the original model. But no details provided about this “slightly revised” model.

8. In the “Methods” it is not clear how “using random digit dialing” the participants were selected for the online survey.

9. The authors stated that almost 3% of involved survey participants were excluded because they indicated during the survey wrong age or sex compared to initially registered in the commercial panel they used. But if the discrepancy for sex or age is as high as 3%, how we could be confident that the participants provided the meaningful answers to other questions and not just click over answers to receive a financial incentives for completing the survey?

10. While the authors stated the sample was representative, they did not provide comparison to the Italian adult population data, and the representativeness of the sample remains questionable.

11. At line 182 the authors stated that “Ethical approval was obtained from the institutional review board at Catholic University of Milan (IRB#2019-12)”, that seemingly indicate the IRB occurred in December 2019, when nobody known about COVID-19 epidemic. Please could you address this issue, and provide the Ethical approval in the Supplement?

12. The idea to study the trust to authorities is very interesting, but the questions used seem questionable. Particularly, the statement “I fully trust the National Healthcare System” rated by on a scale ranging between 1 (completely disagree) to 5 (completely agree) is very non-specific, and could reflect not the trust to authorities but believes about financial stability of the NHS. This is a strong limitation, since it is among the central topics of the manuscript, and requires a caution reflection in the “Discussion”.

13. Moreover, the question about media reliability (lines 228-231) is not related at all to the trust to authorities, and thus the whole analysis on measurement of trust to authorities become very questionable.

14. The question “have you reduced meals in ethnic restaurants?” at line 244 has no sense for persons who not visiting ethnic restaurants.

15. The description of questions regarding changes in purchasing behaviors at lines 250-260 is limited and does not contain the possible answer.

16. As a general consideration, instead of describing all questions in the “Study measures” section, the authors could provide the complete questionnaire used during survey in the Supplement, and describe in the “Study measures” more precisely the meaning of the questions used.

17. The presentation of the “Results” in Table 1, 3 and 4, 7 is not compliant for publication but resembles more the output from statistical software.

18. Table 1 contains the description of the classification of participants according to the “Chronic patient” category, but any details about its definition are absent in the “Methods”.

19. The “Partial Credit Rasch Model” described in “Results” should be described in the “Methods”, and of course it should be supported by the relevant references to the literature (that is insufficient in the manuscript now).

20. Tables should not include abbreviations in the title, or should include footer with their explanations.

21. The authors introduce some concepts “on the fly” in the “Results” without any explanations in the “Methods”, like “Person Separation Index”.

22. The calculation of the “Health Engagement Level“ is not clear, and not described in the manuscript. The authors should provide the exact explanations on which questions they used for defining one of the four possible levels. Without knowing how it was calculated, all subsequent discussion about the role of Health Engagement (that is a central idea of the manuscript) seems not having substantial ground.

23. The same concerns also all metrics mentioned in the Table 4. How the authors calculated “Risk severity”.

24. The description of differences between groups provided at lines 333-336 is repetitive. The same concerns lines 343-346.

25. Many lines that authors put in “Results” to describe statistical methods should be used in “Methods”.

26. Table 6 should not use plural for “logistic regression”, but most importantly should clearly define whether it was uni- or multivariable LR.

27. In the “Discussion” the authors stated that “many of Italian citizens experienced panic and enacted maladaptive behaviors”, without any examples that should be provided.

28. The discussion is rather weak and includes rather few references to studies measuring impact of previous epidemics in other countries. This should be corrected.

29. “Limitations” should include issues pointed above.

30. In the “Practical implications” the authors propose, for example to provide during the “ “psychological blackout”, reassuring messages, aimed at sustaining the emotional

elaboration of the emergency and related worries would be particularly needed”. But they did not clarify what messages they exactly mean, and did not refer previously to any literature suggesting the content of such “reassuring messages”. The same concerns also other proposed by the authors stages of “Patient Health Engagement”. Thus, the practical implications remain rather vague.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Sep 11;15(9):e0238613. doi: 10.1371/journal.pone.0238613.r002

Author response to Decision Letter 0


2 Jul 2020

Comments from the editors and reviewer

We are very grateful to have been given the opportunity to revise our manuscript for Plos One.

We thank the referee and editor for their comments to strengthen the presentation of our work. We have modified the text to respond to all the issues and have elaborated on the changes below.

Editor Comments

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

Thanks. We revised accordingly.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (a) whether consent was informed and (b) what type you obtained (for instance, written or verbal). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

We thank the Editors for the suggestions. We have provided additional information regarding the participant consent in the Ethic statement in the methods section.

3. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses.

For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information. Moreover, please include more details on how the questionnaire was pre-tested, and whether it was validated.

Thank you, we have provided a copy of both the original survey and an English translation as Supplementary Information.

4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

Raw anonymous data have been uploaded as supplementary information in a .sav format (commonly used in psychology and social sciences, usable with software such as SPSS, R, Jasp).

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

We have made our anonymized dataset available and provided it as as Supporting information materials

5. Thank you for stating the following in the Declarations Section of your manuscript:

'Funding This study was conducted was conducted within the CRAFT project, funded by Fondazione Cariplo & Regione Lombardia'

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 'The authors received no specific funding for this work' Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

Dear Editor, thank you for the suggestion. We have deleted the statement from the main text and we kindly ask you to update it in the online form. Please, add following the statement.

Funding: This study was conducted was conducted within the CRAFT project, funded by Fondazione Cariplo & Regione Lombardia.

6. Your ethics statement must appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please also ensure that your ethics statement is included in your manuscript, as the ethics section of your online submission will not be published alongside your manuscript.

Thanks for the suggestion. We moved the ethic statement in the Methods section as suggested.

Reviewer’s comments

Reviewer #1: The manuscript by Barello et al presents the results of online survey administered between February 28th and March 4th 2020 among 1000 persons in Italy. It has several interesting and potentially important findings, however, the manuscript should be substantially revised to overcome numerous pitfalls listed below.

We thank the Reviewer for all the suggestions, which we have addressed and explained in the following points. The suggestions allowed us to better clarify some crucial points of the article and to revise it. We hope that this could improve our contribution to the study of Covid-19 psychological fallouts on the Italian population. We remain at disposition if further clarifications are needed.

1. The manuscript requires correction of English, since sometimes there are expressions which hard to understand. The manuscript should be checked for the vocabulary, and some non-existing words like “iperactive” should be corrected.

After Reviewer’s suggestions, we have the article revised by a professional native English reviewer. Certification is available upon requests.

2. In the “Abstract” the description of statistical methods “To investigate the relationship between Health Engagement and these variables, a series of ANOVAs, Logistic regressions and crosstabs have been carried out” should be changed to avoid plural form of analyses, and clarify what does the “crosstabs” mean.

We thank the Reviewer for the suggestions that allowed us to better clarify the abstract description. We have revised it avoiding plural forms in the analyses description and we have substitute “crosstabs” with “contingency table”, in order to better specify the nature of this analysis.

3. The “Abstract” should include a brief characteristic of the “Health Engagement (PHE-S)” metric.

Thanks to the Reviewer’s suggestions, we have added a brief description of the PHE-S metrics in the Abstract section.

4. The authors cite their own previously published papers to support the patient health engagement importance, and in general it is normal if not excessive. However, the “patient health engagement” search in PubMed returns over 30,000 results, and more equilibrated balance between self-citation and citation of other research groups would be much better.

We have also increased the number of publications by other authors suggesting the relevance and explicative power of patient engagement on a series of clinical and behavioural outcomes to better support our background and research questions.

5. The only two references supporting the detailed explanations of the “Patient Health Engagement model” at line 116 present the papers published by the authors. If this model is unique and has not been applied by others, this should be stated explicitly. The lack of validating studies for this model from independent research groups (if this is a case) should also be indicated.

Dear Reviewer, thank you for the suggestions. The Patient Health Engagement Model is a relatively new model developed by the authors in 2017. Until now, the model has been validated in China, Spain, Korea and is under cross-cultural validation in other languages by independent authors, confirming its metric characteristics and explicative value (references added in the main text). Moreover, it has been used by some research groups in collaboration with the authors (references added in the main text). We are also aware about the newness of this model and further research is needed in order to strengthen these first results. So, together with the addition of new references, we have also addresses this aspect in the limitation of the study.

6. Moreover, the description of the model itself at lines 116-140 is not very clear and should be revised. The consequences of four model positions should be provided. The description of the first “blackout” phase (in the authors’ terminology) as “psychologically frozen and behaviorally paralyzed” is not very compliant with the current epidemic, since many persons continued to follow their routine life style soon after the initial epidemic. The overall details provided for the model is very scarce.

Thank to the Reviewer for the comments. We have broadened the description of PHE model and given a theoretical revision aimed at better connect the model with the context of application of COVID-19 disease emergency. We hope that this can better clarify the doubts raised. We remain at disposition if further clarifications are needed.

We also think the overall description has taken advantage from the English revision.

7. The statement at line 201 “For this study purposes the PHE- s® was slightly revised in order to adapt the items formulation to the specific contest of the health emergency” indicates the modification of the original model. But no details provided about this “slightly revised” model.

We have added a brief description in the same section of what we have adapted in order to answer to this Reviewer’s comment. Thank you. Briefly, the scale was revised in the incipit and in some items (reported in detail in the main text) to adapt to the specific situation.

8. In the “Methods” it is not clear how “using random digit dialing” the participants were selected for the online survey.

We thank the reviewer for the comment. We clarified in the methods section the sampling procedures.

9. The authors stated that almost 3% of involved survey participants were excluded because they indicated during the survey wrong age or sex compared to initially registered in the commercial panel they used. But if the discrepancy for sex or age is as high as 3%, how we could be confident that the participants provided the meaningful answers to other questions and not just click over answers to receive a financial incentives for completing the survey?

Thank you for pointing this out. Reliability is an issue with every online-based data collection, as the researcher has (generally) no means to ensure participants’ compliance and data quality. In this particular case, we decided to adopt a criterion based on data available to the panel that were also included in our survey (age and gender): whenever we found a discrepancy in these characteristics, we deemed the answers unreliable and removed the participant from our dataset. Of course, there is no way to make sure that remaining data are indeed more reliable, as there isn’t in most of CAWI-based studies (that, however, is a widespread method for collecting data in sociology, psychology and social sciences). Nevertheless, we added a short statement in the “limitation” section.

10. While the authors stated the sample was representative, they did not provide comparison to the Italian adult population data, and the representativeness of the sample remains questionable.

Thank you for your feedback. In the table reporting sample characteristics we have added a column with comparative data. Moreover, in the text we added the link of the website of ISTAT (National Institute of Statistics) where we took the reference data.

11. At line 182 the authors stated that “Ethical approval was obtained from the institutional review board at Catholic University of Milan (IRB#2019-12)”, that seemingly indicate the IRB occurred in December 2019, when nobody known about COVID-19 epidemic. Please could you address this issue, and provide the Ethical approval in the Supplement?

We thank the reviewer for this comment. We specified the ethical authorization process in the main text. The code IRB#2019-12 refers to the progressive number assigned to the protocol when submitted. We received the approval on January 2020. The study we report on is part of a larger continuative project which is aimed to monitor consumer behaviours along time on both fixed variables and ad hoc ones basing on the contingencies of the specific historical moment (i.e. the covid-19 pandemic in this case).

12. The idea to study the trust to authorities is very interesting, but the questions used seem questionable. Particularly, the statement “I fully trust the National Healthcare System” rated by on a scale ranging between 1 (completely disagree) to 5 (completely agree) is very non-specific, and could reflect not the trust to authorities but believes about financial stability of the NHS. This is a strong limitation, since it is among the central topics of the manuscript, and requires a caution reflection in the “Discussion”.

We partially agree with the reviewer’s concern. Due to time, space and methodological concerns, for the measurement of trust in authorities we decided to develop our own set of ad hoc items. Indeed, there is no way to be sure of how participants interpreted this particular statement (or the others, by the way) and we have added a statement in the limitations of this study. Nevertheless, the section of the survey in which there was this particular statement, was dedicated to Covid19 and Covid19-management (as pointed out in the instructions to participants), so we find it more likely that participants were oriented to interpret this question in this regard. Moreover, in Italy the NHS is a public institution, hence its financial stability is not generally a common concern.

13. Moreover, the question about media reliability (lines 228-231) is not related at all to the trust to authorities, and thus the whole analysis on measurement of trust to authorities become very questionable.

We agree with the reviewer that the question about media reliability is hardly related to the questions regarding trust in authorities. In trying to describe our study, we put it in the same section as we found that it was somewhat related to the topic. However, it is necessary to point out that for this very reason we never calculated a composite score out of these measures, and that they were treated as single dependent variables in the different analyses.

14. The question “have you reduced meals in ethnic restaurants?” at line 244 has no sense for persons who not visiting ethnic restaurants.

We agree with the reviewer’s concern: this was an oversight in the design of our questionnaire and hence we added a statement in the limitation section.

15 and 16. The description of questions regarding changes in purchasing behaviours at lines 250-260 is limited and does not contain the possible answer. As a general consideration, instead of describing all questions in the “Study measures” section, the authors could provide the complete questionnaire used during survey in the Supplement, and describe in the “Study measures” more precisely the meaning of the questions used.

Thank you for this suggestion, we have added our questionnaire as a supplement.

17. The presentation of the “Results” in Table 1, 3 and 4, 7 is not compliant for publication but resembles more the output from statistical software.

Tables have been revised.

18. Table 1 contains the description of the classification of participants according to the “Chronic patient” category, but any details about its definition are absent in the “Methods”.

Participants were simply asked if they were chronic patients or not. However, we agree that it need to be more explicitly stated in the methods section. Moreover, the exact question can now be found in the provided Supplement.

19. The “Partial Credit Rasch Model” described in “Results” should be described in the “Methods”, and of course it should be supported by the relevant references to the literature (that is insufficient in the manuscript now).

Thank you, we have added a few lines in paragraph 2.3.1 (lines 308-312) to better explain and reference the used model.

20. Tables should not include abbreviations in the title, or should include footer with their explanations.

Tables have been revised and abbreviations removed

21. The authors introduce some concepts “on the fly” in the “Results” without any explanations in the “Methods”, like “Person Separation Index”.

Thank you for you feedback: both the methods and the results sections have been revised. In particular, the Person Separation Index has been further explained at lines 432-435.

22. The calculation of the “Health Engagement Level“ is not clear, and not described in the manuscript. The authors should provide the exact explanations on which questions they used for defining one of the four possible levels. Without knowing how it was calculated, all subsequent discussion about the role of Health Engagement (that is a central idea of the manuscript) seems not having substantial ground.

The items of the Health Engagement scale are now visible in the Supplement. As for the scoring, this measure is available for use only with (free) licence and, as such, the Authors are not authorized to share details about scoring.

23. The same concerns also all metrics mentioned in the Table 4. How the authors calculated “Risk severity”.

All the measures mentioned in Table 4 are single items with answers on a Likert scale ranging from 1 to 5 or 1 to 10

24. The description of differences between groups provided at lines 333-336 is repetitive. The same concerns lines 343-346.

25. Many lines that authors put in “Results” to describe statistical methods should be used in “Methods”.

26. Table 6 should not use plural for “logistic regression”, but most importantly should clearly define whether it was uni- or multivariable LR.

Thank you for your feedback. Both the Methods and Results sections have been revised to make them clearer and more organized. Tables also have been revised.

27. In the “Discussion” the authors stated that “many of Italian citizens experienced panic and enacted maladaptive behaviors”, without any examples that should be provided.

Thank you, discussion has been improved and some examples made explicit

28. The discussion is rather weak and includes rather few references to studies measuring impact of previous epidemics in other countries. This should be corrected.

Thank you for your feedback. The discussion of our manuscript has been revised, making particular attention to previous literature

29. “Limitations” should include issues pointed above.

The discussion of “Limitations” has been improved and expanded to include the issues you kindly pointed out.

30. In the “Practical implications” the authors propose, for example to provide during the “ “psychological blackout”, reassuring messages, aimed at sustaining the emotional elaboration of the emergency and related worries would be particularly needed”. But they did not clarify what messages they exactly mean, and did not refer previously to any literature suggesting the content of such “reassuring messages”. The same concerns also other proposed by the authors stages of “Patient Health Engagement”. Thus, the practical implications remain rather vague.

Thanks for this suggestion. We further elaborate this part to improve the practical implication.

Attachment

Submitted filename: response to reviewers.docx

Decision Letter 1

Wen-Jun Tu

12 Aug 2020

PONE-D-20-11202R1

Measuring Italian Citizens’ Engagement in the First Wave of the COVID-19 Pandemic Containment Measures: A Cross-sectional Study

PLOS ONE

Dear Dr. Barello,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 26 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Wen-Jun Tu

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: No

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: In table1, chronic patient contained what types of disease and also the YES or No respectively represent the proportion of men and women or the proportion of chronic diseases in the total population?

In table3, the item was HE1,2,3,4,5,what does these mean?

In the part results, which contains too many methods,so please revise and reorganize the results and methods.

4.The following references should be discussed in the revision text.

Cao JL, Hu XR, Tu WJ., & Liu Q. (2020). Clinical Features and Short-term Outcomes of 18 Patients with Corona Virus Disease 2019 in Intensive Care Unit. Intensive Care Medicine, DOI: 10.1007/s00134-020- 05987-7.

Cao JL, Tu WJ, Hu XR, & Liu Q. (2020). Clinical Features and Short-term Outcomes of 102 Patients with Corona Virus Disease 2019 in Wuhan,China. Clinical Infectious Diseases,DOI: 10.1093/cid/ciaa243/ 5814897.

5.While the authors stated the sample was representative, they did not provide comparison to the Italian adult population data, and the representativeness of the sample remains questionable,So on behalf of the people who participated in the research, how to explain the reliability of the experiment

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Sep 11;15(9):e0238613. doi: 10.1371/journal.pone.0238613.r004

Author response to Decision Letter 1


19 Aug 2020

Comments from the editors and reviewer

We are very grateful to have been given the opportunity to revise our manuscript for Plos One.

We thank the referee and editor for their comments to strengthen the presentation of our work. We have modified the text to respond to all the issues and have elaborated on the changes below.

Comment 1

In table1, chronic patient contained what types of disease and also the YES or No respectively represent the proportion of men and women or the proportion of chronic diseases in the total population?

Response:

Thanks for your comments. In our survey we asked participants whether they do or not suffer from a chronic disease; hence, the table 1 simply reports frequencies of responses (Yes vs No) in our sample, we have no means to know the types of diseases of which they suffer. We changed the label for more clarity.

Comment 2

In table3, the item was HE1,2,3,4,5,what does these mean?

Response:

Thanks for this comment. It means “health engagement”, which is the measured variable. We modified the label for more clarity.

Comment 3

In the part results, which contains too many methods, so please revise and reorganize the results and methods.

Response:

Thanks. We revised the two sections moving some part from the results to the method section.

Comment 4

The following references should be discussed in the revision text.

Cao JL, Hu XR, Tu WJ., & Liu Q. (2020). Clinical Features and Short-term Outcomes of 18 Patients with Corona Virus Disease 2019 in Intensive Care Unit. Intensive Care Medicine, DOI: 10.1007/s00134-020- 05987-7.

Cao JL, Tu WJ, Hu XR, & Liu Q. (2020). Clinical Features and Short-term Outcomes of 102 Patients with Corona Virus Disease 2019 in Wuhan,China. Clinical Infectious Diseases, DOI: 10.1093/cid/ciaa243/ 5814897.

Response:

Thanks for this suggestion. We added this reference in the introduction section.

Comment 5

While the authors stated the sample was representative, they did not provide comparison to the Italian adult population data, and the representativeness of the sample remains questionable, So on behalf of the people who participated in the research, how to explain the reliability of the experiment

Response:

The sample was representative of the Italian population due to the sampling method adopted, we’ve added further details in the methods section. Comparison data are provided in Table 1 under the “% Italian population” columns and retrieved from the website of ISTAT (the Italian National Institute of Statistics). Therefore, we assume that the study results are valid for not only for the sample of the study, but also for the larger Italian Population. Surely, further study on other sample should confirm that. We stressed this aspect in the limitation section.

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 2

Wen-Jun Tu

21 Aug 2020

Measuring Italian Citizens’ Engagement in the First Wave of the COVID-19 Pandemic Containment Measures: A Cross-sectional Study

PONE-D-20-11202R2

Dear Dr. Barello,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Wen-Jun Tu

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Wen-Jun Tu

28 Aug 2020

PONE-D-20-11202R2

Measuring Italian Citizens’ Engagement in the First Wave of the COVID-19 Pandemic Containment Measures: A Cross-sectional Study

Dear Dr. Barello:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Wen-Jun Tu

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Survey coronavirus Eng.

    Study survey–English version,

    (DOCX)

    S2 Appendix. Survey coronavirus ITA.

    Study survey–Italian version.

    (DOCX)

    S3 Appendix

    (PDF)

    S1 File. Coronavirus Eng.

    Study original dataset.

    (SAV)

    Attachment

    Submitted filename: response to reviewers.docx

    Attachment

    Submitted filename: Response to reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES