Skip to main content
BMJ Paediatrics Open logoLink to BMJ Paediatrics Open
. 2024 Nov 21;8(1):e002926. doi: 10.1136/bmjpo-2024-002926

Lesson in understanding parents’ perspective: perception of quality of care and COVID-19-related fears among users of paediatric health services over the COVID-19 pandemic in 11 facilities in Italy

Paolo Dalena 1,2, Alessandro Zago 2,✉, Angela Troisi 3, Gian Luca Trobia 4, Annunziata Lucarelli 5, Silvia Bressan 6, Silvia Fasoli 7, Stefano Martelossi 8, Riccardo Lubrano 9, Roberta Parrino 10, Enrico Felici 11, Chiara Pilotto 12, Idanna Sforzi 13, Egidio Barbi 1,2, Marzia Lazzerini 1,14; on behalf of the CHOICE Study Group
PMCID: PMC11603713  PMID: 39577872

Abstract

Background

The COVID-19 pandemic had an important psychological impact on children and their families. This study aims to explore paediatric health services users’ perceptions of quality of care (QOC) and COVID-19-related fears, and their evolution over time in relation to COVID-19 pandemic.

Methods

In a multicentre cross-sectional study involving 11 public hospitals providing paediatric care across the Italian territory, we collected data from services users through a validated questionnaire. We analysed four indicators—(1) QOC perceived in relation to COVID-19; (2) overall QOC perceived; (3) fear of accessing health services due to COVID-19; (4) fear of contracting COVID-19 in hospital—and calculated Spearman’s correlation indexes (ρ) with the number of COVID-19 new cases over time. Subgroup analyses were conducted by macroregions and single facility.

Results

Data from 956 services users were analysed. QOC indicators were stable over time at values close to the maximum (range 77–100 and median 100 for COVID-19 QOC, range 74–98 and median 80 for overall QOC), and no correlations were found with the COVID-19 new cases (ρ=−0.073 and −0.016, respectively). Fear of accessing care and fear of contracting the infection varied over time in between 0%–52% and 0%–53%, respectively, but did not correlate directly with number of COVID-19 new cases (ρ=0.101, 0.107 and 0.233, 0.046, respectively). At subgroup analyses, significantly higher frequencies of fear (p values <0.05) and lower QOC (p values <0.001) were reported in South Italy, and three facilities showed moderate correlation between these indicators.

Conclusions

COVID-19-related fears and perceived QOC may be mediated by more complex cultural and facility/regional-level factors, than simply by epidemic peaks. Subgroup analyses can help unpack major differences within the same country.

Keywords: COVID-19, adolescent health, caregivers, child health, epidemiology


WHAT IS ALREADY KNOWN ON THIS TOPIC

  • The COVID-19 pandemic had an important psychological burden on children and their families, especially in seeking care. While literature describes the causes and the consequences of perceived fear in seeking care, less is known about the link between the pandemic epidemiological trend and perceived fear and quality of care.

WHAT THIS STUDY ADDS

  • Our study aims to describe that perceived fear and quality of care did not correlate with the epidemiological trend of COVID-19, as they could be influenced by a complex network of sociocultural factors.

HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY

  • The regular monitoring of indicators considered in this paper could help healthcare workers and policymakers to deal with possible future pandemics.

Introduction

The COVID-19 pandemic caused profound and widespread challenges for children and their families in European countries, mostly due— more than to the disease itself, which is most often mild in healthy children—to its indirect effects, such as schools’ closure, social isolation, reduced healthcare access and economic crisis.1

Several studies documented the effects of the COVID-19 pandemic on healthcare access. A study conducted in UK reported that one out of three presentations in Paediatric Emergency Departments (PED) had a delay in accessing care.2 Another study in Italy highlighted that, during the pandemic, children with infectious diseases had a significant delay in accessing care when compared with the prepandemic period.3 Other evidence suggested that reluctance in seeking adequate medical care severely affected patient outcomes,4 especially for patients with disabilities, chronic diseases and malignancies,5 6 as well as acute emergencies such as sepsis, diabetic ketoacidosis7 and appendicitis.8

Previous studies showed that many different factors may explain fear in accessing health services and delay in seeking care during the COVID-19 pandemic, including doubts on the quality of care (QOC) provided at hospital level, and fear of contracting the infection.4 In previous reports, many different individual-level factors, such as young parental age,9 having a child with chronic illnesses,9 as well as psychological traits, such as the perception of loneliness and death obsession10 were found to be related to a higher level of fear/hesitancy in accessing health services.

However, there is little evidence of the possible links between the evolution over time of the COVID-19 pandemic, in terms of new positive cases, and the fears perceived by paediatric health service users, as well as the perceived QOC. A better understanding of parents’ perspectives may be useful beyond the pandemic for paediatricians and healthcare providers in order to improve quality of service.

This study aimed to investigate the correlation over time between the pandemic trends (in terms of COVID-19 new positive cases) and the QOC perceived by paediatric health service users, and their COVID-19-related fears, across 11 hospitals in Italy distributed across the whole national territory. We also conducted a subgroup analysis by macroregions in Italy (north and centre/south), to assess whether findings changed by geographical distribution. This study used data from the CHOICE (Child HOspItal CarE) project, which aimed at assessing QOC according to the WHO Standards for improving QOC for children at facility levels.11

Methods

Study design

This was a multi-centre cross-sectional study in the form of a survey and is reported according to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement12 (the STROBE checklist is provided as online supplemental table 1).

Setting and population

Data were collected in 11 public hospitals providing care for children in Italy, distributed across the national territory and with different characteristics in terms of organisational structure (ie, facility level and type) and work volume (online supplemental figure 1 and table 2).

We collected data from service users, that is, parents or other caregivers of patients between 0 and 15 years admitted to the Emergency Departments observation units or paediatric wards of participating sites, between 30 April 2021 and 22 March 2022. Whenever appropriate based on family assessment, we encouraged the involvement of children in completing the survey. Exclusion criteria for parents/caretakers were: age under 18 years; psychiatric disorders; parents/caretakers of children older than 15 years; parents/caretakers of a deceased child; parents/caretakers of a child admitted to intensive care, neuropsychiatric or surgery department.

Data collection procedures

Parents/caregivers were invited to complete a validated questionnaire13 on the QOC either through an online platform or in a paper format. The questionnaire was based on the WHO standards for improving QOC for children in facility levels.11 Details regarding the process of prioritisation of the WHO Quality Measures and the validation of the questionnaire—demonstrating good levels of validity, reliability, acceptability, perceived utility and internal consistency—have been detailed elsewhere13 with a summary provided in online supplemental table 3.

Respondents were approached by research staff during clinical shifts, and data were collected using REDCap (Research Electronic Data Capture) V.8.5.21, Vanderbilt University, at the moment of access in the PED, with the use of a tablet, allowing a single entry for each questionnaire. In the Paediatric Emergency setting there were no periods of service discontinuation in all the hospitals of the network. The centralised platform allowed for data entry directly from respondents or by research staff entering data from paper-based questionnaires into REDCap. REDCap is a software that registers only completed (full) responses. Data not provided through the online platform were excluded, due to the impossibility of accurately determining the day on which the questionnaire was filled.

Study variables and data analysis

Due to the descriptive primary aim of this study, the sample size was set as the maximum possible number of parents who could be reached during the data collection period for each facility involved in the project.

Data cleaning procedures were predefined and included removing cases with missing information on key variables (ie, facility site, date of compilation) or on more than 90% of close-ended questions under analysis, including sociodemographic variables. According to the data cleaning plan, suspected duplicates were defined as cases that exhibited identical answers to more than 90% of the socio-demographic questions and same information on key variables (ie, facility site, date of compilation).

First, we conducted a descriptive analysis of respondents’ socio-demographic characteristics and the study key variables. The four key variables analysed in relation to our research question are listed below.

  1. The ‘COVID-19 QOC Index’, calculated based on 10 predefined Quality Measures related specifically to organisational changes due to the COVID-19 pandemic. This index had a predefined scoring system (online supplemental tables 3 and 4), resulting in a score ranging from 0 (low QOC) to 100 (high QOC).

  2. The ‘Overall QOC Perceived’, calculated based on the following question: ‘In general, what score do you give to the QOC received in the hospital?’ (answers: values from 0, low quality, to 10, high quality). The score provided by the service users was standardised to a score from 0 to 100, by multiplying it by a factor of 10.

  3. The ‘Fear of accessing health services’, assessed using the following predefined question: ‘Has the fear of contracting COVID-19 infection in the hospital delayed the decision to bring your child to the hospital?’ (answers: No, Yes, to a little extent and Yes, crucially). These data were analysed as percentage frequencies of answers provided, for each of the three categories of answer (0–100%).

  4. The ‘Fear of contracting COVID-19 in the hospital’, assessed using the following predefined question: ‘Currently, are you concerned that your child or yourself or other caregivers may contract the infection in the hospital?’ (answers: No, Yes, to a little extent and Yes, crucially). These data were analysed as percentage frequencies of answers provided, for each of the three categories of answer (0%–100%).

Data were presented, by each facility and on the overall sample, as absolute numbers and percentage frequencies and by means, SD, medians and IQRs for non-normally distributed data.

Second, we conducted an analysis of the distribution of the selected key variables over time when compared with the COVID-19 new positive cases, at a national and at a regional level. Data on the COVID-19 epidemiological situation in the whole country and in each individual regions under analysis were downloaded from the Italian Civil Protection’s COVID-19 emergency database, which is freely available online.14 Daily data for new COVID-19 positive cases in the time range in which the questionnaires were administered (30 April 2021–22 March 2022) were extracted. For increasing data accuracy, the results over time were graphically rendered by considering both daily values and moving averages with a span of 7 adjacent days (the average of the values of the day in question, the previous 3 days and the next 3 days). The latter technique provides smoother curves and avoids isolated spikes due to extreme values. In cases where there was more than one questionnaire completed on the same day, the average value was calculated and considered in the analyses. The correlation between the indicators and COVID-19 new positive cases, both at national and regional levels, was studied by considering Spearman’s rank correlation index.

In addition, to assess whether findings changed by geographical distribution, we conducted a subgroup analysis by macroregions. Regions were grouped according to the Italian National Institute of Statistics (https://www.istat.it/en/organisation-and-activity), combining islands with South Italy. A second subgroup analysis was also conducted, dividing the data into two COVID-19 periods. These periods were identified by splitting the dataset on 1 November 2021, which corresponds to the start of the Omicron variant phase in Italy15 (online supplemental tables 5–7). The distributions of the variables of interest were compared between periods and correlation coefficients were calculated with the number of new COVID-19 cases within each time period. Comparisons were made using the two-proportion Z test.

All the tests were two-tailed and a p value of <0.05 was taken as statistically significant. R (R Foundation for Statistical Computing, Vienna, Austria) V.4.2.1 was used for data analysis.

Ethical considerations

Approval for data collection was obtained by the Ethical Committee of the Friuli Venezia Giulia Region for the coordinating centre (Study ID: 2976, RC 15/2019 Prot. 0035348, 3 December 2019) and by ethical committees of all 12 participating hospitals. Anonymity in data collection was ensured by not collecting any information that could disclose participants’ identity.

Patients and public involvement

Patients and/or the public were involved in the design, or conduct, or reporting or dissemination plans of this research.

Results

Characteristic of the sample

Data from 1028 responders were gathered in 11 different Italian hospitals. A total of 72 (7%) parents were excluded from the study since lacking information about the questionnaire compilation date (figure 1). Zero observations were identified as suspected duplicates.

Figure 1. Flow chart of selection of valid completed surveys for analysis. Notes: 1Missing information on close-ended questions including sociodemographic questions or time of compilation of the survey; 2suspected duplicates identified as cases with same answers to sociodemographic questions and other close-ended questions and, when available, same date of questionnaire completion.

Figure 1

Characteristics of respondents and their children are summarised in online supplemental tables 8 and 9, respectively. Among the 956 analysed parents, the majority of respondents (87.4%) were mothers, with a median age of 38 years (IQR 32–43). Overall, in 817 (85.5%) cases both parents were of Italian nationality; 327 (34.2%) of respondents held a university degree or higher.

The age distribution of the children showed that a significant portion (56.6%) fell below 6 years old, with an equal representation of both sexes. Approximately half of the children (49.8%) were admitted to the Emergency Department. Overall, almost one out of two children (45.0%) were hospitalised for a period between 3 and 7 days.

A total of 318 (33.3% of cases) children actively participated in answering the survey alongside their parent(s) or caregiver(s). Most of the children who participated in the questionnaire were from older age groups (41.5% between 6 and 12 years and 43.4% between 12 and 16).

Descriptive analysis

When analysed on the overall sample, the COVID-19 QOC index resulted in scores very close to the maximum value (median 100, IQR 90–100), while the overall QOC perceived had slightly lower values (median 80, IQR 80–90, table 1). In the entire sample, the percentages of parents and caregivers who reported that COVID-19 delayed their decision to access care and that they were concerned about contracting the infection in the hospital were very similar (32% and 31.6%, respectively, when combining the answers Yes, crucially and Yes, a lot, table 1).

Table 1. Descriptive analysis of the four indicators.

Q1 Median Q3
COVID-19 QOC index 90 100 100
Overall QOC perceived 80 80 90
Answer N %
Fear of accessing health services Yes, crucially 70 7.3
Yes, to a little extent 236 24.7
No 650 68.0
Fear of contracting COVID-19 in the hospital Yes, a lot 43 4.5
Yes, pretty much 259 27.1
No 654 68.4

Q1, first quartile; Q3, third quartileQOCquality of care

Indicators over time

The analysis of the distributions of the four indicators over time (figures25), when conducted at a national level, showed a lack of direct correlation between COVID-19 new cases and any other indicators of interest. The COVID-19 QOC index remained substantially stable with values near the maximum (range 77–100) and a lack of correlation between COVID-19 new cases at national level (Spearman’s correlation index=−0.1842, figure 2). The overall QOC perceived also was stably around high values (range 74–98) and did not correlate with the number of COVID-19 new cases at the national level (figure 3, Spearman’s correlation index=−0.0821). Fear of accessing care (figure 4) and of contracting the infection in the hospital (figure 5) had some more variation over time (ranges 0%–52% and 0%–53%, respectively, when combining the two possible answers) and did not correlate directly with the number of COVID-19 new cases (Spearman’s correlation indexes ranged from 0.233 to 0.046).

Figure 2. COVID-19 QOC index versus COVID-19 new positive cases. Note: the red line refers to the number of new COVID-19 positives in thousands in Italy. The dotted line indicates the daily time trend, while the full line refers to the MA values with a span of 7 days. The resulting value of Spearman’s correlation index is reported in the grey box. MA, moving average; QOC, quality of care.

Figure 2

Figure 5. Fear of contracting COVID-19 in the hospital versus COVID-19 new positive cases. Note: the red line refers to the number of new COVID-19 positives in thousands in Italy. The dotted line indicates the daily time trend, while the full lines refer to the MA values with a span of 7 days. The resulting value of Spearman’s correlation index is reported in the grey box. MA, moving average.

Figure 5

Figure 3. Overall QOC perceived versus COVID-19 new positive cases. Note: the red line refers to the number of new COVID-19 positives in thousands in Italy. The dotted line indicates the daily time trend, while the full line refers to the MA values with a span of 7 days. The resulting value of Spearman’s correlation index is reported in the grey box. MA, moving average; QOC, quality of care.

Figure 3

Figure 4. Fear of accessing health services versus number of COVID-19 new positive cases. Note: the red line refers to the number of new COVID-19 positives in thousands in Italy. The dotted line indicates the daily time trend, while the full lines refer to the MA values with a span of 7 days. The resulting value of Spearman’s correlation index is reported in the grey box. MA, moving average.

Figure 4

When the time trend analysis was conducted at the regional/facility level (online supplemental figures 2–5), it confirmed in general the same results, with very low Spearman’s correlation indexes, demonstrating lack of correlation, except for three facilities showing some Spearman’s correlation indexes suggesting moderate correlation. Specifically, data from the facility located in Bari had Spearman’s correlation indexes equal to −0.5587 to –0.4959, 0.4872 and 0.5434, respectively, for COVID-19 QOC index, overall QOC perceived, fear to access health services and fear of contracting COVID-19. The facility in Mantova had Spearman’s correlation indexes around 0.40 for the variables: COVID-19 QOC index (ρ=−0.1166), fear to access health services (ρ=0.0524) and fear of contracting COVID-19 (ρ=0.5122). Finally, the facility in Alessandria had a Spearman’s correlation index equal to 0.2925 for the overall QOC perceived, and equal to 0.4977 for the fear of contracting COVID-19.

Subgroup analyses

Significant differences were observed by macroregions (tables2 3). The results for the COVID-19 QOC index and overall QOC perceived were significantly lower in the centre/south than in the north (mean of 89.93 vs 94.64 and 79.9 vs 85.4, respectively, both p values <0.001).

Table 2. COVID-19 QOC index and overall QOC perceived by macroregions in Italy (30 April 2021 to 22 March 2022).

N Mean SD Q1 Median Q3 P value
COVID-19 QOC index Centre/south 429 89.93 16.60 90 95 100 <0.001
North 527 94.64 10.89 95 100 100
Overall QOC perceived Centre/south 429 79.9 16.3 70 80 90 <0.001
North 527 85.4 13.2 80 90 100

Q1, first quartile; Q3, third quartileQOCquality of care

Table 3. Fear of accessing health services and getting infected in the hospital by macroregions in Italy (30 April 2021 to 22 March 2022).

Answer Centre/south North P value
N % N %
‘Has the fear of contracting COVID-19 infection in the hospital delayed the decision to bring your child to the hospital?’ Yes, crucially 43 10.0 27 5.1 <0.001
Yes, to a little extent 150 35.0 86 16.3
No 236 55.0 414 78.6
‘Currently, are you concerned that your child or yourself or other caregivers may contract the infection in the hospital?’ Yes, a lot 20 4.7 23 4.4 0.018
Yes, pretty much 135 31.5 124 23.5
No 274 63.9 380 72.1

Considering both the answers Yes, crucially and Yes, to a small extent, almost half (45%) of respondents in the centre/south reported delaying access to health services because of the fear of COVID-19, compared with 21.4% in the North Italy (p value <0.001). In addition, considering again both the answers, 35.2% of service users from central/southern hospitals were concerned of contracting the infection in the hospital, compared with 27.9% of service users from northern Italian centres (p value=0.018).

Discussion

This study generated several new findings. It clearly showed that, when all responders were pooled together, QOC was perceived as good, while still a large proportion of service users had COVID-19-related fears, and all these indicators lacked a significant correlation with the COVID-19 peaks. However, when data were analysed by macroregions, major differences were observed, as well as some significant correlation with the COVID-19 epidemic curves. Overall, these data suggest that COVID-19-related fears and perceived QOC may be mediated by more complex cultural and facility/regional-level factors, than by simply the epidemic peaks. Conducting subgroup analysis by regions/single facility proved to be critical in unpacking major differences within the same country, which however may have multiple explanations.

Study findings may be justified by multiple reasons. High perceived QOC could be due to health system-related factors such as a more robust healthcare network, trustworthy medical education, easy access to healthcare, financial aspects such as a higher average families’ income and different perception of community values. This is the first study to analyse the overall QOC perceived by paediatric health service users during the COVID-19 pandemic, so we lack a comparison with the prepandemic period findings. However, other studies related to childbirth highlighted the lack of correlation between satisfaction with care received and many other variables related to the process of care, suggesting that the outcome of cure (a healthy baby) may, at the end, be more relevant to parents than the process itself.13

The variation in the frequency of perceived fear over time may be due to multiple factors, both at the individual level, at the facility level and in the general context. For example, in previous studies, higher levels of fear and anxiety were found to be associated with lower social class, unemployment16 and previous mental-health conditions.17 Furthermore, anxiety can similarly spread virally, with the mechanism of ‘emotion contagion’,18 with the use of social media being associated with higher anxiety,19 especially in more susceptible individuals. Notably, the COVID-19 period was characterised by multiple intercorrelated changes at once. The epidemic itself had multiple peak phases and low prevalence periods, which may have resulted in phases of strong physiological fatigue alternated by other periods of relative optimism. If from one side evidence strongly suggested worsening in mental-health indicators,20 21 high distress among health staff and high staff turnover22,25 and major difficulties in many work sectors affecting most of the population and in particular parents and female workers,24 25 there were also major reorganisations in the health system.26 The COVID-19 epidemic was an important opportunity to align with international protocols for risk management,24 reorganise care including improving effective leadership27 and adopting many new tools and digital technologies.28 29 Variations in COVID-19-related fears may therefore reflect a mixture of positive and negative factors happening at once, including some improvements in QOC, but also challenges in healthcare provision, overall resulting in a long period of instability, with either low or variable confidence towards the health systems, and with high variability in the subjective perceptions mediated both by contextual and individual aspects. Information on COVID-19 pandemic and the perception of the information received may also have played a key role in COVID-19-related fears.

A geographical gradient in reported QOC has been observed in other studies,30,32 and it can be explained as the results of several historical, sociocultural and economical aspects.33 34 Historically, QOC is perceived as poorer in the South of Italy with people moving from south to north in the idea of obtaining better care.35 While this phenomenon is decreasing, the stereotype of South Italy providing poorer healthcare is still persisting. Differences in the availability of resources and in organisational aspects across different geographical regions35 may also have affected the observed differences at subgroup analyses. All the above cited factors may have occurred at different degrees of intensity in different regions/facilities, thus justifying differences found at subgroup analyses.

We believe that the observed findings are of major relevance in terms of policies. As a matter of fact, the geographical gradient of fear, perception of reduced QOC and reduced access to health services is related to a well-documented reduced trust in National Health System (NHS) among population in the South of Italy. This is a well-described phenomenon in the country, documented by a consistent literature and decades of history of ‘sanitary migration’ by patients/families from the South of Italy to get care in the North of Italy, especially in the setting of rare diseases, complicated/severe illnesses.36 These phenomena imply increased cost both for the population and for the health system.

The data of this study confirm the persistence of this effect, bringing new evidence related to the context of the COVID-19 pandemic, which, per se, increases emotions and anxiety. Remarkably, some differences in quality of paediatric care between North and South of the country are still reported37; however, heterogeneity in QOC has also been documented among health centres in the North of Italy.37,40

According to these results, we suggest that policymakers should: (1) adopt policies to ensure that the quality of paediatric care is regularly monitored by key meaningful objective indicators; (2) use findings of the quality assessment to take actions to improve QOC, so that all children receive high-quality care independently from their geographical location; (3) adopt policies to inform the population, and increase trust in the NHS independently from the geographical location; and (4) monitor service user’s perspective on QOC. Notably, all these aspects will be important increasing preparedness to future possible pandemic.

Among the strengths of this study there are the numerosity of the facilities involved across the national territory, and the standardised methods of data collection, using a validated questionnaire,13 allowing easy replication of data collection in other sites or in the future to monitor data in the postpandemic period.

Among the study limitations, we acknowledge the simplification of a complex feeling like fear, necessary for pragmatical reason of data collection. In addition, this paper aimed at exploring fear in the context of the COVID-19 pandemic, and results are not generalisable in other time periods. Our study aimed at answering a specific exploratory research question, and not at investigating the vastitude of factors potentially affecting fears. Our questionnaire did not assess the different possible causes of fear and potentially related factors both at individual level (eg, knowledge, attitudes, personalities, socioeconomic status, previous COVID-19 infections, previous experience of quarantine, etc) and at the facility level (eg, existing resources and protocols, specific aspects of the QOC). However, it should be noted that a comprehensive assessment of all factors potentially related to fear may include a very long list of variables at different levels, including personality traits, sociodemographic factors, cultural factors and health system factors, in many instances difficult to quantify in an objective way due to the lack of standardised data collection tools or due to limited feasibility. For example, the assessment of personality trait was not done for practicality, since otherwise a much more burdensome data collection had to be implemented, seriously limiting acceptability for patients. In addition, we missed a comparison between the prepandemic and pandemic period. Moreover, we do not describe the impact of COVID-19 vaccines on the perceived QOC. Results are therefore explorative, and more research is needed to better elucidate the complex relationships in between epidemics, individual factors and health systems. At the same time, our study is adding new data, which can complement already existing literature on fear anxiety during the COVID-19 pandemic.

The results of this study are not generalisable to different settings. Considering that the COVID-19 pandemic is not fully over, and other pandemics may also happen in the future, we suggest that this study may be considered just a starting point, to favour reflection on considering monitoring indicators related to access to care more often, if not on a regular basis, as suggested also by the sustainable developmental goal Target 3.8 (achieve universal health coverage, including financial risk protection, access to quality essential healthcare services and access to safe, effective, quality and affordable essential medicines and vaccines for all).41 Notably, COVID-19 fears have resulted in delayed access to care and worsened health outcomes,4 while monitoring this indicator, together with a better understanding of its causes, will increase preparedness for possible future pandemics. QOC should also be monitored on a regular basis, using multiple indicators, as suggested by the WHO.13

Conclusion

Overall, this study adds to previous evidence, suggesting that both perceived fear and QOC did not vary over time due to variables such as vaccine availability, lockdown periods and death rates and were not related to the epidemiological trend of the infection. It rather shows that general emotions and social trends matter more in this perspective than hard epidemiological data. While subgroup analyses can help unpack major differences within the same country, more studies are needed to further explore multiple factors explaining these differences. Monitoring key indicators of perceived fear to access care and QOC over time will increase hospital preparedness and will contribute improving QOC.

supplementary material

online supplemental file 1
bmjpo-8-1-s001.pdf (2MB, pdf)
DOI: 10.1136/bmjpo-2024-002926

Acknowledgements

CHOICE project was supported by the Ministry of Health, Rome, Italy, in collaboration with the Institute for Maternal and Child Health IRCCS Burlo Garofolo, Trieste, Italy. We would like to thank all CHOICE partners and volunteer who helped in the development of the questionnaire and all health workers who took the time to respond to this survey despite the burden of the COVID-19 pandemic. Special thanks to the CHOICE Study Group for their contribution to the development of this project and support for this manuscript. We are grateful to all health workers involved in data collection: Massimo Dagnelut from Trieste; Idanna Sforzi, Rosa Santangelo, Anna Madera from Firenze; Maristella Toniutti from Udine; Chiara Grisaffi from Alessandria; Silvia Galiazzo from Padova; Francesca Patanè, Laura Portale, Marta Arrabito from Catania; Chiara Stefani from Treviso; Riccardo Lubrano, Vanessa Martucci, Mariateresa Sanseviero, Silvia Bloise, Alessia Marcellino from Latina; Silvia Fasoli, Maria Luisa Casciana from Mantova; Sara Dal Bo, Angela Troisi from Ravenna; Massimo Lo Verde from Palermo.

Footnotes

Funding: This study was supported by the Ministry of Health, Rome, Italy, in collaboration with the Institute for Maternal and Child Health IRCCS Burlo Garofolo, Trieste, Italy (CHOICE Study: RC 15/19).

Provenance and peer review: Not commissioned; externally peer reviewed.

Patient consent for publication: Not applicable.

Ethics approval: Approval for data collection was obtained by the Ethical Committee of the Friuli Venezia Giulia Region for the coordinating centre (Study ID: 2976, RC 15/2019 Prot. 0035348 3 December 2019) and by ethical committees of all 12 participating hospitals. Anonymity in data collection was ensured by not collecting any information that could disclose participants’ identity. Participants gave informed consent to participate in the study before taking part.

Patient and public involvement: Patients and/or the public were involved in the design, or conduct, or reporting or dissemination plans of this research. Refer to the Methods section for further details.

Collaborators: Alessandria: Marta Gagliardi, Kevin Valentino, Chiara Grisaffi, Enrico Felici; Bari: Fabio Cardinale, Annunziata Lucarelli, Lucia Grazia Tricarico, Mariateresa De Sario, Alessandra Pisani; Catania: Maria Carla Finocchiaro, Laura Portale, Marta Arrabito, Gian Luca Trobia, Francesca Patanè, Vita Antonella Di Stefano; Firenze: Stefano Masi, Marco Greco, Emiliano Talanti, Andrea Iuorio, Anna Madera, Paola Stillo, Rosa Santangelo, Nicolò Chiti, Idanna Sforzi; Latina: Riccardo Lubrano, Vanessa Martucci, Mariateresa Sanseviero, Silvia Bloise, Alessia Marcellino; Mantova: Silvia Fasoli, Silvia Sordelli, Maria Luisa Casciana, Mariangela Labruzzo; Padova: Silvia Bressan, Silvia Galiazzo, Francesca Tirelli; Palermo: Massimo Lo Verde, Domenico Cipolla, Sarah Contorno, Roberta Parrino, Giuseppina De Rosa; Ravenna: Sara Dal Bo, Angela Troisi, Federico Marchetti, Alessandra Iacono, Vanna Graziani, Carlotta Farneti, Francesco Oppido, Giulia Sansovini; Treviso: Stefano Martelossi, Chiara Stefani, Marcella Massarotto, Paola Crotti, Giada Sartor, Benedetta Ferro, Riccardo Pavanello, Marta Minute, Paola Moras; Trieste: Marzia Lazzerini, Egidio Barbi, Paolo Dalena, Ilaria Mariani, Elia Balestra, Benmario Castaldo, Marta Magnolato, Michele Maiola, Giorgio Cozzi, Alessandro Amaddeo, Alice Del Colle, Massimo Dagnelut, Alessandro Zago; Udine: Ilaria Liguoro, Maristella Toniutti, Michela Pandullo, Sara Rivellini, Chiara Pilotto, Paola Cogo.

Contributor Information

Paolo Dalena, Email: paolo.dalena@burlo.trieste.it.

Alessandro Zago, Email: alessandro.zago@icloud.com.

Angela Troisi, Email: angela.troisi@auslromagna.it.

Gian Luca Trobia, Email: gianluca.trobia@aoec.it.

Annunziata Lucarelli, Email: lucarelliannunziata@gmail.com.

Silvia Bressan, Email: silvia.bressan.1@unipd.it.

Silvia Fasoli, Email: silvia.fasoli@asst-mantova.it.

Stefano Martelossi, Email: stefano.martelossi@aulss2.veneto.it.

Riccardo Lubrano, Email: riccardo.lubrano@uniroma1.it.

Roberta Parrino, Email: parrinoroberta@gmail.com.

Enrico Felici, Email: enrico.felici@ospedale.al.it.

Chiara Pilotto, Email: chiara.pilotto@asufc.sanita.fvg.it.

Idanna Sforzi, Email: idanna.sforzi@meyer.it.

Egidio Barbi, Email: egidio.barbi@burlo.trieste.it.

Marzia Lazzerini, Email: marzia.lazzerini@burlo.trieste.it.

on behalf of the CHOICE Study Group:

Marta Gagliardi, Kevin Valentino, Chiara Grisaffi, Enrico Felici, Fabio Cardinale, Annunziata Lucarelli, Lucia Grazia Tricarico, Mariateresa De Sario, Alessandra Pisani, Maria Carla Finocchiaro, Laura Portale, Marta Arrabito, Gian Luca Trobia, Francesca Patanè, Vita Antonella Di Stefano, Stefano Masi, Marco Greco, Emiliano Talanti, Andrea Iuorio, Anna Madera, Paola Stillo, Rosa Santangelo, Nicolò Chiti, Idanna Sforzi, Riccardo Lubrano, Vanessa Martucci, Mariateresa Sanseviero, Silvia Bloise, Alessia Marcellino, Silvia Fasoli, Silvia Sordelli, Maria Luisa Casciana, Mariangela Labruzzo, Silvia Bressan, Silvia Galiazzo, Francesca Tirelli, Massimo Lo Verde, Domenico Cipolla, Sarah Contorno, Roberta Parrino, Giuseppina De Rosa, Sara Dal Bo, Angela Troisi, Federico Marchetti, Alessandra Iacono, Vanna Graziani, Carlotta Farneti, Francesco Oppido, Giulia Sansovini, Stefano Martelossi, Chiara Stefani, Marcella Massarotto, Paola Crotti, Giada Sartor, Benedetta Ferro, Riccardo Pavanello, Marta Minute, Paola Moras, Marzia Lazzerini, Egidio Barbi, Paolo Dalena, Ilaria Mariani, Elia Balestra, Benmario Castaldo, Marta Magnolato, Michele Maiola, Giorgio Cozzi, Alessandro Amaddeo, Alice Del Colle, Massimo Dagnelut, Alessandro Zago, Ilaria Liguoro, Maristella Toniutti, Michela Pandullo, Sara Rivellini, Chiara Pilotto, and Paola Cogo

Data availability statement

Data are available upon reasonable request.

References

  • 1.Golberstein E, Wen H, Miller BF. Coronavirus Disease 2019 (COVID-19) and Mental Health for Children and Adolescents. JAMA Pediatr. 2020;174:819–20. doi: 10.1001/jamapediatrics.2020.1456. [DOI] [PubMed] [Google Scholar]
  • 2.Lynn RM, Avis JL, Lenton S, et al. Delayed access to care and late presentations in children during the COVID-19 pandemic: a snapshot survey of 4075 paediatricians in the UK and Ireland. Arch Dis Child. 2021;106:e8. doi: 10.1136/archdischild-2020-319848. [DOI] [PubMed] [Google Scholar]
  • 3.Rusconi F, Di Fabrizio V, Puglia M, et al. Delayed presentation of children to the emergency department during the first wave of COVID-19 pandemic in Italy: Area-based cohort study. Acta Paediatr. 2021;110:2796–801. doi: 10.1111/apa.16019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lazzerini M, Barbi E, Apicella A, et al. Delayed access or provision of care in Italy resulting from fear of COVID-19. Lancet Child Adolesc Health. 2020;4:e10–1. doi: 10.1016/S2352-4642(20)30108-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Ding Y-Y, Ramakrishna S, Long AH, et al. Delayed cancer diagnoses and high mortality in children during the COVID-19 pandemic. Pediatr Blood Cancer. 2020;67:e28427. doi: 10.1002/pbc.28427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Duncanson M, Wheeler BJ, Jelleyman T, et al. Delayed access to care and late presentations in children during the COVID-19 pandemic New Zealand-wide lockdown: A New Zealand Paediatric Surveillance Unit study. J Paediatr Child Health. 2021;57:1600–4. doi: 10.1111/jpc.15551. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kamrath C, Mönkemöller K, Biester T, et al. Ketoacidosis in Children and Adolescents With Newly Diagnosed Type 1 Diabetes During the COVID-19 Pandemic in Germany. JAMA. 2020;324:801–4. doi: 10.1001/jama.2020.13445. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Snapiri O, Rosenberg Danziger C, Krause I, et al. Delayed diagnosis of paediatric appendicitis during the COVID-19 pandemic. Acta Paediatr. 2020;109:1672–6. doi: 10.1111/apa.15376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Davis AL, Sunderji A, Marneni SR, et al. Caregiver-reported delay in presentation to pediatric emergency departments for fear of contracting COVID-19: a multi-national cross-sectional study. CJEM. 2021;23:778–86. doi: 10.1007/s43678-021-00174-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Enea V, Eisenbeck N, Petrescu TC, et al. Perceived Impact of Quarantine on Loneliness, Death Obsession, and Preoccupation With God: Predictors of Increased Fear of COVID-19. Front Psychol. 2021;12:643977. doi: 10.3389/fpsyg.2021.643977. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.World Health Organization Standards for improving the quality of care for children and young adolescents in health facilities. 2018. [-Jun-2023]. https://www.who.int/publications-detail-redirect/9789241565554 Available. Accessed.
  • 12.Elm E von, Altman DG, Egger M, et al. Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335:806–8. doi: 10.1136/bmj.39335.541782.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Lazzerini M, Mariani I, de Melo E Lima TR, et al. WHO standards-based tools to measure service providers’ and service users’ views on the quality of hospital child care: development and validation in Italy. BMJ Open. 2022;12:e052115. doi: 10.1136/bmjopen-2021-052115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.GitHub Dipartimento della protezione civile (Italy). “pcm-dpc/COVID-19.”. [-Jun-2023]. https://github.com/pcm-dpc/COVID-19 Available. Accessed.
  • 15.CDC morbidity and mortality weekly report (MMWR) https://www.cdc.gov/mmwr/volumes/70/wr/mm7050e1.htm n.d. Available.
  • 16.Coronado-Vázquez V, Ramírez-Durán MDV, Barrio-Cortes J, et al. The Influence of Socioeconomic and Educational Factors on the Level of Anxiety and Fear of COVID-19. Healthcare (Basel) 2024;12:99. doi: 10.3390/healthcare12010099. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Rahman MA, Islam SMS, Tungpunkom P, et al. COVID-19: Factors associated with psychological distress, fear, and coping strategies among community members across 17 countries. Global Health. 2021;17:117. doi: 10.1186/s12992-021-00768-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Wheaton MG, Prikhidko A, Messner GR. Is Fear of COVID-19 Contagious? The Effects of Emotion Contagion and Social Media Use on Anxiety in Response to the Coronavirus Pandemic. Front Psychol. 2020;11:567379. doi: 10.3389/fpsyg.2020.567379. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Kramer ADI, Guillory JE, Hancock JT. Experimental evidence of massive-scale emotional contagion through social networks. Proc Natl Acad Sci USA. 2014;111:8788–90. doi: 10.1073/pnas.1320040111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Shimizu K. 2019-nCoV, fake news, and racism. Lancet. 2010 doi: 10.1016/S0140-6736(20)30357-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Goldfarb EV. Participant stress in the COVID-19 era and beyond. Nat Rev Neurosci. 2020;21:663–4. doi: 10.1038/s41583-020-00388-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Poon Y-SR, Lin YP, Griffiths P, et al. A global overview of healthcare workers’ turnover intention amid COVID-19 pandemic: a systematic review with future directions. Hum Resour Health. 2022;20:70. doi: 10.1186/s12960-022-00764-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Johns G, Samuel V, Freemantle L, et al. The global prevalence of depression and anxiety among doctors during the covid-19 pandemic: Systematic review and meta-analysis. J Affect Disord. 2022;298:431–41. doi: 10.1016/j.jad.2021.11.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Vitória B de A, Ribeiro MT, Carvalho VS. The work-family interface and the COVID-19 pandemic: A systematic review. Front Psychol. 2022;13:914474. doi: 10.3389/fpsyg.2022.914474. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.C Fong V, Iarocci G. Child and Family Outcomes Following Pandemics: A Systematic Review and Recommendations on COVID-19 Policies. J Pediatr Psychol. 2020;45:1124–43. doi: 10.1093/jpepsy/jsaa092. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Nicastro E, Mazza A, Gervasoni A, et al. A Pediatric Emergency Department Protocol to Avoid Intrahospital Spread of SARS-CoV-2 during the Outbreak in Bergamo, Italy. J Pediatr. 2020;222:231–5. doi: 10.1016/j.jpeds.2020.04.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Graham RNJ, Woodhead T. Leadership for continuous improvement in healthcare during the time of COVID-19. Clin Radiol. 2021;76:67–72. doi: 10.1016/j.crad.2020.08.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Fahy N, Williams GA, Habicht T, et al. Copenhagen (Denmark): European Observatory on Health Systems and Policies; 2021. Use of digital health tools in Europe: before, during and after COVID-19.https://www.ncbi.nlm.nih.gov/books/NBK576970/ Available. [PubMed] [Google Scholar]
  • 29.Ortíz-Barrios MA, Coba-Blanco DM, Alfaro-Saíz JJ, et al. Process Improvement Approaches for Increasing the Response of Emergency Departments against the COVID-19 Pandemic: A Systematic Review. Int J Environ Res Public Health. 2021;18:8814. doi: 10.3390/ijerph18168814. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Lazzerini M, Covi B, Mariani I, et al. Quality of care at childbirth: Findings of IMAgiNE EURO in Italy during the first year of the COVID-19 pandemic. Int J Gynaecol Obstet. 2022;157:405–17. doi: 10.1002/ijgo.14119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Dallolio L, Lenzi J, Fantini MP. Temporal and geographical trends in infant, neonatal and post-neonatal mortality in Italy between 1991 and 2009. Ital J Pediatr. 2013;39:19. doi: 10.1186/1824-7288-39-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Lauria L, Saporito M. Comparison of stillbirth and neonatal mortality in two Italian regions: Lombardia and Campania. Epidemiol Prev. 2004;28:217–24. [PubMed] [Google Scholar]
  • 33.Matranga D, Maniscalco L. Inequality in Healthcare Utilization in Italy: How Important Are Barriers to Access? Int J Environ Res Public Health. 2022;19:1697. doi: 10.3390/ijerph19031697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Masseria C, Giannoni M. Equity in access to health care in Italy: a disease-based approach. Eur J Public Health. 2010;20:504–10. doi: 10.1093/eurpub/ckq029. [DOI] [PubMed] [Google Scholar]
  • 35.Save The Children I divari tra nord e sud nel diritto alla salute. [-May-2024];2024 https://www.savethechildren.it/blog-notizie/i-divari-tra-nord-e-sud-nel-diritto-alla-salute Available. accessed.
  • 36.Resta E, Resta O, Costantiello A, et al. The hospital emigration to another region in the light of the environmental, social and governance model in Italy during the period 2004-2021. BMC Public Health. 2024;24:1880. doi: 10.1186/s12889-024-19369-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Liguoro I, Mariani I, Iuorio A, et al. Implementation of the WHO Standards to assess the quality of paediatric care using health workers as source of data: findings of a multicentre study (CHOICE) in Italy. Bmjpo. 2024;8:e002612. doi: 10.1136/bmjpo-2024-002612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Lazzerini M, Dagnelut M, Dalena P, et al. Evaluation of the WHO standards to assess quality of care for children with acute respiratory infections: findings of a baseline multicentre assessment (CHOICE) in Italy. BMJ Paediatr Open. 2024;8:e002552. doi: 10.1136/bmjpo-2024-002552. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Lazzerini M, Sforzi I, Liguoro I, et al. Implementation of the WHO standards to assess the quality of care for children with acute diarrhoea: findings of a multicentre study (CHOICE) in Italy. BMJ Paediatr Open. 2024;8:e002569. doi: 10.1136/bmjpo-2024-002569. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Balestra E, Cozzi G, Sforzi I, et al. Implementation of the WHO standards to assess quality of care for children with acute pain in EDs: findings of a multicentre study (CHOICE) in Italy. BMJ Paediatr Open. 2024;8:e002610. doi: 10.1136/bmjpo-2024-002610. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.World Health Organization SDG target 3.8 | achieve universal health coverage, including financial risk protection, access to quality essential health-care services and access to safe, effective, quality and affordable essential medicines and vaccines for all. [-Jun-2023]; https://www.who.int/data/gho/data/themes/topics/indicator-groups/indicator-group-details/GHO/sdg-target-3.8-achieve-universal-health-coverage-(uhc)-including-financial-risk-protection Available. accessed.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    online supplemental file 1
    bmjpo-8-1-s001.pdf (2MB, pdf)
    DOI: 10.1136/bmjpo-2024-002926

    Data Availability Statement

    Data are available upon reasonable request.


    Articles from BMJ Paediatrics Open are provided here courtesy of BMJ Publishing Group

    RESOURCES