Skip to main content
BMJ Open logoLink to BMJ Open
. 2023 Mar 6;13(3):e062939. doi: 10.1136/bmjopen-2022-062939

Time spent on documenting quality indicator data and associations between the perceived burden of documenting these data and joy in work among professionals in intensive care units in the Netherlands: a multicentre cross-sectional survey

Gijs Hesselink 1,, Rutger Verhage 1, Oscar Hoiting 2, Eva Verweij 3, Inge Janssen 4, Brigitte Westerhof 5, Gilian Ambaum 6, Iwan C C van der Horst 7,8, Paul de Jong 9, Nynke Postma 10, Johannes G van der Hoeven 1, Marieke Zegers 1
PMCID: PMC9990602  PMID: 36878656

Abstract

Objectives

The number of indicators used to monitor and improve the quality of care is debatable and may influence professionals’ joy in work. We aimed to assess intensive care unit (ICU) professionals’ perceived burden of documenting quality indicator data and its association with joy in work.

Design

Cross-sectional survey.

Setting

ICUs of eight hospitals in the Netherlands.

Participants

Health professionals (ie, medical specialists, residents and nurses) working in the ICU.

Measurements

The survey included reported time spent on documenting quality indicator data and validated measures for documentation burden (ie, such documentation being unreasonable and unnecessary) and elements of joy in work (ie, intrinsic and extrinsic motivation, autonomy, relatedness and competence). Multivariable regression analysis was performed for each element of joy in work as a separate outcome.

Results

In total, 448 ICU professionals responded to the survey (65% response rate). The overall median time spent on documenting quality data per working day is 60 min (IQR 30–90). Nurses spend more time documenting these data than physicians (medians of 60 min vs 35 min, p<0.01). Most professionals (n=259, 66%) often perceive such documentation tasks as unnecessary and a minority (n=71, 18%) perceive them as unreasonable. No associations between documentation burden and measures of joy in work were found, except for the negative association between unnecessary documentations and sense of autonomy (β=−0.11, 95% CI −0.21 to −0.01, p=0.03).

Conclusions

Dutch ICU professionals spend substantial time on documenting quality indicator data they often regard as unnecessary. Despite the lacking necessity, documentation burden had limited impact on joy in work. Future research should focus on which aspects of work are affected by documentation burden and whether diminishing the burden improves joy in work.

Keywords: Quality in health care, HEALTH SERVICES ADMINISTRATION & MANAGEMENT, Clinical governance


STRENGTHS AND LIMITATIONS OF THIS STUDY.

  • We used validated scales to estimate outcome measures regarding documentation burden and joy in work, and then subjected these measures to multivariable analysis.

  • The high response rate and the large sample of respondents from eight different hospitals allowed us to provide a complete and robust picture of the situation in different types of intensive care units (ICUs) in the Netherlands.

  • Findings are based on data from Dutch ICU professionals and may not be representative of ICU professionals in other countries.

  • Response bias, which is commonly associated with self-assessment scales, may have occurred.

Introduction

Like in many other healthcare settings, quality indicators are used in intensive care units (ICUs) as standards to measure, compare and improve quality of care.1 2 The collection of information and reporting on these indicators is meant to inform various stakeholders (ie, patients, healthcare professionals, health insurers, regulators) about structural and procedural aspects of care and related patient outcomes and experiences.3 4 Quality indicator data are assumed to improve the quality of care by providing feedback and enabling healthcare providers to compare and benchmark their performance.3–5 Fuelled by the benefits of quality measurement, the growing accountability of hospitals towards different stakeholders, and the growing public interest in healthcare quality, there is an increasing demand for hospitals to deliver performance data to be held accountable for.6 7

Parallel to this trend, stakeholders have started to raise concerns about the often excessive number of quality indicators healthcare professionals are faced with as it diverts time from real quality improvement and actual patient care.8–11 Not only the number of quality indicators, but also their efficacy is under debate. There is a little evidence that the considerable effort and resources invested in documenting quality data improve health outcomes.5 12–14 Lack of validity of indicators, reliability issues, poor data quality or lack of support by clinicians may be the underlying reasons.15–18 The multitude of required documentations on measures that often are not proven effective and valid may diminish their joy in work.19 Above all, administrative tasks are the leading cause of burnout and turnover among healthcare professionals.20 21

Despite these concerns, the burden of documenting quality indicator data as perceived by ICU professionals is hardly studied while this group, like other healthcare providers, have to deal with many administrative tasks apart from providing actual patient care.8 Furthermore, this documentation burden may take its toll on the morale and motivation of ICU professionals that are already negatively impacted by a long period of hardworking during the COVID-19 pandemic. Therefore, we aimed to assess ICU professional’s perceived burden due to documenting data for quality monitoring and improvement and its association with joy in work. Furthermore, this study serves as a baseline measurement for an intervention study evaluating the impact of working with a reduced set of ICU care quality indicators on documentation burden and joy in work that currently runs in the ICUs of eight hospitals in the Netherlands.

Methods

Study design, setting and population

A cross-sectional survey was conducted between May and June 2021 in the ICUs of one academic, five teaching and two non-teaching hospitals in the eastern part of the Netherlands. This study is a multi-centre follow-up to a previous study performed between 2017 and 2018.8 Overlap can be found in the content of the survey and the analysis of data. Participating ICUs were mixed medical-surgical ICUs providing intensive care for (treating) adult critically ill surgical, medical or trauma patients. Study participants were ICU healthcare professionals who document quality information and are involved in direct medical or nursing care. This study is reported in accordance with the Strengthening the Reporting of Observational Studies in Epidemiology guideline and using the Consensus-Based Checklist for Reporting of Survey Studies.

Data collection

All eligible ICU professionals at the participating institutions were sent an invitation by email to participate in the survey, containing a personalised link to an online questionnaire. Two reminders were sent after the initial invitation, the first after 14 days and the second after 28 days. The questionnaire was built in the web-based system Castor Electronic Data Capture, and tested on the usability and technical functionality prior to data collection. Informed consent was obtained as a first question. Data were immediately stored digitally in Castor EDC, Amsterdam, the Netherlands.

The survey started with eight general questions, including age, gender, profession, professional tenure, working hours per week and dedicated hours for patient care per shift. Questions about documentation burden were then introduced by providing the respondents with a definition of a quality indicator and examples of quality indicators in the ICU for which professionals document data (eg, pain scores and the incidence of delirium, pressure ulcers and sepsis). Then, the ICU professionals were asked how many minutes they spend on documenting quality indicator data on a typical working day (documentation time), and their attitudes towards documenting such data, using the Bern Illegitimate Tasks Scale.22 23 This scale contains four statements measuring the perceptions of documenting such data as being unnecessary (eg, ‘How often do you document quality indicator data where you wonder whether they make sense at all?’) and four statements measuring perceptions of documenting such data as being unreasonable (eg, ‘How often do you document quality indicator data where you believe that this is going too far, and should not be expected of you?’). Responses were given on a 5-point Likert scale, ranging from 1=never to 5=often.22 23 We measured the consequences of documenting these data on the professionals’ joy in work in terms of their work motivation and sense of autonomy, competence, and relatedness. Work motivation refers to intrinsic motivation (being motivated because the job is fun, enjoyable or in line with one’s values),24 which was measured using six items from the Multidimensional Work Motivation Scale (eg, ‘I exert effort for my job because the work I do is interesting’), and extrinsic motivation (being motivated because the job leads to certain outcomes, such as money and status, or it helps to avoid negative feelings), which was measured using 10 items from the Multidimensional Work Motivation Scale (eg, ‘I exert effort for my job because I risk losing my job if I do not put enough effort in’).25 Responses were given on a 7-point Likert scale, ranging from 1=not at all, to 7=totally.25 Experienced autonomy (ie, sense of volition, eg, ‘I feel free to do things my own way’), relatedness (ie, meaningful relationships, eg, ‘I care about the people I spend time with’) and competence (sense of being capable, eg, ‘I feel competent to achieve my goals’) were each measured using three items from the Basic Psychological Needs Scale.26 Answers were rated on a 5-point Likert scale, ranging from 1=totally disagree to 5=totally agree. The reliability of the different scales was determined using Cronbach’s alpha and was considered acceptable for all measures except for the 3-item scale for competence (α=0.60). This scale’s reliability improved after removing one item (α=0.67), and the analyses are based on the resulting 2-item scale.

Data analysis

Data were analysed using SPSS V.25. Descriptive statistics were used to summarise the respondent’s characteristics. Frequency, percentage, mean, SD, median and IQR scores were used according to the data type. The variables ‘minutes spent on documenting quality indicator data per day’ and ‘hours of direct patient care per day’ had a skewed distribution, and therefore the non-parametric Mann-Whitney U test was applied. Normally distributed variables were analysed using the independent t-test. Subgroup analyses were carried out for physicians (ie, medical specialists and residents) and nurses (ie, ICU nurses, nurse practitioners and nurse students).

We analysed missing values and removed cases with missing values on one of the documentation burden or joy in work variables (listwise analysis). Bivariate correlations between variables were assessed using Spearman’s rho and Pearson’s correlations according to the data type. Univariate regression analyses were used to assess the association between each type of documentation burden as independent predictors with each element of joy in work (ie, intrinsic and extrinsic motivation, autonomy, relatedness and competence). This was followed by multivariable regression analyses including both types of perceived documentation burden and controlling for professional tenure, hours of direct patient care per day, working hours per week, type of profession (dichotomised into physicians and nurses) and ICU setting. Age was not included in the regression analyses because this variable highly correlated with professional tenure (r=0.87, p<0.01). Documentation time was not included in the regression analyses because this variable did not correlate with any of the joy of work elements. A regression-based moderation analysis was performed to identify whether the relationship between documentation burden and joy in work is different for physicians and nurses. Therefore, two interaction terms were added to the multivariable regression models: that is, unreasonable documentation*type of profession and unnecessary documentation*type of profession. Because of the hierarchical structure, with professionals nested within eight ICUs, fixed-effect dummies for ICUs were included in all the multivariable analyses to account for this cluster effect. A p value of <0.05 was considered to be statistically significant, based on two-sided tests.

Patient and public involvement

There were no patients or members of the public involved in the design or conduct of this study.

Results

Study participants

The survey was sent to 694 ICU professionals of whom 448 replied, resulting in a response rate of 65%. Response rates across the participating ICUs varied between 50% and 85% (online supplemental file 1). Twenty-five respondents were excluded from the analysis because they did not fill in any answer or only answered the demographic questions (n=21), or were not involved in direct patient care and did not document quality information (n=4). An additional 29 respondents were left out of the regression analysis because of missings for the variables on documentation burden or joy in work. A test of differences between the excluded respondents with demographic data and included respondents showed that the excluded respondents were younger (Mexc=38.6 years vs Minc=43.8 years, p<0.01) and had less working experience (Mexc=10.8 years vs Minc=19.1 years, p<0.01). No statistically significant difference was found in gender (p=0.06) and the number of working hours per week (p=0.47).

Supplementary data

bmjopen-2022-062939supp001.pdf (40.4KB, pdf)

Table 1 presents characteristics of the respondents. Most of the respondents worked as a nurse (including students and nurse practitioners; 82.8%) compared with those who worked as a medical specialist or resident (17.2%). Overall, this distribution represents the ratio of nurses versus physicians working in the different participating ICU settings (online supplemental file 2). On average, respondents were experienced ICU professionals working 33 hours per week in the ICU.

Table 1.

Characteristics of respondents (n=423)

Variable Value
Age in years, mean (SD) 43.3 (12.0)
Gender, n (%)
 Female 302 (71.4)
 Male 121 (28.6)
Profession, n (%)
 Nurse 331 (78.3)
 Medical specialist 56 (13.2)
 Medical residents 17 (4.0)
 Nurse student 10 (2.4)
 Nurse practitioner 9 (2.1)
Professional tenure in years, median (IQR) 16.0 (7.0–31.0)
Working hours per week, mean (SD) 32.6 (6.8)
Hours dedicated to patient care per shift, median (IQR) 5.0 (4.0–6.0)
Supplementary data

bmjopen-2022-062939supp002.pdf (85.8KB, pdf)

Documentation burden and joy in work

Table 2 shows median and mean scores on documentation time, perceived documentation burden, and elements of joy in work. The overall median time spent on documenting quality indicator data by physicians and nurses is 60 min per working day (IQR 30–90). Nurses spent significantly more minutes per day documenting than physicians, with a median of 60 min (IQR 30–93) versus 35 min (IQR 20–60), respectively (p<0.01). A minority (n=71, 18%) of the healthcare professionals reported that they often document quality data which they perceived as unreasonable, while two-thirds of the respondents (n=259, 66%) often documented data on what they considered to be unnecessary quality indicators (online supplemental file 3). No differences were found between physicians and nurses in their perception of unnecessary (p=0.21 and unreasonable (p=0.32) documentations.

Table 2.

Descriptives and reliability of study variables including documentation burden and joy in work (n=394)

Answer options α All respondents (M, SD) Nurses*
(n=326)
(M, SD)
Physicians†
(n=68)
(M, SD)
P value
Time documenting quality indicator data (min/day)‡ Open 60.0 (30.0–90.0) 60.0 (30.0–92.5) 35.0 (20.0–60.0) <0.01
Unreasonable documentation 1–5 0.78 2.73 (0.73) 2.71 (0.71) 2.83 (0.79) 0.21
Unnecessary documentation 1–5 0.86 3.66 (0.78) 3.68 (0.74) 3.56 (0.95) 0.32
Intrinsic motivation 1–7 0.89 5.58 (0.76) 5.55 (0.76) 5.74 (0.75) 0.06
Extrinsic motivation 1–7 0.85 3.23 (0.92) 3.19 (0.94) 3.46 (0.77) 0.01
Autonomy 1–5 0.66 3.54 (0.57) 3.52 (0.59) 3.68 (0.44) <0.01
Relatedness 1–5 0.80 3.71 (0.55) 3.67 (0.56) 3.88 (0.45) 0.01
Competence 1–5 0.68 3.91 (0.60) 3.89 (0.62) 4.01 (0.45) 0.70
Professional tenure (years)‡ Open 17.0 (7.0–31.0) 19.50 (9.0–33.0) 8.0 (2.0–14.0) <0.01
Patient care (hours/day)‡ Open 5.0 (4.0–6.0) 5.0 (4.0–6.0) 5.0 (4.0–7.0) 0.64
Working hours per week Open 32.72 (6.70) 30.81 (4.70) 41.86 (7.31) <0.01
Age Open 43.81 (11.95) 44.19 (12.52) 42.00 (8.61) 0.08

Statistically significant (p<0.05) tests of difference (nurses vs physicians) are presented in bold.

*Nurses, nurse practitioners and nurse students combined.

†Medical specialists and medical residents combined.

‡Median (IQR).

M, mean.

Supplementary data

bmjopen-2022-062939supp003.pdf (63KB, pdf)

Physicians, as a group, scored higher on all joy in work outcomes compared with nurses. Although group differences were statistically significant for extrinsic motivation (p=0.01), and sense of autonomy (p<0.01) and relatedness in work (p=0.01), the absolute difference in means for all joy in work outcomes is relatively small (table 2).

Correlations between documentation time and burden and elements of joy in work

Table 3 shows that no statistically significant correlations were found between the time spent documenting quality indicator data per working day and any measure of joy in work. A weak correlation was found between documentation time and both unreasonable (rs=0.25, p<0.01) and unnecessary documentations (rs=0.18, p<0.01). A moderate correlation was found between documenting unreasonable and unnecessary indicator data (r=0.56, p<0.01). Both unreasonable and unnecessary documentations correlated negatively with autonomy (r=−0.13, p=0.01), indicating that professionals with a sense of being autonomous in their job are more likely to perceive the documentation of quality data as unreasonable or unnecessary than their colleagues who feel less autonomous.

Table 3.

Correlations between registration burden and healthcare professionals’ joy in work (n=394)

Variable 1 2 3 4 5 6 7 8 9 10 11
1. Time documenting quality indicator data (min/day)
2. Unreasonable documentation 0.25**
3. Unnecessary documentation 0.18** 0.56**
4. Intrinsic motivation 0.07 −0.07 −0.04
5. Extrinsic motivation 0.08 0.05 0.03 0.18**
6. Autonomy −0.02 0.13* 0.13** 0.36** 0.02
7. Relatedness 0.07 0.02 −0.03 0.36** 0.09 0.39**
8. Competence −0.03 −0.01 0.04 0.23** 0.01 0.27** 0.14**
9. Professional tenure (years) 0.03 0.10* −0.04 0.16** 0.14** 0.16** −0.08 −0.09
10. Patient care (hours/day) −0.08 −0.08 −0.01 0.02 −0.10 0.14** 0.03 0.04 0.03
11. Working hours per week 0.10* <0.01 −0.09 0.12* 0.09 0.14** 0.09 0.08 0.39** 0.03
12. Age 0.18** 0.11* −0.06 0.13** 0.15** 0.14** −0.07 −0.03 0.18** 0.05 0.15**

1–3: documentation burden; 4–8: joy in work; 9–11: control variables.

Spearman’s rho (rs) is given for 1, 9 and 10, Pearson’s correlation is given for 2–8 and 11–12.

Statistically significant (*p<0.05 (two-tailed); **p<0.01 (two-tailed)) results are presented in bold.

Associations between types of documentation burden and elements of joy in work

Unreasonable and unnecessary documentation were negatively associated with ICU professional’s sense of autonomy, as seen in the univariate models in table 4 and online supplemental file 4. No univariate associations between both types of documentation burden and other elements of joy in work were found. After controlling for other variables, only unnecessary documentation was negatively associated with sense of autonomy (β=−0.11, 95% CI −0.21 to −0.01, p=0.03). This association was not moderated by the type of profession (being a nurse or physician). The variance in professionals’ autonomy explained by perceived unnecessary documentation, and other measured covariables was low with 15% (table 4).

Table 4.

Univariate and multivariable linear regression analyses of the influence of documentation burden on ICU professionals’ joy in work (n=394)

Intrinsic motivation Extrinsic motivation Autonomy Relatedness Competence
UV MV UV MV UV MV UV MV UV MV
β β β β β β β β β β
Constant 5.50** 3.10** 3.65** 3.90** 4.00**
Unreasonable documentation (scale) −0.07 −0.10 0.05 0.08 −0.13* −0.08 0.02 0.02 −0.01 −0.10
Unnecessary documentation (scale) −0.04 0 0.03 0.04 −0.13** −0.11* −0.03 −0.07 0.04 0.01
Unreasonable tasks* profession
(n=0; p=1)
0.08 0.02 0.10 −0.17 0.10* 0.18 0.15** 0 0.11* 0.21
Unnecessary tasks* profession
(n=0; p=1)
0.08 −0.05 0.10* −0.05 0.10* 0.06 0.15** 0.06 0.11* 0.12
Professional tenure −0.12* 0 −0.14** −0.01* −0.17** −0.01** −0.08 0 −0.08 0
Hours patient care/day 0.01 0 −0.12 −0.06* 0.18** 0.06** 0.02 0 0.04 0.01
Working hours/week 0.12* 0.01 0.09 0 0.14** 0.01 0.09 0.01 0.08 0
Profession (n=0; p=1) 0.10* 0.19 0.11* 0.82 0.11* −0.72* 0.15** −0.10 0.08 −0.94*
ICU setting (ICU 1 as reference)
 ICU 2 −0.17 0.25 −0.05 −0.17 0
 ICU 3 0 0.40 −0.10 −0.13* −0.09
 ICU 4 −0.17 0.04 0 −0.23 0.09
 ICU 5 0.21 −0.14 0.05 0.10 −0.11
 ICU 6 0.04 0.17 0.13 −0.15 0.02
 ICU 7 0.15 0.43 0.20 −0.02 0.18
 ICU 8 −0.08 0.33 −0.24 −0.53** 0
R2 0.06 0.08 0.15 0.09 0.05
F value 1.27 1.89* 3.83** 2.27** 1.18

*p<0.05 (two-tailed); **p<0.01 (two-tailed).

ICU, intensive care unit; MV, multivariable; n, nurses; p, physicians; UV, univariate.

Supplementary data

bmjopen-2022-062939supp004.pdf (77.6KB, pdf)

Discussion

This survey shows that ICU professionals in the Netherlands spend substantial time on documenting quality indicator data. Such documentation tasks are especially time-consuming for ICU nurses who are responsible for most of these documentations compared with ICU physicians. Furthermore, two-thirds of the respondents consider the documentation of quality data often as unnecessary. A smaller group of ICU professionals (one-fifth) considered such tasks often as unreasonable, particularly those documentations of which professionals thought other should do it. Our findings also show that the burden of documenting quality data seems to have limited impact on ICU professionals’ joy in work.

The median reported time of 60 min per day spent on documentation corresponds with findings of previous studies involving Dutch ICU professionals,2 8 and can be explained by a large number of ICU quality indicators (more than 100) professionals are obliged to collect data for.8 At the international level, several studies have previously reported on physicians’ and nurses’ time spent on administrative tasks in general,9 27 28 and related costs,29 but studies on the documentation of quality information in ICUs specifically are scarce. Apart from the costs associated with collecting and documenting data,9 27 these time-consuming activities may come at the expense of direct patient care,10 11 and the quality of care and the documentation themselves.6 Therefore, it is justified to question which quality indicators in the ICU contribute to better and safer patient care. The above-mentioned considerations regarding the added value of quality indicators might also explain the ICU professionals’ perceptions of documenting quality data observed in our study. A qualitative study in the Netherlands showed that health professionals perceive documentation tasks as unnecessary because they were not relevant for clinical practice or used for quality improvement, overlapped or contradicted with other documentation, or replaced clinical reasoning.8 Moreover, valuable documentation time could have been reduced if the documentation process had been organised more efficiently. Nurses in the UK previously reported similar frustrations and explanations for this type of burden.30 An explanation for documentation perceived as unreasonable can be found in the fact that most of the documentation of data in Dutch ICUs are for purposes other than direct quality improvement in clinical practice (eg, accountability, accreditation and payment),8 and therefore are not seen as a part of their professional core tasks.

Contrary to previous literature,8 31 32 our study also shows that documentation burden seems to have limited impact on ICU professionals’ joy in work, based on the measures we applied. No associations were found between perceived documentation burden and measures of joy in work, except for unnecessary documentations being associated with a lower sense of autonomy. Documenting information that ICU physicians and nurses perceive as unnecessary conflicts with their basic need for professional autonomy, that is, being able to act volitionally and in line with one’s values and professional knowledge base,24 25 and is in line with previous studies indicating that ‘ticking boxes’ diminishes physicians’ and nurses’ sense of autonomy and clinical reasoning.8 20 33 Because professional autonomy is key to delivering good quality of care, especially in acute care settings,16 19 34 35 these unnecessary tasks may threaten the quality of ICU care. The lack of further associations between either documentation time and unreasonable documentation tasks and joy in work could be explained by possible differences among professionals in the extent to which they are affected by documentation burden.8 Some professionals may become frustrated and demotivated, whereas others do not let themselves be affected by these tasks, for example, because they are internally rationalised, skip the documentation of certain data, or find other coping mechanisms. In addition, organisational culture and team climate may reinforce or protect ICU professionals from experiencing the negative consequences of documentation burden.36–38 Another explanation might be that the perceptions of documentation moderate the relationship between documentation time and joy in work.8 Devoting time to documenting useful quality information could align with ICU professionals’ values, and therefore not reduce, but possibly even increase their intrinsic motivation (ie, doing enjoyable things that are in line with one’s values). Finally, this survey was performed amid the COVID-19 pandemic. The impact of the pandemic on ICU professionals’ work and mental well-being is significant,39–41 and most likely influenced their joy in work. This might be a reason for the low variance in measures of joy in work explained by the registration burden. On the other hand, the high response rate during a pandemic might underline the perceived importance of the studied subject.

Strengths and limitations

To our knowledge, this is the first empirical multicentre study examining ICU professionals’ burden of documenting quality indicator data. Compared with other studies,42 especially web-based surveys,43 this study had a high response rate of 65%. Our sample seems sufficiently large and the inclusion of ICUs across eight hospitals provides a more complete picture of the situation in different types of ICUs in the Netherlands. Of the respondents, 83% were nurses and 17% were physicians representing the nurse–physician ratio in our ICUs. Furthermore, we used validated scales in the questionnaire to estimate outcome measures and then subjected these measures to multivariable analysis. Previous validation of these instruments strengthens the evidence that most ICU professionals often deal with documenting quality data they often perceive as unnecessary and that a relation exists between unnecessary documentation and a reduced sense of autonomy.

Several limitations of the study should, however, be noted. First, our findings may not be representative of other countries. Although the documentation burden seems to affect healthcare professionals around the globe, the demand for quality data and documentation efficiency differs per country.44 Compared with most other high-income countries, health professionals in the Netherlands face more paperwork and other bureaucratic tasks.44 Second, there may be a possibility that our findings are biased due to a selective group that did not respond to our survey. We did not use specific methods to address this issue, except for comparing excluded with included cases on demographics. Third, response bias, which is commonly associated with self-assessment scales,45 may have occurred. Respondents tend to overestimate themselves when filling out these scales. This could mean that the results provided an overestimation, for example, on motivation levels. Moreover, documentation time was based on a self-reported estimation using a single-item measure. This may have led to less accurate estimations. The impact of the COVID-19 pandemic on the work and the mental health of ICU professionals,39–41 could also have influenced the scoring by respondents, for example, to emphasise that the documentation of quality data is time-consuming and takes away valuable time from providing necessary care to the large volume of COVID-19 patients. However, outcome scores on documentation burden and joy in work seen within our sample are similar to the levels observed in other samples of health professionals,8 46 supporting our belief in our sample’s representativeness. Finally, ratings may be partly based on perceptions on the documentation of information for routine clinical care instead of monitoring and improvement purposes. We provided a definition and examples of quality indicators in the questionnaire to address this issue.

Implications

Our study calls for a critical review of the number of quality indicators in ICUs. Since this is the first multicentre study on the burden of documenting quality indicator data in the ICU, more research on this topic is needed in different countries to examine the representativeness of our findings and to gather more empirical evidence on the relationship between ICU professionals’ documentation burden and joy in work. Future studies should focus on which aspects of work are affected by this type of burden (after carefully defining these concepts and selecting appropriate measures) and whether diminishing the burden improves joy in work. A combination of quantitative and qualitative research methods is preferred to gain a broad overview of burden types and insight into the underlying factors impacting the joy in work.

Nevertheless, more focus on documenting only what matters is needed. This could be achieved by formulating a core set of measurable quality indicators with for each indicator a clear operationalisation. The selection and use of these indicators should be built on the consensus of all stakeholders who have information demands (ie, policy-makers, regulators, funders, boards, healthcare professionals and patients). In this process, they must align their information needs to avoid unnecessary overlap.8 Documentation burden in the ICU may also be reduced by organisational adjustments to facilitate efficient data collection and documentation (eg, use of intelligent information technology and administrative staff). Also by replacing bureaucratic controls with a policy based on trust in the ICU professional who takes responsibility for the quality of care. The above-mentioned strategies have been recently implemented in the ICUs of the eight participating hospitals. The effects of this intervention bundle on ICU professionals’ documentation burden and joy in work will be evaluated in a longitudinal study.

Conclusion

Dutch ICU professionals spend substantial time on documenting quality indicator data they often regard as unnecessary. Although more research on this topic is needed in different countries to examine the representativeness of our findings and to gather more empirical evidence on the relationship between ICU professionals’ documentation burden and joy in work, it is evident that the use of quality indicators in the ICU is a topic that needs further improvement. Documenting only what matters in a core set of quality indicators, reducing inefficiencies in the process of collecting and documenting data, and giving ICU professionals more responsibility for quality improvement along with adequate organisational means, are vital in tackling the adverse effects of documentation burden.

Supplementary Material

Reviewer comments
Author's manuscript

Acknowledgments

The authors thank all respondents for their participation in this study.

Footnotes

Contributors: MZ, RV and JGvdH conceived the study. MZ, RV, GH, OH, EV, IJ, BW, GA, ICCvdH, PdJ, NP and JGvdH were responsible for the recruitment of participants and the collection of data. GH analysed and interpreted the survey data under the supervision of MZ. GH drafted the manuscript, which was critically revised for important intellectual content by all other authors. All authors read and approved the final manuscript. GH is the guarantor for the work.

Funding: This work was supported by the Netherlands Federation of University Medical Centers (NFU). This organisation was not involved in the design of the study, nor with the data collection, analysis, interpretation or writing of the manuscript.

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer-reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Data availability statement

The deidentified dataset of the current study is available from the corresponding author on reasonable request.

Ethics statements

Patient consent for publication

Not applicable.

Ethics approval

This study involves human participants and local ethics committee ‘CMO region Arnhem-Nijmegen’ approved the study (registration number: 2021-8156). Participants informed consent was obtained at the start of the questionnaire. Participation was only possible after reading the informed consent and selecting the 'agree' option; otherwise, the questionnaire could not be filled out. Participants gave informed consent to participate in the study before taking part.

References

  • 1.Rhodes A, Moreno RP, Azoulay E, et al. Prospectively defined indicators to improve the safety and quality of care for critically ill patients: a report from the task force on safety and quality of the European Society of intensive care medicine (ESICM). Intensive Care Med 2012;38:598–605. 10.1007/s00134-011-2462-3 [DOI] [PubMed] [Google Scholar]
  • 2.de Vos M, Graafmans W, Keesman E, et al. Quality measurement at intensive care units: which indicators should we use? Journal of Critical Care 2007;22:267–74. 10.1016/j.jcrc.2007.01.002 [DOI] [PubMed] [Google Scholar]
  • 3.Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q 2005;83:691–729. 10.1111/j.1468-0009.2005.00397.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Mainz J. Quality indicators: essential for quality improvement. International Journal for Quality in Health Care 2004;16(suppl_1):i1–2. 10.1093/intqhc/mzh036 [DOI] [Google Scholar]
  • 5.Fung CH, Lim YW, Mattke S, et al. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med 2008;148:111–23. 10.7326/0003-4819-148-2-200801150-00006 [DOI] [PubMed] [Google Scholar]
  • 6.Meyer GS, Nelson EC, Pryor DB, et al. More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf 2012;21:964–8. 10.1136/bmjqs-2012-001081 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Botje D, Klazinga NS, Suñol R, et al. Is having quality as an item on the executive board agenda associated with the implementation of quality management systems in European hospitals: a quantitative analysis. Int J Qual Health Care 2014;26 Suppl 1(Suppl 1):92–9. 10.1093/intqhc/mzu017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Zegers M, Veenstra GL, Gerritsen G, et al. Perceived burden due to registrations for quality monitoring and improvement in hospitals: a mixed methods study. Int J Health Policy Manag 2022;11:183–96. 10.34172/ijhpm.2020.96 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Woolhandler S, Himmelstein DU. Administrative work consumes one-sixth of U.S. physicians’ working hours and lowers their career satisfaction. Int J Health Serv 2014;44:635–42. 10.2190/HS.44.4.a [DOI] [PubMed] [Google Scholar]
  • 10.Christino MA, Matson AP, Fischer SA, et al. Paperwork versus patient care: a nationwide survey of residents’ perceptions of clinical documentation requirements and patient care. J Grad Med Educ 2013;5:600–4. 10.4300/JGME-D-12-00377.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Erickson SM, Rockwern B, Koltov M, et al. Putting patients first by reducing administrative tasks in health care: a position paper of the American College of physicians. Ann Intern Med 2017;166:659–61. 10.7326/M16-2697 [DOI] [PubMed] [Google Scholar]
  • 12.Saver BG, Martin SA, Adler RN, et al. Care that matters: quality measurement and health care. PLoS Med 2015;12:e1001902. 10.1371/journal.pmed.1001902 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.de Vos M, Graafmans W, Kooistra M, et al. Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care 2009;21:119–29. 10.1093/intqhc/mzn059 [DOI] [PubMed] [Google Scholar]
  • 14.Ballard A. Framing bias in the interpretation of quality improvement data: evidence from an experiment. Int J Health Policy Manag 2019;8:307–14. 10.15171/ijhpm.2019.08 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Fischer C, Lingsma HF, Marang-van de Mheen PJ, et al. Is the readmission rate a valid quality indicator? A review of the evidence. PLoS One 2014;9:e112282. 10.1371/journal.pone.0112282 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Anema HA, Kievit J, Fischer C, et al. Influences of hospital information systems, indicator data collection and computation on reported Dutch Hospital performance indicator scores. BMC Health Serv Res 2013;13:212. 10.1186/1472-6963-13-212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Freeman T. Using performance indicators to improve health care quality in the public sector: a review of the literature. Health Serv Manage Res 2002;15:126–37. 10.1258/0951484021912897 [DOI] [PubMed] [Google Scholar]
  • 18.Shaw J, Taylor R, Dix K. Uses and abuses of performance data in healthcare. London: Dr Foster, 2015. [Google Scholar]
  • 19.Berenson RA, Rice T. Beyond measurement and reward: methods of motivating quality improvement and accountability. Health Serv Res 2015;50 Suppl 2(Suppl 2):2155–86. 10.1111/1475-6773.12413 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Del Carmen MG, Herman J, Rao S, et al. Trends and factors associated with physician burnout at a Multispecialty academic faculty practice organization. JAMA Netw Open 2019;2:e190554. 10.1001/jamanetworkopen.2019.0554 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Rao SK, Kimball AB, Lehrhoff SR, et al. The impact of administrative burden on academic physicians: results of a hospital-wide physician survey. Acad Med 2017;92:237–43. 10.1097/ACM.0000000000001461 [DOI] [PubMed] [Google Scholar]
  • 22.Semmer NK, Tschan F, Meier LL, et al. Illegitimate tasks and counterproductive work behavior. Appl Psychol 2010;59:70–96. 10.1111/j.1464-0597.2009.00416.x [DOI] [Google Scholar]
  • 23.Jacobshagen N. Illegitimate tasks, illegitimate stressors: testing a new stressor-strain concept [dissertation]. Switzerland, University of Bern, 2006 [Google Scholar]
  • 24.Deci EL, Ryan RM. Self-determination theory: a macrotheory of human motivation, development, and health. Canadian Psychology / Psychologie Canadienne 2008;49:182–5. 10.1037/a0012801 [DOI] [Google Scholar]
  • 25.Gagné M, Forest J, Vansteenkiste M, et al. The multidimensional work motivation scale: validation evidence in seven languages and nine countries. European Journal of Work and Organizational Psychology 2015;24:178–96. 10.1080/1359432X.2013.877892 [DOI] [Google Scholar]
  • 26.Chen B, Vansteenkiste M, Beyers W, et al. Basic psychological need satisfaction, need frustration, and need strength across four cultures. Motiv Emot 2015;39:216–36. 10.1007/s11031-014-9450-1 [DOI] [Google Scholar]
  • 27.Sinsky C, Tutty M, Colligan L. Allocation of physician time in ambulatory practice. Ann Intern Med 2017;166:683–4. 10.7326/L17-0073 [DOI] [PubMed] [Google Scholar]
  • 28.Casalino LP, Nicholson S, Gans DN, et al. What does it cost physician practices to interact with health insurance plans? Health Aff (Millwood) 2009;28:w533–43. 10.1377/hlthaff.28.4.w533 [DOI] [PubMed] [Google Scholar]
  • 29.Himmelstein DU, Jun M, Busse R, et al. A comparison of hospital administrative costs in eight nations: US costs exceed all others by far. Health Aff (Millwood) 2014;33:1586–94. 10.1377/hlthaff.2013.1327 [DOI] [PubMed] [Google Scholar]
  • 30.Walshe K. The rise of regulation in the NHS. BMJ 2002;324:967–70. 10.1136/bmj.324.7343.967 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Andersen LB, Kristensen N, Pedersen LH. Documentation requirements, intrinsic motivation, and worker absence. International Public Management Journal 2015;18:483–513. 10.1080/10967494.2015.1028582 [DOI] [Google Scholar]
  • 32.Damschroder LJ, Robinson CH, Francis J, et al. Effects of performance measure implementation on clinical manager and provider motivation. J Gen Intern Med 2014;29 Suppl 4(Suppl 4):877–84. 10.1007/s11606-014-3020-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Cañadas-De la Fuente GA, Vargas C, San Luis C, et al. Risk factors and prevalence of burnout syndrome in the nursing profession. Int J Nurs Stud 2015;52:240–9. 10.1016/j.ijnurstu.2014.07.001 [DOI] [PubMed] [Google Scholar]
  • 34.Rao AD, Kumar A, McHugh M. Better nurse autonomy decreases the odds of 30-day mortality and failure to rescue. J Nurs Scholarsh 2017;49:73–9. 10.1111/jnu.12267 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.van Oostveen C, Vermeulen H. Greater nurse autonomy associated with lower mortality and failure to rescue rates. Evid Based Nurs 2017;20:56. 10.1136/eb-2016-102591 [DOI] [PubMed] [Google Scholar]
  • 36.Garcia AB, Rocha FLR, Pissinati P de SC, et al. The effects of organisational culture on nurses’ perceptions of their work. Br J Nurs 2017;26:806–12. 10.12968/bjon.2017.26.14.806 [DOI] [PubMed] [Google Scholar]
  • 37.Shanafelt TD, Gorringe G, Menaker R, et al. Impact of organizational leadership on physician burnout and satisfaction. Mayo Clin Proc 2015;90:432–40. 10.1016/j.mayocp.2015.01.012 [DOI] [PubMed] [Google Scholar]
  • 38.West CP, Dyrbye LN, Shanafelt TD. Physician burnout: contributors, consequences and solutions. J Intern Med 2018;283:516–29. 10.1111/joim.12752 [DOI] [PubMed] [Google Scholar]
  • 39.Kok N, van Gurp J, Teerenstra S, et al. Coronavirus disease 2019 immediately increases burnout symptoms in ICU professionals: a longitudinal cohort study. Crit Care Med 2021;49:419–27. 10.1097/CCM.0000000000004865 [DOI] [PubMed] [Google Scholar]
  • 40.Donkers MA, Gilissen V, Candel M, et al. Moral distress and ethical climate in intensive care medicine during COVID-19: a nationwide study. BMC Med Ethics 2021;22:73. 10.1186/s12910-021-00641-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Meynaar IA, Ottens T, Zegers M, et al. Burnout, resilience and work engagement among dutch intensivists in the aftermath of the COVID-19 crisis: a nationwide survey. J Crit Care 2021;62:1–5. 10.1016/j.jcrc.2020.11.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Cho YI, Johnson TP, Vangeest JB. Enhancing surveys of health care professionals: a meta-analysis of techniques to improve response. Eval Health Prof 2013;36:382–407. 10.1177/0163278713496425 [DOI] [PubMed] [Google Scholar]
  • 43.Dykema J, Jones NR, Piché T, et al. Surveying clinicians by web: current issues in design and administration. Eval Health Prof 2013;36:352–81. 10.1177/0163278713496630 [DOI] [PubMed] [Google Scholar]
  • 44.Schneider EC, Shah A, Doty MM, et al. Mirror, mirror 2021 – reflecting poorly: health care in the U.S. compared to other high-income countries New York: Commonwealth Fund Report; 2021. [Google Scholar]
  • 45.Rosenman R, Tennekoon V, Hill LG. Measuring bias in self-reported data. IJBHR 2011;2:320. 10.1504/IJBHR.2011.043414 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.van der Burgt SME, Kusurkar RA, Wilschut JA, et al. Medical specialists’ basic psychological needs, and motivation for work and lifelong learning: a two-step factor score path analysis. BMC Med Educ 2019;19:339. 10.1186/s12909-019-1754-0 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2022-062939supp001.pdf (40.4KB, pdf)

Supplementary data

bmjopen-2022-062939supp002.pdf (85.8KB, pdf)

Supplementary data

bmjopen-2022-062939supp003.pdf (63KB, pdf)

Supplementary data

bmjopen-2022-062939supp004.pdf (77.6KB, pdf)

Reviewer comments
Author's manuscript

Data Availability Statement

The deidentified dataset of the current study is available from the corresponding author on reasonable request.


Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES