Abstract
Background
Early identification of palliative patients is challenging. The Surprise Question (SQ1; Would I be surprised if this patient were to die within 12 months?) is widely used to identify palliative patients. However, its predictive value is low. Therefore, we added a second question (SQ2) to SQ1: ‘Would I be surprised if this patient is still alive after 12 months?’ We studied the accuracy of this double surprise question (DSQ) in a general practice.
Methods
We performed a prospective cohort study with retrospective medical record review in a general practice in the eastern part of the Netherlands. Two general practitioners (GPs) answered both questions for all 292 patients aged ≥75 years (mean age 84 years).
Primary outcome was 1-year death, secondary outcomes were aspects of palliative care.
Results
SQ1 was answered with ‘no‘ for 161/292 patients. Of these, SQ2 was answered with ‘yes’ in 22 patients. Within 12 months 26 patients died, of whom 24 had been identified with SQ1 (sensitivity: 92%, specificity: 49%). Ten of them were also identified with SQ2 (sensitivity: 42%, specificity: 91%). The latter group had more contacts with their GP and more palliative care aspects were discussed.
Conclusions
The DSQ appears a feasible and easy applicable screening tool in general practice. It is highly effective in predicting patients in high need for palliative care and using it helps to discriminate between patients with different life expectancies and palliative care needs. Further research is necessary to confirm the findings of this study.
Keywords: Palliative care, General practice, Identification, Prediction, Death
Background
Timely, proactive and multidimensional palliative care has shown its beneficial effects for patients with cancer as well as for those with other life-limiting diseases [1–5]. The majority of people in need of palliative care are of older age [6]. This group will further increase because of an aging population. Moreover, as Bennett and all showed, older age is associated with a shorter duration of palliative care [7].
In the Netherlands, general practitioners (GPs) are important for providing palliative care at home, as they are easily accessible and they often know the patient and his context for years. However, even for GPs it is difficult to identify patients with an increased risk to deteriorate or die and hence might benefit from palliative care. Besides, GPs restrict identification of palliative patients mostly to case-finding [8, 9] and don’t systematically screen their population. As a result, palliative care nowadays mostly remains reactive, terminal care.
To help GPs and other professionals to timely identify patients in need of palliative care, several tools have been developed, [10, 11]. Most of these tools are time-intensive to apply and complex to use. Because they have different indicators per type of disease, it makes them less suitable as a generic screening instrument for daily (general) practice.
One of the instruments however, the Surprise Question (SQ1), is an easy and non-time consuming tool to apply [12]. A clinician asks himself in silence “Would I be surprised if this patient were to die in the next 12 months?” Its accuracy to predict 1-year mortality has been studied in several populations, [13, 14] but the original purpose of the SQ1 is not prognostication but identifying palliative care needs [12, 15]. Unfortunately, its specificity and prognostic accuracy vary largely; a large number of patients identified by the answer ‘no’ on SQ1 are not in need of palliative care, as many are still in an acceptable health condition. Moreover, although desirable, providing structured or specialized palliative care to all patients that are identified by SQ1 when used as a screening tool for a wider population would ask disproportionate time investments and resources.
For these reasons, we developed an additional, second Surprise Question, to be answered when SQ1 is answered with ‘no’: “Would I be surprised if this patient will be still alive after 12 months?” (SQ2). We hypothesized that adding SQ2 if SQ1 is answered with ‘no’ helps to select those patients with a high chance of deterioration or dying within 1 year, and thus are in urgent need of early palliative care. In two case vignette studies GPs considered the combination of SQ1 and SQ2, called the double SQ (DSQ), a useful tool and it triggered them to plan more anticipatory, multidimensional palliative care for those they considered most vulnerable [16, 17].
However, the DSQ has not been studied in a prospective study. In this explorative study we therefore compared the accuracy (sensitivity, specificity and predictive values) of screening patients ≥75 years in general practice with the DSQ regarding 1-year mortality to SQ1 alone, and compared health care needs and actually provided palliative care in relation to the answers on the DSQ.
Methods
Design
We performed an explorative, prospective study with a retrospective medical record review. In May 2016, two GPs (CV and WG) answered the DSQ for each included patient of their dual practice.
Participants and setting
Patients were not involved in the design of the study. Participants were two GPs in a dual practice in the Southeastern part of the Netherlands. In this practice, both GPs often have a longstanding relationship with their patients. One male GP (CV; 57 years of age, 21 years of experience) had had specialized training in palliative care, the other female GP (WG; 42 years of age, 13 years of experience as a GP) had had specialized training in elderly care.
Procedure
In 2016, both GPs together, in consensus, answered SQ1 for each patient on their patient list aged 75 years or older. If SQ1 was answered with ‘no’, they answered SQ2. By restricting identification to this age category, time investment was feasible, while selecting the majority of patients at risk of deteriorating or dying. In the Netherlands, in 2016 the mean age at death was 75.6 years for men and 80.5 years for women; 66% of the population dies at the age of 75 years or older [6]. No exclusion criteria were used. The answers were kept in a sealed envelope, not documented in the patient files and not used while planning care for patients in the following year.
Ethics
The study was approved by the research ethics committee of the Radboud University Nijmegen Medical Center, case number 2017–3552. In this academic GP practice, all patients have been informed that data from their medical record may be used for research; if they don’t want their data to be used for this, they can opt out. Anonymity was guaranteed. The researcher was, in her role as medical student, part of the general practice team. In the Dutch law, written informed consent for medical record review is not required.
Outcome measures
The primary outcome was death at 12 months.
Next, we related the answers to the SQs to the quantity of received palliative care (secondary outcome measures 1 and 2). Besides, based on the WHO definition of palliative care that states that it should be multidimensional and proactive, [18] secondary outcome measures 3 and 4 were chosen to measure the quality of palliative care:
Number of consultations with the GP practice (consultations at practice, home visits, telephone contacts, consultations with the practice assistant and consultations with the practice nurse);
Number of contacts with the out of hours GP cooperation, emergency room (ER) visits and hospitalizations;
Quality of palliative care and advance care planning (ACP). To analyze these aspects, we checked which palliative domains (somatic, social, psychological and spiritual) and patient preferences for treatment and end-of-life care (ACP directives) were discussed and documented.
Place of death
Data collection
One year after the SQs had been answered, the medical records of all screened patients were blindly reviewed by an independent researcher (NN) who did not know the answers to the SQs.
Characteristics of all screened patients of whom medical records were available were retrieved and also analyzed per answering category group (Table 1). Of the patients that had moved and left the practice in the year after the SQs were answered, only eventual date of death was considered; for them, the secondary research questions were not answered.
Table 1.
Characteristics of patients aged ≥75 years, grouped by SQ1 answers and DSQ answers
| SQ1 | DSQ | |||||
|---|---|---|---|---|---|---|
| Group 1 (SQ1 yes) n = 131a |
Group 2 (SQ1 no) n = 161 |
Group 1 (SQ1 yes) N = 131a |
Group 2a (SQ1 no, SQ2 no) n = 139 |
Group 2b (SQ1 no, SQ2 yes) n = 22 |
All patients n = 292 |
|
| Age; mean (sd) | 82 (4.67) | 86 (5.24) | 82 (4.67) | 86 (5.23) | 87 (5.32) | 84 (5.46) |
| Gender; female n (%) | 87 (131 (66%) | 88/161 (55%) | 87 (131 (66%) | 77/139 (55%) | 11/22 (50%) | 175/292 (60%) |
| Living situation; n (%) | ||||||
| -at home | 88/122 (72%) | 91/154 (59%) | 88/122 (72%) | 79/133 (59%) | 12/21 (57%) | 179/276 (65%) |
| -residential home | 33/122 (27%) | 61/154 (40%) | 33/122 (27%) | 52/133 (39%) | 9/21 (43%) | 94/271 (34%) |
| -with family, other than partner | 1/122 (1%) | 2/154 (1%) | 1/122 (1%) | 2/133 (2%) | 0/21 (0%) | 3/276 (1%) |
| Marital status; n (%) | ||||||
| -married or living together | 69/124 (56%) | 55/156 (35%) | 69/124 (56%) | 48/135 (36%) | 7/21 (33%) | 124/280 (44%) |
| -widow or single | 55/124 (%) | 101/156 (65%) | 55/124 (44%) | 87/135 (64%) | 14/21 (67%) | 156/280 (56%) |
| Care provider; n (%) | ||||||
| -child | 19/123 (15%) | 65/155 (42%) | 19/123 (15%) | 55/134 (41%) | 10/21 (48%) | 84/278 (30%) |
| -partner | 1/123 (1%) | 6/155 (4%) | 1/123 (1%) | 6/134 (5%) | 0/21 (0%) | 7/278 (3%) |
| -other | 10/123 (8%) | 18/155 (12%) | 10/123 (8%) | 14/134 (10%) | 4/21 (19%) | 28/278 (10%) |
| -unknown or none | 93/123 (76%) | 66/155 (43%) | 93/123 (76%) | 59/134 (44%) | 7/21 (33%) | 159/278 (57%) |
| Home care; n (%) | 18/123 (15%) | 83/155 (54%) | 18/123 (15%) | 67/134 (50%) | 16/21 (76%) | 101/278 (36%) |
| Diseasesb; n (%) | ||||||
| -cancer | 2/123 (2%) | 19/155 (12%) | 2/123 (2%) | 11/134 (8%) | 8/21 (38%) | 21/278 (8%) |
| -organ failurec | 24/123 (20%) | 38/155 (25%) | 24/123 (20%) | 67/134 (50%) | 16/21 (76%) | 107/278 (39%) |
| -cognitive impairment | 10/123 (8%) | 38/155 (25%) | 10/123 (8%) | 34/134 (25%) | 4/21 (19%) | 48/278 (17%) |
| -chronic heart failure | 7/123 (6%) | 23/155 (15%) | 7/123 (6%) | 15/134 (11%) | 8/21 (38%) | 30/278 (11%) |
aFor some patients that have moved out of the practice, data are missing and therefore totals differ
bPatients were often diagnosed with more diseases, therefore total percentages exceed 100%
cOrgan failure: defined as having COPD, chronic heart failure, chronic kidney failure and/or neurological degenerative disease
One researcher (NN) extracted data from the medical records according to a case report form (Table 2). In case of doubt issues were discussed with a GP (CV) for clarification of what was written and with a non-clinical researcher (YE) for interpretation whether something occurred or didn’t occur. As a double check, the 15 files that had firstly been analyzed were re-analyzed at the end.
Table 2.
Format for extracting data out of the patient files
| Consultations GP | Consultations at practice, also for small surgery. |
| Telephonic consultations GP | Telephonic consultations or mail contact with patient or caregiver/family, not regarding practicalities such as faxing medical data, or only to inform about lab results. Also: A reaction from the GP at a medical question from the patient, asked by telephone to the assistant. |
| Home visits GP | Home visits of the GP. |
| Consultations practice nurse | Consultations, telephonic consultations, home visits, mail contact and reactions to questions from the patient asked to the assistant, by the somatic and psychological practice nurse or the specialized nurse, not regarding practicalities, or only to inform about lab results. |
| Consultations practice assistant | Consultations, telephonic consultations, home visits, mail contact and reactions to questions from the patient, not regarding practicalities such as faxing medical data or to repeat medication recipes, or only to inform about lab results. Also for diagnostic tests, wound controls and small surgery. If the (telephonic) consultation of the assistant was followed by a consultation or home visit of the GP, only the latter was counted. |
| Quality of palliative care and ACP | Everything regarding the aspects of palliative care and ACP, noted in the patient file by the GP, the assistant, the practice nurse or the specialized nurse. |
| If a will statement was uploaded into the patient file, any ACP directives that it contained were counted. | |
| Dimensions: | |
| Somatic: symptoms, complaints, general health | |
| Psychological: fear, depressed mood, emotions, anger, denial, anxiety, worries | |
| Social: social contacts, tensions between patient and loved ones or care providers, financial worries, leaving loved ones when dying, saying goodbyes | |
| Existential: things that occupy someone, balance of life, questions regarding life and death, preparing for dying, a wish to die, feeling powerless or dependant, hope, faith | |
| Home care | If anywhere during the year, home care was given, it was counted as ‘yes’. |
| Diseases | Also diseases that were diagnosed before the screening with the SQs were counted. |
| Cancer: only when active disease or active treatment | |
| Cardiovascular disease: all cardiovascular diseases, including hypertension, cardiovascular incidents and vascular disease. |
Characteristics or outcomes not mentioned here were unambiguous to extract
Of all included patients, characteristics were described (age, gender, living situation, marital status, whether receiving home care, types of diseases and whether the patient died in the 12 months after screening. For all secondary outcomes, the medical records were retrospectively analyzed for the period of 1 year after the screening. As advance care planning (ACP) could already have been performed before screening took place, we also checked the medical records on end of life preferences of the period before the screening.
Data were kept in Castor, a valid database that meets the Good Clinical Practice criteria. After all data had been extracted, the database was locked. Next, data were exported to SPSS, where the answers to the SQs were added.
Analyses
Statistical analyses were performed with IBM SPSS software version 22. Based on the answers to the SQs, patients were grouped in three possible answer combination groups (group 1: SQ1 answered with ‘yes’; group 2: SQ1 ‘no’, SQ2 ‘no’; group 3: SQ1 ‘no’, SQ2 ‘yes’). Descriptive statistics were used to describe characteristics of all patients and of the patients per group.
To answer the primary outcome, we related the answers to both SQs to 1-year mortality and calculated sensitivity, specificity, positive and negative predictive value (PPV and NPV) of SQ1 and of SQ2. Sensitivity (ability to correctly identify patients who will die) and specificity (ability to correctly identify patients who will not die) were calculated, as well as the positive and negative predictive value (PPV and NPV: ability to respectively predict death and survival) regarding 1 year mortality for respectively SQ1 and SQ2. For each group, frequencies, means and standard deviations of the secondary outcome variables were calculated with descriptive statistics. Besides, for all secondary outcomes we analyzed if there were differences between the deceased patients with different answers to the SQs.
Results
Patients
At the day of screening, 294 (15%) of the 1960 patients on the patient list were aged 75 years or older, and for 292 of them, SQ1 and SQ2 were answered by the two GPs, which took them about 3 h in total. One year later 20 patients had moved and were no longer on the patient list of the practice, and, according to the Dutch privacy law, their medical records had become inaccessible. However, information on their survival could be retrieved. Therefore, primary outcomes were based on data of 292 patients, and secondary outcomes on data of 272 patients (Fig. 1).
Fig. 1.
Flow chart: Inclusion and analysis of patients
For 131 patients, the answer to SQ1 was ‘yes’; the GP would be surprised if these patients would die within a year (group 1). These patients had a lower mean age, more often lived at home and had less morbidities, with exception of cardiovascular disease, than patients for whom SQ1 was answered with ‘no’. SQ1 was answered with ‘no’ for the remaining 161 patients: Of these, SQ2 was answered with “no” in 139 patients (the GP would not be surprised if they would be still alive; group 2) and with ‘yes’ in 22 patients (the GP would be surprised if they would be still alive; group 3). Compared to the patients in groups 1 and 2, patients in group 3 more often received home care and more often were diagnosed with cancer or organ failure.
Deaths – primary outcome
In total 26 patients died during the year of study, of whom two, who both died unexpectedly, had not been identified with SQ1 (SQ1 = no) (sensitivity SQ1: 92%). The specificity of SQ1 was 49%. Of the 161 patients identified with SQ1, 24 died (PPV SQ1: 15%). The negative predictive value (NPV) of SQ1 was 99% (Table 3).
Table 3.
Accuracy of SQ1 and of SQ2
| Total, n |
Died, n |
Survived, n |
Sensitivitya, % (95% CI) | Specificitya, % (95% CI) | PPVa, % (95% CI) | NPVa, % (95% CI) | |
|---|---|---|---|---|---|---|---|
| SQ1 | |||||||
| No | 161 | 24 | 137 | 24/26 = 92.3% (74.9–9.1%) | 129/266 = 48.5% (42.4–54.7%) | 24/161 = 14.9% (9.8–21.4%) | 129/131 = 98.5% (94.6–99.8%) |
| Yes | 131 | 2 | 129 | ||||
| Total | 292 | 26 | 266 | ||||
| SQ2b | |||||||
| Yes | 22 | 10 | 12 | 10/24 = 41.7% (22.1–3.4%) | 125/137 = 91.2% (85.2–95.4%) | 10/22 = 45.5% (24.4–67.8%) | 125/139 = 89.9% (83.7–94.4%) |
| No | 139 | 14 | 125 | ||||
| Total | 161 | 24 | 137 | ||||
Specificity: ability to correctly detect patients who are not dying
PPV Positive predictive value: ability to predict death
NPV Negative predictive value: ability to predict survival
a Sensitivity: ability to correctly detect patients who are dying
b SQ2 was only answered for patients with a negative answer to SQ1
Ten of the deceased patients had been identified with SQ2 (SQ2 = yes), 14 had not (sensitivity SQ2: 42%). The specificity of SQ2 was 91%. With SQ2, 22 patients had been identified, of whom ten had died (PPV SQ2: 45%). The NPV of SQ2 was 90% (Table 3).
After a year, 46% of the patients in group 3 had died, compared to 10% of the patients in group 2 and 2% of the patients in group 1.
Secondary outcomes
Consultations with GP
The mean number of contacts (all types) with the GP was lowest for group 1 and highest for group 3 (group 1: 6.13; group 2: 11.14; group 3: 13.05).
Out of hours GP cooperation, ER visits, hospitalizations
The mean number of contacts with the out of hours service was 0.25 in group 1, 0.77 in group 2 and 1.29 in group 3. No large differences in number of ER visits and hospitalizations were found (Table 4).
Table 4.
Contact with GP and out of hours service, ER visits and hospitalizations; means and standard deviations per answering group on the DSQ
| Group 1 (n = 122)a | Group 2 (n = 129)b | Group 3 (n = 21)c | |
|---|---|---|---|
| Consultations GP; mean (SD) | |||
| - At practice | 3.45 (2.81) | 3.69 (3.36) | 3.90 (4.73) |
| - Telephonic consultation | 1.58 (1.66) | 2.99 (3.67) | 2.05 (1.53) |
| - Home visits | 1.10 (2.39) | 4.46 (6.79) | 7.10 (6.72) |
| Total | 6.13 (4.42) | 11.14 (8.29) | 13.05 (6.98) |
| Total contact with general practiced | 8.87 (6.11) | 15.23 (10.49) | 17.24 (9.16) |
| Contact with out of hours service; mean (SD) | |||
| - Consultation | 0.05 (0.22) | 0.09 (0.35) | 0.00 (0.00) |
| - Telephonic consultation | 0.11 (0.38) | 0.37 (0.88) | 0.81 (1.12) |
| - Home visit | 0.09 (0.43) | 0.31 (0.71) | 0.48 (0.81) |
| Total | 0.25 (0.68) | 0.77 (1.42) | 1.29 (1.59) |
| Emergency Room visits; mean (SD) | 0.19 (0.50) | 0.26 (0.55) | 0.14 (0.36) |
| Hospitalizations; mean (SD) | 0.15 (0.42) | 0.16 (0.42) | 0.24 (0.54) |
aGroup 1: SQ1 = yes
bGroup 2: SQ1 = no, SQ2 = no
cGroup 3: SQ1 = no, SQ2 = yes
dAlso including contacts with GP practice assistant and practice nurse
Palliative care provision
Regarding the documentation of palliative care aspects, figures were almost always highest in group 3 and lowest in group 1 (Table 5). Existential issues were discussed with 57% of the patients in group 3, with 32% of the patients in group 2 and with only 18% of the patients in group 1. Advance care planning was done most often in group 3 (52% versus 34% in group 2 and 20% in group 1) and in the majority of the patients in group 3 (81%), advance care planning often had already been started before the screening with the SQs.
Table 5.
Palliative care aspects, analyzed per answering group on the DSQ
| Group 1 (n = 122)a |
Group 2 (n = 129)b |
Group 3 (n = 21)c |
|
|---|---|---|---|
| Dimensions discussedd; n (%) | |||
| - Somatic | 115 (94%) | 127 (98%) | 21 (100%) |
| - Social | 32 (26%) | 49 (38%) | 8 (38%) |
| - Psychological | 45 (37%) | 59 (46%) | 12 (57%) |
| - Existential | 22 (18%) | 41 (32%) | 12 (57%) |
| Total number of dimensions; median (IQR) | 2 (1) | 2 (2) | 3 (1) |
| ACP directivese; median (IQR) | 0 (0) | 0 (0) | 0 (2) |
| ACP aspectsd; n (%) | |||
| - Discussing end-of-life wishes | 12 (10%) | 17 (13%) | 3 (14%) |
| - Discussing dying scenarios | 0 (0%) | 2 (2%) | 3 (14%) |
| - Discussing preferred place of death | 0 (0%) | 4 (3%) | 4 (19%) |
| - Assignment for out of hours GP care | 5 (4%) | 16 (12%) | 5 (24%) |
| Total number of ACP aspects and directives; median (IQR) | 0 (0) | 0 (1) | 1 (3) |
| At least one ACP aspect or directive | 24 (20%) | 44 (34%) | 11 (52%) |
| At least one ACP aspects or directive discussed before May 2016 | 41 (34%) | 75 (58%) | 17 (81%) |
| At least one ACP aspects or directive, over all time | 53 (43%) | 91 (71%) | 19 (90%) |
| Other palliative care aspectsa; n (%) | |||
| - Discussing personal aspects of quality of life | 0 (0%) | 3 (2%) | 0 (0%) |
| - Discussing personal goals | 2 (2%) | 4 (3%) | 3 (14%) |
| - Discussing preferences for treatment | 18 (15%) | 42 (33%) | 5 (24%) |
| - Involving family and loved-ones in planning care | 18 (15%) | 42 (33%) | 11 (52%) |
| - Providing care for family and loved-ones | 2 (2%) | 10 (8%) | 3 (14%) |
aGroup 1: SQ1 = yes
bGroup 2: SQ1 = no, SQ2 = no
cGroup 3: SQ1 = no, SQ2 = yes
dDimensions, ACP aspects and palliative care aspects: when at least once discussed and documented
eDirectives include: CPR, hospital admissions, mechanical ventilation, antibiotics and artificial feeding and liquid administration
Discussion
Summary
In this study, we investigated the outcome of the Double Surprise Question (DSQ): adding SQ2 to SQ1 if SQ1 is answered with ‘no’, as a proactive screening tool for palliative care needs in primary care. We found a low specificity of SQ1, meaning that many patients were incorrectly identified. For SQ2, we found a low sensitivity, which means that more patients were missed. Therefore each of both SQs on its own is inaccurate in predicting death. However, by asking both questions, a division into three groups was made with largely different death rates (highest in group 3 (SQ1: no, SQ2: yes) and lowest in group 1 (SQ1: yes). Furthermore, patients in group 3 had more contacts with the GP and the out of hours GP service, and aspects of palliative care and advance care planning were more often discussed with these patients than with patients in groups 1 and 2. Patients in group 1 had the lowest figures for these outcomes.
Our findings suggest that the DSQ discriminates between patients with different life expectancies and care consumptions, and also show that SQ2 complements SQ1. The differences in provided care between the two answering categories of SQ2 (group 2 versus group 3), but also between the two categories of SQ1 (group 1 versus groups 2 plus 3 together), show that SQ2 cannot replace SQ1; SQ1 and SQ2 are meant to be applied together.
Because of the clear differences between the three groups, the answers to the DSQ seem related to palliative care needs, although we realize that care needs are not equal to care consumption. In general practice, it is not feasible to provide proactive palliative care to all patients identified with SQ, because of time constraints. Moreover, providing proactive palliative care to patients not in need of it is undesirable for patients and GPs.. SQ2 however divides those patients selected with SQ1 in a small group to focus proactive palliative care on, and a larger group to monitor less intensively.
Strengths and limitations
The DSQ is a simple, innovative, and easy applicable screening tool with the potential to predict individual death and palliative care needs of older patients in daily general practice. It offers the possibility to improve the correct identification of palliative patients. With our study design, we were able to gain information about its properties, taking other outcomes than 1-year mortality in account. While planning care for their patients, the GPs were therefore not actively influenced by the answers to the SQs, although there is a chance that the GPs could recall the small number of patients in group 3 which might have influenced the results. However, if this was the case, to our opinion this recalling of the patients in group 3 will be more related to the frail condition of these patients than to the answers to the SQs. In this prospective study we were able to screen in the whole population elderly, with a high prevalence of death and palliative care.
However, this study has also some limitations. This explorative study was performed in one general practice, where both GPs have been extensively trained in respectively palliative care and frail elderly care and are familiar with both SQs, and are both authors of this paper. This might have influenced the findings.
Next, we studied the DSQ in patients aged 75 and older, implying that we have no information on its value for younger patients.
Almost half of the patients in group 3 died during the year. This means that they had less time to have had contacts with the GP. If they had lived the entire year, they probably would have had more contacts. This may have led to an underestimation of the quantity and also quality of care in group 3.
Comparison with existing literature
Over the past decade, studies on the original SQ (SQ1) in different settings and in different patient groups were always limited to prognostication of death. However, palliative care needs are not always linked to prognosis. The original aim of SQ1 was to identify if a patient is thought to benefit from palliative care services [12] and not to determine if a patient is likely to die in the next year. Our study is the first to study other proxies for palliative care needs as well. Next, up to now the value of SQ1 has been mainly studied in hospital settings or in patient groups with specific, advanced diseases. The only exception is a study of Mitchell et al., who also studied SQ1 as a screening tool in elderly patients in general practice [19]. Finally, this is the first time that the DSQ has been studied prospectively.
Recent meta-analyses showed large ranges in sensitivity and specificity of the individual SQ1 for different studies in homogeneous populations [13, 14]. However, in a daily clinical primary care practice, both high sensitivity and a high specificity are needed to identify the individual patients with a high certitude to die in the coming year, in order to adapt proper care planning in the high through put practice of the future.
Some criticisms at the use of SQ1 as a screening tool have been expressed [20–22]. Because of its moderate predictive values for death, the limited research in patients with non-cancer disease and the lack of evidence that a negative answer to SQ1 correlates with palliative care needs, resistance against its prominent position in extensive screening tools for palliative needs and in palliative care guidelines have been raised. Within this study, we screened all elderly and included other proxies for palliative care needs, thereby providing more information about the properties of SQ1, and also of SQ2.
Conclusions
The DSQ is an innovative, easy and fast screening tool with the potential to predict individual death and palliative care needs of (older) patients in daily general practice as it divides the patient population into three groups with different life expectancy and care consumptions. Further research is necessary to confirm the findings in this explorative study.
Using the DSQ is not meant to predict survival, but to trigger GPs to think about the condition of the patient and to use this awareness while planning and providing palliative care [1, 23, 24].
Acknowledgements
None.
Abbreviations
- ACP
Advance Care Planning
- DSQ
The Double Surprise Question
- ER
Emergency Room
- GP(s)
General Practitioner(s)
- NPV
Negative Predictive Value
- PPV
Positive Predictive Value
- SQ1
The Surprise Question
- SQ2
The second Surprise Question
- SQs
Surprise Questions
- WHO
World Health Organization
Authors’ contributions
CMMV initiated the idea for SQ2 and this study, supervised medical record review, developed the protocol. NN performed the medical record review, analyzed the data and wrote the initial draft of the paper. WDG was involved in data collection and interpreting the data. CAHHVMV and NN wrote the initial draft of the paper, to which all the authors contributed. YE was involved in study design, data collection, analysis, and co-writing the paper. She also supervised the entire study. SV, HS and KCPV were involved in development of the protocol and the writing process, and all authors had access to all data. All authors have read and approved the final manuscript.
Funding
We did not receive any funding for this research.
Availability of data and materials
Data are available upon request via the corresponding author.
Ethics approval and consent to participate
The study was approved by the research ethics committee of the Radboud University Nijmegen Medical Center, case number 2017–3552.
In this academic GP practice, all patients have been informed that data from their medical record may be used for research; if they don’t want their data to be used for this, they can opt out. Anonymity was guaranteed. The researcher was, in her role as medical student, part of the general practice team. The research ethic committee applied a combination of 3 Dutch laws regarding privacy and medical anonymity (the Algemene Verordening Gegevensbescherming AVG (https://wetten.overheid.nl/BWBR0040940/2018-05-25), Wet op de Geneeskundige Behandelingsovereenkomst WGBO (https://www.rijksoverheid.nl/onderwerpen/rechten-van-patient-en-privacy/rechten-bij-een-medische-behandeling/rechten-en-plichten-bij-medische-behandeling) and Wet Maatschappelijke Ondersteuning WMO (https://www.rijksoverheid.nl/onderwerpen/zorg-en-ondersteuning-thuis/wmo-2015) in the approval process of the study, which included the permission not asking written informed consent.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
YE is a member of the editorial board (Associate Editor) of this journal, but the editorial board had no role in the editorial process of this manuscript. No support from any organisation for the submitted work.
No financial relationships with any organisations that might have an interest in the submitted work.
No other relationships or activities that could appear to have influenced the submitted work.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
C. M. M. Veldhoven and N. Nutma contributed equally to this work.
Contributor Information
C. M. M. Veldhoven, Email: carel.veldhoven@radboudumc.nl
N. Nutma, Email: nienke.nutma@radboudumc.nl
W. De Graaf, Email: wdegraaf@huisartsenpraktijkbergendal.nl
H. Schers, Email: Henk.Schers@radboudumc.nl
C. A. H. H. V. M. Verhagen, Email: stans.verhagen@radboudumc.nl
K. C. P. Vissers, Email: kris.vissers@radboudumc.nl
Y. Engels, Email: yvonne.engels@radboudumc.nl
References
- 1.Temel JS, Greer JA, Muzikansky A, Gallagher ER, Admane S, Jackson VA, et al. Early palliative Care for Patients with metastatic non–Small-cell lung Cancer. N Engl J Med. 2010;363(8):733–742. doi: 10.1056/NEJMoa1000678. [DOI] [PubMed] [Google Scholar]
- 2.Bakitas M, Lyons K, Hegel MT, et al. Effects of a palliative care intervention on clinical outcomes in patients with advanced cancer: the project enable ii randomized controlled trial. JAMA. 2009;302(7):741–749. doi: 10.1001/jama.2009.1198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Gomes B, Calanzani N, Curiale V, McCrone P, Higginson IJ. Effectiveness and cost-effectiveness of home palliative care services for adults with advanced illness and their caregivers. Cochrane Database Syst Rev. 2013;(6):CD007760. 10.1002/14651858.CD007760.pub2. [DOI] [PMC free article] [PubMed]
- 4.Sidebottom AC, Jorgenson A, Richards H, Kirven J, Sillah A. Inpatient palliative care for patients with acute heart failure: outcomes from a randomized trial. J Palliat Med. 2015;18(2):134–142. doi: 10.1089/jpm.2014.0192. [DOI] [PubMed] [Google Scholar]
- 5.Higginson IJ, Bausewein C, Reilly CC, Gao W, Gysels M, Dzingina M, et al. An integrated palliative and respiratory care service for patients with advanced disease and refractory breathlessness: a randomised controlled trial. Lancet Respir Med. 2014;2(12):979–987. doi: 10.1016/S2213-2600(14)70226-7. [DOI] [PubMed] [Google Scholar]
- 6.CBS . Dutch Mortality Figures. 2018. [Google Scholar]
- 7.Bennett MI, Ziegler L, Allsop M, Daniel S, Hurlow A. What determines duration of palliative care before death for patients with advanced disease? A retrospective cohort study of community and hospital palliative care provision in a large UK city. BMJ Open. 2016;6(12):e012576. doi: 10.1136/bmjopen-2016-012576. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Thoonsen B, Vissers K, Verhagen S, Prins J, Bor H, van Weel C, et al. Training general practitioners in early identification and anticipatory palliative care planning: a randomized controlled trial. BMC Fam Pract. 2015;16:126. doi: 10.1186/s12875-015-0342-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Abarshi EA, Echteld MA, Van den Block L, Donker GA, Deliens L, Onwuteaka-Philipsen BD. Recognising patients who will die in the near future: a nationwide study via the Dutch sentinel network of GPs. Br J Gen Pract. 2011;61(587):e371–e378. doi: 10.3399/bjgp11X578052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Maas EA, Murray SA, Engels Y, Campbell C. What tools are available to identify patients with palliative care needs in primary care: a systematic literature review and survey of European practice. BMJ Support Palliat Care. 2013;3(4):444–451. doi: 10.1136/bmjspcare-2013-000527. [DOI] [PubMed] [Google Scholar]
- 11.Walsh RI, Mitchell G, Francis L, van Driel ML. What diagnostic tools exist for the early identification of palliative care patients in general practice? A systematic review. J Palliat Care. 2015;31(2):118–123. doi: 10.1177/082585971503100208. [DOI] [PubMed] [Google Scholar]
- 12.Lynn Joanne. Living Long in Fragile Health: The New Demographics Shape End of Life Care. Hastings Center Report. 2005;35(7):s14–s18. doi: 10.1353/hcr.2005.0096. [DOI] [PubMed] [Google Scholar]
- 13.Downar J, Goldman R, Pinto R, Englesakis M, Adhikari NK. The "surprise question" for predicting death in seriously ill patients: a systematic review and meta-analysis. CMAJ. 2017;189(13):E484–Ee93. doi: 10.1503/cmaj.160775. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.White N, Kupeli N, Vickerstaff V, Stone P. How accurate is the ‘surprise question’ at identifying patients at the end of life? A systematic review and meta-analysis. BMC Med. 2017;15(1):139. doi: 10.1186/s12916-017-0907-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Romo RD, Lynn J. The utility and value of the "surprise question" for patients with serious illness. CMAJ. 2017;189(33):E1072–E10E3. doi: 10.1503/cmaj.733231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Weijers F, Veldhoven C, Verhagen S, Vissers K, Engels Y. Does adding a second surprise question to case vignettes help GPs to increase the thoroughness of palliative care planning? Results of a pilot RCT. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Klok L, Engels Y, Veldhoven C, Rotar PD. Early identification of patients in need of palliative care in Slovenian general practice. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.WHO . Definition of palliative care. 2002. [Google Scholar]
- 19.Mitchell Geoffrey K, Senior Hugh E, Rhee Joel J, Ware Robert S, Young Sharleen, Teo Patrick CK, Murray Scott, Boyd Kirsty, Clayton Josephine M. Using intuition or a formal palliative care needs assessment screening process in general practice to predict death within 12 months: A randomised controlled trial. Palliative Medicine. 2017;32(2):384–394. doi: 10.1177/0269216317698621. [DOI] [PubMed] [Google Scholar]
- 20.Janssen DJA, Beuken-van Everdingen vd, M.H.J., Schols JMGA. Verrast door de ‘surprise question’. Ned Tijdschr Geneeskd. 2015;159:A8427.
- 21.Small N, Gardiner C, Barnes S, Gott M, Payne S, Seamark D, et al. Using a prediction of death in the next 12 months as a prompt for referral to palliative care acts to the detriment of patients with heart failure and chronic obstructive pulmonary disease. Palliat Med. 2010;24(7):740–741. doi: 10.1177/0269216310375861. [DOI] [PubMed] [Google Scholar]
- 22.Bodkin H. ‘Surprise question’ sees thousands wrongly told they will die under faulty NHS system. The Telegraph. 2017. [Google Scholar]
- 23.Denvir MA, Cudmore S, Highet G, Robertson S, Donald L, Stephen J, et al. Phase 2 randomised controlled trial and feasibility study of future care planning in patients with advanced heart disease. Sci Rep. 2016;6:24619. doi: 10.1038/srep24619. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Duenk RG, Verhagen C, Bronkhorst EM, van Mierlo P, Broeders M, Collard SM, et al. Proactive palliative care for patients with COPD (PROLONG): a pragmatic cluster controlled trial. Int J Chron Obstruct Pulmon Dis. 2017;12:2795–2806. doi: 10.2147/COPD.S141974. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data are available upon request via the corresponding author.