Abstract
Background
Accurate diagnosis of delirium is very important for prevention and treatment. Present study was designed to validate the 3-Minute Diagnostic Interview for CAM-defined Delirium Chinese version (3D-CAM-CN) in surgical ICU patients.
Methods
In this prospective diagnostic study, the 3D-CAM was translated into Chinese with culture adaption. Two interviewers (Roles A and B) independently administrated 3D-CAM-CN assessment in adult patients from postoperative days 1 to day 3. At the meantime, a panel of psychiatrists diagnosed delirium according to the Diagnostic and Statistical Manual of Mental Disorders-fifth edition as the reference standard. The sensitivity and specificity were calculated to analyze the diagnostic character of the 3D-CAM-CN. Kappa coefficient was used to evaluate interrater reliability.
Results
Two hundred forty-five adult patients were assessed for at least 2 days, resulting a total of 647 paired-assessments. When compared with the reference standard, the sensitivity and specificity of the 3D-CAM-CN assessment were 87.2 and 96.7%, respectively, by Role A and 84.6 and 97.4%, respectively, by Role B, with good interrater reliability (Kappa coefficient = 0.82, P < 0.001). It also performed well in patients with mild cognitive impairment, with the sensitivity from 85.7 to 100% and the specificity from 95.7 to 96.4%.
Conclusion
Our results showed that the 3D-CAM-CN can be used as a reliable and accurate instrument for delirium assessment in surgical patients.
Trial registration
This trail was approved by the Clinical Research Ethic Committee of Peking University First Hospital (No. 2017–1321) and registered on Chinese clinical trial registry on July 6, 2017 (ChiCTR-OOC-17011887).
Keywords: Delirium; Diagnosis; Screening tool; 3D-CAM; Chinese version, validation, Chinese
Background
According to the Diagnostic and Statistical Manual of Mental Disorders-fifth edition (DSM-5), delirium is a transient brain syndrome that develops over a short period of time and is characterized by fluctuating disturbances in attention, awareness and cognition [1]. The reported incidence varies from 11.2 to 23.0% in general patients and is up to 50.6% in those admitted to the intensive care unit (ICU) after major surgery [2–4]. The occurrence of delirium is associated with worse outcomes, including prolonged lengths of stay in ICU and hospital, increased postoperative complications and in-hospital mortality, as well as shortened long-term survival and worsened quality of life in long-term survivors [2, 3, 5–7]. The development of postoperative delirium is a result of multiple factors, including predisposing factors (such as old age, cognitive deficit, preexisting comorbidities, etc.) and precipitating factors (such as surgical trauma, pain, opioids, and surgery-related stress response) [8].
Early diagnosis is essential for delirium prevention and treatment [8]. Unfortunately, underestimation and misdiagnosis of delirium are common and the rate may reach 50 to 70% [9–11]. The DSM-5 is the gold standard for diagnosing delirium [1]. However, the criteria of DSM-5 lack practical and standardized assessment methods for attention, awareness and cognition. Its proper use requires professional psychiatric background and training [12, 13]. To facilitate delirium diagnosis, several bedside assessment tools have been designed for non-psychiatric clinicians, such as the Confusion Assessment Method (CAM), the CAM for the Intensive Care Unit (CAM-ICU) and the 3-Minute Diagnostic Interview for CAM-defined Delirium (3D-CAM) [14–16]. Of these, the CAM is the most widely used delirium assessment tool, but it still has a defect in inconsistence of diagnostic criteria and substantial training is required to guarantee the quality of assessment [14, 17]. To overcome this defect, the 3D-CAM is derived from the CAM and reconstructed with definite criteria for administration [16]. In its original validation study, the 3D-CAM performs well in elderly patients with high sensitivity (93 to 96%) and specificity (86 to 96%) [16].
The aim of this study was to translate the 3D-CAM into Chinese and to validate the 3D-CAM Chinese version (3D-CAM-CN) in surgical patients.
Methods
This was a prospective diagnostic study to validate the reliability of the 3D-CAM-CN in surgical patients. The study protocol was approved by the Clinical Research Ethics Committee of Peking University First Hospital (2017–1321) and registered on Chinese Clinical Trial Registry on July 6, 2017 (http://www.chictr.org.cn, ChiCTR-OOC-17011887). The study was administrated in Peking University First Hospital. Written informed consents were obtained from all enrolled patients or their surrogates.
Translation and back translation
After approval by Dr. Edward R. Marcantonio, [16] translation and back-translation were performed according to the principles of translation and cultural adaptation of patient report outcome measures [18, 19]. Firstly, the original 3D-CAM was translated into Chinese by two anesthesiologists (DLM and DXW) and one psychiatrist (XYS) independently. The three translational versions then were discussed and merged into a final version. Back translation was performed in regardless of any information from its original version. Both the translated and back translated versions (Supplement 1) were sent to Dr. Marcantonio for approval.
To be noted, the translation of items 6 and 7 was adapted according to Chinese culture (Supplement 2). In Chinese, answers to the original items 6 and 7 will be “xingqi (week) 6, xingqi 5, … , and xingqi tian (week day)” and “month 12, month 11, … , and month 1” respectively. This means there are only numeric changes of the word sequence and the difficulty of the tests will be decreased. After discussion with a panel of psychiatrists and approval from Dr. Marcantonio, we adopted “seasons backward” and “minus calculation” instead of the original item 6 and 7, respectively (Supplement 2). Both the recall of seasons in a backward sequence and the minus calculation have been used to test attention in several psychometric instruments and have been validated in Chinese population [20–22].
Participants
The inclusion criteria were adult patients (age ≥ 18 years old) who were admitted to the ICU after surgery with a predicted length of stay for more than 48 h. Those who met any of the following criteria were excluded: (1) refused to participate; (2) history of dementia, schizophrenia, epilepsy, Parkinsonism, or any other cerebral disease that might impede communication; (3) hearing/vision impairment, language barrier or endotracheal intubation which might impede communication; or (4) coma or deep sedation.
Enrollment and baseline data collection
One day before surgery, researchers visited patients who met the inclusion and exclusion criteria. Study protocol and related procedures were explained thoroughly to potential participants. After obtaining written informed consent, baseline data were collected which included demographic characteristics, current diagnosis and history of comorbidities. Cognitive function was assessed with the Mini-Mental State Examination (MMSE, total range 0–30, with higher score indicating better cognitive function) [22]. Patients with a MMSE score of less than 27 were considered to have preoperative cognitive impairment [22, 23].
Delirium assessment
Delirium assessment with the 3D-CAM-CN
Before the study period, all researchers participated in a 3-h training program on delirium and delirium assessment. The theoretical lecture session included the clinical manifestations and diagnosis of delirium, the structure and content of the 3D-CAM-CN, as well as the key points in administrating the 3D-CAM-CN. In the practical training session, two interviewers (PPD and MJL, anesthesia residents) firstly administered the instrument to each other and then to actual patients; the training continued until the diagnosis of delirium reached 100% agreement with the panel of psychiatrists.
During the study period, the two interviewers (Role A [PPD] and Role B [MJL]) were designated to assess delirium with the 3D-CAM-CN. To reduce bias, random numbers were created by a biostatistician to determine the sequence of assessment (i.e., A-B or B-A). The first interviewer asked question at each time during the assessment; the two interviewers then completed delirium assessment independently and were blinded to each other’s result. Patients were consecutively followed-up and repeatedly assessed for delirium from postoperative days 1 to 3 between 18:00 and 20:00. All assessment processes were recorded by video.
Delirium assessment with the DSM-5
One of the psychiatrist panel members (SZZ, QG and QT), who was blinded to the 3D-CAM-CN assessment results, evaluated the patients according to the criteria of DSM-5 within 3 min after the 3D-CAM assessment [1]. The interview process was also recorded by video. The panel then reviewed the video together and made a decision if the patient suffered from delirium. All diagnostic results were reconfirmed by a consultant psychiatrist (XYS). The final results were considered as the reference standards.
Validation of adapted items 6 and 7
Each time during delirium assessment, the psychiatrist panel also made a special examination of attention and judged if the patient had inattention. This was considered as the reference standard for adapted items 6 and 7. The sensitivity and specificity were calculated to test the diagnostic characteristics of these adapted items.
Statistical analysis
Sample size calculation
In our previous study, the incidence of delirium after noncardiac surgery was about 15% [24]. We assumed that the width of confidence interval was 0.2; with the sensitivity and specificity set at 90%, we need to enroll 230 and 41 patients, respectively. Considering a 5% loss to follow-up rate, we planned to enroll 245 patients.
Outcome analysis
Continuous data was presented as mean (standard deviation, SD) or median (interquartile range). Categorical data was presented as number (percentage). The sensitivity and specificity were calculated to analyze the diagnostic characteristics of 3D-CAM-CN in comparison with the reference standard. The sensitivity and specificity of adapted items 6 and 7 were also calculated according to the reference standard. Kappa coefficient was employed to analyze the interrater reliability between two interviewers. All statistical analyses were performed with SPSS 25.0 (IBM SPSS Inc., Chicago, IL, USA). Two-tailed P value of less than 0.05 was considered statistically significant.
Results
Patients
From July 19, 2017 to September 10, 2017, 293 patients were screened. Of these, 245 gave written informed consents and were enrolled; all these patients completed the study and were included in final analyses (Fig. 1). The enrolled patients had a mean age of 73.0 (SD 10.0) years; 22.0% of them (54/245) had preoperative cognitive impairment. Baseline data were presented in Table 1.
Fig. 1.

Flowchart of present study
Table 1.
Baseline and perioperative data
| Variables | Enrolled patients (n = 245) |
|---|---|
| Age, year | 73.0 (10.0) |
| Female gender | 92 (37.6) |
| Height, cm | 165.6 (8.3) |
| Body weight, kg | 65.9 (11.3) |
| Previous medical history | |
| Stroke | 23 (9.4) |
| Hypertension | 142 (58.0) |
| Coronary heart disease | 81 (33.1) |
| Arrhythmia | 31 (12.7) |
| Pneumonia | 1 (0.4) |
| COPD | 9 (3.7) |
| Asthma | 5 (2.0) |
| Diabetics | 65 (26.5) |
| Hyperlipidemia | 2 (0.8) |
| Chronic renal failure | 14 (5.7) |
| Hypothyroidism | 5 (2.0) |
| Hyperthyroidism | 2 (0.8) |
| MMSE, score | 27.5 (2.8) |
| MMSE < 27 | 54 (22.0) |
| Type of surgery | |
| Gastrointestinal | 67 (27.3) |
| Thoracic | 22 (9.0) |
| Orthopedic | 45 (18.4) |
| Urological | 111 (45.3) |
| APACHE II, score | 12.5 (4.3) |
Data was presented as mean (standard deviation) or number (percentage)
COPD chronic obstructive pulmonary disease; MMSE Mini-Mental State Examination; APACHE Acute Physiology and Chronic Health Evaluation
Detection of delirium
Each patient was assessed for at least two consecutive days, resulting 647 paired assessments. According to the DSM-5, the psychiatrist panel reported that 9.8% (24/245) of patients suffered from at least one episode of delirium during the interview assessment. The incidence of delirium reported by Roles A and B was 12.7% (31/245) and 12.2% (30/245), respectively.
Validation of the 3D-CAM-CN assessment
When compared with the reference standard, the sensitivity and specificity of the 3D-CAM-CN assessment by Role A were 87.2% (95% CI 76.7 to 97.7%) and 96.7% (95% CI 95.3 to 98.1%), respectively; and those by Role B were 84.6% (95% CI 73.3 to 95.9%) and 97.4% (95% CI 96.1 to 98.6%), respectively (Table 2). There was a good interrater reliability between Roles A and B (Kappa coefficient = 0.820, P < 0.001).
Table 2.
Validation of the 3D-CAM-CN assessment
| Reference standard by DSM-5 | Role A | Role B | ||||
|---|---|---|---|---|---|---|
| Delirium (yes) | Delirium (no) | Total | Delirium (yes) | Delirium (no) | Total | |
| Delirium (yes) | 34 | 5 | 39 | 33 | 6 | 39 |
| Delirium (no) | 20 | 588 | 608 | 16 | 592 | 608 |
| Sensitivity | 87.2% (76.7–97.7%) | 84.6% (73.3–95.9%) | ||||
| Specificity | 96.7% (95.3–98.1%) | 97.4% (96.1–98.6%) | ||||
| Kappa | 0.820 | |||||
| Pvalue | < 0.001 | |||||
Results are presented as number and estimate (95% confidence interval)
Exploratory analysis of validation of the 3D-CAM-CN assessment
In all enrolled patients, 264 paired assessments were completed in the ICU and 383 in the general ward. The 3D-CAM-CN performed well in both settings with the sensitivity ranged from 82.6 to 93.8% and the specificity from 96.7 to 98.1%, respectively (Table 3).
Table 3.
Exploratory analysis of validation of the 3D-CAM-CN assessment
| Reference standard by the DSM-5 | In the ICU | In the general ward | ||||||||||
| Role A | Role B | Role A | Role B | |||||||||
|
Delirium (yes) |
Delirium (no) |
Total |
Delirium (yes) |
Delirium (no) |
Total | Delirium (yes) |
Delirium (no) |
Total |
Delirium (yes) |
Delirium (no) |
Total | |
| Delirium (yes) | 19 | 4 | 23 | 19 | 4 | 23 | 15 | 1 | 16 | 19 | 4 | 23 |
| Delirium (no) | 8 | 233 | 241 | 9 | 232 | 241 | 12 | 355 | 367 | 9 | 232 | 241 |
| Sensitivity | 82.6% (67.1–98.1%) | 82.6% (67.1–98.1%) | 93.8% (81.9–100%) | 87.5% (71.3–100%) | ||||||||
| Specificity | 96.7% (94.4–98.9%) | 96.3% (93.9–98.7%) | 96.7% (94.9–98.5%) | 98.1% (96.7–99.5%) | ||||||||
| Kappacoefficient | 0.817 | 0.822 | ||||||||||
| Pvalue | < 0.001 | < 0.001 | ||||||||||
| Reference standard by the DSM-5 | In patients with normal cognition | In patients with cognitive impairment | ||||||||||
| Role A | Role B | Role A | Role B | |||||||||
| Delirium (yes) | Delirium (no) | Total | Delirium (yes) | Delirium (no) | Total | Delirium (yes) | Delirium (no) | Total | Delirium (yes) | Delirium (no) | Total | |
| Delirium (yes) | 28 | 4 | 32 | 26 | 6 | 32 | 6 | 1 | 7 | 7 | 0 | 7 |
| Delirium (no) | 14 | 456 | 470 | 11 | 459 | 470 | 6 | 132 | 138 | 5 | 133 | 138 |
| Sensitivity | 87.5% (76.0–99.0%) | 81.3% (67.7–94.8%) | 85.7% (59.8–100%) | 100% (100–100%) | ||||||||
| Specificity | 97.0% (95.5–98.6%) | 97.7% (96.3–99.0%) | 95.7% (92.2–99.1%) | 96.4% (93.3–99.5%) | ||||||||
| Kappacoefficient | 0.849 | 0.727 | ||||||||||
| Pvalue | < 0.001 | < 0.001 | ||||||||||
Results are presented as number and estimate (95% confidence interval)
In 191 patients with normal cognitive function, 502 paired assessments were completed. The sensitivity of 3D-CAM-CN assessment ranged from 81.3 to 87.5%, and the specificity from 97.0 to 97.7%. In 54 patients with cognitive impairment, 145 paired assessments were completed. The sensitivity of 3D-CAM-CN assessment ranged from 85.7 to 100%, and specificity from 95.7 to 96.4% (Table 3).
Validation of the assessment with adapted items 6 and 7
After culture adaptation, items 6 and 7 showed acceptable sensitivity and specificity in validation test (for item 6: sensitivity 71.7 to 73.9%, specificity 78.0 to 78.9%; for item 7: sensitivity 82.6%, specificity 64.9 to 65.1%). The Kappa coefficient of interrater reliability was 0.943 and 0.822, respectively (all P < 0.001) (Table 4).
Table 4.
Validation of adapted items 6 and 7 assessment
| Reference standard by psychiatrists | Item 6 (seasons of year, backward) | Item 7 (minus calculation) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Role A | Role B | Role A | Role B | |||||||||
| Inattention (yes) | Inattention (no) | Total | Inattention (yes) | Inattention (no) | Total | Inattention (yes) | Inattention (no) | Total | Inattention (yes) | Inattention (no) | Total | |
| Inattention (yes) | 33 | 13 | 46 | 34 | 12 | 46 | 38 | 8 | 46 | 38 | 8 | 46 |
| Inattention (no) | 127 | 474 | 601 | 132 | 469 | 601 | 211 | 390 | 601 | 210 | 391 | 601 |
| Sensitivity | 71.7% (58.7–84.8%) | 73.9% (61.2–86.6%) | 82.6% (71.7–93.6%) | 82.6% (71.7–93.6%) | ||||||||
| Specificity | 78.9% (75.6–82.1%) | 78.0% (74.7–81.3%) | 64.9% (61.1–68.7%) | 65.1% (61.2–68.9%) | ||||||||
| Kappa | 0.943 | 0.822 | ||||||||||
| Pvalue | < 0.001 | < 0.001 | ||||||||||
Results are presented as number and estimate (95% confidence interval)
Discussion
Our results showed that the 3D-CAM-CN can be used as a reliable instrument for delirium assessment in patients after surgery. It performed well in patients with mild cognitive impairment or in the ICU settings without endotracheal intubation.
More than 28 kinds of assessment instruments are constructed and introduced to facilitate delirium screening [17, 25]. These instruments significantly improved the efficacy and accuracy of delirium diagnosis. Of these, the CAM was proposed to be the most efficient one [17, 25]. However, one deficit of the CAM is that there exists discrepancy in diagnostic criteria between interviewers even after substantial training [17]. For example, question 2 of the CAM is designed to access if a patient experiences inattention; but there are no clear criteria and predefined assessment method [26]. The interviewer’s skill of interrogation will significantly influence assessment result [17]. The 3D-CAM is derived from the CAM and provides a brief and structured assessment algorithm to accelerate and simplify the process of diagnosis [16].
The present study validated the efficacy and accuracy of the 3D-CAM-CN in surgical patients in both the ICU setting (without endotracheal intubation) and the general ward. Several bed-side instruments have been used for diagnosing delirium in ICU patients, such as the CAM-ICU and the Intensive Care Delirium Screening Checklist (ICDSC) [27]. However, these instruments are seldom compared with the 3D-CAM in ICU patients. In a prospective cohort study of 101 non-ICU geriatric patients (aged ≥75 years), the authors reported that the 3D-CAM was superior than the CAM-ICU in diagnosing delirium [28].
Delirium assessment in patients with cognitive impairment or dementia is a challenging task [29]. Lack of an efficient instrument is considered the main reason of mis- and underdiagnosis of delirium in this population [29, 30]. Marcantonio and colleagues [16] reported that the sensitivity and specificity of the 3D-CAM in dementia patients was 96% and of 86%, respectively. Our study also confirmed that the 3D-CAM-CN performed well in patients with mild cognitive impairment, with high sensitivity (85.7 to 100%) and specificity (95.7 to 96.4%).
Inattention is considered as a core characteristic of delirium by the DSM-5 [1]. Backward recall of weekdays and months is used to detect inattention in the original version of the 3D-CAM. However, in Chinese, answers to the original items 6 and 7 are too simple to guarantee their sensitivity and specificity. In the present study, two alternative tools were adopted for inattention assessment from the MMSE and the Loewenstein Occupational Therapy Cognitive Assessment Battery-second edition [20–22]. In our results, the adapted items 6 and 7 showed good sensitivity and specificity in detecting inattention with high interrater reliability.
The strength of our study included the sufficient pre-study training, the strict reference standards provided by a panel of psychiatrists, and the sufficient sample size. However, limitations also exist. The present study was performed in a single center and only enrolled patients after surgery. These may limit the generalizability of our results.
Conclusions
Our study confirmed that the 3D-CAM-CN can be used as a reliable and accurate instrument for delirium assessment in surgical patients. It performs well in non-intubated patients in the ICU and in those with mild cognitive impairment.
Supplementary information
Additional file 1. Supplement 1 Back translation of 3D-CAM Chinese version
Additional file 2. Supplement 2. Culture adaptation of items 6 and 7
Acknowledgements
We greatly appreciate Drs. Qin Gao (Department of Psychiatry, Third People’s Hospital of Fuyang) and Qi Tang (Department of Psychiatry, Zigong Mental Health Center) for their help in study administration.
Abbreviations
- 3D-CAM
3-Minute Diagnostic Interview for CAM-defined Delirium
- 3D-CAM-CN
3-Minute Diagnostic Interview for CAM-defined Delirium Chinese version
- ICU
Intensive care unit
- DSM-5
Diagnostic and Statistical Manual of Mental Disorders-fifth edition
- CAM
Confusion Assessment Method
- CAM-ICU
CAM for the Intensive Care Unit
- MMSE
Mini-Mental State Examination
- ICDSC
Intensive Care Delirium Screening Checklist
- SD
Standard deviation
- CI
Confidence interval
Authors’ contributions
DLM, study design and administration, manuscript draft. PPD, SZZ, MJL, study administration. XYS, study design, administration and final approval of publication. XYL, statistical analysis. DXW, study design and manuscript revision. The author(s) read and approved the final manuscript.
Funding
This work was supported by National Key R&D Program of China (2018YFC2001800). The sponsors have no role in the study design and conduct; the collection, management, analysis, and interpretation of the data; or the preparation and approval of the manuscript.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study protocol was approved by the Clinical Research Ethics Committee of Peking University First Hospital (2017–1321) and registered on Chinese Clinical Trial Registry on July 6, 2017 (http://www.chictr.org.cn, ChiCTR-OOC-17011887). Written informed consents were obtained from all enrolled patients or their surrogates.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary information accompanies this paper at 10.1186/s12888-020-02544-w.
References
- 1.Association AP. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington: American Psychiatric Association. 2013.
- 2.Su X, Meng ZT, Wu XH, Cui F, Li HL, Wang DX, Zhu X, Zhu SN, Maze M, Ma D. Dexmedetomidine for prevention of delirium in elderly patients after non-cardiac surgery: a randomised, double-blind, placebo-controlled trial. Lancet (London, England) 2016;388(10054):1893–1902. doi: 10.1016/S0140-6736(16)30580-3. [DOI] [PubMed] [Google Scholar]
- 3.Mu DL, Wang DX, Li LH, Shan GJ, Li J, Yu QJ, Shi CX. High serum cortisol level is associated with increased risk of delirium after coronary artery bypass graft surgery: a prospective cohort study. Crit Care (London, England) 2010;14(6):R238. doi: 10.1186/cc9393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Mu DL, Zhang DZ, Wang DX, Wang G, Li CJ, Meng ZT, Li YW, Liu C, Li XY. Parecoxib supplementation to morphine analgesia decreases incidence of delirium in elderly patients after hip or knee replacement surgery: a randomized controlled trial. Anesth Analg. 2017;124(6):1992–2000. doi: 10.1213/ANE.0000000000002095. [DOI] [PubMed] [Google Scholar]
- 5.Ely EW, Shintani A, Truman B, Speroff T, Gordon SM, Harrell FE, Jr, Inouye SK, Bernard GR, Dittus RS. Delirium as a predictor of mortality in mechanically ventilated patients in the intensive care unit. Jama. 2004;291(14):1753–1762. doi: 10.1001/jama.291.14.1753. [DOI] [PubMed] [Google Scholar]
- 6.Thomason JW, Shintani A, Peterson JF, Pun BT, Jackson JC, Ely EW. Intensive care unit delirium is an independent predictor of longer hospital stay: a prospective analysis of 261 non-ventilated patients. Crit Care (London, England) 2005;9(4):R375–R381. doi: 10.1186/cc3729. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Zhang DF, Su X, Meng ZT, Li HL, Wang DX, Li XY, Maze M, Ma D. Impact of Dexmedetomidine on long-term outcomes after noncardiac surgery in elderly: 3-year follow-up of a randomized controlled trial. Ann Surg. 2018;270:356. doi: 10.1097/SLA.0000000000002801. [DOI] [PubMed] [Google Scholar]
- 8.Barr J, Fraser GL, Puntillo K, Ely EW, Gelinas C, Dasta JF, Davidson JE, Devlin JW, Kress JP, Joffe AM, et al. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med. 2013;41(1):263–306. doi: 10.1097/CCM.0b013e3182783b72. [DOI] [PubMed] [Google Scholar]
- 9.Spronk PE, Riekerk B, Hofhuis J, Rommes JH. Occurrence of delirium is severely underestimated in the ICU during daily care. Intensive Care Med. 2009;35(7):1276–1280. doi: 10.1007/s00134-009-1466-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.McCoy TH, Jr, Snapper L, Stern TA, Perlis RH. Underreporting of delirium in statewide claims data: implications for clinical care and predictive modeling. Psychosomatics. 2016;57(5):480–488. doi: 10.1016/j.psym.2016.06.001. [DOI] [PubMed] [Google Scholar]
- 11.Chin YC, Koh GC, Tay YK, Tan CH, Merchant RA. Underdiagnosis of delirium on admission and prediction of patients who will develop delirium during their inpatient stay: a pilot study. Singap Med J. 2016;57(1):18–21. doi: 10.11622/smedj.2016007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Meagher DJ, Morandi A, Inouye SK, Ely W, Adamis D, Maclullich AJ, Rudolph JL, Neufeld K, Leonard M, Bellelli G, et al. Concordance between DSM-IV and DSM-5 criteria for delirium diagnosis in a pooled database of 768 prospectively evaluated patients using the delirium rating scale-revised-98. BMC Med. 2014;12:164. doi: 10.1186/s12916-014-0164-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.European Delirium Association ADS The DSM-5 criteria, level of arousal and delirium diagnosis: inclusiveness is safer. BMC Med. 2014;12:141. doi: 10.1186/s12916-014-0141-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med. 1990;113(12):941–948. doi: 10.7326/0003-4819-113-12-941. [DOI] [PubMed] [Google Scholar]
- 15.Ely EW, Inouye SK, Bernard GR, Gordon S, Francis J, May L, Truman B, Speroff T, Gautam S, Margolin R, et al. Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU) Jama. 2001;286(21):2703–2710. doi: 10.1001/jama.286.21.2703. [DOI] [PubMed] [Google Scholar]
- 16.Marcantonio ER, Ngo LH, O'Connor M, Jones RN, Crane PK, Metzger ED, Inouye SK. 3D-CAM: derivation and validation of a 3-minute diagnostic interview for CAM-defined delirium: a cross-sectional diagnostic test study. Ann Intern Med. 2014;161(8):554–561. doi: 10.7326/M14-0865. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Wong CL, Holroyd-Leduc J, Simel DL, Straus SE. Does this patient have delirium?: value of bedside instruments. Jama. 2010;304(7):779–786. doi: 10.1001/jama.2010.1182. [DOI] [PubMed] [Google Scholar]
- 18.Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–3191. doi: 10.1097/00007632-200012150-00014. [DOI] [PubMed] [Google Scholar]
- 19.Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94–104. doi: 10.1111/j.1524-4733.2005.04054.x. [DOI] [PubMed] [Google Scholar]
- 20.Yu ZZ, Jiang SJ, Li J, Bi S, Li F, Xie T, Wang R, Zhang XT. Clinical application of Loewenstein Occupational Therapy Cognitive Assessment Battery-Second Edition in evaluating of cognitive function of Chinese patients with post-stroke aphasia. Chin Med Sci J. 2013;28(3):167–171. doi: 10.1016/s1001-9294(13)60043-7. [DOI] [PubMed] [Google Scholar]
- 21.Han Y, Liu Y, Zhang X, Tam W, Mao J, Lopez V. Chinese family caregivers of stroke survivors: determinants of caregiving burden within the first six months. J Clin Nurs. 2017;26(23–24):4558–4566. doi: 10.1111/jocn.13793. [DOI] [PubMed] [Google Scholar]
- 22.Katzman R, Zhang MY, Ouang Ya Q, Wang ZY, Liu WT, Yu E, Wong SC, Salmon DP, Grant I. A Chinese version of the mini-mental state examination; impact of illiteracy in a Shanghai dementia survey. J Clin Epidemiol. 1988;41(10):971–978. doi: 10.1016/0895-4356(88)90034-0. [DOI] [PubMed] [Google Scholar]
- 23.Feng L, Chong MS, Lim WS, Ng TP. The modified mini-mental state examination test: normative data for Singapore Chinese older adults and its performance in detecting early cognitive impairment. Singap Med J. 2012;53(7):458–462. [PubMed] [Google Scholar]
- 24.Liu P, Li YW, Wang XS, Zou X, Zhang DZ, Wang DX, Li SZ. High serum interleukin-6 level is associated with increased risk of delirium in elderly patients after noncardiac surgery: a prospective cohort study. Chin Med J. 2013;126(19):3621–3627. [PubMed] [Google Scholar]
- 25.van Velthuijsen EL, Zwakhalen SM, Warnier RM, Mulder WJ, Verhey FR, Kempen GI. Psychometric properties and feasibility of instruments for the detection of delirium in older hospitalized patients: a systematic review. Int J Geriatr Psychiatry. 2016;31(9):974–989. doi: 10.1002/gps.4441. [DOI] [PubMed] [Google Scholar]
- 26.I SK. The Confusion Assessment Method (CAM): Training Manual and Coding Guide. Boston: Hospital Elder Life Program; 2003. [Google Scholar]
- 27.Bilotta F, Lauretta MP, Borozdina A, Mizikov VM, Rosa G. Postoperative delirium: risk factors, diagnosis and perioperative care. Minerva Anestesiol. 2013;79(9):1066–1076. [PubMed] [Google Scholar]
- 28.Kuczmarska A, Ngo LH, Guess J, O'Connor MA, Branford-White L, Palihnich K, Gallagher J, Marcantonio ER. Detection of delirium in hospitalized older general medicine patients: a comparison of the 3D-CAM and CAM-ICU. J Gen Intern Med. 2016;31(3):297–303. doi: 10.1007/s11606-015-3514-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Roden M, Simmons BB. Delirium superimposed on dementia and mild cognitive impairment. Postgrad Med. 2014;126(6):129–137. doi: 10.3810/pgm.2014.10.2827. [DOI] [PubMed] [Google Scholar]
- 30.Fick DM, Agostini JV, Inouye SK. Delirium superimposed on dementia: a systematic review. J Am Geriatr Soc. 2002;50(10):1723–1732. doi: 10.1046/j.1532-5415.2002.50468.x. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional file 1. Supplement 1 Back translation of 3D-CAM Chinese version
Additional file 2. Supplement 2. Culture adaptation of items 6 and 7
Data Availability Statement
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
