Skip to main content
Archives of Rehabilitation Research and Clinical Translation logoLink to Archives of Rehabilitation Research and Clinical Translation
. 2021 Jan 13;3(1):100102. doi: 10.1016/j.arrct.2021.100102

How Well Does the Brief Interview for Mental Status Identify Risk for Cognition Mediated Functional Impairment in a Community Sample?

Timothy S Marks a, Gordon M Giles b,c, Muhammad O Al-Heizan d, Dorothy F Edwards a,
PMCID: PMC7984985  PMID: 33778475

Abstract

Objective

To determine the adequacy of the Brief Interview for Mental Status (BIMS) compared with other screening tools in identifying individuals with limitations in functional cognition and instrumental activities of daily living (IADL).

Design

Cross-sectional observational study.

Setting

Midsized midwestern city.

Participants

We assessed a convenience sample of community dwelling individuals (N=197) aged 55 years and older who were living independently.

Main Outcome Measures

Participant scores on the BIMS, Mini-Cog, Menu Task, and Montreal Cognitive Assessment (MoCA) were compared with the Performance Assessment of Self-Care Skills Checkbook Balancing and Shopping tasks (PCST), which are known to predict impairment in complex IADLs associated with a diagnosis of mild cognitive impairment. Multiple logistic regression analyses controlling for participant demographics, as well as sensitivity and specificity, were computed for each screening measure using the PCST as the criterion measure.

Results

The Mini-Cog, Menu Task, and MoCA identified 25.89%, 32.49%, and 47.21% more individuals, respectively, as impaired than the BIMS. In multiple logistical regression analyses, the BIMS correctly identified 58% of those impaired on the PCST. However, each of the alternate screening measures correctly identified at least 70% of individuals as impaired on the PCST.

Conclusions

In this community sample, the BIMS was insensitive to subtle impairments with the potential to compromise community living, suggesting that the BIMS may be inappropriate for use outside nursing home settings.

Keywords: Activities of daily living, Cognition, Diagnostic Testing and Procedures

List of abbreviations: AUC, area under the curve; BIMS, Brief Interview for Mental Status; CI, confidence interval; CMS, Center for Medicare and Medicaid Services; IADL, instrumental activities of daily living; MoCA, Montreal Cognitive Assessment; OR, odds ratio; PASS, Performance Assessment of Self-Care Skills; PCST, Checkbook Balancing and Shopping tasks


The ability to predict an individual’s ability to perform instrumental activities of daily living (IADL) in real-world contexts is notoriously difficult.1 Typically, complex IADL performance is not directly observable in acute, postacute, or primary care settings,2 and other methods of determining the presence of subtle, but still potentially significant, cognitive impairments are limited.1,3 Cognitive impairment and cognitive decline are known to affect community dwelling elders. For example, a cognitive impairment rate of 23% was observed in a large longitudinal study of community dwelling older adults,4 and cognitive decline is estimated to affect 15 to 35% of hospitalized older adults receiving general medicine services.5 Furthermore, higher rates of cognitive impairment have been observed in acute or postacute care settings for older adults and specific diagnostic populations, such as stroke and cardiopulmonary disease.6,7 Although unimpaired performance of IADLs was initially a prerequisite for the diagnosis of mild neurocognitive disorder, current evidence suggests that unrecognized deficits in complex IADL, also termed “preclinical” disability, may occur in such individuals8, 9, 10, 11 and may presage the need for ongoing monitoring and support.9,12

The Brief Interview for Mental Status (BIMS) was introduced as part of the Minimum Data Set 3.0 to measure cognitive impairment in nursing home populations.13,14 The BIMS is a brief cognitive screening measure that focuses on orientation and short-term word recall. The BIMS represented a major improvement from the Minimum Data Set 2.0 cognitive assessment, which relied on subjective staff observations and had the potential for misclassification of cognitively unimpaired individuals as cognitively impaired.13,14 The 15-point BIMS can be administered in an average of 3.2±2.0 min, resulting in low user and administrator burden,14 and categorizes test takers as severely impaired (0-7 points), moderately impaired (8-12 points), or cognitively intact (13-15 points). The Center for Medicare and Medicaid Services (CMS) has mandated that use of the BIMS be extended across all postacute care settings.15 Although the stated intent of CMS is to use the BIMS “to screen for cognitive impairment in a broad population,”15(p605) given its reliance on short-term memory and orientation assessment, the BIMS may not be an ideal measure for use outside of a skilled nursing context.16, 17, 18 Additionally, the BIMS has been found to have limitations in the identification of milder forms of cognitive impairment even in nursing homes.14,19 It has been argued that measures that incorporate assessments of executive function may perform better in evaluating older adults’ everyday IADL performance,20,21 and that performance-based tests, particularly those that simulate real-life activities, may add to the information derived from traditional neuropsychological measures.22,23 The construct of functional cognition, which has been developed primarily by occupational therapists, is one approach to performance-based testing.15,24 Rather than assess specific cognitive skills in isolation (eg, attention, memory, executive functions), the goal of the evaluation of functional cognition is to assess the capacity to perform essential tasks given the totality of the clients’ abilities, including their use of strategies, habits and routines, and environmental resources.25

In its continuing response to the IMPACT Act,26 the CMS identified both cognition screening and the screening of functional cognition as important domains for measurement consideration.26,27 At this time, the CMS has not selected a functional cognition assessment, but has selected the BIMS for use across postacute care settings (ie, skilled nursing facilities, inpatient rehabilitation facilities, long-term acute care hospitals, and home health care).15 The selection of the BIMS as the neuropsychological screening measure of choice by the CMS may accelerate the adoption of the BIMS by other providers. Indeed, use of the BIMS to screen for cognitive impairment has been reported by care providers in community settings,18,28 and it has been used to validate the hospital-based diagnosis of dementia.29,30 Despite this expanding use of the BIMS, we have been unable to identify reports of its performance relative to other available measures outside inpatient or skilled nursing environments.

With the expanding use of the BIMS in mind, we compared the ability of the BIMS to identify individuals classified as having potential for complex IADL deficits by a measure of functional cognition, the Performance Assessment of Self-Care Skills (PASS) Checkbook Balancing and Shopping tasks (PCST). The PASS has been shown to both predict home care utilization 30-days post hospital discharge31 and to distinguish individuals with mild cognitive impairment from neurologically healthy older adults.12 We selected 3 methodologically distinct measures that include assessments of executive function to compare with the performance of the BIMS in identifying impaired performance on the PCST: the Mini-Cog (a 3-5-minute cognitive screening measure), the Menu Task (a 3-5-minute functional cognitive screening measure), and the Montreal Cognitive Assessment (MoCA) (a 10-minute neuropsychological screening measure). The Mini-Cog is an established screening measure sensitive to cognitive impairments across a variety of diagnoses, including dementia, diabetes, and heart failure, and with demonstrated clinical utility in primary care, acute care, and community settings.32, 33, 34 The Mini-Cog uses a 3-word delayed recall task, but instead of the orientation assessment, which is part of the BIMS, the Mini-Cog has the participant perform a clock-drawing test that is considered sensitive to executive function deficits. The Menu Task is a performance-based measure of functional cognition that is comparable in time to administer to the BIMS and the Mini-Cog.35 The MoCA was selected as a broader measure of neuropsychological functioning and one that is used widely in acute, postacute, and primary care settings.36 We hypothesized that the Mini-Cog, Menu Task, and MoCA would be more sensitive than the BIMS in identifying individuals who were identified by the PCST as having impaired functional cognition with potential for IADL disability. Given that the BIMS is a screening test and not a diagnostic test, the primary focus of our study was on sensitivity, or the capacity of the BIMS to correctly identify individuals with possible impaired functional cognition.37 We also examined the specificity of the BIMs and hypothesized that the BIMS would have the highest specificity and therefore the highest percentage of false negative classifications compared with the other 3 screening measures. We compared the percentages of individuals correctly classified as impaired on the PCST by the BIMS with percentage impairment obtained by each of the other 3 screening measures.

Methods

Research design

This cross-sectional observational study was approved by the Institutional Review Board of the University of Wisconsin–Madison. All participants provided written informed consent. Occupational therapy graduate students from the University of Wisconsin were trained to criterion with each study measure and received weekly supervision during data collection.

Participants and recruitment

A convenience sample of community dwelling adults was recruited in Madison, Wisconsin and its environs (n=197). Inclusion criteria were age 55 years or older, living independently in the community, and willingness and ability to read and write in English.

Study measures

Baseline demographic information was collected for each study participant, including sex, age, education, and chronic health conditions (eg, heart disease, stroke, diabetes, arthritis, kidney disease, etc). To evaluate the relative sensitivity of the BIMS to impaired functional cognition as measured by the PCST, the following measures were administered to study participants: the BIMS, MoCA, Menu Task, Mini-Cog, and PCST. These measures are described in table 1.

Table 1.

Study measures

Measure Description
BIMS The BIMS13,14 is a 15-point cognitive screening measure that evaluates memory and orientation and includes free and cued recall items. A cutoff score of 13 is recommended to indicate the presence of any cognitive impairment and was adopted for this study.
MoCA The MoCA is a multicomponent cognitive screening tool that takes approximately 10 minutes to administer.38 Possible scores range from 0 to 30, with higher scores indicating better performance. Results from a meta-analysis concluded that a cutoff score of 25 was optimal for individuals older than the age of 60 years (sensitivity, 80.48%; specificity, 81.19%) and was adopted for this study.39
Menu Task The Menu Task is a brief performance-based screening measure of functional cognition35 that involves completing a simulated menu and following instructions regarding how the participant must approach the task. The average time to completion was 4 minutes or less in both a community and hospital sample.35 Possible scores range from 0 to 12, with higher scores indicating better performance. This study used a cutoff score of 8 to classify participants as impaired.40
Mini-Cog The Mini-Cog is a widely used 2-part cognitive screening measure that incorporates 3-word recall and a clock-drawing test and that takes 2 to 3 minutes to administer.41 Possible scores range from 0 to 5, with lower scores indicative of greater impairment. A cutoff score of 4 is recommended for greater sensitivity42,43 and was adopted for this study.
PCST The PASS44 includes 26 items that measure activities of daily living and IADL skills, 14 of which are described as IADL items with a cognitive emphasis. Using a cutoff score of 8, the combined scores of the PASS PCST have been found to be as sensitive as the sum score of all PASS items in discriminating between individuals with mild cognitive impairment and healthy older adults.12 These 2 subtests were adopted as a criterion measure in this study. PCST scores are the sum of the number of cues required for independence and adequacy on each task, with lower scores indicating better performance (fewer cues needed). The PASS has been shown to predict hospitalized patients’ 30-day postdischarge home care needs.31

Statistical analyses

The current study is a secondary analysis of data collected as part of another study designed to assess functional cognition among community dwelling middle-aged and older adults. Descriptive analyses for continuous data and frequency distributions for noncontinuous demographic data were computed. We used established cutoff scores for impairment on each screening measure as follows: 13 for the BIMS, 4 for the Mini-Cog, 8 for the Menu Task, and 25 for the MoCA. A series of 2×2 contingency tables were computed to compare each of the screening measures to the PCST. Sensitivity and specificity values were generated in these analyses for each scale.45 A receiver operating characteristic curve was generated for each screening test to further evaluate the diagnostic performance of the screening tests in the classification of impairment on the PCST.

The PCST was used as the index measure for the computation of a series of multiple logistic regression analyses. Participants with PCST scores of 9 or higher were classified as impaired for the purpose of these analyses.12 Multiple stepwise logistic regression analyses using forward model selection procedures were computed separately for each screening measure to estimate odds ratios and 95% confidence intervals. The regression equations predicted membership in the PCST impaired group. Age was categorized as younger or older than 65 years, education was classified as high school or less or at least some college, and sex and number of chronic health conditions were included as covariates to estimate the fit of the final model and the odds of impairment on the PCST. The Nagelkerke R2 was used to report the variance accounted for by the final model. IBM SPSS, version 25,a was used for all statistical analyses.

Results

Table 2 presents the demographic characteristics and scores for each study measure. The sample was predominantly female (76.65%) and White (80.71%) and generally in good health as indicated by a low number of reported chronic health conditions (mean ± SD, 1.16±1.26) detailed in table 2. Participants ranged in age from 55 to 93 years (mean ± SD, 70.46±8.26y), and just under half of the sample reported currently living alone (47.21%) compared to living with a friend or family member (52.79%). Participants were highly educated with between 8 and 27 years of education (mean ± SD, 15.10±3.05y). Men were more likely than women to be categorized as impaired on the Mini-Cog (χ2=5.24, P=.02), Menu Task (χ2=6.32, P=.01), and MoCA (χ2=4.67, P=.03).

Table 2.

Demographic characteristics and scores on study measures

Variable Mean ± SD or n (%) Range Impaired, n (%)
Age, y 70.46±8.26 55-93 -
Chronic Health Conditions 1.16±1.26 0-7 -
 Arthritis 75 (38.07) - -
 Cancer 21 (10.70) - -
 COPD 19 (9.64) - -
 Diabetes 40 (20.30) - -
 Heart disease 32 (16.24) - -
 Kidney disease 12 (6.09) - -
 Mental health condition 20 (10.15) - -
 Stroke 6 (3.05) - -
Education, y 15.10±3.05 8-27 -
BIMS 14.57±0.88 11-15 8 (4.06)
Mini-Cog 3.98±1.28 0-5 59 (29.95)
Menu Task 8.24±2.0 4-12 72 (36.55)
MoCA 24.09±3.55 14-30 101 (51.27)
PCST cues 10.08±9.63 0-48 83 (42.13)
Women 151 (76.65)
White 159 (80.71)

NOTE. N=197. BIMS possible range: 0-15; Mini-Cog possible range: 0-5, Menu Task possible range: 0-12, MoCA possible range: 0-30, PCST possible range: 0+.

Pearson correlations between age and each of the screening measures showed little or no relationship: BIMS (r=.01), Mini-Cog (r=–.14), Menu Task (r=–.20), and MoCA (r=–.18). The number of chronic conditions was not significantly associated with the total scores on any of the screening measures: BIMS (r=–.02), Mini-Cog (r=–.14), Menu Task (r=–.18), and MoCA (r=–.22). There was a minimal association between the BIMS and education (r=.14). The correlations between BIMS total scores and the 3 comparison measures were higher: Mini-Cog (r=.28), Menu Task (r=.37), and MoCA (r=.37).

Based on the previously described scoring criteria, the percentage of participants impaired on each measure was computed. Our index measure, the PCST, categorized 42.13% of participants as impaired (ie, showing difficulty with complex simulated IADL activities). The BIMS, which is the primary focus of the study, categorized only 4.06% of participants as impaired, compared to the Mini-Cog, which categorized 29.95% as impaired, the Menu Task, which categorized 36.55% as impaired, and the MoCA, which categorized 51.27% as impaired (fig 1). Our results indicate that, although the BIMS is highly specific (96% specificity), it has very low sensitivity (5%) as well as the highest misclassification rates of each of the 4 measures we compared. The BIMS had a 50% rate of false positives compared to 35% for the MoCA, 29% for the Menu Task, and 25% for the Mini-Cog. The BIMS also had the highest rate of false negatives (42%) compared to the Mini Cog (28%), the Menu Task (26%), and the MoCA (18%). Although each of the comparison measures included in this study had sensitivities above 50% (ie, >10 times that of the BIMS), the balance of sensitivity and specificity varied across the measures. The MoCA had the highest sensitivity (79%), followed by the Menu Task (61%) and the Mini-Cog (53%). The Mini-Cog had the highest specificity (87%), followed by the Menu Task (82%) and the MoCA (69%). In the receiver operating characteristic curve analysis to detect impairment on the PCST (fig 2), the area under the curve (AUC) for the BIMS was 0.62 (95% confidence interval [CI], 0.54-0.70; P<.01), the AUC for the Mini-Cog was 0.76 (95% CI, 0.69-0.83; P<.001), the AUC for the Menu Task was 0.77 (95% CI, 0.70-0.84; P<.001), and the AUC for the MoCA was 0.83 (95% CI, 0.77-0.89; P<.001) (table 3).

Fig 1.

Fig 1

Percentage of the sample (N=197) identified as impaired by each measure. Measures included the BIMS (cutoff: 13,) Mini-Cog (cutoff: 4), Menu Task (cutoff: 8), Montreal Cognitive Assessment (cutoff: 25), and PCST (cutoff: 8). Abbreviation: MT, Menu Task.

Fig 2.

Fig 2

Receiver operating characteristic curve analysis demonstrating the accuracy of the (A) BIMS, (B) Mini-Cog, (C) Menu Task, and (D) Montreal Cognitive Assessment, in classifying individuals as impaired versus unimpaired on the PCST.

Table 3.

Sensitivity and specificity of screening measures with PCST as index measure

Test (Cutoff) Sensitivity, % (95% CI) Specificity, % (95% CI) TP (%) TN (%) FP (%) FN (%)
BIMS (13) 5 (1.33-11.88) 96 (91.26-99.04) 50 58 50 42
Mini-Cog (4) 53 (41.74-64.07) 87 (79.23-92.44) 75 72 25 28
MoCA (25) 79 (69.24-87.59) 69 (59.97-77.60) 65 82 35 18
Menu Task (8) 61 (50.12-71.93) 82 (73.23-88.22) 71 74 29 26

NOTE. N=197.

Abbreviations: FN, false negative; FP, false positive; TN, true negative; TP, true positive.

In the multiple logistic regression models, the MoCA, Mini-Cog, and Menu Task all outperformed the BIMS (table 4). Having less than a college education was independently associated with increased odds of poor performance on the PCST compared with having at least some college in each multiple logistic regression model. However, number of chronic conditions was not associated with increased odds of impaired performance on the PCST for any of the multiple logistic regression models. Impaired cognition vs unimpaired cognition as measured by the BIMS (odds ratio [OR], 1.14; 95% CI, 0.20-6.67) did not significantly increase the odds of impaired performance on the PCST impairment after controlling for the independent effects of sex and education. In this model, men and all individuals with less than a college education irrespective of sex had significantly increased odds of impaired scores on the PCST, relative to women and individuals with at least some years of college. This model explained 28% of the variance and correctly classified 57% of the participants.

Table 4.

Multiple logistic regression models predicting IADL impairment


Measure/Variable
OR (95% CI) P Value Nagelkerke R2 Model Correct Classification IADL Impairment, %
BIMS .28 57
 Women 0.34 (0.14-0.82) .02
 Age >65 y 1.04 (0.43-2.48) .93
 Education ≥ high school 0.11 (0.04-0.29) .001
 Chronic health conditions 1.18 (0.83-1.58) .23
 BIMS impaired 1.14 (0.20-6.67) .88
MoCA .40 74
 Women 0.47 (0.19-1.20) .12
 Age >65 y 0.97 (0.39-2.44) .95
 Education ≥ high school 0.14 (0.05-0.38) <.001
 Chronic health conditions 1.15 (0.87-1.55) .37
 MoCA impaired 6.17 (2.35-16.16) <.001
Mini-Cog .39 76
 Women 0.42 (0.17-1.06) .07
 Age >65 y 0.94 (0.37-2.37) .89
 Education ≥ high school 0.13 (0.05-0.35) .001
 Chronic health conditions 1.18 (0.86-1.65) .30
 Mini-Cog impaired 10.65 (2.77-40.91) .001
Menu Task .34 73
 Women 0.41 (0.16-0.95) .05
 Age >65 y 0.98 (0.43-2.37) .96
 Education ≥ high school 0.15 (0.05-0.40) <.001
 Chronic health conditions 1.16 (0.86-1.56) .39
 Menu Task impaired 3.06 (1.37-6.85) .01

NOTE. N=197. BIMS possible range: 0-15, MoCA possible range: 0-30, Mini-Cog possible range: 0-5, Menu Task possible range: 0-12, PCST possible range: 0+.

Scores below vs above the MoCA cutoff (OR, 6.17; 95% CI, 2.35-16.16) were associated with having impaired functional cognition as measured by the PCST. Less than a college education (OR, 0.14; 95% CI, 0.05-0.38) independently increased the odds of impaired performance on the PCST relative to individuals with at least some college. This model explained 40% of the variance and correctly classified 74% of the participants.

Scoring below vs above the Mini-Cog cutoff (OR, 10.65; 95% CI, 2.77-40.91) was an independent risk factor for impaired functional cognition as measured by the PCST. Less than a college education (OR, 0.13; 95% CI=0.05-0.35) independently increased the odds of impaired performance on the PCST relative to having at least some years of college. This model explained 39% of the variance and correctly classified 76% of the participants.

Scoring below vs above the Menu Task cutoff (OR, 3.06; 95% CI, 1.37-6.85) was a predictor of having impaired functional cognition as measured by the PCST. In this model, having less than a college education (OR, 0.15; 95% CI, 0.05-0.40), and being male (OR, 0.41; 95% CI, 0.16-0.95) significantly increased the odds of impaired performance on the PCST relative to having at least some years of college. This model explained 34% of the variance and correctly classified 73% of the participants.

The results of the sensitivity and specificity and multiple logistic regression analyses indicated that the BIMS has limited sensitivity to IADL deficits as measured by the PCST, suggesting that screening measures such as the Mini-Cog, Menu Task, or MoCA may be more appropriate than the BIMS for use in a general population.

Discussion

The goal of the present study was to evaluate the performance of the BIMS compared with that of 3 other brief screening measures in the identification of community residing individuals with impaired functional cognition as indicated by the PCST. Our results indicate that the BIMS, with low sensitivity and high specificity and high rates of both false positives and false negatives, is not an optimal screening tool for the purpose of identifying individuals at risk for IADL impairment. This result is not surprising given the nature of the BIMS as a measure that includes only 3-word recall and orientation information. The better performance of the other measures may at least partially be accounted for by their inclusion of activities believed to be sensitive to executive function impairment. Although the comparison measures included in this study have markedly higher levels of sensitivity, their balance of sensitivity and specificity varies. The BIMS had the highest specificity (ie, the lowest rate of false positive findings) across all of the screening measures. Individuals unimpaired on the PSCT were also likely to be classified as unimpaired on the BIMS. Because the BIMS is highly specific, a positive result provides solid evidence for impairment. While screening tests are ideally both highly sensitive and specific, sensitivity is generally preferred over specificity if the objective is early identification and intervention.46 If the goal of screening programs is to identify individuals at risk for impaired cognition and potential for impaired community independence, then the scales with low false negative rates are likely to be the most useful. All 3 comparison measures evaluated have far lower false negative rates than the BIMS. Nonetheless, other factors such as ease of administration and scoring may also be relevant to measure selection depending on setting.

The BIMS was designed to identify cognitive deficits among a postacute skilled nursing population and was a major advance over the procedures in use before its introduction. However, the BIMS does not distinguish between individuals with milder impairments and cognitively healthy individuals, even in a skilled nursing population.13,14,19 Nevertheless, the use of the BIMS is being expanded beyond the population for which it was designed. The results of this study highlight the limitations of the BIMS in identifying individuals with cognitive deficits significant enough to suggest the need for ongoing monitoring and support. Each comparison measure identified more individuals with impaired performance on simulated complex IADL tasks than the BIMS. The 3 comparison measures were selected as methodologically distinct from the BIMS and from each other. The Mini-Cog is the most similar to the BIMS in that it uses 3-word registration and recall, but it differs from the BIMS in using clock drawing, a measure considered sensitive to executive functioning, instead of an assessment of orientation.47,48 As previously noted, the BIMS assesses memory and orientation, but does not include items sensitive to impaired executive functions13,14 that are considered critical to IADL and community independence.1 The Menu Task was designed to be a performance-based measure of functional cognition in which an individual has to complete a simulated menu while following rules. A single task with subcomponents intended to impose cognitive load. Like the BIMS, both the Mini-Cog and the Menu Task take 3 to 4 minutes to administer and require no equipment other than preprinted stimulus materials and a pencil. The MoCA was included in our comparison because it is widely used in acute, postacute, and primary care settings and was developed as a measure of mild cognitive impairment. The MoCA also requires no equipment; however, it takes approximately 10 minutes to administer, making it longer than may be ideal for a screening measure, and, as of 2020, paid certification is required for each user.

We found no association between age or number of self-reported chronic diseases and impairment on the PCST, but a higher proportion of men than women were found to be impaired on 2 of the 4 measures used in this study. Lower educational attainment was also associated with impaired performance on the BIMS and the 3 comparison measures. The MoCA scoring system includes a 1-point adjustment for less than 12 years of education, but none of the other measures have education related adjustments. The independent effects of sex and education suggests that the measures current cutoff scores may require re-evaluation in larger, more diverse samples.

The IMPACT Act was intended to bring uniformity to data collection measures across postacute care settings, but the measures adopted for use still need to be adequate for the intended purpose in each of the settings to which they are applied. Adoption of a measure by the CMS is also likely to lead to its general implementation as a standard across providers. This study raises doubt regarding the adequacy of the BIMS for the expanded purpose proposed by the CMS and suggests that other potentially superior measures are available that meet the criteria established by the CMS. Further research should examine whether a brief screening measure with the components considered sensitive to executive function can be administered routinely by staff with minimal training. Screening measures should be assessed for their ability to predict future IADL impairments.

Study limitations

This study has limitations and caution should be used in interpreting the findings. Participants in the sample were 55 years old and older and were not selected for the presence of cognitive impairment. As a result, the number of individuals with cognitive impairments was lower in our community sample than would be expected across postacute care populations. All measures were administered in the same session, and individual assessment results may have been affected by cross measure contamination. Our estimates of administration time for each measure were derived from the original reports and our own observations. We did not formally record administration times. Because impairments rates in our sample are lower than those expected across postacute settings, it is possible that each of these screening tests would take longer to administer in these populations. In addition, given the relatively small sample size of this study, caution is warranted in interpreting the ORs given the wide CIs. These findings should be independently verified with a larger sample.

Conclusions

This study has important clinical implications for the selection of screening measures used to identify individuals with impaired functional cognition who are at risk for IADL impairments. Functional cognitive impairment has been associated with unstable community placement and the potential for readmission among recently discharged hospital patients who may need additional supports to safely remain in the community. The current findings confirm prior reports that the BIMS is not sensitive to milder forms of cognitive impairments13,14 and provide evidence that several rapid screening measures more accurately identify individuals with deficits in functional cognition than the BIMS.

Supplier

  • a.

    SPSS, version 25.0; IBM Corp.

Acknowledgments

We thank the occupational therapy students who assisted with data collection. This project was supported in part by NIH/NIA NIA 2P30AG033514-01.

Footnotes

Disclosures: none.

References

  • 1.Gold D.A. An examination of instrumental activities of daily living assessment in older adults and mild cognitive impairment. J Clin Exp Neuropsychol. 2012;34:11–34. doi: 10.1080/13803395.2011.614598. [DOI] [PubMed] [Google Scholar]
  • 2.Giles G.M., Edwards D.F., Morrison M.T., Baum C., Wolf T.J. Screening for functional cognition in postacute care and the Improving Medicare Post-Acute Care Transformation (IMPACT) Act of 2014. Am J Occup Ther. 2017;71:7105090010. doi: 10.5014/ajot.2017.715001. [DOI] [PubMed] [Google Scholar]
  • 3.Schmitter-Edgecombe M., Parsey C., Cook D.J. Cognitive correlates of functional performance in older adults: comparison of self-report, direct observation, and performance-based measures. J Int Neurosychol Soc. 2011;17:853–864. doi: 10.1017/S1355617711000865. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Unverzagt F.W., McClure L.A., Wadley V.G. Vascular risk factors and cognitive impairment in a stroke-free cohort. Neurology. 2011;77:1729–1736. doi: 10.1212/WNL.0b013e318236ef23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Joray S., Wietlisbach V., Büla C.J. Cognitive impairment in elderly medical inpatients: detection and associated six-month outcomes. Am J Geriatr Psychiatry. 2004;12:639–647. doi: 10.1176/appi.ajgp.12.6.639. [DOI] [PubMed] [Google Scholar]
  • 6.Buslovich S., Kennedy G.J. Potential effect of screening for subtle cognitive deficits on hospital readmission. J Am Geriatr Soc. 2012;60:1980–1981. doi: 10.1111/j.1532-5415.2012.04135.x. [DOI] [PubMed] [Google Scholar]
  • 7.Edwards D.F., Hahn M., Baum C., Dromerick A.W. The impact of mild stroke on meaningful activity and life satisfaction. J Stroke Cerebrovasc Dis. 2006;15:151–157. doi: 10.1016/j.jstrokecerebrovasdis.2006.04.001. [DOI] [PubMed] [Google Scholar]
  • 8.Fieo R., Stern Y. Increasing the sensitivity of functional status assessment in the preclinical range (normal to mild cognitive impairment): exploring the IADL-extended approach. Dement Geriatr Cogn Disord. 2018;45:282–289. doi: 10.1159/000487632. [DOI] [PubMed] [Google Scholar]
  • 9.Lindbergh C.A., Dishman R.K., Miller L.S. Functional disability in mild cognitive impairment: a systematic review and meta-analysis. Neuropsychol Rev. 2016;26:129–159. doi: 10.1007/s11065-016-9321-5. [DOI] [PubMed] [Google Scholar]
  • 10.Brown P.J., Devanand D.P., Liu X., Caccappolo E., Alzheimer's Disease Neuroimaging Initiative Functional impairment in elderly patients with mild cognitive impairment and mild Alzheimer's disease. Arch Gen Psychiatry. 2011;68:617–626. doi: 10.1001/archgenpsychiatry.2011.57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lee M.T., Jang Y., Chang W.Y. How do impairments in cognitive functions affect activities of daily living functions in older adults? PLoS One. 2019;14 doi: 10.1371/journal.pone.0218112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Rodakowski J., Skidmore E.R., Reynolds C.F. Can performance on daily activities discriminate between older adults with normal cognitive function and those with mild cognitive impairment? J Am Geriatr Soc. 2014;62:1347–1352. doi: 10.1111/jgs.12878. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Chodosh J., Edelen M.O., Buchanan J.L. Nursing home assessment of cognitive impairment: development and testing of a brief instrument of mental status. J Am Geriatr Soc. 2008;56:2069–2075. doi: 10.1111/j.1532-5415.2008.01944.x. [DOI] [PubMed] [Google Scholar]
  • 14.Saliba D., Buchanan J., Edelen M.O. MDS 3.0: brief interview for mental status. J Am Med Dir Assoc. 2012;13:611–617. doi: 10.1016/j.jamda.2012.06.004. [DOI] [PubMed] [Google Scholar]
  • 15.Medicare program; prospective payment system and consolidated billing for skilled nursing facilities.
  • 16.Abd Razak M.A., Ahmad N.A., Chan Y.Y. Validity of screening tools for dementia and mild cognitive impairment among the elderly in primary health care: a systematic review. Public Health. 2019;169:84–92. doi: 10.1016/j.puhe.2019.01.001. [DOI] [PubMed] [Google Scholar]
  • 17.Mansbach W.E., Mace R.A., Tanner M.A., Simmons S.P. A path to early diagnosis of mild cognitive impairment and dementia: validity and reliability of the myMemCheck® self-administered screening tool. Fam Pract. 2020;37:561–567. doi: 10.1093/fampra/cmaa014. [DOI] [PubMed] [Google Scholar]
  • 18.Koncilja K., Koncilja K., Hinds E., Messinger-Rapport B., Lathia A. Effectiveness of the Brief Interview for Mental Status (BIMS) as a screening tool for cognitive impairment in the geriatric heart failure population. J Am Med Dir Assoc. 2014;15:B26. [Google Scholar]
  • 19.Mace R.A., Mansbach W.E., Clark K.M. Rapid cognitive assessment of nursing home residents: a comparison of the Brief Interview for Mental Status (BIMS) and Brief Cognitive Assessment Tool–Short Form (BCAT-SF) Res Gerontol Nurs. 2016;9:35–44. doi: 10.3928/19404921-20150522-05. [DOI] [PubMed] [Google Scholar]
  • 20.Cahn-Weiner D.A., Boyle P.A., Malloy P.F. Tests of executive function predict instrumental activities of daily living in community-dwelling older individuals. Appl Neuropsychol. 2002;9:187–191. doi: 10.1207/S15324826AN0903_8. [DOI] [PubMed] [Google Scholar]
  • 21.Rapp M.A., Beeri M.S., Schmeidler J., Sano M., Silverman J.M., Haroutunian V. Relationaship of neuropsychological performance to functional status in nursing home residents and community-dwelling older adults. Am J Geriatr Psychiatry. 2005;13:450–459. doi: 10.1176/appi.ajgp.13.6.450. [DOI] [PubMed] [Google Scholar]
  • 22.Goverover Y., Toglia J., DeLuca J. The weekly calendar planning activity in multiple sclerosis: a top-down assessment of executive functions. Neuropsychol Rehabil. 2020;30:1372–1387. doi: 10.1080/09602011.2019.1584573. [DOI] [PubMed] [Google Scholar]
  • 23.Priestley N., Manchester D. The courts, neuropsychologists and Covid-19: the case for tele-neuropsychology. Neuropsychologist. 2020;10:21–28. [Google Scholar]
  • 24.Wesson J., Giles G.M. Understanding functional cognition. In: Wolf T.J., Edwards D.F., Giles G.M., editors. Functional cognition and occupational therapy: a practical approach to treating individuals with cognitive loss. AOTA Press; Bethesda, MD: 2019. pp. 7–20. [Google Scholar]
  • 25.Wolf T.J., Edwards D.F., Giles G.M. AOTA Press; Bethesda, MD: 2019. Functional cognition and occupational therapy: a practical approach to treating individuals with cognitive loss. [Google Scholar]
  • 26.Improving Medicare Post-Acute Care Transformation Act of 2014. https://www.congress.gov/113/plaws/publ185/PLAW-113publ185.pdf Available at: Accessed December 29, 2020.
  • 27.Skidmore E.R. Functional cognition: implications for practice, policy, and research. Am J Geriatr Psychiatry. 2017;25:483–484. doi: 10.1016/j.jagp.2016.12.020. [DOI] [PubMed] [Google Scholar]
  • 28.Chiriboga D.A., Park N.S., Gilbert K., Molinari V.A., Barnes M. Cognitive and functional status of persons newly enrolled at dementia-specific adult day centers and burden of their caregivers. Innov Aging. 2019;3:igz013. doi: 10.1093/geroni/igz013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Downer B., Thomas K.S., Mor V., Goodwin J.S., Ottenbacher K.J. Cognitive status of older adults on admission to a skilled nursing facility according to a hospital discharge diagnosis of dementia. J Am Med Dir Assoc. 2017;18:626–728. doi: 10.1016/j.jamda.2017.04.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Loomer L., Downer B., Thomas K.S. Relationship between functional improvement and cognition in short-stay nursing home residents. J Am Geriatr Soc. 2019;67:553–557. doi: 10.1111/jgs.15708. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Brown C.L., Finlayson M.L. Performance measures rather than self-report measures of functional status predict home care use in community-dwelling older adults. Can J Occup Ther. 2013;80:284–294. doi: 10.1177/0008417413501467. [DOI] [PubMed] [Google Scholar]
  • 32.Kallumpuram S., Sudhir Kumar C.T., Khan B., Gavins V., Khan A., Iliffe S. Targeted case finding for dementia in primary care: Surrey Downs dementia diagnosis project. BMJ Qual Improv Rep. 2015;4 doi: 10.1136/bmjquality.u209827.w4086. u209827.w204086. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Patel A., Parikh R., Howell E.H., Hsich E., Landers S., Gorodeski E.Z. Mini-Cog performance: novel marker of post discharge risk among patients hospitalized for heart failure. Circulation. 2015;8:8–16. doi: 10.1161/CIRCHEARTFAILURE.114.001438. [DOI] [PubMed] [Google Scholar]
  • 34.Sinclair A.J., Gadsby R., Hillson R., Forbes A., Bayer A.J. Brief report: use of the Mini-Cog as a screening tool for cognitive impairment in diabetes in primary care. Diabetes Res Clin Pract. 2013;100:e23–e25. doi: 10.1016/j.diabres.2013.01.001. [DOI] [PubMed] [Google Scholar]
  • 35.Edwards D.F., Wolf T.J., Marks T. Reliability and validity of a functional cognition screening tool to identify the need for occupational therapy. Am J Occup Ther. 2019;73 doi: 10.5014/ajot.2019.028753. 7302205050p1-730220505010. [DOI] [PubMed] [Google Scholar]
  • 36.Julayanont P., Nasreddine Z.S. The Montreal Cognitive Assessment (MoCA): concept and clinical review. In: Larner A.J., editor. Cognitive screening instruments: a practical approach. 2nd ed. Springer-Verlag; Basel: 2017. pp. 139–185. [Google Scholar]
  • 37.Maxim L.D., Niebo R., Utell M.J. Screening tests: a review with examples. Inhal Toxicol. 2014;26:811–828. doi: 10.3109/08958378.2014.955932. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Nasreddine Z.S., Phillips N.A., Bédirian V. The Montreal Cognitive Assessment (MoCA): a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–699. doi: 10.1111/j.1532-5415.2005.53221.x. [DOI] [PubMed] [Google Scholar]
  • 39.Ciesielska N., Sokolowski R., Mazur E., Podhorecka M., Polak-Szabela A., Kedziora-Kornatowska K. Is the Montreal Cognitive Assessment (MoCA) test better suited than the Mini-Mental State Examination (MMSE) in mild cognitive impairment (MCI) detection among people aged over 60? Meta-analysis. Psychiatr Pol. 2016;50:1039–1052. doi: 10.12740/PP/45368. [DOI] [PubMed] [Google Scholar]
  • 40.Al-Heizan M.O. University of Wisconsin–Madison; Madison, WI: 2019. Screening for functional cognitive deficits in community dwelling older adults [dissertation] [Google Scholar]
  • 41.Lam A.Y., Anderson K., Borson S., Smith F.L. A pilot study to assess cognition and pillbox fill accuracy by community-dwelling older adults. Consult Pharm. 2011;26:256–263. doi: 10.4140/TCP.n.2011.256. [DOI] [PubMed] [Google Scholar]
  • 42.Borson S., Scanlan J.M., Chen P., Ganguli M. The Mini-Cog as a screen for dementia: validation in a population-based sample. J Am Geriatr Soc. 2003;51:1451–1454. doi: 10.1046/j.1532-5415.2003.51465.x. [DOI] [PubMed] [Google Scholar]
  • 43.McCarten J.R., Anderson P., Kuskowski M.A., McPherson S.E., Borson S. Screening for cognitive impairment in an elderly veteran population: acceptability and results using different versions of the Mini-Cog. J Am Geriatr Soc. 2011;59:309–313. doi: 10.1111/j.1532-5415.2010.03249.x. [DOI] [PubMed] [Google Scholar]
  • 44.Rogers J.C., Holm M., Chisholm D. University of Pittsburgh; Pittsburgh: 2016. Performance assessment of self-care skills. [Google Scholar]
  • 45.Altman D.G., Bland J.M. Diagnostic tests. 1: sensitivity and specificity. BMJ. 1994;308:1552. doi: 10.1136/bmj.308.6943.1552. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Trevethan R. Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice. Front Public Health. 2017;5:307. doi: 10.3389/fpubh.2017.00307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Suleman R., Padwal R., Hamilton P., Senthilselvan A., Alagiakrishnan K. Association between central blood pressure, arterial stiffness, and mild cognitive impairment. Clin Hypertens. 2017;23:2. doi: 10.1186/s40885-016-0058-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Cornelis E., Gorus E., Van Schelvergem N., De Vriendt P. The relationship between basic, instrumental, and advanced activities of daily living and executive functioning in geriatric patients with neurocognitive disorders. Int J Geriatr Psychiatry. 2018;34:889–899. doi: 10.1002/gps.5087. [DOI] [PubMed] [Google Scholar]

Articles from Archives of Rehabilitation Research and Clinical Translation are provided here courtesy of Elsevier

RESOURCES