Abstract
Background
Functional decline in community-dwelling older persons is associated with the loss of independence, the need for hospital and nursing-home care and premature death. The effectiveness of multifactorial interventions in preventing functional decline remains controversial. The aim of this study is to investigate whether functional decline in community-dwelling older persons can be delayed or prevented by a comprehensive geriatric assessment, multifactorial interventions and nurse-led care coordination.
Methods/Design
In a cluster randomized controlled trial, with the general practice as the unit of randomization, 1281 participants from 25 general practices will be enrolled in each condition to compare the intervention with usual care. The intervention will focus on older persons who are at increased risk for functional decline, identified by an Identification of Seniors at Risk Primary Care (ISAR-PC) score (≥ 2). These older persons will receive a comprehensive geriatric assessment, an individually tailored care and treatment plan, consisting of multifactorial, evidence-based interventions and subsequent nurse-led care coordination. The control group will receive 'care as usual' by the general practitioner (GP). The main outcome after 12 months is the level of physical functioning on the modified Katz-15 index score. The secondary outcomes are health-related quality of life, psychological and social functioning, healthcare utilization and institutionalization. Furthermore, a process evaluation and cost-effectiveness analysis will be performed.
Discussion
This study will provide new knowledge regarding the effectiveness and feasibility of a comprehensive geriatric assessment, multifactorial interventions and nurse-led elderly care in general practice.
Trial registration
Grant
Unrestricted grant 'The Netherlands Organisation for Health Research and development' no 313020201
Keywords: Comprehensive geriatric assessment, Multifactorial interventions, Nurse-led care coordination, Functional decline, Community dwelling older persons
Background
Functional decline in community-dwelling older persons is associated with the loss of independence, the need for hospital and nursing-home care and premature death [1]. Functional decline is defined as the deterioration of one or more activities of daily living (ADL) or instrumental activities of daily living (IADL) and it affects approximately 12% of community-dwelling persons aged 75 years and over yearly [2,3]. Present evidence suggests that with the increasing life expectancy, functional decline is postponed toward the oldest age (> 85 years) [4,5]. With an aging population, increasing levels of functional decline are expected to place a high burden on social and economic resources [6]. Therefore, there has been considerable focus on multifactorial interventions to maintain physical functioning and independence and to postpone disabilities in community-dwelling older persons [1]. Nevertheless, the effectiveness of multifactorial interventions, regarded as interventions relating to different aspects of care, for the prevention of functional decline remains controversial [1,7-10]. Previously, a meta-analysis reported no reduction in functional decline [8] whereas two later meta-analyses reported a reduction in functional decline only in programs that included a clinical examination [8,9,11]. A fourth meta-analysis showed a favorable yet modest reduction in functional decline, but no specific benefit for type or intensity of intervention was noted [1].
Despite controversy about their effectiveness, annual multidimensional assessments or preventive home visitation programs are part of national policies in several Western countries, including the United Kingdom and Denmark [12,13]. In the Netherlands, comprehensive guidelines for the care of community-dwelling older persons with multifactorial care needs are still lacking. In 2008, the Dutch government launched the National Program of Care for Elderly Persons to improve care and cure rates for older persons by stimulating innovative healthcare projects focused on multifactorial care.
The aim of this study, as part of the National Program, is to investigate whether functional decline in community-dwelling older persons can be delayed or prevented by a comprehensive geriatric assessment, an individually tailored care and treatment plan based on multifactorial, evidence-based interventions and nurse-led care coordination.
Methods
Design and setting
This cluster randomized trial is being conducted in 25 general practices (34 general practitioners (GPs)), with a total of 10,471 persons aged 70 years and over, in the northwestern region of the Netherlands. The region has both urban and rural communities, which is broadly representative of the general Dutch population. The study started on December 1, 2010 and in each general practice, the intervention will end after 12 months, with a final follow-up measurement after 24 months.
Study population
General practices are eligible unless they already employ nurses for care coordination for community-dwelling older persons. At the start of the study on December 1, 2010, such programs were still rare. All community-dwelling persons aged 70 years and over who are registered with one of the participating general practices are selected from the electronic medical records by their GP. Persons are excluded if, according to their GP, they are terminally ill, suffer from dementia, do not understand Dutch, plan to move or spend a long time abroad or live in a nursing home. Eligible persons receive a letter with study information from their GP, along with a written informed consent form, a self-reporting questionnaire and a pre-paid envelope. They are invited to fill out the questionnaire themselves, but if they need help, an informal caregiver is allowed to provide help.
Those persons unwilling to participate are asked to select one of four prestructured reasons on a reply card: too ill, no health problems, not interested, or lack of time. Or, they can add their own comment. A postal reminder is sent after three weeks if no response is received. After six weeks, two attempts by phone are made to contact those who have failed to respond.
Ethical approval and informed consent
All general practitioners are asked to provide written informed consent for their participation in the study. All participants are asked to provide written informed consent for data collection and participation in the study after receiving written study information.
The recruitment procedures are conducted in accordance with the Dutch Medical Research Involving Human Subjects Act and the WMA declaration of Helsinki. The study has been approved by the Medical Ethics Committee of the Academic Medical Center, University of Amsterdam, in the Netherlands (protocol ID MEC10/182).
Randomization and blinding
In this cluster randomized controlled trial, with the general practice as the unit of randomization to minimize contamination [14], 25 general practices are randomly assigned to the intervention condition or the control condition (Figure 1). General practitioners who share a patient register are considered to be a single practice. A prerandomization procedure is conducted to prepare the intervention practices for the introduction of a registered nurse (RN) specialized in care for older persons, to provide instructions about the study protocol to the RNs and GPs and to plan home visits for respondents at increased risk for functional decline in the intervention practices.
Computerized randomization is performed by an independent statistician. To ensure sufficient balance between the intervention and control condition, the randomization procedure contains the following restrictions: (1) for both study arms, the total number of potential participants should not differ by more than 250 persons, (2) the number of general practices should not differ by more than five practices and (3) the absolute difference in the proportion of participants with a high socioeconomic status score should not differ by more than 20%. The first computer-randomized list generated that fulfills all criteria will be used.
With regard to the intervention, a postponed informed consent procedure has been chosen to blind all participants in both arms [15]. This procedure is applied to prevent selection bias; subjects in the control condition may be less motivated to participate if they are aware that they are assigned to a control cluster [15]. Similarly, participants in the intervention condition may influence their self-rated scores if they are aware that a higher score may lead to nurse-led care [16]. In the intervention condition, eligible participants are further informed about the procedure of the comprehensive geriatric assessment (CGA), the individually tailored care and treatment plan (CTP) based on multifactorial interventions and the nurse-led care coordination, but they are not otherwise informed that this is the intervention under study. As explained in the study information, participants in both study groups will receive written information on the complete study objectives and outcomes after termination of the study.
Blinded research assistants will conduct all physical follow-up assessments after 12 months in the intervention group.
Sample size calculation
On the basis of a consensus within the study group, we determined the smallest meaningful clinical difference to be 0.5 points on the primary outcome measure (Katz-15) within the group of participants at increased risk of functional decline (ISAR-PC score ≥ 2). Observational data from primary care practices from a prospective cohort study (mean Katz score 2.70, SD 2.55) indicates that this would represent an effect size of 0.20. With an assumed ICC of 0.015 [17] and an expected cluster size of 100 participants per practice, the design effect would amount to 2.50 (1 + 100*0.015). Using a two-sided alpha of 0.05 and power of 80%, 1025 participants would be needed in each group, taking into account the design effect (unadjusted 410). To allow for a drop-out rate of 20% within one year, the final target sample of participants was increased to 1281 per treatment arm.
Identification of older persons at increased risk for functional decline
The ISAR questionnaire was originally developed to identify older persons at risk for functional decline who visited the emergency department [18]. The questionnaire consists of six dichotomous, self-rated questions on the dependence of ADL and IADL, recent hospitalizations, impaired memory, visual impairment and polypharmacy. In a prospective cohort study with 790 patients, the ISAR was adapted and validated for the prediction of functional decline at 12 months in community-dwelling older persons (ISAR-Primary Care, ISAR-PC). The ISAR-PC comprises four simple, self-rated questions on the dependence of ADL and IADL, impaired memory and age (70-75 years; 75-85 years; > 85 years) that can be rated on a score card (Table 1). At a cut-off of two points, the ISAR-PC reaches an optimum, with an area under the curve (AUC) of 0.70 (95% CI 0.68-0.71) (Unpublished data). Therefore, all participants with a score of two points or more on the ISAR-PC, which is approximately 39%, are considered to be at increased risk for functional decline and are eligible for the intervention.
Table 1.
ISAR-PC | ||
---|---|---|
1. Did you need assistance for IADL on a regular basis in the last month (e.g., assistance in housekeeping, preparing meals, shopping)? |
No | 0.0 |
Yes | 2.5 | |
2. Did you need assistance for ADL in the last 24 hours (e.g., dressing, going to the toilet)? |
No | 0.0 |
Yes | 2.0 | |
3. Do you regularly have memory problems? | No | 0.0 |
Yes | 2.0 | |
4. Your age is: | 74 year or younger | 0.0 |
Between 75 en 84 year 85 | 1.5 | |
year and older | 3.0 | |
Total score | ... |
Total score 0 or 1: Not at risk
Total score ≥ 2: Patient at risk for functional decline
Maximum score: 9.5 points
Baseline assessment
The self-reporting questionnaire that is conducted at baseline comprises determinants of functional decline (e.g., comorbidities) and a minimal data set (MDS) consisting of demographic data, physical functioning, self-perceived health status, psychological and social functioning, health-related quality of life and healthcare consumption, as the study is conducted as part of the National Program [19]. The questionnaire takes between 20 and 30 minutes to complete (see Table 2 for further details).
Table 2.
Measures | Baseline | 6 m | 12 m | 18 m | 24 m |
---|---|---|---|---|---|
Intervention group | |||||
Self-reporting measures | |||||
Physical function Katz-15 index [33,32] | x | x | x | x | x |
Health-related quality of life (EQ-6D) [34] | x | x | x | x | x |
Psychological and social functioning (subscale Rand 36) [35] | x | x | x | x | x |
Healthcare utilization [36] | x | x | x | x | x |
Incidence of falls within 12 months | x | x | x | x | x |
Evaluation of burden of caregivers (CarerQol) [37] | x | x | x | x | x |
Mortality rate (GP registration) | x | x | x | x | x |
Comprehensive Geriatric Assessment | x | ||||
Physical examination | |||||
BMI (kg/m2) | x | x | |||
Blood pressure (mmHg) | x | x | |||
Pulse (beats/min) | x | x | |||
Grip strength (kg) | x | x | |||
Walking speed (m/s) | x | x | |||
Process evaluation | |||||
Patient interviews | x | ||||
Registred nurse interviews | x | ||||
Interviews general practitioners | x | ||||
Control group | |||||
Self-reporting measures | |||||
Physical function (modified Katz ADL index score) [31,32] | x | x | x | x | x |
Health-related quality of life (EQ-6D) [34] | x | x | x | x | x |
Psychological and social functioning (subscale Rand 36) [35] | x | x | x | x | x |
Healthcare utilization [36] | x | x | x | x | x |
Incidence of falls within 12 months | x | x | x | x | x |
Evaluation of burden of caregivers (CarerQol) [37] | x | x | x | x | x |
Mortality rate (GP registration) | x | x | x | x | x |
Physical examination (aselect sample) | |||||
BMI (kg/m2) | x | x | |||
Blood pressure (mmHg) | x | x | |||
Pulse (beats/min) | x | x | |||
Grip strength (kg) | x | x | |||
Walking speed (m/s) | x | x | |||
BMI (kg/m2) | x | x |
Intervention
The intervention consists of a CGA, an individually tailored CTP based on multifactorial interventions and nurse-led care coordination with components of both disease and case management. All components of the intervention are conducted by an RN and are described in the study protocol (see the web appendix, Additional file 1 for further details).
Registered nurse specialized in care for older persons
In total, fourteen RNs are taking part in the intervention. Both before and during the trial, the RNs follow a 10-day training program in which they are educated on the content and use of the study protocol, the CGA and how to design and apply the individually tailored CTP. Much emphasis is placed on care coordination, patient empowerment and motivational interviewing. Following the training, they will attend a group refresher course every six weeks on the content of the study protocol and discuss complex cases. Each individual RN's work-up and care coordination of complex cases is critically reviewed twice.
Comprehensive Geriatric Assessment
The CGA is conducted during the first two home visits to systematically identify geriatric conditions, problems and needs that are frequently encountered with community-dwelling older persons. The CGA focuses on the physical, psychological, functional and social domains, such as urinary incontinence, memory problems, fall risk and loneliness, respectively (Table 3). For identification of these conditions, the CGA comprises a bundle of internationally validated instruments. While some instruments are used for all participants (e.g., Mini-mental state examination (MMSE)) [20], the use of others is preceded by a positive answer on one or two screening questions (e.g., Geriatric Depression Scale-15 (GDS-15) is preceded by Geriatric Depression Scale-2 (GDS-2)) [21]. If such instruments are not available, we use commonly used items from the guidelines or literature to inquire about the presence or absence of certain problems (e.g., 'do you experience urinary incontinence?'). These questions were piloted among a small group of GPs and patients before they were incorporated into the CGA. After completing the full checklist in all four domains, a physical examination takes place that includes height, weight, blood pressure, pulse, handgrip strength and walking speed. The latter measurements make it possible to define the population along the Fried criteria for frailty [22].
Table 3.
Domain | Question (Q) or instrument (I) in CGA | Condition/disease |
---|---|---|
Physical | ||
Medication | Do you experience difficulties or side effect with medication use? Polypharmacy defined as the use or three or more different medications Medication adherence (questionnaire of Aburuz) [55] |
Medication safety and side effects Polypharmacy Medication adherence |
Mobility and stability | Have you fallen once or more in the past twelfth months? [56] Fear of falling (FES-I) [57] Do you experience dizziness? Fracture risk score [57,58] |
Falls Fear of falling Dizziness Osteoporosis risk |
Nutrition | Short Nutritional Assessment Questionnaire (SNAQ) [59] Have you been admitted to a hospital because of dehydration? Difficulties with swallowing? Do you have pain in your mouth? |
Malnutrition Dehydration Swallowing disturbance Oral hygiene |
Urine and fecal problems | Do you experience urinary incontinence? Do you experience fecal incontinence? Do you have a indwelling urinary catheter? Do you experience obstipation? |
Urinary incontinence Feacal incontinence Indwelling urinary catheter use Obstipation |
Skin | Do you have pressure ulcer(s)? | Pressure ulcer |
Pain | Visual analogue scale for pain [60] | Pain |
Allergy | Are you allergic? | Allergy |
Phychological | ||
Cognition | Do you have memory problems? Mini- Mental State Examination (MMSE) [20] |
Cognitive impairment |
Delirium | Have you ever experienced a delirium? Confusement Assessment Method(CAM) [61] |
Delirium |
Depression | Geriatric depression Scale (GDS-2, GDS-15) [21,62] | Depression |
Anxiety | Do you feel anxious? | Anxiety |
Dependency | Do you smoke? Use of alcohol [63,64] Do you use benzodiazepines? |
Alcohol, smoking and medication use |
Functional | ||
ADL functioning | Modified Katz ADL index score [31] | ADL dependency |
IADL functioning | IADL questions of Lawton and Brody [32] | IADL dependency |
Mobility difficulty | Are you using a walking aid? | Mobility difficulty |
Hearing | Do you experience difficulties with hearing, despite the use of a hearing aid? | Hearing impairment |
Visual | Do you experience difficulties with your vision, despite the use of glasses? | Visual impairment |
Sleep | Do you experience problems with sleeping? Do you use sleeping medication? If yes, how often? |
Sleeping disorder |
Social | ||
Loneliness | Jong Gierveld-questionnaire [38] | Loneliness |
Finance | Can you manage financially? | Finance |
Health related quality of live | EQ-6D [34] | Health related quality of live |
Burden of caregiver | CarerQol instrument [37] | Burden of caregiver |
Physical examination | ||
Body mass index | (kg/m2) | Obesity or weight loss |
Blood pressure | (mmHg) | Hypertension |
Pulse | (beats/min) | Pulse |
Grip strength | Maximal grip strength in the dominant hand (kg) [22] | Frailty |
Walking speed | Walk three meter at usual pace (seconds) [22] | Frailty |
The CGA is based on previous experience from the DEFENCE study [23] by an expert panel consisting of two geriatricians, two GPs and two RNs. Four older, dedicated volunteers with experience in healthcare supported the expert panel by validating the content of the chosen geriatric conditions and problems that are evaluated in the CGA. The CGA takes about 40 to 60 minutes and its feasibility was tested during a pilot phase among 20 randomly chosen older persons aged 70 years and over in two general practices.
Prioritization of conditions for individually tailored treatment and/or care
After the CGA, participants are asked if they recognize the identified geriatric conditions and potentially unmet needs, if they would like any help with or treatment for them and in case of multiple issues, with which set of problems they would prefer to start.
During the second home visit, further diagnostic assessments will follow for the identified problems/conditions based on standardized protocols (see 'uniformity in diagnostics and interventions'). Subsequently, the diagnostic yield of both home visits will be discussed with the GP to develop an individually tailored CTP that is prestructured within the same protocols and based on multifactorial interventions. After this meeting, a third home visit will be used to discuss the CTP with the participants and their caregivers. Potential discrepancies between the priorities of the patients, RNs and GPs will be addressed to find a consensus on the CTP.
Collaboration with the General Practitioner
During the intervention, the RN will work in close collaboration with the participant's GP. They will meet weekly, at a fixed time, to discuss the CGA and finalize each individually tailored CTP. Subsequently, the RN will evaluate the outcomes and changes of the participant's CTP and the need for continuation of care coordination. The GP remains formally responsible for all care and treatment that participants will receive during the intervention.
Home visits
After the CTP is discussed with the participant, the following themes will be addressed during the subsequent home visits (up to seven in total):
(a) the CTP and the initiated interventions are evaluated and adjusted if necessary. A summary of the CTP will be saved in the GP's electronic medical records (EMR);
(b) prioritizing the identified geriatric conditions. During the intervention, geriatric conditions may change, as may participants' prioritization of them;
(c) social functioning and participation;
(d) the burden and needs of a participant's caregiver;
(e) the participant's needs and expectations. The RN enhances empowerment of the participants and caregivers by providing or facilitating psychoeducation on the identified geriatric conditions [24].
The home visits required are flexible in number and timing but are aimed to be in a range between three and eight home visits. Every six to eight weeks, or at shorter intervals if necessary, the RN will visit the participant and evaluate the CTP. The last home visit is planned 12 months after the start of the intervention. Attrition of vulnerable older persons is frequently encountered in trials conducted in this population [25]. To minimize the burden, most of the interventions will take place within the home setting and an informal caregiver is invited to enhance the participants' adherence to the intervention. To build a strong and trusting relationship between the RN and the participant and family, healthcare coordination is performed by only one or two RNs per participant.
Nurse-led care coordination and protocol
Nurse-led care coordination consists of elements of disease and case management, self-management and caregiver support, which are derived from several chronic care models [26-29] and adapted for the Dutch healthcare system. The themes in all four domains of the CGA are potential targets for care coordination and are embedded in the study protocol (web table 3). The RN works in close collaboration with the GP and maintains contact with other healthcare professionals (e.g., occupational therapists, physiotherapists, older persons' welfare consultants, etc.) and the participant's caregiver. Many older persons with several chronic conditions are already in the care of multiple different healthcare professionals at the same time. A comprehensive inventory will be made of all collaborating healthcare professionals and the overall care coordination that may already be in place or is (still) needed. If needed, the RNs will start or expand care coordination.
Uniformity in diagnostic work-up and interventions
To create uniformity in screening, diagnostic assessments and interventions, a toolkit has been constructed that underpins the individually tailored CTP [http://www.effectieveouderenzorg.nl, in Dutch]. The toolkit has been created for the purpose of the present trial, based on previous experience from the DEFENCE study, and consists of standardized protocols for all geriatric conditions that follow international guidelines and are all evidence based or based on current best practices [23]. The protocols share a common structure: a goal to achieve while intervening in a geriatric condition, step-wise action plan, background information (prevalence, risk factors), screening for conditions (appropriate question(s) or validated instruments), indications for further diagnostic work-up, evidence-based interventions, financing of care and advice for participants and an aim of patient empowerment.
For the design and development of the protocols in the toolkit, the expert panel was extended with two occupational therapists, a physiotherapist experienced in geriatric physiotherapy, a nurse specialized in geriatric nursing and an elderly welfare consultant. The extended expert panel worked in close collaboration with four older volunteers with experience in healthcare who will also monitor the study on behalf of the older persons participating in the National Program. Each protocol was written by two members of the expert panel and was accepted to be externally reviewed if at least two other members agreed with the content. All of the protocols were critically reviewed by an external multidisciplinary expert panel, consisting of two geriatricians and four GPs, who paid specific attention to the protocol's correspondence to current guidelines and latest evidence and to its feasibility in general practice. The expert panel met ten times in total.
Control group
Participants registered with general practices that are randomized to the control group will receive unrestricted care as usual according to the current guidelines for Dutch general practice [30]. This care may vary from on-demand care by GPs to regular home care involvement via the GP.
Outcomes and measurements
All of the participants in both conditions will receive similar postal questionnaires at baseline and after six, 12, 18 and 24 months.
Primary outcome
The primary outcome measure is the self-reported level of physical functioning at 12 months, measured with the modified Katz-15 index score [31,32]. This index measures six basic ADL items (bathing, dressing, toileting, eating, continence and transfer) and nine IADL items (housekeeping, meal preparation, shopping, combing hair, telephone use, transportation, medications use, budgeting and walking). Each item is scored 0 (independent) or 1 (dependent), with an overall score ranging from zero to 15; a higher score indicates a higher dependence in ADL and IADL [31-33]. At all time points, the questionnaire will be filled out by the same person (patient or informal caregiver).
Secondary outcomes
The secondary outcome measures are also based on the results of the self-reported questionnaires (at 6, 12, 18 and 24 months) in both groups (Table 3):
1. health-related quality of life (EQ-6D); [34]
2. psychological and social functioning (subscale Rand-36); [35]
3. healthcare utilization (institutionalization, hospitalization and/or visits to the emergency department of the hospital, care provided by a GP during and after hours, other professional care and informal care); [36]
4. incidence of falls within 12 months after the start of the study;
5. evaluation of the provision of care by caregivers and burden of caregivers (CarerQol); [37]
6. overall mortality rate (GP registration).
Tertiary outcomes
Tertiary outcomes are restricted to the intervention group and include changes from baseline in the following:
1. characteristics of frailty (unintentional weight loss (kg), weakness (grip strength (kg)), low endurance (self-reported), slowness (walking speed (m/s)), level of physical activity (self-reported)); [22]
2. blood pressure (mmHg);
3. loneliness (De Jong Gierveld scale of loneliness) [38].
Other measurements
At baseline and after 12 months, a random sample of respondents with an ISAR-PC score ≥ 2 in the control group will receive physical measurements similar to the intervention group to facilitate a secondary analysis on quantitative, objectives scores (e.g., walking speed).
Loss to follow up
Subjects declining (further) participation will be asked permission for a short telephone interview after 12 months to assess the modified Katz-15 index score and health-related quality of life (EQ-6D). Institutionalization and death will be derived from the GPs' electronic information system.
Process evaluation
The study includes a process evaluation on the level of the participant, the RN and the GP. The qualitative data of semi-structured interviews with participants, RNs and GPs by two researchers, JS and MvJ, will be analyzed to evaluate the feasibility and the practicability of the intervention and to identify factors that could facilitate or inhibit the future implementation of the care program. The process indicators are formulated by the study group, based on a consensus on all elements of the intervention, and the adherence to them is evaluated by measuring their pass rates. The process indicators include the number of older persons at increased risk for functional decline, number of completed CGAs, protocols used for the identified geriatric conditions, problems incorporated in the CTP and sessions on CGA and CTP, organized by nurse and GP. The process evaluation will be monitored by older volunteers with experience in healthcare.
Data analysis
All of the analyses will be based on an intention-to-treat principle and will be blinded for the allocation group until all analyses have been completed. The baseline data will be summarized using descriptive statistics. The main analysis focuses on the effectiveness of the interventions on the functioning of older persons through the modified Katz-15. Participants with a similar risk profile (based on ISAR-PC) in the two groups will be compared. The difference between the two groups will be evaluated using a multilevel analysis, as the modified Katz-15 index scores are expected to cluster within GPs and RNs. We will adjust the effect size for baseline imbalances caused by age, sex, socioeconomic status, baseline ADL and IADL functioning and cognitive functioning. The same multilevel approach will be used for all secondary outcomes. Survival data (e.g., institutionalization, mortality) will be additionally analyzed using Cox regression. In all of the analyses, statistical uncertainties will be quantified with corresponding 95% confidence intervals.
Discussion
Main results
This protocol for a cluster randomized controlled trial is designed to prevent functional decline in community-dwelling older persons through the provision of a comprehensive geriatric assessment, an individually tailored care and treatment plan based on multifactorial interventions and nurse-led care coordination.
Other studies
Previous meta-analyses on the effectiveness of multifactorial interventions in preventing functional decline among community-dwelling older persons have yielded inconsistent results. It has been suggested that the differences in effectiveness may be explained in part by the selection of the study population and setting, the nature of the intervention(s), and adherence [1,7-10].
First, the selection of the populations is based on the general population or on high-risk populations according to age [39,40], a combination of risk factors [26,27,41,42] including frailty [43-47], self-reported poor health [48,49], or functional decline [41,42,50]. Ferrucci et al. claimed that preventive interventions should primarily target high-risk persons rather than the general population because high-risk persons are the most likely to benefit [25]. With regard to age, two meta-analyses reported that multifactorial interventions reduced mortality in a younger population (mean age < 80 years) rather than an older study population [9,10]. However, neither the effects of high risk nor age were confirmed by the recent meta-analysis by Beswick et al [1].
Three recent Dutch studies on preventive interventions for frail older people found no effect on functional status [47-49], or the positive effect was not persistent [47]. These results can be explained in part by the selection of a population that was already too frail to benefit from preventive interventions. Pre-frail elderly persons might benefit more from preventive interventions, based on the hypothesis of potential reversibility in an earlier stage of functional decline. Similarly, targeting frailty, defined from a multifactorial perspective or self-reported poor health, seems to be a less sensitive selection, leaving less room for prevention of functional decline.
Second, the features of preventive interventions that are associated with prevention of functional decline are multidimensional (i.e., geriatric assessment including physical examination, long-term follow up [9,10,51], interdisciplinary teamwork, and care coordination) [26,27]. However, no specific benefit based on the type or intensity of intervention was noted in the recent meta-analysis by Beswick et al., who suggested to focus on individually tailored interventions and care [1].
Third, others have suggested that inconsistent results on the benefit of preventive interventions may be explained in part by a large variability in adherence to the intervention or the competence profiles of the nurses taking part in the study [48,49].
Strengths and limitations
This study has several strengths. First, the internal validity is good firm because it is a cluster RCT with postponed informed consent, limiting the risk of response bias in both groups. Second, we aim, in part, to target a younger population (70-75 yrs), in which functional decline is not yet manifested or is still emerging, with a greater preventive potential than older or more frail groups. Similarly, a sensitive selection within an older population (> 75 yrs) at increased risk of functional decline may represent a group with broader opportunities for preservation of independent functioning. To identify older persons who are at increased risk for functional decline, the ISAR-PC screening test is used. Other screening instruments for functional decline were considered less appropriate because they are not validated for the Dutch population and are insufficiently adapted for prediction over time[52-54].
Third, the intervention encompasses a systematic comprehensive geriatric assessment, with multiple home visits, an individually tailored CTP, based on multifactorial, evidence-based interventions and nurse-led collaborative care coordination. All of these features are associated with prevention of functional decline and are combined in the current intervention. Fourth, the study includes a process evaluation to evaluate the feasibility and the practicability of the intervention, the adherence to the intervention, the competence of the RNs and any factors that could facilitate or inhibit future implementation.
Finally, the overall intervention is designed and monitored in collaboration with older volunteers to increase both internal and external validity.
The study also has some limitations. First, the nature of functional decline of individual community-dwelling older persons is dynamic, which makes it difficult to predict functional decline [3].
Second, in this study, persons with dementia are excluded. Although they are clearly at high risk for functional decline, a full range of services for dementia patients is already established in the region, including case management.
Third, the window of opportunity for preventing or delaying functional decline appears to be small. In a recent meta-analysis, a standard mean difference (SMD) of 0.08 was described, which equated to about a half-point improvement in the applied 20-point score [1]. Nevertheless, in view of national plans toward a more proactive care for community-dwelling older people, a large RCT in the Netherlands is still needed to explore the effectiveness of a proactive multifactorial intervention on the prevention of functional decline in older persons who are at increased risk for functional decline. Overall, the improvement on functional status in the Netherlands might be more substantial, as the Dutch healthcare system still lacks comprehensive assessments for older persons.
In summary, this preventive intervention, based on a comprehensive geriatric assessment, an individually tailored CTP of multifactorial interventions and subsequent nurse-led care coordination, has the potential to effectively prevent functional decline in community-dwelling older persons and promote self efficacy. This study is being conducted as part of the Dutch National Care for the Elderly Program. The current study will also provide information on the feasibility of innovative quality programs of care to preserve independent living in community-dwelling older persons.
Abbreviations
ISAR-PC: Identification of Seniors at Risk Primary Care; GP: general practitioner; ADL: activities of daily living; IADL: Instrumental Activities of Daily living; RN: registered nurse; CGA: comprehensive geriatric assessment; CTP: care and treatment plan; AUC: area under the curve; SD: standard deviation; MDS: Minimal Data Set; MMSE: Mini-mental state examination; GDS: Geriatric depression scale; DEFENCE: Develop strategies Enabling Frail Elders New Complications to Evade; EMR: electronic medical records; EQ-6D: Six-Dimensional EuroQol instrument; SMD: standard mean difference
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
JS drafted the manuscript. JS and EMC wrote the protocol for the Medical Ethics Committee. BB, MvJ, RH, GtR, SR en EMC critically reviewed the manuscript and protocol for the Medical Ethics Committee. SR drafted the research proposal. BB, RH and EMC reviewed the research proposal that was sent to the funding organization. RH was involved in the methodological construct of the study. All authors read and approved the final version of the manuscript
Pre-publication history
The pre-publication history for this paper can be accessed here:
Supplementary Material
Contributor Information
Jacqueline J Suijker, Email: j.j.suijker@amc.uva.nl.
Bianca M Buurman, Email: b.m.buurman@amc.uva.nl.
Gerben ter Riet, Email: g.terriet@amc.uva.nl.
Marjon van Rijn, Email: m.vanrijn@amc.uva.nl.
Rob J de Haan, Email: r.j.dehaan@amc.uva.nl.
Sophia E de Rooij, Email: s.e.derooij@amc.uva.nl.
Eric P Moll van Charante, Email: e.p.mollvancharante@amc.uva.nl.
Acknowledgements
We are grateful to all participants, participating GPs and RNs, who are involved in the study. The older volunteers who monitor the study; Mw. A Cornelis, Mw. K Bergmans, Mw. J van Diepen, Mw. R. van Delden, Mw. I Stam. The expert panel and the external expert panel, who developed and reviewed the CGA and the toolkit. Research assistance: Jose Popma
Ameen Abu-hanna for his advice of the design. Marjan Hoogerheide and Petra Wempe for their contributions to the pilot study. The Amsterdam GP Organization and HZNK for their support. Paul Witteman and Melinda van Moorst for their support. Frans van der Vijver for his inspiration and innovative ideas. The study is funded by 'The Netherlands Organisation for Health Research and development'.
References
- Beswick AD, Rees K, Dieppe P, Ayis S, Gooberman-Hill R, Horwood J. et al. Complex interventions to improve physical function and maintain independent living in elderly people: a systematic review and meta-analysis. Lancet. 2008;371(9614):725–735. doi: 10.1016/S0140-6736(08)60342-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hebert R, Brayne C, Spiegelhalter D. Incidence of functional decline and improvement in a community-dwelling, very elderly population. Am J Epidemiol. 1997;145(10):935–944. doi: 10.1093/oxfordjournals.aje.a009053. [DOI] [PubMed] [Google Scholar]
- Hardy SE, Gill TM. Recovery from disability among community-dwelling older persons. JAMA. 2004;291(13):1596–1602. doi: 10.1001/jama.291.13.1596. [DOI] [PubMed] [Google Scholar]
- Christensen K, Doblhammer G, Rau R, Vaupel JW. Ageing populations: the challenges ahead. Lancet. 2009;374(9696):1196–1208. doi: 10.1016/S0140-6736(09)61460-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fries JF, Bruce B, Chakravarty E. Compression of morbidity 1980-2011: a focused review of paradigms and progress. J Aging Res. 2011;2011:261702. doi: 10.4061/2011/261702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mackenbach JP, Slobbe L, Looman CW, van der Heide A, Polder J, Garssen J. Sharp upturn of life expectancy in the Netherlands: effect of more health care for the elderly? Eur J Epidemiol. 2011;26(12):309–14. doi: 10.1007/s10654-011-9633-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouman A, Van RE, Nelemans P, Kempen GI, Knipschild P. Effects of intensive home visiting programs for older people with poor health status: a systematic review. BMC Health Serv Res. 2008;8:74. doi: 10.1186/1472-6963-8-74. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elkan R, Kendrick D, Dewey M, Hewitt M, Robinson J, Blair M. et al. Effectiveness of home based support for older people: systematic review and meta-analysis. BMJ. 2001;323(7315):719–725. doi: 10.1136/bmj.323.7315.719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huss A, Stuck AE, Rubenstein LZ, Egger M, Clough-Gorr KM. Multidimensional preventive home visit programs for community-dwelling older adults: a systematic review and meta-analysis of randomized controlled trials. J Gerontol A Biol Sci Med Sci. 2008;63(3):298–307. doi: 10.1093/gerona/63.3.298. [DOI] [PubMed] [Google Scholar]
- Stuck AE, Egger M, Hammer A, Minder CE, Beck JC. Home visits to prevent nursing home admission and functional decline in elderly people: systematic review and meta-regression analysis. JAMA. 2002;287(8):1022–1028. doi: 10.1001/jama.287.8.1022. [DOI] [PubMed] [Google Scholar]
- Stuck AE, Siu AL, Wieland GD, Adams J, Rubenstein LZ. Comprehensive geriatric assessment: a meta-analysis of controlled trials. Lancet. 1993;342(8878):1032–1036. doi: 10.1016/0140-6736(93)92884-V. [DOI] [PubMed] [Google Scholar]
- Department of Health. London; 2001. Department of Health National service framework for older people. [Google Scholar]
- Leichsenring K. Developing integrated health and social care services for older persons in Europe. Int J Integr Care. 2004;4:e10. doi: 10.5334/ijic.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Donner A, Klar N. Pitfalls of and controversies in cluster randomization trials. Am J Public Health. 2004;94(3):416–422. doi: 10.2105/AJPH.94.3.416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boter H, van Delden JJ, de Haan RJ, Rinkel GJ. Modified informed consent procedure: consent to postponed information. BMJ. 2003;327(7409):284–285. doi: 10.1136/bmj.327.7409.284. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCarney R, Warner J, Iliffe S, Van HR, Griffin M, Fisher P. The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol. 2007;7:30. doi: 10.1186/1471-2288-7-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Campbell MJ, Donner A, Klar N. Developments in cluster randomized trials and Statistics in Medicine. Stat Med. 2007;26(1):2–19. doi: 10.1002/sim.2731. [DOI] [PubMed] [Google Scholar]
- McCusker J, Bellavance F, Cardin S, Trepanier S, Verdon J, Ardman O. Detection of older people at increased risk of adverse health outcomes after an emergency visit: the ISAR screening tool. J Am Geriatr Soc. 1999;47(10):1229–1237. doi: 10.1111/j.1532-5415.1999.tb05204.x. [DOI] [PubMed] [Google Scholar]
- Minimal Data Set. http://www.nationaalprogrammaouderenzorg.nl/het-programma/minimale-data-set/
- Folstein MF, Folstein SE, McHugh PR. Mini-mental state, A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–198. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
- Arroll B, Khin N, Kerse N. Screening for depression in primary care with two verbally asked questions: cross sectional study. BMJ. 2003;327(7424):1144–1146. doi: 10.1136/bmj.327.7424.1144. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J. et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001;56(3):M146–M156. doi: 10.1093/gerona/56.3.M146. [DOI] [PubMed] [Google Scholar]
- Buurman BM, Hoogerduijn JG, de Haan RJ, Abu-Hanna A, Lagaay AM, Verhaar HJ. et al. Geriatric conditions in acutely hospitalized older patients: prevalence and one-year survival and functional decline. PLoS One. 2011;6(11):e26951. doi: 10.1371/journal.pone.0026951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coleman EA, Smith JD, Frank JC, Min SJ, Parry C, Kramer AM. Preparing patients and caregivers to participate in care delivered across settings: the Care Transitions Intervention. J Am Geriatr Soc. 2004;52(11):1817–1825. doi: 10.1111/j.1532-5415.2004.52504.x. [DOI] [PubMed] [Google Scholar]
- Ferrucci L, Guralnik JM, Studenski S, Fried LP, Cutler GB Jr, Walston JD. Designing randomized, controlled trials aimed at preventing or delaying functional decline and disability in frail, older persons: a consensus report. J Am Geriatr Soc. 2004;52(4):625–634. doi: 10.1111/j.1532-5415.2004.52174.x. [DOI] [PubMed] [Google Scholar]
- Bernabei R, Landi F, Gambassi G, Sgadari A, Zuccala G, Mor V. et al. Randomised trial of impact of model of integrated care and case management for older people living in the community. BMJ. 1998;316(7141):1348–1351. doi: 10.1136/bmj.316.7141.1348. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berry-Millett R, Bodenheimer TS. Care management of patients with complex health care needs. Synth Proj Res Synth Rep. 2009. pp. 2155–370x. [PubMed]
- Boult C, Green AF, Boult LB, Pacala JT, Snyder C, Leff B. Successful models of comprehensive care for older adults with chronic conditions: evidence for the Institute of Medicine's "retooling for an aging America" report. J Am Geriatr Soc. 2009;57(12):2328–2337. doi: 10.1111/j.1532-5415.2009.02571.x. [DOI] [PubMed] [Google Scholar]
- Boult C, Reider L, Leff B, Frick KD, Boyd CM, Wolff JL. et al. The effect of guided care teams on the use of health services: results from a cluster-randomized controlled trial. Arch Intern Med. 2011;171(5):460–466. doi: 10.1001/archinternmed.2010.540. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guidelines for Dutch general practice. http://www.nhg.artsennet.nl/standaarden/
- Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffe MW. Studies of illness in the aged. The index of ADL: a standardized measure of biological and psychological function. JAMA. 1963;185:914–919. doi: 10.1001/jama.1963.03060120024016. [DOI] [PubMed] [Google Scholar]
- Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9(3):179–186. doi: 10.1093/geront/9.3_Part_1.179. [DOI] [PubMed] [Google Scholar]
- Weinberger M, Samsa GP, Schmader K, Greenberg SM, Carr DB, Wildman DS. Comparing proxy and patients' perceptions of patients' functional status: results from an outpatient geriatric clinic. J Am Geriatr Soc. 1992;40(6):585–588. doi: 10.1111/j.1532-5415.1992.tb02107.x. [DOI] [PubMed] [Google Scholar]
- EuroQol--a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy. 1990;16(3):199–208. doi: 10.1016/0168-8510(90)90421-9. [DOI] [PubMed] [Google Scholar]
- van der Zee K, Sanderman R. Het meten van de algemene gezondheidstoestand met de rand-36, een handleiding. 2002.
- van den Berg B, Spauwen P. Measurement of informal care: an empirical study into the valid measurement of time spent on informal caregiving. Health Econ. 2006;15(5):447–460. doi: 10.1002/hec.1075. [DOI] [PubMed] [Google Scholar]
- Brouwer WB, van Exel NJ, Van GB, Redekop WK. The CarerQol instrument: a new instrument to measure care-related quality of life of informal caregivers for use in economic evaluations. Qual Life Res. 2006;15(6):1005–1021. doi: 10.1007/s11136-005-5994-6. [DOI] [PubMed] [Google Scholar]
- De Jong GJ, Van TT. The De Jong Gierveld short scales for emotional and social loneliness: tested on data from 7 countries in the UN generations and gender surveys. Eur J Ageing. 2010;7(2):121–130. doi: 10.1007/s10433-010-0144-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Byles JE, Tavener M, O'Connell RL, Nair BR, Higginbotham NH, Jackson CL. et al. Randomised controlled trial of health assessments for older Australian veterans and war widows. Med J Aust. 2004;181(4):186–190. doi: 10.5694/j.1326-5377.2004.tb06233.x. [DOI] [PubMed] [Google Scholar]
- Fletcher AE, Price GM, Ng ES, Stirling SL, Bulpitt CJ, Breeze E. et al. Population-based multidimensional assessment of older people in UK general practice: a cluster-randomised factorial trial. Lancet. 2004;364(9446):1667–1677. doi: 10.1016/S0140-6736(04)17353-4. [DOI] [PubMed] [Google Scholar]
- Gill TM, Baker DI, Gottschalk M, Peduzzi PN, Allore H, Byers A. A program to prevent functional decline in physically frail, elderly persons who live at home. N Engl J Med. 2002;347(14):1068–1074. doi: 10.1056/NEJMoa020423. [DOI] [PubMed] [Google Scholar]
- Stuck AE, Minder CE, Peter-Wuest I, Gillmann G, Egli C, Kesselring A. et al. A randomized trial of in-home visits for disability prevention in community-dwelling older people at low and high risk for nursing home admission. Arch Intern Med. 2000;160(7):977–986. doi: 10.1001/archinte.160.7.977. [DOI] [PubMed] [Google Scholar]
- Dalby DM, Sellors JW, Fraser FD, Fraser C, Van IC, Howard M. Effect of preventive home visits by a nurse on the outcomes of frail elderly people in the community: a randomized controlled trial. CMAJ. 2000;162(4):497–500. [PMC free article] [PubMed] [Google Scholar]
- Rockwood K, Stadnyk K, Carver D, MacPherson KM, Beanlands HE, Powell C. et al. A clinimetric evaluation of specialized geriatric care for rural dwelling, frail older people. J Am Geriatr Soc. 2000;48(9):1080–1085. doi: 10.1111/j.1532-5415.2000.tb04783.x. [DOI] [PubMed] [Google Scholar]
- Newcomer R, Maravilla V, Faculjak P, Graves MT. Outcomes of preventive case management among high-risk elderly in three medical groups: a randomized clinical trial. Eval Health Prof. 2004;27(4):323–348. doi: 10.1177/0163278704270011. [DOI] [PubMed] [Google Scholar]
- Leveille SG, Wagner EH, Davis C, Grothaus L, Wallace J, LoGerfo M. et al. Preventing disability and managing chronic illness in frail older adults: a randomized trial of a community-based partnership with primary care. J Am Geriatr Soc. 1998;46(10):1191–1198. doi: 10.1111/j.1532-5415.1998.tb04533.x. [DOI] [PubMed] [Google Scholar]
- Melis RJ, van Eijken MI, Teerenstra S, Van AT, Parker SG, Borm GF. et al. A randomized study of a multidisciplinary program to intervene on geriatric syndromes in vulnerable older people who live at home (Dutch EASYcare Study) J Gerontol A Biol Sci Med Sci. 2008;63(3):283–290. doi: 10.1093/gerona/63.3.283. [DOI] [PubMed] [Google Scholar]
- Bouman A, Van RE, Ambergen T, Kempen G, Knipschild P. Effects of a home visiting program for older people with poor health status: a randomized, clinical trial in The Netherlands. J Am Geriatr Soc. 2008;56(3):397–404. doi: 10.1111/j.1532-5415.2007.01565.x. [DOI] [PubMed] [Google Scholar]
- van Hout HP, Jansen AP, van Marwijk HW, Pronk M, Frijters DF, Nijpels G. Prevention of adverse health trajectories in a vulnerable elderly population through nurse home visits: a randomized controlled trial [ISRCTN05358495] J Gerontol A Biol Sci Med Sci. 2010;65(7):734–742. doi: 10.1093/gerona/glq037. [DOI] [PubMed] [Google Scholar]
- Hebert R, Robichaud L, Roy PM, Bravo G, Voyer L. Efficacy of a nurse-led multidimensional preventive programme for older people at risk of functional decline. A randomized controlled trial. Age Ageing. 2001;30(2):147–153. doi: 10.1093/ageing/30.2.147. [DOI] [PubMed] [Google Scholar]
- Wieland D. The effectiveness and costs of comprehensive geriatric evaluation and management. Crit Rev Oncol Hematol. 2003;48(2):227–237. doi: 10.1016/j.critrevonc.2003.06.005. [DOI] [PubMed] [Google Scholar]
- Min L, Yoon W, Mariano J, Wenger NS, Elliott MN, Kamberg C. et al. The vulnerable elders-13 survey predicts 5-year functional decline and mortality outcomes in older ambulatory care patients. J Am Geriatr Soc. 2009;57(11):2070–2076. doi: 10.1111/j.1532-5415.2009.02497.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raiche M, Hebert R, Dubois MF. PRISMA-7: a case-finding tool to identify older adults with moderate to severe disabilities. Arch Gerontol Geriatr. 2008;47(1):9–18. doi: 10.1016/j.archger.2007.06.004. [DOI] [PubMed] [Google Scholar]
- Tas U, Steyerberg EW, Bierma-Zeinstra SM, Hofman A, Koes BW, Verhagen AP. Age, gender and disability predict future disability in older people: the Rotterdam Study. BMC Geriatr. 2011;11:22. doi: 10.1186/1471-2318-11-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- AbuRuz SM, Bulatova NR, Yousef AM. Validation of a comprehensive classification tool for treatment-related problems. Pharm World Sci. 2006;28(4):222–232. doi: 10.1007/s11096-006-9048-0. [DOI] [PubMed] [Google Scholar]
- Stalenhoef PA, Diederiks JP, Knottnerus JA, Kester AD, Crebolder HF. A risk model for the prediction of recurrent falls in community-dwelling elderly: a prospective cohort study. J Clin Epidemiol. 2002;55(11):1088–1094. doi: 10.1016/S0895-4356(02)00502-4. [DOI] [PubMed] [Google Scholar]
- Yardley L, Beyer N, Hauer K, Kempen G, Piot-Ziegler C, Todd C. Development and initial validation of the Falls Efficacy Scale-International (FES-I) Age Ageing. 2005;34(6):614–619. doi: 10.1093/ageing/afi196. [DOI] [PubMed] [Google Scholar]
- CBO richtlijn Osteoporose. 2012.
- Neelemaat F, Kruizenga HM, de Vet HC, Seidell JC, Butterman M, Van Bokhorst-de van der Schueren MA. 439. Clin Nutr. 2008;27(3) doi: 10.1016/j.clnu.2008.02.002. [DOI] [PubMed] [Google Scholar]
- Collins SL, Moore RA, McQuay HJ. The visual analogue pain intensity scale: what is moderate pain in millimetres? Pain. 1997;72(1-2):95–97. doi: 10.1016/S0304-3959(97)00005-5. [DOI] [PubMed] [Google Scholar]
- Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method, A new method for detection of delirium. Ann Intern Med. 1990;113(12):941–948. doi: 10.7326/0003-4819-113-12-941. [DOI] [PubMed] [Google Scholar]
- Sheikh JI, Yesavage JA, Brooks JO Jr, Friedman L, Gratzinger P, Hill RD. et al. Proposed factor structure of the Geriatric Depression Scale. Int Psychogeriatr. 1991;3(1):23–28. doi: 10.1017/S1041610291000480. [DOI] [PubMed] [Google Scholar]
- Aertgeerts B, Buntinx F, Ansoms S, Fevery J. Screening properties of questionnaires and laboratory tests for the detection of alcohol abuse or dependence in a general practice population. Br J Gen Pract. 2001;51(464):206–217. [PMC free article] [PubMed] [Google Scholar]
- Gual A, Segura L, Contel M, Heather N, Colom J. Audit-3 and audit-4: effectiveness of two short forms of the alcohol use disorders identification test. Alcohol Alcohol. 2002;37(6):591–596. doi: 10.1093/alcalc/37.6.591. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.