Abstract
Introduction
Advance care planning (ACP) is a process that allows patients to identify their goals for medical care. Traditionally, ACP has focused on completing advance directives; however, we have expanded the ACP paradigm to also prepare patients to communicate their wishes and make informed decisions. To this end, we created an ACP website called PREPARE (http://www.prepareforyourcare.org) to prepare diverse English-speaking and Spanish-speaking older adults for medical decision-making. Here, we describe the study protocol for a randomised controlled efficacy trial of PREPARE in a safety-net setting. The goal is to determine the efficacy of PREPARE to engage diverse English-speaking and Spanish-speaking older adults in a full spectrum of ACP behaviours.
Methods and analysis
We include English-speaking and Spanish-speaking adults from an urban public hospital who are ≥55 years old, have ≥2 chronic medical conditions and have seen a primary care physician ≥2 times in the last year. Participants are randomised to the PREPARE intervention (review PREPARE and an easy-to-read advance directive) or the control arm (only the easy-to-read advance directive). The primary outcome is documentation of an advance directive and/or ACP discussion. Secondary outcomes include ACP behaviour change processes measured with validated surveys (eg, self-efficacy, readiness) and a broad range of ACP actions (eg, choosing a surrogate, identifying goals for care, discussing ACP with clinicians and/or surrogates). Using blinded outcome ascertainment, outcomes will be measured at 1 week and at 3, 6 and 12 months, and compared between study arms using mixed-effects logistic regression and mixed-effects linear, Poisson or negative binomial regression.
Ethics and dissemination
This study has been approved by the appropriate Institutional Review Boards and is guided by input from patient and clinical advisory boards and a data safety monitoring board. The results of this study will be disseminated to academic and community stakeholders.
Trial registration numbers
NCT01990235; NCT02072941; Pre-results.
Keywords: advance care planning, medical decision making, randomized trial, vulnerable populations, health literacy
Strengths and limitations of this study.
This study addresses gaps in advance care planning (ACP) for racially and ethnically diverse English-speaking and Spanish-speaking older adults based on a novel comprehensive ACP paradigm.
The development of the PREPARE intervention was based on extensive published formative research in which the community, key stakeholders and the target population were included in the development of the website.
This study measures the process of ACP and a full range of ACP outcomes including behaviour change and several ACP actions, such as discussions and documentation, over a 12-month follow-up period.
Surrogate recruitment takes a great deal of time and may present obstacles in enrolling surrogate participants.
This study is only occurring in four sites in the San Francisco Bay Area and may have limited generalisability.
Introduction
The population is ageing,1 2 and the prevalence of chronic disease is increasing, especially among underserved and vulnerable populations (ie, economically disadvantaged, racial and ethnic minorities, the uninsured, etc).3 A critical aspect of chronic and serious disease management is advance care planning (ACP), a process whereby patients plan for their future medical care. Traditionally, advance directives have been the main focus of ACP, but unfortunately, most are written in complex legal language.4 This lack of attention to limited health literacy and limited English proficiency may explain why advance directives are often not completed and may explain, in part, why <20% of racially and ethnically diverse, older adults engage in ACP by the end of life.5–8
Furthermore, for ethnic minorities, a population rapidly increasing in the USA, medical decisions are often complicated by a lack of trust and perceived racism.9–11 Ethnic minorities are also more likely to prefer aggressive treatment, mistrust advance directives and have non-autonomous views on decision-making (ie, prefer that family and doctors make medical decisions for them).9 12–16 Hispanics/Latinos account for 15% of the US population, a proportion projected to grow to 30% by 2050.1 2 Spanish-speaking patients face significant communication barriers, and literacy-appropriate and language-appropriate ACP tools that address unique aspects of Latino culture (eg, familismo or a strong commitment and orientation to the family) are lacking.10 In addition, the mean reading level in the USA is only at the eighth grade level, and for adults over 65 years of age it is only at the fifth grade level.17 18 Patients with limited literacy often lack self-efficacy to communicate their wishes or ask questions,19 and the combination of limited literacy and limited English proficiency results in low satisfaction with doctor–patient communication and decision-making.20–22 However, studies show that patients can be motivated to take action in response to culturally and linguistically appropriate information they trust and can understand.8 23
To address these gaps in ACP and shortcomings of advance directives, we developed a novel comprehensive paradigm of ACP focused on preparing patients to identify their wishes, communicate with surrogate decision-makers and clinicians, and make complex decisions over the course of chronic and serious illness.24 This approach recognises that patients' wishes change based on changing clinical contexts and that advance directives are but one tool to be used to inform in-the-moment decision-making.25 26 To address the gaps in ACP for racially and ethnically diverse older adults, and on the basis of the new comprehensive ACP paradigm, we created the interactive, patient-centred PREPARE website (prepareforyourcare.org) in English and Spanish that is culturally, linguistically and literacy appropriate. PREPARE has been shown in pilot studies among English speakers to help older adults engage in the ACP process, but it has yet to be tested in a randomised trial with English-speaking and Spanish-speaking older adults.27 Both the new ACP paradigm and the PREPARE intervention have been described in detail elsewhere.27 28 In addition, a description of a related trial of the efficacy of PREPARE among US Veterans describes the theoretical framework underlying the PREPARE website.28
Methods and analysis
Study overview
This study is a randomised controlled trial (RCT) that uses blinded outcome ascertainment to determine the efficacy of the ACP PREPARE website to engage ethnically diverse English-speaking and Spanish-speaking older primary care patients in the ACP process. First, administrative data and chart review are used to determine potentially eligible patients (figure 1). Then primary care clinicians' permission is obtained to allow the study team to inform their patients about the study. Patients are then recruited, screened for eligibility and scheduled for a baseline interview 1–3 weeks before an upcoming primary care appointment. Next, informed consent is obtained, and those patients who provide consent are randomised to the PREPARE intervention arm (ie, the PREPARE website with action plan exercises plus an easy-to-read advance directive plus PREPARE materials to take home, which include a website login, and a PREPARE pamphlet, booklet and DVD) or the control arm (ie, an easy-to-read advance directive alone). See figure 1 and a full description of the intervention below. Blinded outcome ascertainment is then conducted at 1 week, and at 3, 6 and 12 months after the primary care appointment. At the end of the study, patients are asked if they are willing to refer their surrogate decision-makers to the study, if available, to corroborate patients' reports of engagement in ACP discussions and documentation. Chart review is also conducted at baseline and at the end of the study to determine ACP documentation. We chose an active control arm (ie, an easy-to-read advance directive) because we believe provision of an advance directive for chronically and seriously ill older patients should be the standard of care, even if it is not often ‘usual’ care in clinical practice.8 In addition, the easy-to-read advance directive used in this study has been adopted by the Zuckerberg San Francisco General Hospital (ZSFG) and is available in the primary care clinics.
Figure 1.
PREPARE Study Flowchart Among English and Spanish-speaking Older Adults. ACP, advance care planning; ZSFG, Zuckerberg San Francisco General Hospital.
Research aims and study hypotheses
The aims of this study are to (1) determine the efficacy of PREPARE to engage diverse English-speaking and Spanish-speaking older adults with chronic illness in ACP compared with controls (AD only) and (2) determine whether PREPARE efficacy varies by race/ethnicity, literacy, clinician–patient language concordance and patient's desired role in decision-making. Our primary hypothesis is that the PREPARE programme plus an easy-to-read advance directive will result in greater documentation of ACP wishes, including advance directives and documentation of ACP discussions in the medical record, than an easy-to-read advance directive alone in elderly populations with chronic illness. Our secondary hypotheses are that, compared with an advance directive alone, PREPARE will result in more engagement in behaviour change processes concerning ACP, including increased self-efficacy and readiness, as well as greater engagement in a full range of ACP actions, including discussions with surrogate decision-makers and other trusted family and friends. Secondary outcomes will be ascertained using validated surveys.29–31 We also hypothesise that PREPARE will result in improved satisfaction with patient–doctor communication and informed medical decision-making and that PREPARE efficacy may vary across moderator variables such as patient health literacy, clinician–patient language concordance and patients' desired role in decision-making.
Study setting
Recruitment for this randomised trial is occurring in four separate primary care clinics associated with ZSFG and the San Francisco Health Network (SFHN) in San Francisco, California. These four clinics are housed in three separate physical locations in San Francisco. ZSFG is an urban public hospital that, with the SFHN, serves racially and ethnically diverse, low-income and indigent patients; 30% of patients are Spanish-speaking.8
Eligibility criteria
Older adults are included in this study if they self-report speaking English or Spanish ‘well’ or ‘very well’; are 55 years of age or older; have ≥2 chronic illnesses determined by chart review; have seen a primary care clinician (physician, nurse practitioner or physician assistant) at ZSFG/SFHN-affiliated primary care clinics ≥2 times in the past year (an indication of established primary care); and have had ≥2 additional outpatient or inpatient visits in the past year (an indication of ongoing access to care and severity of illness). Their primary care clinician must also give us permission to contact them to tell them about the study (table 1). Patients will be excluded if they have medical record documentation of being deaf, blind, having dementia or being psychotic, or are deemed by their clinician to be too mentally or physically ill to participate. Through in-person or phone screening by study staff, patients are also excluded if they self-report vision too poor to read a newspaper, lack of a phone (needed for follow-up interviews and scheduling) or plans to be out of the country for ≥3 months; if they screen positive for moderate-to-severe cognitive impairment using the validated Short Portable Mental Status Questionnaire followed by the Mini-Cog,32–34 or self-report or are determined by study staff to be blind, deaf, intoxicated or actively psychotic. Since ACP is an iterative process, participants with prior ACP experiences (eg, an advance directive) are not excluded.
Table 1.
Inclusion and exclusion criteria by type of study participant
| Patient | |
|---|---|
| Inclusion criteria | 55 years of age or older |
| Obtains care in the primary care clinics at ZSFG Hospital | |
| Has been seen at least twice in the last year by a primary care provider (a measure of established primary care) and had at least 2 additional visits to ZSFG in the past year (a measure of frequent the medical centre) | |
| Exclusion criteria | Dementia by ICD-9/ICD-10 codes, clinician assessment, chart review or self-report |
| Blindness or poor vision by ICD-9/ICD-10 codes, clinician assessment, chart review, self-report of blindness or the inability to read print on a newspaper52 | |
| Deafness by ICD-9/ICD-10 codes, clinician assessment, self-report, chart review or research staff assessment | |
| Cognitive impairment as assessed by research staff of any deficits on the validated SPMSQ53 and the Mini-Cog32 54 | |
| Delirium or psychosis as assessed by a clinician or research staff | |
| Does not report speaking English or Spanish ‘well’ or ‘very well’ | |
| No phone for additional study contacts and follow-up interviews | |
| Active drug or alcohol abuse within the past 3 months determined by clinician assessment, self-report, chart review or research staff assessment | |
| Patients who report they will be out of town during their scheduled follow-up interview dates outside of a window of 3 months | |
| Patients who cannot answer consent teach-back questions after 3 attempts | |
| Surrogate | |
| Inclusion criteria | 18 years of age or older |
| An enrolled patient must identify the surrogate as someone who could make medical decisions for him or her if needed | |
| An enrolled patient must provide the surrogate's contact information and give permission to contact their potential surrogate | |
| Exclusion criteria | Self-reported dementia, blindness or deafness |
| Cognitive impairment as assessed by research staff of any deficits on the validated SPMSQ53 and the Mini-Cog32 54 | |
| Delirium or psychosis as assessed by research staff | |
| Does not report speaking English or Spanish ‘well’ or ‘very well’ | |
| No phone for screening and phone interviews | |
| Surrogates who report they will be out of town during their scheduled follow-up interview dates outside of a window of 3 months | |
| Surrogate for whom we cannot schedule an interview >6 months from the patient's final 6-month follow-up interview date | |
| Surrogates who we have attempted to contact 5 times or more without a response | |
| Surrogates who cannot answer consent teach-back questions after 3 attempts | |
ICD, International Classification of Diseases; SPMSQ, Short Portable Mental Status Questionnaire; ZSFG, Zuckerberg San Francisco General.
We are also recruiting participants' self-identified surrogate decision-makers. Surrogates are included if the participant provides the surrogate's name and contact information and gives the study team permission to contact him or her. Through in-person or phone screening by study staff, surrogates are excluded if they self-report having dementia or test positive for moderate-to-severe cognitive impairment,32 33 or self-report or are determined by study staff to be blind, deaf, intoxicated or actively psychotic (table 1).
Recruitment and retention
To facilitate recruitment, we obtained a Health Insurance Portability and Accountability Act waiver to access patients' names, age, race/ethnicity, gender, primary language, phone numbers, addresses, medical record numbers, as well as dates of outpatient primary care clinic appointments in the past year and up to 3 months in the future, other appointments and hospitalisations and emergency room visits in the past year, and the name of patients' outpatient primary care providers. From these data, we obtain a list of potentially eligible patient participants and send a secure email to their primary care providers asking for permission for our study team to tell their patients about the study through a recruitment opt-out study letter, followed by phone or in-person recruitment. Clinicians can decline or approve all of their patients or opt-out individual patients from the patient list provided in the secure email. Clinicians are informed that if they do not respond to our requests within three attempts, we will assume assent to contact their patients.
Study-related fliers written at a fifth grade reading level in English and Spanish are posted in approved areas in ZSFG/SFHN-affiliated primary care clinics. In addition, recruitment letters written at a fifth grade reading level in English and Spanish are mailed and describe the research study as well as provide a telephone number to either opt out or to hear more about the study. Although patients can opt-out at any time, those who do not call the study staff to decline participation within 1 week of the mailings are deemed eligible to be contacted to describe the study, assess willingness to participate and assess study eligibility. To standardise the timing between intervention exposure and primary care follow-up, we schedule patients for the baseline interview and exposure to PREPARE or the control intervention 1–3 weeks prior to their upcoming primary care appointment. Weekly administrative data pulls from the electronic health record identify patients with upcoming primary care appointments and are used to target patient recruitment efforts.
English-speaking and Spanish-speaking surrogates are recruited through enrolled patient referral after the patient has finished his or her 12-month interview. Depending on the information provided by the patient, we may contact the potential surrogate participant in the clinic, or by phone, email or postal mail.
Patients who consent and enrol are paid $50 for the baseline interview and $25 for each of the 1-week, 3-month, 6-month and 12-month interviews. All surrogates are paid $25 for one interview at 12 months.
Diverse vulnerable populations are often difficult to recruit for research studies. We employed several strategies to enhance our recruitment. First, we attempted to hire individuals who had experience with diverse populations and individuals who were bilingual (native Spanish-speaking) and bicultural. Furthermore, we conduct extensive sensitivity training with all research staff and require staff to use approved study scripts when speaking to patients. These study scripts and all study materials used for recruitment have been vetted, updated and approved by our patient advisory and clinical advisory boards. All materials and study scripts are written at a fifth grade reading level and are provided to patients in their preferred language (ie, English or Spanish).
Consent procedures
We use a modified consent process that several co-authors designed for vulnerable populations.28 35 Consent forms written at the fifth grade reading level are provided and read to participants in English or Spanish. This review is then followed by standardised ‘teach-to-goal’ questions to ensure understanding. If potential participants cannot correctly complete the teach-back process after three attempts, the patient is deemed ineligible. For surrogates, if they are available in person, written informed consent is also obtained using the teach-back method. Since some surrogates may live outside of the area, we have permission from the University of California, San Francisco (UCSF) Institutional Review Board (IRB) to obtain verbal consent by phone if the surrogate is able to accurately answer all consent verification questions on teach-back within three attempts.
The consent form has been approved by the UCSF and ZSFG IRBs, the patient/clinical advisory board and the Data Safety Monitory Board (DSMB). The consent form states the following for the purpose of the study: “Why is this study being done? Sometimes patients and their families have to make hard medical decisions. We want to design and test an easy-to-understand handout to help. This handout will help people think about their values, or what is most important to them in their life. It will also help prepare patients to make medical decisions.” We used the word ‘handout’ because, in pilot testing, both groups are given handout materials and written advance directives. For randomisation we explain, “We will ask you to look over a handout and answer some questions about your experience with making medical decisions. There will be two groups that will be given different handouts. You will have a 50/50 chance of being in either group.”
Intervention and control conditions
As previously described, PREPARE is an easy-to-use, patient-centred, interactive website that is available in English or Spanish, is written at a fifth grade reading level, includes voice-overs of all text for the reading-impaired and closed-captioning of all videos for the hearing impaired (http://www.prepareforyourcare.org).27 28 The conceptual framework for PREPARE has been previously published and is based on social cognitive and behavior change theories.27 In the design of the PREPARE website, we included essential theory-based health education strategies, such as the use of video modelling of ACP behaviours, and tailored and interactive content based on patients' values and decision preferences. To ensure that PREPARE was easy to read and understand, we used clear health communication principles (eg, targeting text to the fifth grade reading level) and used extensive formative research and cognitive interviewing with the target population (ie, racially and ethnically diverse older adults with limited health literacy and English proficiency) to ensure that the PREPARE content is acceptable to individuals from diverse cultural backgrounds.27
The PREPARE website leads people through a five-step ACP process that ranges from choosing a surrogate decision-maker to asking their clinicians the right questions. While going through the website, PREPARE also helps individuals answer personal values questions about their medical care and create an action plan to engage in some form of ACP. Patient-generated action plans have been shown to help patients engage in other preventative and disease management activities in the outpatient setting.36
After the baseline interview, participants in the PREPARE arm review all five steps of the PREPARE website in English or Spanish in our research offices. They are asked to review PREPARE on their own and in its entirety. Research assistants are available to answer questions only if needed, but do not go through the website with the participants. At the end of the programme, a summary of the patient's medical wishes and action plan is automatically generated from the PREPARE website in written format. This information, along with the participant's PREPARE website login information, is included in a take-home folder that also contains PREPARE information in pamphlet, booklet and DVD format. We included PREPARE content in non-website formats because some patients may not have access to the internet at home. PREPARE arm participants are also given an easy-to-read advance directive in English or Spanish to review and consider completing.8 37 Participants are asked to review the advance directive form for at least 5 min and up to 15 min in research offices, and then to take the form home to discuss with their potential surrogates and/or their clinicians. The time frame of 5–15 min was chosen because our goal is only to introduce the advance directive and allow participants to ask questions. The goal is not to have patients complete the form on the day of the study, before potential discussions with clinicians or surrogates, unless the participant would like to do so. Participants in the control arm are only given the easy-to-read advance directive, are asked to review it for at least 5 min and up to 15 min, and to take the form home to discuss with their potential surrogates and clinicians. One to 3 days before the patient's next scheduled primary care appointment, research staff call the PREPARE arm participants to remind them to bring in their study materials (ie, action plan and advance directive) and to talk to their clinician about ACP. For the control arm, research staff members only remind patients about their upcoming appointment and do not provide additional encouragement about ACP.
Randomisation procedures
A statistician not involved in recruitment or data collection uses a computer-based random number generator to create a randomisation scheme using block randomisation by health literacy (adequate health literacy vs limited health literacy, as determined by a validated question concerning confidence with medical forms).38 Random block sizes of 4, 6 and 8 are used to ensure an equal number of patients with limited health literacy in each group. Randomisation information is associated with a unique patient identification number and is kept separate from other patient data.
Blinding
Participants are told that each research participant will review one of two guides, but study participants are blinded as to which guide is the active intervention and which is the active control. Since each group obtains ACP materials, such as the easy-to-read advance directive, blinding is enhanced. To ensure blinding of all outcome assessments, research staff who conduct follow-up interviews are never the same staff member who completed the baseline interview and randomisation for that participant. At the start of all follow-up interviews, participants are reminded not to discuss the study materials they reviewed. If, however, during the follow-up interview, the research assistant becomes unblinded (eg, the participant mentions the PREPARE website), this information is noted in our database, and the participant is assigned to a new blinded research assistant for all subsequent interviews.
Intervention fidelity and data collection methods
All staff members are rigorously trained and are required to read and adhere to a standardised study protocol manual, standardised study scripts and standardised checklists for each contact and interview with participants. Several training videos have also been developed for staff. Research staff are not allowed to conduct study tasks independently until they have reviewed all written and video training materials and can demonstrate complete mastery of all scripts and checklist items. In addition, a 10% random sample of all interviews is observed by senior research staff to ensure study fidelity.
Research data are captured live and entered into a web-based software program called Research Electronic Data Capture (REDCap). REDCap is managed by the UCSF Academic Research Systems Team and is stored behind strong-string password-protected firewalls on UCSF servers, not on individual laptops or desktops. All patients are given a unique, non-identifying patient identification number that is removed from any personally identifying information (PII) or personal health information (PHI). All PII and PHI are stored in a Microsoft ACCESS database behind strong-string password-protected firewalls on UCSF and ZSFG servers. To reduce missing data, REDCap has been programmed to not allow study staff to progress if data fields are left blank.
Measures and data collection
Primary and secondary outcomes
Since ACP ideally is a process that occurs over time, we felt it important to measure a full range of ACP measures including ACP documentation (primary outcome), as well as several behaviour change constructs and several additional ACP actions over a 12-month period (secondary outcomes). All study measures, including available validity and reliability information in English and Spanish, and the schedule of administration (ie, baseline, 1 week or 3, 6 or 12 months) are described in table 2. The main outcome measures are also described in detail below.
Table 2.
Longitudinal assessment of measures and constructs used to evaluate the efficacy of the PREPARE study
| Construct | Measure | Number of items | English reliability/validity | Spanish reliability/validity | Screener | Baseline | 1 week | 3 months | 6 months | 12 months |
|---|---|---|---|---|---|---|---|---|---|---|
| Eligibility screening | ||||||||||
| Cognitive impairment | SPMSQ 0–2=eligible 3–7 moderate impairment → Mini-Cog ≥8 severe impairment=ineligible |
7 | Sensitivity 86.2%, specificity 99.0%53 | – | X | |||||
| Cognitive impairment (participants scoring 3–7 errors on SPMSQ) | Mini-Cog (3-item recall as needed, if SPMSQ screen+for cognitive impairment) If recall ≥2 words=eligible |
3 | Sensitivity 76%, specificity 89%32 | Sensitivity 99%, specificity 93%54 | X | |||||
| Vision | Ability to see words on a newspaper52 | 1 | – | X | ||||||
| Health literacy screen for block randomisation (inadequate vs adequate) | ‘How comfortable are you filling out medical forms by yourself?’ ‘Qué tan seguro(a) se siente al llenar formas usted solo(a)’ |
1 | AUROC 0.80 (95% CI 0.67 to 0.93) for inadequate health literacy55 | C-index=0.82, (0.77 to 0.87) for inadequate health literacy56 | X | |||||
| Primary outcome | ||||||||||
| ACP documentation | ACP Engagement Survey:27 self-report: ACP documentation |
1 | ICC*=0.8727 | – | X | X | X | X | X | |
| ACP documentation | Chart review: ACP documentation | X | X | |||||||
| Secondary outcomes | ||||||||||
| The full ACP Process | ACP Engagement Survey:27 behaviour change process measures (knowledge, contemplation, self-efficacy, readiness) Action measures: values identification and discussions |
108 | Process measures: Cronbach's α=0.94 (0.91 to 0.96), ICC=0.70 (0.54 to 0.82)27 Action measures: ICC*=0.87 (0.79 to 0.92)27 |
– | X | X | X | X | X | |
| Communication quality | CAHPS (eg, Did this provider explain things in a way that was easy to understand?) | 13 | Comparative Fit Index=0.98, Tucker Lewis Index=0.98 Cronbach's α≥0.70 for constructs39 |
Cronbach's α ≥0.70 for constructs and associated with global physician rating40 | X | X | ||||
| Satisfaction with communication | (i.e, How satisfied are you that you could share your most important concerns with X/that X understood what was most important to you?) | 8 | – | – | X | X | X | X | X | |
| Care consistent with current goals | Care consistent with goals: comparing 10-point scales of patient ratings about aggressiveness of care desired and care currently receiving |
4 | – | – | X | X | X | |||
| Satisfaction with decision-making | Decisional Conflict Scale | 20 | Test–retest coefficient=0.81 Cronbach's α: 0.78–0.92 for total scale41 |
Cronbach's α=0.8057 | X | X | X | X | ||
| Depression | Patient Health Questionnaire-8 | 8 |
Scores ≥10 100% sensitive and 95% specific for major depressive disorder42 43 |
Scores ≥10 77% sensitive and 100% specific for major depressive disorder58 |
X | X | X | X | X | |
| Anxiety | GAD-744 | 7 | Cronbach's α=0.9244 ICC*=0.83 |
Cronbach's α=0.8845 ICC*=0.64 |
X | X | X | X | X | |
| Barriers to ACP | Checkbox of common barriers and one open-ended question | 13 | Associated with ACP59 | Associated with ACP59 | X | X | ||||
| Attitudes about ACP | Processes of change for ACP31 | 34 | Responsive to an ACP intervention27 | – | X | X | X | X | X | |
| Implementation: acceptability | Acceptability and usability (1) Ease of use and understanding (2) Usefulness in decisions and discussions (3) Attitudes about norms or expectations |
8 6 6 |
1 factor explained 81–85% of variance/scale. Kuder-Richardson >0.758 | 1 factor explained 81–85% of variance/scale. Kuder-Richardson >0.758 | X | |||||
| Implementation: feasibility | Feasibility (both arms) (eg, when and where to review ACP materials) Feasibility (PREPARE only) (eg, when/where to review and which materials did you use and would recommend to others) |
7 34 |
– | – | X | X | ||||
| Surrogate reports of patient engagement in ACP | Modified from the ACP Engagement Survey,29 knowledge of patient's wishes, and confidence making decisions, 5-point Likert | 47 | – | – | X | |||||
| Moderator variables | ||||||||||
| Health literacy assessment | s-TOFHLA scores 0–3660 Continuous and dichotomised to limited=0–22 and adequate=23–36 | 36 | Cronbach's α=0.97 Correlation coefficient with other literacy tests >0.8060 |
Cronbach's α >0.9561 | X | |||||
| Patient–clinician language concordance | To clinicians: ‘How well do you speak Spanish?62 Fluently, very well (concordant) vs well, fair or poor’ | 1 | AUROC† 94% (CI 90% to 98%)62 | AUROC† 94% (CI 90% to 98%)62 | X | |||||
| Desired role in decision-making | CPS with clinicians and family63 | 2 | Correlation between preferred and actual roles in decision-making12 64 65 | Correlation between preferred and actual roles in decision-making66 | X | X | ||||
| US acculturation | Based on acculturation scale (USAS) ‘How many years have you lived in the USA?’ | 1 | Cronbach's α=0.98 Associated with desire to know prognosis67 |
– | X | |||||
| Mediator variables‡ | ||||||||||
| Baseline knowledge | Knowledge subscales of the ACP Engagement Survey27 | 6 | Cronbach's α=0.84 (0.76–0.90), ICC*=0.70 (0.50–0.82)27 | – | X | |||||
| Baseline self-efficacy | Self-efficacy subscales of the ACP Engagement Survey27 | 6 | Cronbach's α=0.83 (0.75–0.89), ICC*=0.60 (0.41–0.76)27 | – | X | |||||
| Baseline readiness | Readiness subscales of the ACP Engagement Survey27 | 10 | Cronbach's α=0.92 (0.88–0.95), ICC*=0.60 (0.53–0.81)27 | – | X | |||||
| Baseline ACP barriers | Checkbox of 13 comment barriers59 | 13 | Associated with ACP59 | – | X | |||||
| Baseline attitudes about ACP | Processes of change for ACP31 | 34 | Responsive to ACP intervention27 | – | X | |||||
| Potential confounders | ||||||||||
| Functional status | ADL and IADL measure (13-item)68 69 | 13 | Morbidity/mortality correlation68 69 | Cronbach's α=0.9470 | X | |||||
| Self-rated health status | How would you rate your health? (5-point Likert)71 72 | 1 | Cronbach α=0.8072 | – | X | |||||
| Self-rated quality of life | How would you rate your quality of life? (5-point Likert)72 73 | 1 | Test–retest coefficient=0.8173 | – | X | |||||
| Comorbid illness | Charlson comorbidity score74
75 Elixhauser comorbidity score76 77 |
0 | Mortality c-stat:78 Charlson=0.704 Elixhauser=0.793 |
– – |
X | |||||
| Prior ACP experience | Prior ACP experiences (eg, (Ever had to make life-threatening medical decisions?)8 |
5 | – | X | ||||||
| Social support | mMOS-SS79 | 11 | Cronbach's α=0.88–0.9379 | Cronbach's α=0.9480 | X | |||||
| Major life changes | For example, ‘In the past 12 months, have you or someone close to you been faced with a serious medical problem or diagnosis?’ | 4 | – | – | X | |||||
| Demographic information | ||||||||||
| Demographic information | Age, gender, race/ethnicity,81 income, marital status and education | X | X | |||||||
| Religion/spirituality | Self-reported extent of how spiritual/religious (five-point Likert) and role play in decision-making82 | 4 | Spirituality associated with quality of life. Religiosity associated with wanting all measures to extend life82 | – | X | |||||
| Finances | ‘In general, how do your finances usually work out at the end of the month?’ | 1 | Associated with functional impairment and comorbidity83 | – | X | |||||
| Socioeconomic status and social standing | Social standing ladder (ie, place an ‘x’ where you think you stand relative to other people in society) | 1 | Associated with functional decline84 | – | X |
If a validated Spanish version of a survey was not available, we translated the English version into Spanish.
*ICC=intraclass correlation.
†Area under the receiver operating curve (AUROC).
‡While mediator variables, measured at baseline, may explain how or why a particular effect or relationship occurs, these variables may also be affected by the intervention and are therefore also considered secondary outcome variables measured over time (ie, knowledge, self-efficacy and readiness, as well as barriers and attitudes).
ACP, advance care planning; ADL, activities of daily living; CAHPS, Consumer Assessment of Healthcare Providers and Systems; CPS, Control Preference Scale; GAD-7, Generalized Anxiety Disorder 7-Item Scale; IADL, instrumental activities of daily living; mMOS-SS, modified Medical Outcomes Study Social Support; SPMSQ, Short Portable Mental Status Questionnaire; s-TOFHLA, Short form Test of Functional Health Literacy in Adults; USAS, US Acculturation Scale.
The primary outcome is documentation of ACP wishes in the ZSFG/SFHN medical record (table 2). ACP documentation for the purposes of this study includes the easy-to-read advance directive or other valid advance directives or living wills, a durable power of attorney for healthcare document (DPOAHC), a physicians orders for life sustaining treatment (POLST) form, or other documentation of patients wishes for medical care (ie, documentation of oral directives by a physician, or code status, such as ‘full code’ or ‘do not resuscitate’ or ‘do not intubate’ orders or notes by a physician). We will assess baseline and 12-month documentation rates and the date of documentation to determine the length of time from study enrolment to subsequent documentation.
Secondary outcomes were chosen to measure the full process of ACP. Using validated questionnaires,29 we will measure ACP behaviour change processes, such as knowledge, contemplation, self-efficacy and readiness, as well as several ACP actions, such as identifying a surrogate decision-maker, identifying values and goals for medical care, choosing the level of leeway in surrogate decision-making, discussing one's wishes with clinicians and surrogates, and documenting one's wishes in an advance directive (table 2). Validity and reliability of the ACP Engagement Questionnaire, as well as the questionnaire's ability to detect change in response to an ACP intervention, have been previously described.27–29
Several additional secondary outcomes are included. Using validated surveys, we assess communication quality and satisfaction,39 40 care consistent with current goals, and satisfaction with decision-making.41 To ensure that the PREPARE programme does not cause undue harm, we will also assess both depression42 43 and anxiety44 45 (table 2). To evaluate whether and how PREPARE will be used in clinical practice and in the community, we also assess acceptability of the PREPARE website compared with an advance directive alone using validated scales from our prior work.8 For the PREPARE arm only, and at the end of the 12-month interview and after unblinding, we also ask how likely patients and surrogates are to recommend the PREPARE intervention to others,46 and about usability, such as when and where to review ACP materials, and which PREPARE materials (ie, the website, pamphlet or DVD) they would recommend. We also obtain corroborating or conflicting information about patient engagement in ACP behaviours from their surrogate (table 2). Surrogates are also asked about their knowledge of the patient's wishes and confidence in making decisions on the patient's behalf, using a five-point Likert scale with response options from ‘not at all’ to ‘extremely’.
On the basis of the previously published conceptual framework of PREPARE,27 we also hypothesise that PREPARE efficacy may vary across several moderator variables (eg, health literacy, clinician–patient language concordance and patient's desired role in decision-making). We also hypothesise that the pathway from PREPARE to the primary and secondary outcomes may be mediated by several baseline variables (eg, knowledge of ACP, perceived barriers to ACP), and that PREPARE efficacy may be affected by several confounding variables (eg, self-rated health, past experiences with ACP, social support (table 2)). We will also assess patient age, gender, finances, social standing, marital status, education and religiosity. In addition, we will assess clinicians' age, race/ethnicity and gender, as these factors may impact patient–clinician communication.20 47
Analytic plan
Our primary analyses will compare change in engagement between study arms with respect to five ACP behaviours (yes/no and a five-point scale) and behaviour change scores (average five-point Likert scores) from baseline to 1 week, and at 3, 6 and 12 months. Baseline comparability will be assessed between groups using t-tests and χ2 tests. To compare outcomes between the two arms longitudinally, we will use mixed-effects linear, Poisson or negative binomial regression for continuous measures and mixed-effects logistic regression for dichotomous measures. The mixed-effects models will include fixed effects for the primary modelling terms of time and arm; an interaction term of study arm and time; and a random effect for participants. We will treat the time variable in three ways: (1) we will encode the time variable as a dummy variable for baseline versus the postintervention time points; (2) we will next model time in a continuous linear fashion; (3) then consider an arbitrary time course by treating time as a categorical factor variable. We will adjust for the randomisation blocking factors limited versus adequate literacy,48 and any predictor variables that differ between arms. We will also include random physician intercepts to account for nesting of patients within physicians and consider including random effects for the primary modelling terms of time, arm and their interaction. Stata V.12 will be used to fit the models using the xt routines. Mediation analyses will use Stata's mediation package.49 For moderator analysis, we will stratify the outcomes (eg, health literacy (continuous score and limited vs adequate health literacy), control preferences for decision-making (three-item categorical and control vs lack of control), patient–clinician language concordance vs discordance) by the dichotomous forms of the three potential moderating factors. To make formal inference on the interaction effects, we will augment our mixed-effects regression models to include interaction terms of these potentially moderating variables.
Sample size
We will measure a full range of ACP behaviours including discussions. However, written advance directive completion is a primary outcome and is the one most well studied.50 Power from longitudinal analyses with repeated measures will be stronger, but to be conservative we consider power for a single postintervention time point (eg, 12 months). A recent meta-analysis of written advance directive documentation studies demonstrated a pooled effect size of 0.50 (95% CI 0.17 to 0.83),50 as did an RCT of an ACP workbook that included both behaviour change constructs and a social work visit,51 and our prior RCT of an easy-to-read AD at ZSFG which showed an increased AD completion rate from 7% to 15%.8 Since both the intervention and control arms will receive the easy-to-read advance directive, we assume that both arms will have an advance directive completion rate of ≤15%. On the basis of prior studies, we assume PREPARE will result in additional benefit of advance directive completion with a minimum effect size of 0.5 (twofold increase) above 15%. A sample of 350 (175 per arm) will afford us 92% power (two-tailed α of 0.05) to detect a difference of advance directive completion rates of 15% in controls versus 30% in the PREPARE arm and 80% power to detect a difference of 15% vs 27%. Power is also expected to be strong for the ACP behavioural change scale outcomes (preliminary data demonstrated a pre-to-post improvement of 0.5 SD).27 With a conservative assumption that controls will improve by 0.1–0.2 SD, we will have 85–98% power, respectively, to conclude that the improvement is better in the PREPARE arm. We expect a 15% dropout rate at 12 months based on our prior RCT at ZSFG,8 and will therefore attempt to recruit 402 patients, or 201 in each arm for each language (English and Spanish) for a total recruitment of 804 patients. On the basis of our prior experience recruiting surrogate decision-makers for a similar trial,28 we plan to recruit 136 surrogates (68 in each arm) for English and Spanish speakers (total of 272), anticipating that 15% of patients will be lost to follow-up, 15% of patients will not have any potential surrogate decision-makers, 15% of patients will refuse permission for us to contact their surrogate and 25% of surrogates will refuse.
Our sample size will also allow adequate power to detect clinically important interactions based on potential moderators (literacy, control preferences, language concordance) for our outcomes. In a prior trial of an easy-to-read advance directive in the same patient population with only 200 patients, we found significant interactions for literacy.8 Thus, if we consider the power scenario of the control group advance directive documentation rate of 15% and the PREPARE group of 28%, and suppose the control group rate is the same (15%) for both levels of the moderating factor, then for a moderating factor split of 1:1 we would have 80% power to detect an interaction. If the PREPARE arm advance directive documentation rate was 18% for one level of the factor and 40% for the other, this corresponds to a relative rate of advance directive documentation of 2.2 times as high for one level of the factor compared with the other. A 2:1 split of the moderating factor still allows detection of a 2.4-fold increase in the relative rate of documentation. Power to detect interactions will most likely be stronger for continuous outcomes (eg, engagement/behavioural scales).
Ethics and dissemination
Ethics
This study is registered at ClinicalTrials.gov (NCT01990235 for English speakers and NCT02072941 for Spanish speakers). Recruitment of English-speaking older adults is funded through a National Institute on Aging R01 grant (R01 AG045043) and recruitment of Spanish-speaking older adults is funded through the Patient-Centered Outcomes Research Institute (CDR-1306-01500).
This study is guided by a patient and clinical advisory board comprising patients, patient advocates, surrogates, and ZSFG/SFHN primary care clinic staff and medical directors. It is also guided by a DSMB consisting of four experts in randomised trials, human participants research and consent, vulnerable populations, palliative care, ACP and biostatistics. Both advisory groups have reviewed and approved all study protocols and related materials. In addition, we continue to meet both groups every 4–6 months to review the progress of the trial, make suggestions for recruitment, review any potentially adverse events (until now, there have been none) and ensure that we are following our study protocols in a way that protects vulnerable patient populations.
Dissemination
For academic audiences, we will present our findings at scientific meetings and in peer-reviewed research journals. We have been working with our community and ZSFG/SFHN clinical and healthcare system partners throughout the development and implementation of the trial. Therefore, we will continue working with these key stakeholders to help us interpret our results and create appropriate messaging for the dissemination of our results to the community. We will also work with UCSF to create a press release for a lay audience and present our findings to our community and clinical partners through in-person lectures and discussions.
If PREPARE is found to be successful, our stakeholder partners will also help us determine how to replicate, refine and disseminate PREPARE in primary care clinics through the ZSFG/SFHN-affiliated system and other public healthcare systems.
Discussion
This is the first study to test the efficacy of the new PREPARE website and its underlying ACP paradigm among diverse English-speaking and Spanish-speaking older adults from urban publicly run primary care clinics. If this trial demonstrates that PREPARE fosters diverse older adults' engagement in ACP and activates them to communicate and document their wishes in the medical record, then PREPARE would represent an efficient and effective strategy to ensure that patients' ongoing wishes are solicited and honoured. PREPARE could also decrease health disparities in ACP by providing ACP information to diverse English-speaking and Spanish-speaking older adults at a literacy level and in a language and format that they can understand. Since PREPARE was designed to be used both inside and outside of the clinical setting, for resource-poor, urban, public hospital systems, future studies should evaluate whether PREPARE saves clinicians' time and is cost-effective.
If the results of this trial are positive, the next step will be to promote local uptake and widespread adoption. By including key patient, clinical and community partners in the design and ongoing conduct of the study and by eliciting suggestions for implementation and dissemination during the randomised trial phase, we are well positioned to move quickly to implementation and dissemination of PREPARE within ZSFG/SFHN-affiliated clinics and within the community.
Trial status
We started recruitment of English-speaking patient participants in March 2014 and will end recruitment in September 2016. We expect to complete recruitment of English-speaking surrogates in September of 2017. We started recruitment of Spanish-speaking patient participants in November 2014 and will end recruitment in March 2016. We expect to complete recruitment of Spanish-speaking surrogates in March 2017. At the time of this manuscript submission, 413 Spanish-speaking patients and 312 English-speaking patients from the ZSFG/SFHN primary care clinics have been enrolled. No surrogates have yet been recruited; surrogate recruitment and enrolment will start in March 2016.
Footnotes
Contributors: RLS, DEB and GML drafted the manuscript; RLS, DEB, JB and DS designed the study; RLS, DEB, RR, SJO, SAR and DS contributed to the conduct of the study; and RLS, DEB, GML, RR, SJO, RLS, JB and DS performed critical revisions to the manuscript. All authors read, contributed to and approved the final manuscript.
Funding: This work is supported by the National Institute on Aging (R01 AG045043) and the Patient-Centered Outcomes Research Institute (CDR-1306-01500).
Disclaimer: The statements in this article are solely the responsibility of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute (PCORI), its Board of Governors or Methodology Committee.
Competing interests: None declared.
Ethics approval: University of California, San Francisco (IRB reference #13–10847).
Provenance and peer review: Not commissioned; externally peer reviewed.
References
- 1.The United Nations Department of Economic and Social Affairs Population Division. World Population Aging: 1950–2050. http://www.un.org/esa/population/publications/worldageing19502050/. (accessed Jan 2016).
- 2.2010 United States Census. Overview of Race and Hispanic Origin: 2010. http://www.census.gov/prod/cen2010/briefs/c2010br-02.pdf (accessed December 2015).
- 3.Wilper AP, Woolhandler S, Lasser KE et al. A national study of chronic disease prevalence and access to care in uninsured US adults. Ann Intern Med 2008;149:170–6. 10.7326/0003-4819-149-3-200808050-00006 [DOI] [PubMed] [Google Scholar]
- 4.Castillo LS, Williams BA, Hooper SM et al. Lost in translation: the unintended consequences of advance directive law on clinical care. Ann Intern Med 2011;154:121–8. 10.7326/0003-4819-154-2-201101180-00012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Wu P, Lorenz KA, Chodosh J. Advance care planning among the oldest old. J Palliat Med 2008;11:152–7. 10.1089/jpm.2007.0134 [DOI] [PubMed] [Google Scholar]
- 6.Krakauer EL, Crenner C, Fox K. Barriers to optimum end-of-life care for minority patients. J Am Geriatr Soc 2002;50:182–90. 10.1046/j.1532-5415.2002.50027.x [DOI] [PubMed] [Google Scholar]
- 7.Crawley LM. Palliative care in African American communities. J Palliat Med 2002;5:775–9. 10.1089/109662102320880697 [DOI] [PubMed] [Google Scholar]
- 8.Sudore RL, Landefeld CS, Barnes DE et al. An advance directive redesigned to meet the literacy level of most adults: a randomized trial. Patient Educ Couns 2007;69:165–95. 10.1016/j.pec.2007.08.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Crawley L, Payne R, Bolden J et al. Palliative and end-of-life care in the African American community. JAMA 2000;284:2518–21. 10.1001/jama.284.19.2518 [DOI] [PubMed] [Google Scholar]
- 10.Smith AK, Sudore RL, Perez-Stable EJ. Palliative care for Latino patients and their families: whenever we prayed, she wept. JAMA 2009;301:1047–57; E1 10.1001/jama.2009.308 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Moody-Ayers SY, Stewart AL, Covinsky KE et al. Prevalence and correlates of perceived societal racism in older African-American adults with type 2 diabetes mellitus. J Am Geriatr Soc 2005;53:2202–8. 10.1111/j.1532-5415.2005.00501.x [DOI] [PubMed] [Google Scholar]
- 12.Singh JA, Sloan JA, Atherton PJ et al. Preferred roles in treatment decision making among patients with cancer: a pooled analysis of studies using the Control Preferences Scale. Am J Manag Care 2010;16:688–96. [PMC free article] [PubMed] [Google Scholar]
- 13.Welch LC, Teno JM, Mor V. End-of-life care in black and white: race matters for medical care of dying patients and their families. J Am Geriatr Soc 2005;53:1145–53. 10.1111/j.1532-5415.2005.53357.x [DOI] [PubMed] [Google Scholar]
- 14.Kwak J, Haley WE. Current research findings on end-of-life decision making among racially or ethnically diverse groups. Gerontologist 2005;45:634–41. 10.1093/geront/45.5.634 [DOI] [PubMed] [Google Scholar]
- 15.Kreling B, Selsky C, Perret-Gentil M et al. ‘The worst thing about hospice is that they talk about death’: contrasting hospice decisions and experience among immigrant Central and South American Latinos with US-born White, non-Latino cancer caregivers. Palliat Med 2010;24:427–34. 10.1177/0269216310366605 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Morrison RS, Meier DE. High rates of advance care planning in New York City's elderly population. Arch Intern Med 2004;164:2421–6. 10.1001/archinte.164.22.2421 [DOI] [PubMed] [Google Scholar]
- 17.Paasche-Orlow MK, Parker RM, Gazmararian JA et al. The prevalence of limited health literacy. J Gen Intern Med 2005;20:175–84. 10.1111/j.1525-1497.2005.40245.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kutner M, Greenbery E, Baer J. A first look at the literacy of America's adults in the 21st century. National Center for Education Statistics, U.S. Department of Education, 2005. [Google Scholar]
- 19.Katz MG, Jacobson TA, Veledar E et al. Patient literacy and question-asking behavior during the medical encounter: a mixed-methods analysis. J Gen Intern Med 2007;22:782–6. 10.1007/s11606-007-0184-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Sudore RL, Landefeld CS, Pérez-Stable EJ et al. Unraveling the relationship between literacy, language proficiency, and patient-physician communication. Patient Educ Couns 2009;75:398–402. 10.1016/j.pec.2009.02.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Schenker Y, Karter AJ, Schillinger D et al. The impact of limited English proficiency and physician language concordance on reports of clinical interactions among patients with diabetes: the DISTANCE study. Patient Educ Couns 2010;81:222–8. 10.1016/j.pec.2010.02.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Fernandez A, Schillinger D, Warton EM et al. Language barriers, physician-patient language concordance, and glycemic control among insured Latinos with diabetes: the Diabetes Study of Northern California (DISTANCE). J Gen Intern Med 2011;26:170–6. 10.1007/s11606-010-1507-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Doak CC DL, Root JH. Teaching patients with low literacy skills. Philadelphia, PA: JB Lippincott, 1996. [Google Scholar]
- 24.Sudore RL, Fried TR. Redefining the “planning” in advance care planning: preparing for end-of-life decision making. Ann Intern Med 2010;153:256–61. 10.7326/0003-4819-153-4-201008170-00008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Tulsky JA. Beyond advance directives: importance of communication skills at the end of life. JAMA 2005;294:359–65. 10.1001/jama.294.3.359 [DOI] [PubMed] [Google Scholar]
- 26.Goldberg GR, Meier DE. A swinging pendulum: comment on “on patient autonomy and physician responsibility in end-of-life care”. Arch Intern Med 2011;171:854 10.1001/archinternmed.2011.173 [DOI] [PubMed] [Google Scholar]
- 27.Sudore RL, Knight SJ, McMahan RD et al. A novel website to prepare diverse older adults for decision making and advance care planning: a pilot study. J Pain Symptom Manage 2014;47:674–86. 10.1016/j.jpainsymman.2013.05.023 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Sudore RL, Le GM, McMahan RD et al. The advance care planning PREPARE study among older Veterans with serious and chronic illness: study protocol for a randomized controlled trial. Trials 201516:570 10.1186/s13063-015-1055-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Sudore RL, Stewart AL, Knight SJ et al. Development and validation of a questionnaire to detect behavior change in multiple advance care planning behaviors. PLoS ONE 2013;8:e72465 10.1371/journal.pone.0072465 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Fried TR, Redding CA, Robbins ML et al. Stages of change for the component behaviors of advance care planning. J Am Geriatr Soc 2010;58:2329–36. 10.1111/j.1532-5415.2010.03184.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fried TR, Redding CA, Robbins ML et al. Promoting advance care planning as health behavior change: development of scales to assess Decisional Balance, Medical and Religious Beliefs, and Processes of Change. Patient Educ Couns 2012;86:25–32. 10.1016/j.pec.2011.04.035 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Borson S, Scanlan JM, Chen P et al. The Mini-Cog as a screen for dementia: validation in a population-based sample. J Am Geriatr Soc 2003;51:1451–4. 10.1046/j.1532-5415.2003.51465.x [DOI] [PubMed] [Google Scholar]
- 33.Milne A, Culverwell A, Guss R et al. Screening for dementia in primary care: a review of the use, efficacy and quality of measures. Int Psychogeriatr 2008;20:911–26. 10.1017/S1041610208007394 [DOI] [PubMed] [Google Scholar]
- 34.Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc 1975;23:433–41. 10.1111/j.1532-5415.1975.tb00927.x [DOI] [PubMed] [Google Scholar]
- 35.Sudore RL, Landefeld CS, Williams BA et al. Use of a modified informed consent process among vulnerable patients: a descriptive study. J Gen Intern Med 2006;21:867–73. 10.1111/j.1525-1497.2006.00535.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Handley M, MacGregor K, Schillinger D et al. Using action plans to help primary care patients adopt healthy behaviors: a descriptive study. J Am Board Fam Med 2006;19:224–31. 10.3122/jabfm.19.3.224 [DOI] [PubMed] [Google Scholar]
- 37.The Institute for Healthcare Advancement: http://www.iha4health.org/our-services/advance-directive/. (accessed Jan 2016).
- 38.Chew LD, Griffin JM, Partin MR et al. Validation of screening questions for limited health literacy in a large VA outpatient population. J Gen Intern Med 2008;23:561–6. 10.1007/s11606-008-0520-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Weech-Maldonado R, Carle A, Weidmer B et al. The Consumer Assessment of Healthcare Providers and Systems (CAHPS) cultural competence (CC) item set. Med Care 2012;50(Suppl 2):S22–31. 10.1097/MLR.0b013e318263134b [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Stern RJ, Fernandez A, Jacobs EA et al. Advances in measuring culturally competent care: a confirmatory factor analysis of CAHPS-CC in a safety-net population. Med Care 2012;50(Suppl 2):S49–55. 10.1097/MLR.0b013e31826410fb [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.O'Connor AM. Validation of a decisional conflict scale. Med Decis Making 1995;15:25–30. 10.1177/0272989X9501500105 [DOI] [PubMed] [Google Scholar]
- 42.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606–13. 10.1046/j.1525-1497.2001.016009606.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Kroenke K, Strine TW, Spitzer RL et al. The PHQ-8 as a measure of current depression in the general population. J Affect Disord 2009;114:163–73. 10.1016/j.jad.2008.06.026 [DOI] [PubMed] [Google Scholar]
- 44.Spitzer RL, Kroenke K, Williams JB et al. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006;166:1092–7. 10.1001/archinte.166.10.1092 [DOI] [PubMed] [Google Scholar]
- 45.García-Campayo J, Zamorano E, Ruiz MA et al. The assessment of generalized anxiety disorder: psychometric validation of the Spanish version of the self-administered GAD-2 scale in daily medical practice. Health Qual Life Outcomes 2012;10:10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Volandes AE, Levin TT, Slovin S et al. Augmenting advance care planning in poor prognosis cancer with a video decision aid: a preintervention-postintervention study. Cancer 2012;118:4331–8. 10.1002/cncr.27423 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Gordon HS, Street RL Jr, Sharf BF et al. Racial differences in doctors’ information-giving and patients’ participation. Cancer 2006;107:1313–20. 10.1002/cncr.22122 [DOI] [PubMed] [Google Scholar]
- 48.Pocock SJ, Assmann SE, Enos LE et al. Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practice and problems. Stat Med 2002;21:2917–30. 10.1002/sim.1296 [DOI] [PubMed] [Google Scholar]
- 49.Hicks R, Tingley D. Causal mediation analysis. Stata J 2011;11:1–15. [Google Scholar]
- 50.Ramsaroop SD, Reid MC, Adelman RD. Completing an advance directive in the primary care setting: what do we need for success? J Am Geriatr Soc 2007;55:277–83. 10.1111/j.1532-5415.2007.01065.x [DOI] [PubMed] [Google Scholar]
- 51.Pearlman RA, Starks H, Cain KC et al. Improvements in advance care planning in the Veterans Affairs System: results of a multifaceted intervention. Arch Intern Med 2005;165:667–74. 10.1001/archinte.165.6.667 [DOI] [PubMed] [Google Scholar]
- 52.Bergman B, Sjöstrand J. A longitudinal study of visual acuity and visual rehabilitation needs in an urban Swedish population followed from the ages of 70 to 97 years of age. Acta Ophthalmol Scand 2002;80:598–607. 10.1034/j.1600-0420.2002.800608.x [DOI] [PubMed] [Google Scholar]
- 53.Erkinjuntti T, Sulkava R, Wikstrom J et al. Short Portable Mental Status Questionnaire as a screening test for dementia and delirium among the elderly. J Am Geriatr Soc 1987;35:412–16. 10.1111/j.1532-5415.1987.tb04662.x [DOI] [PubMed] [Google Scholar]
- 54.Borson S, Scanlan J, Brush M et al. The mini-cog: a cognitive ‘vital signs’ measure for dementia screening in multi-lingual elderly. Int J Geriatr Psychiatry 2000;15:1021–7. [DOI] [PubMed] [Google Scholar]
- 55.Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med 2004;36:588–94. [PubMed] [Google Scholar]
- 56.Sarkar U, Schillinger D, López A et al. Validation of self-reported health literacy questions among diverse English and Spanish-speaking populations. J Gen Intern Med 2011;26:265–71. 10.1007/s11606-010-1552-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Urrutia M, Campos S, O'Connor A. Validation of a Spanish version of the Decisional Conflict scale. Rev Med Chil 2008;136:1439–47. [DOI] [PubMed] [Google Scholar]
- 58.Wulsin L, Somoza E, Heck J. The feasibility of using the Spanish PHQ-9 to screen for depression in primary care in Honduras. Prim Care Companion J Clin Psychiatry 2002;4:191–5. 10.4088/PCC.v04n0504 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Schickedanz AD, Schillinger D, Landefeld CS et al. A clinical framework for improving the advance care planning process: start with patients’ self-identified barriers. J Am Geriatr Soc 2009;57:31–9. 10.1111/j.1532-5415.2008.02093.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Baker DW, Williams MV, Parker RM et al. Development of a brief test to measure functional health literacy. Patient Educ Couns 1999;38:33–42. 10.1016/S0738-3991(98)00116-5 [DOI] [PubMed] [Google Scholar]
- 61.Aguirre AC, Ebrahim N, Shea JA. Performance of the English and Spanish S-TOFHLA among publicly insured Medicaid and Medicare patients. Patient Educ Couns 2005;56:332–9. 10.1016/j.pec.2004.03.007 [DOI] [PubMed] [Google Scholar]
- 62.Rosenthal A, Wang F, Schillinger D et al. Accuracy of physician self-report of Spanish language proficiency. J Immigr Minor Health 2011;13:239–43. 10.1007/s10903-010-9320-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Degner LF, Sloan JA, Venkatesh P. The Control Preferences Scale. Can J Nurs Res 1997;29:21–43. [PubMed] [Google Scholar]
- 64.Degner LF, Sloan JA. Decision making during serious illness: what role do patients really want to play? J Clin Epidemiol 1992;45:941–50. 10.1016/0895-4356(92)90110-9 [DOI] [PubMed] [Google Scholar]
- 65.Gigerenzer G, Gray JAM. Better doctors, better patients, better decisions: envisioning health care 2020. MIT Press, 2011. [Google Scholar]
- 66.Yennurajalingam S, Parsons HA, Duarte ER et al. Decisional control preferences of Hispanic patients with advanced cancer from the United States and Latin America. J Pain Symptom Manage 2013;46:376–85. 10.1016/j.jpainsymman.2012.08.015 [DOI] [PubMed] [Google Scholar]
- 67.Wright AA, Stieglitz H, Kupersztoch YM et al. United States acculturation and cancer patients’ end-of-life care. PLoS ONE 2013;8:e58663 10.1371/journal.pone.0058663 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Lee SJ, Lindquist K, Segal MR et al. Development and validation of a prognostic index for 4-year mortality in older adults. JAMA 2006;295:801–8. 10.1001/jama.295.7.801 [DOI] [PubMed] [Google Scholar]
- 69.Samper-Ternent R, Kuo YF, Ray LA et al. Prevalence of health conditions and predictors of mortality in oldest old Mexican Americans and non-Hispanic whites. J Am Med Dir Assoc 2012;13:254–9. 10.1016/j.jamda.2010.07.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Vergara I, Bilbao A, Orive M et al. Validation of the Spanish version of the Lawton IADL Scale for its application in elderly people. Health Qual Life Outcomes 2012;10:130 10.1186/1477-7525-10-130 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Shadbolt B, Barresi J, Craft P. Self-rated health as a predictor of survival among patients with advanced cancer. J Clin Oncol 2002;20:2514–19. 10.1200/JCO.2002.08.060 [DOI] [PubMed] [Google Scholar]
- 72.Lucas-Carrasco R. The WHO quality of life (WHOQOL) questionnaire: Spanish development and validation studies. Qual Life Res 2012;21:161–5. 10.1007/s11136-011-9926-3 [DOI] [PubMed] [Google Scholar]
- 73.Zimmerman M, Ruggero CJ, Chelminski I et al. Developing brief scales for use in clinical practice: the reliability and validity of single-item self-report measures of depression symptom severity, psychosocial impairment due to depression, and quality of life. J Clin Psychiatry 2006;67:1536–41. 10.4088/JCP.v67n1007 [DOI] [PubMed] [Google Scholar]
- 74.Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol 1992;45:613–19. 10.1016/0895-4356(92)90133-8 [DOI] [PubMed] [Google Scholar]
- 75.Sundararajan V, Henderson T, Perry C et al. New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol 2004;57:1288–94. 10.1016/j.jclinepi.2004.03.012 [DOI] [PubMed] [Google Scholar]
- 76.Elixhauser A, Steiner C, Harris DR et al. Comorbidity measures for use with administrative data. Med Care 1998;36:8–27. 10.1097/00005650-199801000-00004 [DOI] [PubMed] [Google Scholar]
- 77.Quan H, Sundararajan V, Halfon P et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care 2005;43:1130–9. 10.1097/01.mlr.0000182534.19832.83 [DOI] [PubMed] [Google Scholar]
- 78.Southern DA, Quan H, Ghali WA. Comparison of the Elixhauser and Charlson/Deyo methods of comorbidity measurement in administrative data. Med Care 2004;42:355–60. 10.1097/01.mlr.0000118861.56848.ee [DOI] [PubMed] [Google Scholar]
- 79.Moser A, Stuck AE, Silliman RA et al. The eight-item modified Medical Outcomes Study Social Support Survey: psychometric evaluation showed excellent performance. J Clin Epidemiol 2012;65:1107–16. 10.1016/j.jclinepi.2012.04.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Costa Requena G, Salamero M, Gil F. Validity of the questionnaire MOS-SSS of social support in neoplastic patients. Med Clin (Barc) 2007;128:687–91. 10.1157/13102357 [DOI] [PubMed] [Google Scholar]
- 81.United States Bureau of the Census. http://www.census.gov/topics/population/language-use.html (accessed Jan 2016).
- 82.Balboni TA, Vanderwerker LC, Block SD et al. Religiousness and spiritual support among advanced cancer patients and associations with end-of-life treatment preferences and quality of life. J Clin Oncol 2007;25:555–60. 10.1200/JCO.2006.07.9046 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Kahn JR, Fazio EM. Economic status over the life course and racial disparities in health. J Gerontol B Psychol Sci Soc Sci 2005;60(Spec No 2):76–84. [DOI] [PubMed] [Google Scholar]
- 84.Chen B, Covinsky KE, Stijacic Cenzer I et al. Subjective social status and functional decline in older adults. J Gen Intern Med 2012;27:693–9. 10.1007/s11606-011-1963-7 [DOI] [PMC free article] [PubMed] [Google Scholar]

