Abstract
Background
Aging in place (AIP) is a policy strategy designed to help older adults remain in their community. While planners internationally have modified aspects of the older adult care continuum (e.g., home care, assisted living, nursing homes) to facilitate AIP, further improvements to community-based supports and services are also required. This study compared and constrasted the community-based factors (e.g., supports, services and personal strategies or characteristics) that family/friend care partners and healthcare stakeholders (i.e., planners/providers) view as most important to help older adults successfully AIP.
Methods
An initial list of factors shown to influence AIP was created from the academic literature. These factors were used to develop a Delphi survey implemented separately on care partners and healthcare stakeholders. Respondents rated the importance of each factor using a 10-point Likert Scale (1 = not important; 10 = absolutely critical). Consensus in each group was defined when at least 80% of participants scored a factor ≥8 (“very important”), with an interquartile range ≤2. Respondents suggested additional factors during Delphi round one.
Results
Care partners (N = 25) and healthcare stakeholders (N = 36) completed two and three Delphi rounds, respectively. These groups independently agreed that the following 3 (out of 27) factors were very important to help older adults age in place: keeping one’s home safe, maintaining strong inter-personal relationships, and coordinating care across formal providers. While healthcare stakeholders did not reach consensus on other factors, care partners agreed that 7 additional factors (e.g., access to affordable housing, having mental health programs) were important for AIP.
Conclusions
Compared to healthcare stakeholders, care partners felt that more and diverse community-based factors are important to support older adults to successfully AIP. Future research should replicate these findings in other jurisdictions, examine the availability and accessibility of the priority factors, and develop sustainable solutions to enhance their effectiveness.
Background
Healthcare planners internationally have been searching for the right mix of aging in place (AIP) practices designed to delay or prevent nursing home admission, while supporting older adults to remain in their community for as long and safely as possible [1–4]. Planners across Europe [5], the United States [6], and Canada [7, 8], have used various strategies to de-emphasize institutional care while extending the type and number of home and community-based supports and services that they provide. Further adapting and refining these AIP strategies is important given population aging coupled with the projected costs of providing continuing care services (e.g., home care, assisted living, nursing homes) [6, 9, 10], and people’s desire to remain in their own homes or community for as long as realistically possible [11–13].
AIP strategies may focus on restructuring the continuing care system (e.g., increasing publicly funded home care services, creating assisted living to supplement nursing home beds, providing respite to support family and friend care partners) [3, 5, 14], and/or seek to improve and extend allied health and community-based supports. Examples of the latter include comprehensive case management services (e.g., to care for people with dementia), restorative efforts designed to improve one’s physical function, and caregiver education and training programs [15–17]. While researchers have shown the benefits of community-based AIP interventions in randomized controlled trials [15, 18], their effect in real-world settings is less clear [19]. Additionally, despite the potential for AIP to promote feelings of dignity and independence [20, 21], several authors have shown that community-living older adults still experience significant challenges related to housing, finances, and safety [22]; maintaining social connections [23]; and accessing healthcare services [24].
As planners strive to improve AIP, further information is needed to help prioritize the kinds of community-based supports and services that older adults require. Family/friend care partners contribute substantially to older adult care [17, 24], and given this expertise, can help to meaningfully guide the design and delivery of services. Research shows that family/friend care partners and healthcare planners/providers often have different priorities regarding older adult care [25, 26], and that innovations reflecting these different perspectives can lead to improved health outcomes and a greater real-world impact [27, 28]. The purpose of this study was to compare and contrast the community-based factors (e.g., supports, services and personal strategies or characteristics) that family/friend care partners and healthcare stakeholders (i.e., planners and providers) view as most important to help older adults successfully AIP, safely and with as high a quality of life as possible. Study results can help to further establish community-based AIP priorities and provide future research directions.
Methods
Overview and definitions
This study was conducted using a modified Delphi method. This approach generates consensus-based expert opinion using an iterative questionnaire and feedback process [29]. The Delphi method has previously been used to develop guidelines that help families care for people with dementia [30], to assess reportable and preventable events in home care [31], to prioritize quality measures of nursing home care [32–34], and to identify operational standards and guidelines for palliative care [35]. Similar to the approach used by others [30, 36], we conducted the Delphi survey independently with two expert groups (care partners and healthcare stakeholders), enabling us to compare and contrast the priorities identified by these different expert groups. The following definitions were used to guide this research.
Aging in place
Guided by the Canadian federal and provincial governments responsible for seniors [3], we defined aging in place as any strategy designed to help people live safely and independently in their home or community for as long as possible. The term ‘community’ in this research includes home living with or without home care services, and congregate housing options such as assisted living [3, 37], but excludes people residing in nursing homes and chronic care hospitals.
AIP factors
Based on our analyses of the existing literature [38–45] and input from our team of community advisors and healthcare planners, we defined these factors as any community-based supports, services, personal strategies or characteristics that enable older adults to successfully age in place. Examples include (a) policies to ensure affordable housing, (b) medical services that provide timely and necessary care, and (c) personal approaches used to keep physically, mentally, and/or socially well. For the purposes of this research, we excluded from this definition the health and social services provided to assisted living residents (e.g., staffing composition and levels, admission guidelines, types of care provided).
Family/Friend care partners
This term refers to people who provide non-professional care or support to an older adult friend or family member.
Study setting
This study is part of a larger research program funded by the Canadian Institutes of Health Research [46] designed to compare continuing care health service policies, practices and utilization patterns between Edmonton, Alberta and Winnipeg, Manitoba. While Canada has a national insurance plan that funds medically necessary physician and hospital services in each province [47], planners have more latitude when determining the type and volume of continuing care services that are delivered provincially. Manitoba and Alberta were selected for the broader research program given their similar underlying population characteristics (e.g., household size, age structure, prevalence of caregiving) [48, 49], their long-term commitment to support AIP [50, 51], coupled with their differing continuing care health services (e.g., compared to Alberta, Manitoba has 21% more nursing home beds per capita 85+ year old [52], and one versus three levels of community-based assisted living care [37, 53]). Delphi respondents in the present study were recruited from these regions.
Framework
This research was guided by the Lau et al. (2007) Health-Related Safety Framework which shows how micro, mezzo, and macro-level factors can minimize preventable and unintended harm to community-dwelling older adults resulting from breakdowns in the societal system [54]. Micro factors include an individuals’s biological or psychological characteristics (e.g., physical, mental and functional health; attitude and knowledge; personal health behaviours). Mezzo factors include one’s social network, the structure and features of their home and/or community, and available medical and social services. Macro factors include the broader economic, societal and political forces that may affect a person’s ability to age in place (e.g., having access to funds that help people purchase assistive technology) [54]. Similar to others [55, 56], we used the Health-Related Safety Framework to (1) ensure that Delphi responses were based on a diverse array of community-based AIP factors, (2) help structure our study findings.
Selecting factors to include in the Delphi survey
This research was conducted by a team of researchers, healthcare planners, and community advisors (i.e., care partners with system experience) from each province. Two members of our research team (MC and ES) used key words from select articles and reports [38–42] to develop and apply the following search terms to select databases (Google Scholar, PubMed, CINAHL).
“older adults” AND “aging in place” AND/OR “community supports”; “older adults” AND “facilitators for aging in place”; “delay” OR “prevent” AND “nursing home admission”
Titles and abstracts were reviewed, and potential factors were extracted from relevant articles. MC, ES, HCE and MD amalgamated these factors into a comprehensive list and provided a lay description of each factor for use in the Delphi survey. As part of a full-day workshop, our entire team reviewed and refined the list of factors and their definitions.
Participant recruitment, survey development and application
This research was approved by the University of Manitoba Health Research Ethics Board (reference number HS22703 (H2019:117)), the Winnipeg Regional Health Authority Research Access & Approval Committee (#2018–027), the University of Alberta Health Research Ethics Board (MS3_Pro00089982), and Alberta Health Services. Informed consent was obtained from all participants through the online survey.
Two groups of study participants − family/friend care partners (‘care partners’) and healthcare stakeholders (i.e., planners and providers) − were recruited in June and July of 2019 with assistance from team members. To be included, care partners must have lived in Manitoba or Alberta, and have had current or previous experience providing care. These participants were recruited through personal contacts made by our community advisors, and also through Manitoba’s and Alberta’s Primary and Integrated Healthcare Innovation Networks, which help researchers to develop patient partnerships [57, 58]. Community advisor team members approached their personal networks and identified individuals who met the study criteria. MC followed up with interested individuals to confirm their eligibility, answer questions, and identify additional participants using snowball sampling.
To be included in the study, healthcare stakeholders must have had experience working in the Winnipeg or Edmonton continuum of healthcare services, with an emphasis on older adult community-based care. Those who worked exclusively in nursing homes were excluded. Healthcare planner team members identified colleagues using these criteria; MC followed up with each potential participant to determine their interest, confirm eligibility, answer questions, and to identify additional participants using snowball sampling.
A draft version of the survey was piloted with a total of four team members (two healthcare planners, two community advisors). These team members completed the survey and provided feedback about its format and content. They also completed a revised version of the survey to verify that the appropriate improvements were made. The final version of the Delphi survey was administered online using SimpleSurvey [59], separately to each participant group (S1 File contains the round 1 survey for healthcare stakeholders). The survey first explains the study goals, gives key definitions, and provides directions for completing the questionnaire, including a scoring example. Participants were then instructed to complete a consent section, a participant information section (documenting their type and duration of experiences), and the actual questionnaire. With the exception of the group-specific participant information questions, both participant groups completed the same survey.
At the end of Round 1, participants were asked to suggest additional factors to include in subsequent survey rounds. To facilitate group comparisons, the suggestions made by each group were provided to the other. In Round 2, participants from each group were provided with their Round 1 score for each factor, the median score provided by peers, and an anonymized list of (group-specific) comments used to rationalize people’s scoring choice. Participants were asked to re-score each factor taking this information into account. Those who did not complete round one were ineligible to participate in subsequent Delphi rounds.
Delphi scoring and data analysis
Care partners and healthcare stakeholder participants completed the Delphi survey independently, and hence scoring and analyses were conducted separately for each group. Participants in each group rated every factor from 1 (“not important; by providing this score, you are saying that a factor does not help older adults to live successfully the community”) to 10 (“absolutely critical; this factor is amongst the top 1 or 2 things you feel are needed to help most older adults live successfully in the community”). A score of ‘8’ defined factors that were considered ‘very important’ (“this factor is amongst the top 5 or 6 things you feel are needed to help most older adults live successfully in the community”).
Results from each Delphi round were analyzed as per the method described by van der Steen et al. (2014), separately for care partners and healthcare stakeholders [60]. Measures of central tendency (median) and variation (interquartile range, IQR) were used to define the following levels of agreement:
Very High (80+% of participants provided a score ≥8; IQR = 0);
High (80+% of participants provided a score ≥8; IQR = ≤2);
Moderate (60+% of participants provided a score ≥8; IQR ≤4); and
Low (all other results).
Consensus on a given Delphi factor was defined when participants reached a ‘high’ or ‘very high’ level of agreement. As per Jorm (2015), once consensus was reached for a factor, we removed it from subsequent survey rounds [61]. Care partners reached consensus on 10 factors after two Delphi rounds, at which point we decided not to conduct a third Delphi round for this group. This decision is consistent with other studies [36], supports our study goal to identify only the most important AIP factors, and aligns with our rating instructions (i.e., to give, at most, 5 or 6 factors a score of ‘8’). Group specific results were analyzed separately, enabling us to compare and contrast the priotities identified by each expert group.
Results
Community-based aging in place factors
Twenty-three factors were extracted from the academic literature, and 4 additional factors were added by participants during the first Delphi round, for a total of 27 factors examined in this research (Table 1). These factors were categorized into the micro/person (n = 8), mezzo/community (n = 15), and macro/policy and societal (n = 4) levels.
Table 1. Survey factors by source, and categorized by the Health-Related Safety Framework [54].
MICRO | MEZZO | MACRO | |||||
---|---|---|---|---|---|---|---|
Biological | Psychological | Other | Social Network | Home and Neighbourhood Structure | Social Services | Medical Services | Policy and Societal |
Keeping physically active—Grimmer et al. 2015 [43] | Not having significant behavioural or mental health disorders -Luppa et al. 2009 [42] | Being someone who prepares and plans for the future (e.g., participates in health promotion activities, plans financially for the future, develops new skills)—Scharlach et al 2016 [39] | Having strong relationships and links with family, friends, and the community—Grimmer et al. 2015 [43] | Living in a safe home environment (e.g., with enough safety aids and equipment)—Grimmer et al. 2015 [43] | Having accessible and affordable community-based services (e.g., adult education, recreation and support programs)—Cao et al. 2016 [44] | Having coordinated care between all types of formal health care providers (for example, physicians, home care workers, social workers)—Brown et al. 1997 [45] | Having access to affordable housing—Summer, 2005 [40] |
Having policies that allow people to reside in the community with an acceptable level of risk—Fancey & Keefe, 2014 [38] | |||||||
Being continent (with or without the use of continence aids)—Friedman et al. 2005 [41] | Thinking of oneself as healthy—Luppa et al. 2009 [42] | Having a home layout that is appropriate (e.g., the absence of stairs)—Scharlach et al 2016 [39] | Having a resource (e.g., information call centre) that helps people make informed choices about health care services that are available to them—Summer, 2005; Grimmer et al. 2015 [40, 43] | ||||
Having physicians who provide house-calls & home visits—Brown et al. 1997 [45] | |||||||
Having access to funds that help people purchase assistive technology (e.g., motorized wheelchairs) and/or to modify their home (e.g., put in a wheelchair ramp)—Scharlach et al 2016; Summer, 2005 [39, 40] | |||||||
Maintaining a positive attitude, having a high self-esteem and/or sense of personal identity—Grimmer et al. 2015 [43] | Having enough money to afford to stay successfully in the community—Scharlach et al 2016 [39] | ||||||
Having medical professionals (e.g., nurse practitioners, pharmacists) who regularly check the # and type of medications people are taking—Luppa et al. 2009 [42] | |||||||
Having public transportation that is affordable, reliable and accessible—Grimmer et al. 2015 [43] | |||||||
Keeping mentally active—Grimmer et al. 2015 [43] | Having formal healthcare providers (e.g., physicians, home care workers) who are aware of community-based services—Fancey & Keefe, 2014 [38] | Ensuring that community-based alternatives to nursing home use (e.g., supportive housing in Manitoba, lodge and supportive living in Alberta) are affordable* | |||||
Having good communication between informal & formal caregivers—Brown et al. 1997 [45] | |||||||
Having training & education programs for informal caregivers—Friedman et al. 2005 [41] | |||||||
Ensuring that people have adequate access to important allied and medical services (e.g., glasses, dental care, affordable medications, physiotherapy)* | |||||||
Having programs that help people to cope with mental health challenges (e.g., anxiety, depression, loneliness)* | |||||||
Having programs that provide support to complete household chores (e.g., shoveling, mowing grass, completing minor household repairs) and other daily tasks (e.g., banking, grocery shopping)* |
* Factor was added after Delphi Round 1.
Study participants
Twenty-five care partners and 36 healthcare stakeholders participated in this study with low dropout between rounds (Table 2). Care partners were predominantly female (96%) and were on average 67 years old. Forty percent of these participants were currently providing care at the time of the study, and 60% had received either formal or informal care at some point in their life.
Table 2. Description of Delphi participant characteristics.
Family/Friend Care Partners (N = 25)† | |
---|---|
n (%) | |
Profile | |
Participant Sex (Female) | 24 (96%) |
Age in Years, Average (SD) | 67 (11.9) |
Number of people ≥ 65 years old | 17 (68%) |
Region (Winnipeg, Manitoba) | 13 (52%) |
Care Partner Status * | |
Past Care Partner | 17 (68%) |
Present Care Partner | 10 (40%) |
Care Receiving Status * | |
Previously received formal care | 6 (24%) |
Previously received unpaid care from family or friends | 9 (36%) |
Response Rate (based on 28 recruited participants) | |
Round 1 | 25 (89%) |
Round 2 | 24 (85.7%) |
Healthcare Stakeholders (N = 36) ‡ | |
n (%) | |
Profile | |
Participant Sex (Female) | 30 (83.3%) |
Age in Years, Average (SD) | 45.6 (10.4) |
Region (Winnipeg, Manitoba) | 24 (66.7%) |
Years of related working experience, Average (SD) | 15.8 (9.4) |
Job title | |
Facility Level Planner or Provider | 8 (22.2%) |
Regional Planner | 18 (50.0%) |
Government Policy Maker | 10 (27.8%) |
Education | |
Undergraduate Degree | 13 (36.1%) |
Graduate Degree | 14 (38.9%) |
Professional Degree (e.g., nurse, pharmacist etc.) | 9 (25.0%) |
Response Rate (based on 45 recruited participants) | |
Round 1 | 36 (80.0%) |
Round 2 | 33 (73.3.%) |
Round 3 | 30 (66.6.%) |
*Totals may exceed 100 as participants could select more than one status.
† The number of respondents who completed at least one Delphi round. Three additional people agreed to participate in the study but did not participate in either Delphi round.
‡ The number of respondents who completed at least one Delphi round. Nine additional people agreed to participate in the study but did not participate in any Delphi round.
SD = Standard Deviation.
Healthcare stakeholder respondents were also predominantly (83%) female, and all of these participants had at least some post-secondary education (100% bachelor’s degree or higher) (Table 2). At the time of the study, these participants had worked, on average, 15.8 years in the continuing care sector. Half of these participants worked as decision makers in regional programs. The remaining participants were employed by provincial governments or worked in continuing care as planners or care providers.
Delphi findings
The final Delphi results are shown in Table 3. Care partners and healthcare stakeholders reached consensus (high or very high agreement) on ten and three factors, respectively. All three factors identified by the healthcare stakeholders were also selected by the care partners. These three factors were all at the mezzo-level of the Health-Related Safety Framework [54], and were organized into social networks (having strong relationships and links with family, friends, and the community), the structure of the home and neighborhood (living in a safe home environment, e.g., with enough safety aids and equipment), and medical services (having coordinated care between all types of formal health care providers, e.g., physicians, home care workers, social workers) (Fig 1).
Table 3. Final consensus results by factor and participant group.
Delphi Factor | Care Partners | Healthcare Stakeholders | ||||
---|---|---|---|---|---|---|
% of scores ≥ 8 | IQR† | Consensus Level | % of scores ≥ 8 | IQR† | Consensus Level | |
Micro—Biological | ||||||
Keeping physically active | 70.8% | 3 | Moderate | 76.7% | 1 | Moderate |
Being continent (with or without the use of continence aids) | 75.0% | 0.3 | Moderate | 16.7% | 1 | Low |
Micro–Psychological | ||||||
Not having significant behavioural or mental health disorders | 79.2% | 1.5 | Moderate | 73.3% | 1 | Moderate |
Thinking of oneself as healthy | 54.2% | 1 | Low | 6.7% | 1 | Low |
Maintaining a positive attitude, having a high self-esteem and/or sense of personal identity | 75.0% | 1.8 | Moderate | 23.3% | 1 | Low |
Keeping mentally active | 92.0% | 2 | High | 46.7% | 1 | Low |
Micro—Other | ||||||
Being someone who prepares and plans for the future (e.g., participates in health promotion activities, plans financially for the future, develops new skills) | 75.0% | 0.3 | Moderate | 20.0% | 1 | Low |
Having enough money to afford to stay successfully in the community | 84.0% | 2 | High | 70.0% | 1 | Moderate |
Mezzo–Social Network | ||||||
Having strong relationships and links with family, friends, and the community | 88.0% | 2 | High | 90.9% | 1 | High |
Mezzo–Home and Neighbourhood Structure | ||||||
Living in a safe home environment (e.g., with enough safety aids and equipment) | 84.0% | 2 | High | 86.7% | 0 | Very High |
Having a home layout that is appropriate (e.g., the absence of stairs) | 79.2% | 1 | Moderate | 53.3% | 1 | Low |
Mezzo–Social Services | ||||||
Having accessible and affordable community-based services (e.g., adult education, recreation and support programs) | 70.8% | 2 | Moderate | 13.3% | 1 | Low |
Having a resource (e.g., information call centre) that helps people make informed choices about health care services that are available to them | 45.8% | 1.3 | Low | 20.0% | 1 | Low |
Having public transportation that is affordable, reliable and accessible | 66.7% | 3 | Moderate | 20.0% | 0 | Low |
Having formal healthcare providers (e.g., physicians, home care workers) who are aware of community-based services | 83.3% | 1.5 | High | 76.7% | 0 | Moderate |
Having training & education programs for informal caregivers | 58.3% | 1.5 | Low | 13.3% | 0 | Low |
Having programs that help people to cope with mental health challenges (e.g., anxiety, depression, loneliness)* | 91.7% | 2 | High | 56.7% | 1 | Low |
Having programs that provide support to complete household chores (e.g., shoveling, mowing grass, completing minor household repairs) and other daily tasks (e.g., banking, grocery shopping)* | 75.0% | 1.3 | Moderate | 60.0% | 1 | Moderate |
Mezzo–Medical Services | ||||||
Having coordinated care between all types of formal health care providers (e.g., physicians, home care workers, social workers). | 95.8% | 0.5 | High | 80.6% | 2 | High |
Having physicians who provide house-calls & home visits | 58.3% | 1 | Low | 10.0% | 1 | Low |
Having medical professionals (e.g., nurse practitioners, pharmacists) who regularly check the # and type of medications people are taking | 79.2% | 2 | Moderate | 23.3% | 0 | Low |
Having good communication between informal & formal caregivers | 75.0% | 1.3 | Moderate | 76.7% | 0 | Moderate |
Ensuring that people have adequate access to important allied and medical services (e.g., glasses, dental care, affordable medications, physiotherapy)* | 79.2% | 1.5 | Moderate | 56.7% | 1 | Low |
Macro–Policy and Societal | ||||||
Having access to affordable housing | 91.7% | 2 | High | 63.3% | 1 | Moderate |
Having policies that allow people to reside in the community with an acceptable level of risk | 37.5% | 2.3 | Low | 66.7% | 1 | Moderate |
Having access to funds that help people purchase assistive technology (e.g., motorized wheelchairs) and/or to modify their home (e.g., put in a wheelchair ramp). | 100.0% | 1.5 | High | 13.3% | 0 | Low |
Ensuring that community-based alternatives to nursing home use (e.g., supportive housing in Manitoba, lodge and supportive living in Alberta) are affordable* | 83.3% | 2 | High | 76.7% | 0 | Moderate |
† IQR–Interquartile Range is the difference between the 75th and 25th quartile of rating.
* Additional Factor added based on participant feedback after Delphi Round 1.
Note: Bolded results identify factors that both participant groups reached consensus on.
Care partners reached consensus on an additional 7 factors at the micro- (e.g., having enough money to afford to stay successfully in the community), mezzo- (e.g., having programs that help people to cope with mental health challenges such as anxiety, depression and loneliness), and macro-levels (e.g., ensuring that community-based alternatives to nursing home use are affordable) (see Table 3 and Fig 1). The complete results of each Delphi round are provided in S1 and S2 Tables, for care partners and healthcare stakeholders, respectively.
Discussion
This study compares and contrasts how care partners and healthcare stakeholders prioritize the community-based supports, services, and personal strategies required to help older adults successfully age in place. Out of 27 potential factors, each participant group independently identified the same three factors (keeping one’s home safe, maintaining strong inter-personal relationships, and coordinating care across formal providers) that they felt were very important to help older adults remain successfully in their community. While healthcare stakeholders did not reach consensus on other factors, care partners agreed that seven additional factors are also very important to consider. These findings help to establish community-based AIP priority areas and future research directions, guided in part by different participant perspectives.
Priority areas identified by both participant groups
Care partners and healthcare stakeholders in this study agreed that having a safe home environment, maintaining strong social networks with others, and having coordinated healthcare services are very important to help older adults successfully age in place. While researchers have used qualitative approaches [43, 45, 62] and statistical models [44, 63, 64] to identify pertinent AIP factors, to the best of our knowledge this study is the first to identify highly important community-based AIP factors prioritized across participant groups. Our results align with the findings from a UK-based scoping review that defines the kinds of care and support (e.g., social relationships and activities, help related to mobility) that older adults need [65]. These identified priorities are also in keeping with others who have reported that successful AIP relies on adequate home safety (e.g., ensuring that people have the appropriate grab rails, nonslip surfaces and ramps in place) [66], and that people’s decisions to remain in their community are based in part on their ability to effectively adapt their home [67]. Maintaining strong social networks is thought to be essential for successful AIP [68], and alternatively loneliness has been identified as an independent predictor of nursing home admission [69, 70]. Smaller scale interventions addressing these factors have been implemented, including environmental audits to help to improve home safety [71], activity and discussion groups to enhance social connection [72], and navigators to help older adults with chronic conditions transition through the healthcare system [73]. Findings from these smaller-scale interventions can help to guide the implementation and evaluation of larger scale AIP innovations including their sustainability and scale.
Differences in expert group perspectives
In addition to the aforementioned three priority areas, care partners selected seven additional factors that they felt were very important to consider. These additional factors are dispersed across the micro- (keeping mentally active, having enough money to stay in the community), mezzo- (having mental health programs, ensuring providers are aware of community-based care options), and macro- (having access to affordable housing, having funds to purchase assistive technology, having appropriate community-based alternatives to nursing homes) levels of the Health-Related Safety Framework [54]. These additional factors highlight the importance of having the finances to afford the supports and services needed to stay in the community, of ensuring that everyone has access to and is aware of these community-based programs, and the need for more mental health services. Overall, from the perspective and lived experience of care partners, successful AIP likely requires a larger number of diverse strategies to meet the varied needs of community-living older adults.
Other researchers have reported that different participant groups often have different perspectives about healthcare reform [25, 26, 36, 74, 75]. When investigating strategies to improve cancer care services in Greece, Efstathiou, Coll, Ameen and Daly (2011) reported that providers prioritized ways to better coordinate patient services, while healthcare users focused on treatments that would increase chances of survival [36]. Similarly, when investigating mental health research priorities, Owens, Ley and Aitken (2008) reported that clinicians and managers tended to prioritize research that focused on the provision of physical healthcare, while care partners and service users emphasized research that would promote independence, self-esteem and recovery [75].
Examining various perspectives and the potential reasons for their similarities and differences has value, given research showing that collaborative planning across stakeholder groups encourages different ways of thinking, greater reflexivity, and creates innovations that tend to have greater impact when implemented [27, 28, 76]. In the present study, healthcare stakeholders may have selected factors based on their scope of professional experience (e.g., selecting mezzo-level factors like coordinating formal healthcare, and arranging for safety aids and equipment). Alternatively, healthcare stakeholders in our study worked across the care continuum as policy makers, regional planners and providers, and these diverse perspectives may have limited their consensus making capacity. Conversely, care partners may have had more direct lived experiences and hence a broader understanding of the multidimensional nature of AIP, which influenced their selection of factors at the micro, mezzo, and macro-levels of the Health-Related Safety Framework [54]. Notwithstanding these potential explanations, the present study emphasizes the importance of engaging with ‘end-users’ when developing AIP research and care reform priorities, as one means to more effectively advance this agenda.
Future research directions
Two sequential research directions are proposed. First, priorities identified in the present research are based on the views of experts from two Canadian healthcare regions. While our study findings have AIP reform implications for these local regions, further research is needed to define the extent to which they can be generalized to other jurisdictions. While there is some evidence to support the generalized nature of our study results (e.g., UK-based research identifies similar supports needed to age in place) [65], additional and ongoing research in this area is required.
Second, research is needed to examine the extent to which these key supports and services are provided successfully and equitably to various groups of community-dwelling older adults. Since Canada is not alone in its desire to enhance AIP, this analysis should ideally occur using an international comparative lens, in particular engaging with Denmark and Norway that are known to have well-developed home and community-based care programs [5]. The lessons learned from these comparisons can help to guide the development, feasibility testing, and eventual larger-scale implementation of innovations designed to better help older adults successfully age in place.
Limitations
Strengths of this research include our rigorous use of the Delphi method, and our ability to create comparative results across participant groups. These strengths are offset by three potential limitations. First, as previously mentioned, our results are based on expert opinion from two Canadian regions, and generalizations to other national or international jurisdictions, may be limited. Second, while participants were asked to rank the importance of each factor individually, it is likely that multiple factors interact to affect one’s ability to AIP. We also did not ask participants to identity which of the listed supports and services were already available; it is feasible that participants, purposefully or unconsciously, rated factors based on perceived importance and availability. Third, we did not conduct an exhaustive literature review to identify all potential AIP supports, which may have influenced our study results. We minimized this third limitation by asking participants to provide additional factors during the first survey round.
Conclusions
Healthcare stakeholders and care partners agreed that having a safe home environment, maintaining strong social networks with others, and having coordinated healthcare services are very important to help older adults successfully age in place. Care partners also reported that a larger and more diverse range of community-based factors are required to meet the varied needs of community-living older adults. These findings can help to prioritize community-based AIP reform initiatives. Future research should replicate these findings in other jurisdictions, examine the extent to which priority supports and services are available and accessible, and develop sustainable solutions to enhance their effectiveness.
Supporting information
Acknowledgments
We would like to acknowledge the contributions made by the following healthcare planners (Kimberly Weihs, Hana Forbes, Gina Trinidad, Douglas Faulder, Carol Anderson, Carmen Grabusic and Corinne Schalm) and community advisors (Connie Newman, Carol Draper, Louise Hutton, Lynne Mansell, Ingrid Crowther and Grant Geldart) who constitute our research team. These individuals contributed significantly to the manuscript by helping to refine the survey factors and actual questionnaire, and were instrumental in helping to recruit study participants. We would also like to thank Manitoba’s and Alberta’s SPOR Primary and Integrated Healthcare Innovation Networks for their help in recruiting participants.
Data Availability
All relevant data are within the manuscript and its Supporting Information files.
Funding Statement
Funding to conduct this research was provided the Canadian Institutes of Health Research (https://cihr-irsc.gc.ca/e/193.html), application number 402869; MD as Nominated PI. Partial matched funding was provided by Research Manitoba (https://researchmanitoba.ca) and Alberta Health (https://www.alberta.ca/health.aspx). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Sixsmith A, Sixsmith J. Ageing in place in the United Kingdom. Ageing Int. 2008;32(3):219–35. [Google Scholar]
- 2.World Health Organization. World report on ageing and health. Geneva, Switzerland; 2015.
- 3.Federal/ Provincial/ Territorial Ministers responsible for Seniors. Core Community Supports to Age in Community. Ottawa, ON; 2019.
- 4.Sinha, S. Dunning, J. Wong, I. Nici, M. NS. Enabling the future provision of long-term care in Canada. Toronto, ON; 2019.
- 5.Spasova, S. Baeten, R. Coster, S. Ghailani, D. Pena-Casas, R. Vanhercke B. Challenges in long-term care in Europe: A study of national policies. Brussels; 2018.
- 6.Thach, NT. Wiener J. An overview of long-term services and supports and Medicaid: final report. Washington, DC; 2018.
- 7.Ontario Association of Community Care Access Centres. Making way for change: Transforming home and community care for Ontarians. 2014; Available from: http://healthcareathome.ca/southwest/en/news/Documents/OACCAC-Whitepaper-FINAL.pdf
- 8.Cohen MBHC and C. Caring for BC’s aging population: Improving health care for all [Internet]. Vol. 159, Canadian Centre for Policy Alternatives BC Office. 2012. Available from: https://www.policyalternatives.ca/sites/default/files/uploads/publications/BCOffice/2012/07/CCPABC-Caring-BC-Aging-Pop.pdf
- 9.European Commission. The 2018 ageing report: Economic and budgetary projections for the 28 EU member states (2016–2070). Luxembourg; 2018.
- 10.MacDonald, B-J., Wolfson, M., Hirdes J. The future cost of long-term care in Canada. Toronto, ON; 2019.
- 11.Robison JT. Moen P. A life-course perspective on housing expectations and shifts in late midlife. Res Aging. 2000;22(5):499–532. [Google Scholar]
- 12.Leamy M. Miller V. Bright L. Housing decisions in later life. 1st ed. Clough R, editor. 2004. New York, NY: Palgrave Macmillan UK; [Google Scholar]
- 13.Costa-Font J. Elvira D Mascarilla-Miró O. Ageing in Place? Exploring elderly people’s housing preferences in Spain. Urban Stud. 2009;46(2):295–316. [Google Scholar]
- 14.Muramatsu N, Yin H, Campbell RT, Hoyem RL, Jacob MA, Ross CO. Risk of nursing home admission among older Americans: Does states’ spending on home- and community-based services matter? Journals Gerontol—Ser B Psychol Sci Soc Sci. 2007;62(3):169–78. doi: 10.1093/geronb/62.3.s169 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Luker JA, Worley A, Stanley M, Uy J, Watt AM, Hillier SL. The evidence for services to avoid or delay residential aged care admission: A systematic review. BMC Geriatr. 2019;19(1):1–20. doi: 10.1186/s12877-018-1019-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Dawson A, Bowes A, Kelly F, Velzke K, Ward R. Evidence of what works to support and sustain care at home for people with dementia: A literature review with a systematic approach. BMC Geriatr. 2015;15(1). doi: 10.1186/s12877-015-0053-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Duan-Porter W, Ullman K, Rosebush C, McKenzie L, Ensrud KE, Ratner E, et al. Interventions to prevent or delay long-term nursing home placement for adults with impairments—A systematic review of reviews. J Gen Intern Med. 2020;35(7):2118–29. doi: 10.1007/s11606-019-05568-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Beswick AD, Rees K, Dieppe P, Ayis S, Gooberman-Hill R, Horwood J, et al. Complex interventions to improve physical function and maintain independent living in elderly people: a systematic review and meta-analysis. Lancet. 2008;371(9614):725–35. doi: 10.1016/S0140-6736(08)60342-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Deaton A, Cartwright N. Understanding and misunderstanding randomized controlled trials. Soc Sci Med. 2018;210(October 2017):2–21. doi: 10.1016/j.socscimed.2017.12.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Black K, Dobbs D, Young TL. Aging in community: mobilizing a new paradigm of older adults as a core social resource. J ApplGerontol. 2015;34(2):219–43. doi: 10.1177/0733464812463984 [DOI] [PubMed] [Google Scholar]
- 21.Wiles JL, Leibing A, Guberman N, Reeve J, Allen RES. The meaning of “aging in place” to older people. Gerontologist. 2012;52(3):357–66. doi: 10.1093/geront/gnr098 [DOI] [PubMed] [Google Scholar]
- 22.Weeks L. LeBlanc K. Housing concerns of vulnerable older Canadians. Can J Aging. 2010;29(3):333–47. doi: 10.1017/S0714980810000310 [DOI] [PubMed] [Google Scholar]
- 23.Torres S. Cao X. Improving care for elders who prefer informal spaces to age-separated institutions and health care settings. Innov Aging. 2019;3(3). doi: 10.1093/geroni/igz019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Williams P. Peckham A. Watkins J. Warrick N. Tam T Rudoler D. Spalding K. Caring for caregivers: facing up to tough challenges. Healthc Q. 2014;17(3):20 = 23. doi: 10.12927/hcq.2014.24015 [DOI] [PubMed] [Google Scholar]
- 25.Srivarathan A, Jensen AN, Kristiansen M. Community-based interventions to enhance healthy aging in disadvantaged areas: Perceptions of older adults and health care professionals. BMC Health Serv Res. 2019;19(1):1–9. doi: 10.1186/s12913-018-3827-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Levine C. Family caregivers, health care professionals, and policy makers: The diverse cultures of long-term care. J Soc Work Long Term Care. 2003;2(1–2):111–23. [Google Scholar]
- 27.Sibbald SL, Kang H, Graham ID. Collaborative health research partnerships: A survey of researcher and knowledge-user attitudes and perceptions. Heal Res Policy Syst. 2019;17(1):1–10. doi: 10.1186/s12961-019-0485-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Green BN, Johnson CD. Interprofessional collaboration in research, education, and clinical practice: working together for a better future. J Chiropr Educ. 2015;29(1):1–10. doi: 10.7899/JCE-14-36 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Trevelyan EG, Robinson N. Delphi methodology in health research: How to do it? Eur J Integr Med. 2015;7(4):423–8. [Google Scholar]
- 30.Bond KS, Jorm AF, Kitchener BA, Kelly CM, Chalmers KJ. Development of guidelines for family and non-professional helpers on assisting an older person who is developing cognitive impairment or has dementia: a Delphi expert consensus study. BMC Geriatr. 2016. Jul;16(1):129. doi: 10.1186/s12877-016-0305-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Doran D.M., Baker G.R., Szabo C., Mcshane J., Carryer J. Identification of serious and reportable events in home care: A delphi survey to develop consensus. Int J Qual Heal Care. 2014;26(2):136–43. doi: 10.1093/intqhc/mzu008 [DOI] [PubMed] [Google Scholar]
- 32.Lee I, Wang HH. Preliminary development of humanistic care indicators for residents in nursing homes: A Delphi technique. Asian Nurs Res (Korean Soc Nurs Sci) [Internet]. 2014;8(1):75–81. Available from: doi: 10.1016/j.anr.2014.03.001 [DOI] [PubMed] [Google Scholar]
- 33.Saliba D., Solomon D., Rubenstein L., Young R., Schnelle J., Roth C., Wenger N. Quality indicators for the management of medical conditions in nursing home residents. J Am Med Dir Assoc. 2005;6(3 SUPPL.):S35–48. doi: 10.1016/j.jamda.2005.03.022 [DOI] [PubMed] [Google Scholar]
- 34.Estabrooks CA, Knopp-Sihota JA, Norton PG. Practice sensitive quality indicators in RAI-MDS 2.0 nursing home data. BMC Res Notes. 2013;6:460. doi: 10.1186/1756-0500-6-460 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Temkin-Greener H, Ladwig S, Caprio T, Norton S, Quill T, Olsan T, et al. Developing palliative care practice guidelines and standards for nursing home-based palliative care teams: A delphi study. J Am Med Dir Assoc. 2015;16(1):86.e1–86.e7. doi: 10.1016/j.jamda.2014.10.013 [DOI] [PubMed] [Google Scholar]
- 36.Efstathiou N, Coll AM, Ameen J, Daly W. Do Greek healthcare users and healthcare providers share cancer care priorities? Analysing the results from two Delphi studies. Eur J Cancer Care (Engl). 2011;20(2):179–86. doi: 10.1111/j.1365-2354.2009.01176.x [DOI] [PubMed] [Google Scholar]
- 37.Canadian Institute for Health Information (CIHI). Seniors in transition: Exploring pathways across the care continuum [Internet]. Ottawa, ON; 2017. Available from: https://www.cihi.ca/sites/default/files/document/seniors-in-transition-report-2017-en.pdf
- 38.Fancey P, Keefe J. Home to nursing home : Understanding factors that impact the path seniors take. Halifax; 2014. [Google Scholar]
- 39.Scharlach AE, Graham CL, Berridge C. An integrated model of co-ordinated community-based care. Gerontologist. 2015;55(4):677–87. doi: 10.1093/geront/gnu075 [DOI] [PubMed] [Google Scholar]
- 40.Summer L. Strategies to keep consumers needing Long-Term Care in the Community and Out of Nursing Facilities. 2005. [Google Scholar]
- 41.Friedman S., Steinwachs D., Rathouz P., Burton L., Mukamel D. Characteristics predicting nursing home admission in the program of all-inclusive care for elderly people. Gerontologist. 2005;45(2):157–66. doi: 10.1093/geront/45.2.157 [DOI] [PubMed] [Google Scholar]
- 42.Luppa M, Luck T, Weyerer S, König HH, Brähler E, Riedel-Heller SG. Prediction of institutionalization in the elderly. A systematic review. Age Ageing. 2009;39(1):31–8. doi: 10.1093/ageing/afp202 [DOI] [PubMed] [Google Scholar]
- 43.Grimmer K, Kay D, Foot J, Pastakia K. Consumer views about aging-in-place. Clin Interv Aging. 2015;10:1803–11. doi: 10.2147/CIA.S90672 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Cao MJ, Guo XL, Yu H, Chen LY, Mcdonald TA. Chinese community-dwelling elders’ needs: Promoting ageing in place. Int Nurs Rev. 2014;61(3):327–35. doi: 10.1111/inr.12119 [DOI] [PubMed] [Google Scholar]
- 45.Brown JB, McWilliam CL, Mai V. Barriers and facilitators to seniors’ independence: Perceptions of seniors, caregivers, and health care providers. Can Fam Physician. 1997;43(MAR.):469–75. [PMC free article] [PubMed] [Google Scholar]
- 46.Government of Canada. Canadian Institutes of Health Research [Internet]. Available from: https://cihr-irsc.gc.ca/e/193.html
- 47.Tiedemann M. The Canada health act: An overview. Library of Parliament Background Papers, Publication No. 2019-54-E. Ottawa, Canada; 2019.
- 48.Statistics Canada. Census Profile, 2016 Census [Internet]. 2019 [cited 2021 May 21]. Available from: http://www12.statcan.gc.ca/census-recensement/2016/dp-pd/prof/index.cfm?Lang=E&TABID=1
- 49.Statistics Canada. Time spent providing care to a family member or friend with a long-term illness, disability or aging needs by sex and age group [Internet]. 2014 [cited 2021 May 21]. Available from: 10.25318/4410000601-eng [DOI]
- 50.Alberta Health and Wellness. Continuing Care Strategy. Aging in the Right Place. 2008;1–24. Available from: https://open.alberta.ca/dataset/4170b43f-0e47-4ace-b41f-71dbb67615dd/resource/065fa680-f81b-4ba6-bfeb-a666eb9c8b6c/download/4326528-2008-continuing-care-strategy-aging-right-place-2008-12.pdf
- 51.Manitoba H. Advancing Continuing Care: A Blueprint to Support System Change. http://www.gov.mb.ca/health/documents/blueprint.pdf. 2014;
- 52.Sivananthan SN, Doupe M, McGregor MJ. Exploring the ecology of Canada’s publicly funded residential long-term care bed supply. Can J Aging. 2014;34(1):60–74. doi: 10.1017/S071498081400052X [DOI] [PubMed] [Google Scholar]
- 53.Alberta Health Services. Designated Supportive Living [Internet]. [cited 2021 May 13]. Available from: https://www.albertahealthservices.ca/cc/Page15490.aspx
- 54.Lau DT, Scandrett KG, Jarzebowski M, Holman K, Emanuel L. Health-related safety: A framework to address barriers to aging in place. Gerontologist. 2007;47(6):830–7. doi: 10.1093/geront/47.6.830 [DOI] [PubMed] [Google Scholar]
- 55.Paganini-Hill A. Aging in place in a retirement community: 90+ year olds. J Hous Elderly. 2013;27(1–2):191–205. doi: 10.1080/02763893.2012.754822 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Lette M, Ambugo EA, Hagen TP, Nijpels G, Baan CA, De Bruin SR. Addressing safety risks in integrated care programs for older people living at home: A scoping review. BMC Geriatr. 2020;20(1):1–13. doi: 10.1186/s12877-020-1482-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Manitoba SPOR PIHCI Network. Manitoba SPOR PIHCI Network (MPN) [Internet]. 2020. [cited 2020 Sep 23]. Available from: https://manitoba-pihcinet.com
- 58.PIHCIN AS. Alberta SPOR PIHCIN [Internet]. [cited 2020 Sep 23]. Available from: http://alberta-spor-pihcin.com
- 59.Outsidesoft Solutions Inc. SimpleSurvey [Internet]. 2020 [cited 2020 Sep 23]. Available from: https://simplesurvey.com
- 60.Van Der Steen JT, Radbruch L, Hertogh CM, De Boer ME, Hughes JC, Larkin P, et al. White paper defining optimal palliative care in older people with dementia: A Delphi study and recommendations from the European Association for Palliative Care. Palliat Med. 2014;28(3):197–209. doi: 10.1177/0269216313493685 [DOI] [PubMed] [Google Scholar]
- 61.Jorm AF. Using the Delphi expert consensus method in mental health research. Aust N Z J Psychiatry. 2015;49(10):887–97. doi: 10.1177/0004867415600891 [DOI] [PubMed] [Google Scholar]
- 62.Ball MM, Perkins MM, Whittington FJ, Connell BR, Hollingsworth C, King S V., et al. Managing decline in assisted living: The key to aging in place. Journals Gerontol—Ser B Psychol Sci Soc Sci. 2004;59(4):202–12. doi: 10.1093/geronb/59.4.s202 [DOI] [PubMed] [Google Scholar]
- 63.Moon H, Rote S, Haley WE. Factors that contribute to remaining in the community among older adults. Aging Ment Heal. 2018;22(11):1502–9. doi: 10.1080/13607863.2017.1363869 [DOI] [PubMed] [Google Scholar]
- 64.Ahn M, Kwon HJ, Kang J. Supporting Aging-in-Place Well: Findings From a Cluster Analysis of the Reasons for Aging-in-Place and Perceptions of Well-Being. J Appl Gerontol. 2020;39(1):3–15. doi: 10.1177/0733464817748779 [DOI] [PubMed] [Google Scholar]
- 65.Abdi S, Spann A, Borilovic J, de Witte L, Hawley M. Understanding the care and support needs of older people: a scoping review and categorisation using the WHO international classification of functioning, disability and health framework (ICF). BMC Geriatr. 2020;20(1):23. doi: 10.1186/s12877-019-1279-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Hwang E, Cummings L, Sixsmith A, Sixsmith J. Impacts of home modifications on aging-in-place. J Hous Elderly. 2011;25(3):246–57. [Google Scholar]
- 67.Roy N, Dubé R, Després C, Freitas A, Légaré F. Choosing between staying at home or moving: A systematic review of factors influencing housing decisions among frail older adults. Vol. 13, PLoS ONE. 2018. 1–32 p. doi: 10.1371/journal.pone.0189266 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Bacsu J, Jeffery B, Abonyi S, Johnson S, Novik N, Martz D, et al. Healthy aging in place: Perceptions of rural older adults. Educ Gerontol. 2014;40(5):327–37. [Google Scholar]
- 69.Hanratty B, Stow D, Moore DC, Valtorta NK, Matthews F. Loneliness as a risk factor for care home admission in the english longitudinal study of ageing. Age Ageing. 2018;47(6):896–900. doi: 10.1093/ageing/afy095 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Jamieson H, Abey-Nesbit R, Bergler U, Keeling S, Schluter PJ, Scrase R, et al. Evaluating the influence of social factors on aged residential care admission in a national home care assessment database of older adults. J Am Med Dir Assoc. 2019;20(11):1419–24. Available from: doi: 10.1016/j.jamda.2019.02.005 [DOI] [PubMed] [Google Scholar]
- 71.Currin ML, Comans TA, Heathcote K, Haines TP. Staying Safe at Home. Home environmental audit recommendations and uptake in an older population at high risk of falling. Australas J Ageing. 2012;31(2):90–5. doi: 10.1111/j.1741-6612.2011.00545.x [DOI] [PubMed] [Google Scholar]
- 72.O’Rourke HM, Collins L, Sidani S. Interventions to address social connectedness and loneliness for older adults: A scoping review. BMC Geriatr. 2018;18(1):1–13. doi: 10.1186/s12877-017-0691-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Manderson B, McMurray J, Piraino E, Stolee P. Navigation roles support chronically ill older adults through healthcare transitions: A systematic review of the literature. Heal Soc Care Community. 2012;20(2):113–27. doi: 10.1111/j.1365-2524.2011.01032.x [DOI] [PubMed] [Google Scholar]
- 74.Luck J, Peabody JW, DeMaria LM, Alvarado CS, Menon R. Patient and provider perspectives on quality and health system effectiveness in a transition economy: Evidence from Ukraine. Soc Sci Med. 2014;114:57–65. doi: 10.1016/j.socscimed.2014.05.034 [DOI] [PubMed] [Google Scholar]
- 75.Owens C, Ley A, Aitken P. Do different stakeholder groups share mental health research priorities? A four-arm Delphi study. Heal Expect. 2008;11(4):418–31. doi: 10.1111/j.1369-7625.2008.00492.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Hesse-Biber S. Doing Interdisciplinary Mixed Methods Health Care Research. Qual Health Res. 2016;26(5):649–58. doi: 10.1177/1049732316634304 [DOI] [PubMed] [Google Scholar]