Abstract
Background: To date, no instrument in Portugal has evaluated the attitudes of the population about advance care directives. This paper describes the development and testing of the General Public’s Attitudes Toward Advance Care Directives (GPATACD) Scale.
Design and Methods: Methodological study. The development of the instrument was based on a literature review, updated in 2018. Face and content validity were verified by an expert panel and piloted among six participants. Data were collected in an online survey of 1024 Portuguese adults. The obtained data were analyzed using Varimax rotation, while the reliability was evaluated by calculating Cronbach’s alpha.
Results: The scale achieves good Item-Content Validity Index (I-CVI) values, between 0.89 and 1.00, and scale-CVI values of 0.91. A principal component analysis generated four dimensions with 26 items as a final scale, with overall Cronbach’s alpha of 0.848.
Conclusions: The findings demonstrate that the scale is valid and reliable as a vehicle for assessment of the general public’s attitudes toward advance care directives.
Significance for public health.
Public education to disseminate the concept of ACD is needed to raise its awareness. Being asked to complete ACD and receiving information about ACD were found to predict ACD completion.7 What is clear, however, is that passing out information in the form of booklets and asking people if they have ACD is not sufficient to provide the depth of information the population needs to make decisions.33 Nurses are proven patient advocates and have communication skills ideal for ACD education. They encourage people to think unthinkable things, facilitate ACD discussions and reflection upon decisions, and help appoint surrogates. These strategies can be further developed with training programs providing opportunities to practice specific communication skills through role-play with the use of appropriate decision aids. The involvement of health professionals, patients, providers, and community stakeholders might also be required to design an efficient caregiving system for delivering ACD and EOL care.
Key words: Advance care directives, instrument development, reliability, validity, Portugal
Introduction
One of man’s greatest challenges has been to prolong life and postpone the moment of death. Advances in medicine and technology, as well as the entire health-related industry, have greatly contributed to a worldwide increase in average life expectancy.1 This evolution has created a new health paradigm, as well as the need to care for people with chronic illness, situations that are sometimes accompanied by great suffering. Concomitantly, individualism emerges, where a person’s rights and freedoms are recognized in defense of the principle of the user’s self-determination.
Consequently, this brings about a dilemma in the area of health between prolonging life or allowing natural death to occur. If these technological advances have given life many gains over death, it is also no less true that often too much is invested in what cannot be cured.2 End-Of-Life (EOL) has been the subject of great reflection in recent decades, particularly in recent years. The main topics of discussion are a person’s dignity at the time of death and the increasing autonomy in their right to life and death.3
Europe remains in a turmoil regarding euthanasia and medically assisted death. In countries where these practices are not legalized, namely in Portugal, strategies have been created that allow the person to have an EOL with dignity. Examples of these strategies include a palliative care network and advanced care planning.
In Portugal, according to the Basic Law of Palliative Care (Law No. 52/2012 of 5 September), the national palliative care network tries to provide care aimed at improving the quality of life of the sick person and their family members, relieving and preventing suffering in EOL.4 According to Meeussen et al.,5 one of the crucial aspects in EOL care is congruence between the quality of care provided and the patient’s wishes, namely in situations where the person cannot make a decision and his/her preferences are unknown, thereby making it difficult to deliver quality care. One way of managing the future is the Advance Care Directive (ACD), a legal declaration of a person’s will regarding EOL that guarantees compliance with their rights when they are unable to give informed, free and informed consent.6 Decisions taken by the patient imply consent with prior information and clarification, which is of greater relevance before a person becomes incompetent due to illness or age and is unable to consent, dissent or refuse medical treatment or intervention. It attempts to ensure that patients receive the treatment they want, promoting patient-centered care. This greater focus on a patient’s autonomy and right to self-determination was concomitant with a decline in or abandonment of medical paternalism.4
The Portuguese Living Will Law has a triple objective: i) to establish the ACD’s legal regime; ii) to regulate the appointment of the healthcare proxy; and iii) to create the former register of the ACD in the Living Will National Registry (RENTEV).4 According to the Law, any citizen over eighteen years old and duly capable may declare in advance, and in a clear, conscious and informed manner, his or her wishes regarding medical care, by preparing an advance directive. These directives may take the form of a living will and a health care power of attorney.
Some researchers have explored reasons why ACD discussions are not initiated. Early studies showed that lack of knowledge and inaccessibility to ACD documents were the primary reasons.7 Efforts to improve both education and accessibility have failed to increase the number of ACD discussions initiated. Only a few studies have explored the reasons why the general public perceives ACDs as either positive or negative, and the effect those perceptions have on the decision to initiate ACD discussion. In the study conducted by Chung et al.8 about the knowledge, attitudes and preferences of the population of Hong Kong in relation to ACDs, a low percentage of the population reported having heard about them. However, after informing people about ACDs, the majority agreed that they were a good approach to declare their preferences before they became mentally incapable and more than half of the population who participated in the study stated that they would be willing to make an ACD. Age, sex, terminal illness diagnosis and prior knowledge showed a statistically significant correlation with the desire to perform an ACD, while the remaining variables, such as other sociodemographic factors (e.g. education, religion beliefs, marital status, type of housing) and health status, did not show a significant relationship. In another study conducted by Gao et al.9, perceptions about EOL care, and knowledge and realization of ACDs were investigated among Chinese and Americans living in Phoenix. This study revealed the population had scarce awareness and knowledge about ACDs. In contrast, in an Italian nationwide population-based survey, 70.1% of respondents declared they had heard about the law on informed consent and ACDs. Respondents were asked to express their overall opinion on the law’s utility and importance: 88% declared that the law was quite or very important and 76% had a positive attitude toward making/registering advance directives.10
Several studies have also evidenced the positive outcomes and effectiveness of ACDs. Some of the benefits identified included less aggressive medical care11 and better quality of life near death,12 with higher satisfaction and a reduction of psychological distress of both patients and families.13 While an estimated 35% of adults in the US have done an ACD14, in Portugal completion rates are approximately 1%.15 A study performed in 2014, by the Catholic University in partnership with the Palliative Care Association, found that 78% of Portuguese adults did not yet know what a living will is.16 Among the 22% who knew what a living will is, only 50.4% Portuguese knew what to do and where to go in order to execute an ACD, and only 1.4% actually had formally executed one.16 To date, no instrument in Portugal has evaluated the attitudes of the general population about ACDs. The existing instruments have been applied at specific groups of the population, such as health professionals17-19 and students.20 Thus, the aim of our study is to develop and validate a questionnaire that explores the attitudes of the general population toward ACD, so that in future studies it may be used to evaluate public attitudes and experiences about ACD.
Design and Methods
Study design
The study adopted a quantitative approach and consisted of two phases of instrument development21,22, namely: i) construction of the initial instrument using two steps and ii) a psychometric evaluation phase, with one step.
Phase I: Development of a questionnaire
Step 1. To generate an item pool
An inductive approach was applied to generate items, as recommended when there are few available scales.21,22 The researchers developed a questionnaire guided by Colton and Covert’s21 guidelines. A literature search was conducted from March to April 2018, using key words such as “advance care planning”, “advance care directives”, “end-of-life”, “decision making”, in three databases: EBSCOhost, CINAHL, PubMed. Additional searches were also made in Google scholar, in relevant grey literature and by manually studying reference lists of identified articles. The literature search included 19 articles written in English, screened and reviewed by LG and AQ. In the end, eight articles were deemed relevant. Based on evidence and inspired by available instruments,23,24 the authors developed the General Public’s Attitudes Toward Advance Care Directives (GPATACD) scale with 30 items with a 5-point Likert-type scale, where the participants mark their level of agreement between 1 (strongly disagree) and 5 (strongly agree).
The scale measures the extent of one’s positive or negative views about decisions regarding ACD, specifically personal values and wishes related to EOL care, impact of ACD on the individual and family, and perceptions about EOL decision-making.
Several questions were phrased negatively to prevent “response acquiescence”, defined as the tendency to agree rather than disagree. Items 1; 2; 4; 5; 6; 9; 10; 12; 15; 16; 19 and 22 were inverted in the decreasing direction (lower values, more positive attitudes). Aside from the GPATACD scale, the research instrument included questions on basic socio-demographic information, such as age, gender, level of education, and professional status.
Step 2. Face and content validity
Following the literature review, the generated items and scaling responses were tested using a standard pilot study with six individuals considered experts in the health field (1 physician specialized in Public Health and 1 nurse trained in the field of bioethics), in the field of building measurement instruments (2 professors), and two Portuguese language experts. The time taken to complete the questionnaire ranged from 5-10 min. Their participation helped check the facial and content validity,21 contributing to its improvement. The Content Validity Index (CVI) was calculated for all individual items (I-CVI) and the overall scale (S-CVI). Each item was reviewed, and the relevance and appropriateness of each item was discussed. The experts’ evaluation used the 4-point rating scale (1 = not relevant, 2 = somewhat relevant, 3 = quite relevant and 4 = very relevant). Higher score means better items. In two open questions, experts were also asked to suggest revisions and items that should be included. The feedback resulted in minor revisions of eight items (changes in word order and replacement of one word with a more neutral word). For each item, I-CVI was computed as the number of experts giving a rating of three or four, divided by the total number of experts. For example, an item rated three or four by five out of six experts has an I-CVI of 0.80. The I-CVI should be 1.00 in case of five or fewer judges and in case of six or more judges; I-CVI should not be less than 0.78. The S-CVI was computed to ensure content validity of the overall scale. S-CVI (average) focuses on average item quality rather than average performance of the experts. The S-CVI should be at least 0.8 to reflect content validity.25
Phase II: Evaluation of the psychometric properties
Sample and setting
We used convenience and snowballing sampling techniques, with a Portuguese general population aged 18 years or older who answered a questionnaire made available online through social media platforms (Facebook and emails) between March and May 2018. The study was first advertised by the IPLeiria Media and Communication Department using the institutional e-mail contacts of the workers and students and also published on the IPLeiria’s Facebook page. We targeted potential participants by asking those who completed the survey to forward the announcement link to their friends and/or colleagues by e-mail. For practical reasons, the authors also sent the survey by email to their network contacts, mainly health care professionals. The study involved only those participants who had access to the internet.
The necessary sample size to perform factor analysis was calculated based on a rule of thumb of 10 participants per item in the GPATACD.26 Our instrument included 30 items that could be validated, hence the number of participants required was 30*10 = 300.
Data analysis
All analyses were performed using the Statistical Package for Social Sciences version 25.0 (IBM Crop., Armonk, NY, USA). Descriptive statistics was used to summarize the demographic data and responses.
Reliability analysis involved calculating Cronbach’s α to assess the internal consistency of the 30 items measured on a Likert-like scale. Cronbach alpha values greater than 0.9 suggest redundancy of some items, values between 0.70-0.90 imply adequate internal consistency, values between 0.50-0.69 indicate poor internal consistency, and values below 0.50 indicate unacceptable internal consistency. Corrected item-total correlations were then used to identify items that did not agree well with other items in the questionnaire. Corrected item-total correlation values should exceed 0.2 to be considered as acceptable.27
Exploratory factor analysis was used as a data reduction technique, to investigate the dimensionality of the GPATACD scale. In the factor analysis, we noted the number of factors and factor loadings, the inter-item correlations and Keiser-Meir-Olkin (KMO) values.
Results
Demographic characteristics of sample
The sample included 1024 individuals who agreed to participate in the study and who met the previously established criteria. Initially, 1030 people had access to the questionnaire through social networks, of which only 0.58% (n=6) refused to participate in the study.
The mean age of the sample was 40.28 (±11.41) years (range 18–78 years) corresponding to an adult population of working age (Table 1). Most of the participants were female (79.69%) and had finished higher education (79.89%), and 61.62% were married or living together. Of all participants, 71.09% reported they had health care work experience.
Content validity
The I-CVI for all items ranged from 0.89 to 1. The overall SCVI for the 30-item scale was 0.91, which indicated high content validity of the items for the construct of attitudes toward ACD.
Reliability
In order to assess the reliability of this scale, Cronbach’s Alpha Coefficient was calculated for all the instrument’s items, as well as the scale after excluding each item individually. After successive rounds, items 3, 21, 23 and 24 were removed (corrected item-total correlations were low) as they impaired the instrument’s internal consistency, leaving the instrument with a total of 26 items. Table 2 shows the total Cronbach’s Alpha of 0.848, where no item impairs this value. The validity of each item on the scale can be attested through its correlation with the total scale. According to Streiner and Norman,22 this is a good indicator of the total instrument, since almost all items showed values greater than 0.2. Items 5 and 6 revealed lower correlation values, respectively 0.193 and 0.168, but these items were retained as they were deemed to represent theoretically important aspects of the construct (attitudes toward ACD).22
Validity
Regarding the construct validity, we used factor analysis (analysis of the main components of correlations between variables), as it allows us to synthesize relationships between items of an instrument into factors.27 Specifically, to inspect the validity of the GPATACD scale, we conducted exploratory factor analysis using the condensation method in main components and according to the Kaiser criterion (latent roots equal to or greater than one), thus obtaining a scale composed of four factors: F1 - Autonomy and dignity of the person at the EOL (7 items); F2 - EOL decisionmaking (8 items); F3 - Application of ACD (6 items); F4 - Perception of the EOL (5 items).
Table 1.
Characteristics | N (%) |
---|---|
Gender | |
Male | 208 (20.31) |
Female | 816 (79.69) |
Other | 0 |
Age (mean/SD) | M=40.28; SD=11.41 |
Level of Education | |
Elementary education | 36 (3.52) |
Secondary education | 170 (16.60) |
Higher education | 818 (79.89) |
Marital status | |
Married/ living together | 631 (61.62) |
Single | 294 (28.71) |
Divorced/separated/widowed | 99 (9.67) |
Professional status | |
Health care professionals | 728 (71.09) |
Non-health care professionals | 296 (28.91) |
These four factors, after using the Varimax rotation method, explained 50.06% of the total variance (Table 3). For the organization of each item in these factors, we considered three criteria: greater saturation between four factors; saturation between the four factors with a minimum difference of 0.100; and theoretical interpretability of each item. The data indicated a Bartlett’s Sphericity Test value of 8683.057 (p<0.0001), with a Kaiser-Mayer-Olkin value (0.856) close to one. These values represent a satisfactory factor analysis to obtain a scale composed of 26 items and divided into four factors.
Publics’ Attitudes toward ACD
To examine the general public’s attitudes toward ACD the total scores on the GPATACD were analyzed using mean scores and standard deviation (see Table 2). A global average of 1.922 ± 0.440 was obtained (values closer to one are more positive and closer to five are more negative), that is, the majority of participants expressed their level of agreement in the positive sense of attitudes toward ACD.
Discussion
The aim of the study was to develop a scale to measure the general public’s attitudes toward ACD and evaluate its psychometric properties. The analyses show that the GPATACD scale possesses good psychometric qualities and can contribute to understand how the Portuguese population perceives ACD.
Cronbach’s alpha was used to estimate reliability of the total scale. The overall Cronbach’s alpha of the GPATACD scale was 0.848, considered satisfactory for measuring instruments.28
To enhance the validity of the study, content validity was done to ensure the congruence between the target of the research and the data collection tool.29 The content validity of GPATACD scale was explored based on a literature review and judgments of six experts, resulting in 30 items. A CVI on the relevancy of dimensions to concepts indicated a high degree of agreement among experts, which meets an acceptable CVI of 0.80 or greater.25
Table 2.
Mean | Correlation | Cronbach alpha | |
---|---|---|---|
(SD) | item-total | if item deleted | |
1. The existence of the vital testament is not important.* | 1.56 (0.74) | 0.573 | 0.838 |
2. My opinion should not be respected in the EOL process. * | 1.22 (0.51) | 0.402 | 0.844 |
4. ACD do not reflect the patient's values and preferences when making therapeutic decisions at the EOL.* | 1.88 (0.84) | 0.224 | 0.847 |
5. ACD are a useless tool for healthcare professionals when making decisions about EOL patients.* | 1.76 (0.85) | 0.193 | 0.848 |
6. The health care prosecutor appointed by the patient does not facilitate the professionals' decision making.* | 2.18 (0.83) | 0.168 | 0.849 |
7. Compliance with ACD concerns the physician. | 1.79 (1.03) | 0.384 | 0.843 |
8. ACD are a legal form of euthanasia. | 1.56 (0.96) | 0.401 | 0.842 |
9. It is not important that patients make their vital testament or ACD.* | 1.73 (0.87) | 0.496 | 0.839 |
10. It is not important that all citizens make their vital testament or ACD.* | 1.79 (0.92) | 0.506 | 0.839 |
11. ACD are important only for religious reasons. | 1.33 (0.73) | 0.441 | 0.841 |
12. The legalization of the vital testament did not contribute to human dignity.* | 1.61 (0.83) | 0.484 | 0.840 |
13. Death must be postponed, regardless of the person's condition. | 1.58 (0.95) | 0.517 | 0.838 |
14. EOL care should be provided based on the opinion of the health professional. | 2.54 (1.13) | 0.358 | 0.844 |
15. EOL care should not be provided based on the patient's opinion.* | 2.16 (0.98) | 0.220 | 0.848 |
16. I do not want to be able to have an opinion on the care I can receive in an EOL situation.* | 1.40 (0.64) | 0.555 | 0.839 |
17. EOL care should be provided based on the opinion of the family. | 2.11 (1.01) | 0.403 | 0.842 |
18. My family will make the EOL decisions for me when necessary. | 2.19 (1.14) | 0.399 | 0.842 |
19. I am going to overwhelm my family with my EOL decisions.* | 1.66 (0.93) | 0.252 | 0.847 |
20. My doctor will make the EOL decisions for me when the time comes. | 2.07 (1.11) | 0.409 | 0.842 |
22. The vital testament is only important for elderly and sick people.* | 1.51 (0.78) | 0.381 | 0.843 |
25. I am currently healthy, however there may be a need to consider decisions regarding the final phase of my life. | 2.08 (1.17) | 0.503 | 0.838 |
26. At my current age, there may be a need to consider EOL decisions. | 1.85 (1.04) | 0.566 | 0.836 |
27. I have information on ACD/ vital testament. | 2.83 (1.21) | 0.216 | 0.850 |
28. It is possible to make EOL decisions, even if I cannot imagine myself in such a situation. | 2.26 (1.05) | 0.478 | 0.839 |
29. I do not make a vital testament because the information available is still little. | 2.60 (1.05) | 0.394 | 0.842 |
30. I do not want to think that I will eventually die or become disabled, to the point of not being able to make decisions. | 2.64 (1.22) | 0.370 | 0.844 |
Total | 1.92 (0.44) | - | 0.848 |
EOL, end of life; ACD, advance care directive; *reversed items.
Exploratory Factor Analysis was used to explain the maximum portion of variance in the original variable and drive the minimum number of its components. The assumptions of normality, factorability, and sample size had been tested prior to data analysis, and showed acceptable assumptions for factor analysis. The four-factor structure identified in the factor analysis showed that the GPATACD scale can capture various reactions to ACD, which implies the population has opinions and can assess these issues. Although studies of public awareness about ACD are rare in the empirical literature, our findings indicate such studies are feasible.
According to our results, the participants seemed moderately knowledgeable about EOL issues. Since most participants were HCPs, they tended to rate themselves highly in terms of their knowledge and preparedness to engage with ACD, although this was not unanimous.30 In this regard, Hamilton31 implied that practitioners may be uncomfortable with having ACD conversations for fear that patients could potentially endure undue anguish. Research shows that care providers miss opportunities to start a discussion about advanced care planning in part when they lack skills to initiate a conversation or prefer not to engage in discussions when seriously ill patients are feeling well.32
In contrast, public awareness of the concept of ACD and EOL issues remains insufficient for widespread, effective and appropriate EOL care to be accepted as the norm.33 According to the studies by Andrès-Pretel et al.,34 Chan et al.,7 Aguilar-Sanches et al.,35 most participants have favorable/ positive attitudes toward ACD. Moreover, the public has reported wanting more information about ACD, and discussion around dying should be addressed. Education on EOL care represents the foundation to disseminate knowledge in the general population.
Methodological considerations
The strengths of this study include the large sample size and the use of a culturally sensitive, valid, and reliable questionnaire. The GPATACD scale relies on a robust methodology, integrating empirical findings with perspectives from theory and practice. We believe this combination contributes to the scale’s relevance and usefulness for future studies, which can contribute to understand attitudes and awareness about ACD. A valid self-assessment scale enables studies with larger populations, where various perspectives of ACD can be studied and compared over time. Despite the GPATACD scale’s promising psychometric properties, its overall validity should be interpreted in light of potential methodological weaknesses, including the use of convenience sampling composed mainly of subjects with professional background related to healthcare. We were not able to perform discriminative validity (in a population that is generally unaware of ACD) and convergent validity (as no other ACD have been validated in Portugal).
The scale’s psychometric properties can still be improved, and additional analyses need be conducted, such as a test-retest reliability analysis and a Confirmatory Factor Analysis based on supplementary data to confirm the scale’s factor structure.
Table 3.
Item statement | Factor 1 | Factor 2 | Factor 3 | Factor 4 |
---|---|---|---|---|
1. The existence of the vital testament is not important. | 0.734 | _ | _ | _ |
2. My opinion should not be respected in the EOL process. | 0.515 | _ | _ | _ |
9. It is not important that patients make their vital testament or ACD. | 0.797 | _ | _ | _ |
10. It is not important that all citizens make their vital testament or ACD. | 0.809 | _ | _ | _ |
12. The legalization of the vital testament did not contribute to human dignity. | 0.738 | _ | _ | _ |
16. I do not want to be able to have an opinion on the care I can receive in an EOL situation. | 0.625 | _ | _ | _ |
19. I am going to overwhelm my family with my EOL decisions. | 0.491 | _ | _ | _ |
7. Compliance with ACD concerns the physician. | _ | 0.659 | _ | _ |
8. ACD are a legal form of euthanasia. | _ | 0.515 | _ | _ |
11. ACD are important only for religious reasons. | _ | 0.577 | _ | _ |
13. Death must be postponed, regardless of the person's condition. | _ | 0.585 | _ | _ |
14. EOL care should be provided based on the opinion of the health professional. | _ | 0.602 | _ | _ |
17. EOL care should be provided based on the opinion of the family. | _ | 0.611 | _ | _ |
18. My family will make the EOL decisions for me when necessary. | _ | 0.572 | _ | _ |
20. My doctor will make the EOL decisions for me when the time comes. | _ | 0.657 | _ | _ |
4. ACD do not reflect the patient's values and preferences when making therapeutic decisions at the EOL. | _ | _ | 0.774 | _ |
5. ACD are a useless tool for healthcare professionals when making decisions about EOL patients. | _ | _ | 0.812 | _ |
6. The health care prosecutor appointed by the patient does not facilitate the professionals' decision making. | _ | _ | 0.638 | _ |
15. EOL care should not be provided based on the patient's opinion. | _ | _ | 0.558 | _ |
22. The vital testament is only important for elderly and sick people. | _ | _ | 0.438 | _ |
27. I have information on ACD/ vital testament. | _ | _ | 0.520 | _ |
25. I am currently healthy. however there may be a need to consider decisions regarding the final phase of my life. | _ | _ | _ | 0.587 |
26. At my current age. there may be a need to consider EOL decisions. | _ | _ | _ | 0.643 |
28. It is possible to make EOL decisions, even if I cannot imagine myself in such a situation. | _ | _ | _ | 0.761 |
29. I do not make a vital testament because the information available is still little. | _ | _ | _ | 0.494 |
30. I do not want to think that I will eventually die or become disabled, to the point of not being able to make decisions. | _ | _ | _ | 0.734 |
Eigenvalues | 6.154 | 3.053 | 2.200 | 1.609 |
% of variance (Σ = 50.06%) | 23.67% | 11.74% | 8.46% | 6.19% |
ACD, advance care directive; EOL, end of life.
Comparative research or experimental research designs need to investigate whether family centered, community based, and ethnically appropriate approaches to education result in different levels of ACD completion. Combined with the qualitative data, these approaches would provide the information needed to suggest any need for policy revision. A qualitative research design would be beneficial in exploring those factors related to refusal to complete ACD. As the topic is quite sensitive and people may be hesitant to speak about death, and as their distrust of the system, their religious beliefs and other personal factors may contribute to decision making,36 the qualitative design should plan for approaches to increase trust between researcher and respondent.
Conclusions
The GPATACD was a valid and reliable instrument to assess the general public’s awareness and attitude toward ACD. We intend to apply the GPATACD with a larger cohort in Portugal. This data can provide government stakeholders with the information required to implement campaigns promoting literacy about ACD in Portugal.
Acknowledgements
We acknowledge all the volunteers who participated in the online survey to make this study possible.
Funding Statement
Funding: This work was funded by Portuguese national funds provided by Fundação para a Ciência e Tecnologia (FCT) (UIDB/05704/2020 and UIDP/05704/2020). The funder had no role in the study design, data collection, analysis, and interpretation, presentation of results or decision to submit for publication.
References
- 1.Permanyer I, Scholl N. Global trends in lifespan inequality: 1950-2015. PLoS One 2019;14:e0215742. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Fan SY, Wang YW, Lin IM. Allow natural death versus do-notresuscitate: titles, information contents, outcomes, and the considerations related to do-not-resuscitate decision. BMC Palliat Care 2018;17:114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Hall A, Rowland C, Grande G. How should end-of-life advance care planning discussions be implemented according to patients and informal carers? A qualitative review of reviews. J Pain Symptom Manage 2019;58:311-35. [DOI] [PubMed] [Google Scholar]
- 4.Nunes R. [Diretivas antecipadas de vontade].[Thesis in Portuguese]. Brasília, DF: CFM/Faculdade de Medicina da Universidade do Porto; 2016. [Google Scholar]
- 5.Meeussen K, Van den Block L, Echteld M, et al. Advance care planning in Belgium and The Netherlands: a nationwide retrospective study via sentinel networks of general practitioners. J Pain Symptom Manage 2011;42:565-77. [DOI] [PubMed] [Google Scholar]
- 6.Mei Ching L, Hinderer KA, Kehl KA. A systematic review of advance directives and advance care planning in Chinese people from Eastern and Western cultures. J Hosp Palliat Nurs 2014;16:75-85. [Google Scholar]
- 7.Chan CWH, Wong MMH, Choi KC, et al. Prevalence, perception, and predictors of advance directives among Hong Kong Chinese: A population-based survey. Int J Environ Res Public Health 2019;16:365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Chung RY, Wong EL, Kiang N, et al. Knowledge, attitudes, and preferences of advance decisions, end-of-life care, and place of care and death in Hong Kong. A population-based telephone survey of 1067 adults. J Am Med Dir Assoc 2017;18:367.e19-27. [DOI] [PubMed] [Google Scholar]
- 9.Gao X, Sun F, Ko E, Kwak J, Shen HW. Knowledge of advance directive and perceptions of end-of-life care in Chinese-American elders: The role of acculturation. Palliat Support Care 2015;13:1677-84. [DOI] [PubMed] [Google Scholar]
- 10.Panfilis L, Rossi P, Mazzini E, et al. Knowledge, opinion and attitude about the Italian law on advance directives: a population- based survey. J Pain Symptom Manage 2020;60:P906-14. [DOI] [PubMed] [Google Scholar]
- 11.Wright AA, Zhang B, Ray A, et al. Associations between endof- life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. JAMA 2008;300:1665-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Brinkman-Stoppelenburg A, Rietjens JA, van der Heide A. The effects of advance care planning on end-of-life care: a systematic review. Palliat Med 2014;28:1000-25. [DOI] [PubMed] [Google Scholar]
- 13.Detering KM, Hancock AD, Reade MC, Silvester W. The impact of advance care planning on end of life care in elderly patients: randomised controlled trial. BMJ 2010;340:c1345. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Carr D, Luth EA. Advance care planning: contemporary issues and future directions. Innov Aging 2017;1:igx012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Alves R. Has end-of-life decisions or Advance Directives become an economic strategy to contain health care costs has much as a way to respect patient’s informed consent and private autonomy rights? Master of Transnational Law Degree Thesis, Católica Global School of Law; 2018. [Google Scholar]
- 16.Capelas M, Coelho S, Silva S, et al. [Os portugueses e o Testamento Vital]. [Article in Portuguese]. Cadernos Saúde 2017;9:44-53. [Google Scholar]
- 17.Ferreira C, Nunes R. Living will: information verification and sharing in a Portuguese hospital. Rev Bioetica 2019;27:691-8. [Google Scholar]
- 18.Pereira SM, Fradique E, Fialho R, et al. Advance directives: Portuguese palliative care professionals' views. Int J Palliat Nurs 2011;17:373-80. [DOI] [PubMed] [Google Scholar]
- 19.Arruda LM, Abreu KPB, Santana LBC, Sales MVC. Variables that influence the medical decision regarding Advance Directives and their impact on end-of-life care. Einstein (São Paulo) 2019;18:eRW4852. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Leitão P. [Os alunos de Enfermagem do 4º Ano da Faculdade Ciências da Saúde – Universidade Fernando Pessoa perante a aplicação do Testamento Vital]. [Degree Thesis in Portuguese]. 2015. [Google Scholar]
- 21.Colton D, Covert R. Designing and constructing instruments for social research and evaluation. Chichester: J. Wiley & Sons; 2007. [Google Scholar]
- 22.Streiner D, Norman G. Health measurement scales: A practical guide to their development and use. Oxford: University Press; 2008. [Google Scholar]
- 23.Heyland DK, Cook DJ, Rocker GM, et al. The development and validation of a novel questionnaire to measure patient and family satisfaction with end-of-life care: the Canadian Health Care Evaluation Project (CANHELP) Questionnaire. Palliat Med 2010;24:682-95. [DOI] [PubMed] [Google Scholar]
- 24.Nolan MT, Bruder M. Patients' attitudes toward advance directives and end-of-life treatment decisions. Nurs Outlook 1997;45:204-8. [DOI] [PubMed] [Google Scholar]
- 25.Polit DF, Beck CT. The content validity index: are you sure you know what's being reported? Critique and recommendations. Res Nurs Health 2006;29:489-97. [DOI] [PubMed] [Google Scholar]
- 26.Kyriazos T. Applied psychometrics: Sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology 2018;9:2207-30. [Google Scholar]
- 27.Pestana M, Gageiro J. [Análise de dados para ciências sociais: a complementaridade do SPSS].[Book in Portuguese] 6th ed. Lisboa: Edições Sílabo; 2014. [Google Scholar]
- 28.Coluci M, Alexandre N, Milani D. Construction of measurement instruments in the area of health. Ciênc Saúde Colet 2015;20:925-36. [DOI] [PubMed] [Google Scholar]
- 29.Burns N, Grove S. The practice of nursing research: Conduct, critique and utilization. Elsevier Saunders; 2005. [Google Scholar]
- 30.Blackwood DH, Vindrola-Padros C, Mythen MG, Walker D. Advance-care-planning and end-of-life discussions in the perioperative period: a review of healthcare professionals' knowledge, attitudes, and training. Br J Anaesth 2018;121:1138-47. [DOI] [PubMed] [Google Scholar]
- 31.Hamilton IJ. Barriers to advance care planning in primary care. Br J Gen Pract 2016;66:512-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Nedjat-Haiem FR, Cadet TJ, Amatya A, Mishra SI. Healthcare providers’ attitudes, knowledge, and practice behaviors for educating patients about advance directives: A national survey. Am J Hosp Palliat Care 2019;36:387-95. [DOI] [PubMed] [Google Scholar]
- 33.Patel P, Lyons L. Examining the knowledge, awareness, and perceptions of palliative care in the general public over time: A scoping literature review. Am J Hosp Palliat Care 2020;37:481-7. [DOI] [PubMed] [Google Scholar]
- 34.Andrés-Pretel F, Navarro Bravo B, Párraga Martínez I, et al. [Conocimientos y actitudes de los mayores hacia el documento de voluntades anticipadas].[Article in Spanish]. Gac Sanit 2012;26:570-3. [DOI] [PubMed] [Google Scholar]
- 35.Aguilar-Sánchez J, Cabañero-Martínez M, Fernández F, et al. [Grado de conocimiento y actitudes de los profesionales sanitarios sobre el documento de voluntades anticipadas].[Article in Spanish]. Gac Sanit 2017;32:339-45. [DOI] [PubMed] [Google Scholar]
- 36.Macedo JC. Contribution to improve advance directives in Portugal. MOJ Gerontol Ger 2020;5:27‒30. [Google Scholar]