Skip to main content
BMC Nursing logoLink to BMC Nursing
. 2020 Jun 22;19:55. doi: 10.1186/s12912-020-00444-8

Cross-cultural adaptation and psychometric validation of the Flodén ATODAI instrument in the North American context

Anne Flodén 1,2,, Maria Stadtler 3, Stephanie E Jones Collazo 4, Tom Mone 5, Rick Ash 5, Bengt Fridlund 6
PMCID: PMC7310066  PMID: 32581648

Abstract

Background

Intensive and critical-care nurses are the key to successful donor management in the critical-care setting. No studies measuring attitudes toward organ donor advocacy existed before 2011, when the 51-item Swedish “Attitudes Toward Organ Donor Advocacy Scale” was developed. The aim of this study was to translate, adapt and establish the psychometric properties of the North American version of the Flodén ATODAI (Attitudes Toward Organ Donor Advocacy Instrument) in terms of validity and reliability.

Methods

A multi-step approach was used: Initial translation; Back-translation; Review and synthesis of these translations; Expert panel (N = 7) rated the prefinal version of the instrument for content validity index (CVI); International panel made adjustments guided by the expert panel. Reliability testing with test and retest of the adjusted 46-item version was conducted using intraclass correlation coefficient (ICC), weighted kappa (ҡWeight), sign test, and Cronbach’s alpha coefficient (α), (N = 50); and finally Delphi technique procedure with a preselected Delphi panel (N = 15).

Results

The CVI was determined to be greater than the 0.05 significance level. Item level (I-CVI) ranged 0.82–1.0, with a mean of 0.97. Scale level (S-CVI) on the entire instrument was 0.97. Test-retest procedure was performed to estimate stability. In total, 34 of the items had good-to-high ICC. Accepting an ICC of ≥ 0.70 resulted in a total of 24 items. Homogeneity reliability was estimated by α and was calculated for these items where α = 0.90. In total, 20 of the items had a substantial or almost perfect ҡWeight and 23 showed a moderate ҡWeight. None of the items showed systematical differences. The Delphi technique procedure was used on the 22 items with ICC < 0.70 resulted in adjustments establishing that consensus was achieved.

Conclusions

Undertaking this multi-step, cross-cultural adaptation procedure has effectively ensured that the 46-item Flodén ATODAI [North American version] produces valid and reliable measurements.

Keywords: Instrument development, Translation and cross-cultural adaptation, Advocacy, Attitude, Organ donation, Nursing, Intensive care

Background

Organ donor advocacy (ODA) attitudes among intensive care unit (ICU) nurses are crucial when championing and respecting the donor’s and donor’s family’s end-of-life decision to donate. ICU-nurses’ awareness, knowledge, skill and competence, i.e. role has an impact upon the organ donation and by that the organ transplantation process. The care by specialist nurses is the key to successful donor management in the critical-care (CC) setting since their actions and behavior are significantly associated with authorization to, or decline of, organ donation (OD) [112]. In addition, ICU nurses’ attitudes have an impact on the availability of organs for individuals who need life-saving organ transplant treatment [5, 8, 9].

No studies measuring attitudes toward organ donor advocacy (ATODA) in a clinical context existed before 2011. One reason for this is the absence of validated measuring instruments. In 2011, with the intent to gain an understanding of nurses’ behavior, and their level of ability to advocate for their patients who are either potential or actual organ donors, Flodén et al. [13] developed the 51-item Swedish instrument “Attitudes Toward Organ Donor Advocacy Scale” (ATODAS) to measure ATODA among ICU and CC nurses. This instrument measures ATODA by describing nurses’ actions while caring for potential organ donors and throughout the donation procedure and evaluates changes in organizational structure, guidelines, and educational interventions. The ATODAS is validated in the Swedish context by its application on more than 1200 ICU nurses, i.e. ≥ 50% of all ICU nurses in Sweden. This ATODAS instrument is limited to the Swedish context since it only exists in the Swedish language. Today the ATODAS is to our knowledge the only established instrument within the context of measuring organ donor advocacy, and there is a need for a universal translation among different cultures and countries. Currently, the Flodén ATODAI [North American version] is in use in several countries and continents, and the process of developing a Spanish version has started.

Since specific behavior by ICU personnel is significantly associated with the frequency of referral and OD consent, it is of crucial importance to understand the reasons behind ODA. The concept of ODA in the situation of OD is defined by Flodén et al. [5] as respecting the potential or actual organ donor’s rights, representing, or speaking up for his/her wishes, as well as the family’s points of view, in the OD decision-making process. According to the International Council of Nurses’ Code of Ethics, a nurse’s primary professional responsibility is to people requiring nursing care. Thus, nurses’ behavior and their level of ability to advocate for their patients’ desires applies to potential and actual organ donors [14]. In regard to nurses’ professional ethics in situations when the possibility of OD arises, nurses should represent and defend their patients’ wishes regarding ODA [15]. The relative rarity of OD in any hospital or country makes it important to reach out to an international clinical context to establish developmental changes, i.e. professional and/or organizational. After reviewing the roles and practices of ICU and CC nurses in North America, it became clear that the Swedish ATODAS needed to be adjusted to be used in North American context [16]. Therefore, the aim of this study was to translate, adapt, and establish the psychometric properties of the Swedish ATODAS to one which would be equally valid and reliable in North America. As part of the instrument development in this study, the name of the instrument changed from ATODAS, the 51-item Swedish scale, to Flodén ATODAI (Attitudes Toward Organ Donor Advocacy Instrument), the North American English version.

Methods

Design

The study used a methodological design comprising of a cross-cultural adaptation procedure to effectively translate the 51-item Swedish ATODAS instrument for use in other cultural and language settings. Specifically, the study considered the Brislin multi-step approach as best practice [17]. An additional Delphi technique procedure was performed on the Flodén ATODAI [North American version] as a complementary adaptation approach to secure higher scientific certainty of the instrument with regard to validity and reliability by testing the items for content relevance, clarity, and domain coverage [18].

Description of the ATODAS [Swedish version]

Flodén et al. [13] developed the Swedish 51-item ATODAS as a means of psychometric evaluation of measuring ICU nurses’ ATODA, including validation and reliability testing. In addition to the demographic data, the instrument contains three dimensions covering statements about attitudes toward: actions to safeguard the wishes of the potential organ donor; actions for supporting the family of the potential organ donor; and actions that promote OD at an organizational or structural level.

Translation and cross-cultural adaptation of the Flodén ATODAI [North American version]

The procedure to transfer the Swedish ATODAS instrument into an international arena was guided by Brislin’s [17] multi-step back-translation approach, complemented by a Delphi technique procedure [18] (Table 1).

Table 1.

The cross-cultural adaptation procedure in six steps according to Brislin [17] and Delphi technique procedure [18] for translating the 51-item Flodén ATODAS [Swedish version] to the 46-item Flodén ATODAI [North American version]

Step 1: Initial translation by an English-speaking interpreter.
Step 2: Back-translation by a Swedish-speaking interpreter.
Step 3: Review and synthesis of these translations by an International committe of experts.
Step 4:Expert panel of seven designated ICU nurses rating the instrument; Followed by data analysis I (I-CVI and S-CVI).
Step 5: Test and retest of the prefinal version with 2 weeks in between; Followed by data analysis II (ICC, ҡWeight, sign test, and Cronbach’s alpha coefficient). In total, 50 ICU nurses from two hospitals in the greater Los Angeles area participated in the test and retest.
Step 6: A preselected panel (N = 15) performed an additional Delphi technique procedure for items that showed an ICC < 0.70 in step five. The researchers also made adjustments guided by the panel’s feedback.

The first step was for a professional and native American English-speaking interpreter and bilingual Swedish translator to translate the Swedish ATODAS instrument into American-English. The second step comprised of back-translation into American-English, as performed by another expert—a native Swedish-speaking bilingual translator. The translation was performed blindly, i.e. without access to the original version of the Swedish ATODAS.

Step three constituted cross-language testing by the International committe, consisting of three OD specialists; one representing Sweden (PI), and two representing the United States of America (OneLegacy).

“Review and synthesis of the translations” was performed to provide consensus regarding the most accurate and easily understood items. Working from the original instrument, as well as the translated versions, a synthesis of these translations was conducted to produce a consolidated instrument. This validity-checking procedure ensured the translated version reflected the same item content as the original. A written report thoroughly documented the synthesis procedure by addressing each of the issues and how they were resolved. The consensus included the translated version of the instrument and the introduction and instruction to the instrument, resulting in the prefinal version of the Flodén ATODAI [North American version]. The described procedure included achieving equivalence between the original version and the translated version.

Study populations: steps four to six

Step four

Seven designated ICU or CC nurses in the greater Los Angeles with experiential knowledge of caring for at least one organ donor formed an expert panel. The panel evaluated the content validity of the items, with reference to Lynn’s criteria [19]. All seven nurses on the panel were female, aged between 29 and 55 years with a mean age of 44.2 years, and their work experience in the ICU and/or Emergency Department ranged between 5 and 31 years. The panel represented nurses from trauma, education, and teaching hospitals: Three worked in the ICU; three in the Emergency Department; and one in the Education Department. Three of the experts were managers/charge nurses, one was a clinical nurse specialist, one a nurse educator, and two were bedside nurses.

Step five

In total, 50 ICU nurses from two hospitals in the greater Los Angeles area participated in the test and retest; one university-affiliated hospital (with different types of ICUs); and one county or community hospital (one ICU) (Table 2). The inclusion criteria were: Being an ICU or CC nurse; experiential knowledge of caring for at least one organ donor; and currently working in a clinical setting with OD. The exclusion criteria were: Being a nurse who was not currently working and/or being a nurse without experience of caring for organ donors.

Table 2.

Socio-demographics of ICU nurses performing the test-retest of the 46-item Flodén ATODAI [North American version]

ICU or CC nurses N = 50
Age 25–63 years (mean 38 years)
Gender:
 Men n = 13
 Women n = 37
Work experiences 0.1–34 years (mean 10.2 years)
Experience of caring for brain-dead patients:
 ≤  5 times n = 13
 6–10 times n = 6
 ≥  10 times n = 31

Step six

A preselected panel of 15 nurses in the United States of America, with extensive experiential knowledge of caring for organ donors, comprised the Delphi panel for the purpose of completing the additional Delphi technique procedure (Table 3).

Table 3.

Socio-demographics of panel (N = 15) performing the Delphi technique procedure of the 46-item Flodén ATODAI [North American version]

Location:
 Greater Los Angeles n = 11
 Western and South United States n = 4
Age 23–60 years (mean 46.7 years)
Gender:
 Female n = 12
 Male n = 3
Ethnicity:
 Asian n = 7
 Caucasian n = 6
 Afro-American n = 2
Current workplace:
 Intensive Care (general) n = 8
 Emergency Department n = 4
 Trauma ICU n = 1
 Cardiac ICU n = 1
 Neuro ICU n = 1
Main position:
 Bedside nurse n = 14
 Charge nurse n = 1
Work experience in ICU 3–32 years (mean 16 years)
Hospital:
 Community hospital n = 12
 University hospital n = 2
 Trauma hospital n = 1
 Private hospital n = 1

Data collections and analysis: steps four to six

Step four: first data collection

The first data collection required testing the prefinal version of the Flodén ATODAI [North American version]. The expert panel was given a rating form with the theoretical definition and a delineation of the three dimensions, objectives, and items. They were asked to review the prefinal 51-item version of the Flodén ATODAI [North American version] for content relevance, clarity, and domain coverage and to rate each item on a 4-point scale (from 1 = not relevant to 4 = very relevant) [19, 20].

Step four: first data analysis

Content validity

The expert panel was formed to estimate the content validity (with reference to Lynn’s criteria [19] of the items. Content was considered valid when an item was rated as either 3 (relevant and needs little revision) or 4 (very relevant) by at least six evaluators (> 86%) and, thus, was included in the new scale [19].

The International committe analyzed the content validity rating by the expert panel and weighted the scores, which resulted with the prefinal 51-item instrument being reduced to 46 items. Of the remaining 46 items, five items were re-worded, as guided by the recommendations of the expert panel. A content validity index (CVI) was calculated to indicate the extent of expert agreement, both for the item CVI (I-CVI) and for the scale CVI (S-CVI). An I-CVI was determined by the number of experts who rated an item content as valid (giving it a rating of 3 or 4) divided by the total number of experts, resulting in a proportion of agreement for each item. The S-CVI was determined by the averages of the I-CVIs [19, 20].

Step five: second data collection

The study performed a test-retest procedure to estimate stability (reliability testing) of the adjusted version of the prefinal 46-item version of the Flodén ATODAI [North American version], as developed from the data analysis performed in step four. Fifty ICU nurses agreed to participate by answering the instrument on two occasions, with 2 weeks in between.

Step five: second data analysis

Test-retest reliability

The intraclass correlation coefficient (ICC) was used to measure the strength of agreement between the test and retest, using ordered categorial data [21]. The level of agreement was confirmed via the weighted form of kappa coefficients (ҡWeight) [22].

Moreover, the sign test tested for whether systematical differences occur in either direction, described by exact agreement. The test was two-sided and conducted at the 0.05 significance level. The ICC, the ҡWeight, and the sign test analyses were performed using SAS software version 9.4 (SAS Institute Inc., Cary, NC, USA).

Homogeneity and stability reliability

Homogeneity reliability was estimated using Cronbach’s alpha coefficient (α) via SPSS 18.0. According to the conventional rule by Nunnally, this coefficient should at least exceed 0.70 [23].

Step six: third data collection

An additional Delphi technique procedure of the Flodén ATODAI [North American version] was performed to test the items for content relevance, clarity, and domain coverage. The Delphi technique is evidently dependent on the experiential knowledge of its expert panel (i.e. the Delphi panel). In this step, the Delphi panel only reviewed and judged the 22 items which were identified in step five as having an ICC ≤ 0.70. The preselected Delphi panel (N = 15) was used to further improve the feasibility of the instrument [18]. The Delphi panel members were asked to individually review and judge these 22 items in the Flodén ATODAI [North American version] in two occasions, referred to as “round I” and “round II”. The nurses rated each item using a 4-point rating scale (1 = not relevant; 2 = unable to estimate relevance without item revision or item in need of such revision that it would no longer be relevant; 3 = relevant but needs minor alteration; 4 = very relevant and succinct) [19]. In round II, the Delphi panel members reviewed the adjusted version of the Flodén ATODAI [North American version] after round I.

Step six: third data analysis

After round I, this study’s primary investigator (PI) summarized and analyzed all participants’ recommendations. The Delphi panel rated all 22 items as either “relevant but needs minor alteration [3]”, or “very relevant and succinct [4]”. Four of the items were recommended to be kept as they were. The PI, in consultation with the co-investigators, adjusted and re-worded the remaining 18 items, guided by the Delphi panel members’ recommendations. After round II, the PI, in consultation with the co-investigators, summarized, analyzed, and adjusted the Flodén ATODAI [North American version], again guided by the recommendations of the panel.

Results

Content validity

The first data collection comprised of the expert panel rating the prefinal version of the Flodén ATODAI [North American version]. The International committe then analyzed this data for CVI by calculating both the I-CVI and the S-CVI. The I-CVI ranged from 0.82 to 1.0, with a mean of 0.97, while the S-CVI averaged 0.97. This meant the CVI was ≥ 0.78 and, therefore, content validity was established beyond the 0.05 significance level, which is the required criterion according to Lynn [19] and Polit and Beck [20]. This resulted in a reduction of the number of instrument items from 51 to 46. Of the remaining 46 items, five were re-worded using the recommendations of the expert panel.

Test-retest reliability

The strength of agreement between the test and retest was calculated both by ICC and by ҡWeight. Also, the sign test was used to identify whether any systematical differences had occurred. The 46-item Flodén ATODAI [North American version] showed an ICC between 0.268–0.911 (Table 4). In total, 34 of the items had a good or excellent ICC: Good n = 18 (0.60–0.74); Excellent n = 16 (≥ 0.75). Accepting an ICC ≥ 0.70 [24] yielded a total of 24 items. The level of agreement was confirmed by ҡWeight, varying between 0.25–0.87 (Table 5). In total, 20 of the items had a substantial or almost perfect ҡWeight: Substantial n = 17 (0.61–0.80); Almost Perfect n = 3 (0.81–0.99). Moderate ҡWeight (0.41–0.60) was shown for 23 items. Only three items (2, 4, and 37) showed a ҡWeight with fair agreement (0.21–0.40). However, these three items had a high exact agreement that ranged between 75.5–84.0%. Exact agreement between test and retest for all items varied between 52.1–97.9%. None of the items showed statistically significant systematic changes. The retest values were systematically higher for most of the items. The ICC values were, as is to be expected, very similar to those of ҡWeight [25].

Table 4.

The strength of agreement between the test and retest of the 46-item Flodén ATODAI [North American version], as measured by ICC using ordered categorial data [21]

Excellent correlation (0.75–1.00) n = 16
Good correlation (0.60–0.74) n = 18
Fair correlation (0.40–0.59) n = 9
Poor correlation (< 0.40) n = 3

Table 5.

The level of agreement between the test and retest of the 46-item Flodén ATODAI [North American version] by ҡWeight [22]

Almost perfect agreement (0.81–0.99) n = 3
Substantial agreement (0.61–0.80) n = 17
Moderate agreement (0.41–0.60) n = 23
Fair agreement (0.21–0.40) n = 3
Slight agreement (0.01–0.20)
Less than chance agreement (< 0)

Homogeneity and stability reliability

Homogeneity reliability was estimated using α for the 24 items identified with an ICC ≥ 0.70 was α =0.90. None of the items had a greater α coefficient “if item was deleted”, meaning that none of the items would substantially affect reliability if they were removed. Furthermore, all items had a “corrected item-total correlation” of 0.30 or above. Calculating the Cronbach’s alpha of the retest gave an α coefficient of 0.913. Analysis of the results of the test and retest established a reasonable degree of both stability and homogeneity for the 24 items in the Flodén ATODAI [North American version] with an ICC ≥ 0.70 for test-retest reliability. Out of the remaining 22 items, 10 had an ICC ≥ 0.60 (i.e. good correlation), 9 had a fair ICC (0.40–0.59), while 3 had a poor ICC (< 0.40). All items had been rated as “relevant and succinct” or “relevant but needed minor alteration” by the expert panel. The majority of the 22 items with ICC < 0.70 needed minor alterations as part of the Swedish to North American cross-cultural adaptation. These alterations were performed using a Delphi technique procedure.

The Delphi procedure

The Delphi procedure focused on the 22 items identified in step five as showing an ICC < 0.70. During round I, the Delphi panel rated all 22 items as relevant, recommending 16 for minor alterations. Then, during round II, the Delphi panel members reviewed the adjusted items from round I and recommended further changes. The adjustments after both round I and round II involved emphasizing the core of the items via re-wording. The PI performed the final adjustments of the items, guided by feedback from the Delphi panel, until consensus was achieved.

Discussion

Before 2011 no studies measuring ATODA existed in the worldwide clinical context, which is why the Swedish 51-item ATODAS was developed and validated by Flodén et al. [13] and became the first instrument to measure ATODA among ICU and CC nurses. For a worldwide use the primary limitation of the ATODAS is linguistic since it is written in Swedish, but socio-cultural and legal limitations also exist. To address these limitations and allow the scale to be used in an international clinical context, a systematic translation procedure for cross-cultural adaptation was initiated and performed [17, 26] (Table 1).

The term “cross-cultural adaptation” is used to encompass a procedure that takes into consideration issues related to both language (translation) and cultural adaptation during the process of preparing an instrument for use in another setting [26]. To merely translate an instrument word for word into a different language does not adequately take into account the cultural and linguistic differences. The content of the items needs to be relevant in each culture, for example legislations and government regulations. The “cross-cultural adaptation” term consist of three parts: 1st, the preparation of the instrument for use in another culture, language and country; 2nd, the use of target populations to evaluate clarity in the instructions, response format and the items of the instrument; and 3rd, the field testing of the pre-final version of the instrument [17, 2630].

The process of preparing the Flodén ATODAI for use in the North American context

Application of an instrument in a different culture, language and country would necessitate translation and cultural adaptation [17, 2630]. The procedure used for the linguistic translation included two different professional interpreters for the translation and back-translation. As a validity check and to ensure a high-quality translated instrument, the International committe of experts safeguarded that the translated version reflected the same item content as the original version and that the content was relevant in the context of North America. In situations where there were uncertainties around the meaning of specific words or items, a strength was that the developer of the original instrument was a member of the International committe and could provide clarifications when needed [26, 31]. Items in the original Swedish 51-item ATODAS that were related to Swedish legislation and how they shall be applied in the Swedish context were removed. For example, Sweden has a presumed consent to organ donation, and therefore items were removed that asked about approaches and actions to respect the legislated presumed consent and how to balance this legislation toward the wishes of the family. Moreover, items covering organizational structure were adjusted to fit the North American context. In Sweden, when a potential organ donor is identified, the ICUs call the Transplant coordinator on call, which is an in-hospital position linked to the transplant institutes. By contrast in the United States of America, the ICUs call their organ procurement organization (OPO). In Sweden it is considered ethically insensitive to ask about culture, religion, and country of origin. However, the first issue raised by the American members of the International committe was the lack of these topics. Therefore, the descriptive items were adjusted in the cross-cultural adaptation by adding the items of culture, religion, and country of origin to the North American version of the Flodén ATODAI. The literature supports the procedure chosen in this study to ensure that the items were translated correctly and were relevant in the new setting [17, 2630, 32].

The use of target populations

To return to the target populations and have experts in the field discuss the nuances brought out by the different versions of the translated instrument throughout the process is crucial, and the instrument should be adjusted accordingly after a consensus is reached [26, 30, 33, 34]. In our study an expert panel was used to evaluate the content validity following the recommendations by Lynn on how to quantify an otherwise subjective process [19]. It showed that we achieved strong content validity that was culturally relevant. The use of the Delphi panel was an additional approach to return to the target population. The use of the Delphi technique procedure is not included in the original approach by Brislin [17] but was added to this study to increase the test-retest reliability of the Flodén ATODAI [North American version]. The main advantage of the Delphi technique procedure is the capability of guiding the Delphi panel opinion toward achieving consensus in a given area of uncertainty or lack of empirical evidence [18, 33, 35]. The panel size, the composition of panel members as well as the qualification of the experts are important factors to make a valid contribution. To secure higher scientific certainty of the instrument, we followed the recommendations described by Powel by having a heterogeneous group of panel members (Table 3) and followed the recommended procedure consisting of two subsequent rounds [18].

Field testing of the pre-final Flodén ATODAI [North American version]

Field testing and refining the instrument with members of the target populations is needed to ensure that items are translated correctly and are relevant in the new setting [2630]. Test-retest was used to measure the strength of agreement between the test and retest [2123]. The results concluded that reliability was established due to the test-retest reliability testing, where 34 of the items had a good or excellent ICC and the ҡWeight confirmed the level of agreement. Only three items showed a ҡWeight with fair agreement, but all these three items had a high exact agreement between the test and retest. Moreover, the Cronbach’s alpha coefficients showed excellent homogeneity and stability reliability.

In a situation where the possibility of OD occurs in the ICU, the nurses are expected to enable the donation, within the boundaries of professional ethics [14, 15]. The key to successful donor management in the CC setting is significantly associated with the ICU and CC nurses’ attitudes toward OD, having an impact on the availability of organs for individuals who need life-saving organ transplant treatment [112]. The intent of creating the Flodén ATODAI [North American version] was to develop an instrument capable of supporting ICU and CC nurses in gathering knowledge and to develop best practices and guidelines when advising and assisting (potential) organ donors and their families, i.e. support attitudes and actions toward ODA.

After review of the role and practice of the ICU and CC nurses in the United States of America, it became obvious the Swedish ATODAS needed adjustment before it could be used in North America, to fit its socio-cultural and legal context. The main differences between the Swedish version and the North American version of the instrument are due to national context, e.g. legislation and guidelines. The methodological procedure performed, revealed evidence of validity and reliability for the Flodén ATODAI [North American version]. Thus, this multi-step approach has effectively ensured a stronger scale for assessing attitudes toward ODA (the Flodén ATODAI [North American version]).

Clinical benefits of the Flodén ATODAI [North American version] enable identification of educational and organizational needs and may be useful to evaluate organizational changes, and if such changes will be sustainable over time. Therefore, the instrument assists the professional development of ICU nurses. The Flodén ATODAI [North American version] opens the possibilities to use this instrument to perform studies within the North American context, as well as globally to measure ATODA.

Conclusions

The translated and tested instrument Flodén ATODAI [North American version] was adapted to be culturally relevant, yielding valid and reliable results for use in a clinical North American context within a global perspective. Undertaking this multi-step approach has effectively ensured that the cross-cultural adaptation procedure resulted in a stronger instrument for valid and reliable measurements. The North American version of the Flodén ATODAI provides a framework for researchers in general, but clinicians in particular, choosing to utilize this instrument for work in other cultural and geographic settings. Study limitations are that content validity of the 46-item Flodén ATODAI needs to be further scrutinized. Therefore, the next step should be to use the instrument in a large-scale study within the United States of America and implement factor analysis to determine construct validity.

Acknowledgements

The authors would like to acknowledge the Donation Science Research and Education Team, OneLegacy, Los Angeles, for their support, engagement, and companionship, and a warm thank you to all participating nurses of the expert panel, the Delphi panel, and the test and retest participants.

Abbreviations

ATODA

Attitudes Toward Organ Donor Advocacy

ATODAI

Attitudes Toward Organ Donor Advocacy Instrument

ATODAS

Attitudes Toward Organ Donor Advocacy Scale (in Swedish)

CC

Critical Care

ICC

Intraclass correlation coefficient

ICU

Intensive Care Unit

I-CVI

Item - Content Validity Index

OD

Organ Donation

ODA

Organ Donor Advocacy

PI

Primary Investigator

S-CVI

Scale - Content Validity Index

Authors’ contributions

AF (PI) participated in research design; performance of the research; data analysis; writing and revising the paper; and contributed with the research tool ATODAS (Swedish version of the questionnaire). MS participated in performance of the research; data analysis; writing and revising the paper. RA participated in performance of the research; data analysis of step three to five (Table 1); writing and revising the paper. SC participated in performance of the research; data analysis of step six, the Delphi procedure (Table 1); writing and revising the paper. TM participated in performance of the research; and writing and revising the paper. BF participated in research design; performance of the research; data analysis; and writing and revising the paper. All authors read and approved the final manuscript.

Funding

This independent research study was partially funded by a grant from The Swedish Transplant Society, the Professor Lars-Erik Gelin Memorial Foundation for Transplant Research, and Professor Styrbjörn Friman. The funders had no part in the design of the study, nor in the collection, analysis and interpretation of data or in writing the manuscript. Open access funding provided by University of Gothenburg.

Availability of data and materials

The datasets used and/or analyses during the current study are available from the corresponding author on reasonable request.

Ethics approval and consent to participate

This research study complies with the Declaration of Helsinki and the Declaration of Istanbul and obtained Institutional Review Board approvals from St. Vincent Medical Center, Los Angeles, CA (RE: IRB #12–032; RE: IRB #14–005) and Arrowhead Regional Medical Center, Colton, CA (Protocol #14–15). Moreover, the researchers obtained approval from the chief executive officer of each hospital prior to approaching the ICU nurses. All nurses that consented to participate signed a written consent form.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Flodén A, Kelvered M, Frid I, Backman L. Causes why organ donation was not carried out in spite of the deceased being positive to donation. Transplant Proc. 2006;38(8):2619–2621. doi: 10.1016/j.transproceed.2006.07.031. [DOI] [PubMed] [Google Scholar]
  • 2.Cohen J, Ami SB, Ashkenazi T, Singer P. Attitude of health care professionals to brain death: influence on the organ donation process. Clin Transpl. 2008;22:211–215. doi: 10.1111/j.1399-0012.2007.00776.x. [DOI] [PubMed] [Google Scholar]
  • 3.Sharp TA. The impact of trust study days on organ and tissue donation among critical care staff. J Intensive Care Soc. 2009;10:189–196. doi: 10.1177/175114370901000308. [DOI] [Google Scholar]
  • 4.Jacoby L, Jaccard J. Perceived support among families deciding about organ donation for their loved ones: donor vs. nondonor next of kin. Am J Crit Care. 2010;19:e52–e61. doi: 10.4037/ajcc2010396. [DOI] [PubMed] [Google Scholar]
  • 5.Flodén A. Attitudes towards organ donor advocacy among Swedish intensive and critical care nurses. PhD diss., Sahlgrenska Academy, University of Gothenburg. 2011. [DOI] [PubMed] [Google Scholar]
  • 6.Forsberg A, Lennerling A, Fridh I, Rizell M, Lovén C, Flodén A. Attitudes towards organ donor advocacy among Swedish intensive care nurses. Nurs Crit Care. 2015;20(3):126–133. doi: 10.1111/nicc.12128. [DOI] [PubMed] [Google Scholar]
  • 7.Sanner MA. Two perspectives on organ donation: experiences of potential donor families and intensive care physicians of the same event. J Crit Care. 2007;22:296–304. doi: 10.1016/j.jcrc.2007.03.002. [DOI] [PubMed] [Google Scholar]
  • 8.Lin LM, Lin CC, Chen CL, Lin CC. Effects of an education program on intensive care unit nurses' attitudes and behavioral intentions to advocate deceased donor organ donation. Transplant Proc. 2014;46(4):1036–1040. doi: 10.1016/j.transproceed.2013.12.039. [DOI] [PubMed] [Google Scholar]
  • 9.Jawoniyi OO, Gormley K. How critical care nurses' roles and education affect organ donation. Br J Nurs. 2015;24(13):698–700. doi: 10.12968/bjon.2015.24.13.698. [DOI] [PubMed] [Google Scholar]
  • 10.Xie JF, Wang CY, He GP, Ming YZ, Wan QQ, Liu J, Gong LN, Liu LF. Attitude and impact factors toward organ transplantation and donation among transplantation nurses in China. Transplant Proc. 2017;49(6):1226–1231. doi: 10.1016/j.transproceed.2017.02.060. [DOI] [PubMed] [Google Scholar]
  • 11.Hancock J, Shemie SD, Lotherington K, Appleby A, Hall R. Development of a Canadian deceased donation education program for health professionals: a needs assessment survey. Can J Anaesth. 2017;64(10):1037–1047. doi: 10.1007/s12630-017-0882-4. [DOI] [PubMed] [Google Scholar]
  • 12.Jawoniyi O, Gormley K, McGleenan E, Noble HR. Organ donation and transplantation: awareness and roles of healthcare professionals - a systematic literature review. J Clin Nurs. 2018;27(5–6):e726–e738. doi: 10.1111/jocn.14154. [DOI] [PubMed] [Google Scholar]
  • 13.Flodén A, Lennerling A, Fridh I, Rizell M, Forsberg A. Development and psychometric evaluation of the instrument: attitudes towards organ donor advocacy scale (ATODAS) Open Nurs J. 2011;5:65–73. doi: 10.2174/1874434601105010065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.International Council of Nurses (ICN). The ICN code of ethics for nurses. 2012. https://www.icn.ch/sites/default/files/inline-files/2012_ICN_Codeofethicsfornurses_%20eng.pdf accessed 22 April 2020.
  • 15.Koehn D. The ground of professional ethics. New York: Routledge; 1994. [Google Scholar]
  • 16.American Association of Critical-care Nurses, (AACN). https://www.aacn.org/ accessed 22 April 2020.
  • 17.Brislin RW. Back-translation for cross-cultural research. J Cross-Cult Psychol. 1970;1:185–216. doi: 10.1177/135910457000100301. [DOI] [Google Scholar]
  • 18.Powel C. The Delphi technique: myths and realities. J Adv Nurs. 2003;41(4):376–382. doi: 10.1046/j.1365-2648.2003.02537.x. [DOI] [PubMed] [Google Scholar]
  • 19.Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35:382–385. doi: 10.1097/00006199-198611000-00017. [DOI] [PubMed] [Google Scholar]
  • 20.Polit D, Beck C. Nursing research: generating and assessing evidence for nursing practice. 10th ed. edition. Philadelphia: Wolters Kluwer. Lippincott Williams & Wilkins; 2017. [Google Scholar]
  • 21.Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–290. doi: 10.1037/1040-3590.6.4.284. [DOI] [Google Scholar]
  • 22.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310. [DOI] [PubMed] [Google Scholar]
  • 23.Nunnally JC, Bernstein IH. Psychometric theory. 3. New York: McGraw-Hill Publishing Company; 1994. [Google Scholar]
  • 24.Hahn EA, Cella D, Chassany O, Fairclough DL, Wong GY, Hays RD. Precision of health-relate quality-of-life data compared with other clinical measures. Mayo Clin Proc. 2007;82:1244–1254. doi: 10.4065/82.10.1244. [DOI] [PubMed] [Google Scholar]
  • 25.Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measured reliability. Educ Psychol Meas. 1973;33:613–619. doi: 10.1177/001316447303300309. [DOI] [Google Scholar]
  • 26.Beaton D, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;24:3186–3191. doi: 10.1097/00007632-200012150-00014. [DOI] [PubMed] [Google Scholar]
  • 27.Khalaila R. Translation of questionnaires into Arabic in cross-cultural research: Techniques and equivalence issues. J Transcult Nurs. 2013;24(4):363–370. doi: 10.1177/1043659613493440. [DOI] [PubMed] [Google Scholar]
  • 28.Hilton A, Skrutkowski M. Translating instruments into other languages: development and testing processes. Cancer Nurs. 2002;25(1):1–7. doi: 10.1097/00002820-200202000-00001. [DOI] [PubMed] [Google Scholar]
  • 29.Gjersing L, Caplehorn JRM, Clausen T. Cross-cultural adaptation of research instruments: language, setting time and statistical considerations. BMC Med Res Methodol. 2010;10:13. doi: 10.1186/1471-2288-10-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17(2):268–274. doi: 10.1111/j.1365-2753.2010.01434.x. [DOI] [PubMed] [Google Scholar]
  • 31.Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998;7:323–335. doi: 10.1023/A:1008846618880. [DOI] [PubMed] [Google Scholar]
  • 32.Wang W, Lee H, Fetzer SJ. Challenges and strategies of instrument translation. West J Nurs Res. 2006;28:310–321. doi: 10.1177/0193945905284712. [DOI] [PubMed] [Google Scholar]
  • 33.Hohmann E, Brand JC, Rossi MJ, Lubowitz JH. Expert opinion is necessary: Delphi panel methodology facilitates a scientific approach to consensus. Arthroscopy. 2018;34(2):349–351. doi: 10.1016/j.arthro.2017.11.022. [DOI] [PubMed] [Google Scholar]
  • 34.Reichenheim ME, Moraes CL. Operationalizing the cross-cultural adaptation of epidemiological measurement instruments. Rev Saude Publica. 2007;41:665–673. doi: 10.1590/S0034-89102006005000035. [DOI] [PubMed] [Google Scholar]
  • 35.McKenna HP. The Delphi technique: a worthwhile research approach for nursing? J Adv Nurs. 1994;19:1221–1225. doi: 10.1111/j.1365-2648.1994.tb01207.x. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used and/or analyses during the current study are available from the corresponding author on reasonable request.


Articles from BMC Nursing are provided here courtesy of BMC

RESOURCES