Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 Mar 23;18(3):e0282960. doi: 10.1371/journal.pone.0282960

Italian cross-cultural adaptation of the Quality of Communication questionnaire and the 4-item advance care planning engagement questionnaire

Ludovica De Panfilis 1, Simone Veronese 2, Marta Perin 1,3, Marta Cascioli 4, Mariangela Farinotti 5, Paola Kruger 6, Roberta M Zagarella 1,7, J R Curtis 8,9, Rebecca L Sudore 10,11, Elizabeth L Nielsen 8,9, Ruth A Engelberg 8,9, Andrea Giordano 5,*, Alessandra Solari 5; on behalf of the ConCure-SM project
Editor: Francesca Baratta12
PMCID: PMC10035811  PMID: 36952509

Abstract

Background

Advance care planning (ACP) is influenced by several factors (e.g., patient’s readiness to engage, clinician’s skills, and the cultural environment). Availability of reliable and valid self-reported measures of the ACP domains is crucial, including cross-cultural equivalence.

Aim

To culturally adapt into Italian the 19-item Quality of Communication (QOC) and the 4-item ACP Engagement (4-item ACP-E) questionnaires.

Methods

We translated and culturally adapted the two questionnaires and produced a significant other (SO) version of the QOC (QOC-SO). Each questionnaire was field tested via cognitive interviews with users: nine patients (QOC, 4-item ACP-E) and three SOs (QOC-SO) enrolled at three palliative care services.

Results

We made minor changes to 5/19 QOC items, to improve clarity and internal consistency; we changed the response option ‘didn’t do’ into ‘not applicable’. Finally, we slightly revised the QOC to adapt it to the paper/electronic format. QOC debriefing revealed that the section on end of life was emotionally challenging for both patients and SOs. We simplified the 4-item ACP-E layout, added a sentence in the introduction, and revised the wording of one item, to improve coherence with the Italian ACP legislation. ACP-E debriefing did not reveal any major issue.

Conclusions

Results were satisfactory in terms of semantic, conceptual and normative equivalence of both questionnaires. Acceptability was satisfactory for the 4-item ACP-E, while findings of the QOC cognitive debriefing informed a major amendment of a pilot trial protocol on ACP in multiple sclerosis (ConCure-SM): use of the interviewer version only, in an adaptive form. Psychometric testing of both questionnaires on a large, independent sample will follow.

Introduction

Advance care planning (ACP) is a process that “enables individuals who have decisional capacity to identify their values, to reflect upon the meanings and consequences of serious illness scenarios, to define goals and preferences for future medical treatment and care, and to discuss these with family and healthcare professionals” [1]. Consistent with the shared decision making model [2], ACP helps the patients to identify their own personal values and goals, understand their health status, and the treatment and healthcare options available. Moreover, it encourages discussion around end-of-life (EOL) care, a subject that is generally not considered part of healthcare planning, and one that is often avoided by both patients and health professionals. ACP involves many behaviors, including values identification, communication, and documentation; it is influenced by many factors, such as the patient’s readiness to engage, the clinician’s skills, the disease trajectory, and the cultural and logistic environment [3, 4]. Despite having been regulated for more than five years (Law 219/2017), ACP implementation in Italy remains negligible. In contrast, a recent survey showed that 88% (1752/2000) of Italian citizens considered the Law 219/2017 as quite or very important, and 76% had a positive attitude towards making/registering advance directives or ACP [5].

A multidisciplinary Delphi panel agreed on categorizing ACP outcomes into five domains: process (e.g. readiness to engage in ACP, prognostic awareness); action (e.g. decision on a surrogate, documentation of values and care preferences); quality of care (e.g. satisfaction with decision making); health status (e.g. mood symptoms, quality of life); and healthcare utilization (e.g. hospitalizations) [6]. Developing and sharing (self-reported) measures of the ACP domains that are acceptable, reliable, and valid, is crucial. Equally important is having these scales available in different languages, to allow consistent use of these instruments in different countries and cultures, for clinical and research purposes. Their availability in different languages is key for increasing equity of care, for the development of international research networks, and ultimately for strengthening research in this field.

ConCure-SM is an ongoing, multicenter project aimed to set up and evaluate the efficacy of an ACP intervention for multiple sclerosis patients in Italy. The intervention consists of a healthcare professional training program in shared decision-making and ACP, and use of a booklet during the ACP conversation. A range of measures are collected in the pilot/feasibility trial inscribed in the project (trial registration number: ISRCTN48527663) in order to capture the full process of ACP and to assess whether the intervention has any effect on completion of an advance care plan document (primary outcome measure), congruence in treatment preferences between patients and their caregivers, quality of patient–clinician communication and caregiver burden [7]. Of these, two self-reported measures, the 19-item Quality of Communication (QOC) questionnaire [8] and the 4-item ACP-Engagement (4-item ACP-E) questionnaire [6] were not available in Italian. We translated-adapted these two questionnaires. Moreover, to assess the communication skills of the physician involved in the ACP conversation considering the perspective of all the participants–the patient, the physician and, when applicable, the patient’s significant other (SO), we devised a SO version (QOC-SO) and a physician version (QOC-Doc, not presented here) from the Italian version of the patient self-assessed QOC [7].

The objective of the present study was to culturally translate and adapt into Italian the 19-item QOC and the 4-item ACP-E questionnaires.

Materials and methods

The study protocol was approved by the Ethics Committees of the Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan (FINCB; clearance number: 83/2021) and the Azienda USL—IRCCS di Reggio Emilia (clearance number: 2021/0080829). All subjects gave their written consent and all procedures followed the Declaration of Helsinki.

The questionnaires

Developed from qualitative studies with patients and clinicians, the QOC belongs to the ACP ‘quality of care’ domain [9]. The questionnaire (version 1.0) gauges the communication competences of the physician, and is interviewer-administered. This initial version of the QOC consists of 17 items measuring general communication (9 items) and communication about EOL care (8 items); included are also two items providing an assessment of the physicians’ overall communication skills [8, 10]. Each item is rated on a scale from 0 (‘very worst I can imagine’/ ‘not at all’) to 10 (‘very best I can imagine’/ ‘extremely’). Additional response items include “doctor didn’t do” or “don’t know”. If the respondent endorses “doctor didn’t do”, the item is assigned a value of “0”. This assignment was based on the assumption that, because all of the items identified important aspects of EOL communication, the failure to complete or address an item warranted a low score [11]. Two QOC scores are obtained by summing item responses, the range of possible scores being 0 (lowest skills) to 60 (highest skills) for ‘general communication skills’ (items 1, 2, 4, 5, 6, 7), and 0 to 70 for ‘communication about EOL care’ (items 8, 9, 10, 11, 13, 14, 16) [8].

Originally developed as an 82-item (50-minutes administration time) questionnaire measuring the complex behavior of ACP, the ACP-E is available in shorter versions (55-item, 34-item, 9-item, 4-item) [12]. The shorter versions worked well in a cohort of 986 English- and Spanish-speaking old adults from a US county hospital, and were able to detect within- and between-group changes comparable with the 82-item version [13]. Specifically, we were interested in the 4-item version, which assesses the readiness behavior change construct within the ACP ‘process’ domain [12]. The 4-item ACP-E responses are on a 5-point Likert scale: (1) ‘I have never thought about it’; (2) ‘I have thought about it, but I am not ready to do it’; (3) ‘I am thinking about doing it in the next 6 months’; (4) ‘I am definitely planning to do it in the next 30 days’; (5) ‘I have already done it’ [14]. The total score is the average of the four item responses, and ranges from 1 (lowest engagement) to 5 (highest engagement).

Cross-cultural adaptation

Following the International Society for Pharmacoeconomics and Outcomes Research Translation-Cultural Adaptation (ISPOR TCA) Task Force guidelines [15], we cross-culturally adapted the two questionnaires in five subsequent steps:

  1. Forward translation: two qualified translators, both living in Italy, produced two independent translations. A panel consisting of the translators, a palliative care physician (S.V.), a psychologist (A.G.), a neurologist (A.S.), an expert patient (P.K.), and a lay person (M.F.) reviewed the forward translations (meeting 1) and a reconciled version was produced. Besides the professional translators, all the panel members were fluent in English. The panel was established for over 10 years except for S.V. and P.K., who joined more recently; both had previous experience of translation-adaptation.

  2. Backward translation: the reconciled version generated in step 1 was independently translated back into US English by a third qualified translator, living in Italy. The backward translation was produced without access to the original version and without consulting the other translators.

  3. Pre-final version: in a meeting (meeting 2) between those participating in step 1 and the backward translator, the backward translation was compared with the original, and further refinements to the Italian version were made. Differences were resolved by consensus, and a pre-final version was agreed.

  4. Expert feedback: The pre-final version was read by an Italian researcher and clinical bioethicist (L.D.P.) who provided the translation panel comments and feedback on its coherency with the Law 219/2017. Finally, feedback was obtained from each questionnaire’s authors. They received the translation grid, the backward translation produced by the translation panel, and were asked to compare the original questionnaire with the backward translation to identify any critical issues. The authors also received specific queries for items or instructions with problematic wording or conceptual ambiguities identified by the panel.

  5. Questionnaire refinement and devise of the QOC-SO: Each translated questionnaire was refined after the expert feedback, and proof read. A patient self-assessed and a SO version (QOC-SO) were produced from the interviewer-administered Italian version, as well as a physician version (QOC-Doc), the latter including only the last two items (items 18 and 19), assessing the overall communication skills of the physician [7].

Organization and documentation

The Unit of Neuroepidemiology at FINCB had responsibility for the translation-cultural adaptation methodology, devised the materials and procedures, asked permission and involved the questionnaire’s authors, and oversaw each stage of the process. Meetings 1 and 2 were held online (Teams conference system) and recorded. The original questionnaires are available at the University of Washington School of Medicine website [11], and the University of California ‘Prepare for your Care’ website [14].. The whole process is reported in a translation grid (S1 and S2 Files), which was available to each member of the panel before each meeting to facilitate discussion on the semantic, conceptual, and normative equivalence of the questionnaire introduction, items and response options. Challenging phrases, uncertainties and rationale of final decisions are reported in the translation grid. The grid also contains queries sent to the questionnaire’s authors, and their responses. After meeting 2, the translation grid was reviewed by each panel member and by the scale authors for validation.

Cognitive debriefing

Eligibility criteria

Participants (i.e., patients and SOs) were enrolled at three palliative care centers with inpatient, outpatient and home-based palliative care facilities; two centers are in Northern Italy (Reggio Emilia and Turin) and one in Central Italy (Spoleto).

Participants were selected using a purposeful sampling technique ensuring diversity in age and education. They were adults (age ≥18 years), fluent in Italian, and had provided written informed consent to participate in the study. Patients with severe cognitive compromise (clinical judgment), and those with impairments precluding communication were excluded. For each questionnaire, we pre-planned a minimum of five interviews according to Willis’ indications [16], and the modified Tourangeau model of cognitive aspects [17]. Patients debriefed the QOC questionnaire (interview or self-assessed version) and the 4-item ACP-E questionnaire. SOs debriefed the QOC-SO.

Procedure

The referring physician: a) informed the participant about the study and provided the informed consent form; b) confirmed that all the eligibility criteria were met; c) recorded on the clinical record form of the consenting patient the following information: gender, age, education, and current occupation. The interviewer recorded the following SO information: gender, age, education, current occupation, and relationship with the patient.

The interviews were face-to-face, via videoconference or on the phone based on participant’s preference. The interviewers (L.D.P., M.P., M.C.) used an interview guide previously drawn up and agreed by the study authors (S3 File); they took written notes (interviews were not recorded). The interviewer checked that all the eligibility criteria were satisfied. She invited the participant to complete the self-assessed questionnaires alone, or administered the QOC interviewer version. There followed a series of open-ended questions to explore the interviewee’s understanding of each questionnaire as a whole and considering each item, and response options. The interviewees were invited to offer alternative words or paraphrase statements, and they were asked about the questionnaire’s acceptability (length, layout, readability). The interviewers did not have any existing relationship with the participants.

Organization and documentation

The Bioethics Unit, Azienda USL—IRCCS di Reggio Emilia had responsibility for the qualitative study, devised the interview guides, trained the interviewers, and performed the qualitative analysis. Participants were recruited from three centers: the Palliative Care Unit, Azienda USL—IRCCS di Reggio Emilia; the Fondazione FARO, Turin; and the Hospice “La Torre sul Colle”, USL Umbria 2, Spoleto. Each center had responsibility for participant’s screening and enrollment, and recorded the general and clinical information.

Analysis

Continuous data were summarized using medians and ranges, while categorical data were described as numbers and frequencies.

Interview notes were reviewed independently by two researchers (L.D.P., R.M.Z.) using content analysis to identify areas of misunderstanding, and where modifications to wording or layout were indicated [18, 19]. The two reports were compared and discussed jointly by the two researchers, who produced a final report. We followed the consolidated criteria for reporting qualitative research (COREQ) [20]. S4 File reports the COREQ checklist for the current study.

Results

Cross-cultural adaptation

QOC: The translation-cultural adaptation process of the QOC is summarized in Table 1, and detailed in S3 File. The pre-final Italian version of the questionnaire, as well as the patient self-assessed and the SO version (QOC-SO) devised from it, are available at the FINCB website [21]..

Table 1. Overview of revisions made to the 19-item Quality of Communication questionnaire.

Original content Revised content Reason for change
‘Doctor [X]’ (introduction to item 1), ‘this doctor’ (introduction to items 18 and 19; item 19), and ‘your doctor’ (item 18) Il suo medico (‘your doctor’) in all instances To improve clarity and internal consistency
‘Feelings’ (item 8) Pensieri (thoughts/worries) To improve clarity
‘Didn’t do’ (response option) ‘Not applicable’ To improve consistency with the instructions
‘Please select the best number for each statement’ (introduction, instruction to items 18 and 19) Segni (‘tick’) in the paper, and selezioni (‘select’) in the electronic format To adapt to the format (paper or electronic)

Introduction/instructions

The translation of this section went smoothly.

Items

Fourteen of the 19 items (items 2, 5–7, 9–12, 14–19) were easily forward and back-translated, and comparison of the back translation with the original confirmed the equivalence of the Italian version with the original scale. As for the other items, the panel had problems regarding consistency in the wording (4 items) and semantic equivalence (one item). Specifically, in the original questionnaire, the doctor is named as ‘doctor [X]’ (introduction to item 1), ‘this doctor’ (introduction to items 18 and 19; item 19), and ‘your doctor’ (item 18). To increase consistency, in the pre-final Italian translation we used il suo medico (‘your doctor’) in all instances. The term ‘treatment’ (terapie) was present in items 3, 4 and 13 of the original questionnaire, while in the introduction the term was ‘medical care’ (assistenza—which is more comprehensive than terapie). The scale author confirmed that it was OK to have assistenza in the introduction and terapie in items 3/4/13. Lastly, the translation of the word ‘feelings’ was difficult to the panel. After the author clarified that the focus was the emotional component of the discussion, the panel agreed on pensieri (thoughts/worries).

Response options

No difficulties were found, except for the response option ‘didn’t do’, which the panel considered confounding and coincident with the ‘0’ score (‘The very worst I could imagine’) on the numeric scale. The answer ‘not applicable’ was considered as viable in case the behavior could not be assessed (e.g., on item 2, ‘Looking you in the eye’, by a visually impaired person or in a telephone consultation; on item 3, ‘Including your loved ones in decisions about your illness and treatment’, in a consultation where the patient is alone). Thus, the panel agreed to skip the response option ‘didn’t do’, and to add non valutabile (‘not applicable’).

Layout/format

The only revision was made to adapt the text to the administration format of the questionnaire, and concerned the expression ‘please select the best number for each statement’ (introduction, instruction on items 18 and 19). This expression was translated as selezioni (‘select’) in the electronic, and segni (‘tick’) in the paper format.

4-item ACP-E: The translation-cultural adaptation process of the 4-item ACP-E is summarized in Table 2, and detailed in S2 File. The pre-final Italian versions (patient self-assessed, and interviewer versions) are available at the FINCB website [22].

Table 2. Overview of revisions made to the 4-item ACP engagement questionnaire.
Original content Revised content Reason for change
‘Medical decision makers, or surrogates’ (introduction/instructions) ‘Fiduciario’ To improve coherence with the Italian ACP legislation
‘Medical treatments’ (trattamenti sanitari) is used in the introduction to topic 2, while ‘medical care’ (assistenza–a broader term in Italian) is used in questions 2 and 4. ‘Assistenza’ To improve clarity and internal consistency
Introduction/instructions The following sentence has been added: ‘For each statement, select the answer that describes at best your current situation’ (per ciascuna domanda, scelga la risposta che meglio descrive la sua situazione attuale). To improve clarity
Titles, sub-titles, numbering (of topics and items) Removal of contents not pertinent to the patient’s readiness domain To simplify the layout

Introduction/instructions

The translators had difficulties in translating ‘medical decision makers, or surrogates’. Following the bioethicist’s advice, the panel agreed that, consistently with the Law 219/2017, one specific Italian term should be used: fiduciario. This was considered acceptable in terms of cognitive demand as this technical term is explained thereafter in the questionnaire: ‘[…] a family member or friend who can make decisions for you if you were to become too sick to make your own decisions’. Another challenge was that, in the introduction to topic 2 (original questionnaire) the expression ‘medical treatments’ (trattamenti sanitari) is used, while in questions 2 and 4 it is ‘medical care’ (assistenza–a broader term in Italian). A query was generated to the ACP-E author, who agreed on using the broader expression consistently along the questionnaire. In addition, the panel made two main revisions to this section. First, the sentence ‘Please try to answer as honestly as you can’ and ‘Please give us your honest opinions’ were considered conceptually equivalent, and reported only once in the Italian version (repetition can be appropriate in longer versions of the ACP-E, see Layout paragraph below). Second, we added the following instruction at the end of this section: ‘For each statement, select the answer that describes at best your current situation’ (per ciascuna domanda, scelga la risposta che meglio descrive la sua situazione attuale). These changes were agreed on by the ACP-E author.

Questions

No difficulties were found, and the comparison of the back translation with the original confirmed the equivalence of the Italian 4-item ACP-E with the original scale. As a single remark concerning coherence with the Italian Law 219/2017, on item 1, the expression ‘one or more people’ was preferred to ‘a person or group of people’. In fact, in the Italian Law, when more than one medical decision maker is nominated by the patient, they are ordered and act individually, not as a group; if the first person on the list is not available, the second one is contacted, and so on.

Response options

No difficulties were found on any response option.

Layout

The layout and structure of the 4-item ACP-E is the same of the longer questionnaire versions. However, the panel noted that, in the shortest (4-item) version, this structure is disproportionate to the questionnaire contents [14]. Titles, sub-titles, numbering (of topics and items) increase the questionnaire complexity, particularly as the 4-item ACP-E focuses on the patient’s readiness domain only. Thus, the panel proposed a simplified layout in the Italian version [22]. These changes were agreed on by the ACP-E authors.

Cognitive debriefing

Between October 2021 and June 2022, a total of 14 patients and four SOs agreed to participate in the study. Of these, four patients and one SO did not participate due to personal or organizational issues. One patient left the study before receiving the interview (see below). The characteristics of participants are reported in Table 3. Six interviews were held by M.P., three by M.C., and three by L.D.P. The interview guides are reported in S3 File. The interviews lasted between 26 and 60 minutes.

Table 3. General and clinical data of participants in the cognitive debriefing.

One of the nine patients was not interviewed (she left the study after partial completion of the Quality of Communication questionnaire).

Patients (n = 9) Significant others (n = 3)
Characteristic No (%)
Age, years* 69 (42–89) 38 (35–70)
Women 4 (44%) 1 (33%)
Education (degree)
 Middle school 3 (33%) 0 (0%)
 High school 3 (33%) 2 (67%)
 University 3 (33%) 1 (33%)
Working status
 Retired 6 (66%) 1 (33%)
 Occupied (public officer, veterinary) 2 (22%) 2 (67%)
 Unemployed 1 (11%) 0 (0%)
Administration of the interview
 Face to face 7 (78%) 0 (0%)
 Online 1 (11%) 2 (67%)
 On the phone 1 (11%) 1 (33%)
Main diagnosis
 Cancer (kidney n = 2, rectum, bladder, liver, lung, prostate) 7 (78%)
 Heart failure 1 (11%)
 Echinococcosis 1 (11%)
Disease duration, months* 36 (7–72)
Relation with the patient
 Son 2 (67%)
 Friend and trustee 1 (33%)

* Median (min-max)

QOC and QOC-SO: We devised a QOC-SO from the pre-final Italian QOC, to be used in both interview and self-assessed administration [21]. After the first few interviews, it emerged that the items on physician’s communication about EOL care (items 10–17) and the item on physician’s overall EOL communication skills (item 18) were taxing to both patients and SOs. Specifically, one patient (Co005) did not complete items 10–18, and asked to re-schedule the interview; when contacted, she declined participation. One patient (Co004) completed the first seven items and then asked the interviewer to administer him the remaining. One patient and one SO completed the whole questionnaire, however during the interview they recommended a ‘researcher-assisted completion’ (Table 4). After discussion by the Steering Committee and Data Safety and Monitoring Committee of the ConCure-SM project, it was decided to complete the debriefing by using the interview version of the QOC (and the QOC-SO administered by the interviewer). In addition, this finding determined a major amendment in the protocol of the pilot trial (see Discussion). Both patients and SOs considered the questionnaire overall clear and understandable with some exceptions. They judged the response options clear and well differentiated, including the options ‘non saprei’ and ‘non valutabile’. They found the topic of patient-physician communication very important, including EOL communication. However, both types of respondents reported that the questionnaire’s contents were emotionally taxing. This was the case particularly for items 8–13, and 18 (Table 4). One patient initially found item 2 (‘looking into patient’s eyes’) as ‘strange’ and then ‘obvious’. Another patient appreciated this item, as an indicator of a good communication style. Two patients considered item 8 a bit difficult (one of them had to read again the item to fully get it). One patient considered items on patient’s values and beliefs not pertinent to the medical encounter, out of a long-lasting relation. Finally, three patients said that the physician was not expected to be competent on these issues.

Table 4. Main findings of the cognitive debriefing of the Quality of Communication scale.

SO, significant other.

Content Where in the scale Participant
Focusing on a specific physician can be challenging, particularly when followed in hospice or by a team Introduction: ’the doctor taking care of your condition’ Co007
Co012
Co015_SO
Co016_SO Co017_SO
Looking into patient’s eyes is a key element of communication Item 2 Co013
At first unexpected, then obvious issue (i.e. looking into patient’s eyes) Item 2 Co014
Statement difficult to understand, requires attentive reading Item 8 Co010
Same content, item 9 could be skipped Item 8 vs. 9 Co007 Co014
Content could be confused in the patient version Item 8 vs. 9 Co015_SO Co016_SO
’Aspettativa di vita‘ difficult to understand Item 10 Co012 Co014
Statement understandable after re-reading Item 13 Co010
Patient’s values and beliefs are not part of the patient-physician relationship, except for a long-lasting one Items 14–17 Co014
The physician is not expected to be competent on these issues, to be deserved e.g. to a psychologist or to a chaplain Items 14–17 Co004 Co012 Co014
Patients encounter many physicians in their disease trajectory Item 19 Co016_SO

4-item ACP-E: Patients considered the survey clear and understandable, and useful in the (advance) care process. They viewed the layout as adequate: repetitions, use of bold and underlined text, and large font size helped identification of the sessions, and brevity of the survey a plus. Patients recommended replacing self-completion with an ‘assisted administration’ for two main reasons: complexity related to ACP, and dealing with emotions. Concerning complexity, one patient (Co010) considered the introduction a bit difficult, including the phrase ‘there are no right or wrong answers’. The word ‘fiduciario’ was new to two patients (Co008, Co004), and both asked for additional explanation to the description reported in the body of the survey. One patient (Co007) who previously signed her advance directive document found the survey clear and easy to complete. She suggested to skip the English title of the survey.

Discussion

This paper reports the cross-cultural adaptation into Italian of two questionnaires addressing the ACP process, both developed in the US. Our adaptation framework was the ISPOR TCA Task Force guideline [15]. In order to ensure that the Italian version of the QOC and 4-item ACP-E are sensitive to the local context and norms while remaining equivalent to the original measure, we involved the questionnaire’s authors, as well as an Italian clinical bioethicist. The panel proposed some changes in order to simplify the layout and structure of the 4-item ACP-E, which focuses on the ACP patient’s readiness domain only. The cognitive debriefing of the QOC highlighted ways in which the QOC’s EOL communication items were found to be challenging, to both patients and SOs. To protect participants in the ConCure-SM pilot trial from the challenges of these items, we decided to make a major amendment to the trial protocol [7]. The amendment consisted in the use of the interviewer-administered version of the QOC/QOC-SO in an adaptive form: the section on communication about EOL care (8 items), and one item on the overall (EOL) communication skills of the physician are administered only to participants in whom this topic was addressed during the ACP conversation. We acknowledge that patient-clinician discordance on the occurrence of EOL discussions has been reported [23], and will further explore the acceptability of EOL items in the subsequent psychometric testing phase. We also acknowledge that cultural issues arose during the study. These include a lack of knowledge of the Italian ACP legislation, revealed by the fact that some respondents were unaware of the term ’fiduciario’. Another problem is the difficulty of talking about EOL in the Italian clinical context: although all enrolled patients suffered from progressive conditions, they expected their doctors to talk about possible treatments and care pathways, not about EOL. Death being a taboo topic, along with the superstitious belief that talking about something can evoke it, may contribute to this difficulty.

Publications on cross-cultural adaptation typically focus on the psychometric (i.e., statistical) properties of the instrument. The translation of self-reported outcome measures in the target culture are generally poorly documented, despite the fact that these are key components of instrument’s validity, and a prerequisite of measurement equivalence [15, 24, 25]. For this reason, and consistently with our recent policy [26, 27], we described the translation-cultural adaptation and cognitive debriefing phases in a dedicated paper. Important issues have emerged regarding the QOC, informing the development of an interview as well as a self-assessed version of the instrument. Concerning the 4-item ACP, we believe that the simplified layout can ease its administration and the assessment of ACP readiness in research and in routine patient care.

This study has some limitations. Specifically, we interviewed only three SOs, and data saturation was not discussed (S4 File).

Conclusions

The Italian adaptation of the QOC and 4-item ACP-E questionnaires were satisfactory in terms of semantic, conceptual and normative equivalence. Acceptability was satisfactory for the 4-item ACP-E, while the items on EOL of the QOC were emotionally taxing, suggesting the use of the interviewer version of the instrument. Psychometric testing of both questionnaires on a large, independent sample will follow.

Supporting information

S1 File. Translation grid QOC.

(PDF)

S2 File. Translation grid 4-ACP-E.

(PDF)

S3 File. Interview guide.

(PDF)

S4 File. COREQ checklist.

(PDF)

Acknowledgments

We are indebted to the patients and the significant others who provided their valuable input.

ConCure-SM project investigators

Steering Committee: M. Cascioli, L. De Panfilis, M.G. Grasso, A. Giordano, A. Lugaresi, E. Pucci (UOC Neurologia, ASUR Marche, Fermo, Italy), A. Solari, C. Solaro, S. Veronese, M. Bruzzone (The Italian Multiple Sclerosis Society, Genoa, Italy), P. Kruger, A. Gajofatto, F. Patti.

Data Safety and Monitoring Committee: K. Brazil (School of Nursing and Midwifery, Queen’s University of Belfast, Belfast, Northern Ireland, UK), B. Farsides (Brighton & Sussex Medical School, Falmer, Brighton, UK), L. Orsi (The Italian Society of Palliative Care (SICP), Milan, Italy;), C. Peruselli (SICP, Milan, Italy), and D. Oliver (The Tizard Centre, University of Kent, Canterbury, UK) (Chair).

Data Management and Analysis Committee: M. Farinotti (data manager), and A. Giordano.

Qualitative Analysis Panel: M. Cascioli, L. De Panfilis, L. Ghirotto (Qualitative Research Unit, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy), K. Mattarozzi (Department of Experimental, Diagnostic and Specialistic Medicine, School of Medicine, Alma Mater Studiorum University of Bologna, Italy), M. Perin, and S. Veronese.

Health Professional Training Panel: M. Cascioli, L. De Panfilis, K. Mattarozzi, E. Pucci, M. Rimondini (Section of Clinical Psychology, Department of Neuroscience, Biomedicine and Movement Sciences, University of Verona, Policlinico G.B. Rossi, Verona, Italy;), A. Solari, and S. Veronese.

Linguistic validation Panel: M. Farinotti, A. Giordano, P. Kruger, A. Solari, S. Veronese and three independent translators.

Enrolling Centers: Department of Neuroscience, Biomedicine and Movement Sciences, University of Verona; Unit of Neurology, Borgo Roma Hospital, Azienda Ospedaliera Universitaria Integrata Verona: A. Gajofatto, F. Gobbin, R. Orlandi; Department of Rehabilitation M. L. Novarese Hospital, Moncrivello, Vercelli: C. Solaro, E. Grange; Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia: L. De Panfilis, S. Montepietra, F. Sireci; UOSI Riabilitazione Sclerosi Multipla, IRCCS Istituto delle Scienze Neurologiche di Bologna; Dipartimento di Scienze Biomediche e Neuromotorie, Università di Bologna, Bologna: A. Lugaresi, L. Sabbatini, C. Scandellari, E. Ferriani; Fondazione IRCCS Santa Lucia, Roma: M.G. Grasso, G. Presicce; University Hospital Policlinico Vittorio Emanuele, Catania: F. Patti, C.G. Chisari, S. Toscano.

Data Availability

All relevant data are within the paper and its Supporting information files.

Funding Statement

This research was funded by Fondazione Italiana Sclerosi Multipla (FISM; aism.fism.it), grant no. 2020/R-Multi/024 to A.S, and partially supported by the Italian Ministry of Health (RRC). R.L.S. is funded in part by the National Institute on Aging, National Institutes of Health (K24AG054415).The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Rietjens JAC, Sudore RL, Connolly M, van Delden JJ, Drickamer MA, Droger M, et al. ; European Association for Palliative Care. Definition and recommendations for advance care planning: an international consensus supported by the European Association for Palliative Care. Lancet Oncol. 2017;18: e543–e551. doi: 10.1016/S1470-2045(17)30582-X [DOI] [PubMed] [Google Scholar]
  • 2.Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, et al. Shared decision making: a model for clinical practice. J Gen Intern Med. 2012;27: 1361–1367. doi: 10.1007/s11606-012-2077-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Sudore RL, Schillinger D, Katen MT, Shi Y, Boscardin WJ, Osua S, et al. Engaging diverse English- and Spanish-speaking older adults in advance care planning: the PREPARE randomized clinical trial. JAMA Intern Med. 2018;178: 1616–1625. doi: 10.1001/jamainternmed.2018.4657 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bernacki RE, Block SD; American College of Physicians High Value Care Task Force. Communication about serious illness care goals: a review and synthesis of best practices. JAMA Intern Med. 2014;174: 1994–2003. doi: 10.1001/jamainternmed.2014.5271 [DOI] [PubMed] [Google Scholar]
  • 5.De Panfilis L, Rossi PG, Mazzini E, Pistolesi L, Ghirotto L, Noto A, et al. Knowledge, opinion, and attitude about the Italian law on advance directives: a population-based survey. J Pain Symptom Manage. 2020;60: 906–914.e4. doi: 10.1016/j.jpainsymman.2020.06.020 [DOI] [PubMed] [Google Scholar]
  • 6.Sudore RL, Heyland DK, Lum HD, Rietjens JAC, Korfage IJ, Ritchie CS, et al. Outcomes that define successful advance care planning: a Delphi panel consensus. J Pain Symptom Manage. 2018;55: 245–255.e8. doi: 10.1016/j.jpainsymman.2017.08.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.De Panfilis L, Veronese S, Bruzzone M, Cascioli M, Gajofatto A, Grasso MG, et al. Study protocol on advance care planning in multiple sclerosis (ConCure-SM): intervention construction and multicentre feasibility trial. BMJ Open. 2021;11: e052012. doi: 10.1136/bmjopen-2021-052012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Engelberg R, Downey L, Curtis JR. Psychometric characteristics of a quality of communication questionnaire assessing communication about end-of-life care. J Palliat Med. 2006;9: 1086–1098. doi: 10.1089/jpm.2006.9.1086 [DOI] [PubMed] [Google Scholar]
  • 9.Curtis JR, Patrick DL, Caldwell E, Greenlee H, Collier AC. The quality of patient-doctor communication about end-of-life care: a study of patients with advanced AIDS and their primary care clinicians. AIDS. 1999;13: 1123–1131. doi: 10.1097/00002030-199906180-00017 [DOI] [PubMed] [Google Scholar]
  • 10.Curtis JR, Engelberg RA, Nielsen EL, Au DH, Patrick DL. Patient-physician communication about end-of-life care for patients with severe COPD. Eur Respir J. 2004;24: 200–205. doi: 10.1183/09031936.04.00010104 [DOI] [PubMed] [Google Scholar]
  • 11.Quality of Communication Questionnaire. http://depts.washington.edu/eolcare/pubs/wp-content/uploads/2011/08/qoc-online-version-rev.pdf. Accessed 1 March 2023.
  • 12.Sudore RL, Heyland DK, Barnes DE, Howard M, Fassbender K, Robinson CA, et al. Measuring advance care planning: optimizing the advance care planning engagement survey. J Pain Symptom Manage. 2017;53: 669–681.e8. doi: 10.1016/j.jpainsymman.2016.10.367 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Shi Y, Barnes DE, Boscardin J, You JJ, Heyland DK, Volow AM, et al. Brief English and Spanish survey detects change in response to advance care planning interventions. J Pain Symptom Manage. 2019;58: 1068–1074.e5. doi: 10.1016/j.jpainsymman.2019.09.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Advance Care Planning Engagement Survey. 4-item ACP-Engagement. https://prepareforyourcare.org/documents/Advance-Care-Planning-Engagement-Survey-English-Spanish.pdf. Pages 9–12. Accessed 1 March 2023.
  • 15.Wild D, Eremenco S, Mear I, Martin M, Houchin C, Gawlicki M, et al. Multinational trials-recommendations on the translations required, approaches to using the same language in different countries, and the approaches to support pooling the data: the ISPOR Patient-Reported Outcomes Translation and Linguistic Validation Good Research Practices Task Force report. Value Health. 2009;12: 430–440. doi: 10.1111/j.1524-4733.2008.00471.x [DOI] [PubMed] [Google Scholar]
  • 16.Willis GB. Cognitive Interviewing: A Tool for Improving Questionnaire Design. Sage publication: Thousand Oaks, California, USA; 2005. [Google Scholar]
  • 17.Tourangeau R. Cognitive Aspects of Survey Measurement and Mismeasurement. Int J Public Opin Res. 2003;15:3–7. doi: 10.1093/ijpor/15.1.3 [DOI] [Google Scholar]
  • 18.Denzin NK, Lincoln YS. Handbook of Qualitative Research, 2nd ed. London: Sage; 2000. [Google Scholar]
  • 19.Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003;12: 229–238. doi: 10.1023/a:1023254226592 [DOI] [PubMed] [Google Scholar]
  • 20.Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19: 349–357. doi: 10.1093/intqhc/mzm042 [DOI] [PubMed] [Google Scholar]
  • 21.Italian Quality of Communication questionnaire. https://www.istituto-besta.it/neuroepidemiologia-questionari-e-scale. Accessed 1 March 2023.
  • 22.Italian 4-item ACP-Engagement. https://www.istituto-besta.it/neuroepidemiologia-questionari-e-scale. Accessed 1 March 2023.
  • 23.Modes ME, Engelberg RA, Downey L, Nielsen EL, Curtis JR, Kross EK. Did a Goals-of-Care discussion happen? Differences in the occurrence of Goals-of-Care discussions as reported by patients, clinicians, and in the electronic health record. J Pain Symptom Manage. 2019;57: 251–259. doi: 10.1016/j.jpainsymman.2018.10.507 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Prinsen CAC, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27: 1147–1157. doi: 10.1007/s11136-018-1798-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, et al. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27: 1171–1179. doi: 10.1007/s11136-017-1765-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Solari A, Giordano A, Kasper J, Drulovic J, van Nunen A, Vahter L, et al. Role preferences of people with Multiple Sclerosis: image-revised, computerized self-administered version of the Control Preference Scale. PLoS One. 2013;8: e66127. doi: 10.1371/journal.pone.0066127 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Giovannetti AM, Pöttgen J, Anglada E, Menéndez R, Hoyer J, Giordano A, et al. Cross-country adaptation of a psychological flexibility measure: The Comprehensive Assessment of Acceptance and Commitment Therapy Processes. Int J Environ Res Public Health. 2022;19: 3150. doi: 10.3390/ijerph19063150 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Francesca Baratta

1 Feb 2023

PONE-D-22-30497Italian cross-cultural adaptation of the Quality of Communication questionnaire and the 4-item Advance Care Planning Engagement questionnairePLOS ONE

Dear Dr. Giordano,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 18 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Francesca Baratta, PharmD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following financial disclosure:

"This research was funded by Fondazione Italiana Sclerosi Multipla (FISM; aism.fism.it), grant no. 2020/R-Multi/024 to A.S, and partially supported by the Italian Ministry of Health (RRC). R.L.S. is funded in part by the National Institute on Aging, National Institutes of Health (K24AG054415)."             

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

If this statement is not correct you must amend it as needed.

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

3. Thank you for stating the following in the Competing Interests section:

"A.S. reports grants from the Italian Multiple Sclerosis Foundation (FISM) and the European Academy of Neurology, during the conduct of the study; she serves as board member for Merck Serono, and received personal fees from Almirall and Merck Serono, outside the submitted work."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: At the end of your introduction, state the objective of your research instead of what is written in the last paragraph “ For each questionnaire, the linguistic validation encompasses two main actions: translation97 adaptation of the QOC and ACP-E inventories into Italian; psychometric validation. Here we report the results of the first action”.

The main aspect of the paper that can improve is the presentation of the cross-cultural adaptation (Results from page 9-12). Is it possible to create Tables to explain: what items were modified, why and how?

The conclusion should summarise your main results. Avoid citing references in your conclusion.

Reviewer #2: The authors translated and cross-culturally validated the Italian the Quality of Communication (QOC) and the 4-item ACP Engagement (4-item ACP-E). Their results in 14 subjects showed satisfactory semantic, conceptual and normative equivalence. Below my comments.

The authors report that “For each questionnaire, the linguistic validation encompasses two main actions: translation adaptation of the QOC and ACP-E inventories into Italian; psychometric validation”. But they claim to report only the first part (i.e. Translation and adaptation). Why did the authors decide not to report the results of the psychometric properties? Even if the questionnaire has been transculturally translated, if we do not know the psychometric properties (such as reliability and validity) we cannot use it with our patients and therefore the repercussions in clinical practice are very low. I highly recommend reporting the psychometric results as well. Furthermore, I have hardly read of papers reporting only the assessment of cross-cultural validity; these results are usually reported together with the validity and reliability results, to improve the application of the results in clinical practice.

The authors report that “the ACP-E is available in shorter versions (55-item, 34-item, 9-item, 4-item) … Specifically, we were interested in the 4-item version”. What are the reasons that led the authors to prefer the 4-item version? Why didn't they consider translating the entire completed questionnaire?

Information on the structure of the questionnaire is missing. For example, there is no information about the scores for each item and the calculation of the total score

The authors included only 14 patients in the cognitive de briefing. Typically, guidelines for cross-cultural validation suggest including 30 patients. Why did the authors only include 14 of them?

Reviewer #3: Peer-Review PONE-D-22-30497

Dear authors,

Thank you for submitting your manuscript to the journal PLOS ONE. This is a well-prepared and thorough investigation of the content validity of the Italian translations of two questionnaire relevant for supporting Advance Care Planning. I only have very minor comments below.

Clinical relevance of the questionnaires

In the introduction, you explain about ACP - what it is, its elements etc. You also specify that the two questionnaires be used for clinical and research purposes (page 4, line 82/83). I would recommend being a bit more specific regarding the use cases you envisage. Are you translating the questionnaires for evaluation purposes of ACP interventions? Or are you planning to bring them into clinical practice? If yes, in which setting? How is shared decision making going to happen with the aid of these questionnaires?

You can also specify this in the discussion section, not in the background section if you felt it would sit better there.

Methods

You are very comprehensive when it comes to explaining your methods. Although you specify the methods for cognitive interviewing and you also specify the analysis methods, I was missing the framework of Tourangeau being applied to the data. From the results and how they are reported, I would expect you probably used Tourangeau. It might be worth mentioning him and his framework.

Discussion/article

Your aim is the cross-cultural adaptation of the two ACP questionnaires. You do a very thorough translation process. However, although cultural issues are implicitly mentioned in the results, the discussion section then does not make them explicit. You present a lot of evidence in the background on the Italian's readiness to endorse ACP. You also describe the health care system's lack in responding to this need. You describe the "emotionally taxing" nature of some of the items. I was wondering whether it would be possible to explicitly discuss cultural issues and how they reflect on the construct ACP the questionnaire want to measure. After all, achieving translations that are faithful to the original definition and measurement of the construct is one of the aims of a cross-cultural adaptation. The other might be to learn more about once culture and, in reflection, about the construct under investigation. Results from cross-cultural adaptations of questionnaires can feed back into further develop the content validity of the questionnaires. I was missing a section in the discussion to do just that - a bit of reflection on the general content validity of the two questionnaires.

Minor comment

In the introduction section, you often speak of "his/her own personal values" or "his/her health". It is common to do a gender-neutral pronoun in plural in English in these situations (at least in publications, not in the actual questionnaires). Page 4, line 66 could better read as "ACP helps the patient to identify their own personal values and goals, understand their health..."

Otherwise, this was an engaging, clearly structured and methodologically thoroughly prepared study. What a pleasure to read!

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Leonardo Pellicciari

Reviewer #3: Yes: Christina Ramsenthaler

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Mar 23;18(3):e0282960. doi: 10.1371/journal.pone.0282960.r002

Author response to Decision Letter 0


6 Feb 2023

Reviewer #1:

At the end of your introduction, state the objective of your research instead of what is written in the last paragraph “For each questionnaire, the linguistic validation encompasses two main actions: translation adaptation of the QOC and ACP-E inventories into Italian; psychometric validation. Here we report the results of the first action”.

R: We have revised the last sentence of the introduction as suggested.

The main aspect of the paper that can improve is the presentation of the cross-cultural adaptation (Results from page 9-12). Is it possible to create Tables to explain: what items were modified, why and how?

R: We have added two tables to summarize the changes made in the QOC (Table 1) and 4-item ACP-E (Table 2).

The conclusion should summarise your main results. Avoid citing references in your conclusion.

R: We have revised the conclusion as suggested.

Reviewer #2:

The authors report that “For each questionnaire, the linguistic validation encompasses two main actions: translation adaptation of the QOC and ACP-E inventories into Italian; psychometric validation”. But they claim to report only the first part (i.e. Translation and adaptation). Why did the authors decide not to report the results of the psychometric properties?

R: We purposely focused on a research phase that is usually poorly documented: translation and cultural adaptation (and cognitive debriefing). We have aired this in the discussion section.

Even if the questionnaire has been transculturally translated, if we do not know the psychometric properties (such as reliability and validity) we cannot use it with our patients and therefore the repercussions in clinical practice are very low. I highly recommend reporting the psychometric results as well. Furthermore, I have hardly read of papers reporting only the assessment of cross-cultural validity; these results are usually reported together with the validity and reliability results, to improve the application of the results in clinical practice.

R: The psychometric testing phase is currently ongoing and will be reported in a separate manuscript.

The authors report that “the ACP-E is available in shorter versions (55-item, 34-item, 9-item, 4-item) … Specifically, we were interested in the 4-item version”. What are the reasons that led the authors to prefer the 4-item version? Why didn't they consider translating the entire completed questionnaire?

R: We were interested in the 4-item version of the 4-item ACP-E as: (a) it had good sensitivity to change compared to longer versions in a large trial involving US English- and Spanish-speaking old adults (PREPARE study, ref. 12); (b) it assesses the readiness behavior change construct within the ACP ‘process’ domain (ref. 11); (c) administration burden is limited. We have described this in the materials and methods section.

Information on the structure of the questionnaire is missing. For example, there is no information about the scores for each item and the calculation of the total score

R: Following reviewer’s advice, we have added (methods section) the scoring rules for the two scales.

The authors included only 14 patients in the cognitive de briefing. Typically, guidelines for cross-cultural validation suggest including 30 patients. Why did the authors only include 14 of them?

R: As from the ISPOR Task Force, we applied cognitive debriefing, which involves a small group of 5-6 subjects. We guess that the reviewer refers to pilot testing instead, which requires 30–40 subjects.

Reviewer #3: Peer-Review PONE-D-22-30497

Clinical relevance of the questionnaires

In the introduction, you explain about ACP - what it is, its elements etc. You also specify that the two questionnaires be used for clinical and research purposes (page 4, line 82/83). I would recommend being a bit more specific regarding the use cases you envisage. Are you translating the questionnaires for evaluation purposes of ACP interventions? Or are you planning to bring them into clinical practice? If yes, in which setting? How is shared decision making going to happen with the aid of these questionnaires?

You can also specify this in the discussion section, not in the background section if you felt it would sit better there.

R: We have described (introduction section) that we are using the QOC and the 4-item ACP-E for evaluation purposes of an ACP intervention (ConCure-SM). Following reviewer’s advice, we have expanded the description of the ConCure-SM intervention and feasibility trial to clarify the context in which the two instruments are being used.

Methods

You are very comprehensive when it comes to explaining your methods. Although you specify the methods for cognitive interviewing and you also specify the analysis methods, I was missing the framework of Tourangeau being applied to the data. From the results and how they are reported, I would expect you probably used Tourangeau. It might be worth mentioning him and his framework.

R: We thank the reviewer for her comment. We do confirm that we pre-planned the interviews according to Willis' indications [14], and the modified Tourangeau model of cognitive aspects [15]. We have now slightly changed the text, accordingly.

Discussion/article

Your aim is the cross-cultural adaptation of the two ACP questionnaires. You do a very thorough translation process. However, although cultural issues are implicitly mentioned in the results, the discussion section then does not make them explicit. You present a lot of evidence in the background on the Italian's readiness to endorse ACP. You also describe the health care system's lack in responding to this need. You describe the "emotionally taxing" nature of some of the items. I was wondering whether it would be possible to explicitly discuss cultural issues and how they reflect on the construct ACP the questionnaire want to measure. After all, achieving translations that are faithful to the original definition and measurement of the construct is one of the aims of a cross-cultural adaptation. The other might be to learn more about once culture and, in reflection, about the construct under investigation. Results from cross-cultural adaptations of questionnaires can feed back into further develop the content validity of the questionnaires. I was missing a section in the discussion to do just that - a bit of reflection on the general content validity of the two questionnaires.

R: In the discussion section, we have now made explicit the main cultural issues that emerged during the cross-cultural adaptation process: “We also acknowledge that cultural issues arose during the study. These include a lack of knowledge of the Italian ACP legislation, revealed by the fact that some respondents were unaware of the term 'fiduciario'. Another problem is the difficulty of talking about EOL in the Italian clinical context: although all enrolled patients suffered from progressive conditions, they expected their doctors to talk about possible treatments and care pathways, not about EOL. Death being a taboo topic, along with the superstitious belief that talking about something can evoke it, may contribute to this difficulty.”

Minor comment

In the introduction section, you often speak of "his/her own personal values" or "his/her health". It is common to do a gender-neutral pronoun in plural in English in these situations (at least in publications, not in the actual questionnaires). Page 4, line 66 could better read as "ACP helps the patient to identify their own personal values and goals, understand their health..."

R: We have changed the sentence as suggested.

Otherwise, this was an engaging, clearly structured and methodologically thoroughly prepared study. What a pleasure to read!

R: We thank the reviewer for her appreciation of the study.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Francesca Baratta

28 Feb 2023

Italian cross-cultural adaptation of the Quality of Communication questionnaire and the 4-item Advance Care Planning Engagement questionnaire

PONE-D-22-30497R1

Dear Dr. Giordano,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Francesca Baratta, PharmD, PhD

Academic Editor

PLOS ONE

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I thank the authors for their efforts to answer my questions. I agree that the purpose of the paper is to describe the cross-cultural validation process. Unfortunately, in this form the results of this study have limited application in clinical practice. Having the validity and reliability data available allows clinicians to be able to use this tool. I hope these results will be available soon.

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: Yes: Leonardo Pellicciari

Reviewer #3: Yes: Christina Ramsenthaler

**********

Acceptance letter

Francesca Baratta

15 Mar 2023

PONE-D-22-30497R1

Italian cross-cultural adaptation of the Quality of Communication questionnaire and the 4-item Advance Care Planning Engagement questionnaire

Dear Dr. Giordano:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Francesca Baratta

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Translation grid QOC.

    (PDF)

    S2 File. Translation grid 4-ACP-E.

    (PDF)

    S3 File. Interview guide.

    (PDF)

    S4 File. COREQ checklist.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES