Abstract
Background
The Pulmonary Embolism Quality of Life (PEmb-QoL) questionnaire is the first disease-specific scale for assessing the quality of life in patients with a history of pulmonary embolism (PE).
Objectives
To assess the cross-cultural validity and reliability of the disease-specific PEmb-QoL questionnaire.
Methods
The Persian version was prepared through the forward and backward translation of the English questionnaire. Six months after the diagnosis of acute PE, consecutive Persian-speaking patients were asked to complete the PEmb-QoL, the generic 36-item Short Form (SF-36) questionnaires and undertake a 6-minute walk test (6MWT). Acceptability was assessed via item missing rate, reproducibility by the test-retest method, and internal consistency reliability by Cronbach’s α and McDonald’s ω coefficients. Convergence validity was assessed using the Spearman rank correlation between scores of PEmb-QoL, SF-36, and 6MWT. The questionnaire structure was evaluated through exploratory factor analysis.
Results
Ninety-six patients with a confirmed diagnosis of PE completed the questionnaires. The Persian version of PEmb-QoL had good internal consistency (α = 0.95, 3-factor ω = 0.96), inter-item correlation (0.3–0.62), item-total correlation (0.38–0.71), reproducibility (test-retest ICC with 25 participants = 0.92–0.99), and good discriminant validity. Convergence validity was confirmed by the moderate-to-high correlations between PEmb-QoL and SF-36 scores, and a good correlation between the “limitation in daily activities” dimension of the PEmb-QoL questionnaire and 6MWT results. Exploratory factor analysis suggested a 3-component structure with functional (items 1h, 4b-5d, 6, 8, 9i, and 9j), symptoms (1b-h, 7, and 8), and emotional (5a, 6, and 9a-h) components.
Conclusion
The Persian version of the PEmb-QoL questionnaire is valid and reliable for measuring the disease-specific quality of life in patients with PE.
Keywords: pulmonary embolism, quality of life, patient-reported outcome measures, surveys and questionnaires, psychometrics, reproducibility of results
Graphical abstract
Essentials
-
•
Pulmonary embolism (PE) has been shown to impact different aspects of the quality of life (QoL).
-
•
PE quality of life (PEmb-QoL) is a disease-specific survey for patients with PE.
-
•
Cross-cultural validity and reliability of PEmb-QoL were confirmed in a Persian-speaking cohort.
-
•
Minor adjustments in dimensions and their constituent items were required.
1. Introduction
The post-pulmonary embolism (PE) syndrome is defined as new or progressive dyspnea, exercise intolerance, and/or impaired functional or mental status after at least 3 months of adequate anticoagulation following acute PE, which cannot be explained by other (preexisting) comorbidities [[1], [2], [3]]. Although the extent of the disability varies in different populations [4], nearly half of the patients will have persistent dyspnea, with 11% suffering from moderate-to-severe functional limitations [5]. The chronic complications of acute PE are also taxing on one’s psychological and social status. The long-term risk of purchasing psychotropic drugs is substantially increased in adolescents with a history of PE, with more than a quarter of the previously employed patients not returning to work even one year after the initial PE episode [[6], [7], [8]].
Previous statements highlight that the chronic complications actually experienced following acute PE go well beyond the implications of clinically measured outcomes such as RV dysfunction and pulmonary hypertension [4,9,10]. Therefore, valuable information concerning patients’ well-being would be lost if information acquisition is channeled only through the narrow scope of clinical and paraclinical evaluations [11]. Direct formal inquiry of patients’ experiences through adequately validated patient-reported outcome (PRO) measures also confers the advantage of negating interobserver variability and is, thus, potentially more reliable than when such experiences are informally inquired, interpreted, and reported by third parties [12].
Health-related quality of life is a multidimensional construct encompassing one’s self-perception of, at a minimum, physical, emotional, and social well-being [13]. It is usually assessed using both generic and specific PRO questionnaires. Whereas generic questionnaires allow comparison between different populations irrespective of their underlying conditions, condition-specific questionnaires are more sensitive to changes in the frequency and severity of specific outcomes, making them the instrument of choice for evaluating the impacts of therapeutic and rehabilitation strategies [14].
Pulmonary embolism quality of life (PEmb-QoL) questionnaire is the first and currently the only disease-specific PRO instrument for patients with a history of PE. The questionnaire was developed in Dutch, cross-culturally validated in several other languages, and is part of the recently developed core set of outcome measures for patients with PE [11,[15], [16], [17], [18], [19], [20]]. Our study aimed to prepare the first Persian-translation PEmb-QoL, provide an ad hoc evaluation of its psychometric properties, and adjust its structure based on a Persian-speaking PE patient population in Iran.
2. Methods
Our study aimed to prepare the Persian version of PEmb-QoL based on the English version and then evaluate its psychometric properties (acceptability, reliability, and validity) as to whether it is an appropriate instrument for measuring PE-related quality of life.
2.1. Study setting and participants
All Persian-speaking surviving patients with records in the Pulmonary Emboli Registry of Rajaie Cardiovascular Medical and Research Center (RHC-PE) between September 2015 and August 2018 were invited via phone calls to participate in the present prospective study. The RHC-PE registry is an all-comers cohort of patients with a confirmed diagnosis of PE [21]. Briefly, PE was diagnosed mainly via computed tomography pulmonary angiography. The baseline demographic and clinical characteristics were retrieved from the RHC-PE registry. All the information gathered was recorded during the index hospital admission. The risk stratification of the study population was performed according to the European Society of Cardiology guidelines for the diagnosis and management of acute PE [22]. The study protocol was approved by the Ethics Committee of the Rajaie Cardiovascular Medical and Research Center, and signed informed consent was obtained from all the study participants.
2.2. Data collection and follow-up
Each patient was scheduled for a structural 6-month follow-up program composed of detailed transthoracic echocardiography and a 6-minute walk test (6MWT). During the program, a QOL assessment was performed using the disease-specific PEmb-QoL and the generic 36-item Short Form (SF-36) survey over an interview session assisted by an experienced nurse.
2.3. Instruments
2.3.1. 36-Item Short Form (SF-36) survey
SF-36 is a widely used, generic, health-related QOL questionnaire validated in many disease cohorts and languages, including Persian [23]. The questionnaire covers 8 dimensions grouped into 2 summary components: physical and mental [24,25]. The detailed structure of the SF-36 questionnaire is depicted in Supplementary Figure S1. In this study, SF-36 scores were calculated according to the RAND scoring instructions [26].
2.3.2. PEmb-QoL questionnaire
Modeled based on the generic SF-36 and the disease-specific quality of life after acute DVT (VEINES-QOL/Sym) questionnaire, the PEmb-QoL was designed to assess disease-specific health-related QOL in patients with a history of acute PE [15]. It contains 40 items, 38 of which are on a Likert-type scale and are grouped into 6 dimensions, including frequency of complaints, limitations in the activities of daily living, work-related problems, social limitations, intensity of complaints, and emotional complaints. To calculate PEmb-QoL scores, responses to individual items were transformed into a 0–100 scale, with higher scores corresponding to worse health states [16]. This required reversing the scales for questions Q1, Q4, Q5, and Q9. Scores of the constituting items for each dimension were then averaged to produce dimension scores, while an average score of all questionnaire items produced the PEmb-QoL total summary score [20]. Questions Q2 (“At what time of day are your lung symptoms most intense?”) and Q3 (“Compared to 1 year ago, how would you rate the condition of your lungs in general now?”) were considered descriptive in nature and were not scored on a Likert scale. Thus, they were interpreted as is and not incorporated into the dimension scores. Item Q4a (“Do your lung symptoms limit your daily activities at work?”) was treated as missing if a patient had chosen the “I do not work” response [16].
2.4. Translation
A cardiovascular disease specialist proficient in both English and Persian-translated the validated English questionnaire into Persian (forward translation). The translation was converted back into English (backward translation) by 2 different cardiovascular disease specialists proficient in both languages without reviewing the original English version. Afterward, 5 independent experts in pulmonary vascular diseases reviewed and compared the Persian and English versions to ensure clarity and to address any inconsistencies. As the final step, minor adjustments were made to the preliminary translation based on a pilot study in which 20 native Persian-speaking patients were interviewed regarding the clarity of the items after they had completed the first questionnaire draft.
2.5. Psychometric analysis
Psychometric analysis was conducted according to the latest standard protocols [[27], [28], [29], [30], [31], [32], [33]].
2.6. Acceptability and reliability
Acceptability was assessed through the completeness of data (the missing item rate). Reliability was assessed in terms of consistency between the results of repeated measurements (reproducibility) and consistency between responses within the same measurement (internal consistency). Reproducibility was reported as an intraclass correlation via the test-retest method, where the respondents were invited back to our center 3 weeks after the initial QOL assessment to retake the PEmb-QoL questionnaire. The 3-week interval was selected to prevent recall and minimize the chance of clinical changes.
Cronbach’s α is considered an adequate measure of internal consistency for individual dimensions [34]. Still, given that multidimensional constructs do not conform well with the one-dimensionality assumption of Cronbach’s α, in the current investigation, McDonald’s ω was additionally provided for the totality of the questionnaire [35,36]. The evaluation of internal consistency was completed by reporting the association between the individual items (the inter-item correlation), the association between the items and their assigned dimensions (the corrected item-total correlation), and the association between the dimensions (the domain intercorrelation). Although coefficients of internal consistency larger than 0.8 are conventionally regarded as acceptable, a more detailed interpretation should consider that these measures are also influenced by the number of items in the subscale. Supplementary Table S1, extracted from the study by Ponterotto and Ruckdeschel [37], elaborates on the acceptable thresholds for coefficients of internal consistency based on the sample size and scale length.
The score distribution, along with the floor effect and the ceiling effect, was reported for the dimensions. The quality criteria for acceptability and reliability are summarized in Supplementary Table S2. Each item was examined vis-à-vis its frequency of endorsement (respondents who selected the same item response), skewness, corrected item-total correlation with its' corresponding dimensions, and Cronbach’s α of its dimension when the item was excluded. Ideally, fewer than 25% of the items should have negative skewness, while more than 75% should have a skewness value between −1 and 1 [38]. An item is considered for removal when doing so substantially improves α or when its' item-total correlation and frequency of endorsement are outside the range of 0.2 to 0.8 [29].
2.7. Validity
The content validity of the PEmb-QoL has been previously investigated with respect to measurement aims, concepts, target population, and item selection [15,39].
In the present study, construct validity was investigated in terms of convergent and discriminant validity. A PRO measure is expected to have relatively high correlations with other theoretically similar PRO and non-PRO measures (ie, convergent validity) while having relatively lower correlations with theoretically dissimilar measures (ie, discriminant validity) [32,40]. Thus, we expected moderate-to-high Spearman rank correlations between the dimensions of the disease-specific PEmb-QoL and their theoretically similar counterparts from the generic SF-36 questionnaire, as well as moderate-to-high correlations between the dimension of limitations in the activities of daily living and the 6MWT results. We also expected moderate-to-low correlations between the disease-specific PEmb-QoL scores with age, sex, obesity, cancer, and other cardiovascular comorbidities.
We further evaluated internal consistency, item selection, and questionnaire structure through exploratory factor analysis (EFA). EFA investigates the coherence of item responses to suggest an underlying structure for the questionnaire. We first used the Scree test to determine the appropriate number of latent factors (ie, dimensions) and then conducted EFA via a polychoric correlation matrix with the maximum likelihood estimation method. The polychoric correlation matrix was chosen over the conventionally used Pearson correlation, given that items with fewer than 5 to 7 response options (eg, items Q4 and Q5) could violate the linearity assumption of the Pearson correlation [[41], [42], [43]]. Finally, oblique rotation (Oblimin) was applied to account for the interconnected nature of the psychological constructs and to also maximize the distinction between the extracted factors [41,44].
The R programming statistical software version 4.1.3 was used with the tidyverse, Psych, GPArotation, ggcorrplot, and Ggally packages.
3. Results
3.1. Participants
Of 170 patients recruited in the RHC-PE registry, 98 agreed to complete the PEmb-QoL questionnaire. Two participants were excluded as they had responded to fewer than 75% of the items. The responses elicited from the remaining 96 participants had a minimal item missing rate (0.38%), with 6 participants having a total of 14 unresponded items. The details of the patient flow and exclusion criteria are depicted in Figure 1. Nearly half of the respondents were female. The median age of the participants was 54 years, and the obesity rate was 48%. The median (IQR) time interval between the first hospital admission due to PE and questionnaire submission was 6.1 months (IQR 5.4–7.1 months) (Table 1).
Figure 1.
Flow diagram of exclusion criteria. PEmb-QoL, Pulmonary Embolism Quality of Life questionnaire; RHC, Rajaie Cardiovascular Medical and Research Center; SF-36, 36-item Short Form Health Survey.
Table 1.
Baseline characteristics of the 96 included participants.
| Characteristics | N (%) or median (IQR) |
|---|---|
| Age (y) | 54 (38–66) |
| Female | 46 (48) |
| BMI (kg.m-2) | 28 (25.5–31.6) |
| Recurrent PE | 8 (8) |
| PE risk stratificationa | |
| Low risk | 25 (26) |
| Intermediate-low risk | 21 (22) |
| Intermediate-high risk | 31 (32) |
| High risk | 19 (20) |
| Cardiopulmonary comorbidityb | 15 (16) |
| Active malignancy | 4 (4) |
| Centrally located PEc | 42 (44) |
The ethnicity of all study participants was Iranian white. BMI, body mass index; PE, pulmonary embolism.
Risk stratification was performed based on the European Society of Cardiology guidelines for diagnosis and management of acute pulmonary embolism [22].
Patients with a history of systolic or diastolic dysfunction and/or obstructive lung disease.
Thrombi involving the main trunk of the pulmonary artery and/or left and right main pulmonary arteries.
3.2. Psychometric properties
Figure 2 presents the details of the score distribution for the total summary scale and dimensions of the PEmb-QoL. Although the total summary scale and the emotional complaint dimension exhibited neither a floor effect nor a ceiling effect, all the other dimensions had floor effects exceeding 15%, varying from 16.1% (for limitations in the activities of daily living) to 62.6% (for social limitations). Social limitations and work-related problems also exhibited ceiling effects of 4.3% and 25.8%, respectively.
Figure 2.
Score distribution of the PEmb-QoL total scale and subscales. Individual scores are jittered along the horizontal axis to allow visual distinction. Floor or ceiling effects <15% are desirable. Less than 25% of items should have negative skewness, and less than 25% should have a skewness outside of -1 to 1 range.
∗ Patients with the lowest possible score, ie, the best quality of life for the corresponding dimension.
† Patients with the highest possible score, ie, worst quality of life for the corresponding dimension. ADL, activities of daily living; FC, frequency of complaints; PEmb-QoL, Pulmonary Embolism Quality of Life questionnaire.
Our assessment indicated excellent internal consistency reliability for the Persian version of the PEmb-QoL questionnaire (α = 0.95, ω with 3 factors = 0.96). Internal reliability was high (α ≥ 0.81) for almost all the dimensions except the intensity of complaints (α = 0.6). All dimensions had appropriate mean-corrected item-total correlations, ranging between 0.43 and 0.71 (Table 2). Moreover, all PEmb-QoL dimensions showed moderate-to-strong domain intercorrelations. The weakest correlation was between the intensity of complaints and social limitations (r = 0.43) and, expectedly, the strongest between limitations in the activities of daily living limitations and work-related problems (r = 0.75) as well as between the frequency of complaints and the intensity of complaints (r = 0.76) (Figure 3).
Table 2.
Assessment of Internal reliability, discriminative ability, redundancy, and homogeneity.
| PEmb-QoL dimension | PEmb-QoL questions | Number of items | Cronbach’s α | Mean inter-item correlation | Mean-corrected item-total correlation |
|---|---|---|---|---|---|
| Frequency of complaints | Q1 | 8 | 0.83 | 0.38 | 0.56 |
| ADL limitations | Q4 | 13a | 0.94 | 0.53 | 0.70 |
| Work-related problems | Q5 | 4 | 0.86 | 0.62 | 0.71 |
| Social limitations | Q6 | 1 | — | — | — |
| Intensity of complaints | Q7,8 | 2 | 0.6 | 0.4 | 0.38 |
| Emotional complaints | Q9 | 10 | 0.81 | 0.3 | 0.48 |
| Pemb-QoL questionnaire | Q1,4,5,6,7,8,9 | 37a | 0.95 | 0.33 | 0.54 |
ADL, activities of daily living; PEmb-QoL, pulmonary embolism quality of life.
The PEmb-QoL questionnaire contained 38 Likert-type items; however, item Q4a was omitted from the reliability assessment due to the high number of participants with an “I do not work” response which was treated as a missing value. Q2 and Q3 are not Likert-type scales and were thus not included in the reliability analysis.
Figure 3.
Convergent and discriminant validity (top) and domain intercorrelation (bottom) of the PEmb-QoL questionnaire. A moderate-to-high correlation between the theoretically similar dimensions is desired. PEmb-QoL, Pulmonary Embolism Quality of Life questionnaire; SF-36, 36-Item Short Form Health Survey.
Supplementary Figure S2 depicts the response distribution for individual items. Negative skewness was observed only with items 4d (skewness −0.41) and 9d (skewness −0.08). However, only 22 scored items (58%) had skewness between −1 and 1. Item Q1a (“Pain behind or between the shoulder blades?”) had the lowest item-total correlation (r = 0.34). This item was also the only item that, upon removal, would improve the internal consistency of its designated dimension (α = 0.83 to α = 0.85).
Of the 96 included participants, 25 (26%) returned to complete the questionnaire for the second time. Compared to the primary respondent group, participants of the retest were, on average younger (55 years old vs 46.5 years old, P value = .02) and had more odds of being male (odds ratio = 2.85, P value = .05). The test-retest analysis indicated moderate-to-high intraclass correlations for all dimensions, ranging from 0.70 for work-related problems to 0.97 for the intensity of complaints (Table 3). The results of the acceptability and reliability analysis are summarized in Supplementary Table S2.
Table 3.
Test-retest reliability analysis with 25 participants.
| PEmb-QoL dimension | Intraclass correlation coefficient (95% confidence interval) |
|---|---|
| Frequency of complaints | 0.97 (0.92–0.99) |
| Activities of daily living limitations | 0.98 (0.95–0.99) |
| Work-related problems | 0.98 (0.96–0.99) |
| Social limitations | 0.96 (0.91–0.99) |
| Intensity of complaints | 0.92 (0.83–0.97) |
| Emotional complaints | 0.97 (0.93–0.99) |
Item 4a (“Daily activities at work”) was excluded from the EFA as the majority of the participants (65%) had chosen the “I do not work” response. The EFA yielded 3 latent factors, cumulatively accounting for 60% of the total observed variances (Figure 4). Factor 1 contained all items of activities of daily living limitations and work-related problems (4b-m and 5a-d). Factor 1 also incorporated item 1h, item 8 (“concerning the frequency and intensity of breathlessness”), item 6 (“Interference of lung symptoms with normal social activities?”), item 9i (“Felt limited in taking a trip?”), and item 9j (“Afraid of being alone?”). Factor 2 comprised items from the frequency of complaints (1b-g) and the intensity of complaints (item 7 and 8). Factor 3 contained item 5a, 6, and 9b-h. Item 1a (“Pain behind or between the shoulder blades?”) had poor loading values across the board, whereas items 1h, 6, and 8 had high loading values in more than a single factor. These cross-loadings persisted despite the application of different rotation methods.
Figure 4.
Exploratory factor analysis (EFA) of the Persian version of the PEmb-QoL questionnaire with Oblimin rotation method. EFA uses a covariance matrix to extract a set of latent common variables that best explain the observed variance in the responses to questionnaire items. The 3 extracted factors accounted for 34%, 15%, and 11% of the total variance in patient responses. Factor loadings represent the regression coefficient of each item. Coefficients <0.35 were not mentioned. IC, intensity of complaint; PEmb-QoL, Pulmonary Embolism Quality of Life questionnaire; SL, social limitations.
The details of convergent and discriminant validity are presented in Figure 3. The PEmb-QoL dimensions of frequency of complaints, the intensity of complaints, activities of daily living limitations, and work-related problems had stronger associations with the physical health component of the SF-36 questionnaire. Nonetheless, emotional complaints had moderate correlations with all SF-36 dimensions, varying from bodily pain (r = 0.47) to mental health (r = 0.58), which resulted in a roughly similar association with mental health (r = 0.64) and physical health summary scores (r = 0.63) of the SF-36. The median (IQR) distance walked during the 6MWT was 390 meters (320–450 m). Limited exercise capacity, defined as distances less than 350 meters, was observed in 39% of the participants. Expectedly, the 6MWT distance converged best with the scores from limitations in the activities of daily living (r = −0.61) and work-related problems (r = −0.35).
4. Discussion
To our knowledge, The present study is the first, to translate and validate a PE-specific PRO instrument in a Middle Eastern country. Cross-cultural validation of the PEmb-QoL questionnaires in Persian-speaking populations would allow researchers to study the impact of PE and its treatments on the quality of life of a large population of PE survivors, given that over 120 million people worldwide speak the Persian language. Based on our results, almost all the dimensions proposed by the original validation study [15] yielded appropriate inter-item correlations, corrected item-total correlations, domain intercorrelations, and high-reliability coefficients. Our analysis also supported the convergent and discriminant validity of the PEmb-QoL dimensions in the Persian population.
Overall, the PEmb-QoL total summary scale and emotional complaints conformed to almost all gold reliability standards, and their appropriate inter-item correlations and absence of ceiling or floor effects indicated their adequate discriminative power. Still, 5 out of the 6 dimensions had floor effects, with work-related problems also exhibiting a ceiling effect. Similar findings have been observed in all other validation studies of the PEmb-QoL questionnaire [[16], [17], [18], [19], [20]]. These floor and ceiling effects can have several nonmutually exclusive explanations. For one, the substantial floor effects could mean that for many patients, these 5 dimensions of quality of life took no toll due to PE. Two other frequently cited explanations for the undesirable floor effects are gradual health improvements prior to QOL assessments and social desirability bias toward better health status [16,17,20]. Although these 2 explanations are well-substantiated, they were proposed by studies involving European cohorts with relatively long intervals (median 15–43 months) between the acute PE event and questionnaire completion, which could have allowed for gradual health improvements. Nevertheless, the fact that similar results were observed in cross-cultural validation studies in non-European populations with much shorter PE-to-questionnaire completion intervals—a median of 6.1 months in the current study and a median of 4.5 months in the Chinese validation [19]—indicates that other possibilities should also be considered. If resulted from measurement biases, floor and ceiling effects could potentially imply that the instrument struggles to distinguish respondents at the extreme ends of the scale (ie, the best/worst score), which could, in turn, limit the ability of the instrument to detect small changes in the health of these patients in response to effective interventions. Scales with few items, especially those containing few response options or unbalanced response sets, are prone to the undesirable floor and ceiling effects [45]. As a case in point, the marked floor effect of social limitations could be explained by the fact that it is created by a single item (Q6). On the other hand, work-related problems (Q5a-d) constitute the only dimension exhibiting both floor and ceiling effects, possibly because it exclusively comprised items with dichotomous response categories (Supplementary Figure S2).
After clarifying content validity in terms of measured concepts, Klok et al. [15] structured dimensions through clinical concepts and patient interviews for the current version of the questionnaire. However, the suggested structure should be bolstered through exploratory factor analysis before the confirmatory process [8,12]. Our EFA suggested a 3-factor structure closely resembling the study of the French population [17]. These factors were, by and large, combinations of highly associated dimensions. Factor 1 (Q1h, Q4b-m, Q5a-d, Q9i, Q9j) was predominantly formed by items of dimension activities of daily living limitations and work-related problems, factor 2 (Q1b-g, Q7, Q8) was formed by items of the frequency of complaints and intensity of complaints, whereas factor 3 was largely formed by items from emotional complaints. Henceforth, we regard these 3 factors as functional, symptom, and emotional components, respectively.
As suggested by the FDA guidelines [12], we complemented the Klok et al. [15] theoretical framework for item selection through factor, reliability, and item response analyses. Item 1a (“Pain behind or between the shoulder blades?”) was removed because of its poor loading values across all 3 extracted factors. This item also had the lowest coherence with its originally designated dimension (corrected item-total r = 0.38). The removal of item 1a is supported by the fact that the presented description of “pain behind or between the shoulder blades” is not only an uncommon, chronic complication of PE, but it could also overlap with musculoskeletal complaints [46,47]. Four items showed cross-loading. Items 1h (“Difficulty in breathing or breathlessness?”) and 8 (“Intensity of breathlessness?”) had significant loadings in both functional and symptom components, while item 5a (“Cut down the time spent on work or other activities?”) and 6 (“Interference of lung symptoms with normal social activities?”) had significant loadings in both functional and emotional components. Furthermore, although items 9i (“Felt limited in taking a trip?”) and 9j (“Afraid of being alone?”) were originally assigned to emotional complaints, they clustered better with the items of the functional component rather than with the emotional component. A logical explanation could be that individuals tend to judge their independence, at least in part, by their self-perception of physical performance.
Mazdak Tavoly et al. [20] was the first to report and evaluate the total score for the PEmb-QoL questionnaire. Since then, validation studies, including the present one, have found this scale to enjoy adequate reliability [[15], [16], [17], [18], [19], [20],48]. Nonetheless, we believe that the validity of a total summary scale should be revisited. It is generally discouraged to calculate a single total summary score for multidimensional constructs such as QOL, as this process intrinsically involves assigning unjustified weights to each dimension [32,49]. In this case, the Norwegian study calculated a single total summary score by averaging dimensional scores, whereas the French, German, and Chinese studies calculated it by averaging individual item scores. While the former approach assumes equilibrium between the contributions of all dimensions toward QOL, the latter implicitly assumes more weight for dimensions with more items. The rationale behind these assumptions, however, is unclear. Even though the dimensions of QOL are highly influenced by one another, the preference weight for each dimension (eg, physical well-being and social well-being) may vary between individuals. Conflating the scores of these dimensions without incorporating their preference weight for each respondent could, therefore, be unwarranted [49]. We also cannot confirm the reliability or validity of measuring social limitations solely based on item Q6, primarily because single-item dimensions generally fail not only to sufficiently capture all aspects of a general concept, but also to qualify for the conventional analysis of reliability [12]. The cross-loading values of items Q6 (“Interference of lung symptoms with normal social activities”) and Q5a (“Cut down the time spent on work or other activities?”) also demonstrate that they should be interpreted as part of the shared attributes between broader concepts rather than being assigned to, or comprehensively describe, a single subscale.
Our study is subject to several limitations. First, of the 170 registered patients in the RHC-PE registry, only 98 (58%) participated in the PEmb-QoL evaluation (Figure 1). Of these primary respondents, only 25 (26%) returned in the following 2–4 weeks acceptable window of retest analysis. The low turnout for the follow-up sessions precluded an evaluation of the questionnaire’s responsiveness. Second, a higher median age in the nonparticipant group (60 vs 54 years old, P value = 0.03) and the fact that 12 patients died prior to study enrollment indicate that older and probably sicker patients may have been underrepresented in our study population. We believe this low turnout to be the result of our preferred mode of questionnaire administration; during their 6 months follow-up session, patients were asked to complete the questionnaires in the presence of an experienced nurse to minimize missing item responses, and accommodate low literacy, visually impaired, and elderly patients [14]. An in-person mode of administration also allowed us to incorporate the results of 6MWT into our study as a non-PRO measure of functional performance. However, given that our high-volume tertiary cardiovascular center receives patients nationwide, geographical restrictions made patient recruitment, in-person follow-ups and retest sessions challenging.
In summary, the Persian version of the PEmb-QoL questionnaire is a psychometrically valid and reliable PRO instrument to assess health-related QOL in patients with a history of acute PE. We extracted a 3-component structure comprising functional (items 1h, 4b-5d, 6, 8, 9i, and 9j), symptom (1b-h, 7, and 8), and emotional (5a, 6, and 9a-h) components. Further longitudinal studies are warranted to evaluate responsiveness and establish the minimum important difference.
Acknowledgments
Funding
This study received no funding.
Author contributions
K.M.: Conceptualization, methodology, investigation, data curation, formal analysis, writing of the original draft, reviewing and editing of the manuscript, and visualization. M.M.S.: Investigation, data curation, and writing of the original draft. J.M.: Supervision. B.M.: Supervision. F.A.K.: Methodology and reviewing and editing of the manuscript. B.B.: Methodology and reviewing and editing of the manuscript. O.S.: Supervision. H.P.: Data curation and investigation. A.A.: Data curation and investigation. M.F.: Data curation and investigation. R.K.: Data curation and investigation. F.M.: Data curation and investigation. F.R.: Reviewing and editing of the manuscript. H.T.: Data curation and investigation. H.B.: Conceptualization, formal analysis, methodology, supervision, project administration, reviewing and editing of the manuscript, and validation. P.S.: Conceptualization, formal analysis, writing of the original draft, supervision, project administration, reviewing and editing of the manuscript, validation, funding acquisition, and resources.
Relationship Disclosure
F.A.K. has received research support from Bayer, Bristol-Myers Squibb, Actelion, Boston Scientific, Leo Pharma, The Netherlands Organization for Health Research and Development, The Dutch Thrombosis Association, The Dutch Heart Foundation, and the Horizon Europe program, all outside this work and paid to his institution. B.B. is a consulting expert, on behalf of the plaintiff, for litigation related to 2 brand models of IVC filters. All other authors have no conflicts of interest.
Footnotes
Handling Editor: Dr Kristen Sanfilippo
Contributor Information
Hooman Bakhshandeh, Email: hooman.bakhshande@gmail.com.
Parham Sadeghipour, Email: psadeghipour@hotmail.com.
Supporting Information
References
- 1.Klok F.A., van der Hulle T., den Exter P.L., Lankeit M., Huisman M.V., Konstantinides S. The post-PE syndrome: a new concept for chronic complications of pulmonary embolism. Blood Rev. 2014;28:221–226. doi: 10.1016/j.blre.2014.07.003. [DOI] [PubMed] [Google Scholar]
- 2.Klok F.A., Ageno W., Ay C., Bäck M., Barco S., Bertoletti L., et al. Optimal follow-up after acute pulmonary embolism: a position paper of the European Society of Cardiology Working Group on Pulmonary Circulation and Right Ventricular Function, in collaboration with the European Society of Cardiology Working Group on Atherosclerosis and Vascular Biology, endorsed by the European Respiratory Society. Eur Heart J. 2022;43:183–189. doi: 10.1093/eurheartj/ehab816. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Pugliese S.C., Kawut S.M. The post-pulmonary embolism syndrome: real or ruse? Ann Am Thorac Soc. 2019;16:811–814. doi: 10.1513/AnnalsATS.201901-061PS. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Boon G., Huisman M.V., Klok F.A. Determinants and management of the post-pulmonary embolism syndrome. Semin Respir Crit Care Med. 2021;42:299–307. doi: 10.1055/s-0041-1722964. [DOI] [PubMed] [Google Scholar]
- 5.Sista A.K., Miller L.E., Kahn S.R., Kline J.A. Persistent right ventricular dysfunction, functional capacity limitation, exercise intolerance, and quality of life impairment following pulmonary embolism: systematic review with meta-analysis. Vasc Med. 2017;22:37–43. doi: 10.1177/1358863X16670250. [DOI] [PubMed] [Google Scholar]
- 6.Willich S.N., Chuang L.H., van Hout B., Gumbs P., Jimenez D., Kroep S., et al. Pulmonary embolism in Europe - Burden of illness in relationship to healthcare resource utilization and return to work. Thromb Res. 2018;170:181–191. doi: 10.1016/j.thromres.2018.02.009. [DOI] [PubMed] [Google Scholar]
- 7.Højen A.A., Gorst-Rasmussen A., Lip G.Y.H., Lane D.A., Rasmussen L.H., Sørensen E.E., Larsen T.B. Use of psychotropic drugs following venous thromboembolism in youth. A nationwide cohort study. Thromb Res. 2015;135:643–647. doi: 10.1016/j.thromres.2015.01.024. [DOI] [PubMed] [Google Scholar]
- 8.Asady E., Ghanima W., Jelsness-Jorgensen L.P., Klok F.A., Kahn S.R., Stromme H., Wik H.S. Health-related quality-of-life questionnaires for deep vein thrombosis and pulmonary embolism: A systematic review on questionnaire development and methodology. Res Pract Thromb Haemost. 2021;5:e12556. doi: 10.1002/rth2.12556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Barco S., Schmidtmann I., Ageno W., Anušić T., Bauersachs R.M., Becattini C., et al. Survival and quality of life after early discharge in low-risk pulmonary embolism. Eur Respir J. 2021:57. doi: 10.1183/13993003.02368-2020. [DOI] [PubMed] [Google Scholar]
- 10.Valerio L., Mavromanoli A.C., Barco S., Abele C., Becker D., Bruch L., et al. Chronic thromboembolic pulmonary hypertension and impairment after pulmonary embolism: the FOCUS study. Eur Heart J. 2022;43:3387–3398. doi: 10.1093/eurheartj/ehac206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Gwozdz A.M., de Jong C.M.M., Fialho L.S., Likitabhorn T., Sossi F., Jaber P.B., et al. Development of an international standard set of outcome measures for patients with venous thromboembolism: an International Consortium for Health Outcomes Measurement consensus recommendation. Lancet Haematol. 2022;9:e698–e706. doi: 10.1016/S2352-3026(22)00215-0. [DOI] [PubMed] [Google Scholar]
- 12.U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79. doi: 10.1186/1477-7525-4-79. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Retzer A., Aiyegbusi O.L., Rowe A., Newsome P.N., Douglas-Pugh J., Khan S., et al. The value of patient-reported outcomes in early-phase clinical trials. Nat Med. 2022;28:18–20. doi: 10.1038/s41591-021-01648-4. [DOI] [PubMed] [Google Scholar]
- 14.Aaronson N, Elliott T, Greenhalgh J, Halyard M, Hess R, Miller D, et al. User’s Guide to Implementing Patient-Reported Outcomes Assessment in Clinical Practice. 2015. https://www.isoqol.org/wp-content/uploads/2019/09/2015UsersGuide-Version2.pdf; [accessed September 17, 2022]. [DOI] [PubMed]
- 15.Cohn D.M., Nelis E.A., Busweiler L.A., Kaptein A.A., Middeldorp S. Quality of life after pulmonary embolism: the development of the PEmb-QoL questionnaire. J Thromb Haemost. 2009;7:1044–1046. doi: 10.1111/j.1538-7836.2009.03341.x. [DOI] [PubMed] [Google Scholar]
- 16.Klok F.A., Cohn D.M., Middeldorp S., Scharloo M., BüLler H.R., van Kralingen K.W., et al. Quality of life after pulmonary embolism: validation of the PEmb-QoL Questionnaire. J Thromb Haemost. 2010;8:523–532. doi: 10.1111/j.1538-7836.2009.03726.x. [DOI] [PubMed] [Google Scholar]
- 17.Rochat M., Méan M., Limacher A., Hugli O., Klok F.A., Cohn D.M., Aujesky D. Quality of life after pulmonary embolism: validation of the French version of the PEmb-QoL questionnaire. Health Qual Life Outcomes. 2014;12:174. doi: 10.1186/s12955-014-0174-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Frey P.M., Méan M., Limacher A., Leiss W., Schwab N., Rochat M., Aujesky D. Quality of life after pulmonary embolism: prospective validation of the German version of the PEmb-QoL questionnaire. Thromb Res. 2015;135:1087–1092. doi: 10.1016/j.thromres.2015.03.031. [DOI] [PubMed] [Google Scholar]
- 19.Sun X., Li J., Shi J. Validating the Chinese version of the PEmb-QoL questionnaire: A measure for quality of life assessment after pulmonary embolism. Thromb Res. 2018;166:86–91. doi: 10.1016/j.thromres.2018.04.020. [DOI] [PubMed] [Google Scholar]
- 20.Tavoly M., Jelsness-Jørgensen L.P., Wik H.S., Roaldsnes C., Sandset P.M., Ghanima W. Quality of life after pulmonary embolism: first cross-cultural evaluation of the pulmonary embolism quality-of-life (PEmb-QoL) questionnaire in a Norwegian cohort. Qual Life Res. 2015;24:417–425. doi: 10.1007/s11136-014-0779-4. [DOI] [PubMed] [Google Scholar]
- 21.Shafe O., Moosavi J., Alizadehasl A., Pouraliakbar H.R., Naghavi B., Jamalkhani S., et al. Impact of registry implementation on the management and survival of patients with pulmonary embolism. Res Cardiovasc Med. 2021;10:40–44. [Google Scholar]
- 22.Konstantinides S.V., Meyer G., Bueno H., Galié N., Gibbs J.S.R., Ageno W., et al. 2019 ESC guidelines for the diagnosis and management of acute pulmonary embolism developed in collaboration with the European Respiratory Society (ERS) Eur Heart J. 2020;41:543–603. doi: 10.1093/eurheartj/ehz405. [DOI] [PubMed] [Google Scholar]
- 23.Montazeri A., Goshtasebi A., Vahdaninia M., Gandek B. The Short Form Health Survey (SF-36): translation and validation study of the Iranian version. Qual Life Res. 2005;14:875–882. doi: 10.1007/s11136-004-1014-5. [DOI] [PubMed] [Google Scholar]
- 24.McHorney C.A., Ware J.E., Raczek A.E. The MOS 36-item short-form health survey (Sf-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247–263. doi: 10.1097/00005650-199303000-00006. [DOI] [PubMed] [Google Scholar]
- 25.Ware J., Kosinski M., Keller S.D. Health Assessment Lab; Boston: 1994. SF-36 Physical and mental health summary scales: A user’s manual. p. 23–8. [Google Scholar]
- 26.36-Item Short Form Survey (SF-36) Scoring Instructions | RAND, https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form/scoring.html; [accessed Augest 20, 2022].
- 27.Terwee C.B., Bot S.D.M., de Boer M.R., van der Windt D.A.W.M., Knol D.L., Dekker J., et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012. [DOI] [PubMed] [Google Scholar]
- 28.Squires J.E., Hayduk L., Hutchinson A.M., Cranley L.A., Gierl M., Cummings G.G., et al. A protocol for advanced psychometric assessment of surveys. Nurs Res Pract. 2013;2013:156782. doi: 10.1155/2013/156782. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Streiner D., Norman G., Cairney J. 5th ed. Oxford University Press; 2015. Health measurement scales: a practical guide to their development and use. [Google Scholar]
- 30.Revelle W., Condon D.M. Reliability from α to ω: A tutorial. Psychol Assess. 2019;31:1395–1411. doi: 10.1037/pas0000754. [DOI] [PubMed] [Google Scholar]
- 31.Kline P. 2nd ed. Taylor and Francis; 2013. Handbook of psychological testing. [Google Scholar]
- 32.Hubley AM, Zumbo BD. Psychometric characteristics of assessment procedures: an overview. APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology. Washington: American Psychological Association; 2013, p. 3–19.
- 33.Nunnally J.C. Psychometric theory 3E. Tata McGraw-Hill education. 1994 [Google Scholar]
- 34.Tavakol M., Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53. doi: 10.5116/ijme.4dfb.8dfd. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Green S.B., Yang Y. Commentary on coefficient alpha: A cautionary tale. Psychometrika. 2008;74:121–135. [Google Scholar]
- 36.Flora D.B. Your coefficient alpha is probably wrong, but which coefficient omega is right? A tutorial on using R to obtain better reliability estimates. AMPPS. 2020;3:484–501. [Google Scholar]
- 37.Ponterotto J.G., Ruckdeschel D.E. An overview of coefficient alpha and a reliability matrix for estimating adequacy of internal consistency coefficients with psychological research measures. Percept Mot Skills. 2007;105:997–1014. doi: 10.2466/pms.105.3.997-1014. [DOI] [PubMed] [Google Scholar]
- 38.Lamping D.L., Schroter S., Marquis P., Marrel A., Duprat-Lomon I., Sagnier P.P. The community-acquired pneumonia symptom questionnaire: A new, patient-based outcome measure to evaluate symptoms in patients with community-acquired pneumonia. Chest. 2002;122:920–929. doi: 10.1378/chest.122.3.920. [DOI] [PubMed] [Google Scholar]
- 39.Keller K., Tesche C., Gerhold-Ay A., Nickels S., Klok F.A., Rappold L., et al. Quality of life and functional limitations after pulmonary embolism and its prognostic relevance. J Thromb Haemost. 2019;17:1923–1934. doi: 10.1111/jth.14589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Michalos AC. Encyclopedia of quality of life and well-being research. Dordrecht: Springer Netherlands; 2014.
- 41.Flora D.B., LaBrish C., Chalmers R.P. Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Front Psychol. 2012;3:55. doi: 10.3389/fpsyg.2012.00055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Boateng G.O., Neilands T.B., Frongillo E.A., Melgar-Quiñonez H.R., Young S.L. Best practices for developing and validating scales for health, social, and behavioral research: A primer. Front Public Health. 2018;6:149. doi: 10.3389/fpubh.2018.00149. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Rhemtulla M., Brosseau-Liard PÉ Savalei V. When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychol Methods. 2012;17:354–373. doi: 10.1037/a0029315. [DOI] [PubMed] [Google Scholar]
- 44.Price L.R. The Guilford Press; 2017. Psychometric methods: theory into practice. [Google Scholar]
- 45.Chyung S.Y., Hutchinson D., Shamsy J.A. Evidence-based survey design: ceiling effects associated with response scales. Perform Improv. 2020;59:6–13. [Google Scholar]
- 46.Stein P.D., Henry J.W. Clinical characteristics of patients with acute pulmonary embolism stratified according to their presenting syndromes. Chest. 1997;112:974–979. doi: 10.1378/chest.112.4.974. [DOI] [PubMed] [Google Scholar]
- 47.Pollack C.V., Schreiber D., Goldhaber S.Z., Slattery D., Fanikos J., O’Neil B.J., et al. Clinical characteristics, management, and outcomes of patients diagnosed with acute pulmonary embolism in the emergency department: initial report of EMPEROR (Multicenter Emergency Medicine Pulmonary Embolism in the Real World Registry) J Am Coll Cardiol. 2011;57:700–706. doi: 10.1016/j.jacc.2010.05.071. [DOI] [PubMed] [Google Scholar]
- 48.Van Es J., Den Exter P.L., Kaptein A.A., Andela C.D., Erkens P.M.G., Klok F.A., et al. Quality of life after pulmonary embolism as assessed with SF-36 and PEmb-QoL. Thromb Res. 2013;132:500–505. doi: 10.1016/j.thromres.2013.06.016. [DOI] [PubMed] [Google Scholar]
- 49.Lins L., Carvalho F.M. SF-36 total score as a single measure of health-related quality of life: scoping review. SAGE Open Med. 2016;4 doi: 10.1177/2050312116671725. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.





