Abstract
Background
Burden of stroke is rising due to the demographic and epidemiological transitions in Sri Lanka. Assessment of success of stroke-management requires tools to assess the quality of life (QOL) of stroke survivors. Most of currently used QOL tools are developed in high-income countries and may not reflect characteristics relevant to resource-constrained countries. The aim was to develop and validate a new QOL tool for stroke survivors in Sri Lanka.
Methods
The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist was referred. A conceptual framework was prepared. Item generation was done reviewing the existing QOL tools, inputs from experts and from stroke survivors. Non-statistical item reduction was done for the 36 generated items with modified-Delphi technique. Retained 21 items were included in the draft tool. A cross sectional study was done with 180 stroke survivors. Exploratory Factor Analysis was done and identified factors were subjected to varimax rotation. Further construct validity was tested with 6 a-priori hypothesis using already validated tools (SF-36, EQ-5D-3 L) and a formed construct. Internal consistency reliability was assessed with Cronbach alpha.
Results
Four factors identified with principal-component-analysis explained 72.02% of the total variance. All 21 items loaded with a level > 0.4. The developed tool was named as the Post-stroke QOL Index (PQOLI). Four domains were named as “physical and social function”, “environment”, “financial-independence” and “pain and emotional-wellbeing”. Four domain scores of PQOLI correlated as expected with the SF-36, EQ-5D Index and EQ-5D-VAS scores. Higher domain scores were obtained for ambulatory-group than the hospitalized-group. Higher scores for financial-independence domain were obtained for the group without financial-instability. Five a-priori hypothesis were completely proven to be true. Cronbach-alpha level ranged from 0.682 to 0.906 for the four domains.
Conclusions
There is first evidence for sufficient construct validity of the PQOLI as a valid QOL tool for measuring the QOL of stroke survivors with satisfactory internal consistency reliability.
Keywords: PQOLI, Stroke, Tool development and validation, Quality of life, Sri Lanka
Introduction
Stroke is a rapid vascular event with symptoms lasting 24 h or longer [1]. Stroke is regarded as a major cause of disability anywhere in the world [2]. Its burden has been relatively worsening in low- and middle-income-countries (LMICs) compared to high-income countries (HICs) in relation to its incidence as well as social and economic impacts [3]. As an example when a decrease of 42% of stroke incidence is observed in HICs, an increase over 100% is observed in LMICs over the last four decades [3]. Sri Lanka was recently upgraded as a Upper-Middle Income Country after being a LMIC with comparatively satisfactory health parameters [4, 5]. Prevalence of stroke in urban Sri Lanka was estimated to be 10.4 per 1000 (95% CI = 6.3 to 14.5) with a male to female ratio of 2:1 [6]. Relatively higher incidence of stroke among the young also been noted here [7]. With the demographic and the epidemiological transitions, as in many other LMICs, stroke burden is expected to rise further in future.
The World Health Organization (WHO) defines Quality of Life (QOL) as “the individual’s perception of his/her position in life in the context of the culture and value systems in which they live and in relation to their goals” [8]. It is a composite concept affected by many facets [8]. In a patient with a disease condition, the QOL may reflect the success of management of that particular disease, as the patient perceives [9]. Disabilities imposed by stroke would directly or indirectly influence the physical as well as psychological QOL components as perceived by the patients. Hence the QOL of stroke survivors is an extremely important factor, for research, to assess progress and to target services for stroke survivors [10–12].
Since QOL is a patient-reported outcome, there is no agreement on exactly which domains are to be captured within its scope [13]. Hence, though there are many available QOL tools, there is much variability among their domains [14, 15]. Environmental influences (such as user-friendliness and safety of household items) and economic influences (such as financial security), do affect the “self-perceived position in life”, especially in disability-related conditions like stroke. Many QOL tools do not capture these, even though these are proved to impose an impact on overall QOL [16–22]. It has been encouraged to design QOL instruments specially including domains like economic costs and burden to the family members [23]. Furthermore, epidemiological characteristics of stroke are prone to vary even within LMICs [24, 25]. The living contexts (i.e. standards of household environment and items) and the expectations of the people (i.e. due to the differences in salary scales and in social insurance systems) are different between the HICs and LMICs. Stroke-related literature is scarce in relation to LMICs. Hence most of the evidence on stroke rehabilitation which come from Western settings which might not be applicable for lower-middle income settings [26–30]. The development of new QOL tools for stroke survivors would enable more context-related QOL measurements [31].
Out of the many health-related QOL tools available, Short-Form-36 (SF-36) and European Quality of Life 5 dimensional (EQ-5D) tool are two commonly used generic tools [9, 32–34]. SF-36 includes 08 scales and has been used to assess QOL in stroke survivors following hospital discharge [35–39]. It has been validated for several disease conditions including stroke within Sri Lanka [37, 40]. EQ-5D tool consists of an EQ-5D descriptive system as well as an EQ-Visual-Analogue-Scale (VAS). The former system include five dimensions and the latter records the respondent’s self-rated health on a VAS [41]. It too has been validated within Sri Lanka [42, 43]. SF-36 covers a period of 28 days previous to the date of data collection and the EQ-5D captures the QOL related to the time of data collection.
Validity, reliability and responsiveness are three properties that must be evaluated in relation to a newly developed measurement tool [44, 45]. Validity measures whether the tool “actually measures what it is expected to measure” [46]. In the absence of a gold standard test for QOL, the validity based on data is assessed by the construct validity [47]. Reliability refers to a measure of inherent amount of error of any measurement [48]. It includes the assessment of homogeneity of each of the items measured by Cronbach Alpha and reproducibility (measured with test-retest method etc.) [48, 49]. Responsiveness is defined as the ability to detect a clinically important change [50, 51].
Sri Lanka is trying to expand stroke-related services in general including that of acute care, rehabilitation and community-based care [52]. Availability of context-specific QOL tools would greatly help in assessing the success of management of stroke survivors in this context. The aim of the study was to develop and validate a comprehensive quality of life tool for stroke survivors at post-stroke 1-month in Sri Lanka.
Methods
Conceptual framework and item generation
The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist was referred [44, 45]. The literature was searched using electronic databases (PUBMED and MENDELEY) with relevant key words (Supplementary file-I). General and specific tools that measure QOL of the stroke survivors were noted. Having studied the variables/domain of the identified tools, inputs from key informants and clients (three survivors of stroke and two caregivers), a conceptual framework was developed (Fig. 1). The identified domains were within the scope of the interpretation of QOL by the WHO [8].
Using the conceptual framework, items were generated and listed by reviewing the items of identified tools, getting additional inputs from expert key-informants and clients mentioned above. Items were expected to cover the quality of life of a period of 7 days of the stroke survivors’ life, from the time of interview.
In all the above processes inputs were taken from a panel of seven key informants who were experts related to the stroke care. The panel included two consultants in neurology in the premier tertiary hospital of Sri Lanka, one consultant in clinical medicine and anesthesiology from the same setting. Furthermore it included a professor in community medicine and a lecturer in sociology in a premier university as well as a general practitioner.
Non-statistical item reduction and drafting the questionnaire
Similar items were combined. This draft list was sent to the eight experts (i.e. seven above mentioned panel members and another nominated by them) above with modified Delphi technique through emails. They were asked to rate each item with a five-point scale based on the relevance of the question to the local setting (i.e. from least relevant to extremely relevant) and to send back their ratings through email. The items whose average scores were within the first quartile were omitted.
The stems were drafted for these items in par with both an interviewer-administered and a self-administered questionnaire. It is highlighted in the literature, that a tool, being able to be used as both self and interviewer administered, is important in relation to stroke [53]. The concepts described by Streiner and Norman (2008), like conceptual equivalence, item equivalence, semantic equivalence and translation procedures were considered in drafting the stems [54]. The questions were originally formed in English and then translated to Sinhalese. The forward-and- backward-translation method was used adhering to the recommended measures [55].
Five response categories were used for each stem. The response categories ranged from “Always” to “Not at all”. A scoring system from 1 to 5 with 1 representing the worst QOL and 5 representing the best was developed. Stems representing negative phenomena were reverse coded. The items thus generated, were given to the panel of experts to allocate a mark out of 10 per each item in relation to the wording and clarity.
Data collection and factor analysis
A cross sectional study was carried out in two settings to explore the factor structure of the draft instrument. The rehabilitation unit of the Colombo North Teaching Hospital was one setting. Residential rehabilitation services for the stroke survivors are available here. The other setting was the neurology clinics of the National Hospital of Sri Lanka where the ambulatory care is given for patients after the discharge from the hospital. Stroke survivors who were within 28 days to 32 days following the acute phase of their management were selected to the study leaving a margin of 2 days from either side of the intended period of 1 month. In order to obtain reliable estimates, it has been mentioned that a minimum subject to item ratio of 1: 5 is needed for exploratory factor analysis [56]. Since the interviewer-administered questionnaire contained 21 retained questions it was decided to have 7.5 times of the number of variables making the sample size as 157 considering the feasibility of data collection. With an assumed response rate of 90%, the sample size at the data collection stage was decided to be 180. The participants who were managed at study settings from 1st of December 2014 were eligible to be included in the study.
Exploratory factor analysis
Data was entered in to a Statistical Package of Social Sciences (version 17) datasheet. Factorability was assessed using the Kaiser-Meyer-Olkin (KMO) measure of sample adequacy, Bartlett’s test of sphericity and anti-image correlations [57]. Exploratory Factor Analysis with Principal Component Analysis was done. We retained factors whose Eigenvalues were greater than 1. Having studied the scree plots, the selected factors were subjected to varimax rotation. The subsequent factor loadings were examined.
The draft instrument was pre-tested among 10 stroke survivors. Following the administration of the questionnaire, the investigators had a brief interview with them on the wording of items of the questionnaire. Based on the responses, the final adjustments were done in relation to the clarity of wording.
Further assessment of validity and reliability of the developed tool
The three aspects of the judgmental validity; face, content, consensual (i.e. agreement between experts) were assessed with the inputs of the panel of experts [47]. The data-based further construct-validity was assessed using the findings of SF-36, EQ-5D and the questions on financial burden.
Six a-priori hypotheses were used.
The domain scores of the developed tool will have statistically significant positive correlations with all domains of SF-36
The domain scores of the developed tool will have statistically significant positive correlations with EQ-5D index score
The domain scores of the developed tool will have statistically significant positive correlations with EQ-5D VAS score
The domain scores of the developed tool will correlate with more-related domains with a higher strength of association than the scores of other domains.
The a-priori hypotheses from no. 1 to no. 4 were evaluated by testing the construct validity with the findings of SF-36 and EQ-5D-3-Level tools.
-
5.
The domain scores of the developed tool will be statistically significantly higher for the ambulatory group than the hospitalized group. The hypothesis no.05 tested the ability of the tool to discriminate between the two ends of the severity spectrum, as another aspect of construct validity. For this, the domain scores of the institutionalized participants and the ambulatory participants were compared.
-
6.
There will be a statistically significant difference of the financial domain scores between the groups with financial burden at family level and those who are not. The sixth was evaluated by a set of four judgmentally-validated questions composed by reviewing the literature on financial burden [58]. The questions were; whether the participant had to apply for a loan, whether the participant had to sell a property, whether the participant had a reduction of income and whether the participant had to restrict the expenses for other usual matters due to the impact of the disease condition. The presence of any of these was noted as presence of financial burden at family-level.
This procedure of adopting a-priori hypotheses was similar to the methodology adapted in many other global validation studies [59–62]. Satisfactory confirmation of two thirds of the hypotheses at least was considered as necessary for sufficient construct validity.
Internal consistency reliability was assessed by calculating the Cronbach alpha coefficient. Internal consistency estimates of a magnitude of 0.70 or greater was considered as satisfactory [63]. Level of significance was considered as 5%. Ethical clearance was obtained from the Ethics Review Committee of the Medical Research Institute of Sri Lanka (Reference 60/2014). The procedures followed were in accordance with institutional guidelines of the study settings. Informed written consent was obtained from the participants.
Results
The domains of QOL that have been included in the tools found in literature search have been listed in Supplementary file 2 [10, 53, 64–68].
After combining the related items, the initial list included 36 items. The mean and median cumulative scores given by the expert panel through the modified-Delphi technique for the initial item list was 22 and 28 respectively. The upper margin of the first quartile was 7. The number of items which scored more than the upper first quartile was 21. Figure 2 shows the distribution of the cumulative scores given by the experts. No outliers were detected for the scores on clarity and wording.
It took in average 20 min for an interview with a participant. The median (Inter Quartile Range) age of the sample was 56 (46–65). The total respondents were 180 with the male to female ratio of the participants being approximately 2.8 to 1 (73 to 27%). The proportions of missing values ranged from 1.1 to 11.1%. The KMO measure of sampling was 0.876 and the Barlett test of sphericity was significant (p < 0.001). The diagonal anti-image correlation ranged from 0.611 to 0.943. Following the factor analysis, four factors were detected with an eigenvalue more than 1. Out of those 04, the maximum eigenvalue was 10.051 and the least value was 1.182. Out of the total variance, 72.02% was explained by the cumulative variance of these four factors. All the 21 items loaded with a level > 0.4 into the selected four components. Hence no further statistical item reduction was done.
The factor structure analysis of the 21 items is mentioned in Table 1.
Table 1.
Factor 1 | Factor 2 | Factor 3 | Factor 4 | |
---|---|---|---|---|
Item1 | .858 | .237 | .191 | .163 |
Item2 | .886 | .228 | .175 | .103 |
Item3 | .852 | .187 | .221 | .134 |
Item4 | .540 | .077 | .167 | .341 |
Item5 | .838 | .102 | .185 | .147 |
Item6 | .859 | .008 | .043 | .101 |
Item7 | .750 | .234 | .302 | .048 |
Item8 | .613 | .448 | .453 | .065 |
Item9 | .590 | .526 | .291 | .061 |
Item10 | .491 | .508 | .428 | −.176 |
Item11 | .482 | .245 | .642 | .087 |
Item12 | .219 | .151 | .781 | −.014 |
Item13 | .167 | .084 | .854 | .049 |
Item14 | .512 | .231 | −.002 | .508 |
Item15 | .095 | .222 | .691 | .303 |
Item16 | .471 | .254 | .308 | .476 |
Item17 | .138 | −.006 | .088 | .863 |
Item18 | .167 | .752 | .273 | .069 |
Item19 | .096 | .863 | −.016 | −.019 |
Item20 | .142 | .859 | .172 | .127 |
Item21 | .211 | .784 | .179 | .135 |
Considering the factor loadings and the correlations of the factors, items were assigned into the respective factors. The complex variables were retained in the best factor as suggested by the Cronbach alpha values with “items removed”. The Table 2 summarizes the correspondence of the retained items to the individual domains.
Table 2.
Domain I | Domain II | Domain III | Domain IV | |
---|---|---|---|---|
Given name | Physical and social functioning | Environment | Financial independence | Pain and emotional well-being |
Included no. of items | 10 | 4 | 4 | 3 |
Item numbers | Item 1 | Item 18 | Item 11 | Item 14 |
Item 2 | Item 19 | Item 12 | Item 16 | |
Item 3 | Item 20 | Item 13 | Item 17 | |
Item 4 | Item 21 | Item 15 | ||
Item 5 | ||||
Item 6 | ||||
Item 7 | ||||
Item 8 | ||||
Item 9 | ||||
Item 10 |
The developed tool was named as “Post-stroke Quality Of Life Index for strokes survivors” (PQOLI) (Table 3).
Table 3.
Questions are covering the last 7 days | Best responses | |
---|---|---|
1. My illness/s have a negative effect on my ability to walk and move around | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
2. My illness/s have a negative effect on the ability i used to have to look after myself | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
3. My illness/s have a negative effect on my ability to select foods, cook, serve or to eat that I used to have | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
4. My illness/s have a negative effect in having a sound sleep | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
5. My illness/s have a negative effect in my ability to have sexual activities that I used to have | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
6. My illness/s cause discomfort in proper toilet practices | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
7. My illness/s have a negative effect on my ability to communicate with others | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
8. My illness has restricted me performing previous roles I played in my family | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
9. The society assumes that I am not capable of performing social activities that I used to do due to my illness | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
10. My illness has restricted me performing previous recreational activities I used to have | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
11. My income-generation activities are restricted by the illness | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
12. I am worried about the restrictions on life by having to be on regular attention (medications, attending clinics, getting investigations) | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
13. I am worried about the negative effect of my illness on my/my family’s financial stability | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
14. I am generally satisfied about the way I live in spite of my illnesses | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
15. I worry about my or my family’s future as a result of my illness/s | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
16. Due to the illness I suffer from pain | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
17. My health condition is getting worse with time | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
18. The equipment of my house (bed, chairs, equipment, toilet accessories) is not user-friendly considering my health condition | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
19. The living environment of my house (floor, stairs, space) is not user-friendly considering my health condition | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
20. I am worried about the transport in accessing health care | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always | ||
21. I have no restriction or problem in getting the medical care (medical advice, drugs, investigations) | Not at all | |
Rarely | ||
Occasionally | ||
Frequently | ||
Always |
The measures of location and measures of dispersion were obtained as shown in Table 4. All domain scores have a potential range from 0 to 100.
Table 4.
Domain | Mean | Standard deviation | Median | Inter-Quartile Range |
---|---|---|---|---|
I score | 56.17 | 22.35 | 53.00 | 40.00–72.00 |
II score | 58.15 | 20.23 | 60.00 | 40.00–70.00 |
III score | 44.25 | 16.74 | 40.00 | 33.75–55.00 |
IV score | 66.93 | 20.69 | 66.67 | 53.33–86.67 |
Table 5 shows the spearman-correlation of the domain scores with the scores of SF-36 and the EQ-5D tools.
Table 5.
Domain I Correlation (rs)a Significance | Domain II Correlation (rs)a Significance | Domain III Correlation (rs)a Significance | Domain IV Correlation (rs)a Significance | |
---|---|---|---|---|
General Health | 0.352 p < 0.001b | 0.249 p < 0.001b | 0.195 p < 0.001b | 0.296 p < 0.001b |
Physical function | 0.792 p < 0.001b | 0.416 p < 0.001b | 0.476 p < 0.001b | 0.667 p < 0.001b |
Pain | 0.761 p < 0.001b | 0.405 p < 0.001b | 0.485 p < 0.001b | 0.612 p < 0.001b |
RL- physical | 0.581 p < 0.001b | 0.524 p < 0.001b | 0.468 p < 0.001b | 0.372 p < 0.001b |
RL- emotional | 0.502 p < 0.001b | 0.343 p < 0.001b | 0.481 p < 0.001b | 0.382 p < 0.001b |
Vitality | 0.403 p < 0.001b | 0.388 p < 0.001b | 0.305 p < 0.001b | 0.276 p < 0.001b |
Social functioning | 0.759 p < 0.001b | 0.408 p < 0.001b | 0.474 p < 0.001b | 0.570 p < 0.001b |
Mental Health | 0.343 p < 0.001b | 0.340 p < 0.001b | 0.476 p < 0.001b | 0.339 p < 0.001b |
EQ-5D index | 0.845 p < 0.001b | 0.489 p < 0.001b | 0.563 p < 0.001b | 0.812 p < 0.001b |
EQ-5D VAS | 0.745 p < 0.001b | 0.381 p < 0.001b | 0.476 p < 0.001b | 0.667 p < 0.001b |
aSpearman correlation-coefficient bsignificant association
RL-physical- Role-Limitations-physical
RL-Emotional- Role-Limitations-emotional
EQ-5D-Index- Index score of the Euro-QOL-5D tool
EQ-5D-VAS- Visual Analogue Scale score of Euro-QOL-5D tool
All domains showed statistically significant positive correlations with scores of SF-36 and EQ-5D-3 L. The EQ-5D-3 L scores had relatively higher strength of associations for the Domains I and IV. In general, for the domain scores with more similar constructs of the SF-36, the associations were with relatively higher strengths.
The ability to discriminate between the two ends of the severity spectrum of a disease entity is mentioned in Table 6. It shows that the QOL was significantly higher in the ambulatory group than the institutionalized group.
Table 6.
Hospital group (n = 99) | Ambulatory group (n = 81) | Significance of differenca | |
---|---|---|---|
Domain I median (IQR) | 40.00 (30.45–52.73) | 72.72 (59.09–90.00) | p < 0.001b |
Domain II median (IQR) | 50.00 (40.00–60.00) | 60.00 (50.00–85.00) | p < 0.001b |
Domain III median (IQR) | 35.00 (30.00–40.00) | 50.00 (40.00–60.00) | p < 0.001b |
Domain IV median (IQR) | 60.00 (40.00–80.00) | 90.00 (80.00–90.00) | p < 0.001b |
aMann-Whitney U test bSignificant association
IQR Inter-Quartile-Range
In the study sample, 27%(n = 49) had to apply for a loan, 30%(n = 54) had to sell a property, 67%(n = 120) had a potential income loss and 67% (n = 120) had to restrict other expenses, due to the illness. Approximately 73% (n = 133) had a financial burden. Higher values for the financial-domain-score were obtained by those who did not experience a financial burden. The median (IQR) financial-domain-scores of PQOLI for the group with financial burden was 35.00 (25.0–50.0). The relevant scores of the group without financial burden was 40.00 (35.0–55.0). There was a statistically significant difference between these two groups (p = 0.012).
Cronbach alpha level for the domains I,II,II and IV were respectively 0.906, 0.880, 0.803 and 0.682.
Discussion
The PQOLI was developed upon context specific evidence of the study setting. It includes 21 items under four domains of physical/social, pain/emotional, financial stability and environmental domains. Hence it addresses many of the deficiencies of utilizing current QOL measures within the resource-constrained settings [26–29, 31].
Many of the recommended methodological aspects in the development of QOL tools were adhered in the development of the PQOLI [44]. As recommended in global literature, patients too were involved in several components of the study including the phase of item generation [33, 69]. The factorability assessments done by KMO measure, Barlett test, item communalities and anti-correlation images were satisfactory [57, 70, 71]. The KMO measure was more than 0.8 and hence can be classified as “meritorious” [57]. The significant Barlett test suggests that the “correlation matrix was significantly different from the identity matrix and therefore factorable” [57].
Exploratory Factor Analysis is better suited when the domain structure is not previously known as in this study [70]. Principal Component Analysis assumes the continuous nature of the variables and it was ensured by the presence of six response categories for each item [71]. It was performed following that with the intention of having a smaller number of variables that explain the most variation in the original set. Even though the orthogonal varimax rotation is commonly done, as in the present study, oblique techniques have been recommended in some literature [69, 72]. A minimal eigenvalue of 1 is traditionally used in defining the factors as in the present study [61]. All the items had a loading value more than the traditional cut-off of 0.32 [69]. The complex factors with cross-loadings were dealt with internal consistency analysis [69, 72, 73] The Cronbach’s alpha values with “items removed” suggest that the allocation of cross loadings were accurate [74].
PQOLI is a disease-specific QOL tool in contrast to generic tools [75]. Disease-specific tools are considered better than generic tools for being more sensitive in picking the changes of stroke patients [33]. The present tool was developed to cover a recall period of seven days in contrast to the four-weeks recall period of SF-36 and momentary capturing of QOL by EQ-5D [35, 41]. The validity of PQOLI was assessed at one month from the end of acute-management of the stroke. In literature post-stroke QOL has been measured from one month up to five years [76]. The seven-day recall period and utilization at one-month were decided in considering the rehabilitation procedure of the study settings and by considering the quality of patient-responses in the pre-testing period.
Following the factor analysis, financial and environmental components were identified as two domains in the PQOLI. This is an example of the recent global recommendation that domain structures for QOL tools for LMICs should be context specific [31]. Furthermore this proves the necessity of incorporating economic and environmental domains in QOL measurements [16–22]. In many LMICs like Sri Lanka, social-insurance systems are not found. The services not free-of-charge, may have to be achieved by out-of-pocket expenditure creating a potential financial burden. These may be the reasons for getting a financial-independence domain following factor analysis. Domain II proves that the stroke-survivor-friendliness of the lining environment and the accessibility to healthcare too are important in determining the quality of life.
The pattern of correlations, provides evidence that the a-priori hypotheses no.1 to no.4 are fulfilled. This reflects that the PQOLI was based on a reflective model in addition to the assessment with the “thought test” as recommended in the COSMIN checklist [44]. All the items can be assumed to be changed when the underlying construct changes [44]. In evaluating the construct validity by the correlations, significance, direction and effect size are generally considered [44]. However due to the “complexities of the constructs”, the strength of associations cannot be expected to be interpreted in the exact way as in bivariate correlations. Since then, for the a priori-hypotheses 1 to 3, the significance and the directions were included while the explorations of strengths were focused in hypothesis no.4 [77, 78].
The hypothesis no.4 was fulfilled in relation to domain I, but was not to a great extent for domain IV. The domain structure in the PQOLI and the SF-36 are not the same. As an example, the pain domain which is a separate entity in the SF-36, has been included in the domain IV of the PQOLI together with items related to emotional-health. This difference of the item-structure might be one reason for PQOLI domain IV not having a greater strength with the mental-health, vitality and role-limitation-emotional domains of SF-36. However, the strength of associations were still of “acceptable and of medium strength” [77–79].
As expected the domain scores of PQOLI were significantly higher for the ambulatory group than the hospitalized group. This highlights its ability to discriminate between the severities of a spectrum. Institutionalized patients are with a higher severity of illness than the patients in the ambulatory group whom have been discharged from the in-ward care. This fulfills the a-prori hypothesis no.5. Hypothesis no.6 tested the ability of the Domain III to discriminate between groups with differences in the level of financial-independence. A lower financial-independence in the group with “financial-burden” would have lowered their subjective perception of the position of living, thus lowering the QOL. This has been accurately captured by the Domain III of PQOLI. In a summary, five of the six a-priori hypotheses have been completely fulfilled and one has been partially fulfilled. Since the alpha values for domains I,II and III were more than 0.8 and for domain IV being closer to 0.7, it can be classified as demonstrating satisfactory internal consistency [44, 70, 80].
Several limitations can be mentioned in this process. One is that the PQOLI provides only numerical outcome-scores for the domains without providing a categorical outcome as “satisfactory” and “not-satisfactory”. This is acceptable as establishing a cut-off needs research in larger scale and it would be a future extension of this. Secondly the PQOLI provides 4 domain scores rather than an amalgamated score. Such a score would need weighing of the domains and that too would be done as a future extension of this research which would be done in a larger scale. The tool underwent exploratory factor analysis and it was not followed by confirmatory factor analysis in another study sample. Hence it is advisable to conduct confirmatory-factor analysis when this is used in another setting.
The reproducibility was not assessed for PQOLI and only the internal consistency reliability was assessed [80–82]. Similarly the responsiveness of the instrument was also not assessed [50, 51]. These reflect further directions on the future research o PQOLI. There were limited descriptive data on the characteristics of the study sample. Though this was done to minimize the time of data collection, it is another limitation of the study. However, in order to minimize any selection bias, participants with a history of physical or mental conditions that would affect the quality of life were excluded. Furthermore, the study settings were with free healthcare and were without any restriction of access [83].
Conclusions
PQOLI included 21 items which are categorized under 04 domains in its development. There is first evidence for sufficient construct validity of the PQOLI as a valid QOL tool for measuring the QOL of stroke survivors with satisfactory internal consistency reliability, when assessed using already validated QOL tools and with the “known group comparison method”. Five out of the six a-prori hypotheses were completely fulfilled in testing it for validity. Its internal consistency reliability was reflected to be satisfactory. PQOLI can be used for the assessment of QOL after 1 month from the end of acute-phase of management of the stroke survivors, following further explorations.
Supplementary information
Acknowledgements
The authors would like to acknowledge Prof Nalika Gunawardene for her technical inputs on the preparation of the manuscript and for the provision of validated SF-36 questionnaire free-of-charge. Furthermore the authors like to acknowledge the EuroQOL group for providing the translated version of EQ-5D-3 L (Registration ID:6554) and the dataset for the determination of EQ-5D-Index values free-of-charge.
Abbreviations
- QOL
Quality of Life
- PQOLI
Post-stroke Quality Of Life Index
- COSMIN
COnsensus-based Standards for the selection of health Measurement Instruments
- WHO
World Health Organization
- SF-36
Short Form 36
- EQ-5D-3 L
EuroQOL 5-Dimentional 3-level questionnaire
- EQ-VAS
EuroQOL Visual Analogue Scale
- LHS
London Handicap Scale
- NHP
Nottingham Health Profile
- SIP
Sickness Impact Profile
- KMO
Kaiser-Meyer-Olkin
Authors’ contributions
All authors were involved in the planning of the research study. PKB was the principal investigator and involved in getting ethics permissions, data collection, data analysis and writing of the manuscript. MW, S, SM, SN were involved in data analysis, data interpretation and writing of the manuscript. All authors went through the final manuscript. The author(s) read and approved the final manuscript.
Funding
The study was self-funded and was not funded by a third party.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Ethics approval was obtained from the Ethics Review Committee of Sri Lanka Medical Association prior to the data collection (Reference number: ERC/14–019 approval was given on 27th August 2014). Informed written consent was obtained from the participants.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
P.K.B. Mahesh, Email: buddhikamaheshpk@gmail.com
M.W. Gunathunga, Email: wasantg@commed.cmb.ac.lk
S. Jayasinghe, Email: sarojoffice@yahoo.com
S.M. Arnold, Email: mahendra_arnold@yahoo.com
S.N. Liyanage, Email: snliyanage0@gmail.com
Supplementary information
Supplementary information accompanies this paper at 10.1186/s12955-020-01436-7.
References
- 1.Thorvaldsen P, Kuulasmaa K, Rajakangas A-M, Rastenyte D, Sarti C, Wilhelmsen L. Stroke trends in the WHO MONICA project. Stroke. 1997;28(3):500–506. doi: 10.1161/01.STR.28.3.500. [DOI] [PubMed] [Google Scholar]
- 2.McKay J, Mensah GA, Mendis S, Greenlund K. The atlas of heart disease and stroke. Geneva: World Health Organization; 2004. [Google Scholar]
- 3.Yan LL, Li C, Chen J, et al. Prevention, management, and rehabilitation of stroke in low- and middle-income countries. eNeurologicalSci. 2016;2:21–30. doi: 10.1016/j.ensci.2016.02.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.The World Bank. Sri Lanka- Overview. https://www.worldbank.org/en/country/srilanka/overview. Published 2020.
- 5.Smith O. Sri Lanka: achieving pro-poor universal health coverage without health financing reforms. 2018. [Google Scholar]
- 6.Chang T, Gajasinghe S, Arambepola C. Prevalence of stroke and its risk factors in urban Sri Lanka: population-based study. Stroke. 2015;46(10):2965–2968. doi: 10.1161/STROKEAHA.115.010203. [DOI] [PubMed] [Google Scholar]
- 7.De Silva R, Gamage R, Wewelwala C, et al. Young strokes in Sri Lanka: an unsolved problem. J Stroke Cerebrovasc Dis. 2009;18(4):304–308. doi: 10.1016/j.jstrokecerebrovasdis.2008.11.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.WHO Development of the World Health Organization WHOQOL-BREF quality of life assessment. The WHOQOL group. Psychol Med. 1998;28(3):551–558. doi: 10.1017/S0033291798006667. [DOI] [PubMed] [Google Scholar]
- 9.Mahesh PKB, Gunathunga MW, Jayasinghe S, Arnold SM, Haniffa R, De Silva AP. Pre-event quality of life and its influence on the post-event quality of life among patients with ST elevation and non-ST elevation myocardial infarctions of a premier province of Sri Lanka. Health Qual Life Outcomes. 2017;15(1):154. doi: 10.1186/s12955-017-0730-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kim JS, Choi-Kwon S, Kwon SU, Lee HJ, Park KA, Seo YS. Factors affecting the quality of life after ischemic stroke: young versus old patients. J Clin Neurol. 2005;1:59–68. doi: 10.3988/jcn.2005.1.1.59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Abubakar SA, Isezuo SA. Health related quality of life of stroke survivors: experience of a stroke unit. Int J Biomed Sci. 2012;8(3):183–187. [PMC free article] [PubMed] [Google Scholar]
- 12.Xie G, Laskowitz DT, Turner EL, et al. Baseline health-related quality of life and 10-year all-cause mortality among 1739 Chinese adults. Schooling CM, ed. PLoS One. 2014;9(7):e101527. doi: 10.1371/journal.pone.0101527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Salinas J, Sprinkhuizen SM, Ackerson T, et al. An international standard set of patient-centered outcome measures after stroke. Stroke. 2016;47(1):180–186. doi: 10.1161/STROKEAHA.115.010898. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Oeyen SG, Vandijck DM, Benoit DD, Annemans L, Decruyenaere JM. Quality of life after intensive care: a systematic review of the literature. Crit Care Med. 2010;38(12):2386–2400. doi: 10.1097/CCM.0b013e3181f3dec5. [DOI] [PubMed] [Google Scholar]
- 15.Winters BD, Eberlein M, Leung J, Needham DM, Pronovost PJ, Sevransky JE. Long-term mortality and quality of life in sepsis: a systematic review. Crit Care Med. 2010;38(5):1276–1283. doi: 10.1097/CCM.0b013e3181d8cc1d. [DOI] [PubMed] [Google Scholar]
- 16.Herridge MSMS, Cheung AMAM, Tansey CMCM, et al. One-year outcomes in survivors of the acute respiratory distress syndrome. N Engl J Med. 2003;348(8):683–693. doi: 10.1056/NEJMoa022450. [DOI] [PubMed] [Google Scholar]
- 17.Griffiths JA, Barber VS, Cuthbertson BH, Young JD. A national survey of intensive care follow-up clinics. Anaesthesia. 2006;61(10):950–955. doi: 10.1111/j.1365-2044.2006.04792.x. [DOI] [PubMed] [Google Scholar]
- 18.Pappa E, Chatzikonstantinidou S, Chalkiopoulos G, Papadopoulos A, Niakas D. Health-related quality of life of the Roma in Greece: the role of socio-economic characteristics and housing conditions. Int J Environ Res Public Health. 2015;12(6):6669–6681. doi: 10.3390/ijerph120606669. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Thumboo J, Fong KY, Machin D, et al. Quality of life in an urban Asian population: the impact of ethnicity and socio-economic status. Soc Sci Med. 2003;56(8):1761–1772. doi: 10.1016/S0277-9536(02)00171-5. [DOI] [PubMed] [Google Scholar]
- 20.Hamidou Z, Baumstarck K, Chinot O, et al. Domains of quality of life freely expressed by cancer patients and their caregivers: contribution of the SEIQoL. Health Qual Life Outcomes. 2017;15(1):99. doi: 10.1186/s12955-017-0672-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Post M. Definitions of quality of life: what has happened and how to move on. Top Spinal Cord Inj Rehabil. 2014;20(3):167–180. doi: 10.1310/sci2003-167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Pietersma S, de Vries M, van den Akker-van Marle ME. Domains of quality of life: results of a three-stage Delphi consensus procedure among patients, family of patients, clinicians, scientists and the general public. Qual Life Res. 2013. 10.1007/s11136-013-0578-3. [DOI] [PMC free article] [PubMed]
- 23.Angus DC, Carlet J. Surviving intensive care: a report from the 2002 Brussels roundtable. Intensive Care Med. 2003;29(3):368–377. doi: 10.1007/s00134-002-1624-8. [DOI] [PubMed] [Google Scholar]
- 24.Ezejimofor MC, Chen Y-F, Kandala N-B, et al. Stroke survivors in low- and middle-income countries: a meta-analysis of prevalence and secular trends. J Neurol Sci. 2016;364:68–76. doi: 10.1016/j.jns.2016.03.016. [DOI] [PubMed] [Google Scholar]
- 25.Thrift AG, Arabshahi S. Is stroke incidence in low- to middle-income countries driven by economics? Int J Stroke. 2012;7(4):307–308. doi: 10.1111/j.1747-4949.2012.00819.x. [DOI] [PubMed] [Google Scholar]
- 26.Alim M, Lindley R, Felix C, et al. Family-led rehabilitation after stroke in India: the ATTEND trial, study protocol for a randomized controlled trial. Trials. 2016;17(1):13. doi: 10.1186/s13063-015-1129-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Sajjad A, Chowdhury R, Felix JF, et al. A systematic evaluation of stroke surveillance studies in low- and middle-income countries. Neurology. 2013;80(7):677–684. doi: 10.1212/WNL.0b013e318281cc6e. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Khalid W, Rozi S, Ali TS, et al. Quality of life after stroke in Pakistan. BMC Neurol. 2016;16(1):250. doi: 10.1186/s12883-016-0774-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Stenumgård PS, Rakotondranaivo MJ, Sletvold O, Follestad T, Ellekjær H. Stroke in a resource-constrained hospital in Madagascar. BMC Res Notes. 2017;10(1):307. doi: 10.1186/s13104-017-2627-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Langhammer B, Sunnerhagen KS, Stanghelle JK, Sällström S, Becker F, Fugl-Meyer K. Life satisfaction in persons with severe stroke – a longitudinal report from the Sunnaas International Network (SIN) stroke study. Eur Stroke J. 2017;2(2):154–162. doi: 10.1177/2396987317695140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Samsiah M, Das S, Chee SY, et al. The ideal measurement of the quality of life in post stroke patients: an urban study. Clin Ter. 2011;162(3):209–215. [PubMed] [Google Scholar]
- 32.Garratt A, Schmidt L, Mackintosh A, Fitzpatrick R. Quality of life measurement: bibliographic study of patient assessed health outcome measures. Bmj. 2002;324(7351):1417. doi: 10.1136/bmj.324.7351.1417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Kranciukaite D, Rastenyte D. Measurement of quality of life in stroke patients. Medicina (Kaunas) 2006;42(9):709–716. [PubMed] [Google Scholar]
- 34.Thompson DR, Yu C-M. Quality of life in patients with coronary heart disease-I: assessment tools. Health Qual Life Outcomes. 2003;1(1):42. doi: 10.1186/1477-7525-1-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Ware JE, Snow KK, Kosinski M, Gandek B. SF-36 health survey manual and interpretation guide. Bost New Engl Med Cent. 1993:1 v. (various pagings) http://books.google.com/books/about/SF_36_health_survey.html?id=WJsgAAAAMAAJ.
- 36.S P, V S, B Z, M M, P T, P E. Quality of life of stroke patients and their caregivers. Int J Phys Med Rehabil. 2017;05(01). 10.4172/2329-9096.1000387.
- 37.Mallawarachchi DSV. Quality of life of stroke patients presenting to selected hospitals in the Colombo District and the possibility of common mental disorders among the principal informal caregivers. 2007. [Google Scholar]
- 38.Rachpukdee S, Howteerakul N, Suwannapong N, Tang-aroonsin S. Quality of life of stroke survivors: a 3-month follow-up study. J Stroke Cerebrovasc Dis. 2013;22(7):e70–e78. doi: 10.1016/j.jstrokecerebrovasdis.2012.05.005. [DOI] [PubMed] [Google Scholar]
- 39.Mahesh PKB, Gunathunga MW, Jayasinghe S, Arnold SM, Liyanage SN. Factors influencing pre-stroke and post-stroke quality of life among stroke survivors in a lower middle-income country. Neurol Sci. 2018;39(2):287–295. doi: 10.1007/s10072-017-3172-6. [DOI] [PubMed] [Google Scholar]
- 40.Gunawardena NS, Seneviratne SRA, Atauda T. An approach to validation of a multi-dimensional tool. J Coll Community Physicians Sri Lanka. 2003;8:18–26. [Google Scholar]
- 41.Reenen M, Oppe M. EQ-5D-3L User Guide. Netherland: EuroQol Research Foundation; 2015. [Google Scholar]
- 42.Mahesh P.K.B, Gunathunga M.W.JS. Influence of social determinants on the disease-outcome, financial burden and quality of life after a critical illness due to chronic Non Communicable Diseases, among patients treated at government hospitals in the Western province of Sri Lanka. 2015.
- 43.Kularatna S, Whitty JA, Johnson NW, Jayasinghe R, Scuffham PA. EQ-5D-3L derived population norms for health related quality of life in Sri Lanka. Bammann K, ed. PLoS One. 2014;9(11):e108434. doi: 10.1371/journal.pone.0108434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Mokkink LB, Terwee CB, Knol DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10(1):22. doi: 10.1186/1471-2288-10-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–745. doi: 10.1016/j.jclinepi.2010.02.006. [DOI] [PubMed] [Google Scholar]
- 46.Banks JL, Marotta CA. Outcomes validity and reliability of the modified Rankin scale: implications for stroke clinical trials - a literature review and synthesis. Stroke. 2007;38(3):1091–1096. doi: 10.1161/01.STR.0000258355.23810.c6. [DOI] [PubMed] [Google Scholar]
- 47.Abramson JH, Abramson Z. Survey methods in community medicine. 5. Edinburgh: Churchil Livingstone; 1999. [Google Scholar]
- 48.Richardson J, Iezzi A, Khan MA, Maxwell A. Validity and reliability of the assessment of quality of life (AQoL)-8D multi-attribute utility instrument. Patient. 2014;7(1):85–96. doi: 10.1007/s40271-013-0036-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Tang W, Cui Y, Babenko O. Internal consistency: do we really know what it is and how to assess it? J Psychol Behav Sci. 2014;2(2):205–220. [Google Scholar]
- 50.Angst F. The new COSMIN guidelines confront traditional concepts of responsiveness. BMC Med Res Methodol. 2011;11(1):152. doi: 10.1186/1471-2288-11-152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Alderman N, Williams C, Knight C, Wood RL. Measuring change in symptoms of neurobehavioural disability: responsiveness of the St Andrew’s-Swansea neurobehavioural outcome scale. Arch Clin Neuropsychol. 2017:1–12. 10.1093/arclin/acx026. [DOI] [PubMed]
- 52.Ranawaka UK. Stroke care in Sri Lanka: the way we were, the way we are, and the way forward. J Stroke Med. 2018;1(1):45–50. doi: 10.1177/2516608518774167. [DOI] [Google Scholar]
- 53.Buck D, Jacoby A, Massey A, Ford G. Evaluation of measures used to assess quality of life after stroke. Stroke. 2000;31(8):2004–2010. doi: 10.1161/01.STR.31.8.2004. [DOI] [PubMed] [Google Scholar]
- 54.Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 2008. [Google Scholar]
- 55.Tsang S, Royse CF, Terkawi AS. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J Anaesth. 2017;11(Suppl 1):S80–S89. doi: 10.4103/sja.SJA_203_17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Osborne JW, Costello AB. Sample size and subject to item ratio in principal components analysis. Pract Assesment Res Eval. 2004.
- 57.Hauben M, Hung E, Hsieh W-Y. An exploratory factor analysis of the spontaneous reporting of severe cutaneous adverse reactions. Ther Adv Drug Saf. 2017;8(1):4–16. doi: 10.1177/2042098616670799. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Mahesh PKB, Gunathunga MW, Jayasinghe S, et al. Financial burden of survivors of medically-managed myocardial infarction and its association with selected social determinants and quality of life in a lower middle income country. BMC Cardiovasc Disord. 2017;17(1):251. doi: 10.1186/s12872-017-0687-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Luo N, Chew LH, Fong KY, et al. Validity and reliability of the EQ-5D self-report questionnaire in Chinese-speaking patients with rheumatic diseases in Singapore. Ann Acad Med Singap. 2003;32(5):685–690. [PubMed] [Google Scholar]
- 60.Rosales RS, Martin-Hidalgo Y, Reboso-Morales L, Atroshi I. Reliability and construct validity of the Spanish version of the 6-item CTS symptoms scale for outcomes assessment in carpal tunnel syndrome. BMC Musculoskelet Disord. 2016;17(1):115. doi: 10.1186/s12891-016-0963-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.O’Brien KK, Solomon P, Bergin C, et al. Reliability and validity of a new HIV-specific questionnaire with adults living with HIV in Canada and Ireland: the HIV Disability Questionnaire (HDQ) Health Qual Life Outcomes. 2015;13(1):124. doi: 10.1186/s12955-015-0310-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Paradowski PT, Kęska R, Witoński D. Validation of the Polish version of the Knee injury and Osteoarthritis Outcome Score (KOOS) in patients with osteoarthritis undergoing total knee replacement. BMJ Open. 2015;5(7):e006947. doi: 10.1136/bmjopen-2014-006947. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Cho E, Kim S. Cronbach’s coefficient alpha: well known but poorly understood. Organ Res Methods. 2015. 10.1177/1094428114555994.
- 64.Kothari RU, Pancioli A, Liu T, Brott T, Broderick J. Cincinnati prehospital stroke scale: reproducibility and validity. Ann Emerg Med. 1999;33(4):373–378. doi: 10.1016/S0196-0644(99)70299-4. [DOI] [PubMed] [Google Scholar]
- 65.Williams Weinberger M, Harris LE, Clark DO, Biller JLS. Stroke-specific quality of life scale. Stroke. 1999;30(7):1362–1369. doi: 10.1161/01.STR.30.7.1362. [DOI] [PubMed] [Google Scholar]
- 66.Collin C, Wade DT, Davies S, Horne V. The Barthel ADL index: a reliability study. Int Disabil Stud. 1988;10(2):61–63. doi: 10.3109/09638288809164103. [DOI] [PubMed] [Google Scholar]
- 67.Gerety MB, Cornell JE, Mulrow CD, et al. The sickness impact profile for nursing homes (SIP-NH) J Gerontol. 1994;49(1):M2–M8. doi: 10.1093/geronj/49.1.M2. [DOI] [PubMed] [Google Scholar]
- 68.Schuling J, de Haan R, Limburg M, Groenier KH. The Frenchay activities index. Assessment of functional status in stroke patients. Stroke. 1993;24(8):1173–1177. doi: 10.1093/AGEING/12.2.166. [DOI] [PubMed] [Google Scholar]
- 69.Farnik M. Instrument development and evaluation for patient-related outcomes assessments. Patient Relat Outcome Meas. 2012;1. 10.2147/PROM.S14405. [DOI] [PMC free article] [PubMed]
- 70.Kim H, Ku B, Kim JY, Park Y-J, Park Y-B. Confirmatory and exploratory factor analysis for validating the phlegm pattern questionnaire for healthy subjects. Evid Based Complement Alternat Med. 2016;2016:1–8. doi: 10.1155/2016/2696019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Rhemtulla M, Brosseau-Liard PÉ, Savalei V. When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychol Methods. 2012;17(3):354–373. doi: 10.1037/a0029315. [DOI] [PubMed] [Google Scholar]
- 72.Yong AG, Pearce S. A beginner’s guide to factor analysis: focusing on exploratory factor analysis. Tutor Quant Methods Psychol. 2013;9(2):79–94. doi: 10.20982/tqmp.09.2.p079. [DOI] [Google Scholar]
- 73.Rochette SBM. Guidelines for using exploratory factor analysis to test construct validity of inventories in sports research. Am J Sport Train. 2016:3 http://www.ajst.science/article/417/.
- 74.Santos JRA. Cronbach’s alpha: a tool for assessing the reliability of scales. J Ext. 1999;37(2):1–5. [Google Scholar]
- 75.Asadi-Lari M, Tamburini M, Gray D. Patients’ needs, satisfaction, and health related quality of life: towards a comprehensive model. Health Qual Life Outcomes. 2004;2(1):32. doi: 10.1186/1477-7525-2-32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Katona M, Schmidt R, Schupp W, Graessel E. Predictors of health-related quality of life in stroke patients after neurological inpatient rehabilitation: a prospective study. Health Qual Life Outcomes. 2015;13(1):58. doi: 10.1186/s12955-015-0258-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Swank JM, Mullen PR. Evaluating evidence for conceptually related constructs using bivariate correlations. Meas Eval Couns Dev. 2017;50(4):270–274. doi: 10.1080/07481756.2017.1339562. [DOI] [Google Scholar]
- 78.Watson JC, Flamez B. Counseling assessment and evaluation: fundamentals of applied practice. Thousand Oaks: Sage; 2015. [Google Scholar]
- 79.Sink C, Stroh H. Practical significance: the use of effect sizes in school counseling research. Prof Sch Couns. 2006. 10.5330/prsc.9.4.283746k664204023.
- 80.Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Heal Pharm. 2008;65(23):2276–2284. doi: 10.2146/ajhp070364. [DOI] [PubMed] [Google Scholar]
- 81.Paiva CE, Barroso EM, Carneseca EC, et al. A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review. BMC Med Res Methodol. 2014;14(1):8. doi: 10.1186/1471-2288-14-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Fayers PM, Machin D. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes: second edition. 2007. [Google Scholar]
- 83.Mahesh PKB, Gunathunga MW, Jayasinghe S, et al. Construct validity and reliability of EQ-5D-3L for stroke survivors in a lower middle income setting. Ceylon Med J. 2019;64(2):52. doi: 10.4038/cmj.v64i2.8891. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.