Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2019 Mar 7.
Published in final edited form as: Expert Rev Qual Life Cancer Care. 2017 Nov 8;2(6):293–302. doi: 10.1080/23809000.2017.1400911

Quality of Life in Palliative Care

Mellar P Davis 1, David Hui 2
PMCID: PMC6405258  NIHMSID: NIHMS1501801  PMID: 30854466

Abstract

Introduction:

A main goals of palliative care is to improve the health-related quality of life (QOL) of patients with advanced illnesses. The objective of this narrative review is to provide an updated synopsis on the use of QOL questionnaires in the palliative care setting.

Areas covers:

Focusing on the palliative cares setting, we will define QOL, discuss how QOL instruments can be used clinically and in research, review approaches to validate these questionnaires, and how they can be used in utility analyses.

Expert opinion/commentary:

Several QOL questionnaires, such as EORTC-QLQ-C30, McGill QOL questionnaire and EQ-5D have been validated in the palliative care setting. However, significant gaps impede their application, including lack of determination of their responsiveness to change and minimal clinically important differences, the need to conduct more psychometric validation on QOL questionnaires among patients at various stages of disease trajectory, and the paucity of studies examining utility and cost-effectiveness. Further research is needed to address these knowledge gaps so QOL questionnaires can be better used to inform clinical practice and research.

Keywords: palliative care, patient outcome assessment, quality of life, reproducibility of results, validity of results

1. What is quality of life?

Health related quality of life (QOL) is not the absence of disease or suffering but is largely a response to a series of life events that influence quality and quantity of life (1). QOL can also be defined as a subjective evaluation of life as good or satisfactory overall. Individuals may have a disease yet not be “ill” or experience a reduction in perceived QOL. Similarly, there are individuals without disease who complains of being “ill” and have poor QOL (24). Individuals with the same disease stage or severity may have vastly different QOL. Group changes in QOL related to disease, therefore, may not reflect individual responses to disease (57). This is an important issue when interpreting group related QOL outcomes.

QOL is one of the important outcome measures in clinical trials and the most important determining treatment utility (cost effectiveness). QOL is the principal outcome to palliative care interventions (812).

2. What does QOL mean to patients?

Even though innumerable QOL questionnaires has been developed in palliative care, there is not a single questionnaire that fits all purposes and individuals. Patient perspectives when queried about QOL include the following perspectives: Fulfillment of personal goals, good control of physical symptoms, emotional well-being, the ability to lead a normal life and maintain a sense of self, sociability (role within the family and society), existential and transcendent fulfillment, finding meaning in life, adaptability or resiliency, changing values or recalibration of goals with the disease trajectory (13).

In this sense, the World Health Organization definition as “an individual’s perception of their position in life in the context of culture (family and society) and value system in which they live and in relation to their goals, expectations, standards and concerns” is more fitting. “Those who report the very poorest QOL will be least likely to have met their own ‘...goals, expectations, standards and concerns’”(14).This fits well into the concept of “Calman’s gap”(15). This concept views QOL as a ratio or gap between expectation and realization. A narrow gap defines good QOL where patient expectations match reality and poor QOL where patient expectations exceed reality. Collusion and therapeutic misperceptions are a means of falsely maintaining QOL by narrowing the gap. Presenting an overly optimistic future recovery and survival is also another way of falsely narrowing the gap. For example, a recent study found that patients who reported an inaccurate understanding of their advanced illness had better QOL(16). The purpose of palliative care in this context is to reduce this gap through facilitation of a response shift in QOL by helping patients recalibrate expectations and shift important domains with disease projection. Therapies which improve a patient’s sense of who they are as a person will also increase QOL. In addition, excellent symptom management and improvement in function through rehabilitation are means of reducing the gap thus improving QOL.

QOL is not static and will change as the disease progresses (17).There may be changes in reflective items. I and there are changes in causative items in questionnaires that influence QOL scores. Fatigue, physical function, and mood often worsen while pain and certain gastrointestinal symptoms are controlled with progressive disease. Fixed item QOL instruments will not reflect this shift in importance as each item is given equal weight when scoring QOL (18). The European Organization for Research and Treatment of Cancer QOL questionnaire (EORTC-QLQ-C30) commonly used in cancer therapeutic trials has been adapted to palliative care (EORTC QLQ-C15-PAL ) which better reflects QOL at the end-of-life (EOL) (19). The SEIQOL-DW questionnaire measures changes in QOL domains with disease course and thus adapted for recalibrations and response shifts over time. This QOL tool can detect the capacity to change priorities over time and resilience of patient resilience. However, the SEIQOL-DW questionnaire index score does not correlate with objective health, functional status, demographic and clinical parameters. The SEIQOL-DW reflects the patient’s capacity to value domains other than health in life, despite having health problems The main drawback to using this type of questionnaire is that one cannot quantitatively measure the minimal clinical important difference (MCID) in QOL to gauge therapeutic responses to interventions nor can it be used to estimate utility in cost-effectiveness analyses (20).

So, at the EOL what domains influence the QOL (and death)? In an article which used the Good Death Inventory, physical and psychological comfort, living at the preferred location, maintaining hope and pleasure, having a good relationship with the medical team, having good family relationships, maintaining independence as long as possible, being respected as a person, feeling fulfilled in having achieved life goals were of primary importance (21). Many of these domains are not assessed by commonly used questionnaires such as the EORTC-QLQ-C30 and the EUROL questionnaire EQ-5D which is a barrier to assessing utility at the EOL (8, 2226). Because patients often develop delirium in the last weeks/days of life, some investigators have relied on caregivers to provide ratings of the patient’s QOL (27).A utility measure is needed to measure quality of dying since standard utility measures like the EQ- 5D gauge levels of health and not dying. Further research is needed to develop and validate QOL questionnaires appropriate for patients at different points of their disease trajectory.

3. Why measure QOL?

QOL questionnaires may be used for non-research purposes, to survey important domains to identify areas of distress for the purposes of beginning a conversation on what is important to the patient. The Missoula-VITAS QOL Index is validated and is an excellent tool to use for this purpose (2830).

Quality of life questionnaires often are a primary or secondary outcome in many palliative care interventional trials. These questionnaires should ideally not only be validated and reliable, but also be sensitive and responsive to changes in QOL over time (clinimetrically sound). Specifically for this purpose, the MCID needs to be established for the population for which the questionnaire is being used (31).

QOL questionnaires are also used to help manage service delivery and monitor quality. The EORTC-QLQ- C15 PAL, the Palliative Care Outcome Scale (POS) and the Support Team Assessment Schedule (STAS) have been used to audit palliative care for quality outcomes (32, 33). As healthcare becomes more value-based, QOL questionnaires will be increasingly used to inform policy makers about cost effectiveness (utility) of various interventions. Utility represented by quality adjusted life years saved (QALY) is an unique challenge to palliative care (34), which will be discussed in a later section. Certain QOL questionnaires (EQ-5D and SF-36) are utility tools which can discrimination levels of health (3538).

4. Reliability, Validity, Responsiveness: Are there unique problems in palliative care?

The validity of a QOL questionnaire is assessed in multiple ways. Face validity involves reviewing the questions to see if items make intuitive sense. Content validity assesses the degree to which the domains of interest are represented fully in the questionnaire. Construct validity is the measure of correspondence to what is expected by comparison to either another validated questionnaire or to objective measure (e.g. performance score). This “external” validation may be convergent (predicting an outcome) or divergent (discriminating between different distinct groups). QOL may not change with the course of disease. It is also important to recognize that the validity of a questionnaire is highly dependent on the disease state. Static questions that may be appropriate for one disease state may be irrelevant later in the disease course and may be left blank by perplexed patients (e.g. appetite and food consumption when a patient is dependent on PEG tube for feeding at the EOL) (39). It is this important to recognize the appropriate population for which the questionnaire has been validated. An important challenge to QOL assessments in palliative care is the highly diverse patient population with different diagnoses, disease states/prognosis, and languages. It is thus particularly important to validate questionnaires for specific populations. Unfortunately, in palliative care there has been a relative lack of adequately powered studies to validate many existing QOL questionnaires. Most remain under developed.

Reliability refers to the degree to which a questionnaire is free from random error, and includes both internal consistency and reproducibility (i.e. test-retest reliability, inter-rater reliability). Internal consistency measures how well items within a domain or subscale correspond with each other. This is determined most often by Cronbach alpha or factor analysis (40). A high degree of reliability (Cronbach alpha >0.7) facilitates power calculations using a questionnaire’s MCID (41). Internal consistency requires an adequate number of individuals completing the instrument which is estimated to be at least 100 and adequate categories per item, usually 7 or more (40). Items within domains are either reflective or causative (causative items directly influence QOL such as pain or nausea). Causative items can cluster making factor analysis a poor fit for measuring internal consistency. Reliability also involves repeatability which needs to be measured when QOL is stable. Test and retest reliability generally requires at least 50 patients to be reliable (40, 4244). The difficulty with palliative care patients is that QOL is less likely to be stable. Repeatability is assessed too soon (within days), there is likely to be recall bias. The appropriate interval to determine reliability in palliative care is not established (40). Interrater reliability becomes important if there are multiple assessors. An intraclass correlation coefficient (Kappa) is the proportion of agreement corrected for chance which can be used if there are multiple assessors. Kappa is scaled from −1 to +1. The negative value indicates poorer agreement than chance, zero represents chance agreement and positive better than chance agreement. The intraclass correlation coefficient can only be used for binary or nominal scale ratings (45).

Responsiveness measures instrument sensitivity to change over time which have clinical or patient centered importance (46). This requires measuring random measurement error or variability and corresponding changes in mean scores pre-and post-intervention that an individual, group experiences or between group differences. There are 2 approaches to measuring sensitivity; a distributional and anchor based approach, which will be discussed further (6, 4753). Finally, in the last weeks and days of life, delirium is common which can affect how QOL can be assessed. Surrogate substitution will add another element of variability since there is not a perfect correspondence between patient surrogate assessment of QOL.

5. Why is it important to measure meaningful changes in QOL? What are the methods?

Clinicians have difficulty in interpreting QOL and QOL scores. What magnitude of change is clinically significance? This is particularly true for palliative care where the primary outcome is QOL. QOL should be measured regularly either at every clinical visit or consistently over time to detect patient’s improvement, stability or deterioration with palliative interventions over time. Unfortunately,QOL is not routinely measured, is poorly collected in clinical trials and usually a secondary or tertiary outcome (54).

Responsiveness can be estimated by repeating QOL questionnaires over time in observational studies, in single arm interventional studies or randomized trials. Minimal important differences are estimated by various statistical methods: the paired T test, Cohen effect size, standardized response mean and responsiveness (31, 51, 52, 54). The basic statistical principle is the pre-and posttest mean (assuming normality) is divided by intra or intergroup random error or variability. For the Cohen, standard mean difference, for example, is the difference between the group mean pre- and post-intervention divided by the standard deviation of the group baseline values. A minimal important different (MID) in effect size is often designated as a standardized mean different (SMD) of 0.2 (although not universally embraced as some would use 0.5), moderately important differences are 0.5 and large differences 0.8 (55, 56). The advantages of distributional methods are that they are often easily obtained, do not require a clinical anchor, and provide an idea of the data distribution. Confidence intervals are established for precision which cannot be done for anchor methods. However, few agree on such an approach as the benchmark for clinical relevance and some debate the appropriateness of a 0.2 SMD as the definition of MID (57, 58). The distribution approach remains abstract to clinicians though the SMD can be translated into the numbers needed to treat (NNT), as long as the reliability is acceptable (Cronbach alpha +/> 0.7) (59, 60). However, distributional approaches are best used in conjunction with anchor methods in determining important changes in QOL scores (60). There have been attempts to correlate important differences between distributional methods and anchor-based methods. One standard error the mean or 1/2 standard deviation difference between pre-and post-test mean QOL scores correlates with an effect size of 0.5 if reliability by Cronbach alpha is >0.75 and 0.2 if the Cronbach alpha is >0.9 (5961).However, patients need to be in the moderate and not extremes of QOL for this relationship to hold true (62, 63) The MCID from anchor-based methods have not been directly compared to the distributional approach for most QOL questionnaires.

The MCID is “the smallest difference in a score corrected for random noise within a domain of interest which patients perceive as beneficial and which would mandate, in the absence of troublesome side effects or excessive costs, a change in patient management”(53). Unlike distributional methods, anchor methods are patient-centered. One way MCID is determined is to use individual rated global perceived improvements or diminished QOL. By using this anchor approach proportional response outcome ( “responder’s analysis”) is possible which is not possible with distributional methods (7, 53). Population based approaches use external outcomes as anchors to define treatment responses. For example, a 10- point improvement in a QOL questionnaire might be associated with a 20% improvement in function and survival. The MCID, therefore, is a 10- point improvement in the questionnaire scale. The results can be expressed in absolute changes in the scale or relative changes (as a percentage) of the total score. The absolute changes are easier to analyze (6466). Another commonly used anchor method is to use the global impressions of patient perceived change (scales such as −7 to +7) which is dichotomized and used to construct receiver-operating characteristics curves for cut off values which are used to determine sensitivity and specificity (5, 53, 6770).

There are drawbacks to anchor methods. Meaningful important changes are not bidirectional, are anchor dependent and not immutable (52, 7173). The lack of bidirectional symmetry in QOL is observed with well-known QOL tools such as the SF-36 and the Functional Assessment of Cancer Therapy (52, 74). It is unlikely that there will be one MCID for all populations (61, 75, 76); however, because of limited research, the few available MCIDs are often being applied liberally outside of the specific populations from which they were derived. If one is using a global assessment of QOL by patients, the threshold chosen for cut off in the Likert scale (e.g. −7 to +7) will influence the MCID. Anchors do not take into account precision such that the MCID can be within measurement error (63, 77). There can be also be differences between population-based anchors and individual perceived global changes and disease course. For instance, the SF-36 QOL changes follow more closely patient global anchors and physician assessment of response than actual disease course in rheumatoid arthritis (78). Global anchors are subject to response shifts as patients experience their illness. Moreover, global anchors are subject to regression toward the mean. Patients with worst QOL will shift responses toward the mean or less severe rating over time without any intervention (77, 79).

Because of the limitations with both anchor-based and distribution-based approaches, it is recommended that several methods be used to determine the MCID in QOL questionnaires rather than relying on a single approach (52, 71, 77).

Palliative care QOL questionnaires are in general tested psychometrically but the majority lack responsiveness (clinemetrics) (40, 80). Most clinicians depend on statistically significant differences for reporting outcomes and have misinterpreted statistical difference as clinically important. Most have interpreted sound psychometrics of a QOL measure as an indicator of its clinical usefulness. Validity and reliability are only the first step in developing a QOL questionnaire. It is useful clinically when responsiveness is established. It is important that palliative care specialists understand how to interpret QOL changes and understand the clinimetrics of these measures. This will be critically important in a value-based and population-based reimbursement systems in which utility will become important to public and private payers and to policy makers.

6. What is utility and is at relevant to palliative care?

When QOL is used in palliative care the endpoint should have relevance both clinically and economically. QOL questionnaires are adapted to reflect health states or levels which have utility when determining economic outcomes to palliative. Palliative interventions should improve QOL even if they do not improve survival and thus have a positive influence on quality adjusted life years saved(QALYS). The utility of the intervention will be determined by the cost of the intervention in relationship to the change in health state. Interventions which have a small benefit but large cost will not have value in population based health. It will be difficult for palliative care specialists to convince policy makers and payers to support palliative interventions without including utility or cost effectiveness (8184). This is the major future challenge in palliative care. For if palliative care thrives in a value based or population based reimbursement health care system, the specialty will have to show value.

In the era of value-based healthcare, the difference in QALYS before and after an intervention is calculated to estimate its benefits on quality and quantity of life. QALYS is determined by multiplying the length of time (years) with the score for being in a health state during that time. The health state is estimated by QOL questionnaire scores, adjusted for the relative weight for each QOL domain based on patient preferences. Some QOL questionnaires, such as EQ-5D, assessment of QOL and SF-36 transformed to the SF-6D, already have relative weights established based on population based studies, and are particularly useful for utility analyses. The difference in QALYS with or without an intervention generally provides an estimated value between −1 and 1, where 0 indicates a health state as bad as being dead for 1 year, 1 indicates full health, and a negative score indicates a health state worse than death. Cost-effectiveness is assessed by dividing the cost of an intervention by the difference in QALYS, and is sometimes used to make decisions regarding the value of interventions within health care systems. In this sense utility is quite patient centered because they “vote” on interventions by their perceived QOL and benefits.

The QOL measure SF-36 transformed into a utility tool (SF-6D) has 6 QOL domains each with 2–6 health levels. These six domains are physical function, role limitation, social function, pain, mental health and vitality. Values of health range can from 0.35 to 1.0 with this tool (85). The SF-6D MID is 0.03 (mean) and effect size 0.051 (86, 87).

The Assessment of QOL Instrument has been transformed into a utility questionnaire consisting of 5 dimensions (illness, independent living, social relationships, physical function, psychological well-being); 4 dimensions are combined into a multiplicative model weighted for community values. The value in health states range from 0.04 to 1.0. Utility scores of <0.37 with this instrument predict a two-fold increase in readmissions for hospitalized patients (88).

The EQ-5D is the most commonly used utility tool internationally. There are 3 and 5 level Likert question forms (EQ-5D-5L and EQ-5D-3L). There is less of a ceiling effect with the EQ-5D-5L questionnaire. Scores range from −0.59 to 1 with negative values being worse than death and 1 being perfect health. There are population differences in preference values (89). The MID between the SF-6D and EQ-5D are not equal and differ in absolute values. Both separate health status as very good, good, fair, bad and very bad but there is disagreement between the SF-6D and EQ-5D particularly at the lower end of the scale (poor health status) (90, 91).

QOL questionnaires with similar domains as the EQ-5D or SF-6D can be mapped on to these utility measures in clinical studies(9294). Mapping facilitates the use of QOL questionnaires for both clinical outcomes and cost-effectiveness analyses if domains between the QOL questionnaire and utility tool are congruent. QOL questionnaires used to map utility measures also need to have MCIDs established. Mapping between questionnaires is more accurate if multiple predictors are used. Important characteristics include the following: a population that complete a utility measure (e.g. EQ-5D) and QOL questionnaire, similar patient characteristics across studies for which patients complete the utility measure and the QOL questionnaires, an adequate number of patients completing both questionnaires, clinical effectiveness or health outcomes are well-defined, and outcomes are important to the population (25, 95, 96).

There are several draw backs to mapping QOL questionnaires to utility tools. Mapping regression between tools is population dependent. Furthermore, regression algorithms differ between populations such that “one sized does not fit all” (96). Certain commonly used questionnaires such as the IPOS and IPOS-S do not map at all to the EQ-5D and cannot be used for utility if the EQ-5D is used (97). In more general terms, patient views of utility are different than the health care system. Patients are concerned about whether palliative interventions of any sort will benefit them and not be costly to them personally. Utility measures for the most part is blind to family financial toxicity and are focused on medical system economics. QALYS assumes a linear value on the length of life yet patients frequently value time greater near the EOL than at the beginning of their terminal illness, or they may value it in a different way which cannot be measured by fixed utility questionnaires. The metrics of quality of death, as previously mentioned, are missed by the EQ-5D and SF-6D. Dissecting the most valuable components of a complex intervention like palliative care that contributes the greatest value to QOL cannot be detected by utility tools (34).Palliative specialists have an urgent need to develop utility measures for their specialty.

7. What is the evidence that palliative care improves QOL?

A meta-analysis of recently published studies which measured the effect of specialist palliative care services in various locations (hospital, hospice or community setting) on QOL 8 studies, 3 of which had a small but statistically significant difference favoring palliative care and four studies had nonsignificant differences. (98). The effect size (by SMD) was 0.16 (95% confidence interval 0.01–0.31). By sensitivity analysis the SMD was 0.57 (95% confidence interval-0.02 to 1.15). For patients receiving specialist palliative care early the effect size was 0.33 (95% confidence interval 0.05–0.61). A second study analyzed 10 palliative care studies of which 3 were randomized controlled trials. The quality of the studies was moderate to low and the great majority of patients had cancer. The effect size was estimated in half of the studies which was 0.27. The effect size was greater in the observation studies than the randomized trials (99). A third study measured QOL at the EOL using the Good Death Inventory (100). Of the 10 domains, 3 were improved (favorable place, maintained hope and pleasure, living in a comfortable environment) with an effect sizes of 0.1, 0.1 and 0.09 respectively. The benefits were greater in those with worse performance score (ECOG 3 and 4) with an effect size of 0.54.

These population-based effect sizes may seem disappointing regarding the benefits of palliative care on QOL. The effect size seemed in certain cases to be less than the MID previously discussed. However, the population standard median differences are made up of individuals who dramatically improve, those who have modest improvements, and those whose QOL remains stable or those that worsen. Certain groups appear to benefit more than others. Those seen earlier by palliative care had greater improvement in their QOL. Those with poor performance score at the EOL benefitted more than those with good performance scores though this is likely related to the questionnaire used to measure QOL and perhaps regression towards the mean. The real difficulty in gauging QOL benefits of palliative care is the lack of individual responses expressed in those achieving MCID. This would allow us to gauge proportionate or percentage responses (101).This is a significant problem in interpreting the present studies.

8. Which QOL tools should be considered in palliative care?

A recent systematic review of QOL questionnaires in palliative care recommended three measures which had adequate psychometrics (40), including the McGill QOL Questionnaire, the QOL at the End of Life questionnaire and the Quality of Death and Dying questionnaire (102104). The reviewer found that the weakest psychometrics for these questionnaires was responsiveness. A survey of questionnaires used by palliative care specialists in Europe found that the European Organization for Research and Treatment of Cancer QOL questionnaire (EORTC-QLQ-C30) and the Patient Care Outcome Scale (I-POS) were most commonly used (42).

8.1. McGill QOL Questionnaire

The McGill QOL Questionnaire contains 16 items each having 11 responses per item (0–10) included in the questionnaire are psychological symptoms, existential well-being, support, physical symptoms. These domains were validated by factor analysis. The time required to complete the questionnaire was 10–30 minutes. The recall was 2 days. There are sub scale scores are available. This measure has been validated in inpatient palliative care patients. The reliability (Cronbach alpha) was greater than 0.7 except for physical symptoms which was 0.62. It had an intra-class correlation coefficient of 0.62–0.85 as a second measure of reliability. It has been validated by the Spitzer QOL Index and was externally validated against pain intensity. Pain intensity correlated with a 0.56 change in the existential subscale and 0.66 in the total scale. The effect size differences were significant for good to average days and average to bad days for the physical symptoms and support domains (104107).

The McGill QOL questionnaire has been shortened. The shortened form has been validated in 190 terminally ill patients. The time to complete the questionnaire was 3.3 minutes. The Cronbach alpha ranged from 0.46 to 0.86 when compared to the long form of the questionnaire. There was a strong correlation with the multiple domains of the original McGill QOL Questionnaire. Scores were externally validated to hemoglobin levels. The construct validity was supported also by principal component analysis (108).

8.2. QOL at the End of Life Questionnaire

This questionnaire contains 25 items with 5 responses per item. Domains include outlook, inspiration, spiritual activity, religion, community. Recall is at 1 week and 1 month. It requires a structured interview. There is a total and sub section scoring system. The populations for which this was validated included those with heart failure, COPD, cancer and end-stage renal disease and so a diverse population which is an advantage. The internal consistency was greater than 0.7. It correlated with the Functional Assessment of Chronic Illness- spiritual subscale (>0.6) and preparation subscale (o.4–0.6). It moderately correlated with the Missoula-VITAS QOL Index (103).

8.3. Quality of Dying and Death Questionnaire

This questionnaire assesses the quality of death from the perspective of bereaved caregivers or health care professionals. It contains 31 items with 11 potential responses per item (0–10). Domains are symptoms, personal care, preparation for death, moment of death, family, treatment preferences, whole person concerns. The questionnaire is administered by semi-structured proxy interview. The recall is retrospective. The Cronbach alpha for internal consistency is 0.89. Factor analysis did not support subscale construct based on the questionnaires domains. The study population were dying patients. Higher scores were associated with death at home, death in a preferred location, better rating of symptom treatment, adherence to patient preferences, family satisfaction with communication and care, availability of the healthcare team members (102).

8.4. Palliative Care Outcome Scale

This scale was constructed through agreement between staff and patient ratings for 8 of the 10 items. It was validated in 148 palliative care patients. Both staff completed and patient completed scales are available. The original scale has been expanded to include symptoms. The reliability is acceptable with a Cronbach alpha of 0.65 for patient completed questionnaires and 0.74 staff completed questionnaires. It has a construct validity with a range of Spearman correlations from 0.48 to 0.8 using the EORTC-QLQ- C30 and the STAS questionnaires. Test and re-test reliability is acceptable for 7 of 10 items. A change was noted in the scale scores with disease progression but this was not statistically significant (109, 110). It has been validated in patients with cancer using cognitive debriefing of both patients and oncologists. Factor analysis validated distinct domains which were emotional well-being, consequences of disease, received informational support, anxiety and burden of disease. This however has been disputed. A second study suggested that the measure consists of 2 factors (psychological well-being and 3 items related to professional care). Three items were considered independent (family anxiety, symptoms and pain). The author felt the POS better reflected quality of care rather than QOL (111). The experience with the POS has been expanded to include patients with HIV, those with neurologic, pulmonary, cardiac and kidney diseases. It has been used as an outcome to study symptom prevalence and to audit quality of care (32, 112).

8.5. European Organization for Research and Treatment cancer QOL Questionnaire

The EORTC-QLQ-C30 has 9 multi item domains, 5 functional scales (physical, role, cognitive, emotional, social) and 3 symptoms scales (fatigue, pain, nausea and vomiting) (113). It contains a global scale for health and a QOL scale with the time frame of 1 week. There are several single item symptoms scales.

It was initially validated in 305 patients in 13 countries. It takes 11 minutes to complete. Only the functional scale, work and household work failed to meet reliability standards (Cronbach alpha of 0.7 or greater). Intrascale correlations were significant. Each scale appeared to assess distinctly different domains of QOL. It had discriminative validity based on the ECOG performance scale. There were statistically significant changes in the expected direction for physical and role function, global QOL well, fatigue, nausea and vomiting in patients who had either improved or worsened in their performance score. The psychometrics appeared to be consistent across countries and has been validated in terminally ill patients (114).

The measure has also been validated against the Hospital Anxiety and Depression Scale, the Edmonton Symptom Assessment Scale and the WHO-QOL Brief Scale. It has a Cronbach alpha greater than 0.7 in this second study except for social function (0.69), cognitive scale (0.57) and nausea and vomiting (0.69). This study confirmed that it discriminated patient groups by performance score and by treatment and education (115).

A review of 30 studies which used the EORTC-QLQ-C30 found that it improved prognostication by 5–8% over clinical variables alone in many cancers with nausea and vomiting, anorexia, dyspnea, role function and physical function adding to prognostication. Causative items clusters varied by disease. Minimal important differences have been established but these will differ based on the patient population (116).

The EORTC-QLQ-C30 has been adapted for patients in palliative care (EORTC-QLQ-C15-PAL). This questionnaire was reconstructed based on interviews with 44 patients and 66 healthcare professionals in palliative care. Item response theory was used to shorten the scale. Most important items in this modified scale were pain, physical function, emotional function, fatigue, global health status, QOL, nausea and vomiting, appetite, dyspnea, constipation and sleep. Four of the original subscales were shortened to reduce the question burden(117). In a more recent study, the measure was validated in 104 patients. The reliability was 0.7 or greater except for fatigue (0.58). It was found to have convergence validity against the original scale, the Brief Pain Inventory and Beck Depression Inventory Like the original scale, it discriminated performance status (118). One of the most important this scale is that minimal important differences in scale scores which has been established in patients with cancer (73). This questionnaire lends itself to mapping to the EQ-5D to gauge the cost-effectiveness of palliative care interventions.

8.6. EQ-5D

The EQ-5D is a non-disease specific measure which describes health states and value of health related QOL which complements rather than replaces QOL measures (119). The EQ-5D consists of general health description which occurs in 5 domains and is divided into 243 health states plus “unconscious” and “dead”. Utility can be assessed by country specific algorithms. Domains include mobility, self-care, usual activities, pain, comfort, anxiety and depression (120, 121). As mentioned, it comes in a 3 and 5 level response per item questionnaire with the 5 level per item questionnaire less subject to a ceiling effect (122). It also has a vertical 20 cm VAS (visual analogue scale) with anchors “best imaginable “and “worst imaginable” health state (scaled 0–100). The questionnaire is relevant to both the healthy and seriously ill. It generates a single index value. The health state can be rated as even “worse than death” or undesirable as negative values. Utility was established through individual values in certain helps states and through “time trade off” methods which led to the negative values. QALYS was generated by using “time trade off” methods and the VAS scale. It discriminates functional classes which correlate with the Health Assessment Question score (122). The purpose of the EQ-5D is to monitor health status of patients over time, assess the seriousness of conditions or diseases at different times, provide evidence for medical effectiveness in improving health states and provide a measure of cost effectiveness per QALYS. The measure has been used to establish local, regional and national health states (119).

9. Expert commentary

Given that one of the key objectives of palliative care is to improve QOL, it should be measured routinely. There are many QOL questionnaires that have been developed to assess QOL in palliative care. Most have some degree of reliability and validity. What appears to be a significant gap in questionnaires particularly to palliative care is sensitivity to change. Almost no measure has established MCIDs which is critical to interventional studies. Very little has been done in utility or cost effectiveness in palliative care using QOL questionnaires and utility tools. QOL questionnaires can be useful in engaging patients in conversations around areas of their life which are deeply affected by serious illness. Measures are used as outcomes and quality audits but policy makers and payers are interested in utility and cost effectiveness. It will be important in the future that palliative care developed utility measures for health outcomes.

10. Five-year view

Currently, most of the QOL questionnaires in palliative care have fixed number of items. Consolidated effort from the research community is needed to further (1) validate existing QOL questionnaires at various stages along the disease trajectory, (2) define their MCIDs to allow proper power calculation for clinical trials and interpretation of findings, and (3) assess their clinical utility to facilitate cost- effectiveness analyses for various palliative care interventions. At the same time, active efforts are underway to develop newer QOL questionnaires that can be more personalized to the individual’s care goals based on computerized adaptive testing. Such approaches may reduce the number of items required and thus question burden, and facilitate immediate recording and reporting in the electronic health record. A recent study demonstrated that routine patient reported outcome assessment not only has an impact on QOL but also survival(123). The benefits associated with such intervention will need to be further examined.

11. Key issues.

  • The World Health Organization defines quality of life as “an individual’s perception of their position in life in the context of culture and value system in which they live and in relation to their goals, expectations, standards and concerns.”

  • QOL often changes as the disease progresses. Furthermore, an individual’s perception of his/her QOL may also evolve overtime (response shift).

  • Palliative care plays an important role in enhancing patient’s quality of life by improving their ability to achieve personalized goals, such as symptom control and social support, while setting realistic expectations through impeccable communication.

  • Multiple systematic reviews and randomized controlled trials have found that palliative care referral and specific palliative care interventions improve quality of life among patients with advanced diseases.

  • QOL questionnaires may be used to assess patient care needs in clinical settings, provide quality monitoring in health systems, measure clinical outcomes in clinical trials, and estimate utility and cost-effectiveness of clinical interventions.

  • Validity and reliability have been assessed for many QOL questionnaires in palliative care. Validity refers to the ability of a questionnaire to accurately assess what is sets out to measure. Reliability refers to the degree to which a questionnaire is reproducible.

  • The responsiveness to change and minimal clinical important difference have not been determined for a majority of QOL questionnaires. Responsiveness to change examines the ability of a QOL questionnaire to reflect any improvement or deterioration over time. The minimal clinical important difference specifies what the magnitude of change is clinically meaningful.

  • QOL questionnaires may be used to facilitate a utility analyses to assess cost-effectiveness of various interventions. To do this QOL questionnaire scores need to be weighed and transformed into health states to facilitate such analyses. More research is needed in the palliative care setting to assess utility and cost-effectiveness of various interventions.

Acknowledgments

Funding

D Hui is supported in part by National Institutes of Health Grants (1R01CA214960–01A1, R21NR016736), an American Cancer Society Mentored Research Scholar Grant in Applied and Clinical Research (MRSG- 14–1418-01-CCE) and the Andrew Sabin Family Fellowship Award.

Footnotes

Declaration of interest

The authors have no other relevant affiliations or financial involvement with any organization or entity with a financial interest in or financial conflict with the subject matter or materials discussed in the manuscript apart from those disclosed.

Contributor Information

Mellar P Davis, Geisinger Medical Center, Danville, PA 17822.

David Hui, Department of Palliative Care, Rehabilitation and Integrative Medicine, MD D Anderson Cancer Center, Houston, TX, USA, 77030.

References

  • 1.Dulaney C, Wallace AS, Everett AS, Dover L, McDonald A, Kropp L.Defining Health Across the Cancer Continuum. Cureus. 2017;9(2):e1029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Ventriglio A, Torales J, Bhugra D. Disease versus illness: What do clinicians need to know? Int J Soc Psychiatry. 2017;63(1):3–4. [DOI] [PubMed] [Google Scholar]
  • 3.Durkin T Disease versus illness: one patient’s definition. J Med Pract Manage. 2011;26(4):233–5. [PubMed] [Google Scholar]
  • 4.Helman CG. Disease versus illness in general practice. J R Coll Gen Pract. 1981;31(230):548–52. [PMC free article] [PubMed] [Google Scholar]
  • 5.Brozek JL, Guyatt GH, Schunemann HJ. How a well-grounded minimal important difference can enhance transparency of labelling claims and improve interpretation of a patient reported outcome measure. Health Qual Life Outcomes. 2006;4:69. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Sloan JA, Cella D, Frost M, Guyatt GH, Sprangers M, Symonds T, et al. Assessing clinical significance in measuring oncology patient quality of life: introduction to the symposium, content overview, and definition of terms. Mayo Clin Proc. 2002;77(4):367–70. [DOI] [PubMed] [Google Scholar]
  • 7.Lydick E, Epstein RS. Interpretation of quality of life changes. Qual Life Res. 1993;2(3):221–6. [DOI] [PubMed] [Google Scholar]
  • 8.Naik H, Howell D, Su S, Qiu X, Brown MC, Vennettilli A, et al. EQ-5D Health Utility Scores: Data from a Comprehensive Canadian Cancer Centre. Patient. 2017;10(1):105–15. [DOI] [PubMed] [Google Scholar]
  • 9.Lara-Munoz MC, Ponce de Leon S, de Ramon la Fuente J [Conceptualization and measurement of the quality of life of cancer patients]. Rev Invest Clin. 1995;47(4):315–27. [PubMed] [Google Scholar]
  • 10.Kassianos AP, Ioannou M, Koutsantoni M, Charalambous H. The impact of specialized palliative care on cancer patients’ health-related quality of life: a systematic review and meta-analysis. Support Care Cancer. 2017. [DOI] [PubMed] [Google Scholar]
  • 11.Conrad R, Mucke M, Marinova M, Burghardt A, Stieber C, Cuhls H, et al. Measurement of Quality of life in Palliative Care: Evidence for Criterion-Oriented Validity of a Single-Item Approach. J Palliat Med. 2017;20(6):604–10. [DOI] [PubMed] [Google Scholar]
  • 12.Song MK, Happ MB. Generating high quality evidence in palliative and end-of-life care. Heart Lung. 2017;46(1):1–2. [DOI] [PubMed] [Google Scholar]
  • 13.Edlund M, Tancredi LR. Quality of life: an ideological critique. Perspect Biol Med. 1985;28(4):591–607. [DOI] [PubMed] [Google Scholar]
  • 14.Skevington SM, O’Connell KA, Group W. Can we identify the poorest quality of life? Assessing the importance of quality of life using the WHOQOL-100. Qual Life Res. 2004;13(1):23–34. [DOI] [PubMed] [Google Scholar]
  • 15.Calman KC. Quality of life in cancer patients--an hypothesis. J Med Ethics. 1984;10(3):124–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Nipp RD, Greer JA, El-Jawahri A, Moran SM, Traeger L, Jacobs JM, et al. Coping and Prognostic Awareness in Patients With Advanced Cancer. J Clin Oncol. 2017;35(22):2551–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Elmqvist MA, Jordhoy MS, Bjordal K, Kaasa S, Jannert M. Health-related quality of life during the last three months of life in patients with advanced cancer. Support Care Cancer. 2009;17(2):191–8. [DOI] [PubMed] [Google Scholar]
  • 18.Miccinesi G, Paci E, Toscani F, Tamburini M, Brunelli C, Costantini M, et al. [Quality of life at the end of life. Analysis of the quality of life of oncologic patients treated with palliative care. Results of a multicenter observational study (staging)]. Epidemiol Prev. 1999;23(4):333–45. [PubMed] [Google Scholar]
  • 19.Lam K, Zeng L, Zhang L, Tseng LM, Hou MF, Fairchild A, et al. Predictive factors of overall well-being using the EORTC QLQ-C15-PAL extracted from the EORTC QLQ-C30. J Palliat Med. 2013;16(4):402–8. [DOI] [PubMed] [Google Scholar]
  • 20.Wettergren L, Kettis-Lindblad A, Sprangers M, Ring L. The use, feasibility and psychometric properties of an individualised quality-of-life instrument: a systematic review of the SEIQoL-DW. Qual Life Res. 2009;18(6):737–46. [DOI] [PubMed] [Google Scholar]
  • 21.Miyashita M, Morita T, Sato K, Hirai K, Shima Y, Uchitomi Y. Good death inventory: a measure for evaluating good death from the bereaved family member’s perspective. J Pain Symptom Manage. 2008;35(5):486–98. [DOI] [PubMed] [Google Scholar]
  • 22.Vartiainen P, Mantyselka P, Heiskanen T, Hagelberg N, Mustola S, Forssell H, et al. Validation of EQ-5D and 15D in the assessment of healthrelated quality of life in chronic pain. Pain. 2017. [DOI] [PubMed] [Google Scholar]
  • 23.Smith AB, Cocks K, Parry D, Taylor M. A Differential Item Functioning Analysis of the EQ-5D in Cancer. Value Health. 2016;19(8):1063–7. [DOI] [PubMed] [Google Scholar]
  • 24.Pickard AS, Ray S, Ganguli A, Cella D. Comparison of FACT- and EQ-5D-based utility scores in cancer. Value Health. 2012;15(2):305–11. [DOI] [PubMed] [Google Scholar]
  • 25.Crott R, Briggs A. Mapping the QLQ-C30 quality of life cancer questionnaire to EQ-5D patient preferences. Eur J Health Econ. 2010;11(4):427–34. [DOI] [PubMed] [Google Scholar]
  • 26.Wu EQ, Mulani P, Farrell MH, Sleep D. Mapping FACT-P and EORTC QLQ-C30 to patient health status measured by EQ-5D in metastatic hormone-refractory prostate cancer patients. Value Health. 2007;10(5):408–14. [DOI] [PubMed] [Google Scholar]
  • 27.Wright AA, Keating NL, Ayanian JZ, Chrischilles EA, Kahn KL, Ritchie CS, et al. Family Perspectives on Aggressive Cancer Care Near the End of Life. JAMA. 2016;315(3):284–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Selman L, Siegert RJ, Higginson IJ, Agupio G, Dinat N, Downing J, et al. The MVQOLI successfully captured quality of life in African palliative care: a factor analysis. J Clin Epidemiol. 2011;64(8):913–24. [DOI] [PubMed] [Google Scholar]
  • 29.Schwartz CE, Merriman MP, Reed G, Byock I. Evaluation of the Missoula-VITAS Quality of Life Index--revised: research tool or clinical tool? J Palliat Med. 2005;8(1):121–35. [DOI] [PubMed] [Google Scholar]
  • 30.Byock IR, Merriman MP. Measuring quality of life for patients with terminal illness: the Missoula-VITAS quality of life index. Palliat Med. 1998;12(4):231–44. [DOI] [PubMed] [Google Scholar]
  • 31.Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR, Clinical Significance Consensus Meeting G. Method to explain the clinical significance of health status measures. Mayo Clin Proc. 2002;77(4):371–83. [DOI] [PubMed] [Google Scholar]
  • 32.Hermann K, Engeser P, Szecsenyi J, Miksch A. Palliative patients cared for at home by PAMINO-trained and other GPs - health-related quality of life as measured by QLQ-C15-PAL and POS. BMC Palliat Care. 2012;11:13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Tsai LY, Li IF, Liu CP, Su WH, Change TY. Application of quality audit tools to evaluate care quality received by terminal cancer patients admitted to a palliative care unit. Support Care Cancer. 2008;16(9):1067–74. [DOI] [PubMed] [Google Scholar]
  • 34.Normand C Measuring outcomes in palliative care: limitations of QALYs and the road to PalYs. J Pain Symptom Manage. 2009;38(1):27–31. [DOI] [PubMed] [Google Scholar]
  • 35.Grieve R, Grishchenko M, Cairns J. SF-6D versus EQ-5D: reasons for differences in utility scores and impact on reported cost-utility. Eur J Health Econ. 2009;10(1):15–23. [DOI] [PubMed] [Google Scholar]
  • 36.Sach TH, Barton GR, Jenkinson C, Doherty M, Avery AJ, Muir KR. Comparing cost-utility estimates: does the choice of EQ-5D or SF-6D matter? Med Care. 2009;47(8):889–94. [DOI] [PubMed] [Google Scholar]
  • 37.Gandhi PK, Ried LD, Bibbey A, Huang IC. SF-6D utility index as measure of minimally important difference in health status change. J Am Pharm Assoc (2003). 2012;52(1):34–42. [DOI] [PubMed] [Google Scholar]
  • 38.Kim SK, Kim SH, Jo MW, Lee SI. Estimation of minimally important differences in the EQ-5D and SF-6D indices and their utility in stroke. Health Qual Life Outcomes. 2015;13:32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Wilkinson A, Slatyer S, McCullough K, Williams A. Exploring the quality of life at the end of life (QUAL-E) instrument with Australian palliative care hospital patients: hurdles and directions. J Palliat Care. 2014;30(1):16–23. [PubMed] [Google Scholar]
  • 40.Albers G, Echteld MA, de Vet HC, Onwuteaka-Philipsen BD, van der Linden MH, Deliens L. Evaluation of quality-of-life measures for use in palliative care: a systematic review. Palliat Med. 2010;24(1):17–37. [DOI] [PubMed] [Google Scholar]
  • 41.Heo M, Kim N, Faith MS. Statistical power as a function of Cronbach alpha of instrument questionnaire items. BMC Med Res Methodol. 2015;15:86. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Harding R, Simon ST, Benalia H, Downing J, Daveson BA, Higginson IJ, et al. The PRISMA Symposium 1: outcome tool use. Disharmony in European outcomes research for palliative and advanced disease care: too many tools in practice. J Pain Symptom Manage. 2011;42(4):493–500. [DOI] [PubMed] [Google Scholar]
  • 43.Bruley DK. Beyond reliability and validity: analysis of selected quality-of-life instruments for use in palliative care. J Palliat Med. 1999;2(3):299–309. [DOI] [PubMed] [Google Scholar]
  • 44.Farnik M, Pierzchala WA. Instrument development and evaluation for patient-related outcomes assessments. Patient Relat Outcome Meas. 2012;3:1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8. [DOI] [PubMed] [Google Scholar]
  • 46.Sloan JA. Quality-of-life meta-analysis: why treat it differently? J Clin Oncol. 2003;21(7):1422. [DOI] [PubMed] [Google Scholar]
  • 47.Jayadevappa R, Cook R, Chhatre S. Minimal important difference to infer changes in health-related quality of life-a systematic review. J Clin Epidemiol. 2017. [DOI] [PubMed] [Google Scholar]
  • 48.Halme AS, Fritel X, Benedetti A, Eng K, Tannenbaum C. Implications of the minimal clinically important difference for health-related quality-of-life outcomes: a comparison of sample size requirements for an incontinence treatment trial. Value Health. 2015;18(2):292–8. [DOI] [PubMed] [Google Scholar]
  • 49.Cuerda C, Virgili N, Irles JA, Cuesta F, Apezetxea A, Casanueva F, et al. Responsiveness and Minimal Clinically Important Difference of A Specific Health Related Quality of Life (Hrqol) Questionnaire for Home Enteral Nutrition (Hen) Patients: Nutriqol(R) Questionnaire. Value Health. 2014;17(7):A575. [DOI] [PubMed] [Google Scholar]
  • 50.Hong F, Bosco JL, Bush N, Berry DL. Patient self-appraisal of change and minimal clinically important difference on the European organization for the research and treatment of cancer quality of life questionnaire core 30 before and during cancer therapy. BMC Cancer. 2013;13:165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Johnston BC, Thorlund K, Schunemann HJ, Xie F, Murad MH, Montori VM, et al. Improving the interpretation of quality of life evidence in meta-analyses: the application of minimal important difference units. Health Qual Life Outcomes. 2010; 8:116. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Cella D, Hahn EA, Dineen K. Meaningful change in cancer-specific quality of life scores: differences between improvement and worsening. Qual Life Res. 2002;11(3):207–21. [DOI] [PubMed] [Google Scholar]
  • 53.Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407–15. [DOI] [PubMed] [Google Scholar]
  • 54.Juniper EF, Guyatt GH, Willan A, Griffith LE. Determining a minimal important change in a disease-specific Quality of Life Questionnaire. J Clin Epidemiol. 1994;47(1):81–7. [DOI] [PubMed] [Google Scholar]
  • 55.Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care. 1989;27(3 Suppl):S178–89. [DOI] [PubMed] [Google Scholar]
  • 56.Samsa G, Edelman D, Rothman ML, Williams GR, Lipscomb J, Matchar D. Determining clinically important differences in health status measures: a general approach with illustration to the Health Utilities Index Mark II. Pharmacoeconomics. 1999;15(2):141–55. [DOI] [PubMed] [Google Scholar]
  • 57.Deyo RA, Patrick DL. The significance of treatment effects: the clinical perspective. Med Care. 1995,33(4 Suppl):AS286–91. [PubMed] [Google Scholar]
  • 58.Norman GR, Sridhar FG, Guyatt GH, Walter SD. Relation of distribution- and anchor-based approaches in interpretation of changes in health-related quality of life. Med Care. 2001;39(10):1039–47. [DOI] [PubMed] [Google Scholar]
  • 59.Donaldson GW, Moinpour CM. Individual differences in quality-of-life treatment response. Med Care. 2002;40(6 Suppl):III39–53. [DOI] [PubMed] [Google Scholar]
  • 60.Wyrwich KW, Bullinger M, Aaronson N, Hays RD, Patrick DL, Symonds T, et al. Estimating clinically significant differences in quality of life outcomes. Qual Life Res. 2005;14(2):285–95. [DOI] [PubMed] [Google Scholar]
  • 61.Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61(2):102–9. [DOI] [PubMed] [Google Scholar]
  • 62.Norquist JM, Fitzpatrick R, Dawson J, Jenkinson C. Comparing alternative Rasch-based methods vs raw scores in measuring change in health. Med Care. 2004; 42(1 Suppl):I25–36. [DOI] [PubMed] [Google Scholar]
  • 63.Crosby RD, Kolotkin RL, Williams GR. An integrated method to determine meaningful changes in health-related quality of life. J Clin Epidemiol. 2004;57(11):1153–60. [DOI] [PubMed] [Google Scholar]
  • 64.Schunemann HJ, Akl EA, Guyatt GH. Interpreting the results of patient reported outcome measures in clinical trials: the clinician’s perspective. Health Qual Life Outcomes. 2006;4:62. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Guyatt G Understanding the fundamentals of quality of life measurement. Evid Based Cardiovasc Med. 1998;2(2):35–6. [DOI] [PubMed] [Google Scholar]
  • 66.Zhang Y, Zhang S, Thabane L, Furukawa TA, Johnston BC, Guyatt GH. Although not consistently superior, the absolute approach to framing the minimally important difference has advantages over the relative approach. J Clin Epidemiol. 2015;68(8):888–94. [DOI] [PubMed] [Google Scholar]
  • 67.Deyo RA, Centor RM. Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance. J Chronic Dis. 1986;39(11):897–906. [DOI] [PubMed] [Google Scholar]
  • 68.Fayers PM, Hand DJ. Factor analysis, causal indicators and quality of life. Qual Life Res. 1997;6(2):139–50. [DOI] [PubMed] [Google Scholar]
  • 69.Hui D, Bruera E. Reply to minimal clinically important difference and Edmonton Symptom Assessment Scale. Cancer. 2016;122(1):159–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Hui D, Shamieh O, Paiva CE, Khamash O, Perez-Cruz PE, Kwon JH, et al. Minimal Clinically Important Difference in the Physical, Emotional, and Total Symptom Distress Scores of the Edmonton Symptom Assessment System. J Pain Symptom Manage. 2016;51(2):262–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Cella D, Bullinger M, Scott C, Barofsky I, Clinical Significance Consensus Meeting G. Group vs individual approaches to understanding the clinical significance of differences or changes in quality of life. Mayo Clin Proc. 2002;77(4):384–92. [DOI] [PubMed] [Google Scholar]
  • 72.Guyatt GH, Jaeschke RJ. Reassessing quality-of-life instruments in the evaluation of new drugs. Pharmacoeconomics. 1997;12(6):621–6. [DOI] [PubMed] [Google Scholar]
  • 73.Bedard G, Zeng L, Zhang L, Lauzon N, Holden L, Tsao M, et al. Minimal important differences in the EORTC QLQ-C15-PAL to determine meaningful change in palliative advanced cancer patients. Asia Pac J Clin Oncol. 2016;12(1):e38–46. [DOI] [PubMed] [Google Scholar]
  • 74.de Vet HC, Beckerman H, Terwee CB, Terluin B, Bouter LM. Definition of clinical differences. J Rheumatol. 2006;33(2):434; author reply 5. [PubMed] [Google Scholar]
  • 75.Yost KJ, Cella D, Chawla A, Holmgren E, Eton DT, Ayanian JZ, et al. Minimally important differences were estimated for the Functional Assessment of Cancer Therapy-Colorectal (FACT-C) instrument using a combination of distribution- and anchor-based approaches. J Clin Epidemiol. 2005;58(12):1241–51. [DOI] [PubMed] [Google Scholar]
  • 76.Yost KJ, Sorensen MV, Hahn EA, Glendenning GA, Gnanasakthy A, Cella D. Using multiple anchor- and distribution-based estimates to evaluate clinically meaningful change on the Functional Assessment of Cancer Therapy-Biologic Response Modifiers (FACT-BRM) instrument. Health. 2005;8(2):117–27. [DOI] [PubMed] [Google Scholar]
  • 77.Crosby RD, Kolotkin RL, Williams GR. Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol. 2003;56(5):395–407. [DOI] [PubMed] [Google Scholar]
  • 78.Kosinski M, Zhao SZ, Dedhiya S, Osterhaus JT, Ware JE, Jr. Determining minimally important changes in generic and disease-specific health-related quality of life questionnaires in clinical trials of rheumatoid arthritis. Arthritis Rheum. 2000;43(7):1478–87. [DOI] [PubMed] [Google Scholar]
  • 79.Lund Rasmussen C, Johnsen AT, Petersen MA, Groenvold M. Change in health-related quality of life over 1 month in cancer patients with high initial levels of symptoms and problems. Qual Life Res. 2016;25(10):2669–74. [DOI] [PubMed] [Google Scholar]
  • 80.Aslakson R, Dy SM, Wilson RF, Waldfogel J, Zhang A, Isenberg SR, et al. Patient and caregiver- reported assessment tools for palliative care: summary of the 2017 AHRQ Technical Brief. J Pain Symptom Manage. 2017. [DOI] [PubMed] [Google Scholar]
  • 81.Gotay CC. Assessing cancer-related quality of life across a spectrum of applications. J Natl Cancer Inst Monogr. 2004(33):126–33. [DOI] [PubMed] [Google Scholar]
  • 82.Gotay CC, Wilson M. Use of quality-of-life outcome assessments in current cancer clinical trials. Eval Health Prof. 1998;21(2):157–78. [DOI] [PubMed] [Google Scholar]
  • 83.Joish VN, Oderda GM. Cost-utility analysis and quality adjusted life years. J Pain Palliat Care Pharmacother. 2005;19(1):57–61. [PubMed] [Google Scholar]
  • 84.Tengs TO. Cost-effectiveness versus cost-utility analysis of interventions for cancer: does adjusting for health-related quality of life really matter? Value Health. 2004;7(1):70–8. [DOI] [PubMed] [Google Scholar]
  • 85.Ferreira LN, Ferreira PL, Pereira LN, Rowen D, Brazier JE. Exploring the consistency of the SF-6D. Value Health. 2013;16(6):1023–31. [DOI] [PubMed] [Google Scholar]
  • 86.O’Brien BJ, Spath M, Blackhouse G, Severens JL, Dorian P, Brazier J. A view from the bridge: agreement between the SF-6D utility algorithm and the Health Utilities Index. Health Econ. 2003;12(11):975–81. [DOI] [PubMed] [Google Scholar]
  • 87.Walters SJ, Brazier JE. What is the relationship between the minimally important difference and health state utility values? The case of the SF-6D. Health Qual Life Outcomes. 2003; 1:4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Hutchinson A, Rasekaba TM, Graco M, Berlowitz DJ, Hawthorne G, Lim WK. Relationship between health-related quality of life, and acute care re-admissions and survival in older adults with chronic illness. Health Qual Life Outcomes. 2013; 11:136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.McClure NS, Sayah FA, Xie F, Luo N, Johnson JA. Instrument-Defined Estimates of the Minimally Important Difference for EQ-5D-5L Index Scores. Value Health. 2017;20(4):644–50. [DOI] [PubMed] [Google Scholar]
  • 90.Walters SJ, Brazier JE. Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D. Qual Life Res. 2005;14(6):1523–32. [DOI] [PubMed] [Google Scholar]
  • 91.Petrou S, Hockley C. An investigation into the empirical validity of the EQ-5D and SF-6D based on hypothetical preferences in a general population. Health Econ. 2005;14(11):1169–89. [DOI] [PubMed] [Google Scholar]
  • 92.Marriott ER, van Hazel G, Gibbs P, Hatswell AJ. Mapping EORTC-QLQ-C30 to EQ-5D-3L in patients with colorectal cancer. J Med Econ. 2017;20(2):193–9. [DOI] [PubMed] [Google Scholar]
  • 93.Proskorovsky I, Lewis P, Williams CD, Jordan K, Kyriakou C, Ishak J, et al. Mapping EORTC QLQ- C30 and QLQ-MY20 to EQ-5D in patients with multiple myeloma. Health Qual Life Outcomes. 2014;12:35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Meregaglia M, Borsoi L, Cairns J, Tarricone R. Mapping health-related quality of life scores from FACT-G, FAACT, and FACIT-F onto preference-based EQ-5D-5L utilities in non-small cell lung cancer cachexia. Eur J Health Econ. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Kontodimopoulos N, Aletras VH, Paliouras D, Niakas D. Mapping the cancer-specific EORTC QLQ-C30 to the preference-based EQ-5D, SF-6D, and 15D instruments. Value Health. 2009;12(8):1151–7. [DOI] [PubMed] [Google Scholar]
  • 96.McKenzie L, van der Pol M. Mapping the EORTC QLQ C-30 onto the EQ-5D instrument: the potential to estimate QALYs without generic preference data. Value Health. 2009;12(1):167–71. [DOI] [PubMed] [Google Scholar]
  • 97.Dzingina MD, McCrone P, Higginson IJ. Does the EQ-5D capture the concerns measured by the Palliative care Outcome Scale? Mapping the Palliative care Outcome Scale onto the EQ-5D using statistical methods. Palliat Med. 2017;31(8):716–25. [DOI] [PubMed] [Google Scholar]
  • 98.Gaertner J, Siemens W, Meerpohl JJ, Antes G, Meffert C, Xander C, et al. Effect of specialist palliative care services on quality of life in adults with advanced incurable illness in hospital, hospice, or community settings: systematic review and meta-analysis. BMJ. 2017;357:j2925. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Catania G, Beccaro M, Costantini M, Ugolini D, De Silvestri A, Bagnasco A, et al. Effectiveness of complex interventions focused on quality-of-life assessment to improve palliative care patients’ outcomes: a systematic review. Palliat Med. 2015;29(1):5–21. [DOI] [PubMed] [Google Scholar]
  • 100.Yamagishi A, Sato K, Miyashita M, Shima Y, Kizawa Y, Umeda M, et al. Changes in quality of care and quality of life of outpatients with advanced cancer after a regional palliative care intervention program. J Pain Symptom Manage. 2014;48(4):602–10. [DOI] [PubMed] [Google Scholar]
  • 101.Hageman WJ, Arrindell WA. Establishing clinically significant change: increment of precision and the distinction between individual and group level of analysis. Behav Res Ther. 1999;37(12):1169–93. [DOI] [PubMed] [Google Scholar]
  • 102.Curtis JR, Patrick DL, Engelberg RA, Norris K, Asp C, Byock I. A measure of the quality of dying and death. Initial validation using after-death interviews with family members. J Pain Symptom Manage. 2002;24(1):17–31. [DOI] [PubMed] [Google Scholar]
  • 103.Steinhauser KE, Clipp EC, Bosworth HB, McNeilly M, Christakis NA, Voils CI, et al. Measuring quality of life at the end of life: validation of the QUAL-E. Palliat Support Care. 2004;2(1):3–14. [DOI] [PubMed] [Google Scholar]
  • 104.Cohen SR, Mount BM, Bruera E, Provost M, Rowe J, Tong K. Validity of the McGill Quality of Life Questionnaire in the palliative care setting: a multi-centre Canadian study demonstrating the importance of the existential domain. Palliat Med. 1997;11(1):3–20. [DOI] [PubMed] [Google Scholar]
  • 105.Cohen SR, Sawatzky R, Russell LB, Shahidi J, Heyland DK, Gadermann AM. Measuring the quality of life of people at the end of life: The McGill Quality of Life Questionnaire-Revised. Palliat Med. [DOI] [PubMed] [Google Scholar]
  • 106.Cohen SR, Mount BM, Tomas JJ, Mount LF. Existential well-being is an important determinant of quality of life. Evidence from the McGill Quality of Life Questionnaire. Cancer. 1996;77(3):576–86 [DOI] [PubMed] [Google Scholar]
  • 107.Cohen SR, Mount BM, Strobel MG, Bui F. The McGill Quality of Life Questionnaire: a measure of quality of life appropriate for people with advanced disease. A preliminary study of validity and acceptability. Palliat Med. 1995;9(3):207–19. [DOI] [PubMed] [Google Scholar]
  • 108.Lua PL, Salek S, Finlay I, Lloyd-Richards C. The feasibility, reliability and validity of the McGill Quality of Life Questionnaire-Cardiff Short Form (MQOL-CSF) in palliative care population. Qual Life Res. 2005;14(7):1669–81. [DOI] [PubMed] [Google Scholar]
  • 109.Hearn J, Higginson IJ. Development and validation of a core outcome measure for palliative care: the palliative care outcome scale. Palliative Care Core Audit Project Advisory Group. Qual Health Care. 1999;8(4):219–27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 110.Lopes Ferreira P, Pinto Barros A. [Measuring quality of life in palliative care]. Acta Med Port. 2008;21(2):111–24. [PubMed] [Google Scholar]
  • 111.Siegert RJ, Gao W, Walkey FH, Higginson IJ. Psychological well-being and quality of care: a factor-analytic examination of the palliative care outcome scale. J Pain Symptom Manage. 2010;40(1):67–74. [DOI] [PubMed] [Google Scholar]
  • 112.Bausewein C, Le Grice C, Simon S, Prisma Higginson I The use of two common palliative outcome measures in clinical care and research: a systematic review of POS and STAS. Palliat Med. 2011;25(4):304–13. [DOI] [PubMed] [Google Scholar]
  • 113.Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76. [DOI] [PubMed] [Google Scholar]
  • 114.Kyriaki M, Eleni T, Efi P, Ourania K, Vassilios S, Lambros V. The EORTC core quality of life questionnaire (QLQ-C30, version 3.0) in terminally ill cancer patients under palliative care: validity and reliability in a Hellenic sample. Int J Cancer. 2001;94(1):135–9. [DOI] [PubMed] [Google Scholar]
  • 115.Paiva CE, Carneseca EC, Barroso EM, de Camargos MG, Alfano AC, Rugno FC, et al. Further evaluation of the EORTC QLQ-C30 psychometric properties in a large Brazilian cancer patient cohort as a function of their educational status. Support Care Cancer. 2014;22(8):2151–60. [DOI] [PubMed] [Google Scholar]
  • 116.Zikos E, Coens C, Quinten C, Ediebah DE, Martinelli F, Ghislain I, et al. The Added Value of Analyzing Pooled Health-Related Quality of Life Data: A Review of the EORTC PROBE Initiative. J Natl Cancer Inst. 2016;108(5). [DOI] [PubMed] [Google Scholar]
  • 117.Groenvold M, Petersen MA, Aaronson NK, Arraras JI, Blazeby JM, Bottomley A, et al. EORTC QLQ-C15-PAL: the new standard in the assessment of health-related quality of life in advanced cancer? Palliat Med. 2006;20(2):59–61. [DOI] [PubMed] [Google Scholar]
  • 118.Nunes NA. The quality of life of Brazilian patients in palliative care: validation of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 15 PAL (EORTC QLQ-C15-PAL). Support Care Cancer. 2014;22(6):1595–600. [DOI] [PubMed] [Google Scholar]
  • 119.Rabin R, de Charro F. EQ-5D: a measure of health status from the EuroQol Group. Ann Med. 2001;33(5):337–43. [DOI] [PubMed] [Google Scholar]
  • 120.Dolan P, Roberts J. Modelling valuations for Eq-5d health states: an alternative model using differences in valuations. Med Care. 2002;40(5):442–6. [DOI] [PubMed] [Google Scholar]
  • 121.Devlin NJ, Brooks R. EQ-5D and the EuroQol Group: Past, Present and Future. Appl Health Econ Health Policy. 2017;15(2):127–37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 122.Hurst NP, Kind P, Ruta D, Hunter M, Stubbings A. Measuring health-related quality of life in rheumatoid arthritis: validity, responsiveness and reliability of EuroQol (EQ-5D). Br J Rheumatol. 1997;36(5):551–9. [DOI] [PubMed] [Google Scholar]
  • 123.Basch E, Deal AM, Dueck AC, Scher HI, Kris MG, Hudis C, et al. Overall Survival Results of a Trial Assessing Patient-Reported Outcomes for Symptom Monitoring During Routine Cancer Treatment. JAMA. 2017;318(2):197–8. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES