Proposing a standardized method for evaluating patient report of the intensity of dyspnea during exercise testing in COPD

Abstract

Background

Measuring dyspnea intensity associated with exercise provides insights into dyspnea-limited exercise capacity, and has been used to evaluate treatment outcomes for chronic obstructive pulmonary disease (COPD). Three patient-reported outcome scales commonly cited for rating dyspnea during exercise are the modified Borg scale (MBS), numerical rating scale for dyspnea (NRS-D), and visual analogue scale for dyspnea (VAS-D). Various versions of each scale were found. Our objective was to evaluate the content validity of scales commonly used in COPD studies, to explore their ability to capture patients’ experiences of dyspnea during exercise, and to evaluate a standardized version of the MBS.

Methods

A two-stage procedure was used, with each stage involving one-on-one interviews with COPD patients who had recently completed a clinic-based exercise event on a treadmill or cycle ergometer. An open-ended elicitation interview technique was used to understand patients’ experiences of exercise-induced dyspnea, followed by patients completing the three scales. The cognitive interviewing component of the study involved specific questions to evaluate the patients’ perspectives of the content and format of the scales. Results from Stage 1 were used to develop a standardized version of the MBS, which was then subjected to further content validity assessment during Stage 2.

Results

Thirteen patients participated in the two-stage process (n = 6; n = 7). Mean forced expiratory volume in 1 second (FEV₁) percent predicted was 40%, mean age 57 years, and 54% were male. Participants used a variety of terms to describe the intensity and variability of exercise-induced dyspnea. Subjects understood the instructions and format of the standardized MBS, and were able to easily select a response to report the level of dyspnea associated with their recent standardized exercise.

Conclusion

This study provides initial evidence in support of using a standardized version of the MBS version for quantifying dyspnea intensity associated with exercise in patients with COPD.

Introduction

Dyspnea is clinically the most relevant symptom of chronic obstructive pulmonary disease (COPD) that limits physical activity¹ and leads patients to seek medical intervention. Reduced capacity for physical activity is a typical consequence of airflow obstruction in COPD patients, and can be measured by testing the patient’s exercise capacity in the clinic. The evaluation of dyspnea during exercise has been recommended and is used for the assessment of disease severity and progression, to set targets for treatment, and to evaluate the efficacy of interventions for the management of COPD.^2,3 Although patients’ reports of dyspnea during activity around the home can offer insight into the impact of disease and treatment on patients’ daily lives, the variation in these assessments can create measurement challenges.^4,5

The assessment of improvement in exercise capacity using cardiopulmonary exercise testing (CPET), where the physical stimulus is standardized, has been suggested as an efficacy endpoint for clinical trials, to evaluate response to treatments for COPD.⁶ This approach provides the most comprehensive physiological evaluation of exercise- related symptoms in cardiovascular and respiratory diseases, and a formal measurement of dyspnea during CPET is increasingly used as an outcome for evaluating COPD treatment.^2,7,8 However, inconsistent results have been observed in clinical trials evaluating the effect of bronchodilators on exercise capacity, and variations in the design of such studies have been identified as a potential factor driving these inconsistencies.⁸ One of the variations noted in study designs is the tools used to evaluate dyspnea during CPET in these studies.

Various factors must be considered in selecting tools to collect data in CPET studies used to evaluate treatment benefits. Guidelines from regulatory agencies⁹ have emphasized the need for demonstrable content validity of outcome measures which are intended to provide data in support of treatment benefit claims.^10,11 The guidelines suggest that, to confirm content validity, there should be “evidence that the instrument measures the concept of interest, including evidence from qualitative studies that the items and domains of an instrument are appropriate and comprehensive relative to its intended measurement concept, population and use.”⁹ This evidence is collected using qualitative methods; specifically, focus groups or individual interviews with patients.^10,11 Patients’ preferences and cognitive assessments of existing tools are also important for their acceptance in routine clinical and trial settings. While the optimal time to collect this data would be during the development of a new tool, it is also possible to collect data to retrospectively understand and document content validity of an existing tool using these methods.¹¹

The objective of the current study was to assess the content validity of the scales commonly used in COPD studies, to explore their ability to capture patients’ experiences of dyspnea associated with exercise, and to evaluate a standardized version of the modified Borg Scale (MBS) for collecting data about dyspnea (breathlessness) intensity associated with exercise in patients with COPD.

An overview of patient-reported outcome scales used for evaluating dyspnea during an exercise test

The American Thoracic Society (ATS)/American College of Chest Physicians (ACCP) statement on CPET recommends two single-item scales – the modified Borg Scale (MBS) and the visual analogue scale for dyspnea (VAS-D) – for quantifying dyspnea during an exercise test.² Simple numerical rating scales (NRS-D) have also been used in COPD studies.

MBS for rating dyspnea

Various adaptations have been made to the Borg CR10 Scale^{® 12} to measure the intensity of dyspnea in asthma and COPD trials. The versions of the scales that have been adapted to evaluate dyspnea have been referred to as the modifications of the Borg scale/category ratio scales,^13–17 and cite the 1982 paper “Psychophysical bases of perceived exertion” by Borg¹⁸ as the source of the scale. Although this suggests that the same instrument has been used across studies, a closer examination of these studies indicates that the content (instructions, scale range, and labels) and format (eg, verbal, computer screen) of the MBS varies considerably.

Borg¹⁸ describes a 15-grade categorical rating scale, called the rate of perceived exertion (RPE) scale, that had scores ranging from 6 to 20.¹⁹ However, the original category ratio scale, now called the Borg CR10 Scale^®, was presented at a symposium in 1980.¹² The original scale was referred to as a numerical category scale for use in various situations where estimates of subjects’ perception of intensity of any experience are required. The scale was constructed as a 0–10 categorical scale with ratio-level properties, incorporating nonlinear spacing of verbal descriptors of the level of intensity (see Figure 1). The authors noted that the maximal intensity level was placed outside of a 0–10 scale, to diminish a ceiling effect. The more recent Borg CR Scales^® folder²⁰ describes the Borg CR10 Scale^® with the categories similar to the 1982 scale, but has 19 points that can be selected (see Figure 1). This document also describes another “fine- graded” version of the scale: the Borg CR100 Scale, with a 0–100 scaling.

Figure 1.

The original Borg CR10 Scale^® used to measure the perception of intensity of any experience compared to the Borg CR10^® Scale in the recent Borg CR Scales folder. The Borg CR10 Scale^® with instructions can be obtained for a minor fee from Borg Perception, Rädisvägen 124, S-16573, Hässelby, Sweden.

In this paper, we refer to the modifications of the Borg CR10 Scale^® for evaluating dyspnea as the Modified Borg Scale (MBS). The MBS scaling most often used to measure dyspnea in COPD literature is the 0–10 scale.^2,21 Two methods of scaling are described below.

Modifications of the Borg scale to measure dyspnea – maximal intensity at 10

In a publication in 1982, Burdon and colleagues²² described an MBS to study breathlessness as a function of airflow obstruction in patients with asthma (Figure 2). Subjects were asked to score breathlessness by selecting a number or words that most appropriately described their sensation of breathlessness. Subjects were free to select either whole numbers or fractions, and were instructed to score only their sensation of breathlessness and ignore other sensory stimuli, such as nasal or throat irritation. In a later study evaluating the usefulness of the scale in assessing the degree of dyspnea in patients with COPD and asthma,²³ Kendrick et al used a version that included the term “breathlessness” in some of the response options to provide clarity, and reported a tabular format for the scale (Figure 2). The ATS Statement: Guidelines for the Six-minute Walk Test, published in 2002²¹ and suggesting the use of the “Borg scale” to evaluate both dyspnea and fatigue during the walk test, described the scale with the maximal of the scale at 10, “very, very severe (maximal).” This statement cites the paper describing the RPE scale as the source of the scale. The validity and reliability of the MBS (with a maximal rating of 10) have been examined for use as an evaluative instrument for studying dyspnea over a period of time.^24–26

Figure 2.

Versions of the modified Borg scale used to evaluate dyspnea.

(A) Reprinted from: Am Rev Respir Dis. 126(5), Burdon, et al. The perception of breathlessness in asthma, 825–828; Copyright (1982); With permission from American Thoracic Society.

(B) Reprinted from: Journal of Emergency Nursing, 26(3), Kendrick et al, Usefulness of the modified 0–10 Borg scale in assessing the degree of dyspnea in patients with COPD and asthma, 216–222, Copyright (2000); With permission from Elsevier.

Modifications of the Borg scale to measure dyspnea – maximal intensity beyond 10

In 2001, Mahler et al²⁷ used a computerized version of the scale, whereby the person can report ratings of breathlessness spontaneously and continuously during an exercise by moving a computer mouse that adjusts a vertical bar adjacent to a 0–10 scale positioned on a monitor. The scale descriptions are similar to those described in the Burdon article, but include 13 points – thus permitting selection of a point beyond a maximal rating of 10 to indicate maximal intensity, as in the original CR10 Scale^®.

In 2003, the ATS/ACCP statement on CPET² recommended the use of the CR10 Scale^® to evaluate dyspnea during CPET. The statement also describes the format, allowing subjects to select a number greater than 10 as maximal, as in the original CR10^® Scale. The validity and reliability of the MBS that allows for the maximal rating beyond 10 has also been examined for use in the continuous measurement of dyspnea during exercise.²⁷

Visual analogue scale (VAS)

While use of VAS to evaluate dyspnea in exercise testing is mentioned in several articles,^28,29 the content and format of the tools themselves were not described. When discussing outcome measures for COPD, Cazzolo and colleagues described the VAS-D as a vertical or horizontal line, usually 100 millimeters (mm) in length, with descriptors positioned at the extremes of the scale as anchors.³⁰ Anchors for the VAS-D have not been standardized.³¹ Two frequently-used anchor sets are “not breathless at all”/“extremely breathless” and “no shortness of breath”/“shortness of breath as bad as can be.”³² A VAS is typically scored by measuring the distance from the bottom of the scale (or left side if oriented horizontally) to the level indicated by the subject.

Numerical rating scale (NRS)

The NRS is an instrument that is commonly used to assess patients’ experiences with symptoms (eg, pain). Gift and Narsavage³³ found that the NRS for dyspnea (NRS-D) highly correlated with a 0–100 mm VAS-D, and suggested that the NRS may be an easier scale to use to assess shortness of breath in general assessment settings.

Methods

Study design

This was a qualitative, content validity study involving interviews with men and women who had a medical diagnosis of COPD and had recently (ie, within <24 hours) completed a supervised, standardized exercise on a cycle ergometer or treadmill. The interviews were conducted in two stages, with six patients included in Stage 1, and seven patients included in Stage 2.

During the Stage 1 interviews, following open-ended discussion for concept elicitation, participants were asked to complete the scales by marking two responses for dyspnea on a paper version of the scale: one to indicate the level of dyspnea experienced before exercise, and the second to indicate the most severe dyspnea experienced during exercise. Results from Stage 1 were used to develop a standardized version of the modified Borg scale (MBS(S)), which was subjected to further content validity assessment during Stage 2.

For Stage 2, to mirror the potential methods of use of the scales in clinical trials, participants were asked to select three responses from their recollections of their experiences with breathlessness during their most recent exercise: before the exercise, at the most severe level of breathlessness during exercise, and at about one minute following the end of the exercise. The administration of the scales and instructions simulated the experience of responding during exercise (the method that would be used in clinical trials), with the interviewer holding the scale and instructing the participants to point to responses for each scale, rather than writing the response on paper. Interviewers administered the measures in random order to the participants.

Three measures were tested in this study: the VAS-D, the NRS-D, and the MBS. The VAS-D tested in this study was a vertical 100-mm scale, with 0 (“no breathlessness”) at the bottom, and 100 (representing “extremely severe breathlessness”) at the top. As the VAS-D is not commonly used in clinical practice or studies, and considering the results of the patient interviews in Stage 1 (see below), the VAS-D was not tested further in Stage 2.

The second measure tested in this study was the NRS-D. NRS-D instructions ask subjects to indicate how much shortness of breath they are having right now, and the 11-point horizontal response scale ranges from 0 (“no shortness of breath”) to 10 (“shortness of breath as bad as can be”). Subjects were asked to select the number that they believed represented their current level of breathlessness.

The third measure tested in this study was the MBS. For Stage 1, the version of the MBS used by Kendrick and colleagues²³ was tested. Based on the results of the patient interviews from Stage 1, as well as team discussions about versions used more often in clinical trials and rehabilitation settings, a decision was made to use a version of the scale, and develop standardized instructions to provide additional clarity to participants.

The standardized version, MBS(S), was based on the version used by Burdon and colleagues,²² which was the version used most often in the clinical and trial settings. The instructions were adapted based on the wording used in previous clinical trials;³⁴ borders were added to the scale’s layout to frame the response options. Figure 3 shows the version of the tool with patient instructions tested in Stage 2.

Figure 3.

The standardized version of the modified Borg scale (MBS(S)) tested in Stage 2.

Participant recruitment

Participants were recruited from three pulmonology offices associated with one pulmonary rehabilitation clinic near Pittsburgh, PA (in the US). After obtaining Institutional Review Board (IRB) approval, potential participants were screened for study eligibility by site staff using a screening script to ensure that participants met all prespecified inclusion/exclusion criteria.

The sample included patients with a current medical diagnosis of moderate (Global Initiative for COPD [GOLD] Stage II), severe (GOLD Stage III), or very severe (GOLD Stage IV) COPD (including chronic bronchitis and/or emphysema), documented via lung function testing within the previous year. Participants had to be aged 40 years or older, with a smoking history of at least 10 pack/years. Additionally, participants were required to be currently enrolled in a pulmonary rehabilitation program with lower-limb exercise; motivated to exercise to a point of breathlessness, as required during the most recent experience; able to participate in a one-on-one interview; able to read, speak, and understand English; and able to provide written informed consent. To ensure that participants were able to accurately recall the experience of exercise testing, all participants were to have completed a standardized – incremental or constant workload – exercise program in the form of treadmill or cycle ergometry activities within 24 hours of the interview.

Exclusion criteria were as follows: clinically relevant medical or psychiatric condition(s) that would interfere with completing the study, including but not limited to sensory problems, cognitive impairment, acute mental illness, or inadequately-treated depression or anxiety; COPD exacerbation or unexpected visit to the clinic, emergency room (ER), or hospital, and/or prescription medication to treat an exacerbation within the past four weeks; exercise capacity that is unduly limited by comorbid conditions other than COPD, including but not limited to cardiovascular diseases, neurologic diseases, musculoskeletal diseases, and chronic leg pain/discomfort; diagnosis of asthma; body mass index (BMI) of 35 or above; and respiratory disease other than COPD that contributes to ventilatory limitation during the performance of exercise (ie, pulmonary resection, bronchiectasis, pulmonary hypertension, or interstitial lung disease).

Procedures

All interviews lasted approximately 60 minutes, and were conducted by trained, experienced interviewers using a semi-structured interview guide. All participants were interviewed within 24 hours of a recent exercise in the clinic. After obtaining informed consent, the interview began with concept elicitation methods.^10,11 Open-ended questions were used to elicit information from the participants regarding their experience with (and descriptions of) breathlessness during their recent standardized physical exercise. To help anchor patients’ experiences of breathlessness, they were initially asked to describe their experience of breathlessness in daily life, followed by their experience of breathlessness during exercise events in the clinic.

The second half of the interview was designed to evaluate the clarity, comprehensiveness, and relevance of the single-item, patient-reported measures of breathlessness using a cognitive interviewing methodology. To collect data to characterize the sample, participants completed a short questionnaire providing basic sociodemographic information and their COPD-related health status on the Saint George’s Respiratory Questionnaire for COPD (SGRQ-C) at the end of the interview.^35,36 Clinical site personnel completed forms documenting the eligibility of participants for the study, along with basic clinical information about the participants. They also completed the modified Medical Research Council (mMRC) Grading System with their rating of the degree of the participants’ dyspnea to different levels of activity on the five-point mMRC scale.

Data analysis

To explore content validity, transcripts were cleaned and entered into a database for analyses, which were conducted using the ATLAS.ti (version 5.0; Atlas.ti GmbH, Berlin, Germany) qualitative analysis software program. A coding dictionary was developed based on the interview guide and review of the transcripts. This dictionary was used to guide the transcript coding process. The list of codes included a section for the concept elicitation portion of the interview, to capture the terms and phrases that the participants used to describe their breathing, as well as codes for the cognitive interviewing portion of the interview, which captured comments regarding each of the scales. Descriptive statistics to characterize the participant sample were computed using SAS software (version 9.1; SAS Institute, Cary, NC).

Results

Description of sample

Demographic and clinical characteristics of the study sample are shown in Table 1. Participants reported comorbid conditions, and 30% (n = 4) of participants had comorbid cardiovascular disease. In terms of the recently completed exercise, five patients had completed a treadmill exercise, and eight had completed an exercise on the cycle ergometer.

Table 1.

Sociodemographic and clinical characteristics^a

Characteristics	Total sample (N = 13)
Age mean (SD)	56.7 (6.0)
Male (%)	7 (53.8%)
Racial background – n (%)
American Indian or Alaska native	1 (7.7%)
White	12 (92.3%)
Employment status – n (%)
Employed, part-time	2 (15.4%)
Homemaker	1 (7.7%)
Retired	6 (46.2%)
Disabled	4 (30.8%)
Education – n (%)
<High school or below	6 (46.2%)
Associate degree, technical, or trade school	3 (23.1%)
College or above	4 (30.7%)
BMI – mean (SD)	26.2 (4.2)
GOLD STATUS, n (%)
GOLD II	4 (30.8%)
GOLD III	6 (46.2%)
GOLD IV	3 (23.1%)
mMRC, n (%)
1	3 (23.1%)
2	7 (53.8%)
3	2 (15.4%)
4	1 (7.7%)
Smoking history, n (%)
Exsmoker	13 (100.0%)
Total pack-years smoked – mean (SD)	46.5 (25.7)
Years since diagnosis – mean (SD)	5.4 (3.0)
Spirometryb
FEV1 (L) – mean (SD)	1.3 (0.7)
FEV1 (% predicted) – mean (SD)	38.8 (15.1)
FEV1/FVC (%) – mean (SD)c	38.2 (13.1)
Number of COPD exacerbations in past 12 months – mean (SD)	1.1 (1.8)

Notes:

^aAs assessed by clinic site personnel;

^bvalues within 12 months of interview;

^cdata from one participant was missing.

Concept elicitation: participants descriptors of their experience of dyspnea

Participants described their experience of dyspnea in their daily life using such terms as “shortness of breath”, “can’t get my breath”, “out of breath”, and “hard to breathe.” “Shortness of breath” was the term most consistently used by participants (n = 5) to describe situations in which they had difficulty breathing. When probed about the terms used in the single-item patient-reported outcome scales that evaluate dyspnea intensity (eg, breathlessness, shortness of breath, and discomfort with breathing), most responded that they used the term “shortness of breath” to describe their difficulty breathing day to day, or during normal daily activities. Shortness of breath was described as a feeling of not getting enough air or being unable to get their breath; breathlessness was most commonly defined as being unable to catch their breath. When probed, most participants agreed that shortness of breath and breathlessness were similar; three of the 12 participants who discussed this indicated that being breathless was more severe than being short of breath. A few examples of participants’ descriptions of these terms are provided in Table 3.

Table 3.

Examples of participants’ descriptions when probed about terms used for dyspnea in the single-item patient-reported outcome tools: “shortness of breath”, “breathlessness”, and “discomfort with breathing”

Participant ID (GOLD stage)	Shortness of breath (SOB)	Breathlessness	Discomfort with breathing
111 – (GOLD II)	I just can’t catch my breath. I can’t get a, a full lung of air – lungs of air		Only to the extent of not being able to – you know, there is no pain, okay? I mean, there’s certainly no pain. But, it, uh – if, if my – if I’m, you know, so short of breath, and I’m kind of gasping, or something, I mean, that’s – to me, is – it’s a discomfort, I guess
112 – (GOLD II)	Just out of breath	I guess being out of breath	Well, to me, it would be if it hurt. If it hurt, okay, and where would it hurt? I don’t know. I’ve never had – I guess in your lungs, I mean
108 – (GOLD III)	Uh, shortness of breath – well, just going slower and, and knowing that you’re near the verge of breathlessness and whatever you’re doing you stop with breathlessness	Breathlessness, to me, means unable to do anything	It means, uh, not having my use, uh, the total breathing that I would normally have
110 – (GOLD III)	Can’t move enough air in and out	Uh, it would be-to me it means the same thing as short of breath, um, like I say, uh, can’t move enough air in and out	Uh, just like a heavy – my chest feels like it’s real heavy, like somebody’s sitting on me
113 – (GOLD-IV)	Shortness of breath just means – it’s I have to breathe a little faster	Breathlessness means that it feels like I’m not getting any air	Where I have a lot of pain when I take a deep breath

Participants were then asked to describe their breathing during exercise in the clinic/rehab setting. Participants used a variety of descriptors to describe the intensity of dyspnea experienced during their recently-completed clinic-based exercise. Table 4 shows the terms used by the participants to describe the severe end of the dyspnea that they experienced.

Table 4.

Terms used to describe severe breathlessness during exercise

Symptom	Participant ID
	GOLD stage 2				GOLD stage 3						GOLD stage 4
	102	103	111	112	101	106	107	108	109	110	104	105	113
Heavy		X			X	X
Fast				X	X					X
Exerting	X	X
Straining	X
Gasping	X						X	X
Heaving	X
Hard		X		X			X	X		X
Difficult			X			X	X		X		X		X
Laboured										X	X
Passed out											X
Draining												X
Terrible							X					X
Rough												X
Uncomfortable									X

A majority of participants (n = 11) responded that the magnitude of breathlessness they experienced in daily life was different from that experienced during exercise in the clinic. While two participants felt their experience of breathlessness was the same, two participants responded they experienced a greater degree of breathlessness during exercise in the clinic than they experienced at home. This was attributed to the fact that, while in daily life, they could modify the speed of their activity; during the exercise in the clinic, they were unable to control the speed or incline. Nine participants felt they experienced less breathlessness during exercise in the clinic than they did performing daily activities or exercising at home. It must be noted that participants were allowed supplemental oxygen during their exercise.

Cognitive interviewing following administration of the three scales

The VAS-D was only included in the first phase of the debriefing interviews. None of the participants preferred this scale to the NRS-D and MBS. Participants were able to respond to the NRS-D without difficulty. The participants clearly understood the anchor descriptions of “no breathlessness at all” and “breathlessness as bad as it can be,” and were able to select a response that corresponded to their level of breathlessness using the response options.

Participants were able to follow instructions and respond to the MBS (Kendrick²³ version) in Stage 1 and the MBS(S) in Stage 2 without difficulty. They were able to understand what they were supposed to rate; they interpreted it as rating their breathing, and how hard/difficult their breathing was. Participants in the study were familiar with the scale due to its use in their rehab setting, and found it easy to select a response option. Most participants reported using both the numbers and the descriptions to help them select their answer. Participants were able to distinguish between the descriptors to decide which response option to endorse; evidence of participant understanding of the minimum, mid-level, and maximal response options was seen on cognitive interviewing of both versions of the MBS tested in this study. During cognitive interviews, the descriptors used by the participants to describe their interpretation of the lower (0 and 0.5), mid-level (3–5), and upper (6–8) ends of the scale matched the descriptions used by the participants in the open-ended concept elicitation stage. Participants did not have a problem with 6 and 8 not having descriptors; moreover, no participant could easily define or provide descriptions for these options.

All participants understood the term “maximal.” Ten participants linked it to a state of emergency, which would require medical intervention. None of the participants mentioned experiencing maximal breathlessness during a standardized exercise in the clinic, with the reported maximum ranging between 4 and 6.

Participant preference

While participants understood all three scales, the VAS-D was not preferred by participants (and was therefore not tested further in Stage 2); participants felt it was more confusing and subjective than the NRS-D. When discussing their preferences, six of the 11 participants spontaneously mentioned that the inclusion of descriptions next to the number in the MBS and MBS(S) was helpful to them. However, three participants cited the lack of descriptors on the NRS-D as the driving factor behind their preference for that scale.

Discussion and conclusion

Understanding patients’ experiences of dyspnea during a standardized physical exercise is an important consideration for the management of the COPD patient in both the clinical and rehabilitation settings. It is also an endpoint that has been included in clinical trials evaluating the benefits of treatments for COPD. While there have been efforts to standardize the method for evaluative tools for collecting data about this concept using the MBS or the VAS-D, there is a wide variation in the formats, response options, and content; there is also limited evidence about the performance characteristics of these tools. The MBS has been used to evaluate patients’ experiences of dyspnea: “effort to breathe” and “degree of respiratory discomfort”.²⁵ Investigators have asked subjects to rate “severity of breathlessness”, “need to breathe”, and “effort of breathing.” In a recent review of outcome measures in COPD, Glaab and colleagues³⁷ suggested the need for more research to optimize and validate the items on the MBS, including direct patient involvement in instrument generation, to enhance their content validity for use in clinical trials. Our study was conducted to obtain information about patients’ experiences of dyspnea, and to further standardize these assessments. This will help to ensure that the collection of data accurately reflects patients’ experiences, and can be compared across various studies.

The study sample was recruited to reflect the sociodemographic and clinical characteristics of patients usually included in clinical trials. Most (69%) of these patients were classified as GOLD Stage III or above by the clinician, and three (23%) were assigned a grade of 3 (“stops for breath after walking about 100 yards or a few minutes on the level”) or more on the mMRC scale. While all participants self-reported some limitations in their daily activities because of breathlessness, only two of the participants rated their overall health status as “poor.” Mean scores on the activity domain of the SGRQ-C also suggested impairment in that domain. While we were not able to collect data during the standardized exercise, and recognizing the challenges of conducting interviews immediately following an exercise event, all participants were interviewed within 24 hours of a recent standardized exercise in the clinic.

The following limitations must be mentioned. The sample size was relatively small, and therefore, diversity in the sample was limited. Also, all participants were recruited from a single site in the US where they had been previously evaluated using a version of the MBS. However, the MBS is mentioned as a tool to evaluate dyspnea during exercise in documents by the American Thoracic Society^2,21 which provide guidance on the conduct of exercise testing; therefore, it is widely used in clinics across the country. Hence, it would be difficult to enroll patients from such programs who had not been exposed to the scale before. It must also be noted that participants did not actually respond to the three scales during their exercise test, but were interviewed within 24 hours of a recent exercise event in the clinic. As suggested by Laveneziana and colleagues,³⁸ the level of dyspnea does vary during exercise. The concept elicitation interviews revealed that COPD patients used various terms to describe their experiences of dyspnea associated with exercise. Participants’ descriptions of the intensity of severe dyspnea experienced during exercise were similar to those cited by von Leupoldt and colleagues,³⁹ who also found that the COPD patients selected descriptors linked with heavy/fast breathing, including “gasping”, to describe the intensity of their experience at the severe end of dyspnea following an exercise event. In this study, the terms “heavy”, “hard”, “fast”, and “gasping” were used by those in GOLD Stages II and III. Though participants did not spontaneously mention the word “breathless”, they were able to respond to the instructions that required them to indicate the level of breathlessness. They were also able to discriminate among the various levels/descriptions of intensity as marked on the respective scales. While patient perception of dyspnea may be affected by several factors, it was beyond the scope of this study to examine those in detail.

Participants understood the instructions and format of the three scales – the NRS-D, VAS-D, and MBS (both the Kendrick²³ version and the MBS[S]) – interpreting the task correctly within the context of exercise. Participants also were able to respond appropriately to all three scales. However, none of the participants preferred the VAS-D. It was recognized that participants would not be able to mark the VAS while performing the standardized exercise, unless a method such as a computerized version⁴⁰ could be used to allow participants to mark their response without having to move their hand away from the exercise equipment. Gift and Narsavage³³ suggested that the NRS-D may be an easier scale to use to assess dyspnea; six participants in this study even preferred the scale over the MBS/MBS(S).

The results from testing the MBS (Kendrick²³ version) in Stage 1 were used to develop a standardized version of the scale. The MBS(S) was tested with seven patients, and the results of this study support the content validity of the MBS(S). Participants were able to understand the standardized instructions developed for this study. The scale required participants to select a response to describe the intensity of “breathlessness” experienced before, during, and after the exercise.

We examined a version of the MBS with responses on the 0–10 scale, which is used more often in COPD studies. We used the version where the maximal intensity would be scored as 10, rather than beyond 10 as in the original CR10 Scale^®. The finding that the participants in this study did not select a score above 8 on the MBS and MBS(S), together with the participants’ descriptions of “maximal”, suggests that there is no requirement for the scale to have a response option beyond 10. The ATS/CCP statement on CPET had also suggested that patients stopped exercising at ratings of 5 to 8, further supporting the rationale for not requiring an option to score the intensity of dyspnea beyond 10 for a scale to evaluate dyspnea in relation to exercise testing. However, it must be noted that we did not test a version where subjects could select a score above 10, as in the CR10 Scale.

In conclusion, this study provides initial evidence to support the content validity of the MBS(S) for use to collect data about dyspnea (breathlessness) associated with exercise in patients with COPD. We recommend using the instructions that were developed for this study and which were well understood by patients. The replication of the process in a more diverse group could further affirm content validity of the MBS(S) across a wider variety of patients.

Table 2.

Patient report of health status

Health status, n (%)
Excellent	1 (7.7%)
Very good	1 (7.7%)
Good	6 (46.2%)
Fair	3 (23.1%)
Poor	2 (15.4%)
Physical exercise outside of the rehab clinic, n (%)
No	6 (46.2%)
Yes	7 (53.8%)
Degree of daily activity limitation because of breathlessness, n (%)
Slightly limited	5 (38.5%)
Moderately limited	7 (53.8%)
Very limited	1 (7.7%)
Scores on the SGRQ-Ca – Mean (SD)
Total	52.7 (17.2)
Symptom	56.2 (20.1)
Activity	69.8 (16.8)
Impact	41.2 (19.6)

Note:

^aScores range from 0 to 100 with lower scores indicating less impairment.