Abstract
BACKGROUND
Although oxaliplatin is widely established as a standard treatment in colorectal cancer (CRC), oxaliplatin-induced neuropathy has emerged as a prominent dose-limiting side effect associated with quality of life decrements. Ongoing monitoring and management of neuropathy is important for CRC patient quality of life and adherence to treatment. Therefore, a validated self-reported measure of neuropathy would aid in the management and assessment of oxaliplatin-induced neuropathy in clinical practice and research. We sought to evaluate the content validity of the 13-item Functional Assessment of Cancer Therapy/Gynecologic Oncology Group- Neurotoxicity subscale (FACT/GOG-Ntx) for CRC patients receiving oxaliplatin.
AIM
To understand the neuropathy experiences of CRC patients and assess content validity of the FACT/GOG-Ntx.
METHODS
Semi-structured concept elicitation and cognitive debriefing interviews were conducted with 31 CRC patients experiencing peripheral neuropathy from current or previous oxaliplatin treatment. Interview data were analyzed using a constant comparative approach, and data were mapped to the FACT/GOG-Ntx to assess content validity.
RESULTS
Mean age of the sample was 54 (range 34-82). The sample was primarily Caucasian (84%) and consisted of nearly equal numbers of men and women. Participants described 28 unique neuropathy symptoms; hand tingling (experienced by 87% of respondents); feet tingling (81%); hand numbness (68%); and feet numbness (84%) were most frequently mentioned. Neuropathy symptoms occurring on the feet were most often identified as most bothersome by participants. Eleven of the 13 FACT/GOG-Ntx items exhibited moderate to strong evidence of content validity. Two items related to trouble hearing and ringing in the ears had weak support; however, these items represent severe neuropathy and could be useful for a patient reported outcome measure.
CONCLUSION
The FACT/GOG-Ntx represents the key neuropathy experiences of CRC patients treated with oxaliplatin.
Keywords: Neuropathy, Colorectal cancer, Patient reported outcomes, Quality of life
Core tip: Colorectal cancer patients report significant impairment in dexterity, mobility, and balance due to neuropathy. Because prevention and treatment options for oxaliplatin-induced neuropathy are limited ongoing monitoring and management of neuropathy is important for patient quality of life and treatment adherence. A validated self-reported measure of neuropathy would aid in the management and assessment of neuropathy. This study examined the content validity of the Functional Assessment of Cancer Therapy/Gynecologic Oncology Group-Neurotoxicity scale for colorectal patients with oxaliplatin-induced neuropathy; the measure was found to have content validity for this population.
INTRODUCTION
Although oxaliplatin is widely established as a standard treatment in colorectal cancer (CRC), oxaliplatin-induced neuropathy has emerged as a prominent dose-limiting side effect associated with quality of life decrements[1,2]. CRC patients report significant impairment in their activities of daily living because of their neuropathy, including difficulty with tasks requiring fine motor skills and dexterity, mobility, and balance[3]. Oxaliplatin induced neuropathy may be acute or chronic[1-7]. Acute neuropathy typically occurs within 1-2 d of the first oxaliplatin infusion[1]. Acute symptoms tend to resolve spontaneously within one week and typically do not necessitate dose reductions; however, symptoms may return with subsequent administration of oxaliplatin[1,8,9]. Chronic neuropathy develops gradually over time and is related to the cumulative oxaliplatin dose[2,5,8,10-12]. Although symptoms can resolve within six months of treatment[13], there are several reports of chronic neuropathy lasting two years or more[8,10,14,15]. Prevention and treatment options for oxaliplatin-induced neuropathy are limited; approaches include scheduled drug holidays, magnesium and calcium infusions, and pharmacologic interventions including anti-depressant and anti-epileptic agents[1].
Ongoing monitoring and management of neuropathy is important for patient quality of life and adherence to treatment. A validated self-reported measure of neuropathy would aid in the management and assessment of oxaliplatin-induced neuropathy in clinical practice and research. The Functional Assessment of Cancer Therapy/Gynecologic Oncology Group- Neurotoxicity subscale (FACT/GOG-Ntx) is a 13-item subscale of the FACT-G that was developed with input from the Eastern Cooperative Oncology Group (ECOG), the Gynecologic Oncology Group (GOG), and the National Surgical Adjuvant Breast and Bowel Project. The FACT/GOG-Ntx includes the previously validated 11-item FACT/GOG neurotoxicity subscale[16-20], which assesses sensory symptoms (e.g., numbness, tingling, and discomfort in hands and feet), motor symptoms (e.g., trouble walking; buttoning buttons), and ototoxicity (e.g., ringing or buzzing in ears). With the introduction of oxaliplatin, and its unique cold hypersensitivity, two new items were written by investigators from National Surgical Adjuvant Breast and Bowel Project. We sought to examine the content validity of the 13-item FACT/GOG-Ntx for CRC patients receiving oxaliplatin.
MATERIALS AND METHODS
Content validity of the 13-item FACT/GOG-Ntx subscale was assessed via concept elicitation and cognitive debriefing interviews with CRC patients experiencing oxaliplatin-induced neuropathy. Trained interviewers used a semi-structured guide that was informed by literature and guides from prior work to assess content validity of PRO measures[21-24]. The study protocol was reviewed and approved by the Northwestern University Institutional Review Board; all participants provided informed consent.
Participants
Patients were recruited from the Robert H. Lurie Cancer Center and the CRC Alliance (https://www.ccalliance.org/) in 2017. Eligible patients were age 18 and older, had a diagnosis of CRC (any stage), were receiving or had received oxaliplatin, and were experiencing peripheral neuropathy. Patients with a cognitive impairment or those experiencing neuropathy from other causes were excluded. Participants were interviewed in-person or via phone, and were compensated for their time.
Concept elicitation
After providing basic demographic information, patients were asked to list their neuropathy symptoms. Additional details were gathered on each symptom, such as when the symptom began, frequency of the symptom, if it co-occurred with other neuropathy symptoms, and its impact on functioning. Patients rated each symptom as it pertained to their health-related quality of life on a 0 to 10 scale, where 0 = not at all important and 10 = extremely important. Lastly, patients were asked to share which neuropathy symptom was most bothersome, and why.
Cognitive debriefing
After the concept elicitation interview, patients completed the FACT/GOG-Ntx 13 plus 6 additional items (Table 1). The FACT/GOG-Ntx measures the severity and impact of symptoms of neurotoxicity, such as numbness, discomfort, or trouble with motor skills, over the past 7 d. Responses are selected from a scale of 0 (“not at all”) to 4 (“very much”). The 6 additional items were written to test whether numbness and tingling should be combined in one item, as in the current version of the FACT/GOG-Ntx (items NTX1 and NTX2), or divided into separate items (additional items 1-4, Table 1). Additional items 5-6 tested whether “discomfort” or “pain” best fit the patients’ neuropathy experiences. After the patient completed the measure and the 6 additional items, the interviewer conducted a cognitive interview with the patient using a structured interview guide based on the work of Willis[25] to assess patients’ understanding of the measure’s instructions, items, and response options. Patients were asked to state each item in their own words, describe how they arrived at their response, and indicate each item’s relevance to their experience.
Table 1.
Functional Assessment of Cancer Therapy/Gynecologic Oncology Group-Neurotoxicity scale items and additional items used in cognitive interviews
| FACT/GOG-Ntx Items |
| NTX1. I have numbness or tingling in my hands |
| NTX2. I have numbness or tingling in my feet |
| NTX3. I feel discomfort in my hands |
| NTX4. I feel discomfort in my feet |
| NTX5. I have joint pain or muscle cramps |
| HI12. I feel weak all over |
| NTX6. I have trouble hearing |
| NTX7. I get a ringing or buzzing in my ears |
| NTX8. I have trouble buttoning buttons |
| NTX9. I have trouble feeling the shape of small objects when they are in my hand |
| An6. I have trouble walking |
| NTX10. I have pain in my hands or feet when I am exposed to cold temperatures |
| NTX11. I have difficulty breathing when I am exposed to cold temperatures |
| Alternate items tested in cognitive interviews |
| I have numbness in my hands. (Add-1) |
| I have tingling in my hands. (Add-2) |
| I have numbness in my feet. (Add-3) |
| I have tingling in my feet. (Add-4) |
| I have pain in my hands. (Add-5) |
| I have pain in my feet. (Add-6) |
Statistical analysis
Interviews were audiotaped, transcribed verbatim, and transcripts were de-identified. A list of neuropathy symptoms that patients reported during concept elicitation was compiled and redundant symptoms were removed; this condensed symptom list formed the basis of a codebook. Two experienced qualitative researchers analyzed the concept elicitation data systematically using a constant comparative approach[26]. The researchers met regularly to review data for each code. Saturation-the point at which no new, relevant data emerges[27,28]-was tracked using a saturation tracking table. Summaries of the data for each code were written, highlighting terminology used by patients and their experiences. These summaries were mapped to the FACT-GOG/Ntx content. The mapping process aimed to highlight (1) dimensions of neuropathy identified by patients and covered by FACT/GOG-Ntx; (2) FACT-GOG-Ntx content that does not align with CRC patients’ experiences with oxaliplatin-induced neuropathy; and (3) experiences with oxaliplatin-induced neuropathy not represented by the FACT/GOG-Ntx[29]. Although content validity assessment primarily relied on the concept elicitation data, we also utilized the literature and cognitive interview data.
RESULTS
Sample
Sociodemographic and clinical characteristics of the concept elicitation sample (n = 31) are shown in Table 2. Our sample was primarily Caucasian (n = 26, 84%) and consisted of nearly equal numbers of men and women. Approximately one-third of the sample (n = 11, 35%) were currently receiving treatment.
Table 2.
Characteristics of patient sample (n = 31), n (%)
| Patient characteristic | Number of participants |
| Mean age (range, yr) | 54 (34-82) |
| Gender | |
| Male | 15 (48.4) |
| Female | 16 (51.6) |
| Education | |
| High school grad/GED | 5 (16.1) |
| Some college/Technical degree/AA | 5 (16.1) |
| College degree (BA/BS) | 9 (29.0) |
| Advanced degree (MA, PhD, MD, JD) | 12 (38.7) |
| Race | |
| Caucasian | 26 (83.9) |
| African-American | 3 (9.7) |
| Asian | 1 (3.2) |
| Mixed race | 1 (3.2) |
| ECOG status (self-reported) | |
| 0 | 5 (16.1) |
| 1 | 13 (41.9) |
| 2 | 7 (22.6) |
| 3 | 5 (16.1) |
| 4 | 1 (3.2) |
| Currently on therapy | |
| Yes | 11 (35.5) |
| No | 20 (64.5) |
| Mean (raw score) FACT/GOG-Ntx-13 subscale score (range) | 18.8 (7-38) |
ECOG: Eastern Cooperative Oncology Group; FACT/GOG-Ntx: Functional Assessment of Cancer Therapy/Gynecologic Oncology Group- Neurotoxicity subscale.
Concept elicitation results: Patient reported symptoms of neuropathy
In response to the question, “Please describe all of the neuropathy side effects that you are currently experiencing,” patients reported over 60 side effects (i.e., symptoms of neuropathy). After redundant categories were removed, 28 unique concerns remained (Table 3). Saturation of patient-reported neuropathy symptoms occurred at interview number 31. The most frequently mentioned symptoms were associated with the hands and feet: hand tingling (experienced by n = 27, 87% of respondents); feet numbness (n = 26, 84%); feet tingling (n = 25, 81%); and hand numbness (n = 21, 68%). Additionally, 74% (n = 23) of participants reported cold sensitivity in their hands or feet, which they described as feelings of shock, stinging, or pain upon touching cold items. Neuropathy symptoms affecting the feet were most frequently identified as most bothersome (Table 4). Seven of the 28 (25%) respondents to this question stated that numbness in the feet was most bothersome. For example, patient 014 said, “My feet have been most bothersome, because with the numbness, you know, especially if I’m getting tired, I can’t feel my feet and sometimes I just find it difficult to start walking in the morning.” Five of 28 (18%) stated that discomfort/pain in the feet was most bothersome.
Table 3.
Patient reported symptoms of neuropathy and impact on health-related quality of life (n = 31), n (%)
| Symptom | Number of patients who listed the symptom | Importance for health-related quality of life, 0 = not at all important, 10 = extremely important mean (range) | Symptom definition |
| Hand tingling | 27 (87.0) | 4.9 (0-10) | Feeling of pins and needles, stabbing, or prickling in one’s hands |
| Numbness - feet | 26 (83.8) | 6.0 (0-10) | Lack of feeling or sensation causing discomfort in one’s feet |
| Tingling - feet | 25 (80.6) | 5.8 (0-10) | Feeling of pins and needles, stabbing, or a prickling sensation in one’s feet |
| Cold sensitivity - hands/feet | 23 (74.1) | 6.7 (1-10) | Feeling of shock, stinging, or pain upon touching cold items with hands or feet |
| Numbness – hands | 21 (67.7) | 5.6 (0-10) | Lack of feeling or sensation in one’s hands |
| Discomfort/pain - feet | 14 (45.1) | 7.3 (3-10) | Aches (sometimes throbbing), or pain when standing on one’s feet |
| Impaired fine motor skills | 13 (41.9) | 7.2 (3-10) | Trouble buttoning buttons, grasping, or holding objects with one’s hands |
| Discomfort/pain - hands | 12 (38.7) | 7.3 (3-9) | Achy, stinging, or stiff sensation in one’s hands |
| Joint pain/muscle cramps | 7 (22.5) | 6.4 (3-10) | Feeling of stiffness, pain, or aches in joints, hand fatigue, or cramps in one’s legs or feet |
| Cold sensitivity - eating/drinking | 6 (19.3) | 5.6 (2-10) | Feeling as if sharp objects are scratching one’s throat, causing pain when swallowing cold food or drink |
| Trouble walking | 6 (19.3) | 6.8 (2-10) | Difficulty feeling feet when on the floor, resulting in stumbling or clumsiness when walking |
| Discomfort/pain - other body parts | 5 (16.1) | 7.6 (3-10) | Various sensations covered including clenched jaw, heavy sensation of the eyelid, leg pain or spasms |
| Abnormal sensation - foot | 4 (12.9) | 6.3 (4-8) | Feeling as if a small object (e.g., walnut) is beneath one’s foot. Affects balance and walking |
| Cold sensitivity - other body part | 4 (12.9) | 4.3 (3-7) | Internal feeling of body coldness (as opposed to on the surface). Spasms or twitching of one’s face, eyes, or chest. when exposed to cold temperatures |
| Cold sensitivity - breathing | 3 (9.6) | 8.0 (7-9) | Sensitivity to cold temperatures affecting one’s nose (burning) or throat (closure, spasm, choking) |
| Numbness - legs | 2 (6.4) | 5.0 (5) | Feeling of prickling or general sense of fatigue in one’s legs or calves |
| Abnormal sensations – other body part | 2 (6.4) | 3.0 (1-5) | Less common abnormal bodily sensations include feeling of coldness inside one’s head and heavy sensation of the eyelids |
| Burning feet | 2 (6.4) | 2.0 (0-4) | Burning sensation in one’s feet causing discomfort when touched |
Side effects listed by 1 patient each: Ringing ears, Blurry vision, Numbness – tongue, Swelling hands, Discomfort/pain – general, Tingling – legs; Abnormal sensation – eyelid, Numbness – lips, Spasms – chest, Twitching face, Abnormal sensations - other body part.
Table 4.
Neuropathy symptoms identified as most bothersome by patients (n = 28), n (%)
| Symptom/issue identified as most bothersome | Number of patients who chose that symptom/issue |
| Numbness- feet | 7 (25.0) |
| Discomfort/pain- feet | 5 (17.8) |
| Cold sensitivity- eating/drinking | 4 (14.2) |
| Cold sensitivity- hands/feet | 3 (10.7) |
| Tingling- feet | 3 (10.7) |
| Loss of hand function | 2 (7.1) |
| Numbness- hands | 2 (7.1) |
| Abnormal sensation- foot | 1 (3.5) |
| Tingling- hands | 1 (3.5) |
| Trouble walking | 1 (3.5) |
| Muscle spasms- feet and legs | 1 (3.5) |
Cognitive interview results
Twenty-nine patients participated in a cognitive interview. Due to time constraints, not all patients completed the entire cognitive interview. Thus, the sample size varies slightly across questions, as noted below. Twenty-eight patients provided feedback on the questionnaire instructions; all 28 (100%) said the instructions were clear. For every item, 100% of respondents (28 of 28) indicated that they were confident or very confident in their response to the item. All items were interpreted in ways that were consistent with the intended meaning (results not shown). Twenty-three of 28 participants (82%) said they thought of a specific time period when answering questions; the most common time period referenced by this group were the past 7 d (12 of 23 participants, 52%) or the current day (7 of 23 participants, 30%). Patients were also asked if their responses would have been different if the instructions said to think of the last 24 hours. The majority of patients (18 of 28, 64%) said no. Almost all participants (27 of 29, 93%) reported that the instrument captured their experiences with treatment-related neuropathy. Cognitive interview results related to the relevance of individual items is provided below and in Table 5, as part of the content validity assessment.
Table 5.
Summary of support for the Functional Assessment of Cancer Therapy/Gynecologic Oncology Group-Neurotoxicity scale items in patient concept elicitation data
| Instrument content | Content validity support from patient interviews | Example quotations from patient concept elicitation interviews | Recommendation | |
| NTX1 | I have numbness or tingling in my hands | Strong | “It felt like there was a coating of wax over my hands” (PT 031). “It’s like a dead feeling and you don’t really have like complete-like if you're trying to pick up something, like a dime or something, you might not realize that you have it or don’t have it” (PT 003). “Well, first it was my fingertips. And they were numb and tingly” (PT 006). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| NTX2 | I have numbness or tingling in my feet | Strong | “Just I can’t feel (sometimes) I can’t feel like if my feet are…cold or hot, I don’t know, I just it’s just numb, you know” (PT 026). “The best way I can describe it is walking on rice with pieces of broken glass in it. Yeah, I guess that’s the best I way I can describe the tingling. It’s constant, yeah...Fuzzy maybe feeling. Needle, sharp needle pain, because it’s kind of a combination of those. So it’s like a needle” (PT 031). ““It’s mainly in my feet. I have tingling in my toes. A slight numbness that runs up past my ankles” (PT 011). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| NTX3 | I feel discomfort in my hands | Strong | “I can't open them [fingers]. There's probably like I said maybe- I mean they're almost open but they can't go flat, and if I try it, it will hurt more…a dull ache” (PT 008). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| NTX4 | I feel discomfort in my feet | Strong | “They just ache. All up and down, they ache, they hurt, it’s uncomfortable, it’s nagging…it hurts” (PT 018). “…...a tightness like you have a really, really tight shoe on. Like something really heavy is on your feet and you can’t get it off. It feels like an intense weight. Your foot is being smashed” (PT 019). “If you’re walking you feel like maybe there’s something in your shoe or like something, did you step on something? And you really didn’t. It’s just an odd feeling...even like barefoot it will sometimes feel like you stepped on a sock or something” (PT 003). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| NTX5 | I have joint pain or muscle cramps | Moderate | “It’s overall hand fatigue, it’s joint pain. It’s almost like repetitive motion, like I find that if I was out in a tractor all day and just the act of spinning the steering wheel constantly as I went across the field and operating the levers and everything on the tractor, that I needed to get my compression gloves on to do some compensating for that. And then at the end of the day my hands are just really, really fatigued” (PT 013). | Retain the item based on cognitive interviews and literature support as a severe symptom of oxaliplatin-induced neuropathy. |
| HI12 | I feel weak all over | Moderate | "My feet and legs are always cold. And then I guess you could call weakness and I guess chronic pain in my feet and legs, lower legs” (P T 031). | Retain the item based on cognitive interviews and literature support as a symptom of oxaliplatin-induced neuropathy. |
| NTX6 | I have trouble hearing | Weak | -- | Retain the item based on cognitive interviews and literature support as a severe symptom of oxaliplatin-induced neuropathy. |
| NTX7 | I get a ringing or buzzing in my ears | Weak | “I had ringing in my ears, but…I haven’t noticed it in the past week. And the last oxaliplatin was June 19th, so I think it took about a month probably after oxaliplatin for the ringing in my ears to settle down” (PT 005). | Retain the item based on cognitive interview and literature support as a severe symptom of oxaliplatin-induced neuropathy. |
| NTX8 | I have trouble buttoning buttons | Strong | “As the button is concerned, I had a very hard time grasping them and getting them through the button holes. It’s a very frustrating and annoying task. I just kept on fumbling with them and not being able to properly grasp the buttons, and I would have to ask my wife to actually come in and button up my shirt” (PT 033). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| NTX9 | I have trouble feeling the shape of small objects when they are in my hand | Strong | “It takes me longer to do a lot of things. Even like if I’m reaching in my pocket to get something and there’s multiple things in the pocket it’s more difficult to go by feel on what I’ve grabbed” (PT 035). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| An6 | I have trouble walking | Strong | “I have to be hyper vigilant about stepping over sticks and watching my balance…There are times when I would say I trip over my own feet because I will step funny because of lack of sensation. So I have to be conscious of walking and making sure that I’m planting my feet squarely to avoid stumbling” (PT 013). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| NTX10 | I have pain in my hands or feet when I am exposed to cold temperatures | Strong | “It’s just a…ultra-sensitivity to cold, anything, it was, it’s like anything colder than my body temperature would either cause like pain or I couldn’t hold, like in my hands, I wouldn’t be able to hold things...And then for my feet…if I go into cold water or if I’m outside in the cold and my feet seem to get cold faster first before anything else, so...the cold sensitivity would be like touching something extremely hot, like you…your body reacts to pull away, you know. And then for my feet, it’s actually painful when they get cold, when they’re exposed to cold” (PT 012). | Retain the item. Strong support in concept elicitation data, cognitive interview data, and extant literature. |
| NTX11 | I have difficulty breathing when I am exposed to cold temperatures | Moderate | “As the temperature of the air started to change, to breathe in was difficult-it became kind of painful even” (PT 006). “I would have to cover up my mouth and nose because if I breathed the cold air; it was like somebody was trying to strangle me. My throat would close up and it’s like somebody had little daggers or needles they were sticking in my throat. It’s a very horrible experience” (PT 033). | Retain the item based on cognitive interviews and literature support as a symptom of oxaliplatin-induced neuropathy. |
Content validity for FACT-GOG-Ntx items
Items NTX1 - I have numbness or tingling in my hands: Numbness of the hands was commonly described as a lack of feeling or sensation that affected activities of daily living such as buttoning buttons, feeling and holding objects, and writing (Supporting quotations are shown in Table 5). Tingling of the hands was commonly described as a feeling of pins and needles, stabbing, or prickling. Patients reported that the numbness or tingling of the hands was often a constant sensation. During the cognitive interview, 26 of 28 patients (93%) said that item Ntx1 was relevant to their experience.
Item NTX2 - I have numbness or tingling in my feet: Patients described numbness in their feet as a lack of feeling or sensation. Tingling was commonly described as a feeling of electricity, vibration, or being asleep. Patients reported that their numbness or tingling was often a constant sensation that impaired mobility and affected daily activities. Twenty-five of 26 (96%) responding patients said the item was relevant to their experience.
Including numbness or tingling within the same item: We asked patients, “In your experience, do hand/foot numbness and tingling go together?” For hands, 18 of 27 patients (67%) stated that numbness and tingling went together. For feet, 20 of 26 patients (77%) stated that numbness and tingling went together. Patient 025 explained, “I’ll be trying to go to sleep at night…if I move my feet or I touch anything, it comes back-that tingling and that numbness.” During the cognitive interview, 2 of 28 patients (7%) thought that the concepts of numbness and tingling should be separated into two questions. For both NTX1 and NTX2, 100% of patients (28 of 28) indicated they were confident or very confident in their ability to provide a response to the items as they were written; none of the patients found the questions to be confusing. When asked which questions were difficult to answer, patient 031 identified the additional questions 3-4, which separated numbness and tingling in the feet, as most difficult to answer: “Some of the neuropathy questions (were difficult) where you had separate sensations but they should go together, like tingling and numbness.”
Item NTX3 - I feel discomfort in my hands: Over one third of patients (12 of 31, 39%) listed hand discomfort or pain as a symptom of their neuropathy during concept elicitation. Hand discomfort tended to interfere with everyday activities or "basically anything that involved my hands" (patient 033). Twenty-five of 28 (89%) cognitive interview participants said item NTX3 was relevant to their experiences.
Item NTX4 - I feel discomfort in my feet: Eighteen of 31 participants (58%) listed symptoms consistent with discomfort in the feet, including aches, pain, burning sensations, and abnormal sensations. Discomfort in the feet affected activities such as standing and driving. Patients also described feeling as if a small object was in their shoe or under their foot, which affected balance and walking. Twenty-five of 28 (89%) cognitive interview participants said the item was relevant to their experiences.
Discomfort vs pain: Patients overwhelmingly stated that “discomfort” was more consistent with neuropathy experienced in their hands than “pain” (23 of 28 patients, 82%). Likewise, 21 of 28 patients (75%) said that “discomfort” was more consistent with peripheral neuropathy experienced in their feet than “pain”. Patients described discomfort as general, more constant, less severe and less likely to interrupt daily activities than pain. Pain was described as throbbing, hurting, more severe, and more likely to stop daily activities. According to patients: “Pain came sometimes but discomfort was always there.” (PT 011) “I have more discomfort than pain.” (PT 019) “Because my experience is numbness and tingling which is not painful, doesn't hurt, (it is) just annoying.” (PT 023) “It is irritating as opposed to hurting.” (PT 025).
Mean responses on the discomfort and pain items are shown in Figure 1. Thirteen of 28 patients (46%) had identical responses to the items referencing discomfort in the hands and pain in the hands. Of the 15 patients (54% of the sample of 28) whose responses were different, all 15 reported more hand discomfort than hand pain. Moreover, of these 15 patients, 11 (73%) reported “not at all” in response to “I have pain in my hands” while reporting levels of hand discomfort ranging from “a little bit” to “very much”. Fewer patients (11 of 28, 39%) had identical scores for foot discomfort and foot pain. Sixteen of the 17 (94%) patients with differing scores reported more foot discomfort than pain. We investigated the significance of differences in mean responses using two-tailed t-tests assuming equal variance. The findings revealed significant group differences for NTX3 and Add-5 (P = 0.007) and NTX4 and Add-6 (P = 0.016).
Figure 1.
Mean scores of hand and foot discomfort and pain items.
Item NTX5 - I have joint pain or muscle cramps: Seven of 31 participants (23%) listed symptoms consistent with joint pain or muscle cramps. These symptoms were impactful to patient quality of life. For example, according to patient 023, “It was my calves that were cramping and it was, oh, I don’t think I’d call it severe, but it was at least moderate to severe cramping. And it was pretty painful.” Over half of cognitive interview participants (15 of 28, 54%) reported the item as relevant to their experience.
Item HI12 - I feel weak all over: Five of 31 concept elicitation participants (16.1%) mentioned feeling weak. Feeling weak was used to describe neuropathy symptoms in the feet, hands, legs, and feet. Others noted weakness when describing the impact of neuropathy symptoms, such as difficulty walking. For example, “Sometimes I have weakness in general, like I’ll be walking and I feel like I’m going to trip” (patient 010). Twenty-two (78.6%) of cognitive interview participants said the item as relevant to their experience.
Item NTX6 - I have trouble hearing: Trouble hearing was not spontaneously mentioned as a neuropathy symptom in the concept elicitation data. Some support for this item came from the cognitive interviews; three of 28 (11%) participants reported the item “I have trouble hearing” as relevant. Of the 25 who said the item was less relevant, 22 did not have trouble hearing, and three reported having hearing problems prior to beginning treatment.
Item NTX7 - I get a ringing or buzzing in my ears: Ringing or buzzing in the ears was mentioned spontaneously by one patient in the concept elicitation interview. A quarter of cognitive interview participants (7 of 28, 25%) reported the item as relevant to their experiences. Of the 21 (75%) who said it was not relevant, 20 did not experience ear ringing or buzzing, and one was unsure if his ear ringing was a neuropathy symptom.
Item NTX8 - I have trouble buttoning buttons: Seven of 31 participants (23%) described limited fine motor function during concept elicitation that affected their ability to button buttons. The process of buttoning buttons was described as time consuming and frustrating, causing some to require assistance or avoid wearing clothing with buttons. “It (buttoning buttons) took more time and it was frustrating having fine motor function limited” (patient 020). A majority of cognitive interview participants (25 of 28, 89%) reported the item as relevant to their experience.
Item NTX9 - I have trouble feeling the shape of small objects when they are in my hand: Ten of 31 concept elicitation participants (32%) listed symptoms consistent with trouble feeling the shape of small objects in their hand, including difficulties feeling small objects that resulted in problems grasping or holding on to small objects. Furthermore, 24 of 28 cognitive interview participants (86%) reported the item as relevant to their experience.
Item An6 - I have trouble walking: Six of 31 concept elicitation participants (19%) mentioned trouble walking because of their neuropathy. “Because of the tingling and numbness in my feet it’s hard for me to find my balance, to figure out where my feet are in the ground. So I tend to be a little, you know, wobbly…kind of unsure footing” (patient 011). Patients’ comments about trouble walking ranged from fear of falling, practicing caution while walking, and having to limit or avoid activities, such as exercise. Twenty-four of 28 (86%) cognitive interview participants stated that the item was relevant to their experience.
Item NTX10 - I have pain in my hands or feet when I am exposed to cold temperatures: Twenty-three of 31 concept elicitation participants (74%) reported hand or feet pain when exposed to cold temperatures. Some likened the pain to being shocked, “If I touch cold things, I get little zings going through my fingers. It intensifies if it’s colder. Like if I pull something out of the freezer, sometimes I have to drop it because it’s too cold” (patient 010). Patients reported limiting exposure to cold items and temperatures because of the pain and discomfort. All 28 (100%) cognitive interview participants reported the item as relevant to their experiences.
Item NTX11 - I have difficulty breathing when I am exposed to cold temperatures: Three of 31 concept elicitation participants (10%) listed difficulty breathing when exposed to cold temperatures as a symptom of neuropathy. They described feeling their throat close, throat spasms, or choking when exposed to cold temperatures. They also described feeling like needles were sticking in their throat. While relatively few patients listed difficulty breathing when exposed to cold temperatures in the concept elicitation interview, those who reported the symptom rated its importance to quality of life high (mean score=8). Moreover, 16 of 28 (57%) cognitive interview participants reported the symptom as relevant to their experience.
Coverage of all patient-reported concepts on the instrument: To ensure that the instrument adequately covers symptoms of importance to patients, we considered whether symptoms reported by at least 20% of the sample (Table 3) during concept elicitation were represented in the FACT/GOG-Ntx. Nine symptoms fit this criteria: hand tingling, feet tingling, hand numbness, feet numbness, cold sensitivity in the hands or feet, discomfort in the feet, discomfort in the hands, impaired fine motor skills, and joint pain or muscle cramps. Each of these symptoms is included in the FACT/GOG-Ntx.
DISCUSSION
In this qualitative study with 31 CRC patients experiencing peripheral neuropathy, tingling and/or numbness of the hands and feet were the most commonly experienced peripheral neuropathy symptoms. Additionally, almost 3 out of 4 participants reported cold sensitivity in their hands or feet. Neuropathy symptoms affecting the feet were most bothersome to patients.
The qualitative concept elicitation data, in combination with data from cognitive interviews and the literature, provide moderate to strong support for the content validity of 11 the 13 items of the FACT/GOG-Ntx-13. Two items - “I have trouble hearing” (NTX6) and “I get a ringing of buzzing in my ears” (NTX7), had limited support in our data. However, limited support is not surprising given that hearing impairment is a symptom of severe neuropathy, and oxaliplatin therapy may be discontinued or reduced prior to impacting hearing. We recommend retaining these items as indicators of severe neuropathy.
Patients related more with the term “discomfort” than “pain” when reporting neuropathy in their hands and feet. Quantitative responses to items with either “discomfort” or “pain” showed that patients report higher levels of discomfort relative to pain. These results are consistent with the original selection of the term “discomfort” over “pain” owing to the observation that discomfort is reported earlier than pain in the trajectory of emerging neuropathy. These findings also highlight the need for developers of other patient reported outcome measures to consider whether pain or discomfort is the best concept for their particular population or condition. We also considered whether including “numbness or tingling” in a single item was problematic due to the possibility that such items would be “double-barreled.” Most patients reported experiencing the two symptoms together. Patient comments suggest that numbness and tingling tend to appear, increase, and decrease in similar ways; future work should confirm this observation. Most patients did not find the items on “numbness or tingling” in hands or feet to be confusing, although they did understand the distinction between the two symptoms. Only 2 patients (7.1%) stated that the concepts should be separated into two questions. Adding questions to the Ntx-13 that separate numbness and tingling is not likely to improve the measure or change responses to any measurable degree. Patients most often considered the last 7 days when responding to the questionnaire. The 7 d recall period is consistent with other PRO measures recommended for use in clinical oncology[30].
This study has a number of strengths, including a relatively large concept elicitation sample and a cognitive interview protocol that closely examined patient interpretation of key concepts. Our methods are consistent with Food and Drug Administration Guidance and other published guidelines for assessing content validity[29,31].
ARTICLE HIGHLIGHTS
Research background
A content valid assessment of neuropathy is needed for clinical research among colorectal cancer (CRC) patients receiving oxaliplatin. The authors assessed the content validity of the Functional Assessment of Cancer Therapy/Gynecologic Oncology Group-Neurotoxicity (FACT/GOG-Ntx) scale among CRC patients who had received oxaliplatin. The measure exhibited good content validity. Moreover, patients reported that foot neuropathy was most bothersome for them. This study is significant because the authors provide evidence that the FACT/GOG-Ntx is suitable for use in clinical trials and other research studies of this population.
Research motivation
This study examines the neuropathy experiences of CRC patients and the appropriateness (i.e., content validity) of a patient reported outcome measure of neuropathy. These topics are important to examine because patient reported outcome measures are needed to assess drug side effects in clinical trial settings.
Research objectives
The main objective was to test the content validity of FACT/GOG-Ntx. This objective was realized; the measure was found to have content validity and can be used in future research and clinical practice.
Research methods
The authors used semi-structured patient interviews to assess the FACT/GOG-Ntx. Semi-structured interviews entail using a set list of questions, administered by a trained interviewer. Interviews typical contain a combination of closed-ended and open-ended questions. By using pre-planned and spontaneous probing questions, the interviewer is able to gather a detailed description of the key topics from the perspective on the interviewee.
Research results
The qualitative concept elicitation data, in combination with data from cognitive interviews and the literature, provide moderate to strong support for the content validity of 11 the 13 items of the FACT/GOG-Ntx-13. Two items - “I have trouble hearing” (NTX6) and “I get a ringing of buzzing in my ears” (NTX7), had limited support in our data. However, limited support is not surprising given that hearing impairment is a symptom of severe neuropathy, and oxaliplatin therapy may be discontinued or reduced prior to impacting hearing. The authors recommend retaining these items as indicators of severe neuropathy.
Research conclusions
The FACT/GOG-Ntx has content validity for CRC patients receiving oxaliplatin. Patients related more with the term “discomfort” than “pain” when reporting neuropathy in their hands and feet. The FACT/GOG-Ntx has content validity for CRC patients receiving oxaliplatin. This study builds upon the body of evidence supporting the use of the FACT/GOG-Ntx in future research and clinical practice.
Research perspectives
Existing patient reported outcome measures can be tested for their validity in new, specific populations. The authors anticipate continued advancement in the use of patient reported measures in clinical research and in drug development. Future work on the use of patient reported outcomes measures in clinical practice is best suited for a combination of patient-focused, qualitative research and large, quantitative surveys to assess measurement properties.
ACKNOWLEDGEMENTS
We are grateful to the CRC Alliance (https://www.ccalliance.org/) for their assistance in recruiting patients to this study.
Footnotes
Institutional review board statement: This study was reviewed and approved by the Ethics Committee of Northwestern University.
Informed consent statement: The patients provided written consent before participation in the study.
Conflict-of-interest statement: The authors have no conflicts of interest to declare.
STROBE statement: The authors have read the STROBE Statement-checklist of items, and the manuscript was prepared according to the STROBE Statement-checklist of items.
Manuscript source: Unsolicited Manuscript
Peer-review started: October 7, 2019
First decision: October 18, 2019
Article in press: January 6, 2020
Specialty type: Oncology
Country of origin: United States
Peer-review report classification
Grade A (Excellent): 0
Grade B (Very good): B, B
Grade C (Good): 0
Grade D (Fair): 0
Grade E (Poor): 0
P-Reviewer: Ananthakrishnan N, Trkulja V S-Editor: Ma YJ L-Editor: A E-Editor: Qi LL
Contributor Information
Karen Kaiser, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States. k-kaiser@northwestern.edu.
Madison Lyleroehr, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States.
Sara Shaunfield, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States.
Leilani Lacson, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States.
Maria Corona, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States.
Sheetal Kircher, Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States.
Malin Nittve, Project and Regulatory Affairs, PledPharma AB, Stockholm 114 46, Sweden.
David Cella, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States.
References
- 1.Weickhardt A, Wells K, Messersmith W. Oxaliplatin-induced neuropathy in colorectal cancer. J Oncol. 2011;2011:201593. doi: 10.1155/2011/201593. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Zedan AH, Hansen TF, Fex Svenningsen A, Vilholm OJ. Oxaliplatin-induced neuropathy in colorectal cancer: many questions with few answers. Clin Colorectal Cancer. 2014;13:73–80. doi: 10.1016/j.clcc.2013.11.004. [DOI] [PubMed] [Google Scholar]
- 3.Bennett BK, Park SB, Lin CS, Friedlander ML, Kiernan MC, Goldstein D. Impact of oxaliplatin-induced neuropathy: a patient perspective. Support Care Cancer. 2012;20:2959–2967. doi: 10.1007/s00520-012-1428-5. [DOI] [PubMed] [Google Scholar]
- 4.Hoff PM, Saad ED, Costa F, Coutinho AK, Caponero R, Prolla G, Gansl RC. Literature review and practical aspects on the management of oxaliplatin-associated toxicity. Clin Colorectal Cancer. 2012;11:93–100. doi: 10.1016/j.clcc.2011.10.004. [DOI] [PubMed] [Google Scholar]
- 5.de Gramont A, Figer A, Seymour M, Homerin M, Hmissi A, Cassidy J, Boni C, Cortes-Funes H, Cervantes A, Freyer G, Papamichael D, Le Bail N, Louvet C, Hendler D, de Braud F, Wilson C, Morvan F, Bonetti A. Leucovorin and fluorouracil with or without oxaliplatin as first-line treatment in advanced colorectal cancer. J Clin Oncol. 2000;18:2938–2947. doi: 10.1200/JCO.2000.18.16.2938. [DOI] [PubMed] [Google Scholar]
- 6.Extra JM, Marty M, Brienza S, Misset JL. Pharmacokinetics and safety profile of oxaliplatin. Semin Oncol. 1998;25:13–22. [PubMed] [Google Scholar]
- 7.Extra JM, Espie M, Calvo F, Ferme C, Mignot L, Marty M. Phase I study of oxaliplatin in patients with advanced cancer. Cancer Chemother Pharmacol. 1990;25:299–303. doi: 10.1007/BF00684890. [DOI] [PubMed] [Google Scholar]
- 8.Grothey A. Oxaliplatin-safety profile: neurotoxicity. Semin Oncol. 2003;30:5–13. doi: 10.1016/s0093-7754(03)00399-3. [DOI] [PubMed] [Google Scholar]
- 9.Hausheer FH, Schilsky RL, Bain S, Berghorn EJ, Lieberman F. Diagnosis, management, and evaluation of chemotherapy-induced peripheral neuropathy. Semin Oncol. 2006;33:15–49. doi: 10.1053/j.seminoncol.2005.12.010. [DOI] [PubMed] [Google Scholar]
- 10.Grothey A. Clinical management of oxaliplatin-associated neurotoxicity. Clin Colorectal Cancer. 2005;5 Suppl 1:S38–S46. doi: 10.3816/ccc.2005.s.006. [DOI] [PubMed] [Google Scholar]
- 11.Cassidy J, Misset JL. Oxaliplatin-related side effects: characteristics and management. Semin Oncol. 2002;29:11–20. doi: 10.1053/sonc.2002.35524. [DOI] [PubMed] [Google Scholar]
- 12.Gamelin E, Gamelin L, Bossi L, Quasthoff S. Clinical aspects and molecular basis of oxaliplatin neurotoxicity: current management and development of preventive measures. Semin Oncol. 2002;29:21–33. doi: 10.1053/sonc.2002.35525. [DOI] [PubMed] [Google Scholar]
- 13.Park SB, Koltzenburg M, Lin CS, Kiernan MC. Longitudinal assessment of oxaliplatin-induced neuropathy. Neurology. 2012;78:152. doi: 10.1212/01.wnl.0000410913.88642.bf. [DOI] [PubMed] [Google Scholar]
- 14.Graham J, Mushin M, Kirkpatrick P. Oxaliplatin. Nat Rev Drug Discov. 2004;3:11–12. doi: 10.1038/nrd1287. [DOI] [PubMed] [Google Scholar]
- 15.Land SR, Kopec JA, Cecchini RS, Ganz PA, Wieand HS, Colangelo LH, Murphy K, Kuebler JP, Seay TE, Needles BM, Bearden JD, 3rd, Colman LK, Lanier KS, Pajon ER, Jr, Cella D, Smith RE, O'Connell MJ, Costantino JP, Wolmark N. Neurotoxicity from oxaliplatin combined with weekly bolus fluorouracil and leucovorin as surgical adjuvant chemotherapy for stage II and III colon cancer: NSABP C-07. J Clin Oncol. 2007;25:2205–2211. doi: 10.1200/JCO.2006.08.6652. [DOI] [PubMed] [Google Scholar]
- 16.Cella D, Peterman A, Hudgens S, Webster K, Socinski MA. Measuring the side effects of taxane therapy in oncology: the functional assesment of cancer therapy-taxane (FACT-taxane) Cancer. 2003;98:822–831. doi: 10.1002/cncr.11578. [DOI] [PubMed] [Google Scholar]
- 17.Calhoun EA, Welshman EE, Chang CH, Lurain JR, Fishman DA, Hunt TL, Cella D. Psychometric evaluation of the Functional Assessment of Cancer Therapy/Gynecologic Oncology Group-Neurotoxicity (Fact/GOG-Ntx) questionnaire for patients receiving systemic chemotherapy. Int J Gynecol Cancer. 2003;13:741–748. doi: 10.1111/j.1525-1438.2003.13603.x. [DOI] [PubMed] [Google Scholar]
- 18.Cheng HL, Molassiotis A. Longitudinal validation and comparison of the Chinese version of the European Organization for Research and Treatment of Cancer Quality of Life-Chemotherapy-Induced Peripheral Neuropathy Questionnaire (EORTC QLQ-CIPN20) and the Functional Assessment of Cancer-Gynecologic Oncology Group-Neurotoxicity subscale (FACT/GOG-Ntx) Asia Pac J Clin Oncol. 2019;15:56–62. doi: 10.1111/ajco.13000. [DOI] [PubMed] [Google Scholar]
- 19.Yoshida Y, Satoh A, Yamada T, Aisu N, Matsuoka T, Koganemaru T, Kajitani R, Munechika T, Matsumoto Y, Nagano H, Komono A, Sakamoto R, Morimoto M, Arima H, Hasegawa S. The Relationship Between Evaluation Methods for Chemotherapy-Induced Peripheral Neuropathy. Sci Rep. 2019;9:20361. doi: 10.1038/s41598-019-56969-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Schmoldt A, Benthe HF, Haberland G. Digitoxin metabolism by rat liver microsomes. Biochem Pharmacol. 1975;24:1639–1641. [PubMed] [Google Scholar]
- 21.Cella D, Rosenbloom SK, Beaumont JL, Yount SE, Paul D, Hampton D, Abernethy AP, Jacobsen PB, Syrjala K, Von Roenn JH. Development and validation of 11 symptom indexes to evaluate response to chemotherapy for advanced cancer. J Natl Compr Canc Netw. 2011;9:268–278. doi: 10.6004/jnccn.2011.0026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Magasi S, Mallick R, Kaiser K, Patel JD, Lad T, Johnson ML, Kaplan EH, Cella D. Importance and relevance of pulmonary symptoms among patients receiving second- and third-line treatment for advanced non-small-cell lung cancer: support for the content validity of the 4-item Pulmonary Symptom Index. Clin Lung Cancer. 2013;14:245–253. doi: 10.1016/j.cllc.2012.07.001. [DOI] [PubMed] [Google Scholar]
- 23.Victorson DE, Anton S, Hamilton A, Yount S, Cella D. A conceptual model of the experience of dyspnea and functional limitations in chronic obstructive pulmonary disease. Value Health. 2009;12:1018–1025. doi: 10.1111/j.1524-4733.2009.00547.x. [DOI] [PubMed] [Google Scholar]
- 24.Eton DT, Shevrin DH, Beaumont J, Victorson D, Cella D. Constructing a conceptual framework of patient-reported outcomes for metastatic hormone-refractory prostate cancer. Value Health. 2010;13:613–623. doi: 10.1111/j.1524-4733.2010.00702.x. [DOI] [PubMed] [Google Scholar]
- 25.Willis GB. Cognitivie interviewing: A tool for improving questionnaire design. 1 ed. Thousand Oaks, CA: Sage, 2005. [Google Scholar]
- 26.Glaser B, Strauss AL. The Discovery of Grounded Theory. Chicago: Aldine de Gruyter, 1967. [Google Scholar]
- 27.Bowen GA. Naturalistic inquiry and the saturation concept: a research note. Qual Res. 2008;8:137–152. [Google Scholar]
- 28.Guest G, Bunce A, Johnson L. How Many Interviews Are Enough? Field Methods. 2006;18:59–82. [Google Scholar]
- 29.Rothman M, Burke L, Erickson P, Leidy NK, Patrick DL, Petrie CD. Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report. Value Health. 2009;12:1075–1083. doi: 10.1111/j.1524-4733.2009.00603.x. [DOI] [PubMed] [Google Scholar]
- 30.Basch E, Abernethy AP, Mullins CD, Reeve BB, Smith ML, Coons SJ, Sloan J, Wenzel K, Chauhan C, Eppard W, Frank ES, Lipscomb J, Raymond SA, Spencer M, Tunis S. Recommendations for incorporating patient-reported outcomes into clinical comparative effectiveness research in adult oncology. J Clin Oncol. 2012;30:4249–4255. doi: 10.1200/JCO.2012.42.5967. [DOI] [PubMed] [Google Scholar]
- 31.Department of Health and Human Services Food and Drug Administration. Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims, 2009. Available from: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-reported-outcome-measures-use-medical-product-development-support-labeling-claims.