Abstract
Documented deficiencies in adult sickle cell disease (SCD) care include poor access to knowledgeable providers and inadequate treatment in emergency departments (EDs).
The aim of this study was to create patient-reported outcome measures of the quality of ambulatory and ED care for adults with SCD.
We developed and pilot tested SCD quality of care questions consistent with Consumer Assessments of Healthcare Providers and Systems surveys. We applied psychometric methods to develop scores and evaluate reliability and validity.
The participants of this study were adults with SCD (n = 556)—63% aged 18 to 34 years; 64% female; 64% SCD-SS—at 7 US sites.
The measure used was Adult Sickle Cell Quality of Life Measurement information system Quality of Care survey.
Most participants (90%) reported at least 1 severe pain episode (pain intensity 7.8 ± 2.3, 0–10 scale) in the past year. Most (81%) chose to manage pain at home rather than the ED, citing negative ED experiences (83%). Using factor analysis, we identified Access, Provider Interaction, and ED Care composites with reliable scores (Cronbach α 0.70–0.83) and construct validity (r = 0.32–0.83 correlations with global care ratings). Compared to general adult Consumer Assessments of Healthcare Providers and Systems scores, adults with SCD had worse care, adjusted for age, education, and general health.
Results were consistent with other research reflecting deficiencies in ED care for adults with SCD. The Adult Sickle Cell Quality of Life Measurement Quality of Care measure is a useful self-report measure for documenting and tracking disparities in quality of SCD care.
Keywords: access to care, ambulatory care, emergency medicine, health care delivery, quality of care, sickle cell disease
1. Introduction
The probability of survival to adulthood in sickle cell disease (SCD) has improved to nearly 95% in the United States[1] with a range of therapies preventing early mortality.[2–5] As life spans increase, adults with SCD face increased morbidities including multiorgan failure, chronic pain, and neurocognitive deficits.[6–8] The growing demand for health care for adults with SCD reveals inadequacies, including limited access to providers who are knowledgeable about unique clinical needs of the population.[6,9]
Adults with SCD report stigmatization in the health care system[10–13] with providers generally insensitive to the pain experiences characteristic of SCD. Providers can be overly concerned about addiction, leading to failure to provide timely and adequate pain control when needed.[12,14–16] In turn, these negative health care experiences were related to many adults postponing seeking health care, managing pain episodes at home, and self-discharging from the hospital.[17–20]
As a consequence of these shortcomings, the National Heart, Lung, and Blood Institute (NHLBI) launched a series of efforts aimed at improving adult SCD care, including the recent development of a set of evidence-based clinical practice guidelines for primary care providers.[21] NHLBI also sponsored the development of the Adult Sickle Cell Quality of life Measurement (ASCQ-Me—pronounced “Ask me”) information system,[22,23] a system designed to be complementary with the Patient-Reported Outcomes Measurement Information System (PROMIS).[24] ASCQ-Me and PROMIS (a National Institutes of Health Common Fund initiative) use comparable methods for instrument development and validation to create state-of-the-science assessments for self-reported health.[25]
As part of the ASCQ-Me project, we concurrently developed and tested the ASCQ-Me Quality of Care (QOC) survey to be a patient-reported outcome designed to assess access and quality of adult sickle cell care. We used rigorous psychometric methods to evaluate the ASCQ-Me QOC survey with a cohort of adults with SCD, using a cross-sectional design. Our goal was to develop a measure that allows for comparison of results across care settings and over time, and to produce comprehensible information that has utility for both health care providers and patients served.
Here we describe the development and psychometric properties of the ASCQ-Me QOC survey. We hypothesized that responses of adults with SCD to a series of questions about their health care experiences could be used to derive reliable and valid QOC scores. Moreover, we expected that the empirical evidence provided by these questions would reliably discriminate the care experience of patients with SCD from that of other populations.
2. Materials and methods
All materials, methods, and procedures received approval from the Institutional Review Boards of the American Institutes for Research, Children's Hospital Oakland Research Institute, and the sponsoring hospitals.
2.1. Participants
Participants completed the ASCQ-Me QOC survey anonymously during the ASCQ-Me field test data collection, a larger study with methodology detailed elsewhere.[22,23] The sample size requirement for the QOC analysis was based on the number of respondents per question. Depending on the intercorrelations among items in the factors, recommendations can vary from 5 to 20 respondents per item in the factor analysis to support stable estimates—larger sample sizes are required when the intercorrelations are smaller.[26] There were 12 questions hypothesized to address 4 composites in the field test version of the ASCQ-Me QOC; thus, a sample size of 240 would be ample. The targeted enrollment for the ASCQ-Me field test of 550 adults far exceeded that needed for the current study.
Data were collected at 7 geographically and clinically (e.g., academic medical center, community-based organization, rural health center) varied sites of care, with the goal of addressing potential sources of bias by enrolling a diverse sample of patients. Inclusion criteria were broad, as follows: any diagnosis of SCD and ages ≥18 years. Exclusion criteria were as follows: no diagnosis of SCD or diagnosis with sickle cell trait, younger than 18 years, and not able to read English. Participants answered screener questions when responding to recruitment materials in order to determine that they should not be excluded. Their sickle cell providers also referred participants to the study so they had a known diagnosis of SCD. Data were collected between October 2008 and May 2009.
2.2. Data collection procedures
Participants were volunteers responding to descriptions of the study at clinical care sites, SCD community-based organizations, and the Sickle Cell Disease Association of America website. At ASCQ-Me field test sites, site coordinators explained study procedures in detail to qualified adults who then signed informed consent forms. Site coordinators then entered minimal demographic data about the participants (age range, gender, and diagnosis) and assisted them in logging into the ASCQ-Me data collection website. Participants proceeded to complete the survey on their own.
2.3. Measurement development
We generated preliminary themes about the experiences of adults with SCD, and then ASCQ-Me questions, from information from the NHLBI consumer working groups[9] and a literature review.[22] Next, we conducted individual and focus group interviews involving 122 adults with SCD and 15 providers. We qualitatively analyzed participant responses to confirm and expand on initial themes related to QOC.[22] Themes identified included the following:
Lack of SCD knowledge on the part of providers in ambulatory and emergency department (ED) settings, leading to stigmatization of adults with SCD as drug seeking, as well as to inappropriate and ineffective care
Extremely long waits before receiving care in the ED
Disrespectful providers who did not consider information provided by the patient, leading to undermedication or overmedication for pain
Preference of adults to treat the symptoms of SCD outside of the health care setting, given the preceding
These themes informed the construction of the ASCQ-Me QOC survey questions that were also modeled after the Consumer Assessments of Healthcare Providers and Systems (CAHPS) surveys.[27,28] CAHPS represents the most widely used method for capturing and reporting patients’ experiences of their care, covering literally millions of lives. CAHPS measures are used to assess the performance of health care entities including Medicare, Medicaid, private health plans, clinicians, and medical groups, among others.[29–33] We included questions that were similar or identical to CAHPS when questions were consistent with content suggested by the ASCQ-Me formative research, in order to enable comparisons across care experiences.
The ASCQ-Me QOC survey consists of 27 questions, but skip patterns allow respondents to complete the survey in as few as 5 questions, if they did not have any sickle cell–related pain in the past 12 months and never sought emergency or ambulatory care. Twelve ASCQ-Me QOC questions were hypothesized to be indicators of 4 domains of health care quality. The first domain mirrors the CAHPS “Access” composite[34] and consisted of 2 items, for example, “In the past 12 months, when you tried to make an appointment to see a provider, how often were you able to get one as soon as you wanted?” (rated Never to Always). The second domain mirrors the CAHPS “Provider Communication” composite[34] and consisted of 4 items, for example, “In the past 12 months, how often did the doctor or nurse listen carefully to you?” (rated Never to Always). The third domain, “ED Care,” included 3 items regarding the patient's interaction with staff (doctors, nurses, clerks/receptionists) during emergency visits along with an item asking the extent to which providers believed that the patient had severe pain.[34] The fourth composite—ED Pain Treatment—included 2 items that asked how successfully pain was treated in the ED, and how long the patient had to wait to get treated.[34]
Three questions addressed global evaluations of care for SCD by asking participants how often they were satisfied (Never to Always) with their usual provider, and with the QOC received from their usual provider and the ED. Participants also provided an overall evaluation of all the care they received on a scale from 0 to 10 anchored from Worst to Best care possible. Separate scores were produced for each of the 4 global questions.
For the preceding 12 months, participants reported on the number of visits with their usual provider and the number of times they had been to the ED because of pain or had managed pain at home, without going to a doctor, clinic, or hospital. Three other questions measured participants’ perceptions of how knowledgeable their primary care provider was about SCD and the final 2 questions asked if participants had ever avoided going to the ED when they thought they needed care, either due to bad experiences or due to health insurance issues.
2.4. Data analysis
Data analyses were conducted using Statistical Analysis Software (www.sas.com). Twelve QOC survey questions were hypothesized to form 4 composite scores: Access, Provider Communication, ED Care, and ED Pain Treatment. We evaluated the amount of systematic information provided by these 4 composites by determining their internal consistency reliability using Cronbach α.[35] We examined the distribution of composite scores to see the percentage of patients who reported the highest (ceiling effect) and lowest (floor effect) quality. We evaluated the construct validity of the composites using the following: scaling success rate[36,37]—to determine whether 100% of correlations between responses to questions and their composite score were stronger (correcting for overlap) than the correlation of those questions with other composite scores[38]; confirmatory factor analysis (CFA)[39,40]—to determine whether the hypothesized relationships between indicators and underlying dimensions of QOC fit the data by requiring fit statistics >0.95 and the root mean square error of approximation (an indication of the amount of variance in the data not accounted for by specified relationships between questions and composites) <0.06[41]; and examination of correlations of each composite measure score to the 4 overall ratings of care.[42]
We imputed missing data in order to conduct the factor analysis. We used a multiple imputation procedure. One of the 5 data sets of imputed values produced by missing values procedure was selected at random to be used as input for these exploratory models and the goodness-of-fit analyses (CFA). Once a final revised model was identified, the analyses were repeated on each of the 4 remaining sets of imputed values to evaluate the generalizability of the results. The analyses were then repeated using all 5 sets of imputed values combined into 1 data set. Results from these subsequent analyses are reported only if they differ from the results based on the single set of imputed values and if they suggest a poor fit for the revised structure.
We also examined the validity of ASCQ-Me QOC scores by comparing the scores of those of “known groups”—comparable, publicly reported scores for people covered under private insurance, Medicare, and Medicaid.[43] We expected QOC scores for adults living with SCD to be more similar to those for Medicaid, with lower quality scores compared with Medicare or private insurance.[22]
When the CFA did not support the hypothesized relationship of questions to composite measures, we conducted exploratory factor analysis (EFA) and examined the rotated factor loading pattern. We identified those items as belonging to a composite that had a factor loading >0.30, with differences between that primary loading and any secondary loadings on competing factors of ≥0.20.
3. Results
3.1. Demographic characteristics
A total of 561 adults with SCD at geographically dispersed sites were enrolled in ASCQ-Me with 556 completing the QOC survey. Participants were mostly female (64%) and most were between the ages of 18 and 34 years (63%), with 20% aged 35 to 44 years, and 18% aged 45 years and older. Most participants reported that they had the Hb-SS variation of SCD (64%), followed by Hb-SC (21%), and Hb-Sβ thalassemia (10%). Less than 1% of respondents (0.89%) had missing data on the QOC survey.
3.2. Characteristics of pain
Almost all participants (90%) indicated that they had had a severe pain episode in the past 12 months, with 20% reporting a pain episode within the past week, and 9% reporting a pain episode at the time of the survey. Half reported ≥4 episodes and 9% reported no pain episodes in the past 12 months. The average severity rating for the last pain episode was 7.8 ± 2.3 on a word graphic rating scale, where 0 = no pain and 10 = worst pain imaginable. Most participants (67%) reported that the pain was severe enough to interfere with their lives, with 37% reporting that the pain was so severe that they could not take care of themselves and needed either some help or constant care. The duration of the most recent pain episode ranged from 1 day (68%) to >1 week (21%).
3.3. Characteristics of participants’ health care
Seven questions on the ASCQ-Me QOC survey were not hypothesized to contribute to composite scores but were included to provide information to characterize health care experiences (Table 1). The majority of participants (89%) reported having a regular provider specializing in SCD care that they saw for routine care, and most (61%) had seen this provider ≥4 times in the past year. Most participants (81%) also reported going to the ED for pain in the past 12 months, with 32% visiting the ED for pain ≥4 times. Waits of >1 hour before treatment were common (reported by 62%). Participants reported treating the majority of pain episodes at home without medical assistance, with 83% reporting that previous bad experiences with ED care played at least some role in that decision.
Table 1.
3.4. Reliability and validity of composites
The CFA fit statistics did not support the arrangement of the 12 questions into 4 composites, so we conducted EFA on the questions plus the question on bad experiences in the ED. The EFA pointed toward 3 composites that had fit indices exceeding the conservative cutoff criterion of 0.50 for loading on a single factor and no loadings on a secondary factor >0.25, with the exception of the question about ease of getting an appointment for ambulatory care (Table 2). We labeled the composites Provider Communication (quality of patient and provider communication), ED Care (QOC in the ED), and Access (access to routine and emergency care). We retained the question about access to routine ambulatory care for further analysis because it referred to content that would be important to include in the final survey. Subsequent statistical analysis supported this decision. Once we accounted for residual correlations among items due to inclusion of the phrase “emergency care” in the question stem, the CFA with the 3-factor, 13-question composite structure fit the data very well (CFI = 0.97; root mean square error of approximation = 0.05). Internal consistency reliabilities for all 3 composites were >0.70, and all composite questions were more highly correlated with their own composites versus competing composites (scaling success rate for all 3 was 100%; Table 3). Floor effects were minimal for all composites and ceiling effects were minimal for the Access and ED Care composites (Table 3). More than 40% of participants reported the highest QOC possible for Provider Communication.
Table 2.
Table 3.
Correlations between the composites and the CAHPS global ratings of QOC can be seen in Table 4. Sample sizes associated with different questions differed because respondents were instructed not to answer questions that did not pertain to them. For example, if they did not go to the ED, they were asked to skip the questions asking about their experience in the ED. Stronger relations of the Provider Communication composite with overall ratings of routine care (r = 0.65) and provider ratings overall (r = 0.83) compared with the other composites provided evidence of construct validity. Similarly, the ED Care composite was most strongly related to overall ratings of QOC in the ED. Interestingly, the Access composite was also most highly related to overall evaluations of ED care.
Table 4.
Figures 1 and 2 display the frequency distributions of overall ratings of care and quality of communication between patient and provider, respectively, for adults completing ASCQ-Me compared to those of other patient populations who responded to the same questions included in CAHPS surveys. Scores for all groups were adjusted for patient mix using general linear models in which age, education, and general health status were specified as covariates.[44]Figure 1 shows that the overall rating of health care by adults with SCD was substantially worse than all other groups, including Medicaid.
Reports of poor provider communication for adults with SCD (Doctor/Provider Communication composite) were comparable to reports of adults treated under Medicaid[45] (Fig. 2). Both groups reported more often that providers “never” or only “sometimes” performed quality communication behaviors, that is, listened carefully, spent enough time, treated them with respect, and explained things well, compared with participants seen in group practices, those in the hospital, those on Medicare, and those on commercial insurance plans.
4. Discussion
We propose our successfully developed measure, ASCQ-Me QOC, as a patient-reported outcome measure of QOC for adults with SCD. While the ASCQ-Me QOC survey was developed with 4 domains in mind—Access, Provider Communication, ED Care, and ED Pain Treatment—factor analytic results provided more support for a 3-composite structure in which subsets of questions hypothesized to belong to the ED Pain Treatment topic were found to be highly related to either Access or ED Care. Given the salient role that pain episodes play in most patients’ lives and in their interactions with the health care system, it makes sense that questions referring to SCD pain treatment would not be separable from other aspects of the patients’ interactions with the health care system. Our literature review and qualitative research indicates that the experience of SCD pain pervades all areas of the lives of adults with SCD.[22] Also consistent with this literature, the composite that most strongly related to overall evaluations of health care was ED Care.
Results of our psychometric analyses supported the reliability and validity of the 3 composites—access to care, quality of provider communication, and QOC in the ED—for adults with SCD. All 3 composites showed good precision for discriminating among groups experiencing poor QOC, while the low ceiling effects for the Access and ED Care composites suggest that these measures will do a good job of discriminating among groups of individuals who experience higher QOC. The Provider Communication composite may not be as discriminating among groups of individuals who have positive experiences on this care dimension; however, ceiling effects of ≥44% are not unusual for items that ask patients to evaluate their providers.[46,47] Moreover, Fig. 2 shows that this composite was able to distinguish differences in care provided to adults with SCD from that provided to other groups.
Our hypothesis that adults with SCD would report care experiences similar to those reported by patients treated under Medicaid (who have historically given the lowest ratings of care when compared to patients treated under Medicare or private insurance[43]) was supported. These results not only support the validity of the ASCQ-Me QOC survey but are also consistent with studies showing that adults with SCD report greater race-based and disease-based discrimination in health care compared with other African Americans.[48] In turn, negative provider attitudes influence patient–provider interactions and quality of SCD care provided.[49]
The majority of our volunteer sample of adults with SCD had reasonable access to ambulatory care, which is not surprising given our sampling strategy that was appropriate for conducting psychometric evaluation of the ASCQ-Me QOC survey and that was not intended to be representative of the population of adults with SCD. Our select group of adults with SCD reported that their outpatient providers were knowledgeable about SCD care and highly rated regarding communication, respect, and time spent. Nevertheless, our adults reported very poor QOC in the ED. The majority of adults with SCD in the United States do not have access to either adequate ambulatory or adequate ED care.[15,20,22]
Because the ASCQ-Me QOC survey psychometrics were generated within the context of a larger field test including ASCQ-Me short forms and PROMIS measures, we did not time how long it took respondents to complete the QOC measure. Given its length, the time to complete the ASCQ-Me QOC survey is likely to be <10 minutes, according to previous research and practice, with quicker times expected if the survey is administered electronically.[50,51] Given skip patterns, the fewest number of questions that an adult with SCD would have to answer would be 5, thus taking <2 minutes to complete. This brevity lends to the use of the ASCQ-Me QOC survey in day-to-day clinical practice.
The needed improvement of adult health care for SCD is literally a matter of life and death. In our qualitative data analysis for ASCQ-Me, adults reported that they delayed or completely avoided going to the ED because of their past negative experiences, despite facing life-threatening complications.[22] Deaths related to SCD due to patient refusal to seek needed health care have been documented.[52] Severe painful vaso-occlusive episodes remain a marker for premature mortality in a modern cohort[53] and the well-documented delays in treatment when adults with SCD present to the ED[54] can be associated with preventable deaths, such as what can occur with the rapid progression of acute chest syndrome.[8,55] The research reported here suggests that the ASCQ-Me QOC survey could assist in efforts to improve the QOC delivered to adults with SCD by identifying deficiencies from the patient's perspective and enabling care delivery systems to implement quality improvement initiatives and evaluate their success in addressing these deficiencies.
5. Conclusion
Understanding patient experiences is a first step in improving the QOC delivery. Improving access to routine and emergency care, provider communication, and the quality of emergency care as measured by the patient-reported outcome measure, ASCQ-Me QOC, can potentially reduce health care costs as patients receive timely and appropriate care.[56]
Acknowledgment
The authors wish to thank Natasha Dean for her assistance with the preparation of this article.
Footnotes
Abbreviations: ASCQ-Me = Adult Sickle Cell Quality of Life Measurement, CAHPS = Consumer Assessments of Healthcare Providers and Systems, CFA = confirmatory factor analysis, CFI = comparative fit index, ED = emergency department, EFA = exploratory factor analysis, NHLBI = National Heart, Lung, and Blood Institute, PROMIS = Patient-Reported Outcomes Measurement Information System, QOC = quality of care, SCD = sickle cell disease.
Funders: This research was funded by a contract from the National Heart, Lung, and Blood Institute, National Institutes of Health, to the American Institutes for Research, contract no. HHSN-268-2005-74264C.
A presentation based on these results was presented at the International Society for Quality of Life Research (ISOQOL) Annual Meeting in Budapest, Hungary, in 2012.
The authors have no conflicts of interest to disclose.
References
- 1.Quinn CT, Rogers ZR, McCavit TL, et al. Improved survival of children and adolescents with sickle cell disease. Blood 2010; 115:3447–3452. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Adamkiewicz TV, Silk BJ, Howgate J, et al. Effectiveness of the 7-valent pneumococcal conjugate vaccine in children with sickle cell disease in the first decade of life. Pediatrics 2008; 121:562–569. [DOI] [PubMed] [Google Scholar]
- 3.Adams RJ, Brambilla D. Discontinuing prophylactic transfusions used to prevent stroke in sickle cell disease. N Engl J Med 2005; 353:2769–2778. [DOI] [PubMed] [Google Scholar]
- 4.Fullerton HJ, Adams RJ, Zhao S, et al. Declining stroke rates in Californian children with sickle cell disease. Blood 2004; 104:336–339. [DOI] [PubMed] [Google Scholar]
- 5.Halasa NB, Shankar SM, Talbot TR, et al. Incidence of invasive pneumococcal disease among individuals with sickle cell disease before and after the introduction of the pneumococcal conjugate vaccine. Clin Infect Dis 2007; 44:1428–1433. [DOI] [PubMed] [Google Scholar]
- 6.Yawn BP, Buchanan GR, Afenyi-Annan AN, et al. Management of sickle cell disease: summary of the 2014 evidence-based report by expert panel members. JAMA 2014; 312:1033–1048. [DOI] [PubMed] [Google Scholar]
- 7.Vichinsky EP, Neumayr LD, Gold JI, et al. Neuropsychological dysfunction and neuroimaging abnormalities in neurologically intact adults with sickle cell anemia. JAMA 2010; 303:1823–1831. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ballas SK, Kesen MR, Goldberg MF, et al. Beyond the definitions of the phenotypic complications of sickle cell disease: an update on management. ScientificWorldJournal 2012; 2012:949535. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.National Heart, Lung, and Blood Institute. [website]. Workshop on Adults with Sickle Cell Diseases: Meeting Unmet Needs. Executive Summary and Recommendations. Retrieved September 8, 2015, from: http://www.nhlbi.nih.gov/meetings/scdmtg/execsum.htm/. [Google Scholar]
- 10.Haywood C, Jr, Beach MC, Lanzkron S, et al. A systematic review of barriers and interventions to improve appropriate use of therapies for sickle cell disease. J Natl Med Assoc 2009; 101:1022–1033. [DOI] [PubMed] [Google Scholar]
- 11.Maxwell K, Streetly A, Bevan D. Experiences of hospital care and treatment seeking for pain from sickle cell disease: qualitative study. BMJ 1999; 318:1585–1590. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Strickland O, Jackson G, Gilead M, et al. Use of focus groups for pain and quality of life assessment in adults with sickle cell disease. J Natl Black Nurses Assoc 2001; 12:36–43. [PubMed] [Google Scholar]
- 13.Thomas V, Taylor L. The psychosocial experience of people with sickle cell disease and its impact on quality of life: qualitative findings from focus groups. Br J Health Psychol 2002; 7:345–363. [DOI] [PubMed] [Google Scholar]
- 14.Labbe E, Herbert D, Haynes J. Physicians’ attitude and practices in sickle cell disease pain management. J Palliat Care 2005; 21:246–251. [PubMed] [Google Scholar]
- 15.Lazio MP, Costello HH, Courtney DM, et al. A comparison of analgesic management for emergency department patients with sickle cell disease and renal colic. Clin J Pain 2010; 26:199–205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Murray N, May A. Painful crises in sickle cell disease—patients’ perspectives. BMJ 1988; 297:452–454. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Haywood C, Jr, Lanzkron S, Ratanawongsa N, et al. Hospital self-discharge among adults with sickle-cell disease (SCD): associations with trust and interpersonal experiences with care. J Hosp Med 2010; 5:289–294. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Jenerette CM, Brewer C. Health-related stigma in young adults with sickle cell disease. J Natl Med Assoc 2010; 102:1050–1055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Jenerette CM, Brewer CA, Ataga KI. Care seeking for pain in young adults with sickle cell disease. Pain Manag Nurs 2014; 15:324–330. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Smith WR, Scherer M. Sickle-cell pain: advances in epidemiology and etiology. Hematology Am Soc Hematol Educ Program 2010; 2010:409–415. [DOI] [PubMed] [Google Scholar]
- 21.National Heart, Lung, and Blood Institute. [website]. Evidence Based management of sickle cell disease: expert panel report, 2014. Retrieved January 25, 2016, from: http://www.nhlbi.nih.gov/health-pro/guidelines/sickle-cell-disease-guidelines/. [Google Scholar]
- 22.Treadwell MJ, Hassell K, Levine R, et al. Adult sickle cell quality-of-life measurement information system (ASCQ-Me): conceptual model based on review of the literature and formative research. Clin J Pain 2014; 30:902–914. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Keller SD, Yang M, Treadwell MJ, et al. Patient reports of health outcome for adults living with sickle cell disease: development and testing of the ASCQ-Me item banks. Health Qual Life Outcomes 2014; 12:125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Cella D, Riley W, Stone A, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol 2010; 63:1179–1194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Keller SD, Werner EM. Building on PROMIS: ASCQ-Me. In: The Second PROMIS Conference: Improving Measurement of Patient-Reported Outcomes-New Tools and the Science Behind Them; 2008; Bethesda, MD. [Google Scholar]
- 26.Stevens J. Applied Multivariate Statistics for the Social Sciences. 2nd ed.Hillsdale, NJ: Lawrence Earlbaum Associates; 1992. [Google Scholar]
- 27.Crofton C, Lubalin JS, Darby C. Consumer Assessment of Health Plans Study (CAHPS). Foreword. Med Care 1999; 37 (3 suppl):MS1–MS9. [DOI] [PubMed] [Google Scholar]
- 28.Goldstein E, Farquhar M, Crofton C, et al. Measuring hospital care from the patients’ perspective: an overview of the CAHPS® hospital survey development process. Health Serv Res 2005; 40:1977–1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Frentzel EM, Sangl JA, Evensen CT, et al. Giving voice to the vulnerable: the development of a CAHPS nursing home survey measuring family members’ experiences. Med Care 2012; 50:S20–S27. [DOI] [PubMed] [Google Scholar]
- 30.Darby C, Hays RD, Kletke P. Development and evaluation of the CAHPS® Hospital Survey. Health Serv Res 2005; 40:1973–1976. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Weidmer BA, Cleary PD, Keller S, et al. Development and evaluation of the CAHPS (Consumer Assessment of Healthcare Providers and Systems) survey for in-center hemodialysis patients. Am J Kidney Dis 2014; 64:753–760. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Keller S, Col Martin GC, Evensen CT, et al. The development and testing of a survey instrument for benchmarking dental plan performance: using insured patients’ experiences as a gauge of dental care quality. J Am Dent Assoc 2009; 140:229–237. [DOI] [PubMed] [Google Scholar]
- 33.Levine RE, Fowler FJ, Jr, Brown JA. Role of cognitive testing in the development of the CAHPS Hospital Survey. Health Serv Res 2005; 40:2037–2056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Keller S, O’Malley AJ, Hays RD, et al. Methods used to streamline the CAHPS Hospital Survey. Health Serv Res 2005; 40:2057–2077. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951; 16:297–334. [Google Scholar]
- 36.Hayashi T, Hays R. A microcomputer program for analyzing multitrait-multimethod matrices. Behav Res Methods 1987; 19:345–348. [Google Scholar]
- 37.Steiger JH. Tests for comparing elements of a correlation matrix. Psychol Bull 1980; 87:245–251. [Google Scholar]
- 38.Howard KI, Forehand GA. A method for correcting item-total correlations for the effect of relevant item inclusion. Educ Psychol Meas 1962; 22:731–735. [Google Scholar]
- 39.Hatcher L. A Step-by-Step Approach to Using the SAS System for Factor Analysis and Structural Equation Modeling. Cary, NC: SAS Institute Inc; 1994. [Google Scholar]
- 40.Nunnally J, Bernstein I. Psychometric Theory. 3rd ed.New York: McGraw-Hill Book Company; 1995. [Google Scholar]
- 41.Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equation Model 1999; 6:1–55. [Google Scholar]
- 42.Cohen J. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum; 1988. [Google Scholar]
- 43.US Department of Health and Human Services. Publicly reported CAHPS scores for 2011 from the Medicaid, Medicare, and Adult Commercial Health Plan. Available at: https://www.cahpsdatabase.ahrq.gov/CAHPSIDB/Public/about.aspx Accessed September 8, 2015. [Google Scholar]
- 44.AHRQ. Instructions for analyzing data from CAHPS surveys. 2015. Available at: https://cahps.ahrq.gov/surveys-guidance/survey4.0-docs/2015_instructions_for_analyzing_data.pdf Accessed September 8, 2015. [Google Scholar]
- 45.US Department of Health and Human Services. Medicare scores are based on the Medicare version of the CAHPS Health Plan Survey 4.0; Medicaid scores are based on the Adult Medicaid Survey 4.0; Adult Commercial scores are based on the Adult Commercial Survey 4.0. Available at: https://cahps.ahrq.gov/surveys-guidance/hp/about/index.html Accessed September 8, 2015. [Google Scholar]
- 46.Castle N. Family satisfaction with nursing facility care. Int J Qual Health Care 2004; 16:483–489. [DOI] [PubMed] [Google Scholar]
- 47.Gasquet I, Dehé S, Gaudebout P, et al. Regular visitors are not good substitutes for assessment of elderly patient satisfaction with nursing home care and services. J Gerontol A Biol Sci Med Sci 2003; 58:M1036–M1041. [DOI] [PubMed] [Google Scholar]
- 48.Haywood C, Jr, Diener-West M, Strouse J, et al. Perceived discrimination in health care is associated with a greater burden of pain in sickle cell disease. J Pain Symptom Manage 2014; 48:934–943. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Freiermuth CE, Haywood C, Jr, Silva S, et al. Attitudes toward patients with sickle cell disease in a multicenter sample of emergency department providers. Adv Emerg Nurs J 2014; 36:335–347. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Khanna D, Maranian P, Rothrock N, et al. Feasibility and construct validity of PROMIS and “legacy” instruments in an academic scleroderma clinic. Value Health 2012; 15:128–134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Research V. How to estimate the length of a survey. 2009–2016. Available at: http://www.verstaresearch.com/newsletters/how-to-estimate-the-length-of-a-survey.html Accessed June 8, 2016. [Google Scholar]
- 52.Perronne V, Roberts-Harewood M, Bachir D, et al. Patterns of mortality in sickle cell disease in adults in France and England. Hematol J 2002; 3:56–60. [DOI] [PubMed] [Google Scholar]
- 53.Darbari DS, Wang Z, Kwak M, et al. Severe painful vaso-occlusive crises and mortality in a contemporary adult sickle cell anemia cohort study. PLoS One 2013; 8:e79923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Tanabe P, Hafner JW, Martinovich Z, et al. Adult emergency department patients with sickle cell pain crisis: results from a quality improvement learning collaborative model to improve analgesic management. Acad Emerg Med 2012; 19:430–438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Wilkie DJ, Johnson B, Mack AK, et al. Sickle cell disease: an opportunity for palliative care across the life span. Nurs Clin North Am 2010; 45:375–397. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Carroll CP, Haywood C, Fagan P, et al. The course and correlates of high hospital utilization in sickle cell disease: evidence from a large, urban Medicaid managed care organization. Am J Hematol 2009; 84:666–670. [DOI] [PMC free article] [PubMed] [Google Scholar]