Abstract
Background and objectives: Because there is wide variation in case-mix adjusted outcomes across dialysis facilities, it is possible that top-performing facilities use practices not shared by others. We sought to catalogue “best practices” that may account for interfacility variations in outcomes.
Design, setting, participants, & measurements: This multidisciplinary study identified candidate best practices in dialysis through a staged process, including systematic review, cognitive interviews, and a national “virtual focus group” of dialysis providers. The resulting candidate practices were rank-ordered by perceived importance as determined by mean RAND Appropriateness Scores from a national survey of nephrologists, nurses, and opinion leaders.
Results: A total of 155 candidate best practices were identified. Among these, respondents believed dialysis outcomes are most strongly related to 1) characteristics of multidisciplinary care conferences, 2) technician proficiency in protecting vascular access, 3) training of nurses to provide education in fluid management, vascular access, and nutrition, 4) use of random and blinded audits of staff performance, and 5) communication and teamwork among staff. In contrast, there was wide disagreement about the importance of facility-based health maintenance practices, optimal staffing ratios, frequency of dialysis-based physician visits, and optimal frequency of multidisciplinary care.
Conclusions: This study provides a “conceptual map” of candidate dialysis best practices and highlights areas of general agreement and disagreement. These findings can help the dialysis community think critically about what may define “best practice” and provide targets for future research in quality improvement.
In 2005, the U.S. Center for Medicare and Medicaid Services announced a pioneering initiative to provide reimbursement based on the quality of care provided to its beneficiaries. Although not yet fully enacted, this “pay-for-performance” (P4P) initiative (1) may redefine how U.S. providers, including nephrologists and dialysis facilities, are reimbursed for their services. In end-stage renal disease, P4P aims to track provider and facility achievement of key evidence-based clinical performance measures (CPMs), including optimization of dialysis dose, achievement of phosphate control, effective anemia management, correction of serum albumin levels, and use of fewer intravascular catheters (2–10).
Yet despite the dissemination of practice guidelines (11), considerable variation remains in achievement of CPM targets and overall mortality across facilities (12–16). Although outcome variation is a natural byproduct of variations in patient populations, data indicate that outcome variation persists even after case-mix adjustment (12,14,16). Because these variations exceed what would be expected by chance alone, there may be other unmeasured facility-level factors or practices affecting these outcomes. These factors may be procedural (e.g., implementation patterns of policies in a facility), attitudinal (e.g., staff morale), interpersonal (e.g., staff communication), belief-oriented (e.g., beliefs about the role of facility-based health maintenance), or structural (e.g., layout of facilities), among others. In short, there may be facility-level “best practices” that explain the variation in outcomes between facilities.
We initiated the Identifying Best Practices in Dialysis (IBPiD) study in preparation for P4P. IBPiD is a multidisciplinary research effort that aims to identify “best practices” that may improve facility-level achievement of CPMs and overall mortality in dialysis patients. IBPiD is organized into three phases (Figure 1). Phase I identifies and catalogues the array of candidate best practices proposed to drive facility-level outcomes in dialysis. This includes a systematic literature review and cognitive interviews of dialysis personnel. Phase II prioritizes these practices by quantifying perceptions of their relative importance. This paper provides the results of phase I and II. Phase III will subsequently test whether the candidate best practices predict CPM achievement and overall outcomes across a range of dialysis organizations.
Materials and Methods
Phase I: Identifying Candidate Best Practices
Systematic Literature Review.
As a first step toward cataloguing candidate best practices, we performed a systematic review of MEDLINE to identify studies that contain information linking patient-level, physician-level, and facility-level variables with dialysis outcomes. Systematic review is a necessary first step to develop a conceptual map of potential targets for “best practice” and is a technique used throughout other areas of medicine when developing candidate best practices (17–22). Appendix A provides the search strings for the review. Based on this review, we developed a taxonomy to categorize predictors of dialysis outcomes, with the aim of providing a qualitative framework to guide development of our subsequent cognitive interviews.
Appendix A.
Group | Search Terms | Significance of Grouping |
---|---|---|
1 | MEDLINE + EMBASE | Targeted bibliographic databases |
2 | (Chronic kidney failure [MeSH] OR Chronic Kidney Failures [MeSH] OR (Failure, Chronic Kidney [MeSH] OR Chronic Kidney Failure [MeSH] OR Chronic Kidney Failures [MeSH] OR Failure, Chronic Kidney [MeSH] OR Failures, Chronic Kidney [MeSH] OR Kidney Failures, Chronic [MeSH] OR Renal Failure, Chronic [MeSH] OR Chronic Renal Failure [MeSH] OR Chronic Renal Failures [MeSH] OR Failure, Chronic Renal [MeSH] OR Failures, Chronic Renal [MeSH] OR Renal Failures, Chronic [MeSH] OR End-Stage Kidney Disease [MeSH] OR Disease, End-Stage Kidney [MeSH] OR Diseases, End-Stage Kidney [MeSH] OR End Stage Kidney Disease [MeSH] OR End-Stage Kidney Diseases [MeSH] OR Kidney Disease, End-Stage [MeSH] OR Kidney Diseases, End-Stage [MeSH] OR ESRD [MeSH] OR Kidney Insufficiency, Chronic [MeSH] OR Chronic Kidney Insufficiencies [MeSH] OR Chronic Kidney Insufficiency [MeSH] OR Insufficiencies, Chronic Kidney [MeSH] OR Insufficiency, Chronic Kidney [MeSH] OR Kidney Insufficiencies, Chronic [MeSH] OR End-Stage Renal Disease [MeSH] OR Disease, End-Stage Renal [MeSH] OR Diseases, End-Stage Renal [MeSH] OR End Stage Renal Disease [MeSH] OR End-Stage Renal Diseases [MeSH] OR Renal Diseases, End-Stage [MeSH] OR Renal Disease, End-Stage [MeSH] OR Renal Disease, End Stage [MeSH] OR Renal Failure, End-Stage [MeSH] OR End-Stage Renal Failure [MeSH] OR End-Stage Renal Failures [MeSH] OR Failure, End-Stage Renal [MeSH] OR Failures, End-Stage Renal [MeSH] OR Renal Failure, End Stage [MeSH] OR Renal Failures, End-Stage [MeSH] OR Renal Insufficiency, Chronic [MeSH] OR Chronic Renal Insufficiencies [MeSH] OR Chronic Renal Insufficiency [MeSH] OR Insufficiencies, Chronic Renal [MeSH] OR Insufficiency, Chronic Renal [MeSH] OR Renal Insufficiencies, Chronic [MeSH] OR Failure, Kidney [MeSH] OR Failures, Kidney [MeSH] OR Kidney Failures [MeSH] OR Renal Insufficiency [MeSH] OR Insufficiencies, Renal [MeSH] OR Insufficiency, Renal [MeSH] OR Renal Insufficiencies [MeSH] OR Renal Failure [MeSH] OR Failure, Renal [MeSH] OR Failures, Renal [MeSH] OR Renal Failures [MeSH] OR Kidney Insufficiency [MeSH] OR Insufficiencies, Kidney [MeSH] OR Insufficiency, Kidney [MeSH] OR Kidney Insufficiencies OR Dialyses, Renal [MeSH] OR Renal Dialyses [MeSH] OR Dialysis, Renal [MeSH] OR Dialysis, Extracorporeal [MeSH] OR Dialyses, Extracorporeal [MeSH] OR Extracorporeal Dialyses [MeSH] OR Extracorporeal Dialysis [MeSH] OR Hemodialysis [MeSH] OR Hemodialyses OR Dialyses, Peritoneal [MeSH] OR Dialysis, Peritoneal [MeSH] OR Peritoneal Dialyses) | Targeted topic focus |
3 | (Mortality [tw] OR Survival [tw] OR Longevity [tw]) | Targeted content key words |
4 | (Letter [pt] OR editorial [pt] OR review [pt] OR news [pt]) | Excluded study types |
The four search groups were combined as follows: (1 AND 2 AND 3) NOT 4. The search specifically sought to identify studies containing information linking any patient-level, physician-level, facility-level, and surrogate/intermediate level variables with outcomes (particularly mortality) in dialysis patients. [tw = text word; pt = publication type; MeSH = Medical Subject Heading].
Dialysis Staff Cognitive Interviews.
Following the literature review, we expanded our conceptual framework by conducting detailed cognitive interviews with dialysis personnel, including technicians, nurses, dieticians, social workers, nephrologists, medical directors, and nurse managers, to elicit perceptions regarding best practices in dialysis care. Cognitive interviews are a technique to explore content in a structured yet flexible format (23,24). We conducted 9 one-on-one interviews in 2 university-based dialysis units, including 2 medical director/nephrologists, 2 nurse managers, 2 floor nurses, 1 dialysis physician assistant, 1 dialysis technician, and 1 dietician. The UCLA Institutional Review Board approved the protocols. Each interview began with an open-ended probe using the “think aloud” technique of cognitive interviewing (23,24). The interviewer then focused the respondent with “scripted probes” (24). The scripted probe technique allowed the interviewer to explore the basis of a response and to apply the a priori structure of the interview to the open-ended format.
National Online “Virtual Focus Group.”
We supplemented the interviews with a national online “virtual focus group” of a random sample of 250 nurse and nurse manager members of the American Nephrology Nurses' Association (ANNA), 250 community nephrologists from the AMA Masterfile, the 2000 clinical members of the Renal Physician Association, and 50 academic opinion leaders in dialysis care. The online “virtual focus group” asked respondents to “think of any processes of care that might distinguish ‘high performing’ dialysis facilities from ‘low performing’ dialysis facilities.”
Cataloguing Candidate Best Practices.
After abstracting the interviews and national online elicitations, we compiled an inventory of candidate best practices and created a series of questionnaires with Likert response scales to operationalize the practices. We designed these questionnaires to provide dialysis administrators with a standardized approach to measure staff perceptions about adherence with candidate best practices in their units.
Phase II: Quantifying Perceptions of Appropriateness and Importance of Candidate Best Practices
Overview of National Perceptions Survey.
After abstracting the cognitive interviews and national online elicitations, we compiled an inventory of candidate best practices. We then rank-ordered these practices in a national provider survey on the basis of: 1) perceived appropriateness, 2) perceived importance, and 3) presence and magnitude of variation in provider beliefs both within and between groups (25–27).
Sampling frame and Survey Distribution.
We surveyed dialysis opinion leaders and randomly selected community nephrologists and dialysis nurses from the RPA, AMA, and ANNA. The survey was mailed and administered on the Internet. Using baseline data from the RPA, ANNA, and AMA, we compared responders to nonresponders across key covariates.
Analyses.
Respondents rated the perceived importance of each candidate best practice using a standard 9-point RAND/UCLA Appropriateness Scale (RAS) with the following interpretation: 1 to 3 = “generally not appropriate”; 4 to 6 = “moderately appropriate”; 7 to 9 = “generally appropriate” (26).
We rank-ordered the perceived importance of the candidate best practices by mean RAS. In addition, we conducted analysis of variance to compare the mean RAS scores across groups for each practice. We defined “endorsement” of a candidate best practice with a score of 7 to 9 on the RAS, and we conducted χ2 tests to compare endorsement across the provider groups, a technique used in provider surveys in other areas of medicine (27). We then performed multivariate regression to determine if any provider or practice-type characteristics were associated with endorsement of individual practices. To quantify the level of agreement, we calculated the RAND/UCLA Disagreement Index (DI) for each candidate best practice (26). A DI >1.0 indicates “extreme variation” in beliefs; DI <1.0, including negative values, reflect increasing levels of agreement (26).
Results
Phase I: Identifying Candidate Best Practices
Figure 2 lists the complete inventory of candidate best practices resulting from phase I. These 155 candidate practices are categorized into to 8 “major domains,” including: 1) physician practices, 2) staff working climate, 3) facility characteristics and amenities, 4) facility-based health maintenance, 5) technician practices, 6) nursing practices, 7) general dialysis care practices, and 8) miscellaneous practices. These are subdivided into 23 “minor domains.” The candidate best practices have been structured into questionnaires for potential use with facility staff. The full questionnaires can be viewed under the “surveys” tab at www.ResearchCORE.org.
Phase II: Quantifying Perceptions of Appropriateness and Importance of Candidate Best Practices
Table 1 displays the characteristics of the survey respondents. There were 342 respondents, including 42% of opinion leaders (21 of 50), 24% of AMA nephrologists (60 of 250), 10% of RPA nephrologists (200 of 2000), and 38% of ANNA nurses (95 of 250). There were no statistically significant differences in mean age, gender, years in practice, proportion in management, or region of practice between responders and nonresponders.
Table 1.
Variable | Dialysis Opinion Leaders (n = 21) | Community MDs (n = 260) | Nurses (n = 95) | P |
---|---|---|---|---|
Age (yr) (mean ± SD) | 53 ± 9 | 50.4 ± 10 | 50.4 ± 7 | 0.81 |
Male gender (%) | 95 | 86 | 4 | <0.001 |
Primary practice in large dialysis organization (%) | 41 | 69 | 40 | <0.001 |
Years of experience in dialysis (mean ± SD) | 17 ± 11 | 14 ± 9 | 8 ± 7 | <0.001 |
Based primarily in university/academic practice setting (%) | 72 | 14 | 1 | <0.001 |
No. of dialysis patients seen/wk | 52.6 ± 26 | 65.9 ± 45 | 66.9 ± 60 | 0.11 |
Geographic location (%) | ||||
West | 20 | 22 | 21 | 0.91 |
Midwest | 40 | 18 | 20 | 0.07 |
South | 15 | 37 | 29 | 0.09 |
Northeast | 25 | 23 | 30 | 0.73 |
To help establish a prioritization among the 155 candidate best practices identified during phase I, the phase II survey asked respondents to measure perceived importance of each candidate best practice vis-a-vis its potential impact on improving overall facility outcomes. Table 2 lists the Top-30 candidate best practices perceived by respondents as being most impactful, as rank-ordered by mean RAND Appropriateness Scores.
Table 2.
Rank | Candidate “Best Practice” | Mean RAS | RAND DI |
---|---|---|---|
1 | Ensure that attending nephrologist is present for all multidisciplinary care conferences for their patients. | 8.46 | −0.34 |
2 | Monitor and audit to ensure that technicians follow aseptic technique with all cannulations. | 8.36 | −0.34 |
3 | Monitor and audit to ensure that nurses are highly proficient in conducting vascular access assessments. | 8.23 | −0.34 |
4 | Ensure that nurses prepare and administer all injectables before end of dialysis run. | 7.98 | −0.93 |
5 | Ensure that nurses are trained and highly proficient in performing accurate dry weight assessments. | 7.95 | −0.93 |
6 | Ensure that nurse is present for all multidisciplinary care conferences for their patients. | 7.91 | −0.93 |
7 | Ensure that social worker attends all multidisciplinary patient care conferences. | 7.79 | −0.93 |
8 | Ensure that dietician attends all multidisciplinary patient care conferences. | 7.71 | −0.93 |
9 | Ensure that nurses are trained and highly proficient in providing vascular access education. | 7.67 | −0.93 |
10 | Monitor and audit to ensure that technicians are highly proficient in assessing vascular access bruit and thrill. | 7.66 | −0.93 |
11 | Ensure that nurses are trained and highly proficient in providing fluid management education. | 7.60 | −0.93 |
12 | Create nursing teams so that less experienced nurses are paired with senior nurses. | 7.57 | −0.71 |
13 | Maintain low threshold to “fire” patients who are disruptive, combative, or threatening to patients and staff. | 7.40 | −0.93 |
14 | Maintain an intershift “communication log book” to communicate key information between nursing shifts. | 7.39 | −0.93 |
15 | Employ formal process of monitoring and tracking hemoglobin A1C levels in diabetic patients. | 7.24 | −0.93 |
16 | Require that nurses actively confirm that techs have entered accurate dialysis rescription before start of all runs. | 7.07 | −2.14 |
17 | Employ formal process of monitoring and tracking lipid panels in all patients. | 7.00 | −3.08 |
18 | Ensure that nurse manager attends all multidisciplinary patient care conferences. | 6.99 | −2.14 |
19 | Make an extra mid-shift nurse available to assist during busy periods (e.g., patients coming on or off machine). | 6.88 | −3.08 |
20 | Employ formal policy to perform random and blinded reviews of the technician performance. | 6.82 | −3.08 |
21 | Require nurses to pass a written competency test before being hired. | 6.60 | −9.09 |
22 | Employ formal policy to perform random and blinded reviews of the nurse performance. | 6.41 | 30.00 |
23 | Ensure that technicians are highly proficient in providing patients with vascular access education. | 6.28 | 30.00 |
24 | Employ a “team nursing” approach instead of one-on-one nursing. | 6.25 | 30.00 |
25 | Allow and encourage patient attendance at own multidisciplinary patient care conference. | 6.19 | 30.00 |
26 | Ensure that nurses are trained and proficient in providing patients with nutritional counseling. | 5.92 | 4.71 |
27 | Ensure that nurses are trained and proficient in providing diabetic patients with counseling. | 5.85 | 4.71 |
28 | Monitor and audit to ensure that technicians use a tourniquet with every cannulation attempt. | 5.76 | 2.35 |
29 | Match nurses' cultural and language backgrounds to individual patient cultural and language backgrounds. | 5.70 | 2.04 |
30 | Ensure that nurses are trained and proficient in conducting depression screening. | 5.44 | 1.88 |
The results are based on the phase II national survey of dialysis personnel and physicians, and the rank order is based on the mean RAND Appropriateness Score (RAS) rating for each candidate best practice. RAS scores >6.0 indicate the highest level of endorsement. The RAND Disagreement Index (DI) is a measure of variation in belief, in which a score <1.0 (including negative values) indicates general agreement, whereas a score >1.0 indicates “extreme variation.” The lower the DI, the higher the agreement between providers.
In addition to rank-ordering candidate practices, we also focused phase II on the candidate best practices that were characterized by disagreement and controversy in the cognitive interviews. Using this criterion, we identified 4 categories for evaluation: 1) facility-based health maintenance practices, 2) staffing ratios, 3) frequency of dialysis-based physician visits, and 4) frequency of multidisciplinary patient care conferences. Because of strong disagreement about “best practices” in these domains, the phase II national survey focused in these areas of contention to better quantify perceptions.
Perceptions Regarding Facility-based Health Maintenance Practices
There is debate about what role dialysis facilities should play in providing health maintenance services (e.g., immunizations, referral for age-appropriate cancer screening). Because disagreement was also evident in our phase I focus groups, we measured provider beliefs about the appropriateness of offering health maintenance services in dialysis facilities. Thirty-six percent of respondents reported that routine health maintenance is “generally appropriate.” This belief did not vary significantly between provider groups. However, within groups, opinion leaders were internally consistent in their perception (DI = −6.2), whereas nurses (DI = 1.7), medical directors (DI = 1.6), and nephrologists (DI = 3.1) exhibited “extreme variation” in their opinion of facility-based health maintenance services (i.e., DI >1).
Perceptions Regarding “Best Practice” Staffing Ratios
Because phase I revealed disagreements regarding best practice staffing ratios, we formally quantified opinions regarding staffing ratios in our phase II national survey. We elicited perceptions regarding patient-to-nurse ratios, patient-to-technician ratios, and patient-to-dietician ratios. For each pairing, we asked: “What do you think is the optimal ratio to provide quality care in a resource-limited environment?” Table 3 displays the results. Nurses were willing to maintain a higher patient-to-nurse ratio (9.5:1) than community nephrologists (8:1). Dialysis managers and opinion leaders were willing to maintain a higher patient-to-dietician ratio (70:1) than nurses (48:1) and community nephrologists (56:1). All providers agreed that the best practice patient-to-technician ratio should be between 3 and 4:1.
Table 3.
Ratio | Nurses | Community Nephrologists | Management Personnel (Medical Directors/Nurse Administrators) | Dialysis Opinion Leaders | P |
---|---|---|---|---|---|
Patient:nurse | 9.5 ± 4: 1 | 8.0 ± 4: 1 | 7.9 ± 3: 1 | 7.8 ± 3: 1 | Nurse vs. other: P < 0.001; other comparisons: not significant |
Patient:technician | 3.6 ± 1: 1 | 3.4 ± 1: 1 | 3.8 ± 1: 1 | 2.9 ± 1: 1 | All pairwise comparisons: P > 0.05 |
Patient:dietician | 48 ± 30: 1 | 56 ± 28: 1 | 70 ± 29: 1 | 70 ± 23: 1 | Nurse vs. other: P < 0.001; nephrologist vs. manager: P < 0.05; nephrologists vs. KOL: P < 0.05 |
Perceptions Regarding Dialysis-based Physician Visits
Because phase I revealed disagreement about the “best practice” frequency of dialysis-based nephrology visits, we posed the following question in the phase II survey: “Recognizing that physicians are busy, how frequently do you think physicians should routinely visit stable hemodialysis patients in the dialysis facility?” Forty-six percent believed nephrologists should visit their patients at least weekly, whereas 25% believed physicians should visit only monthly or less frequently. The remainder believed nephrologists should visit every other week (30%). Nurses were more likely to endorse frequent (i.e., ≥weekly) visits versus physicians (P = 0.04). Similarly, physicians with larger patient loads (>50 patients/wk) were more likely to endorse frequent visits versus less busy physicians (P = 0.001).
Perceptions Regarding “Best Practice” Multidisciplinary Conference (MDC) Practices
The essential elements for a successful MDC have not been well described, and participants in phase I revealed disagreement regarding “best practice” frequency of MDCs. To measure perceptions about best practice frequency, the phase II survey posed the following question: “Recognizing the concerns of very busy staff and scheduling conflicts, how frequently should multidisciplinary care rounds be held for an ‘average,’ stable hemodialysis patient?” Five percent believed MDCs should be held at least every other week, whereas 33% believed every 6 mo is appropriate. The remainder believed MDCs should be held monthly (35%), every other month (7%), or every third month (20%). Nurses were more likely to endorse frequent (i.e., <monthly) MDCs compared with physicians (P = 0.0004). Similarly, providers with patients in large facilities (>20 chairs) were more likely to endorse frequent MDCs versus providers in smaller facilities (P = 0.001).
Discussion
It is important to formally understand how dialysis facilities can improve their outcomes. Despite the dissemination of K/DOQI guidelines (11), data indicate that adjusted outcomes vary by up to 30% between U.S. dialysis facilities (12–16). It is possible that top-performing facilities enact specific practices that bottom-performing facilities do not enact. We sought to identify candidate “best practices” that may account for variation in outcomes between top and bottom performing centers.
In reviewing Figure 2, it becomes clear that dialysis personnel believe that facility-level outcomes are related to a wide range of factors. In particular, respondents believe that outcomes are related to a range of issues pertaining to interpersonal relationships within the dialysis facility (e.g., level of mutual respect, open communication, staff empowerment). Similarly, we found general consensus that structural characteristics of dialysis facilities may be important predictors of facility-level outcomes. Specifically, respondents perceived that even mundane factors such as the position of nurse workstations, location of patient weigh-in scales (to avoid “cheating”), and configuration of pods may partly dictate outcomes. Respondents also believed that facility-level outcomes may be related to a series of procedural best practices, including physician-level practices (e.g., rapidly returning pages), nurse-level practices (e.g., creating nursing teams that optimally match experience), staff enhancement practices (e.g., appointing a dedicated anemia manager), and dialysis scheduling practices (e.g., developing formal systems to correct short-staffing), among many others.
It is unlikely that all 155 candidate “best practices” in Figure 2 are equally important. To help determine which proposed best practice are most important for future research and targeting, we rank-ordered the perceived impact of the candidate practices based on rankings from a national survey nephrologists, dialysis nurses, and dialysis managers (Table 2). The results demonstrate several trends, including: 1) a successful MDC is critical to ensure optimal patient outcomes, and it is particularly important that the attending nephrologist attend all conferences for their own patients; 2) it is critical to audit technician proficiency in obtaining vascular access, with special attention paid to using aseptic technique, consistently using a tourniquet, and assessing the bruit and thrill of fistulae; 3) nurses must be trained and highly proficient in educating patients across a range of topics, including fluid management, vascular access care, and nutrition; 4) dialysis units should employ random and blinded reviews of nurse and technician performance; and 5) communication and teamwork among the nursing staff should be enhanced with various maneuvers, including maintaining an intershift “communication log book,” creating nursing teams so that less experienced nurses are paired with senior nurses, using a “team nursing” approach instead of one-on-one nursing, and matching nurses' cultural and language backgrounds to individual patient cultural and language backgrounds.
Although we found consensus regarding many candidate best practices, we also found wide disagreement about several aspects of dialysis care, including: 1) facility-based health maintenance practices, 2) staffing ratios, 3) frequency of dialysis-based physician visits, and 4) frequency of multidisciplinary patient care conferences.
There is debate about what role dialysis facilities should play in providing health maintenance services. Because patients are a “captive audience” in the dialysis facility, there may be opportunities to provide healthcare maintenance and preventive care (28–30). However, many providers believe these services are more appropriately delivered outside of the dialysis facility. We found that one-third of providers in our survey believed that routine health maintenance is appropriate, whereas the rest were either neutral or believed these services are inappropriate. This suggests that the dialysis community lacks clarity about the role of dialysis facilities in providing routine health maintenance services. The “extreme variation” in beliefs (as measured by a DI >1.0) indicates that future research should formally measure the relationship between facility health maintenance activities and overall facility outcomes.
Staffing of dialysis clinics has changed considerably over the past two decades. Changes include relying more heavily on technicians to provide care and increasing the panel size of patients cared for by dieticians and social workers. Although minimum staffing ratios exist, it remains unclear what defines a “best practice” ratio given the often resource-limited environment of dialysis care. We found wide variation in perceived best practice staffing ratios, particularly for patient-to-nurse and patient-to-dietician ratios. Future research should measure the effectiveness and cost-effectiveness of varying staff ratios on patient and facility outcomes.
We found significant disagreement about the best practice frequency of dialysis-based physician visits. Whereas one-half of respondents believed nephrologists should visit their dialysis patients at least weekly, the other half believed less frequent visitation is appropriate. Although the focus has been on quantity of visits, the quality of the visits may be even more relevant. The semiprivate environment and limited accessibility of vascular access arm may reduce the value of mandatory income-generating weekly visit, whereas less frequent but more in-depth visits outside the dialysis clinic (e.g., nephrologist's office) are reimbursed at a lower level. Further research should explore the effectiveness of varying physician visitation schedules/venues in stable dialysis patients before establishing a best practice frequency of dialysis-based visits.
Finally, we found striking variation in the perceived optimal frequency of MDCs for stable hemodialysis patients. Nurses appear to value frequent MDCs more than physicians, as do providers with patients in large facilities. MDCs are an essential component of end-stage renal disease patient care and are required for dialysis facility reimbursement by CMS. Although the enhanced coordination of care is a touted benefit of these conferences, it is unclear what aspects of an MDC influence outcomes. Future research should measure the effectiveness of varying MDC schedules in stable dialysis patients before developing any best practice criteria.
Although we used quantitative methods in this study, the candidate best practices were largely derived through a qualitative approach. Qualitative research has pros and cons. In this instance, the “pro” is that we have systematically surveyed a range of dialysis providers to identify candidate best practices based on their experience and knowledge of the field, an approach that has become standard for developing initial candidate best practices in other areas of medicine (17–22). Moreover, we have used quantitative methods to rank-order candidate practices as a form of prioritization. The “con” of this type of qualitative research is that, although the process identifies novel ideas about how best to improve outcomes, it does not prove that these ideas are necessarily valid. Although the next research step is to empirically measure the link between these candidate practices and outcomes, this could not occur in the absence of a conceptual map. The current study provides the map. The next step is to empirically determine what really matters and what is mere “noise” now that the conceptual map has been laid out.
In the meantime, the data from this study can help dialysis organizations think critically about what may define “best practices” and provide a roadmap, based on current provider perceptions, for how to improve overall outcomes of dialysis. Moreover, it provides data regarding specific areas of controversy, including facility-based health maintenance practices, staffing ratios, frequency of dialysis-based physician visits, and characteristics of MDCs. As part of quality improvement efforts to standardize care, future research should be targeted in these areas of variation.
Disclosures
None.
Acknowledgments
B.M.R.S. was supported by VA HSR&D Research Career Development Award RCD 03 to 179–2 and by the CURE Research Center (NIH 2P30 DK 041301–17). A.A.D. was supported by a training grant from the Agency for Healthcare Research and Quality. M.G. is an employee of Amgen, Inc. Support for this investigator-initiated study was provided by a research grant from Amgen, Inc.
Published online ahead of print. Publication date available at www.cjasn.org.
References
- 1.Centers for Medicare and Medicaid Services. Medicare pay for performance (P4P) initiatives. http://www.cms.hhs.gov/apps/media/press/release.asp?Counter=1343. Accessed July 2007
- 2.Port FK, Pisoni RL, Bragg-Gresham JL, Satayathum SS, Young EW, Wolfe RA, Held PJ: DOPPS estimates of patient life years attributable to modifiable hemodialysis practice patterns in the United States. Blood Purif 22: 175–180, 2004 [DOI] [PubMed] [Google Scholar]
- 3.Combe C, McCullough KP, Asano Y, Ginsberg N, Maroni BJ, Pifer TB: Kidney Disease Outcomes Quality Initiative (K/DOQI) and the Dialysis Outcomes and Practice Patterns Study (DOPPS): nutrition guidelines, indicators, and practices. Am J Kidney Dis 44[Suppl 3]: 39–46, 2004 [DOI] [PubMed] [Google Scholar]
- 4.Saran R, Dykstra DM, Pisoni RL, Akiba T, Akizawa T, Canaud B, Chen K, Piera L, Saito A, Young EW: Timing of first cannulation and vascular access failure in haemodialysis: an analysis of practice patterns at dialysis facilities in the DOPPS. Nephrol Dial Transplant 19: 2334–2340, 2004 [DOI] [PubMed] [Google Scholar]
- 5.Young EW, Albert JM, Satayathum S, Goodkin DA, Pisoni RL, Akiba T, Akizawa T, Kurokawa K, Bommer J, Piera L, Port FK: Predictors and consequences of altered mineral metabolism: the Dialysis Outcomes and Practice Patterns Study. Kidney Int 67: 1179–1187, 2005 [DOI] [PubMed] [Google Scholar]
- 6.Pisoni RL, Bragg-Gresham JL, Young EW, Akizawa T, Asano Y, Locatelli F, Bommer J, Cruz JM, Kerr PG, Mendelssohn DC, Held PJ, Port FK: Anemia management and outcomes from 12 countries in the Dialysis Outcomes and Practice Patterns Study (DOPPS). Am J Kidney Dis 44: 94–111, 2004 [DOI] [PubMed] [Google Scholar]
- 7.Plantinga LC, Fink NE, Jaar BG, Sadler JH, Levin NW, Coresh J, Klag MJ, Powe NR: Attainment of clinical performance targets and improvement in clinical outcomes and resource use in hemodialysis care: a prospective cohort study. BMC Health Serv Res 7: 5, 2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Held PJ, Port FK, Wolfe RA, Stannard DC, Carroll CE, Daugirdas JT, Bloembergen WE, Greer JW, Hakim RM: The dose of dialysis and patient mortality. Kidney Int 50: 550–556, 1996 [DOI] [PubMed] [Google Scholar]
- 9.Xue JL, Dahl D, Ebben JP, Collins AJ: The association of initial hemodialysis access type with mortality outcomes in elderly Medicare ESRD patients. Am J Kidney Dis 42: 1013–1019, 2003 [DOI] [PubMed] [Google Scholar]
- 10.Woods JD, Turenne MN, Strawderman RL Young EW, Hirth RA, Port FK, Held PJ: Vascular access survival among incident hemodialysis patients in the United States. Am J Kidney Dis 30: 50–57, 1997 [DOI] [PubMed] [Google Scholar]
- 11.NKF-K/DOQI. Clinical Practice Guidelines for Hemodialysis Adequacy, New York, National Kidney Foundation, 2001 [DOI] [PubMed]
- 12.McClellan WM, Soucie JM, Flanders WD: Mortality in end-stage renal disease is associated with facility-to-facility differences in adequacy of hemodialysis. Am Soc Nephrol 9: 1940–1947, 1998 [DOI] [PubMed] [Google Scholar]
- 13.Fink JC, Zhan M, Blahut SA, Soucie M, McClellan WM: Measuring the efficacy of a quality improvement program in dialysis adequacy with changes in center effects. J Am Soc Nephrol 13: 2338–2344, 2002 [DOI] [PubMed] [Google Scholar]
- 14.Fink JC, Hsu VD, Zhan M, Walker LD, Mullins CD, Jones-Burton C, Langenberg P, Seliger SL: Center effects in anemia management of dialysis patients. J Am Soc Nephrol 18: 646–653, 2007 [DOI] [PubMed] [Google Scholar]
- 15.Sehgal AR, Silver MR, Covinsky KE, Coffin R, Cain JA: Use of standardized mortality ratios to examine variability in hemodialyis vascular access across facilities: Medical Review Board of the Renal Network, Inc. Am J Kidney Dis 35: 275–281, 2000 [DOI] [PubMed] [Google Scholar]
- 16.Goodkin DA: Does case mix explain the differences in dialysis mortality rates around the world? A report from the Dialysis Outcomes and Practice Patterns Study (DOPPS). iKidney Nephrology Incite 13, 2005
- 17.Wenger NS, Roth CP, Shekelle P, ACOVE Investigators: Introduction to the assessing care of vulnerable elders: 3 quality indicator measurement set. J Am Geriatr Soc 55[Suppl]: 247–252, 2007 [DOI] [PubMed] [Google Scholar]
- 18.McGory ML, Shekelle PG, Ko CY: Development of quality indicators for patients undergoing colorectal cancer surgery. J Natl Cancer Inst 98: 1623–1633, 2006 [DOI] [PubMed] [Google Scholar]
- 19.Lorenz KA, Lynn J, Dy S, Wilkinson A, Mularski RA, Shugarman LR, Hughes R, Asch SM, Rolon C, Rastegar A, Shekelle PG: Quality measures for symptoms and advance care planning in cancer: a systematic review. J Clin Oncol 24: 4933–4938, 2006 [DOI] [PubMed] [Google Scholar]
- 20.McGory ML, Shekelle PG, Rubenstein LZ, Fink A, Ko CY: Developing quality indicators for elderly patients undergoing abdominal operations. J Am Coll Surg 201: 870–883, 2005 [DOI] [PubMed] [Google Scholar]
- 21.Rhew DC, Goetz MB, Shekelle PG: Evaluating quality indicators for patients with community-acquired pneumonia. Jt Comm J Qual Improv 27: 575–590, 2001 [DOI] [PubMed] [Google Scholar]
- 22.Shekelle PG, MacLean CH, Morton SC, Wenger NS: Acove quality indicators. Ann Intern Med 135: 653–667, 2001 [DOI] [PubMed] [Google Scholar]
- 23.Ericsson A, Simon H: Protocol Analysis: Verbal Reports as Data, 2nd ed, Cambridge, MA, MIT Press, 1993
- 24.Willis G: Cognitive Interviewing and Questionnaire Design: A Training Manual [Working Paper 7], Washington, DC, National Center for Health Statistics, 1994
- 25.Brook RH, Lohr KN: Efficacy, effectiveness, variations, and quality boundary-crossing research. Med Care 23: 710–722, 1985 [DOI] [PubMed] [Google Scholar]
- 26.Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle J, Lazaro P, van het Loo M, McDonnell J, Vader JP, Kahan JP, eds. The RAND/UCLA Appropriateness Method User's Manual, Santa Monica, CA, RAND, 2001
- 27.Esrailian E, Spiegel BMR, Targownik L, Dulai GS, Gralnek IM: Differences in the management of Crohn's disease among experts and community providers, based on a national survey of sample case vignettes. Aliment Pharmacol Ther 26: 1005–1018, 2007 [DOI] [PubMed] [Google Scholar]
- 28.Anand S, Nissenson AR: Utilizing a disease management approach to improve ESRD patient outcomes. Semin Dial 15: 38–40, 2002 [DOI] [PubMed] [Google Scholar]
- 29.Sehgal AR, Leon JB, Siminoff LA, Singer ME, Bunosky LM, Cebul RD: Improving the quality of hemodialysis treatment: a community-based randomized controlled trial to overcome patient-specific barriers. JAMA 17: 1961–1967, 2002 [DOI] [PubMed] [Google Scholar]
- 30.McMurray SD, Johnson G, Davis S, McDougall K: Diabetes education and care management significantly improve patient outcomes in the dialysis unit. Am J Kidney Dis 40: 566–575, 2002 [DOI] [PubMed] [Google Scholar]