Abstract
Background
Little is known about disease specific knowledge in patients with chronic kidney disease (CKD). We developed and examined the results of a survey to characterize kidney disease knowledge.
Design
Survey about kidney disease knowledge, with questions developed by experts. Setting and Participants: 401 adult patients with CKD (Stages 1–5) attending a nephrology clinic from April to October 2009.
Outcomes & Measurements
We calculated survey reliability using the Kuder-Richardson-20 coefficient, and established construct validity by testing a priori hypotheses of associations between the survey and patient characteristics. We descriptively analyzed survey responses and applied linear regression analyses to evaluate associations with patient characteristics. Health literacy was measured using the Rapid Estimate of Adult Literacy in Medicine.
Results
Participants median age was 58 (25th-75th percentile, 46–68) years, 83% were White, 18% had limited literacy, and 77% had CKD Stages 3–5. The 28 question knowledge survey had good reliability (KR-20=0.72), and mean (SD) knowledge score was 66% (15%). In support of construct validity of our knowledge survey, bivariate analysis shows that scores are associated with age (β, −0.01 per ten years; 95% CI, −0.02–−0.005; p=0.003), formal education (β, 0.09; 95% CI, 0.03–0.15; p=0.004), health literacy (β, 0.06; 95% CI, 0.03–0.10; p=0.001), kidney education class participation (β, 0.05; 95% CI, 0.01–0.09; p=0.009), knowing someone else with CKD (β, 0.05; 95% CI, 0.02–0.08; p=0.001), and awareness of one’s own CKD diagnosis (β, 0.07; 95% CI, 0.04–0.10; p<0.001). Findings were similar in adjusted analyses.
Limitations
Recruitment from one clinic limits generalizabilty of findings.
Conclusions
For patients with CKD, this kidney disease knowledge survey (KiKS) is reliable and valid, and identifies areas of and risk factors for poor kidney knowledge. Further study is needed to determine the impact of CKD knowledge on self-care behaviors and clinical outcomes.
Chronic kidney disease (CKD) affects millions of people within the United States and is estimated to increase in the future.1 CKD can lead to kidney failure requiring renal replacement therapy, and is associated with morbidity and mortality at all stages.2 The health and economic implications of this are enormous.3 Fortunately, therapies exist to reduce complications of disease,4–6 and may delay or even halt progression to advanced stages.7–8
However, nearly all therapies aimed at preventing kidney disease progression and reducing associated complications rely heavily on patient self care, including recommendations for adherence to medication regimens,9–11 avoidance of further nephrotoxic insults,12 and in advanced stages, maintenance of strict diet control.13 Research indicates more patient knowledge is associated with improved patient self management behaviors in patients receiving hemodialysis,14 improved glycemic control in patients with diabetes,15–16 and increased medication adherence in patients with HIV.17 Higher kidney disease specific knowledge is associated with lower rates of peritonitis in patients receiving peritoneal dialysis,18 and less use of catheters for vascular access in those receiving hemodialysis.19
Among the general population most people are unaware they have kidney disease,20 and perceived kidney disease knowledge is even low in patients with CKD under the care of a nephrologist.21 In a study of 676 patients with CKD Stages 3–5, 35% of patients reported knowing little or nothing about their own chronic kidney disease diagnosis, and nearly half reported they had no knowledge about treatment options if their kidneys failed.21 This is striking considering patients on average had been seeing a nephrologist for more than four years in this cohort.
In addition, descriptive research repeatedly reveals that patients want and need more disease specific knowledge to support self care behaviors,22–26 and that lack of effective provider communication is seen as a barrier to receiving and understanding this information.27 Although educational interventions have been shown to delay initiation of dialysis and reduce risk of death,28 it is notable that a recent review of randomized trials of educational interventions in kidney disease revealed no studies were performed in patients with early CKD.29 Conceptual models have been developed to describe the relationship between individual capacity, system/provider factors, and health outcomes, and patient knowledge is often noted as an important and necessary component of these relationships.30–31 Yet, little is known about actual knowledge in patients with all stages of CKD on topics relevant to optimizing and preserving kidney function. Assessment of patient disease-specific knowledge is clinically relevant in that it may reveal topics difficult for patients to understand, and aid in the development of educational interventions that specifically target areas of low knowledge. Questionnaires have been developed to measure some aspects of knowledge in patients with or at risk for CKD.14, 19, 32–36 However, not all have been validated in populations that include patients with CKD Stages I-V, nor do they focus on areas specific to optimizing self-care in early CKD to prevent disease progression.
The aim of this study was to develop a valid and reliable survey to measure kidney disease specific knowledge in patients with CKD not yet requiring renal replacement therapy, and use it to describe areas of and patient characteristics associated with low knowledge. We hypothesized disease specific knowledge in patients with established chronic kidney disease would be limited.
METHODS
Survey Validation Process
Survey development
We developed a survey to assess kidney disease knowledge in a step-wise fashion. A priori we developed survey questions to represent knowledge about topics important to kidney disease management. Approximately 100 questions were first generated to maximize content relevant to kidney knowledge. These content areas included the functions of the kidney, treatment options for kidney failure, signs and symptoms of disease progression, medications of potential benefit or harm to the kidney, blood pressure targets, and other topics important to preserving kidney function. We conducted a content review of kidney knowledge questionnaires,18–19, 21, 32–37 patient perspectives on disease specific information needs,14, 22–25, 38–42 and convened experts in various areas of kidney disease care, including nephrologists (3), nurses (3), dieticians (2), research personnel (6), and a kidney disease educator (1). In addition, we solicited methodological input from experts (3) in health literacy, scale validation, and psychometric analysis. Through an iterative process the items were reviewed for face and content validity, and redundancy, and ultimately reduced to 34 kidney knowledge questions. These were field tested in a small group of clinical and nonclinical personnel for clarity. Approximately the first 20 study participants were asked to comment on clarity and content, and there were no additional suggestions. The survey score was defined as the sum of the correct responses to each survey question divided by the total number of questions.
Survey psychometric analyses
We performed factor analysis to determine if there were underlying subscales within our survey and to assist in reducing the number of questions. Then the Kuder-Richardson-20 coefficient (KR-20) was used to determine internal consistency, a measure of internal reliability for surveys with dichotomous responses.43 All survey items except one had only one correct response. In the survey item with two correct responses (asking the participant to identify two potential treatments for kidney failure), the item was considered correct only if both treatments were checked. We eliminated any item that received ≥ 95% correct responses. These items with low difficulty would not contribute to discrimination between different levels of patient knowledge.43 Items with negative item-rest correlations, implying they were not associated in the same direction with other survey questions, nor the underlying construct of patient knowledge, were also removed.
There is no universal ‘gold standard’ for measuring patient kidney knowledge to compare correlations with our new survey. Therefore, we established evidence of construct validity by defining an a priori model of patient characteristics we hypothesized to be associated with kidney disease knowledge (Figure 1). Where able, we were informed by associations observed in knowledge scales in other chronic diseases, for example HIV17 and diabetes.15, 44 If our knowledge scores were associated similarly with patient characteristics, this would support construct validity of our new instrument.43,45
Figure 1.
Model of hypothesized associations with knowledge about chronic kidney disease
Study Design
Study participants
In calculating an adequate sample size for survey validation, 5–10 participants are generally recommended for each question.43 We estimated 10 participants for 34 knowledge questions, giving us a sample size enrollment goal of 340 participants. The final sample size was inflated for a dropout rate of 10–15%, to account for potential study withdrawals.
Adult patients with CKD (Stages 1–5) were enrolled from April 2009 to October 2009. Eligible patients were at least 18 years of age, English-speaking, and had chronic kidney disease as defined by National Kidney Foundation’s Kidney Disease Outcomes Quality Initiative (KDOQI) guidelines.46 All had seen a nephrologist in the Vanderbilt Nephrology Clinic at least once prior to enrollment. Excluded were patients who had a kidney transplant or were currently receiving dialysis, as it was felt their disease specific knowledge may include topics outside the scope of general CKD knowledge. Patients with a pre-existing cognitive or vision impairment (prohibiting ability to see the materials) were also excluded. Subjects were offered monetary compensation for participation. The institutional review board from Vanderbilt University Medical Center approved the study and written consent was obtained from all participants.
The study population was composed of eligible patients enrolled during a visit to the nephrology clinic. Literacy was assessed using the Rapid Estimate of Adult Literacy in Medicine (REALM), a validated measure of pronunciation ability that correlates well with reading comprehension.47 The survey was written at a 6th grade reading level. If participants scored less than a sixth-grade reading level by the REALM, the knowledge survey was administered orally so that low reading comprehension would not be a barrier to its completion.
We abstracted from the medical record patient age, visit information (e.g. disease diagnosis, number of visits in the past year), and laboratory values. Additional variables collected included self-reported race, income, highest level of educational attainment, and attendance in a kidney education session. Two additional questions targeted awareness of chronic kidney disease diagnosis; we asked patients if they had a “kidney problem” and also asked, “Do you have chronic kidney disease?”
Statistical Analysis
Descriptive statistics were calculated as median (25th–75th percentile) for continuous variables or frequency and percentage for categorical variables. Stage of chronic kidney disease was determined using laboratory serum creatinine and urinary protein measurements abstracted from the medical record. The 4-variable MDRD Study equation was applied to calculate estimated glomerular filtration rate (eGFR),48 and patients were assigned CKD stage according to KDOQI guidelines.46 To examine differences in participant baseline characteristics, we used the Kruskal-Wallis test and Pearson’s chi-square or Fisher’s exact tests in continuous or categorical variables by CKD stage, as appropriate. Bivariate associations with overall knowledge scores were calculated using simple linear regression for the patient characteristics as defined in our a priori model and additional exploratory analyses were performed for age, sex, and race. We report beta coefficients for both unadjusted and adjusted analyses. The adjusted model used ordinary least squares regression and retained variables with significant associations in bivariate analyses, and diagnostic testing was performed to evaluate model assumptions.
For all statistical analyses, findings with a p value ≤ 0.05 are considered statistically significant. We performed all statistical analyses using STATA version 10.0 (Stata Corporation, www.stata.com).
RESULTS
Participant characteristics
Four hundred and six consecutive consenting patients were recruited from a nephrology speciality clinic (67% response rate). The most common reason for not participating was insufficient time. We do not have information on non-participants. The survey took an average of 25 minutes to complete. Five of the participants withdrew due to illness (2), did not want to finish (1), and time (2), leaving 401 participants.
Overall, participants were a median of 58 (25th-75th percentile, 46–68) years old, 53% were male, and 83% were White (Table 1). Most had an education level of high school graduate or more (94%), yet 18% had limited health literacy (< 9th grade reading level). Forty-eight percent reported a household income greater than $55,000 per year. Seventy-seven percent had CKD Stages 3–5 and 58% had seen a nephrologist at least three times in the past year. Seventeen percent of participants reported attending a kidney education session. Although 94% of participants were aware they had a “kidney problem,” when asked “Do you have chronic kidney disease?” only 69% responded “yes.”
Table 1.
Participant Characteristics, Stratified by CKD Stage
| Participant Characteristic | All Participants n=401 | CKD Stage | p-value | ||
|---|---|---|---|---|---|
| 1–2 (n=92) | 3 (n=195) | 4–5 (n=114) | |||
| Age (years) | 58 (46, 68) | 40 (30,55) | 62 (52, 69) | 62 (54, 71) | <0.001 |
| Male | 213 (53) | 46 (50) | 105 (54) | 62 (54) | 0.8 |
| Race | 0.009 | ||||
| White | 333 (83) | 69 (75) | 173 (89) | 91 (80) | |
| Nonwhite | 68 (17) | 23 (25) | 22 (11) | 23 (20) | |
| Formal Educational Attainment ≥ High School Graduate | 375 (94) | 89 (97) | 182 (93) | 104 (91) | 0.3 |
| Health Literacy Level ≥ 9th grade reading level | 330 (82) | 82 (89) | 157 (81) | 91 (80) | 0.1 |
| Annual Household Income | 0.2 | ||||
| ≤$25,000 | 71 (19) | 16 (18) | 27 (15) | 28 (26) | |
| $25,001-$55,000 | 128 (34) | 28 (31) | 68 (37) | 32 (30) | |
| > $55,000 | 181 (48) | 46 (51) | 88 (48) | 47 (44) | |
| Self-reported kidney education class | 67 (17) | 0 (0) | 19 (10) | 48 (42) | <0.001 |
| ≥ 3 kidney provider visits in past year | 232 (58) | 41 (45) | 103 (53) | 88 (77) | <0.001 |
| Know someone with CKD | 198 (50) | 41 (45) | 94 (49) | 63 (56) | 0.3 |
| Aware of ‘Kidney Problem’ | 375 (94) | 83 (90) | 181 (93) | 111 (97) | 0.08 |
| Aware of CKD Diagnosis | 278 (69) | 50 (54) | 130 (67) | 98 (86) | <0.001 |
| Self Reported Diabetes (n=380) | 145 (38) | 18 (21) | 76 (42) | 51 (46) | 0.001 |
| Self Reported High BP (n=394) | 338 (86) | 71 (78) | 162 (85) | 105 (93) | 0.01 |
Values are given as median (25th, 75th percentile) or n (%)
Abbreviations: BP, blood pressure; CKD, chronic kidney disease
Participant characteristics, stratified into three categories by CKD Stage, are presented in Table 1. More advanced kidney disease was significantly associated with older age, diabetes, hypertension, more frequent visits with a nephrologist, participation in kidney education class, and awareness of kidney disease.
Knowledge Survey Results
Factor analysis revealed no clear subscales in the knowledge survey. Table 2 presents the initial 34 knowledge item topics, the proportion of correct responses, the item-rest correlations and factor loading onto the first factor. Although there seemed to be similar loadings for items onto one factor related to kidney functions and symptoms (factor loadings ≥ 0.4), these loadings were modest, and overall the factor analysis revealed no clear knowledge subscales. There were 5 items that ≥ 95% of participants answered correctly and these were removed. One remaining item had negative correlations with the rest and was also removed. The 28 question kidney knowledge survey (KiKS; Item S1, available as online supplementary material) was analyzed for internal consistency, and the Kuder-Richardson-20 reliability coefficient was 0.72. KiKS had a mean (SD) score of 0.66 (0.15), and a range of 0.11 – 0.96.
Table 2.
KiKS Individual Question Topics and Psychometric Testing Results,
| Topic | Item Difficulty (% Correct) | Item-rest Correlation | Factor Loading |
|---|---|---|---|
| General Knowledge | |||
| Reasons why protein in urine is a problem | 19 | 0.079 | 0.052 |
| Understanding increased risk of heart disease | 66 | 0.35 | 0.43 |
| Definition of ‘GFR’ | 68 | 0.23 | 0.089 |
| Medications a person with CKD should avoid | 72 | 0.20 | 0.17 |
| Treatment options for kidney failure | 74 | 0.25 | 0.17 |
| Understanding increased risk of mortality | 78 | 0.25 | 0.35 |
| Medications important to kidney health | 84 | 0.17 | 0.15 |
| Blood pressure goal | 91 | 0.051 | 0.06 |
| Knowing there are stages of CKD | 93 | 0.22 | 0.19 |
| Understanding CKD is a condition that does not go away | 95 | 0.13 | 0.082 |
| How kidney function is checked | 96 | −0.026 | −0.10 |
| Understanding high BP can hurt the kidneys | 97 | 0.13 | 0.12 |
| Understanding diabetes can hurt the kidneys | 98 | 0.11 | 0.11 |
| Number of kidneys a person normally has | 99 | 0.091 | 0.13 |
| Knowledge of kidney functions: | |||
| Role in glucose control | 40 | 0.0067 | −0.17 |
| Role in bone health | 49 | 0.26 | 0.43 |
| Role in BP control | 68 | 0.25 | 0.41 |
| Urine production | 68 | 0.13 | 0.22 |
| Role in anemia | 71 | 0.30 | 0.44 |
| Role in hair loss | 78 | 0.040 | −0.18 |
| Role in phosphorus control | 78 | 0.33 | 0.44 |
| Role in potassium control | 83 | 0.38 | 0.49 |
| Role in waste clearance (‘cleaning blood’) | 88 | 0.37 | 0.38 |
| Knowledge of symptoms of progression or failure: | |||
| No symptoms at all | 22 | 0.071 | 0.11 |
| Unusual itching | 41 | 0.37 | 0.49 |
| Confusion | 48 | 0.37 | 0.50 |
| Metallic/Bad taste | 53 | 0.34 | 0.42 |
| Shortness of breath | 57 | 0.29 | 0.46 |
| Difficulty sleeping | 59 | 0.37 | 0.50 |
| Blindness | 59 | −0.0061 | −0.21 |
| Nausea/vomiting | 62 | 0.42 | 0.46 |
| Weight loss | 63 | 0.34 | 0.43 |
| Hair loss | 69 | 0.018 | −0.19 |
| Increased fatigue | 93 | 0.32 | 0.34 |
Abbreviations: CKD, chronic kidney disease; BP, blood pressure; KiKS, kidney knowledge survey; GFR, glomerular filtration rate
Descriptively, we looked at each survey question to determine topic areas where patient knowledge may be low (Table 2). Topics where less than 50% of the cohort answered correctly included the relationship of proteinuria to poor kidney function (19%), role of the kidney in glucose control (40%), and knowledge about some of the symptoms of progressing kidney disease, specifically, a lack of understanding that there may not be any symptoms at all (22%).
Topics in which greater than 90% of the cohort answered correctly included knowledge of blood pressure goal (91%), understanding there are stages of CKD (93%), and recognizing fatigue as a sign of kidney disease (93%). In bivariate analyses, KiKS score was associated with age (β, −0.01 per ten years; 95% CI, −0.02 to −0.005; p=0.003), education (β, 0.09; 95% CI, 0.03–0.15; p=0.004), health literacy (β, 0.06; 95% CI, 0.03–0.10; p=0.001), kidney education class participation (β, 0.05; 95% CI, 0.01–0.09; p=0.009), knowing someone else with CKD (β, 0.05; 95% CI, 0.02–0.08; p=0.001), and awareness of their own CKD diagnosis (β, 0.07; 95% CI, 0.04–0.10; p<0.001) (Table 3). Knowledge scores were not associated with race or sex in this cohort. A subgroup analysis for participants with an eGFR of < 60 ml/min/1.73m2 (n=309), showed similar results.
Table 3.
Associations between Kidney Knowledge Score and Patient Characteristics
| Patient Characteristic | Unadjusted Model β Coefficient (95% CI) | p value | Adjusted Model± β Coefficient (95% CI) | p value |
|---|---|---|---|---|
| Age, per 10 years | −0.01 (−0.02to − 0.005) | 0.003 | −0.01 (−0.02to − 0.002) | 0.02 |
| Sex, male vs. female | −0.01 (−0.04 to 0.02) | 0.4 | ||
| Race, Nonwhite vs white | 0.02 (−0.02 to 0.06) | 0.4 | ||
| Annual household income | ||||
| $25,001–$55,000 vs ≤ $25,000 | −0.01 (−0.06 to 0.03) | 0.5 | ||
| > $55,000 vs ≤ $25,000 | 0.03 (−0.01 to 0.07) | 0.2 | ||
| Stage of CKD | ||||
| Stage 3 vs Stages 1–2 | −0.04 (−0.08 to − 0.004) | 0.03 | −0.03 (−0.07 to 0.02) | 0.2 |
| Stages 4–5 vs Stages 1–2 | 0.003 (−0.04 to 0.04) | 0.9 | −0.004 (−0.05 to 0.04) | 0.9 |
| Formal Education, HS Graduate vs Non HS Graduate | 0.09 (0.03 to 0.15) | 0.004 | 0.05 (−0.009 to 0.11) | 0.1 |
| Health Literacy Level, ≥ 9th grade vs < 9th grade | 0.06 (0.03 to 0.10) | 0.001 | 0.05 (0.01 to 0.09) | 0.04 |
| Kidney education class, attended vs not attended | 0.05 (0.01 to 0.09) | 0.009 | 0.04 (0.002 to 0.09) | 0.04 |
| Number of visits in past year, ≥ 3 visits vs ≤ 2 visits | 0.02 (−0.01 to 0.05) | 0.2 | ||
| Know someone with CKD, Yes vs No | 0.05 (0.02 to 0.08) | 0.001 | 0.04 (0.009 to 0.07) | 0.01 |
| Aware of ‘Chronic Kidney Disease” Diagnosis vs Not aware | 0.07 (0.04 to 0.10) | <0.001 | 0.05 (0.02 to 0.09) | 0.001 |
The adjusted linear regression analysis includes age, stage of ckd, formal education, health literacy level, kidney education class, knowing someone with CKD, and awareness of CKD diagnosis. The R^2 for the adjusted model is 0.13
Abbreviations: HS, high school; CKD, chronic kidney disease
The multivariable analysis included age, stage of CKD, education, health literacy level, participation in a kidney education class, knowing someone with CKD, and awareness of CKD diagnosis. Similar to the bivariate analyses, younger age (β, −0.01 per ten years; 95% CI, −0.02 to −0.002; p=0.02), higher health literacy (β, 0.05; 95% CI, 0.01–0.09; p=0.04), previous attendance in a kidney education class (β, 0.04; 95% CI, 0.002–0.09; p=0.04), knowing someone with CKD (β, 0.04; 95% CI, 0.009–0.07; p=0.01), and awareness of chronic kidney disease diagnosis (β, 0.05; 95% CI, 0.02–0.09; p=0.001) remained independently associated with higher KiKS score.
DISCUSSION
Through a systematic method of survey design, development, administration, and analysis, we have created an instrument that is valid and reliable in measuring disease-specific knowledge in patients with chronic kidney disease. The reliability calculated for our knowledge survey is similar to other knowledge scales in similar populations (hemodialysis)14, 19 and in patients with other chronic diseases.44 KiKS performed as expected with our a priori model, and showed similar bivariate associations as those found in knowledge scales in other diseases providing evidence supporting its validity.14–15, 44
We identified many topic areas important to patient self care that are not well understood by patients with kidney disease. We often counsel patients to avoid non-steroidal anti-inflammatory medications as use may promote kidney dysfunction,49–51 however 28% of patients did not identify this as the medication to avoid. Further, although reducing proteinuria is one of our mainstays of therapy, 81% of our patients did not fully understand that urinary protein is not only a marker of damage, but left uncontrolled may contribute to further disease progression.52 Studies suggest that patients want to know more about what can be done to protect existing kidney function, including information on appropriate use of medications, and guidance in understanding the meaning and interpretation of tests used to monitor potential disease progression.22, 39
In addition, we found there appears to be limited knowledge regarding basic information about the kidney. For example, patients did not seem to understand some of the kidney’s actions, as over a third of our participants did not know that the kidney makes urine. A lack of understanding regarding fundamentals of major organs, including anatomy, has been previously noted in patients with chronic disease.53 In addition, over 30% of our study population did not understand the term “GFR.” An estimate of GFR is one of the recommended methods for CKD testing and considered one of the best overall measures of kidney function.54 It is used by many healthcare centers,55–57 and is recommended for use by providers when explaining kidney test results with patients.58 Although patients59 and providers60 express the desire for additional resources to support patient education in kidney disease, lack of understanding common vocabulary may contribute to patient confusion and frustration.
Patient knowledge of symptoms was also limited, and only 22% of participants correctly responded that as CKD progresses there may not be any symptoms. It is possible that if participants selected any of the symptoms in our survey, they may have felt the response “no symptoms” was incorrect. However, this also highlights a potential gap in patient understanding: even without symptoms, CKD may be progressing to advanced stages of disease. People at risk for CKD believe knowledge about symptoms is one of the most important concepts for patients to understand.27 Further emphasis that symptoms may not manifest until disease is well advanced may provide additional information our patients need to motivate regular follow up and testing, rather than reliance on “how one feels” when seeking out kidney care.
KiKS scores were lower than we expected given that patients were established within the nephrology clinic, and most had moderate to severe CKD. Low knowledge and low health literacy were significantly associated, as with other chronic diseases,61–63 and addressing low literacy using clear communication principles may be beneficial.64
Awareness of chronic kidney disease diagnosis is low in the general population,20 and we found that even in a nephrology specialty clinic, patients understanding they have “chronic kidney disease” cannot be assumed. When asked “Do you have chronic kidney disease?”, over one third of participants answered “no”, suggesting a lack of understanding of how to interpret their own kidney testing evaluation, or the information discussed by their provider. It is also possible that providers may choose not to disclose some information to patients, or that patients are in denial regarding their diagnosis. This may be related to low perceived susceptibility to kidney disease,65 uncertainty or fear of treatments, or mistrust in information from their provider. In one qualitative study exploring self-management experiences of people with CKD (Stages 1–3), participants admitted they knew they had a “kidney problem” but did not know “how big (of) a problem,” and in some cases did not “really even want to know.” 25 Patients discussed a struggle with uncertainty about the permanence of kidney disease, and recommended avoidance of the term “chronic,” using instead terms like ‘life-long” and “forever.”25 Other patients, however, felt uninformed about the fact that their condition was “chronic,” and considered this inappropriate “withholding” of information on the part of the provider.25 These perspectives highlight complexity providers face in assessing and determining a patient’s readiness to accept and process information about their diagnosis. Although many mechanisms underlying poor awareness of CKD remain unknown, improving awareness of kidney disease is a newly identified priority of Healthy People 2020.66
There are several limitations to this study. First, this is a cross sectional study, and thus causality cannot be inferred. Second, this population was a convenience sample enrolled from a single nephrology clinic, and resources limited our ability to approach all potentially eligible patients. Thus, our results are not generalizable to the entire CKD population. Thirdly, KiKS score was not consistently associated with stage of CKD, nor the number of visits to the provider in the past year. We suspect that duration of seeing a kidney specialist may be an important factor in these potential associations, but were not able to capture a measure of duration in this sample. Patients more comfortable with their level of knowledge and educational background in general, may have been more willing to take our knowledge survey, however we do not have measures in our nonparticipants for comparison.
We have yet to fully determine the clinical significance of observed differences in KiKS scores and the potential impact on outcomes in kidney disease. However, when educational interventions are provided to patients near renal replacement, we see benefit of increases in time to dialysis initiation, partly attributed to increased patient knowledge,67 and even modest differences observed with a dialysis knowledge survey (3% difference) were associated with an important clinical outcome.19
Still there are important implications of our research. Our survey measured knowledge in participants with a CKD diagnosis that was recognized, established, and treated under the care of a nephrologist. Yet, studies indicate that the majority of patients with early stages of CKD are seen by primary care providers,68 where adherence to optimal CKD treatment guidelines,69 as well as recognition of CKD diagnosis,70–71 are lower than those seen by kidney specialists. Thus, patient disease specific knowledge, and potential subsequent cues to optimal self-care behaviors, may also be lower in these settings.
In addition, although not all patient characteristics associated with low knowledge are modifiable, they still may serve as a guide to providers to identify those patients who may have low knowledge. Providing targeted and tailored education is modifiable, and we did find higher scores in those who reported seeing a CKD educator. Recent changes in reimbursement policy by the Centers for Medicare and Medicaid Services (CMS), supports kidney education in advanced CKD,72 and also calls for tools to ensure comprehension of education provided. Tools such as our knowledge survey may have use as an initial starting point for such assessments, or be used to monitor response to an existing educational program.
In summary, we have developed a survey to measure patient knowledge about many topics integral to self-care practices and prevention of CKD progression. Reliability and validity have been supported and are similar to other knowledge scales. With better understanding of the particular areas of low patient knowledge, we see that even within an optimal setting of kidney disease specific care, communicating disease related concepts with patients is complex. Further research is needed to validate the survey in other populations with CKD and assess how knowledge and outcomes are modified through targeted interventions.
Supplementary Material
Acknowledgments
This work was supported in part by T32 DK007569 and a Clinical Scientist in Nephrology Fellowship Grant from The American Kidney Fund (to Dr Wright). Additional support was provided by the National Institute of Diabetes and Digestive and Kidney Diseases by awards K23DK080952 and K23DK080952-02S1 (Dr Cavanaugh), K24DK77875 and P60DK020593 (Dr Elasy), and K24DK062849 (Dr Ikizler). The funding agencies did not have a role in the design, conduct, or reporting of the study.
Footnotes
Financial Disclosure: The authors declare that they have no relevant financial interests.
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- 1.U.S. Renal Data System. USRDS 2009 Annual Data Report: Atlas of Chronic Kidney Disease and End Stage Renal Disease in the United States. National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases; Behesda MD: 2009. [Google Scholar]
- 2.Go AS, Chertow GM, Fan D, McCulloch CE, Hsu CY. Chronic kidney disease and the risks of death, cardiovascular events, and hospitalization. N Engl J Med. 2004 Sep 23;351(13):1296–1305. doi: 10.1056/NEJMoa041031. [DOI] [PubMed] [Google Scholar]
- 3.Levey AS, Schoolwerth AC, Burrows NR, Williams DE, Stith KR, McClellan W. Comprehensive public health strategies for preventing the development, progression, and complications of CKD: Report of an expert panel convened by the Centers for Disease Control and Prevention. Am J Kid Dis. 2009;53(3):522–535. doi: 10.1053/j.ajkd.2008.11.019. [DOI] [PubMed] [Google Scholar]
- 4.Bucher HC, Griffith LE, Guyatt GH. Systematic review on the risk and benefit of different cholesterol-lowering interventions. Arterioscler Thromb Vasc Biol. 1999 Feb;19(2):187–195. doi: 10.1161/01.atv.19.2.187. [DOI] [PubMed] [Google Scholar]
- 5.Prevention of stroke by antihypertensive drug treatment in older persons with isolated systolic hypertension. Final results of the Systolic Hypertension in the Elderly Program (SHEP) SHEP Cooperative Research Group. JAMA. 1991 Jun 26;265(24):3255–3264. [PubMed] [Google Scholar]
- 6.Sever PS, Dahlof B, Poulter NR, et al. Prevention of coronary and stroke events with atorvastatin in hypertensive patients who have average or lower-than-average cholesterol concentrations, in the Anglo-Scandinavian Cardiac Outcomes Trial--Lipid Lowering Arm (ASCOT-LLA): a multicentre randomised controlled trial. Lancet. 2003 Apr 5;361(9364):1149–1158. doi: 10.1016/S0140-6736(03)12948-0. [DOI] [PubMed] [Google Scholar]
- 7.Lewis EJ, Hunsicker LG, Bain RP, Rohde RD. The effect of angiotensin-converting-enzyme inhibition on diabetic nephropathy. The Collaborative Study Group. N Engl J Med. 1993 Nov 11;329(20):1456–1462. doi: 10.1056/NEJM199311113292004. [DOI] [PubMed] [Google Scholar]
- 8.Lewis EJ, Hunsicker LG, Clarke WR, et al. Renoprotective effect of the angiotensin-receptor antagonist irbesartan in patients with nephropathy due to type 2 diabetes. N Engl J Med. 2001 Sep 20;345(12):851–860. doi: 10.1056/NEJMoa011303. [DOI] [PubMed] [Google Scholar]
- 9.National Kidney Foundation. K/DOQI clinical practice guidelines for management of dyslipidemias in patients with kidney disease. Am J Kidney Dis. 2003 Apr;41(4 Suppl 3):I–IV. S1–91. [PubMed] [Google Scholar]
- 10.National Kidney Foundation. K/DOQI clinical practice guidelines on hypertension and antihypertensive agents in chronic kidney disease. Am J Kidney Dis. 2004 May;43(5 Suppl 1):S1–290. [PubMed] [Google Scholar]
- 11.National Kidney Foundation. K/DOQI clinical practice guidelines for cardiovascular disease in dialysis patients. Am J Kidney Dis. 2005 Apr;45(4 Suppl 3):S1–153. [PubMed] [Google Scholar]
- 12.Harkonen S, Kjellstrand C. Contrast nephropathy. Am J Nephrol. 1981;1(2):69–77. doi: 10.1159/000166493. [DOI] [PubMed] [Google Scholar]
- 13.National Kidney Foundation. K/DOQI Clinical practice guidelines for nutrition in chronic renal failure. Am J Kidney Dis. 2000 Jun;35(6 Suppl 2):S1–140. doi: 10.1053/ajkd.2000.v35.aajkd03517. [DOI] [PubMed] [Google Scholar]
- 14.Curtin RB, Sitter DC, Schatell D, Chewning BA. Self-management, knowledge, and functioning and well-being of patients on hemodialysis. Nephrol Nurs J. 2004 Jul-Aug;31(4):378–386. 396. quiz 387. [PubMed] [Google Scholar]
- 15.Huizinga MM, Elasy TA, Wallston KA, et al. Development and validation of the Diabetes Numeracy Test (DNT) BMC Health Serv Res. 2008;8:96. doi: 10.1186/1472-6963-8-96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Fitzgerald JT, Funnell MM, Hess GE, et al. The reliability and validity of a brief diabetes knowledge test. Diabetes Care. 1998 May;21(5):706–710. doi: 10.2337/diacare.21.5.706. [DOI] [PubMed] [Google Scholar]
- 17.Osborn CY, Davis TC, Bailey SC, Wolf MS. Health literacy in the context of HIV treatment: introducing the Brief Estimate of Health Knowledge and Action (BEHKA)-HIV version. AIDS Behav. 2010 Feb;14(1):181–188. doi: 10.1007/s10461-008-9484-z. [DOI] [PubMed] [Google Scholar]
- 18.Kazancioglu R, Ozturk S, Ekiz S, Yucel L, Dogan S. Can using a questionnaire for assessment of home visits to peritoneal dialysis patients make a difference to the treatment outcome? J Ren Care. 2008 Jun;34(2):59–63. doi: 10.1111/j.1755-6686.2008.00023.x. [DOI] [PubMed] [Google Scholar]
- 19.Cavanaugh KL, Wingard RL, Hakim RM, Elasy TA, Ikizler TA. Patient dialysis knowledge is associated with permanent arteriovenous access use in chronic hemodialysis. Clin J Am Soc Nephrol. 2009 May;4(5):950–956. doi: 10.2215/CJN.04580908. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Coresh J, Byrd-Holt D, Astor BC, et al. Chronic kidney disease awareness, prevalence, and trends among U.S. adults, 1999 to 2000. J Am Soc Nephrol. 2005 Jan;16(1):180–188. doi: 10.1681/ASN.2004070539. [DOI] [PubMed] [Google Scholar]
- 21.Finkelstein FO, Story K, Firanek C, et al. Perceived knowledge among patients cared for by nephrologists about chronic kidney disease and end-stage renal disease therapies. Kidney Int. 2008 Nov;74(9):1178–1184. doi: 10.1038/ki.2008.376. [DOI] [PubMed] [Google Scholar]
- 22.Schatell D, Ellstrom-Calder A, Alt PS, Garland JS. Survey of CKD patients reveals significant gaps in knowledge about kidney disease. Part 2. Nephrol News Issues. 2003 May;17(6):17–19. [PubMed] [Google Scholar]
- 23.Schatell D, Ellstrom-Calder A, Alt PS, Garland JS. Survey of CKD patients reveals significant GAPS in knowledge about kidney disease. Part 1. Nephrol News Issues. 2003 Apr;17(5):23–26. [PubMed] [Google Scholar]
- 24.Rantanen M, Kallio T, Johansson K, Salantera S, Virtanen H, Leino-Kilpi H. Knowledge Expectations of Patients on Dialysis Treatment. Continuing Nursing Education. 2008 May-June;35(3):249–255. [PubMed] [Google Scholar]
- 25.Costantini L, Beanlands H, McCay E, Cattran D, Hladunewich M, Francis D. The self-management experience of people with mild to moderate chronic kidney disease. Continuing Nursing Education. 2008 March-April;35(2):147–155. [PubMed] [Google Scholar]
- 26.Lewis AL, Stabler KA, Welch JL. Perceived informational needs, problems, or concerns among patients with Stage 4 Chronic Kidney Disease. Nephrology Nursing Journal. 2010 March-April;37(2):143–148. [PubMed] [Google Scholar]
- 27.Jennette CE, Vupputuri S, Hogan SL, Shoham DA, Falk RJ, Harward DH. Community perspectives on kidney disease and health promotion from at-risk populations in rural North Carolina, USA. Rural Remote Health. 2010 Apr-Jun;10(2):1388. [PubMed] [Google Scholar]
- 28.Devins GM, Mendelssohn DC, Barre PE, Taub K, Binik YM. Predialysis psychoeducational intervention extends survival in CKD: a 20-year follow-up. Am J Kidney Dis. 2005 Dec;46(6):1088–1098. doi: 10.1053/j.ajkd.2005.08.017. [DOI] [PubMed] [Google Scholar]
- 29.Mason J, Khunti K, Stone M, Farooqi A, Carr S. Educational interventions in kidney disease care: a systematic review of randomized trials. Am J Kidney Dis. 2008 Jun;51(6):933–951. doi: 10.1053/j.ajkd.2008.01.024. [DOI] [PubMed] [Google Scholar]
- 30.Baker DW. The meaning and the measure of health literacy. J Gen Intern Med. 2006 Aug;21(8):878–883. doi: 10.1111/j.1525-1497.2006.00540.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Devraj R, Gordon EJ. Health literacy and kidney disease: toward a new line of research. Am J Kidney Dis. 2009 May;53(5):884–889. doi: 10.1053/j.ajkd.2008.12.028. [DOI] [PubMed] [Google Scholar]
- 32.Devins GM, Binik YM, Mandin H, et al. The Kidney Disease Questionnaire: a test for measuring patient knowledge about end-stage renal disease. J Clin Epidemiol. 1990;43(3):297–307. doi: 10.1016/0895-4356(90)90010-m. [DOI] [PubMed] [Google Scholar]
- 33.Waterman AD, Browne T, Waterman BM, Gladstone EH, Hostetter T. Attitudes and behaviors of African Americans regarding early detection of kidney disease. Am J Kidney Dis. 2008 Apr;51(4):554–562. doi: 10.1053/j.ajkd.2007.12.020. [DOI] [PubMed] [Google Scholar]
- 34.Schatell D, Wise M, Klicko K, Becker BN. In-center hemodialysis patients’ use of the internet in the United States: a national survey. Am J Kidney Dis. 2006 Aug;48(2):285–291. doi: 10.1053/j.ajkd.2006.04.072. [DOI] [PubMed] [Google Scholar]
- 35.Gordon EJ, Wolf MS. Health literacy skills of kidney transplant recipients. Prog Transplant. 2009 Mar;19(1):25–34. doi: 10.1177/152692480901900104. [DOI] [PubMed] [Google Scholar]
- 36.Chambers JK, Boggs DL. Development of an instrument to measure knowledge about kidney function, kidney failure, and treatment options. ANNA J. 1993 Dec;20(6):637–642. 650. discussion 643. [PubMed] [Google Scholar]
- 37.Hejaili FF, Tamim H, Ghamdi GA, et al. Level of health awareness of Saudi patients on renal replacement therapy. Saudi Med J. 2007 May;28(5):747–751. [PubMed] [Google Scholar]
- 38.Ormandy P. Information topics important to chronic kidney disease patients: A systematic review. Journal of Renal Care. 2008;34(1):19–27. doi: 10.1111/j.1755-6686.2008.00006.x. [DOI] [PubMed] [Google Scholar]
- 39.Coupe D. Making decisions about dialysis options: an audit of patients’ views. EDTNA ERCA J. 1998 Jan-Mar;24(1):25–26. 31. [PubMed] [Google Scholar]
- 40.Curtin RB, Walters BA, Schatell D, Pennell P, Wise M, Klicko K. Self-efficacy and self-management behaviors in patients with chronic kidney disease. Adv Chronic Kidney Dis. 2008 Apr;15(2):191–205. doi: 10.1053/j.ackd.2008.01.006. [DOI] [PubMed] [Google Scholar]
- 41.Macnicol AM, Wright AF, Watson ML. Education and attitudes in families with adult polycystic kidney disease. Nephrol Dial Transplant. 1991;6(1):27–30. doi: 10.1093/ndt/6.1.27. [DOI] [PubMed] [Google Scholar]
- 42.Murray MA, Brunier G, Chung JO, et al. A systematic review of factors influencing decision-making in adults living with chronic kidney disease. Patient Educ Couns. 2009 Aug;76(2):149–158. doi: 10.1016/j.pec.2008.12.010. [DOI] [PubMed] [Google Scholar]
- 43.DeVellis RF. Scale Development: Theory and Applications. 2. Thousand Oaks, CA: Sage Publications, Inc; 2003. [Google Scholar]
- 44.Rothman RL, Malone R, Bryant B, et al. The Spoken Knowledge in Low Literacy in Diabetes scale: a diabetes knowledge scale for vulnerable patients. Diabetes Educ. 2005 Mar-Apr;31(2):215–224. doi: 10.1177/0145721705275002. [DOI] [PubMed] [Google Scholar]
- 45.Glanz K, Rimer BK, Viswanath K. Health Behavior and Health Education. 4. San Francisco, CA: John Wiley & Sons, Inc; 2008. Types of Validity; p. 492. [Google Scholar]
- 46.National Kidney Foundation. KDOQI Clinical Practice Guidelines and Clinical Practice Recommendations for Diabetes and Chronic Kidney Disease. Am J Kidney Dis. 2007 Feb;49(2 Suppl 2):S12–154. doi: 10.1053/j.ajkd.2006.12.005. [DOI] [PubMed] [Google Scholar]
- 47.Davis TC, Long SW, Jackson RH, et al. Rapid estimate of adult literacy in medicine: a shortened screening instrument. Fam Med. 1993 Jun;25(6):391–395. [PubMed] [Google Scholar]
- 48.Levey AS, Coresh J, Balk E, Kausz AT, Levin A, Steffes MW, Hogg RJ, Perrone RD, Lau J, Eknoyan G. National Kidney Foundation practice guidelines for chronic kidney disease: Evaluation, classification, and stratification. Ann Intern Med. 2003;139:137–147. doi: 10.7326/0003-4819-139-2-200307150-00013. [DOI] [PubMed] [Google Scholar]
- 49.Nanra RS, Stuart-Taylor J, de Leon AH, White KH. Analgesic nephropathy: etiology, clinical syndrome, and clinicopathologic correlations in Australia. Kidney Int. 1978 Jan;13(1):79–92. doi: 10.1038/ki.1978.11. [DOI] [PubMed] [Google Scholar]
- 50.Fored CM, Ejerblad E, Lindblad P, et al. Acetaminophen, aspirin, and chronic renal failure. N Engl J Med. 2001 Dec 20;345(25):1801–1808. doi: 10.1056/NEJMoa010323. [DOI] [PubMed] [Google Scholar]
- 51.Gooch K, Culleton BF, Manns BJ, et al. NSAID use and progression of chronic kidney disease. Am J Med. 2007 Mar;120(3):280, e281–287. doi: 10.1016/j.amjmed.2006.02.015. [DOI] [PubMed] [Google Scholar]
- 52.Burton C, Harris KP. The role of proteinuria in the progression of chronic renal failure. Am J Kidney Dis. 1996 Jun;27(6):765–775. doi: 10.1016/s0272-6386(96)90512-0. [DOI] [PubMed] [Google Scholar]
- 53.Weinman J, Yusuf G, Berks R, Rayner S, Petrie KJ. How accurate is patients’ anatomical knowledge: a cross-sectional, questionnaire study of six patient groups and a general public sample. BMC Fam Pract. 2009;10:43. doi: 10.1186/1471-2296-10-43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Vassalotti JA, Stevens LA, Levey AS. Testing for chronic kidney disease: a position statement from the National Kidney Foundation. Am J Kidney Dis. 2007 Aug;50(2):169–180. doi: 10.1053/j.ajkd.2007.06.013. [DOI] [PubMed] [Google Scholar]
- 55.Accetta NA, Gladstone EH, DiSogra C, Wright EC, Briggs M, Narva AS. Prevalence of estimated GFR reporting among US clinical laboratories. Am J Kidney Dis. 2008 Oct;52(4):778–787. doi: 10.1053/j.ajkd.2008.05.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.den Hartog JR, Reese PP, Cizman B, Feldman HI. The costs and benefits of automatic estimated glomerular filtration rate reporting. Clin J Am Soc Nephrol. 2009 Feb;4(2):419–427. doi: 10.2215/CJN.04080808. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Wyatt C, Konduri V, Eng J, Rohatgi R. Reporting of estimated GFR in the primary care clinic. Am J Kidney Dis. 2007 May;49(5):634–641. doi: 10.1053/j.ajkd.2007.02.258. [DOI] [PubMed] [Google Scholar]
- 58.National Kidney Disease Education Program. Resources Explaining Your Kidney Test Results, A Tear-Off Pad for Clinical Use. Jun, 2010. [Google Scholar]
- 59.Rubin HR, Jenckes M, Fink NE, et al. Patient’s view of dialysis care: development of a taxonomy and rating of importance of different aspects of care. CHOICE study. Choices for Healthy Outcomes in Caring for ESRD. Am J Kidney Dis. 1997 Dec;30(6):793–801. doi: 10.1016/s0272-6386(97)90084-6. [DOI] [PubMed] [Google Scholar]
- 60.Powe NR, Thamer M, Hwang W, et al. Cost-quality trade-offs in dialysis care: a national survey of dialysis facility administrators. Am J Kidney Dis. 2002 Jan;39(1):116–126. doi: 10.1053/ajkd.2002.29899. [DOI] [PubMed] [Google Scholar]
- 61.Cavanaugh K, Wallston KA, Gebretsadik T, et al. Addressing literacy and numeracy to improve diabetes care: two randomized controlled trials. Diabetes Care. 2009 Dec;32(12):2149–2155. doi: 10.2337/dc09-0563. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.DeWalt DA, Malone RM, Bryant ME, et al. A heart failure self-management program for patients of all literacy levels: a randomized, controlled trial [ISRCTN11535170] BMC Health Serv Res. 2006;6:30. doi: 10.1186/1472-6963-6-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Jacobson TA, Thomas DM, Morton FJ, Offutt G, Shevlin J, Ray S. Use of a low-literacy patient education tool to enhance pneumococcal vaccination rates. A randomized controlled trial. JAMA. 1999 Aug 18;282(7):646–650. doi: 10.1001/jama.282.7.646. [DOI] [PubMed] [Google Scholar]
- 64.Kripalani S, Weiss BD. Teaching about health literacy and clear communication. J Gen Intern Med. 2006 Aug;21(8):888–890. doi: 10.1111/j.1525-1497.2006.00543.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Boulware LE, Carson KA, Troll MU, Powe NR, Cooper LA. Perceived susceptibility to chronic kidney disease among high-risk patients seen in primary care practices. J Gen Intern Med. 2009 Oct;24(10):1123–1129. doi: 10.1007/s11606-009-1086-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Department of Health and Human Services. Healthy People 2020 Public Meetings. [Accessed 5/8/2010];2009 Draft Objectives. CKD HP2020--14. http://www.healthypeople.gov/HP2020/
- 67.Devins GM, Mendelssohn DC, Barre PE, Binik YM. Predialysis psychoeducational intervention and coping styles influence time to dialysis in chronic kidney disease. Am J Kidney Dis. 2003 Oct;42(4):693–703. doi: 10.1016/s0272-6386(03)00835-7. [DOI] [PubMed] [Google Scholar]
- 68.Nissenson AR, Collins AJ, Hurley J, Petersen H, Pereira BJ, Steinberg EP. Opportunities for improving the care of patients with chronic renal insufficiency: current practice patterns. J Am Soc Nephrol. 2001 Aug;12(8):1713–1720. doi: 10.1681/ASN.V1281713. [DOI] [PubMed] [Google Scholar]
- 69.Patwardhan MB, Samsa GP, Matchar DB, Haley WE. Advanced chronic kidney disease practice patterns among nephrologists and non-nephrologists: a database analysis. Clin J Am Soc Nephrol. 2007 Mar;2(2):277–283. doi: 10.2215/CJN.02600706. [DOI] [PubMed] [Google Scholar]
- 70.Boulware LE, Troll MU, Jaar BG, Myers DI, Powe NR. Identification and referral of patients with progressive CKD: a national study. Am J Kidney Dis. 2006 Aug;48(2):192–204. doi: 10.1053/j.ajkd.2006.04.073. [DOI] [PubMed] [Google Scholar]
- 71.Israni RK, Shea JA, Joffe MM, Feldman HI. Physician characteristics and knowledge of CKD management. Am J Kidney Dis. 2009 Aug;54(2):238–247. doi: 10.1053/j.ajkd.2009.01.258. [DOI] [PubMed] [Google Scholar]
- 72.Department of Health & Human Services (DHHS), Centers for Medicare & Medicaid (CMS) CMS Manual System, Pub 100-04 Medicare Claims Processing, Transmittal 1876. Dec 18, 2009. [January 25, 2010]. Accessed online at: http://www.cms.gov/transmittals/downloads/R1876CP.pdf. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

