Abstract
Background
Extreme obesity affects nearly 8% of Canadians, and is debilitating, costly and ultimately lethal. Bariatric surgery is currently the most effective treatment available; is associated with reductions in morbidity/mortality, improvements in quality of life; and appears cost-effective. However, current demand for surgery in Canada outstrips capacity by at least 1000-fold, causing exponential increases in already protracted, multi-year wait-times. The objectives and hypotheses of this study were as follows: 1. To serially assess the clinical, economic and humanistic outcomes in patients wait-listed for bariatric care over a 2-year period. We hypothesize deterioration in these outcomes over time; 2. To determine the clinical effectiveness and changes in quality of life associated with modern bariatric procedures compared with medically treated and wait-listed controls over 2 years. We hypothesize that surgery will markedly reduce weight, decrease the need for unplanned medical care, and increase quality of life; 3. To conduct a 3-year (1 year retrospective and 2 year prospective) economic assessment of bariatric surgery compared to medical and wait-listed controls from the societal, public payor, and health-care payor perspectives. We hypothesize that lower indirect, out of pocket and productivity costs will offset increased direct health-care costs resulting in lower total costs for bariatric surgery.
Methods/design
Population-based prospective cohort study of 500 consecutive, consenting adults, including 150 surgically treated patients, 200 medically treated patients and 150 wait-listed patients. Subjects will be enrolled from the Edmonton Weight Wise Regional Obesity Program (Edmonton, Alberta, Canada), with prospective bi-annual follow-up for 2 years. Mixed methods data collection, linking primary data to provincial administrative databases will be employed. Major outcomes include generic, obesity-specific and preference-based quality of life assessment, patient satisfaction, patient utilities, anthropometric indices, cardiovascular risk factors, health care utilization and direct and indirect costs.
Discussion
The results will identify the spectrum of potential risks associated with protracted wait times for bariatric care and will quantify the economic, humanistic and clinical impact of surgery from the Canadian perspective. Such information is urgently needed by health-service providers and policy makers to better allocate use of finite resources. Furthermore, our findings should be widely-applicable to other publically-funded jurisdictions providing similar care to the extremely obese.
Trial Registration
Clinicaltrials.gov NCT00850356
Background
Obesity currently affects 24% of Canadians[1] and is a chronic medical condition that leads to substantial morbidity,[2] premature mortality,[3] impaired quality of life (QOL),[4] and increased health care costs [5]. Obesity is most commonly defined according to body mass index (BMI), with BMI levels of 30-34.9, 35-39.9 and over 40 kg/m2 corresponding to Class I, II and III obesity, respectively. Extreme obesity, defined herein as patients with moderate or severe obesity, is the fastest growing obesity subgroup affecting nearly 8% of Canadians [6]. Extreme obesity has increased in prevalence in Canada by 400% in two decades;[5] increases the risk of type 2 diabetes by up to 18-fold compared to normal-weight individuals;[2] shortens life expectancy by 8-13 years;[7] increases work-absenteeism;[8] and dramatically reduces QOL,[4] productivity,[9] and employability [10]. Health care expenditures in the 3% of the employed US population that are severely obese account for 21% of all health care costs associated with obesity [11].
Bariatric Surgery for Extreme Obesity
Lifestyle modification (diet, exercise ± behavioural therapy) and pharmacotherapy for obesity each reduce weight by approximately 3-5% but are limited by poor long-term effectiveness and sub-optimal adherence [12,13]. In comparison, bariatric surgery leads to substantial weight reduction and has emerged an effective means to reduce weight and improve comorbidity in patients with extreme obesity [14]. Surgery is currently indicated in medically refractory patients with BMI levels of ≥ 40 kg/m2 or BMI levels of ≥ 35 kg/m2 with a major obesity-related comorbidity (e.g., hypertension, diabetes, sleep apnea) [14].
Bariatric procedures either involve stomach restriction alone or combined restriction plus intestinal diversion. The types of procedures performed have evolved over the past several decades and certain procedures, such as banded gastroplasty, have been abandoned due to poor long-term weight loss results. In Canada and globally, the most common operations performed are adjustable gastric banding (42%), Roux-en-y gastric bypass (40%) and sleeve gastrectomy (5%). Ninety percent of bariatric procedures are performed via laparoscopic (minimally invasive) techniques [15]. In gastric banding, the proximal stomach is encircled with an adjustable band that is progressively inflated to create a small, restrictive gastric pouch which reduces meal portions. In the roux-en-y gastric bypass, a highly restrictive gastric pouch is created and coupled with diversion of the upper small intestine. The sleeve gastrectomy procedure is performed by fashioning the stomach into an elongated tube and resecting the majority of the greater curve of the stomach.
Outcomes Associated with Bariatric Surgery
Although no large scale, contemporary randomized controlled trials (RCTs) have examined the impact of surgery on cardiovascular morbidity or overall mortality, compelling data are available from high quality observational studies such as the Swedish Obesity Study (SOS), a matched cohort study of 2010 surgical and 2037 controls [16,17]. Compared to the poor long-term results of non-surgical therapy, surgery is the only therapy associated with substantial improvements in weight (averaging 33% after 2-3 years[18] and 16% after 10 years[16]); 15-year mortality rates (5.0% versus 6.3% in well-matched controls; HR 0.71; 95% CI 0.54 to 0.92);[19] 11-year incidence rates of first time cancers (HR 0.67; 95% CI 0.53-0.85);[17] and 7-year mortality rates from coronary artery disease (HR 0.41; 95% CI 0.21-0.78) and cancer (HR 0.40; 95% CI 25-0.65) [20]. In terms of other medical comorbidity, surgery increased remission rates for type 2 diabetes (73% versus 13%; p < 0.001; OR 5.5; 95% CI 2.2-14) in a 60-patient RCT;[21] and meta-analyses of primarily observational data has demonstrated that surgery is associated with resolution or improvement of type 2 diabetes, hypertension, dyslipidemia and sleep apnea in 70-86% of cases [18]. Additional studies demonstrate that surgery significantly (p < 0.05) improves psychosocial functioning,[22] quality of life,[23] and physical function [24].
In terms of Canadian data, a retrospective analysis of 1035 bariatric surgery patients from a single practice in Quebec reported 5-year excess weight losses of 61-75% following gastric bypass and banding [25]. In an earlier study, patients from this bariatric program (n = 1035) were also retrospectively compared with 5746 age and sex-matched controls identified using administrative data claims in Quebec (clinical variables such as height and weight were not available for controls) [26]. Mortality rates over 5 years were markedly lower in the bariatric surgery cohort compared to controls (0.68% versus 6.17%; RR 0.11, 95% CI 0.04-0.27) although the design of this study cannot rule out the very real likelihood that surgical selection bias (i.e., healthier and higher socioeconomic status patients with lower likelihood of surgical complications more likely to receive surgery) explains some if not most of these findings.
Risks of Surgery
The complications of surgery can be divided into peri-operative and long-term complications. The totality of data suggests that the benefits of surgery far outweigh these risks [18,27]. Perioperative death rates are 0.1-0.5% and immediate postoperative complications (e.g., clots, cardiorespiratory events and wound infections) occur in 10% of individuals. Diversionary procedures increase the long-term risk of nutrient deficiency (up to 50% of patients) while gastric bands can slip (6% of patients) or erode (10%) necessitating re-operation [27]. Some long-term consequences of surgery such as micronutrient deficiencies (e.g., vitamin D deficiency and metabolic bone disease) are incompletely understood and require further study.
Economic Evaluations of Bariatric Surgery
From the payor perspective and relative to the commonly cited thresholds of acceptability,[28,29] the long-term (20 years to lifetime) cost-effectiveness of surgery compared with non-surgical management appears attractive. Incremental cost-effectiveness ratios (ICERs) range from $5000 to $35 000 per quality-adjusted-life-year (QALY) [30]. The cost-effectiveness of surgery in patients with type 2 diabetes appears dominant (provides net health benefits and cost savings) compared to non-surgical interventions [31,32]. A recent Canadian economic evaluation performed by our group from the health care payor's perspective estimated that surgery is associated with ICERs of $8000-10 000/QALY over a lifetime horizon in Canada, with more favourable ICERs in subjects with greater obesity related comorbidity [30]. The only other additional published economic data from the Canadian perspective have been reported from a retrospective cohort study from Quebec. Surgery reduced health care utilization for a variety of disorders and was cost saving after 3.5 years compared to matched controls identified through administrative data claims [33].
However, there are limitations to the above studies. Economic studies based solely upon administrative data inputs do not include home and workforce productivity and patient borne costs. Furthermore, cost effectiveness analyses from the payor perspective do not examine such costs. Therefore, these additional data elements would provide a much more accurate picture of overall costs and benefits from a societal perspective.
Demand, Access and Wait Times For Bariatric Surgery
Demand for bariatric surgery has increased at an exponential rate. The number of procedures performed globally has increased from 5000 in 1987-9 to 350 000 (63% in US/Canada) in 2009 [15,34]. In Canada, the annual number of procedures performed in public health care facilities in the past decade has increased nearly 19-fold to ~1500 procedures per year [35,36].
Despite this dramatic rise in uptake, the number of individuals potentially eligible for surgery greatly exceeds current surgical capacity. Given that the number of Canadians potentially eligible for surgery is 5.8% or 1.5 million (assuming a 2009 adult population of nearly 26 million),[37] and that about 1500 procedures are performed annually in Canada,[36] only 0.1% of potentially eligible patients are accessing surgery in this country. Therefore, actual demand may be orders of magnitude greater than current provision of surgery [38].
In Canada and elsewhere, surgery is available in both publicly and privately funded programs. Private surgery costs approximately $17 000 in Canada and is unaffordable to many [39]. However, wait times for publicly funded bariatric procedures in this country average 5 years,[40] and are similarly protracted in other public health care systems [41]. This clearly indicates a substantial demand-supply gap. A 2005 Ontario Ministry of Health report estimated demand at 3500 surgeries per year in that province, a 7-fold higher number than the 500 surgeries currently performed annually [42]. This necessitated outsourcing of procedures to the US at substantial cost;[42] and resulting in petitions from advocacy groups demanding improved access [43]. In 2009, Ontario announced $75 million funding to increase procedure numbers from 244/year to nearly 1500/year [38].
Knowledge Gaps
In summary, the prevalence of extreme obesity has increased dramatically and bariatric surgery is the most effective treatment available. However, access to bariatric care in Canada is severely limited and wait times are lengthy. The ramifications of protracted wait times on health and health care costs have not previously been examined. In addition, data assessing the clinical and cost effectiveness of surgery in Canada are limited and further study is needed. Specifically, a comprehensive, population-based prospective assessment of the economic consequences from a health care payor, public payor (health care + other benefits such as unemployment insurance and other transfer payments), and societal (public payor, out-of-pocket costs, home and work productivity costs) perspective has not been performed to our knowledge in Canada or elsewhere.
Lastly, much of the prospective data evaluating bariatric procedures comes from the SOS study. However, vertical banded gastroplasty, which is now outdated, comprised nearly 70% of the procedures performed in SOS. More recent studies have evaluated gastric banding and gastric bypass and have reported similar results to SOS in terms of weight reduction and improvement in obesity-related comorbidities [44,45]. However, no prior studies comparing sleeve gastrectomy to medical management and APPLES results will help address this knowledge gap.
Objectives and Hypotheses
The APPLES study is a population-based, prospective controlled study enrolling at minimum of 500 patients and designed to assess the impact of extended wait-times for bariatric care and examine the clinical and cost-effectiveness of bariatric treatment in the Canadian context.
The three major objectives of APPLES are:
1. To assess the impact of extended wait times for bariatric care by examining the two-year change in clinical, economic and humanistic outcomes in wait-listed patients. We hypothesize that patients will report progressive deterioration in these outcomes over time.
2. To determine the clinical effectiveness and changes in health-related quality of life associated with modern bariatric procedures and compare these outcomes to medically treated controls and untreated wait-listed controls. We hypothesize that surgery will markedly reduce body weight, decrease the need for unplanned medical care, and increase quality of life compared to controls.
3. To compare the costs associated with bariatric surgery to costs associated with medical and wait-listed controls over three years, from societal, public payor, and health care payor perspectives. We hypothesize that lower indirect, out of pocket and productivity costs will offset increased direct health-care costs resulting in lower total costs for bariatric surgery.
Methods/design
Overall Study Design
In this prospective cohort study, consecutive and consenting patients enrolled in the Weight Wise Regional Obesity Program and without a contraindication to surgery will be enrolled. The minimum enrolment sample size will include 150 surgical patients, 200 patients receiving intensive medical therapy and 150 patients wait-listed to enter the clinic (Figure 1). The number of patients enrolled in the medical arm is larger because we anticipate an increased rate of censoring in this study arm, as some of these patients will ultimately undergo bariatric surgery within the two-year follow-up period.
Study Setting and Subject Recruitment
The Edmonton Weight Wise program is a comprehensive initiative established in 2005 designed to deliver integrated, patient-focused, evidence-based care to the Edmonton Zone of Alberta Health Services (AHS). This region is one of the largest integrated health delivery systems in Canada and includes a catchment population of approximately 1 million residents within greater Edmonton and an additional 600 000 residents in surrounding regions cared for by more than 1000 physicians, with an annual healthcare budget of almost two billion dollars [46].
Weight Wise includes a central, region-wide single-point-of-access referral system; community education and weight management sessions; and adult and pediatric bariatric specialty clinics. Adult specialty services are offered to patients with BMI levels of ≥ 35 kg/m2 referred from a medical practitioner. By extrapolating from contemporary Canadian obesity surveillance data (i.e. ~8% of Canadians are moderately [BMI 35.0-39.9 kg/m2] or severely [> 40 kg/m2] obese), we estimate that over 125 000 adult patients within our region's catchment area has a BMI ≥ 35 kg/m2 [6]. Community-dwelling patients referred for evaluation in the adult clinic are wait-listed at the time of referral (Figure 2). Currently, over 2000 adult patients are wait-listed for entry into the specialty clinic and their average wait may be up to several years in duration. Wait-listed patients are expected to attend community-based group education sessions prior to clinic entry. Otherwise, they receive no specific intervention.
Eligibility For Surgery
Within the adult specialty clinic, patients receive approximately 24-36 weeks of intensive lifestyle counselling (diet, exercise, behavioural modification), delivered by a multidisciplinary staff (internists, dieticians, nurses, physiotherapists, and psychologists) according to current recommendations [14]. Patients are seen approximately every 4-8 weeks. Patients interested in bariatric surgery are also evaluated for this procedure by the same multidisciplinary staff. Patients deemed to be appropriate candidates are subsequently evaluated by a bariatric surgeon. Patients with BMI levels ≥ 35-39.9 kg/m2 and a major medical comorbidity (e.g., hypertension, type 2 diabetes, sleep apnea) or BMI levels ≥ 40 kg/m2 are considered potential candidates for surgery. Absolute contraindications to surgery include pregnancy, uncontrolled psychiatric disease, active substance abuse or smoking (patients are required to quit prior to surgery), an active eating disorder (anorexia or bulimia), and high-risk for surgery medical status (e.g. severe coronary artery disease). Because of limited data documenting the benefits of surgery in patients younger than 18 years of age and evidence for possible harm in patients over 60,[47] procedures are not performed in these age groups. In order to access surgery, patients are also required to demonstrate commitment to attend scheduled appointments and adhere to lifestyle modification and behavioural therapy.
Inclusion Criteria
1. Male or female patients in the Weight Wise Regional Obesity Program
2. 18-60 years old
3. BMI levels ≥ 35 kg/m2 and a major medical comorbidity or BMI levels ≥ 40 kg/m2
4. Able to provide informed consent
Exclusion Criteria
1. Pregnant or nursing
2. Currently participating in an obesity-related clinical trial or in whom protein-sparing low calorie diet is planned.
3. Contraindication to bariatric surgery and/or weight loss
4. Unable or unwilling to complete questionnaires or expected to experience difficulty with attendance of visits or completion of study data
5. Any other medical, social or geographic condition which, in the opinion of the investigators, would not allow safe completion of the study protocol
Surgical Procedures Performed
Roux-en-Y gastric bypass, gastric banding and sleeve gastrectomy are all performed. Surgical techniques have been previously detailed [30,48,49]. Gastric banding is performed using the Swedish Adjustable Gastric Band (SAGB) Realize I/II(tm) (Johnson & Johnson/Ethicon Endosurgery, Cincinnati, Ohio) and sleeve gastrectomies are created over a 50 Fr bougie using staple line reinforcement throughout. Initially, gastric bypass was performed by hand sewing the gastrojejunostomy over a 34 Fr orogastric tube and positioning of the roux limb was retrocolic. Over the past two years, the technique has been modified and a 21 or 25 mm circular stapler is now used for the gastrojejunostomy pouch, with antecolic positioning of the roux limb. The roux limb is ~100 cm in length. The entero-enterostomy is created using varying techniques, including a combination of linear staplers and sutured closure.
Follow-up
Follow-up visits will be scheduled every 6 months for two years and will be performed in-person or by telephone if necessary. The final two year follow-up visit will be performed in-person.
Data Collection and Outcome Measures (Additional File 1 and Table 1)
Table 1.
Cost Category1 | Source Details | Units of Resources | Time Frame |
---|---|---|---|
1. Inpatient encounters | Administrative data | # of hospitalizations length-of-stay |
Provided by fiscal year Referenced to time zero |
2. Outpatient encounters | Administrative data | # encounters # procedures |
Provided by fiscal year Referenced to time zero |
3. Physician Fees | Administrative data | # encounters Provider specialty Service provided |
Provided by fiscal year Referenced to time zero |
4. Medications | Patient interview | Name Dosage, frequency & duration |
Bi-annual |
5. Weight Wise Clinic Visits | Administrative data and chart review | Personnel (nurses, dieticians, support staff) salaries Administrative and capital costs Supplies & equipment |
Provided by fiscal year Referenced to time zero |
6. Home Care & Long Term Care | Patient interview | Personnel (nurse, OT, PT, RT) salaries Disability aids (walker, bars, rails, etc.) Administrative and capital costs |
Bi-annual |
7. Transfer Payments | Patient interview | Unemployment insurance Disability benefits Assured Income for the Severely Handicapped (AISH) |
Bi-annual |
8. Employment status, absenteeism | Patient interview | Employment status in past year (# hours/week, # weeks) Absenteeism in past year (# days) Annual income (by quintile) |
Bi-annual |
9. Weight Loss Interventions | Patient interview | Weight loss program, meal replacements, physical trainer, exercise programs, alternative therapies, nutritional counselling, commercial program | Bi-annual |
10. Mobility and Medical | Patient interview | Mobility aids, home modification/renovations, rehabilitation, paid personal assistance (household activities and home productivity, driving) | Bi-annual |
11. Personal/Household Productivity | Patient interview as part of quality of life surveys | Capacity to perform household/domestic activities, personal care, and participate in leisure activities (Scalar) Paid/unpaid caregivers |
Bi-annual |
AHCIP = Alberta Health Care Insurance Plan. MACAR = Morbidity and Ambulatory Care Abstracting Record. DAD = Discharge Abstract Database. LOS = Length of stay. CIHI = Canadian Institute for Health Information. OT = occupational therapy. PT = physiotherapy. RT = respiratory therapy. SW = social worker.
1Health Care Payor perspective includes cost categories 1-6; Public Payor perspective includes cost categories 1-7 and Societal Payor perspective includes all costs.
After informed consent is obtained, baseline data collection for consenting patients will include the following: age, sex, race, marital status, employment status, household income quintile (≤ 20 K, 20-40 K, 40-60 K, 60-80 K, ≥80 K), general medical history and obesity-related comorbidities, smoking status (current, past, never), detailed current and past medications, weight, BMI, waist circumference, blood pressure, fasting lipids, fasting glucose, HbA1c, and liver enzymes.
Body weight will be measured using a validated, calibrated scale to the nearest 0.1 kilogram after the patient has emptied his/her bladder. Subjects will wear light indoor clothing with empty pockets and no shoes. Height will be measured using a wall-mounted stadiometre. A single reading taken using an automated blood pressure monitor and using an appropriately sized blood pressure cuff will be recorded with the subject seated in a chair and after five minutes of rest.
Repeat assessment of blood pressure, body weight, and cardiovascular risk factors (cholesterol profile, glycemic parameters) will be performed at 2 years.
Additional outcomes to be collected every 6 months will include:
1. Household income and employment status
2. Quality of life and utility measurement: Health related quality of life will be measured using validated, widely-used instruments. Generic and preference-based quality of life will be assessed using the Short Form-12 (SF-12[50]) and the EuroQol-5D (EQ-5D[51]) respectively. Obesity-specific quality of life will be assessed using the Impact of Weight on Quality of Life-Lite (IWQOL-Lite) [52].
3. Patient satisfaction: Satisfaction with medical care will be assessed using two questions, which will be rated on a 5-point Likert Scale:
a. The medical care I have been receiving is just about perfect
b. I am dissatisfied with some things about the medical care I received.
4. Impact of Extended Wait Times: The Waiting List Impact Questionnaire (WLIQ),[53] is a previously validated 47-item list of open-ended patient statements designed to assess the impact of extended wait-times in Canada for coronary bypass surgery and will be administered to wait-listed patients. This instrument has been modified for use in a bariatric population and items deemed not relevant to the bariatric setting were eliminated, resulting in a 40-item questionnaire. The instrument assesses general quality of life on a scale of 0-100 and also examines specific domains (physical stress, social support, frustration, employment status), which are serially evaluated by patients on a 5-point Likert scale. The degree of interest in bariatric surgery is specifically assessed.
5. Edmonton Obesity Staging Score (EOSS):[54] EOSS is a recently proposed, preliminary staging system for obesity which is based upon the presence or absence of obesity-related comorbities. EOSS will be evaluated as a triage and prognostic tool within the APPLES cohort.
6. Economic Data (Table 1): Economic data will be collected for the year prior to enrolment and in the two years following enrolment. Two major data sources will be used to collect economic data.
a. Administrative Data: Linkage to AHS and Alberta Health and Wellness (AHW) administrative data sources will be performed according to previously described methods [55,56]. Because all permanent residents of Alberta are eligible for insurance by AHW and over 99.9% participate in this coverage, these administrative data will comprehensively capture patient-specific health care resource utilization. Data elements include vital statistics (mortality) and the following health care resources and costs: inpatient and outpatient encounters, physician billings, medical procedures, and emergency room visits (Table 1).
b. Patient-Reported: Second, in order to comprehensively capture all economic consequences and enable a societal perspective, each patient enrolled in the study will provide additional information retrospectively for the year prior to enrolment and prospectively for two years after enrolment on a bi-annual basis. Resource use will be identified through investigator and clinical experience as well as examination of comprehensive costs lists, and published literature (Table 1) [57]. There is no previously validated data collection instrument to measure these costs in obesity; thus, we have developed a comprehensive instrument using commonly used techniques [58,59]. Societal costs include costs of weight loss interventions (meal replacement, weight loss programs, alternative therapy, medications), mobility and medical costs (mobility aids, home modifications, rehabilitation, home care, housekeeping), workforce productivity (employment, absenteeism), home productivity (domestic chores, leisure activity, use of paid or unpaid caregivers) and transfer payments (unemployment insurance), and will be valued in accordance with Canadian guidelines [60].
Statistical Analysis and Sample Size Considerations
Clinical, Humanistic and Economic Outcomes in Wait-listed Patients
This analysis specifically focuses on the wait-listed group and will examine two-year change scores in each relevant outcome using the appropriate statistical methodology. Analyses will be conducted in all wait-listed patients as well as those indicating a specific interest in surgery. Examples of clinical outcomes include anthropometric indices, blood pressure, lipid profile, glycemic control, diabetes prevalence. Examples of humanistic outcomes include QOL and patient satisfaction. Economic outcomes include total and categorical costs. For example, two-year change scores will be analysed for QOL domains (e.g. SF-12, IWQoL-Lite) using appropriately calibrated and constructed linear regression models and/or analysis of variance. Because these are self-reported data collected on a semi-annual basis, we will use a "last-value carried forward" approach to handle missing data as our primary analytic strategy.
Sample Size Considerations
The sample size of 150 subjects provides ample power to detect 2-year change scores and explore potential independent correlates of change. For example, for a 2-year change in SF-12 domains such as physical function, with baseline score of 31.6, SD 9,[61] a clinically important change in QOL of 5 points, two-sided alpha = 0.05, beta = 0.90, and a 30% attrition rate, 48 patients would be required. Similarly, to detect a 2-year change in IWQoL-Lite, with a baseline score of 28.7, SD 18.7,[61] a clinically important change in QOL of 10 points,[62] two-sided alpha = 0.05, beta = 0.90, and a 30% attrition rate, 51 patients would be required.
Comparing Clinical and Humanistic Outcomes in Patients Treated with Surgery to Medically Treated and Wait-listed Patients
Outcomes are similar to those listed above. Two-year mean changes in continuous variables will be compared between the surgical arm and medical or wait-listed controls using unpaired t-tests for continuous outcomes and chi-squared tests for dichotomous ones. Multivariable predictors of the 2-year change in a given outcome will be identified using appropriately constructed and calibrated covariate-adjusted linear regression models for continuous outcomes or logistic regression models for dichotomous ones. Patients who cross over to another study arm (e.g., medically treated patients who undergo surgery) will be censored at the point of cross over and a last-observation-carried-forward approach to missing data will be used for the primary analysis.
Sample Size Considerations
As an example, we calculated the sample size required to examine changes in body weight. Conservatively assuming a 2-year weight loss of 33% for surgical patients with a standard deviation of 17%,[18,27] a 25% 2-year difference in weight between surgical patients and intensively treated medical controls (an extremely conservative estimate, as this difference is generally several orders of magnitude),[18,27] a 2-sided α = 0.05, β = 0.9, and 30% attrition rate, we would require 13 patients.
Comparisons of Costs Over Three Years Between the Surgical Arm, Medically Treated Controls and Wait-listed Controls
First, descriptive statistics will be used to assess cumulative and incremental costs (by perspective and cost category) in each year using the arithmetic mean and 95% confidence interval for normally distributed variables and median with interquartile ranges for skewed variables. Within and between-group comparisons will be performed. Distributions of cost are often skewed and will be normalized, if necessary, by using log-transformations. Unadjusted analyses of costs will be performed using ANOVA; if cost cannot be normalized then nonparametric (e.g., Kruskal-Wallis) tests will be used. If log-transformation of costs is necessary, Duan's smearing estimator will be used to calculate appropriate error estimates after the data are re-transformed from the logarithmic scale [63].
Second, covariate controlled sequential multiple linear regression models will be constructed to determine the independent association of surgery (versus medical or wait-list controls) on each incremental cost outcome. Cumulative costs over time will be calculated using standardized methods,[64,65]and costs for average hypothetical patients will be calculated using the least squares means method, and adjusted for significant predictor variables for costs for medical and wait-listed controls.
Third, the net economic impact of increasing bariatric surgery rates from a societal, public payor, and health care payor perspective will be assessed using a mathematical model developed by our team. The costs determined above will be input, and the net economic impact of increasing rates of bariatric surgery from current rates (0.1% of eligible patients) to 0.5% (estimated current rates in US), 5% and 10% of all eligible patients will be calculated.
Sample Size Considerations
Using previous estimates,[66] we have adequate power to detect a difference of 20% or greater in costs between the surgical groups and the medical controls or the wait list controls, assuming an average 2-year total incremental cost of $12 183 in surgical patients, a standard deviation of $6000, two sided alpha = 0.05, and beta = 0.90.
Extended Follow-up
Using anonymised and de-identified study identification numbers, we will link our study sample with provincial administrative databases so as to facilitate extended follow-up of health care utilization, clinical events, and costs. We have undertaken several previous studies linking clinical registry and cohort data with these high quality databases, and have previously reported greater than 96% linkage success with follow-up extending 5 years and beyond [55,67].
Ethics Approval
APPLES has been approved by the Health Research Ethics Board of the University of Alberta.
Discussion
In summary, APPLES is a prospective observational study that aims to address current knowledge gaps by examining the impact of wait times for bariatric care in a surgery eligible population and by generating prospective, population-based Canadian bariatric clinical, economic and humanistic outcome data. Protracted, multi-year wait times are a major concern within Canada's publicly funded health care system [40]. Therefore, APPLES will help clinicians and decision makers determine whether or not current wait times are contributing to a deterioration in health outcomes and/or increases in costs. If such findings are demonstrated, further analyses may help to identify predictors of worsening outcomes and this may potentially inform how best to triage patients and optimally allocate scarce bariatric surgery resources. The paucity of data on appropriate triage of patients for surgery has been identified as a major gap in current knowledge and is suggested as a priority for future studies [68].
An additional advantage of the APPLES study design is that, because subjects are enrolled from a regional program, the study will examine outcomes and costs on a population-wide basis rather than from a more selected source such as a single clinic or group of clinics. Thus, we feel that the results should both inform health care delivery in the Canadian context as well as be generalizable to other single-payor systems with universal health care coverage. Notably, lengthy wait times for surgery are not isolated to Canada and are present in publicly funded health care systems across the world [41].
APPLES will also provide a comprehensive assessment of the costs related to bariatric care and will examine contemporary procedures, including sleeve gastrectomy. Data will be collected from both administrative and patient sources within a health care delivery model that includes universal access and comprehensive capture of hospital and outpatient encounters. These high quality costing data will include an assessment of costs commonly viewed as 'indirect' in nature. Although the time frame for data collection is limited to 2 years, these data will also be useful to inform economic models and will thus enable assessment of cost-effectiveness over a longer time frame. This will be particularly useful in more accurately assessing the overall cost-effectiveness of bariatric surgery in Canada. For example, a finding of unequivocal cost savings or neutrality from a public payor perspective would indicate that bariatric surgery is "dominant" (cost saving with health benefits) over medical management, and expansion should be a priority.
As of May 2010, 95% of baseline enrolment within APPLES has been completed. Recruitment of all 500 patients is expected by June 2010, with two-year follow-up extending to June 2012. Final results for the APPLES analysis are anticipated by late 2012 or early 2013.
Competing interests
DB has received honoraria for advisory boards, teaching and research from Ethicon Endo-Surgery Inc., a Johnson and Johnson company. All other authors had no competing interests to declare at the time of submission of this manuscript.
Authors' contributions
RP drafted the initial study concept and all authors contributed to the study design. RP wrote the initial draft of the protocol and all authors provided input into revisions and approved the final draft.
Pre-publication history
The pre-publication history for this paper can be accessed here:
Supplementary Material
Contributor Information
Raj S Padwal, Email: rpadwal@ualberta.ca.
Sumit R Majumdar, Email: me2.majumdar@ualberta.ca.
Scott Klarenbach, Email: swk@ualberta.ca.
Dan W Birch, Email: dbirch@ualberta.ca.
Shahzeer Karmali, Email: Shazeer.Karmali@albertahealthservices.ca.
Linda McCargar, Email: Linda.McCargar@afhe.ualberta.ca.
Konrad Fassbender, Email: konrad.fassbender@ualberta.ca.
Arya M Sharma, Email: amsharm@ualberta.ca.
Acknowledgements
APPLES is funded by the Canadian Institutes of Health Research grant number 86642. RP, SRM, SK and AM are supported by an alternative funding plan from the Government of Alberta and the University of Alberta. SRM and SK are supported by the Alberta Heritage Fund for Medical Research. AMS is supported by an Alberta Health Services Chair in Obesity Research and Management.
We wish to express our gratitude to the staff and patients of Weight Wise and, in particular our study coordinators Danielle Gabert and Lydia du Toit.
References
- Statistics Canada. Canadian Health Measures Survey. 2010. http://www.statcan.gc.ca/daily-quotidien/100113/dq100113a-eng.htm Accessed on June 4, 2010.
- Must A, Spadano J, Coakley EH, Field AE, Colditz G, Dietz WH. The disease burden associated with overweight and obesity. JAMA. 1999;282:1523–1529. doi: 10.1001/jama.282.16.1523. [DOI] [PubMed] [Google Scholar]
- Allison DB, Fontaine KR, Manson JE, Stevens J, VanItallie TB. Annual deaths attributable to obesity in the United States. JAMA. 1999;282:1530–1538. doi: 10.1001/jama.282.16.1530. [DOI] [PubMed] [Google Scholar]
- Jia H, Lubetkin EI. The impact of obesity on health-related quality-of-life in the general adult US population. J Pub Health. 2005;27:156–164. doi: 10.1093/pubmed/fdi025. [DOI] [PubMed] [Google Scholar]
- Katzmarzyk PT, Mason C. Prevalence of class I, II and III obesity in Canada. CMAJ. 2006;174:156–157. doi: 10.1503/cmaj.050806. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tjepkema M. Measured obesity. Adult obesity in Canada: measured height and weight. Nutrition: findings from the Canadian Community Health Survey 2004;issue I (cat no 82-620-MWE2005001) 2008. http://www.statcan.ca/english/research/82-620-MIE/2005001/articles/adults/aobesity.htm Accessed February 15, 2010.
- Peeters A, Barendregt JJ, Willekens F, Mackenbach JP, Al Mamun A, Bonneux L. Obesity in adulthood and its consequences for life expectancy: a life-table analysis. Ann Intern Med. 2003;138:24–32. doi: 10.7326/0003-4819-138-1-200301070-00008. [DOI] [PubMed] [Google Scholar]
- Tucker LA, Friedman GM. Obesity and absenteeism: an epidemiologic study of 10 825 employed adults. Am J Health Promot. 1998;12:202–207. doi: 10.4278/0890-1171-12.3.202. [DOI] [PubMed] [Google Scholar]
- Klarenbach S, Padwal R, Chuck A, Jacobs P. Population-based analysis of obesity and workforce participation. Obesity. 2006;14:920–927. doi: 10.1038/oby.2006.106. [DOI] [PubMed] [Google Scholar]
- Hensrud DD, Klein S. Extreme obesity: a new medical crisis in the United States. Mayo Clin Proc. 2006;81(10):S5–10. doi: 10.1016/s0025-6196(11)61175-0. [DOI] [PubMed] [Google Scholar]
- Finkelstein E, Fiebelkorn C, Wang G. The costs of obesity among full-time employees. Am J Health Promot. 2005;20:45–51. doi: 10.4278/0890-1171-20.1.45. [DOI] [PubMed] [Google Scholar]
- Padwal RS, Majumdar SR. Drug treatments for obesity: orlistat, sibutramine, and rimonabant. Lancet. 2007;369:71–77. doi: 10.1016/S0140-6736(07)60033-6. [DOI] [PubMed] [Google Scholar]
- Dansinger ML, Tatsioni A, Wong JB, Chung M, Balk EM. Meta-analysis: the effect of dietary counseling for weight loss. Ann Intern Med. 2007;147:41–50. doi: 10.7326/0003-4819-147-1-200707030-00007. [DOI] [PubMed] [Google Scholar]
- Lau DCW, Douketis JD, Morrison KM, Hramiak IM. 2006 Canadian clinical practice guidelines on the management and prevention of obesity in adults and children. CMAJ. 2007;176(8):1–117. doi: 10.1503/cmaj.061409. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buchwald H, Oien DM. Metabolic/Bariatric Surgery Worldwide 2008. Obes Surg. 2009;19:1605–1611. doi: 10.1007/s11695-009-0014-5. [DOI] [PubMed] [Google Scholar]
- Sjostrom L, Lindroos AK, Peltonen M, Torgerson J, Bouchard C, Carlsson B, Dahlgren S, Larsson B, Narbro K, Sjöström CD, Sullivan M, Wedel H. Lifestyle, diabetes, and cardiovascular risk factors 10 years after bariatric surgery. N Engl J Med. 2004;351:2683–2693. doi: 10.1056/NEJMoa035622. [DOI] [PubMed] [Google Scholar]
- Sjostrom L, Gummesson A, Sjostrom CD, Narbro K, Peltonen M, Wedel H, Bengtsson C, Bouchard C, Carlsson B, Dahlgren S, Jacobson P, Karason K, Karlsson J, Larsson B, Lindroos AK, Lonroth H, Naslund I, Olbers T, Stenlof K, Torgerson J, Carlsson LM. Effects of bariatric surgery on cancer incidence in obese patients in Sweden (Swedish Obese Subjects Study): a prospective, controlled intervention trial. Lancet Onc. 2009;10:653–662. doi: 10.1016/S1470-2045(09)70159-7. [DOI] [PubMed] [Google Scholar]
- Buchwald H, Avidor Y, Braunwald E, Jensen MD, Pories W, Fahrbach K, Schoelles K. Bariatric surgery: a systematic review and meta-analysis. JAMA. 2004;292:1724–1737. doi: 10.1001/jama.292.14.1724. [DOI] [PubMed] [Google Scholar]
- Sjostrom L, Narbro K, Sjostrom CD, Karason K, Larsson B, Wedel H, Lystig T, Sullivan M, Bouchard C, Carlsson B, Bengtsson C, Dahlgren S, Gummesson A, Jacobson P, Karlsson J, Lindroos AK, Lönroth H, Näslund I, Olbers T, Stenlöf K, Torgerson J, Agren G, Carlsson LM. Effects of bariatric surgery on mortality in Swedish obese subjects. N Engl J Med. 2007;357:741–752. doi: 10.1056/NEJMoa066254. [DOI] [PubMed] [Google Scholar]
- Adams TD, Gress RE, Smith SC, Halverson RC, Simper SC, Rosamond WD, Lamonte MJ, Stroup AM, Hunt SC. Long-term mortality after gastric bypass surgery. N Engl J Med. 2007;357:753–761. doi: 10.1056/NEJMoa066603. [DOI] [PubMed] [Google Scholar]
- Dixon JB, O'Brien PE, Playfair J, Chapman L, Schachter LM, Skinner S, Proietto J, Bailey M, Anderson M. Adjustable gastric banding and conventional therapy for type 2 diabetes: a randomized controlled trial. JAMA. 2008;299:316–323. doi: 10.1001/jama.299.3.316. [DOI] [PubMed] [Google Scholar]
- Herpetz S, Kielmann R, Wolf AM, Langkafel M, Senf W, Hebebrand J. Does obesity surgery improve psychosocial functioning? A systematic review. Int J Obes. 2003;27:1300–1314. doi: 10.1038/sj.ijo.0802410. [DOI] [PubMed] [Google Scholar]
- Karlsson J, Taft C, Rydén A, Sjöström L, Sullivan M. Ten-year trends in health-related quality of life after surgical and conventional treatment for severe obesity: the SOS intervention study. Int J Obes. 2007;31:1248–1261. doi: 10.1038/sj.ijo.0803573. [DOI] [PubMed] [Google Scholar]
- Dixon JB, Dixon ME, O'Brien PE. Quality of life after lap-band placement: influence of time, weight loss, and comorbidities. Obes Res. 2001;9:713–721. doi: 10.1038/oby.2001.96. [DOI] [PubMed] [Google Scholar]
- Christou N, Efthimiou E. Five-year outcomes of laparoscopic adjustable gastric banding and laparoscopic Roux-en-Y gastric bypass in a comprehensive bariatric surgery program in Canada. Can J Surg. 2009;52:E249–58. [PMC free article] [PubMed] [Google Scholar]
- Christou N, Sampalis JS, Liberman M, Look D. Surgery Decreases Long-term Mortality, Morbidity, and Health Care Use in Morbidly Obese Patients. Ann Surg. 2004;240:416–424. doi: 10.1097/01.sla.0000137343.63376.19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maggard MA, Shugarman LR, Suttorp M, Maglione M, Sugerman HJ, Sugarman HJ, Livingston EH, Nguyen NT, Li Z, Mojica WA, Hilton L, Rhodes S, Morton SC, Shekelle PG. Meta-analysis: surgical treatment of obesity. Ann Intern Med. 2005;142:547–559. doi: 10.7326/0003-4819-142-7-200504050-00013. [DOI] [PubMed] [Google Scholar]
- Laupacis A, Feeny D, Detsky AS, Tugwell PX. How attractive does a new technology have to be to warrant adoption and utilization? Tentative guidelines for using clinical and economic evaluations. CMAJ. 1992;146:473–481. [PMC free article] [PubMed] [Google Scholar]
- Rawlins MD, Culyer AJ. National Institute for Clinical Excellence and its value judgments. BMJ. 2004;329:224–227. doi: 10.1136/bmj.329.7459.224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klarenbach S, Padwal R, Wiebe N, Hazel M, Birch D, Manns B, Karmali S, Sharma A, Tonelli M. Bariatric surgery for severe obesity: a systematic review and economic evaluation. Canadian Agency for Drugs and Technologies in Health. 2010. http://www.cadth.ca/index.php/en/hta/reports-publications/search/publication/2667 Accessed on October 5, 2010.
- Ackroyd R, Mouiel J, Chevallier JM, Daoud F. Cost-effectiveness and budget impact of obesity surgery in patients with type-2 diabetes in three European countries. Obes Surg. 2006;16:1488–1503. doi: 10.1381/096089206778870067. [DOI] [PubMed] [Google Scholar]
- Keating CL, Dixon JB, Moodie ML, Peeters A, Bulfone L, Maglianno DJ, O'Brien PE. Cost-effectiveness of surgically induced weight loss for the management of type 2 diabetes: modeled lifetime analysis. Diabetes Care. 2009;32:567–574. doi: 10.2337/dc08-1749. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sampalis JS, Liberman M, Auger S, Christou NV. The impact of weight reduction surgery on health-care costs in morbidly obese patients. Obes Surg. 2004;14:939–947. doi: 10.1381/0960892041719662. [DOI] [PubMed] [Google Scholar]
- Samuel I, Mason EE, Renquist KE, Huang YH, Zimmerman MB, Jamal M. Bariatric surgery trends: an 18-year report from the International Bariatric Surgery Registry. Am J Surg. 2006;192:657–662. doi: 10.1016/j.amjsurg.2006.07.006. [DOI] [PubMed] [Google Scholar]
- Padwal RS, Lewanczuk RZ. Trends in bariatric surgery in Canada, 1993-2003. CMAJ. 2005;172:735. doi: 10.1503/cmaj.045286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arkinson J, Ji H, Fallah S, Pérez J. Bariatric Surgery in Canada. Healthc Q. 2010;13:14–17. doi: 10.12927/hcq.2013.21682. [DOI] [PubMed] [Google Scholar]
- Statistics Canada. Population estimates by sex and age group as of July 1, 2009, Canada. http://www.statcan.gc.ca/daily-quotidien/091127/t091127b2-eng.htm Accessed on February 5, 2010.
- Ministry of Health and Long-Term Care. Ontario Improves Access to Bariatric Surgery. http://www.health.gov.on.ca/english/media/news_releases/archives/nr_09/feb/nr_20090223.html Accessed on February 6, 2010.
- The Medical Advisory Secretariat. Ministry of Health and Long-term Care. Bariatric Surgery. Health Technology and Literature Review. 2005.
- Christou NV, Efthimiou E. Bariatric surgery waiting times in Canada. Can J Surg. 2009;52:229–234. [PMC free article] [PubMed] [Google Scholar]
- Padwal R, Sharma AM. Treating severe obesity: Morbid weights and morbid waits. CMAJ. 2009;181:777–778. doi: 10.1503/cmaj.081508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ontario Health Technology Advisory Committee. Bariatric Surgery: Health Technology Literature Review. 2005. http://www.health.gov.on.ca/english/providers/program/mas/tech/reviews/sum_baria_010105.html Accessed on October 5, 2010.
- Citizens of Ontario. Ontario government funding for bariatric surgery. http://www.petitiononline.com/ossg2002/petition.html Accessed on May 31, 2008.
- Adams TD, Pendleton RC, Strong MB, Kolotkin RL, Walker JM, Litwin ES, Berjaoui WK, Lamonte MJ, Cloward TV, Avelar E, Owan TE, Nuttall RT, Gress RE, Crosby RD, Hopkins PN, Brinton EA, Rosamond WD, Wiebke GA, Yanowitz FG, Farney RJ, Halverson RC, Simper SC, Smith SC, Hunt SC. Health outcomes of gastric bypass patients compared to nonsurgical, nonintervened severely obese. Obesity. 2010;18:121–130. doi: 10.1038/oby.2009.178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- O'Brien PE, Dixon J, Laurie C. Treatment of mild to moderate obesity with laparoscopic adjustable gastric banding or an intensive medical program: a randomized trial. Ann Intern Med. 2006;144:625–633. doi: 10.7326/0003-4819-144-9-200605020-00005. [DOI] [PubMed] [Google Scholar]
- Alberta Health Services. http://www.albertahealthservices.ca/about.asp About Us (online). 2010 Accessed on May 31, 2010.
- Flum DR, Dellinger EP. Impact of gastric bypass operation on survival: a population-based analysis. J Am Coll Surg. 2004;199:543–551. doi: 10.1016/j.jamcollsurg.2004.06.014. [DOI] [PubMed] [Google Scholar]
- Karmali S, Schauer P, Birch D, Sharma AM, Sherman V. Laparoscopic sleeve gastrectomy: an innovative new tool in the battle against the obesity epidemic in Canada. Can J Surg. 2010;53:126–132. [PMC free article] [PubMed] [Google Scholar]
- Karmali S, Shafer E. The battle against the obesity epidemic: is bariatric surgery the perfect weapon? Clin Invest Med. 2005;28:147–156. [PubMed] [Google Scholar]
- SF-36.org. The SF-12(r): An even shorter health survey. Accessed at http://www.sf-36.org/tools/sf12.shtml on May 26, 2010.
- EuroQol Group. EQ-5D: A standardised instrument for use as a measure of health outcome. http://www.euroqol.org Accessed at http://www.euroqol.org on May 28, 2010.
- Kolotkin RL, Crosby RD, Kosloski KD. et al. Development of a brief measure to assess quality of life in obesity. Obes Res. 2001;9:102–111. doi: 10.1038/oby.2001.13. [DOI] [PubMed] [Google Scholar]
- Teo KK, Spoor M, Pressey T, Williamson H, Calder P, Gelfand E, Koshal A. Impact of managed waiting for coronary artery bypass graft surgery on patients' perceived quality of life. Circulation. 1998;98:29II–33II. [PubMed] [Google Scholar]
- Sharma AM, Kushner R. A proposed clinical staging system for obesity. Int J Obes. 2009;33:289–295. doi: 10.1038/ijo.2009.2. [DOI] [PubMed] [Google Scholar]
- Jiang HX, Majumdar SR, Dick DA. Development and initial validation of a risk score for predicting in-hospital and 1-year mortality in patients with hip fractures. J Bone Miner Res. 2005;20:494–500. doi: 10.1359/JBMR.041133. [DOI] [PubMed] [Google Scholar]
- Hemmelgarn BR, Manns BJ, Zhang J, Tonelli M, Klarenbach S. et al. Association between multidisciplinary care and survival for elderly patients with chronic kidney disease. J Am Soc Nephrol. 2007;18:993–999. doi: 10.1681/ASN.2006080860. [DOI] [PubMed] [Google Scholar]
- Drummond MF. Methods for the economic evaluation of health care programmes. New York: Oxford University Press; 1997. [Google Scholar]
- Brouwer W, Rutten F, Koopmanschap M. In: Economic evaluation in health care: merging theory with practice. Drummond M, McGuire A, editor. Vol. 68. Oxford: Oxford University Press; 2001. Costing in economic evaluations. [Google Scholar]
- Jacobs P, Fassbender K. The measurement of indirect costs in the health economics evaluation literature. A review. Int J Technol Assess Health Care. 1998;14:799–808. doi: 10.1017/S0266462300012095. [DOI] [PubMed] [Google Scholar]
- Canadian Agency for Drugs and Technologies in Health. Ottawa, Canada. 3 2006. Guidelines for the economic evaluation of health technologies. [Google Scholar]
- Kolotkin RL, Crosby RD, Gress RE, Hunt SC, Adams TD. Two-year changes in health-related quality of life in gastric bypass patients compared with severely obese controls. Surg Obes Relat Disord. 2009;5:250–256. doi: 10.1016/j.soard.2009.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolotkin RL, Crosby RD, Williams GR, Hartley GG, Nicol S. The relationship between health-related quality of life and weight loss. Obes Res. 2001;9:564–571. doi: 10.1038/oby.2001.73. [DOI] [PubMed] [Google Scholar]
- Duan N. Smearing estimate: a nonparametric transformation method. J Am Stats Assoc. 1983;78:605–610. doi: 10.2307/2288126. [DOI] [Google Scholar]
- Lin DY, Feuer EJ, Etzioni RD. et al. Estimating medical costs from incomplete follow-up data. Biometrics. 1997;53:419–443. doi: 10.2307/2533947. [DOI] [PubMed] [Google Scholar]
- Etzioni RD, Feuer EJ, Sullivan SD. et al. On the use of survival analysis techniques to estimate medical care costs. J Health Econ. 1999;18:365–380. doi: 10.1016/S0167-6296(98)00056-3. [DOI] [PubMed] [Google Scholar]
- Jacobs P, Ohinmaa A, Lier D, Klarenbach S, Chuck A, Padwal R. Costing of alternative interventions for the treatment of morbid obesity. Alberta Health and Wellness Technical Report. 2005.
- Hemmelgarn BR, Clement F, Manns BJ, Klarenbach S, James MT, Overview of the Alberta Kidney Disease Network. BMC Nephrol. p. 30. [DOI] [PMC free article] [PubMed]
- Flum DR, Khan TV, Dellinger EP. Toward the rational and equitable use of bariatric surgery. JAMA. 2007;298:1442–1444. doi: 10.1001/jama.298.12.1442. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.