Skip to main content
Elsevier - PMC COVID-19 Collection logoLink to Elsevier - PMC COVID-19 Collection
. 2010 Sep 17;140(4):757–763. doi: 10.1016/j.jtcvs.2010.06.040

The effect of regionalization on outcome in pulmonary lobectomy: A Canadian national study

Christian J Finley a,, Anna Bendzsak a, George Tomlinson b, Shaf Keshavjee a, David R Urbach b, Gail E Darling a
PMCID: PMC7094104  PMID: 20850656

Abstract

Objective

To examine the effect of regionalization of thoracic surgery services in Canada by evaluating change over time in hospital volumes of pulmonary lobectomy and its impact on length of stay and in-hospital mortality.

Methods

Data on pulmonary lobectomy between 1999 and 2007 were abstracted from the Canadian Institute for Health Information Discharge Abstract Database. In-hospital mortality was analyzed by logistic regression, and log-transformed length of stay was analyzed by linear regression. Cross-sectional analysis of hospital volume, in-hospital mortality, and length of stay was performed, controlling for clustering. Within-hospital changes in annual volume on outcome was analyzed using multivariable logistic regression, controlling for Charlson comorbidity index and other confounders.

Results

Of 19,732 patients, 10, 281 (52%) were male, with an average age of 63.3 years. There was a 45% (95% confidence interval, 21–61; P = .001) relative risk reduction in in-hospital mortality with a 19% reduction in length of stay (95% confidence interval, 12–25; P < .0001). On comparison of volume between hospitals, an increase of 20 cases was associated with a 15% relative risk reduction (95% confidence interval, 9–19; P < .0001) in in-hospital mortality and a 5% relative decrease (95% confidence interval, 3–7; P < .001) in length of stay. Within hospitals there was a nonsignificant relationship between volume and in-hospital mortality.

Conclusions

In-hospital mortality and length of stay for lobectomies have decreased in Canada. In multivariate analysis, volume was associated with improved in-hospital mortality, but there was no reduction in mortality when volume was increased within a given hospital. However, the proportion of patients treated in high-volume centers has increased over time, inferring the importance of high-volume centers in improved outcomes. This supports regionalization policies for pulmonary lobectomy.

Abbreviations and Acronyms: CI, confidence interval; ICD, International Classification of Diseases; IHM, in-hospital mortality; LOS, length of stay; SD, standard deviation


Inline graphicEarn CME credits at http://cme.ctsnetjournals.org

The association between hospital volumes and surgical outcomes has been well documented for many high-risk surgical procedures, including surgery for lung cancer.1, 2, 3, 4 In the United States, a large body of evidence suggests a consistent relationship between larger hospital volumes and improved short-term outcomes for lobectomy and pneumonectomy.4, 5, 6 Improvements in long-term outcomes are also related to institutional volume.4 There is also a suggestion that institutional designation as a cancer center provides improved outcomes beyond volume.7 The evidence for this volume–outcome relationship is somewhat controversial, however, because there are several studies from the United Kingdom, Canada, and the United States that fail to show any benefit to hospital volume on outcome in pulmonary resections.8, 9, 10 Furthermore, many smaller institutions are considered to deliver high-quality care and have among the most favorable outcomes reported in the literature.11

There is no universally accepted volume standard for a large-volume center, with many publications quoting differing thresholds. The Society of Thoracic Surgeons database,12 a voluntary dedicated thoracic database, reports a median of 31.4 lobectomies per participant per year, but numbers range from 1 to 128. Hospital lobectomy volumes ranging from 19 to 37 per year have been considered large volume,1, 13 and in Canada, Ontario has set a standard of 150 anatomic lung resections per year as a target for high-volume centers.14 In searching for a volume threshold above which outcomes are improved, factors other than volume are often found to have more influence on the variability in outcomes.15

The evidence for a positive relationship between hospital volumes and surgical outcomes has led to the suggestion that care be regionalized primarily in large-volume centers.16 In Canada, thoracic surgery services have been formally regionalized in British Columbia and Ontario as a result of this literature with added funding and resources being added to facilitate optimum care in 2001 and 2004, respectively.14, 17 In the largest province of Ontario, the regionalization came with necessary requirements for facilities and availability of specialized care. Informally, many other provinces have amalgamated existing smaller centers to effectively regionalize their services without explicit added resources. Several authors caution about potential untoward side effects of regionalization policies,11 and as yet, the effect of manipulating hospital volumes on surgical outcomes for patients has not been established. Authors theorize that patient outcomes will be improved by increasing an institution's volume or alternatively by referring patients to existing high-volume centers.

To address the effect of regionalization on outcomes in thoracic surgery, pulmonary lobectomy was chosen because it is the most commonly performed major thoracic oncologic surgical procedure with a reported mortality ranging from 0.8% to 3.8%9, 12, 18, 19 and a morbidity rate of 15.3% to 47%.12, 18, 19

The objective of this study was to examine changes in length of stay (LOS) and in-hospital mortality (IHM) after pulmonary lobectomy in Canada over time and to describe relationships between these short-term surgical outcomes and changes in hospital volumes, both between and within hospitals.

Materials and Methods

All pulmonary lobectomies for patients age 18 years and older recorded in the Canadian Institute for Health Information Discharge Abstract Database from 1999 to 2007 were included (International Classification of Diseases [ICD], 9th Revision code 44.4 for cases up to 2004, and 10th revision code 1.GR.89.DA/NW/QB). Extended resections and bilobectomy were excluded. The Discharge Abstract Database contains all hospital discharges in Canada with the exception of those performed in Quebec and Manitoba outside Winnipeg. De-identified information on age, gender, admission date, LOS, IHM, province of operation, institution number, surgeon, and patient disposition were collected. To adjust for patient risk factors, the Charlson comorbidity index was calculated using pre-hospitalization ICD-9 and 10 diagnosis codes,20 a method that has been validated.21, 22 The study was approved by the institutional research ethics board at the University Health Network.

Descriptive analyses were conducted to determine the change in number of cases performed, IHM, and LOS over time. Random effects logistic regression was used for the analysis of IHM, and random effects linear regression was used for the log-transformed LOS analysis. Unadjusted regression was performed to examine trends in outcomes over time. The effect of annual hospital lobectomy volumes on outcomes was examined by modeling yearly hospital volume by IHM and LOS, adjusting for calendar year, gender, age, Charlson comorbidity index (each score analyzed separately), province of care (using Ontario as the reference province), and the average volume per hospital over the study period. An institutional increase in volume of 20 cases per year was considered clinically relevant.

We then examined the effect of changing lobectomy volumes within an individual hospital. Both absolute yearly differences from the overall mean per hospital and relative yearly differences from the overall mean per hospital were examined in multivariate models and yielded similar results. We present the results from the analysis using absolute differences in yearly hospital volumes. An institutional increase in volume of 20 cases per year was considered clinically relevant.

In the multivariate model, volume was analyzed as a continuous variable. To present groupings of hospitals into low, medium, and high volume, the number of cases performed over time was examined using different thresholds for “high volume,” ranging from 50 to 100 cases per year, and “medium volume” as 10 cases per year up to the threshold of “high volume.” After plotting the results graphically, a threshold of 60 cases per year (or ∼1 per week) was determined to be clinically relevant as the cutoff for “high volume” because our data supported changes in time in institutional numbers at this value. Low volume was defined as fewer than 10 cases per year or approximately 1 per month.

Results

The study interval from 1999 to 2007 included 19,732 patients, of whom 10,281 (52%) were male. The average age was 63.3 (standard deviation [SD] = 13.2; range, 18–94) years. The average Charlson comorbidity index was 2.26 (SD = 1.30). The average Charlson comorbidity index increased over the study interval from 1.9 to 2.3. The number of procedures performed per year increased over the study period from 2120 to 2561, as shown in Figure 1 . Preoperatively, 82.8% of patients had a diagnosis of cancer. A decrease in lobectomies in 2003 is thought to be attributable to the severe acute respiratory syndrome outbreak.

Figure 1.

Figure 1

Number of pulmonary lobectomies in Canada per year. Error bars represent 95% CIs.

IHM per year is shown in Figure 2 . The unadjusted analysis revealed a 45% relative risk reduction (95% confidence interval [CI], 21–61; P = .001) in IHM over the study period and a 19% reduction in LOS (95% CI, 12–25; P < .0001). The IHM yearly rate decreased over the study period from a peak of 3.1% in 1999 to 1.95% in 2007. Similarly, LOS yearly rates decreased from 10.4 days (SD = 12.2) in 1999 to 8.9 days (SD = 10.1) in 2007.

Figure 2.

Figure 2

Pulmonary lobectomy mortality rate in Canada per year. Error bars represent 95% CIs.

When we examined the effect of volume on mortality, we found that hospitals performing fewer than 10 lobectomies per year had the highest mortality at 4.8%, whereas those performing more than 100 lobectomies per year had the lowest mortality at 1.8% (Figure 3 ).

Figure 3.

Figure 3

Mortality as it relates to the number of procedures done cross-sectionally over the entire study.

The risk-adjusted models for IHM and LOS are shown in Table 1 . Both lower IHM and lower LOS were associated with institutions with higher volumes. After adjusting for age, gender, and Charlson index, there was a 15% relative risk reduction (95% CI, 9–19; P < .0001) for IHM and a 5% relative decrease (95% CI, 3–7; P < .001) in LOS for every 20 additional cases performed per hospital. Table 1 shows that male gender and increasing age are associated with worse outcomes. However, after adjusting for known patient factors and volume, year of procedure remains a significant factor.

Table 1.

Multivariable regression model of in-hospital mortality and length of stay

In-hospital mortality Odds ratios Lower 95% Upper 95% P value
Yearly mean volume (per patient) 0.992 0.989 0.995 <.0001
Relative volume 1.003 0.997 1.008 .3899
Calendar year 0.952 0.916 0.989 .0107
Gender (male) 1.753 1.435 2.142 <.0001
Age (per 10 y) 1.628 1.482 1.788 <.0001
Charlson = 1 0.396 0.227 0.694 .0009
Charlson = 2 0.27 0.205 0.356 <.0001
Charlson = 3 0.402 0.292 0.555 <.0001
Charlson = 4 1.371 0.832 2.258 .2064
Charlson = 5 0.258 0.169 0.393 <.0001
Charlson = 6 + 1.009 0.535 1.9 .9785

Length of stay Odds ratios Lower 95% Upper 95% P value
Yearly mean volume (per patient) 0.997 0.996 0.999 <.0001
Relative volume 0.998 0.997 0.999 .0005
Calendar year 0.982 0.979 0.986 <.0001
Gender (male) 1.033 1.016 1.05 .0001
Age (per 10 y) 1.098 1.09 1.105 <.0001
Charlson = 1 1.087 1.039 1.137 .0001
Charlson = 2 1.003 0.974 1.034 .4097
Charlson = 3 0.998 0.964 1.033 .4436
Charlson = 4 1.369 1.26 1.487 <.0001
Charlson = 5 1.037 0.998 1.078 .0297
Charlson = 6 + 1.39 1.273 1.518 <.0001

When examining changes in volume that occurred within an individual hospital, there was a nonsignificant relationship between increasing volumes within hospitals and IHM, with a −5% (95% CI, 6 to −18, P = .39) relative decrease in mortality for each additional 20 cases performed within a given hospital. In contrast, there was a significant decrease in LOS, with a 4% relative decrease in LOS (95% CI, 1–6; P = .0005) for each incremental increase in volume of 20 cases within a given hospital. There was a significant difference in LOS between the provinces, but not for IHM (data not shown).

The change in percentage of patients treated in centers with different volumes over the study period is shown in Figure 4 . In 1999, 77 institutions performed lobectomies in Canada, compared with 69 institutions in 2007. The percentage of cases performed in “high-volume” centers (>60 cases per year) increased over time from 49.7% to 65%, the percentage of cases performed in “medium-volume” centers (11–60 cases per year) decreased from 43.4% to 31%, and the percentage of cases performed in small-volume centers decreased from 6.9% to 3.2%, suggesting that cases overall are being increasingly performed in high-volume centers.

Figure 4.

Figure 4

Changing percentage of patients treated at centers with different volumes.

Discussion

This study presents the relationship between hospital volumes and short-term outcomes for pulmonary lobectomy in Canada during the study interval of 1999 to 2007. We found a significant decrease in IHM and LOS despite increased numbers of lobectomies performed in patients with increased comorbidities. For the approximately 2600 cases of lung lobectomies performed in 2007 in Canada, this change results in approximately 26 lives saved and 3900 patient days in hospital avoided. It is a considerable improvement in the delivery of one thoracic operation, which could have even more profound impact when extrapolated across other thoracic surgical procedures.

The multivariate model shows that although mortality decreases with increasing volume when comparing between hospitals, there is no effect on mortality when individual hospitals increase their volumes. Furthermore, we observed both a decrease in overall adjusted mortality over time and an increase in volumes in those hospitals performing high-volume procedures over time, similar to US reports.23, 24 Although the total volume of cases increased over time could explain this, only 5.6% of institutions crossed from the medium-volume institutions to high-volume institutions. Thus, it is likely that the decrease in mortality is associated with a larger proportion of lobectomies being delivered in high-volume centers and the cessation of the lower-volume institutions with their associated average higher mortality. This suggests that for lobectomy in Canada, the volume–outcome relationship is best optimized by selective referral to existing large-volume institutions.

Factors affecting mortality include patient factors and the average procedural volume of the hospital where the lobectomy is performed. Patient and volume characteristics seem to be changing over time with overall increasing Charlson comorbidity index and proportion of patients being treated in high-volume centers, whereas age is relatively stable. However, mortality is improving over time beyond that explained by these factors. Whether this added effect reflects improved staging, surgical selection, or early interventions on critically ill patients25 is unclear. The increasing availability of video-assisted lobectomy offers a potential surgical factor that may contribute to improved outcomes in larger institutions, but the adoption of this technique in Canada is still ongoing, and with the limitations of the coding, its effect is inaccessible. A shift in procedures to high-volume hospitals is the sole potentially externally modifiable variable. Indeed, there has clearly been a movement of patients to higher-volume centers.

Our study also addresses the question of what occurs to outcomes when the volumes in individual centers change. Notably, increasing an individual center's volume failed to show any change in mortality, but a significant improvement in LOS was observed when individual hospital volumes increased. LOS is frequently used as a marker of quality of care, with reduced LOS representing a surrogate marker for improved management of patients, including preoperative patient selection, operative care, postoperative course, and reduced complications. Its improvement with increased hospital volumes may represent change in practice over time or improved efficiency of care in response to healthcare economic pressures.

Study Limitations

Our study has several limitations. Accounting for case-mix and comorbidity is required in volume–outcome relationship investigations, but we were limited to the use of the Charlson comorbidity index, which has been validated for population-based studies and used elsewhere in volume–outcome research. Its use, however, of comorbid illnesses, such as congestive heart failure, diabetes, human immunodeficiency virus, renal failure, and cancer, does not include all accepted factors that increase the risk of pulmonary resection. Other important markers, such as forced expiratory volume in 1 second, carbon monoxide diffusion in the lung, and exercise testing, are not available in the Canadian Institute for Health Information database and are not part of the Charlson index. In our study, IHM and LOS did not change uniformly with progressive Charlson comorbidity scores as would be expected. This could be explained by the expected worse outcomes in patients undergoing anatomic lung resection for inflammatory reasons, many of whom would have a correspondingly lower Charlson score. As such, each score was analyzed separately and not linearly to account for this effect. Furthermore, although the Charlson index accounts for malignancy, we do not have stage information in our database, which limits our ability to control for patients with more advanced disease, although arguably this should not affect short-term outcome in well-selected patients.

There was a coding change from ICD-9 to ICD-10 over the course of our study, which was incorporated at different times in each province. The ICD-10 coding system is more detailed than the ICD-9 system, and thus it is possible that the same spectrum of cases was not captured by our use of the ICD-10 codes as was captured for the use of ICD-9 codes. Because the results were consistent across the study period, however, this is likely not a significant factor. The Charlson comorbidity index is formed from ICD coding, but it has been shown that the change in coding did not affect its performance in capturing comorbidity.20, 21, 22

There has been active promotion of the concept of regionalization of thoracic surgery services to high-volume centers based on the quantity of cross-sectional evidence for volume–outcome relationships. Our results support the cross-sectional relationship between short-term outcomes and higher-volume centers. In addition, we show that, over time, there has been an improvement in short-term mortality, and this change is in part due to more cases being done in higher-volume centers rather than within-hospital improvement. These results support the idea that services should continue to be regionalized to high-volume centers. However, regionalization is clearly more than just volume and includes other processes of care that we have not measured, such as specialized services, staff, and experience. This study suggests that systematic initiatives in regionalization of thoracic surgery are moving us forward in improving outcomes of patients undergoing lobectomy. It also underscores the importance of outcome data collection and analysis going forward to accurately assess the efficacy of our attempts to improve the quality and efficiency of health care delivery.

Conclusions

During a period when several initiatives were implemented to improve patient care in thoracic surgery in Canada, IHM and LOS for pulmonary lobectomies decreased. High-volume centers demonstrated significantly improved overall outcomes. Although increased volume within a hospital was related to decreasing LOS, we did not find a significant relationship between mortality and changing yearly volume within a given hospital. The proportion of patients treated in high-volume centers has increased over time, and volume is associated with improved outcome in the multivariate model. These results infer an important role of high-volume centers in improved LOS and IHM. Our results support the policy that services should continue to be regionalized to high-volume centers. They also underscore the importance of prospective outcome data analysis to accurately assess the efficacy of efforts to improve quality and efficiency of health care delivery.

Footnotes

Disclosures: None.

References

  • 1.Birkmeyer J., Therese S., Siewers A., Goodney P., Wennberg D., Lucas L. Surgeon volume and operative mortality in the United States. N Engl J Med. 2003;349:2117–2127. doi: 10.1056/NEJMsa035205. [DOI] [PubMed] [Google Scholar]
  • 2.Begg C., Cramer L., Hoskins W., Brennan M. Impact of hospital volume on operative mortality for major cancer surgery. JAMA. 1998;280:1747–1751. doi: 10.1001/jama.280.20.1747. [DOI] [PubMed] [Google Scholar]
  • 3.Gordon T.A., Burleyson G.P., Tielsch J.M., Cameron J.L. The effects of regionalization on cost and outcome for one general high-risk surgical procedure. Ann Surg. 1995;221:43–49. doi: 10.1097/00000658-199501000-00005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bach P.B., Cramer L.D., Schrag D., Downey R.J., Gelfand S.E., Begg C.B. The influence of hospital volume on survival after resection for lung cancer. N Engl J Med. 2001;345:181–188. doi: 10.1056/NEJM200107193450306. [DOI] [PubMed] [Google Scholar]
  • 5.Hannan E.L., Radzyner M., Rubin D., Dougherty J., Brennan M.F. The influence of hospital and surgeon volume on in-hospital mortality for colectomy, gastrectomy, and lung lobectomy in patients with cancer. Surgery. 2002;131:6–15. doi: 10.1067/msy.2002.120238. [DOI] [PubMed] [Google Scholar]
  • 6.Finlayson E., Goodney P., Birkmeyer J. Hospital volume and operative mortality in cancer surgery: a national study. Arch Surg. 2003;138:721–726. doi: 10.1001/archsurg.138.7.721. [DOI] [PubMed] [Google Scholar]
  • 7.Birkmeyer N.J., Goodney P.P., Stukel T.A., Hillner B.E., Birkmeyer J.D. Do cancer centers designated by the National Cancer Institute have better surgical outcomes? Cancer. 2005;103:435–441. doi: 10.1002/cncr.20785. [DOI] [PubMed] [Google Scholar]
  • 8.Simunovic M., Rempel E., Thériault M.E., Coates A., Whelan T., Holowaty E. Influence of hospital characteristics on operative death and survival of patients after major cancer surgery in Ontario. Can J Surg. 2006;49:251–258. [PMC free article] [PubMed] [Google Scholar]
  • 9.Treasure T., Utley M., Bailey A. Assessment of whether in-hospital mortality for lobectomy is a useful standard for the quality of lung cancer surgery: retrospective study. BMJ. 2003;327:73. doi: 10.1136/bmj.327.7406.73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Khuri S.F., Daley J., Henderson W., Hur K., Hossain M., Soybel D. Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program. Ann Surg. 1999;230:414–432. doi: 10.1097/00000658-199909000-00014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Urschel J.D., Urschel D.M. The hospital volume-outcome relationship in general thoracic surgery. Is the surgeon the critical determinant? J Cardiovasc Surg. 2000;41:153–155. [PubMed] [Google Scholar]
  • 12.Boffa D.J., Allen M.S., Grab J.D., Gaissert H.A., Harpole D.H. Wright CD Data from The Society of Thoracic Surgeons General Thoracic Surgery database: the surgical management of primary lung tumors. J Thorac Cardiovasc Surg. 2008;135:247–254. doi: 10.1016/j.jtcvs.2007.07.060. [DOI] [PubMed] [Google Scholar]
  • 13.Finlayson E.V., Birkmeyer J.D. Effects of hospital volume on life expectancy after selected cancer operations in older adults: a decision analysis. J Am Coll Surg. 2003;196:410–417. doi: 10.1016/S1072-7515(02)01753-2. [DOI] [PubMed] [Google Scholar]
  • 14.Available at: www.cancercare.on.ca/cms/one.aspx?pageId=41173.
  • 15.Meguid R., Weiss E., Chang D., Brock M., Yang S. The effect of volume on esophageal cancer resections: what constitutes acceptable resection volumes for centers of excellence? J Thorac Cardiovasc Surg. 2009;137:23–29. doi: 10.1016/j.jtcvs.2008.09.040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Birkmeyer J.D. Should we regionalize major surgery? Potential benefits and policy considerations. J Am Coll Surg. 2000;190:341–349. doi: 10.1016/s1072-7515(99)00270-7. [DOI] [PubMed] [Google Scholar]
  • 17.BC Thoracic Surgery. About Us. Vancouver, BC: 2006; BC Thoracic Surgery. Available at: http://www.thoracicsurgery.bc.ca/aboutus.html. Accessed March 9, 2009.
  • 18.Berry M., Hanna J., Tong B., Burfeind W., Harpole D., D'Amico T. Risk factors for morbidity after lobectomy for lung cancer in elderly patients. Ann Thorac Surg. 2009;88:1093–1099. doi: 10.1016/j.athoracsur.2009.06.012. [DOI] [PubMed] [Google Scholar]
  • 19.Meguid R., Brooke B., Chang D., Sherwood T., Brock M., Yang S. Are surgical outcomes for lung cancer resections improved at teaching hospitals? Ann Thorac Surg. 2008;85:1015–1025. doi: 10.1016/j.athoracsur.2007.09.046. [DOI] [PubMed] [Google Scholar]
  • 20.Li B., Evans D., Faris P., Dean S., Quan H. Risk adjustment performance of Charlson and Elixhauser comorbidities in ICD-9 and ICD-10 administrative databases. BMC Health Serv Res. 2008;8:12. doi: 10.1186/1472-6963-8-12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Iezzoni L.I. Health Administration Press; Chicago, IL: 2003. Risk Adjustment for Measuring Health Care Outcomes. [Google Scholar]
  • 22.Quan H., Sundararajan V., Halfon P., Fong A., Burnand B., Luthi J.C. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–1139. doi: 10.1097/01.mlr.0000182534.19832.83. [DOI] [PubMed] [Google Scholar]
  • 23.Memtsoudis S.G., Besculides M.C., Zellos L., Patil N., Rogers S.O. Trends in lung surgery: United States 1988 to 2002. Chest. 2006;130:1462–1470. doi: 10.1378/chest.130.5.1462. [DOI] [PubMed] [Google Scholar]
  • 24.Ho V., Heslin M.J., Yun H., Howard L. Trends in hospital and surgeon volume and operative mortality for cancer surgery. Ann Surg Oncol. 2006;13:851–858. doi: 10.1245/ASO.2006.07.021. [DOI] [PubMed] [Google Scholar]
  • 25.Ghaferi A., Birkmeyer J., Dimick J. Variation in hospital mortality associated with inpatient surgery. N Engl J Med. 2009;361:1368–1375. doi: 10.1056/NEJMsa0903048. [DOI] [PubMed] [Google Scholar]

Articles from The Journal of Thoracic and Cardiovascular Surgery are provided here courtesy of Elsevier

RESOURCES