Skip to main content
PMC home page
Systematic Reviews logoLink to Systematic Reviews
. 2014 Sep 19;3:103. doi: 10.1186/2046-4053-3-103

Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol)

Adegboyega K Lawal 1,✉, Thomas Rotter 1, Leigh Kinsman 2, Nazmi Sari 3, Liz Harrison 4, Cathy Jeffery 5, Mareike Kutz 6, Mohammad F Khan 7, Rachel Flynn 8
PMCID: PMC4171573  PMID: 25238974

Abstract

Background

Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits. It emphasizes the consideration of the customer’s needs, employee involvement and continuous improvement. Research on the application and implementation of lean principles in health care has been limited.

Methods

This is a protocol for a systematic review, following the Cochrane Effective Practice and Organisation of Care (EPOC) methodology. The review aims to document, catalogue and synthesize the existing literature on the effects of lean implementation in health care settings especially the potential effects on professional practice and health care outcomes. We have developed a Medline keyword search strategy, and this focused strategy will be translated into other databases. All search strategies will be provided in the review. The method proposed by the Cochrane EPOC group regarding randomized study designs, non-randomised controlled trials controlled before and after studies and interrupted time series will be followed. In addition, we will also include cohort, case–control studies, and relevant non-comparative publications such as case reports. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the reported types of implementation in the primary studies. We will present the results of studies in a tabular form.

Discussion

Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the implementation of lean activities in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and implementation methodologies reported in health care.

Systematic review registration

PROSPERO CRD42014008853

Keywords: Lean, Systematic review, Health care, Toyota management system

Background

Lean is a set of operating philosophies and methods that help create maximum value for patients by reducing waste and waits [1]. It aims to fundamentally change organization thinking and value, which ultimately leads to the transformation of organization behaviour and culture over time [2]. Based on the Toyota model, it focuses on how efficiently resources are being used and ask, 'what value is being added for the customer’ in every process [3]. Recently, the health care industry has demonstrated success in applying these principles in the United States, United Kingdom, Australia and now Canada [4]. Despite indications that lean is prevalent in health care, many authors regard its implementation to be pragmatic, patchy and fragmented [5]. The application of lean management in health care can also be holistic such as the transformation of an overall business strategy [2,6]. Although lean thinking originated from car making, research on its application and sustainability in health care is still limited [7]. Primary studies often lack appropriate concepts explicitly stated, research designs, appropriate analysis and outcome measures [7]. The majority of studies also reported on successful lean interventions, whereas little has been documented about the failed attempts or barriers to its implementation in health care [7]. It is therefore imperative to catalogue and synthesize the existing literature via a systematic review on the effects of lean implementation especially the potential effects on professional practice and health care outcomes in various settings.

Review questions and objectives

The primary review question is as follows:

What are the effects of lean management in health care on professional practice and health care outcomes?

The secondary review questions are as follows:

(i.) What can we learn from the existing evidence on lean to better understand the various methodologies used and the experience in evaluating the impact?

(ii.) What are the differences in lean implementation, and can we explain how those differences might lead to different outcomes?

Criteria for considering existing publications for this review

The systematic review will include all relevant studies according to the review questions and objectives. We will apply the electronic search strategy to identify all primary studies reporting on the effectiveness of lean and the different strategies used for implementation. We will extract and collate all of the concepts used to describe lean, how it is applied and the activities involved in the implementation process. We will not include editorial reports, animal studies, lean applications in other industries, teaching and investigations using self-reported outcomes.

Types of publications/studies

The method proposed by the Cochrane Effective Practice and Organisation of Care (EPOC) group regarding randomized study designs (RCTs), non-randomised controlled trials (NRCTs), controlled before and after studies (CBA) and interrupted time series (ITS) will be included [8]. In addition, we will also consider cohort or panel (longitudinal) studies, case–control studies and relevant non-comparative publications such as case reports. A case report is a document that provides details about how a study was conducted and its subsequent findings. A panel study is a longitudinal study in which variables are measured on the same units over time.

Types of institutions and participants

•All sectors of the health care system, including hospital care, primary care and rehabilitation

•All employees such as CEOs, health professionals, administrative staff and support staff

•Patients and their families

•Management, lean experts and key stakeholders

Types of lean interventions reported

Definition

Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits [1]. The approach was originally derived from the Toyota car company production line system: a continuous process improvement system comprising of structured inventory management, waste reduction and quality improvement techniques [9]. Lean utilises a continuous learning cycle that is driven by the 'true’ experts in the processes of health care, being the patients/families, health care providers and support staff [10].

The majority of lean investigations published in the international literature refer to the Toyota management system as applied to health care [11-18]. In particular, the Virginia Mason Medical Center’s application of lean 'became the catalyst for lean health care’ in other health systems, particularly in the United States and the United Kingdom [19,20]. Other authors refer to Thedacare [21] or simply to a lean management system or lean principles/lean philosophy [2,22-24].

Lean application in Saskatchewan

In Saskatchewan, the Toyota lean management system is used in combination with a strategic management and policy deployment system, called Hoshin Kanri [25], and daily visual management. Daily visual management is an approach where staff members take the time each day to evaluate their progress using the key elements of daily huddles and visibility walls.

Types of implementation strategy reported

Varying terms and Japanese terminologies are used to describe the lean implementation strategies. The most frequently reported lean implementation activities are 'lean basics’ workshops, also described as 'Kaizen basics’ workshops. A 'Kaizen or lean basics’ session is a one-day workshop, introducing lean tools and techniques [6,18]. Other activities reported in the literature to implement lean in health care are 5S events to reorganize the workplace, rapid process improvement workshops (RPIW) and value stream mapping to improve current and future care processes [11-13,26]. 5S stands for 'Sort, Sweep, Simplify, Standardize, Sustain/Self-Discipline’, and it represents a set of concepts that helps organizations ensure a clean and organized work place [27]. An RPIW is a week-long event also reported as a three-day lean event where teams of patients and their families, staff and clinicians focus on one problem, identify the root cause, create solutions and implement the solution in the workplace [27]. A value stream map in health care is a visual tool to understand the flow of patients, supplies or information through the journey of a patient, and it maps all processes required to deliver a health care service [27]. We will report on all activities used to implement lean concepts and methodologies. More examples of activities to be included are Kanban, lean leadership training, mistake-proofing projects, and other activities used to implement the lean management system. Kanban is a visual signalling system when new parts, supplies or services are needed, in the quantity needed, and at the time they are needed. A Kanban signal is usually a card, indicating the need to reorder supplies [27]. The aim of a mistake-proofing project is to develop a device or procedure to avoid such an error in the future (e.g. specific hose coupling in anaesthesia, forcing functions in order entry) [27].

Types of outcome measures

All objectively reported process and outcome measures will be included. To be considered for this review, the studies must include one or more of the following primary or secondary outcomes.

Primary outcomes

Any objective measure of the following:

1. Health system improvement outcomes: admission time, collection time, turnaround time, triage time, time to see a physician, dispensing time, examination room time, number of patient visit, length of stay, discharge rate, patient journey time, scheduling time, near miss event rate, turnover time, wait time, etc.

2. Patient outcomes: patient satisfaction, mortality rate, re-admission rate, etc.

3. Professional outcomes: employee satisfaction, time spent with the patient, staff overtime, login to provider time, etc.

Secondary outcomes

Any objective measure of the following:

1. The various types of lean definitions or concepts: lean, lean philosophy, lean principles, continuous quality improvement, etc.

2. Lean management systems: Toyota management system, Henry ford production system, Thedacare improvement system, Virginia Mason production system, etc.

3. Lean activities: 5S, Value stream mapping, Rapid process improvement workshops, Kaizens basics workshops, 3P, etc.

Search strategy for the identification of studies

To develop our search strategy, we ran the Medline search strategy (see Additional file 1, Strategy A) from a Cochrane review on the broad concept of continuous quality improvement [28]. However, this strategy was not focused on lean. Since lean is not represented in controlled vocabularies of biomedical databases, an information scientist developed a Medline search strategy (see Additional file 1, Strategy B) This focused keyword strategy will be translated and run in the databases listed below. We will not make use of methodological filters and will not apply date or language limits. All search strategies will be provided in the final review. The following electronic databases will be searched for primary studies: Medline (OVID), Embase (OVID), HealthStar (OVID), Web of Science (Science, Social Sciences, and Arts & Humanites Citations Indexes and Conference Proceedings), Health Technology Assessment (HTA), Economics Evaluation (EED) databases, Cochrane Library, EconLit, PAIS (Public Affairs Information Service) International, Proquest Dissertations & Theses, Proquest Political Science and Canadian Research Index (see Additional file 1, Strategy C).

Other search methods

We will also do the following:

•Search websites of organizations (grey literature searching) concerned with quality in health care such as AHRQ (Agency for Healthcare Research & Quality) and ASQ.org. Sites searched will be reported in the review.

•Contact the authors of relevant studies or reviews to clarify reported published information or to seek unpublished results/data (as needed).

•Contact researchers with expertise relevant to our topic (as needed).

•Conduct cited reference searches (in citation indexes) for studies we include in this review.

Methods/Design

Screening

All titles and abstracts will be included in a reference management database; duplicates will be deleted. Two review authors will independently screen all titles and abstracts (MFHK and MK) to assess which studies meet the inclusion criteria. We will retrieve the full text copies of all potentially relevant papers, and disagreement on the inclusion will be resolved by a third member of the research team (TR).

Data management

We will record and report details on the number of retrieved references, the number of full text papers obtained and the number of included and excluded articles. We will manage this data in EndNote and use an excel spreadsheet. We will categorize articles based on three types of studies as suggested by a previously published literature review on lean management in hospitals [29]. The three article types are as follows: (1) articles that discuss the application of lean principles and are based only on the experience or general knowledge of the authors, (2) empirical articles based on actual case studies or research related to the application of lean principles and (3) literature reviews related to lean processes [29]. The reason for excluding retrieved full text studies will be stated in the final review.

Data extraction

Pairs of two review authors (TR and LA, RF and MK, LH and NS, LK and CJ) will independently extract data according to the double data entry method by using a standardized data extraction sheet (Excel spreadsheet); they will extract data directly from the included studies. We will refer unresolved disagreements on data abstraction to a third review author (TR and LK) and if consensus cannot be reached, the contact author of the review, LA. If necessary, we will seek additional information from the authors of the primary studies.

Risk of bias assessment

Two independent review authors will assess the methodological quality of all included studies, using the EPOC checklist for the assessment of methodological quality of studies [8]. EPOC criteria to be assessed include allocation of concealment, sequence generation, blinding of participants and personnel, similarities of baseline measures, confounding, similarities of baseline characteristics, management of incomplete outcome data, selective outcome reporting, contamination and other risk of bias identified by the review team. (See Additional file 2 for full list). For non-randomized designs such as case studies and cohort studies, we will use a tool for before-after studies that was developed based on the Newcastle-Ottawa scale [30] and used in a previous review [31]. Confounding factors (e.g. simultaneously ongoing initiatives such as changes in hospital policy and implementation of DRGs) will be also considered for case studies and cohort studies. The methodological quality of included studies will be assessed, and we will categorize them into three classes: A (low risk of bias), B (moderate risk of bias) and C (high risk of bias). We will refer unresolved disagreement on risk of bias to a third review author. We will consider studies with low risk of bias for all key domains or where it seems unlikely for bias to seriously alter the results. We will consider studies where risk of bias in at least one domain is unclear or judged to have some bias that could raise doubts about the conclusions as having an unclear risk of bias. We will consider studies with a high risk of bias in at least one domain or judged to have serious bias that decreases the certainty of the conclusions as having a high risk of bias [32]. We will not exclude studies from the review classified at high risk of bias. We will retain these studies and include them in a subsequent sensitivity analysis based on the assigned risk of bias.

Data analysis and synthesis

For the primary review question, that is, the effects of lean management on professional practice and health care outcomes, data will be reported in natural units. For dichotomous data (i.e. odds ratio (OR) or risk ratio (RR)) we will calculate a crude event rate as a measure of overall frequency giving the total number of events occurring over the follow-up period reported unadjusted for covariates (i.e. sex, age). In the case of missing standard deviation, the appropriate transformation will be undertaken [32]. We will assess the data on resource use, costs and cost-effectiveness according to the methodology used in the individual studies [33]. Financial data will be presented in US$ for the same base year and will be adjusted for inflation by using a country-specific price index [34]. Additionally, we will provide the nominal cost data to allow readers to recalculate the results using alternative price indexes. Studies reporting in other currencies will be converted to US$ [35]. For the two secondary review questions, all relevant data will be extracted and presented in a tabular form. All outcomes will be counted and grouped in a tabular form into similar implementation activities, complications such as in-hospital complications and the direction of effect reported e.g. positive, negative and null. Relevant findings will be categorized and synthesized in the form of a narrative summary using text and evidence tables according to the definitions and implementation strategy reported in the primary study [36]. Whenever possible, we will attempt to contact the original investigators to request for missing information. For missing standard deviation, we will recalculate them from the reported statistics provided in these studies (e.g. confidence intervals, standard errors, t values, P values) [37].

Combining studies

We will make an assessment of the reported lean methodologies, implementation strategies and effects, based upon the quality, size and direction of effects observed or reported. Positive, negative and null effects will be assessed, and studies will be grouped following the methods reported in the primary study. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the method reported in the primary studies. The results will be presented in a tabular form. We expect to find both statistical and contextual heterogeneity, given the range of outcomes measured and the many different settings and types of professionals and patients included. This may make statistical pooling impossible, but if there seems be a group of studies amenable to meta-analysis, then a random-effect model will be employed with the results displayed graphically. We will assess statistical heterogeneity by visually inspecting the confidence intervals of the effect estimates and by calculating a test of heterogeneity (I squared test I2) [38], with a cut off of 60%.

Subgroup analysis

We will perform a sub-group analysis of the primary and secondary outcomes reported where applicable. We will group studies according to the following categories:

1. Country(s) where the study was carried out (adjusting for possible market forces).

2. Setting(s) where the implementation of lean intervention occurred.

3. Year of publication to assess temporal differences in the outcomes reported over time

Sensitivity analysis

Sensitivity analysis will be carried out to explore the robustness of the results by investigating the effects of including and excluding studies with high risk of bias and studies with missing information.

Ongoing studies

We will describe identified ongoing studies, where available, detailing the primary author, research question(s), methods and outcome measures together with an estimate of the reporting date.

Discussion

Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the various types of definition, concepts, methodology and effects of lean in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and the types of implementation strategies utilized, based on the review findings and conclusions.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

All review authors have contributed to the production of the protocol, and all authors read and approved the manuscript. LA and TR led the writing of the protocol; all other review authors provided comment and feedback. For the full review, The Cochrane EPOC trail search coordinator, Michelle Fiander, has developed and will run the search strategy together with Vicky Duncan, the Nursing Liaison Librarian at the University of Saskatchewan. MK and MFHK will screen all the titles and abstracts for eligibility. TR and LA, RF and MK, LH and NS, LK and CJ will assess all primary studies for eligibility in review phase II. All review authors will abstract data, undertake analysis and write up the review. Michelle Fiander and VD will take the leadership regarding additional search strategies as defined in this review protocol. TR and NS will give advice on the methodological issues and the statistical analysis. LK would act as arbitrator should disagreement arise and will give advice on methodological issues. TR and LK will assess all full text studies in the second review stage about the practical relevance of the published methods. TR will lead the writing of the full review. LK and TR will critically appraise the review findings and conclusions, that is, to access the transferability of the international evidence.

Supplementary Material

Additional file 1

Search Strategies Lean Review. This file contain details of the search strategy ran in a particular database (Medline).

Click here for file (144.8KB, pdf)
Additional file 2

EPOC risk of bias criteria. This file contains the suggested risk of bias for EPOC reviews.

Click here for file (118.8KB, pdf)

Contributor Information

Adegboyega K Lawal, Email: lawal.kazeem@usask.ca.

Thomas Rotter, Email: thomas.rotter@usask.ca.

Leigh Kinsman, Email: leigh.kinsman@utas.edu.

Nazmi Sari, Email: nazmi.sari@usask.ca.

Liz Harrison, Email: liz.harrison@usask.ca.

Cathy Jeffery, Email: cathy.jeffery@usask.ca.

Mareike Kutz, Email: kutz.mareike@gmail.com.

Mohammad F Khan, Email: khan.faizul@gmail.com.

Rachel Flynn, Email: Rachel.Flynn@ualberta.ca.

Acknowledgements

We would like to thank Michelle Fiander, the Trial search coordinator from the Cochrane EPOC group in Ottawa for her contribution to the design of the search strategies we will use for the review.

Funding

The protocol development has been supported by the Saskatchewan Health Quality Council (Contract C7036).

References

  1. JBA. Lean leader certification and maintenance - physician track (FAQs) 2014. http://www.sma.sk.ca/data/1/rec_docs/872_2013-2009-2003LLTFAQ.pdf (Accessed June 21, 2014.
  2. Smith G, Poteat-Godwin A, Harrison LM, Randolph GD. Applying Lean principles and Kaizen rapid improvement events in public health practice. J Public Health Manag Pract. 2012;18(1):52–54. doi: 10.1097/PHH.0b013e31823f57c0. [DOI] [PubMed] [Google Scholar]
  3. Campbell RJ. Thinking lean in healthcare. J AHIMA. 2009;80(6):40–43. quiz 45–46. [PubMed] [Google Scholar]
  4. Fine BA, Golden B, Hannam R, Morra D. Leading Lean: a Canadian healthcare leader’s guide. Healthc Q. 2009;12(3):32–41. doi: 10.12927/hcq.2013.20877. [DOI] [PubMed] [Google Scholar]
  5. Burgess N, Radnor Z. Evaluating Lean in healthcare. Int J Health Care Qual Assur. 2013;26(3):220–235. doi: 10.1108/09526861311311418. [DOI] [PubMed] [Google Scholar]
  6. Ulhassan W, Sandahl C, Westerlund H, Henriksson P, Bennermo M, von Thiele SU, Thor J. Antecedents and characteristics of lean thinking implementation in a Swedish hospital: a case study. Qual Manag Health Care. 2013;22(1):48–61. doi: 10.1097/QMH.0b013e31827dec5a. [DOI] [PubMed] [Google Scholar]
  7. Mazzocato P, Holden RJ, Brommels M, Aronsson H, Backman U, Elg M, Thor J. How does lean work in emergency care? A case study of a lean-inspired intervention at the Astrid Lindgren Children’s hospital, Stockholm. Sweden. BMC Health Serv Res. 2012;12:28. doi: 10.1186/1472-6963-12-28. doi:10.1186/1472-6963-1112-1128. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Effective Practice and Organisation of Care (EPOC) EPOC resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2013. Available at: http://epocoslo.cochrane.org/sites/epocoslo.cochrane.org/files/uploads/05%20What%20study%20designs%20should%20be%20included%20in%20an%20EPOC%20review%202013%2008%2012_0.pdf. [Google Scholar]
  9. Black J, Miller D. The Toyota Way to Healthcare Excellence: Increase Efficiency and Improve Quality with Lean. Chicago, IL: Health Administration Press; 2008. [Google Scholar]
  10. de Souza L. Trends and approaches in Lean healthcare leadership. Leadership in Healthcare. 2009;22(2):121–139. [Google Scholar]
  11. Mazzocato P, Holden RJ, Brommels M, Aronsson H, Backman U, Elg M, Thor J. How does lean work in emergency care? A case study of a lean-inspired intervention at the Astrid Lindgren Children’s hospital, Stockholm, Sweden. BMC Health Serv Res. 2012;12(28) doi: 10.1186/1472-6963-12-28. http://www.biomedcentral.com/content/pdf/1472-6963-12-28.pdf. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Hummer J, Daccarett C. Improvement in prescription renewal handling by application of the Lean process. Nurs Econ. 2009;27(3):197–201. [PubMed] [Google Scholar]
  13. Belter D, Halsey J, Severtson H, Fix A, Michelfelder L, Michalak K, Abella P, De Ianni A. Evaluation of outpatient oncology services using lean methodology. Oncol Nurs Forum. 2012;39(2):136–140. doi: 10.1188/12.ONF.136-140. [DOI] [PubMed] [Google Scholar]
  14. Casey JT, Brinton TS, Gonzalez CM. Utilization of lean management principles in the ambulatory clinic setting. [Review] [35 refs] Nat Clin Pract Urol. 2009;6(3):146–153. doi: 10.1038/ncpuro1320. [DOI] [PubMed] [Google Scholar]
  15. Ford AL, Williams JA, Spencer M, McCammon C, Khoury N, Sampson TR, Panagos P, Lee JM. Reducing door-to-needle times using Toyota’s lean manufacturing principles and value stream analysis. Stroke. 2012;43(12):3395–3398. doi: 10.1161/STROKEAHA.112.670687. 3395. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Naik T, Duroseau Y, Zehtabchi S, Rinnert S, Payne R, McKenzie M, Legome E. A structured approach to transforming a large public hospital emergency department via lean methodologies. J Healthc Qual. 2012;34(2):86–97. doi: 10.1111/j.1945-1474.2011.00181.x. [DOI] [PubMed] [Google Scholar]
  17. Waldhausen JH, Avansino JR, Libby A, Sawin RS. Application of lean methods improves surgical clinic experience. J Pediatr Surg. 2010;45(7):1420–1425. doi: 10.1016/j.jpedsurg.2009.10.049. 1420. [DOI] [PubMed] [Google Scholar]
  18. McDermott AM, Kidd P, Gately M, Casey R, Burke H, O’Donnell P, Kirrane F, Dinneen SF, O’Brien T. Restructuring of the diabetes day centre: a pilot lean project in a tertiary referral centre in the west of Ireland. BMJ Qual Saf. 2013;22(8):681–688. doi: 10.1136/bmjqs-2012-001676. [DOI] [PubMed] [Google Scholar]
  19. Wood D. Taking the pulse of lean healthcare. Healthcare quarterly (Toronto, Ont) 2012;15(4):27–33. doi: 10.12927/hcq.2013.23198. [DOI] [PubMed] [Google Scholar]
  20. Blackmore CC, Bishop R, Luker S, Williams BL. Applying lean methods to improve quality and safety in surgical sterile instrument processing. Joint Comm J Qual Patient Saf. 2013;39(3):99–105. doi: 10.1016/s1553-7250(13)39014-x. [DOI] [PubMed] [Google Scholar]
  21. Barnas K. Theda Care’s business performance system: sustaining continuous daily improvement through hospital management in a lean environment. Joint Comm J Qual Patient Saf. 2011;37(9):387–399. doi: 10.1016/s1553-7250(11)37049-3. [DOI] [PubMed] [Google Scholar]
  22. Van Vliet EJ, Bredenhoff E, Sermeus W, Kop LM, Sol JC, Van Harten WH. Exploring the relation between process design and efficiency in high-volume cataract pathways from a lean thinking perspective. Int J Qual Health Care. 2011;23(1):83–93. doi: 10.1093/intqhc/mzq071. [DOI] [PubMed] [Google Scholar]
  23. Atkinson P, Mukaetova-Ladinska EB. Nurse-led liaison mental health service for older adults: service development using lean thinking methodology. J Psychosom Res. 2012;72(4):328–331. doi: 10.1016/j.jpsychores.2011.11.018. [DOI] [PubMed] [Google Scholar]
  24. Vegting IL, van Beneden M, Kramer MH, Thijs A, Kostense PJ, Nanayakkara PW. How to save costs by reducing unnecessary testing: lean thinking in clinical practice. Eur J Intern Med. 2012;23(1):70–75. doi: 10.1016/j.ejim.2011.07.003. [DOI] [PubMed] [Google Scholar]
  25. Cowley M, Domb E. Beyond Strategic Vision: Effective Corporate Action with Hoshin Planning. New York: Rutledge; 1997. [Google Scholar]
  26. Esain A, Williams S, Massey L. Combining planned and emergent change in a healthcare Lean transformation. Public Money & Management. 2008;28(1):21–26. [Google Scholar]
  27. JBA. John Black and Associates LLC. 25 Glossary. 2014. http://blog.hqc.sk.ca/wp-content/uploads/2013/09/JBA-Lean-Glossary.pdf (Accessed Jan 23, 2014)
  28. Brennan S, McKenzie JE, Whitty P, Buchan H, Green S. Continuous quality improvement: effects on professional practice and healthcare outcomes (Protocol) Cochrane Database Syst Rev. 2009;Art. No(Issue 4):CD003319. doi:10.1002/14651858.CD003319.pub2. [Google Scholar]
  29. Brackett T, Comer L, Whichello R. Do lean practices lead to more time at the bedside? J Healthc Qual. 2013;35(2):7–14. doi: 10.1111/j.1945-1474.2011.00169.x. [DOI] [PubMed] [Google Scholar]
  30. Wells GSB, O’Connell J, Robertson J, Peterson V, Welch V, Losos M, Tugwell P. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analysis. 2005. http://www.ohri.ca/programs/clinical_epidemiology/nosgen.pdf] (accessed June 26, 2014)
  31. Rowe BH, Bond K, Ospina MB, Blitz S, Friesen C, Schull M, Innes G, Afilalo M, Bullard M, Campbell SG, Curry G, Holroyd B, Yoon P, Sinclair D. Emergency department overcrowding in Canada: what are the issues and what can be done? [Technology overview no 21]. Ottawa: Canadian Agency for Drugs and Technologies in Health. 2006. http://www.cadth.ca/media/pdf/422_overcrowding_to_e.pdf.
  32. Higgins JP, Deeks JJ. In: Cochrane Handbook for Systematic Reviews of Interventions. Higgins JP, Green S, editor. Chichester, West Sussex: Wiley; 2008. Selecting studies and collecting data; pp. 151–185. [Google Scholar]
  33. Deeks JJ HJ, Alman DG. In: Cochrane Handboo for Systematic Reviews of Intervention. Higgins Jpt G, editor. Chichester, West Sussex; Hoboken NJ: Wiley; 2008. Analyzing data and undertaking meta-analyses; pp. 243–296. [Google Scholar]
  34. Shemilt I, Thomas J, Morciano M. A web-based tool for adjusting costs to a specific target currency and price year. Evidence Policy: A J Res, Debate and Practice. 2010;6(1):51–59. doi: 10.1332/174426410X482999. [DOI] [Google Scholar]
  35. Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. BMJ Econ Evaluation Working Party BMJ. 1996;313(7052):275–283. doi: 10.1136/bmj.313.7052.275. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. NICE. Public Health Guidance -Methods Manual. National Institute for Health and Clinical Excellence. 2005. https://www.nice.org.uk/guidance/cg15/resources/cg15-type-1-diabetes-in-children-and-young-people-evidence-table-2 (accessed Jan 31, 2014)
  37. Higgins JP, Deeks JJ, Altman DG. In: Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 [Updated March 2011] Higgins JPT, Green S, editor. The Cochrane Collaboration; 2011. Chapter 16: Special topics in statistics. Available from http://handbook.cochrane.org/ [Google Scholar]
  38. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–560. doi: 10.1136/bmj.327.7414.557. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1

Search Strategies Lean Review. This file contain details of the search strategy ran in a particular database (Medline).

Click here for file (144.8KB, pdf)
Additional file 2

EPOC risk of bias criteria. This file contains the suggested risk of bias for EPOC reviews.

Click here for file (118.8KB, pdf)

Articles from Systematic Reviews are provided here courtesy of BMC

RESOURCES