Skip to main content
BMJ Global Health logoLink to BMJ Global Health
. 2017 Apr 13;2(2):e000243. doi: 10.1136/bmjgh-2016-000243

Do changes to supply chains and procurement processes yield cost savings and improve availability of pharmaceuticals, vaccines or health products? A systematic review of evidence from low-income and middle-income countries

Gabriel Seidman 1, Rifat Atun 1
PMCID: PMC5435270  PMID: 28589028

Abstract

Introduction

Improving health systems performance, especially in low-resource settings facing complex disease burdens, can improve population health. Specifically, the efficiency and effectiveness of supply chains and procurement processes for pharmaceuticals, vaccines and other health products has important implications for health system performance. Pharmaceuticals, vaccines and other health products make up a large share of total health expenditure in low-income and middle-income countries (LMICs), and they are critical for delivering health services. Therefore, programmes which achieve cost savings on these expenditures may help improve a health system's efficiency, whereas programmes that increase availability of health products may improve a health system's effectiveness. This systematic review investigates whether changes to supply chains and procurement processes can achieve cost savings and/or improve the availability of drugs in LMICs.

Methods

Using the PRISMA guidelines for systematic reviews, we searched PubMed, Embase, CINAHL and the Health Economic Evaluation Database to identify.

Results

We identified 1264 articles, of which 38 were included in our study. We found evidence that centralised procurement and tendering can achieve direct cost savings, while supply chain management programmes can reduce drug stock outs and increase drug availability for populations.

Conclusions

This research identifies a broad set of programmes which can improve the ways that health systems purchase and delivery health products. On the basis of this evidence, policymakers and programme managers should examine the root causes of inefficiencies in pharmaceutical supply chain and procurement processes in order to determine how best to improve health systems performance in their specific contexts.


Key questions.

What is already known about this topic?

  • Pharmaceuticals, vaccines and other health products are an important component of a strong health system. Procurement processes and supply chains are critical for purchasing and delivering these products.

What are the new findings?

  • Centralising procurement for health products can yield cost savings across many contexts.

  • Efforts to improve supply chain management can increase the availability of health products in low-income and middle-income countries, especially by reducing stock outs. However, there is no single approach to improving supply chains that should be used in all contexts.

Recommendations for policy

  • Policymakers and practitioners should consider the root causes of programmatic challenges to purchasing and distributing health products in their context and identify specific interventions that can strengthen these processes.

Introduction

Health systems performance along key outputs, such as equity, efficiency, effectiveness and responsiveness, has important implications for population health.1 2 Specifically, maximising ‘technical efficiency’ of the health system, or the amount of outputs generated by a given cost (or other input), can increase total fiscal space for health in a country, thereby freeing up resources for additional programmes or activities.1–3 Improving the effectiveness of the health system in its delivery of services can improve population health and build trust in the health system.

Pharmaceuticals, vaccines and other health products constitute a key component of health systems by providing important treatments to populations. Pharmaceutical health expenditures make up a large share of health spending: in low-income and middle-income countries (LMICs), the total pharmaceutical expenditure as a share of total health expenditure in 2006 varied from 7.7% to 67.6%.4 Access to pharmaceuticals, such as essential medicines, remains a challenge, with only 61.5% of select essential medicines available in select LMICs.5

Improved procurement and supply chain management can reduce costs and address the problem of supply shortages,6 which adversely affect health outcomes by interrupting treatment and, in the case of certain drugs, possibly leading to drug resistance. In LMICs, where procurement and supply chain management tend to be complex and fragmented, these types of improvements can be critical for strengthening the health system.7 Changes to the procurement and supply chain processes include centralising or decentralising purchasing, improving data systems to monitor and inform purchasing (eg, early-warning systems), improving infrastructure or processes along the supply chain to reduce wastage and altering the methods for financing purchases, among others.

Given the high spending on pharmaceuticals, vaccines and other health commodities and their importance for population health outcomes, this systematic review aims to answer two questions regarding the performance of a health system: (1) do efforts to improve supply chains and procurement processes yield cost savings for health systems in LMICs, and (2) do these efforts lead to increased availability of drugs, vaccines or other health commodities in LMICs? We use these two criteria as evidence for changes to health system performance for several reasons. Both metrics are objective and captured through routine data collection in the management of many health systems. Any change in spend without a commensurate change in the quantity or quality of products purchased will indicate a change in the technical efficiency of the health system. Changes in supply availability, as measured by a reduction in stock outs or several other measures, is a useful indicator of whether health facilities (eg, hospitals, clinics and pharmacies) can effectively deliver certain services to patients.

To the best of our knowledge, no systematic review has attempted to answer these questions, which are critical for policymakers and programme managers looking to improve health systems performance and maximise population health outcomes.

Methods

This systematic review follows the criteria and methodology described in the PRISMA guidelines on systematic reviews.8

Search process and criteria

This search relied on an internal protocol developed by GS and RA. The protocol was not registered externally. We searched PubMed, Embase, CINAHL and the Health Economic Evaluation Database. The main search that was conducted on 22 March 2016 was as follows (for PubMed), with an additional search term for LMICs, and any publication from before that date was eligible for our review:

(“Materials Management, Hospital”[Mesh] OR “Pharmaceutical Preparations/supply and distribution”[Mesh] OR materials management[tiab] OR (supply chain*[tiab] AND (redesign*[tiab] OR improv*[tiab] OR oversight[tiab] OR management[tiab])) OR ((purchas*[tiab] OR procure*[tiab]) AND (“Pharmaceutical Preparations”[Mesh] OR drug*[tiab] OR medicine*[tiab] OR pharmaceutical*[tiab])))

AND

(“Cost Savings”[mesh] OR “Cost Benefit Analysis”[mesh] OR “Efficiency”[mesh] OR cost[tiab] OR costs[tiab] OR efficienc*[tiab] OR economies of scale[tiab] OR economies of scope[tiab] OR productivity[tiab] OR stock out*[tiab] OR stockout*[tiab] OR out of stock[tiab] OR drug suppl*[tiab]).

We also conducted several additional searches based on a review of citation lists from relevant publications and based on recommendations from public health researchers.

Study selection and eligibility criteria

After conducting our search, all titles were reviewed for relevance. After excluding irrelevant titles, we read all abstracts and, when appropriate, full articles to determine the relevance of the article for our research question and the availability of relevant data for inclusion. In order to be included in the study, the publication had to meet the following criteria:

  • Report on an effort, such as a program or policy intervention, aiming to improve or modify the supply chain or procurement processes for pharmaceuticals, vaccines or other health products. (For the purpose of simplicity, we often refer to all commodities under consideration in this review simply as products or health products.)

  • Report on the impact of the programme or policy on costs to the health system or availability of pharmaceuticals, vaccines or other health products. Cost comparisons could be reported using any cost ratio or change in cost figure and could report costs from the provider or patient perspective. Availability of products could be reported as the frequency of stock outs, or an indirect indicator for availability, such as number of emergency orders.

  • Report results from an actual intervention, rather than a computer model or simulation.

  • Report results from a low-income or middle-income country.

  • Be original research about an intervention published in a peer-reviewed format (as opposed to an editorial, literature review, opinion piece, interview, etc).

  • Have a complete article available (as opposed to just an abstract).

  • Be published in English.

Data collection process

In order to extract data for this review, we piloted an Excel-based data collection tool that was used to capture results from a preliminary search, the results of which were presented at the Harvard Ministerial Leadership Program in the summer of 2016. On the basis of our experience with this initial process, we modified the tool accordingly and finalised a tool which collected the following information: author, year, title, publication, abstract, country, continent, geographic level of intervention (subnational, national or international), description of the intervention, relevant outcome metric and result on relevant outcome metric. The relevant outcome metric had to involve some comparison or change in costs either from the patient or provider perspective in quantitative terms or change in product availability, and the summary measures for the review follow from these outcome metrics. Results which did not provide evidence of cost changes, such as baseline costing studies, were excluded. GS conducted a first review of all references in the search, and the list was reviewed by all coauthors in order to identify missing references or references which had been improperly included.

Risk of bias

At the level of individual studies, there is the possibility that authors are more likely to report positive outcomes (eg, programmes that resulted in cost savings or reduced stock outs) than negative outcomes. In addition, because many references describe programmatic activities that do not use experimental designs, it may be difficult to obtain the statistical significance of quantitative findings. Nonetheless, we have chosen to include all studies that report changes in costs as a result of a relevant programme in order to demonstrate to policymakers the range of potential impacts that supply chain and procurement projects can have.

Across all studies, there is also a risk that authors have publication bias or only report selective outcomes for their programmes. In addition, there is a risk that the literature under-reports findings from these kinds of programmes in general, since the peer-review process may favour rigorous experimental designs, which are not necessarily appropriate for programmatic health systems improvements, over other types of programme evaluations.

Results

Study selection

We reviewed 1264 articles and identified 25 references which specified the cost implications from changing supply chain or procurement practices—8 from Latin America, 5 from the Middle East/North Africa, 5 from Sub-Saharan Africa, 4 from Asia, 1 from Eastern Europe, 1 focused on a programme on multiple continents and 1 reporting separate results from programmes in Latin America and the Middle East. Of these 25 references, 9 reported result from a nationwide intervention, 10 from an intervention within parts of a single nation (eg, a city or region) and 6 from an intervention that spanned multiple countries. We also identified 15 studies reporting a change in availability of pharmaceuticals, vaccines or other health products as a result of these types of programmes—12 from Sub-Saharan Africa, 2 from Asia and 1 from Latin America. (Of the latter 15 studies, 2 were also included in the 25 reporting cost implications, making for a total of 38 studies included in the review.) See figure 1 for the study selection for inclusion in this systematic review.

Figure 1.

Figure 1

Study selection for inclusion in systematic review.

Of the 25 references analysing the cost implications of supply chain or procurement changes, 23 found a reduction in costs to the health system. Of these, 12 focused on cost savings from some form of centralised procurement or tendering process. The other references which demonstrated cost savings included supply chain management projects, comprehensive drug policies at the national, district or city level and other types of interventions. Of the two references that did not exclusively demonstrate savings, one reference analysed centralised procurement processes in multiple Middle Eastern countries and found that some countries achieved cost savings compared to local procurement, while other countries experienced cost increases.9 One reference that studied the impact of requiring bioequivalence studies as part of the drug procurement process found that the programme resulted in price increases due to an increased failure rate on these studies.10

Of the 15 references analysing changes in health product availability, 13 found improvements, and 8 of these were from supply chain management programmes. One reference about supply chain management programme in Tanzania found a reduction in unaccounted antimalarials and antihelminthics, but an increase in stock outs for oral rehydration salts (ORS).11 One reference about a centralised procurement process for antimalarials in Kenya found that a delay in the process, and the awarding of the tender to a relatively new, unknown company, resulted in a nationwide increase in stock outs.12

The full list of references meeting inclusion criteria can be found in tables 1 and 2.

Table 1.

Full list of references with cost implications from programmes

Author and year Level Country/region Intervention Outcome measure Results
Comprehensive drug system policy
Chaudhury et al15 (2005) Subnational India Evaluation of a comprehensive drug policy in Delhi which included development of an Essential Drugs List, a centralised pooled procurement system, and activities to promote rational drug use Total savings to the Government of Delhi from drug purchases Approximately 30% cost savings
Homedes, and Ugalde13 (2006) National Brazil Multiple interventions by the Ministry of Health, including promotion of multisource drugs, the development of the Brazilian pharmaceutical industry and the use of provisions of the TRIPS agreements to engage in aggressive price bargaining with multinational pharmaceutical manufacturers Annual cost per person of ARV treatment Costs reduced from US$4860 in 1997 to US$2530 in 2001 (48% reduction) and to about US$1000 in 2003 (60% reduction, for a total reduction of 79% in 6 years)
Li et al14 (2013) National China Evaluation of the National Essential Medicines Scheme, which included a National Essential Drugs List, a grassroots zero-mark-up policy, reimbursements for drugs on the list and public procurement of drugs Total cost of drugs in select districts for treating (1) pneumonia or bronchitis, and (2) gastroenteritis Costs decreased by 17.5% for patients with pneumonia (p<0.05) and 48.4% for patients with gastroenteritis (no significance figure reported)
Centralised procurement/tender
Adesina et al21 (2013) National Mexico Evaluation of the Mexican Commission for Price Negotiation on the price of ARV drugs Cost savings from negotiation process for 12 ARV drugs 38% reduction in total spend on ARV drugs (but prices still above those in other upper-middle-income countries)
Alabbadi19 (2011) National Jordan JPD of Jordan bids for four government agencies and aims to unify purchases of drugs and medical supplies to reduce the cost of purchased drugs Savings from joint purchasing for all drugs in first year of JPD 5.2% savings achieved; 17% savings reported when one drug (cephalexin), whose raw material prices doubled that year, excluded from analysis
Al-Abbadi et al20 (2009) National Jordan Establishment of a joint procurement system across four different government agencies Total savings to the four agencies 8.9% reduction in spend on drugs using joint procurement system
Amaral and Blatt24 (2011) Subnational Brazil Intermunicipal Health Consortium used to procure drugs for multiple municipalities after a government policy decentralising procurement to the municipality level Number of drugs with reduced unit prices 76% of drugs had a reduction in unit price within 2 years of programme implementation
Chaumont et al22 (2015) National Mexico Creation of the Coordinating Commission for Negotiating the Price of Medicines (CCNPM) to negotiate prices for drugs, especially ARVs Annual treatment cost for various ARVs in Mexico compared to HICs, UMICs, and LMICs ARV prices were ‘higher than those paid by similar upper-middle income countries’ and were higher than prices in HICs in some cases
Danzon et al49 (2015) International Brazil, China, Algeria, Egypt, India, Indonesia, Philippines, Thailand, South Africa, and French West Africa Tendered procurement by NGOs for cardiovascular and anti-infective drugs (including HIV and TB drugs) in LMICs Comparison of retail originator drug prices to tendered originators and tendered generic drugs Price for tendered originators was 42.4% less than the price for retail originators; price for tendered generics was 66.8% less than the price for retail originators
DeRoeck et al16 (2006)* International Bahrain, Kuwait, Oman, Qatar, Saudi Arabia, and the United Arab Emirates GCC group purchasing programme which centralised tender and two times a day processes Savings on price for vaccines procured through the group purchasing programme 4–46% price reduction on six vaccines
DeRoeck et al16 (2006)* International Latin America PAHO EPI Revolving Fund, which purchases vaccines and immunizations on behalf of countries in Latin America and the Caribbean Savings on price for vaccines procured through Revolving Fund vs those supplied directly to countries before creation of the fund 70–82% price savings on vaccines and immunisations
Ewen et al9 (2014) International Palestine (Gaza/The West Bank), Jordan, Lebanon, Syria Comparison of different procurement mechanisms for drugs by the United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA); analysis of price differences when drugs procured using central tender vs locally by each field site Prices of medicines including antidiabetic medicines, antimicrobials, antihypertensives and antipyretics Syria paid 20% less for drugs procured locally; Lebanon paid 83% more for drugs procured locally and West Bank paying 128% more for drugs procured locally
Gomez-Dantes et al23 (2012) National Mexico Introduction of the Coordinating Commission for Negotiating the Price of Medicines and other health inputs (CCPNM) in 2008 Annual direct savings on public expenditure for public medicines since introduction of CCPNM Annual savings from US$52.1 million—US$121.8 million in the first four years of CCPNM
Huff-Rousselle and Burnett18 (1996) International Caribbean ECDS, which provides pooled procurement services to nine small island nations Average savings on drugs procured through ECDS after first tender cycle 16.1–66.1% savings across different countries
Khoja and Bawazir17 (2005) International Bahrain, Kuwait, Oman, Qatar, Saudi Arabia, and the United Arab Emirates Group purchasing agreement among six countries via the GCC Total cost savings to member countries ‘According to a study performed by GCC Executive Offices in 1992, total of US$33 million was saved by the five GCC states. Furthermore, more than US$11 million was saved by 3 GCC states in 2001.’
Milovanovic et al25 (2004) Subnational Serbia Evaluation of a drug tender process of 479 drug formulations by a university hospital Cost savings compared to free market price 17.2% cost savings from drug tender compared to free market price for basket of drugs purchased
Sigulem and Zucchi26 (2009) Subnational Brazil E-procurement tool used to facilitate joint purchasing of medications by multiple hospitals within a network Change in unit price of drugs from (1) before joint purchasing to beginning of joint purchasing, and (2) from beginning of joint purchasing to last joint purchase over 2-year period Of 37 drugs included, 34 showed price reductions after implementation of e-procurement system, and 27 showed further decreases in price over the following 2 years
Supply chain management
Hamel et al50 (2015) Subnational Nigeria Programme to strengthen laboratory services in hospitals and clinics, with procurement of more efficient equipment, laboratory modifications, supply chain management and trainings; programme involved securing reduced reagent costs due to high volume of regular laboratory tests Reduction in cost/test for specific tests CD4+ cell count test reduced from US$22/test to US$2/test; routine chemistry tests (such as alanine aminotransferase) reduced from >US$1/test to US$0.29/test; viral load tests reduced from US$33/test to US$14/test
Lloyd et al (2015)51 Subnational Tunisia Modification of methods to store and transport vaccines, including the use of electric utility vehicles for regular deliveries Energy costs for storage and distribution of vaccines 20.16% reduction in costs after implementation of supply chain improvements
Riewpaiboon et al27 (2015) National Thailand Transition to VMI system to manage vaccine supply chain Total cost per dose of vaccine procured Costs increased from US$1.35 (conventional system) to US$1.43 (VMI)
Other
Bevilacqua et al10 (2011) Subnational Brazil Study of the impact of requiring bioequivalence and/or bioavailability studies as part of the procurement of generic medicines Change in total procurement cost of the same quantity of 150 medicines before and after the policy Total costs increased by 87% after implementation of the policy because test failure rates increased from 2.6% before the policy to 56.9% after the policy
Maiga et al38 (2003) Subnational Mali Comparison of city (Niono) where public health system regularly supplies drugs with another city (Koutiala) where public health system does not supply drugs, limiting supply to availability in private sector Cost of drugs to consumers after accounting for the content of transactions (ie, type and quantity of drugs) Drugs cost 32% less in city where public health system supplied drugs
Ramani39 (2006) Subnational India Implementation of a reengineered, IT-enabled system to purchase hospital supplies Cost to purchase common items 7.7% reduction in cost of purchase for common items after implementation of system
Thuray et al40 (1997) National Sierra Leone Procurement of drugs and supplies directly from commercial supplier, rather than through standard governmental channels, by a PMM team under the Ministry of Health and with external partner support Reduction in total costs for drugs and supplies associated with select obstetric procedures in conditions (comparison between PMM costs vs hospital pharmacy costs) 28% price reduction for treating sepsis/induced abortion (non-surgical); 30% price reduction for treating eclampsia; 49% price reduction for obstetric surgery; 54% price reduction for treating postpartum haemorrhage
Tougher et al36 (2012) International Ghana, Kenya, Madagascar, Niger, Nigeria, Uganda, and Tanzania Evaluation of the AMFm, which included price reductions through negotiations with manufacturers of QAACTs; a buyer subsidy, via a copayment by the Global Fund to participating manufacturers, for purchases made by eligible public, private and non-governmental organisation importers; and interventions to support AMFm implementation and promote appropriate antimalarial use Manufacturer price of QAACTs sold to private, for-profit buyers; median price of QAACTs sold in the private, for-profit sector Manufacturer price reduced 29–78% depending on package size; Median price to consumers dropped in all seven pilot countries, with a statistically significant drop (p<0.0001) for five of seven countries
Witter (2007)52 Subnational Sudan RDF which oversees procurement, distribution and sale of drugs Prices of drugs for its list of essential drugs Drugs 40% cheaper than CMSPO and 100% cheaper than private sector outlets

*Note that these entries refer to the same citation, which reports results from two different programmes.

AMFm, Affordable Medicines Facility-malaria; ARV, antiretroviral treatments; CCNPM, Coordinating Commission for Negotiating the Price of Medicines; CMSPO, Central Medical Supplies Public Organisation; ECDS, Eastern Caribbean Drug Service; EPI, Expanded Programme on Immunisation; GCC, Gulf Cooperation Council; HICs, high-income countries; JPD, Joint Procurement Directorate; LMICs, low-income and middle-income countries; PAHO, Pan-American Health Organization; PMM, preventing maternal mortality; QAACTs, quality-assured ACTs; RDF, revolving drug fund; UMICs, upper-middle income countries; VMI, vendor managed inventory.

Table 2.

Full list of references with drug availability implications from programmes

Author and year Level Country/region Intervention Outcome measure Results
Comprehensive drug system policies
Chaudhury et al (2005)15 Subnational India Evaluation of a comprehensive drug policy in Delhi which included development of an Essential Drugs List, a centralised pooled procurement system and activities to promote rational drug use Percentage availability of key drugs (eg, amoxicillin, cloxacillin) before and after implementation of centralised pooled procurement system Key drug availability increased from 40% to 70% before implementation of system to >90% after implementation
Centralised procurement/tendering
Tren et al (2009)12 National Kenya Requirement by the Global Fund that Kenya purchase 75% of its annual order for first-line treatment of uncomplicated malaria (ALU) through an international open tender Availability of ALU after tender process Owing to tender process, which was delayed and which ended up purchasing drugs from a relatively new and unknown company, Kenya “was experiencing wide stock-outs of ALU and had to place emergency orders with the President's Malaria Initiative”
Supply chain management
Alayande et al (2016)30 Subnational Nigeria UNFPA-supported programme to increase distribution of contraceptives, which involved bimonthly meetings attended by reproductive health coordinators, family planning providers and representatives from the State health team to review commodity inventory and replenish stock Annual average rate of contraceptive stock unavailability Reduction from 30% in 2012 to 24.1% in 2013
Berger et al (2007)31 Subnational Haiti Evaluation of a web-based stock management system for rural clinics Reduction in stockouts (eg, for ARVs) from initial rollout of system to end of first year Stockouts reduced from 2.6% to 1.1% (p<0.001) in 1 year
Bukhari et al (2010)47 National Pakistan Evaluation of 12 guidelines focused on supply and management of essential medicines during emergencies Per cent of donated medicine wasted during a disaster 1.3% wastage per annum in Pakistan, compared to 20–70% in other benchmark disasters
Daff et al (2014)32 Subnational Senegal Evaluation of the IPM, which brings deliveries of drugs closer to clients in health facilities Levels of stockouts for four types of contraceptives: IUDs, implants, injectables and pills Stockouts for all four types of contraceptives reduced to 0% within 6 months from baseline of 14% for IUDs, 86% for implants, 57% for injectables and 57% for pills
Mikkelsen-Lopez et al (2014)11 Subnational Tanzania Evaluation of a transition from a central ‘push’ system for drug delivery to a ‘pull’ ILS Percentage of unaccounted antihelminthics, antimalarials and ORS before and after system implemented Unaccounted for antimalarials decreased from 59.8% to 17.8% (p<0.05); unaccounted for antihelmintics decreased from 81.9% to 71.1% (p<0.05); unaccounted for ORS increased from 63.8% to 80.7% (p<0.05)
Namisango et al (2016)28 Subnational Uganda mHealth application used to track supply chain and service delivery information Reduction in emergency orders after implementing the mHealth application Reduction from five times per quarter to two times per quarter
Shieshia et al (2014)29 Subnational Malawi Comparison of an EPT supply chain intervention, which focused on improving product flow and data flow, with an EM intervention, which focused on product flow, data flow and improving the effectiveness of the people by promoting team performance Mean percentage stockout rate over 18 months for six drugs (cotrimoxazole, LA 1×6, LA 2×6, ORS, paracetamol, and zinc) EM resulted in lower stockout rates for all six drugs (p<0.001 for all six drugs)
Steyn et al (2009)48 Subnational South Africa Comprehensive plan with ‘investments to upgrade the national drug distribution system at all levels of the healthcare system’, with particularly strict requirements to dispense ARV drugs Availability of essential drugs and supplies for HIV care other than ARV medication (eg, antibiotics and anti-TB medications) At baseline, 8 of 15 essential HIV care items not available at all facilities, but 2 years after intervention, only 3 of 15 items not available at all facilities
Tumwine et al (2010)33 Subnational Uganda Implementation of a ‘pull system’ for ordering drugs at a rural hospital, in which health units had to determine the types and quantities of medicines and medical supplies needed Median days out of stock for drugs, and average % days out-of-stock for drugs (eg, amoxicillin, diclofenac) Median out-of-stock days reduced from 94 to 24 (p<0.001); average % out-of-stock days reduced from 15.3% to 3.5% (p<0.001)
Other
Knippenberg (1997)34 Subnational Guinea Evaluation of the Bamako Initiative—a RDF Availability of vaccines Increase from 86% in 1991 to 100% 1 year later
Sabot et al (2009)37 Subnational Tanzania Evaluation of impact of subsidy on ex-factory price of ACTs as a pilot to test the AMFm model Per cent of shops stocking ACTs Increase from 0% of shops stocking ACTs before pilot to 72.2% of shops stocking ACTs 1 year later (p<0.001)
Tougher et al (2012)36 International Ghana, Kenya, Madagascar, Niger, Nigeria, Uganda, and Tanzania (and Zanzibar as a separate site) Evaluation of AMFm pilot, which included price reductions through negotiations on QAACTs, a buyer subsidy, and interventions to support AMFm implementation Achievement of a benchmark to show an increase of 20 percentage points from baseline to end point in the availability of QAACT among all outlets stocking antimalarial treatment All eight sites showed an increase in availability of QAACTs, and five of eight sites showed either a statistically significant chance of achieving the benchmark or a definitive demonstration of achieving the benchmark
Uzochukwu et al (2002)35 Subnational Nigeria Evaluation of the Bamako Initiative—a RDF Number of essential drugs available Average of 35.4 essential drugs available in Bamako Initiative facilities, compared with 15.3 essential drugs in other facilities (p<0.05)

AMFm, Affordable Medicines Facility-malaria; ARV, antiretroviral treatment; EM, enhanced management; EPT, efficient product transport; ILS, Integrated Logistics System; IPM, Informed Push Distribution Model; QAACTs, quality-assured ACTs; RDF, revolving drug fund.

Comprehensive drug system policies

Three references described comprehensive policies and programmes to improve drug procurement and supply chains at either the national or municipal level. In Brazil, a series of policies by the Ministry of Health aimed to promote the use of multisource drugs (those which can be purchased from multiple manufacturers or distributors), development of the national pharmaceutical industry and aggressive price bargaining for select drugs, such as antiretroviral treatments (ARVs), under the provisions in the TRIPS agreement.13 These initiatives resulted in a 79% reduction in the annual cost per person of ARVs in 6 years (from 1997 to 2003).

In China, the National Essential Medicines Scheme, established in 2009 as part of broader health sector reform, included four components: a National Essential Drugs List, a zero-mark-up policy, reimbursement for drugs on the Essential Drugs List and public procurement of drugs.14 An evaluation of this scheme in three provinces found that it resulted in a 17.5% reduction in cost of drugs needed to treat pneumonia or bronchitis (p<0.05) and a 48.4% reduction in cost of drugs needed to treat gastroenteritis (statistical significance not reported).

In Delhi, India, a 1997 comprehensive drug policy included the development of an Essential Drugs List, a central pooled procurement system and programmatic activities to promote rational drug use.15 This policy was found to result in 30% savings on the cost of drugs to the Government of Delhi and to increase the availability of key drugs from 40% to 70% before the policy's implementation to >90% after its implementation.

Centralised procurement and tendering processes

We found the most references demonstrating cost savings from centralised procurement and tendering processes. These references included joint procurement across multiple countries, including the Gulf Cooperation Council (GCC) of Bahrain, Kuwait, Oman, Qatar, Saudi Arabia and UAE,16 17 the PAHO Expanded Program on Immunisation (EPI) which included many Latin American countries16 and the Eastern Caribbean Drug Service (ECDS) which serviced nine small Caribbean countries.18 We found references from two countries—Jordan and Mexico—that described centralised procurement at the national level. In Jordan, a Joint Procurement Directorate bids for drugs across four different government agencies, and this programme achieved 5.2–17% cost savings on drugs procured.19 20 In Mexico, a Commission to purchase ARVs and other drugs established in 2008 achieved cost savings of US$52.1 million—US$121.8 million in its first 4 years, although the prices for ARVs were still above those of other upper-middle income countries.21–23 At the subnational level, references found cost savings from an Intermunicipal Health Consortium which coordinated procurement for multiple municipalities in Brazil24 and centralised procurement at hospitals or hospital systems in Serbia25 and Brazil.26 No references found that centralised procurement reduced stock outs or improved availability of health products.

Supply chain/cold chain management

Three references identified cost savings from efforts to improve supply chain management. Of these three references, one programme in Nigeria aimed at strengthening laboratory services in hospitals reduced the costs of conducting laboratory tests by increasing the total volume of tests and then purchasing reagents in bulk at reduced costs. Another reference found that a modification of methods to store and transport vaccines in Tunisia resulted in a 20.16% reduction in energy costs for vaccine storage and distribution. A third reference found that transitioning to a vendor-managed inventory (VMI) system, in which customers automatically send inventory information to the supplier who then creates and fills order to replenish the inventory, resulted in an increase in unit costs per vaccine, but reductions in total logistics costs and unopened phial wastage led to an 18% reduction in overall programme costs.27

An additional eight studies found improvements in availability of health products from supply chain management programmes, suggesting that these initiatives can improve health systems performance by ensuring access to products for populations. For example, certain references documented programmes to improve data systems or processes to track and monitor drug inventory, including an mHealth application,28 improved human-related processes and meetings relating to the supply chain,29 30 and a web-based stock management system for rural clinics in Haiti.31 Three references identified programmes that changed the process for ordering drugs: one programme in Senegal used an informed Push Model, in which projected demand dictates quantities of drug orders, to reduce stock outs for contraceptives,32 whereas a Pull Model, which uses clinic or customer demand to inform drug orders, improved drug availability in Tanzania and Uganda.11 33

Other types of programmes

In addition to the types of programmes listed above, we found limited evidence for the impact of a number of other types of initiatives related to supply chain management or procurement on health systems costs and availability of health products. Three references described revolving drug funds (RDFs), which maintain drug inventory by beginning with an initial donation or free contribution of drugs, and then maintaining inventory by selling these drugs at cost (plus a mark-up in some cases) and then purchasing replacement drugs. One reference found that in South Sudan, drug prices were 40% cheaper in the RDF than those purchased by the Central Medical Supplies Public Organisation, and two references found increased availability of vaccines or essential drugs in RDFs in Guinea34 and Nigeria.35 Two references reported on the Affordable Medicines Facility-malaria (AMFm), which provided subsidies to manufacturers of artemisinin-based combination therapies (ACT) at the global level, and which resulted in price reductions for ACTs to consumers36 and increased availability of ACTs in various countries in Sub-Saharan Africa.36 37 Other references reported cost savings from public procurement of drugs (compared to private sector only) in Mali,38 the implementation of an IT system to purchase hospital supplies in India39 and the direct purchase of drugs from commercial suppliers rather than through government channels in Sierra Leone.40

Discussion

With this review, we aimed to synthesise the evidence on whether programmes to improve supply chain and procurement can achieve cost savings or improve health product availability in LMICs. Our findings indicate that multiple approaches to strengthening purchasing and supply systems in LMICs can improve the system's performance. These findings have significant implications for policymakers, discussed below. They also have limitations, discussed in the next section.

Opportunities to improve procurement and supply exist at every level of the health system

The breadth of findings in this review suggests that governments and other organisations can take multiple approaches to improving the procurement and delivery of health products. On the one end of the spectrum, the AMFm represents an example of a comprehensive, international agreement that built on existing global governance structures to improve availability of antimalarials. Our review also included examples of national programmes to improve drug supply, such as those in China, Brazil and Mexico, and initiatives all the way down to the clinic and community levels. These findings suggest that there is no ‘one-size-fits-all’ approach to improving the performance of health systems and the provision of health products. Therefore, we believe that policymakers should use a problem-driven approach to understanding and addressing the root causes of problems in their drug procurement and supply systems.

Different supply chain management systems can yield similar results in different contexts

Following from the point above, it is worth noting that our review identified a variety of techniques to strengthen supply chains in different countries, and, in some cases, these approaches conflicted with each other. Indeed, our review identified references that demonstrated improved drug availability from ‘pull’ and ‘push’ systems, which take opposite approaches in how to determine drug order quantities. Similarly, some references focused on using technology to improve inventory management, while others focused on improving teamwork and the human elements of supply chain management, and both types of initiatives achieved positives results. These findings further reinforce our point that policymakers and programme managers should examine the specific context of their systems and identify root causes of their inefficiencies in order to determine how to improve them.

Centralised procurement has the potential to achieve cost savings across many contexts

In contrast to the first two points, which emphasise that different contexts require different types of interventions in order to achieve improvements in health system performance, we found that centralised procurement/tendering achieved cost savings in the Middle East, Brazil, the Caribbean, Mexico, other parts of Latin America and several countries in Asia and Africa. It also achieved cost savings when centralising procurement across countries, within a single country, or across multiple municipalities or health centres. Although centralised procurement is certainly not a panacea for improving health systems efficiency, these findings suggest that by creating economies of scale and improved purchasing power, centralised procurement and tendering can reduce health systems costs in many contexts. This is a particularly noteworthy finding since many countries are moving to decentralise their health systems.41 42

Limitations of the evidence, risks of bias and directions for future research

This systematic review has several limitations that are worth noting. First, the studies included in this review used many different types of metrics to quantify the impact of supply chain and procurement programmes on health systems costs and product availability. Because of this situation, it is difficult to compare or synthesise findings across studies. When analysing impacts on health systems costs, references used metrics such as total absolute cost savings, cost savings as a percentage of spend in previous years and percentage of individual products which had lower costs from 1 year to another. They also use costs to the health system and to the patient; changes to costs to the patient may not actually reflect a change to health systems efficiency. Further, since efficiency is achieved by a reduction in costs without a commensurate reduction in (quality of) outputs, or vice versa, but many studies only report total cost savings, it is difficult to determine conclusively that these cost savings result in a true efficiency improvement to the health system. (On the other hand, studies which demonstrate a reduction in cost per drug or cost per person treated do likely reflect an improvement in efficiency.)

Second, because these findings are context-specific, one cannot predict the impact that a specific programme reported in this review would have in another context. Although the body of evidence presented in this study suggests that health systems can improve their performance by undertaking efforts to improve supply chain and procurement processes, policymakers and programme managers must keep in mind that the most effective programmes tend to achieve improvements when they address the root causes of inefficiencies in the system, so a programme that works in one context may fail in another.

Third, reductions in costs and improvements in drug availability both improve health system performance, but in different ways. As already discussed, cost reductions can serve as a proxy indicator for efficiency improvements. On the other hand, increases in availability of products can improve the effectiveness of health facilities providing services. Although stock out reductions may result in indirect cost savings (eg, by reducing how often patients default from drug treatment), they may also increase costs simply because the health system has to purchase and provide more drugs (paid for either by institutional payers or patients). Weighing the importance of reducing costs versus increasing the availability of health products is the job of practitioners and cannot be determined by this review.

Fourth, even though we find that many programmes either reduce costs or improve drug availability, these interventions have other shortcomings which limit their effectiveness as interventions to improve health systems performance. For example, implementation of RDFs has had many challenges, such as fund decapitalisation due to unanticipated changes in procurement costs, inflation or exchange rates, failure to recover costs and other issues.43 Centralised or pooled procurement may require increased coordination and governance arrangements among purchasers, and it may be important to avoid relying exclusively on a single supplier to ensure that alternative supplies are available, especially in the case of emergencies.44 VMI can lead to challenges, inter alia, integrating technologies between customer and supplier and dependency on the supplier for monitoring inventory.45 Describing the advantages and limitations of each of these types of programmes is beyond the scope of this review. We recommend that practitioners consult a reference text, such MDS-3: Managing Access to Medicines and Health Technologies, for detailed information on the logistical considerations for different types of supply chain and procurement programmes.46

Finally, as discussed already, biases in the publication of individual studies limit the generalisability of study. In particular, there are very few studies which reported negative outcomes from supply chain or procurement improvement programmes; our experience working in health systems in LMICs suggests that it is very unlikely that so few programmes fail. Therefore, the results of this study are likely biased by researchers tending only to publish positive outcomes from these types of initiatives. Nonetheless, the research still provides compelling evidence that these types of programmes can help improve health systems performance when implemented properly.

In the future, we recommend that researchers, programme planners and policymakers should work together to better understand which types of supply chain and procurement programmes can improve health systems performance in which types of contexts. It is also important to understand better the key barriers and enablers of success for these types of programmes. Health systems experts should also identify a common set of indicators and metrics for measuring improvements in supply chains in order to standardise reporting and simplify comparisons across programmes. These may include the metrics used in this research, or other key indicators such as the frequency of counterfeit medicines and the frequency of medicine expirations.

Conclusions

This systematic review aimed to determine whether efforts to improve procurement and supply chains for pharmaceuticals, vaccines and other health products can achieve cost savings and improve drug availability in LMICs. Our findings indicate that many different types of initiatives can achieve these improvements. While the evidence suggests that centralised procurement has the potential to improve efficiency across multiple contexts, other efforts require more context-specific implementation.

Acknowledgments

The authors thank Michael Sinclair and Brian Dugan from the Harvard Ministerial Leadership Program for their support in preparation of this report. The authors thank Paul Bain at the Harvard Library for help developing the search strategy for this review.

Footnotes

Handling editor: Seye Abimbola.

Contributors: GS and RA jointly conceived of the concept for this paper. GS designed the search methodology with a Harvard librarian, screened all references and drafted the initial manuscript. RA checked the final list of references included. GS and RA revised subsequent versions of the manuscript.

Funding: An original draft of this paper was commissioned by the Harvard Ministerial Leadership Program, a joint initiative of the Harvard TH Chan School of Public Health, Harvard Kennedy School of Government and the Harvard Graduate School of Education in collaboration with Big Win Philanthropy and with the support of the Bill and Melinda Gates Foundation, Bloomberg Philanthropies, the GE Foundation and the Rockefeller Foundation.

Competing interests: None declared.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data sharing statement: No additional data are available.

References

  • 1.Seidman G, Atun R. Aligning values and outcomes in priority-setting for health. J Glob Health 2016;6:020308 10.7189/jogh.06.020308 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Roberts M, Hsiao W, Berman P et al. . Getting health reform right: a guide to improving performance and equity. Oxford: Oxford University Press, 2008. [Google Scholar]
  • 3.Tandon A, Cashin C. Assessing public expenditure on health from a fiscal space perspective. In: HNP Discussion Paper. The World Bank: Washington DC, 2010.
  • 4.Lu Y, Hernandez P, Abegunde D, et al. The World Medicines Situation 2011: medicine expenditures. 2011 (cited 1 October 2016). http://www.who.int/health-accounts/documentation/world_medicine_situation.pdf.
  • 5.Bazargani YT, Ewen M, De Boer A et al. . Essential medicines are more available than other medicines around the globe. PLoS One 2014;9:e87576 10.1371/journal.pone.0087576 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.World Health Organization. Addressing the global shortage of medicines, and the safety and accessibility of children's medication. 2015 (cited 15 March 2016). http://apps.who.int/gb/ebwha/pdf_files/EB138/B138_41-en.pdf
  • 7.Committee on Understanding the Global Public Health Implications of Substandard Falsified and Counterfeit Medical Products. weaknesses in the drug distribution chain. In: Buckley G, Gostin L, eds. Countering the problem of falsified and substandard drugs. Washington: (DC: ): National Academies Press (US), 2013. [PubMed] [Google Scholar]
  • 8. PRISMA. PRISMA: transparent reporting of systematic reviews and meta-analyses. 2015 (cited 6 September 2016). http://www.prisma-statement.org/
  • 9.Ewen M, Al Sakit M, Saadeh R et al. . Comparative assessment of medicine procurement prices in the United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA). J Pharm Policy Pract 2014;7:13 10.1186/2052-3211-7-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Bevilacqua G, Farias MR, Blatt CR. Procurement of generic medicines in a medium size municipality. Rev Saude Publica 2011;45:583–9. 10.1590/S0034-89102011005000020 [DOI] [PubMed] [Google Scholar]
  • 11.Mikkelsen-Lopez I, Cowley P, Kasale H et al. . Essential medicines in Tanzania: does the new delivery system improve supply and accountability? Health Syst (Basingstoke) 2014;3:74–81. 10.1057/hs.2013.14 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Tren R, Hess K, Bate R. Drug procurement, the Global Fund and misguided competition policies. Malar J 2009;8:305 10.1186/1475-2875-8-305 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Homedes N, Ugalde A. Improving access to pharmaceuticals in Brazil and Argentina. Health Policy Plan 2006;21:123–31. 10.1093/heapol/czj011 [DOI] [PubMed] [Google Scholar]
  • 14.Li Y, Ying C, Sufang G et al. . Evaluation, in three provinces, of the introduction and impact of China's National Essential Medicines Scheme. Bull World Health Organ 2013;91:184–94. 10.2471/BLT.11.097998 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Chaudhury RR, Parameswar R, Gupta U et al. . Quality medicines for the poor: experience of the Delhi programme on rational use of drugs. Health Policy Plan 2005;20:124–36. 10.1093/heapol/czi015 [DOI] [PubMed] [Google Scholar]
  • 16.Deroeck D, Bawazir SA, Carrasco P et al. . Regional group purchasing of vaccines: review of the Pan American Health Organization EPI revolving fund and the Gulf Cooperation Council group purchasing program. Int J Health Plann Manag 2006;21:23–43. 10.1002/hpm.822 [DOI] [PubMed] [Google Scholar]
  • 17.Khoja TA, Bawazir SA. Group purchasing of pharmaceuticals and medical supplies by the Gulf Cooperation Council states. East Mediterr Health J 2005;11:217–25. [PubMed] [Google Scholar]
  • 18.Huff-Rousselle M, Burnett F. Cost containment through pharmaceutical procurement: a Caribbean case study. Int J Health Plann Manage 1996;11:135–57. [DOI] [PubMed] [Google Scholar]
  • 19.Alabbadi I. Cost impact of purchasing pharmaceuticals jointly in the public health sector in Jordan. Jordan J Pharm Sci 2011;4:97–104. [Google Scholar]
  • 20.Al-Abbadi I, Qawwas A, Jaafreh M et al. . One-year assessment of joint procurement of pharmaceuticals in the public health sector in Jordan. Clin Ther 2009;31:1335–44. 10.1016/j.clinthera.2009.05.021 [DOI] [PubMed] [Google Scholar]
  • 21.Adesina A, Wirtz VJ, Dratler S. Reforming antiretroviral price negotiations and public procurement: the Mexican experience. Health Policy Plan 2013;28:1–10. 10.1093/heapol/czs015 [DOI] [PubMed] [Google Scholar]
  • 22.Chaumont C, Bautista-Arredondo S, Calva JJ et al. . Antiretroviral purchasing and prescription practices in Mexico: constraints, challenges and opportunities. Salud Publica Mex 2015;57(Suppl 2):s171–82. 10.21149/spm.v57s2.7606 [DOI] [PubMed] [Google Scholar]
  • 23.Gomez-Dantes O, Wirtz V, Reich M et al. . A new entity for the negotiation of public procurement prices for patented medicines in Mexico. Bull World Health Organ 2012;90:788–92. 5 10.2471/BLT.12.106633 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Amaral SM, Blatt CR. Municipal consortia for medicine procurement: impact on the stock-out and budget. Rev Saude Publica 2011;45:799–801. 10.1590/S0034-89102011005000016 [DOI] [PubMed] [Google Scholar]
  • 25.Milovanovic DR, Pavlovic R, Folic M et al. . Public drug procurement: the lessons from a drug tender in a teaching hospital of a transition country. Eur J Clin Pharmacol 2004;60:149–53. 10.1007/s00228-004-0736-1 [DOI] [PubMed] [Google Scholar]
  • 26.Sigulem F, Zucchi P. E-procurement in the Brazilian healthcare system: the impact of joint drug purchases by a hospital network. Rev Panam Salud Publica 2009;26:429–34. [PubMed] [Google Scholar]
  • 27.Riewpaiboon A, Sooksriwong C, Chaiyakunapruk N et al. . Optimizing national immunization program supply chain management in Thailand: an economic analysis. Public Health 2015;129:899–906. 10.1016/j.puhe.2015.04.016 [DOI] [PubMed] [Google Scholar]
  • 28.Namisango E, Ntege C, Luyirika EB et al. . Strengthening pharmaceutical systems for palliative care services in resource limited settings: piloting a mHealth application across a rural and urban setting in Uganda. BMC Palliat Care 2016;15:20 10.1186/s12904-016-0092-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Shieshia M, Noel M, Andersson S et al. . Strengthening community health supply chain performance through an integrated approach: using mHealth technology and multilevel teams in Malawi. J Glob Health 2014;4:020406 10.7189/jogh.04.020406 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Alayande A, Mamman-Daura F, Adedeji O et al. . Midwives as drivers of reproductive health commodity security in Kaduna State, Nigeria. Eur J Contracept Reprod Health Care 2016;21:207–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Berger EJ, Jazayeri D, Sauveur M et al. . Implementation and evaluation of a web based system for pharmacy stock management in rural Haiti. AMIA Annu Symp Proc 2007:46–50. [PMC free article] [PubMed] [Google Scholar]
  • 32.Daff BM, Seck C, Belkhayat H et al. . Informed push distribution of contraceptives in Senegal reduces stockouts and improves quality of family planning services. Glob Health Sci Pract 2014;2:245–52. 10.9745/GHSP-D-13-00171 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Tumwine Y, Kutyabami P, Odoi RA et al. . Availability and expiry of essential medicines and supplies during the ‘Pull’ and ‘Push’ drug acquisition systems in a Rural Ugandan Hospital. Trop J Pharm Res 2010;9:557–64. [Google Scholar]
  • 34.Knippenberg R, Alihonou E, Soucat A et al. . Implementation of the Bamako initiative: strategies in Benin and Guinea. Int J Health Plann Manage 1997;12(Suppl 1):S29–47. [DOI] [PubMed] [Google Scholar]
  • 35.Uzochukwu BS, Onwujekwe OE, Akpala CO. Effect of the Bamako-Initiative drug revolving fund on availability and rational use of essential drugs in primary health care facilities in south-east Nigeria. Health Policy Plan 2002;17:378–83. 10.1093/heapol/17.4.378 [DOI] [PubMed] [Google Scholar]
  • 36.Tougher S, Ye Y, Amuasi JH et al. . Effect of the Affordable Medicines Facility-malaria (AMFm) on the availability, price, and market share of quality-assured artemisinin-based combination therapies in seven countries: a before-and-after analysis of outlet survey data. Lancet 2012;380:1916–26. 10.1016/S0140-6736(12)61732-2 [DOI] [PubMed] [Google Scholar]
  • 37.Sabot OJ, Mwita A, Cohen JM et al. . Piloting the global subsidy: the impact of subsidized artemisinin-based combination therapies distributed through private drug shops in rural Tanzania. PLoS One 2009;4:e6857 10.1371/journal.pone.0006857 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Maiga FI, Haddad S, Fournier P et al. . Public and private sector responses to essential drugs policies: a multilevel analysis of drug prescription and selling practices in Mali. Soc Sci Med 2003;57:937–48. 10.1016/S0277-9536(02)00462-8 [DOI] [PubMed] [Google Scholar]
  • 39.Ramani KV. Managing hospital supplies: process reengineering at Gujarat Cancer Research Institute, India. J Health Organ Manag 2006;20:218–26. 10.1108/14777260610662744 [DOI] [PubMed] [Google Scholar]
  • 40.Thuray H, Samai O, Fofana P et al. . Establishing a cost recovery system for drugs, Bo, Sierra Leone. Int J Gynaecol Obstet 1997;59(SUPPL 2):S141–7. 10.1016/S0020-7292(97)00159-8 [DOI] [PubMed] [Google Scholar]
  • 41.Bossert TJ, Beauvais JC. Decentralization of health systems in Ghana, Zambia, Uganda and the Philippines: a comparative analysis of decision space. Health Policy Plan 2002;17:14–31. 10.1093/heapol/17.1.14 [DOI] [PubMed] [Google Scholar]
  • 42.Bossert TJ, bowser DM, Amenyah JK. Is decentralization good for logistics systems? Evidence on essential medicine logistics in Ghana and Guatemala. Health Policy Plan 2007;22:73–82. [DOI] [PubMed] [Google Scholar]
  • 43.Embrey M. Chapter 13: Revolving drug funds and user fees. In: Management Sciences for Health, eds MDS-3: managing access to medicines and health technologies. Arlington: (VA: ): Management Sciences for Health, 2012. [Google Scholar]
  • 44.Barraclough A, Clark M. Chapter 18: managing procurement. In: Management Sciences for Health, eds MSD-3 managing access to medicines and health technologies. Arlington (VA): Management Sciences for Health, 2012. [Google Scholar]
  • 45.Battini D, Hassinivassiliki Manthou E. Vendor managed inventory (VMI): evidences from lean deployment in healthcare. Strat. Outsourcing 2013;6:8–24. 10.1108/so.2013.35706aaa.001 [DOI] [Google Scholar]
  • 46.Management Sciences for Health. MDS-3: managing access to medicines and health technologies. Arlington (VA): Management Sciences for Health, 2012. [Google Scholar]
  • 47.Bukhari SK, Qureshi JA, Jooma R et al. . Essential medicines management during emergencies in Pakistan. East Mediterr Health J 2010;16:S106–13. [PubMed] [Google Scholar]
  • 48.Steyn F, Schneider H, Engelbrecht MC et al. . Scaling up access to antiretroviral drugs in a middle-income country: public sector drug delivery in the Free State, South Africa. AIDS Care 2009;21:1–6. 10.1080/09540120903131138 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Danzon PM, Mulcahy AW, Towse AK. Pharmaceutical pricing in emerging markets: effects of income, competition, and procurement. Health Economics 2015;24:238–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Hamel DJ, Sankale JL, Samuels JO, et al. doi: 10.4102/ajlm.v4i1.190. Building laboratory capacity to support HIV care in Nigeria: Harvard/APIN PEPFAR, 2004-2012. Afr J Lab Med 2015;4(1). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Lloyd J, Sankale JL, McCarney S, Ouhichi R et al. . Optimizing energy for a ‘green’ vaccine supply chain. Vaccine 2015;33:908–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Witter S. Achieving sustainability, quality and access: lessons from the world's largest revolving drug fund in Khartoum. East Mediterr Health J 2007;13:1476–85. [DOI] [PubMed] [Google Scholar]

Articles from BMJ Global Health are provided here courtesy of BMJ Publishing Group

RESOURCES