Abstract
Introduction
There are increasing concerns regarding the inappropriate use of medicines with expenditure continuing to grow driven by increasing sales in oncology and orphan diseases, enhanced by their emotive nature. As a result, even high income countries are struggling to fund new premium priced medicines. These concerns have resulted in initiatives to better manage the entry of new medicines and enhance the rational use of medicines (RUM). However, there is a need to ascertain the current situation. We sought to address this by developing the Current Obstacles for Rationalizing Use of Medicines in Europe (CORUM) mapping tool to qualitatively investigate the current situation and provide analysis of current views on RUM and interventions among key European payers and their advisers. The findings will be used to provide future guidance.
Methodology
Descriptive study exploring and identifying perceived gaps to achieving optimal RUM. The CORUM tool was based on the WHO 12 key interventions to promote RUM.
Results
62 participants took part with most respondents believing their country could improve RUM capacity. This included educational initiatives on the use of clinical guidelines (90%) and the inclusion of problem-based pharmacotherapy in undergraduate curricula and for Continued Professional Development. Key challenges included a lack of regular updates of guidelines, exacerbated by limited funding and a lack of follow-up to monitor adherence to agreed guidelines. RUM could also be enhanced by the development of regional formularies as well as implementing Drug and Therapeutic Committees where these are currently limited. There also needs to be greater co-ordination between RUM and Health Technology Assessment activities, with countries learning from each other.
Conclusion
There is an urgent need to improve RUM through improved educational and other activities among European countries, with countries learning from each other. This will involve addressing current challenges and we will be following this up.
Keywords: rational use of medicines, Europe, health authorities, initiatives, health technology assessment
Introduction
The World Health Organization (WHO) estimates that more than half of all medicines are prescribed, dispensed or sold inappropriately, and that half of all patients fail to take them correctly (World Health Organization, 2012; Ofori-Asenso and Agyeman, 2016). This results in the waste of healthcare resources as well as leads to health hazards. The situation is even more critical in lower- and middle-income countries (LMICs) where expenditure on medicines can be up to 70% of total healthcare expenditure, much of which is out-of-pocket (Cameron et al., 2009; Ofori-Asenso and Agyeman, 2016). Expenditure on medicines has increased since 2015 beyond US$800 billion (€720 billion) among countries of The Organisation for Economic Co-operation (OECD) (European Central Bank, 2015; OECD, 2017). This is driven by increased expenditure on biological medicines, including those for cancer, as well as new medicines for patients with hepatitis C (OECD, 2017). Total retail pharmaceutical expenditure in Europe was more than €210 billion in 2016 (adjusting for purchasing power parities), an increase of 5% since 2010 (OECD/EU, 2018). The increase was limited by strategies across Europe to enhance the prescribing of low-cost generics and biosimilars versus originators and patented products where care is not compromised (Godman et al., 2014a; Moon et al., 2014; Moorkens et al., 2017; Vogler and Schneider, 2017; OECD/EU, 2018; Simoens et al., 2018; Godman et al., 2019a).
Expenditure on cancer medicines is a concern, with global expenditure in 2017 at US$133 billion (~€ 117 bn) up from US$96 billion in 2009, and estimated to reach US$200 billion (~ € 176 bn) by 2022 with an average growth rate of 10 to 13% per year during the coming years (IQVIA Institute for Human Data Science, 2018). This increase in expenditure will be driven by anticipated increases in the prices of new cancer medicines and increased incidence rates with an estimated 21.4 million new cancer cases globally per year by 2030 up from 18.1 million in 2018 (Chalkidou et al., 2014; Kelly and Smith, 2014; Howard et al., 2015; Godman et al., 2017; Bray et al., 2018). In addition, over 500 companies are actively pursuing new cancer medicines across multiple indications (IMS Institute for Healthcare Informatics, 2016; Godman et al., 2018), intensifying expectations for the rising costs for oncology medicines (Durkee et al., 2016; Haycox, 2016; Godman et al., 2017; Dolgin, 2018). There are similar concerns and issues with new medicines for patients with orphan diseases (Simoens et al., 2013; Godman et al., 2018; Luzzatto et al., 2018) where we are likely to see global spending on orphan medicines reaching US$178 billion (~€ 160 bn) per year by 2020 (Brau and Tzeng, 2018). This will again be enhanced by the number of medicines for orphan diseases currently available and in development, and their envisaged prices (Godman et al., 2016; Godman et al., 2018; Luzzatto et al., 2018).
Overall, the costs of new medicines are a growing concern across countries driven by changing demographics, rising patient expectations, single disease treatment guidelines, and the continued launch of new premium priced medicines (WHO, 2015; Godman et al., 2014b; Godman et al., 2018). This is set to continue exacerbated by the number of new medicines in development as well as the emotive nature of disease areas such as cancer and orphan diseases (Simoens et al., 2013; WHO, 2015; Haycox, 2016; Cohen, 2017; Goldstein et al., 2017; Godman et al., 2018; Luzzatto et al., 2018). We are also seeing high income countries increasingly struggle to fund new medicines, and this will continue unless actively addressed (Malmstrom et al., 2013; Ghinea et al., 2015; Godman et al., 2018; Kwon et al., 2018). These challenges have led to the development of new models to better manage the entry of new medicines as well as initiatives to enhance the rational use of medicines (RUM). These new models include encouraging the use of biosimilars and multiple sourced products where pertinent to conserve resources alongside instigating active disinvestment processes (Godman et al., 2014a; WHO, 2015; Parkinson et al., 2015; Guerra-Junior et al., 2017; Moorkens et al., 2017; Godman et al., 2018) as well as a growing use of managed entry agreements (MEAs). However, there are concerns with MEAs including the extent and usefulness of any clinical data collected, as well as the ability to actively monitor the role and value of new medicines in routine clinical care to provide future guidance (Ferrario and Kanavos, 2013; WHO, 2015; Garattini and Curto, 2016; Carlson et al., 2017; Ferrario et al., 2017; Garcia-Doval et al., 2017; Guerra-Junior et al., 2017; Mercer et al., 2017; Eriksson et al., 2018; Frisk et al., 2018; Alvarez-Madrazo et al., 2019; Antonanzas et al., 2019; Mueller et al., 2019).
The WHO defines RUM as “Patients receive medications appropriate to their clinical needs, in doses that meet their own individual requirements, for an adequate period of time, and at the lowest cost to them and their community” (World Health Organization, 2002; World Health Organization, 2007). According to the WHO, a sound rational drug use program in any country involves interventions on three levels. The first is on the level of healthcare authorities that includes setting strategies for monitoring the use of medicines, second is on the level of healthcare service providers, which for example includes enhancing the use of agreed clinical guidelines, and the third is on the level of medicines used by consumers, which includes raising awareness on key aspects of RUM (World Health Organization, 2012). Whilst these strategies are operational in a number of countries, they are rarely subjected to a thorough assessment of their actual impact in practice such as encouraging the preferential use of multiple sourced medicines where pertinent without compromising care or encouraging caution for new medicines where there are concerns with patient safety (Godman et al., 2010a; Wettermark et al., 2010; Forslund et al., 2011; Kaplan et al., 2012; Moon et al., 2014; Godman et al., 2014b; Troncoso and Diogene, 2014; Frisk et al., 2018; Jacobs et al., 2019). Especially, there seems to be a gap regarding stakeholder engagement to assess the implementation of these strategies, or in gathering information about the key challenges of implementation and ways of circumventing these challenges, with a focus on variable contexts and different healthcare ecosystems.
We sought to address this gap by developing the Current Obstacles for Rationalizing Use of Medicines in Europe (CORUM) mapping tool. The objective of the CORUM tool was to qualitatively investigate the current situation and to provide an in-depth analysis of current views on RUM interventions among key payers and their advisers among European countries in addition to the challenges encountered when attempting to implement these interventions. The findings will be used to develop strategies to enhance RUM in Europe given increasing budgetary and other concerns.
Methodology
General
This is a descriptive study exploring and identifying perceived gaps to achieving optimal RUM in Europe. The CORUM tool (Supplementary Appendix 1) was developed by the authors based on the WHO 12 key interventions to promote RUM (Table 1) (World Health Organization, 2012). For each key intervention, we inquired regarding the extent to which respondents agreed to the intervention being a key intervention to promote RUM, checked for current obstacles for this intervention to be realized based on respondents’ experience in his/her own country, and asked for respondents’ views concerning possible ways to circumvent these obstacles to enhance the rational use of medicine within their own country (Supplementary Appendix 1). The study also embeds considerations from common elements including cooperation between national organizations that are traditionally evident in Health Technology Assessment (HTA) frameworks widely established within member states of the European Union (EU) (EUnetHTA, 2018; EUnetHTA Mission, vision and values, 2019; Vella Bonanno et al., 2019). HTA is the multidisciplinary process to determine the value of a health technology. The dimensions of value for a health technology may be assessed by examining intended and unintended consequences of health technologies, including the clinical, economical, ethical, social, organizational, and environmental aspects, as well as wider implications for the patient, relatives, caregivers, and the population. The overall value may vary depending on the perspective taken, the stakeholders involved, and the decision context.
Table 1.
1. Establishment of a multidisciplinary national body to coordinate policies on medicine use |
2. Use of clinical guidelines |
3. Development and use of national essential medicines lists |
4. Establishment of drug and therapeutics committees in districts and hospitals |
5. Inclusion of problem-based pharmacotherapy training in undergraduate curricula |
6. Continuing in-service medical education as a licensure requirement |
7. Supervision, audit, and feedback |
8. Use of independent information on medicines |
9. Public education about medicines |
10. Avoidance of perverse financial incentives |
11. Use of appropriate and enforced regulation |
12. Sufficient government expenditure to ensure availability of medicines and staff. |
We believe this combination of sources was an appropriate starting point to develop a cross-sectional survey (see CORUM Mapping Survey) that could be distributed across key stakeholders in Europe to gather their perception of the proposed RUM interventions.
Participants
The target audience of the tool could be categorized into two main groups. The first were the policy makers (users of evidence) who are typically the decision makers responsible for legislating and implementing frameworks for adopting and monitoring the use of medicines within their own region or country. The second group were “technocrats” (suppliers of evidence), who are often the producers of assessments of medicines or those giving recommendations that directly or indirectly influence decisions regarding RUM based on evidence-based medicine and/or HTA (Ward et al., 2009).
Sampling for the participants to be surveyed was conducted based on a purposive non-random sampling technique, which is typically used for exploratory work such as this study. The participants who were approached for this initial survey were stakeholders across various realms of the healthcare community spread across different geographical locations within Europe. The participants were primarily members of Piperska Group, a non-governmental organization which the authors are also members.
The Piperska Group is a pan-European network of payers (health insurers), advisers, and academics that researches and analyzes key health policies and their impact with the aim of enhancing the health of populations and individual patients in a sustainable way (Garattini et al., 2008). Activities include developing new models to improve the managed entry of new medicines, developing quality indicators for new medicines, assessing key issues such as MEAs, discussing minimum effectiveness levels for new cancer medicines, appraising key issues surrounding personalized medicine and adaptive pathways as well as potential ways to enhance the prescribing of low cost generics and biosimilars to release resources to fund increased medicine volumes with aging populations and new valued medicines within agreed budgets (Godman et al., 2013a; Malmstrom et al., 2013; Godman et al., 2014b; Godman et al., 2014c; Moon et al., 2014; Campbell et al., 2015; Godman et al., 2015a; de Bruijn et al., 2016; Ermisch et al., 2016; Wild et al., 2016; Ferrario et al., 2017; Moorkens et al., 2017; Vella Bonanno et al., 2017; Godman et al., 2018; Godman et al., 2019b; Vella Bonanno et al., 2019). In addition, organizing courses to improve the managed entry of new medicines and prescribing at the interface (Godman et al., 2012; Bjorkhem-Bergman et al., 2013; Matusewicz et al., 2015). The various activities and outputs have been achieved through cooperation and the exchange of ideas among a wide base of multi-stakeholder groups in Europe. As a result, this group helps provide European thought leadership specifically for constructing policies around enhancing RUM and related therapies.
Consequently, the Piperska Group was deemed an appropriate target audience to drive this exploratory mapping study. Furthermore, we also incorporated a snowball sampling technique where existing study participants invited future participants to take part in this survey. Initially, prospective participants were approached through e-mail, inviting them to participate in the survey with the potential of forwarding the survey to known colleagues.
Tool: CORUM Mapping Survey
Development of the Survey
The CORUM Mapping Tool is a survey of 9 structured questions where each question pertains to one of the WHO key interventions. Although the WHO proposes 12 key interventions for optimal RUM, we adapted the questions to combine one or more interventions to avoid a lengthy questionnaire. The authors established face-validity of the survey by allowing experts in the field including health authority personnel to read through the survey and share their feedback. The survey was subsequently reviewed by a psychometrician to check for common questionnaire errors. We adjusted the survey based on the received feedback and subsequently ran a pilot test on a subset of the prospective participants to enhance the robustness of the survey. The final survey is available as a supplement.
A brief introduction about the survey, its objectives, and the instructions were contained in the cover page. Each question in the survey first presented one of the key interventions and subsequently asked the participants to select a score on a 1–5 scale that best represented how strongly they agreed (score 5) or disagreed (score 1) that the particular intervention is key for RUM. A 5-point scale is standard tool for research studies such as this one (Desser et al., 2010; Shrank et al., 2011; Deutsch et al., 2015; Garcia et al., 2019). Thereafter, the participants rated their country’s performance with regards to the presented key intervention. Following this, the participants selected whether or not they believed there are current challenges to realizing the presented intervention in addition to clarifying what these challenges are. The final sub-question asked the participants to propose possible solutions to overcome perceived challenges to implementing the presented intervention.
We used the online website checkmarket.com to build the questionnaire layout and subsequently deliver it to the participants. Checkmarket offers a user-friendly platform to creating, administering, and analyzing online surveys. The survey ran for 3 months between March and June 2017 although we allowed one week prior to the “active period” where we sent the invitation e-mails to participants inviting them to take part. Weekly reminders were sent to participants requesting them to complete the survey or clarify any questions if they had any. All communications with participants were conducted through e-mail.
Analysis
The responses were analyzed to present a frequency distribution of the answers. We typically consolidated the high-end and low-end scores in the 1–5 point scale, e.g. strongly disagree and disagree, for ease of analysis.
The same approach was followed for questions with binary answers (i.e. yes or no) and multi-select questions. Finally, the open-answers, where the participants stated possible ways to address the perceived challenges of achieving optimal rational use of medicines, were coded and analyzed according to the so-called 4 E approach (Education, Economics, Engineering, and Enforcement) first discussed by Wettermark et al. (2009a) and used extensively since then to analyze the influence of typically multiple health policy interventions to improve the quality and/or efficiency of prescribing (Wettermark et al., 2009a; Godman et al., 2010a; Godman et al., 2010b; Voncina et al., 2011; Woerkom et al., 2012; Fraeyman et al., 2013; Godman et al., 2013b; Moon et al., 2014; Leporowski et al., 2018; McCabe et al., 2019).
The 4 E’s consolidate the multiple strategies that can be applied to rationalizing medicine use. Education refers to a wide range of educational activities ranging from simple distribution of printed material to more advanced strategies such as academic detailing and educational visits by trained facilitators. Academic detailing, sometimes called educational outreach visits, typically includes a visit of a trained health professional such as a physician or pharmacist to a general practitioner in their own setting on a one-on-one basis to provide information to help change behavior (Grimshaw et al., 2004; O’Brien et al., 2007; Jin et al., 2012; Chhina et al., 2013; Costa et al., 2016). Goals can include active dissemination and discussion on agreed national or regional treatment guidelines and improving the management of targeted health conditions (Chhina et al., 2013; Godman et al., 2014d; Costa et al., 2016). Typically academic detailing is undertaken in one or more visits and often combined with other strategies to enhance its effectiveness including audits and other feedback approaches (O’Brien et al., 2007; Gustafsson et al., 2011; Costa et al., 2016).
Engineering captures strategies that are more organizational or managerial interventions such as monitoring of prescribing against agreed targets such as the quality and outcome framework in the United Kingdom or percentage targets for prescribing in Scotland or Sweden (Godman et al., 2009; McGinn et al., 2010; Campbell et al., 2011; Godman et al., 2014a). Economics strategies typically include financial incentives or disincentives to all key stakeholder groups including physicians, pharmacists, and patients, i.e. financial incentives for achieving agreed prescribing targets and writing annual reports on potential ways to improve future prescribing (Godman et al., 2009; Wettermark et al., 2009b; McGinn et al., 2010; Martin et al., 2014). Finally, Enforcement strategies are those that include regulations by law such as mandatory generic substitution or mandatory prescribing restrictions (Godman et al., 2009; Wettermark et al., 2009a; Wettermark et al., 2010; Godman et al., 2014d).
We did not seek ethical approval as this study did not involve patients. This is in line with previous studies undertaken by the co-authors in related areas including analysis of policies to enhance the rationale use of medicines as well as seeking a greater role for biosimilars and generics involving health authority personnel and their advisers (Godman et al., 2010a; Godman et al., 2010b; Godman et al., 2014c; Moon et al., 2014; Godman et al., 2015b; Ferrario et al., 2017; Moorkens et al., 2017; Godman et al., 2019b) as well as in line with local legislation and institutional guidelines. Nevertheless, sufficient information was provided to participants about the objectives of this study in an invitation email and within the survey instrument (see Supplementary Appendix 1), with consent sought to gather responses and analyse the results for research purposes.
Results
Response Rate
The link to the survey was eventually emailed to 235 potential respondents. Overall, 62 professionals completed the questionnaire giving a response rate of 26% which is in line with the average response rates for e-mail surveys (Fincham, 2008).
Table 2 below shows the breakdown of respondents (n = 62) by professional category and European region. The majority of the participants were from national health organization bodies (n = 20) followed by academics (n = 19), while the highest portion of respondents were from Eastern Europe (n = 37). There was also a high percentage of Piperska member respondents in the health insurance and national health organization group (56%), with the least number among healthcare professionals (17%).
Table 2.
Participant Category | CE | EE | NE | SE | TOTAL, n (%) |
---|---|---|---|---|---|
Health Insurer | 1 | 2 | 1 | 0 | 4 (7) |
Industry | 0 | 7 | 0 | 0 | 7 (11) |
National Health Organization | 2 | 10 | 5 | 3 | 20 (32) |
Health Care Professional | 2 | 5 | 3 | 2 | 12 (19) |
University/Academic | 2 | 13 | 3 | 1 | 19 (31) |
TOTAL, n (%) | 7 (11) | 37 (60) | 12 (19) | 6 (10) | 62 (100) |
CE, Central Europe; EE, Eastern Europe; NE, Northern Europe; SE, Southern Europe.
Capacity for Rational Use of Medicine
The majority of the respondents agreed that the presented five interventions are perceived as key contributors for RUM (see Figure 1). The percentage of agreement ranged from 65% (drug therapeutic committees, DTCs) to 84% (clinical guidelines).
Respondents subsequently scored the performance of their countries in achieving the relevant key RUM interventions on a scale of 1–5, where 1 refers to “Poor performance” and 5 being “Strong performance”. The percentage of respondents who believed that their country performed “above average” or “strongly” ranged between 23 and 34% across all interventions (Figure 2). The remaining respondents (66–77%) believed that their country’s performance with achieving RUM capacity was currently poor, suboptimal, or fair.
The majority of the respondents highlighted that there are current challenges to instigating appropriate interventions to enhance RUM (Figure 3). The percentages ranged from 66% regarding the inclusion of problem-based pharmacotherapy training to 90% with regard to the use of clinical guidelines.
The two most selected challenges hindering the use of clinical guidelines were “lack of updated guidelines or prescribed guidance” and lack of “governmental funding” to maintaining these guidelines (Figure 4). “Lack of follow-up of adherence to formularies” was regarded as the greatest challenge to the development and use of national/regional formularies. Furthermore, 45% of the respondents selected “lack of incentives and/or time” as a limitation to establishing DTCs in districts, regions, and hospitals. Of the respondents, 39% cited “lack of time” as a challenge to including problem-based pharmacotherapy training in undergraduate courses, while 45% of the respondents believed that the lack of government support hinders initiatives that support RUM such as education, feedback, and prescription restrictions.
Figure 5 shows the possible solutions proposed by the respondents to overcome current challenges to promoting RUM. “Education” was the solution most proposed by the respondents (46–53%). Proposed activities included creating RUM guidelines, implementing electronic aids to support prescription writing and knowledge sharing through congresses. Initiatives that are categorized as “Engineering” approaches were the second most proposed strategies to address potential challenges, which include stronger involvement of public health authorities and national payers in promoting RUM strategies. Finally, strategies pertaining to “Economics” and “Enforcement” solutions were the least proposed by participants. Examples of these strategies are increased governmental funding for the implementation of guidelines including incentives to physicians (Economics) and payer contractual agreements with prescribers that guidance must be adhered to (Enforcement).
Linkage Between HTA and RUM
We asked respondents what kind of body is responsible for coordinating RUM initiatives and/or policies in their countries. Fifty-six percent (n = 35) of total respondents stated that their country has a body that coordinates RUM initiatives and/or policies. Among these, the majority of bodies were governmental national units (HTA entity) within the ministry of health (MoH) (23%, Table 3). However, 23% of respondents mentioned that the HTA entity in their respective country (if this exists) is not involved in coordinating RUM activities. The other selected types of RUM-coordinating entities varied between being independent governmental agencies (13%), regulatory governmental authority (8%), or a payer agency (6%). Furthermore, 85% (n = 53) of respondents were aware of WHO Europe as a pan-European stakeholder which advocates RUM (Table 4), followed by EuNetHTA (68%, n = 42) and Piperska Group (65%, n = 40).
Table 3.
Type of HTA entity | Proportion of respondents, % (n) |
---|---|
No HTA entity involved with RUM policy coordination | 23% (14) |
Government national unit (within MoH) | 23% (14) |
Government agency (independent) | 13% (8) |
Regulatory authority national government | 8% (5) |
Funding agency (i.e. payer) | 6% (4) |
Professional society (national) | 5% (3) |
Academia | 5% (3) |
More than one entity | 5% (3) |
Network of HTA agencies (more than one country) | 3% (2) |
Healthcare provider under MoH (e.g. public hospital) | 3% (2) |
Regional drug agency | 2% (1) |
Public insurance agency | 2% (1) |
Professional society—international | 2% (1) |
Network of HTA agencies (within one country) | 2% (1) |
HTA, health technology assessment; RUM, rational use of medicine; MoH, Ministry of Health.
Table 4.
Pan-European Group | Proportion of respondents aware, % (n) |
---|---|
WHO Europe | 85% (53) |
EuNetHTA | 68% (42) |
Piperska Group | 65% (40) |
MEDEV | 42% (26) |
HTAi | 40% (25) |
EuroDURG | 37% (23) |
PPRI | 37% (23) |
EACPT | 18% (11) |
Others | 13% (8) |
WHO, World Health Organization; EuNetHTA, European network for health technology assessment; MEDEV, The Medicine Evaluation Committee; HTAi, Health Technology Assessment International; EuroDURG, European Drug Utilisation Research Group; PPRI, Pharmaceutical pricing and reimbursement information initiative; EACPT, European Association for Clinical Pharmacology and Therapeutics.
Our analysis shows that of the countries in which HTA plays a role in coordinating RUM initiatives, only 27% of the respondents rated their country’s HTA entity as performing above average or strong, with 31% as fair and 42% as poor or suboptimal in helping to achieve effective RUM policy co-ordination. Seventy-seven percent of the respondents subsequently believed there are certain challenges to their country’s HTA entities’ contribution to effective RUM policy coordination. The top two challenges that were mentioned (Figure 6) included a “lack of political will” (48%) and “Not enough knowledge in linking RUM function within an HTA institution” (44%).
To overcome these challenges, the respondents proposed solutions that fell under Education (39%) such as the inclusion of RUM-focused courses for undergraduate students within pharmacy and medical schools. Solutions pertaining to Engineering strategies (44%) were creating an HTA multidisciplinary independent body, while Economics (16%) highlighted the need for continuous funding to maintain RUM policies including potential incentives to physicians. No solutions were proposed under “Enforcement.”
Governance of RUM Mechanisms
The majority of respondents (79%) agreed or strongly agreed that consumer education is a key intervention to enhancing RUM. However, only 16% of the respondents rated their country’s performance to consumer education as being above average or strong to promoting RUM, with 37% scoring it as fair and 47% as poor/suboptimal.
Furthermore, 74% believed there are currently challenges to providing consumer education in the context of RUM, which need to be addressed. The greatest challenge mentioned was a “lack of innovative ways to deliver public education in a useful manner” (52%), followed by “lack of financial resources” (40%), “limited role of professional societies” (35%), and “lack of technical knowledge” (31%) (Figure 7).
The majority of the respondents cited educational policies as a means to address the challenges that hinder effective consumer education (55%). Possible “educational” solutions that were mentioned included public campaigns via the local ministry of health in addition to increasing public understanding of medicines and their use. Engineering strategies such as further regulations on medicinal marketing was cited by 17% of respondents, and finally 23% cited financial resources as one strategy to support patient education around RUM.
Role of Pan-European Groups
The top 3 organizations that respondents are aware of in the realm of RUM were WHO Europe (85%), EuNetHTA (68%), and the Piperska Group (65%) (Table 4), with a lower number aware of the European Association for Clinical Pharmacology and Therapeutics (EACPT—18%).
Increasing RUM Impact
Among the respondents, 73% agreed or strongly agreed to the need for organizations that are enhancing knowledge sharing and cooperation between stakeholders across Europe with regards to RUM. However, 56% of respondents believed there are current challenges that hinder these organizations with enhancing RUM across Europe. The challenge that was mostly mentioned by respondents was “Financial support” (37%) (Figure 8). Finally, the majority of the solutions cited by respondents to address these challenges were again Educational policies (43%) such as communication of research results between these groups, followed by Engineering policies (28%) including strategic alliances among various pan-European groups.
Discussion
The results of our study point to the use of clinical guidelines as the most important key intervention to enhance RUM (Figure 1). Whilst clinical guidelines have been instrumental in optimizing care and promoting RUM across settings (Ament et al., 2015; Colbeck et al., 2016; Ebben et al., 2018; Brouwers et al., 2019; Niaz et al., 2019; Richards et al., 2019), there are challenges such as regularly updating the guidance or sufficient government or health authority funding for their development and active dissemination in the first place. There can also be concerns with conflicts of interest among guideline developers unless adequately addressed such as the “Wise List” and guidance in Stockholm, Sweden (Gustafsson et al., 2011; Bjorkhem-Bergman et al., 2013; Shnier et al., 2016; DeJong and Steinbrook, 2018; The Lancet, 2019). Addressing the reasons behind the lack of funding for their dissemination, including how technology can assist with their wider dissemination and usability in practice to promote RUM, should be explored further. This is particularly important in situations where physician education is principally offered via pharmaceutical companies with the potential for bias (Spurling et al., 2010; Riaz et al., 2015; Fickweiler et al., 2017; Fadare et al., 2018; Khazzaka, 2019; Ogunleye et al., 2019), although ethical codes of practice are increasing across countries to address such concerns (Francer et al., 2014). As a result, there might be a need in some countries to develop a better understanding of mechanisms to ensure continuous updating and dissemination of clinical guidance as well as continual professional development around clinical pharmacology and RUM. In addition, ensuring in the future that clinical guidance is readily accessible in an easy-to-find manner through Apps or other mechanisms during clinic visits and other patient interactions to improve their utility. There are concerns with RUM if clinical guidelines are not readily accessible or utilized (Md Rezal et al., 2015; Mashalla et al., 2016; Matsitse et al., 2017); alternatively, where physicians are overloaded with guidelines and where they have doubts about them (Sermet et al., 2010). We do know that if physicians trust key personnel involved in the development of prescribing guidance, there is a comprehensive dissemination strategy and prescribing is regularly monitored, there is high adherence to any prescribing guidance produced. This is illustrated by high adherence rates to recommended treatment guidance in Stockholm County Council in Sweden with their “Wise List” of medicines and guidelines (Gustafsson et al., 2011; Bjorkhem-Bergman et al., 2013; Eriksen et al., 2017; Eriksen et al., 2018).
There are concerns though that DTCs recorded the lowest percentage of being key for promoting RUM (Figure 1). The relatively high percentage of neutral responders (24%) suggests that more awareness is needed to raise the role and function of DTCs in both ambulatory and hospital care, and its link in promoting RUM, given concerns with their implementation and effectiveness especially in LMICs (Lima-Dellamora Eda et al., 2014; Matlala et al., 2017; Fadare et al., 2018; Mashaba et al., 2019). According to the WHO, the goal of DTCs is to ensure access to the best possible cost effective and high quality of care through determining what medicines will be available at what cost and how will they be used (World Health Organization, 2003; Lima-Dellamora Eda et al., 2014). The important work of DTCs includes establishing documented rules and policies for all aspects of drug management including the selection of formulary list medicines and agreement regarding treatment protocols should be emphasized and reassessed for learnings. Other functions include continuing education for all key stakeholder groups, auditing and feedback, drug utilization reviews, and monitoring of adverse reactions and medication errors to promote RUM (Godman et al., 2009; Lima-Dellamora Eda et al., 2014; Meyer et al., 2017; Mashaba et al., 2019). Nevertheless, it still remains unclear how DTCs with this important mandate represented by these activities failed to have a critical role in promoting RUM compared to clinical guidelines. More research is needed to uncover the reasons behind this to provide future direction given the critical role that DTCs including formularies have played with enhancing the RUM (Holloway and Green, 2003; Godman et al., 2009; Thawani, 2010; Holloway et al., 2018; Sabir, 2018), and we will be exploring this further in the future.
Furthermore, there is a clear need for clarity over the linkage between HTA and RUM. It is noted that RUM is a strategy that is applied through various structures across different tiers and levels. This assumes HTA as one corner stone structure that safe-guards RUM policies. Nevertheless, the healthcare community is yet to define the nature and depth of the relationship between the two. This may be because HTA can be linked more to reimbursement and funding decisions for new medicines across countries rather than a key role in guideline development. Similar to HTA practice, RUM policies aim to optimize treatment processes and cut waste. An example of a long-lasting research program, funded by the Ministry of Health, and where HTA and RUM come together is the Rational Use of Pharmacotherapy of ZonMw in the Netherlands (ZonMw, 2015; ZonMw, 2019).
Regarding the survey results, it is imperative to reflect on how RUM interventions are carried forward by different entities and bodies within the healthcare system, and how these entities translate RUM strategies into action. Equally important is the role of HTA as a function and practice, and how HTA entities establish a harmonized relationship with the remaining structures/entities that promote RUM implementation. This consequently entails more research on establishing an effective governance system across all involved entities and stakeholders to effectively incentivize and deliver RUM interventions to improve patient care.
Finally, it is important to emphasize that educational activities remain the most important interventions to improve RUM. Compared to engineering, economics, and enforcement, education related initiatives were perceived as the most important to address challenges hindering optimal RUM. This includes raising awareness on RUM to a wider group of stakeholders including government officials, patients, practitioners, and the public. The aim would be to focus on how best to achieve better utilization of current interventions to enhance RUM, and how can these interventions be assessed, evaluated, and modified to appeal to different stakeholders as well as raise the level of understanding of the concept of RUM. These are projects for the future especially among Central and Eastern European countries.
We were aware of a number of limitations with this study. Firstly, the respondents taking part in the study were not representative of all key stakeholder groups. However, those taking part were actively involved in initiatives in their own countries to try and enhance RUM through different mechanisms. Secondly, some respondent groups had a high proportion of Piperska members. Thirdly, we did not fully query all the interventions such as “avoidance of perverse financial incentives” as we believed it’s a very complex issue that is difficult to capture through one question. Lastly, the low response rate. However, we expect the impact of a higher response rate would have been limited and would not have appreciably altered the conclusions drawn as our target sample was highly specific. Consequently, those who responded are believed to be well representative of the healthcare community involved with RUM in their country to give good guidance. As a result despite these limitations, we believe the findings provide relevant insights into current RUM initiatives and challenges within Europe with the research team seeking to maximize the survey tool to obtain results that are as accurate as possible.
Conclusion
In conclusion, the importance of the RUM cannot be overstated given the growing pressure on healthcare resources across countries. Whilst our findings point to the importance of the key interventions surveyed, especially around clinical guideline development, the results suggest that the stakeholders are keen to develop better utilization of these interventions, investing in their appropriate application in practice. This can be achieved most prominently by increasing educational initiatives around RUM, and to call on creating mechanisms linking rational use of medicines with the HTA function already developed in most European countries. There is also a clear role for groups such as WHO Europe, especially in Central and Eastern European countries, EUNetHTA, Piperska, HTAi, EuroDURG, and patient groups such as EUPATI to enhance RUM through their various activities and initiatives. In particular, this includes encouraging countries and stakeholders to learn from each other and to collaborate in order to improve RUM building on existing Pan-European networks. We will be following this up in the future including re-evaluating progress in this area.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Author Contributions
MG, AS, and BG developed the concept for the paper with help from WO. They subsequently coordinated the distribution of the questionnaire with the help of Jesper van den Bergh and WO. The methodology was developed by MG and AS, with principal analysis undertaken by AS and MG with all authors contributing to the development of the paper and its approval.
Conflict of Interest
AS is employed by IQVIA.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We would like to thank Jesper van den Bergh for his contribution in the delivery of the surveys and following-up with participants to ensure enough respondents for our research.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphar.2020.00144/full#supplementary-material
References
- Alvarez-Madrazo S., Kavanagh K., Siebert S., Semple Y., Godman B., Maciel Almeida A., et al. (2019). Discontinuation, persistence and adherence to subcutaneous biologics delivered via a homecare route to Scottish adults with rheumatic diseases: a retrospective study. BMJ Open 9 (9), e027059. 10.1136/bmjopen-2018-027059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ament S. M., de Groot J. J., Maessen J. M., Dirksen C. D., van der Weijden T., Kleijnen J. (2015). Sustainability of professionals’ adherence to clinical practice guidelines in medical care: a systematic review. BMJ Open 5 (12), e008073. 10.1136/bmjopen-2015-008073 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Antonanzas F., Juarez-Castello C., Lorente R., Rodriguez-Ibeas R. (2019). The use of risk-sharing contracts in healthcare: theoretical and empirical assessments. PharmacoEconomics. 37 (12), 1469–1483. 10.1007/s40273-019-00838-w [DOI] [PubMed] [Google Scholar]
- Bjorkhem-Bergman L., Andersen-Karlsson E., Laing R., Diogene E., Melien O., Jirlow M., et al. (2013). Interface management of pharmacotherapy. Joint hospital and primary care drug recommendations. Eur. J. Clin. Pharmacol. 69 Suppl 1, 73–78. 10.1007/s00228-013-1497-5 [DOI] [PubMed] [Google Scholar]
- Brau R., Tzeng I. (2018). Orphan Drug Commercial Models. Available at URL: https://www.lifescienceleader.com/doc/orphan-drug-commercial-models-0001.
- Bray F., Ferlay J., Soerjomataram I., Siegel R. L., Torre L. A., Jemal A. (2018). Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA 68 (6), 394–424. 10.3322/caac.21492 [DOI] [PubMed] [Google Scholar]
- Brouwers M. C., Florez I. D., McNair S. A., Vella E. T., Yao X. (2019). Clinical practice guidelines: tools to support high quality patient care. Semin. In Nuclear Med. 49 (2), 145–152. 10.1053/j.semnuclmed.2018.11.001 [DOI] [PubMed] [Google Scholar]
- Cameron A., Ewen M., Ross-Degnan D., Ball D., Laing R. (2009). Medicine prices, availability, and affordability in 36 developing and middle-income countries: a secondary analysis. Lancet. 373 (9659), 240–249. 10.1016/S0140-6736(08)61762-6 [DOI] [PubMed] [Google Scholar]
- Campbell S. M., Kontopantelis E., Hannon K., Burke M., Barber A., Lester H. E. (2011). Framework and indicator testing protocol for developing and piloting quality indicators for the UK quality and outcomes framework. BMC Fam Pract. 12, 85. 10.1186/1471-2296-12-85 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Campbell S. M., Godman B., Diogene E., Furst J., Gustafsson L. L., MacBride-Stewart S., et al. (2015). Quality indicators as a tool in improving the introduction of new medicines. Basic Clin. Pharmacol. Toxicol. 116 (2), 146–157. 10.1111/bcpt.12295 [DOI] [PubMed] [Google Scholar]
- Carlson J. J., Chen S., Garrison L. P., Jr. (2017). Performance-based risk-sharing arrangements: an updated international review. PharmacoEconomics. 35 (10), 1063–1072. 10.1007/s40273-017-0535-z [DOI] [PubMed] [Google Scholar]
- Chalkidou K., Marquez P., Dhillon P. K., Teerawattananon Y., Anothaisintawee T., Gadelha C. A., et al. (2014). Evidence-informed frameworks for cost-effective cancer care and prevention in low, middle, and high-income countries. Lancet Oncol. 15 (3), e119–e131. 10.1016/S1470-2045(13)70547-3 [DOI] [PubMed] [Google Scholar]
- Chhina H. K., Bhole V. M., Goldsmith C., Hall W., Kaczorowski J., Lacaille D. (2013). Effectiveness of academic detailing to optimize medication prescribing behaviour of family physicians. J. Pharm. Pharm. Sci. 16 (4), 511–529. 10.18433/J3KK6C [DOI] [PubMed] [Google Scholar]
- Cohen D. (2017). Cancer drugs: high price, uncertain value. BMJ 359, j4543. 10.1136/bmj.j4543 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Colbeck M., Lockwood C., Peters M., Fulbrook P., McCabe D. (2016). The effect of evidence-based, treatment-oriented, clinical practice guidelines on improving patient care outcomes: a systematic review protocol. JBI Database Syst. Rev. Implement. Reps. 14 (6), 42–51. 10.11124/JBISRIR-2016-002515 [DOI] [PubMed] [Google Scholar]
- Costa J. O., Almeida-Brasi C., Godman B., Fischer M. A., Dartnell J., Heaney A., et al. (2016). Implementation of clinical guidelines in Brazil: Should academic detailing be used? Jn Pharm. Health Serv. Res. 7, 105–115. 10.1111/jphs.12133 [DOI] [Google Scholar]
- de Bruijn W., Ibanez C., Frisk P., Bak Pedersen H., Alkan A., Vella Bonanno P., et al. (2016). Introduction and Utilization of High Priced HCV Medicines across Europe; Implications for the Future. Front. Pharmacol. 7, 197. 10.3389/fphar.2016.00197 [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeJong C., Steinbrook R. (2018). Continuing problems with financial conflicts of interest and clinical practice guidelines. JAMA Intern Med. 178 (12), 1715. 10.1001/jamainternmed.2018.4974 [DOI] [PubMed] [Google Scholar]
- Desser A. S., Gyrd-Hansen D., Olsen J. A., Grepperud S., Kristiansen I. S. (2010). Societal views on orphan drugs: cross sectional survey of Norwegians aged 40 to 67. BMJ. 341, c4715. 10.1136/bmj.c4715 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Deutsch J. E., Romney W., Reynolds J., Manal T. J. (2015). Validity and usability of a professional association’s web-based knowledge translation portal: American Physical Therapy Association’s PTNow.org. BMC Med. Inform Decis Mak. 15, 79. 10.1186/s12911-015-0178-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dolgin E. (2018). Bringing down the cost of cancer treatment. Nature 555 (7695), S26–Ss9. 10.1038/d41586-018-02483-3 [DOI] [PubMed] [Google Scholar]
- Durkee B. Y., Qian Y., Pollom E. L., King M. T., Dudley S. A., Shaffer J. L., et al. (2016). Cost-effectiveness of pertuzumab in human epidermal growth factor receptor 2-positive metastatic breast cancer. J. Clin. Oncol. 34 (9), 902–909. 10.1200/JCO.2015.62.9105 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ebben R. H. A., Siqeca F., Madsen U. R., Vloet L. C. M., van Achterberg T. (2018). Effectiveness of implementation strategies for the improvement of guideline and protocol adherence in emergency care: a systematic review. BMJ Open 8 (11), e017572. 10.1136/bmjopen-2017-017572 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eriksen J., Gustafsson L. L., Ateva K., Bastholm-Rahmner P., Ovesjo M. L., Jirlow M., et al. (2017). High adherence to the ‘Wise List’ treatment recommendations in Stockholm: a 15-year retrospective review of a multifaceted approach promoting rational use of medicines. BMJ Open 7 (4), e014345. 10.1136/bmjopen-2016-014345 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eriksen J., Ovesjo M. L., Vallin M., Juhasz-Haverinen M., Andersen-Karlsson E., Ateva K., et al. (2018). Primary care physicians report high trust in and usefulness of the Stockholm drug and therapeutic committee’s list of recommended essential medicines (the ‘Wise List’). Eur. J. Clin. Pharmacol. 74 (1), 131–138. 10.1007/s00228-017-2354-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eriksson I., Wettermark B., Bergfeldt K. (2018). Real-world use and outcomes of olaparib: a population-based cohort study. Targeted Oncol. 13 (6), 725–733. 10.1007/s11523-018-0604-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ermisch M., Bucsics A., Vella Bonanno P., Arickx F., Bybau A., Bochenek T., et al. (2016). Payers’ Views of the Changes Arising through the Possible Adoption of Adaptive Pathways. Front. Pharmacol. 7, 305. 10.3389/fphar.2016.00305 [DOI] [PMC free article] [PubMed] [Google Scholar]
- EUnetHTA Mission, vision and values. Available at URL: https://www.eunethta.eu/about-eunethta/mission-vision-and-values/.
- EUnetHTA (2018). An analysis of HTA and reimbursement procedures in EUnetHTA partner countries: final report.
- European Central Bank (2015). Euro Foreign Exchange Reference Rates. 1 July . Available at URLhttps://www.ecb.europa.eu/stats/exchange/eurofxref/shared/pdf/2015/07/20150701.pdf.
- Fadare J. O., Oshikoya K. A., Ogunleye O. O., Desalu O. O., Ferrario A., Enwere O. O., et al. (2018). Drug promotional activities in Nigeria: impact on the prescribing patterns and practices of medical practitioners and the implications. Hosp. Pract. 46 (2), 77–87. 10.1080/21548331.2018.1437319 [DOI] [PubMed] [Google Scholar]
- Fadare J. O., Ogunleye O., Obiako R., Orubu S., Enwere O., Ajemigbitse A. A., et al. (2018). Drug and therapeutics committees in Nigeria: evaluation of scope and functionality. Expert Rev. Clin. Pharmacol. 11 (12), 1255–1262. 10.1080/17512433.2018.1549488 [DOI] [PubMed] [Google Scholar]
- Ferrario A., Kanavos P. (2013). Managed entry agreements for pharmaceuticals: the European experience. EMiNet, Brussels, Belgium: Available at URL: http://eprints.lse.ac.uk/50513/ [Google Scholar]
- Ferrario A., Arāja D., Bochenek T., Čatić T., Dankó D., Dimitrova M., et al. (2017). The implementation of managed entry agreements in central and eastern europe: findings and implications. . PharmacoEconomics 35 (12), 1271–1285. 10.1007/s40273-017-0559-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fickweiler F., Fickweiler W., Urbach E. (2017). Interactions between physicians and the pharmaceutical industry generally and sales representatives specifically and their association with physicians’ attitudes and prescribing habits: a systematic review. BMJ Open 7 (9), e016408. 10.1136/bmjopen-2017-016408 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fincham J. E. (2008). Response rates and responsiveness for surveys, standards, and the Journal. Am. J. Pharm. Educ. 72 (2), 43. 10.5688/aj720243 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Forslund T., Raaschou P., Hjemdahl P., Krakau I., Wettermark B. (2011). Usage, risk, and benefit of weight-loss drugs in primary care. J. Obesity 2011, 459263. 10.1155/2011/459263 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fraeyman J., Van Hal G., Godman B., Beutels P. (2013). The potential influence of various initiatives to improve rational prescribing for proton pump inhibitors and statins in Belgium. Expert Rev. Of Pharmacoeconomics Outcomes Res. 13 (1), 141–151. 10.1586/erp.12.88 [DOI] [PubMed] [Google Scholar]
- Francer J., Izquierdo J. Z., Music T., Narsai K., Nikidis C., Simmonds H., et al. (2014). Ethical pharmaceutical promotion and communications worldwide: codes and regulations. Philosophy Ethics Hum. In Med. 9 (1), 7. 10.1186/1747-5341-9-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frisk P., Aggefors K., Cars T., Feltelius N., Loov S. A., Wettermark B., et al. (2018). Introduction of the second-generation direct-acting antivirals (DAAs) in chronic hepatitis C: a register-based study in Sweden. Eur. J. Clin. Pharmacol. 74 (7), 971–978. 10.1007/s00228-018-2456-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garattini L., Curto A. (2016). Performance-based agreements in italy: ‘Trendy Outcomes’ or mere illusions? PharmacoEconomics. 34 (10), 967–969. 10.1007/s40273-016-0420-1 [DOI] [PubMed] [Google Scholar]
- Garattini S., Bertele V., Godman B., Haycox A., Wettermark B., Gustafsson L. L. (2008). Enhancing the rational use of new medicines across European health care systems. Eur. J. Clin. Pharmacol. 64 (12), 1137–1138. 10.1007/s00228-008-0537-z [DOI] [PubMed] [Google Scholar]
- Garcia M. M., Barbosa M. M., Silva R. M., Reis E. A., Alvares J., Assis Acurcio F., et al. (2019). Indicator of access to medicines in relation to the multiple dimensions of access. J. Comp. Effect. Res. 8 (12), 1027–1041. 10.2217/cer-2019-0031 [DOI] [PubMed] [Google Scholar]
- Garcia-Doval I., Cohen A. D., Cazzaniga S., Feldhamer I., Addis A., Carretero G., et al. (2017). Risk of serious infections, cutaneous bacterial infections, and granulomatous infections in patients with psoriasis treated with anti-tumor necrosis factor agents versus classic therapies: Prospective meta-analysis of Psonet registries. J. Am. Acad. Dermatol. 76 (2), 299–308.e16. 10.1016/j.jaad.2016.07.039 [DOI] [PubMed] [Google Scholar]
- Ghinea H., Kerridge I., Lipworth W. If we don’t talk about value, cancer drugs will become terminal for health systems. Available at URL: http://theconversation.com/if-we-dont-talk-about-value-cancer-drugs-will-become-terminal-for-health-systems-44072.
- Godman B., Oortwijn W., de Waure C., Mosca I., Puggina A., Specchia M. L., et al. (2016). Links between Pharmaceutical R&D Models and Access to Affordable Medicines. A Study for the ENVI COMMITTEE. Available at URL: http://www.europarl.europa.eu/RegData/etudes/STUD/2016/587321/IPOL_STU(2016)587321_EN.pdf.
- Godman B., Wettermark B., Hoffmann M., Andersson K., Haycox A., Gustafsson L. L. (2009). Multifaceted national and regional drug reforms and initiatives in ambulatory care in Sweden: global relevance. Expert Rev. Pharmacoecon. Outcomes Res. 9 (1), 65–83. 10.1586/14737167.9.1.65 [DOI] [PubMed] [Google Scholar]
- Godman B., Shrank W., Andersen M., Berg C., Bishop I., Burkhardt T., et al. (2010. a). Policies to enhance prescribing efficiency in europe: findings and future implications. Front. Pharmacol. 1, 141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Godman B., Shrank W., Andersen M., Berg C., Bishop I., Burkhardt T., et al. (2010. b). Comparing policies to enhance prescribing efficiency in Europe through increasing generic utilization: changes seen and global implications. Expert Rev. Of Pharmacoeconomics Outcomes Res. 10 (6), 707–722. 10.1586/erp.10.72 [DOI] [PubMed] [Google Scholar]
- Godman B., Paterson K., Malmstrom R. E., Selke G., Fagot J. P., Mrak J. (2012). Improving the managed entry of new medicines: sharing experiences across Europe. Expert Rev. Of Pharmacoeconomics Outcomes Res. 12 (4), 439–441. 10.1586/erp.12.44 [DOI] [PubMed] [Google Scholar]
- Godman B., Finlayson A. E., Cheema P. K., Zebedin-Brandl E., Gutierrez-Ibarluzea I., Jones J., et al. (2013. a). Personalizing health care: feasibility and future implications. BMC Med. 11, 179. 10.1186/1741-7015-11-179 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Godman B., Persson M., Miranda J., Skiold P., Wettermark B., Barbui C., et al. (2013. b). Changes in the utilization of venlafaxine after the introduction of generics in Sweden. Appl. Health Economics And Health Policy 11 (4), 383–393. 10.1007/s40258-013-0037-x [DOI] [PubMed] [Google Scholar]
- Godman B., Wettermark B., van Woerkom M., Fraeyman J., Alvarez-Madrazo S., Berg C., et al. (2014. a). Multiple policies to enhance prescribing efficiency for established medicines in Europe with a particular focus on demand-side measures: findings and future implications. Front. Pharmacol. 5, 106. 10.3389/fphar.2014.00106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Godman B., Malmstrom R. E., Diogene E., Jayathissa S., McTaggart S., Cars T., et al. (2014. b). Dabigatran - a continuing exemplar case history demonstrating the need for comprehensive models to optimize the utilization of new drugs. Front. Pharmacol. 5, 109. 10.3389/fphar.2014.00109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Godman B., Petzold M., Bennett K., Bennie M., Bucsics A., Finlayson A. E., et al. (2014. c). Can authorities appreciably enhance the prescribing of oral generic risperidone to conserve resources? Findings from across Europe and their implications. BMC Med. 12, 98. 10.1186/1741-7015-12-98 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Godman B., Acurcio F., Guerra Junior A. A., Alvarez-Madrazo S., Faridah Aryani M. Y., et al. (2014. d). Initiatives among authorities to improve the quality and efficiency of prescribing and the implications. J. Pharm. Care Health Sys. 1 (3), 1–15. [Google Scholar]
- Godman B., Malmstrom R. E., Diogene E., Gray A., Jayathissa S., Timoney A., et al. (2015. a). Are new models needed to optimize the utilization of new medicines to sustain healthcare systems? Expert Rev. Clin. Pharmacol. 8 (1), 77–94. [DOI] [PubMed] [Google Scholar]
- Godman B., Wilcock M., Martin A., Bryson S., Baumgärtel C., Bochenek T., et al. (2015. b). Generic pregabalin; current situation and implications for health authorities, generics and biosimilars manufacturers in the future. GaBI J. 4 (3), 125–135. 10.5639/gabij.2015.0403.028 [DOI] [Google Scholar]
- Godman B., Wild C., Haycox A. (2017). Patent expiry and costs for anti-cancer medicines for clinical use. Gene. Biosimilars Initiative J. 6 (3), 105–106. 10.5639/gabij.2017.0603.021 [DOI] [Google Scholar]
- Godman B., Bucsics A., Vella Bonanno P., Oortwijn W., Rothe C. C., Ferrario A., et al. (2018). Barriers for access to new medicines: searching for the balance between rising costs and limited budgets. Front. Public Health 6, 328. 10.3389/fpubh.2018.00328 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Godman B., Allocati E., Moorkens E. (2019. a). Ever-Evolving landscape of biosimilars in Canada; findings and implications from a global perspective. Gene. Biosimilars Initiative J. J. 8 (3). [Google Scholar]
- Godman B., Hill A., Simoens S., Kurdi A., Gulbinovič J., Martin A. P., et al. (2019. b). Pricing of oral generic cancer medicines in 25 European countries; findings and implications. Gene. Biosimilars Initiative J. 8 (2), 49–70. 10.5639/gabij.2019.0802.007 [DOI] [Google Scholar]
- Goldstein D. A., Clark J., Tu Y., Zhang J., Fang F., Goldstein R., et al. (2017). A global comparison of the cost of patented cancer drugs in relation to global differences in wealth. Oncotarget 8 (42), 71548–71555. 10.18632/oncotarget.17742 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grimshaw J. M., Thomas R. E., MacLennan G., Fraser C., Ramsay C. R., Vale L., et al. (2004). Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol. Assess. 8 (6), iii–iv, 1-72. 10.3310/hta8060 [DOI] [PubMed] [Google Scholar]
- Guerra-Junior A. A., Pires de Lemos L. L., Godman B., Bennie M., Osorio-de-Castro C. G. S., Alvares J., et al. (2017). Health technology performance assessment: real-world evidence for public healthcare sustainability. Int. J. Technol. Assess. In Health Care 33 (2), 279–287. 10.1017/S0266462317000423 [DOI] [PubMed] [Google Scholar]
- Gustafsson L. L., Wettermark B., Godman B., Andersen-Karlsson E., Bergman U., Hasselstrom J., et al. (2011). The ‘wise list’- a comprehensive concept to select, communicate and achieve adherence to recommendations of essential drugs in ambulatory care in Stockholm. Basic Clin. Pharmacol. Toxicol. 108 (4), 224–233. 10.1111/j.1742-7843.2011.00682.x [DOI] [PubMed] [Google Scholar]
- Haycox A. (2016). Why Cancer? PharmacoEconomics 34 (7), 625–627. 10.1007/s40273-016-0413-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holloway K., Green T. (2003). Drug and therapeutics committees. A practical guide on behalf of the WHO in collaboration with MSH. Available at URL: http://apps.who.int/medicinedocs/pdf/s4882e/s4882e.pdf.
- Holloway K. A., Kotwani A., Batmanabane G., Santoso B., Ratanawijitrasin S., Henry D. (2018). Promoting quality use of medicines in South-East Asia: reports from country situational analyses. BMC Health Serv. Res. 18 (1), 526. 10.1186/s12913-018-3333-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Howard D. H., Bach P., Berndt E. R., Conti R. M. (2015). Pricing in the Market for Anticancer Drugs. J. Econ. Perspect. 29 (1), 139–162. 10.1257/jep.29.1.139 [DOI] [PubMed] [Google Scholar]
- IMS Institute for Healthcare Informatics (2016). Global Oncology Trend Report. A Review of 2015 and Outlook to 2020. June. Available at URL: https://www.scribd.com/document/323179495/IMSH-Institute-Global-Oncology-Trend-2015-2020-Report.
- IQVIA Institute for Human Data Science (2018). Global Oncology Trends. Available at URL: https://www.iqvia.com/institute/reports/global-oncology-trends-2018.
- Jacobs T. G., Robertson J., van den Ham H. A., Iwamoto K., Bak Pedersen H., Mantel-Teeuwisse A. K. (2019). Assessing the impact of law enforcement to reduce over-the-counter (OTC) sales of antibiotics in low- and middle-income countries; a systematic literature review. BMC Health Serv. Res. 19 (1), 536. 10.1186/s12913-019-4359-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jin M., Naumann T., Regier L., Bugden S., Allen M., Salach L., et al. (2012). A brief overview of academic detailing in Canada: another role for pharmacists. Can. Pharmacists J.: CPJ = Rev. Des. Pharmaciens du Canada: RPC 145 (3), 142–6.e2. 10.3821/145.3.cpj142 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaplan W. A., Ritz L. S., Vitello M., Wirtz V. J. (2012). Policies to promote use of generic medicines in low and middle income countries: a review of published literature, 2000-2010. Health Policy 106 (3), 211–224. 10.1016/j.healthpol.2012.04.015 [DOI] [PubMed] [Google Scholar]
- Kelly R. J., Smith T. J. (2014). Delivering maximum clinical benefit at an affordable price: engaging stakeholders in cancer care. Lancet Oncol. 15 (3), e112–e118. 10.1016/S1470-2045(13)70578-3 [DOI] [PubMed] [Google Scholar]
- Khazzaka M. (2019). Pharmaceutical marketing strategies’ influence on physicians’ prescribing pattern in Lebanon: ethics, gifts, and samples. BMC Health Serv. Res. 19 (1), 80. 10.1186/s12913-019-3887-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kwon H.-Y., Kim H., Godman B. (2018). Availability and affordability of drugs with a conditional approval by the european medicines agency; comparison of korea with other countries and the implications. Front. Pharmacol. 9 (938), 1–9. 10.3389/fphar.2018.00938 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leporowski A., Godman B., Kurdi A., MacBride-Stewart S., Ryan M., Hurding S., et al. (2018). Ongoing activities to optimize the quality and efficiency of lipid-lowering agents in the Scottish national health service: influence and implications. Expert Rev. Of Pharmacoeconomics Outcomes Res. 18 (6), 655–666. 10.1080/14737167.2018.1501558 [DOI] [PubMed] [Google Scholar]
- Lima-Dellamora Eda C., Caetano R., Gustafsson L. L., Godman B. B., Patterson K., Osorio-de-Castro C. G. (2014). An analytical framework for assessing drug and therapeutics committee structure and work processes in tertiary Brazilian hospitals. Basic Clin. Pharmacol. Toxicol. 115 (3), 268–276. 10.1111/bcpt.12215 [DOI] [PubMed] [Google Scholar]
- Luzzatto L., Hyry H. I., Schieppati A., Costa E., Simoens S., Schaefer F., et al. (2018). Outrageous prices of orphan drugs: a call for collaboration. Lancet 392 (10149), 791–794. 10.1016/S0140-6736(18)31069-9 [DOI] [PubMed] [Google Scholar]
- Malmstrom R. E., Godman B. B., Diogene E., Baumgartel C., Bennie M., Bishop I., et al. (2013). Dabigatran - a case history demonstrating the need for comprehensive approaches to optimize the use of new drugs. Front. Pharmacol. 4, 39. 10.3389/fphar.2013.00039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin A., Godman B., Miranda J., Tilstone J., Saleem N., Olsson E., et al. (2014). Measures to improve angiotensin receptor blocker prescribing efficiency in the UK: findings and implications. J. Comp. Effect. Res. 3 (1), 41–51. 10.2217/cer.13.83 [DOI] [PubMed] [Google Scholar]
- Mashaba T. P., Matlala M., Godman B., Meyer J. C. (2019). Implementation and monitoring of decisions by pharmacy and therapeutics committees in South African public sector hospitals. Expert Rev. Clin. Pharmacol. 12 (2), 159–168. 10.1080/17512433.2018.1545572 [DOI] [PubMed] [Google Scholar]
- Mashalla Y. J., Sepako E., Setlhare V., Chuma M., Bulang M., Massele A. Y. (2016). Availability of guidelines and policy documents for enhancing performance of practitioners at the Primary Health Care (PHC) facilities in Gaborone, Tlokweng and Mogoditshane, Republic of Botswana. J. Public Health Epidemiol. 8 (8), 127–135. [Google Scholar]
- Matlala M., Gous A. G., Godman B., Meyer J. C. (2017). Structure and activities of pharmacy and therapeutics committees among public hospitals in South Africa; findings and implications. Expert Rev. Clin. Pharmacol. 10 (11), 1273–1280. 10.1080/17512433.2017.1364625 [DOI] [PubMed] [Google Scholar]
- Matsitse T. B., Helberg E., Meyer J. C., Godman B., Massele A., Schellack N. (2017). Compliance with the primary health care treatment guidelines and the essential medicines list in the management of sexually transmitted infections in correctional centres in South Africa: findings and implications. Expert Rev. Anti-infective Ther. 15 (10), 963–972. 10.1080/14787210.2017.1382354 [DOI] [PubMed] [Google Scholar]
- Matusewicz W., Godman B., Pedersen H. B., Furst J., Gulbinovic J., Mack A., et al. (2015). Improving the managed introduction of new medicines: sharing experiences to aid authorities across Europe. Expert Rev. Pharmacoecon. Outcomes Res. 15 (5), 755–758. 10.1586/14737167.2015.1085803 [DOI] [PubMed] [Google Scholar]
- McCabe H., Godman B., Kurdi A., Johnston K., MacBride-Stewart S., Lennon J., et al. (2019). Prescribing trends of inhaler treatments for asthma and chronic obstructive pulmonary disease within a resource-constrained environment in the Scottish national health service: findings and implications. Expert Rev. Respir. Med. 13 (7), 679–689. 10.1080/17476348.2019.1624528 [DOI] [PubMed] [Google Scholar]
- McGinn D., Godman B., Lonsdale J., Way R., Wettermark B., Haycox A. (2010). Initiatives to enhance the quality and efficiency of statin and PPI prescribing in the UK: impact and implications. Expert Rev. Pharmacoecon. Outcomes Res. 10 (1), 73–85. 10.1586/erp.09.73 [DOI] [PubMed] [Google Scholar]
- Md Rezal R. S., Hassali M. A., Alrasheedy A. A., Saleem F., Md Yusof F. A., Godman B. (2015). Physicians’ knowledge, perceptions and behaviour towards antibiotic prescribing: a systematic review of the literature. Expert Rev. Anti-Infective Ther. 13 (5), 665–680. 10.1586/14787210.2015.1025057 [DOI] [PubMed] [Google Scholar]
- Mercer L. K., Askling J., Raaschou P., Dixon W. G., Dreyer L., Hetland M. L., et al. (2017). Risk of invasive melanoma in patients with rheumatoid arthritis treated with biologics: results from a collaborative project of 11 European biologic registers. Ann. Rheumatic Dis. 76 (2), 386–391. 10.1136/annrheumdis-2016-209285 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meyer J. C., Schellack N., Stokes J., Lancaster R., Zeeman H., Defty D., et al. (2017). Ongoing initiatives to improve the quality and efficiency of medicine use within the public healthcare system in south africa; a preliminary study. Front. Pharmacol. 8, 751. 10.3389/fphar.2017.00751 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moon J. C., Godman B., Petzold M., Alvarez-Madrazo S., Bennett K., Bishop I., et al. (2014). Different initiatives across Europe to enhance losartan utilization post generics: impact and implications. Front. Pharmacol. 5, 219. 10.3389/fphar.2014.00219 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moorkens E., Vulto A. G., Huys I., Dylst P., Godman B., Keuerleber S., et al. (2017). Policies for biosimilar uptake in Europe: An overview. . PloS One 12 (12), e0190147. 10.1371/journal.pone.0190147 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mueller T., Alvarez-Madrazo S., Robertson C., Wu O., Bennie M. (2019). Comparative safety and effectiveness of direct oral anticoagulants in patients with atrial fibrillation in clinical practice in Scotland. Br. J. Clin. Pharmacol. 85 (2), 422–431. 10.1111/bcp.13814 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Niaz Q., Godman B., Massele A., Campbell S., Kurdi A., Kagoya H. R., et al. (2019). Validity of World Health Organisation prescribing indicators in Namibia’s primary healthcare: findings and implications. Int. J. Qual. In Health Care 31 (5), 338–345. 10.1093/intqhc/mzy172 [DOI] [PubMed] [Google Scholar]
- O’Brien M. A., Rogers S., Jamtvedt G., Oxman A. D., Odgaard-Jensen J., Kristoffersen D. T., et al. (2007). Educational outreach visits: effects on professional practice and health care outcomes. Cochr. Database Syst. Rev. (4), Cd000409. [DOI] [PMC free article] [PubMed] [Google Scholar]
- OECD/EU (2018). Health at a Glance: Europe 2018 - State of Health in the EU Cycle. OECD Publishing, Paris: Available at URL: 10.1787/health_glance_eur-2018-en. [DOI] [Google Scholar]
- OECD (2017). Health at a Glance Available at URL: https://www.oecd-ilibrary.org/docserver/health_glance-2017-en.pdf?expires=1531413926&id=id&accname=guest&checksum=656327F799B10217DD2D80F463DAB8732017.
- Ofori-Asenso R., Agyeman A. A. (2016). Irrational use of medicines—a summary of key concepts. Pharmacy 4, 35. 10.3390/pharmacy4040035 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ogunleye O. O., Fadare J. O., Yinka-Ogunleye A. F., Anand Paramadhas B. D., Godman B. (2019). Determinants of antibiotic prescribing among doctors in a Nigerian urban tertiary hospital. Hosp. practice. 47 (1), 53–58. 10.1080/21548331.2018.1475997 [DOI] [PubMed] [Google Scholar]
- Parkinson B., Sermet C., Clement F., Crausaz S., Godman B., Garner S., et al. (2015). Disinvestment and value-based purchasing strategies for pharmaceuticals: an international review. PharmacoEconomics 33 (9), 905–924. 10.1007/s40273-015-0293-8 [DOI] [PubMed] [Google Scholar]
- Riaz H., Godman B., Hussain S., Malik F., Mahmood S., Shami A., et al. (2015). Prescribing of bisphosphonates and antibiotics in Pakistan: challenges and opportunities for the future. JPHSR 6, 111–121. 10.1111/jphs.12091 [DOI] [Google Scholar]
- Richards J. M., Burgon T. B., Tamondong-Lachica D., Bitran J. D., Liangco W. L., Paculdo D. R., et al. (2019). Reducing unwarranted oncology care variation across a clinically integrated network: a collaborative physician engagement strategy. J. Oncol. practice., Jop1800754. 10.1200/JOP.18.00754 [DOI] [PubMed]
- Sabir M. B. (2018). Role of WHO: government and pharmacist in promoting rational drug use. J. Appl. Pharm. 10, 256. [Google Scholar]
- Sermet C., Andrieu V., Godman B., Van Ganse E., Haycox A., Reynier J. P. (2010). Ongoing pharmaceutical reforms in France: implications for key stakeholder groups. Appl. Health Economics And Health Policy 8 (1), 7–24. 10.1007/BF03256162 [DOI] [PubMed] [Google Scholar]
- Shnier A., Lexchin J., Romero M., Brown K. (2016). Reporting of financial conflicts of interest in clinical practice guidelines: a case study analysis of guidelines from the Canadian Medical Association Infobase. BMC Health Serv. Res. 16 (a), 383. 10.1186/s12913-016-1646-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shrank W. H., Liberman J. N., Fischer M. A., Girdish C., Brennan T. A., Choudhry N. K. (2011). Physician perceptions about generic drugs. Ann. Pharmacotherapy. 45 (1), 31–38. 10.1345/aph.1P389 [DOI] [PubMed] [Google Scholar]
- Simoens S., Picavet E., Dooms M., Cassiman D., Morel T. (2013). Cost-effectiveness assessment of orphan drugs: a scientific and political conundrum. Appl. Health Economics And Health Policy 11 (1), 1–3. 10.1007/s40258-012-0004-y [DOI] [PubMed] [Google Scholar]
- Simoens S., Le Pen C., Boone N., Breedveld N., Llombart-Cussac A., Jorgensen F., et al. (2018). How to realize the potential of off-patent biologicals and biosimilars in Europe? Guidance to policymakers. Gene. Biosimilars Initiative J. 7 (2), 70–74. 10.5639/gabij.2018.0702.014 [DOI] [Google Scholar]
- Spurling G. K., Mansfield P. R., Montgomery B. D., Lexchin J., Doust J., Othman N., et al. (2010). Information from pharmaceutical companies and the quality, quantity, and cost of physicians’ prescribing: a systematic review. PloS Med. 7 (10), e1000352. 10.1371/journal.pmed.1000352 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thawani V. (2010). Rational use of medicines: Achievements and challenges. Indian J. Pharmacol. 42 (2), 63–64. 10.4103/0253-7613.64486 [DOI] [PMC free article] [PubMed] [Google Scholar]
- The Lancet (2019). Managing conflicts of interests in clinical guidelines. Lancet. 394 (10200), 710. 10.1016/S0140-6736(19)32000-8 [DOI] [PubMed] [Google Scholar]
- Troncoso A., Diogene E. (2014). Dabigatran and rivaroxaban prescription for atrial fibrillation in Catalonia, Spain: the need to manage the introduction of new drugs. Eur. J. Clin. Pharmacol. 70 (2), 249–250. 10.1007/s00228-013-1593-6 [DOI] [PubMed] [Google Scholar]
- Vella Bonanno P., Ermisch M., Godman B., Martin A. P., Van Den Bergh J., Bezmelnitsyna L., et al. (2017). Adaptive pathways: possible next steps for payers in preparation for their potential implementation. Front. Pharmacol. 8, 497. 10.3389/fphar.2017.00497 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vella Bonanno P., Bucsics A., Simoens S., Martin A. P., Oortwijn W., Gulbinovic J., et al. (2019). Proposal for a regulation on health technology assessment in Europe - opinions of policy makers, payers and academics from the field of HTA. Expert Rev. Of Pharmacoeconomics Outcomes Res. 19 (3), 251–261. 10.1080/14737167.2019.1575730 [DOI] [PubMed] [Google Scholar]
- Vogler S., Schneider P. (2017). Do pricing and usage-enhancing policies differ between biosimilars and generics? Findings from an international survey. Gene. Biosimilars Initiative J. 6 (2), 79–88. 10.5639/gabij.2017.0602.015 [DOI] [Google Scholar]
- Voncina L., Strizrep T., Godman B., Bennie M., Bishop I., Campbell S., et al. (2011). Influence of demand-side measures to enhance renin-angiotensin prescribing efficiency in Europe: implications for the future. Expert Rev. Of Pharmacoeconomics Outcomes Res. 11 (4), 469–479. 10.1586/erp.11.42 [DOI] [PubMed] [Google Scholar]
- Ward V. L., House A. O., Hamer S. (2009). Knowledge brokering: exploring the process of transferring knowledge into action. BMC Health Serv. Res. 9, 12. 10.1186/1472-6963-9-12 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wettermark B., Godman B., Jacobsson B., Haaijer-Ruskamp F. M. (2009. a). Soft regulations in pharmaceutical policy making: an overview of current approaches and their consequences. Appl. Health Econ. Health Policy 7 (3), 137–147. 10.1007/BF03256147 [DOI] [PubMed] [Google Scholar]
- Wettermark B., Pehrsson A., Juhasz-Haverinen M., Veg A., Edlert M., Tornwall-Bergendahl G., et al. (2009. b). Financial incentives linked to self-assessment of prescribing patterns: a new approach for quality improvement of drug prescribing in primary care. Qual. Primary Care 17 (3), 179–189. [PubMed] [Google Scholar]
- Wettermark B., Godman B., Neovius M., Hedberg N., Mellgren T. O., Kahan T. (2010). Initial effects of a reimbursement restriction to improve the cost-effectiveness of antihypertensive treatment. Health Policy 94 (3), 221–229. 10.1016/j.healthpol.2009.09.014 [DOI] [PubMed] [Google Scholar]
- WHO (2015). Access to new medicines in Europe: technical review of policy initiatives and opportunities for collaboration and research. Available at URL: http://www.euro.who.int/:data/assets/pdf_file/0008/306179/Access-new-medicines-TR-PIO-collaboration-research.pdf?ua=1.
- Wild C., Grossmann N., Bonanno P. V., Bucsics A., Furst J., Garuoliene K., et al. (2016). Utilisation of the ESMO-MCBS in practice of HTA. Ann. Oncol. 27 (11), 2134–2136. 10.1093/annonc/mdw297 [DOI] [PubMed] [Google Scholar]
- Woerkom M., Piepenbrink H., Godman B., Metz J., Campbell S., Bennie M., et al. (2012). Ongoing measures to enhance the efficiency of prescribing of proton pump inhibitors and statins in The Netherlands: influence and future implications. J. Of Comp. Effect. Res. 1 (6), 527–538. 10.2217/cer.12.52 [DOI] [PubMed] [Google Scholar]
- World Health Organization (2012). The pursuit of responsible use of medicines: Sharing and learning from country experiences. Available at URL: https://apps.who.int/iris/bitstream/handle/10665/75828/WHO_EMP_MAR_2012.3_eng.pdf;jsessionid=D819046B9E21DE48A1391A19A07770CC?sequence=1 .
- World Health Organization (2002). Promoting rational use of medicines: core components, Available at URL: http://apps.who.int/medicinedocs/en/d/Jh3011e/.
- World Health Organization (2007). Progress in the rational use of medicines, Available at URL: https://www.who.int/selection_medicines/committees/expert/18/policy/RUM_WHA60.16.pdf.
- World Health Organization (2003). Drug and Therapeutics Committee: A Practical Guide. Available from URL: https://apps.who.int/medicinedocs/en/d/Js4882e/3.3.html.
- World Health Organization (2012). Essential Medicines and Health Products Available from: https://www.who.int/medicines/areas/rational_use/en/.
- ZonMw (2015). Expansion and extension of the use of cancer registry data as a HTA tool in pharmacotherapy [Available from URL: https://www.zonmw.nl/nl/onderzoek-resultaten/geneesmiddelen/programmas/project-detail/doelmatigheidsonderzoek-farmacotherapie/expansion-and-extension-of-the-use-of-cancer-registry-data-as-hta-tool-in-pharmacotherapy/.
- ZonMw (2019). Proper Use of Medicines. [Available from URL: https://www.zonmw.nl/nl/onderzoek-resultaten/doelmatigheidsonderzoek/programmas/programma-detail/goed-gebruik-geneesmiddelen/.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.