Skip to main content
PLOS One logoLink to PLOS One
. 2023 Feb 6;18(2):e0281280. doi: 10.1371/journal.pone.0281280

Association of exogenous factors with the access to innovative pharmaceutical products in Hungary

Gergő Merész 1,2,*, Péter Gaál 1
Editor: Vasileios Kallinterakis3
PMCID: PMC9901764  PMID: 36745671

Abstract

Introduction

Access to innovative pharmaceuticals is thought to be associated with several exogenous factors related to the local legal or financial framework of pharmaceutical reimbursement. Our aim was to describe the association between the outcome of the reimbursement procedure on innovative pharmaceutical submissions in Hungary and several potential explanatory variables related to the legal or financial framework of reimbursement procedures, such as the submission implying a need for a legal act to conclude on a positive decision; having a risk-sharing agreement (RSA) in place at the time of submission; the aim of the submission and expenditure on individual funding requests.

Methods

Publicly available administrative announcements of the Hungarian National Health Insurance Fund Manager were used to construct the analysis dataset including all concluded procedures between 1 January 2018 and 7 June 2021, complemented with information on the overall aim of the submission (new compound or new indication). Logistic regression models were used to estimate odds ratios while adjusting for potential confounding.

Results

Needing a legislative change as a proxy of involving high-level decision makers to reimburse had a lower (OR = 0.05, CI95%:0.02–0.11), whereas having an RSA had a statistically significant higher chance of a positive decision (OR = 3.49, CI95%:1.56–7.82). In contrast, neither the overall purpose of the submission (OR = 1.32, CI95%:0.65–2.69), nor the average biennial expenditure on individual funding requests exceeding 200 million HUFs (OR = 1.04, CI95%:0.92–1.19) had a statistically significant association with the decision.

Conclusions

This study quantitatively demonstrated that the need for legal acts to conclude on a positive decision decreases, whereas having an RSA for the particular product increases the likelihood of a positive reimbursement decision in Hungary. The role of other factors remain unclear. Our findings suggest that the legal requirements and RSAs play key roles in the reimbursement of innovative pharmaceuticals and can be viewed as potential areas of policy interventions in expanding access to these products, although the feasibility of such interventions need strong commitment from decision-makers, as well as implying increased autonomy to the entities involved in reimbursement procedures. Further research is needed to assess the impact of endogenous and exogenous factors in a coherent framework.

Introduction

Patient access to new treatments has been in the focus of a number of high-level healthcare stakeholders over past decades, with some focusing on timeliness and equality [1], while others echoing the importance of affordability [2]. Although having a tax-funded social health insurance system with a single payer, the so-called National Health Insurance Fund Manager (NHIFM), which provides practically universal coverage, drug policy in Hungary faces the similar challenges as other European countries in terms of patient access to innovative pharmaceutical treatments [35].

As an initial step to identify possible determinants of patient access, the local decision-making procedure must be described. The procedure to finance an innovative pharmaceutical product is initiated by the market authorization holder submitting a reimbursement dossier for a product-indication pair. The dossier contains the summary of clinical evidence and the underlying reports, as well as an economic evaluation covering the cost-effectiveness and budget impact analyses. The dossier is critically appraised using published methods [6] that are tailored to meet the local needs by the local HTA body, an non-binding assessment report is issued. The critical appraisal procedure culminates in a dedicated meeting of the Health Technology Assessment Committee, and a recommendation for decision is formulated, and initial price negotiations (i.e. arranging risk-sharing agreements) may start. If the dossier proposes to introduce a new compound, or a new indication of an already reimbursed compound to the list of reimbursed pharmaceutical products, certain ministerial decrees will need to be changed, and therefore, the Secretary of State for Health (and the Ministry of Finance) needs to be involved. Ideally, the Secretary of State convenes semi-annually a committee responsible for the prioritisation of dossiers with a positive recommendation to reimburse within the budgetary limits. The committee consists of representatives from the payer (i.e. NHIFM), the Department of Pharmaceutical Policy and Medical Devices of the Secretary of State for Health, the Ministry of Finance, as well as the Department of Health Technology Assessment at the National Institute of Pharmacy and Nutrition (NIPN). Due to the number of actors involved and the complexity of the procedure, timely decisions are needed to reimburse innovative pharmaceutical products, as otherwise patients may have limited or delayed access to these treatments [7]. The delayed access to innovative pharmaceutical products may arise from endogenous factors directly related to the clinical or economic properties of the product submitted for reimbursement (i.e. clinical added value; cost-effectiveness) or from factors outside of these domains, and rather related to the reimbursement procedure, that is, exogenous to the actual submission. Barriers of patient access related to local reimbursement procedures have been already assessed in details by some researchers for particular disease areas using qualitative data from certain Central and Eastern European countries, including Hungary [8]. Godman and colleagues [9] reported on a narrative review prepared to identify barriers for access to new medicines, touching base on a number of factors related to the features of multiple criteria decision analysis tools and the role of managed entry agreements in enhancing chances of reimbursement for innovative products.

However, only anecdotal evidence is available on what, how and to what extent financial and procedural circumstances influence the outcome of decision-making on the submissions of innovative pharmaceutical products in Hungary. Having the list of reimbursed health technologies set out by governmental decrees can be perceived as an administrative barrier. As a consequence, submissions requiring a legislative change due to the local legal environment are expected to be less likely to conclude in a positive decision This assumption is supported by the fact that such situations require involving the Ministry of Human Capacities (the ministry responsible for health in Hungary), and decision-making continues on a higher, political level, with the involvement of further stakeholders and long bureaucratic processes. Supporting such a submission usually requires the reallocation of funding between sub-budgets or additional resources. Another frequently, but anecdotally echoed possible explanatory factor, in this case for positive reimbursement decisions, is already having a risk-sharing agreement (RSA) in place for a particular compound at the time of submitting the dossier. It is reasoned that in these situations (i.e. extending the reimbursed indications of a compound), the payer and the market authorization holder have already closed an earlier round of price negotiations, so there is less uncertainty around the financial impact of reimbursement decisions for both parties. This suggests a mutual interest in having a positive reimbursement decision, and may accelerate patient access, as suggested by others [10]. However, the aim of the submission can also be viewed as a separate explanatory variable alongside RSAs. Submissions aiming to introduce an entirely new compound (or a new combination of compounds) can potentially be distinguished from those that propose the introduction of a new indication for an already reimbursed compound. An entirely new compound would possibly invoke greater interest, as it may address an unmet need in the population or offer a new therapeutic option for patients and clinicians. A somewhat different situation can occur if a new indication of an already reimbursement compound is requesting reimbursement. It is possible that experience with financing the treatment may impact the outcome of the decision regardless of a valid RSA. Reimbursement submissions may also have other purposes that are less relevant to the current research, such as adjusting the reimbursement technique (i.e. moving the product from the inpatient setting to the outpatient setting), introducing a new pharmaceutical form, or increasing the price of an already reimbursed compound. Finally, higher levels of expenditure on individual funding requests (IFRs) may also motivate the payer to conclude on a positive decision as handling these requests can be burdensome in both administrative and financial terms. IFRs are a system to provide reimbursement for products and indications, which have not been included in the positive list of pharmaceuticals of the public benefit package, yet, but there is some evidence of clinical benefit for (usually a small number of) patients. There is no quantitative restriction on the number IFRs submitted by clinicians or any strong barrier alike, and the documentation supporting each request that needs to be attached is quite brief as well, resulting in an acceptance rate of over 88% in 2020 [11]. Hence, they are an exceptionally useful means of enabling health equity and patient access, as submitting them are in the merit of the patient and the clinician. However, the number of such requests (around 20,000 per annum in the past years) and the limited bargaining power of the financing agent for this financing mechanism can incentivise the healthcare decision-makers to transfer products with high IFR volumes into routine reimbursement as soon as possible. Moreover, pharmaceutical products that have relatively high IFR volumes consequently have a high level of baseline spending, and the formal reimbursement of decision comes with only minor net budget impact on the level of the healthcare budget. Hence it is plausible to think that having an IFR contributes to a positive reimbursement decision.

Although the availability of innovative pharmaceutical products is monitored regularly in European countries, the factors contributing to limited or delayed access have so far been mostly explored with qualitative techniques. The aim of the current study is to provide a quantitative description of the association between the outcome of reimbursement decision with the aforementioned potential contributing exogenous factors.

Materials and methods

In order to explore the association between the outcome of the reimbursement procedure, the anecdotal contributing factors were operationalised as independent variables in a multivariate logistic regression framework. Univariate- and multivariate models were used to estimate odds ratios (ORs), quantifying the association between each factor and the outcome of the decision procedure. Basic information is publicly available on each reimbursement submission [12], maintained by the NHIFM. Apart from the name of the product, date of the submission and further administrative details, this data source contains the outcome of the procedure and information on whether a positive decision on the submission would imply the amendment of the current legislation.

The need for the amendment of the current legislation occurs, if a new compound is submitted for reimbursement, aiming at an indication which is not yet recognized in legal acts. This essentially means that the Ministry of Human Resources is directly involved as a new entity in the decision-making procedure. This variable is expected to decrease the chance of a positive decision on reimbursement.

Having an RSA in place on the submitted product at the time of submission means that the NHIFM and the market authorization holder (MAH) already engaged in price negotiations before the actual submission. This is mostly relevant for submissions with purposes other than introducing an entirely new compound to the healthcare system. This variable is expected to increase the risk of a positive decision on reimbursement. Although the contents of RSAs are confidential, there are public semi-annual reports on products that are reimbursed with RSAs in place [13]. This information can be used to identify submissions which were involved in an RSA at the time of their submission.

The purpose of the submission may also impact the outcome of the decision-making procedure and therefore should be assessed. The archives of the Department of Health Technology Assessment at the National Institute of Pharmacy and Nutrition were used to review the submitted documentation to identify the overall purpose of the submission, namely, whether it aimed for the reimbursement of an entirely new compound, or had other purposes, such as extending the current reimbursement of a compound to a new indication.

Finally, expenditure on IFRs may also have an impact on the reimbursement decisions, as the financing agent may not be fully capable of engaging in price negotiations, and the administrative burden of handling these requests is also demanding. Therefore, a high level of expenditure on IFRs would presumably develop an interest in the financing agent to include the product on the reimbursement list, i.e. increasing the chance of a positive decision while reducing the administrative burden. We used publicly available financial reports on expenditures reimbursed through individual funding requests of pharmaceutical products to further expand our dataset [14].

Data analysis

As the current legislative framework of pharmaceutical reimbursement submissions was issued in late 2017 [15], reimbursement submissions between 1 January 2018 and 7 June 2021 were considered for this analysis. First, dossiers not submitted for the full procedure and procedures which did not conclude during the observation period were both omitted from the analysis. Second, procedures related to submissions aiming to increase the price of an already reimbursed product were also excluded, as these are not relevant to providing information on access to innovative pharmaceutical products.

Apart from descriptive analyses, the association between the outcome of the decision-making procedure as the dependent variable and the need of a legal act, having an RSA in place at the time of submission, overall purpose of the submission or expenditure on IFRs as independent variables was studied in univariate and multivariate logistic regression framework. A quasi case-control study design was adapted where the outcome of the decision-making procedure was coded as a binary variable with the value „1” marking a positive decision, and „0” if any other outcome was reached (negative decisions or no decision reached within mandatory deadlines of the procedure). The need of a legal act for decision-making (yes = 1, no = 0), the presence of an RSA at the time of submission (yes = 1, no = 0), overall purpose of the dossier (new compound or a new combination containing a new compound = 1, any other purpose, but not a price increase = 0) were also included as dichotomous variables. Expenditures reimbursed on the basis of IFRs were collected for the actual and preceding year of submission for each procedure. However, to help interpretation, this variable was recoded by using units of 200 million HUFs for the biennial expenditures on IFRs to tackle the potential seasonality and fluctuation of expenditures on IFRs. Data analysis was conducted in R version 4.1.2 [16]. The threshold for statistical significance was 0.05. Missing data points were omitted from the analyses.

Results

The total number of reimbursement submissions between 1 January 2018 and 7 June 2021 was 1,390. Among these submissions, 486 was submitted in the full procedure, of which 162 did not conclude at the time of analysis. Of the remaining 324 submissions, 92 was aiming for a price increase, or adjusting the reimbursement technique, and were considered irrelevant to the current research.

The primary analysis dataset consisted of information on 232 submissions, enriched with data on legal act needed for the decision, RSAs in place at the time of submission, compound-level biennial expenditure on IFRs (expressed HUFs) and overall aim of the submission.

Table 1 summarises the descriptive data on submissions according to the outcome of the decision-making and independent variables. Chi-square and independent samples T-tests were performed to study the association between the outcome of the decision-making procedure and the independent variables.

Table 1. Description of the submissions according to independent variables.

Positive Any other outcome All procedures p-value
A legal act is needed for the positive decision
    Yes 30 (29.13%) 112 (86.82%) 142 (61.21%) p<0.001
    No 73 (70.87%) 17 (13.18%) 90 (38.79%)
RSA was in effect at the time of submission
    Yes 32 (31.07%) 18 (13.96%) 50 (21.55%) p = 0.002
    No 71 (68.93%) 111(86.04%) 182 (78.44%)
Overall aim of the submission
    Introducing a new compound or a combination with a new compound 13 (12.62%) 53 (41.09%) 66 (28.21%) p<0.001
    Introducing a new indication for an already reimbursed compound 48 (46.60%) 70 (54.26%) 118 (50.43%)
    Other, but not a price increase 42 (40.78%) 6 (4.65%) 50 (21.37%)
Average biennial expenditure on compound, based on IFRs (HUF, mean (SD)) 194,934,323 (531,420,827) 164,388,885 (463,476,416) 181,050,033 (499,868,965) p = 0.5617

More, than two thirds of reimbursement submissions with a positive decision did not need a legal act, whereas 86.82% of reimbursement dossiers with non-positive outcomes would have needed a modification of the legal acts, yielding a statistically significant difference. The proportion of dossiers where the compound itself was covered by an RSA at the time of submission were also significantly more frequent in case of procedures with positive outcomes. Among reimbursement procedures with a non-positive outcome, dossiers proposing to introduce a new compound (or a combination with a new compound) to the healthcare system were also more frequent, although statistically not significant. The average biennial expenditure on the compound, based on IFRs tended to be higher in the case of procedures which finally concluded in a positive decision, yet the difference was not statistically significant.

The results of the univariate and multivariate logistic regression models (see Table 2) showed a consistent significant negative association between needing a legal act for the positive decision and the log odds of the procedure arriving at a positive decision (adjusted OR = 0.05, CI95%: 0.02–0.11, p<0.001). Similarly, having an RSA in place at the time of submission was consistently positively associated in both univariate and multivariate models with a statistically significant higher chance of a positive decision (adjusted OR = 3.49, CI95%: 1.56–7.82, p = 0.003). However, the overall purpose of the submission did not have statistically significant association with the outcome of the decision procedure (adjusted OR = 1.32, CI95%: 0.65–2.69, p = 0.45) and the direction of the association was not consistent between univariate and multivariate models. Neither did the average biennial expenditure exceeding 200 million HUFs show statistical significance, although it was positively associated with the decision outcome being supportive (adjusted OR = 1.04, CI95%: 0.92–1.19, p = 0.54) in both univariate and multivariate models.

Table 2. Results of the logistic regression analyses with the outcome of the decision being positive as the dependent variable.

The decision procedure is positive
OR (CI95%) Univariate Model OR (CI95%) Multivariate Model
A legal act is needed for the positive decision 0.06 (0.03–0.12) p<0.001 AIC: 237.67 0.05 (0.02–0.11) p<0.001 AIC: 232.15
RSA was in place at the time of submission 2.78 (1.45–5.32) p = 0.002 AIC: 312.78 3.49 (1.56–7.82) p = 0.003
Introducing a new compound or a combination with a new compound 0.74 (0.44–1.24) p = 0.25 AIC: 321.35 1.32 (0.65–2.69) p = 0.45
Average biennial expenditure on the basis of IFRs exceeds 200 million HUFs 1.02 (0.92–1.13) p = 0.71 AIC: 322.56 1.04 (0.92–1.19) p = 0.54

As the current analysis covers a broader time period, the effect of the year of submission was included in a supplementary logistic regression analysis to explore the effect of adjusting to the date of submission. Although having the reimbursement dossier submitted in the year 2019 was associated with a statistically significant higher likelihood of a positive decision (adjusted OR = 3.24, CI95%: 1.36–7.72, p = 0.008) and therefore can be interpreted as an effect modifier, results on other independent variables were consistent both in terms of the direction of association and statistical significance with the former multivariate analysis. The goodness-of-fit characteristic was somewhat improved for the multivariate model including the year of submission (AIC: 229.11).

Discussion

The a priori expectations on the relationship between legal and financial factors and the outcome of the reimbursement procedure have been confirmed by the data for the impact of needing a legal act for the positive decision and the impact of having an RSA in place for the particular compound at the time of submitting the reimbursement dossier. However, in case of the overall purpose of the submission and the expenditure on IFRs, results were not conclusive. A possible explanation to the former, to some extent, is that decision on a reimbursement submission that proposes the introduction a new compound may also be affected by other, endogenous factors, such as unmet medical need. It is also unclear whether the number of IFRs have a bigger impact on the outcome of the decision than the actual expenditure through the financial mechanism, but there are no publicly available data for this investigation.

In certain settings, such as for France or Germany, assessing the determinants of coverage decisions is redundant to some extent, as the outcome of the HTA procedure is directly linked to the pricing and reimbursement status of pharmaceutical products. However, in other settings, Maynou and Carnes [17] evaluated a set of factors that can potentially contribute to coverage decision from an econometric perspective and concluded for cancer drugs that their probability of reimbursement in 6 countries was higher when the product was considered cost-effective by NICE or SMC and when there was a managed entry agreement of financial type.

A strength of the current research is that attempts to explore the association between the outcome of the reimbursement procedure and certain independent variables which were generated from the legal and financial environment of each submission in a quantitative way. So far, only limited, descriptive research has been available on the reimbursement decisions in Hungary, and these did not assess the factors influencing the outcomes of decisions [18]. Further examples from other settings include using qualitative data sources to retrospectively evaluate the impact of RSAs on reimbursement decisions [19]. This study assesses multiple factors with their relevance to stakeholders involved in the decision-making procedure. Moreover, the current research applied formal hypothesis testing in a multivariate framework.

A potential methodological limitation of the current study is that we did not consider the time necessary for arriving at a decision for each procedure like other studies did [20]. Although time is certainly an important factor, we argue that the time required for decision-making may be biased in this particular setting. Positive decisions may accumulate over time, because some reimbursement procedures (such as the ones needing legislative changes or re-allocation of funds between government functions) apply a sequential, interactive approach and involve stakeholders other governmental entities (Ministry of Finance, Ministry of Interior) than the payer and the MAH. Therefore, a clear political mandate to reimburse may also be needed for such decisions that might affect the semi-annual convention of the committee responsible for the prioritisation of dossiers; a lack of mandate essentially means that committee meetings are delayed, creating a backlog in formal decision-making. This study is also limited by the operationalisation of the explanatory variables, which is determined to a great extent by the level of transparency and reporting standards of information, especially on RSAs. At the moment, the existence of RSAs attached to pharmaceutical products are public, with a categorical description of the type of manufacturer payment (simple discount, price-volume, outcome-based schemes). A further limitation to this study is that it does not assess important potential explanatory variables that are endogenous factors of submissions, for example, the conclusion on their clinical added benefit or their cost-effectiveness, although these factors can be seen as confirmed contributors to recommendations on cancer drugs for a number of agencies, as concluded by a recent systematic literature review [21]. Unfortunately, a conclusion on the clinical added benefit was not implemented in the health technology assessment procedure in Hungary at the time of the implementation of the current research. A potential direction for future research is to evaluate the association between the outcome of reimbursement processes and exogenous as well as endogenous factors in a common, coherent framework.

While the place of our research has been confined to Hungary, we consider the findings of our study relevant to many other countries, since the exogenous factors investigated in the frame of this research are by no means exclusive to the Hungarian system of the reimbursement of pharmaceuticals [20, 22, 23]. Regardless of the local setting, it is important to note that policy tools for ensuring access are not mutually exclusive: from a broader, pharmaceutical policy perspective, this research implies that the legal framework of reimbursement decisions, as well as RSAs both play key roles in managing access to innovative products. Re-defining the situations with a clear need for legislative changes to conclude on positive reimbursement decisions is a potential way of enabling access. Otherwise, given that high-level legislative control is maintained over the reimbursement of novel compounds, the timeliness of these decisions should be ensured to enhance the predictability of decisions. Also, providing public payers with the appropriate authorisation and sufficient resources to setting up RSAs during price negotiations may broaden access to innovative treatments, while still adhering to budgetary limits. The need for timely decisions and empowering payers are both in line with others’ call for defining simple, transparent and robust decision-making frameworks to strengthen pricing and reimbursement systems that increase access to innovative pharmaceutical products while also ensuring affordability [24].

One of the lessons learned from the current research is that when assessing the delay in access to innovative pharmaceutical products, a distinction should be made between submissions that require a sequence of decisions (such as implementing new legislative acts) for granting access, and submissions that only require lower level decision making in order to reach a conclusion on reimbursement. Another distinction could be made based on whether the product of interest has been included in an RSA between the financing agent and the MAH. This should be for particular interest in the near future as according to a new legislation, RSAs may also be used to manage expenses based on IFR applications of reimbursed compounds as of the 28 June 2021 [25]. Therefore, a future research may also consider the cases of compounds with a valid market authorization that were not formally submitted for reimbursement, but patients may have limited access to them via IFRs and RSAs. However, when evaluating the role of RSAs in broadening access, their administrative burden, transparency and effectiveness as cost-containment measures should also be taken into account.

Conclusion

The current research provides a quantitative analysis of the association between certain explanatory variables depicting the local health financing environment of pharmaceutical reimbursement submissions and the outcome of the corresponding decision-making procedure in Hungary. In this study, it was shown that the need of a legal act statistically significantly independently decreases, whereas having an RSA in place at the time of submission significantly increases the likelihood of a positive decision. The role of other factors, such as the purpose of the submission or the amount of expenditure through named patient programmes, do not have a statistically significant impact on the decision outcome, although the latter seems to have a positive association with a positive decision.

Our findings suggest that the local legal and financial environment of pharmaceutical policy has a significant impact on patient access to innovative pharmaceuticals. This paper may contribute to highlighting the potential targets of pharmaceutical policy interventions to expand patient access to innovative health technologies. To complement the picture, further research is needed on the role of endogenous factors and their association with the factors studied here.

Data Availability

Data and the analysis script is available at the following repository: https://github.com/mereszgergo/coverage.

Funding Statement

The authors received no specific funding for this work.

References

Decision Letter 0

Thomas Tischer

26 Jul 2022

PONE-D-21-40982Association of Exogenous Factors with the Access to Innovative Pharmaceutical Products in HungaryPLOS ONE

Dear Dr. Merész,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please note that we have only been able to secure a single reviewer to assess your manuscript. We are issuing a decision on your manuscript at this point to prevent further delays in the evaluation of your manuscript. Please be aware that the editor who handles your revised manuscript might find it necessary to invite additional reviewers to assess this work once the revised manuscript is submitted. However, we will aim to proceed on the basis of this single review if possible.  The reviewer requests a more in-depth discussion of the studies premise, results and the associated literature. Could you please revise the manuscript?

Please submit your revised manuscript by Sep 08 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Thomas Tischer

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an interesting piece of work that adds to the literature on determinants of access to medicines in a particular setting (Hungary) - thank you for working in this area and preparing your manuscript for publication. My main reservations rest with a) the lacking description of the decision-making process in Hungary that would elucidate what could potentially be changed and how; b) the partial contextualisation within the broader literature on determinants of coverage decisions; and c) the need for a more nuanced discussion of the lessons learned (is the article really advocating for managed entry agreements for all new medicines? at least the issue of administrative burden, transparency and cost containment should be discussed). Please see the following comments for more detail on suggested changes.

Abstract

The independent variables need to be more clearly named. The "need for legilative change to reimburse" is not clear without the context of the Hungarian reality that only comes in the main text. Part of the conclusions (the recommendaitons) does not appear equivalently in the main text. The recommendations should consider feasibility (see general comments above).

Introduction

When references to the literature are made (e.g. lines 46-61), it is not clear if you refer to all literature examining the relation between endogenous/exogenous factors and reimbursement decisions or only literature on Hungary. This is important to do very clearly, because there is quite a bit of research on what influences reimbursement decisions in different health systems, which is not captured in the introduction but is important for context. Please add a more comprehensive summary of available evidence (in general and in HUngary in particular) to also help set up a discussion of what this study adds later in the manuscript.

Lines 67-71: how is this different from the distinction you make in lines 62-67? The existence of RSA?

Lines 76-77: please justify the assessment of the usefulness of IFR (you will need to explain better what they are and how they fit in the HUngarian reimbursement system)

Generally for the introduction: Please provide an overall description of how reimbursement of new mediicnes works in Hungary (one paragraph, not very long) that you can use as a basis for details brought up and used in the methodology (such as need for legislative change or IFRs). This is necessary for understanding your paper and how it fits/what it adds better. You could also add a figure if helpful.

Methods

Generally, information on Managed Entry Agreements is not publicly available, but you seem to have at least some in Hungary. Please makes this clear early on tin the methods.

Lines 107-116: please check redundancy with the introduction. If you end up providing a foundational description as suggested above, you can be shorter in the methods when it comes to the definition of your variables.

Lines 123-124: this is not the place for a funding statement of your work, should be moved to the peripherals of the manuscript.

Lines 144-145 "however, this variable was recorded...200 million HUFs". This needs further explanation.

Line 152: "changing the reimbursement technique" - what does this mean? might be solved with a better description of processes in the intro as suggested above.

Results

Lines 188-192: the logic of what is in the table and what is reported only is not always clear. Is the year of submission an independent variable?

Discussion

Lines 198-200: you should not bring in new potential independent variables to discard at this point, this should be done earlier. Also perhaps spend a few words in the introduction to discuss how you categorise endogenous and exogenous parameters.

Line 203: I would argue that this is rather an attempt to explore the association in a quantitative way rather than quanitfying the association

Lines 205-210: as int he introduction, unclear if the contrast here is to literature on these issues in general or only literature on Hungary.

213-214: Please clarify this and link to a fundamental description of decision-making processes in Hungary.

Lines 232-237: this needs further explanation (what is the new law on/what does it say-how does it change the situation)

The limitations of the study need to be discussed in further detail, including the chosen methodology and the adequacy of the independent variables. Why this article is of interest beyond Hungary should be substantiated further.

Conclusions

The recommendations in the abstract do not appear in the main text (see also comment above). The potential targets (meaning legislative change and more MEAs?) should be justified in more detail.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Feb 6;18(2):e0281280. doi: 10.1371/journal.pone.0281280.r002

Author response to Decision Letter 0


30 Nov 2022

Dear Reviewer,

We would like to thank you for your valuable insights and we hope that our responses address your reservations. Let us know if there is anything else to adjust on the manuscript.

Best wishes,

The Authors

Attachment

Submitted filename: Response.pdf

Decision Letter 1

Vasileios Kallinterakis

20 Jan 2023

Association of Exogenous Factors with the Access to Innovative Pharmaceutical Products in Hungary

PONE-D-21-40982R1

Dear Dr. Merész,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Vasileios Kallinterakis

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: No

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: This research study is indeed very interesting and is conducted in a rigorous scientific way. However, in order to be published, the manuscript requires heavy editing to make the story flow better and ensure good use of the English language.

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

Acceptance letter

Vasileios Kallinterakis

25 Jan 2023

PONE-D-21-40982R1

Association of Exogenous Factors with the Access to Innovative Pharmaceutical Products in Hungary

Dear Dr. Merész:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Vasileios Kallinterakis

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response.pdf

    Data Availability Statement

    Data and the analysis script is available at the following repository: https://github.com/mereszgergo/coverage.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES