Abstract
Background
Clinical trial funders aim for trials conducted with high quality, within the planned time and budget. The majority of non-commercial investigator-initiated clinical trials do not complete participant recruitment in time or are discontinued early. In addition, the implementation of the results may be challenging. We aim to list the good practices available for public funders of clinical trials in Europe. Our focus is on practice-oriented trials exploring research questions not studied by industry.
Methods
We list the funding practices at the public trial funder KCE Trials in Belgium, together with good practices identified at the National Institute of Health and Care Research (NIHR) in England and ZonMw in The Netherlands. The literature on practices of public trial funders was searched.
Results
Assessment of the effectiveness of individual clinical trial funding practices is an under-studied area of research. Many funding practices have been integrated for decades in the NIHR HTA program, resulting in trials with significant health impact. Some practices of the commercial sector are now also used by public trial funders, such as on-site feasibility checks for recruitment capacity and paying sites based on participant recruitment and retention.
The array of public funder practices with the collective aim to reduce risk and enhance impact can be grouped into ten categories: integration of the funder in the research user landscape; the funder’s team and transparency in the use of public money; support for the sponsor’s team; the terms and conditions of the funding, access rights and data sharing; an efficient and pragmatic trial design; trial selection and improvement; budget and payments, the importance of feasibility checks and site payments; recruitment and retention; dissemination and implementation of results; collaboration between funders and multi-national clinical trials in the EU.
Conclusions
Public funders of practice-oriented clinical trials have tools available to improve the health impact of the trials they fund. The relative contribution of each practice in a funding program in relation to its cost remains to be studied. Challenges remain for recruitment in non-commercial trials and efficient funding and management of multi-national non-commercial trials.
Keywords: Clinical trials, Public funder, Non-commercial sponsor, Investigator-initiated trials
Introduction
Investigator–initiated trials answer important questions with no commercial interest [1, 2]. In theory, clinical trials are conducted with high quality, within the planned time and budget. In practice, this ambition is often not fully realized. The majority of non-commercial trials do not complete participant recruitment in time [3, 4] or are discontinued early because of poor recruitment or insufficient funding [5–8].
The adherence to good practices such as trial registration and results publication is lower for non-commercial trials compared with commercial trials [7, 9–11]. Negative academic trials may be at especially high risk not to get published [12]. Funders of non-commercial trials have a key role in promoting successful completion and trial transparency, but practices vary greatly [7, 10, 11, 13, 14].
The WHO points to the importance of sufficient and sustained funding of clinical trials and calls for the engagement of health technology assessment (HTA) bodies throughout the process [15]. The WHO, HTA bodies, and the European Medicines Agency (EMA) stress the importance of randomization to obtain a reliable estimation of the benefits and harms of an intervention [15–17].
Despite a frequently reported positive return on investment [2, 18–23], the impact of publicly funded clinical trial programs is not always systematically evaluated or publicly reported. Furthermore, no studies were found evaluating the impact of specific practices of public funders. Based on the 2014 Lancet series on ensuring value and minimizing waste in research [24], a total of 17 good research funding practices were identified, resulting in an assessment tool [25] used by research funders [26, 27].
In this paper, we start from the risk-reducing or impact-enhancing practices at a recently created public funding program of practice-oriented non-commercial clinical trials at the Belgian health care knowledge centre (KCE), launched in 2016 and named KCE Trials (https://kce.fgov.be/en/kce-trials/what-is-the-kce-trials-programme).
While best funding practices are broadly applicable to clinical trials across various types and stages, the focus of this paper is specifically on large confirmatory pragmatic trials conducted (as trial sponsor) by academic or non-profit research institutions in Europe. Pragmatic in this context means the evaluation of the effectiveness of an intervention under real-world conditions, rather than in a highly controlled environment.
Methods
We start from the experience gained from the risk-reducing or impact-enhancing practices at KCE Trials, the National Institute for Health and Care Research (NIHR) HTA program in England and the clinical trial funding streams at ZonMw in The Netherlands. Based on discussions among the authors, the practices are grouped under ten headings. References are added based on a literature search, with a focus on Europe (Appendix 1).
Results
A total of 28 publications were selected based on the literature search (Appendix 1). The authors contributed additional papers or webpages.
Integration of the funder in the research user landscape
In a 2015 KCE report on publicly funded trials [1, 2], three key success factors were identified: (1) selection of the most relevant trials; (2) a professional trial conduct; (3) implementation of the results. Research funders should take the needs of the potential users of research into account when setting priorities for funding [28]. The users of the results of practice-oriented trials are the patients, the healthcare professionals, and the healthcare payers.
In order to address the needs of regulators and payers, and to implement the trial results, public funders of clinical trials should be well integrated in the healthcare landscape of the jurisdiction they cover. The most important integrated trial funder in Europe is the NIHR in England [1]. Similar healthcare-oriented trial funding programs were identified at ZonMw in the Netherlands, with attention for implementation of the trial results [29].
KCE is a federal scientific advisory body active in health services research, the development of practice guidelines, and HTA. The KCE board of directors includes the various ministries, agencies, and stakeholders in the Belgian healthcare landscape. It is an essential facilitator for public health impact creation based on the KCE reports and trial results. KCE Trials is inspired by the NIHR HTA program [30, 31]. The focus is on non-commercial, confirmatory randomized comparative-effectiveness trials for all types of interventions, including repurposed drugs. The KCE Board is represented in the KCE Trials Prioritization Group, which oversees, prioritizes, and approves the funding of the selected trials and manages the portfolio of funded studies.
In many EU countries, the funding of clinical trials is part of broader research and innovation efforts, with a primary emphasis on academic advancement, economic development, or job creation. These trials often miss the input of the regulators, payers, and other policymakers in the healthcare system [1]. This might explain why some early-phase academic clinical trials are not part of a full clinical development plan aiming for a later integration of the intervention in the healthcare system [32]. For instance, in Belgium, the funding of early phase trials is regarded as innovation-driven research and therefore supported through regional funding mechanisms, while the healthcare system is funded mainly by the federal government.
Both early and late phase academic clinical trials could benefit from a low threshold single point of contact for regulatory and HTA advice to position the clinical trial in an overall development and funding plan [15, 32–34]. Regulatory review of drug repurposing trial applications is encouraged at KCE and ZonMw [35], in collaboration with the regulators.
The funder’s team and transparency in the use of public money
About 10% of the 10 million euros yearly budget of KCE Trials is used for personnel costs of the funder’s team and for operational costs such as payments of reviewers of applications, legal advisors, contract organizations, and grant management software. Such tools can help to efficiently manage proposal submission, conflict of interest checks, proposal review, selection meetings, subsequent submissions, tracking of contracts, recruitment milestones, and outcomes. Offices, standard information technology, and human resources services are not included in the 10%. The funder’s team is composed of personnel with a medical, scientific, economic, or legal background and experienced in the various aspects of clinical trial conduct, especially pragmatic trials [36]. This allows for the selection of appropriate reviewers and interactions during the review meetings, resulting in well-argued feedback to the applicants. During the trial conduct, online meetings of the funder and the sponsor team every 2 to 4 weeks allow for timely corrective actions taken in consensus with the sponsor team.
KCE Trials strives to be highly transparent about the spending of public money and the stage of advancement of the trials funded. As mandated by law [37], good clinical practice [38], medical ethics [39], and journals [40], all trials are to be registered in a publicly accessible registry before the start of recruitment. This should preferably include the full protocol after ethics committee approval. Publications of the protocol or the main results of trials funded by KCE should be open access. The associated costs are part of the trial budget [41].
A plain language summary of each funded trial and the results is posted on the website in English (https://kce.fgov.be/en/kce-trials), Dutch and French. Publications and details on the progress, including the anticipated study report date, are shared using a dashboard on the KCE website (https://trials.kce.be/dashboard). It is updated weekly and shows the actual recruitment at each site for all ongoing trials.
KCE Trials newsletters and social media announce a.o. the calls for funding and for reviewers. The website lists resources for investigators such as the processes, contract templates, and training material (https://kce.fgov.be/en/kce-trials/resources), similar to the NIHR online Research Funding Good Practice Guide [42].
Support for the sponsor’s team
When KCE Trials was started in Belgium in 2016, academic centers had clearly more experience participating in commercial clinical trials compared with managing all sponsor responsibilities of a large multicentric randomized trial [43–46]. Academic reward systems may incentivize quantity more than quality, and novelty more than reliability [8, 47]. Therefore, candidate investigators may not be inclined to set up a large multicentric or international trial. They should be supported by a clinical trial unit (CTU) where trial sponsor expertise is centralized [48]. Efficiency gains are obvious for applicants in obtaining support for protocol development [49], funding [50], legal and regulatory compliance, contracting, statistics, data management, and monitoring. CTUs need to have a sufficient workload to maintain resourcing to keep well trained staff. Therefore, interested smaller hospitals or general practice associations [51] should be able to source these services from an existing CTU. In the UK, Germany, Switzerland, and Spain, the CTUs form networks, improving efficiencies [1, 44, 52].
At the start, KCE Trials organized a sponsor capacity gap analysis of twelve interested CTUs in Belgian universities and hospitals, each resulting in an improvement plan [53]. Often, the expertise was found to be scattered over several clinical departments and not centralized. KCE Trials regularly organizes training courses and discussion sessions with CTU staff. The topics include e-CRFs, safety reporting, risk-based monitoring [54], and low intervention trials [55]. In addition, KCE Trials symposia (https://kce.fgov.be/nl/kce-trials/resources/presentations-from-kce-trials-symposia) focus on topics ranging from registry-based and pragmatic trials [56] to clinical trials in surgery. The trial funding received as well as the educational efforts have contributed to increasing the expertise and capacity of the (centralized) CTUs. Finally, having a better trained workforce might also make the country more attractive for commercial clinical trials, a topic that is high on the agenda of many countries, the European Commission, the EMA [57], and the industry [58].
The terms and conditions of the funding, access rights, and data sharing
Contracting is often cited as an inefficiency [4]. This concerns agreements between funder and sponsor and between sponsor and the trial sites. KCE minimizes delays by working with templates developed together with the academic sponsors.
Data sharing in general is required and the sponsor of the trial is expected to set up a data sharing policy. Recommendations for preparing clinical trials data sets for sharing have been published [59]. Funders should consider the costs involved in the preparation of anonymized trial data sets [60, 61].
The funding agreement defines that KCE and similar institutes in Europe have the right to use the pseudonymized trial database for public health purposes, including HTA. Health-economic evaluations alongside clinical trials have been reported for Australia [62]. Also KCE and ZonMw conduct such analyses for selected trials [63]. For health-economic evaluations or for long-term survival analyses, the trial data set can be linked to other data sets such as billing data, vital statistics, or other registry data after the appropriate data privacy and data security approvals [63]. Participants are informed during the consent procedure. In our experience, this additional public health purpose of the funded trials did not have any negative impact on recruitment. Based on a rough estimate, the data linkage at KCE was less costly compared with a full data collection [63]; however, in contrast with two cases in New Zealand [64].
Protecting intellectual property based on publicly funded research, especially early phase or drug repurposing, is relevant from a healthcare payer perspective as it can influence access and affordability [65]. KCE and similar institutes in Europe automatically receive non-exclusive, royalty-free access rights to use the trial results for public health purposes. In addition, and similar to the NIHR policy [66], the KCE contract includes so-called “socially responsible licensing clauses,” of relevance when commercialisation of trial results is intended [32].
An efficient and pragmatic trial design
The annual KCE Trials calls fund investigator-led (bottom-up) trials. Commissioned calls (top-down), where the research question is, e.g., based on a healthcare payer priority topic, have been tried, but the response from possible sponsors was low. A lower response to commissioned calls has also been observed in the NIHR efficacy and mechanism evaluation program [20]. For reasons that are not entirely clear, the trials funded under a commissioned call at NIHR yielded fewer high-impact publications compared with investigator-led trials [67].
Funded trials should optimally inform HTA. This can be achieved with randomized clinical trials that compare the tested intervention against standard care, recruit a representative and inclusive patient population, and assess patient-relevant outcomes [37, 68]. Trials should therefore be as pragmatic as appropriate [56, 69–72]. Efforts are needed to familiarize investigators and sponsors with pragmatic trials [73]. The PRECIS-2 tool can also be used [74]. Both benefits and harms should be measured and reported [75]. Care should be taken to obtain complete data sets, also for health-economic analyses [76]. Core outcome sets are to be checked and used where available [77]. The use of a generic quality of life instrument such as EQ-5D-5L at several time points allows for a calculation of quality-adjusted life years (QALYs) gained, an important outcome for health-economic analyses [37, 78].
Important efficiency gains have been obtained using randomized registry-based trials or trials within cohorts [79]. In the Swedish cardiology registry 70% of the patients accepted to be randomized in a comparative effectiveness trial [80], leading to a shorter recruitment period. Registry-based randomized trials can be run at a small fraction of the usual trial cost, e.g., 0.5 M euros instead of 15 M euros for a similar RCT, provided the registry is of high quality [80]. Platform trials can be very informative as they provide comparative evidence on the multiple interventions tested in parallel. However, there is currently little reported experience by funders on the trial budget impact of dropping or adding intervention arms. Also the health-economic potential may be impacted when changes are made in an adaptive platform trial [81]. Research is ongoing on value-adaptive trial designs optimized for HTA and public health decision making [82].
Trial selection and improvement
KCE, similar to NIHR and ZonMw, installed a two-stage selection process, consisting of a research outline (first stage) and full proposal (second stage) (Fig. 1). The review and scoring of the outlines are performed by a Panel of healthcare professionals and patient representatives covering the clinical areas concerned. Only the outlines that are of high clinical relevance and considered acceptable from a health economic point of view by KCE health economists are reviewed by the Trials Board. These independent statisticians and study design experts evaluate the quality of the trial during the two stages. An application may need first to be improved before it can move on. Overall, for the two stages, the number of Trials Board review rounds per application has been capped at five. The average time from application to selection is 10 months, with an additional 8 months for feasibility checks until the funding contract is signed.
Fig. 1.
Funder steps at KCE trials, from opening a call to implementation of trial results
All experts participating in the selection process declare their interests (https://kce.fgov.be/en/kce-trials/resources/kce-trials-policies-and-procedures). The policy to avoid possible conflicts of interests needs to be both rigorous and flexible enough to be workable.
Before applying, applicants are expected to check the research priorities [83], obtain the input of patients on the research question, the outcome measures, and the feasibility of the trial procedures. Patients are also present at each selection meeting and have voting rights.
Funders need to have an appeal procedure for applicants but should be aware that such procedure may delay the selection and funding process of the other applications.
Budget and payments, the importance of feasibility checks and site payments
While trial underfunding is a frequently reported problem [1, 6, 84], there is limited expertise in correctly budgeting academic trials [85, 86]. Public funders should aim to cover the real costs of the trial both for the sponsor and the recruiting sites. KCE and others have developed budgeting tools, which are updated regularly [41, 87, 88].
Even before the final funding decision, a number of risk-reducing tasks can be performed. The drafting of a full protocol requires the input from patients, statisticians, third-party suppliers of goods or services, and definitely site investigators. KCE, as a funder, is rather unique as it pays a non-reimbursable lump sum of 12,500 euros to the sponsor for protocol development when an outline is selected (Fig. 1). A similar advance payment is made to support the sponsor for the on-site feasibility check in a representative set of sites. The non-commercial sponsor is supported by a contract research organization hired by KCE, adding to a more standardized and independent approach. The sponsor team’s feedback so far was mainly positive as it leads to further protocol improvement and risk reduction for the sponsor and funder. If there are doubts about the feasibility, a pilot trial may first be funded. A pilot study is a miniature version of the main study to test whether the components of the main study can all work together [89, 90].
Even for pragmatic trials, some site activities are not part of routine care and need to be reflected in the trial site budget. For KCE funded trials, site payments typically account for 30–60% of the overall budget. Compensation of trial participants for travel and time spent is needed when trial procedures extend beyond the routine care visits.
Upon signing the funding contract, a payment of 15–20% of the sponsor costs is made, covering the initial personnel costs for project management and data management. In addition, each funded trial should have a trial steering committee. It should include experts independent of the sponsor team [91]. Milestone payments to the sponsor are mainly driven by trial recruitment (first patient, 25% of planned number, 50% etc.), while sites are paid twice a year for the number of patients included and study visits performed. Ideally, the funder should keep a small reserve to maintain flexibility if unforeseen justifiable expenses occur.
Database lock should follow within 3 months after the last patient’s last visit. This is possible if data cleaning and query resolution are managed carefully. This requires trained personnel for data management and monitoring. The statistical analysis plan should be finalized well in advance of the database lock. No time should be lost after the database lock to start producing the results and the report writing, which is expected 6 months after the last patient’s last visit. A last milestone is paid to the sponsor when the manuscript containing the main results of the trial has been submitted for journal publication.
Co-funding
For national trials, co-funding is not stimulated as the funding tries to be comprehensive. Co-funding by industry or free supply of study materials needs a thorough review of the contract with the sponsor as it needs to be in agreement with the KCE funding contract.
For international trials with a non-Belgian sponsor, a national coordinating center in Belgium will take up certain sponsor responsibilities, if applicable. The trial budget is lower when less sponsor-related activities are delegated but will always cover the patient fees for the participating sites. When the trial is selected, KCE will fund the activities in Belgium using a contract with the Belgian coordinating center. A commitment letter is required from the international sponsor which specifies a.o. the non-commercial purpose of the trial, the trial registration, the publication and the access rights to the Belgian pseudonymized trial data set.
Recruitment and retention
The main reason for non-commercial trials not completing in time or even being discontinued early is a recruitment rate that is lower than planned. The perception by investigators and patients of equipoise between the different interventions studied is a key requirement for successful patient recruitment. Experience has shown that patient inclusion in randomized trials comparing surgical techniques or surgery versus a non-surgical intervention is challenging if not all surgeons–investigators are fully convinced of the equipoise.
On-site feasibility visits can help identify competing trials and any financial disincentives of trial participation for the investigator and the hospital. Paying sites for the specific trial activities based on trial recruitment and follow-up visits is a well-accepted standard in commercial trials and may also be critical for recruitment in non-commercial trials, including pragmatic trials.
Patients may not perceive equipoise for trials that test a drug dose or duration that is lower than the (conditionally) approved (and reimbursed) standard [92]. This is often the case for new oncology drugs conditionally approved for prolonged use based on limited clinical data [93]. The treatment duration may be questioned as side effects need to be balanced with any additional therapeutic benefit of prolonged use [94–97]. National public payers or charities may fund such treatment optimization trials in cases where there is no interest from the marketing authorization holder [72, 94, 95, 97]. The purpose of such trials may be better reflected in a comparative design rather than the common non-inferiority design [94, 98].
Patients, clinicians and ethics committee members may not know or well understand the status of “conditional marketing authorization” or “coverage with evidence development” [99, 100]. This can negatively impact trial feasibility [92, 99, 100]. It might make sense for regulators and payers to introduce an easy-to-understand concept like the “orange traffic light” status when a drug is made available to patients under conditions that require further clinical trials. This could facilitate recruitment in treatment-optimization trials. Limiting access to trial participants is an alternative option [99], e.g., for expensive new medicines in The Netherlands that have entered “de sluis” (the lock) [101]. Limiting payer coverage to participants in a pragmatic trial on intraarterial treatment for stroke had a positive effect on recruitment [102]. In Belgium, coverage of an app for rehabilitation after knee or hip arthroplasty was limited to participants to a trial [103].
A 2018 Cochrane review on strategies to improve recruitment identified only two interventions with high-level evidence for an effect [104]. A 6% absolute improvement was seen for patients who received a telephone call when not responding to a postal invitation. A 10% improvement was seen in an open trial compared with a blinded placebo trial [105, 106]. Retention also seemed to improve using an open trial design. The use of digital tools to improve recruitment and retention in trials is an active area of research [107–109].
Recruitment rates in practice can be low because of stringent eligibility criteria and/or eligible patients not willing to participate. In contrast to explanatory trials [110], pragmatic designs aim to include a more representative population. Input of patients in the trial design and the schedule of visits and examinations may result in a higher participation rate and a lower drop-out rate [111]. Overall, 72% of oncology patients stated they would accept to participate in a randomized trial, with a preference for trials comparing active treatments [112].
Non-teaching hospitals or GP practices may happen to treat the majority of the target patient population, so their participation in practice-oriented trials seems essential. Recruitment of patients outside of the hospital setting can be performed in a cost-effective way [113]. Simulations using budget tools show that the trial recruitment period and trial duration in general are more important drivers of the overall cost than the number of sites opened. A condition of course is that all opened sites or practices need to be able to cope with the trial workload.
Not only the classical trial newsletters, but also the KCE public dashboard showing the actual recruitment at each site is believed to lead to a healthy competition between recruiting sites.
Dissemination and implementation of results
The WHO best practices and the AllTrials campaign demands a summary of results is entered in the trials registry within 12 months after trial completion [14, 114]. Of relevance, medical journals do not consider this as dual publication [40]. While trial registration has become the norm, not all investigators perceive the need to publish the trial results on the registry, as reflected in the adherence to the WHO best practices on trial transparency for the KCE funded trials, available on the dashboard (https://trials.kce.be/dashboard) and in a report [115].
A plain language summary of the study results is posted on the KCE website in English, Dutch, and French (https://kce.fgov.be/en/kce-trials). All trial-related publications are shared using the dashboard. In addition, the KCE Trials symposia (https://kce.fgov.be/en/kce-trials/resources/presentations-from-kce-trials-symposia) offer a platform for investigators to present completed trials.
Implementation of the trial results in Belgium is enhanced by the position of KCE as an advisory body within the Belgian healthcare landscape. Based on the results, an additional HTA may be conducted to better inform the healthcare payer [63]. KCE is also well positioned to help adapt clinical practice guidelines where appropriate.
Collaboration between funders and multi-national clinical trials in the EU
KCE and ZonMw collaborate in the Belgium-Netherlands Funding of International Trials (BeNeFIT) calls for comparative effectiveness trials conducted jointly in both Belgium and The Netherlands. Investigators from both countries can apply to the joint trial selection and improvement process. Sponsor activities are often split between the main sponsor and the coordinating center in the other country. The payments made by KCE and ZonMw for the funded BeNeFIT trials will generally not cross the border.
Public funders of clinical trials reside under different ministries in different countries and typically act in isolation. However, there may be good reasons to collaborate. Sharing of good funding practices may improve the level of expertise of each participating funder. KCE Trials had a jump start using the processes of the NIHR HTA program. Best practices are also shared with ZonMw [116]. A platform of funders of comparative effectiveness trials could fit well in the existing Ensuring Value in Research (EViR) initiative [117].
For many trials recruiting in smaller patient populations, there is a need for international trials in Europe. Collaboration among funders could result in call synchronization across countries. Lack thereof hampers the start of recruitment in EU multi-national trials, for example, in trials coordinated by the European Clinical Research Infrastructure Network (ECRIN) [33, 84, 118, 119].
In Europe, about 40% of clinical trials with medicinal products are sponsored by non-commercial sponsors [33]. Most of these trials are small and nearly all are mono-national. The European Commission recognizes the issues with the funding of academic multi-national clinical trials but has not yet found efficient solutions [33]. The national–EU co-funded ERA4Health partnership uses a joint selection and (co-)funding mechanism for multi-national trials [120]. However, in common with most academic initiatives, it lacks the input from the national healthcare systems and may need additional efforts on the trial selection and improvement cycles, feasibility checks, use of data for HTA, trial budgeting, and the close monitoring of the trial progress. Further harmonization of the good practices among national funders, as was explored for the BeNeFIT collaboration, may be the next step forward.
Provided that standard care is similar across the countries, there may be an opportunity for a more centralized EU-wide approach to multi-national clinical trials. This could solve the issues related to call synchronization and national regulatory hurdles [33, 84, 119, 121]. The proposed EU Biotech Act is tackling some of these issues [34].
International rare disease registries funded by the EU should be designed with registry-based randomized trials in mind, which can then be run at low cost. HTA Joint Clinical Assessments (JCA) of novel drugs and medical devices at EU level are becoming a reality [122]. Based on the JCA, regulators and HTA bodies should together define the remaining research priorities that concern most if not all member states.
Member state clinical trial funders and public health insurance systems could contribute to an EU clinical trials fund and help set research priorities. Instead of the currently used national–EU co-funding approach and similar to the NIHR in England, a European Institute of Health and Care Research could be set up. It could use the EU trials fund to initiate without unnecessary delays the needed international non-commercial clinical trials. More efficiency in funding and conduct of a trial will allow patients to benefit more rapidly from the results. In case of an emergency situation, this fund together with a top-down management of the prioritized clinical trials in the EU might prove to be a fast route to start international publicly funded trials or re-orient the “ever warm” EU platform trials, coordinated by the Health Emergency Preparedness and Response Agency (HERA) [123]. In addition, a better collaboration between funders can improve response during an outbreak [124].
Discussion and conclusions
Publicly funded clinical trials can result in significant health benefits [2]. Funders of clinical trials have a set of tools and approaches available to improve the health impact of the funded clinical trials. Many of these practices have been tested over more than 30 years in the NIHR HTA program, resulting in significant health impact. Other practices have been developed and tested by commercial sponsors before being also taken up by public trial funding organizations, such as on-site feasibility checks and recruitment-based site payments. Experience to date at KCE Trials has shown such payment schedules are well accepted, replacing the traditional grant approach not linked to recruitment or milestones achieved. The use of a budget tool and milestone payments has been shown to work for two neighboring countries (BeNeFIT program), but it is yet to be tested in larger multi-national non-commercial trials.
The practices presented represent a burden for the funder. They require experienced personnel and the investment of time and resources, totaling about 10% of the overall trial funding budget. The study of the cost, the effectiveness, and the impact of individual clinical trial funding practices, instruments, and processes remains an under-studied area of research. Little is known about the relative cost of each practice in a funding program or its contribution to the overall impact. Nevertheless, the practices presented may inspire public or charity funders of non-commercial clinical trials to supplement their approach to the funding of clinical trials.
Participant recruitment remains a key hurdle for non-commercial trials, for example for treatment–optimization trials for drugs that entered the market using an accelerated pathway. Both national funders and regulators have a role to facilitate a rapid start of international trials in the EU. Collaborations among funders can synchronize calls and create common selection procedures. However, an earmarked EU trials fund and a more top-down management of EU trials may prove to be the more efficient way forward.
Acknowledgements
Not applicable.
Abbreviations
- BeNeFIT
Belgium–Netherlands Funding of International Trials
- CTU
Clinical trial unit
- ECRIN
European Clinical Research Infrastructure Network
- EFFECTT
Empowering Funders For Enhanced Clinical Trial Transparency
- EFPIA
European Federation of Pharmaceutical Industries and Associations
- EMA
European Medicines Agency
- EViR
Ensuring Value in Research
- GCP
Good Clinical Practice
- HERA
Health Emergency Preparedness and Response Agency
- HTA
Health Technology Assessment
- ICH
International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use
- ISO
International Organization for Standardization
- JCA
Joint Clinical Assessment
- JSC
Joint Scientific Consultation
- KCE
Belgian Health Care Knowledge Centre
- NIHR
National Institute of Health and Care Research
- TwiCs
Trials within Cohorts
- WHO
World Health Organization
- QALYs
Quality-adjusted life years
- QoL
Quality of life
Appendix 1
Literature search strategy
The funding of clinical trials does not have a specific Mesh term. PubMed was therefore searched on 24/9/2025 using (“Research support as topic”[MeSH Terms] and trials) for papers published from 2011 onwards. This yielded 754 hits, of which 15 publications were selected for citation by the first author.
The search “Clinical Trials as Topic/economics”[Mesh] and (“funding” or “funder” or “publicly funded”) and (“investigator-initiated” or “academic” or “non-commercial” or “non-industry sponsored”) yielded 64 hits, of which eight additional papers have been cited.
Five more references out of 58 hits were identified using a PubMed search for (“funding”[Title] or “funder”[Title] or “funders”[Title]) AND “trial”[Title].
Further relevant references were identified by the co-authors or using the snowballing technique.
Authors’ contributions
FH drafted the first outline for the manuscript, performed the literature search, and integrated the contributions from the co-authors. All co-authors provided additional concepts and references. All authors read and approved the final manuscript.
Funding
No funding was obtained.
Data availability
Not applicable.
Declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Neyt M, Christiaens T, Demotes J, Hulstaert F. Publicly funded practice-oriented clinical trials. Health Services Research (HSR). Brussels. KCE Reports. 2015;246. [DOI] [PubMed]
- 2.Neyt M, Christiaens T, Demotes J, Walley T, Hulstaert F. Publicly funded practice-oriented clinical trials: of importance for healthcare payers. J Comp Eff Res. 2016;5(6):551–60. [DOI] [PubMed] [Google Scholar]
- 3.Sully BG, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14:166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Duley L, Gillman A, Duggan M, Belson S, Knox J, McDonald A, et al. What are the main inefficiencies in trial conduct: a survey of UKCRC registered clinical trials units in the UK. Trials. 2018;19(1):15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Barnard KD, Dent L, Cook A. A systematic review of models to predict recruitment to multicentre clinical trials. BMC Med Res Methodol. 2010;10:63. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Briel M, Elger BS, McLennan S, Schandelmaier S, von Elm E, Satalkar P. Exploring reasons for recruitment failure in clinical trials: a qualitative study with clinical trial stakeholders in Switzerland, Germany, and Canada. Trials. 2021;22(1):844. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Speich B, Taji Heravi A, Schonenberger CM, Hausheer L, Gryaznov D, Busse JW, et al. Nonregistration, discontinuation, and nonpublication of randomized trials: a systematic review. JAMA Netw Open. 2025;8(9): e2524440. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Moreno-Galarraga L, Gracia Vera C, Rivero-Calle I, Martinon-Torres F, Diez Lopez I, Cabanas F, et al. Pediatric research in Spain: challenges and opportunities. Anales de Pediatría (English Edition). 2025;103(1):503854. [DOI] [PubMed] [Google Scholar]
- 9.Al-Durra M, Nolan RP, Seto E, Cafazzo JA. Prospective registration and reporting of trial number in randomised clinical trials: global cross sectional study of the adoption of ICMJE and Declaration of Helsinki recommendations. BMJ. 2020;369:m982. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.O’Riordan M, Haslberger M, Cruz C, Suljic T, Ringsten M, Bruckner T. Are European clinical trial funders policies on clinical trial registration and reporting improving? A cross-sectional study. J Clin Transl Sci. 2023;7(1):e166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Dal-Re R. Current policies of non-commercial funders towards transparency in clinical trials. Eur J Clin Invest. 2024;54(6):e14187. [DOI] [PubMed] [Google Scholar]
- 12.Alix-Doucet AS, Vinatier C, Fin L, Lena H, Range H, Locher C, et al. Reporting of interventional clinical trial results in an academic center: a survey of completed studies. BMC Med Res Methodol. 2024;24(1):93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.DeVito NJ, French L, Goldacre B. Noncommercial funders’ policies on trial registration, access to summary results, and individual patient data availability. JAMA. 2018;319(16):1721–3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bruckner T, Rodgers F, Styrmisdottir L, Keestra S. Adoption of World Health Organization best practices in clinical trial transparency among European medical research funder policies. JAMA Netw Open. 2022;5(8):e2222378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.World Health Organization (WHO). Guidance for best practices for clinical trials 2024. https://iris.who.int/bitstream/handle/10665/378782/9789240097711-eng.pdf?sequence=1. Accessed 15 Sep 2025.
- 16.Heads of HTA agencies group and the European Medicines Agency. Joint HTAb-regulatory perspectives on understanding evidence challenges, managing uncertainties and exploring potential solutions. Outcome of a workshop series between HTA bodies and regulators. 2025. https://www.iqwig.de/printprodukte/joint-htab-regulatory-perspectives-on-understanding-evidence-challenges-final.pdf. Accessed 15 Sep 2025.
- 17.Wieseler B, Neyt M, Kaiser T, Hulstaert F, Windeler J. Replacing RCTs with real world data for regulatory decision making: a self-fulfilling prophecy? BMJ. 2023;380:e073100. [DOI] [PubMed] [Google Scholar]
- 18.ZonMw, SiRM. Externe evaluatie programma DoelmatigheidsOnderzoek ZonMw 2006–2017. 2018. https://www.zonmw.nl/nl/artikel/evaluatie-doelmatigheidsonderzoek-2006-2017. Accessed 1 Oct 2025.
- 19.Medical Research Council, IPSOS Mori, Technopolis UK. MRC 10 year translational research evaluation report 2008 to 2018. 2019. https://www.ukri.org/publications/mrc-translational-research-evaluation-report/. Accessed 1 Oct 2025.
- 20.Rentel MC, Simpson K, Dave A, Carter S, Blake M, Franke J, et al. A 10-year impact assessment of the Efficacy and Mechanism Evaluation (EME) programme: an independent mixed-method evaluation study. 2021. https://www.ncbi.nlm.nih.gov/pubmed/34807553. Accessed 1 Oct 2025. [PubMed]
- 21.ZonMw, SiRM. Externe evaluatie Programma Goed Gebruik Geneesmiddelen ZonMw 2012 - 2022 2022. https://www.zonmw-geneesmiddelenmagazines.nl/wp-content/uploads/sites/4/2022/06/Rapport-Externe-evaluatiecie-1.pdf. Accessed 1 Oct 2025.
- 22.Rijksoverheid. ZonMw Realiseert Impact Met Kennis-Kaderwetevaluatie ZonMw 2016–2022. 2023. https://www.rijksoverheid.nl/documenten/publicaties/2023/03/10/kaderwetevaluatie-zonmw. Accessed 1 Oct 2025.
- 23.ZonMw, TwynstraGudde. Externe evaluatie van het ZonMw-programma DoelmatigheidsOnderzoek 2018–2023 2024. https://www.zonmw.nl/sites/zonmw/files/2025-01/Rapport-Externe-evaluatie-ZonMw-programma-DoelmatigheidsOnderzoek-2018-2023-DEF---digitale-versie.pdf. Accessed 1 Oct 2025.
- 24.Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, Ioannidis JP, et al. Biomedical research: increasing value, reducing waste. Lancet. 2014;383(9912):101–4. [DOI] [PubMed] [Google Scholar]
- 25.EViR. Self-Audit Tool. 2025. https://evir.org/events-and-resources/resources/self-audit/. Accessed 7 Oct 2025.
- 26.Whitlock EP, Selby JV, Dunham KM, Fernandez A, Forsythe LP, Norquist G. Examining the role of funders in ensuring value and reducing waste in research: an organizational case-study of the Patient-Centered Outcomes Research Institute. F1000Res. 2019;8:288. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Cody A, Hiney M, Clarke P, O’Driscoll M. Funders’ responsibility to ensure value in research: a self-audit by the Health Research Board Ireland. HRB Open Res. 2021;4:35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gulmezoglu AM, et al. How to increase value and reduce waste when research priorities are set. Lancet. 2014;383(9912):156–65. [DOI] [PubMed] [Google Scholar]
- 29.Somai P. Role of research funders in creating impact from research projects. Thesis Master Health Economics, Policy & Law, Rotterdam. 2021. https://thesis.eur.nl/pub/62417/Thesis_Somai_482636_2.pdf. Accessed 14 Oct 2025.
- 30.Dent L, Raftery J. Treatment success in pragmatic randomised controlled trials: a review of trials funded by the UK Health Technology Assessment programme. Trials. 2011;12:109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.National Institute for Health and Care Research (NIHR). Health Technology Assessment (HTA). Informing health and social care decision making through comparative effectiveness research. 2025. https://www.nihr.ac.uk/research-funding/funding-programmes/health-technology-assessment. Accessed 18 Sep 2025.
- 32.Pouppez C, Bourgeois J, Hulstaert F, Vinck I. Academic development of ATMPS in Belgium–an exploratory study of the legal and strategic options. Health Services Research (HSR). Brussels. KCE Reports 396C. 2025.
- 33.European Commission. Exploratory analysis on funding to support academic sponsors conduct multi-national clinical trials 2024. https://accelerating-clinical-trials.europa.eu/document/download/4966eb20-b95c-47d5-805c-bc609a834d74_en?filename=Exploratory%20analysis%20on%20funding%20to%20support%20academic%20sponsors%20conduct%20multi-national%20clinical%20trials.pdf. Accessed 15 Sep 2025.
- 34.European Commission. Proposal for a regulation to establish measures to strengthen the Union’s biotechnology and biomanufacturing sectors (European Biotech Act) 2025. https://health.ec.europa.eu/publications/proposal-regulation-establish-measures-strengthen-unions-biotechnology-and-biomanufacturing-sectors_en. Accessed 20/1/2026.
- 35.ZonMw. Programma Goed Gebruik Geneesmiddelen 2024–2027. 2023. https://www.zonmw.nl/sites/zonmw/files/2023-12/Programmavoorstel-GGG4-2024-2027_nov23.pdf. Accessed 16 Sep 2025.
- 36.Norton WE, Zwarenstein M, Czajkowski S, Kato E, O’Mara A, Shelburne N, et al. Building internal capacity in pragmatic trials: a workshop for program scientists at the US National Cancer Institute. Trials. 2019;20(1):779. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Hulstaert F, Pouppez C, Primus-de Jong C, Harkin K, Neyt M. Evidence gaps for drugs and medical devices at market entry in Europe and potential solutions. Health Services Research (HSR) KCE Reports. 2021;347.
- 38.European Medicines Agency (EMA). Good clinical practice. 2025. https://www.ema.europa.eu/en/human-regulatory-overview/research-development/compliance-research-development/good-clinical-practice#:~:text=Good%20clinical%20practice%20(GCP)%20is,clinical%2Dtrial%20data%20are%20credible. Accessed 10 Oct 2025.
- 39.World Medical Association. The Declaration of Helsinki 2024. https://www.wma.net/what-we-do/medical-ethics/declaration-of-helsinki/. Accessed 26 Sep 2025.
- 40.International Committee of Medical Journal Editors (ICMJE). Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals. 2025. https://www.icmje.org/icmje-recommendations.pdf. Accessed 8 Oct 2025. [DOI] [PMC free article] [PubMed]
- 41.Nevens H, Harrison J, Vrijens F, Verleye L, Stocquart N, Marynen E, et al. Budgeting of non-commercial clinical trials: development of a budget tool by a public funding agency. Trials. 2019;20(1):714. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.National Institute for Health and Care Research (NIHR). NIHR Research Funding Good Practice Guide 2024. https://www.nihr.ac.uk/nihr-research-funding-good-practice-guide. Accessed 15 Sep 2025.
- 43.Ravinetto R, De Nys K, Boelaert M, Diro E, Meintjes G, Adoke Y, et al. Sponsorship in non-commercial clinical trials: definitions, challenges and the role of Good Clinical Practices guidelines. BMC Int Health Hum Rights. 2015;15:34. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Gisbert JP, Chaparro M. Challenges of independent clinical research. Gastroenterol Hepatol. 2021;44(8):599–610. [DOI] [PubMed] [Google Scholar]
- 45.International Council for Harmonisation of technical requirements for pharmaceuticals for human use (ICH). ICH Harmonised Guideline for Good Clinical Practice E6(R3), Final version, Adopted on 06 January 2025. 2025. https://database.ich.org/sites/default/files/ICH_E6%28R3%29_Step4_FinalGuideline_2025_0106.pdf. Accessed 14 Oct 2025.
- 46.International Organization for Standardization (ISO). ISO 14155:2020, Clinical investigation of medical devices for human subjects-good clinical practice, Published (Edition 3, 2020). 2020. https://www.iso.org/standard/71690.html. Accessed 14 Oct 2025.
- 47.Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Croghan IT, Viker SD, Limper AH, Evans TK, Cornell AR, Ebbert JO, et al. Developing a clinical trial unit to advance research in an academic institution. Contemp Clin Trials. 2015;45(Pt B):270–6. [DOI] [PubMed] [Google Scholar]
- 49.Thomas RAB, Aitken EL, Antonelli J, Marson L. How to set up a clinical trial. Postgrad Med J. 2020;96(1139):564–9. [DOI] [PubMed] [Google Scholar]
- 50.Health innovation and research institute (HIRUZ). Research funding https://hiruz.be/ivu/funding/. Accessed 15 Sep 2025.
- 51.Kenning C, Usher-Smith JA, Jamison J, Jones J, Boaz A, Little P, et al. Impact of research activity on performance of general practices: a qualitative study. BJGP Open. 2024;8(3). 10.3399/BJGPO.2024.0073. [DOI] [PMC free article] [PubMed]
- 52.von Niederhausern B, Magnin A, Pauli-Magnus C. The impact of clinical trial units on the value of clinical research in Switzerland. Swiss Med Wkly. 2018;148:w14615. [DOI] [PubMed] [Google Scholar]
- 53.Vanherle L. (AcQaS), Belgian Healthcare Knowledge Centre (KCE). Capacity and Capability Analysis of Clinical Trial Units in Belgian Hospitals. 2017. https://kce.fgov.be/sites/default/files/2021-11/KCE%20sponsor%20due%20diligence%20report%20summary%20report_%202017.pdf. Accessed 16 Sep 2025.
- 54.Hurley C, Sinnott C, Clarke M, Kearney P, Racine E, Eustace J, et al. Perceived barriers and facilitators to risk based monitoring in academic-led clinical trials: a mixed methods study. Trials. 2017;18(1):423. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Tudur Smith C, Williamson P, Jones A, Smyth A, Hewer SL, Gamble C. Risk-proportionate clinical trial monitoring: an example approach from a non-commercial trials unit. Trials. 2014;15:127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Ford I, Norrie J. Pragmatic trials. N Engl J Med. 2016;375(5):454–63. [DOI] [PubMed] [Google Scholar]
- 57.European Medicines Agency (EMA). New targets for clinical trials in Europe 2025. https://www.ema.europa.eu/en/news/new-targets-clinical-trials-europe. Accessed 7 Oct 2025.
- 58.European Federation of Pharmaceutical Industries and Associations (EFPIA). EFPIA vision for clinical trials: 2030 and beyond 2025. https://www.efpia.eu/media/y2njed53/clinical-trial-strategy-in-a-snapshot.pdf. Accessed 14 Oct 2025.
- 59.Ohmann C, Banzi R, Canham S, Battaglia S, Matei M, Ariyo C, et al. Sharing and reuse of individual participant data from clinical trials: principles and recommendations. BMJ Open. 2017;7(12): e018647. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Tudur Smith C, Hopkins C, Sydes MR, Woolfall K, Clarke M, Murray G, et al. How should individual participant data (IPD) from publicly funded clinical trials be shared? BMC Med. 2015;13:298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Tudur Smith C, Nevitt S, Appelbe D, Appleton R, Dixon P, Harrison J, et al. Resource implications of preparing individual participant data from a clinical trial to share with external researchers. Trials. 2017;18(1):319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Carrandi A, Wells C, Morton RL, Norman R, Skouteris H, Grove A, et al. Uptake of health economic evaluations alongside clinical trials in Australia: an observational study. Trials. 2024;25(1):705. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Neyt M, De Meester C, Devriese S, Marynen E, Beeckman D. Silicone adhesive multilayer foam dressings to prevent hospital-acquired sacrum pressure ulcers: an economic evaluation based on a publicly funded pragmatic randomized controlled trial linked with real-world data. J Tissue Viability. 2024;33(4):772–7. [DOI] [PubMed] [Google Scholar]
- 64.Shahbaz M, Harding JE, Milne B, Walters A, Underwood L, von Randow M, et al. Time and cost of linking administrative datasets for outcomes assessment in a follow-up study of participants from two randomised trials. BMC Med Res Methodol. 2025;25(1):21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Gabriele SME, Martin MJ, Kesselheim AS, Tu SS. The strength and importance of government-funded patents for approved drugs. Nat Biotechnol. 2025;43(7):1050–2. [DOI] [PubMed] [Google Scholar]
- 66.National Institute for Health and Care Research (NIHR). NIHR IP policy and guidance for determining NIHR revenue share arrangements 2025. https://www.nihr.ac.uk/about-us/who-we-are/policies-and-guidelines/ip-policy-guidance-determining-revenue-share Accessed 12 Sep 2025.
- 67.Hammond A, Hay AD. Quality and costs of commissioned vs. researcher-led NIHR research: retrospective cohort study of randomised controlled trials. PLoS One. 2025;20(4):e0321425. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Hulstaert F, Ruether A, Demotes J, Melien O. Closing the cycle of innovation in healthcare in Europe. Int J Technol Assess Health Care. 2020;36(2):75–9. [DOI] [PubMed] [Google Scholar]
- 69.Chalkidou K, Tunis S, Whicher D, Fowler R, Zwarenstein M. The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research. Clin Trials. 2012;9(4):436–46. [DOI] [PubMed] [Google Scholar]
- 70.Platt R, Bosworth HB, Simon GE. Making pragmatic clinical trials more pragmatic. JAMA. 2024;332(22):1875–6. [DOI] [PubMed] [Google Scholar]
- 71.Propes C, Mehl K, Morain SR. Untapped potential? Representativeness in pragmatic clinical trials. JAMA. 2025;333(5):375–6. [DOI] [PubMed] [Google Scholar]
- 72.Cardoso Borges F, van der Graaf WTA, Saesen R, Aebi S, Amariutei AE, Bekelman J, et al. Defining the role of pragmatic clinical trials in cancer clinical research: outcomes of a collaborative workshop hosted by the European Organisation for Research and Treatment of Cancer. Lancet Oncol. 2025;26(5):e253–63. [DOI] [PubMed] [Google Scholar]
- 73.Rychlickova J, Cechova Z, Nagy V, Nebeska K, Souckova L, Mouly S, et al. Enhancing pragmatic competence in investigator-initiated clinical trials: structure and evaluation of the CONSCIOUS II training programme. BMC Med Educ. 2025;25(1):502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147. [DOI] [PubMed] [Google Scholar]
- 75.Favier R, Crepin S. The reporting of harms in publications on randomized controlled trials funded by the “Programme Hospitalier de Recherche Clinique,” a French academic funding scheme. Clin Trials. 2018;15(3):257–67. [DOI] [PubMed] [Google Scholar]
- 76.Xin Y, Song R, Hao J, Li W, Wu C, Zuo L, et al. Poor reporting quality and high proportion of missing data in economic evaluations alongside pragmatic trials: a cross-sectional survey. BMC Med Res Methodol. 2025;25(1):61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.COMET Initiative. Core outcome measures in effectiveness trials (COMET) 2025. https://www.comet-initiative.org. Accessed 12 Sep 2025.
- 78.Neyt M, Thiry N, Cleemput I. Belgian guidelines for economic evaluations and budget impact analyses: third edition. In: METHOD Brussels: Belgian Health Care Knowledge Centre (KCE). KCE Reports 400. 2025. [Google Scholar]
- 79.Anderson BR, Gotlieb EG, Hill K, McHugh KE, Scheurer MA, Mery CM, et al. Registry-based trials: a potential model for cost savings? Cardiol Young. 2020;30(6):807–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Erlinge D. Registry-based randomized clinical trials in cardiology: opportunities and challenges. REC Interv Cardiol. 2021;3:157–60. [Google Scholar]
- 81.Kachapila M, Watson S, Pinkney T, Hall JA, Andronis L, Oppong R. Economic considerations in designs and modifications of multiarm, multistage adaptive and adaptive platform randomized controlled trials: a systematic literature review. Value Health. 2025;28(3):477–88. [DOI] [PubMed] [Google Scholar]
- 82.Flight L, Brennan A, Chick SE, Forster M, Julious S, Tharmanathan P. Value-adaptive clinical trial designs for efficient delivery of publicly funded trials-a discussion of methods, case studies, opportunities and challenges. BMC Med Res Methodol. 2025;25(1):153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Partridge N, Scadding J. The James Lind Alliance: patients and clinicians should jointly identify their priorities for clinical trials. Lancet. 2004;364(9449):1923–4. [DOI] [PubMed] [Google Scholar]
- 84.Del Alamo M, Lemeret S, Nieto C, Pandya L, Hagen H, Walker S, et al. Funding multinational investigator-initiated clinical studies in Europe: why and how? Trials. 2024;25(1):689. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Wright JR, Roche K, Smuck B, Cormier J, Cecchetto S, Akow M, et al. Estimating per patient funding for cancer clinical trials: an Ontario based survey. Contemp Clin Trials. 2005;26(4):421–9. [DOI] [PubMed] [Google Scholar]
- 86.McLennan S, Griessbach A, Briel M. Making randomized trials affordable G. practices and attitudes of Swiss stakeholders regarding investigator-initiated clinical trial funding acquisition and cost management. JAMA Netw Open. 2021;4(6):e2111847. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Griessbach A, Speich B, Amstutz A, Hausheer L, Covino M, Wnfried Ramirez H, et al. Resource use and costs of investigator-sponsored randomized clinical trials in Switzerland, Germany, and the United Kingdom: a metaresearch study. J Clin Epidemiol. 2024;176:111536. [DOI] [PubMed] [Google Scholar]
- 88.Griessbach A, Chiaborelli M, Ehrlich K, Grossmann R, De Medina Redondo M, Fayet A, et al. Clinical trial budgeting approaches in Switzerland-a meta-research study. Trials. 2025;26(1):158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Jeray KJ, Tanner SL. Pilot randomized trials: is there a need? J Bone Joint Surg Am. 2012;94(Suppl 1):15–8. [DOI] [PubMed] [Google Scholar]
- 90.National Institute for Health and Care Research (NIHR). Additional guidance for applicants including a clinical trial, pilot study or feasibility as part of a personal award application. 2019. https://www.nihr.ac.uk/additional-guidance-applicants-including-clinical-trial-pilot-study-or-feasibility-part-personal-award-application. Accessed 20 Sep 2025.
- 91.Harman NL, Conroy EJ, Lewis SC, Murray G, Norrie J, Sydes MR, et al. Exploring the role and function of trial steering committees: results of an expert panel meeting. Trials. 2015;16:597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.van Hattem CC, de Jong AJ, de Groot JS, Hoekman J, Broekman KE, Sonke GS, et al. Factors affecting the feasibility of post-authorisation RCTs for conditionally authorised anticancer medicines: a multistakeholder perspective from a qualitative focus group study. BMJ Open. 2024;14(11):e084483. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Agrawal S, Arora S, Amiri-Kordestani L, de Claro RA, Fashoyin-Aje L, Gormley N, et al. Use of single-arm trials for US Food and Drug Administration drug approval in oncology, 2002-2021. JAMA Oncol. 2023;9(2):266–72. [DOI] [PubMed] [Google Scholar]
- 94.Tannock IF, de Vries EGE, Fojo A, Buyse M, Moja L. Dose optimisation to improve access to effective cancer medicines. Lancet Oncol. 2025;26(3):e171–80. [DOI] [PubMed] [Google Scholar]
- 95.Treatmeds. Regiebureau Dure Medicijnen 2025. https://treatmeds.nl/. Accessed 14 Oct 2025.
- 96.Alsop P, Metcalfe S, Evans J. Funding a clinical trial: the perspective of a medicines funder. Pharmacoeconomics. 2008;26(10):811–4. [DOI] [PubMed] [Google Scholar]
- 97.Bouche G, Gilbert D, Quartagno M, Dehbi HM, Merrick S, Barjesteh van Waalwijk van Doorn-Khosrovani S, et al. Determining the optimal use of approved drugs in oncology. Lancet Oncol. 2025;26(5):e282-e94. [DOI] [PubMed]
- 98.Tannock IF, Buyse M, De Backer M, Earl H, Goldstein DA, Ratain MJ, et al. The tyranny of non-inferiority trials. Lancet Oncol. 2024;25(10):e520–5. [DOI] [PubMed] [Google Scholar]
- 99.Maksimova MV, van Thiel G, Tromp Y, Lechner R, van Delden JJM, Bloem LT. Balancing ethical norms and duties for the introduction of new medicines through conditional marketing authorization: a research agenda. Front Med (Lausanne). 2024;11:1408553. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Tromp Y. An ethical evaluation of conditional marketing authorisations. Thesis at University of Utrecht. 2024. https://studenttheses.uu.nl/bitstream/handle/20.500.12932/46798/Tromp_4254031%60_Ma3WS.pdf?sequence=1&isAllowed=y. Accessed 12 Sep 2025.
- 101.Zorginstituut Nederland (ZIN). Sluis voor dure geneesmiddelen 2025. https://www.zorginstituutnederland.nl/over-ons/programmas-en-samenwerkingsverbanden/horizonscan-geneesmiddelen/sluis-voor-dure-geneesmiddelen. Accessed 12/9/2025.
- 102.Berkhemer OA, Fransen PS, Beumer D, van den Berg LA, Lingsma HF, Yoo AJ, et al. A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med. 2015;372(1):11–20. [DOI] [PubMed] [Google Scholar]
- 103.National Institutes of Health (NIH). Patient reported outcome measures (PROMs) in rehabilitation with or without the possible use of a mobile application after primary knee or hip arthroplasty (NCT04628468). 2023. https://www.clinicaltrials.gov/study/NCT04628468. Accessed 17 Oct 2025.
- 104.Treweek S, Pitkethly M, Cook J, Fraser C, Mitchell E, Sullivan F, et al. Strategies to improve recruitment to randomised trials. Cochrane Database Syst Rev. 2018;2(2):MR000013. [DOI] [PMC free article] [PubMed]
- 105.Avenell A, Grant AM, McGee M, McPherson G, Campbell MK, McGee MA. The effects of an open design on trial participant recruitment, compliance and retention- -a randomized controlled trial comparison with a blinded, placebo-controlled design. Clin Trials. 2004;1(6):490–8. [DOI] [PubMed] [Google Scholar]
- 106.Hemminki E, Hovi SL, Veerus P, Sevon T, Tuimala R, Rahu M, et al. Blinding decreased recruitment in a prevention trial of postmenopausal hormone therapy. J Clin Epidemiol. 2004;57(12):1237–43. [DOI] [PubMed] [Google Scholar]
- 107.Blatch-Jones A, Nuttall J, Bull A, Worswick L, Mullee M, Peveler R, et al. Using digital tools in the recruitment and retention in randomised controlled trials: survey of UK Clinical Trial Units and a qualitative study. Trials. 2020;21(1):304. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Frampton GK, Shepherd J, Pickett K, Griffiths G, Wyatt JC. Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map. Trials. 2020;21(1):478. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109.Treweek S, Briel M. Digital tools for trial recruitment and retention-plenty of tools but rigorous evaluation is in short supply. Trials. 2020;21(1):476. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110.Kennedy-Martin T, Curtis S, Faries D, Robinson S, Johnston J. A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results. Trials. 2015;16:495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 111.Vanneste A, Wens I, Sinnaeve P, Louati C, Huys I, Ioannidis JPA, et al. Evolution of reported patient and public involvement over time in randomised controlled trials in major medical journals and in their protocols: meta-epidemiological evaluation. BMJ. 2025;389: e082697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 112.Jenkins V, Fallowfield L. Reasons for accepting or declining to participate in randomized clinical trials for cancer therapy. Br J Cancer. 2000;82(11):1783–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Aung T, Haynes R, Barton J, Cox J, Murawska A, Murphy K, et al. Cost-effective recruitment methods for a large randomised trial in people with diabetes: a study of cardiovascular events in diabetes (ASCEND). Trials. 2016;17(1):286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Sense about Science. AllTrials 2025. https://senseaboutscience.org/alltrials/. Accessed 26 Sep 2025.
- 115.KCE Trials. First monitoring report on transparency practices in trials funded by KCE Trials. 2023. https://kce.fgov.be/sites/default/files/2023-12/First%20monitoring%20report%20transparency%20practices%20KCE%20Trials_2023.pdf. Accessed 13 Oct 2025.
- 116.ZonMw. Gluren bij de Buren, presentation bij Frank Hulstaert, KCE, at ZonMw Projectleidersbijeenkomst Zorgevaluatie. 2019. https://www.zonmw.nl/sites/zonmw/files/typo3-migrated-files/Gluren_bij_de_buren_-_Frank_Hulstaert.pdf. Accessed 29 Sep 2025.
- 117.EViR. Ensuring Value in Research (EViR) initiative. 2025. https://evir.org. Accessed 20 Sep 2025.
- 118.European Research Infrastructure Evaluation Consortium (ERIEC). Evaluation Report of ECRIN-ERIC 2020. https://www.eriec.eu/_files/ugd/aee7b1_6fa582f2d2f543a186f4b45cd52e308e.pdf?index=true. Accessed 12 Sep 2025.
- 119.European Clinical Research Infrastructure Network (ECRIN). Funding for multinational clinical trials. European funding programs for multinational clinical trials https://ecrin.org/funding-multinational-clinical-trials. Accessed 15 Sep 2025.
- 120.ERA4Health. The ERA4Health Partnership, co-funded bu the European Union. 2025. https://era4health.eu/. Accessed 23 Sep 2025.
- 121.Del Alamo M, Buhrer C, Fisher D, Griese M, Lingor P, Palladini G, et al. Identifying obstacles hindering the conduct of academic-sponsored trials for drug repurposing on rare-diseases: an analysis of six use cases. Trials. 2022;23(1):783. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.European Commission. Joint Clinical Assessments 2025. https://health.ec.europa.eu/health-technology-assessment/implementation-regulation-health-technology-assessment/joint-clinical-assessments_en. Accessed 20 Sep 2025.
- 123.European Commission-Health Emergency Preparedness and Response (HERA). Research and development of medical countermeasures. 2025. https://health.ec.europa.eu/health-emergency-preparedness-and-response-hera/preparedness/research-and-development-medical-countermeasures_en. Accessed 8 Oct 2025.
- 124.Foster I, Amuasi J, Geelen J, Miyagawa S, Bocking D, Hagen H, et al. How funders can support improved clinical trial practice for outbreaks. Lancet. 2023;402(10395):26. [DOI] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.

