Abstract
Integrating real-world evidence (RWE) into evidence-based medicine (EBM) enhances healthcare decision-making. RWE provides insights into the real-world effectiveness and safety of therapies and health technologies, filling gaps that clinical trials may leave. EBM, which concentrates on therapeutic issues, depends on rigorous evaluation of evidence, including data from randomized controlled trials (RCTs) and RWE. Combining evidence from RCTs and RWE when forming recommendations offers a comprehensive understanding of benefits and risks by considering their strengths, limitations, and standardized methods. The 2nd European Academy of Allergy & Clinical Immunology/Respiratory Effectiveness Group (EAACI/REG) Workshop, held in Rome, Italy, on October 4th, 2023, discussed integrating RWE and EBM. The goals were to develop recommendations for high-quality RWE and its inclusion in evidence syntheses, with a particular focus on airway diseases. During the discussion, key topics emerged. An “action plan” is needed to share these topics in various formats. RCTs are currently seen as providing the strongest evidence, so how to incorporate Non-Randomized Studies of Interventions (NRSI) requires careful consideration. An educational plan and collaboration with patients’ organizations are also very important. A collaborative approach involving patients, clinicians, and regulators is essential for achieving meaningful results and can be adapted as needed for cultural differences. A “glossary” of terms used in this context will be created to improve understanding. Setting benchmarks for data quality and reliability, such as quality thresholds, in disease-specific studies requires collaboration with research method experts. Managing and recording registries according to standardized protocols and quality standards from well-designed registries will ensure the data is valid and accurate.
Keywords: real world evidence, evidence-based medicine, real world data, registries
Introduction
While randomized controlled trials (RCTs) are considered the gold standard for establishing efficacy because of their internal validity and ability to reduce bias through randomization and controlled conditions, they also have well-known limitations. These include highly selective inclusion criteria, limited sample sizes, short follow-up periods, and artificial treatment environments—all of which decrease their external validity and generalizability to broader patient populations. Consequently, RCTs might not fully reflect the effectiveness, safety, and adherence patterns of interventions in everyday clinical practice. Real-world data (RWD), when collected and analyzed properly, can complement RCTs by offering evidence on how interventions perform across diverse populations, care settings, and over longer periods. This complementary role is especially important for informing clinical guidelines, health technology assessments, and regulatory decisions.
Real-world evidence (RWE) can be obtained from RWD using various study designs, each with unique methodological features and regulatory considerations. These include prospective pragmatic clinical trials, which evaluate interventions under routine care conditions while maintaining randomization; non-randomized interventional studies, which follow prospective protocols without random assignment; randomized controlled trials (RCTs) that utilize external control arms built from real-world data sources such as disease registries or electronic health records (EHRs); and retrospective observational studies, which analyze pre-existing data from structured sources (eg, registries, administrative claims databases, EHRs) to assess treatment effects or disease patterns. The suitable approach depends on the research question, data availability, feasibility, and regulatory environment. Importantly, methodological standards—such as pre-defining hypotheses and protocols, validating RWD sources for their intended purpose, and maintaining transparency in reporting—are critical to ensure the credibility of the evidence produced. These issues have increasingly been addressed in guidance documents issued by the FDA and EMA, as well as in academic literature exploring the strengths, limitations, and appropriate uses of different RWE-generation methods.1–4
The integration of RWE into evidence-based medicine (EBM) improves healthcare decision-making. RWE, derived from RWD, offers valuable insights into the real-world effectiveness and safety of therapies and health technologies outside of clinical trial settings,5 filling knowledge gaps that may exist because of the limitations of randomized controlled trials (RCTs) that use an explanatory study design.6,7 Guidelines systematically evaluate a relevant evidence base and then utilize the best available evidence.8 By combining RWE and EBM, decision-makers can gain a more comprehensive understanding of the benefits and risks of health interventions (Table 1).9,10 RWE provides real-world context and long-term outcomes data, while high-quality RCTs establish a solid evidence foundation for initial efficacy evaluations. This integration demands careful consideration of the strengths and limitations of both methods and the development of standardized approaches for data collection, analysis, and interpretation.11,12 Drawing from the existing knowledge repository for RWE, along with the perspectives and guidance from experts and scholarly organizations, in 2021 Paoletti et al proposed a hierarchy of RWE (Box 1).13
Table 1.
Defining the Pillars of Modern Clinical Practice: A Concise Overview of Real-World Evidence (RWE) and Evidence-Based Medicine (EBM)
Definition | |
---|---|
Real-World Evidence (RWE) | RWE pertains to health care information derived from multiple sources outside of typical clinical research settings, including electronic health records, insurance claims, and product and disease registries.[A] |
Evidence-Based Medicine (EBM) | EBM is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. EBM means integrating individual clinical expertise with the best available external clinical evidence from systematic research. [B,C] |
Notes: [A]: Milone V et al. Int J Environ Res Public Health. 2024 Jan 15;21(1):95. [B]: Chen S et al. J Manag Care Spec Pharm. 2021 Jan;27(1):95–104; [C] Roche et al Eur Respir J. 2019 Sep 19;54(3):1901511.
Box 1.
The Definition of the Type of Real World Studies (Paoletti G et al. Allergy. 2021 Sep;76(9):2663–2672)
Pragmatic randomized controlled trial: trials designed to evaluate the effectiveness of interventions in real-life routine practice conditions, opposite to explanatory trials that aim to test whether an intervention works under optimal situations. |
Registry real-world evidence: an organized system that uses observational methods to collect uniform data relative to real-world setting on specified outcomes in a population defined by a particular disease, condition, or exposure |
Prospective database real-world evidence: is a type of cohort study, where participants are enrolled into the study before they develop the disease or outcome in question in a real-world context. |
Retrospective multicentre database real-world evidence: is based on the use of an existing database to respond retrospectively to clinical questions |
Retrospective multicentre real-world evidence: is a clinical trial conducted at more than one medical centre or clinic where, in contrast to a prospective study, the outcome of interest has already occurred at the time the study is initiated |
Expert experience/evidence: is somebody who has a broad and deep competence in terms of knowledge, skill, and experience through practice and education in a particular field |
To understand and discuss how to integrate RWE into guidelines, the 2nd European Academy of Allergy & Clinical Immunology/Respiratory Effectiveness Group (EAACI/REG) Workshop was organized.
Materials and Methods
The meeting was held as a hybrid event on October 4th, 2023, in Rome, Italy, and online. The main goals of the meeting were to develop recommendations for producing high-quality RWE, understanding how to report and evaluate it, and integrating RWE with other sources of EBM.
Results
Meeting Objectives and Context
This was the second of two meetings in a series focused on standardizing the integration of Real-World Evidence (RWE) into clinical guidelines. The primary objective of the Rome meeting was to create a framework for producing, evaluating, and incorporating high-quality RWE into evidence-based recommendations.
Participants identified ongoing confusion about the definition and use of RWE and called for better education on RWE methodologies. This includes training for investigators and guideline developers on how to collect, analyze, and apply real-world data.
Regulatory Frameworks and Initiatives
The EAACI-ROC (Research and Outreach Committee) METHODOLOGY PROJECT has increasingly been used to develop clinical practice guidelines, addressing the need to include real-world data like data from registries, electronic health records, or patient-generated information. However, there is still a lack of clarity about what RWE means, how it can be produced, and how it can be integrated into the evidence-to-decision processes.
Another important point emphasized is the need for education on the methodologies used for generating, collecting, and analyzing high-quality Real-World Evidence. This educational component aims to equip investigators and guideline developers with a clear understanding of the complex processes involved, ultimately promoting expertise and ensuring the development of reliable and robust guidelines.14
Since the inaugural meeting, several documents and manuscripts have been published by different groups to support the use of real-world data and real-world evidence in regulatory decisions. The European Medicines Agency (EMA) and the Food and Drug Administration (FDA) are actively working to develop a sustainable framework that promotes the value and use of real-world evidence.
In EMA, the main focus is determining the evidentiary value of real-world evidence (RWE). In 2019, the OPTIMAL framework was introduced, covering three main pillars: operational, technical, and methodological. More recently, the European Union (EU) approach has placed RWE within the larger context of big data, in line with the key recommendations of the Big Data Task Force, which are carried out through the Big Data Steering Group. A framework to ensure the quality of real-world data (RWD) has also been published.11
Measures are also being taken to improve the discoverability of RWD through standardized metadata and the creation of a public catalog of RWD sources, building on the initial work of the European Network of Centres for Pharmacoepidemiology and Pharmacovigilance (ENCePP). The ENCePP Guide on Methodological Standards in Pharmacoepidemiology, which was extensively updated in 2021, along with recently issued guidance on conducting studies based on patient registries, serve as the foundational documents for updating RWE study method standards. Additionally, the Data Analytics and Real World Interrogation Network (DARWIN EU), a distributed RWD network across the EU, was launched in early 2022.
Additionally, the FDA finalized guidance on using real-world evidence in the drug approval process. According to this release, real-world evidence may be used to expand a product’s indication.15
It is encouraging that sponsors increasingly prioritize transparency by making their study protocols publicly available on platforms such as ClinicalTrials.gov or ENCePP’s webpage, or by encouraging independent peer review, such as the Anonymised Data Ethics & Protocol Transparency (ADEPT) Committee of REG and the Independent Scientific Advisory Committee (ISAC) for the Clinical Practice Research Datalink (CPRD). Additionally, sponsors should provide detailed descriptions of patient characteristics and study populations in their final reports, highlighting any differences that may influence the study findings. Each study should have a statistical analysis protocol, to which analyses conducted on the final dataset should adhere, and any additional analyses should be clearly labeled as post hoc or exploratory, as appropriate. Study monitoring aims to ensure protocol adherence, improve data submission reliability to regulatory agencies, and ensure proper data protection. For non-randomized studies, even early in the registry process, it is helpful to verify that permissions have been obtained for using copyrighted questionnaires and to ensure sites obtain consent and record data correctly. This involves verifying the accuracy and consistency of real-world data, ensuring compliance with prespecified plans and protocols,16 and documenting and evaluating any deviations. The minimum monitoring requirements for non-randomized studies include obtaining appropriate consent, ensuring data accuracy and consistency, adhering to study protocols and statistical analysis plans, and identifying and documenting deviations from prespecified plans and protocols, with necessary interventions.
Monitoring and Quality Standards for RWE
The GRADE (Grading of Recommendations Assessment, Development, and Evaluation) approach is the primary framework for evaluating evidence that informs recommendations and guidelines. Used by over 100 organizations, the GRADE approach employs a transparent and structured process to assess factors that reduce the certainty of evidence (also known as quality of evidence). These factors include limitations in the design and execution of studies (ie, risk of bias), consistency of results, precision of results, potential publication bias, and the relevance of evidence to the target population, setting, interventions, and outcomes (ie, directness).17,18
Factors that increase confidence in the results are also considered, such as a large magnitude of effects, a dose-response gradient, and reciprocal confounding. In addition to providing a framework to rate the certainty of evidence, the GRADE approach also offers a framework for developing recommendations. The following factors are systematically assessed when forming recommendations: the balance of desirable and undesirable health outcomes (ie, benefits and harms or burden), certainty of evidence, equity, feasibility, acceptability, and resources.
Non-randomized studies of interventions (NRSI) can be used sequentially, as complements, or as substitutes for randomized controlled trials (RCTs) within the GRADE framework. When RCTs do not provide evidence for outcomes considered critical or important by a guideline committee, NRSI can inform the committee about those outcomes. If RCTs offer moderate or lower certainty evidence due to issues like inconsistency, imprecision, or indirectness, then NRSI can serve as complements to the RCTs. Ultimately, when RCTs are unavailable or provide low or very-low certainty evidence, NRSI can replace RCTs, provided they offer higher certainty. Therefore, both NRSI and RCTs contribute to the evidence base guiding guideline recommendations, with non-randomized studies—often classified as “real-world evidence (RWE)”—sometimes being more applicable.19
When combining NRSI and RCTs, a practical approach is essential. It is important to assess the certainty of evidence from both NRSI and RCTs, as well as how well they agree. Agreement can be evaluated through visual comparison, statistical significance, or interaction tests.
Defining thresholds20–27 of benefits and harms will help determine congruency. The integration of NSRI with experts from diverse fields is the most effective way to combine NSRI and RCTs. One group of individuals may include clinicians who work in the real world, another group may include individuals with research expertise, and a final group may include individuals with expertise in evidence synthesis. It is important to emphasize that when evaluating an intervention, it is crucial to consider aspects of the evidence beyond study design alone.
Guideline methodology requires that recommendations be based on the best available evidence; therefore, rigorous methodology should be used to conduct and register NRSI, such as registry-based studies, to enhance the certainty of evidence and increase the likelihood that NRSI will inform guideline recommendations. The purpose of a rigorous research methodology is to reduce bias, as biases lead to systematic deviations from the truth. Common research biases include confounding, selection bias, information bias, time-related bias, and prevalent-user bias. Despite efforts to improve inclusion and applicability, bias can still occur in research design and implementation. For example, registries may be subject to selection bias if the main pathway to enrollment is through specialist care; additionally, low- and middle-income countries are often underrepresented. Two common scenarios that may contribute to biased research are design and execution issues or applicability challenges. Efforts to prevent these issues can increase the chances that research results will inform guideline recommendations and patient care.
All decisions are made based on challenging thresholds, and clinical data can be helpful in their determination, especially if more evidence about thresholds becomes available.
Glossary and Terminology Harmonization
Another critical point concerns the terminology used in RWE/NRSI. Many patient associations, clinicians, and researchers need to become more familiar with the acronyms used in studies and their definitions. Moreover, the term “RWE” is used with different meanings among health professionals and researchers, causing confusion within the global clinical research framework and its related terminology. Therefore, developing a comprehensive glossary to address these issues is essential. This glossary would serve as a vital foundation for widespread dissemination. It can be expanded gradually by implementing an algorithm that allows for the addition of new terms over time. Collaboration among different groups and organizations in the field is crucial; therefore, the glossary should be written in plain language to be accessible to patients and clinicians unfamiliar with research terminology. It is also important to align these efforts with the recommendations issued by regulatory and funding agencies, including the Data Quality Framework for EU medicines regulation, the EU-funded REALM project, the EMA-HMA catalogs of data sources and non-interventional studies, and the BDSG report on RWE framework to support regulatory decision-making.3
Role and Governance of Registries
Another important aspect involves registries, emphasizing their role, which can vary in terms of data collection type and quality.4 The use of registries in the drug approval process depends on their compliance with specific quality standards. When setting up a registry, several factors are considered, including identifying the target population, defining the registry’s purpose, and establishing criteria for patient inclusion and exclusion.
The procedural framework needs to be established; however, specifying every characteristic to be recorded in advance might hinder adding new patients over time as our understanding of the disease and its treatment options evolves. Other factors worth considering include the follow-up process (focusing on addressing low follow-up rates in some registries; it’s important to develop a system that minimizes the risk of losing patients to follow-up) and data analysis (which involves creating methods for monitoring, reporting, and conducting sensitivity checks when the data are used for regulatory purposes).
All the above information must be shared with scientific societies, regulatory agencies, and individuals creating new registries.
According to the EMA Guideline on registry-based studies, a registry’s characteristics should include certain essential elements. First, administrative information should be easily accessible, such as a website that provides detailed information about the registry’s main features. Additionally, there should be a designated contact point for questions, a publicly available collaboration policy, a governance structure for decision-making, and support functions for scientific, technical, ethical, and legal issues. Furthermore, a template for research agreements between the registry and external organizations should be available.4
Secondly, the registry should adhere to the requirements of informed consent and data protection. This includes complying with the General Data Protection Regulation (GDPR) and relevant local data protection laws, providing detailed information about consent in the Informed Consent Form, obtaining permissions for data use in research, patient re-contact, and quality management.4
Thirdly, the registry should identify its funding sources, assess their impact on financial sustainability, and address any potential conflicts of interest that may arise.4
Moving on to the methods used by a registry, it is important to clarify the purpose of the data collection system, as it influences the inclusion criteria for the registry population and the data collected. Additionally, detailed information about data providers, such as patients, caregivers, and healthcare professionals, should include their geographic area, selection criteria, and characteristics of the local health system.4
A record of permission to use any copyrighted questionnaires and compliance with their format for electronic data collection should be maintained.
The patient population covered by the registry should be defined based on the disease, condition, time period, and procedure. Information about the setting and geographic coverage should be provided, along with the inclusion and exclusion criteria for patient eligibility. Methods to reduce selection bias and loss to follow-up should be implemented, and statistics such as the number of patients, new entries, and exits per year should be recorded.4
The registry should also specify the core and optional data sets collected, including their definitions, dictionaries, formats, and plans for updates to these data elements. Applied standards and terminologies should be explicitly stated.4
Regarding the infrastructure, the registry should detail its data collection, recording, and reporting systems, along with the timelines for these processes. It should also have the capability for expedited and periodic reporting, data cleaning, transfer, and record linkage. Additionally, safety reporting procedures should be established.4
Quality requirements are vital for maintaining the integrity of the registry. This includes plans for planning, control, assurance, and improvement processes, as well as data verification methods and their frequency. The approach to managing missing data should be specified, and details of auditing procedures should be included.4
A multi-center registry can enhance transparency and compliance with standards in its governance and data collection methods by following these detailed guidelines.
The issue involves integrating evidence from registries and other sources of real-world evidence (RWE) with randomized controlled trials (RCTs), while also developing new tools for collecting patient-reported outcomes, which are currently often gathered by clinicians rather than patients themselves. As a result, collaboration with patients becomes essential. It’s important to recognize that registries are not always the final solution.
Discussion
The workshop’s findings are highly relevant to the broader goal of improving how real-world evidence (RWE) is integrated into evidence-based medicine. However, their practical impact depends on following key methodological standards. Participants recognized that credible RWE requires more than just access to real-world data (RWD); it needs a strict and transparent approach to study planning and execution. This includes clearly defining study hypotheses, protocols, and data analysis plans (DAPs), all of which should be registered and publicly available before starting the study. Additionally, RWD sources must be assessed for their suitability—ensuring they are relevant, complete, consistent, and reliable for the research question. Transparent reporting of the study process, including protocol deviations, population details, and outcome definitions, is equally vital for allowing reproducibility and regulatory review. These principles are increasingly included in guidance documents such as the FDA’s Real-World Evidence Program Framework and the EMA’s Guideline on Registry-Based Studies,3,4 both of which offer detailed recommendations on planning, conducting, and evaluating RWE studies. Applying these standards in everyday practice will be essential to ensure that initiatives like this workshop lead to meaningful improvements in how real-world evidence is generated.
Expert Opinion and Future Directions
The integration of Real-World Evidence (RWE) into evidence-based decision-making has become a practical necessity rather than just a theoretical concept. The workshop consensus highlights that high-quality RWE, when generated and interpreted with rigorous methods, can effectively supplement or sometimes replace data from randomized controlled trials (RCTs).
One clear outcome of the meeting was recognizing the necessity for structured educational programs targeted at clinicians, patients, and decision-makers. Without a fundamental understanding of RWE principles—such as bias reduction, transparency in protocols, and relevance—its usefulness will be limited. Similarly, the support for a straightforward, easy-to-understand glossary underscores the urgent need to standardize terminology to enhance communication among different stakeholder groups.
From a methodological perspective, the push for standardization in registry governance and study oversight aligns with evolving regulatory standards. Ensuring RWE studies meet the quality benchmarks established by the EMA and FDA will be crucial for their inclusion in guidelines and regulatory decisions.
Looking ahead, the next key step is to put these principles into practice through collaborative pilot projects, joint initiatives between academia and regulators, and cross-disciplinary working groups. Enhancing the representativeness of RWE—both geographically and across various health systems—will be essential for global relevance. Additional guidance from the GRADE Working Group and research focused on implementation will help establish best practices for integrating evidence.
Acknowledgments
Stefano Del Giacco and Giorgio Walter Canonica are co-first authors for this study. The authors would like to express their sincere gratitude to Enrica Piras for the editorial and medical writing assistance throughout the preparation of this manuscript. The views expressed in this report are the personal views of the authors and may not be understood or quoted as being made on behalf of or reflecting the position of the respective national competent authority, the European Medicines Agency, or one of its committees or working parties.
Disclosure
GWC reports research or clinical trials grants paid to his Institution from Menarini, AstraZeneca,GSK, Sanofi Genzyme and fees for lectures or advisory board participation from Menarini, AstraZeneca, Celltrion, Chiesi, Faes Farma, Firma, Guidotti-Malesci, GSK, HAL Allergy, Innovacaremd, OM Pharma, Red Maple, Sanofi-Aventis, Sanofi-Genzyme, Stallergenes Greer, and Uriach Pharma. SDG reports research or clinical trials grants paid to his Institution from AstraZeneca, Chiesi, GSK, Novartis, Sanofi Genzyme and fees for lectures or advisory board participation from AstraZeneca, Chiesi, CSL-Behring, GSK, Guidotti, Lusofarmaco, Novartis, Sanofi Genzyme, Stallergenes Greer, Takeda. HS is the chair of the GRADE Working Group. IA is the Chair of EAACI Research and Outreach Committee. DP reports advisory board membership with AstraZeneca, Boehringer Ingelheim, Chiesi, GlaxoSmithKline, Novartis, Viatris, Teva Pharmaceuticals; consultancy agreements with AstraZeneca, Boehringer Ingelheim, Chiesi, GlaxoSmithKline, Novartis, Viatris, Teva Pharmaceuticals; grants and unrestricted funding for investigator-initiated studies (conducted through Observational and Pragmatic Research Institute Pte Ltd) from AstraZeneca, Chiesi, Viatris, Novartis, Regeneron Pharmaceuticals, Sanofi Genzyme, and UK National Health Service; payment for lectures/speaking engagements from AstraZeneca, Boehringer Ingelheim, Chiesi, Cipla, Inside Practice, GlaxoSmithKline, Medscape, Viatris, Novartis, Regeneron Pharmaceuticals and Sanofi Genzyme, Teva Pharmaceuticals; payment for travel/accommodation/meeting expenses from AstraZeneca, Boehringer Ingelheim, Novartis, Medscape, Teva Pharmaceuticals.; stock/stock options from AKL Research and Development Ltd which produces phytopharmaceuticals; owns 74% of the social enterprise Optimum Patient Care Ltd (Australia and UK) and 92.61% of Observational and Pragmatic Research Institute Pte Ltd (Singapore); 5% shareholding in Timestamp which develops adherence monitoring technology; is peer reviewer for grant committees of the UK Efficacy and Mechanism Evaluation programme, and Health Technology Assessment; and was an expert witness for GlaxoSmithKline. IAns reports Fees for lectures or advisory board participation from Abbott, Bayer, Bial, Cipla, Eurodrug, Faes Farma, Gebro, Glenmark, Menarini, MSD, Roxall and Sanofi. SBA reports personal fees/ grants from Teva Pharmaceuticals, AstraZeneca, Boehringer Ingelheim, GSK, Sanofi, Abbvie, and Mylan, outside the submitted work; and during the time of writing and preparation of this manuscript, she was a full time University academic. And also the director at the Respiratory Effectiveness Group. She has since that time become an Honorary University academic and am employed by AstraZeneca Australia and New Zealand in the role of Real World Evidence Lead. All work contributed to this manuscript was conducted during her employment as a full time University Academic and Director at the Respiratory Effectiveness Group. JB reports personal fees from Cipla, Menarini, Mylan, Novartis, Purina, Sanofi-Aventis, Teva, Noucor; shareholder of KYomed-Innov and MASK-air SAS, outside the submitted work. KF is an employee of Optimum Patient Care Global (OPCG), a co-funder of the International Severe Asthma Registry. JK reports grants, personal fees and/or non-financial support from AstraZeneca, Boehringer Ingelheim, Chiesi, Genentech, GSK, Mundi Pharma, Teva, MSD, COVIS Pharma, ALK-Abello, Verona, American Academy of Allergy, Asthma, and Immunology, American Lung Association, grants from COPD Foundation, grants from National Institutes of Health, grants from Patient Centered Outcomes Research Institute and Valneva, outside the submitted work; and JK holds <5% shares of Lothar Medtec GmbH and 72.5% of shares in the General Practitioners Research Institute. NGP reports research or clinical trials grants paid to his Institution from Capricare, Nestle, Numil, Vianex, Vibrant, REG and fees for lectures or advisory board participation from Abbott, Abbvie, Astra Zeneca, GSK, HAL, Medscape, Menarini/Faes Farma, Mylan, Novartis, Nutricia, OM Pharma and Regeneron/Sanofi. MD is a senior epidemiologist at the European Medicines Agency. The views expressed in this article are those of the author and not any organisation or committee. SP reports grants from Astra Zeneca, Abbvie, Boehringer Ingelheim, Chiesi, DBV Technologies, OM Pharma, Pfizer, Regeneron, Roche, Sanofi Genzyme, Viatris; Clinical trials Advisory Groups for Boehringer Ingelheim, Roche and Sanofi and Sanofi-Regeneron and advisory groups on patient perspective for Pfizer, outside the submitted work; and Participation in advisory groups of Astra Zeneca on COPD and respiratory sustainability and of Chiesi environmental sustainability without honorarium to EFA or the author. HR reports grants, personal fees, and/or non-financial support from AstraZeneca, GlaxoSmithKline, Sanofi, Chiesi, Novartis, Teva, Getz, Alkem, Cipla, outside the submitted work; and Chair of the Global Initiative for Asthma (GINA) Science Committee. MT reports personal fees and/or grants from Leti Laboratories, Aimmune Therapeutics, Diater, ISCIII, European Commission, SEAIC, outside the submitted work. The authors report no other conflicts of interest in this work.
References
- 1.Sherman RE, Anderson SA, Dal GJ, et al. Real-world evidence-what is it and what can it tell us? N Engl J Med. 2016;375(23):2293–2297. doi: 10.1056/NEJMsb1609216 [DOI] [PubMed] [Google Scholar]
- 2.Makady A, de Boer A, Hillege H, Klungel O, Goettsch W. What is real-world data? A review of definitions based on literature and stakeholder interviews. Value Health. 2017;20(7):858–865. doi: 10.1016/j.jval.2017.03.008 [DOI] [PubMed] [Google Scholar]
- 3.Framework for FDA’s real-world evidence program; 2018. Available from: www.fda.gov. Accessed August 19, 2025.
- 4.European Medicines Agency (EMA). European Medicines Agency (EMA). Committee for Human Medicinal Products (CHMP) guideline on registry-based studies draft sent to the EU regulatory network for consultation including EMA committees, patients’ and consumers’ working party and healthcare professionals’ Working Party; 2021. Available from: www.ema.europa.eu/contact. Accessed August 19, 2025.
- 5.Graili P, Guertin JR, Chan KKW, Tadrous M. Integration of real-world evidence from different data sources in health technology assessment. J Pharm Pharm Sci. 2023;26:11460. doi: 10.3389/jpps.2023.11460 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Hathial M, Bhat P, Hathial C, et al. Real world evidence studies: perspective on study design and regulatory framework for RWE. World J Adv Res Rev. 2023;19(1):235–245. doi: 10.30574/wjarr.2023.19.1.1280 [DOI] [Google Scholar]
- 7.Paoletti G, Pepys J, Casini M, et al. Biologics in severe asthma: the role of real-world evidence from registries. Eur Respir Rev. 2022;31(164):210278. doi: 10.1183/16000617.0278-2021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Dang A. Real-world evidence: a primer. Pharmaceut Med. 2023;37(1):25–36. doi: 10.1007/s40290-022-00456-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Chen S, Graff J, Yun S, et al. Online tools to synthesize real-world evidence of comparative effectiveness research to enhance formulary decision making author affiliations. J Manage Care Specialty Pharm. 2021;27(1):95–104. doi: 10.18553/jmcp.2021.27.1.095 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Milone V, Fusco A, De Feo A, Tatullo M. Clinical impact of “real world data” and blockchain on public health: a scoping review. Int J Environ Res Public Health. 2024;21(1):95. doi: 10.3390/ijerph21010095 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.European Medicine Agency. Real-world evidence framework to support EU regulatory decision-making; 2023. Available from: https://www.ema.europa.eu/system/files/documents/report/real-world-evidence-framework-support-eu-regulatory-decision-making-report-experience-gained_en.pdf
- 12.Arlett P, Kjær J, Broich K, Cooke E. Real-world evidence in EU medicines regulation: enabling use and establishing value. Clin Pharmacol Ther. 2022;111(1):21–23. doi: 10.1002/cpt.2479 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Paoletti G, Di Bona D, Chu DK, et al. Allergen immunotherapy: the growing role of observational and randomized trial “real-world evidence. Allergy Eur J Allergy Clin Immunol. 2021;76(9):2663–2672. doi: 10.1111/all.14773 [DOI] [PubMed] [Google Scholar]
- 14.Canonica GW, Agache I, Schünemann HJ, Roche N, Price D, Del Giacco S. Next generation health guidelines: the role of real-life data in evidence-based medicine. Allergy Eur J Allergy Clin Immunol. 2023. doi: 10.1111/all.15887 [DOI] [PubMed] [Google Scholar]
- 15.U.S. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research (CDER) Center for Biologics Evaluation and Research (CBER) Oncology Center of Excellence (OCE). Considerations for the use of real-world data and real-world evidence to support regulatory decision-making for drug and biological products guidance for industry; 2023. Available from: https://www.fda.gov/vaccines-blood-biologics/guidance-compliance-regulatory-information-biologics/biologics. Accessed August 19, 2025.
- 16.Fritzsching B, Contoli M, Porsbjerg C, et al. Long-term real-world effectiveness of allergy immunotherapy in patients with allergic rhinitis and asthma: results from the REACT study, a retrospective cohort study. Lancet Regional Health. 2022;13:100275. doi: 10.1016/j.lanepe.2021.100275 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Cuello-Garcia CA, Santesso N, Morgan RL, et al. GRADE guidance 24 optimizing the integration of randomized and non-randomized studies of interventions in evidence syntheses and health guidelines. J Clin Epidemiol. 2022;142:200–208. doi: 10.1016/j.jclinepi.2021.11.026 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Schünemann HJ, Tugwell P, Reeves BC, et al. Non‐randomized studies as a source of complementary, sequential or replacement evidence for randomized controlled trials in systematic reviews on the effects of interventions. Res Synth Methods. 2013;4(1):49–62. doi: 10.1002/jrsm.1078 [DOI] [PubMed] [Google Scholar]
- 19.Gershon AS, Lindenauer PK, Wilson KC, et al. Informing healthcare decisions with observational research assessing causal effect. Am J Respir Crit Care Med. 2021;203(1):14–23. doi: 10.1164/rccm.202010-3943ST [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Vandenbroucke JP, Von Elm E, Altman DG, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and Elaboration. PLOS Med 2007;147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Roche N, Campbell JD, Krishnan JA, et al. Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT): report from the Respiratory Effectiveness Group - European Academy of Allergy and Clinical Immunology Task Force. Clin Transl Allergy. 2019;9(1). doi: 10.1186/s13601-019-0255-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Campbell JD, Perry R, Papadopoulos NG, et al. The REal Life EVidence AssessmeNt Tool (RELEVANT): development of a novel quality assurance asset to rate observational comparative effectiveness research studies. Clin Transl Allergy. 2019;9(1). doi: 10.1186/s13601-019-0256-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Cox E, Martin BC, Van Staa T, Garbe E, Siebert U, Johnson ML. Good research practices for comparative effectiveness research: approaches to mitigate bias and confounding in the design of nonrandomized studies of treatment effects using secondary data sources: the international society for pharmacoeconomics and outcomes research good research practices for retrospective database analysis task force report - Part II. Value Health. 2009;12(8):1053–1061. doi: 10.1111/j.1524-4733.2009.00601.x [DOI] [PubMed] [Google Scholar]
- 24.Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62:e1–e34. doi: 10.1016/j.jclinepi.2009.06.006 [DOI] [PubMed] [Google Scholar]
- 25.Pinnock H, Barwick M, Carpenter CR, et al. Standards for Reporting Implementation Studies (StaRI): explanation and elaboration document. BMJ Open. 2017;7(4):e013318. doi: 10.1136/bmjopen-2016-013318 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337(7680):1223–1226. doi: 10.1136/bmj.a2390 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Chavannes N, Stallberg B, Lisspers K, et al. Unlock: uncovering and noting long-term outcomes in COPD to enhance knowledge. Primary Care Respir J. 2010;19(4):408. doi: 10.4104/pcrj.2010.00084 [DOI] [PMC free article] [PubMed] [Google Scholar]