1. Background
Recent years, particularly the COVID-19 pandemic, can be considered a turning point for pharmacovigilance and pharmacoepidemiology in terms of their role in drug safety and drug utilisation monitoring in clinical practice [1]. Researchers operating in the fields of pharmacovigilance and pharmacoepidemiology have extensive knowledge about approved medications, many of which have been or are currently undergoing clinical trials for repurposing. In this context, clinical pharmacologists’ knowledge can be used and translated to optimise dosing and treatment regimens and to assess the relationship between active compound exposure and adverse drug reactions (ADR) or adverse events following immunisation (AEFI), with the crucial aims of optimising drugs or vaccines’ efficacy and ensuring patients’ safety.
2. Pharmacovigilance
Adverse drug reactions represent a relevant clinical issue, causing each year a significant number of medical consultations, emergency department (ED) visits, and/or patients’ hospitalisations [2], including an increase in the length of patients’ hospital stay. ADRs are considerable medical occurrence, not only from a clinical point of view, but they also represent an economic burden, since they can be involved in the death of several thousand patients each year, accounting up for a not negligible percentage of a hospital’s budget [3]. This scenario is even more complex if we consider that many ADRs are predictable and therefore preventable.
Drug and vaccine safety surveillance is a continuous process, which includes all the phases of the life cycle of a drug/vaccine. Additionally, also surveillance of the safety of products belonging to complementary and alternative medicine (CAM), defined as phytovigilance [4], contributes to guaranteeing the safety of patients.
During the drug development process, safety is investigated in different preclinical and clinical phases. Although drug and vaccine safety evaluation is very rigorous and highly regulated, randomised clinical trials (RCTs) have several limitations, which include limited numbers of patients, strict eligibility criteria, and limited duration. These intrinsic characteristics of RCTs make their results far from representing the real-world population, thus not allowing an exhaustive assessment of the safety profile of drugs and vaccines. Consequently, post-marketing surveillance, also known as pharmacovigilance (during phase IV of drug development), plays a key role in better defining drugs’ and vaccines’ safety profiles in clinical practice, overcoming the gap of evidence derived from the pre-marketing phases [5,6]. These aspects are even more relevant if we consider that most CAM products (i.e., dietary supplements, herbal supplements, traditional Chinese medicine products, homoeopathic products, etc.) are placed on the market without first being tested on humans, even less in frailer subgroups [6].
In the last decades, spontaneous reporting of suspected ADRs, AEFIs, and adverse events associated with CAM products, has represented the starting point and the milestone to build the modern pharmacovigilance system which is currently operating, although with differences between countries, all over the world under the coordination of the World Health Organisation Uppsala Monitoring Centre. More recently, new methodological approaches have become necessary in the field of pharmacovigilance, to try to overcome the limits of spontaneous reporting, particularly the underreporting [2].
An important example is represented by active pharmacovigilance projects, aimed at estimating the impact of ADRs, AEFIs, and adverse events associated with CAM products through continuous pre-organized activities in specific clinical settings (i.e., ED, hospital ward, nursing home, etc.) [2,5] or through the analysis of local or national administrative healthcare databases (i.e., dispensed drugs, emergency department records, hospital discharge records, exemption codes, etc.) [7].
In the frame of ED, active pharmacovigilance represents a valuable methodology, allowing healthcare professionals and researchers to detect, collect and characterise the clinical burden of ADRs [6], AEFIs [8], and adverse events associated with CAM products [9,10] in outpatients. Furthermore, active pharmacovigilance may help to recognise risk factors associated with adverse reactions among specific patient populations, such as the elderly (age ≥ 65 years) [11], women [7], including those in pregnancy or breastfeeding [12,13], children [14], subjects exposed to polypharmacy, or patients affected by substance use disorder [15]. In this framework, an active pharmacovigilance approach can help to early recognise and prevent adverse reactions, minimising their clinical, economic and social impact.
In recent years, new technologies are also making an important contribution to active pharmacovigilance. In particular, machine learning, deep learning, and natural language processing approaches can be used to detect adverse reactions from unconventional data sources, e.g., social media [16,17], and to discover safety signals, underlying some adverse reactions not yet reported [18]. Moreover, safety data collected from healthcare social networks and forums, general social networking, and search logs can be processed by big data sentiment analysis algorithms to provide a more comprehensive picture of the public opinion, experiences, and sentiments about drugs and vaccines [19], and can be used to create effective public health campaigns on drugs/vaccines safety, diseases prevention or to fight vaccine hesitancy [20].
3. Pharmacoepidemiology
Pharmacoepidemiology refers to the study of interactions between drugs, vaccines, or CAM products and populations. In particular, it can be defined as the study of the utilisation, therapeutic effects, and risks of different health products through several epidemiological approaches. Even though RCTs may be preferred for evaluating the efficacy of a drug or a vaccine, the principal aim of the pharmacoepidemiological method is to estimate drug or vaccine effect in real life (effectiveness), avoiding, as much as possible, any modification caused by the study itself (i.e., presence of biases). From a practical point of view, pharmacoepidemiology relates to descriptive methodologies (i.e., describing the use of a drug in a specific demographic or clinical setting) [21], as well as to etiologic methodologies (i.e., estimating the association between drug exposure and a specific clinical outcome) [22]. Researchers operating in the field of pharmacovigilance, first the clinical pharmacologist, can use pharmacoepidemiological studies to identify unexpected or rare safety issues and detect changes in frequency of expected ADRs/AEFIs, making possible a continuous monitoring of the benefit risk ratio of a drug, vaccine or CAM product in the real-world setting [5].
New evidence concerning drug safety obtained through pharmacoepidemiological approaches is relevant for pharmaceutical industries because they can use this information to submit amendments to the approved indications for their products. In fact, pharmacoepidemiology allows industries to demonstrate the safety of their products, especially compared to others (comparative observational studies). Furthermore, it is also fundamental for regulatory agencies, for physicians, and patients using health products. In this context, there is a clear need for high-quality epidemiological research in the post-marketing phase for the timely identification of any significant safety concerns that arise when a drug, vaccine, or CAM product is used in the real-world “uncontrolled” setting. All this is mandatory to protect the health and quality of life of patients.
Over the past decades, more data has become increasingly available due to the constant growth of administrative healthcare databases, in particular those reporting data on prescription drugs. This circumstance has enhanced the improvement of pharmacoepidemiology, a dynamic research field that has undergone a more rapid development than many other research areas of pharmacology and clinical pharmacology. Evidence proliferation in modern society will continue, and population-based observational studies (i.e., cohort and case control studies) aimed at assessing the effectiveness (defined as the extent to which a drug achieves its intended effect in the usual clinical setting) and safety of drugs, vaccines, and CAM products will be increasingly requested by industry, regulatory agencies, payers, healthcare professionals, patients, and caregivers.
The availability of electronic healthcare databases will enable researchers operating in the fields of pharmacovigilance and pharmacoepidemiology to identify a growing number of cases in which effectiveness does not match efficacy. This will challenge the actions of all concerned stakeholders. For these reasons, pharmacoepidemiological studies will also be increasingly requested by reimbursement agencies and other payers to assess the value of health products used in the general population. In conclusion, it is essential that the increasing amount of data collected to monitor the utilisation, effectiveness, and safety of new drugs, vaccines, and CAM products will be used to improve clinical decision-making. In this complex scenario, the clinical pharmacologist will certainly have to play an important role, in concert with the other actors involved in the post-marketing setting.
4. The Role of the Clinical Pharmacologist
In the real-world setting, there are two different actors in the issue of ADRs: the healthcare professional (i.e., medical doctor, pharmacist, nurse, etc.) and the citizen/patient. While they are directly involved, in cooperation with universities, regulatory authorities, and drug manufacturers, the figure of the clinical pharmacologist (with a medicine or pharmacy single-cycle degree background) has also a pivotal role in the management of adverse reactions. However, his/her role is still often underestimated and underused [23].
Generally, the clinical pharmacologist has a dual background, in biomedical science and in pharmacology. Furthermore, a clinical pharmacologist will often be trained in biostatistics and pharmacoepidemiology. For example, in Italy, to become a clinical pharmacologist, a single-cycle master’s degree in healthcare (i.e., medicine or pharmacy), followed by a doctorate and/or a specialisation in clinical pharmacology and toxicology is needed. Clinical pharmacologists operate in universities, industry, regulatory authorities, and hospitals. In fact, their activities comprehend teaching in biomedical schools, research in the public or industry fields, regulatory affairs, and hospital activities.
In Italy, the main healthcare professionals that are involved in pharmacovigilance are hospital pharmacists. However, while the hospital pharmacist is directly involved in the management of pharmacovigilance report forms, including all activities related to the proper functioning of the national pharmacovigilance system, clinical pharmacologists have a unique insight into the possible mechanism of the putative adverse reaction, the underlying or concomitant diseases, and the possibility of drug–drug, drug–CAM or drug–disease interactions [1,24]. Thus, more recently, hospital pharmacists have been supported by one or more clinical pharmacologists, and their cooperation at both hospital and territorial level enhance the knowledge of drug safety in the pre- and post-marketing settings. Moreover, the clinical pharmacologist may enhance the quality of information and may help in the interpretation of data collected during adverse events reporting. This could be of utmost importance for modern projects of active pharmacovigilance when the clinical pharmacologist can play the role of a trained monitor.
At the individual patient level, the clinical pharmacologist could be involved in the resolution of several drug-related issues, which can vary from some advice regarding drug administration, to the choice of a drug in specific population subgroups, such as pregnant women. Indications in adverse reactions management can be based on literature evidence or on knowledge of drugs’ pharmacokinetics and pharmacodynamics, or they may be part of a more proactive approach. In proactive and preventive approaches, the clinical pharmacologist could take part in the resolution/prevention of adverse reactions, cooperating with other healthcare professionals to improve the appropriateness of use of drugs and CAM products and to increase personalised medicine [25]. Moreover, new technologies for adverse reactions monitoring could be improved by clinical pharmacologists’ knowledge. These new applications and tools can be designed taking into account many aspects of pharmacology, pharmacoepidemiology, and pharmacological use in real clinical practice in which the clinical pharmacologist is an expert.
During the SARS-CoV-2 pandemic, great attention was paid to the risk associated with the involuntary intoxication and to the need for correct information concerning the in-home utilisation of several medical and non-medicinal products (i.e., cleaners and disinfectants, medical devices, etc.), thus representing a further field of action in which the clinical pharmacologist can guarantee a fundamental contribution [26]. Actually, the role of clinical pharmacologists, particularly those working in a poison control center, is valuable in the identification and management of exposures and suspected intoxications in the general population or in specific subgroups [27].
5. Future Perspectives
Real-world data are crucial to further establish the safety profile of pharmacological treatments in the general population [28]. As a next step, real-world data from electronic healthcare databases may be used in pharmacovigilance and pharmacoepidemiology to monitor drug utilisation patterns, as well as the effectiveness and safety of drugs in large populations. Big data and machine learning analysis technologies could be used to extract and aggregate pharmacovigilance data from different and unrelated sources (i.e., health insurance companies, academic institutions, healthcare systems, etc.) and associate relevant information on drug safety using artificial intelligence tools [29]. All these approaches will be particularly useful in the near future for the monitoring of COVID-19 vaccines’ safety. Moreover, among new technologies, gamification is another promising technology with several potential uses in drug safety. Gamification applications transfer gaming dynamics to the “serious context” of pharmacological therapies, for example, to educate health professionals [30] and patients [31] on the correct management of chronic diseases or to improve adherence to drug treatments thus reducing adverse events [32]. In this context, “digital therapeutics” (algorithms and software) can represent an innovative approach through which the clinical pharmacologist can improve the management and safety of pharmacological and/or integrative treatments [33].
As the amount of data available from randomised controlled trials and pharmacoepidemiological studies will increase over the coming years, the characteristics of adverse events related to medicines, vaccines or CAMs will become clearer and the central role of the clinical pharmacologist should become even more relevant. Managing adverse events should be a routine activity for clinical pharmacologists. This management takes advantage of all the skills of the clinical pharmacologist to explore individual cases and the mechanisms of adverse events. With their knowledge in pharmacovigilance and pharmacoepidemiology, clinical pharmacologists may play a key role by bringing various healthcare professionals together in a proactive discussion/collaboration aimed at improving the safety of pharmacological and/or integrative treatments in clinical practice.
Author Contributions
Conceptualization, G.C. and N.L.; writing—original draft preparation, G.C. and N.L.; writing—review and editing, R.B., R.C., G.M. and A.V. All authors have read and agreed to the published version of the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
Funding Statement
This research received no external funding.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Crescioli G., Brilli V., Lanzi C., Burgalassi A., Ieri A., Bonaiuti R., Romano E., Innocenti R., Mannaioni G., Vannacci A., et al. Adverse Drug Reactions in SARS-CoV-2 Hospitalised Patients: A Case-Series with a Focus on Drug-Drug Interactions. Intern. Emerg. Med. 2021;16:697–710. doi: 10.1007/s11739-020-02586-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lombardi N., Crescioli G., Bettiol A., Tuccori M., Capuano A., Bonaiuti R., Mugelli A., Venegoni M., Vighi G.D., Vannacci A., et al. Italian Emergency Department Visits and Hospitalizations for Outpatients’ Adverse Drug Events: 12-Year Active Pharmacovigilance Surveillance (The MEREAFaPS Study) Front. Pharmacol. 2020;11:412. doi: 10.3389/fphar.2020.00412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Perrone V., Conti V., Venegoni M., Scotto S., Esposti L.D., Sangiorgi D., Prestini L., Radice S., Clementi E., Vighi G. Seriousness, Preventability, and Burden Impact of Reported Adverse Drug Reactions in Lombardy Emergency Departments: A Retrospective 2-Year Characterization. Clin. Outcomes Res. 2014;6:505–514. doi: 10.2147/CEOR.S71301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Lombardi N., Crescioli G., Bettiol A., Menniti-Ippolito F., Maggini V., Gallo E., Mugelli A., Vannacci A., Firenzuoli F. Safety of Complementary and Alternative Medicine in Children: A 16-Years Retrospective Analysis of the Italian Phytovigilance System Database. Phytomedicine. 2019;61:152856. doi: 10.1016/j.phymed.2019.152856. [DOI] [PubMed] [Google Scholar]
- 5.Marconi E., Crescioli G., Bonaiuti R., Pugliese L., Santi R., Nesi G., Cerbai E., Vannacci A., Lombardi N. Acute Appendicitis in a Patient Immunised with COVID-19 Vaccine: A Case Report with Morphological Analysis. Br. J. Clin. Pharmacol. 2022 doi: 10.1111/bcp.15421. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Pagani S., Lombardi N., Crescioli G., Giuditta Vighi V., Spada G., Andreetta P., Capuano A., Vannacci A., Venegoni M., Vighi G.D. Clinical Medicine Drug-Related Hypersensitivity Reactions Leading to Emergency Department: Original Data and Systematic Review. J. Clin. Med. 2022;11:2811. doi: 10.3390/jcm11102811. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Spini A., Crescioli G., Donnini S., Ziche M., Collini F., Gemmi F., Virgili G., Vannacci A., Lucenteforte E., Gini R., et al. Sex Differences in the Utilization of Drugs for COVID-19 Treatment among Elderly Residents in a Sample of Italian Nursing Homes. Pharmacoepidemiol. Drug Saf. 2022;31:489–494. doi: 10.1002/pds.5420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Luxi N., Giovanazzi A., Capuano A., Crisafulli S., Cutroneo P.M., Fantini M.P., Ferrajolo C., Moretti U., Poluzzi E., Raschi E., et al. COVID-19 Vaccination in Pregnancy, Paediatrics, Immunocompromised Patients, and Persons with History of Allergy or Prior SARS-CoV-2 Infection: Overview of Current Recommendations and Pre- and Post-Marketing Evidence for Vaccine Efficacy and Safety. Drug Saf. 2021;44:1247–1269. doi: 10.1007/s40264-021-01131-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Crescioli G., Lombardi N., Bettiol A., Menniti-Ippolito F., Roberto I., Da Cas R., Parrilli M., Del Lungo M., Gallo E., Mugelli A., et al. Adverse Events Following Cannabis for Medical Use in Tuscany: An Analysis of the Italian Phytovigilance Database. Br. J. Clin. Pharmacol. 2019;86:106–120. doi: 10.1111/bcp.14140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lombardi N., Crescioli G., Maggini V., Ippoliti I., Menniti-Ippolito F., Gallo E., Brilli V., Lanzi C., Guido Mannaioni G., Firenzuoli F., et al. Acute Liver Injury Following Turmeric Use in Tuscany: An Analysis of the Italian Phytovigilance Database and Systematic Review of Case Reports. Br. J. Clin. Pharmacol. 2021;87:741–753. doi: 10.1111/bcp.14460. [DOI] [PubMed] [Google Scholar]
- 11.Crescioli G., Bettiol A., Bonaiuti R., Tuccori M., Rossi M., Capuano A., Pagani S., Spada G., Venegoni M., Vighi G.D., et al. Risk of Hospitalization Associated with Cardiovascular Medications in the Elderly Italian Population: A Nationwide Multicenter Study in Emergency Departments. Front. Pharmacol. 2021;11:611102. doi: 10.3389/fphar.2020.611102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Vannacci A., Bettiol A., Lombardi N., Marconi E., Crescioli G., Bonaiuti R., Maggini V., Gallo E., Mugelli A., Firenzuoli F., et al. The Use of Complementary and Alternative Medicines during Breastfeeding: Results from the Herbal Supplements in Breastfeeding InvesTigation (HaBIT) Study. Br. J. Clin. Pharmacol. 2018;84:2040. doi: 10.1111/bcp.13639. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Bettiol A., Lombardi N., Marconi E., Crescioli G., Bonaiuti R., Maggini V., Gallo E., Mugelli A., Firenzuoli F., Ravaldi C., et al. The Impact of Previous Pregnancy Loss on Lactating Behaviors and Use of Herbal Medicines during Breastfeeding: A Post Hoc Analysis of the Herbal Supplements in Breastfeeding InvesTigation (HaBIT) Evid. Based Complement. Altern. Med. 2018;2018:1035875. doi: 10.1155/2018/1035875. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Lombardi N., Crescioli G., Bettiol A., Tuccori M., Rossi M., Bonaiuti R., Ravaldi C., Levi M., Mugelli A., Ricci S., et al. Vaccines Safety in Children and in General Population: A Pharmacovigilance Study on Adverse Events Following Anti-Infective Vaccination in Italy. Front. Pharmacol. 2019;10:948. doi: 10.3389/fphar.2019.00948. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Sartori S., Crescioli G., Brilli V., Traversoni S., Lanzi C., Vannacci A., Mannaioni G., Lombardi N. Phenobarbital Use in Benzodiazepine and Z-Drug Detoxification: A Single-Centre 15-Year Observational Retrospective Study in Clinical Practice. Intern. Emerg. Med. 2022;12:1–10. doi: 10.1007/s11739-022-02976-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Maggini V., Lombardi N., Crescioli G., Gallo E., Sivelli F., Gensini G.F., Vannacci A., Firenzuoli F. Chelidonium Majus: Relevant Safety Aspects of a Hepatotoxic Plant, Trawling the Web. Phyther. Res. 2019;33:2465–2469. doi: 10.1002/ptr.6437. [DOI] [PubMed] [Google Scholar]
- 17.Soysal E., Wang J., Jiang M., Wu Y., Pakhomov S., Liu H., Xu H. CLAMP—A Toolkit for Efficiently Building Customized Clinical Natural Language Processing Pipelines. J. Am. Med. Informatics Assoc. 2018;25:331–336. doi: 10.1093/jamia/ocx132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Lian A., Du J., Tang L. Using a Machine Learning Approach to Monitor COVID-19 Vaccine Adverse Events (VAE) from Twitter Data. Vaccines. 2022;10:103. doi: 10.3390/vaccines10010103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Du J., Tang L., Xiang Y., Zhi D., Xu J., Song H.Y., Tao C. Public Perception Analysis of Tweets during the 2015 Measles Outbreak: Comparative Study Using Convolutional Neural Network Models. J. Med. Internet Res. 2018;20:e236. doi: 10.2196/jmir.9413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Chou W.Y.S., Budenz A. Considering Emotion in COVID-19 Vaccine Communication: Addressing Vaccine Hesitancy and Fostering Vaccine Confidence. Health Commun. 2020;35:1718–1722. doi: 10.1080/10410236.2020.1838096. [DOI] [PubMed] [Google Scholar]
- 21.Lombardi G., Lombardi N., Bettiol A., Crescioli G., Ferrari C., Lucidi G., Polito C., Berti V., Bessi V., Bagnoli S., et al. Long-Term Use of Pharmacological Treatment in Alzheimer’s Disease: A Retrospective Cohort Study in Real-World Clinical Practice. Eur. J. Clin. Pharmacol. 2022;1:3. doi: 10.1007/s00228-022-03325-y. [DOI] [PubMed] [Google Scholar]
- 22.Lombardi N., Brilli V., Crescioli G., Bettiol A., Ippazio C., Mazzaglia G., Fumagalli S., Mannaioni G., Vannacci A., Gini R. Patterns and Trends of Idarucizumab Use in an Italian Region: A Probabilistic Record-Linkage Approach in a Real-Life Setting. Eur. Heart J. 2020;41:ehaa946-3364. doi: 10.1093/ehjci/ehaa946.3364. [DOI] [Google Scholar]
- 23.van der Graaf P.H., Giacomini K.M. COVID-19: A Defining Moment for Clinical Pharmacology? Clin. Pharmacol. Ther. 2020;108:11–15. doi: 10.1002/cpt.1876. [DOI] [PubMed] [Google Scholar]
- 24.Crescioli G., Lanzi C., Mannaioni G., Vannacci A., Lombardi N. Adverse Drug Reactions in SARS-CoV-2 Hospitalised Patients: A Case-Series with a Focus on Drug-Drug Interactions-Reply. Intern. Emerg. Med. 2021;16:799–800. doi: 10.1007/s11739-021-02677-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sobiak J., Resztak M., Crescioli G., Lombardi N., Vagnoli L., Bettiol A., Giunti L., Cetica V., Coniglio M.L., Provenzano A., et al. STOP Pain Project-Opioid Response in Pediatric Cancer Patients and Gene Polymorphisms of Cytokine Pathways. Pharmaceutics. 2022;14:619. doi: 10.3390/pharmaceutics14030619. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Crescioli G., Lanzi C., Gambassi F., Ieri A., Ercolini A., Borgioli G., Bettiol A., Vannacci A., Mannaioni G., Lombardi N. Exposures and Suspected Intoxications during SARS-CoV-2 Pandemic: Preliminary Results from an Italian Poison Control Centre. Intern. Emerg. Med. 2021;17:535–540. doi: 10.1007/s11739-021-02774-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Missanelli A., Lombardi N., Bettiol A., Lanzi C., Rossi F., Pacileo I., Donvito L., Garofalo V., Ravaldi C., Vannacci A., et al. Birth Outcomes in Women Exposed to Diagnostic Radiology Procedures during First Trimester of Pregnancy: A Prospective Cohort Study. Clin. Toxicol. 2022;60:175–183. doi: 10.1080/15563650.2021.1919693. [DOI] [PubMed] [Google Scholar]
- 28.Crescioli G., Boscia E., Bettiol A., Pagani S., Spada G., Vighi G.V., Bonaiuti R., Venegoni M., Vighi G.D., Vannacci A., et al. Risk of Hospitalization for Adverse Drug Events in Women and Men: A Post Hoc Analysis of an Active Pharmacovigilance Study in Italian Emergency Departments. Pharmaceuticals. 2021;14:678. doi: 10.3390/ph14070678. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gibson T.B., Nguyen M.D., Burrell T., Yoon F., Wong J., Dharmarajan S., Ouellet-Hellstrom R., Hua W., Ma Y., Baro E., et al. Electronic Phenotyping of Health Outcomes of Interest Using a Linked Claims-Electronic Health Record Database: Findings from a Machine Learning Pilot Project. J. Am. Med. Inform. Assoc. 2021;28:1507–1517. doi: 10.1093/jamia/ocab036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Gentry S.V., Gauthier A., Ehrstrom B.L.E., Wortley D., Lilienthal A., Car L.T., Dauwels-Okutsu S., Nikolaou C.K., Zary N., Campbell J., et al. Serious Gaming and Gamification Education in Health Professions: Systematic Review. J. Med. Internet Res. 2019;21:e12994. doi: 10.2196/12994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Patel M.S., Small D.S., Harrison J.D., Hilbert V., Fortunato M.P., Oon A.L., Rareshide C.A.L., Volpp K.G. Effect of Behaviorally Designed Gamification with Social Incentives on Lifestyle Modification among Adults with Uncontrolled Diabetes: A Randomized Clinical Trial. JAMA Netw. Open. 2021;4:e2110255. doi: 10.1001/jamanetworkopen.2021.10255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Maurin K.D., Girod C., Consolini J.L., Belzeaux R., Etain B., Cochet B., Leboyer M., Genty C., Gamon L., Picot M.C., et al. Use of a Serious Game to Strengthen Medication Adherence in Euthymic Patients with Bipolar Disorder Following a Psychoeducational Programme: A Randomized Controlled Trial. J. Affect. Disord. 2020;262:182–188. doi: 10.1016/j.jad.2019.10.008. [DOI] [PubMed] [Google Scholar]
- 33.Crisafulli S., Santoro E., Recchia G., Trifirò G. Digital Therapeutics in Perspective: From Regulatory Challenges to Post-Marketing Surveillance. Front. Drug Saf. Regul. 2022;2:5. doi: 10.3389/fdsfr.2022.900946. [DOI] [Google Scholar]