Abstract
The rapid advancement of artificial intelligence (AI) technologies, particularly machine learning, has brought substantial progress to the field of nephrology, enabling significant improvements in the management of kidney diseases. ChatGPT, a revolutionary language model developed by OpenAI, is a versatile AI model designed to engage in meaningful and informative conversations. Its applications in healthcare have been notable, with demonstrated proficiency in various medical knowledge assessments. However, ChatGPT’s performance varies across different medical subfields, posing challenges in nephrology-related queries. At present, comprehensive reviews regarding ChatGPT’s potential applications in nephrology remain lacking despite the surge of interest in its role in various domains. This article seeks to fill this gap by presenting an overview of the integration of ChatGPT in nephrology. It discusses the potential benefits of ChatGPT in nephrology, encompassing dataset management, diagnostics, treatment planning, and patient communication and education, as well as medical research and education. It also explores ethical and legal concerns regarding the utilization of AI in medical practice. The continuous development of AI models like ChatGPT holds promise for the healthcare realm but also underscores the necessity of thorough evaluation and validation before implementing AI in real-world medical scenarios. This review serves as a valuable resource for nephrologists and healthcare professionals interested in fully utilizing the potential of AI in innovating personalized nephrology care.
Keywords: artificial intelligence, chatbot, ChatGPT, nephrology, kidney disease, application
1. Introduction
Advancements in artificial intelligence (AI) technologies have notably influenced the landscape of various fields, including finance, transportation, and healthcare [1], leading to remarkable improvements in efficiency and productivity. AI is characterized by its capability to handle diverse tasks that traditionally need human intelligence. As AI applications become more integrated across different fields, the technology has grown to include major subsets like machine learning and deep learning. In medical research, machine learning has become particularly valuable for its ability to analyze and draw meaningful conclusions from the extensive data generated in healthcare. Specifically, in nephrology, a medical specialty focused on kidney diseases, machine learning has proven effective in classifying different patient subgroups across various kidney conditions, such as acute kidney injury (AKI), chronic kidney disease (CKD), end-stage kidney disease (ESKD), and kidney transplants [2,3,4,5]. Additionally, since 2018, there has been a surge in the utilization of machine learning-powered medical devices in healthcare. A thorough study revealed that a significant majority (77%) of these FDA-approved devices are predominantly used in radiology, with cardiovascular applications coming in second at 10% [6]. The most commonly approved types of these devices are radiological image processing and computer-assisted triage and notification systems [6]. However, it is noteworthy that in nephrology, the use of FDA-approved AI-enhanced medical devices is still an unexplored area.
ChatGPT, a significant language model introduced by OpenAI on 30 November 2022, is noted for generating human-like responses in a conversational style to user input [7,8]. Currently, ChatGPT has two primary versions: the broadly available GPT-3.5 and the more sophisticated, subscription-based GPT-4 [9]. ChatGPT exhibits its potential in various healthcare areas, including medical practices, research, and education [10,11]. Particularly notable is its remarkable proficiency in medical knowledge, which has been demonstrated to approach or even exceed the passing threshold (approximately 60%) for the United States Medical Licensing Examination (USMLE) [12,13]. In another study, ChatGPT nearly passed a radiology board-style examination with an accuracy of 69% [14]. In a third study, ChatGPT achieved an accuracy of approximately 80% in answering the questions from the competency-based medical education curriculum of microbiology [15]. However, it is important to consider the outcomes of an observational study that utilized the General Practitioners Applied Knowledge Test (GPAKT). The study revealed that ChatGPT’s overall performance was 60%, falling below the average passing threshold of 70% [16].
In our initial investigation, we observed that GPT-3.5’s performance was very limited when it came to responding to 150 questions related to glomerular disease from the Nephrology Self-Assessment Program (NephSAP) and Kidney Self-Assessment Program (KSAP). On the first and second runs, GPT-3.5 achieved an overall accuracy of only 44% and 41%, respectively. These results fell significantly below the required passing threshold of 75% set by the American Society of Nephrology (ASN) for nephrologists [17]. Subsequently, we conducted a comprehensive assessment using a larger set of 975 nephrology test questions, consisting of 508 questions from NephSAP and 467 from KSAP (Figure 1) [18]. GPT-3.5 obtained a total accuracy rate of 51% and a total concordance rate of 78%. Although GPT-4 showed improvement with a total accuracy rate of 74% and a total concordance rate of 83%, it still fell short of both the passing threshold and the average score of 77% achieved by nephrology examinees [18].
This comprehensive assessment also highlighted that ChatGPT’s performance varied notably across different subfields (Figure 2). As we observed, accuracy rates were relatively lower in areas such as electrolyte and acid–base disorders, glomerular diseases, and renal-related bone and stone disorders [18]. These subjects were more likely to require higher-level cognitive engagement, which ChatGPT is documented to be weaker at performing. For instance, clinical questions related to electrolyte and acid–base disorders require more complex calculations. This was also evident in glomerular diseases, where questions often require a detailed understanding of kidney pathology, physiology, and various treatment options, spanning a broad range of topics including immunology, genetics, and pharmacology. These results indicate that the AI model struggles more with tasks requiring in-depth understanding, analytical skills, and precise calculations.
There has been a surge of interest in examining and discussing the potential practical uses of ChatGPT in various domains, which has mostly focused on its impact on medical education, scientific research, medical writing, ethical considerations, diagnostic or treatment decision making, automated data analysis, and criticisms [10,19,20,21,22,23,24], with over 1000 papers in PubMed dedicated to this subject. Yet, as far as our understanding goes, there is still a noticeable lack of a review consolidating the potential applications of ChatGPT, specifically within the field of nephrology, aiming to innovate personalized nephrology care.
2. Potential Applications of ChatGPT in Nephrology
In nephrology, mastering the core principles and having access to appropriate datasets are vital elements for optimizing personalized patient outcomes and facilitating substantial research contributions. The following discussion will focus on the practical implications of integrating ChatGPT into nephrological clinical settings, as shown in (Figure 3). It is important to note that the GPT Builder represents a key feature of ChatGPT models [25]. One of the most significant advantages of the GPT Builder is its user-friendly interface, which does not require extensive programming knowledge. This accessibility means that nephrologists, researchers, and healthcare providers can directly involve themselves in the development and adaptation of AI models to suit their specific clinical and research requirements. The GPT Builder not only simplifies the creation and configuration of GPT models but also ensures that these models are more aligned with the specific needs of nephrology, thereby maximizing their effectiveness and utility in both clinical and research settings.
2.1. Integration of ChatGPT with Nephrology Datasets
2.1.1. Current Datasets in Nephrology
Electronic health records (EHRs) have revolutionized healthcare by providing a comprehensive digital repository of patient information [26]. In nephrology, EHRs capture clinical data related to kidney health, including laboratory results, imaging studies, medication history, and progress notes. EHRs offer several advantages, such as real-time availability of patient data, facilitating clinical decision making, and supporting research endeavors. By harnessing the wealth of information stored within EHRs, researchers and clinicians can conduct retrospective analyses, identify patterns, and generate evidence-based guidelines for optimal management of kidney diseases.
Besides EHRs, several datasets specifically curated for nephrology research also provide valuable information on patient characteristics, disease profiles, treatment modalities, and outcomes [27]. Examples of widely used nephrology datasets (Figure 4) include the United States Renal Data System (USRDS), the United Network for Organ Sharing (UNOS), the Organ Procurement and Transplantation Network (OPTN), and the Nephrotic Syndrome Study Network (NEPTUNE). In addition to these databases in the United States, other countries worldwide also have big datasets within nephrology for researchers, such as the European Renal Association-European Dialysis and Transplant Association (ERA-EDTA) Registry, the National Kidney Disease Surveillance Program in Ireland, the surveillance project on CKD management in Canada, and the China Kidney Disease Network (CK-NET). These datasets offer valuable insights into diverse aspects of kidney disease, such as CKD progression, dialysis outcomes, and kidney transplantation.
2.1.2. Implications for ChatGPT Integration
While nephrology data sources offer immense potential, they are not without challenges and limitations. First and foremost is how to manage, handle, and process such a great amount of data that increased rapidly over time. Data quality and completeness can also be a significant concern. Inaccurate or missing data elements may limit the validity and generalizability of research findings. Furthermore, data interoperability and standardization issues across different healthcare systems can pose challenges in data integration and analysis.
Machine learning and other AI techniques possess the ability to handle intricate datasets and vast numbers of variables, surpassing the capabilities of classical statistical methods [28]. By leveraging AI tools like ChatGPT, the management of databases becomes significantly more feasible [29]. ChatGPT can be specifically fine-tuned to operate with a particular dataset and generate commands capable of executing various operations on that database. When incorporating ChatGPT or any other AI tool into nephrology data, it is essential to acknowledge and tackle potential biases and limitations associated with the model. Language models heavily rely on their training data, which can introduce inherent biases.
However, when applied appropriately, using ChatGPT for database management offers several advantages. Firstly, it saves valuable time and effort by automatically generating complex queries and commands, eliminating the need for manual and error-prone writing. Additionally, the fine-tuned model can be seamlessly integrated into larger applications, such as chatbots, enabling users to interact with the database using natural language. To ensure the accuracy and reliability of results, it is crucial to thoroughly evaluate and validate ChatGPT-generated outputs against expert knowledge and diverse patient populations. This evaluation helps mitigate potential biases. By addressing these challenges and leveraging available data effectively, researchers and healthcare professionals can lead to significant advancements in nephrology practice.
2.2. Applying ChatGPT in Nephrology Diagnostics
Accurate diagnosis is crucial for effective treatment and patient well-being. Human error can impede precise diagnostics due to the complexity and cognitive challenges of interpreting medical information. The advent of AI and natural language processing (NLP) technologies offers promising opportunities to revolutionize diagnostics [30].
2.2.1. Integration of CDSS with ChatGPT in Nephrology
Clinical decision support systems (CDSSs) are computer-based tools designed to assist healthcare professionals in making clinical decisions and providing patient care [31,32]. These systems utilize patient-specific data, medical knowledge, and algorithms to provide recommendations, alerts, and reminders at the point of care. Although CDSSs offer numerous advantages, they also come with some drawbacks [31]. For instance, CDSSs can disrupt clinician workflows, especially in the case of stand-alone systems. Excessive and inappropriate alerts can burden clinicians with additional verification tasks and result in alert fatigue. Limited technological proficiency can hinder the effective utilization of CDSSs. A study indicated that ChatGPT-generated suggestions have the potential to serve as a valuable complement in the optimization of CDSS alerts [22,33]. They could play a significant role in assisting experts in developing their own suggestions for enhancing CDSS effectiveness.
Additionally, many CDSSs lack transportability and interoperability, limiting their seamless integration into existing systems. While ChatGPT has limited ability to directly execute specific algorithms, it plays a valuable role in facilitating algorithm design for intelligent CDSS at the textual level [34]. One key aspect of integrating ChatGPT with CDSS is the seamless integration of the language model into the existing CDSS infrastructure. To optimize integration, ChatGPT should undergo fine-tuning specifically for nephrology-related tasks and queries. Real-time data integration from EHRs is also essential in the CDSS-ChatGPT system. By accessing up-to-date patient information such as laboratory results, medication history, and clinical notes, ChatGPT can generate more precise recommendations and assist clinicians in making informed decisions. Moreover, the integration can enhance clinical education and knowledge sharing by providing access to relevant literature, clinical guidelines, and case studies.
2.2.2. Development of ChatGPT Diagnostic Model for Kidney Disease
Building a ChatGPT diagnostic model specifically for kidney disease classification involves several crucial steps and considerations. Nephrology experts and data scientists need to collaborate to gather and curate diverse data from various sources like EHRs. These data include a wide range of kidney diseases, their associated symptoms, and relevant diagnostic criteria, as well as individual patient information (e.g., demographics, medical histories, laboratory results, imaging findings, and diagnostic outcomes). The dataset can be used to train ChatGPT to learn the relationships between input features and the corresponding kidney disease classifications, thus recognizing patterns and making accurate predictions. During the training process, the model’s performance is evaluated and adjusted by partitioning the dataset into training and validation subsets and further enhanced through techniques like transfer learning and fine-tuning. This ChatGPT diagnostic tool has the potential to assist healthcare providers in accurately identifying and classifying various kidney diseases, contributing to timely and effective treatment decisions [35].
2.2.3. Assessing Performance of ChatGPT in Nephrology Diagnostics
Evaluating the performance, including the accuracy and repeatability, of ChatGPT in nephrology diagnostics is crucial for assessing its reliability for clinical use. During an assessment involving a typical clinical scenario of acute organophosphate poisoning, ChatGPT-3 demonstrated commendable performance in addressing all inquiries, including making a diagnosis [36]. In a research study, the diagnostic accuracy of ChatGPT-3 was evaluated for ten common clinical cases with typical symptoms. The study showed that ChatGPT generated differential diagnosis lists with a high accuracy of 93%, although this accuracy rate was slightly lower compared to the physicians’ rate of 98% [37]. In another examination focused on evaluating the diagnostic capabilities of ChatGPT-3.5 in relation to kidney disease, the system exhibited an impressive accuracy rate of 91%, outperforming human physicians in both accuracy and speed [38]. ChatGPT, particularly GPT-4, showed the potential to provide faster responses to routine clinical laboratory questions. The study reported a correct rate of 76% (completely correct 51% and partially correct 23%), but the correct answers were most frequently seen in questions related to basic medical or technical knowledge [39].
Several important considerations should be taken into account during these evaluations to ensure robust and valid results. Firstly, a benchmark must be established for comparison. This can be achieved by using existing diagnostic methods or expert opinions as a reference standard. By comparing ChatGPT’s diagnostic performance against established standards, we can evaluate its accuracy, sensitivity, specificity, and overall diagnostic usefulness. To ensure generalizability and minimize bias, a comprehensive evaluation should involve a diverse range of patient cases covering various nephrological conditions and different patient demographics. Secondly, to quantitatively evaluate and compare the diagnostic accuracy of ChatGPT, it is recommended to employ performance metrics such as precision, recall, F1 score (combination of the precision and recall scores), and receiver operating characteristic (ROC) curves. These metrics offer objective measures of the model’s performance, enabling a comprehensive assessment of its strengths and limitations [40,41]. Prospective studies can be conducted to compare the diagnostic accuracy and treatment decisions made with and without the assistance of ChatGPT.
2.3. Applying ChatGPT in Treatment Planning
2.3.1. ChatGPT-Powered Treatment Recommendations and Personalized Care
A significant benefit of incorporating ChatGPT into treatment strategies lies in its capacity for crafting individualized medical guidance [42,43,44]. Research shows that ChatGPT-4 has demonstrated proficiency in pinpointing medications adhering to established guidelines for treating advanced solid tumors [45]. By processing diverse patient data, including medical histories, lab test results, and coexisting health issues, ChatGPT can formulate personalized treatment options. These may involve specific drug dosages, recommended dietary changes, alterations in daily habits, and tailored monitoring protocols [46]. Right now, there exist two main types of leading chatbot models. One type revolves around OpenAI’s versions like ChatGPT-3.5, ChatGPT-4, and Bing Chat. Microsoft introduced Bing Chat in February 2023 as part of its search engine, utilizing OpenAI’s GPT-4 model for conversational AI features [47]. The other notable model is Bard AI from Google, which is based on the Pathways Language Model 2 (PaLM2), a transformer language model [48]. In a recent study evaluating the capability of ChatGPT-3.5, ChatGPT-4, Bard AI, and Bing Chat in discerning potassium and phosphorus content in foods for CKD patients, distinct levels of accuracy were observed (Figure 5). Using 240 food items from the Mayo Clinic Renal Diet Handbook, each model categorized foods as high or low in potassium and phosphorus, and their results were compared to the handbook’s guidelines. ChatGPT-4 led in potassium identification with 81% accuracy, excelling notably over ChatGPT-3.5, which had a 66% accuracy rate. In phosphorus identification, Bard AI achieved perfect accuracy, while ChatGPT-4 lagged with 77%. These findings highlight the burgeoning role of AI in facilitating renal dietary planning, though improvements are needed for maximum effectiveness.
2.3.2. ChatGPT-Powered Decision Support for Medication Management
Medication management is a critical aspect of nephrology care, considering the complexity of drug regimens and the potential for medication-related complications. By integrating with EHRs and leveraging its vast knowledge base, ChatGPT can assist in drug–drug interaction checks, dosage adjustments based on renal function, and adherence monitoring. Furthermore, ChatGPT can facilitate communication between healthcare professionals and patients regarding medication-related queries, side effects, and treatment goals. The utilization of ChatGPT in a case report regarding a delayed diagnosis for a 27-year-old woman who reported chest pain and shortness of breath to the emergency department suggests its potential for clinical decision making, including improved diagnostic accuracy and addressing human factors contributing to medical errors [49]. Another study was conducted to see how well ChatGPT can answer medical questions [50]. The authors tested it with a case of a 22-year-old man who has a condition called treatment-resistant schizophrenia (TRS) and compared ChatGPT’s recommendations for assessment and treatment with the current standards used by doctors. The results showed that ChatGPT correctly identified the patient’s condition as TRS. It also suggested a thorough examination to find out the possible medical and psychiatric causes of the symptoms. Additionally, ChatGPT provided a comprehensive treatment plan, including medication and non-medication options, which matched the usual care provided by healthcare professionals for TRS.
2.4. Integrating Patient Education and Counseling with ChatGPT
Patient education and counseling are critical components of healthcare, aimed at empowering patients to actively participate in their treatment and manage their condition effectively. ChatGPT can serve as a valuable tool for integrating patient education and counseling into the nephrological treatment planning process [51], such as enhancing kidney transplant care [52].
Firstly, ChatGPT can provide accessible and personalized educational materials to patients. With its vast knowledge base, ChatGPT can offer comprehensive information on kidney diseases, treatment options, lifestyle modifications, and self-care practices [53]. Patients can engage in interactive conversations with ChatGPT, asking questions and seeking clarification on complex medical concepts. By delivering information in a conversational and user-friendly manner, ChatGPT can enhance patient comprehension and engagement with educational content. A study indicated that ChatGPT answered all queries well and offered good explanations of the underlying reasons regarding a typical clinical toxicology case of acute organophosphate poisoning retrieved from an online presentation [36]. The accuracy and reproducibility of ChatGPT were also examined in answering questions regarding knowledge, management, and emotional support for cirrhosis and hepatocellular carcinoma. While approximately 75% of the questions were answered with reliable information, the information regarding treatment recommendations such as decision-making cut-offs and treatment durations did not always align with the United States guidelines [54,55].
Secondly, ChatGPT can support counseling sessions by providing empathetic and supportive interactions. Patients living with kidney disease often face emotional and psychosocial challenges, including anxiety, depression, and uncertainty about the future. ChatGPT can act as a virtual companion, offering emotional support and guidance during counseling sessions. Patients can express their concerns, fears, and frustrations to ChatGPT, which can respond with empathy, validation, and practical advice. By facilitating open and non-judgmental conversations, ChatGPT can help patients navigate their emotional well-being and improve their overall quality of life. A cross-sectional study showed that ChatGPT generated quality and empathetic responses to patient questions posed in an online forum [56]. Moreover, ChatGPT can also help patients set realistic goals, develop personalized action plans, and track their progress. By providing reminders, motivational messages, and accountability, ChatGPT can support patients in making sustainable lifestyle changes and adhering to their prescribed treatment regimens [46]. The interactive nature of ChatGPT allows for ongoing communication, enabling patients to seek guidance and discuss challenges they encounter in their self-management journey.
2.5. Streamlining Diagnosis, Treatment Coding, and Billing with ChatGPT
ChatGPT presents the opportunity to enhance productivity and reduce expenses, thereby streamlining overall operations in healthcare services [57]. Proper coding and billing are essential for documenting diagnoses, procedures, and services provided to patients accurately. They enable healthcare providers to communicate essential information to payers, government agencies, and other stakeholders involved in reimbursement processes. Moreover, accurate coding and billing contribute to transparent and ethical financial practices in healthcare settings.
2.5.1. Enhancing ICD-10 Diagnosis Coding with ChatGPT
ICD-10 coding is a complex process that requires adherence to specific guidelines and conventions for accurate diagnosis coding. The extensive range of kidney diseases, their variations, and associated comorbidities pose challenges in selecting the appropriate diagnosis codes. A study was conducted to develop an automated ICD-10 coding system using a deep neural network based on supervised learning. The researchers’ model demonstrated a notable improvement in the F1 score; however, it did not result in a reduction in the time required for disease coders to perform coding tasks [58]. ChatGPT’s NLP capabilities enable it to analyze patient information, laboratory results, imaging reports, and clinical notes in real-time, and provide immediate suggestions for diagnosis codes. Through continuous feedback and suggestions, ChatGPT can enhance coding accuracy, reduce the need for retrospective code correction, and minimize the potential for claim denials or payment delays. ChatGPT’s real-time coding assistance can also save time for healthcare providers, allowing them to focus more on patient care and reducing the administrative burden associated with coding tasks [59].
2.5.2. Enhancing Treatment Coding with ChatGPT
Current procedural terminology (CPT) codes provide a standardized system for identifying and reporting medical procedures and services. Nephrologists encounter various procedures in their practice, such as dialysis, kidney transplantation, vascular access placement, and kidney biopsies. Each procedure has a specific CPT code associated with it, reflecting the nature and complexity of the intervention. ChatGPT can provide coding support for these procedures by offering guidance on the appropriate CPT codes, documentation requirements, and coding modifiers that may be necessary [10]. For example, in the case of dialysis, ChatGPT can assist nephrologists in selecting the correct CPT codes for various dialysis modalities (e.g., hemodialysis, peritoneal dialysis, etc.) and associated services (e.g., vascular access management, dialysis catheter insertion, etc.). Similarly, in kidney transplantation, ChatGPT can aid in coding the transplant procedure, immunosuppressive therapy, and post-transplant follow-up care. Moreover, ChatGPT can offer real-time coding suggestions, ensuring that the appropriate CPT codes are assigned for the procedures performed. This can reduce the potential for coding errors and minimize the need for retrospective code corrections.
2.5.3. Improving Billing Efficiency with ChatGPT
ChatGPT can analyze the clinical data within the EHR and assist in generating accurate billing codes, such as diagnosis-related group (DRG) codes, CPT codes, and evaluation and management (E/M) codes. This integration eliminates the need for manual code selection and reduces the potential for coding errors, leading to improved billing accuracy and efficiency [60]. In addition, this integration can offer the potential for enhanced communication between healthcare providers and insurance companies [60]. Through the generation of precise and standardized codes, the AI model enables smoother information exchange, leading to expedited claim processing and reimbursements. Furthermore, the integration of ChatGPT into billing processes can maximize revenue cycle efficiency by automating repetitive billing tasks, such as code generation, charge capture, and claims submission and identifying potential coding and billing discrepancies. This not only saves time but also reduces the risk of errors and improves overall billing accuracy [60]. Consequently, this can alleviate the administrative workload on healthcare providers, enabling them to dedicate more attention to patient care.
Utilizing ChatGPT and similar AI tools built on extensive large language models (LLMs) provides remarkable assistance in programming tasks, although their application necessitates careful consideration [61]. It is crucial to assess the influence of ChatGPT on coding accuracy, billing efficiency, and reimbursement to effectively determine its effectiveness in the field of nephrology practice.
2.6. Enhancing Effective Communication with ChatGPT
Effective communication is a cornerstone of quality healthcare delivery. Written communication plays a crucial role in conveying important information, facilitating collaboration, and advocating for patients. By utilizing ChatGPT, the field of medical writing has the potential to undergo a revolutionary transformation [62]. A systematic review indicated that the benefits of ChatGPT were most frequently cited in the context of academic and/or scientific writing, such as efficiency and versatility in writing with text of high quality, improved language, and good readability [10].
2.6.1. Significance of Written Communication in Nephrology
Written communication serves as a vital means of transmitting crucial information in nephrology practice [63]. It enables nephrologists to deliver comprehensive and well-organized messages, ensuring clarity and minimizing misinterpretation [64]. Letters are particularly valuable in conveying complex medical information to patients, referring providers, and payers, promoting understanding, collaboration, and continuity of care. Well-documented letters serve as a permanent record of patient assessments, treatment plans, and progress updates. These records not only support clinical decision making but also provide a legal and professional framework for healthcare providers to justify their actions and decisions.
2.6.2. Utilizing ChatGPT for Crafting Patient Correspondence
When writing letters to patients, it is crucial to use language that is easily understandable and free of medical jargon. In the United States, it is recommended that patient-facing health literature be written at or below a sixth-grade level [65]. In addition, patient letters should provide educational resources (i.e., websites, brochures, or educational videos) to empower patients in self-management and address common questions and concerns that patients may have regarding their condition or treatment. ChatGPT can help craft patient-friendly letters to explain the diagnosis, treatment plans, and lifestyle recommendations using plain language and visual aids whenever possible. A pilot study showed that it is possible to generate clinic letters with a high overall correctness and humanness score with ChatGPT in a series of different clinical communication scenarios that covered the remit of a clinician’s skin cancer practice. Furthermore, these letters were written at a reading level that is broadly similar to current real-world human-generated letters [66,67].
2.6.3. Leveraging ChatGPT for Communicating with Referring Providers
When communicating with referring providers, referral letters play a vital role in ensuring a seamless transition of care. Referral letters should provide a concise summary of the patient’s medical history, current condition, and the reason for referral and include relevant test results, imaging findings, and any specific questions or concerns that require attention.
In the context of referring letters, integrating ChatGPT can offer several benefits in updating referring providers on patient progress and recommendations. Firstly, ChatGPT can be utilized to automatically generate concise summaries of patient progress, extracting key information from EHRs and clinical notes. Secondly, ChatGPT can seamlessly integrate with CDSS to provide evidence-based treatment suggestions and recommendations. This integration ensures that referring providers receive accurate and up-to-date information regarding the patient’s progress. The suggestions can be included in the follow-up and consultation letters, ensuring that referring providers are informed about the most appropriate management strategies based on the latest medical knowledge. Thirdly, ChatGPT can assist in enhancing the language and clarity of the follow-up and consultation letters. By refining the language, ChatGPT can help nephrologists convey complex medical information in a more understandable and concise manner, facilitating better communication and comprehension for referring providers. In addition, ChatGPT can provide real-time assistance and feedback to nephrologists as they draft follow-up and consultation letters. By analyzing the content being written, ChatGPT can suggest additional details to include, prompt for clarification, or identify potential gaps in information. This interactive feedback helps nephrologists ensure that the letters are comprehensive and accurate before finalizing and sending them to referring providers. Furthermore, ChatGPT can support the implementation of shared decision making between nephrologists and referring providers. It can provide educational resources and relevant literature to facilitate discussions about treatment options, potential risks and benefits, and patient preferences. Ultimately, ChatGPT promotes a patient-centered approach and strengthens the therapeutic alliance between nephrologists and referring providers.
2.6.4. Utilizing ChatGPT for Medication Approval Appeals
Medication approval appeals are essential when patients require specific medications that may not be initially approved by insurance providers or healthcare organizations. Writing medication approval appeal letters is a critical aspect of nephrology practice, as it involves advocating for patients’ therapeutic needs and ensuring that patients receive timely access to the medications required for managing their kidney disease and related conditions.
ChatGPT can provide valuable assistance in writing medication approval appeal letters. It can offer healthcare providers access to a vast array of medical literature, research articles, and clinical guidelines, enabling them to incorporate the most up-to-date and relevant information into their appeals. Additionally, ChatGPT can help refine the language, suggest alternative phrases, and ensure that the appeal letter adheres to the conventions of academic writing. By leveraging ChatGPT’s capabilities, healthcare providers can enhance the persuasiveness and effectiveness of their medication approval appeals, ultimately advocating for patients’ therapeutic needs.
2.7. Enhancing Nephrology Research with ChatGPT
2.7.1. Leveraging ChatGPT for Data Analysis
ChatGPT, as a powerful language model, can be used to gather data from large numbers of patients and extract valuable insights from unstructured textual data sources such as EHRs, clinical trial reports, and the scientific literature, streamlining the process of data collection and analysis [19,68]. This can be particularly useful in longitudinal studies, where ChatGPT can be used to track patient outcomes over time. One specific application of ChatGPT in nephrology research is the analysis of EHRs. By training ChatGPT on large-scale EHR datasets, researchers can develop models that can extract and analyze specific data elements relevant to nephrology, such as kidney function indicators, disease progression markers, and treatment outcomes. This enables researchers to gain deeper insights into the factors influencing kidney diseases, develop predictive models, and identify potential interventions for improved patient outcomes.
In addition, ChatGPT can generate commands and syntax for various statistical software packages, enabling researchers, even those with limited programming experience, to explore and analyze their data efficiently.
2.7.2. Enhancing Articles Writing with ChatGPT
ChatGPT excels in accelerating the writing process, generating outlines, incorporating additional details, and enhancing the overall writing style [69,70,71,72,73,74,75]. The assistance of ChatGPT can be instrumental in identifying discussion points and clarifying language for the readers of medical literature reports [76,77]. However, it is important to acknowledge its limitations. As a precautionary measure, it is crucial to carefully review and edit the generated text to ensure that it adheres to ethical standards, avoiding issues like plagiarism and fabrication.
2.7.3. Assisting Nephrology Literature Analysis with ChatGPT
The vast amount of publications makes it challenging for researchers to keep up with the latest findings and integrate the existing knowledge effectively. Traditional literature review methods are time consuming and prone to human error. ChatGPT can aid in literature mining and analysis by automatically extracting relevant information from scientific articles, summarizing key findings and evidence, and identifying potential biases of relevant studies and relationships between different concepts. By leveraging ChatGPT’s capabilities, researchers can streamline the literature review process, identify knowledge gaps, and accelerate the discovery of new insights [78]. Its ability to handle large volumes of data and extract meaningful insights makes it a valuable tool for conducting rigorous systematic reviews and meta-analyses.
We conducted an initial evaluation of ChatGPT’s performance in recognizing references related to literature reviews in the field of nephrology [79]. Our results showed that out of a total of 610 references, only 62% were accurately sourced by ChatGPT, while 31% were fabricated references, and 7% were incomplete citations (Figure 6).
Furthermore, approximately 70% of the provided links and half of the Digital Object Identifiers (DOIs) were found to be inaccurate (Figure 7). Notably, when we examined specific topics such as electrolyte balance, hemodialysis, and kidney stones, we found that over 60% of the references were either incorrect or misleading, often containing unreliable authorship and links.
Moreover, we recently evaluated the citation accuracy of AI tools, specifically ChatGPT, Bing Chat, and Bard AI, in the field of nephrology [80]. The evaluation involved generating prompts for each tool to provide 20 references in Vancouver style across 12 topics, followed by validation through PubMed, Google Scholar, and Web of Science. The findings reveal that Bard AI was the least accurate, providing only 3% accurate references along with a high percentage of fabricated (63%) and incomplete (11%) citations (Figure 8). Bing Chat performed marginally better but was still inadequate, with 30% accurate, 49% inaccurate, 13% fabricated, and 8% incomplete references. The most frequent error across platforms was incorrect DOIs.
In light of our findings, it is advisable not to solely rely on ChatGPT for identifying references to literature reviews in the nephrology field at this time. Therefore, as with any automated tool, evaluating the reliability and accuracy of ChatGPT for literature review is of utmost importance. Researchers and developers need to assess its performance against established benchmarks and human reviewers. This involves conducting comparative studies to evaluate its ability to identify relevant articles, extract key information accurately, and provide reliable summaries. Additionally, assessing the robustness of ChatGPT in handling different study designs, languages, and data sources is crucial for determining its generalizability and applicability in the field of nephrology.
2.8. Enhancing Nephrology Education with ChatGPT
The successful completion of examinations like the USMLE by ChatGPT brings attention to certain shortcomings within medical education, particularly its heavy reliance on memorization rather than the analysis of intricate health and disease models. This accomplishment serves as a crucial reminder to re-evaluate the methods used to train and evaluate our medical students [81]. It is important to acknowledge that ChatGPT lacks the nuanced reasoning abilities possessed by humans. Consequently, it is imperative to recognize that AI can never replace the invaluable role played by nurses, doctors, and other healthcare professionals on the frontlines. However, there is no denying that AI and LLMs will revolutionize all aspects of our work, spanning from research and writing to medical diagnosis, treatment, and education across various fields [81,82,83,84].
2.8.1. ChatGPT as an Educational Tool: Facilitating Learning and Knowledge Dissemination
With its ability to generate human-like responses and engage in interactive conversations, ChatGPT can simulate real-time interactions between students and virtual tutors or instructors. This enables learners to ask questions, seek explanations, and receive instant feedback, thereby enhancing their understanding of complex nephrological concepts. Moreover, ChatGPT can adapt its responses based on the learner’s level of knowledge, providing personalized and tailored explanations to address individual learning needs.
Traditional educational materials, such as textbooks and lectures, may have limitations in terms of availability and accessibility. However, ChatGPT can be deployed as a web-based or mobile application, allowing learners to access educational content anytime and anywhere. Learners can engage in interactive discussions, explore case studies, and receive guidance on nephrology topics, ultimately fostering a self-directed and flexible learning experience. Furthermore, ChatGPT can also assist in knowledge dissemination within the nephrology community. It can be used to develop virtual educational platforms where nephrology experts can share their expertise, engage in discussions, and disseminate the latest research findings. By leveraging ChatGPT’s natural language generation capabilities, educational content such as question banks, tutorials, case studies, and guidelines can be generated and shared with a wider audience [85]. This not only promotes collaboration and knowledge exchange among healthcare professionals but also ensures that the most up-to-date information is readily available to support evidence-based practice.
2.8.2. Integration of ChatGPT into Continuing Medical Education (CME) Programs
By incorporating ChatGPT into CME platforms, clinicians can access up-to-date research findings, summaries, and interactive discussions on relevant nephrology topics. This integration allows for personalized and on-demand learning experiences, enabling clinicians to stay informed about the latest advancements in the field. Moreover, ChatGPT can serve as a virtual assistant during CME activities, answering questions, providing clarification, and facilitating case-based discussions. The ability of ChatGPT to optimize and summarize the medical conference panel recommendations was assessed in the first Pan-Arab Pediatric Palliative Critical Care Hybrid Conference [86]. The results suggest that ChatGPT-4 effectively facilitated complex do-not-resuscitate (DNR) conflict resolution by summarizing key themes such as effective communication, collaboration, patient- and family-centered care, trust, and ethical considerations and demonstrated its potential benefits for enhancing critical thinking among medical professionals [86].
3. Ethical and Legal Implications of ChatGPT Integration in Nephrology
Adherence to secure data exchange protocols and privacy regulations is crucial for ensuring patient confidentiality during clinical practices [87,88]. It is important to identify and address any potential ethical or regulatory concerns regarding the use of ChatGPT. At present, the norms and protocols governing the clinical implementation of AI are inadequately defined or non-existent [89]. Even so, the integration of ChatGPT in nephrology firstly requires compliance with existing regulatory frameworks and ethical guidelines, such as the Health Insurance Portability and Accountability Act (HIPAA) in the United States. Secondly, obtaining informed consent is imperative to ensuring that patients willingly consent to the utilization of AI-assisted healthcare (i.e., diagnostics or treatment planning) and have the autonomy to decline participation if they choose [90] (Figure 9).
Additionally, integrating ChatGPT in nephrology raises questions about accountability and liability in decision-making processes [91,92]. While ChatGPT can provide valuable insights and recommendations, the ultimate responsibility for patient care lies with healthcare providers. Clear guidelines should be established to outline the roles and responsibilities of healthcare providers when using ChatGPT in clinical practice. It is crucial to define the extent to which healthcare providers rely on ChatGPT recommendations and how they integrate these recommendations with their own clinical expertise and judgment. Mechanisms for tracking and documenting ChatGPT’s contributions to clinical decision making should be established to ensure transparency and accountability.
Moreover, the integration of ChatGPT should aim to enhance, rather than replace, the expertise of nephrologists. Healthcare providers must maintain an active role in interpreting ChatGPT outputs, critically evaluating recommendations, and making informed decisions based on the patient’s unique clinical context. Nephrologists should continuously update their knowledge and skills to effectively utilize ChatGPT as a supportive tool. The ethical integration of ChatGPT requires striking a balance between AI support and human expertise [24,93], ensuring that patients receive the highest quality of care that combines the benefits of AI technology and the human touch.
4. Future Directions and Challenges in Nephrology with ChatGPT
ChatGPT explores the latest developments in NLP, machine learning, and AI algorithms that have the potential to revolutionize nephrology practice in various ways [10,24,94]. In the future, collaboration between nephrologists and AI specialists is essential for optimizing the performance and impact of ChatGPT in nephrology practice, where nephrologists provide domain expertise and clinical insights while AI specialists contribute technical expertise in machine learning and NLP. By working together, these professionals can refine ChatGPT’s algorithms, develop specialized models tailored to nephrology-specific tasks, and integrate feedback mechanisms for continuous improvement. Collaboration also enables the customization of ChatGPT to address the unique challenges and complexities of nephrology, ultimately enhancing its clinical utility and effectiveness to provide personalized patient care. Additionally, we emphasize the importance of developing strong protocols for data collection, storage, and sharing to protect privacy and guarantee the security of data [95,96]. Furthermore, regulatory bodies, such as medical boards and professional associations, should start to establish the guidelines and ensure that ChatGPT applications meet the required standards for safety, accuracy, and reliability.
5. Conclusions
ChatGPT holds immense potential to revolutionize nephrology practice by facilitating clinical decision making, enhancing patient communication, streamlining research, and improving operational efficiency. By embracing a multidisciplinary approach, fostering collaboration between nephrologists and AI specialists, and prioritizing ethical considerations, the future of ChatGPT in nephrology appears promising. Continued research, development, and evaluation will shape the evolution of ChatGPT, leading to its wider adoption and integration into routine nephrology care and ultimately improving patient outcomes and advancing personalized patient care in the field. However, it is essential to acknowledge that with the ongoing evolution of AI, it becomes particularly vital for the upcoming generation of physicians to adeptly navigate these challenges. They must weigh the potential benefits and risks to effectively determine how extensively AI should be integrated into medical practice.
Author Contributions
Conceptualization, J.M. and W.C.; writing—original draft preparation, J.M., C.T., F.Q. and W.C.; writing—review and editing, J.M., C.T., S.S., O.A.G.V., F.Q. and W.C.; supervision J.M., C.T., F.Q. and W.C.; project administration W.C. The mind map showcased in this manuscript was designed using Whimsical. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data used in this study can be obtained upon reasonable request to the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest.
Funding Statement
This research received no external funding.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Moshawrab M., Adda M., Bouzouane A., Ibrahim H., Raad A. Reviewing Federated Machine Learning and Its Use in Diseases Prediction. Sensors. 2023;23:2112. doi: 10.3390/s23042112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Thongprayoon C., Vaitla P., Jadlowiec C.C., Leeaphorn N., Mao S.A., Mao M.A., Pattharanitima P., Bruminhent J., Khoury N.J., Garovic V.D., et al. Use of Machine Learning Consensus Clustering to Identify Distinct Subtypes of Black Kidney Transplant Recipients and Associated Outcomes. JAMA Surg. 2022;157:e221286. doi: 10.1001/jamasurg.2022.1286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Krisanapan P., Tangpanithandee S., Thongprayoon C., Pattharanitima P., Cheungpasitporn W. Revolutionizing Chronic Kidney Disease Management with Machine Learning and Artificial Intelligence. J. Clin. Med. 2023;12:3018. doi: 10.3390/jcm12083018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ravizza S., Huschto T., Adamov A., Bohm L., Busser A., Flother F.F., Hinzmann R., Konig H., McAhren S.M., Robertson D.H., et al. Predicting the early risk of chronic kidney disease in patients with diabetes using real-world data. Nat. Med. 2019;25:57–59. doi: 10.1038/s41591-018-0239-8. [DOI] [PubMed] [Google Scholar]
- 5.Abdel-Fattah M.A., Othman N.A., Goher N. Predicting Chronic Kidney Disease Using Hybrid Machine Learning Based on Apache Spark. Comput. Intell. Neurosci. 2022;2022:9898831. doi: 10.1155/2022/9898831. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Joshi G., Jain A., Araveeti S.R., Adhikari S., Garg H., Bhandari M. FDA approved Artificial Intelligence and Machine Learning (AI/ML)-Enabled Medical Devices: An updated landscape. medRxiv. 2023 doi: 10.1101/2022.12.07.22283216. [DOI] [Google Scholar]
- 7.Models. [(accessed on 3 June 2023)]. Available online: https://platform.openai.com/docs/models.
- 8.Introducing ChatGPT. [(accessed on 18 April 2023)]. Available online: https://openai.com/blog/chatgpt.
- 9.Ecoffet A. GPT-4 Technical Report. arXiv. 2023 doi: 10.48550/arXiv.2303.08774. [DOI] [Google Scholar]
- 10.Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare. 2023;11:887. doi: 10.3390/healthcare11060887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Eysenbach G. The Role of ChatGPT, Generative Language Models, and Artificial Intelligence in Medical Education: A Conversation with ChatGPT and a Call for Papers. JMIR Med. Educ. 2023;9:e46885. doi: 10.2196/46885. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Kung T.H., Cheatham M., Medenilla A., Sillos C., De Leon L., Elepano C., Madriaga M., Aggabao R., Diaz-Candido G., Maningo J., et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS Digit. Health. 2023;2:e0000198. doi: 10.1371/journal.pdig.0000198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Gilson A., Safranek C.W., Huang T., Socrates V., Chi L., Taylor R.A., Chartash D. How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Med. Educ. 2023;9:e45312. doi: 10.2196/45312. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bhayana R., Krishna S., Bleakney R.R. Performance of ChatGPT on a Radiology Board-style Examination: Insights into Current Strengths and Limitations. Radiology. 2023;307:e230582. doi: 10.1148/radiol.230582. [DOI] [PubMed] [Google Scholar]
- 15.Das D., Kumar N., Longjam L.A., Sinha R., Deb Roy A., Mondal H., Gupta P. Assessing the Capability of ChatGPT in Answering First- and Second-Order Knowledge Questions on Microbiology as per Competency-Based Medical Education Curriculum. Cureus. 2023;15:e36034. doi: 10.7759/cureus.36034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Thirunavukarasu A.J., Hassan R., Mahmood S., Sanghera R., Barzangi K., El Mukashfi M., Shah S. Trialling a Large Language Model (ChatGPT) in General Practice with the Applied Knowledge Test: Observational Study Demonstrating Opportunities and Limitations in Primary Care. JMIR Med. Educ. 2023;9:e46599. doi: 10.2196/46599. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Miao J., Thongprayoon C., Cheungpasitporn W. Assessing the Accuracy of ChatGPT on Core Questions in Glomerular Disease. Kidney Int. Rep. 2023;8:1657–1659. doi: 10.1016/j.ekir.2023.05.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Miao J., Thongprayoon C., Garcia Valencia O.A., Krisanapan P., Sheikh M.S., Davis P.W., Mekraksakit P., Gonzalez Suarez M., Craici I.M., Cheungpasitporn W. Performance of ChatGPT on nephrology test questions. Clin. J. Am. Soc. Nephrol. 2023 doi: 10.2215/CJN.0000000000000330. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Lu Y., Wu H., Qi S., Cheng K. Artificial Intelligence in Intensive Care Medicine: Toward a ChatGPT/GPT-4 Way? Ann. Biomed. Eng. 2023;51:1898–1903. doi: 10.1007/s10439-023-03234-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Cheng K., Guo Q., He Y., Lu Y., Gu S., Wu H. Exploring the Potential of GPT-4 in Biomedical Engineering: The Dawn of a New Era. Ann. Biomed. Eng. 2023;51:1645–1653. doi: 10.1007/s10439-023-03221-1. [DOI] [PubMed] [Google Scholar]
- 21.Biswas S.S. Role of Chat GPT in Public Health. Ann. Biomed. Eng. 2023;51:868–869. doi: 10.1007/s10439-023-03172-7. [DOI] [PubMed] [Google Scholar]
- 22.Liu S., Wright A.P., Patterson B.L., Wanderer J.P., Turer R.W., Nelson S.D., McCoy A.B., Sittig D.F., Wright A. Using AI-generated suggestions from ChatGPT to optimize clinical decision support. J. Am. Med Inform. Assoc. 2023;30:1237–1245. doi: 10.1093/jamia/ocad072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Temsah O., Khan S.A., Chaiah Y., Senjab A., Alhasan K., Jamal A., Aljamaan F., Malki K.H., Halwani R., Al-Tawfiq J.A., et al. Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts. Cureus. 2023;15:e37281. doi: 10.7759/cureus.37281. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Lee P., Bubeck S., Petro J. Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine. N. Engl. J. Med. 2023;388:1233–1239. doi: 10.1056/NEJMsr2214184. [DOI] [PubMed] [Google Scholar]
- 25.GPT Builder. [(accessed on 30 November 2023)]. Available online: https://chat.openai.com/gpts/editor.
- 26.Evans R.S. Electronic Health Records: Then, Now, and in the Future. Yearb. Med. Inform. 2016;25((Suppl. S1)):S48–S61. doi: 10.15265/IYS-2016-s006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Thongprayoon C., Kaewput W., Kovvuru K., Hansrivijit P., Kanduri S.R., Bathini T., Chewcharat A., Leeaphorn N., Gonzalez-Suarez M.L., Cheungpasitporn W. Promises of Big Data and Artificial Intelligence in Nephrology and Transplantation. J. Clin. Med. 2020;9:1107. doi: 10.3390/jcm9041107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Xie G., Chen T., Li Y., Chen T., Li X., Liu Z. Artificial Intelligence in Nephrology: How Can Artificial Intelligence Augment Nephrologists’ Intelligence? Kidney Dis. 2020;6:1–6. doi: 10.1159/000504600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Adeojo O. How to Connect ChatGPT to Your Database. [(accessed on 8 June 2023)]. Available online: https://docs.kanaries.net/articles/chatgpt-database.
- 30.Mirbabaie M., Stieglitz S., Frick N.R.J. Artificial intelligence in disease diagnostics: A critical review and classification on the current state of research guiding future direction. Health Technol. 2021;11:693–731. doi: 10.1007/s12553-021-00555-5. [DOI] [Google Scholar]
- 31.Sutton R.T., Pincock D., Baumgart D.C., Sadowski D.C., Fedorak R.N., Kroeker K.I. An overview of clinical decision support systems: Benefits, risks, and strategies for success. NPJ Digit. Med. 2020;3:17. doi: 10.1038/s41746-020-0221-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Kawamoto K., Houlihan C.A., Balas E.A., Lobach D.F. Improving clinical practice using clinical decision support systems: A systematic review of trials to identify features critical to success. BMJ. 2005;330:765. doi: 10.1136/bmj.38398.500764.8F. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Liu S., Wright A.P., Patterson B.L., Wanderer J.P., Turer R.W., Nelson S.D., McCoy A.B., Sittig D.F., Wright A. Assessing the Value of ChatGPT for Clinical Decision Support Optimization. medRxiv. 2023 doi: 10.1101/2023.02.21.23286254. [DOI] [Google Scholar]
- 34.Liao Z., Wang J., Shi Z., Lu L., Tabata H. Revolutionary Potential of ChatGPT in Constructing Intelligent Clinical Decision Support Systems. Ann. Biomed. Eng. 2023 doi: 10.1007/s10439-023-03288-w. [DOI] [PubMed] [Google Scholar]
- 35.Alhasan K., Raina R., Jamal A., Temsah M.H. Combining human and AI could predict nephrologies future, but should be handled with care. Acta Paediatr. 2023;112:1844–1848. doi: 10.1111/apa.16867. [DOI] [PubMed] [Google Scholar]
- 36.Sabry Abdel-Messih M., Kamel Boulos M.N. ChatGPT in Clinical Toxicology. JMIR Med. Educ. 2023;9:e46876. doi: 10.2196/46876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Hirosawa T., Harada Y., Yokose M., Sakamoto T., Kawamura R., Shimizu T. Diagnostic Accuracy of Differential-Diagnosis Lists Generated by Generative Pretrained Transformer 3 Chatbot for Clinical Vignettes with Common Chief Complaints: A Pilot Study. Int. J. Environ. Res. Public Health. 2023;20:3378. doi: 10.3390/ijerph20043378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Frackiewicz M. ChatGPT for Diagnosis of Kidney Diseases: Advancements and Limitations. [(accessed on 17 April 2023)]. Available online: https://ts2.space/en/chatgpt-for-diagnosis-of-kidney-diseases-advancements-and-limitations/
- 39.Munoz-Zuluaga C., Zhao Z., Wang F., Greenblatt M.B., Yang H.S. Assessing the Accuracy and Clinical Utility of ChatGPT in Laboratory Medicine. Clin. Chem. 2023;69:939–940. doi: 10.1093/clinchem/hvad058. [DOI] [PubMed] [Google Scholar]
- 40.Brinch M.L., Hald T., Wainaina L., Merlotti A., Remondini D., Henri C., Njage P.M.K. Comparison of Source Attribution Methodologies for Human Campylobacteriosis. Pathogens. 2023;12:786. doi: 10.3390/pathogens12060786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Munir K., Elahi H., Ayub A., Frezza F., Rizzi A. Cancer Diagnosis Using Deep Learning: A Bibliographic Review. Cancers. 2019;11:1235. doi: 10.3390/cancers11091235. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Arslan S. Exploring the Potential of Chat GPT in Personalized Obesity Treatment. Ann. Biomed. Eng. 2023;51:1887–1888. doi: 10.1007/s10439-023-03227-9. [DOI] [PubMed] [Google Scholar]
- 43.Ismail A.M.A. Chat GPT in Tailoring Individualized Lifestyle-Modification Programs in Metabolic Syndrome: Potentials and Difficulties? Ann. Biomed. Eng. 2023;51:2634–2635. doi: 10.1007/s10439-023-03279-x. [DOI] [PubMed] [Google Scholar]
- 44.Cheng K., Li Z., He Y., Guo Q., Lu Y., Gu S., Wu H. Potential Use of Artificial Intelligence in Infectious Disease: Take ChatGPT as an Example. Ann. Biomed. Eng. 2023;51:1130–1135. doi: 10.1007/s10439-023-03203-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Schulte B. Capacity of ChatGPT to Identify Guideline-Based Treatments for Advanced Solid Tumors. Cureus. 2023;15:e37938. doi: 10.7759/cureus.37938. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Qarajeh A., Tangpanithandee S., Thongprayoon C., Suppadungsuk S., Krisanapan P., Aiumtrakul N., Garcia Valencia O.A., Miao J., Qureshi F., Cheungpasitporn W. AI-Powered Renal Diet Support: Performance of ChatGPT, Bard AI, and Bing Chat. Clin. Pract. 2023;13:1160–1172. doi: 10.3390/clinpract13050104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Bing Chat with GPT-4. [(accessed on 14 October 2023)]. Available online: https://www.microsoft.com/en-us/bing?form=MA13FV.
- 48.Anil R., Dai A.M., Firat O., Johnson M., Lepikhin D., Passos A., Shakeri S., Taropa E., Bailey P., Chen Z., et al. PaLM 2 Technical Report. arXiv. 2023 doi: 10.48550/arXiv.2305.10403. [DOI] [Google Scholar]
- 49.Brown C., Nazeer R., Gibbs A., Le Page P., Mitchell A.R. Breaking Bias: The Role of Artificial Intelligence in Improving Clinical Decision-Making. Cureus. 2023;15:e36415. doi: 10.7759/cureus.36415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Galido P.V., Butala S., Chakerian M., Agustines D. A Case Study Demonstrating Applications of ChatGPT in the Clinical Management of Treatment-Resistant Schizophrenia. Cureus. 2023;15:e38166. doi: 10.7759/cureus.38166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Khan R.A., Jawaid M., Khan A.R., Sajjad M. ChatGPT—Reshaping medical education and clinical management. Pak. J. Med. Sci. 2023;39:605–607. doi: 10.12669/pjms.39.2.7653. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Garcia Valencia O.A., Thongprayoon C., Jadlowiec C.C., Mao S.A., Miao J., Cheungpasitporn W. Enhancing Kidney Transplant Care through the Integration of Chatbot. Healthcare. 2023;11:2518. doi: 10.3390/healthcare11182518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Sharma S., Pajai S., Prasad R., Wanjari M.B., Munjewar P.K., Sharma R., Pathade A. A Critical Review of ChatGPT as a Potential Substitute for Diabetes Educators. Cureus. 2023;15:e38380. doi: 10.7759/cureus.38380. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Benyon B. ChatGPT Can Answer Cancer Questions, But Clinician Input Still Vital. [(accessed on 10 April 2023)]. Available online: https://www.curetoday.com/view/chatgpt-can-answer-cancer-questions-but-clinician-input-still-vital.
- 55.Yeo Y.H., Samaan J.S., Ng W.H., Ting P.S., Trivedi H., Vipani A., Ayoub W., Yang J.D., Liran O., Spiegel B., et al. Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma. Clin. Mol. Hepatol. 2023;29:721–732. doi: 10.3350/cmh.2023.0089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Ayers J.W., Poliak A., Dredze M., Leas E.C., Zhu Z., Kelley J.B., Faix D.J., Goodman A.M., Longhurst C.A., Hogarth M., et al. Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum. JAMA Intern. Med. 2023;183:589–596. doi: 10.1001/jamainternmed.2023.1838. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.ChatGPT’s Potential Impact on the Delivery of Healthcare Services. [(accessed on 28 February 2023)]. Available online: https://abcsrcm.com/chatgpts-potential-impact-on-the-delivery-of-healthcare-services/
- 58.Chen P.F., Wang S.M., Liao W.C., Kuo L.C., Chen K.C., Lin Y.C., Yang C.Y., Chiu C.H., Chang S.C., Lai F. Automatic ICD-10 Coding and Training System: Deep Neural Network Based on Supervised Learning. JMIR Med. Inform. 2021;9:e23230. doi: 10.2196/23230. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.DiGiorgio A.M., Ehrenfeld J.M. Artificial Intelligence in Medicine & ChatGPT: De-Tether the Physician. J. Med. Syst. 2023;47:32. doi: 10.1007/s10916-023-01926-3. [DOI] [PubMed] [Google Scholar]
- 60.Frackiewicz M. The Impact of ChatGPT on Medical Coding and Billing Accuracy. [(accessed on 2 May 2023)]. Available online: https://ts2.space/en/the-impact-of-chatgpt-on-medical-coding-and-billing-accuracy/
- 61.Perkel J.M. Six tips for better coding with ChatGPT. Nature. 2023;618:422–423. doi: 10.1038/d41586-023-01833-0. [DOI] [PubMed] [Google Scholar]
- 62.Biswas S. ChatGPT and the Future of Medical Writing. Radiology. 2023;307:e223312. doi: 10.1148/radiol.223312. [DOI] [PubMed] [Google Scholar]
- 63.Payton J. Improving Communication Skills within the Nephrology Unit. Nephrol. Nurs. J. 2018;45:269–280. [PubMed] [Google Scholar]
- 64.Geetha D., Lee S.K., Srivastava A.J., Kraus E.S., Wright S.M. Clinical excellence in nephrology: Examples from the published literature. BMC Nephrol. 2015;16:141. doi: 10.1186/s12882-015-0134-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.National Action Plan to Improve Health Literacy. [(accessed on 3 July 2023)]; Available online: https://health.gov/sites/default/files/2019-09/Health_Literacy_Action_Plan.pdf.
- 66.Ali S.R., Dobbs T.D., Hutchings H.A., Whitaker I.S. Using ChatGPT to write patient clinic letters. Lancet Digit. Health. 2023;5:e179–e181. doi: 10.1016/S2589-7500(23)00048-1. [DOI] [PubMed] [Google Scholar]
- 67.Drury D.J., Kaur A., Dobbs T., Whitaker I.S. The Readability of Outpatient Plastic Surgery Clinic Letters: Are We Adhering to Plain English Writing Standards? Plast. Surg. Nurs. 2021;41:27–33. doi: 10.1097/PSN.0000000000000356. [DOI] [PubMed] [Google Scholar]
- 68.D’Amico R.S., White T.G., Shah H.A., Langer D.J. I Asked a ChatGPT to Write an Editorial About How We Can Incorporate Chatbots into Neurosurgical Research and Patient Care. Neurosurgery. 2023;92:663–664. doi: 10.1227/neu.0000000000002414. [DOI] [PubMed] [Google Scholar]
- 69.Benichou L., ChatGpt Role de l’utilisation de l’intelligence artificielle ChatGPT dans la redaction des articles scientifiques medicaux The Role of Using ChatGPT AI in Writing Medical Scientific Articles. J. Stomatol. Oral Maxillofac. Surg. 2023;124:101456. doi: 10.1016/j.jormas.2023.101456. [DOI] [PubMed] [Google Scholar]
- 70.Huang J., Tan M. The role of ChatGPT in scientific communication: Writing better scientific review articles. Am. J. Cancer Res. 2023;13:1148–1154. [PMC free article] [PubMed] [Google Scholar]
- 71.Verhoeven F., Wendling D., Prati C. ChatGPT: When artificial intelligence replaces the rheumatologist in medical writing. Ann. Rheum. Dis. 2023;82:1015–1017. doi: 10.1136/ard-2023-223936. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Athaluri S.A., Manthena S.V., Kesapragada V., Yarlagadda V., Dave T., Duddumpudi R.T.S. Exploring the Boundaries of Reality: Investigating the Phenomenon of Artificial Intelligence Hallucination in Scientific Writing Through ChatGPT References. Cureus. 2023;15:e37432. doi: 10.7759/cureus.37432. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Salvagno M., Taccone F.S., Gerli A.G. Can artificial intelligence help for scientific writing? Crit. Care. 2023;27:75. doi: 10.1186/s13054-023-04380-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Lubowitz J.H. ChatGPT, An Artificial Intelligence Chatbot, Is Impacting Medical Literature. Arthroscopy. 2023;39:1121–1122. doi: 10.1016/j.arthro.2023.01.015. [DOI] [PubMed] [Google Scholar]
- 75.Dergaa I., Chamari K., Zmijewski P., Ben Saad H. From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biol. Sport. 2023;40:615–622. doi: 10.5114/biolsport.2023.125623. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Zhou Z. Evaluation of ChatGPT’s Capabilities in Medical Report Generation. Cureus. 2023;15:e37589. doi: 10.7759/cureus.37589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Schuppe K., Burke S., Cohoe B., Chang K., Lance R.S., Mroch H. Atypical Nelson Syndrome Following Right Partial and Left Total Nephrectomy with Incidental Bilateral Total Adrenalectomy of Renal Cell Carcinoma: A Chat Generative Pre-Trained Transformer (ChatGPT)-Assisted Case Report and Literature Review. Cureus. 2023;15:e36042. doi: 10.7759/cureus.36042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Gilat R., Cole B.J. How Will Artificial Intelligence Affect Scientific Writing, Reviewing and Editing? The Future is Here. Arthroscopy. 2023;39:1119–1120. doi: 10.1016/j.arthro.2023.01.014. [DOI] [PubMed] [Google Scholar]
- 79.Suppadungsuk S., Thongprayoon C., Krisanapan P., Tangpanithandee S., Garcia Valencia O., Miao J., Mekraksakit P., Kashani K., Cheungpasitporn W. Examining the Validity of ChatGPT in Identifying Relevant Nephrology Literature: Findings and Implications. J. Clin. Med. 2023;12:5550. doi: 10.3390/jcm12175550. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Aiumtrakul N., Thongprayoon C., Suppadungsuk S., Krisanapan P., Miao J., Qureshi F., Cheungpasitporn W. Navigating the Landscape of Personalized Medicine: The Relevance of ChatGPT, BingChat, and Bard AI in Nephrology Literature Searches. J. Pers. Med. 2023;13:1457. doi: 10.3390/jpm13101457. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Mbakwe A.B., Lourentzou I., Celi L.A., Mechanic O.J., Dagan A. ChatGPT passing USMLE shines a spotlight on the flaws of medical education. PLoS Digit. Health. 2023;2:e0000205. doi: 10.1371/journal.pdig.0000205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Miao H., Ahn H. Impact of ChatGPT on Interdisciplinary Nursing Education and Research. Asian Pac. Isl. Nurs. J. 2023;7:e48136. doi: 10.2196/48136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Fatani B. ChatGPT for Future Medical and Dental Research. Cureus. 2023;15:e37285. doi: 10.7759/cureus.37285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Lee H. The rise of ChatGPT: Exploring its potential in medical education. Anat. Sci. Educ. 2023 doi: 10.1002/ase.2270. ahead of print . [DOI] [PubMed] [Google Scholar]
- 85.Biswas S. Passing is Great: Can ChatGPT Conduct USMLE Exams? Ann. Biomed. Eng. 2023;51:1885–1886. doi: 10.1007/s10439-023-03224-y. [DOI] [PubMed] [Google Scholar]
- 86.Almazyad M., Aljofan F., Abouammoh N.A., Muaygil R., Malki K.H., Aljamaan F., Alturki A., Alayed T., Alshehri S.S., Alrbiaan A., et al. Enhancing Expert Panel Discussions in Pediatric Palliative Care: Innovative Scenario Development and Summarization with ChatGPT-4. Cureus. 2023;15:e38249. doi: 10.7759/cureus.38249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Price W.N., 2nd, Cohen I.G. Privacy in the age of medical big data. Nat. Med. 2019;25:37–43. doi: 10.1038/s41591-018-0272-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Kayaalp M. Patient Privacy in the Era of Big Data. Balk. Med. J. 2018;35:8–17. doi: 10.4274/balkanmedj.2017.0966. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Crossnohere N.L., Elsaid M., Paskett J., Bose-Brill S., Bridges J.F.P. Guidelines for Artificial Intelligence in Medicine: Literature Review and Content Analysis of Frameworks. J. Med. Internet Res. 2022;24:e36823. doi: 10.2196/36823. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Kavian J.A., Wilkey H.L., Patel P.A., Boyd C.J. Harvesting the Power of Artificial Intelligence for Surgery: Uses, Implications, and Ethical Considerations. Am. Surg. 2023:31348231175454. doi: 10.1177/00031348231175454. [DOI] [PubMed] [Google Scholar]
- 91.Kleebayoon A., Wiwanitkit V. Assessing the performance of ChatGPT: Comment. Clin. Mol. Hepatol. 2023;29:815–816. doi: 10.3350/cmh.2023.0170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Dave T., Athaluri S.A., Singh S. ChatGPT in medicine: An overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front. Artif. Intell. 2023;6:1169595. doi: 10.3389/frai.2023.1169595. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Fernandes A.C., Souto M. Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine. N. Engl. J. Med. 2023;388:2399–2400. doi: 10.1056/NEJMc2305286. [DOI] [PubMed] [Google Scholar]
- 94.Ruksakulpiwat S., Kumar A., Ajibade A. Using ChatGPT in Medical Research: Current Status and Future Directions. J. Multidiscip. Healthc. 2023;16:1513–1520. doi: 10.2147/JMDH.S413470. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Garcia Valencia O.A., Suppadungsuk S., Thongprayoon C., Miao J., Tangpanithandee S., Craici I.M., Cheungpasitporn W. Ethical Implications of Chatbot Utilization in Nephrology. J. Pers. Med. 2023;13:1363. doi: 10.3390/jpm13091363. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Mello M.M., Guha N. ChatGPT and Physicians’ Malpractice Risk. JAMA Health Forum. 2023;4:e231938. doi: 10.1001/jamahealthforum.2023.1938. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data used in this study can be obtained upon reasonable request to the corresponding author.