Skip to main content
Sage Choice logoLink to Sage Choice
. 2025 Jun 22;20(3):131–148. doi: 10.1177/15562646251350203

ChatGPT in Academic Writing: A Scientometric Analysis of Literature Published Between 2022 and 2023

Gergely Ferenc Lendvai 1,
PMCID: PMC12231813  PMID: 40545657

Abstract

This paper reviews the disruptive role of ChatGPT in academic writing, focusing on its implications for scholarly practices and emerging ethical challenges. Using document co-citation analysis (DCA), it maps the thematic and intellectual structure of the discourse on ChatGPT in academic knowledge production. Drawing on a dataset of 171 peer-reviewed articles from Scopus, the analysis, conducted using CiteSpace, identified 10 major thematic clusters, including ethical risks, practical applications, and pedagogical innovations. The resulting high-modularity network (Q = 0.8989, S = 0.9466), comprising 866 nodes and 2,274 edges, ensured methodological rigor and thematic clarity. The findings reveal widespread recognition of ChatGPT's value in enhancing writing and supporting innovative educational frameworks, especially for non-native speakers. Concerns persist regarding hallucinated references, plagiarism, authorship ethics, and the reliability of AI-detection tools. Our paper accentuates the need for proactive oversight and policy development to ensure responsible integration of generative AI in research and education.

Keywords: ChatGPT, academic writing, AI and research, ethical challenges, scholarly innovation

Introduction

Introduced in late 2022, ChatGPT, OpenAI's flagship innovation, has rapidly become an ineluctable technological tool. The platform has amassed 100 million users in only two months, making it by far the fastest-growing large language model (LLM) to have ever been created (Ray, 2023; Twinomurinzi & Gumbo, 2023). It has been popularized in mass media outlets as well as scholarly literature as a tool that has an unprecedented societal, technological, educational, and ethical impact on how humans will interact with democratized artificial intelligence-based software and what dilemmas LLMs like ChatGPT will cause in the future (Ray, 2023; Rudolph et al., 2023; Wei et al., 2024).

The present research aims to investigate how scholarly literature has perceived ChatGPT in academic publications disseminated on the subject. The choice of this research endeavor is not accidental. On the one hand, a myriad of benefits have been reported regarding the use or application of ChatGPT in education and research. Such benefits include a more accessible, personalized, and interactive learning and writing experience which highly enhanced student's engagement with educational materials (Dahlan et al., 2024; Limna et al., 2023) and theoretical research papers have also lamented that the implementation of ChatGPT may result in the fostering of critical thinking among students as well as more active collaborations due to the active, feedback-based nature of the platform (Bai˙doo-Anu & Ansah, 2023; Jelica et al., 2024; Kasneci et al., 2023). With regard to research, there is a dynamically growing body of literature which notes the positive aspects of using ChatGPT to facilitate data collection, processing, and analysis (Hassan et al., 2023), in helping to proofread manuscripts and assist writing from a technical standpoint (Karakose, 2023; Zhou, 2024) but also in sparking new ideas, coming up with novel hypotheses and finding research gaps (Karakose, 2023). On the other hand, however, a plethora of scholarly outputs have questioned the reliability and integrity of using the platform for educational and academic purposes. Research is growing fast on whether the use of AI-powered tools such as ChatGPT involves increased concerns on data privacy, as there is a substantial risk of sensitive information being accidentally or inadvertently shared through the platform, especially in view of the rather rudimentary legislative measures on artificial intelligence, even in seemingly more progressive legal environments, such as the European Union (Bin-Nashwan et al., 2023; Helberger & Diakopoulos, 2023; Khowaja et al., 2024; Leboukh et al., 2023; Sebastian, 2023; Taktak et al., 2024; Tlili et al., 2023; Wu et al., 2023). Scholars have also noted extensively the already existing and potential biases in working with ChatGPT. Results in this regard have demonstrated there is a burning bias issue with the usage of ChatGPT for professional purposes, as the platform regularly exhibits content and opinions that are diagnostic, educational, cultural, demographic, political and ideological, and in some instances, even gender bias (Gross, 2023; Huang, 2024; Motoki et al., 2023; Qu & Wang, 2024; Rozado, 2023; Schmidt et al., 2024). On a more academic writing-related note, Cotton et al.'s (2023) foundational paper—which also happens to be one of the highest-cited papers in this research subject at the time of writing of this study—highlights the potential misuse of ChatGPT for plagiarism and unauthorized assistance, while emphasizing the need for updated policies, ethical guidelines, and educational strategies. In this regard, Lin et al. (2023) also outlined that the three most significant problems with ChatGPT in research stem from the triad of research ethics, potential plagiarism of others’ work and the lack of integrity. An equally important problem with using the tool in research is its frequent “hallucinations” which arises from the fact that it is always obligated to respond to the user's query even in cases when it cannot access reliable or existing data (Alkaissi & McFarlane, 2023; Emsley, 2023). In academic writing, this often transpires into the creation of fraudulent research materials such as made-up databases or the generation and citation of non-existent literature (Da Silva, 2023; Day, 2023; Safdar et al., 2024b).

Even more importantly, there is a critical question to be asked when using ChatGPT for research: who is the author? Even more so; should we acknowledge it as an author? Does it even matter if ChatGPT was used in the writing of an article if the results itself are sound and valid? The current academic landscape tends to be cautious in answering these questions. Some claim that ChatGPT might even question the very definition of authorship and that critical questions should be asked on future ethical academic research (Nazarovets & Da Silva, 2024), while others reject this notion stating that the program lacks every fundamental skills that are attributed to an author which include knowledge, belief, intention, and accountability (Tang, 2024; Van Woudenberg et al., 2024). Journals, for instance, are slowly adapting to this issue with differing or somewhat naïve policies on acknowledging ChatGPT as an author or an assistant to the research conducted. In their highly cited opinion paper, Dwivedi et al. (2023) as well as Solomon et al. (2023) underline that ChatGPT is a transformative and highly disruptive tool which will most probably have significant benefits in certain research domains and emphasize the importance of integrating transparency, ethics, and effective regulations into the deployment of such AI systems.

The present research aims to analyze the current state of research on ChatGPT and academic knowledge production. As seen above, there are currently more questions than answers—and this is likely to remain the case for a long time. Nonetheless, understanding the interests of researchers in this subject is crucial and highly useful for developing future research agendas, identifying research gaps and reviewing significant literature and thematical topics. Subsequently, our study seeks to systematically map the scholarly discourse on ChatGPT in academic writing by identifying key thematic clusters and intellectual trends with the central objective of answering the question of how academic literature has conceptualized, critiqued, and integrated ChatGPT into knowledge production and scholarly communication.

Material and Methods

The present research employs the research model set forth by Cataldo et al. (2022) which is based on a scientometric assessment of literature with the use of document co-citation analysis (“DCA”). The proposed research methodology distinguishes itself from systematic literature reviews in its primary application in interdisciplinary and “cross-field” research. It uses a unique bibliometric method that focuses on the relationships among frequently cited documents, which effectively allows us to uncover the intellectual framework of a research domain by analyzing the frequency with which pairs of documents are co-cited in other publications (Appio et al., 2014; Mustafee et al., 2013; Trujillo & Long, 2018). The DCA is also an effective method for identifying key papers and authors in a subject. This approach also facilitates the creation of knowledge clusters and is an adequate method to create reliable knowledge networks with accurate results (Appio et al., 2014; Sanguri et al., 2020). As a preliminary limitation, however, it is necessary to note that scientometric analyses, including DCA, may inherit biases from the underlying dataset (such as publication language (English-only), journal selection bias within Scopus, and time lag effects that underrepresent newer but influential work) (Bradley et al., 2019; Worrall & Cohn, 2023). These limitations were taken into account when interpreting the results.

Bibliometric research has already been conducted on ChatGPT in its status and use in knowledge production in different disciplines (Abdelwahab et al., 2024; Baber et al., 2023; Farhat et al., 2024; Oliński et al., 2024; Safdar et al., 2024a; Tian et al., 2023; Yalcinkaya & Yucel, 2024), however, there is currently no comprehensive thematical research summarizing the current state of the art on ChatGPT and academic writing.

Following Cataldo et al.'s (2022) research outline, we used CiteSpace (version 6.4.R1.) to conduct the DCA and identify the key topical clusters. CiteSpace is a visualization tool designed for analyzing and mapping trends and patterns in scientific literature by identifying key research areas, authors, and concepts, and it facilitates the exploration of co-citation networks, keyword bursts, and the evolution of knowledge structures within a given field (Chen, 2004; 2005). We proposed the use of CiteSpace over other tools due to its advanced capabilities in detecting emerging trends, identifying burst terms, and producing high-resolution co-citation cluster maps, which are particularly suited for tracing intellectual structures in interdisciplinary domains (Liu et al., 2022; Ping et al., 2017). As CiteSpace supports time-sliced analysis and structural metrics such as modularity and silhouette scores, we deemed this tool exceptionally valuable in mapping academic discourses surrounding ChatGPT.

Data Collection

We utilized Elsevier's Scopus for data collection as it is one of the most reliable, accurate, and used scholarly repositories featuring rigorous content selection and an extensive coverage of publications (Baas et al., 2020). Data was collected in accordance with the PRISMA guidelines (Moher et al., 2009; Page et al., 2021). We used the following search string “(TITLE-ABS-KEY(“ChatGPT”) AND TITLE-ABS-KEY (“academic writing” OR “scholarly writing” OR “academic authorship” OR “scientific writing”)) on 24 December 2024 and identified 327 records for our search string. We focused on articles as they are more reliable in terms of academic rigor and excluded non-English papers. The final, cleaned dataset consisted of 171 documents.

The keywords selected for this study were chosen to reflect the central themes identified both in the existing literature and during preliminary data screening. Notably, we chose not to include broader terms such as “academic publishing” or “scientific communication,” as following our preliminary screening, these keywords seemed to capture a wider set of literature less directly focused on writing itself and more on editorial workflows or journal policies which are not constituent parts of our scope. Therefore, we aimed to specifically target the writing or preparation tasks to narrow down our focus with the selected keywords. Nevertheless, we have also included several references later in the paper that discuss academic publishing (see Sections 4.1–4.3). Even though the concentrated selection ensured thematic precision, we also underline preliminary limitations. For instance, excluding terms like the aforementioned examples may have filtered out relevant discussions on peer review and editorial policy shifts. Future work may benefit from a more expansive keyword strategy to encompass the broader institutional dynamics of AI in Academia. (Figure 1)

Figure 1.

Figure 1.

Data collection process (Own edit).

Importing Data on CiteSpace and Setting the Metrics

Data was then imported on CiteSpace. A total of 6294 references were found and the software identified 5875 references as valid with an extremely high success rate of 93% making the research eligible for conduct. When data was loaded into the CiteSpace, the link retaining factor (LRF) was set to 2.5 with maximum links per node set 10 and the TopN set to 1.0—meaning that only the most highly cited node (per time slice) was retained, based on citation frequency. CiteSpace employs a modified version of the g-index, incorporating a scaling factor k to adjust the threshold for selecting nodes or clusters in the analysis. The formula used is g2k∑Igci. In this study, k was set to 125, striking a balance by including a reasonable number of nodes without overcrowding the visualization. For the Top N parameter, we opted to include the top 50 most cited and frequently occurring items from each time slice. Top N% was operationalized so that the top 10% of most cited items were selected for each slice with a maximum N of selected items per slice being set to 100.

The resulting network consisted of 866 nodes and 2274 edges, representing the connections between distinct items scuh as keywords, authors, or documents. The density of the network was 0.0061, indicating a sparse but meaningful structure with focused interactions among the included items. The largest connected component (LCC) comprised 45% of the nodes (391), indicating a substantial cluster of highly interconnected elements. Only 1% of the nodes were labeled, suggesting that labeling was highly selective, likely focusing on the most significant or central nodes. No pruning was applied, allowing for a comprehensive visualization of the network's complexity and relationships. The modularity (Q) and silhouette (S) values, as well as the high harmonic mean (Q, S), all confirmed that the network was meaningful and eligible for scientometric evaluation (Chen et al., 2010). The scores were the following:

  • Q = 0.8989

  • S = 0.9466

  • Q, S = 0.9221.

Generally, a Q value close to 1.0 signals well-separated clusters, while a high S score (for example, above 0.9) suggests internal consistency within clusters (cf. Chen, 2005; Newman, 2006). These values confirm that the network structure is both robust and thematically meaningful. Therefore, in our analysis, both the modularity (Q = 0.8989) and silhouette (S = 0.9466) values indicated strong structural and thematic cohesion.

Results

Figure 2 illustrates the co-citation network generated by CiteSpace, where each node represents a document and edges indicate the co-citation strength. Larger nodes denote more frequently cited works, while color-coded clusters reflect thematic groupings. The DCA resulted in the identification of 10 major clusters. Larger clusters represent more prominent topic clusters, while larger nodes on the clusters signify papers with more citations. The analyzed network revealed ten distinct clusters representing various thematic focuses within the realm of ChatGPT and academic writing. The largest cluster, Cluster #0 (“Originality vs. AI”), comprises 80 nodes with a highly cohesive silhouette score of 0.996 and an average publication year of 2022, reflecting its focus on originality and AI in academic writing. Following this, Cluster #1 (“Enhancing a. [academic] writing with AI”) includes 63 nodes with a moderate silhouette score of 0.776, primarily discussing the integration of AI tools to improve academic writing skills. Cluster #2 (“Foundations and risks”), the third largest, contains 57 nodes with a robust silhouette score of 0.977, emphasizing early ChatGPT-related publications and associated risks. Smaller but significant, Cluster #5 (“Plagiarism and ethical concerns”) consists of 39 nodes with a silhouette score of 0.953, focusing on ethical issues such as plagiarism in AI-assisted writing. Cluster #9 (“Systematic reviews”), with 31 nodes and a silhouette value of 0.901, highlights recent systematic reviews from 2023, underscoring GPT's features in research contexts. The remaining clusters, such as Cluster #10 (“Integrating AI in Scholarly Writing Instruction”) and Cluster #15 (“Boon or Bane?”), delve into specific applications and debates surrounding AI, showcasing the diverse scope of the network. (Figure 2)

Figure 2.

Figure 2.

The ten major clusters of research on ChatGPT and academic writing (Own edit).

To enhance visual clarity, a circular layout of the network is provided in Figure 3 below. We computed this representation to emphasize the centrality of Cluster #0, which is thematically associated with the question of originality. This circular format also helps illustrate the relative interconnectedness of clusters and supports the grouping approach used later in the discussion. (Figure 3)

Figure 3.

Figure 3.

Circular visualization of the ten major clusters highlighting the central status of Cluster #0 (Own edit).

Clusters were renamed due to the rather incohesive auto-naming of CiteSpace. The changes made, as well as the other possible names, are also included. With regard to auto-labels, LSI is generated based on latent semantic indexing, summarizing the cluster's topic using keywords derived from the shared terminology of the articles. Similarly, LLR (Log-Likelihood Ratio) highlights the most statistically significant terms that distinguish the cluster from others, and MI (Mutual Information) identifies additional key terms by focusing on the informational overlap within the cluster. We introduce these new names as they are more descriptive of the papers and themes entailed in the respective clusters.

Furthermore, to enhance clarity, we first provide a brief and general overview of the range of topics represented by the identified clusters. The clusters capture a diverse set of discussions on ChatGPT in academic writing, including concerns about originality and authorship, practical tools and applications in scholarly workflows, ethical risks such as plagiarism and misinformation, and the pedagogical role of generative AI in education. However, it is worth noting that a great number of clusters focus on domain-specific themes. This can be exemplified by clusters related to the applications in medical writing or stylistic features of AI-generated texts. Moreover, although some clusters represent emerging concerns, others reflect established debates. This aspect enabled a comprehensive mapping of the intellectual discourse. (Table 1)

Table 1.

The Major Clusters by Their Cluster Data and Denomination Versions (Own Edit).

Cluster ID Size Silhouette Original Label (LSI) Original Label (LLR) Original Label (MI) Average Year Updated Name
0 80 0.996 Fluent but not factual Originality (9.84, 0.005) Academic writing (0.03) 2022 Originality vs. AI
1 63 0.776 Post-ChatGPT use Academic writing skill (26.18, 1.0E-4) Artificial intelligence tool (1.76) 2022 Enhancing a. writing with AI
2 57 0.977 Great detective First ChatGPT-related publication (26.04) The risk (2.14) 2022 Foundations and risks
5 39 0.953 Using ChatGPT Plagiarism academic ethics (27.61, 1.0E-4) Research writing creativity (0.2) 2022 Plagiarism and ethical concerns
6 37 0.995 Post-ChatGPT use Using ChatGPT (21.64, 1.0E-4) Source-based writing task (0.03) 2022 Practical Applications of ChatGPT in Academic Writing
9 31 0.901 Revolutionizing EFL writing Systematic review (29.13, 1.0E-4) GPT-fabricated features spread (0.28) 2023 Systematic reviews
10 28 1 Generative Scholarly writing instruction (13.11, 0.001) Originality (0.03) 2021 Integrating AI in Scholarly Writing Instruction
13 23 0.996 Role of chatbots on gastroenterology Gastroenterology (7.98, 0.005) Academic writing (0.04) 2022 Gastroenterology Research
15 18 1 The use of ChatGPT in academic writing: A blessing or a curse in disguise? Curse (10.24, 0.005) Academic writing (0.03) 2022 Boon or Bane?
18 15 0.999 Do artificial intelligence chatbots have a writing style? Stylistic feature (10.24, 0.005) Academic writing (0.03) 2021 Stylistic Features

Although Cataldo et al. (2022) solely analyzed the larger clusters in more detail—mainly due to a larger dataset and many more references—we intended to outline all clusters and detail them by associative pairings. We investigated all clusters and, based on their descriptive data in CiteSpace, paired clusters according to their connectedness and thematic similarities, allowing us to create separate and distinct topical groups for discussion. For this analysis, we did not take into account the sizes of the clusters but rather focused on qualitative similarities. Our rearrangement of clusters has resulted in five distinct thematical groups presented below in Table 2.

Table 2.

Thematical Groups of Research on ChatGPT and Academic Writing (Own Edit).

# Group Name Clusters Reason for Grouping
1 Risks, Ethics, and Challenges Cluster #2 (“Foundations and risks”), Cluster #5 (“Plagiarism and ethical concerns”), Cluster #15 (“Boon or Bane?”) These clusters collectively explore the risks associated with ChatGPT, ethical challenges like plagiarism and integrity, and its controversial dual nature as a “blessing or curse”.
2 Practical Applications and ChatGPT as a Research Assistant Cluster #6 (“Practical Applications of ChatGPT in Academic Writing”), Cluster #9 (“Systematic reviews”) Focus on functional, task-based uses of ChatGPT in academic workflows
3 Innovation and Scholarly Integration Cluster #0 (“Originality vs. AI”), Cluster #1 (“Enhancing a. writing with AI”), Cluster #10 (“Integrating AI in Scholarly Writing Instruction”), Cluster #18 (“Stylistic Features”) Focus on ChatGPT's transformative role in writing originality, skill enhancement, educational integration, and stylistic contributions.
4 Specialized Applications Cluster #13 (“Gastroenterology Research”) [excluded from the discussion] This cluster uniquely focuses on ChatGPT's application in a highly specialized field.

We have identified four groups. Group 1 titled “Risks, Ethics, and Challenges” consolidates clusters addressing foundational concerns, such as plagiarism, academic integrity, and the dual nature of ChatGPT as both a tool and a potential threat. Group 2, “Practical Applications and Systematic Use” is distinctly focused on task-based roles, including ChatGPT's practical contributions to academic workflows and systematic reviews. Group 3, the “Innovation and Scholarly Integration” group, emphasizes ChatGPT's transformative impact on originality, writing skills, pedagogical integration, and stylistic features, reflecting its broader potential in academic contexts. There is a fourth group (Group 4), which was so special in theme that we deemed it necessary to make it a “stand-alone group” and titled it “Specialized Applications”. This group specifically focuses on a niche research endeavor, ChatGPT and gastroenterology research, which differs thematically from the broader discussions. Because Group 4 solely consisted of one individual major citing document—which is also included in another group (Group 1) and is accessible in full version online (cf. Li, 2023b)—as well as its extremely specified nature, which mainly concerns a niche segment of ChatGPT and academic writing research, we excluded this group from the discussion. (Table 2)

Following Cataldo et al.'s (2022) model, we first analyzed the DCA results for each cluster, in our case, each group. As CiteSpace has no identified and bursts, we mainly focused on citation data. With regard to specific cluster/group data, it is important to outline CiteSpace's labeling system. Coverage represents the number of articles within a cluster that cites a specific work, showing its influence within that research area. We considered GCS (Global Citation Score) which reflects the total number of citations an article has received across all datasets. In a few instances an individual paper was present in multiple groups. In these cases, we aimed to associate the paper, based on their findings and key thematical point to the more appropriate group and discuss its details therein.

Commencing with Group 1, we identified 23 individual papers with a mean coverage of 6.64 and a GCS of 7.48. It is to be underlined the certain papers, such as Li's (2023) paper on gastroenterology and ChatGTP was so prevalent that it was included in multiple clusters of themes. This group included two papers that we were not able to access in full-text version and they were not included in the discussion (%validity = 91.3). (Table 3)

Table 3.

Papers Included in the Risks, Ethics, and Challenges Group (Only First Author Mentioned) (Group 1) (Own Edit).

Coverage GCS Bibliography
18 1 ALBERTH, - (2023-JAN) The use of chatgpt in academic writing: a blessing or a curse in disguise?. Teflin Journal, V34, P15 DOI 10.15639/teflinjournal.v34i2/337-352
28 3 Li, L (2023-JAN) Role of chatbots on gastroenterology: let's chat about the future. Gastroenterology and Endoscopy DOI 10.1016/j.gande.2023.06.002
13 22 Levin, G (2023-JAN) Exploring the use of chatgpt in obgyn: a bibliometric analysis of the first chatgpt-related publications. Archives of Gynecology and Obstetrics DOI 10.1007/s00404-023-07081-x
12 23 Frosolini, A (2023-JAN) Assessing the accuracy of chatgpt references in head and neck and ent disciplines. European Archives of Oto-Rhino-Laryngology DOI 10.1007/s00405-023-08205-4
9 5 Pan, Et (2024-JAN) Human vs machine: identifying chatgpt-generated abstracts in gynecology and urogynecology. American Journal of Obstetrics and Gynecology DOI 10.1016/j.ajog.2024.04.045
7 1 Wang, J (2024-JAN) The impact of using chatgpt on academic writing among medical undergraduates. Annals of Medicine DOI 10.1080/07853890.2024.2426760
6 6 Flitcroft, Ma (2024-JAN) Performance of artificial intelligence content detectors using human and artificial intelligence-generated scientific writing. Annals of Surgical Oncology DOI 10.1245/s10434-024-15549-6
6 27 Farhat, F (2023-JAN) How trustworthy is chatgpt? the case of bibliometric analyses. Cogent Engineering DOI 10.1080/23311916.2023.2222988
6 1 Carnino, Jm (2024-JAN) Ai-generated text in otolaryngology publications: a comparative analysis before and after the release of chatgpt. European Archives of Oto-Rhino-Laryngology DOI 10.1007/s00405-024-08834-3
6 5 Lawrence, Kw (2024-JAN) Human versus artificial intelligence-generated arthroplasty literature: a single-blinded analysis of perceived communication, quality, and authorship source. International Journal of Medical Robotics and Computer Assisted Surgery DOI 10.1002/rcs.2621
6 0 Chen, A (2024-JAN) Generative artificial intelligence: applications in scientific writing and data analysis in wound healing research. Advances in Skin and Wound Care DOI 10.1097/ASW.0000000000000226
6 42 Eppler, M (2024-JAN) Awareness and use of chatgpt and large language models: a prospective cross-sectional global survey in urology. European Urology DOI 10.1016/j.eururo.2023.10.014
5 4 Li, J (2024-JAN) Exploring the potential of artificial intelligence to enhance the writing of english academic papers by non-native english-speaking medical students - the educational application of chatgpt. BMC Medical Education DOI 10.1186/s12909-024-05738-y
5 1 Labouchère, A (2024-JAN) Chatgpt and bard in plastic surgery: hype or hope?. Surgeries (Switzerland) DOI 10.3390/surgeries5010006
5 4 Liu, Jqj (2024-JAN) The great detectives: humans versus ai detectors in catching large language model-generated medical writing. International Journal for Educational Integrity DOI 10.1007/s40979-024-00155-6
4 0 Albuck, Al (2024-JAN) Precision of chatbot generative pretrained transformer version 4-generated references for colon and rectal surgical literature. Journal of Surgical Research DOI 10.1016/j.jss.2024.07.021
4 1 Fatima, A (2024-JAN) Chatgpt in medicine: a cross-disciplinary systematic review of chatgpt's (artificial intelligence) role in research, clinical practice, education, and patient interaction. Medicine (United States) DOI 10.1097/MD.0000000000039250
4 2 Ambrosio, L (2024-JAN) Threats and opportunities of using chatgpt in scientific writing—the risk of getting spineless. JOR Spine DOI 10.1002/jsp2.1296
36 1 Koplin, J (2023-JAN) Plagiarism, academic ethics, and the utilization of generative ai in academic writing. International Journal of Applied Philosophy, V37, P23 DOI 10.5840/ijap2023372202
4 2 Popkov, Aa (2024-JAN) Ai vs academia: experimental study on ai text detectors’ accuracy in behavioral health academic writing. Accountability in Research DOI 10.1080/08989621.2024.2331757
4 5 Nazarovets, S (2024-JAN) Chatgpt as an “author”: bibliometric analysis to assess the validity of authorship. Accountability in Research DOI 10.1080/08989621.2024.2345713
2 4 Kandeel, Me (2024-JAN) Legal dangers of using chatgpt as a co-author according to academic research regulations. Journal of Governance and Regulation DOI 10.22495/jgrv13i1siart3
1 0 Malik, Ma (2024-JAN) Global insights: chatgpt's influence on academic and research writing, creativity, and plagiarism policies. Frontiers in Research Metrics and Analytics DOI 10.3389/frma.2024.1486832

Group 2, which is titled Practical Applications and ChatGPT as a Research Assistant consisted of 8 documents. Both the mean coverage (9.125) and the mean GCS (10.125) were higher than in Group 1. We were able to access 7 out of 8 papers in full version (%validity = 88). (Table 4)

Table 4.

Papers Included in the Practical Applications and ChatGPT as a Research Assistant Group (Only First Author Mentioned) (Group 2) (Own Edit).

Coverage GCS Citing Articles
37 68 Jarrah, Am (2023-JAN) Using chatgpt in academic writing is (not) a form of plagiarism: what does the literature say?. Online Journal of Communication and Media Technologies DOI 10.30935/ojcmt/13572
2 11 Nugroho, A (2024-JAN) Students’ appraisals post-chatgpt use: students’ narrative after using chatgpt for writing. Innovations in Education and Teaching International DOI 10.1080/14703297.2024.2319184
1 2 Tarchi, C (2024-JAN) The use of chatgpt in source-based writing tasks. International Journal of Artificial Intelligence in Education DOI 10.1007/s40593-024-00413-1
11 0 Kousha, K (2024-JAN) How is chatgpt acknowledged in academic publications?. Scientometrics, V129, P10 DOI 10.1007/s11192-024-05193-y
10 0 Andrade-hidalgo, G (2024-JAN) Exploring the impact of artificial intelligence on research ethics - a systematic review. Journal of Academic Ethics DOI 10.1007/s10805-024-09579-8
4 0 Liu, Z (2024-JAN) Second language writing anxiety and chatgpt adoption as an automated writing evaluation tool. Journal of Applied Research in Higher Education DOI 10.1108/JARHE-06-2024-0260
4 0 Cai, Y (2024-JAN) Impact of gpt on the academic ecosystem. Science and Education DOI 10.1007/s11191-024-00561-9
4 0 Alsagri, Hs (2024-JAN) Chatgpt or gemini: who makes the better scientific writing assistant?. Journal of Academic Ethics DOI 10.1007/s10805-024-09549-0

Group 3, consisting of 4 smaller clusters is titled Innovation and Scholarly Integration, and includes papers on the proficiency of AI chatbots (Lozić & Štular, 2023), stylistic features, and a segment on educational purposes which are closely related to innovative ways of transforming writing with ChatGPT (see Zhao et al., 2024). This group consisted is of 8 papers and had the both the highest mean Coverage (18.9) and mean GCS (12.5). Only one paper was inaccessible and, therefore, not included in the discussion (%validity = 87.5). (Table 5)

Table 5.

Papers Included in the Innovation and Scholarly Integration Group (Only First Author Mentioned) (Group 3) (Own Edit).

Coverage GCS Citing Articles
80 19 Lozić, E (2023-JAN) Fluent but not factual: a comparative analysis of chatgpt and other ai chatbots’ proficiency and originality in scientific writing for humanities. Future Internet DOI 10.3390/fi15100336
14 32 Mahapatra, S (2024-JAN) Impact of chatgpt on esl students’ academic writing skills: a mixed methods intervention study. Smart Learning Environments DOI 10.1186/s40561-024-00295-9
10 11 Chaka, C (2024-JAN) Reviewing the performance of ai detection tools in differentiating between ai-generated and human-written texts: a literature and integrative hybrid review. Journal of Applied Learning and Teaching DOI 10.37074/jalt.2024.7.1.14
9 10 Sevnarayan, K (2024-JAN) Generative artificial intelligence in distance education: transformations, challenges, and impact on academic integrity and student voice. Journal of Applied Learning and Teaching DOI 10.37074/jalt.2024.7.1.41
9 4 Kong, S (2024-JAN) A pedagogical design for self-regulated learning in academic writing using text-based generative artificial intelligence tools: 6-p pedagogy of plan, prompt, preview, produce, peer-review, portfolio-tracking. Research and Practice in Technology Enhanced Learning DOI 10.58459/rptel.2024.19030
27 20 Parker, Jl (2023-JAN) Chatgpt for automated writing evaluation in scholarly writing instruction. Journal of Nursing Education DOI 10.3928/01484834-20231006-02
2 3 Maphoto, Kb (2024-JAN) Advancing students’ academic excellence in distance education: exploring the potential of generative ai integration to improve academic writing skills. Open Praxis, V16, P17 DOI 10.55982/openpraxis.16.2.649
15 12 Alafnan, Ma (2023-JAN) Do artificial intelligence chatbots have a writing style? an investigation into the stylistic features of chatgpt-4. Journal of Artificial Intelligence and Technology DOI 10.37965/jait.2023.0267

Discussion

The findings of our study reveal a rich but also rather fragmented discourse around ChatGPT in academic writing. The fragmentation emerges partly from ChatGPT's practical potential and ethical complexity but also from the different sectoral angles on the issue of implementing such tools in Academia. Having applied a DCA, we were able to identify three major thematic groups: (1) risks, ethics, and challenges; (2) practical applications and the role of ChatGPT as a research assistant; and (3) innovation and scholarly integration. These groupings were chosen based on descriptive findings stemming from citation frequency and also because they reflect the most salient tensions and controversial issues in the academic discourse: the growing concerns over integrity and authorship, the rapid adoption of ChatGPT as a functional tool, and its potential to reshape scholarly writing and education. The present discussion synthesizes these clusters to articulate broader implications for academic practice, institutional policy, and future research, moving beyond descriptive analysis to offer a critical assessment of where the field is heading.

Risks, Ethics, and Challenges

As a general observation, a vast majority of papers, as AI language models seem to expand at an exponential rate and their capabilities tend to develop at an unprecedented tempo, significant polemics and dilemmas arise in terms of how academic writing and knowledge production will change (Alberth, 2023; Carnino et al., 2024; Frosolini et al., 2023; Li, 2023a; Nazarovets & Da Silva, 2024; Popkov & Barrett, 2024). The papers included in this group heavily accentuate these issues in the specific segment of medicine and healthcare (Eppler et al., 2023; Fatima et al., 2024; Flitcroft et al., 2024; Labouchère & Raffoul, 2024; Lawrence et al., 2024; Liu et al., 2024; Pan & Florian-Rodriguez, 2024; Popkov & Barrett, 2024; Wang et al., 2024) and were almost exclusively empirical papers with very few theoretical research.

As for risks, hallucinations are of critical importance, particularly hallucinated references and academic work as well as completely fabricated data used for empirical purposes. Frosolini et al. (2023) and Albuck et al. (2024) tested different versions of ChatGPT and found a great tendency to generate incomplete, erroneous, or nonexistent references, raising concerns about the tool's reliability in scientific writing. Generating corpus is no exception of the above polemic; texts created with AI display a high error rate from a factual aspect which questions its use in certain research areas such as bibliometric analyses (Farhat et al., 2023)—though AlSagri et al.'s (2024) more recent research shows improvements in the latter area, especially in terms of ChatGPT's potential in literature reviews. Quality-wise, it can also be underlined that AI-generated texts are usually of lesser quality and comprehensiveness, however, it is also worth accentuating that it is becoming harder to differentiate between AI-generated and human written texts (Lawrence et al., 2024). Labouchère and Raffoul (2024) in this regard also emphasize the “superficial” statements generated by LLMs (ChatGPT and Bard) which cause concerns on the accuracy of research and the compromise of quality for the sake of productivity. In view of Carnino et al.'s (2024) findings, who noted the rapid increase in AI-generated or AI-assisted research and the positive attitude of researchers in certain segments to include Ai in research more (Eppler et al., 2023), these risks will undoubtedly be significant in research in the coming years.

From an ethical perspective, Nazarovets and Da Silva (2024) raise a critical issue based on their empirical research. The authors identified 14 papers crediting ChatGPT as an author, including cases where it was listed alongside editors-in-chief, and some of these papers have accrued significant citations, which raise concerns about the definition of authorship, accountability, and the enforcement of ethical standards in academic publishing. Read together with challenges of detecting AI in text these ethical concerns become even more burning. Kandeel and Eldakak (2024) highlight the legal side of ethical concerns. These include risks like copyright violations and plagiarism stemming from unverified or incorrect information generated by ChatGPT (Kandeel & Eldakak, 2024). Malik et al. (2024) also make the case that “creativity may no longer be restricted to the ability to write, but also to use ChatGPT or other large language models (LLMs) to write creatively” which eventually questions the very core of authorship and academic writing and may be a leading thought in the age of AI-assisted research.

AI-detection and the lack of reliability of these systems is probably one of the most capital problems. For example, Popkov and Barrett's (2024) experimental study found significant false positive and false negative rates across free and commercial AI detection tools. Free tools identified 27.2% of academic texts as AI-generated, while commercial software performed better (but still with substantial fault rates) when analyzing text from journals between 2016 and 2018 together with AI-generated content. Newer research, however, show different results, with freely accessible tools being more accurate than certain commercial detectors, such as Turnitin, especially when paraphrased texts were analyzed (Liu et al., 2024). Flitcroft et al. (2024), Chaka (2024), and Liu et al. (2024) also underline the high variability of results in different AI detectors indicating an important limitation in their use. Pan and Florian-Rodriguez's (2024) research which compared human reviewers and AI detectors confirmed the above results. Though at the time of the research humans highly outperformed AI detectors when identifying whether an abstract is generated by AI or is written by humans, there seems to be a vivid ongoing debate on the problems of using AI detectors for reviewing research (Pan & Florian-Rodriguez, 2024).

It is also worth noting that a few papers outline important benefits other than risks, ethical issues, and challenges. Scholars noted the increase in productivity, drafting assistance (especially in the case of non-English authors (Fatima et al., 2024; Li et al., 2024)), improvement in efficiency and patient outcomes (Ambrosio et al., 2023; Carnino et al., 2024; Levin et al., 2023; Li, 2023a; Li et al., 2024; Malik et al., 2024; Wang et al., 2024).

In sum, as noted by Levin et al. (2023), research on ChatGPT is still developing with a plethora of research gaps to explore. It can be stated, however, that there seems to be a crucial need to revise AI-related writing and editorial guidelines in academic publishing as they are either not in frequent use, outdated, or just simply easy to circumvent (Ambrosio et al., 2023). It is also to be underlined that using ChatGPT for research entails an increase in AI hallucinations, especially in terms of references (Albuck et al., 2024; Frosolini et al., 2023) which may be alarming in view of the growing problems surrounding the lack of capacity or, in certain cases, rigor, in peer reviewing (Hoffman, 2021; Tennant & Ross-Hellauer, 2020; Tite & Schroter, 2006). To end this segment, the cautious use of AI in scientific literature to preserve publication standards and reliability is advised with rigorous human oversight (Alberth, 2023; Albuck et al., 2024; AlSagri et al., 2024; Eppler et al., 2023; Fatima et al., 2024; Flitcroft et al., 2024; Lawrence et al., 2024). Furthermore, the strict adherence to copyright laws and academic regulations when utilizing AI tools should be more scrutinized to limit the potential harms (Kandeel & Eldakak, 2024).

Practical Applications and ChatGPT as a Research Assistant

As seen from the ending section in the previous section, integrating AI in academic writing is no longer a question of “when” but rather a question of “how” and more importantly, “how not to”. Though ethical dilemmas, and more focally, plagiarism is a key issue discussed in these papers (Jarrah et al., 2023), research conducted in this group and the pertaining clusters presents substantial benefits.

The common attitude towards ChatGPT is dual: it is both a transformative and a disruptive technology. The tool is noted for its important and facilitative role for non-English authors to prepare, and more importantly, enhance the level of writing of their papers (Cai et al., 2024; Kousha & Thelwall, 2025; Nugroho et al., 2024) and language enhancement is the most common acknowledgement scholars make when citing ChatGPT (Kousha & Thelwall, 2025). It can also be highlighted that academic integrity—though endangered by the overuse of abuse of ChatGPT in writing—may be protected, as it is easier to spot or highlight data errors or fake data or results via ChatGPT (Cai et al., 2024), though there is still significant room for improvement (AlSagri et al., 2024). AlSagri et al. (2024) coined the idea of testing an earlier version (version 3.5) of ChatGPT (and Gemini) as a research assistant and showed that though it often fell short in specific areas, in general, these tools are useful in assisting in explaining papers, exploring data and formatting citations.

In view of these results, we propose adopting the concluding thoughts presented in Andrade-Hidalgo et al. (2024) research which suggests that educators should be encouraged to adopt practical strategies by incorporating the reviewed tools and promoting AI literacy, collaborating with AI experts to develop more effective teaching methods, creating controlled environments where students can safely engage with AI, and providing ongoing training for educators on the ethical use of technology, as these efforts aim to ensure responsible teaching practices that uphold core educational principles. Moreover, on a more technical side of practicability, Cai et al. (2024) note that researchers may benefit from improved knowledge retrieval through the conversational interface of the platform, while journal editors can leverage GPT for manuscript classification and review processes.

As the level of integration of ChatGPT varies and “ChatGPT literacy” is rather rudimentary (Tarchi et al., 2024), there seems to be an important research gap in the effective use of ChatGPT in research and possible ways to meaningfully and ethically integrate the tool in writing other than language enhancement. Furthermore, educational research may also focus in the future on academic training opportunities to ameliorate expertise on the usage of LLMs in research.

Innovation and Scholarly Integration

Reflecting on the opening thoughts of Lozić and Štular's (2023) foundational work, as creativity and creativeness seemingly loses its uniquely human nature, research also tends to shift its focus on how the “new creativeness” brought by ChatGPT can be used for research innovation and integration.

Starting with innovation, mixed-method approaches show that among undergraduate students ChatGPT has positively impacted writing skills which was accompanied by a positive attitude towards the tool as well (Mahapatra, 2024). The latter is of critical importance because Sevnarayan and Potter (2024) found that there is a shift towards a more negative attitude among scholars, and in view of the practical benefits enshrined in this new technology, a new, innovative communication of ChatGPT and its positive side is necessary in Academia (also cf. Bin-Nashwan et al., 2023). This is also important as in other uses of ChatGPT, for example in teaching and learning as well as potential innovative opportunities, academics’ attitude tend to be positive (Maphoto et al., 2024). From a technical viewpoint, it can be noted that ChatGPT evolves innovatively, too. Per AlAfnan and MohdZuki's (2023) findings, ChatGPT's newly versions generate texts of average reading ease and rather low lexical diversity and uses more inclusive language (e.g., using “they” instead of singular forms of third-person pronouns). Though the originality of these texts is still questionable (Lozić & Štular, 2023), the rate at which ChatGPT develops, discussion on its innovative nature should also accelerate.

As for scholarly integration, Kong et al. (2024) introduces a 6-phase (6P) program to meaningfully and effectively integrate generative AI in academic writing. This proposed pedagogical framework begins with the Plan phase, where students develop a clear outline of their writing's content and structure, ensuring control over the process by defining the thesis and organizing ideas effectively. In the Prompt phase, students craft and refine prompts to interact with generative AI tools, guiding the AI to generate content aligned with their goals. During the Preview phase, students critically evaluate the AI-generated output for accuracy, coherence, and alignment with their objectives, correcting errors and cross-referencing with credible sources. The Produce phase requires students to integrate the validated AI-generated ideas with academic references and their perspectives to create a coherent and credible piece of writing. In the Peer Review phase, students exchange feedback with peers to improve the quality, clarity, and depth of their work. Finally, the Portfolio-Tracking phase involves reflecting on the entire process, assessing performance, and developing strategies to enhance their use of AI tools for future academic writing tasks. This framework emphasizes self-regulation, critical thinking, and ethical engagement with AI in educational contexts. (Kong et al., 2024).

Regarding a broader understanding of integration, it is worth revisiting the detection-dilemma set forth in Group 1. Chaka's (2024) comprehensive detector-testing research shows that integration should entail a combinative approach to AI-detection which is built on both newer, AI-specific detectors as well as traditional plagiarism detectors with the input and oversight of humans.

Summary of Key Themes in the Literature on ChatGPT in Academic Writing

In order to provide a more accessible overview of the findings discussed throughout the above-detailed sections, Table 6 below summarizes the core thematic areas identified through the DCA. These areas, namely, ethical risks, practical applications, and pedagogical innovation, all emerged consistently in some form across multiple clusters. The goal of this synthesis is to condense a large and diverse body of literature into a comparative format that highlights not only what is being discussed, but why it matters for academic institutions, researchers, and policymakers. Firstly, ethical challenges such as fabricated citations, ambiguous authorship, and unreliable AI detection mechanisms appear to dominate the discourse, particularly in empirical studies from the medical and STEM fields. In parallel, researchers have begun exploring functional uses of ChatGPT, particularly in assisting non-native speakers, improving clarity, and automating low-level writing tasks. Subsequently, there is no clear scientific stance on the direct use of ChatGPT in academic writing as there certainly are useful and practical benefits, however, ChatGPT-enhance works are tempered by concerns over factual reliability and the risk of academic dependency. Secondly, from pedagogical standpoint, a number of studies propose structured integration frameworks that seek to maintain academic rigor while embracing AI as a tool for enhancing learning and scholarly expression. Nonetheless, attitudes among educators remain mixed and there is a growing consensus that responsible use, guided by clear ethical policies and transparent disclosure, is more sustainable than outright bans or unchecked adoption. We propose that the below thematic synthesis helps clarify not only the breadth of ongoing debates but, more importantly, also the emerging areas where more theoretical grounding, policy development, and empirical testing are needed. (Table 6)

Table 6.

Summary of the Discourse on ChatGPT in Academic Writing.

Thematic Area Key Issues / Findings Implications for Academia
Risks and ethical challenges
  • Hallucinated references and fabricated data

  • Inconsistent AI-detection tools- Ambiguity in authorship and accountability

  • Policy gaps in journals

Use of ChatGPT is likely to undermine credibility of academic outputs and it also weakens peer review and editorial oversight. There is an urgent need for coherent journal policies.
Plagiarism and integrity concerns
  • Use of AI tools without disclosure

  • Redefined notions of creativity and originality

  • Potential legal risks in copyright and licensing

A significant risk is the threat to academic honesty and originality which requires (1) updated definitions of misconduct and (2) better disclosure norms.
Practical applications
  • Assistance for non-native speakers

  • Improvements in writing clarity, formatting, and summarizing

While risks do exist, as a positive, it should be underlined that ChatGPT is proven to enhance productivity and access. Furthermore, since it offers language equity and supports research tasks, especially for early-career scholars, AI may be used to help the integration of non-native scholars.
Limitations of practical use
  • Inability to fact-check or verify data and the dependency and overuse risk (including limited reasoning depth)

It is argued in nearly all sources that LLMs should supplement, not replace, researcher judgment. Human oversight is still essential in data-driven work and the sole reliance on ChatGPT is not sufficient nor adequate in academic work.
Pedagogical integration and innovation
  • Positive reception among students

  • Programs for responsible AI use and inclusive language and style potential

It is stated that ChatGPT, indeed, supports critical thinking and self-regulated learning in a specific way. However, its use requires training and a more outlined institutional alignment.
Academic culture and attitudes
  • Mixed perceptions among educators

  • Hesitation due to ethical fears vs. optimism for instructional utility

There is an urgent need for culture shift and dialogue across disciplines. This could be commenced by the normalization of transparent AI use through policy and pedagogy.

As an ending to the discussion, we also acknowledge that our findings have several limitations. First of all, since drew our data exclusively from English-language Scopus-indexed literature, it may have affected the inclusivity of our research and given Scopus's innate limitations, the findings potentially underrepresent perspectives from non-Western and non-English contexts. Moreover, software constraints in CiteSpace limited the detection of citation bursts, excluding emerging yet uncited work. Future research should address these limitations by integrating qualitative content analysis, and prospectively, expert interviews. Expanding data sources to include preprints and non-English publications.

Research Agenda

Building on our findings, we propose that future research should move beyond identifying risks and begin addressing concrete institutional and disciplinary needs. Although ethical concerns remain undisputed and central, there is limited insight into how journal editors, peer reviewers, and academic institutions are adapting to AI-assisted writing. Research should examine how policies are evolving, where inconsistencies remain, and how detection and disclosure practices can be standardized. Furthermore, studies should explore ChatGPT's role in promoting or complicating scholarly equity, especially for non-native English speakers and under-resourced researchers. Few papers assess whether generative AI narrows global academic inequalities or creates new forms of dependency. These questions are critical as AI tools become more accessible across diverse educational contexts. Lastly, there is a burning need for more developed theoretical frameworks as most current literature remains descriptive or, in some cases, anecdotal. Future work should incorporate ethical, epistemological, or STS frameworks to analyze AI's impact on scholarly norms, authorship, and publication culture. In this regard, longitudinal studies could track how AI reshapes academic writing genres and disciplinary communication over time. Lastly, further bibliometric and scientometric papers would be necessary to better outline research venues for other disciplines.

Educational Implications

In view of the literature, the integration of ChatGPT into educational settings must be addressed with urgency, as the technology presents both transformative opportunities and serious challenges. The problem of integration, however, is a complex issue and should be treated with adequate supervision. On the one hand, ChatGPT can enhance learning by offering personalized, iterative writing support (cf. Oates & Johnson, 2025), particularly for students struggling with language or expression. It may also encourage exploratory thinking when used as a brainstorming tool (see Almumen & Jouhar, 2025). However, concerns over over-reliance and academic dishonesty are valid. An important implication to consider is to help mitigate these risks, institutions through implement structured AI-use policies in coursework, including clear guidelines on disclosure, permitted tasks, and expectations for independent contributions. In this regard, AI literacy programs are essential at both undergraduate and postgraduate levels (Almatrafi et al., 2024; Ng et al., 2023). These programs should go beyond technical use and include ethical reasoning, limitations of generative tools, and practical use cases. For example, the 6P pedagogical framework proposed by Kong et al. (2024) offers a step-by-step integration model for AI in academic writing courses. Universities might also consider incorporating AI-focused modules into academic integrity or digital research skills curricula (cf. Rudolph et al., 2024 and Naznin et al., 2025). Moreover, faculty development is key. Educators require training and support to stay ahead of technological shifts and to design assignments that encourage meaningful engagement rather than shortcutting learning.

Best Practices

Scholars integrating ChatGPT into academic workflows must exercise extreme caution to preserve the integrity and reliability of their work. It is undeniable that ChatGPT offers valuable support in drafting, editing, and language enhancement among a plethora of other benefits, however, its susceptibility to generating hallucinated references, factual inaccuracies, and biased outputs poses significant risks. Banning or restricting ChatGPT in academic knowledge production with the current detection systems is nearly impossible. Therefore, to mitigate these challenges, researchers should always verify AI-generated content against credible sources and should always refrain from using ChatGPT for generating primary research data or references. Transparency is paramount; scholars should disclose their use of AI tools in all academic outputs to maintain ethical accountability. On a more holistic level, there is a clear need for the development of best practices in academic institutions. Employing hybrid AI-detection systems alongside human oversight can ensure that scholarly outputs remain authentic and credible and should be more accentuated in scholarly and editorial guidelines. Lastly, scholars are also encouraged to explore ChatGPT as a supplementary tool for idea generation or language refinement rather than as a primary authoring resource. Adopting these best practices can help balance the benefits of ChatGPT with the need to uphold rigorous academic standards and ethical norms.

Conclusions

Our study aimed at systematically mapping the research landscape of ChatGPT in academic writing through document co-citation analysis with CiteSpace. We identified major thematic clusters as well as emerging intellectual trends. Our findings reveal a dual narrative. While ChatGPT enhances accessibility, especially for non-native speakers and under-resourced authors, it simultaneously raises serious concerns regarding authorship, plagiarism, the validity of the generated content, and the limitations of AI-detection tools. Although some journals have banned AI tools from authorship credit, others lack explicit guidance, leading to inconsistencies in ethical enforcement. We find it critical to emphasize that addressing this issue is urgent as these policy and scholarly ethical gaps in the terms of use of LLM in writing be mitigated through clearly articulated disclosure requirements and institutional policies. Our study also suggests that research on ChatGPT should expand beyond ethical polemics. There is a need to include deeper investigations into disciplinary applications, equity, and the long-term impact on scholarly communication and future research must be both interdisciplinary and cross-cultural, capturing the diverse ways generative AI is shaping academic work. We claim that a proactive and collaborative approach among educators, researchers, and policymakers will be essential in ensuring that AI augments rather than undermines the integrity of academic knowledge production.

Author Biography

Gergely Ferenc Lendvai is a visiting research fellow in interdisciplinary social sciences and humanities at the University of Richmond and a PhD fellow at Ludovika University of Public Service, Hungary. His research interests include scientometrics, research evaluation, academic writing, research ethics, and research funding. He is the sole author and drafter of the present research which included data curation, visualization, analysis, and manuscript drafting.

Footnotes

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Project no. TKP2021-NKTA-51 has been implemented with the support provided by the Ministry of Culture and Innovation of Hungary from the National Research, Development and Innovation Fund, financed under the A TKP2021-NKTA funding scheme.

ORCID iD: Gergely Ferenc Lendvai https://orcid.org/0000-0003-3298-8087

Data Availability: The dataset used is attached.

References

  1. Abdelwahab S. I., Farasani A., Alfaifi H. A., Hassan W. (2024). Bibliometric analysis of ChatGPT and plastic surgery research: Insights from diverse search strategies and co-word analysis. Chinese Journal of Plastic and Reconstructive Surgery, 6(4), 185–195. 10.1016/j.cjprs.2024.10.002 [DOI] [Google Scholar]
  2. AlAfnan M. A., MohdZuki S. F. (2023). Do Artificial Intelligence Chatbots Have a Writing Style? An Investigation into the Stylistic Features of ChatGPT-4. Journal of Artificial Intelligence and Technology, 3(3), 85–94. 10.37965/jait.2023.0267 [DOI] [Google Scholar]
  3. Alberth N. (2023). The use of Chatgpt in academic writing: A blessing or a curse in disguise? TEFLIN Journal - a Publication on the Teaching and Learning of English, 34(2), 337–352. 10.15639/teflinjournal.v34i2/337-352 [DOI] [Google Scholar]
  4. Albuck A. L., Becnel C. M., Sirna D. J., Turner J. (2024). Precision of Chatbot generative pretrained transformer version 4-generated references for colon and rectal surgical literature. Journal of Surgical Research, 302, 324–328. 10.1016/j.jss.2024.07.021 [DOI] [PubMed] [Google Scholar]
  5. Alkaissi H., McFarlane S. I. (2023). Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus, 15(2), 1–4. 10.7759/cureus.35179 [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Almatrafi O., Johri A., Lee H. (2024). A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023). Computers and Education Open, 6, 100173. 10.1016/j.caeo.2024.100173 [DOI] [Google Scholar]
  7. Almumen H. A., Jouhar M. R. (2025). The impact of ChatGPT as a brainstorming tool on gifted Students’ persuasive writing. Journal of Writing Research, 229–326. https://www.jowr.org/jowr/article/view/1514/996 [Google Scholar]
  8. AlSagri H. S., Farhat F., Sohail S. S., Saudagar A. K. J. (2024). ChatGPT or Gemini: Who Makes the Better Scientific Writing Assistant? Journal of Academic Ethics. 10.1007/s10805-024-09549-0 [DOI] [Google Scholar]
  9. Ambrosio L., Schol J., La Pietra V. A., Russo F., Vadalà G., Sakai D. (2023). Threats and opportunities of using ChatGPT in scientific writing—The risk of getting spineless. JOR Spine, 7(1), 1–3. 10.1002/jsp2.1296 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Andrade-Hidalgo G., Mio-Cango P., Iparraguirre-Villanueva O. (2024). Exploring the impact of artificial intelligence on research ethics - A Systematic review. Journal of Academic Ethics. 10.1007/s10805-024-09579-8 [DOI] [Google Scholar]
  11. Appio F. P., Cesaroni F., Di Minin A. (2014). Visualizing the structure and bridges of the intellectual property management and strategy literature: A document co-citation analysis. Scientometrics, 101(1), 623–661. 10.1007/s11192-014-1329-0 [DOI] [Google Scholar]
  12. Baas J., Schotten M., Plume A., Côté G., Karimi R. (2020). Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies. Quantitative Science Studies, 1(1), 377–386. 10.1162/qss_a_00019 [DOI] [Google Scholar]
  13. Baber H., Nair K., Gupta R., Gurjar K. (2023). The beginning of ChatGPT – a systematic and bibliometric review of the literature. Information and Learning Sciences, 125(7/8), 587–614. 10.1108/ils-04-2023-0035 [DOI] [Google Scholar]
  14. Bai˙doo-Anu D., Ansah L. O. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52–62. 10.61969/jai.1337500 [DOI] [Google Scholar]
  15. Bin-Nashwan S. A., Sadallah M., Bouteraa M. (2023). Use of ChatGPT in academia: Academic integrity hangs in the balance. Technology in Society, 75, 102370. 10.1016/j.techsoc.2023.102370 [DOI] [Google Scholar]
  16. Bradley J., Devarakonda S., Davey A., Korobskiy D., Liu S., Lakhdar-Hamina D., Warnow T., Chacko G. (2019). Co-citations in context: Disciplinary heterogeneity is relevant. Quantitative Science Studies, 1(1), 264–276. 10.1162/qss_a_00007 [DOI] [Google Scholar]
  17. Cai Q., Lin Y., Yu Z. (2024). Factors influencing learner attitudes towards ChatGPT-assisted language learning in higher education. International Journal of Human-Computer Interaction, 40(22), 7112–7126. 10.1080/10447318.2023.2261725 [DOI] [Google Scholar]
  18. Carnino J. M., Chong N. Y. K., Bayly H., Salvati L. R., Tiwana H. S., Levi J. R. (2024). AI-generated text in otolaryngology publications: A comparative analysis before and after the release of ChatGPT. European Archives of Oto-Rhino-Laryngology, 281(11), 6141–6146. 10.1007/s00405-024-08834-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Cataldo I., Lieu A. A., Carollo A., Bornstein M. H., Gabrieli G., Lee A., Esposito G. (2022). From the cradle to the web: The growth of “sharenting”—A scientometric perspective. Human Behavior and Emerging Technologies, 2022, 1–12. 10.1155/2022/5607422 [DOI] [Google Scholar]
  20. Chaka C. (2024). Reviewing the performance of AI detection tools in differentiating between AI-generated and human-written texts: A literature and integrative hybrid review. Journal of Applied Learning & Teaching, 7(1), 115–126. 10.37074/jalt.2024.7.1.14 [DOI] [Google Scholar]
  21. Chen C. (2004). Searching for intellectual turning points: Progressive knowledge domain visualization. Proceedings of the National Academy of Sciences, 101(suppl_1), 5303–5310. 10.1073/pnas.0307513100 [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Chen C. (2005). Citespace II: Detecting and visualizing emerging trends and transient patterns in scientific literature. Journal of the American Society for Information Science and Technology, 57(3), 359–377. 10.1002/asi.20317 [DOI] [Google Scholar]
  23. Chen C., Ibekwe-SanJuan F., Hou J. (2010). The structure and dynamics of cocitation clusters: A multiple-perspective cocitation analysis. Journal of the American Society for Information Science and Technology, 61(7), 1386–1409. 10.1002/asi.21309 [DOI] [Google Scholar]
  24. Cotton D. R. E., Cotton P. A., Shipway J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239. 10.1080/14703297.2023.2190148 [DOI] [Google Scholar]
  25. Dahlan M. A., Omar R., Kamarudin S. (2024). ChatGPT in academia: A holistic examination of student performance and future implications. In A. Hamdan & A. Harraf (Eds.), Business development via AI and digitalization. Studies in systems, decision and control (vol. 538. pp. 617–627). Springer, Cham. 10.1007/978-3-031-62102-4_51 [DOI] [Google Scholar]
  26. Da Silva J. a. T. (2023). MANUSCRIPTS WITH FAKE CHATGPT-CREATED REFERENCES: A CASE STUDY. Central Asian Journal of Medical Hypotheses and Ethics, 4(3), 168–171. 10.47316/cajmhe.2023.4.3.05 [DOI] [Google Scholar]
  27. Day T. (2023). A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. The Professional Geographer, 75(6), 1024–1027. 10.1080/00330124.2023.2190373 [DOI] [Google Scholar]
  28. Dwivedi Y. K., Kshetri N., Hughes L., Slade E. L., Jeyaraj A., Kar A. K., Baabdullah A. M., Koohang A., Raghavan V., Ahuja M., Albanna H., Albashrawi M. A., Al-Busaidi A. S., Balakrishnan J., Barlette Y., Basu S., Bose I., Brooks L., Buhalis D., … Wright R. (2023). Opinion paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. 10.1016/j.ijinfomgt.2023.102642 [DOI] [Google Scholar]
  29. Emsley R. (2023). ChatGPT: these are not hallucinations – they’re fabrications and falsifications. Schizophrenia, 9(1), 1–2. 10.1038/s41537-023-00379-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Eppler M., Ganjavi C., Ramacciotti L. S., Piazza P., Rodler S., Checcucci E., Rivas J. G., Kowalewski K. F., Belenchón I. R., Puliatti S., Taratkin M., Veccia A., Baekelandt L., Teoh J. Y., Somani B. K., Wroclawski M., Abreu A., Porpiglia F., Gill I. S., … Cacciamani G. E. (2023). Awareness and use of ChatGPT and large language models: A prospective cross-sectional global survey in urology. European Urology, 85(2), 146–153. 10.1016/j.eururo.2023.10.014 [DOI] [PubMed] [Google Scholar]
  31. Farhat F., Silva E. S., Hassani H., Madsen DØ, Sohail S. S., Himeur Y., Alam M. A., Zafar A. (2024). The scholarly footprint of ChatGPT: a bibliometric analysis of the early outbreak phase. Frontiers in Artificial Intelligence, 6, 1–18. https://doi.org/10.3389/frai.2023.1270749 [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Farhat F., Sohail S. S., Madsen DØ. (2023). How trustworthy is ChatGPT? The case of bibliometric analyses. Cogent Engineering, 10(1), 1–8. 10.1080/23311916.2023.2222988 [DOI] [Google Scholar]
  33. Fatima A., Shafique M. A., Alam K., Ahmed T. K. F., Mustafa M. S. (2024). ChatGPT in medicine: A cross-disciplinary systematic review of ChatGPT’s (artificial intelligence) role in research, clinical practice, education, and patient interaction. Medicine, 103(32), e39250. 10.1097/md.0000000000039250 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Flitcroft M. A., Sheriff S. A., Wolfrath N., Maddula R., McConnell L., Xing Y., Haines K. L., Wong S. L., Kothari A. N. (2024). Performance of artificial intelligence content detectors using human and artificial intelligence-generated scientific writing. Annals of Surgical Oncology, 31(10), 6387–6393. 10.1245/s10434-024-15549-6 [DOI] [PubMed] [Google Scholar]
  35. Frosolini A., Franz L., Benedetti S., Vaira L. A., De Filippis C., Gennaro P., Marioni G., Gabriele G. (2023). Assessing the accuracy of ChatGPT references in head and neck and ENT disciplines. European Archives of Oto-Rhino-Laryngology, 280(11), 5129–5133. 10.1007/s00405-023-08205-4 [DOI] [PubMed] [Google Scholar]
  36. Gross N. (2023). What ChatGPT tells us about gender: A cautionary tale about performativity and gender biases in AI. Social Sciences, 12(8), 435. 10.3390/socsci12080435 [DOI] [Google Scholar]
  37. Hassan E., Bhatnagar R., Shams M. Y. (2023). Advancing scientific research in computer science by ChatGPT and LLaMA—A review. In P. H. V. S. Talpa Sai, S. Potnuru, M., Avcar, & V.Ranjan Kar (Eds.), Intelligent Manufacturing and Energy Sustainability. ICIMES 2023. Smart Innovation, Systems and Technologies (vol. 372, pp. 23–37). Springer, Singapore. 10.1007/978-981-99-6774-2_3 [DOI] [Google Scholar]
  38. Helberger N., Diakopoulos N. (2023). ChatGPT and the AI Act. Internet Policy Review, 12(1), 1–6. 10.14763/2023.1.1682 [DOI] [Google Scholar]
  39. Hoffman A. J. (2021). A modest proposal to the peer review process: A collaborative and interdisciplinary approach in the assessment of scholarly communication. Research Ethics, 18(1), 84–91. 10.1177/17470161211051230 [DOI] [Google Scholar]
  40. Huang Z. A. (2024). Terminology, AI bias, and the risks of current digital public diplomacy practices. Place Branding and Public Diplomacy, 1–7. 10.1057/s41254-024-00324-x [DOI] [Google Scholar]
  41. Jarrah A. M., Wardat Y., Fidalgo P. (2023). Using ChatGPT in academic writing is (not) a form of plagiarism: What does the literature say? Online Journal of Communication and Media Technologies, 13(4), e202346. 10.30935/ojcmt/13572 [DOI] [Google Scholar]
  42. Jelica S., Miroslav M., Uroš Š. (2024). Possible applications of ChatGPT in higher education. In: J. A. d. C. Gonçalves, J. L. S. d. M. Lima, J. P. Coelho, F. J. García-Peñalvo, A. García-Holgado. (Eds.), Proceedings of TEEM 2023. TEEM 2023. Lecture notes in educational technology (pp. 135-144). Springer, Singapore. 10.1007/978-981-97-1814-6_13 [DOI] [Google Scholar]
  43. Kandeel M. E., Eldakak A. (2024). Legal dangers of using ChatGPT as a co-author according to academic research regulations. Journal of Governance and Regulation, 13(1, special Issue), 289–298. 10.22495/jgrv13i1siart3 [DOI] [Google Scholar]
  44. Karakose T. (2023). The Utility of ChatGPT in Educational Research—Potential Opportunities and Pitfalls. Educational Process International Journal, 12(2), 7–13. 10.22521/edupij.2023.122.1 [DOI] [Google Scholar]
  45. Kasneci E., Sessler K., Küchemann S., Bannert M., Dementieva D., Fischer F., Gasser U., Groh G., Günnemann S., Hüllermeier E., Krusche S., Kutyniok G., Michaeli T., Nerdel C., Pfeffer J., Poquet O., Sailer M., Schmidt A., Seidel T., … Kasneci G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. 10.1016/j.lindif.2023.102274 [DOI] [Google Scholar]
  46. Khowaja S. A., Khuwaja P., Dev K., Wang W., Nkenyereye L. (2024). ChatGPT needs SPADE (sustainability, PrivAcy, digital divide, and ethics). Evaluation: A Review. Cognitive Computation, 16(5), 2528–2550. 10.1007/s12559-024-10285-1 [DOI] [Google Scholar]
  47. Kong S., Lee J. C., Tsang O. (2024). A pedagogical design for self-regulated learning in academic writing using text-based generative artificial intelligence tools: 6-P pedagogy of plan, prompt, preview, produce, peer-review, portfolio-tracking. Research and Practice in Technology Enhanced Learning, 19, 030. 10.58459/rptel.2024.19030 [DOI] [Google Scholar]
  48. Kousha K., Thelwall M. (2025). Assessing the societal influence of academic research with ChatGPT: Impact case study evaluations. Journal of the Association for Information Science and Technology. 10.1002/asi.25021 [DOI] [Google Scholar]
  49. Labouchère A., Raffoul W. (2024). ChatGPT and bard in plastic surgery: Hype or hope? Surgeries, 5(1), 37–48. 10.3390/surgeries5010006 [DOI] [Google Scholar]
  50. Lawrence K. W., Habibi A. A., Ward S. A., Lajam C. M., Schwarzkopf R., Rozell J. C. (2024). Human versus artificial intelligence-generated arthroplasty literature: A single-blinded analysis of perceived communication, quality, and authorship source. International Journal of Medical Robotics and Computer Assisted Surgery, 20(1), e2621. 10.1002/rcs.2621 [DOI] [PubMed] [Google Scholar]
  51. Leboukh F., Aduku E. B., Ali O. (2023). Balancing ChatGPT and data protection in Germany: Challenges and opportunities for policy makers. Journal of Politics and Ethics in New Technologies and AI, 2(1), e35166. 10.12681/jpentai.35166 [DOI] [Google Scholar]
  52. Levin G., Brezinov Y., Meyer R. (2023). Exploring the use of ChatGPT in OBGYN: A bibliometric analysis of the first ChatGPT-related publications. Archives of Gynecology and Obstetrics, 308(6), 1785–1789. 10.1007/s00404-023-07081-x [DOI] [PubMed] [Google Scholar]
  53. Li J. (2023a). Security implications of AI chatbots in health care. Journal of Medical Internet Research, 25, e47551. 10.2196/47551 [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Li L. (2023b). Role of chatbots on gastroenterology: Let's chat about the future. Gastroenterology & Endoscopy, 1(3), 144–149. 10.1016/j.gande.2023.06.002 [DOI] [Google Scholar]
  55. Li J., Zong H., Wu E., Wu R., Peng Z., Zhao J., Yang L., Xie H., Shen B. (2024). Exploring the potential of artificial intelligence to enhance the writing of English academic papers by non-native English-speaking medical students - the educational application of ChatGPT. BMC Medical Education, 24(1). 10.1186/s12909-024-05738-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Limna P., Kraiwanit T., Jangjarat K., Klayklung P., Chocksathaporn P. (2023). The use of ChatGPT in the digital era: Perspectives on chatbot implementation. Journal of Applied Learning & Teaching, 6(1). 10.37074/jalt.2023.6.1.32 [DOI] [Google Scholar]
  57. Lin S., Chung H., Chung F., Lan Y. (2023). Concerns about using ChatGPT in education. In: Y. M. Huang & T. Rocha (Eds.), Innovative technologies and learning. ICITL 2023. Lecture Notes in Computer Science (vol. 14099, pp. 37–49). Springer, Cham. 10.1007/978-3-031-40113-8_4 [DOI] [Google Scholar]
  58. Liu D., Che S., Zhu W. (2022). Visualizing the Knowledge Domain of Academic Mobility Research from 2010 to 2020: A Bibliometric Analysis Using CiteSpace. SAGE Open, 12(1). 10.1177/21582440211068510 [DOI] [Google Scholar]
  59. Liu J. Q. J., Hui K. T. K., Zoubi F. A., Zhou Z. Z. X., Samartzis D., Yu C. C. H., Chang J. R., Wong A. Y. L. (2024). The great detectives: humans versus AI detectors in catching large language model-generated medical writing. International Journal for Educational Integrity, 20(1). 10.1007/s40979-024-00155-6 [DOI] [Google Scholar]
  60. Lozić E., Štular B. (2023). Fluent but not factual: A comparative analysis of ChatGPT and other AI Chatbots’ proficiency and originality in scientific writing for humanities. Future Internet, 15(10), 336. 10.3390/fi15100336 [DOI] [Google Scholar]
  61. Mahapatra S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study. Smart Learning Environments, 11(1), 1–18. 10.1186/s40561-024-00295-9 [DOI] [Google Scholar]
  62. Malik M. A., Amjad A. I., Aslam S., Fakhrou A. (2024). Global insights: ChatGPT’s influence on academic and research writing, creativity, and plagiarism policies. Frontiers in Research Metrics and Analytics, 9. 10.3389/frma.2024.1486832 [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Maphoto K. B., Sevnarayan K., Mohale N. E., Suliman Z., Ntsopi T. J., Mokoena D. (2024). Advancing Students’ academic excellence in distance education: Exploring the potential of generative AI integration to improve academic writing skills. Open Praxis, 16(2), 142–159. 10.55982/openpraxis.16.2.649 [DOI] [Google Scholar]
  64. Moher D., Liberati A., Tetzlaff J., Altman D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ, 339(1), b2535. 10.1136/bmj.b2535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Motoki F., Neto V. P., Rodrigues V. (2023). More human than human: Measuring ChatGPT political bias. Public Choice, 198(1–2), 3–23. 10.1007/s11127-023-01097-2 [DOI] [Google Scholar]
  66. Mustafee N., Katsaliaki K., Fishwick P. (2013). Exploring the modelling and simulation knowledge base through journal co-citation analysis. Scientometrics, 98(3), 2145–2159. 10.1007/s11192-013-1136-z [DOI] [Google Scholar]
  67. Nazarovets S., Da Silva J. a. T. (2024). ChatGPT as an “author”: Bibliometric analysis to assess the validity of authorship. Accountability in Research, 1–11. 10.1080/08989621.2024.2345713 [DOI] [PubMed] [Google Scholar]
  68. Naznin K., Mahmud A. A., Nguyen M., Chua C. (2025). ChatGPT integration in higher education for personalized learning, academic writing, and coding tasks: A systematic review. Computers, 14(2), 53. 10.3390/computers14020053 [DOI] [Google Scholar]
  69. Newman M. E. J. (2006). Modularity and community structure in networks. Proceedings of the National Academy of Sciences, 103(23), 8577–8582. 10.1073/pnas.0601602103 [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Ng D. T. K., Su J., Leung J. K. L., Chu S. K. W. (2023). Artificial intelligence (AI) literacy education in secondary schools: A review. Interactive Learning Environments, 32(10), 6204–6224. 10.1080/10494820.2023.2255228 [DOI] [Google Scholar]
  71. Nugroho A., Andriyanti E., Widodo P., Mutiaraningrum I. (2024). Students’ appraisals post-ChatGPT use: Students’ narrative after using ChatGPT for writing. Innovations in Education and Teaching International, 1–13. 10.1080/14703297.2024.2319184 [DOI] [Google Scholar]
  72. Oates A., Johnson D. (2025). ChatGPT in the Classroom: Evaluating its Role in Fostering Critical Evaluation Skills. International Journal of Artificial Intelligence in Education, 1–32. 10.1007/s40593-024-00452-8 [DOI] [Google Scholar]
  73. Oliński M., Krukowski K., Sieciński K. (2024). Bibliometric overview of ChatGPT: New perspectives in social sciences. Publications, 12(1), 9. 10.3390/publications12010009 [DOI] [Google Scholar]
  74. Page M. J. McKenzie J. E. Bossuyt P. M. Boutron I. Hoffmann T. C. Mulrow C. D. Shamseer L. Tetzlaff J. M. Akl E. A. Brennan S. E. Chou R. Glanville J. Grimshaw J. M. Hróbjartsson A. Lalu M. M. Li T. Loder E. W. Mayo-Wilson E. McDonald S.,… Moher D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, n71. https://doi.org/10.1136/bmj.n71 [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Pan E. T., Florian-Rodriguez M. (2024). Human vs machine: Identifying ChatGPT-generated abstracts in gynecology and urogynecology. American Journal of Obstetrics and Gynecology, 231(2), 276.e1–276.e10. 10.1016/j.ajog.2024.04.045 [DOI] [PubMed] [Google Scholar]
  76. Ping Q., He J., Chen C. (2017). How many ways to use CiteSpace? A study of user interactive events over 14 months. Journal of the Association for Information Science and Technology, 68(5), 1234–1256. 10.1002/asi.23770 [DOI] [Google Scholar]
  77. Popkov A. A., Barrett T. S. (2024). AI Vs academia: Experimental study on AI text detectors’ accuracy in behavioral health academic writing. Accountability in Research, 1–17. 10.1080/08989621.2024.2331757 [DOI] [PubMed] [Google Scholar]
  78. Qu Y., Wang J. (2024). Performance and biases of Large Language Models in public opinion simulation. Humanities and Social Sciences Communications, 11(1), 1–13. 10.1057/s41599-024-03609-x [DOI] [Google Scholar]
  79. Ray P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121–154. 10.1016/j.iotcps.2023.04.003 [DOI] [Google Scholar]
  80. Rozado D. (2023). The political biases of ChatGPT. Social Sciences, 12(3), 148. 10.3390/socsci12030148 [DOI] [Google Scholar]
  81. Rudolph J., Ismail F. M. M., Popenici S. (2024). Higher education’s generative artificial intelligence paradox: The meaning of Chatbot mania. Journal of University Teaching and Learning Practice, 21(6), 1–35. 10.53761/54fs5e77 [DOI] [Google Scholar]
  82. Rudolph J., Tan S., Tan S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1), 342–363. 10.37074/jalt.2023.6.1.9 [DOI] [Google Scholar]
  83. Safdar M., Siddique N., Gulzar A., Adil S. A., Yasin H., Khan M. A. (2024a). A bibliometric analysis of literature published on ChatGPT and GPT. Global Knowledge, Memory and Communication. 10.1108/gkmc-08-2023-0304 [DOI] [Google Scholar]
  84. Safdar M., Siddique N., Gulzar A., Yasin H., Khan M. A. (2024b). Does ChatGPT generate fake results? Challenges in retrieving content through ChatGPT. Digital Library Perspectives, 40(4), 668–680. 10.1108/dlp-01-2024-0006 [DOI] [Google Scholar]
  85. Sanguri K., Bhuyan A., Patra S. (2020). A semantic similarity adjusted document co-citation analysis: A case of tourism supply chain. Scientometrics, 125(1), 233–269. 10.1007/s11192-020-03608-0 [DOI] [Google Scholar]
  86. Schmidt H. G., Rotgans J. I., Mamede S. (2024). Bias Sensitivity in Diagnostic Decision-Making: Comparing ChatGPT with Residents. Journal of General Internal Medicine, 40, 790–795. 10.1007/s11606-024-09177-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  87. Sebastian G. (2023). Privacy and data protection in ChatGPT and other AI chatbots. International Journal of Security and Privacy in Pervasive Computing, 15(1), 1–14. 10.4018/ijsppc.325475 [DOI] [Google Scholar]
  88. Sevnarayan K., Potter M. (2024). Generative Artificial Intelligence in distance education: Transformations, challenges, and impact on academic integrity and student voice. Journal of Applied Learning & Teaching, 7(1), 104–114. 10.37074/jalt.2024.7.1.41 [DOI] [Google Scholar]
  89. Solomon D. H., Allen K. D., Katz P., Sawalha A. H., Yelin E. (2023). ChatGPT, et al. … artificial intelligence, authorship, and medical publishing. ACR Open Rheumatology, 5(6), 288–289. 10.1002/acr2.11538 [DOI] [PMC free article] [PubMed] [Google Scholar]
  90. Taktak M., Bellibas M. S., Özgenel M. (2024). Use of ChatGPT in Education: Future Strategic Road Map with SWOT Analysis. Educational Process International Journal, 13(3), 7–21. 10.22521/edupij.2024.133.1 [DOI] [Google Scholar]
  91. Tang B. L. (2024). Did ChatGPT ask or agree to be a (co)author? ChatGPT authorship reflects the wider problem of inappropriate authorship practices. Science Editing, 11(2), 93–95. 10.6087/kcse.337 [DOI] [Google Scholar]
  92. Tarchi C., Zappoli A., Ledesma L. C., Brante E. W. (2024). The use of ChatGPT in source-based writing tasks. International Journal of Artificial Intelligence in Education. 10.1007/s40593-024-00413-1 [DOI] [Google Scholar]
  93. Tennant J. P., Ross-Hellauer T. (2020). The limitations to our understanding of peer review. Research Integrity and Peer Review, 5(1), 1–14. 10.1186/s41073-020-00092-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  94. Tian Q., Yi W., Wang P., Xu X., Zhang Y. (2023). Bibliometric analysis of research on ChatGPT: Using VOSviewer. In ICETM ‘23: Proceedings of the 2023 6th International Conference on Educational Technology Management (pp. 235–243). 10.1145/3637907.3637979 [DOI] [Google Scholar]
  95. Tite L., Schroter S. (2006). Why do peer reviewers decline to review? A survey. Journal of Epidemiology & Community Health, 61(1), 9–12. 10.1136/jech.2006.049817 [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. Tlili A., Shehata B., Adarkwah M. A., Bozkurt A., Hickey D. T., Huang R., Agyemang B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 1–24. 10.1186/s40561-023-00237-x [DOI] [Google Scholar]
  97. Trujillo C. M., Long T. M. (2018). Document co-citation analysis to enhance transdisciplinary research. Science Advances, 4(1), 1–9. 10.1126/sciadv.1701130 [DOI] [PMC free article] [PubMed] [Google Scholar]
  98. Twinomurinzi H., Gumbo S. (2023). ChatGPT in scholarly discourse: Sentiments and an inflection point. In Communications in computer and information science (pp. 258–272). 10.1007/978-3-031-39652-6_17 [DOI] [Google Scholar]
  99. Van Woudenberg R., Ranalli C., Bracker D. (2024). Authorship and ChatGPT: A Conservative View. Philosophy & Technology, 37(1), 1–26. 10.1007/s13347-024-00715-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  100. Wang J., Liao Y., Liu S., Zhang D., Wang N., Shu J., Wang R. (2024). The impact of using ChatGPT on academic writing among medical undergraduates. Annals of Medicine, 56(1), 1–9. 10.1080/07853890.2024.2426760 [DOI] [PMC free article] [PubMed] [Google Scholar]
  101. Wei X., Chu X., Geng J., Wang Y., Wang P., Wang H., Wang C., Lei L. (2024). Societal impacts of chatbot and mitigation strategies for negative impacts: A large-scale qualitative survey of ChatGPT users. Technology in Society, 77, 102566. 10.1016/j.techsoc.2024.102566 [DOI] [Google Scholar]
  102. Worrall J. L., Cohn E. G. (2023). Citation data and analysis: Limitations and shortcomings. Journal of Contemporary Criminal Justice, 39(3), 327–340. 10.1177/10439862231170972 [DOI] [Google Scholar]
  103. Wu X., Duan R., Ni J. (2023). Unveiling security, privacy, and ethical concerns of ChatGPT. Journal of Information and Intelligence, 2(2), 102–115. 10.1016/j.jiixd.2023.10.007 [DOI] [Google Scholar]
  104. Yalcinkaya T., Yucel S. C. (2024). Bibliometric and content analysis of ChatGPT research in nursing education: The rabbit hole in nursing education. Nurse Education in Practice, 77, 103956. 10.1016/j.nepr.2024.103956 [DOI] [PubMed] [Google Scholar]
  105. Zhao X., Cox A., Cai L. (2024). ChatGPT and the digitisation of writing. Humanities and Social Sciences Communications, 11(1), 1–9. 10.1057/s41599-024-02904-x [DOI] [Google Scholar]
  106. Zhou N. S. (2024). A Survey on the Usefulness of ChatGPT as a Modern Tool for Research in China. El Profesional De La Informacion, 33(2), 1–11. 10.3145/epi.2024.0213 [DOI] [Google Scholar]

Articles from Journal of Empirical Research on Human Research Ethics are provided here courtesy of SAGE Publications

RESOURCES