Abstract
Background
Bibliometric have been widely applied to the evaluation of academic productivity. However, those of individuals or institutions on a specific disease have not been explored. The aim of the present study is to conduct a bibliometric analysis of particular rare disease and investigate whether those doctors and hospitals with higher index screened by this method specialize in this disease.
Methods
A representative rare disease, Wilson disease (WD), was searched on Clarivate Analytics’ Web of Science and Elsevier’s Scopus, which was published in English between 1 January 2001 and 31 December 2020. Clinical authors and medical institutions with the most papers were screened, and their total number of publications and citations, h-index and g-index were computed and then ranked by h-index.
Results
A total of 6856 and 6193 papers and 200 and 160 authors were got from WoS and Scopus, respectively. Scopus provided 160 institutions. The above bibliometric indices were calculated in 100 researchers and 80 institutions, and top 30 authors (Top-30a) and top 20 institutions (Top-20i) of them based on the h-index were listed in the tables. Top-30a came from seven specialties and 13 countries whose median (interquartile range) h-index was 14 (12–19.5) (range 10–28) which was located between associate and full professors in some other disciplines. Top-20i was distributed in 13 countries whose mean ± standard deviation of the h-index was 15 ± 4.9 (range 10–27).
Conclusions
The related specialists and medical institutions of WD screened by specific disease bibliometric analysis are eminent and credible and benefit WD patients to obtain reliable medical treatment. This model may be suitable for other rare diseases.
Supplementary Information
The online version contains supplementary material available at 10.1186/s13023-022-02459-7.
Keywords: Academic productivity, Wilson disease, Bibliography, Bibliometric
Background
In the field of academic medicine, scientific productivity is still a crucial and more objective factor for evaluating scholarly achievements and promotion [1, 2]. Bibliometric provides a quantitative method that is widely accepted thus far. The h-index [3] and g-index [4] are two of the most broadly known and used bibliometric parameters on the individual and departmental levels [5–9]. “The h-index is defined as an individual having h papers with at least h citations” [3]. It balances both the total publications and citations per publication, and has good stability since it is less affected by low-cited articles [10]. The g-index means that the most cited g articles earned at least g2 citations [4]. It could provide weight to a h-index that is too-low when a small number of very influential papers result in an uneven distribution of citations.
At present, bibliometric studies focus on the global academic productivity of individuals or departments, rather than a single disease. It is impossible for an expert to have high scholarly achievement in varied diseases. A single disease’s bibliometric analysis may be necessary when we need to assess the influence of a doctor on a particular disease, especially for the diagnosis and therapy of rare diseases.
To date, there is no exact and uniform definition and count of rare diseases. A disease that affects fewer than 200,000 people in the United States is rare [11]. Meanwhile, in the European Union in 2000, less than 5 in 10,000 people was considered a rare disease [12]. It is estimated the number of rare diseases is more than 10,000 [13]. Therefore, all rare diseases face a similar clinical dilemma, since most clinicians and departments do not have more opportunities to deal with rare disease patients which precisely prevents them from accumulating adequate experience to recognize and manage rare diseases. Then, diagnosis is often delayed or wrong followed by increased financial burden and physical torment. Therefore, the answers to the following questions may be particularly critical: Who are authentic clinical specialists of rare diseases? How can their clinical competence be evaluated? Would rare disease bibliometric research for individuals and clinical institutions be the perfect solution?
Wilson disease (WD) is a rare but potentially treatable and inherited disorder of copper metabolism with a prevalence of 2.9–5.87 per 100,000 [14–17]. As far as I know, there is abundant literature on WD available for analysis. In this study, we took WD as an example of a rare disease to conduct a bibliometric analysis based on literature published from 2001 to 2020, investigated the academic productivity of experts and institutions in this special field, and explored whether the experts and institutions singled out by particular disease bibliometrics were reliable in the field of that rare disease.
Methods
Search and inclusion criteria
All publications were searched using “Hepatolenticular Degeneration” as the medical subject heading (MeSH) term and related entry terms which came from the National Center for Biotechnology Information (NCBI). The above terms were retrieved in the “Article title, Abstract and Keywords” of Elsevier’s Scopus and the “Topic” of Clarivate Analytics’ Web of Science (WoS) to analyze the bibliometric information of relevant dissertations that were published between 1 January 2001 and 31 December 2020 in English and document types were limited to articles or review articles or case report or letters or clinical trial or report (Additional file 1). The study data were collected in December 2021 over one week period. For the purpose of this study, the inclusion criteria of this literature were that (1) the details must be related to WD (known or called also hepatolenticular degeneration); and (2) their authors need to involve clinicians, not just fundamental science (nonclinical) researchers. We can only identify whether the author is a clinical researcher based on the institution of the latest published articles, and those obscure and uncertain results would not be involved in this study.
Citation data sources
The list of authors with the most papers and their publication data were extracted from Scopus and WoS databases on the same day. One author may have various abbreviations of the first name, for instance, Michael L Schilsky, Michael Schilsky, MICHAEL Schilsky, ML Schilsky, M L Schilsky and M Schilsky are the same person. We sorted by author's last name to maximize the discovery of all his articles. Article title, authors, department, institution, abstract, PubMed unique identifier, publication year and cited times were extracted. Our colleagues checked and merged raw data from two databases to unify the author’s name and ignore the nonclinical researcher and erase the duplicate items and unrelated themes. The top cited articles and the list of institutions were provided by Scopus. Their publication data were screened as above. Suspicious items were identified from the original literature. The above data were then saved as a spreadsheet for bibliometric calculations. We cannot identify the most-paper authors’ sex, age, and work situation, for instance, in-service, retired or emeritus. Although we tried our best to retrieve the initials of those authors in various forms, the omission of a few papers may still be inevitable. Since there is no uniform named standard and some institutions have renamed, merged or ceased to exist, we did not consider the literature data of institutions sourced from Scopus to be accurate.
Bibliometric indices
The most-paper authors’ following indices were calculated: total number of publications; the total number of citations; h-index; g-index. The top 20 most-cited papers (Top-20p) and their authors were listed. We ranked the top 30 authors/doctors (Top-30a) worldwide according to their scientific research output and h-index. The network mapping of Top-30a and their coauthors was charted with the VOSviewer program [18], which reflects their influence power in this specialty field. The h-index, which is used to calculate individual academic output, [3] was borrowed here to calculate the academic performance of organizations and obtain the top 20 medical institutions (Top-20i).
Results
Characteristics of publications
A total of 6856 and 6193 papers related to WD were searched from WoS and Scopus respectively. The different names of article types in these databases resulted in discrepancies in the results, although the MeSH was the same. The Top-20p, which was taken part in by clinicians, is shown in Table 1. Seven of the top 10 most-cited papers are guidelines or reviews, and most of them were published 10 years ago [19–25]. Notably, compared with only one laboratory study on the mouse model of WD [26], the other 19 studies were all clinical investigations or reviews. The highest citation, 772, was produced by a practice guideline article [23], which belongs to Eve A. Roberts and Michael L. Schilsky, published in Hepatology in 2008 and represented the position of the American Association for Study of Live Disease (AASLD). Michael L. Schilsky and Peter Ferenci, two prestigious professors, were the principal coauthors in Top-20p. Michael L. Schilsky [27], professor of medicine and medical director in Adult Liver Transplant at Yale-New Haven Transplantation Center, was involved in seven publications, four of which ranked first to fourth [19, 22–24] on Top-20p. Moreover, the first and fourth papers are clinical practice guidelines of AASLD and the European Association for the Study of the Liver (EASL) respectively. Another eminent researcher, Peter Ferenci [28, 29], liver expert in the division of gastroenterology and hepatology, comes from the department of medicine III of Medical University Vienna. He was the chairman of EASL Clinical Practice Guidelines: Wilson’s disease [24] and had 6 publications listed on Top-20p.
Table 1.
Rank | Title | Total cites | Authors | Journal | Year | Type |
---|---|---|---|---|---|---|
1 | Diagnosis and treatment of Wilson disease: An update | 772 | Eve A. Roberts, Michael L. Schilsky | Hepatology | 2008 | Guideline |
2 | Wilson's disease | 745 | Aftab Ala, Ann P. Walker, Keyoumars Ashkan, James S. Dooley, Michael L. Schilsky | Lancet | 2007 | Review |
3 | Diagnosis and phenotypic classification of Wilson disease | 549 | Peter Ferenci, Karel Caca, Georgios Loudianos, Giorgina Mieli-Vergani, Stuart Tanner, Irmin Sternlieb, Michael L. Schilsky, et al | Liver International | 2003 | Review |
4 | EASL Clinical Practice Guidelines: Wilson's disease | 548 | Peter Ferenci, Anna Czlonkowska, Wolfgang Stremmel, Roderick Houwen, William Rosenberg, Michael L. Schilsky, et al | Journal of Hepatology | 2012 | Guideline |
5 | Wilson's disease and other neurological copper disorders | 345 | Oliver Bandmann, Karl Heinz Weiss, Stephen Kaler | The Lancet Neurology | 2015 | Review |
6 | Clinical presentation, diagnosis and long-term outcome of Wilson's disease: A cohort study | 337 | UTA Merle, Matthias R. Schaefer, Peter Ferenci, Wolfgang Stremmel | Gut | 2007 | Article |
7 | A practice guideline on Wilson disease | 307 | Eve A. Roberts, Michael L. Schilsky | Hepatology | 2003 | Review |
8 | Wilson Disease | 266 | Jonathan D Gitlin | Gastroenterology | 2003 | Review |
9 | Wilson's disease in children: 37-year experience and revised King's for liver transplantation | 230 | Anil Dhawan, Rachel M. Taylor, Paul Cheeseman, Pamela De Silva, Leah Katsiyiannakis, Giorgina Mieli-Vergani | Liver Transplantation | 2005 | Article |
10 | Treatment of Wilson disease with ammonium tetrathiomolybdate—IV. Comparison of tetrathiomolybdate and trientine in a double-blind study of treatment of the neurologic presentation of Wilson disease | 199 | George J. Brewer, Fred Askari, Matthew T. Lorincz, Martha Carlson, Michael L. Schilsky, Karen J Kluin, et al | Archives of Neurology | 2006 | Article |
11 | Wilson's disease: An update | 197 | Shyamal K. Das, Kunal Ray | Nature Clinical Practice Neurology | 2006 | Review |
12 | A genetic study of Wilson's disease in the United Kingdom | 186 | Alison J Coffey, Miranda Durkie, Stephen Hague, Kirsten McLay, Jennifer Emmerson, Christine Lo, Stefanie Klaffke, Christopher J Joyce, Anil Dhawan, et al | Brain | 2013 | Article |
13 | Regional distribution of mutations of the ATP7B gene in patients with Wilson disease: Impact on genetic testing | 177 | Peter Ferenci | Human Genetics | 2006 | Review |
14 | High copper selectively alters lipid metabolism and cell cycle machinery in the mouse model of Wilson disease | 159 | Dominik Huster, Tina D. Purnat, Jason L. Burkhead, Martina Ralle, Oliver Fiehn, Franziska Stuckert, N Erik Olson, Daniel Teupser, Svetlana Lutsenko | Journal of Biological Chemistry | 2007 | Article |
15 | Wilson disease: Description of 282 patients evaluated over 3 decades | 157 | Arun B. Taly, Meenakshi-Sundaram S., Sanjib Sinha, HS. Swamy, GR. Arunodaya | Medicine | 2007 | Article |
16 | Late-Onset Wilson's Disease | 155 | Peter Ferenci, Anna Czlonkowska, UTA Merle, Szalay Ferenc, Grazyna Gromadzka, Cihan Yurdaydin, Wolfgang Vogel, Radan Bruha, Hartmut T Schmidt, Wolfgang Stremmel | Gastroenterology | 2007 | Article |
17 | Neurologic Wilson's disease | 148 | Matthew T. Lorincz | Annals of the New York Academy of Sciences | 2010 | Review |
18 | Wilson's disease: Cranial MRI observations and clinical correlation | 144 | Sanjib Sinha, Arun B. Taly, Saiprasad Ravishankar, et al | Neuroradiology | 2006 | Article |
19 | Screening for Wilson disease in acute liver failure: A comparison of currently available diagnostic tests | 142 | Jessica D. Korman, Irene Volenberg, Jody Balko, Joe Webster, Frank V Schiodt, Robert H. Squires Jr, Robert J Fontana, William M. Lee, Michael L. Schilsky, | Hepatology | 2008 | Article |
20 | Diagnostic value of quantitative hepatic copper determination in patients with Wilson's disease | 141 | Peter Ferenci, Petra Steindl-Munda, Wolfgang Vogel, Wolfgang Jessner, Michael Gschwantler, Rudolf Stauber, et al | Clinical Gastroenterology and Hepatology | 2005 | Article |
Top authors’ academic productivity
WoS and Scopus presented 200 and 160 authors whose median (interquartile range, IQR) paper numbers were 25(19, 35) (range 13–102) and 12(10, 17) (range 9–75) respectively (data not shown). The top 100 authors on WoS with the most articles were retrieved, whose article numbers ranged from 18 to 102. Then, their records on Scopus were downloaded and merged with those of WoS to calculate the h-index. According to the h-index, Top-30a who were productive in the WD field, coming from seven specialties and 13 countries (Fig. 1A), are listed in Table 2. The median (IQR) of the h-index is 14 (12–19.5), ranging from 28 to 10. Anna Czlonkowska tops the list with the highest h-index, 28, and the largest number of papers, 98, which generated 3039 citations. Peter Ferenci and Michael L. Schilsky followed behind closely with h-index values of 27 and 26, respectively. Nevertheless, their g-indices were higher than Anna Czlonkowska’s and occupied the top two positions. Tomasz Litwin, similar to his colleague Anna Czlonkowska, had a number of articles and a disproportionate h-index. In terms of total cites, Michael L. Schilsky, who was coauthor of both AASLD and EASL’s guidelines about WD [23, 24], ranked first by virtue of 4953 citations of 77 articles. Furthermore, his g-index score, 70, was far higher than his peers, just like his total cites. Surprisingly, Dominik Huster and Eve A. Roberts, ranking 13th and 19th based on the h-index, merely relied on 20 papers to earn 1276 citations and 1504 citations, respectively. We made a heatmap based on the number of articles published by each author per year (Fig. 2). It showed that the academic output of top researchers, such as Anna Czlonkowska, Peter Ferenci, Michael L. Schilsky and Wolfgang Stremmel, was not only consistent but also productive. Impressively, Jean Marc Trocello and Aurelia Poujois, who both came from the French National Reference Centre for Wilson Disease (Paris), and Karolina Dziezyc (Warsaw) have had a good start to the last decade and may have a bright future (Fig. 2).
Table 2.
Rank | Name | h-index | g-index | Total articles | Total cites | Specialty | Department & Institution |
---|---|---|---|---|---|---|---|
1 | Anna Czlonkowska | 28 | 51 | 98 | 3039 | Neurology | Second Department of Neurology, Institute of Psychiatry and Neurology, Warsaw, Poland |
2 | Peter Ferenci | 27 | 53 | 53 | 3726 | Gastroenterology and Hepatology | Division of Gastroenterology and Hepatology, Medical University of Vienna, Vienna, Austria |
3 | Michael L. Schilsky | 26 | 70 | 77 | 4953 | Liver Transplant | Departments of Medicine and Surgery, Yale University Medical Center, New Haven, CT, USA |
4 | Wolfgang Stremmel | 25 | 48 | 48 | 2556 | Gastroenterology and Hepatology | Department of Gastroenterology and Hepatology, University Hospital of Heidelberg, Heidelberg, Germany |
5 | Karl Heinz Weiss | 23 | 40 | 51 | 1674 | Gastroenterology and Hepatology | Department of Gastroenterology and Hepatology, University Hospital of Heidelberg, Heidelberg, Germany |
6 | George J. Brewer | 23 | 36 | 36 | 1801 | Internal Medicine | Department of Human Genetics and Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, USA |
7 | Tomasz Litwin | 21 | 38 | 74 | 1695 | Neurology | Second Department of Neurology, Institute of Psychiatry and Neurology, Warsaw, Poland |
8 | France Woimant | 19 | 27 | 45 | 846 | Neurology | Neurology Department and National Reference Centre for Wilson's Disease, AP-HP, Lariboisière University Hospital, Paris, France |
9 | UTA Merle | 19 | 26 | 26 | 1318 | Gastroenterology and Hepatology | Department of Gastroenterology, University Hospital Heidelberg, Heidelberg, Germany |
10 | Arun B Taly | 18 | 32 | 33 | 1049 | Neurology | Department of Neurology, National Institute of Mental Health and Neuro Sciences, Bangalore, India |
11 | Sanjib Sinha | 17 | 31 | 33 | 1004 | Neurology | Department of Neurology, National Institute of Mental Health and Neuro Sciences, Bangalore, India |
12 | Valentina Medici | 17 | 29 | 29 | 918 | Gastroenterology and Hepatology | Division of Gastroenterology and Hepatology, Department of Internal Medicine, University of California Davis, Sacramento, USA |
13 | Dominik Huster | 17 | 20 | 20 | 1276 | Gastroenterology and Oncology | Department of Gastroenterology and Oncology, Deaconess Hospital Leipzig, Academic Teaching Hospital University of Leipzig, Germany |
14 | Hartmut Schmidt | 17 | 31 | 36 | 1013 | Transplantation | University Hospital of Muenster, Muenster, Germany |
15 | Grzegorz Chabik | 14 | 18 | 18 | 602 | Neurology | Second Department of Neurology, Institute of Psychiatry and Neurology, Warsaw, Poland |
16 | Jean Marc Trocello | 14 | 20 | 20 | 566 | Neurology | Neurology Department and National Reference Centre for Wilson's Disease, AP-HP, Lariboisière University Hospital, Paris, France |
17 | Giacomo Carlo Sturniolo | 14 | 18 | 18 | 631 | Gastroenterology | Department Surgery & Gastroenterol, University of Padova, Padova, Italy |
18 | Georgios Loudianos | 13 | 30 | 30 | 1032 | NA | Ospedale Regionale Microcitemie, Cagliari, Italy |
19 | Eve A. Roberts | 13 | 20 | 20 | 1504 | Gastroenterology | Division of Gastroenterology, Hepatology and Nutrition, The Hospital for Sick Children, University of Toronto, Canada, |
20 | Egberto Reis Barbosa | 13 | 23 | 28 | 570 | Neurology | Department of Neurology, University of São Paulo Medical School, São Paulo, Brazil |
21 | Karolina Dziezyc | 13 | 21 | 25 | 470 | Neurology | Second Department of Neurology, Institute of Psychiatry and Neurology, Warsaw, Poland |
22 | John M. Walshe | 13 | 22 | 22 | 541 | Internal Medicine | Formerly of Addenbrookes Hospital, Cambridge and the Middlesex Hospital, London, UK |
23 | Anil Dhawan | 12 | 19 | 19 | 858 | Paediatric Hepatology | Paediatric Liver, GI and Nutrition Centre and Mowat Labs, King's College Hospital, Denmark Hill, London, UK |
24 | Raffaele Iorio | 12 | 21 | 21 | 576 | Pediatrics | Department of Pediatrics, University of Naples Federico II, Naples, Italy |
25 | Luigi Demelia | 12 | 16 | 17 | 287 | Gastroenterology | Department of Gastroenterology, Hospital of University of Cagliari, Cagliari, Italy |
26 | Wieland Hermann | 11 | 17 | 17 | 435 | Neurology | Department of Neurology, SRO AG Spital Langenthal, Langenthal, Switzerland |
27 | Zhiying Wu | 11 | 18 | 18 | 449 | Neurology | Department of Neurology and Research Center of Neurology in Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China |
28 | Masaru Harada | 10 | 18 | 19 | 327 | Internal Medicine | Third Department of Internal Medicine, School of Medicine, University of Occupational and Environmental Health, Fukuoka, Japan |
29 | Renmin Yang | 10 | 15 | 15 | 247 | Neurology | Department of Neurology, The Affiliated Hospital of the Neurology Institute, Anhui University of Chinese Medicine, Hefei, China |
30 | Aurelia Poujois | 10 | 15 | 22 | 245 | Neurology | Neurology Department and National Reference Centre for Wilson's Disease, AP-HP, Lariboisière University Hospital, Paris, France |
Median (range) | 14 (10–28) | 22.5 (15–70) | 25.5 (15–98) | 888 (245–4953) | |||
Inter-quartile range | 12–19.5 | 18–33 | 19–38.3 | 523.3–1546.5 |
USA United States of American, AP-HP Public Assistance-Paris Hospitals, UK United Kingdom
Broadly speaking, Asian researchers’ academic productivity, especially Japan and China, at least in English publications, was inefficient. The higher h-index, g-index, total articles and total cites of authors, by contrast, all belonged to Europe and the United States (Table 2, Fig. 1A). In addition, approximately half of Top-30a came from neurology and one third of them were gastroenterologists and hepatologists (Fig. 1B). Most of Top-30a were employees of the hospital affiliated with the medical university (Table 2).
The network relationships of Top-30a and their coauthors are presented in Fig. 3. Obviously, in the lower left corner, Chinese researchers, RM. Yang, and ZY. Wu, and Japanese scholar, M. Harada, do not have academic cooperation with the right sophisticated and interlinked cluster, which was made up of European and American peers. In line with the performance of Top-30a in Table 2, generally, the higher up authors also had larger circles, more complex network relationships and a more central position in Fig. 2, for instance, A. Czlonkowska, P. Ferenci, K. Weiss and M. Schilsky. Top-30a in the same area and with the same color generally belong to the same cluster or even the same institution.
Top institution’ academic productivity
Scopus demonstrated 160 institutions based on article counts whose median (IQR) was 25 (19, 35) (range 16–88). The top 80 (50%) institutions’ papers, which ranged from 25 to 88, were proven and their related indices were calculated. In light of the h-index again, Table 3 ranks the Top-20i located in 13 countries whose h-index was between 10 and 27, with a mean ± standard deviation of 15 ± 4.9. In contrast with the affiliated institutions of Top-30a in Table 2, unexpectedly, all indices of Top-20i were much lower, which was why we only retrieved 20. Due to universal nomenclature being nonexistent and job-hopping, the above differences may be reasonable. The Institute of Psychiatry and Neurology in Warsaw, Poland, whose four authors are presented in the Top-30a list (Table 2), ranked first in the Top-20i list with 27 of h-index, 45 of g-index and 2440 total cites yielded by 88 papers, followed by the University Hospital of Heidelberg, from which three researchers in the Top-30a list came (Tables 2, 3). In addition, there were four institutions that acquired very higher cites that rely on relatively fewer articles: University (Hospital) of California Davis, First Faculty of Medicine of Charles University, King's College of Hospital and University of Toronto Hospital for Sick Children. Geographically, as with Top-30a, Germany, the US and Italy remained the main players. Furthermore, Switzerland, Japan and China disappeared from Table 3, albeit they had outstanding individual performance (Table 2).
Table 3.
Rank | Institution | Location | h-index | g-index | Total articles | Total Cites |
---|---|---|---|---|---|---|
1 | Institute of Psychiatry and Neurology | Warsaw, Poland | 27 | 45 | 88 | 2440 |
2 | University Hospital of Heidelberg | Heidelberg, Germany | 25 | 43 | 54 | 2274 |
3 | National Institute of Mental Health and Neuro Sciences | Bangalore, India | 20 | 35 | 39 | 1276 |
4 | University (Hospital) of Leipzig | Leipzig, Germany | 19 | 27 | 27 | 1172 |
5 | University of Michigan Medical School (Hospital) | Ann Arbor, USA | 19 | 25 | 25 | 1776 |
6 | Medical University (Hospital) of Vienna | Vienna, Austria | 18 | 31 | 31 | 1717 |
7 | AP-HP, Lariboisière University Hospital | Paris, France | 18 | 29 | 40 | 856 |
8 | University (Hospital) of Naples Federico II | Naples, Italy | 15 | 26 | 26 | 856 |
9 | University (Hospital) of California Davis | California, USA | 15 | 22 | 22 | 1669 |
10 | University (Hospital) of Padova | Padova, Italy | 15 | 18 | 18 | 640 |
11 | Münster University Hospital | Münster, Germany | 14 | 26 | 26 | 739 |
12 | University of São Paulo School of Medicine (Hospital) | São Paulo, Brazil | 13 | 23 | 29 | 581 |
13 | First Faculty of Medicine, Charles University | Prague, Czech Republic | 13 | 19 | 19 | 1181 |
14 | Sanjay Gandhi Post Graduate Institute (Hospital) of Medical Sciences | Lucknow, India | 12 | 18 | 20 | 337 |
15 | University Medical Center Utrecht | Utrecht, Netherlands | 12 | 15 | 15 | 855 |
16 | University (Hospital) of Cagliari | Cagliari, Italy | 11 | 22 | 24 | 494 |
17 | King's College of Hospital | London, UK | 10 | 19 | 19 | 1348 |
18 | University of Toronto Hospital for Sick Children | Toronto, Canada | 10 | 16 | 16 | 1232 |
19 | Yale University School of Medicine (Hospital) | New Haven, USA | 10 | 15 | 15 | 379 |
20 | Asan Medical Center, University of Ulsan College of Medicine | Seoul, South Korea | 10 | 15 | 15 | 294 |
Median ± Standard deviation (range) | 15.3 ± 4.9 (10–27) | 24.5 ± 8.7 (15–45) | 28.4 ± 17.2 (15–88) | 1105.8 ± 622.6 (294–2440) |
USA United States of American, AP-HP Public Assistance-Paris Hospitals, UK United Kingdom
Discussion
Taking the WD as an example and using bibliometric methods, we have screened the Top-30a and Top-20i, which may be the most trustworthy in the diagnosis and treatment of WD. This model may provide a basis to help WD patients choose the appropriate doctor or medical institution and may even be beneficial for undiagnosed dubious patients.
Regarding bibliometric, the h-index is the most broadly used and accepted measure of scholarly productivity and even for hiring, promotion, award and funding decisions [1, 6, 30–32]. Some studies have been conducted in fields such as neurosurgery, pediatric, academic otolaryngology, anesthesia, radiology and chronic pain medicine [2, 5–9]. This study may be the first attempt to calculate the h-index using papers from a specific disease rather than all literature. The h-index increases gradually with advancing academic ranks from lecturer to assistant professor, associate professor (AP), full professor (FP) and finally chairman [32]. Hirsch found that a general value for promotion to AP or FP would be ~ 12 and ~ 18 respectively [3]. The h-index is robust because of its insensitivity to lowly cited articles in a researcher’s album [5, 10, 32]. The common view is that the h-index will never fall and with no doubt is influenced by the author’s scholarly career period, which is seen as a drawback. However, this could be a benefit in the rare disease field, where senior physicians tend to have abundant experience.
Almost all physicians of Top-30a are affiliated with university hospitals or research institutes (Table 2). Top-20i better illustrates this point (Table 3). Based on data from 2001 to 2020 alone and limited in particular disease (WD), the median (IQR) h-index of Top-30a is 14 (12–19.5), nearly equal to that of FP of chronic pain physicians in the USA: 16.5 (6, 30) [2], lower than that of anesthesia FP in the UK: 21 (16–26), both in their whole period [7]. Compared to the general academic pediatrician, the median h-index (14) and g-index (22.5) of Top-30a were slightly lower than those of FP (16 and 29) and markedly higher than AP (6 and 11) [9]. Although we did not list researchers’ titles, by comparison with the h- and g-index of AP and FP of other disciplines, we believe that these data obtained from our method can prove to us that these experts’ and institutions’ academic productivity in the field of WD is sufficiently convincing, they are also most likely to be good at WD. In fact, considering the enormous workload, we cannot retrieve all researchers and institutions listed by WoS and Scopus. We believe that the researchers/institutions who appear on this list are credible. Furthermore, there are four departments, coming from Switzerland, China and Japan, which appeared on the Top-30a table (Table 2) but disappeared on the Top-20i table (Table 3). We suspect that job-hopping had spread their work across different organizations, which may be the cause of the above results.
The European, American and Indian outputs were distinctly better than those of the rest of Asia, such as Japan and China (Tables 2 and 3, Fig. 1A). Language family [33] and collaboration may be the inescapable reasons (Fig. 3). Figure 3 demonstrates that Japanese and Chinese researchers had no academic collaboration with other clusters. Since bibliometric indices do not consider author rank in the manuscripts, multiple coauthors receiving equal credit, the citation and h-index can be strongly influenced by the size of his circle of collaborators [32]. The present study did not involve non-English papers; if these nonnative English speakers’ academic publications in their home countries were included, especially Japan and China, the rankings might change dramatically. We must always clearly realize that these lists only display academic productivity on WD field published in English between 2001 and 2020, which does not mean that the physicians on the list are definitely better at other periods than other scholars in other disease fields. If this method is applied to a specific country, such as Brazil, Japan, China and other non-English speaking countries, it may be more practical to use their native language papers as the object of analysis.
Although, academic influence about some disease does not completely equate to clinical diagnosis and treatment competence. In the domain of rare diseases with the background of rare patients, we believe that those who can sustain consistent and productive scholarly output can be relied upon by these patients. Therefore, the above bibliometric results are dependable. For rare disease patients, it could be used as a clue to help them discover the most suitable doctors and specialist institutions, which are bound to help reduce misdiagnosis and mistherapy and reduce the disease burden on individuals and society. Rare disease researchers will have access to more rare clinical cases and experience, which will be more beneficial to their scientific study. An ideal format, we conceive, might be an application that can be installed and operated on smartphones and computers. When the user enters doubtful or definitive diagnosis keywords in the search box, he will obtain relevant helpful experts and medical institutions.
Some limitations might influence the reliability of our results. First, we cannot include all authors and institutions listed by WoS and Scopus, which may omit some outstanding targets. However, from the perspective of our research purposes, we must ensure that the doctors on the list are excellent, and comprehensiveness is not compulsory. Their median h-index is 14 which is already higher than the AP of many disciplines and nearly reaches the level of FP. Therefore, their academic power is believable. Comparing the paper number of 200 authors (range 13–102) listed on WoS and the top 100 writers of them with the most publications (range 18–102) that were retrieved by us, we hold the opinion that the comprehensiveness is acceptable. The Top-20i also had the same situation. Second, the confidence level of our results only is proven by comparing their bibliometric indices with other subjects and specialties, whereas there is no dependable external validation. Peer review is probably a common practice; however, we doubt that they cannot ignore the impact of academic productivity. Third, WD is a sufficiently researched rare disease, and its related articles are abundant. When we handle other rare diseases, for instance, Dubin-Johnson Syndrome, which only has 3690 publications searched as above on WoS (data not shown) and may also include many unrelated topics, the situation could be entirely different, and the results could be obscure. Searching in larger categories may be a solution, such as inherited jaundice or inherited liver disease. Further research is still needed to verify these findings.
Conclusion
As the research has demonstrated, through specific disease bibliometric analysis, we calculated a number of academic productivity indices of researchers and medical institutions in the field of WD. According to the h-index, we ranked and screened out the relevant credible specialists and specialized medical institutions that benefit WD patients to obtain most appropriate medical treatment. This model may be applied to other rare diseases and perhaps to some intractable diseases.
Supplementary Information
Acknowledgements
We thank Professor Qizhi Xu (University of Science and Technology of China) and Qiong Liu (Zhejiang University) for their valuable help in this work.
Abbreviations
- AASLD
American Association for Study of Live Disease
- AP
Associate professor
- EASL
European Association for the Study of the Liver
- FP
Full professor
- IQR
Interquartile range
- MeSH
Medical subject headings
- NCBI
National Center for Biotechnology Information
- Top-30a
Top 30 authors
- Top-20i
Top 20 medical institutions
- Top-20p
Top 20 most-cited papers
- WD
Wilson disease
- WoS
Web of Science
Author contributions
LC and ZL prepared the material, collected and analyzed the data, and wrote and reviewed the manuscript. YF, LP and JZ collected and analyzed the data and visualization. YZ, YW and NW checked the data and reviewed the manuscript. BR designed and supervised the research and interpreted the results. All authors read and approved the final manuscript.
Funding
This study was supported by grants from the National Major Science and Technology Project of China (Grant No. 2017ZX10105001-001) and the National Human Genetic Resources Sharing Service Platform (Grant No. 2005DKA21300).
Availability of data and materials
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Declarations
Ethics approval and consent to participate
Not applicable. This article does not contain any studies with human or animal subjects. This manuscript does not involve a research protocol requiring approval by the relevant institutional review board or ethics committee.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Lin Chen and Zhuoqi Lou contributed equally to this work
Contributor Information
Lin Chen, Email: chenlin-cn@zju.edu.cn.
Zhuoqi Lou, Email: louzhuoqigl@163.com.
Yangxin Fang, Email: 12018221@zju.edu.cn.
Liya Pan, Email: 11818050@zju.edu.cn.
Jianhua Zhao, Email: 22060162@zju.edu.cn.
Yifan Zeng, Email: 17803866390@163.com.
Ying Wang, Email: wy.euph@zju.edu.cn.
Nan Wang, Email: graduatewangnan@163.com.
Bing Ruan, Email: ruanbing@zju.edu.cn.
References
- 1.Carpenter CR, Cone DC, Sarli CC. Using publication metrics to highlight academic productivity and research impact. Acad Emerg Med. 2014;21(10):1160–1172. doi: 10.1111/acem.12482. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Orhurhu MS, Orhurhu V, Salisu B, Abimbola A, Cohen SP. Factors associated with academic rank among chronic pain medicine faculty in the USA. Reg Anesth Pain Med. 2020;45(8):589–596. doi: 10.1136/rapm-2019-101139. [DOI] [PubMed] [Google Scholar]
- 3.Hirsch JE. An index to quantify an individual's scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569–16572. doi: 10.1073/pnas.0507655102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Egghe L. Theory and practise of the g-index. Scientometrics. 2006;69(1):131–152. doi: 10.1007/s11192-006-0144-7. [DOI] [Google Scholar]
- 5.Lee J, Kraus KL, Couldwell WT. Use of the h index in neurosurgery. Clinical article J Neurosurg. 2009;111(2):387–392. doi: 10.3171/2008.10.JNS08978. [DOI] [PubMed] [Google Scholar]
- 6.Rad AE, Brinjikji W, Cloft HJ, Kallmes DF. The H-index in academic radiology. Acad Radiol. 2010;17(7):817–821. doi: 10.1016/j.acra.2010.03.011. [DOI] [PubMed] [Google Scholar]
- 7.Moppett IK, Hardman JG. Bibliometrics of anaesthesia researchers in the UK. Br J Anaesth. 2011;107(3):351–356. doi: 10.1093/bja/aer124. [DOI] [PubMed] [Google Scholar]
- 8.Svider PF, Choudhry ZA, Choudhry OJ, et al. The use of the h-index in academic otolaryngology. Laryngoscope. 2013;123(1):103–106. doi: 10.1002/lary.23569. [DOI] [PubMed] [Google Scholar]
- 9.Tschudy MM, Rowe TL, Dover GJ, Cheng TL. Pediatric academic productivity: pediatric benchmarks for the h- and g-indices. J Pediatr. 2016;169:272–276. doi: 10.1016/j.jpeds.2015.10.030. [DOI] [PubMed] [Google Scholar]
- 10.Vanclay JK. On the robustness of the h-index. J Am Soc Inf Sci Tec. 2007;58(10):1547–1550. doi: 10.1002/asi.20616. [DOI] [Google Scholar]
- 11.Roberts AD, Wadhwa R. Orphan drug approval laws. StatPearls. Treasure Island (FL); 2022. [PubMed]
- 12.Groft SC, Posada M, Taruscio D. Progress, challenges and global approaches to rare diseases. Acta Paediatr. 2021;110(10):2711–2716. doi: 10.1111/apa.15974. [DOI] [PubMed] [Google Scholar]
- 13.Haendel M, Vasilevsky N, Unni D, et al. How many rare diseases are there? Nat Rev Drug Discov. 2020;19(2):77–78. doi: 10.1038/d41573-019-00180-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bachmann H, Lossner J, Biesold D. Wilson's disease in the German Democratic Republic. I. Genetics and epidemiology. Z Gesamte Inn Med. 1979;34(24):744–748. [PubMed] [Google Scholar]
- 15.Saito T. An assessment of efficiency in potential screening for Wilson's disease. J Epidemiol Community Health. 1981;35(4):274–280. doi: 10.1136/jech.35.4.274. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Cheng N, Wang K, Hu W, et al. Wilson disease in the South Chinese Han population. Can J Neurol Sci. 2014;41(3):363–367. doi: 10.1017/S0317167100017315. [DOI] [PubMed] [Google Scholar]
- 17.Czlonkowska A, Litwin T, Dusek P, et al. Wilson disease. Nat Rev Dis Primers. 2018;4(1):21. doi: 10.1038/s41572-018-0018-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.van Eck NJ, Waltman L. Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics. 2010;84(2):523–538. doi: 10.1007/s11192-009-0146-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ferenci P, Caca K, Loudianos G, et al. Diagnosis and phenotypic classification of Wilson disease. Liver Int. 2003;23(3):139–142. doi: 10.1034/j.1600-0676.2003.00824.x. [DOI] [PubMed] [Google Scholar]
- 20.Gitlin JD. Wilson disease. Gastroenterology. 2003;125(6):1868–1877. doi: 10.1053/j.gastro.2003.05.010. [DOI] [PubMed] [Google Scholar]
- 21.Roberts EA, Schilsky ML, Division of G, Nutrition HfSCTOC A practice guideline on Wilson disease. Hepatology. 2003;37(6):1475–1492. doi: 10.1053/jhep.2003.50252. [DOI] [PubMed] [Google Scholar]
- 22.Ala A, Walker AP, Ashkan K, Dooley JS, Schilsky ML. Wilson's disease. Lancet. 2007;369(9559):397–408. doi: 10.1016/S0140-6736(07)60196-2. [DOI] [PubMed] [Google Scholar]
- 23.Roberts EA, Schilsky ML, American Association for Study of Liver D Diagnosis and treatment of Wilson disease: an update. Hepatology. 2008;47(6):2089–2111. doi: 10.1002/hep.22261. [DOI] [PubMed] [Google Scholar]
- 24.European Association for Study of L EASL clinical practice guidelines: Wilson's disease. J Hepatol. 2012;56(3):671–685. doi: 10.1016/j.jhep.2011.11.007. [DOI] [PubMed] [Google Scholar]
- 25.Bandmann O, Weiss KH, Kaler SG. Wilson's disease and other neurological copper disorders. Lancet Neurol. 2015;14(1):103–113. doi: 10.1016/S1474-4422(14)70190-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Huster D, Purnat TD, Burkhead JL, et al. High copper selectively alters lipid metabolism and cell cycle machinery in the mouse model of Wilson disease. J Biol Chem. 2007;282(11):8343–8355. doi: 10.1074/jbc.M607496200. [DOI] [PubMed] [Google Scholar]
- 27.Michael Schilsky. https://medicine.yale.edu/profile/michael_schilsky/. Accessed 16 December 2021.
- 28.Peter Ferenci receives Masters of the WGO Award. www.meduniwien.ac.at/web/en/about-us/news/detailsite/2019/news-im-september-2019/peter-ferenci-receives-masters-of-the-wgo-award/. Accessed 16 December 2021.
- 29.Shouval D. EASL Awardee 2008. https://easl.eu/wp-content/uploads/2018/11/2008_Peter-Ferenci-by-D.-Shouval.pdf. Accessed 16 December 2021.
- 30.Fuller CD, Choi M, Thomas CR., Jr Bibliometric analysis of radiation oncology departmental scholarly publication productivity at domestic residency training institutions. J Am Coll Radiol. 2009;6(2):112–118. doi: 10.1016/j.jacr.2008.07.004. [DOI] [PubMed] [Google Scholar]
- 31.Bould MD, Boet S, Sharma B, et al. h-Indices in a university department of anaesthesia: an evaluation of their feasibility, reliability, and validity as an assessment of academic performance. Br J Anaesth. 2011;106(3):325–330. doi: 10.1093/bja/aeq403. [DOI] [PubMed] [Google Scholar]
- 32.Aoun SG, Bendok BR, Rahme RJ, Dacey RG, Jr, Batjer HH. Standardizing the evaluation of scientific and academic performance in neurosurgery–critical review of the "h" index and its variants. World Neurosurg. 2013;80(5):e85–90. doi: 10.1016/j.wneu.2012.01.052. [DOI] [PubMed] [Google Scholar]
- 33.Mishra DC. Citations: rankings weigh against developing nations. Nature. 2008;451(7176):244. doi: 10.1038/451244a. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.