Abstract
Research endeavours require the collaborative effort of an increasing number of individuals. International scientific collaborations are particularly important for HIV and HPV co-infection studies, since the burden of disease is rising in developing countries, but most experts and research funds are found in developed countries, where the prevalence of HIV is low. The objective of our study was to investigate patterns of international scientific collaboration in HIV and HPV research using social network analysis. Through a systematic review of the literature, we obtained epidemiological data, as well as data on countries and authors involved in co-infection studies. The collaboration network was analysed in respect to the following: centrality, density, modularity, connected components, distance, clustering and spectral clustering. We observed that for many low- and middle-income countries there were no epidemiological estimates of HPV infection of the cervix among HIV-infected individuals. Most studies found only involved researchers from the same country (64%). Studies derived from international collaborations including high-income countries and either low- or middle-income countries had on average three times larger sample sizes than those including only high-income countries or low-income countries. The high global clustering coefficient (0.9) coupled with a short average distance between researchers (4.34) suggests a “small-world phenomenon.” Researchers from high-income countries seem to have higher degree centrality and tend to cluster together in densely connected communities. We found a large well-connected community, which encompasses 70% of researchers, and 49 other small isolated communities. Our findings suggest that in the field of HIV and HPV, there seems to be both room and incentives for researchers to engage in collaborations between countries of different income-level. Through international collaboration resources available to researchers in high-income countries can be efficiently used to enroll more participants in low- and middle-income countries.
Introduction
As science evolves, important scientific achievements require the collaborative effort of an increasing number of researchers. The study of patterns of scientific collaboration allows us to gain further understanding of innovation and knowledge production. Scientific collaboration networks have been the subject of growing interest in the past few years [1]–[4]. Collaborative scientific publications have a long history. The first collaborative research paper was published in 1665 in the Philosophical Transactions of the Royal Society [5]. To date, the most multi-authored scientific paper was published in Physics Letters B in 2010, when 3,222 researchers from 32 different countries contributed to a study of ‘charged-particle multiplicities’ performed in the Large Hadron Collider at CERN [6].
No single researcher has all the means to conduct large epidemiological studies. Scientific collaboration is a critical tool for progress in epidemiology as it allows the pooling of data, expertise and resources, promoting synergies in the production of knowledge. International scientific collaborations are particularly important in HIV and HPV co-infection studies. Even though the burden of disease related to the co-infection is rising in developing countries [7], most researchers and research funds are found in developed countries where initiatives to scale-up HIV screening and the use of combined antiretrovirals have contributed to substantially limit the HIV pandemic [8].
Cervical cancer is caused by HPV and it is the most common cause of cancer-related deaths among women in developing countries [8], [9]. Despite mounting evidence on interventions to prevent cervical cancer, there is limited information on the prevalence and incidence of HPV infection and cervical abnormalities in HIV-positive women worldwide, and how the natural history of HPV to cervical cancer is modified by HIV infection and antiretroviral treatment [10]–[13]. Gaining better understanding of the epidemiology and biology of HIV and HPV co-infection would allow us to tailor more efficient screening and vaccination strategies to prevent cervical cancer [14]–[16].
Despite the importance of scientific collaborations to medical studies, there are limited studies analysing these collaborations [17]–[19]. In particular, no peer-reviewed publications investigating international scientific collaboration in HIV and HPV research could be found in Medline, Embase, or Global Health databases. Therefore, the objective of this study is to evaluate patterns of international scientific collaboration in HIV and HPV epidemiological research.
Materials and Methods
Search Strategy and Data Extraction
This analysis is part of a broad effort to summarize all prevalence and incidence estimates for HPV infection, as well as cytological and histological cervical abnormalities in HIV-positive women in order to populate mathematical models. Based on search strategies used in previous studies [20], [21], we systematically reviewed PubMed, OVID Medline, Embase, and Global Health database using the following combined keywords (HIV OR human immunodeficiency virus) AND (HPV OR human papilloma virus OR human papillomavirus). The query yielded 2,934 records, of which 1,793 remained after the removal of duplicates. The inclusion criteria were: peer-reviewed journal article, original research, epidemiological studies on the prevalence and/or incidence of HPV infection in the cervix of HIV-infected women (i.e. cross-sectional and cohort studies), published from 01/01/1996 to 30/09/2012 (i.e. the HAART era). Non peer-reviewed reports, review articles, news articles, editorials, and conference abstracts were excluded. There were no language restrictions. By screening titles and abstracts, two independent reviewers identified 278 eligible articles for which the full papers were retrieved.
From the papers retrieved, we extracted data for year of publication, title, journal, number of patients enrolled, country from which the patients were recruited, authors' names, institutional affiliation and location (country), as well as, epidemiological data. Each paper with more than one author was considered to be a scientific collaboration. Papers co-authored by authors affiliated to institutions from different countries were considered an international scientific collaboration [17], [22]. Countries were classified according to the World Bank's three economic groups: low-, middle-, and high-income [22].
Social network analysis
A social network is a set of social entities, such as individuals, presenting some pattern of relationship between them [23]. These networks are usually represented by graphs, where nodes symbolize social entities and edges (or links) connect nodes that are related to each other. The underlying patterns of organization of such networks are the object of study of social network analysis (SNA) [24]. Studies of social networks reflect not only our inherent interest in these patterns, but also the importance of these networks in the spread of information. A famous example is the study conducted by Stanley Milgram [25], in which randomly selected subjects from Nebraska were asked to get a letter to a target subject in Boston through chains of friends and acquaintances. Milgram found that on average it took six steps for the letters to reach the target. This finding became part of the popular culture through John Guarés play, Six Degrees of Separation [26], and it is interpreted as evidence of the “small-world phenomenon” [27].
In our study, we used network analysis to evaluate collaborative networks between countries and authors in HIV and HPV research worldwide. For this purpose, we developed a programme in C++ to rearrange the data extracted in mixing matrices, which was further analysed in MATLAB and Gephi. MATLAB is a numerical computing environment suitable for the manipulation and analysis of matrices. Gephi is open-source network analysis software for visualization and exploration of networks and complex systems [28]. The Fruchterman-Reingold forced-directed algorithm was used to define the network layout. It is a flexible algorithm that optimizes the arrangement of the nodes in an undirected graph based on the strength (force) of their connection [29]. An undirected network is one in which edges have no orientation. We produced two entities' undirected networks: countries and authors.
The degree of centrality is one of various types of measure of centrality, or importance, of an entity in a network. It is perhaps the most intuitive since it is the number of links that a node has [24]. Besides degree centrality, we also computed betweenness and PageRank centrality for the authors' network. Betweenness centrality can be described as the number of shortest paths between different nodes in the network that pass through the node in question. It is a more informative measure than just the node's degree of connectivity, since it also captures the importance of the node as a bridge in the transmission of information through the network [23]. PageRank is a measure of the influence of a node in which scores are assigned to all nodes in the network based on, for example, their degree of centrality, and nodes connected to high-scoring nodes will have higher PageRank measure than those connected to low-scoring nodes. It is named after its inventor, Larry Page, co-founder of Google, and it is popularly used to rank the relative importance of hyperlinked documents [30].
The authors' network statistics included average degree of centrality, degree of centrality distribution, density, modularity, connected components, diameter, average distance between nodes, clustering coefficient, as well as number and size of clusters. Density measures how well connected the nodes are in the network relative to the theoretically possible connections [24]. Modularity measures the division of a network into modules, or communities. Networks with high modularity have dense connections between the nodes within the same module but sparse connections between nodes in different modules [31]. A connected component of an undirected network is a sub-network in which any two nodes can reach each other by paths composed by one or more edges [32]. The diameter is the longest distance between any two nodes in the network. Two connected nodes have a distance of one [33]. The clustering coefficient measures the degree to which nodes are embedded in their neighbourhoods [24]. A high clustering coefficient, along with low average distance between nodes, can indicate a “small-world phenomenon” [27], [34].
Results
Epidemiological studies on HIV and HPV could be found for most high-income countries (figure 1). However, there are still many low- and middle-income countries particularly in South America and Africa for which no study could be found. Table 1 indicates that most studies involved one country and eight or fewer researchers. The average number of entities per publication in the period studied (1996–2012) remained stable (data not shown). Table 2 shows that those studies involving international collaborations including high-income countries and either a low- or middle-income country had on average three times larger population sample sizes than those including only high-income countries or low-income countries.
Table 1. Size of collaborations* in respect to number of authors, institutions and countries.
Authors | Institutions | Countries | ||||
Size of Collaboration | % | Absolute number | % | Absolute number | % | Absolute number |
1 | 0.0 | 0 | 16.2 | 45 | 64.7 | 180 |
2 | 0.7 | 2 | 21.6 | 60 | 23.7 | 66 |
3 | 3.6 | 10 | 18.7 | 52 | 6.5 | 18 |
4 | 4.7 | 13 | 12.9 | 36 | 2.5 | 7 |
5 | 7.6 | 21 | 9.0 | 25 | 1.8 | 5 |
6 | 14.4 | 40 | 6.1 | 17 | 0.4 | 1 |
7 | 14.0 | 39 | 4.0 | 11 | 0.4 | 1 |
8 | 8.3 | 23 | 2.5 | 7 | 0.0 | 0 |
9 | 10.8 | 30 | 2.9 | 8 | 0.0 | 0 |
10 | 12.2 | 34 | 3.6 | 10 | 0.0 | 0 |
11 | 9.3 | 26 | 2.1 | 6 | 0.0 | 0 |
12 | 5.8 | 16 | 0.4 | 1 | 0.0 | 0 |
13 | 2.5 | 7 | 0.0 | 0 | 0.0 | 0 |
14 | 1.8 | 5 | 0.0 | 0 | 0.0 | 0 |
≥15 | 4.3 | 12 | 0.0 | 0 | 0.0 | 0 |
*Each paper with more than one author was considered to be a scientific collaboration.
Table 2. International collaboration by economic groups of countries (1996–2012).
Collaborating countries (1) | Collaborating countries (2) | Frequency | Average number of authors | Average number of institutions | Average number of countries | Average study sample size |
High-income | Middle-income | 49 (50%) | 8.7 | 3.9 | 2.3 | 628 |
High-income | Low-income | 36 (36.7%) | 9.5 | 4.6 | 2.8 | 637 |
High-income | High-income | 11 (11.3%) | 9.6 | 5 | 2.5 | 186 |
Low-income | Low-income | 2 (2%) | 8.5 | 2.5 | 2.5 | 216 |
International collaborations were considered when the paper involved different countries, 98 in total. The combination of countries according to economic groups considered income extremes. For example, if there was a collaboration involving one high-income country and two middle-income countries, this was classified as a high- and middle-income country collaboration, not as middle and middle.
The United States stands out as the country with the greatest number of international collaborations (Figure 2), particularly with South Africa, Uganda and Brazil. Despite the geographical proximity, collaboration between the US and Canada in HIV and HPV research was not very frequent. There was more intra-continental collaboration between European countries, including frequent collaboration between Norway, Sweden, Finland and the Netherlands, and with low-income countries like Uganda. The results indicate frequent collaborations between France and the United Kingdom and both countries collaborate with many other countries in Africa. Among middle-income countries, South Africa and Brazil stand out as the most collaborative countries. Among low-income countries, Kenya and Uganda were the most collaborative. We found many independent studies from low- and middle-income studies such as Democratic Republic of Congo, Central African Republic, Mexico and Chile.
In figure 3, we observe that most authors (or nodes) with the highest degree of centrality are from high-income countries. Some nodes from middle-income countries have a fairly high degree of centrality and among low-income countrieś nodes only one (near the top) has a higher degree. The average degree of centrality in the network was 11.1, meaning that on average authors had collaborated with 11 other authors in HIV and HPV research. The degree distribution followed a power law of exponent 2.5, which is different from a Poisson distribution found in randomly formed networks, and consistent with previous results for biomedical collaboration networks [2]. The high global clustering coefficient (0.9), associated with a short average distance between nodes (4.34), as well as diameter (9) suggest a “small-world phenomenon” within HIV and HPV researchers. The network has a low density of 0.008 reflecting its sparse connections. The largest connected component is composed of 949 nodes, which corresponds to 70% of the network. Besides the large connected component, there are 49 smaller components with sizes ranging from 2 to 42 nodes. Authors from countries within the same economic group often form these smaller components in the periphery of the network. However, collaborations between low- and high-income countries can also be found in the periphery and more rarely collaborations between middle- and high-income countries. We used Laplacian eigenvectors to identify clusters in the largest connected component [35], finding 11 clusters. They were: one core cluster of 276 nodes, two large clusters of 152 and 112 nodes and 8 smaller clusters. The core cluster can be seen almost in the centre of the largest connected component, including the nodes with the highest degree. The modularity was 0.85, which being a positive number supports the hypothesis that edges are not distributed at random.
In Figure 4, outside the main cluster we can visualize some nodes in dark blue, which are smaller in size than other dark blue nodes in the main cluster. Although at a local level these nodes have limited importance (i.e. connectivity), at a global level they are important for bridging different groups of researchers. In Table 3, we can see the name of the most important authors in the network according to different metrics. According to degree of centrality, the 10 most important authors are all from high-income countries. When we consider betweenness centrality, some researchers from the International Agency for Research on Cancer (WHO) and middle-income countries also appear to have important positions in the collaboration network. Little difference can be found when comparing the degree of centrality and PageRank lists. It is worth noting that many of the best-ranked researchers in respect to degree of centrality and PageRank are affiliated to the Women's Interagency HIV Study.
Table 3. International scientific network (authors) statistics.
Rank | Degree centrality | Authors (inc) | Betweenness centrality | Authors (inc) | PageRank | Authors (inc) |
1. | 113 | Palefsky, J (3) | 72,188 | Shah, KV (3) | 0.005 | Palefsky, J (3) |
2. | 95 | Burk, R (3) | 59,863 | Franceschi, S (3) | 0.004 | Burk, R (3) |
3. | 85 | Shah, KV (3) | 51,046 | Palefsky, J (3) | 0.004 | Shah, KV (3) |
4. | 82 | Minkoff, H (3) | 49,355 | Massad, LS (3) | 0.003 | Minkoff, H (3) |
5. | 69 | Anastos, K (3) | 48,743 | Watts, DH (3) | 0.003 | Watts, DH (3) |
6. | 69 | Watts, DH (3) | 43,227 | Levi, JE (2) | 0.003 | Cu-Uvin, S (3) |
7. | 68 | Levine, AM (3) | 37,387 | Gravitt, PE (3) | 0.003 | Anastos, K (3) |
8. | 67 | Cu-Uvin, S (3) | 34,794 | Gonçalves, M (2) | 0.003 | Strickler, HD (3) |
9. | 67 | Strickler, HD (3) | 33.644 | Smith, JS (3) | 0.003 | Levine, AM (3) |
10. | 62 | Massad, LS (3) | 32,535 | Lima, LP (2) | 0.003 | Williamson, S (2) |
inc- income-level of the country of origin: (3) high-income, (2) middle-income and (1) low-income country. The definitions of the network statics here presented can be found in the Materials and Methods section, sub-section Social Network Analysis.
Discussion
There are still many low- and middle-income countries for which no epidemiological estimates of HPV infection of the cervix among HIV-infected women could be found. The studies included in this analysis were highly collaborative in respect to the number of researchers involved but not as much in respect to the number of countries. Most studies only included researchers from the same country. Among studies involving international collaborations, those including high-income countries and either low- or middle-income countries seemed to have larger patient sample sizes than those including only high-income countries or low-income countries. This may be due to the leveraging of financial resources available to researchers in high-income countries and the larger patient populations in low- and middle-income countries, where the prevalence of HIV and HPV is higher.
The United States was the country with the largest number of international collaborations, particularly with South Africa, Uganda and Brazil. These three nations were the most collaborative among low- and middle-income countries. It is important to point out that densely linked networks are more resilient to the loss of central nodes. The high global clustering coefficient coupled with a short average distance between nodes suggests a “small-world phenomenon” among HIV and HPV researchers, similar to what was found by Newman et al in a general analysis of papers indexed in MEDLINE [2]. We found that the researchers from high-income countries seem to have a high number of research collaborations among them and to cluster together in densely connected communities, particularly those from the US. There is a large well-connected community, which encompasses 70% of researchers, and other much smaller communities. Some researchers from international institutions and middle-income countries play an important role by bridging different research communities in the network. The fact that many of the best-ranked researchers in respect to degree of centrality and PageRank are affiliated to the Women's Interagency HIV Study suggests that funding stream plays an important role in the network formation.
Although we did not find other studies on HIV and HPV research networks, we found a few scientometrics studies on HIV. These studies examining patterns in HIV research provided a base of understanding how a similar research field evolved. A citation analysis in the early years of the HIV epidemic traced the expansion of the field and changes of focus [36]. Additional studies captured the presence of new scientific terminology and the specialization of journals as the field progressed [37]–[39]. The emergence of the study of HIV as an interdisciplinary field of research, coupled with the advancement of scientometric analysis methods in recent years has enabled researchers to better assess collaboration patterns, geographic distribution, and expansion of subject areas [40], [41]. A recent evaluation of six NIH HIV/AIDS clinical trials networks showed that US-based authors collaborated with authors in 41 different countries on a total of 243 papers [42].
Different from previous studies that focused on simple statistics on the productivity of areas and individuals in terms of papers published, our study focused on patterns of collaboration using comprehensive network analysis methods. Additionally, we investigated the impact of international collaboration patterns on the population sample size of studies. From a global perspective, our study was also able to identify many countries for which no HIV and HPV estimates could be found. One of the limitations of our analysis is the scarce number of studies available. Different from other co-authorship network analyses using a more sensitive search strategy in Web of Science [4], [17], for two reasons we opted to have a more specific search strategy in Medline, Embase, Cochrane Library, and Global Health databases. Firstly, a more selective sample of studies made it feasible to manually extract data on the sample size of the studies and the origin of participants. Secondly, the databases used in our analysis are more specific for the medical literature.
The research networks presented in our paper are likely to be the intersection of both HIV and HPV research networks. Future studies should try to expand the analysis in order to jointly analyse HIV, HPV and co-infection research networks. As more data become available, it would also be beneficial to analyze their evolution over time. Statistics on research collaboration networks could be further correlated to information on research funding calls, public-private partnerships, global burden of disease and diplomatic agreements. Additionally, it would be interesting to evaluate the determinants of researchers' inclination to connect to different research groups. This analysis could be coupled with an evaluation of networks' structural holes [43]. Further investigations could also investigate the existence and the role of the Big-fish-small-pond effect [44] in epidemiological research networks.
International research networks not only can generate more precise epidemiological estimates for different countries, but they can also assist in knowledge transfer between developed and developing countries, as well as standardizing measurements and reducing duplication of research [45]–[47]. Moreover, network analysis can be used to monitor strategic goals such as integration and collaboration within and across research areas over time [19], [42]. Collaborative and coordinated efforts among those working in epidemiological studies worldwide are crucial in defining and implementing global health initiatives that will improve lives in both developed and developing countries.
Funding Statement
The authors have no support or funding to report.
References
- 1. Barabási A-L (2009) Scale-Free Networks: A Decade and Beyond. Science 325: 412–413. [DOI] [PubMed] [Google Scholar]
- 2. Newman ME (2001) The structure of scientific collaboration networks. Proc Natl Acad Sci U S A 98: 404–409. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Newman MEJ (2001) Scientific collaboration networks. II. Shortest paths, weighted networks, and centrality. Physical Review E 64: 016132. [DOI] [PubMed] [Google Scholar]
- 4. De Stefano D, Fuccella V, Vitale MP, Zaccarin S (2013) The use of different data sources in the analysis of co-authorship networks and scientific performance. Social Networks 35: 370–381. [Google Scholar]
- 5. Uddin S, Hossain L, Rasmussen K (2013) Network Effects on Scientific Collaborations. PLoS ONE 8: e57546. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.(2011) Knowledge, networks and nations: global scientific collaborations in the 21th century. The Royal Society.
- 7. Clifford G, Gallus S, Herrero R, Munoz N, Snijders P, et al. (2005) Worldwide distribution of human papillomavirus types in cytologically normal women in the International Agency for Research on Cancer HPV prevalence surveys: a pooled analysis. Lancet 366: 991–998. [DOI] [PubMed] [Google Scholar]
- 8.De Cock KM, Jaffe HW, Curran JW (2012) The evolving epidemiology of HIV/AIDS. Aids 26: 1205–1213 1210.1097/QAD.1200b1013e328354622a. [DOI] [PubMed]
- 9. Trottier H, Franco E (2006) The epidemiology of genital human papillomavirus infection. Vaccine 24: S1–S15. [DOI] [PubMed] [Google Scholar]
- 10. Palefsky J (2003) Cervical human papillomavirus infection and cervical intraepithelial neoplasia in women positive for human immunodeficiency virus in the era of highly active antiretroviral therapy. Current opinion in Oncology 15: 382–388. [DOI] [PubMed] [Google Scholar]
- 11. Strickler H, Burk R, Fazzari M, nastos K, Minkoff H, et al. (2005) Natural History and Possible Reactivation of Human Paillomavirus in Human Immunodeficiency Virus-Positive Women. J Natl Cancer Inst 97: 577–586. [DOI] [PubMed] [Google Scholar]
- 12.De Vuyst H, Lillo F, Broutet N, Smith JS (2008) HIV, human papillomavirus, and cervical neoplasia and cancer in the era of highly active antiretroviral therapy. European Journal of Cancer Prevention 17: : 545–554 510.1097/CEJ.1090b1013e3282f1075ea1091. [DOI] [PubMed] [Google Scholar]
- 13. Denny LA, Franceschi S, de Sanjosé S, Heard I, Moscicki AB, et al. (2012) Human Papillomavirus, Human Immunodeficiency Virus and Immunosuppression. Vaccine 30 Supplement 5F168–F174. [DOI] [PubMed] [Google Scholar]
- 14. De Vuyst H, Mugo NR, Chung MH, McKenzie KP, Nyongesa-Malava E, et al. (2012) Prevalence and determinants of human papillomavirus infection and cervical lesions in HIV-positive women in Kenya. Br J Cancer 107: 1624–1630. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Moodley J, Hoffman M, Carrara H, Allan B, Cooper D, et al. (2006) HIV and pre-neoplastic and neoplastic lesions of the cervix in South Africa: a case-control study. BMC Cancer 6: 135. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Vanni T, Luz PM, Grinsztejn B, Veloso VG, Foss A, et al. (2012) Cervical cancer screening among HIV-infected women: An economic evaluation in a middle-income country. International Journal of Cancer 131: E96–E104. [DOI] [PubMed] [Google Scholar]
- 17. Yu Q, Shao H, He P, Duan Z (2013) World scientific collaboration in coronary heart disease research. International journal of cardiology 167: 631–639. [DOI] [PubMed] [Google Scholar]
- 18. Vasconcellos AG, Morel CM (2012) Enabling policy planning and innovation management through patent information and co-authorship network analyses: a study of tuberculosis in Brazil. PLoS One 7: e45569. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Long JC, Cunningham FC, Braithwaite J (2012) Network structure and the role of key players in a translational cancer research network: a study protocol. BMJ Open 2.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Clifford G, Goncalves M, Franceschi S, HPV, Group HS (2006) Human papillomavirus types among women infected with HIV: a meta-analysis. AIDS 20: 2337–2344. [DOI] [PubMed] [Google Scholar]
- 21. Guan P, Clifford GM, Franceschi S (2013) Human papillomavirus types in glandular lesions of the cervix: A meta-analysis of published studies. International Journal of Cancer 132: 248–250. [DOI] [PubMed] [Google Scholar]
- 22.World Bank classification of countries according to income-level.
- 23.Newman MEJ, Barabási A-L, Watts DJ (2006) The Structure and Dynamics of Networks: Princeton University Press.
- 24.De Nooy W, Mrvar A, Batageli V (2011) Exploratory Social Network Analysis with Pajek: Cambridge University Press.
- 25. Milgram S (1967) The Small World Problem. Psychology Today 2: 60–67. [Google Scholar]
- 26.Guare J (1992) Six Degrees of Separation: Dramatists Play Service.
- 27.Easley D, Kleinberg J (2010) Networks, Crowds, and Markets: Reasoning About a Highly Connected World: Cambridge University Press.
- 28.M B, S H, M J (2009) Gephi: an open source software for exploring and manipulating networks. International AAAI Conference on Weblogs and Social Media.
- 29. Fruchterman TMJ, Reingold EM (1991) Graph drawing by force-directed placement. Software: Practice and Experience 21: 1129–1164. [Google Scholar]
- 30.Page L, Brin S, Motwani R, Winograd T (1998) The PageRank Citation Ranking: Bringing Order to the Web.
- 31. Newman MEJ (2006) Modularity and community structure in networks. Proceedings of the National Academy of Sciences 103: 8577–8582. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Tarjan R (1972) Depth-First Search and Linear Graph Algorithms. SIAM Journal on Computing 1: 146–160. [Google Scholar]
- 33. Brandes U (2001) A faster algorithm for betweenness centrality*. The Journal of Mathematical Sociology 25: 163–177. [Google Scholar]
- 34. Latapy M (2008) Main-memory triangle computations for very large (sparse (power-law)) graphs. Theoretical Computer Science 407: 458–473. [Google Scholar]
- 35. Luxburg U (2007) A tutorial on spectral clustering. Statistics and Computing 17: 395–416. [Google Scholar]
- 36. Small H, Greenlee E (1989) A Co-Citation Study of AIDS Research. Communication Research 16: 642–666. [Google Scholar]
- 37. Bierbaum EG, Brooks TA (1995) The literature of acquired immunodeficiency syndrome (AIDS): Continuing changes in publication patterns and subject access. Journal of the American Society for Information Science 46: 530–536. [Google Scholar]
- 38. Sengupta IN, Kumari L (1991) Bibliometric analysis of AIDS literature. Scientometrics 20: 297–315. [Google Scholar]
- 39. Small H (1994) A SCI-Map case study: Building a map of AIDS research. Scientometrics 30: 229–241. [Google Scholar]
- 40. Onyancha OB, Ocholla DN (2004) A comparative study of the literature on HIV/AIDS in Kenya and Uganda: A bibliometric study. Library & Information Science Research 26: 434–447. [Google Scholar]
- 41. Matthew E. Falagas IAB, Barbara Kondilis, Elpidoforos S Soteriades (2006) Eighteen Years of Research on AIDS: Contribution of and Collaborations between Different World Regions. AIDS Research and Human Retroviruses 22: 1199–1205. [DOI] [PubMed] [Google Scholar]
- 42. Rosas SR, Kagan JM, Schouten JT, Slack PA, Trochim WM (2011) Evaluating research and impact: a bibliometric analysis of research by the NIH/NIAID HIV/AIDS clinical trials networks. PLoS One 6: e17428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Ronald S Burt (2004) Structural Holes and Good Ideas. American Journal of Sociology 110: 349–399. [Google Scholar]
- 44. Thijs J, Verkuyten M, Helmond P (2010) A Further Examination of the Big-Fish–Little-Pond Effect: Perceived Position in Class, Class Size, and Gender Comparisons. Sociology of Education 83: 333–345. [Google Scholar]
- 45. Ambos TC, Ambos B (2009) The impact of distance on knowledge transfer effectiveness in multinational corporations. Journal of International Management 15: 1–14. [Google Scholar]
- 46. Breschi S, Catalini C (2010) Tracing the links between science and technology: An exploratory analysis of scientists' and inventors' networks. Research Policy 39: 14–26. [Google Scholar]
- 47. Rochon PA, Mashari A, Cohen A, Misra A, Laxer D, et al. (2004) Relation between randomized controlled trials published in leading general medical journals and the global burden of disease. Canadian Medical Association Journal 170: 1673–1677. [DOI] [PMC free article] [PubMed] [Google Scholar]