Skip to main content
Frontiers in Research Metrics and Analytics logoLink to Frontiers in Research Metrics and Analytics
. 2026 Aug 5;11:1829439. doi: 10.3389/frma.2026.1829439

Navigating bibliometric indicators in university rankings: a conceptual framework for strategic research management

Wael Alkattan 1, Asma Terkawi 1,*, Mohamad Bakir 2, Mohammad Alaa Mufti 2, Karam Hamweyah 1
PMCID: PMC13485913  PMID: 42620856

Abstract

The increasing prominence of global university rankings has fundamentally transformed the strategic landscape of higher education institutions worldwide. This review examines the strategic application of bibliometric indicators, with particular emphasis on Field-Weighted Citation Impact (FWCI), in the context of university ranking systems. We propose a framework for institutions to develop metric-informed strategies while maintaining research integrity and avoiding the pitfalls of metric manipulation. The review concludes with actionable recommendations for universities seeking to enhance their global standing through evidence-based research management practices.

Keywords: bibliometrics, citation analysis, field-weighted citation impact, normalized metrics, research evaluation, scopus, strategic planning, university rankings

1. Introduction

The state of global higher education has undergone a profound transformation over the past two decades, driven largely by the increasing influence of international university rankings (Hazelkorn, 2011). These rankings have transitioned from basic reputational surveys to sophisticated multi-dimensional evaluation systems that profoundly influence institutional strategy, financial allocation, and academic agendas (Marginson and van der Wende, 2007). Research performance metrics have become crucial indicators of institutional ranking, with citation-based measures exerting significant influence.

The Field-Weighted Citation Impact (FWCI) signifies a notable progression in bibliometric techniques, tackling enduring issues with the comparability of citation trends across various academic fields (Merton, 1979). In contrast to conventional citation counts or journal-based metrics, FWCI offers a normalized metric that facilitates equitable assessment of research impact across disciplines with significantly divergent publication and citation practices. This standardization is essential for institutional evaluation, as universities generally include many specialties with distinct citation practices.

Global universities are progressively acknowledging that their standings in international rankings significantly affect their capacity to attract premier talent, obtain research funding, forge international collaborations (MacRoberts and MacRoberts, 1989), and cultivate a robust research ecosystem. The quest for enhanced metrics must prioritize research integrity and prevent the inadvertent implications of metric optimization.

This paper seeks to present an overview of FWCI and associated bibliometric indicators within the framework of university ranking systems. We investigate the theoretical underpinnings and methodological aspects of these metrics, compare various bibliometric platforms and their citation normalization strategies, and evaluate how prominent ranking algorithms integrate these measurements. Additionally, we examine the strategic implications for institutions aiming to elevate their global prominence. This article adopts a narrative review and conceptual synthesis approach rather than a systematic literature review. By integrating bibliometric theory, institutional strategy, and critical perspectives on ranking systems, this paper aims to provide a framework for research administrators and academic leaders. The paper examines the interplay between citation-based indicators, institutional isomorphism, and the practical challenges of balancing global reputation with localized research missions.

2. Theoretical foundations of citation-based metrics

2.1. The evolution of citation analysis

Citation analysis, utilized for assessing research impact, originates from the foundational contributions of Eugene Garfield and the creation of the Science Citation Index in the 1960s (Schubert and Braun, 1986). The core principle of citation-based evaluation is that citations serve as a means of intellectual recognition, whereby researchers acknowledge and build upon the contributions of their colleagues. This framework regards citations as markers of academic impact and the dissemination of knowledge throughout the scholarly community.

The interpretation of citations as definitive indicators of quality or impact has been widely questioned. Merton's (1979) “Matthew Effect” in science explains how citation aggregation can be swayed by elements beyond study quality, such as author fame and institutional status (Merton, 1979). MacRoberts and MacRoberts (1989) delineated various limits in citation analysis, encompassing negative citations, ceremonial citations, and systematic biases in citation practices across disciplines (MacRoberts and MacRoberts, 1989). The creation of normalized citation metrics evolved in reaction to these criticisms, namely tackling the issue of cross-disciplinary comparison. The acknowledgment that citation rates significantly differ among disciplines, with biomedical sciences often exhibiting substantially greater citation frequencies than mathematics or humanities, prompted the creation of field-normalized measures (Schubert and Braun, 1986).

2.2. Field normalization: principles and approaches

Field normalization constitutes a significant methodological enhancement in bibliometric analysis, facilitating substantive comparisons across many study domains. The core premise entails evaluating the citation performance of a publication relative to a reference set of like publications, generally characterized by subject area, publication year, and document type (Waltman, 2016).

A variety of methodologies for field normalization have been established over the years. Source normalization evaluates citations in relation to the journal of publication, as demonstrated by the Source Normalized Impact per Paper (SNIP) measure (Moed, 2010). Field-based normalization evaluates against articles within the same subject category, serving as the foundation for measures like the Category Normalized Citation Impact (CNCI) and the Field-Weighted Citation Impact (FWCI) (Waltman et al., 2011a,b). Citation-based clustering employs citation networks to algorithmically delineate domains, rather than depending on established categories, hence providing a possibly more precise depiction of intellectual relationships (Boyack and Klavans, 2010). Every method possesses unique benefits and drawbacks. Journal-based normalization may provide challenges for multidisciplinary research or publications that encompass multiple disciplines. Field-based normalization is significantly reliant on the precision and detail of subject classification systems. Citation-based clustering, although theoretically more precise in delineating intellectual connections, can be computationally demanding and less visible in its approach (Leydesdorff and Bornmann, 2016).

2.3. Comparative methodology: FWCI, CNCI, and RCR

Field-Weighted Citation Impact (FWCI), Category Normalized Citation Impact (CNCI), and Relative Citation Ratio (RCR) are prominent metrics utilized in bibliometrics. All three serve as article-level field-normalized citation indicators, although they utilize distinct reference sets for normalization, resulting in varying biases. The primary sub-queries involve the normalizing technique, the resultant biases stemming from field delineation, and the tangible implications for assessment and comparison. FWCI and CNCI employ the traditional cited-side normalization method, wherein a paper's citations are split by the mean citations of comparable articles from the same year and discipline (Haunschild et al., 2022; Bornmann and Wohlrabe, 2019; Bornmann and Haunschild, 2017). In Scopus-based applications, the anticipated count is determined by document type, publication year, and subject area, usually categorized by ASJC, with papers allocated to various fields employing a harmonic mean over those fields. RCR employs a cited-side ratio, although its domain is dynamically established through the co-citation network of the manuscript instead of a predetermined journal category (Bornmann and Haunschild, 2017; Janssens et al., 2017). The numerator consists of citations annually, while the denominator represents an anticipated citation rate based on publications inside that co-citation-defined domain, benchmarked against NIH-funded peer-reviewed journals, resulting in a more focused and contextual comparison group than category-based metrics (Hutchins et al., 2016; Smith et al., 2023; Reddy et al., 2021).

FWCI and CNCI assess influence by comparing articles against averages derived from the same year of publication, document classification, and subject category (Huggett et al., 2018). Conversely, the RCR assesses annual citations relative to a dynamically established benchmark determined by the paper's unique co-citation network (Hutchins et al., 2016; Reddy et al., 2021). Moreover, in contrast to the universal category benchmarks employed by FWCI and CNCI, the RCR is contingent upon a standard uniquely associated with the performance of NIH-funded counterparts (Smith et al., 2023).

The primary methodological bias in FWCI and CNCI arises from the classification approach employed to designate fields. Conventional classification-oriented normalization is recognized to encounter issues, and outcomes can significantly vary when the same formula is utilized with diverse field-categorization frameworks (Haunschild et al., 2022; Waltman and Van Eck, 2013). This is not merely a theoretical concept: journals within the same substantive domain might be allocated disparate ASJC codes, resulting in papers on similar subjects being standardized against varying benchmarks (Scelles and Teixeira Da Silva, 2025). RCR was partially developed to mitigate this issue using co-citation-based field delineation, which is more effective at distinguishing fields than cited or citing networks and is more suitable for interdisciplinary research. However, RCR possesses its own predisposition: co-citation networks may encompass numerous loosely associated papers, and one criticism revealed that around 80% of co-cited articles were referenced together solely once, potentially rendering field delineation ambiguous and inconsistent (Janssens et al., 2017). Empirically, FWCI and RCR tend to have a strong correlation and demonstrate comparable stability across several disciplines, particularly at elevated aggregation levels like universities. Research on normalization techniques indicates that disparities among methods tend to diminish at larger scales, although they become increasingly significant for individual manuscripts, small collectives, journals, or niche disciplines (Waltman et al., 2011a,b; Zitt et al., 2005).

2.4. The sociology of citations

Comprehending citation behavior necessitates an examination of the social and cultural aspects that affect researchers' citation practices. Research has demonstrated systematic variations in citation habits throughout fields, career phases, and geographic regions (Borgman and Furner, 2002). Review articles generally generate more citations than original research publications, not solely due to superior research quality, but because they serve as thorough reference sources (Miranda and Garcia-Carpintero, 2018). The notion of “citation cultures” includes the standards and practices that regulate citation practice within particular academic communities. These cultures affect variables such as the average number of citations per publication, the inclination to reference contemporary vs historical literature, and the preference for self-citation or citation of proximate collaborators (Hellsten et al., 2007). Understanding these cultural disparities is crucial for accurately interpreting citation-based metrics and creating equitable grading systems that consider disciplinary variables outside the scope of mathematical normalization.

3. Field-weighted citation impact: methodology and implementation

3.1. FWCI calculation methodology

The Field-Weighted Citation Impact, utilized in Elsevier's Scopus database and SciVal analytics platform, is one of the most often employed field-normalized citation metrics. The computation employs a direct yet complex method in which FWCI is defined as the ratio of actual citations received to anticipated citations (Dresbeck, 2015). The actual citations denote the cumulative citations garnered by a publication within a designated timeframe, whereas expected citations indicate the mean citations accrued by analogous publications, characterized by identical publication year, document type, and subject area as delineated by the All Science Journal Classification (ASJC) system.

This methodology considers several elements that affect citation patterns. By adjusting for publication year, FWCI accounts for the inherent buildup of citations over time. Document type normalization acknowledges that reviews generally garner more citations than original research papers. Field normalization facilitates comparison among disciplines characterized by significantly disparate citation rates (Purkayastha et al., 2019).

3.2. Handling interdisciplinary research

A primary problem in field normalization relate to publications that encompass numerous disciplines. Scopus employs a fractional counting method when a publication is categorized under multiple ASJC classifications. The anticipated citations are computed as a weighted average derived from the citation trends within each pertinent discipline (Leydesdorff and Opthof, 2010). This methodology has significant ramifications for the assessment of transdisciplinary research. Publications situated in the convergence of high-citation and low-citation domains may leverage this averaging effect, thereby fostering cross-disciplinary collaboration. Nonetheless, genuinely innovative multidisciplinary research that does not conform to established classifications may be at a disadvantage if the reference sets fail to adequately reflect the citation trends of the developing subject (Rafols et al., 2012).

An institution's FWCI is primarily driven by research profiles that exhibit worldwide collaboration and multidisciplinary diversity, rather than dependence on a singular dominant discipline (Limaymanta et al., 2022; Li and Yin, 2023). Empirical studies indicate that articles categorized as “Multidisciplinary,” in addition to particular domains like Medicine and Physics, consistently achieve the highest FWCI scores among global universities (Limaymanta et al., 2022). This interdisciplinarity serves as a quantifiable catalyst for quality; for example, organizations exhibiting significant multidisciplinary variety (e.g., a Shannon index above 2.5) often attain overall FWCI values >1.5 (Li and Yin, 2023). Nevertheless, this approach necessitates meticulous adjustment, as an overabundance of topics within a single study group may ultimately diminish citation influence instead of augmenting it (Balel, 2025). Significantly, enhancing institutional FWCI is not just reliant on increasing total publishing output. Research demonstrates that concentrated scholarly quality often surpasses sheer size, enabling smaller institutions or departments to exceed their more prolific counterparts in normalized influence (Cheng et al., 2026). The development of these particular multidisciplinary and collaborative profiles acts as a significant catalyst for performance ranking; however, institutional strategists should be cognizant that FWCI may still be artificially skewed due to erratic or unreliable field classifications in bibliometric databases (Liu et al., 2021).

3.3. Temporal considerations and citation windows

The selection of the citation window profoundly influences FWCI values and their interpretation. Although Scopus computes the FWCI constantly, with updates occurring as new citations are added, the time of the evaluation is significantly important. Various disciplines display unique citation velocity patterns: biomedical and life sciences experience swift initial citation growth, peaking within 2–3 years; physical sciences and engineering show moderate citation velocity with consistent accumulation over 3–5 years; while mathematics and humanities reveal slow citation accumulation, typically necessitating 5–10 years for substantial evaluation (Wang, 2013).

These disparities require meticulous investigation when employing FWCI for institutional assessment. A one-year citation window may significantly underestimate influence in slow-evolving domains while potentially overstating early citations in rapidly advancing industries. Optimal methodologies include employing 3–5 year intervals for thorough evaluation, incorporating field-specific modifications as necessary (Abramo et al., 2011).

3.4. Statistical properties and reliability

The statistical characteristics of FWCI significantly influence its application in research assessment. The distribution of FWCI values is markedly skewed, with the majority of articles attaining FWCI values under 1.0 and a prolonged tail of extensively referenced studies. This skewness means that institutional FWCI averages can be significantly influenced by a small number of highly cited publications (Waltman and van Eck, 2019). The reliability of FWCI values also depends on the size of the reference set. For publications in narrow specialties with few comparable papers, the expected citation calculation may be based on small samples, leading to greater uncertainty. Institutions should be cautious when interpreting FWCI values for publications in emerging or niche fields (Thelwall and Wilson, 2014).

4. FWCI in university ranking systems

4.1. Times higher education world university rankings

The Times Higher Education (THE) World University Rankings exemplifies a significant utilization of FWCI in institutional evaluation. THE's methodology assigns 30% of the total score to research citations, rendering it a vital element of ranking performance. The implementation encompasses various intricate components (Zhou et al., 2024; Bautista-Puig et al., 2022).

The citation score calculation is based on a 5-year publication window using Scopus data with FWCI as the underlying metric, excludes publications with fewer than a threshold number of authors, and applies regional modification factors to account for citation biases. Previously, THE utilized granular indicators such as Citation Impact (15%), Research Strength (75th percentile of FWCI), Research Excellence (percentage of publications in top 10% by FWCI), and Research Influence (network-based) (Marginson, 2022).

The methodology has since evolved to consolidate these into a unified “Research Quality” pillar, mitigating issues associated with mean-based metrics distorted by outliers. Under this framework, the production of top 10% highly cited publications exerts a substantial influence on institutional performance. Specifically, THE directly evaluates “Research Excellence” by calculating the number of institutional publications landing in the global top 10 citation percentiles, normalized by publication year, subject category, and staff size (Kwan et al., 2024; Innocent, 2025). Consequently, universities that strategically cultivate these elite outputs not only maximize this targeted sub-indicator but also elevate their broader field-weighted citation metrics, which strongly correlate with upward ranking mobility (Szluka et al., 2023; Tóth et al., 2024). Benchmarking analyses confirm this pattern, revealing that top-ranked global institutions consistently couple a high overall FWCI with a disproportionately large share of top 10% outputs (Kwan et al., 2024). Nevertheless, relying exclusively on highly cited papers is a flawed institutional strategy. Because the THE methodology employs a multi-pillar evaluation framework, the ranking benefits of elite citation impact can be entirely offset by low overall publication volume, deficits in teaching or international outlook, or the influx of highly competitive new entrants (Innocent, 2025; Tóth et al., 2024). Therefore, while top 10% publications are a critical lever for maximizing citation-based scores, their impact is fully realized only when integrated into a comprehensive strategy that sustains robust research volume alongside performance across all methodological pillars (Rajagukguk et al., 2023).

4.2. Other ranking systems and citation metrics

Although THE notably incorporates FWCI, other significant ranking systems utilize alternative methodologies for citation analysis. The QS World University Rankings employs citations per faculty as its principal citation metric, derives data from Scopus without implementing field normalization, has faced criticism for potential bias against institutions in low-citation disciplines, and utilizes a more straightforward methodology that is less adept at addressing disciplinary variations (Hazelkorn and Mihut, 2021).

The Academic Ranking of World Universities (ARWU/Shanghai) incorporates highly cited researchers from the Clarivate Analytics list, utilizes publications in Nature and Science as indicators, applies various citation methodologies in discipline-specific rankings, and prioritizes absolute performance over normalized metrics (Liu and Cheng, 2005). The Leiden Ranking by CWTS is solely bibliometric, presenting several indicator alternatives, including both field-normalized and non-normalized metrics, enabling users to choose indicators and parameters, and exhibiting the highest transparency in process among prominent rankings (Waltman, 2016). The variety of methodologies underscores the absence of agreement on ideal citation metrics. Institutions must comprehend the technique of each system to formulate suitable strategies for enhancement (Daraio et al., 2016).

4.3. Regional and specialized rankings

In addition to worldwide rankings, other regional and specialty ranking systems utilize citation measures. The THE Asia University Rankings utilize a modified methodology that considers regional citation patterns, the QS Latin America Rankings apply adjusted weights to acknowledge regional publication habits, and U-Multirank, a European initiative, provides a multidimensional assessment (Hazelkorn and Gibson, 2017).

Subject-specific rankings frequently depend more on citation metrics because of disciplinary consistency, may utilize specialist databases, and can more effectively consider field-specific publication norms. These specialized rankings frequently offer a more detailed evaluation for universities with specific regional or disciplinary strengths. Nevertheless, they may be deficient in worldwide awareness and reputation compared to comprehensive world rankings (Aguillo et al., 2010).

4.4. Global rankings vs. local mission

A core conflict arises between enhancing global standings, which favor uniform results such as citation metrics, and addressing local societal objectives, which necessitate contextually relevant involvement (Mohamed Hashim et al., 2022; Drissi et al., 2025; Borodiyenko et al., 2023). As global frameworks urge universities to attain transnational prominence, regional advancement necessitates that institutions tackle particular topographical and socio-economic challenges (Thomas et al., 2023; Jones et al., 2021; Zenkiene and Leišyte, 2024; Fonseca and Nieth, 2021). This discrepancy is more pronounced when organizations encounter urgent societal demands. Arab colleges frequently emphasize urgent regional issues such as health, education, and unemployment (Saleh and Adly, 2024), whereas institutions in the Global South concentrate on localized sustainability (Drissi et al., 2025), crucial initiatives that are predominantly overlooked in international assessments.

Due to these conflicting demands, colleges are progressively embracing comprehensive roles in regional policy and community advancement (Thomas et al., 2023). Peripheral universities, especially, maintain significant interactions with local governments, and in times of crisis, this civic approach often takes precedence over research reputation as a key institutional focus (Fonseca and Nieth, 2021; Orzhel et al., 2023). Nonetheless, a continual operational discrepancy exists: although university strategic frameworks often advocate for regional accountability, their internal assessments and motivators seldom provide comprehensive backing for it (Borodiyenko et al., 2023).

Harmonizing these conflicting demands necessitates the reconfiguration of government and collaborations instead of viewing global standings and local involvement as opposing priorities (Zenkiene and Leišyte, 2024; Filho et al., 2023). Research suggests that collaboration across sectors, regional establishment, and deliberate involvement of stakeholders can simultaneously improve social effect and external recognition (Filho et al., 2023; Sribanasarn et al., 2025). In the end, colleges are evaluated based on international standards, yet their most significant impacts are frequently local, relational, and enduring, underscoring the persistent tension between quantifiable worldwide reputation and contextual societal worth (Veidemane, 2022; Hastangka Rahma et al., 2025).

5. Strategic applications and institutional implementation

5.1. Developing FWCI-informed institutional strategies

Universities aiming to improve their FWCI performance must formulate comprehensive strategies that match with their mission and capitalize on their existing strengths and areas of excellence. Effective execution necessitates synchronized efforts across several tiers. Universities should set explicit research performance objectives in accordance with strategic plans, invest in bibliometric infrastructure and expertise, implement incentive structures that prioritize quality over quantity, formulate policies that promote international collaboration, and allocate resources based on performance potential and strategic priorities.

International collaboration typically exhibits a robust positive correlation with normalized citation metrics like FWCI, while the extent of this advantage is significantly influenced by the strategic nature of the collaboration. Empirical investigations conducted in various international settings encompassing 60 institutions across five continents including public colleges in South America demonstrate that augmenting the number of nations included in a publication greatly enhances its FWCI (Limaymanta et al., 2022; Duarte et al., 2025). This increase is mostly fueled by articles co-authored abroad, which garner a significantly greater number of foreign citations, thus enhancing the research's visibility outside national limits (Wang et al., 2024). Nonetheless, optimizing FWCI cannot be accomplished with a simplistic “more is better” strategy concerning the number of countries. The caliber of partners is a vital factor; partnerships with economies that invest significantly in research are invariably linked to superior outcomes (Thelwall et al., 2024). Moreover, when cooperative networks consist of nations with very disparate research system capabilities, extensive international collaboration does not automatically surpass robust, concentrated regional studies (Vieira, 2023). Consequently, institutional approaches ought to transcend merely increasing the quantity of international collaborators, prioritizing the development of alliances that strategically enhance access to robust, high-investment research networks.

At the faculty and departmental level, implementation entails formulating a departmental research strategy that incorporates specific FWCI benchmarks, delivering consistent performance feedback via bibliometric dashboards, assisting early-career researchers in establishing high-impact research agendas, identifying research priorities, promoting interdisciplinary collaboration aligned with institutional strengths, and providing training on publication strategies and journal selection (Abramo et al., 2018).

Institutions should instruct individual researchers on citation metrics and their effects, offer a comprehensive guide to enhance awareness, provide tools and assistance for identifying high-impact publication venues, promote strategic collaboration with high-performing international partners, facilitate attendance at esteemed conferences for networking, and acknowledge and reward significant FWCI accomplishments in promotion considerations (Hicks et al., 2015).

5.2. Avoiding pitfalls and unintended consequences

The purposeful pursuit of enhanced metrics must be tempered by an understanding of possible adverse outcomes. Gaming and manipulation may occur through excessive self-citation or citation rings, fragmentation of research into numerous publications, evasion of dangerous or creative research that may not yield quick citations, and the disregard of teaching or service obligations in favor of publication pursuits (Biagioli and Lippman, 2020).

Excessive focus on FWCI may introduce disciplinary bias, disadvantaging professions with naturally lower citation rates or extended citation half-lives.

Field-normalized citation metrics, such the Field-Weighted Citation Impact (FWCI), may systematically penalize specialized research, applied sciences, and the humanities when baseline domains are inadequately defined, excessively broad, or derived from incomplete databases. In highly specialized niche domains, journals with overlapping substantive interests are often categorized into several subject classifications, leading to comparable articles being assessed against varying standards instead of a genuine peer group (Scelles and Teixeira Da Silva, 2025; Lisciandra, 2025). Moreover, expansive field classifications frequently do not effectively distinguish the unique citation practices of particular subfields (Lisciandra, 2025). The distinctive citation patterns of vertebrate paleontology are inaccurately portrayed when compared to wider ecological or geoscientific standards (Price, 2025). Applied sciences encounter further obstacles, as insufficient data and an absence of interconnected records in niche areas—like engineering or healthcare—make field-based normalization statistically precarious and untrustworthy (Szomszor and Adie, 2022).

The humanities and social sciences are especially disadvantaged by dependence on prominent bibliographic databases, which have traditionally shown inadequate representation of non-journal materials such as books and conference proceedings (Wilder and Walters, 2021; Worrall and Cohn, 2023). This disproportionate index coverage fundamentally distorts cross-disciplinary comparisons, as reliance on databases is a principal factor for citation metrics to vary significantly by discipline (Lisciandra, 2025). Moreover, research that is applied and socially engaged is systematically devalued as conventional metrics of publishing and citation do not adequately reflect a paper's wider impact on education, practical use, and public understanding (Wilder and Walters, 2021; Davies et al., 2021).

Notwithstanding these systemic drawbacks, it is crucial to acknowledge that the bias is not definitive; field-normalized citations continue to exhibit a favorable correlation with research quality across all disciplines, including the arts and humanities eight. Nonetheless, excessive dependence on these indicators may “over-simplify” specialty with varying average quality or citation practices, unintentionally masking achievement in transdisciplinary or ancillary domains instead of highlighting it (Thelwall and Jiang, 2025; Thelwall et al., 2023). As a result, measures such as FWCI often disadvantage research fields that are minor, diverse, inadequately indexed, or influential outside conventional journal formats, highlighting the importance of employing them with more comprehensive evaluation techniques instead of relying on them as isolated assessment instruments.

Institutions must ensure that evaluation systems account for disciplinary differences beyond what field normalization provides (Hammarfelt and de Rijcke, 2015). Ethical considerations are crucial, as the temptation to enhance metrics has been associated with a rise in scientific misconduct, including data fabrication and improper authoring procedures. Institutions must maintain strong research integrity frameworks alongside performance management systems (Fanelli, 2009).

6. Future directions and emerging trends

6.1. Technological advances in bibliometrics

Technological advancements are shaping the future of citation analysis and study appraisal. Artificial intelligence and machine learning facilitate the automated categorization of publications into precise subject classifications, forecasting future citation impact based on preliminary indicators, identifying citation manipulation and anomalous patterns, and employing natural language processing to comprehend citation context and sentiment (Fortunato et al., 2018).

The incorporation of artificial intelligence in research assessment presents considerable dangers of prejudiced and unclear evaluations that may compromise equity, diminish trust, and adversely influence researcher conduct (Thelwall, 2025). A major issue is the emergence of algorithmic, data, and user-interaction biases that might systematically punish certain demographics or academic disciplines instead of impartially evaluating quality. Despite seemingly strong technical performance, latent biases in big language models constitute a significant risk to fair assessment, a challenge intensified by unrepresentative training datasets that often overlook minority instances and academic contributions from the Global South (Pagano et al., 2023; Baumgartner et al., 2023). The absence of transparency exacerbates these bias issues. The opaque characteristics of numerous AI models hinder substantial independent evaluation; for example, an analysis of AI usage in oncology indicated that hardly 22% of research provided adequate data and repeatability resources, underscoring how lack of transparency impedes scientific validation (Smiley et al., 2025). Genuine transparency demands not only observable results but also thorough data lineage, ongoing oversight, and verifiable mechanisms. In the end, if AI instruments in bibliometrics are not meticulously scrutinized and consistently monitored by humans, they may provide inequitable rankings, enable unaccountable administrative choices, and foster new incentives for researchers to manipulate outcomes (Singhal et al., 2024).

Blockchain and distributed systems provide opportunities for transparent and immutable documentation of citations and metrics, decentralized methodologies for research assessment, and smart contracts for automated acknowledgment and reward mechanisms (Tenorio-Fornés et al., 2018). Real-time analytics are evolving from intermittent snapshots to continuous monitoring, incorporating dynamic dashboards with predictive analytics and early warning systems for performance deterioration (Rousseau et al., 2018).

6.2. Evolving evaluation frameworks

The research evaluation landscape is experiencing fundamental shifts in response to critiques of current systems. The responsible metrics movement, adhering to the San Francisco Declaration on Research Assessment (DORA) and the Leiden Manifesto, advocates for the utilization of quantitative metrics to complement, rather than replace, qualitative assessment. It acknowledges disciplinary variations in evaluation, recognizes a range of research outputs beyond journal articles, and emphasizes transparency in the computation and application of metrics (Hicks et al., 2015).

Multi-dimensional assessment methodologies will likely integrate various indicators, encompassing traditional citation metrics with enhanced normalization, altmetrics, societal impact measures, open science practices, reproducibility, collaboration and knowledge transfer metrics, as well as contributions to teaching and mentoring (European Commission, 2017). Instead of universal metrics, assessment may become more tailored to institutional missions, regional priorities, and disciplinary standards. This may result in more meaningful evaluations but complicate international comparisons (Ràfols, 2019).

6.3. Implications for global higher education

The advancement of research metrics and ranking systems significantly impacts the worldwide higher education environment. The growing stratification may occur as the focus on quantifiable research performance intensifies disparities between well-funded universities adept at strategic metric optimization and those lacking such resources. This may result in an increased concentration of resources and talent within already prestigious colleges (Cantwell and Taylor, 2013).

6.4. Institutional isomorphism and university rankings

Institutional isomorphism clarifies the ranking conduct of universities as an endeavor for legitimacy amongst shared external influences, compelling institutions to adopt like frameworks, agendas, and performance indicators (Stensaker et al., 2019; Fowles et al., 2016). In rankings, this typically entails modifying strategy, governance, and research endeavors to align with the indicators that denote worldwide standing, particularly citations, reputation, and international prominence (Szluka et al., 2023; Meylani, 2026; Peters, 2019).

Coercive isomorphism explains the process in which governments, accreditors, and policy frameworks associated with rankings compel universities to conform to approved organizational structures (Anafinova, 2020; Cardona Mejía et al., 2019). In the realm of higher education, this frequently entails the compulsion to embrace the Anglo-American research university paradigm, as prominent rankings favor research productivity and citations in prestigious English-language journals. Mimetic isomorphism elucidates the phenomenon whereby lower-status or uncertain colleges imitate the methods of more prestigious institutions in contexts where rankings delineate clear victors and vanquished. This emulation include the utilization of rankings in strategic development, the modeling of successful academic institutions, and adherence to recognized organizational frameworks for accreditation, programs, and research strategy (Anafinova, 2020; Cardona Mejía et al., 2019; Yoon et al., 2021). Normative isomorphism elucidates convergence via professional standards, prestigious faculty pathways, and global networks that propagate common perceptions of an exemplary university. In reality, colleges hire professors educated in prevailing research frameworks and use ranking criteria as assumed indicators of quality and credibility (Anafinova, 2020; Yoon et al., 2021; Adam, 2024).

Isomorphism does not yield absolute uniformity; responses are differentiated by status. Universities of varying ranks seek legitimacy through distinct approaches, although aligning with similar worldwide indicators (Stensaker et al., 2019; Adam, 2024). Rankings have significant stability and are contingent on prior paths, hence imitation may bolster established hierarchies instead of facilitating seamless transitions (Fowles et al., 2016; Peters, 2019; Sallam, 2025). This elucidates how ranking-driven isomorphism can constrict institutional diversity and skew academic conduct. Ranking systems streamline performance evaluation, encourage uniformity, and motivate focus on comparative standing, whereas publication-centric metrics might redirect research priorities toward enhancing visibility and maximizing citations (Maka et al., 2026). Recent findings additionally highlight more pronounced metric-responsive conduct at certain rapidly ascending colleges, encompassing authorship irregularities and heightened integrity-related threats (Meho, 2025) (Figure 1).

Figure 1.

Diagram illustrating the metric-informed strategic cycle in academic research, showing the interactions among local mission, bibliometric indicators, university rankings, isomorphic pressures, metric risks, responsible metrics frameworks, research management, and research outputs, with arrows representing cyclical relationships, safeguards, distorting influences, and tensions.

Conceptual framework of the metric-informed strategic cycle. Field-normalized bibliometric indicators (FWCI, CNCI, RCR) aggregate into global ranking scores, which generate coercive, mimetic, and normative isomorphic pressures that shape institutional research management strategies; the resulting research outputs feed back into the indicators. Responsible metrics frameworks (DORA, Leiden Manifesto) act as a safeguard on this cycle, while unchecked metric optimization introduces distortions (gaming, disciplinary bias, integrity risks). The institution's local and societal mission stands in bidirectional tension with globally oriented ranking performance.

7. Recommendations for strategic implementation

Based on our comprehensive analysis, we propose the following recommendations for institutions seeking to strategically leverage FWCI and related metrics.

7.1. Strategic recommendations

By funding training programs for administrators, faculty, and researchers, setting up specialized bibliometric support units with technical know-how, and fostering an institution-wide awareness of metrics' advantages and disadvantages, institutions can cultivate comprehensive bibliometric literacy (Petersohn and Heinze, 2018). Balanced performance frameworks need to incorporate FWCI as a component within multi-dimensional assessment systems, tailor targets and benchmarks according to discipline and career stage, and prioritize research quality and integrity in conjunction with metrics (GläSer and Laudel, 2007).

Strategic alliances should be developed by discovering and nurturing partnerships with institutions, facilitating international mobility and exchange programs (Wagner and Leydesdorff, 2005). Investment in research infrastructure must ensure access to extensive bibliometric databases and tools, facilitate open access publishing in reputable settings, and establish institutional repositories to enhance exposure (Tennant et al., 2016).

Open Access (OA) publishing serves as a significant factor in the citation performance of institutions, while its influence on Field-Weighted Citation Impact (FWCI) is somewhat complex. Although open access journals typically achieve greater total citation counts and engage a more varied geographical and institutional readership, consistent FWCI improvements are not assured across every subject or open access format (Hadad et al., 2025). Empirical data suggests that Green OA, which employs repository-based access, exhibits the greatest significant citation benefit, consistently producing elevated FWCI scores and enhanced citation diversity compared to publisher-platform OA (Huang et al., 2024). Moreover, when journals consistently adopt open access models, they generally observe heightened publication rates and standardized citation influence, but these improvements differ significantly between disciplines (Momeni et al., 2021). It is essential that institutional open access plans are weighed against systemic equity risks. The shift to Open Access, especially those dependent on hybrid Article Processing Charges (APCs), may not ensure enhanced impact and may unintentionally exacerbate authorship inequality by limiting publishing opportunities for academics in economically disadvantaged areas (Chen et al., 2024; Levin et al., 2024). Thus, organizations aiming to strengthen FWCI ought to emphasize strong repository frameworks (Green OA) rather than universal mandates, guaranteeing that initiatives to improve global visibility do not undermine international collaborative fairness.

7.2. Policy and governance recommendations

Policymakers and ranking bodies should enhance methodological precision to improve classification methods for new disciplines, devise superior strategies for interdisciplinary research, and rectify acknowledged biases in citation databases and practices. Transparency must be enhanced by mandating comprehensive disclosure of ranking techniques and data sources, facilitating institutional verification of their data, and disseminating confidence intervals and indicators of ambiguity.

Responsible use should be encouraged through developing guidelines for appropriate metric application, discouraging over-reliance on single indicators, and supporting research into evaluation methodologies (de Rijcke et al., 2016). Specialized measures should be developed for various regional and disciplinary contexts, instead of uniform evaluation methods and acknowledging unique paradigms of research achievement.

8. Conclusion

The Field-Weighted Citation Impact has become an effective instrument for research evaluation, providing substantial benefits above conventional citation counts due to its advanced normalization methodology. The FWCI's significant position in esteemed rating systems such as Times Higher Education has become it an essential statistic for institutional strategy and research administration. Our analysis indicates that although FWCI mitigates certain shortcomings of previous citation metrics, it possesses its own limitations and potential for misuse. The strategic utilization of FWCI and associated metrics necessitates a sophisticated comprehension of their technical characteristics, recognition of their limitations, and dedication to responsible execution. Institutions must avoid the inclination to prioritize metric optimization over research quality, integrity, and overarching academic principles. The most effective strategies will utilize metrics as instruments to promote institutional excellence, rather than viewing them as objectives in their own right. The primary objective of any metric system should be to foster and acknowledge exemplary research that enhances knowledge and serves societal interests. By sustaining this viewpoint while selectively utilizing bibliometric indicators, institutions can increase their global reputation in ways that bolster rather than undermine their core academic goals. The forthcoming issue involves managing the conflict between competitive demands and academic principles, use metrics judiciously to cultivate research environments that are both outstanding and sustainable. The primary objective of any metric system should be to foster and acknowledge outstanding research that enhances knowledge and serves societal interests. By adopting this viewpoint and deliberately utilizing bibliometric indicators, institutions can increase their global reputation in ways that support rather than undermine their core academic objectives. The forthcoming challenge involves managing the conflict between competitive pressures and academic principles, use metrics judiciously to cultivate research environments that are both exemplary and sustainable.

Funding Statement

The author(s) declared that financial support was not received for this work and/or its publication.

Footnotes

Edited by: Siluo Yang, Wuhan University, China

Reviewed by: Walter Ysebaert, Vrije University Brussels, Belgium

Mahesh Bhanushali, Dr VN Bedekar Institute of Management Studies, India

Author contributions

WA: Supervision, Writing – review & editing. AT: Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing. MB: Conceptualization, Methodology, Investigation, Formal analysis, Data curation, Visualization, Project administration, Writing – original draft, Writing – review & editing. MM: Writing – review & editing. KH: Supervision, Writing – review & editing.

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declared that Generative AI was used in the creation of this manuscript. Generative AI (Google Gemini) was utilized to improve the language, readability, and structural flow of the manuscript. The author(s) reviewed, edited, and take full responsibility for all final content.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  1. Abramo G., Cicero T., D'Angelo C. A. (2011). Assessing the varying level of impact measurement accuracy as a function of the citation window length. J. Inform. 5, 659–667. doi: 10.1016/j.joi.2011.06.004 [DOI] [Google Scholar]
  2. Abramo G., D'Angelo C. A., Costa F. D. (2018). The effect of multidisciplinary collaborations on research diversification. Scientometrics 116, 423–433. doi: 10.1007/s11192-018-2746-2 [DOI] [Google Scholar]
  3. Adam E. A. (2024). reappraisal of global university rankings' influence in Canada: a senior university leaders' perspective. J. Further High. Educ. 48, 56–69. doi: 10.1080/0309877X.2023.2253430 [DOI] [Google Scholar]
  4. Aguillo I. F., Bar-Ilan J., Levene M., Ortega J. L. (2010). Comparing university rankings. Scientometrics 85, 243–256. doi: 10.1007/s11192-010-0190-z [DOI] [Google Scholar]
  5. Anafinova S. (2020). The role of rankings in higher education policy: coercive and normative isomorphism in Kazakhstani higher education. Int. J. Educ. Develop. 78:102246. doi: 10.1016/j.ijedudev.2020.102246 [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Balel Y. (2025). The most influential publications in oral and maxillofacial surgery over the past decade. J. Stomatol. Oral Maxillofacial Surg. 126:102110. doi: 10.1016/j.jormas.2024.102110 [DOI] [PubMed] [Google Scholar]
  7. Baumgartner R., Arora P., Bath C., Burljaev D., Ciereszko K., Custers B., et al. (2023). Fair and equitable AI in biomedical research and healthcare: social science perspectives. Artificial Intel. Med. 144:102658. doi: 10.1016/j.artmed.2023.102658 [DOI] [PubMed] [Google Scholar]
  8. Bautista-Puig N., Orduña-Malea E., Perez-Esparrells C. (2022). Enhancing sustainable development goals or promoting universities? An analysis of the Times Higher Education impact rankings. Int. J. Sustain. Higher Educ. 23, 211–231. doi: 10.1108/IJSHE-07-2021-0309 [DOI] [Google Scholar]
  9. Biagioli M., Lippman A. (2020). Gaming the Metrics: Misconduct and Manipulation in Academic Research (Cambridge, MA: MIT Press; ), 307. doi: 10.7551/mitpress/11087.001.0001 [DOI] [Google Scholar]
  10. Borgman C. L., Furner J. (2002). Scholarly communication and bibliometrics. Annual Rev. Inform. Sc. Technol. 36, 2–72. doi: 10.1002/aris.1440360102 [DOI] [Google Scholar]
  11. Bornmann L., Haunschild R. (2017). Relative Citation Ratio (RCR): an empirical attempt to study a new field-normalized bibliometric indicator. Assoc. Inform. Sci. Tech. 68, 1064–1067. doi: 10.1002/asi.23729 [DOI] [Google Scholar]
  12. Bornmann L., Wohlrabe K. (2019). Normalisation of citation impact in economics. Scientometrics 120, 841–884. doi: 10.1007/s11192-019-03140-w [DOI] [Google Scholar]
  13. Borodiyenko O., Malykhina Y., Spryndys S., Kamenska I., Bokshyts O. (2023). Ukrainian universities as clusters of regional socioeconomic development: inspirations from European experience. ФКДПТП 3, 447–456. doi: 10.55643/fcaptp.3.50.2023.4026 [DOI] [Google Scholar]
  14. Boyack K. W., Klavans R. (2010). Co-citation analysis, bibliographic coupling, and direct citation: which citation approach represents the research front most accurately? J. Am. Soc. Inform. Sci. Technol. 61, 2389–2404. doi: 10.1002/asi.21419 [DOI] [Google Scholar]
  15. Cantwell B., Taylor B. J. (2013). Global status, intra-institutional stratification and organizational segmentation: a time-dynamic tobit analysis of ARWU position among U.S. Universities. Minerva 51, 195–223. doi: 10.1007/s11024-013-9228-8 [DOI] [Google Scholar]
  16. Cardona Mejía L. M., Pardo Del Val M., Dasí Coscollar À. (2019). The institutional isomorphism in the context of organizational changes in higher education institutions. IJRES 6:61. doi: 10.46328/ijres.v6i1.639 [DOI] [Google Scholar]
  17. Chen B. K., Custis T., Monteggia L. M., George T. P. (2024). Effects of open access publishing on article metrics in Neuropsychopharmacology. Neuropsychopharmacol. 49, 757–763. doi: 10.1038/s41386-024-01796-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Cheng Z., Liu X., Zou Y., Zhang W., Zhou J. (2026). Rethinking knowledge production in university research teams: an intellectual capital-based analysis from Chinese engineering disciplines. European J. Educ. 61:e70455. doi: 10.1111/ejed.70455 [DOI] [Google Scholar]
  19. Daraio C., Lenzerini M., Leporelli C., Moed H. F., Naggar P., Bonaccorsi A., et al. (2016). Data integration for research and innovation policy: an ontology-based data management approach. Scientometrics 106, 857–871. doi: 10.1007/s11192-015-1814-0 [DOI] [Google Scholar]
  20. Davies S. W., Putnam H. M., Ainsworth T., Baum J. K., Bove C. B., Crosby S. C., et al. (2021). Promoting inclusive metrics of success and impact to dismantle a discriminatory reward system in science. PLoS Biol. 19:e3001282. doi: 10.1371/journal.pbio.3001282 [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. de Rijcke S., Wouters P. F., Rushforth A. D., Franssen T. P., Hammarfelt B. (2016). Evaluation practices and effects of indicator use—a literature review. Res. Evaluat. 25, 161–169. doi: 10.1093/reseval/rvv038 [DOI] [Google Scholar]
  22. Dresbeck R. (2015). SciVal. J Med Libr Assoc. 103, 164–166. doi: 10.3163/1536-5050.103.3.018 [DOI] [Google Scholar]
  23. Drissi M., Meftah S., Skalli L. (2025). The role of universities in implementing the sustainable development goals (SDGs): a case study of Hassan First University (2018–2023). Discover Sustain. 6:926. doi: 10.1007/s43621-025-01547-5 [DOI] [Google Scholar]
  24. Duarte I., Santos H. G. G., Rodrigues M. L. A. (2025). General analysis of the impact of international collaboration on the citation indices of scientific publications from 60 institutions across five continents. Acad. Bras. Ciênc. 97:e20241035. doi: 10.1590/0001-3765202520241035 [DOI] [PubMed] [Google Scholar]
  25. European Commission. (2017). Bar-Ilan University (IL), Directorate-General for Research and Innovation (European Commission), Graz University of Technology, Kiel University, Leibniz Information Centre for Economics, Leiden University, et al. Next-generation metrics: responsible metrics and evaluation for open science. Publications Office of the European Union. Available online at: https://data.europa.eu/doi/10.2777/337729 (Accessed May 31, 2025).
  26. Fanelli D. (2009). How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PLoS ONE. 4:e5738. doi: 10.1371/journal.pone.0005738 [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Filho W. L., Abubakar I. R., Mifsud M. C., Eustachio J. H. P. P., Albrecht C. F., Dinis M. A. P., et al. (2023). Governance in the implementation of the UN sustainable development goals in higher education: global trends. Environ Dev Sustain. 27, 20695–20718. doi: 10.1007/s10668-023-03278-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Fonseca L., Nieth L. (2021). The role of universities in regional development strategies: a comparison across actors and policy stages. European Urban Reg. Stud. 28, 298–315. doi: 10.1177/0969776421999743 [DOI] [Google Scholar]
  29. Fortunato S. Bergstrom C. T. Börner K. Evans J. A. Helbing D. Milojević S. Science of science. Science (2018) 359:eaao0185. 10.1126/science.aao0185 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Fowles J., Frederickson H. G., Koppell J. G. S. (2016). University rankings: evidence and a conceptual framework. Public Adm. Rev. 76, 790–803. doi: 10.1111/puar.12610 [DOI] [Google Scholar]
  31. GläSer J., Laudel G. (2007). “The social construction of bibliometric evaluations,” in The Changing Governance of the Sciences: The Advent of Research Evaluation Systems, eds. R. Whitley, and J. Gläser (Dordrecht: Springer Netherlands), 101–123. Available online at: https://doi.org/10.1007/978-1-4020-6746-4_5 (Accessed May 31, 2025). doi: 10.1007/978-1-4020-6746-4_5 [DOI] [Google Scholar]
  32. Hadad S., Raban D., Aharony N. (2025). Unequal access, unequal impact? the role of open access policies in publishing and citation trends across three countries. Publications 13:20. doi: 10.3390/publications13020020 [DOI] [Google Scholar]
  33. Hammarfelt B., de Rijcke S. (2015). Accountability in context: effects of research evaluation systems on publication practices, disciplinary norms, and individual working routines in the faculty of Arts at Uppsala University. Res. Evaluat. 24, 63–77. doi: 10.1093/reseval/rvu029 [DOI] [Google Scholar]
  34. Hastangka Rahma A., Fitria H., Sihombing A. A., Agung I., Siswanto H. W. (2025). Education for Sustainable Development (2005–2025): a critical policy analysis of global and local frameworks. J. Environ. Educ. 56, 477–492. doi: 10.1080/00958964.2025.2565483 [DOI] [Google Scholar]
  35. Haunschild R., Daniels A. D., Bornmann L. (2022). Scores of a specific field-normalized indicator calculated with different approaches of field-categorization: are the scores different or similar? J. Inform. 16:101241. doi: 10.1016/j.joi.2021.101241 [DOI] [Google Scholar]
  36. Hazelkorn E. (ed.). (2011). “Impact and influence of rankings — the view from inside higher education,” in Rankings and the Reshaping of Higher Education: The Battle for World-Class Excellence (London: Palgrave Macmillan UK; ), 82–120. Available online at: https://doi.org/10.1057/9780230306394_4 (Accessed May 31, 2025). doi: 10.1057/9780230306394_4 [DOI] [Google Scholar]
  37. Hazelkorn E., Gibson A. (2017). Global science, national research, and the question of university rankings. Palgrave Commun. 3, 1–11. doi: 10.1057/s41599-017-0011-6 [DOI] [Google Scholar]
  38. Hazelkorn E., Mihut G. (2021). Research Handbook on University Rankings. Cheltenham: Edward Elgar Publishing. Available online at: https://EconPapers.repec.org/RePEc:elg:eebook:18635 (Accessed May 31, 2025).
  39. Hellsten I., Lambiotte R., Scharnhorst A., Ausloos M. (2007). Self-citations, co-authorships and keywords: a new approach to scientists' field mobility? Scientometrics 72, 469–486. doi: 10.1007/s11192-007-1680-5 [DOI] [Google Scholar]
  40. Hicks D., Wouters P., Waltman L., de Rijcke S., Rafols I. (2015). Bibliometrics: the Leiden Manifesto for research metrics. Nature 520, 429–431. doi: 10.1038/520429a [DOI] [PubMed] [Google Scholar]
  41. Huang C. K., Neylon C., Montgomery L., Hosking R., Diprose J. P., Handcock R. N., et al. (2024). Open access research outputs receive more diverse citations. Scientometrics 129, 825–845. doi: 10.1007/s11192-023-04894-0 [DOI] [Google Scholar]
  42. Huggett S., James C., Palmaro E. (2018). “Field-weighting readership: how does it compare to field-weighting citations?” in Altmetrics for Research Outputs Measurement and Scholarly Information Management, eds. M. Erdt, A. Sesagiri Raamkumar, E. Rasmussen, and Y. L. Theng. (Singapore: Springer Singapore), 96–104. (Communications in Computer and Information Science). Available online at: https://link.springer.com/10.1007/978-981-13-1053-9_8 (Accessed July 19, 2026). doi: 10.1007/978-981-13-1053-9_8 [DOI] [Google Scholar]
  43. Hutchins B. I., Yuan X., Anderson J. M., Santangelo G. M. (2016). Relative Citation Ratio (RCR): a new metric that uses citation rates to measure influence at the article level. Vaux DL, editor. PLoS Biol. 14:e1002541. doi: 10.1371/journal.pbio.1002541 [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Innocent C. M. (2025). Times Higher Education's administrative influence on tertiary education in Thailand: a comparative content analytical study. AJSSMS 12, 28–38. doi: 10.20448/ajssms.v12i1.6807 [DOI] [Google Scholar]
  45. Janssens A. C. J. W., Goodman M., Powell K. R., Gwinn M. (2017). A critical evaluation of the algorithm behind the Relative Citation Ratio (RCR). Vaux D, editor. PLoS Biol. 15:e2002536. doi: 10.1371/journal.pbio.2002536 [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Jones E., Leask B., Brandenburg U., De Wit H. (2021). Global social responsibility and the internationalisation of higher education for society. J. Stud. Int. Educ. 25, 330–347. doi: 10.1177/10283153211031679 [DOI] [Google Scholar]
  47. Kwan Y. M., Muhamad F., Chin M. Y. (2024). Setting the benchmark: a comparative analysis of research performance indicators between leading world research universities and top-ranked research universities in Malaysia. JRMG 6, 3–21. doi: 10.22452/jrmg.vol6no1.2 [DOI] [Google Scholar]
  48. Levin G., Brezinov Y., Tzur Y., Meyer R. (2024). Open access transition in obstetrics and gynecology journals—The international impact. Int. J. Gynecol. Obs. 166, 266–271. doi: 10.1002/ijgo.15398 [DOI] [PubMed] [Google Scholar]
  49. Leydesdorff L., Bornmann L. (2016). The operationalization of “fields” as WoS subject categories (WCs) in evaluative bibliometrics: the cases of “library and information science” and “science and technology studies.” J. Assoc. Inform. Sci. Technol. 67, 707–714. doi: 10.1002/asi.23408 [DOI] [Google Scholar]
  50. Leydesdorff L., Opthof T. (2010). Scopus's source normalized impact per paper (SNIP) versus a journal impact factor based on fractional counting of citations. J. Am. Soc. Inform. Sci. Technol. 61, 2365–2369. doi: 10.1002/asi.21371 [DOI] [Google Scholar]
  51. Li H., Yin Z. (2023). Influence of publication on university ranking: citation, collaboration, and level of interdisciplinary research. J. Librarian. Inform. Sci. 55, 828–835. doi: 10.1177/09610006221106178 [DOI] [Google Scholar]
  52. Limaymanta C. H., Quiroz-de-García R., Rivas-Villena J. A., Rojas-Arroyo A., Gregorio-Chaviano O. (2022). Relationship between collaboration and normalized scientific impact in South American public universities. Scientometrics 127, 6391–6411. doi: 10.1007/s11192-022-04523-2 [DOI] [Google Scholar]
  53. Lisciandra C. (2025). Citation metrics: a philosophy of science perspective. Episteme 22, 1–15. doi: 10.1017/epi.2024.46 [DOI] [Google Scholar]
  54. Liu N. C., Cheng Y. (2005). The Academic Ranking of World Universities. High. Educ. Europe 30, 127–136. doi: 10.1080/03797720500260116 [DOI] [Google Scholar]
  55. Liu Y., Ma J., Song H., Qian Z., Lin X. (2021). Chinese universities' cross-border research collaboration in the social sciences and its impact. Sustainability 13:10378. doi: 10.3390/su131810378 [DOI] [Google Scholar]
  56. MacRoberts M. H., MacRoberts B. R. (1989). Problems of citation analysis: a critical review. J. Am. Soc. Inform. Sci. 40, 342–349. doi: 10.1002/(SICI)1097-4571(198909)40 [DOI] [Google Scholar]
  57. Maka L., Olatunji O., Strydom C. (2026). Trends and production dynamics in university rankings research: a bibliometric analysis for higher education policy. IJER 8:a15. doi: 10.38140/ijer-2026.vol8.1.15 [DOI] [Google Scholar]
  58. Marginson S. (2022). What drives global science? The four competing narratives. Stud. High. Educ. 47, 1566–1584. doi: 10.1080/03075079.2021.1942822 [DOI] [Google Scholar]
  59. Marginson S., van der Wende M. (2007). To rank or to be ranked: the impact of global rankings in higher education. J. Stud. Int. Educ. 11, 306–329. doi: 10.1177/1028315307303544 [DOI] [Google Scholar]
  60. Meho L. I. (2025). Gaming the metrics: bibliometric anomalies in global university rankings and the research integrity risk index (RI2). Scientometrics 130, 6683–6726. doi: 10.1007/s11192-025-05480-2 [DOI] [Google Scholar]
  61. Merton R. K. (1979). The Sociology of Science: Theoretical and Empirical Investigations, ed. N. W. Storer (Chicago, IL: University of Chicago Press), 636. Available online at: https://press.uchicago.edu/ucp/books/book/chicago/S/bo28451565.html (Accessed May 31, 2025).
  62. Meylani R. (2026). Understanding global university rankings: performance indicators, institutional strategies, and governance implications. IEJES 13:10. doi: 10.31458/iejes.1853202 [DOI] [Google Scholar]
  63. Miranda R., Garcia-Carpintero E. (2018). Overcitation and overrepresentation of review papers in the most cited papers. J. Inform. 12, 1015–1030. doi: 10.1016/j.joi.2018.08.006 [DOI] [Google Scholar]
  64. Moed H. F. (2010). Measuring contextual citation impact of scientific journals. J. Inform. 4, 265–277. doi: 10.1016/j.joi.2010.01.002 [DOI] [Google Scholar]
  65. Mohamed Hashim M. A., Tlemsani I., Duncan Matthews R. (2022). A sustainable university: digital transformation and beyond. Educ. Inform. Technol. 27, 8961–8996. doi: 10.1007/s10639-022-10968-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Momeni F., Mayr P., Fraser N., Peters I. (2021). What happens when a journal converts to open access? A bibliometric analysis. Scientometrics 126, 9811–9827. doi: 10.1007/s11192-021-03972-5 [DOI] [Google Scholar]
  67. Orzhel O., Trofymenko M., Porkuian O., Drach I., Halhash R., Stoyka A., et al. (2023). Displaced universities in Ukraine: challenges and optimal development models. European J. Educ. 58, 629–646. doi: 10.1111/ejed.12581 [DOI] [Google Scholar]
  68. Pagano T. P., Loureiro R. B., Lisboa F. V. N., Peixoto R. M., Guimarães G. A. S., Cruz G. O. R., et al. (2023). Bias and unfairness in machine learning models: a systematic review on datasets, tools, fairness metrics, and identification and mitigation methods. BDCC 7:15. doi: 10.3390/bdcc7010015 [DOI] [Google Scholar]
  69. Peters M. A. (2019). Global university rankings: metrics, performance, governance. Educ. Philosophy Theory. 51, 5–13. doi: 10.1080/00131857.2017.1381472 [DOI] [Google Scholar]
  70. Petersohn S., Heinze T. (2018). Professionalization of bibliometric research assessment. Insights from the history of the Leiden Centre for Science and Technology Studies (CWTS). Sci. Public Policy. 45, 565–578. doi: 10.1093/scipol/scx084 [DOI] [Google Scholar]
  71. Price G. J. (2025). Distinctive citation dynamics in vertebrate palaeontology: benchmarking regional field-normalized evaluation metrics. Austral. J. Palaeontol. 49, 757–773. doi: 10.1080/03115518.2025.2597022 [DOI] [Google Scholar]
  72. Purkayastha A., Palmaro E., Falk-Krzesinski H. J., Baas J. (2019). Comparison of two article-level, field-independent citation metrics: field-weighted citation impact (FWCI) and relative citation ratio (RCR). J. Inform. 13, 635–642. doi: 10.1016/j.joi.2019.03.012 [DOI] [Google Scholar]
  73. Ràfols I. (2019). S&T indicators in the wild: contextualization and participation for responsible metrics. Res. Evaluat. 28, 7–22. doi: 10.1093/reseval/rvy030 [DOI] [Google Scholar]
  74. Rafols I., Leydesdorff L., O'Hare A., Nightingale P., Stirling A. (2012). How journal rankings can suppress interdisciplinary research: a comparison between Innovation Studies and Business and Management. Res. Policy 41, 1262–1282. doi: 10.1016/j.respol.2012.03.015 [DOI] [Google Scholar]
  75. Rajagukguk S. A., Prabowo H., Bandur A., Setiowati R. (2023). Behind the rank: the synthesis of a causal model of variables influencing Times Higher Education university rankings. JSMS 13, 364–380. doi: 10.33168/JSMS.2023.0325 [DOI] [Google Scholar]
  76. Reddy V., Gupta A., White M. D., Gupta R., Agarwal P., Prabhu A. V., et al. (2021). Assessment of the NIH-supported relative citation ratio as a measure of research productivity among 1687 academic neurological surgeons. J. Neurosurg. 134, 638–645. doi: 10.3171/2019.11.JNS192679 [DOI] [PubMed] [Google Scholar]
  77. Rousseau R., Egghe L., Guns R. (eds). (2018). “Chapter 2 - Scientific Research and Communication,” in Becoming Metric-Wise. (Oxford: Chandos Publishing), 11–35. (Chandos Information Professional Series). Available online at: https://www.sciencedirect.com/science/article/pii/B9780081024744000029 (Accessed May 31, 2025). doi: 10.1016/B978-0-08-102474-4.00002-9 [DOI] [Google Scholar]
  78. Saleh S. A. K., Adly H. M. (2024). Measuring the impact of higher education in promoting sustainable development goals: analysis of the Arab universities' performance. Probl Ekorozw. 19, 261–274. doi: 10.35784/preko.5384 [DOI] [Google Scholar]
  79. Sallam M. (2025). The mirage of university rankings: toward transparent and trustworthy measures of academic excellence. Recent Prog Sci. 2:10. doi: 10.70462/rps.2025.2.010 [DOI] [Google Scholar]
  80. Scelles N., Teixeira Da Silva J. A. (2025). Making the impact of publications within a field comparable by improving the field-weighted citation impact (FWCI): the case of sport management. Scientometrics 130, 1571–1586. doi: 10.1007/s11192-025-05268-4 [DOI] [Google Scholar]
  81. Schubert A., Braun T. (1986). Relative indicators and relational charts for comparative assessment of publication output and citation impact. Scientometrics 9, 281–291. doi: 10.1007/BF02017249 [DOI] [Google Scholar]
  82. Singhal A., Neveditsin N., Tanveer H., Mago V. (2024). Toward fairness, accountability, transparency, and ethics in ai for social media and health care: scoping review. JMIR Med. Inform. 12:e50048. doi: 10.2196/50048 [DOI] [PMC free article] [PubMed] [Google Scholar]
  83. Smiley A., Reategui-Rivera C. M., Villarreal-Zegarra D., Escobar-Agreda S., Finkelstein J. (2025). Exploring artificial intelligence biases in predictive models for cancer diagnosis. Cancers 17, 407. doi: 10.3390/cancers17030407 [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Smith T. A., Sudah S. Y., Manzi J. E., Michel C. R., Kerrigan D. J., Dijanic C. N., et al. (2023). The relative citation ratio: evaluating a new measure of scientific influence among academic sports medicine surgeons. Orthopaedic J. Sports Med. 11:7845. doi: 10.1177/23259671221137845 [DOI] [PMC free article] [PubMed] [Google Scholar]
  85. Sribanasarn W., Phumiphan A., Kaewplang S., Khotdee M., Sivanpheng O., Kangrang A., et al. (2025). sustainability in action: analyzing Mahasarakham University's Integration of SDGs in education, research, and operations. Sustainability 17:6378. doi: 10.3390/su17146378 [DOI] [Google Scholar]
  86. Stensaker B., Lee J. J., Rhoades G., Ghosh S., Castiello-Gutiérrez S., Vance H., et al. (2019). Stratified university strategies: the shaping of institutional legitimacy in a global perspective. J. High. Educ. 90, 539–562. doi: 10.1080/00221546.2018.1513306 [DOI] [Google Scholar]
  87. Szluka P., Csajbók E., Gyorffy B. (2023). Relationship between bibliometric indicators and university ranking positions. Sci. Rep. 13:14193. doi: 10.1038/s41598-023-35306-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  88. Szomszor M., Adie E. (2022). Overton: a bibliometric database of policy document citations. Quantitat. Sci. Stud. 3, 624–650. doi: 10.1162/qss_a_00204 [DOI] [Google Scholar]
  89. Tennant J. P., Waldner F., Jacques D. C., Masuzzo P., Collister L. B., Hartgerink C. H. J., et al. (2016). The academic, economic and societal impacts of Open Access: an evidence-based review. F1000Res 5:632. doi: 10.12688/f1000research.8460.3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  90. Tenorio-Fornés A., Jacynycz García V., Llop D., Sánchez-Ruiz A., Hassan S. (2018). Towards a decentralized process for scientific publication and peer review using blockchain and IPFS (Hawaii: ). doi: 10.24251/HICSS.2019.560 [DOI] [Google Scholar]
  91. Thelwall M. (2025). Research quality evaluation by AI in the era of large language models: advantages, disadvantages, and systemic effects – An opinion paper. Scientometrics 130, 5309–5321. doi: 10.1007/s11192-025-05361-8 [DOI] [Google Scholar]
  92. Thelwall M., Jiang X. (2025). Is OpenAlex suitable for research quality evaluation and which citation indicator is best? Assoc. Inform. Sci. Tech. 76, 1660–1681. doi: 10.1002/asi.70020 [DOI] [Google Scholar]
  93. Thelwall M., Kousha K., Abdoli M., Stuart E., Makita M., Wilson P., et al. (2024). Which international co-authorships produce higher quality Journal articles? Assoc. Inform. Sci. Tech. 75, 769–788. doi: 10.1002/asi.24881 [DOI] [Google Scholar]
  94. Thelwall M., Kousha K., Stuart E., Makita M., Abdoli M., Wilson P., et al. (2023). Do bibliometrics introduce gender, institutional or interdisciplinary biases into research evaluations? Res. Policy. 52:104829. doi: 10.1016/j.respol.2023.104829 [DOI] [Google Scholar]
  95. Thelwall M., Wilson P. (2014). Regression for citation data: an evaluation of different methods. J. Inform. 8, 963–971. doi: 10.1016/j.joi.2014.09.011 [DOI] [Google Scholar]
  96. Thomas E., Pugh R., Soetanto D., Jack S. L. (2023). Beyond ambidexterity: universities and their changing roles in driving regional development in challenging times. J. Technol. Transfer 48, 2054–2073. doi: 10.1007/s10961-022-09992-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  97. Tóth B., Motahari-Nezhad H., Horseman N., Berek L., Kovács L., Hölgyesi Á., et al. (2024). Ranking resilience: assessing the impact of scientific performance and the expansion of the Times Higher Education World University Rankings on the position of Czech, Hungarian, Polish, and Slovak universities. Scientometrics 129, 1739–1770. doi: 10.1007/s11192-023-04920-1 [DOI] [Google Scholar]
  98. Veidemane A. (2022). Education for sustainable development in higher education rankings: challenges and opportunities for developing internationally comparable indicators. Sustainability 14:5102. doi: 10.3390/su14095102 [DOI] [Google Scholar]
  99. Vieira E. S. (2023). The influence of research collaboration on citation impact: the countries in the European Innovation Scoreboard. Scientometrics 128, 3555–3579. doi: 10.1007/s11192-023-04715-4 [DOI] [Google Scholar]
  100. Wagner C. S., Leydesdorff L. (2005). Network structure, self-organization, and the growth of international collaboration in science. Res. Policy. 34, 1608–1618. doi: 10.1016/j.respol.2005.08.002 [DOI] [Google Scholar]
  101. Waltman L. (2016). A review of the literature on citation impact indicators. J. Inform. 10, 365–391. doi: 10.1016/j.joi.2016.02.007 [DOI] [Google Scholar]
  102. Waltman L., Van Eck N. J. (2013). Source normalized indicators of citation impact: an overview of different approaches and an empirical comparison. Scientometrics 96, 699–716. doi: 10.1007/s11192-012-0913-4 [DOI] [Google Scholar]
  103. Waltman L., van Eck N. J. (2019). “Field normalization of scientometric indicators.” in Springer Handbook of Science and Technology Indicators, eds. W. Glänzel, H. F. Moed, U, Schmoch, and M. Thelwall (Cham: Springer International Publishing), 281–300. Available online at: https://doi.org/10.1007/978-3-030-02511-3_11 (Accessed May 31, 2025). doi: 10.1007/978-3-030-02511-3_11 [DOI] [Google Scholar]
  104. Waltman L., van Eck N. J., van Leeuwen T. N., Visser M. S., van Raan A. F. J. (2011a). Towards a new crown indicator: some theoretical considerations. J. Inform. 5, 37–47. doi: 10.1016/j.joi.2010.08.001 [DOI] [Google Scholar]
  105. Waltman L., Van Eck N. J., Van Leeuwen T. N., Visser M. S., Van Raan A. F. J. (2011b). Towards a new crown indicator: an empirical analysis. Scientometrics 87, 467–481. doi: 10.1007/s11192-011-0354-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  106. Wang J. (2013). Citation time window choice for research impact evaluation. Scientometrics 94, 851–872. doi: 10.1007/s11192-012-0775-9 [DOI] [Google Scholar]
  107. Wang J., Frietsch R., Neuhäusler P., Hooi R. (2024). International collaboration leading to high citations: global impact or home country effect? J. Inform. 18:101565. doi: 10.1016/j.joi.2024.101565 [DOI] [Google Scholar]
  108. Wilder E. I., Walters W. H. (2021). Using conventional bibliographic databases for social science research: web of science and scopus are not the only options. SAR 3:4. doi: 10.29024/sar.36 [DOI] [Google Scholar]
  109. Worrall J. L., Cohn E. G. (2023). Citation data and analysis: limitations and shortcomings. J. Contemp. Criminal Justice 39, 327–340. doi: 10.1177/10439862231170972 [DOI] [Google Scholar]
  110. Yoon H., Belkhouja M., Wei Y., Lee S. (2021). Born to be similar? Global isomorphism and the emergence of latecomer business schools. Int. Business Rev. 30:101863. doi: 10.1016/j.ibusrev.2021.101863 [DOI] [Google Scholar]
  111. Zenkiene L., Leišyte L. (2024). Strengthening university capacity in regional innovation ecosystem through the participation in the European Universities initiative. European J. High. Educ. 14, 88–108. doi: 10.1080/21568235.2024.2410358 [DOI] [Google Scholar]
  112. Zhou Y., Abe Y., Asano A. (2024). “Times higher education rankings analysis for enhancing university performance using multi-criteria decision making,” in 2024 IEEE 17th International symposium on embedded multicore/many-core systems-on-chip (MCSoC) [Internet], 117–21. Available from: https://ieeexplore.ieee.org/abstract/document/10819510 (Accessed May 31, 2025). doi: 10.1109/MCSoC64144.2024.00030 [DOI]
  113. Zitt M., Ramanana-Rahary S., Bassecoulard E. (2005). Relativity of citation performance and excellence measures: from cross-field to cross-scale effects of field-normalisation. Scientometrics 63, 373–401. doi: 10.1007/s11192-005-0218-y [DOI] [Google Scholar]

Articles from Frontiers in Research Metrics and Analytics are provided here courtesy of Frontiers Media SA

RESOURCES