Skip to main content
F1000Research logoLink to F1000Research
. 2024 Oct 14;13:324. Originally published 2024 Apr 23. [Version 3] doi: 10.12688/f1000research.147599.3

A scoping review on what constitutes a good research culture

Amanda Jane Blatch-Jones 1,a, Kay Lakin 2, Sarah Thomas 2
PMCID: PMC11140362  PMID: 38826614

Version Changes

Revised. Amendments from Version 2

The revised version addresses the additional comments received by the reviewers. The introduction has been expanded to provide more clarity (using examples such as Vitae), and additional examples have been included in the results and discussion section to explain the findings in more detail under each theme.  We have also amended, corrected errors, and conducted a thorough grammar check to make the manuscript more coherent.

Abstract

Background

The crisis in research culture is well documented, covering issues such as a tendency for quantity over quality, unhealthy competitive environments, and assessment based on publications, journal prestige and funding. In response, research institutions need to assess their own practices to promote and advocate for change in the current research ecosystem.

Aims

The purpose of the scoping review was to explore ‘ What does the evidence say about the ‘problem’ with ‘poor’ research culture, what are the benefits of ‘good’ research culture, and what does ‘good’ look like?’

Methods

A scoping review was undertaken. Six databases were searched along with grey literature. Eligible literature had relevance to academic research institutions, addressed research culture, and were published between January 2017 to May 2022. Evidence was mapped and themed to specific categories. The search strategy, screening and analysis took place between April-May 2022.

Results

1666 titles and abstracts, and 924 full text articles were assessed for eligibility. Of these, 253 articles met the eligibility criteria for inclusion. A purposive sampling of relevant websites was drawn from to complement the review, resulting in 102 records included in the review. Key areas for consideration were identified across the four themes of job security, wellbeing and equality of opportunity, teamwork and interdisciplinary, and research quality and accountability.

Conclusions

There are opportunities for research institutions to improve their own practice, however institutional solutions cannot act in isolation. Research institutions and research funders need to work together to build a more sustainable and inclusive research culture that is diverse in nature and supports individuals’ well-being, career progression and performance.

Keywords: research culture, research institutions, funding organisations, academia, open research, early career researchers, transparency, research integrity


Abbreviations

AI

Artificial Intelligence

CCB

Complementary Capacity Building

COPE

Committee on Publication Ethics

COS

Center for Open Science

COVID-19

Coronavirus Disease

CRediT

Contributor Roles Taxonomy

CV

Curriculum Vitae

DEI

Diversity Equity and Inclusion

DORA

Declaration on Research Assessment

ECR

Early Career Researchers

EDI

Equality Diversity and Inclusion

ENRIO

European Network of Research Integrity Offices

FAIR

Findable, Accessible, Interoperable and Reusable

FTC

Fixed Term Contract

HEI

Higher Education Institution

HEP

Higher Education Provider

INORMS SCOPE

International Network of Research Management Societies (INORMS)

ISRIA

International School on Research Impact Assessment

JBI

Joanna Briggs Institute

JSTOR

Journal Storage

KPI

Key performance Indicator

LMIC

Low Middle-Income Countries

MyNRMN

National Research Mentoring Network

NA

Not applicable

NHS

National Health Service

NIC

Networked Improvement Community

NRMN

National Research Mentoring Network

OA

Open Access

OKI

Open Knowledge Institutions

OIS

Open Innovation Science

ORBIT

ORCID’s Reducing Burden and Improving Transparency

ORCID

Open Researcher and Contributor IDentifier

OSF

Open Science Framework

PEER

Persons Excluded from science because of Ethnicity and Race

PhD

Doctor of Philosophy

PRISMA-ScR

Preferred Reporting Items for Systematic Reviews and Meta-analyses extension for Scoping Reviews

QPP

Quality Publication Practice

REF

Research Excellence Framework

RFO

Research Funding Organisations

RoRi

Research on Research Institute

STEM

Science, Technology, Engineering, Mathematics

STEMM

Science, Technology, Engineering, Mathematics and Medicine

TOP

Transparency and Openness Promotion

UK

United Kingdom

UKRI

UK Research and Innovation

UKRN

UK Reproducibility Network

USA

United States of America

WoS

Web of Science

Background

Concerns about the pressures of working in research and the potential negative impact of a poor research culture are well documented in academic literature across diverse disciplines. 1 , 2 The impact is felt by all individuals working in a research environment (e.g., researchers, research-enabling staff), putting a strain on, not only the health and wellbeing of staff, but also career progression, job security, team science, innovation, and research integrity. There is also a strong connection between concerns about research culture and the inappropriate use of metrics and indicators that drive both institutional and individual researcher behavior, assessment and reward. 3 5 In response to these concerns, several actions have emerged to enable and encourage the adoption of a healthier research culture by developing frameworks to support strategic planning to embed research integrity, good governance and best practice. 6 8 International action to address some of the underlying drivers of poor research culture (e.g., lack of diversity, career paths, and recognition and reward) include INORMS SCOPE framework for responsible research evaluation 9 ; Declaration on Research Assessment (DORA) 10 ; development of 10 principles for the measurement of research performance: the Leiden Manifesto for Research Metrics 11 ; establishment of the International School on Research Impact Assessment (ISRIA) 12 ; and the HuMetricsHSS Initiative. 13

In response to concerns about the experience of working in research, the Wellcome Trust undertook work in the UK to better understand research culture, which has enabled initiatives from the Russell Group and the Royal Society to actively work towards enabling researchers to ‘flourish’. 14 A survey conducted by the Wellcome Trust, focused on the experience of researchers, revealed that poor research culture is leading to unhealthy competition, bullying and harassment, mental health issues, and a system that favours quantity over quality. 15 Unfortunately, these experiences mirror previous findings, and show the longevity of the issues as the research environment continues to be pressured, competitive and uncertain for many researchers. 16

The consequences of poor research culture do not only affect researchers, they also affect research-enabling staff (e.g., technicians, librarians, research managers and administrative staff), the production and quality of research, reduce innovation in research and affect public trust in research. 17 21 Research England’s funding to English Higher Education Providers (HEPs) has enabled greater exploration into research processes and experiences of working in research, through piloting new initiatives or enhancing existing activities. 22 , 23

Striving for excellence and changing research culture is a collective responsibility, requiring action from research institutions, funding organisations and researchers. 14 Higher Education Institutions (HEIs) need to assess their own practices to promote and advocate for change in the current research ecosystem. As highlighted by the Wellcome Trust and others, there remains a tendency for quantity over quality, assessment based on publications, journal prestige and funding. 5 , 15 , 24 , 25 Any attempts on reform requires commitment from everyone (e.g., publishers, research institutions, funders, researchers etc.) so that diversity, impact, teamwork, open research, and assessment systems are valued. In turn, we may begin to see enhancements for the promotion of transparency, open access, knowledge mobilisation and collaborative networking practices. A research culture framework recently developed by Vitae, in collaboration with Shift Insight and the UK Reproductivity Network (UKRN), from a report commissioned by UK Research and Innovation, is an example of how we are beginning to see these commitments starting to take place. 26

The consequences and challenges associated with an inadequate research culture are well evidenced across the research ecosystem. Several reports, from funding organisations to independent providers have demonstrated the extent of the problem and the need for a cultural change in research. 14 , 15 , 27 , 28 However, the evidence very much focuses on the challenges and barriers, with limited evidence on solutions or how to implement change, initiate opportunities, or what works for whom and in what context (inclusive of all research and research-enabling staff in an academic environment). 29 31

The purpose of this scoping review was to therefore explore the evidence on what constitutes a good research culture as outlined in the Wellcome Trust survey across four areas: security, wellbeing and equality of opportunity, teamwork and research quality and accountability, to enhance and promote a more sustainable research culture environment. 32 The barriers and challenges with a ‘poor’ culture were explored within the context of four areas, outlined in the Wellcome Trust published work, but were not the main focus of the review. The scoping review was intended to inform future practice within a specific research organisation (the University of Southampton, UK), however the findings here will have relevance and application to a wider audience. The scoping review was conducted to address the following question: What does the evidence say about the ‘problem’ (barriers, challenges, consequences etc.) with ‘poor’ research culture, what are the benefits of ‘good’ research culture, and what does ‘good’ look like?

Methods

Scoping reviews are relevant to addressing research questions that seek to identify priorities for research, clarification on concepts and definitions, identifying research frameworks, or locating background information in preparation for a systematic review. Scoping reviews aim to understand ‘What has been done previously?’ and ‘What does the literature say?’ compared to systematic reviews that ask the question ‘Does this intervention work for this group of individuals?’ The purpose of this scoping review was to identify the current evidence and body of relevant literature using the Joanna Briggs Institute (JBI) guidance/approach to guide the development, analysis and write up of the scoping review. 33 35 Using this approach enabled the reviewers to map the evidence to four key areas highlighted from existing published work from the Wellcome Trust (outlined under section ‘data extraction and evidence selection’), to ensure consistency and continuity to predefined areas already established by the research community (through a survey, interviews and workshops). 15 Although the review was guided by the outcomes of the Wellcome Trust, the purpose was to further explore the literature in terms of key areas, initiatives and considerations to ‘what the problems are with ‘poor’ research culture’ and ‘what does a good research culture look like’.

Eligibility criteria

Context: The context included UK and international settings within the academic environment (research ecosystem).

Participants: Academic, administrative, and technical staff and students of all levels, grades, disciplines, and professions. This meant including academic and research-enabling staff (e.g., research managers, technicians, administrators, and librarians) to ensure an inclusive approach was taken (and incorporate the principles of ‘team science’ and organisational culture).

Inclusion criteria: Evidence from research institutions only (considering Education, Enterprise and Research, the triple helix approach 36 , 37 ) for both academic and grey literature were included. All disciplines within the academic environment were included. All initiatives aimed, partly or wholly, at enhancing or assessing research culture were included.

Exclusion criteria: Anyone undertaking or supporting research outside of a research institution/Higher Education Institutes environment (for example in the health and social care field the National Health Service (NHS) Trusts, hospital settings, primary health care settings, allied health professional settings). Industry and professional service businesses (including consultancies) were not included as they were not considered to have an academic focus. Non-English articles were excluded if no translation was available for the full article.

The database searches and grey literature did not have any limitations on country of origin, apart from news items that were restricted to the UK, Europe, North America, and Australasia.

Types of sources

Several types of contributions were used for the scoping review, which included articles, reports, blogs and web-based articles from both empirical studies and grey literature.

The scoping review considered all types of study designs for inclusion (e.g., randomised controlled trials, non-randomised controlled trials, before and after studies and interrupted time-series studies, analytical observational studies including prospective and retrospective cohort studies, case-control studies, analytical cross-sectional studies, descriptive observational study designs including case series, individual case reports and descriptive cross-sectional studies).

Qualitative studies were also considered that focused on qualitative data including, but not limited to, designs such as phenomenology, grounded theory, ethnography, qualitative description, action research and feminist research. In addition, systematic reviews that met the inclusion criteria were considered, depending on the research question. Editorials and opinion papers were also considered for inclusion in the scoping review.

A range of data were required to be as inclusive as possible due to the diverse nature of how research culture is reported and discussed in the public domain (and its associated parts in Open Access (OA), Equality, Diversity, and Inclusion (EDI) and career paths). Therefore, the review included published material from academic outputs (e.g., journal articles, commentaries, editorials, perspectives, opinion letters) and from grey literature (e.g., reports, blogs, web-based articles, and newsletters including associated webpages of relevance).

Search strategy

The search strategy aimed to locate both published and unpublished references. An initial limited search of Medline and Web of Science (WoS) was undertaken to identify articles on the topic, to develop and pilot the search strategy. The text words contained in the titles and abstracts of relevant articles and reports, and the index terms used to describe the articles were used to develop a full search strategy. 15 , 38 41 The search strategy, including all identified keywords and index terms, were adapted for each included database and/or information source.

There were no study or language limits applied in the initial retrieval process. The search strategy was limited from 2017 to 2022 but a preliminary search of references during 2015-2022 was initially screened for relevance. Preliminary scoping and piloting of the search terms and strategies suggested that five years was sufficient for literature to be relevant, current, and broad (including relevant references on the reporting of initiatives such as DORA, and any changes due to the COVID-19 pandemic). The review included UK and international literature (including grey literature, although see below for pragmatic restrictions for news items).

Databases: Six databases were searched (Medline, Engineering village, Scopus, JSTOR, ProQuest and WoS) during the period 29 April to 18 May 2022. A range of databases enabled the reviewers to capture several disciplines and to be as inclusive as possible.

Grey literature searches: A pragmatic systematic search was undertaken of the Lexis-Nexis Academic database concentrating on newspapers and news items. The scoping and piloting of the search terms in the database suggested that geographical exclusions were needed due to the scale of results from the searches. As part of discussions with team members as well as an experienced librarian, the results were filtered to only include news outlets and organisations based in UK, Europe, North America, and Australasia. To augment the news searches, purposive sampling of relevant research websites was documented in an Excel spreadsheet to record all platforms and webpages visited. The sampling of websites was drawn from discussions with team members as well as an experienced librarian. Examples of research websites explored include: The Conversation, Nature, Science, UK Research and Innovation (UKRI) and Research on Research Institute (RoRi). Relevant references were identified from Wellcome Trust 14 , 15 as well as snowballing. The key references of the included articles and/or reports were screened for additional references to be included as part of the overall screening process (including grey literature).

Data extraction and evidence selection

Following the searches, all identified articles were collated and uploaded into Endnote version 20 ( Clarivate Analytics, PA, USA, https://endnote.com/ ) (a free alternative is Mendeley: https://www.mendeley.com/) and duplicates were removed. Following a pilot test, all titles and abstracts were screened, by two independent reviewers for assessment against the inclusion criteria for the review using Rayyan (rayyan, https://www.rayyan.ai/ freely available for 3 active reviews). Potentially relevant articles were then retrieved for full extraction. At the full citation screening stage, reasons for exclusion were noted independently by both reviewers. Where the independent reviewer was unsure, the article was discussed, and a decision was made by consensus. Screening at both stages (title and abstract and full extraction) was piloted using Rayyan ( https://www.rayyan.ai/) and labels were applied to categorise the focus of the articles based on four areas:

  • Security (including career paths, career progression, stability contracts/careers, issues affecting early career researchers etc.)

  • Wellbeing and equality of opportunity (including equality, diversity and inclusion, mental health, and wellbeing, bullying and harassment)

  • Teamwork (including team science, recognition of broad contribution to research, incentives)

  • Research quality and accountability (including research integrity, reproducibility, policy, and governance).

Both reviewers applied the articles under one of the four areas during extraction, based on the content and context of the article. Some articles were relevant to more than one category, which was reflected in the data extraction table. The reviewers independently checked the included articles to ensure that they were included appropriately across the four areas.

These focus areas were reported in the Wellcome Trust report and formed the basis of the current scoping review, to enable the University of Southampton to build on activity already undertaken, activity underway and enable alignment for future consideration. 14 , 15

The list of included articles for full extraction were then exported to a Microsoft Excel spreadsheet using the labelling of articles from Rayyan (these categories were grouped together under the four focused areas). The results of the search and the study inclusion process are reported in full using the Preferred Reporting Items for Systematic Reviews and Meta-analyses extension for scoping reviews (PRISMA-ScR), including the flow diagram reported in Figure 1.

Figure 1. PRISMA flow diagram.

Figure 1.

Both reviewers extracted data from the full text articles using a data extraction tool developed by the reviewers to address the research question. This included the focus of the article, issues and/or problems reported in the article, solutions and/or recommendations provided in the article and details about whether the article related to more than one topic area.

No risk of bias or assessment on quality was conducted due to using a scoping review methodological approach. All the evidence was mapped and categorised into the four areas, which were discussed and agreed between team members at various stages of data extraction and during the write-up of the findings.

Results

A total of 3,042 articles were retrieved from the six databases. With 1,376 duplications that were removed, 1666 titles and abstracts and 924 full text articles were assessed for eligibility. Of these 924 full text articles, 253 articles met the eligibility criteria for inclusion.

A total of 341 documents were retrieved (Lexis-Nexis) or identified across all the sources based on the titles. These were assessed for eligibility of which 102 met the criteria for inclusion.

Figure 1 provides a full account of the records of identification flow diagram, including the reasons for the excluded articles.

Characteristics of the included studies

From the evidence there was a steady rise in the number of published articles over the last five years, with a notable increase from 2019. Table 1 shows that from the 253 included articles, there were 135 original research articles (this included qualitative and quantitative studies), 20 review articles (using a range of methodological review approaches), 86 perspective articles and 10 conference papers.

Table 1. Characteristics of the included studies.

Characteristics N=253 (%) Databases N=102 (%) Grey literature
Areas of focus: *
Security 72 69
Wellbeing and equality of opportunity 52 50
Teamwork 64 40
Research quality and accountability 133 52
Year of publication:
2017 20 (7.9) 12 (11.7)
2018 18 (7.1) 30 (29.4)
2019 47 (18.6) 15 (14.7)
2020 61 (24.1) 11 (10.8)
2021 85 (33.6) 27 (26.5)
2022 ** 22 (8.7) 7 (6.9)
NA 20 (7.9)
Country:
Europe 43 (17.0) 2 (1.9)
USA and Canada 71 (28.1) 4 (3.9)
International 73 (28.8) 11 (10.8)
NA 66 (26.1) 78 (76.5)
Article type:
Journal – Original research (including panel discussions) 135 (53.5) 0
Journal – Review 20 (7.9) 0
Journal – Perspective *** 86 (33.9) 40 (39.3)
Conference papers 10 (3.9) 0
Book 2 (0.8) 0
Blog 0 2 (1.9)
Case study 0 2 (1.9)
Newspaper 0 29 (28.5)
Podcast 0 2 (1.9)
Report 0 10 (9.8)
Webpages/Educational webpages 0 17 (16.7)
*

Note that some articles reported under more than one area of focus. The total number does not equal to the number of articles included in the scoping review.

**

Jan-April inclusive, searches were conducted during April-May 2022.

***

Includes, editorial, commentaries, news features, correspondence, and perspective articles in journals.

The location of the study generation was captured for the included articles (based on location of the research and/or authors location). The included articles covered a global perspective with 71 articles from USA and Canada, 73 from international locations such as Africa (n=13), China (n=7), Australia (n=7) and Pakistan (n=4), 43 from Europe and of these 17 were from the UK.

The grey literature provided 102 additional materials, 40 perspective articles reported in journals, 29 newspaper articles, 17 webpages (including educational webpages such as The Conversation: https://theconversation.com/uk) and including 10 reports. The remaining six were either a podcast, blog or case study. A majority of the grey literature material could not be grouped by location due to the nature of the material (76.5%, 78/102).

Summarising the evidence

The evidence found in the database searches and grey literature was grouped according to the four focused areas, based on the key concepts developed during the full screening of the articles (based on the Wellcome Trust report). 15 Several included articles were relevant to more than one focus area, which showed the breadth of the topic but also how these areas are overlapping and mutually reinforcing. For example, evidence reported under security was also closely linked to wellbeing and equality of opportunity (especially for early career researchers (ECRs) and Science, Technology, Engineering, Mathematics and Medicine (STEMM)).

The sections below provide a summary of the evidence based on the four focused areas, with particular attention on security, wellbeing, equality of opportunity and teamwork, and research quality and accountability 14 , 15 (see Figure 2). The quality or assessment of these initiatives were not explored as part of this scoping review and the key considerations arising from the evidence are not presented in order of priority.

Figure 2. Summary of the evidence base on the four focused areas.

Figure 2.

Security and career progression

From the evidence it was clear that there is a global drive to expose the challenges and barriers in academic research culture. It was evident that these factors were not exclusive to specific countries, disciplines, or research institutions and the challenge is at a system level. Concerns over job security, career progression and sustainability (e.g., long-term employment, job performance, and organisational commitment) were particularly experienced by PhD students, ECRs and junior researchers from a range of academic environments. 42 45 The evidence reflects the range of research careers, roles, skills and expertise that are involved in research activity and therefore affected by poor research culture. Research institutions often separate staff into job families such as research, education, technical, clinical, and managerial roles titles reflecting different career pathways. 17 , 46 48

Despite the range and diverse roles within academic environments, the evidence suggests there are concerns that research institutions are not managing career progression expectations or providing ways to develop and train staff, across career levels or job families, which can result in inequalities with regard to job security and career pathways. 17 , 46 48 This can accumulate in feelings of failure by staff, or staff feeling pressured to be successful, which ultimately could promote unhealthy working practices such as excessive workloads and working long hours to meet expectations. 49 51 These issues affect all research institution staff but the evidence suggests they are particularly acute for several groups such as ECRs, STEMM, people on Fixed Term Contracts (FTC), people with caring responsibilities, and people with disabilities 49 51 (see Table 2 for a summary of the key considerations associated to security and career progression).

Table 2. Key concepts, areas and considerations associated to security and career progression.

Key themes No Key areas and considerations associated to security and career progression. No. refs
Support and train established researchers to be leaders, managers, and mentors 1 Consider evaluating supervisors and mentor support by including impact statements of projects and career progression, including encouraging multiple career paths, benefits of collaboration across disciplinary boundaries and pooling scarce resources 8 , 14 , 25 , 47 50 , 54 86 40
2 Provide all staff with access to flexible approaches and methods to mentoring and peer coaching schemes, enabling self-learning, innovation and productivity 6 , 17 , 49 , 50 , 55 , 56 , 58 , 59 , 61 , 64 , 65 , 67 , 69 72 , 74 76 , 78 , 79 , 81 , 84 , 85 , 87 101 39
3 Consider feedback initiatives to support continued professional development for supervisors and team leaders or collate benchmarking data focused on the culture of the research team between supervisor-student 24 , 25 , 45 , 46 , 51 , 57 , 60 , 62 , 63 , 65 , 67 , 69 , 73 , 83 , 95 , 101 114 29
4 Explore opportunities for leadership and management training (including project management) for all staff, levels, stages, and position within academia 25 , 46 , 57 , 60 , 63 , 65 , 67 , 69 , 70 , 73 , 93 , 98 , 99 , 103 , 106 , 107 , 110 , 115 124 27
5 Provide those who supervise PhDs, counsel researchers (including ECRs/junior staff) with clear guidelines on best practice and mechanisms for support (including benefits of networking), encouraging an open mind about career progression 28 , 48 , 54 , 55 , 60 , 62 65 , 69 , 72 , 77 , 82 , 84 , 86 , 88 , 107 , 117 , 125 132 26
6 Seek ways to reduce the administrative burden for those involved in leading and managing research, including innovative tools to support meaningful networking connections (e.g., MyNRMN, National Research Mentoring Network, Kaupapa Māori Frameworks) 8 , 25 , 49 , 56 , 58 , 64 , 65 , 69 , 70 , 74 , 76 , 81 , 84 , 85 , 88 , 93 , 95 , 110 , 129 , 132 22
7 Explore ways to support staff with line management skills including appraisal and inclusive management practices and motivate managers to prioritise these duties, including the upskilling of all staff 46 , 57 , 72 , 121 , 128 , 133 6
Reduce hyper competition and provide a culture of kindness 1 Recognise and incentivize all staff for developing equitable practices and partnerships (e.g., capacity building with Low Middle Income Countries (LMICs) as collaborators and beneficiaries) and focus less on publication numbers and citations (including the number of grant awards) 4 , 17 , 40 , 44 , 60 , 71 , 73 , 83 , 97 , 105 109 , 111 , 112 , 119 , 120 , 133 142 28
2 Provide regular opportunities for informal, open, safe and honest conversations (and ways to optimise the role of networking), including environmental tensions between research, education, enterprise, and teaching etc. 45 , 50 , 51 , 55 , 60 , 64 , 66 , 70 , 72 , 84 , 98 , 107 , 116 , 125 , 128 , 135 , 139 , 140 , 143 147 23
3 Consider ways to demonstrate support for researchers to secure funding as part of progression (and review current reward systems), ensuring education, teaching and research are equally prioritised 40 , 51 , 58 , 63 , 64 , 91 , 97 , 99 , 117 , 127 , 135 , 140 , 143 146 , 148 17
4 Encourage staff to provide positive feedback and praise to each other, making the working environment friendly, productive and conducive for learning 6 , 51 , 65 , 66 , 87 , 89 91 , 94 , 98 , 100 , 101 , 142 , 144 , 148 150 17
5 Raise awareness on the value of sharing science outreach goals, promoting mutual learning for all (including academic induction and orientation practices) to help with retention and progression 17 , 43 , 57 , 58 , 62 , 66 , 69 , 71 , 98 , 118 , 125 , 140 , 141 , 146 , 147 , 151 , 152 17
6 Provide opportunities for shared learning and to develop from failure in funding applications and publishing, avoiding the stresses of perceived failure 50 , 62 , 71 , 117 , 125 , 133 , 153 7
Promote fair and transparent process for career progression 1 Ensure greater alignment between individual and institutional values that encourages teamwork (team science), collective leadership and shared decision-making, building a more supportive research culture, and facilitating institutional and departmental recognition in faculty career development 17 , 24 , 25 , 28 , 40 , 44 , 46 48 , 50 , 51 , 54 , 57 , 58 , 60 , 63 , 65 , 66 , 68 72 , 75 , 77 , 82 , 86 , 90 , 92 , 94 , 96 , 101 110 , 112 , 113 , 115 , 117 , 120 , 126 , 128 , 133 , 136 , 137 , 140 , 141 , 143 , 144 , 146 , 152 , 154 157 61
2 Consider approaches to award and recognition of performance that is not solely based on academic publications that is fair and transparent for all staff, differentiating key performance areas, as well as the workload of academics in various career stages and positions 4 , 17 , 24 , 48 , 50 , 55 , 57 , 58 , 60 , 66 , 71 , 82 , 104 , 106 , 117 , 119 , 126 , 128 , 135 , 138 140 , 142 , 145 , 147 , 148 , 154 , 155 , 157 29
3 Raise awareness about using research metrics responsibly and appropriately. For example, do not use journal-based metrics, such as Journal Impact Factors, as a surrogate measure of the quality of individual research articles, to assess an individual scientist’s contributions, or in hiring and promotion 3 , 4 , 20 , 28 , 40 , 53 , 59 , 64 , 71 , 87 , 127 , 129 , 142 , 158 , 159 15
4 Consider and optimise how academic CVs are used. Provide instructions for researchers and evaluators; prioritise actual achievements; focus on recent achievements, relevant activities and outputs; acknowledge the broad range of contributions; balance and control incentives; use academic age not biological age; encourage narratives (e.g., narrative CV, Résumé for Research); and use metrics cautiously (Open Researcher and Contributor ID organization (ORCID) as a spin-off from ORCID’s Reducing Burden and Improving Transparency (ORBIT) project to foster exchange and pool expertise, to optimise the responsible use of contributions and metrics) 3 , 4 , 20 , 28 , 53 , 58 , 59 , 87 , 117 , 129 , 158 , 159 12
Cultivate a culture of support that fosters a diverse set of skills and career pathways 1 Raise awareness of the issues surrounding research culture amongst ECRs so they can contribute to the University, their departments or research teams by: facilitating membership of formal networks, provide opportunities to connect with colleagues for social and work-related activities, and review policies around office attendance that support integration and innovation 6 , 24 , 28 , 43 , 44 , 49 , 51 , 57 60 , 64 , 66 , 72 , 90 92 , 96 , 101 , 102 , 104 , 107 109 , 112 , 122 , 129 131 , 140 , 152 , 153 , 157 33
2 Consider ways to embed ‘career optimism’ to teach, prepare and respect the diversity of career pathways of PhD students/early career researchers within and beyond the University (and finding a research niche) 17 , 24 , 45 , 47 49 , 54 , 55 , 57 , 58 , 62 , 66 , 86 , 99 , 104 , 105 , 114 , 118 , 122 , 126 , 130 , 131 , 145 147 , 154 , 156 , 157 , 160 29
3 Provide opportunities to encourage ECRs to join and engage in conversations that affect them, such as research assessment, career progression, awards system (including sabbatical leave) 3 , 6 , 28 , 47 , 57 , 58 , 63 , 64 , 66 , 77 , 86 , 91 , 99 , 104 , 107 , 108 , 118 , 120 , 122 , 127 , 129 131 , 148 , 152 , 154 , 158 160 29
4 Recognise and value the diverse skill-set of research managerial and technical staff and provide opportunities for them to host and supervise researchers, apply for research grants and undertake research by promoting the benefits of collaboration 4 , 8 , 17 , 40 , 44 , 47 , 48 , 62 , 66 , 71 , 83 , 94 , 97 , 98 , 107 , 109 , 112 , 113 , 121 , 145 , 150 , 152 , 156 , 157 , 160 , 161 26
5 Offer opportunities to build hybrid careers by offering different and multiple pathways and opportunities in research, including alignment with the private sector and employment outside of academia for when long-term academic employment is not viable 6 , 48 , 55 , 58 , 68 , 77 , 82 , 86 , 105 , 116 , 118 , 120 , 125 , 127 , 145 , 152 , 154 , 156 , 157 19
6 Consider how to develop a career development mindset that supports people in all aspects of research not just research projects, therefore attracting a diverse workforce and provide greater career stability (e.g., type of contract) 47 , 48 , 55 58 , 66 , 76 , 86 , 103 , 104 , 106 , 128 , 148 , 154 , 157 , 160 , 162 18
7 Offer or provide opportunities for writing retreats, boot camps, away days and mentoring including cross disciplinary training, enabling informed decisions such as choosing your own mentor 17 , 49 , 55 , 56 , 61 , 67 , 72 , 74 76 , 78 , 79 , 85 , 92 , 99 , 120 , 163 17
8 Consider how those in research management and technical roles (including librarians) have adequate routes to continued professional development through inhouse or formal training (examples from University of California Curation Center, part of the CDL, and the Digital Curation Centre in Edinburgh, UK) 43 , 46 , 73 , 98 , 99 , 111 , 116 , 120 , 122 124 , 145 , 150 , 152 , 156 , 161 16
9 Explore ways to implement a ‘culture of structure’ for graduate students where expectations are clear and students have contact with multiple faculty members, including focus on sources that support all students, faculty, and staff 24 , 43 , 45 , 48 , 58 , 62 , 94 , 95 , 105 , 113 , 114 , 125 , 147 , 155 , 157 15

The review suggests that the problem is reinforced by a culture where researchers are incentivized to produce many funding applications and academic publications despite there being high rejection rates. 50 The evidence suggests that this can result in a lack of workload oversight, a culture discouraging of appreciation, that in turn can make researchers feel pressured to be successful, often resulting in a significant amount of time in pursuit of success at the cost of their wellbeing. 45 , 49 , 50 , 52 54

The concept of research culture and job security was broad and included (but is not limited to) career paths; stability of contracts and careers; and issues affecting ECRs and students. 60 , 144 , 148 To improve job security, research institutions and funding organisations need to readdress how research positions are funded, particularly in the early career stage. A wide range of initiatives were explored in the literature covering a broad spectrum of factors (as detailed in Table 2). The evidence showed how, where, and why changes are needed to establish a global cultural change to the research ecosystem to enable fair and transparent progression for all research staff 102 , 107 , 164 ; cultivate a culture that fosters diversity across career pathways 17 , 58 and; initiate deeper integration of knowledge to ensure institutional stability and innovation. 60 , 156

The evidence suggests that offering potential solutions or supportive actions for research institutions and the research community may enhance (e.g., opportunities for promotion and/or flexible career path changes) and stabilise career paths, particularly those in the early career stage, including those in technical and managerial roles (see Table 2). Although these solutions and supportive actions are by no way exhaustive, they do provide a summary of the range of factors that could go some way in promoting a better research culture. 57 , 141 , 157 , 165

Wellbeing and equality of opportunity

A key consideration from the evidence suggests that there are disparities across the research ecosystem, which are in turn influencing individuals’ wellbeing. 42 , 43 , 46 , 73 , 95 , 99 , 102 , 121 , 166 169 The impact of these disparities are preventing or slowing down initiatives to seek for a cultural change in the academic environment. Although there has been some progress, the evidence suggests progress is slow and continues to be a challenge, especially for under-represented groups. 169 172 The disparities highlighted in the literature suggests that under-represented groups are less likely to be promoted or receive funding and have a higher risk of decreased well-being. 18 , 67 , 86 , 92 , 173 182 However, as Lee (2022) pointed out, although underrepresented groups and junior staff are more likely to experience these challenges anyone can, at some point in their academic career experience some form of microaggression (e.g., bullying, patronage power, exploitation, discrimination, imposter syndrome). 20 Moreover, the way disciplines are taught at university means that curricula focusing on traditional perspectives may not be inclusive to everyone. 126 , 179

The review revealed that the risks associated with a lack of diversity and inclusion often result in individuals leaving academia, low job satisfaction, increased stress, burnout and mental health problems, and decreased productivity. 18 , 47 , 77 Moreover, the increasing demands of heavy workloads and the risk of perpetuating a culture of academic rejection can impact an individual’s wellbeing. 18 , 49 , 50 , 109 , 183 The evidence suggests that these wellbeing issues can have an impact at an institutional level, resulting in a lack of diversity across leadership roles, 76 , 100 , 184 a shortage of role models and peer mentors, 166 , 47 , 95 , 185 and driving off talent due to staff leaving academia. 8 Table 3 provides a summary of the key considerations associated to wellbeing and equality of opportunity.

Table 3. Key concepts, areas and considerations associated to wellbeing and equality of opportunity.

Key themes No Key areas and considerations associated to wellbeing and equality of opportunity No. refs
Embed and support an inclusive culture 1 Create a climate for diversity and inclusivity by working collectively to reduce attitudes of hostility and competition that are pervasive, across all fields including STEM (e.g., SciComm, diversity programs) 6 , 47 , 72 , 76 , 81 , 82 , 84 86 , 92 , 109 , 112 , 114 , 123 , 126 , 132 , 149 , 150 , 159 , 173 , 174 , 176 , 178 , 179 , 186 205 44
2 Lead with data by moving from expert opinion and commentary on effective measures for advancing Diversity Equity and Inclusion (DEI) to objective, validated, and evidence-based research and evaluation 6 , 18 , 76 , 81 , 82 , 84 86 , 91 , 92 , 101 , 109 , 112 , 114 , 123 , 132 , 159 , 169 , 170 , 173 , 176 , 178 180 , 192 194 , 196 198 , 201 210 40
3 Enable honest conversations around the complexities, challenges and barriers to achieving diversity in leadership 6 , 76 , 81 , 82 , 84 86 , 92 , 95 , 101 , 109 , 112 , 114 , 123 , 126 , 132 , 159 , 168 , 170 , 178 , 179 , 187 189 , 191 , 196 , 198 , 200 208 36
4 Diversify visible reporting routes to encourage institutions to move away from performative actions and acknowledge that institutional factors play a role in improving mental health for individuals (e.g., ‘Me Too’ movement, #STEMToo social media hashtag to share stories) 6 , 18 , 20 , 45 , 49 , 54 , 72 , 77 , 78 , 82 , 83 , 92 , 94 , 100 , 104 , 110 , 114 , 149 , 150 , 174 , 182 , 192 194 , 200 , 205 , 211 , 212 28
5 Encourage and support staff and students to build support groups, to reach out for help, to talk openly about mental health, and to ask how others are doing 6 , 20 , 45 , 49 , 54 , 77 , 78 , 82 , 83 , 92 , 94 , 99 , 100 , 104 , 110 , 114 , 123 , 126 , 176 , 201 , 205 , 212 22
6 Use institution-specific data to drive changes in policy and programming to improve the social culture and climate, including shifting institutional practice in a context-specific way 64 , 92 , 101 , 104 , 112 , 165 , 170 , 172 , 173 , 180 , 182 , 187 , 189 , 200 , 213 , 214 16
7 Create greater emphasis on cultural competency, to enable the ability to understand, honor, appreciate, and respect the values, beliefs, attitudes, and behaviors of those from cultures different to our own 92 , 101 , 104 , 112 , 170 , 172 , 173 , 176 , 186 , 198 , 215 11
8 Enable conversations that shine a light on power imbalances within academia through initiatives (e.g., “Me Too” Movement) 18 , 125 , 168 , 170 , 172 , 173 , 180 , 198 , 200 , 207 , 214 11
9 Explore avenues which will help to identify how disciplines could be taught through a more inclusive and ethical lens, ensuring that socio-economic data on employees is collected and monitored (as recommended by the Social Mobility Commission) 126 , 192 195 , 197 , 198 7
10 Improve professional workplace mental health and access to services/support for mental health and ensure the use of these services do not stigmatize. Invest to improve mental health literacy across the institution, supporting those who provide assistance and training in mental health (particularly post COVID) 18 , 49 , 54 , 99 4
Investing in people to reduce burden and improve wellbeing 1 Train leaders, principal investigators, staff and students in mental health and diversity, and dignity and respect 6 , 20 , 45 , 49 , 54 , 77 , 78 , 81 85 , 92 , 94 , 100 , 104 , 110 , 112 , 123 , 126 , 132 , 159 , 167 , 178 , 179 , 187 , 188 , 190 , 193 196 , 201 205 , 208 , 212 39
2 Enable access to childcare near or on campus, extend paid maternity/parental leaves, parttime options for work, a career pause during children’s formative childrearing years, greater access to administrative and research support, and the fundamental recognition of family status in policies and practices 6 , 20 , 45 , 49 , 54 , 76 78 , 82 , 83 , 86 , 92 , 94 , 99 , 100 , 104 , 110 , 114 , 125 , 149 , 150 , 168 , 170 , 180 , 182 , 199 , 206 , 212 , 216 29
3 Provide or maximise mentorship, sponsorship and collaboration between academics and research-enabling staff at all stages of their career 47 , 49 , 50 , 64 , 67 , 72 , 76 , 92 , 101 , 104 , 112 , 165 168 , 175 , 187 , 196 , 199 , 200 , 202 , 205 , 215 , 217 24
4 Consider courses aimed at underrepresented groups to improve confidence, assertiveness and to manage negative influences, such as imposter syndrome; empower staff through participation in decision-making and problem solving 121 , 165 , 176 , 182 , 190 , 200 , 202 , 213 215 , 217 11
5 Consider pre-assessing research skills so that different types of mentor-mentee matching strategies can be formed in as many areas as needed, which can help new investigators, early-stage investigators and underrepresented minorities 50 , 64 , 67 , 72 , 166 , 187 , 196 , 206 , 215 9
6 Reward or emphasize collaboration over competition 47 , 83 , 92 , 101 , 104 , 112 , 218 7
Making use of and learning from existing tools and initiatives to support cultural change 1 Consider adopting an inclusive and shared leadership model such as Networked Improvement Community (NIC) which focuses on shared leadership, inclusive practices in different contexts (e.g., for STEM, establishing a culture of equity and engagement) to strengthen infrastructure at local levels 72 , 81 , 92 , 99 , 101 , 104 , 112 , 149 , 150 , 167 , 168 , 172 , 174 , 176 , 180 , 182 , 186 , 187 , 192 , 197 , 200 , 207 209 , 218 , 219 26
2 Encourage and signpost staff to peer groups to enable and encourage networking and shared understanding including critically reflectly on cultural identity (e.g., Blackett Lab Family, Black Heroes of Mathematics, Africans in STEM) 72 , 125 , 149 , 167 , 169 , 173 , 174 , 178 , 210 , 217 , 220 11
3 Implement and encourage staff development opportunities (e.g., StellarHE) that are inclusive to and for everyone, regardless of characteristics, career stage or job role, including learning from networks and initiatives such as the National Research Mentoring Network (NRMN), Athena Swan (UK based), UK’s Concordat to Support the Career Development of Researchers 56 , 72 , 126 , 165 , 166 , 182 , 192 , 197 , 200 , 206 10
4 Consider adopting PRESS, an evidence-based framework for achieving racial equity; as well as using well-designed metrics that can help to manage discrimination ‘blind spots’ and encourage a ‘sense of belonging’ (e.g., Challenged Sense of Belonging Scale) 169 , 172 , 176 , 184 , 207 209 , 220 8
5 Seek to safeguard the physical and emotional well-being of PEER trainees, by equipping STEM allies with tools to combat discrimination (e.g., Allyship for PEER trainees (Persons Excluded from science because of Ethnicity and Race) (PEERs)) 72 , 125 , 149 , 169 , 172 , 174 , 184 , 217 8
6 Increase uptake of digital tools and inclusion-sensitive pedagogy to support equal participation in Higher Education programmes, including promotional materials and promote open knowledge institutions (OKIs) in diversity, communications and coordination, support opportunities for virtual conferences to increase access for researcher participation in training, symposia, and conferences 165 , 171 , 184 , 188 , 190 , 197 , 211 7
7 Consider the use of Authentic Interrogation, Acknowledgment, and Accountability that requires SciCommers to explicitly articulate the ways in which STEM and SciComm have been used as systems of oppression 72 , 149 , 172 , 174 , 186 5
Support for a balanced and flexible working pattern 1 Ensure staff contracts can accommodate better pathways for flexible working so there are no unintended consequences on careers for focusing on care-giver responsibilities or changing circumstances 72 , 81 , 95 , 99 , 121 , 125 , 149 , 150 , 165 , 168 , 170 , 172 , 180 , 182 , 199 , 206 , 216 17
2 Put in place options that help staff to return to work after a period of absence to improve transition back to work and promote life-work balance (for students and staff) 18 , 72 , 99 , 121 , 123 , 126 , 149 , 165 , 168 , 170 , 180 , 199 , 201 , 206 14
3 Commit to the ring-fencing of research-time and ensure researchers confirm time against other duties (i.e., teaching, administration, marking and preparation), and for leaders to demonstrate healthy working practices 49 , 51 , 81 , 125 , 149 , 165 , 215 7
4 Include working hours as a standing item on appraisals and manage expectations around working hours, breaks and holidays to reduce excessive working hours, including the use of more inclusive job descriptions in hiring processes 49 , 51 , 99 , 125 , 159 5

The review illustrates that over the last three years, the COVID-19 pandemic has highlighted some important challenges to this already highly pressured working environment, with mixed effects, particularly to those with caring responsibility. 18 , 47 , 77 However, there is also emerging evidence showing the potential benefits and opportunities as a result of COVID-19. 18 , 47 , 67 , 76 , 77 , 100 , 180 , 197 For example, use of online platforms for training and teaching purposes has opened up opportunities to bring together specific communities and countries. The pandemic led to calls for more ‘kindness in research’ where empathy replaced the usual expectations on life-work balance. 76 , 100 , 184 In addition to opportunities emerging from the pandemic, the review also identified clear efforts to improve and raise awareness of the need for academia to embrace the EDI agenda through several initiatives, movements, and policy implementations (as detailed in Table 3). Most prominently, focusing on efforts to improve individuals’ opportunities through networking, collaborations, mentoring and peer-to-peer support, balancing career, and family aspirations can help to guide inclusivity and strengthen infrastructure and local capacity. 174 , 180 , 186 , 208

Teamwork and supportive working relationships

Collaboration, openness, and transparency were highlighted in the evidence as key indicators of success for driving forward a positive cultural change. However, the emerging evidence suggested that perverse incentives within the research ecosystem, a lack of training, opportunity, support, and infrastructure can undermine ambitions for change, which is further hampered by researcher perceptions of what an academic career entails. 4 , 25 , 63 , 157 , 185 , 221 , 222

The evidence pointed to a range of barriers that have repercussions on the notion of teamwork, such as the ongoing tradition of first and last authors taking most or all of the credit for the work, 223 the use of ‘gift authorship’ to enhance research publication of academics with poor research performance, 5 and the pressures to have global impact on the scientific community through high-quality scientific writing. 167 Researchers are incentivized to attain research excellence despite ‘excellence’ being narrowly defined, which can often lead to hyper-competitiveness and unfair working practices. 4 , 19 , 25 , 53 , 62 , 91 , 92 , 209 The evidence further suggested that the Research Excellence Framework (REF) in the UK has been criticised as promoting competition between departmental colleagues rather than collaboration due to criteria on who they can contribute with and the increased demand on publications. 52 , 92

Practices that could restrict collaboration as a result of REF can have a detrimental impact for the promotion of research integrity and team science, especially for ECRs. Research careers encompass a range of roles, skills, and expertise but as the evidence suggests this is not universal, with some universities separating research staff from research-enabling colleagues such as research managers, technicians, administrators, and librarians, some of whom have research-level qualifications and experience. 44 , 102 , 161 Separation in this way could lead to inequality of how staff are included (or not), trained, mentored and perceived by fellow colleagues (see Table 4 for a summary of the key considerations associated to teamwork and supportive working relationships).

Table 4. Key concepts, areas and considerations associated to teamwork and supportive working relationships.

Key themes No Key areas and considerations associated to teamwork and supportive working relationships No. refs
Everyone feeling valued and having equality of opportunities to contribute 1 Encourage faculties to support collaborations and networks that provide a sense of mutual support and culture of team effort rather than individual competition, through interactive learning environments and faculty members as supporters and mentors 5 , 19 , 24 , 28 , 44 , 46 , 48 , 49 , 52 , 62 , 63 , 72 , 75 , 76 , 90 92 , 95 , 98 , 101 , 102 , 104 , 110 , 112 , 133 , 144 , 167 , 175 , 180 , 181 , 185 , 196 , 209 , 215 , 223 239 51
2 Consider incentives and mechanisms to share open data and empower multi-disciplinary teams to reuse data, and adopt incentives that are transparent across funding agencies and organisations, journals and research institutions (including replication research) 24 , 28 , 44 , 46 , 51 , 52 , 90 , 92 , 101 , 102 , 104 , 112 , 144 , 157 , 218 , 221 , 223 , 235 , 236 , 238 243 25
3 Encourage transformative interdisciplinary research to diversify teams, deepen integration of knowledge and move beyond separate disciplinary research 19 , 24 , 28 , 44 , 49 , 52 , 60 , 72 , 76 , 90 92 , 104 , 112 , 167 , 209 , 223 , 225 , 227 , 238 , 239 , 244 , 245 23
4 Bring researchers together under a common goal to address specific research issues through a challenge-led (problem-led) research approach (including the health of labs) 19 , 48 , 49 , 60 , 72 , 76 , 91 , 92 , 95 , 101 , 104 , 161 , 181 , 227 , 232 , 242 , 244 17
5 Provide greater opportunities and capacity for technical and library staff to improve their own research skills through networking, collaborative partnerships and being contributors to research, including raising accessibility for multi-disciplinary teams and interaction 48 , 93 , 98 , 110 , 133 , 161 , 218 , 227 , 237 , 246 248 12
6 Ensure that those in research management and technical roles have adequate routes to continued professional development through inhouse or formal training (including ethical considerations and issues) 98 , 102 , 155 , 161 , 181 , 227 , 230 , 247 , 249 252 12
7 Recognise and value the diverse skillset of research management and technical staff (and early career researchers), and provide opportunities for them to host and supervise researchers, apply for research grants and have the opportunity to undertake research 44 , 48 , 62 , 98 , 161 , 230 , 234 , 242 , 249 9
Measuring success that rewards contribution and open research practices 1 Ensure that the term research excellence is understood and qualified within assessment processes to minimise opportunities to reward individualism at the expense of the collaborative, and create environments that assess the performance of the collective rather than only individuals (e.g., performance-based research funding systems PBRFS, and productivity) 3 , 5 , 6 , 8 , 21 , 24 , 28 , 53 , 60 , 87 , 90 92 , 94 , 95 , 97 , 100 , 101 , 110 , 112 , 133 , 142 , 156 , 161 , 215 , 224 , 226 , 230 , 236 239 , 245 , 253 258 39
2 Reward multidisciplinary work through separate evaluation structures to encourage team science initiatives (consider including data sharing and collegiality as part of employment evaluation criteria) 24 , 25 , 28 , 44 , 46 , 52 , 90 , 92 , 101 , 102 , 104 , 112 , 157 , 167 , 209 , 218 , 223 , 225 , 229 , 238 , 239 , 245 22
3 Review how research is recognised, incentivised and rewarded (subjective and objective measures of quantity, quality and impact), including Key Performance Indicators (KPIs) and whether monitoring systems are contributing to optimum solutions (including financial support and elevating barriers) 3 , 8 , 24 , 28 , 53 , 87 , 95 , 101 , 112 , 181 , 220 , 224 , 235 , 240 , 242 , 244 , 246 , 255 , 257 19
4 Review, consider and evaluate the value, role, and purpose of incentives. Consider questions such as ‘Do they foster scientific knowledge?’ and ‘Are large collaboratives, open science practices innovative enough?’ 8 , 19 , 24 , 25 , 60 , 101 , 110 , 111 , 133 , 167 , 215 , 221 , 240 , 253 14
5 Reward credible research practices that are addressing problems with credibility, rigour, and reproducibility in grant guidelines (e.g., incorporating Registered Reports in two stage funding models). Seek to encourage practice across publishers and institutions to not disadvantage researchers who engage in open practices (consider frameworks to improve quality publication practices (QPPs)) 8 , 24 , 25 , 48 , 101 , 111 , 230 , 236 , 240 , 243 , 250 , 253 , 259 13
6 Consider ‘human-oriented’ knowledge practices over ‘output-oriented’ practices so that researchers and educators are evaluated based on value, quality and contribution, including early career researchers 4 , 48 , 148 , 180 , 196 , 224 , 234 , 244 , 250 9
Ensure routes for development are inclusive and for everyone (regardless of position, role or discipline) 1 Develop and reward cross-disciplinary training and mentoring aligned with development of on the job skills to promote interdisciplinary insight 19 , 49 , 63 , 72 , 75 , 76 , 91 93 , 95 , 98 , 101 , 104 , 155 , 157 , 175 , 185 , 196 , 220 , 225 , 231 , 235 , 250 252 , 260 26
2 Invest capacity in fostering change for different specializations and teams to create a trusting environment for knowledge-exchange, particularly around inefficiencies and pressure on grant funding 24 , 28 , 44 , 46 , 48 , 52 , 62 , 90 , 92 , 101 , 102 , 104 , 112 , 167 , 180 , 223 , 225 , 226 , 229 , 238 , 239 , 246 , 261 23
3 Invest in leadership training and encourage a culture of knowledge sharing between senior leaders to foster a healthy work environment, in particular around Open Science, Open Research practice and competencies (including project management and oversight and training such as awareness and motivation) 8 , 19 , 24 , 25 , 63 , 101 , 111 , 155 , 167 , 175 , 181 , 225 , 231 , 233 , 246 , 250 253 , 260 , 262 21
4 Implement an inclusive leadership programme, and promote the benefits of collaborative working to breakdown the feeling of a competitive research culture 19 , 60 , 62 , 63 , 110 , 133 , 157 , 161 , 175 , 228 , 230 , 232 , 233 , 244 , 262 15
5 Provide access to research capacity building activities that value research and provide access to resources 19 , 93 , 167 , 215 , 220 , 226 , 244 , 246 , 261 9
Make use of or build on existing tools and initiatives to advance innovation 1 Centralize computing and experimental infrastructure to engage core facilities to provide data services, including ways to enhance productivity through the use of social media (and digitalisation) 3 , 6 , 8 , 21 , 24 , 25 , 28 , 53 , 87 , 90 , 91 , 94 , 95 , 100 , 101 , 112 , 142 , 157 , 230 , 236 , 239 , 248 , 249 , 253 255 , 257 , 258 28
2 Consider implementing a Complementary Capacity Building (CCB) programme to improve the sustainability of research partnerships (including productivity), with particular focus on LMIC research capacity (and identifying synergies between research and services for development (R&S4D) 6 , 8 , 21 , 24 , 28 , 53 , 87 , 90 , 91 , 93 95 , 97 , 100 , 101 , 142 , 156 , 224 , 226 , 237 , 239 , 253 255 , 257 , 258 , 261 27
3 Promote or encourage use of: the Open Science Framework platforms; project management tools designed to enhance transparency and foster collaborations; the Open Innovation Science (OIS) concept/framework; Network data centres and task forces (e.g., UK Reproducibility Network and developing framework/guidelines to enhance understanding); and implement and encourage use of contributorship approaches such as mandating the use of CRediT 7 , 25 , 110 , 133 , 181 , 218 , 236 , 263 8
4 Consider optimal models of collaboration which promote integration that is appropriate and relevant as different problems (including different countries) require different approaches 157 , 224 , 226 , 228 , 231 , 236 6

Although there are several challenges related to workplace relationships, any steps to reform these barriers will require accessibility to opportunities and resources that collectively bring research staff together in a unified and cohesive way to promote and create trust (rather than having intensive competitive pressures to achieve based on individual merit). 54 , 167 , 250

The evidence reveals multiple layers of complexity around the notion of ‘teamwork’ and the interrelated social and environmental factors that unfortunately reinforce a status quo. For change to occur there needs to be synergy for collaboration to ensure individuals, Research institutions, funding organisations and society share a unified approach to move beyond solitary, isolated teams to a deeper integration of multi-disciplinary/inter-disciplinary culture. 7 , 60 An inclusive, representative, and collaborative research environment contributes to improvement in researchers’ sense of belonging and to positive cultural change. 209

The identified evidence suggests that there is a need to take a holistic and integrated view of the intrinsic (those within disciplines) and extrinsic factors (those outside of disciplines) that affect the research environment to come up with novel ways to tackle the challenges with teamwork and collaboration to ensure openness and a cultural shift in the right direction. 7 There is growing evidence that success in research and innovation requires diversity in roles, knowledge, and skills, an inclusive, representative, and collaborative research environment all contribute to improvement in researchers’ sense of belonging and to positive cultural change is required. 209

Research quality and accountability – open and trustworthy research

From the existing evidence it was clear that transparency, open research, and integrity requires collaboration from research institutions, funding organisations, researchers, publishers, and other sectoral organisations such as industry. 29 , 263 , 264 A large proportion of the evidence (more than a quarter of articles (133/253) included from the database searches and half of the grey literature (52/102)) suggested a link between lack of open research and reproducibility that could lead to public distrust and inhibit several open research practices. 25 , 89 , 219 , 238 , 240 , 260 , 265 Increasing pressures on researchers is causing a ‘publish or perish’ practice, and has meant that researchers are prioritising ‘getting it published’ rather than ‘getting it right’. 25 , 89 , 238 , 240 , 257 , 258 , 260

However, as noted by Munafo (2022), the ‘replication crisis’ could be regarded as an opportunity to promote motivation for improvements. Determining where effort is most needed and what changes are required, provides opportunities for the research ecosystem. Specifically, research institutions and funding organisations can mandate open research practices, and therefore coordinate change at both research integrity and researcher integrity level 264 (see Table 5 for a summary of the key considerations associated to teamwork and supportive working relationships).

Table 5. Key concepts, areas and considerations associated to research quality and accountability – open and trustworthy research.

Key themes No Key areas and considerations associated to research quality and accountability – open and trustworthy research No. refs
Incentives and innovation 1 Synthesize insights across multiple disciplines to help to unify collaborative practices and breakdown boundaries and disconnect to signal organisational values, such as the Open Innovation in Science (OIS) Research Framework (particularly for early career researchers, supervisors, technicians), enabling change to the research ecosystem becoming interoperable and responsive to the open access movement 7 , 8 , 19 , 24 , 28 , 46 , 52 , 58 , 87 89 , 95 , 101 , 104 , 112 , 122 , 129 131 , 154 , 159 , 195 , 227 , 237 239 , 244 , 266 281 43
2 Encourage greater efficiency and use of innovative and alternative approaches such as alternative publishing models (e.g., Octopus); registering with Center for Open Science; methods to assess research and researchers (e.g., SPACE); and, Open Knowledge Indicators, mapping diversity, communication and coordination 24 , 58 , 88 , 111 , 130 , 154 , 165 , 172 , 211 , 219 , 240 , 250 , 259 , 264 , 266 268 , 282 294 30
3 Prioritise shared decision making to ensure all perspectives of the full research eco system are captured, to initiate change in practice, including policy makers, funders, publishers, technicians, researchers, institution leaders, editors, including level of appropriateness for performance based funding schemes 5 , 28 30 , 39 , 87 , 88 , 95 , 101 , 130 , 141 , 154 , 159 , 227 , 236 , 239 , 247 , 260 , 271 , 281 , 286 , 290 , 291 , 295 299 28
4 Maintain hiring, appointment and promotional policies that are fair and not solely based on authorship, publications or secured grants, and value softer skills 25 , 58 , 88 , 138 , 139 , 172 , 219 , 234 , 240 , 250 , 259 , 260 , 266 , 267 , 278 , 282 , 300 309 26
5 Develop a coordinated approach to incentivize open access policies to seek a cultural shift using existing initiatives in open access research practices (e.g., UK Research and Innovation, European and international position in open research) 8 , 29 , 88 , 101 , 129 , 138 , 165 , 221 , 253 , 271 , 274 , 275 , 277 , 278 , 291 , 304 , 309 , 310 18
6 Ensure continued monitoring and evaluation, including meta-research/research on research takes place to avoid unintended consequences, efficient use of resources and demonstrate which aspects are beneficial to the research ecosystem (including where improvements are required at institutional and professional level) 21 , 203 , 250 , 264 , 291 , 299 , 307 , 311 315 12
Creation and facilitation 1 Monitor, evaluate and embed learning from education, training, supervision and mentoring to improve research integrity and to create a responsible research culture that is not individualized (including publishing culture built on individual reputation and rankings) but is a collective role in promoting and fostering research/academic integrity, through initiatives such as open science peer networks, and not to capitalize on individual researchers’ compliance 4 , 19 , 21 , 28 , 46 , 58 , 79 , 88 , 101 , 104 , 109 , 111 113 , 122 , 124 , 129 , 130 , 132 , 141 , 154 , 172 , 188 , 213 , 237 239 , 244 , 250 , 253 , 256 , 259 , 260 , 264 267 , 271 , 275 , 280 , 281 , 283 286 , 288 290 , 292 , 297 , 303 , 311 , 312 , 314 , 316 334 73
2 Adopt open practices early on at all staff levels, but also at the institutional and funders level particularly around software and digital tools (including social media, Artificial Intelligence capabilities, the digital context, management tools), publishing mechanisms, workflows, ethics and data accessibility, supporting collaborations and training progression 39 , 46 , 58 , 59 , 73 , 75 , 79 , 88 , 89 , 102 , 104 , 109 , 111 , 113 , 122 , 124 , 132 , 145 , 165 , 217 , 236 , 240 , 244 , 256 , 260 , 263 , 266 , 267 , 269 , 287 , 289 , 290 , 293 295 , 307 , 311 , 312 , 319 , 320 , 324 , 326 , 329 , 335 345 54
3 Ensure alignment between grant funding and publication outputs as well as consistency with open research initiatives, and opportunities to create mechanisms for reproducibility so greater collaboration can be gained, including understanding of authorship/contributorship consideration 8 , 19 , 25 , 58 , 87 , 88 , 101 , 130 , 138 , 139 , 154 , 172 , 234 , 236 , 238 , 240 , 244 , 253 , 254 , 258 260 , 265 , 267 , 277 , 279 , 282 , 283 , 287 291 , 294 , 301 , 302 , 304 , 305 , 308 , 309 , 322 , 330 , 332 , 346 , 347 45
4 Coordinate and facilitate research integrity officers/champions to promote and create a responsible research culture, including opportunities for an academic integrity framework for policy and practice (including institutional improvements and avoiding the persistence of behaviors detrimental to reproducibility while encouraging responsible research conduct) 19 , 21 , 30 , 46 , 79 , 87 , 101 , 104 , 109 , 113 , 122 , 124 , 130 , 154 , 213 , 238 , 239 , 254 , 258 , 265 , 275 , 280 , 281 , 283 , 288 , 289 , 291 , 297 , 299 , 312 , 314 , 316 , 317 , 321 , 325 , 327 , 329 334 , 348 43
5 Support Responsible Research Practices (RRP) as they require facilitation, advice and steer from the Government, funding organisations and research institutions (progression and progress cannot be done in isolation). Such activity should consider six key areas: research policies; research practices; training researchers; evaluating research (ers); rewarding researchers; funding research (ers) 4 , 29 , 46 , 59 , 73 , 75 , 79 , 88 , 89 , 95 , 101 , 102 , 104 , 109 , 111 , 113 , 122 , 124 , 132 , 159 , 188 , 236 , 250 , 280 , 284 , 289 , 297 , 301 , 310 , 312 , 317 , 318 , 326 , 328 , 329 , 349 36
6 Enable researchers to have a voice in articulating (and contextualizing) how research could be evaluated and provide a mechanism for more detailed and transparent reporting of scholarly activities, using formal evaluative systems that explicitly capture behaviors that support reproducibility 39 , 87 , 130 , 131 , 134 , 154 , 230 , 238 , 254 , 258 , 265 , 275 , 276 , 279 , 283 , 288 , 289 , 291 , 300 , 315 , 330 , 332 , 335 , 336 , 350 , 351 26
Fostering transparency and visibility 1 Provide clarity, transparency and understanding of research mandates, policies and procedures to permit and maintain productivity in research for all staff and students (including career advantages), across all disciplines (acknowledging the reproducibility networks) 4 , 8 , 22 , 24 , 28 , 39 , 46 , 87 , 89 , 95 , 100 , 104 , 118 , 130 , 131 , 141 , 145 , 154 , 159 , 165 , 188 , 195 , 230 , 237 239 , 244 , 253 255 , 257 , 258 , 265 , 270 , 272 , 273 , 275 279 , 281 , 283 , 288 , 289 , 291 , 300 , 315 , 317 319 , 329 , 330 , 332 , 336 , 340 , 346 , 352 58
2 Actively encouraging researchers to make their research more accessible and open through sharing protocols and data openly and transparently, could foster greater knowledge exchange opportunities 8 , 19 , 39 , 87 , 88 , 101 , 130 , 131 , 145 , 154 , 165 , 211 , 236 238 , 253 , 254 , 256 , 258 , 260 , 265 , 276 , 279 , 283 , 284 , 288 , 289 , 291 , 293 , 300 , 301 , 304 , 307 , 317 , 319 , 320 , 324 , 330 , 332 , 335 , 336 , 338 , 340 , 342 , 344 , 346 , 350 , 353 , 354 49
3 Greater understanding and consideration of existing steps to promote open science practices such as Center for Open Science and its pre-registration process ( https://cos.io/prereg/); Editor’s Code of Ethics ( http://editorethics.uncc.edu/); Committee on Publication Ethics (COPE, http://publicationethics.org/); Transparency and Openness Promotion (TOP) guidelines; Open Science Grid ( http://opensciencegrid.org/); Open Knowledge institutions (OKIs); European Network of Research Integrity Offices; SPACE (SPACE is a rubric for analyzing institutional progress indicators and conditions for success); Open Government Data Act; FAIR (findable, accessible, interoperable, and reusable); alternative repositories for open access publications (University Journals) 21 , 24 , 46 , 79 , 88 , 101 , 109 , 111 , 113 , 122 , 124 , 130 , 154 , 211 , 239 , 265 , 281 , 283 285 , 288 290 , 292 , 295 , 306 , 307 , 326 , 329 333 , 337 , 341 , 343 , 347 37
4 Increasingly adopt and promote publicly available data sets shared through repositories (e.g., Figshare, Zenodo), data management techniques, open materials and open data badges through the Center for Open Science, increasingly being mandated by funders and journals (including networks such as the Open Traits Network and toolkits for open access, and self-assessment of digital research) 3 , 8 , 24 , 28 , 52 , 59 , 87 , 88 , 101 , 111 , 112 , 130 , 132 , 154 , 159 , 211 , 227 , 253 , 255 , 257 , 263 , 269 , 277 , 283 , 285 , 287 290 , 292 , 320 , 324 , 331 , 335 , 339 , 340 , 345 37
5 Ensure scholarly outputs are credited using alternative contributorship models (e.g., CRediT) and moving away from the traditional authorship models including becoming more preventative than reactive 21 , 25 , 79 , 88 , 139 , 234 , 282 , 287 , 291 , 301 , 305 , 308 12
6 Incorporate and consider web-based tools such as Open Science Framework (OSF), Open Knowledge Institutions framework (OKIs) to increase transparency and visibility of research at an international, global and institutional level 24 , 111 , 130 , 211 , 263 , 283 , 285 , 288 , 289 , 292 , 320 , 346 12
7 Become a signatory of initiatives such as DORA and seek to engage with local and international networks such as the Reproducibility Network 22 , 29 , 39 , 101 , 263 , 264 , 271 , 307 , 315 , 332 10

The existing evidence demonstrated that open research practices (e.g., research integrity, researcher integrity, open data, open access and transparency) requires a global effort, as well as involvement from all sectors of the research ecosystem (e.g., institutions, researchers, funding organisations, publishers, industry). However, more evidence is needed to demonstrate where and in what circumstances the change is having tangible benefit. 46 , 263 , 264 , 285 , 332

As the evidence suggests, practices should be evaluated to assess whether change has been of value, enhancing the research pathway and align to be evidence informed, therefore avoiding any unintended consequences. 5 , 7 , 138 , 264 , 275 Meta research (e.g., research on research, meta science) is one way to evaluate and evidence any innovation taking place, and therefore determine the impact and tangible benefit of these changes to promote and enhance the research ecosystem. 7 , 25 , 39 , 250 , 264 , 284 , 332 , 344

The evidence review found several initiatives such as the UK Reproducibility Network (UKRN), Declaration on Research Assessment (DORA), and the European Network of Research Integrity Offices (ENRIO) to promote, encourage and prioritise the facilitation and creation of open research practices. 7 , 22 , 284 , 288 , 328 Adopting such initiatives enhances innovation across all aspects of the research ecosystem but there is variation on how far they have been implemented (including what stage of the development) and the acceptance level from researchers, research institutions and funding organisations. 306 , 325 , 328 , 333

Discussion

From the evidence, it was clear that there were several initiatives seeking a cultural change across research institutions particularly around capacity building, attracting and retaining staff, fostering an inclusive and open collegial environment, fostering transparency and visibility, supporting incentives to advance innovation, and invest in people to feel supported and valued. Reviewing the evidence under the four areas (e.g., security, wellbeing and equality of opportunity, teamwork and research quality and accountability) demonstrated several areas of best practice that could be considered to support and adopt a good research culture (see Tables 2 to 5). However, adopting and implementing ways to enhance research culture will inevitably vary by country and setting. It is therefore imperative that regular and continuous monitoring and evaluation happens to improve and create a responsible research culture, fostering progression and innovation. Although this was promising to see, the commitment is complex considering the multifaceted structures and processes governing the research ecosystem. As a result, evaluating the components of what constitutes a good research culture is challenging. There could be several reasons for the lack of evaluative research, particularly where there are multiple factors influencing institutional culture (e.g., funder policies and practices, league tables, promotion, policies and processes). Adding to the complexity, is the acknowledgement from research institutions that they have a role to play in not only supporting research staff, at all levels, but also recognise the role and function of research-enabling staff. 79 , 88 , 117 , 140 , 159 , 232 As noted in the Department for Business, Energy and Industrial Strategy (BEIS) R&D People and Culture Strategy report, high quality research and innovation requires an acknowledgment of the full range of people involved, promoting equality of opportunity for everyone and the sense of being valued. 8 An inclusive, representative and collaborative research environment contributes to improvement in researchers’ sense of belonging and to steps to enable a positive cultural change. 26 , 209

Security: Over the last five years, and particularly the last two years (i.e., post the COVID-19 pandemic), there has been a surge of evidence to capture the effects of these challenges and barriers and how these failings in the research ecosystem can be mitigated. Much of the literature that focused on career stability, job security and career progression suggested the need to build research capacity that spans across research, education and enterprise. However, with this comes new challenges and pressures for research active staff to also mentor, support and educate, whilst also having committed time to conduct their own research. 7 , 25 , 47 , 53 , 76 , 77 , 100 , 180 , 197 , 340 Several initiatives and opportunities were found in the evidence, particularly around supporting multiple career paths, promoting fair and transparent processes (particularly around the appropriate use of research metrics), and cultivating a culture that promotes diversity of skills and career pathways (e.g., triple helix approach). 36

Wellbeing and equality of opportunity: The effect of the COVID-19 pandemic also presented several challenges around the physical and emotional wellbeing of staff, particularly how additional burden placed on women reduced their productivity far more than men with women having ‘borne the brunt of the pandemic in academic settings.’ 180 There has been a steady increase in mental health distress arising from the COVID-19 pandemic, which added to the existing strain in academia, can often feel detrimental to an individual’s career. 18 Several initiatives were reported in the evidence to also suggest that the COVID-19 pandemic may have perhaps initiated more transparency on obtaining a life/work balance, particularly at a time when many parents and carers across the world were not only managing increasing work demands but also having to manage home life and home schooling simultaneously. Recognising such demands on individuals has introduced new opportunities that would not otherwise have been considered, such as the use of alternative methods and approaches for teaching and training (e.g., online platforms and virtual teaching methods).

Teamwork: There was a strong sense and recognition of the value and importance of research capacity building, and the evidence clearly provided a wealth of initiatives to embark on. Interestingly, models, approaches and initiatives for capacity building have been reported by several countries. 60 , 73 , 93 , 106 , 133 , 136 , 162 , 226 , 313 , 355 Initiatives taking place, emphasized the benefits of learning from experiences in other countries was encouraging to report from the literature. Factoring some of these initiatives, it is evident that academia is confronting the challenges ‘head on’ to build a more sustainable and credible research environment. 20 , 165 , 219 Although this is promising, the evidence suggests that research institutions must not assume that ‘one size fits all’. There is diversity across disciplines, research and research-enabling staff (across research, education and enterprise) and several types of research institutions. To enhance research culture, different solutions will require different approaches at individual, institutional and systemic levels (see Table 4).

Open and trustworthy research: The increasing competitiveness perpetuated by research funding organisations sometimes placing greater focus on citation impact rather than creativity and innovation, is contributing to the need for cultural change. The health of research groups (e.g., project teams inclusive of academics and research-enabling staff) and those that lead them has been identified as an area that universities need to pay more attention to, rather than centering on individual researchers, particularly in the context of preventing research misconduct. 46 Team leaders play an important role in creating trustful environments, which support knowledge exchange processes and open research 167 and crucially they act as mentors and role models for research integrity and open working practices. 46 , 95

Future considerations: Given the growing evidence that success in research and innovation requires diversity in roles, knowledge, and skills, embedding a research culture of inequality between career types within the same research team discourages a culture of collaboration and appreciation of a diversity of roles, specialisations and contributions. 26 , 44 , 167 With increasing demands to incentivise and promote change it is necessary to acknowledge that both funding organisations and research institutions have responsibility to transform and shape best practice in research. Providing opportunities for staff to combine their academic research with work in other sectors could bring more value to academia and strengthen the synergies for cultural change in the long-term. 156 The development of the research culture framework by Vitae in 2023, is a promising move to promote a better understanding about how research is managed and undertaken, ensures value, supports people, and empowering people to engage with others. 26

Guidance on how to create a global long-term sustainable model that has representation at all levels is going to take time, and the COVID-19 pandemic has aggravated this already challenging and highly pressured working environment. 18 , 47 , 76 , 77 However, despite the pandemic causing global disruption and concern, it has initiated new opportunities to bring communities and countries together by assessing the value and implementation of alternative digital technology such as the use of social media and interviewing techniques using virtual platforms (see Table 4). 197 , 244 , 248 , 260 , 267 , 335 , 345 , 347 Research, training and teaching took place online, and the growing evidence suggests that offering greater accessibility through virtual platforms goes some way to reform the connectivity and diversity of the research environment. A good example of this is virtual conferences, as those with accessibility issues, family commitments, funding limitations and research communities from Low- and Middle-Income Countries (LMIC) now can attend, where they could not before. 211 , 248 Any changes will inevitably take time, but small incremental improvements can have an impact, affecting both research institutions and funding organisations. 184 In addition, the pandemic provided the impetus to embed kindness in research where empathy replaced the usual expectations on life-work balance, 100 and researchers who felt supported during the pandemic tended to have better indicators of well-being. 76 , 77

Study strengths and limitations

The main strength of the review was using several systematic database literature searches, which was complemented with additional grey literature searches of known online education articles and websites. However, a limitation is that scoping reviews only map the evidence and do not assess the quality of the articles or risk of bias. Most of the database articles had an international focus, with most of them from USA and Canada (28.2%) and other international countries (28.7%). For a large proportion of the grey literature, it was not possible to ascertain the articles countries region. Moreover, on a pragmatic basis, news items from news organisations based outside of UK, Europe, Norther America, and Australia were excluded, which along with the exclusion of non-English language documents means that other initiatives being used to improve research culture may well have been missed. On this basis, there could have been international and regional biases, but it could also be that there is a lack of evidence from these regions rather than missing articles from the systematic searches.

The review found more than 200 articles from the systematic database searches (n=253) and more than 100 from the grey literature searches (n=102) which suggested that there is growing literature around what constitutes a ‘good’ research culture and what this could look like. However, as the literature has shown, progress has been slow and although the evidence provided several examples of established initiatives and networking opportunities, the evidence was more anecdotal, and opinion focused.

Conclusions

The review has shown that there is a wealth of evidence suggesting how and where changes are needed to establish a global cultural change to the research ecosystem. Reviewing the literature under four broad areas of what constitutes a good research culture (e.g., security, wellbeing and equality of opportunity, teamwork and research quality and accountability), demonstrated not only the complexities of how to implement change but also how they do not work in isolation. For example, to thrive and enhance job security, individuals need to feel empowered and safe in their workplace, feel a sense of team support, and treated with respect. However, the commitment for change and progress to occur requires the whole research community to work collaboratively, not one part can work in isolation. Individuals, research organisations and funding organisations need to be responsible and work together; to uphold and ensure fair and transparent policies and governance. Change will not happen overnight, but by working together in a collaborative and diverse way to ensure all views, opinions and expectations are fully inclusive will strengthen and enhance research culture for the better. There is a lot that can be done, and the evidence base for promoting a good research culture is substantial. Future considerations need to be inclusive of emerging frameworks such as the research culture framework by Vitae and to also ensure that monitoring, evaluation and learning occurs to assess the relative effort, value and benefit both at an institutional and professional level. 26 , 203 , 250 , 264 , 291 , 299 , 307

The barriers to a sustainable research culture are complex and underneath linger more multi-faceted challenges, such as the impact on the wellbeing of research and research-enabling staff, resistance to innovation, equity for research institution staff and career progression. 30 , 65 , 67 , 88 , 198 , 263 , 339 Adding to the complexity is the increasing pressure for academic institutions, research groups, disciplines, and staff to demonstrate the impact of their research. The growing focus on performance measures has undoubtedly caused unintended consequences for the whole research ecosystem. This model is not sustainable, not only for the quality of research and trust in research, but also for the next generation of talented researchers. Researchers are leaving academia, leaving behind a career that should be fostering innovation and building research capacity at its core. Removing such barriers and adopting best research practice and enhancing the diversity of opportunities for all is ultimately down to everyone working within the research environment. 26

Ethics and consent

Ethical approval and written consent statement were not required.

Authors’ contributions

Conceptualization: Amanda Blatch-Jones, Kay Lakin, Sarah Thomas

Data curation: Amanda Blatch-Jones, Kay Lakin

Formal analysis: Amanda Blatch-Jones, Kay Lakin

Investigation: Amanda Blatch-Jones, Kay Lakin

Methodology: Amanda Blatch-Jones, Kay Lakin

Validation: Amanda Blatch-Jones, Kay Lakin

Project administration: Amanda Blatch-Jones

Supervision: Amanda Blatch-Jones

Writing – original draft: Amanda Blatch-Jones

Writing – review and editing: Amanda Blatch-Jones, Kay Lakin, Sarah Thomas

Acknowledgements

We would like to thank John Holloway and Rebecca Hoyle for their contribution to the development of the scoping review and Beverly Sherbon for her contribution during the early stages of the planning of the scoping review. We would also like to thank Becky Clarke-Harris for her contribution to screening and full extraction, Jennifer McHugh for her involvement in the wider collaboration across the University of Southampton, and support from the University of Southampton Library during the scoping and piloting phase for grey literature searches using Lexis-Nexis.

Funding Statement

This research was funded through a Research England QR fund to the University of Southampton as part of a programme of activity on Research Culture. The views and opinions expressed in the discussion are those of the authors and do not necessarily reflect those of the University of Southampton.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 3; peer review: 4 approved]

Data availability statement

All underlying data are available as part of the article and no additional source data are required.

Underlying data

OSF: A scoping review on what constitutes a good research culture. https://osf.io/wjhcf/. 356

This project contains the following underlying data:

  • Fig 1 PRISMA flow diagram (PRISMA)

  • Fig 2 themed areas diagram (four themed areas diagram)

  • S1 Appendix search terms and key words (search terms and key words)

  • S2 Appendix PRISMA ScR checklist (completed checklist)

  • S1 Table database searches examples (search strategies used)

  • S2 Table database lit articles (complete list of included articles in the review)

  • S3 Table grey lit articles (complete list of included articles from the grey literature in the review)

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

Extended data

Reporting guidelines

OSF repository: PRISMA ScR checklist and flow chart for “A scoping review on what constitutes a good research culture.” https://osf.io/wjhcf/. 356

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

References

  • 1. Hunter J, McKernan R, Rankin S, et al. : Seven principles to change the UK’s research culture. Times Higher Education. 2020. [Google Scholar]
  • 2. Jong L, Franssen T, Pinfield S: ‘Excellence’ in the Research Ecosystem: A Literature Review. Research on Research Institute;2021. [Google Scholar]
  • 3. Else H: Impact factors are still widely used in academic evaluations. Nature. 2019. 10.1038/d41586-019-01151-4 [DOI] [PubMed] [Google Scholar]
  • 4. Xu X, Oancea A, Rose H: The Impacts of Incentives for International Publications on Research Cultures in Chinese Humanities and Social Sciences. Minerva. 2021;59(4):469–492. 10.1007/s11024-021-09441-w [DOI] [Google Scholar]
  • 5. Buckle RA, Creedy J: Methods to evaluate institutional responses to performance-based research funding systems. Aust. Econ. Pap. 2022;61:615–634. 10.1111/1467-8454.12263 [DOI] [Google Scholar]
  • 6. Gadd E: Metistalk. 2022. Reference Source
  • 7. Beck S, Bergenholtz C, Bogers M, et al. : The Open Innovation in Science research field: a collaborative conceptualisation approach. Ind. Innov. 2022;29(2):136–185. 10.1080/13662716.2020.1792274 [DOI] [Google Scholar]
  • 8. BEIS: Research and development (R&D) people and culture strategy. In: Industry DfBE, editor. 2021.
  • 9. Inorms: SCOPE Framework for Research Evaluation.Last accessed 22/02/2023. Reference Source
  • 10. DORA: The Declaration on Research Assessment.Last accessed 22/02/2023. Reference Source
  • 11. Hicks D, Wouters P, Waltman L, et al. : Bibliometrics: The Leiden Manifesto for research metrics. Nature. 2015;520(7548):429–431. 10.1038/520429a [DOI] [PubMed] [Google Scholar]
  • 12. ISRIA: The International School on Research Impact Assessment.Last Accessed 22/02/2023. Reference Source
  • 13. Agate N, Long CP, Russell B, et al. : Walking the Talk: Toward a Values-Aligned Academy. HuMetricsHSS;2022. 10.17613/06sf-ad45 [DOI] [Google Scholar]
  • 14. Wellcome: Research culture: let’s reimagine how we work together.Last accessed 22/02/2023. Reference Source
  • 15. Wellcome: What researchers think about the culture they work in.Last accessed 22/02/2023. Reference Source
  • 16. Jo Billings: Research culture: what researchers think of the culture they work in.Last accessed 22/02/2023. Reference Source
  • 17. Ullrich LE, Ogawa JR, Jones-London MD: Factors that influence career choice among different populations of neuroscience trainees. eNeuro. 2021;8(3):ENEURO.0163–ENEU21.2021. 10.1523/ENEURO.0163-21.2021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Limas JC, Corcoran LC, Baker AN, et al. : The Impact of Research Culture on Mental Health & Diversity in STEM. Eur. J. Chem. 2022;28(9). 10.1002/chem.202102957 [DOI] [PubMed] [Google Scholar]
  • 19. Grant S, Wendt KE, Leadbeater BJ, et al. : Transparent, Open, and Reproducible Prevention Science. Prev. Sci. 2022;23:701–722. 10.1007/s11121-022-01336-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Erickson M, Walker C, Hanna P: Survey of academics finds widespread feelings of stress and overwork. The Conversation. 2020. Reference Source [Google Scholar]
  • 21. Marinetto M: How can we tackle the thorny problem of fraudulent research? The Guardian. 2017. [Google Scholar]
  • 22. UK Research and Innovation: Enhancing research culture funding allocations 2021 to 2022.Last accessed 22/02/2023. Reference Source
  • 23. Wellcome: Research culture: let’s reimagine how we work together.Last accessed 22/02/2023. Reference Source Reference Source
  • 24. Horn L, Bouter L: Researchers should be assessed on quality not quantity: here’s how. The Conversation. 2022. Reference Source [Google Scholar]
  • 25. Kowalczyk OS, Lautarescu A, Blok E, et al. : What senior academics can do to support reproducible and open research: a short, three-step guide. BMC. Res. Notes. 2022;15(1):116. 10.1186/s13104-022-05999-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Shift Insight: UK Reproducibility Network, Vitae. Research Culture Initiatives in the UK. 2024. Reference Source
  • 27. Manville C, d’Angelo C, Culora A, et al. : Understanding perceptions of the Research Excellence Framework among UK researchers. 2021.
  • 28. The Royal Society: Research culture embedding inclusive excellence: Insights on the future culture of research. 2017.
  • 29. Stewart SLK, Pennington CR, Silva GR, et al. : Reforms to improve reproducibility and quality must be coordinated across the research ecosystem: the view from the UKRN Local Network Leads. BMC. Res. Notes. 2022;15(1):58. 10.1186/s13104-022-05949-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Ross-Hellauer T, Reichmann S, Cole NL, et al. : Dynamics of cumulative advantage and threats to equity in open science: a scoping review. R. Soc. Open Sci. 2022;9(1). 10.1098/rsos.211032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Sørensen MP, Ravn T, Marušić A, et al. : Strengthening research integrity: which topic areas should organisations focus on? Hum. Soc. Sci. Comm. 2021;8(1). 10.1057/s41599-021-00874-y [DOI] [Google Scholar]
  • 32. Wellcome: What researchers think about the culture they work in.Last accessed 22/02/2023. Reference Source
  • 33. JBI: Scoping Review Network.Last accessed 17/02/2023. Reference Source
  • 34. Peters MDJ, Marnie C, Tricco AC, et al. : Updated methodological guidance for the conduct of scoping reviews. JBI Evid. Implement. 2021;19(1):3–10. 10.1097/XEB.0000000000000277 [DOI] [PubMed] [Google Scholar]
  • 35. Khalil H, Peters MD, Tricco AC, et al. : Conducting high quality scoping reviews-challenges and solutions. J. Clin. Epidemiol. 2021;130:156–160. 10.1016/j.jclinepi.2020.10.009 [DOI] [PubMed] [Google Scholar]
  • 36. Cai Y, Amaral M: The triple helix model and the future of innovation: a reflection on the triple helix research agenda. Triple Helix. 2021;8(2):217–229. [Google Scholar]
  • 37. Halilem N: Inside the Triple Helix: An Integrative Conceptual Framework of the Academic Researcher’s Activities, a Systematic Review. J. Res. Adm. 2010;41(3):23–50. [Google Scholar]
  • 38. Borkowski D, McKinstry C, Cotchett M, et al. : Research culture in allied health: a systematic review. Aust. J. Prim. Health. 2016;22(4):294–303. 10.1071/PY15122 [DOI] [PubMed] [Google Scholar]
  • 39. Munafo MR, Chambers CD, Collins AM, et al. : Research Culture and Reproducibility. Trends Cogn. Sci. 2020;24(2):91–93. 10.1016/j.tics.2019.12.002 [DOI] [PubMed] [Google Scholar]
  • 40. Stentiford L, Koutsouris G, Boyle C, et al. : The structures and processes governing education research in the UK from 1990–2020: A systematic scoping review. Rev. Educ. 2021;9(3). 10.1002/rev3.3298 [DOI] [Google Scholar]
  • 41. Slade SC, Philip K, Morris ME: Frameworks for embedding a research culture in allied health practice: a rapid review. Health Res. Policy Syst. 2018;16(1):29. 10.1186/s12961-018-0304-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Allen J, Smith JL, Ransdell LB: Missing or seizing the opportunity? The effect of an opportunity hire on job offers to science faculty candidates. Equal Diversity Incl. 2019b;38(2):160–177. 10.1108/EDI-09-2017-0201 [DOI] [Google Scholar]
  • 43. Blackburn H: The Status of Women in STEM in Higher Education: A Review of the Literature 2007–2017. Sci. Technol. Libr. 2017;36(3):235–273. 10.1080/0194262X.2017.1371658 [DOI] [Google Scholar]
  • 44. Teperek M, Cruz M, Kingsley D: Time to re-think the divide between academic and support staff. Nature. 2022. 10.1038/d41586-022-01081-8 [DOI] [PubMed] [Google Scholar]
  • 45. Hall R: Are PhDs just cheap labour for universities?; PhD grads complain that there are too few academic jobs. Should universities support their postgrads into alternative careers? The Guardian (London). 2019 01/04/2019. [Google Scholar]
  • 46. Anon: Integrity starts with the health of research groups. Nature. 2017;545(7652):5–6. 10.1038/545005b [DOI] [PubMed] [Google Scholar]
  • 47. Anon: COVID is disrupting scientific careers around the world. Nature. 2021;599:179. 10.1038/d41586-021-03049-6 [DOI] [PubMed] [Google Scholar]
  • 48. Christian K, Johnstone C, Larkins JA, et al. : A survey of early-career researchers in Australia. elife. 2021;10(01):11. 10.7554/eLife.60613 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Creaton J: Addressing the mental health crisis. Nat. Rev. Cancer. 2021;21(1):1–2. 10.1038/s41568-020-00319-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Allen K, Donoghue G, Hattie J, et al. : Journal papers, grants, jobs … as rejections pile up, it’s not enough to tell academics to ‘suck it up’. The Conversation. 2021. Reference Source [Google Scholar]
  • 51. Grove J: Research intelligence: big ideas to improve research culture. The Times Higher Education Supplement. 2021. [Google Scholar]
  • 52. Grove J: Do national research assessment exercises still pass peer review? The Times Higher Education Supplement. 2021. 02/09/2021. [Google Scholar]
  • 53. Mrva-Montoya A, Luca E: Book publishing sidelined in the game of university measurement and rankings. The Conversation. 2021. Reference Source [Google Scholar]
  • 54. Cassuto L: The Grief of the Ex-Academic. Chron. High. Educ. 2018 25/02/2018. [Google Scholar]
  • 55. Afonja S, Salmon DG, Quailey SI, et al. : Postdocs’ advice on pursuing a research career in academia: A qualitative analysis of free-text survey responses. PLoS One. 2021;16(5 May):e0250662. 10.1371/journal.pone.0250662 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Ahmed T, Johnson J, Latif Z, et al. : MyNRMN: A national mentoring and networking platform to enhance connectivity and diversity in the biomedical sciences. Faseb Bioadvances. 2021;3(7):497–509. 10.1096/fba.2020-00102 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Barnes N, Plessis M, Frantz J: Institutional culture and academic career progression: Perceptions and experiences of academic staff. SA J. Ind. Psychol. 2021;47:47. 10.4102/sajip.v47i0.1878 [DOI] [Google Scholar]
  • 58. Herde V, Björnmalm M, Susi T: Game over: Empower early career researchers to improve research quality. Insights UKSG J. 2021;34:1–6. 10.1629/uksg.548 [DOI] [Google Scholar]
  • 59. Finkel A: To move research from quantity to quality, go beyond good intentions. Nature. 2019;566(297):297. 10.1038/d41586-019-00613-z [DOI] [PubMed] [Google Scholar]
  • 60. Gibson C, Stutchbury T, Ikutegbe V, et al. : Challenge-Led Interdisciplinary Research in Practice: Program Design, Early Career Research, and a Dialogic Approach to Building Unlikely Collaborations. Res. Eval. 2019;28(1):51–62. 10.1093/reseval/rvy039 [DOI] [Google Scholar]
  • 61. Griffith EE, Dasgupta N: How the demographic composition of academic science and engineering departments influences workplace culture, faculty experience, and retention risk. Soc. Sci. 2018;7(5). 10.3390/socsci7050071 [DOI] [Google Scholar]
  • 62. Jung J, Horta H, Zhang LF, et al. : Factors fostering and hindering research collaboration with doctoral students among academics in Hong Kong. High. Educ. 2021;82:519–540. 10.1007/s10734-020-00664-6 [DOI] [Google Scholar]
  • 63. Maxwell TW, Chophel D: The impact and outcomes of (non-education) doctorates: the case of an emerging Bhutan. High. Educ. 2020;80(6):1081–1102. 10.1007/s10734-020-00531-4 [DOI] [Google Scholar]
  • 64. Mendez S, Tygret JA, Conley VM, et al. : Exploring the mentoring needs of early- And mid-career URM engineering faculty: A phenomenological study. Qual. Rep. 2020;25(4):891–908. [Google Scholar]
  • 65. Owusu F, Kalipeni E, Awortwi N, et al. : Building research capacity for African institutions: confronting the research leadership gap and lessons from African research leaders. Int. J. Leadersh. Educ. 2017;20(2):220–245. 10.1080/13603124.2015.1046497 [DOI] [Google Scholar]
  • 66. Panina SV, Arkhipova SN, Parnikova TA, et al. : Student Career Choices before and during Quarantine Measures. Propositos Y Representaciones. 2020;8:8. 10.20511/pyr2020.v8nSPE3.711 [DOI] [Google Scholar]
  • 67. Ransdell LB, Lane TS, Schwartz AL, et al. : Mentoring new and early-stage investigators and underrepresented minority faculty for research success in health-related fields: An integrative literature review (2010-2020). Int. J. Environ. Res. Public Health. 2021;18(2):1–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68. Santos P, Patrício MT: Academic culture in doctoral education: Are companies making a difference in the experiences and practices of doctoral students in Portugal? Int J Doctoral Studies. 2020;15:685–704. 10.28945/4665 [DOI] [Google Scholar]
  • 69. Shelton DS, Delgado MM, Greenway EVG, et al. : Expanding the Landscape of Opportunity: Professional Societies Support Early-Career Researchers Through Community Programming and Peer Coaching. J. Comp. Psychol. 2021;135(4):439–449. 10.1037/com0000300 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70. Termini CM, Hinton AO, Jr, Garza-López E, et al. : Building Diverse Mentoring Networks that Transcend Boundaries in Cancer Research. Trends Cancer. 2021;7(5):385–388. 10.1016/j.trecan.2021.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71. Ullah S, Arabia DHA, Mansoor SN, et al. : Beyond publish or perish: Promoting quality and increasing standards in medical research and writing. J. Pak. Med. Assoc. 2018;68(5):823–824. [PubMed] [Google Scholar]
  • 72. Aldercotte A, Guyan K, Lawson J, et al. : ASSET 2016: Experiences of gender equality in STEMM academia and their intersections with ethnicity, sexual orientation, disability and age. 2017.
  • 73. Anon: Workshop on ‘Perspective of Manipuri Culture’ to promote quality research. India: Imphal Free Press;2021c 21/01/2021. [Google Scholar]
  • 74. Clynes M, Corbett A, Overbaugh J: Why we need good mentoring. Nat. Rev. Cancer. 2019;19(9):489–493. 10.1038/s41568-019-0173-1 [DOI] [PubMed] [Google Scholar]
  • 75. Gopalakrishna G: Preprint advocates must also fight for research integrity. Nature. 2021. 10.1038/d41586-021-02481-y [DOI] [PubMed] [Google Scholar]
  • 76. Gould J: Kindness alone won’t improve the research culture. Nature. 2020. Podcast. 10.1038/d41586-020-03110-w [DOI] [Google Scholar]
  • 77. Gould J: The career costs of COVID-19: how postdocs and PhD students are paying the price. Nature. 2020. Podcast. 10.1038/d41586-020-03108-4 Reference Source [DOI] [Google Scholar]
  • 78. Guccione K: Aren’t they all leaving anyway? What’s the value of mentoring early career research staff? 2018.
  • 79. Gunsalus CK, Robinson AD: Nine pitfalls of research misconduct. Nature. 2018;557(7705):297–299. 10.1038/d41586-018-05145-6 [DOI] [PubMed] [Google Scholar]
  • 80. Mejlgaard N, Bouter LM, Gaskell G, et al. : Research integrity: nine ways to move from talk to walk. Nature. 2020;586(7829):358–360. 10.1038/d41586-020-02847-8 [DOI] [PubMed] [Google Scholar]
  • 81. McKinsey & Company: Bridging the challenge gap in Denmark. 2018.
  • 82. Moreau M, Bernard T: Carers and Careers in Higher Education: What works? AdvanceHE. 2018. Reference Source [Google Scholar]
  • 83. Sample I: Researchers facing ‘shocking’ levels of stress, survey reveals; Nearly two thirds of those who took part had witnessed bullying or harassment. The Guardian (London). 2020 15/01/2020. [Google Scholar]
  • 84. Thomson R: How we can turn the tide for women in science. The Conversation. 2018. Reference Source [Google Scholar]
  • 85. Wells B: University holds special academic meeting. The Marquette tribune. Marquette University;2021 04/05/2021. [Google Scholar]
  • 86. Yelken Y: The Aditi Leadership Programme: Developing the potential of Black, Asian and Minority Ethnic Leaders. Advance HE;2018. [Google Scholar]
  • 87. Jones R, Wilsdon J: The Biomedical Bubble: Why UK research and innovation needs a greater diversity of priorities, politics, places and people. 2018.
  • 88. Mejilgaard N, Bouter LM, Gaskell G, et al. : Research integrity: nine ways to move from talk to walk. Nature. 2020;586:358–360. 10.1038/d41586-020-02847-8 [DOI] [PubMed] [Google Scholar]
  • 89. Neff EP: On the past, present, and future of in vivo science. Lab Anim. 2021;50(10):273–276. 10.1038/s41684-021-00848-2 [DOI] [PubMed] [Google Scholar]
  • 90. Norris D, Dirnagl U, Zigmond MJ, et al. : Health tips for research groups. Nature Publishing Group;2018. [DOI] [PubMed] [Google Scholar]
  • 91. Powell K: Should we steer clear of the winner-takes-all approach? Nature. 2018;553(7688):367–369. 10.1038/d41586-018-00482-y [DOI] [PubMed] [Google Scholar]
  • 92. Sibai O, Figueirdo B, Ferreira MC: Overworked and isolated: the rising epidemic of loneliness in academia. The Conversation. 2019. Reference Source [Google Scholar]
  • 93. Van Noorden R: Some hard numbers on science’s leadership problems. Nature. 2018;557:294–296. 10.1038/d41586-018-05143-8 [DOI] [PubMed] [Google Scholar]
  • 94. Woolston C: Feeling overwhelmed by academia? You are not alone. Nature. 2018;557:129–131. 10.1038/d41586-018-04998-1 [DOI] [Google Scholar]
  • 95. Anon: Research institutions must put the health of labs first. Nature. 2018;557:279–280. 10.1038/d41586-018-05159-0 [DOI] [PubMed] [Google Scholar]
  • 96. Han X, Appelbaum RP: China’s science, technology, engineering, and mathematics (STEM) research environment: A snapshot. PLoS One. 2018;13(4). 10.1371/journal.pone.0195347 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97. Hartvigson L, Heshmati A: Sustainability of Cooperation in the International Development of African Higher Education. Scan. J. Educ. Res. 2022;67:489–503. 10.1080/00313831.2022.2042729 [DOI] [Google Scholar]
  • 98. Sheikh A, Malik A, Mahmood K: Research practices of LIS professionals in Pakistan: A study of attitudes, involvement and competencies. J. Inf. Sci. 2020;48:587–599. 10.1177/0165551520972033 [DOI] [Google Scholar]
  • 99. Burton MFZ, Cao XE: Navigating mental health challenges in graduate school. Nat. Rev. Mater. 2022;7(6):421–423. 10.1038/s41578-022-00444-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100. Derrick G: How COVID-19 lockdowns could lead to a kinder research culture. Nature. 2020;581:107–108. 10.1038/d41586-020-01144-8 [DOI] [PubMed] [Google Scholar]
  • 101. Gottlieb G, Smith S, Cole J, et al. : Realising Our Potential Backing Talent and Strengthening UK Research Culture and Environment. Russell Group;2021. [Google Scholar]
  • 102. Anon.: Research managers are essential to a healthy research culture. Nature. 2021;595(150):150. 10.1038/d41586-021-01823-0 [DOI] [PubMed] [Google Scholar]
  • 103. Azeem M, Mataruna L: Identifying factor measuring collective leadership at academic workplaces. Int. J. Educ. Manag. 2019;33(6):1316–1335. [Google Scholar]
  • 104. Chaplin K, Price D: 7 ways to promote better research culture. 2018.
  • 105. Halpern JB, Huber TE, Sinex SA, et al.: Building a Dynamic University-Community College Partnership: The Second Decade of a Broad, Mutually Beneficial Materials Science Collaboration. Materials Research Society;2018. [Google Scholar]
  • 106. Hammad W, Al-Ani W: Building Educational Research Capacity: Challenges and Opportunities From the Perspectives of Faculty Members at a National University in Oman. SAGE Open. 2021;11(3):215824402110326. 10.1177/21582440211032668 [DOI] [Google Scholar]
  • 107. Malotky MKH, Mayes KM, Price KM, et al. : Fostering Inclusion through an Interinstitutional, Community-Engaged, Course-Based Undergraduate Research Experience. J. Microbiol. Biol. Educ. 2020;21(1). 10.1128/jmbe.v21i1.1939 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108. McAllister M, Donna LB: ‘Pre-Run, Re-Run’: An innovative research capacity building exercise. Nurse Educ. Pract. 2017;27:144–150. 10.1016/j.nepr.2017.09.002 [DOI] [PubMed] [Google Scholar]
  • 109. Marín-Spiotta E: Harassment should count as scientific misconduct. Nature. 2018;557(7704):141. 10.1038/d41586-018-05076-2 [DOI] [PubMed] [Google Scholar]
  • 110. Russell S, Foulkes I: Embedding a positive research culture that fosters innovation. Nat. Rev. Cancer. 2019;19(5):241–242. 10.1038/s41568-019-0127-7 [DOI] [PubMed] [Google Scholar]
  • 111. Schiermeier Q: Data management made simple. Nature. 2018;555:403–405. 10.1038/d41586-018-03071-1 [DOI] [PubMed] [Google Scholar]
  • 112. Wellcome: esponsible conduct of research. 2022. Reference Source
  • 113. Winchester C: Give every paper a read for reproducibility. Nature. 2018;557(7706):281–282. 10.1038/d41586-018-05140-x [DOI] [PubMed] [Google Scholar]
  • 114. Woolston C: PhDs: the tortuous truth. Nature. 2019;575:403–406. 10.1038/d41586-019-03459-7 [DOI] [PubMed] [Google Scholar]
  • 115. Devi G, Sudan R, Freel S, et al. : 2305: Advancement of translational sciences: developement of an INTL! - erprofessional program and outcome measures for foundational, clinical, and health care researchers. J. Clin. Transl. Res. 2017;1:47. 10.1017/cts.2017.171 [DOI] [Google Scholar]
  • 116. Juvonen S, Nurkka P, Vakevainen K, editors. Experiences of cooperation between a higher education institution and industry and its impact on working culture 11th International Conference on Technology, Education and Development (INTED); 2017 2017 Mar 06-08; Valencia, SPAIN. 2017.
  • 117. Langhaug LF, Jack H, Hanlon C, et al. : “We need more big trees as well as the grass roots”: going beyond research capacity building to develop sustainable careers in mental health research in African countries. Int. J. Ment. Heal. Syst. 2020;14:1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118. Abe I, Mugobo V: Low research productivity: Transformation, institutional and leadership concern at a South African University. Perspect. Educ. 2021;39(2):113–127. 10.18820/2519593X/pie.v39.i2.9 [DOI] [Google Scholar]
  • 119. Lorenz-Meyer D: The Academic Productivist Regime: Affective Dynamics in the Moral-Political Economy of Publishing. Sci. Cult. 2018;27(2):151–174. 10.1080/09505431.2018.1455821 [DOI] [Google Scholar]
  • 120. Madia Lourenco LH, Baker BL, Dias Junior AG, et al. : Engaging local health research communities to enhance long-term capacity building in Brazil. BMJ Glob. Health. 2021;6(10):10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 121. Angelini D: Swindon consultant creates uni course to improve women’s confidence in male-dominated jobs. Swindon Advertiser. 2020 03/08/2020. [Google Scholar]
  • 122. Anon: How to grow a healthy lab. Nature. 2018;557:293. 10.1038/d41586-018-05142-9 [DOI] [PubMed] [Google Scholar]
  • 123. Dougherty S, Ecton W: How better funding can increase the number and diversity of doctoral students. The Conversation. 2021. Reference Source [Google Scholar]
  • 124. Grove J: India to train researchers in how to spot predatory journals. The Times Higher Education Supplement. 2020 23/01/2020. [Google Scholar]
  • 125. Christian K, Johnstone C, Larkins JA, et al. : Why have eight researcher women in STEMM left academic research, and where did they go? Int. J. Acad. Dev. 2021;28:31–44. 10.1080/1360144X.2021.1972304 [DOI] [Google Scholar]
  • 126. Dowey N, Barclay J, Fernando B, et al. : A UK perspective on tackling the geoscience racial diversity crisis in the Global North. Nat. Geosci. 2021;14(5):256–259. 10.1038/s41561-021-00737-w [DOI] [Google Scholar]
  • 127. Heng K, Hamid MO, Khan A: Research engagement of academics in the Global South: the case of Cambodian academics. Glob. Soc. Educ. 2022;21:322–337. 10.1080/14767724.2022.2040355 [DOI] [Google Scholar]
  • 128. Hishan SS, Ramakrishnan S, Mansor NNBA: Research engagement of foreign language teachers among select higher education institutions in Malaysia. Rupkatha J. Interdiscip. Stud. Humanit. 2020;12(1). 10.21659/rupkatha.v12n1.42 [DOI] [Google Scholar]
  • 129. Jessani NS, Valmeekanathan A, Babcock CM, et al. : Academic incentives for enhancing faculty engagement with decision-makers-considerations and recommendations from one School of Public Health. Humanit. Soc. Sci. Commun. 2020;7(1). 10.1057/s41599-020-00629-1 [DOI] [Google Scholar]
  • 130. Pauliuk S: Making sustainability science a cumulative effort. Nat. Sustain. 2020;3(1):2–4. 10.1038/s41893-019-0443-7 [DOI] [Google Scholar]
  • 131. Pownall M, Talbot CV, Henschel A, et al. : Navigating Open Science as Early Career Feminist Researchers. Psychol. Women Q. 2021;45(4):526–539. 10.1177/03616843211029255 [DOI] [Google Scholar]
  • 132. Universities New Zealand: Tauira Māori Initiatives – Sharing good practice in New Zealand universities. 2018.
  • 133. McGinn MK, Niemczyk EK: Team dynamics and learning opportunities in social science research teams. Alta. J. Educ. Res. 2020;66(4):364–386. [Google Scholar]
  • 134. Faure C, Munung NS, Ntusi NAB, et al. : Considering equity in global health collaborations: A qualitative study on experiences of equity. PLoS One. 2021;16(10 October):e0258286. 10.1371/journal.pone.0258286 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 135. Gong Y, MacPhail A, Young AM: Chinese higher education-based physical education teacher educators’ professional learning needs for involvement in research activities. Prof. Dev. Educ. 2021;1–17. 10.1080/19415257.2021.1895286 [DOI] [Google Scholar]
  • 136. Haja W: OC 8586 Institutional research capacity building for multi-disciplinary health research to support the health system rebuilding phase in sierra leone. BMJ Glob. Health. 2019;4(Suppl 3):A15.1–A1A15. 10.1136/bmjgh-2019-EDC.36 [DOI] [Google Scholar]
  • 137. Malekzadeh A, Michels K, Wolfman C, et al. : Strengthening research capacity in LMICs to address the global NCD burden. Glob. Health Action. 2020;13(1):1846904. 10.1080/16549716.2020.1846904 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 138. Muthama E, McKenna S: The unintended consequences of using direct incentives to drive the complex task of research dissemination. Educ. Change. 2020;24:1–23. [Google Scholar]
  • 139. Norman MK, Mayowski CA, Fine MJ: Authorship stories panel discussion: Fostering ethical authorship by cultivating a growth mindset. Account. Res. 2021;28(2):115–124. 10.1080/08989621.2020.1804374 [DOI] [PubMed] [Google Scholar]
  • 140. Oancea A, Fancourt N, Robson J, et al. : Research capacity-building in teacher education. Oxf. Rev. Educ. 2021;47(1):98–119. 10.1080/03054985.2020.1842184 [DOI] [Google Scholar]
  • 141. Uhlmann EL, Ebersole CR, Chartier CR, et al. : Scientific Utopia III: Crowdsourcing Science. Perspect. Psychol. Sci. 2019;14(5):711–733. 10.1177/1745691619850561 [DOI] [PubMed] [Google Scholar]
  • 142. Tregoning J: Will my popular science book bring any career benefits? The Times Higher Education Supplement. 2021 14/10/2021. [Google Scholar]
  • 143. Jager P, Lubbe I, Papageorgiou E: The South African chartered accountant academic: Motivations and challenges when pursuing a doctoral degree. Meditari. Account. Res. 2018;26(2):263–283. 10.1108/MEDAR-03-2017-0125 [DOI] [Google Scholar]
  • 144. Gaikwad P: Balancing research productivity and teaching by faculty in higher education: A case study in the philippines. J. High Educ. Theory Pract. 2021;21(7):181–192. [Google Scholar]
  • 145. Inga E, Inga J, Cárdenas J, et al. : Planning and strategic management of higher education considering the vision of latin america. Educ. Sci. 2021;11(4). 10.3390/educsci11040188 [DOI] [Google Scholar]
  • 146. Nhem D: Quality in higher education: what do students in Cambodia perceive? Tert. Educ. Manag. 2022;28(1):43–59. 10.1007/s11233-021-09084-2 [DOI] [Google Scholar]
  • 147. Wilson C, Hirtz M, Levkin PA, et al. : Facilitating an International Research Experience Focused on Applied Nanotechnology and Surface Chemistry for American Undergraduate Students Collaborating with Mentors at a German Educational and Research Institution. J. Chem. Educ. 2019;96(11):2441–2449. 10.1021/acs.jchemed.9b00146 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 148. Delbari S, Rajaipour S, Abedini Y: Investigating the relationship between career development and productivity with the mediating role of self-regulation among university staff. J. Appl. Res. High Edu. 2020;13(3):759–781. 10.1108/JARHE-06-2019-0153 [DOI] [Google Scholar]
  • 149. Babalola OO, Plessis Y, Babalola SS: Insight into the Organizational Culture and Challenges Faced by Women STEM Leaders in Africa. Soc. Sci. (Basel). 2021;10(3). 10.3390/socsci10030105 [DOI] [Google Scholar]
  • 150. Wolter I, Ehrtmann L, Seidel T, et al. : Social or Economic Goals? The Professional Goal Orientation of Students Enrolled in STEM and Non-STEM Majors in University. Front. Psychol. 2019;10. 10.3389/fpsyg.2019.02065 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 151. Davis D, Garbarino J, Bahia P, et al. : Recommendations for the Continued Professionalization of Science Outreach within the Scientific Enterprise (SciOut18). Figshare. 2020. [Google Scholar]
  • 152. Slovacek S, Miu V, Soto K, et al. : Supporting STEM in Higher Education. J. Int. Educ. Pract. 2019;7(4):438–449. 10.18488/journal.61.2019.74.438.449 [DOI] [Google Scholar]
  • 153. Bond M, Marín VI, Bedenlier S: International Collaboration in the Field of Educational Research: A Delphi Study. J. New Approaches Educ. Res. 2021;10(2):190–213. 10.7821/naer.2021.7.614 [DOI] [Google Scholar]
  • 154. Bishop DVM, Bates T, Loryman C, et al. : What can be done to improve research integrity?. The Times Higher Education Supplement. 2022 20/01/2022. [Google Scholar]
  • 155. Kwok R: How lab heads can learn to lead. Nature. 2018;557(7706):457–459. 10.1038/d41586-018-05156-3 [DOI] [PubMed] [Google Scholar]
  • 156. Saric J, Käser F, Lys JA, et al. : Synergising research and service activities at swiss research institutions to accelerate sustainable development. Sustainability. 2021;13(17). 10.3390/su13179626 [DOI] [Google Scholar]
  • 157. Way GP, Greene CS, Carninci P, et al. : A field guide to cultivating computational biology. PLoS Biol. 2021;19(10):e3001419. 10.1371/journal.pbio.3001419 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 158. Strinzel M, Brown J, Kaltenbrunner W, et al. : Ten ways to improve academic CVs for fairer research assessment. Hum. Soc. Sci. Comm. 2021;8(1):251. 10.1057/s41599-021-00929-0 [DOI] [Google Scholar]
  • 159. Stroobants K: You can help to create a new researcher-reward system. Nature. 2021. 10.1038/d41586-021-01208-3 [DOI] [PubMed] [Google Scholar]
  • 160. Grove J: Retirement planning: Do compulsory retirement ages benefit the academy? The Times Higher Education Supplement. 2018 13/12/2018. [Google Scholar]
  • 161. Hanson A, Bullers K, Howard AM, et al. : Using a Reflexive Process to Investigate Organizational Change: The Use of the Research Spider Matrix. Med. Ref. Serv. Q. 2019;38(4):312–325. 10.1080/02763869.2019.1657724 [DOI] [PubMed] [Google Scholar]
  • 162. Achmad S, Badu SQ, editors. Cultural Quality Revitalization Model in Strengthening The Higher Education Capacity Building ‘Good Learning Culture’. 1st Yogyakarta International Conference on Educational Management/Administration and Pedagogy (YICEMAP); 2017 2017 May 13; Yogyakarta, INDONESIA. 2017.
  • 163. Rowtho V, Gopee S, Hingun A: Doctoral boot camps: from military concept to andragogy. Educ. Train. 2020;62(4):379–392. 10.1108/ET-11-2018-0233 [DOI] [Google Scholar]
  • 164. Russell S, Foulkes I: Embedding a positive research culture that fosters innovation. Nat. Rev. Cancer. 2019;19(5):241–242. 10.1038/s41568-019-0127-7 [DOI] [PubMed] [Google Scholar]
  • 165. Allen C, Mehler DMA: Open science challenges, benefits and tips in early career and beyond. PLoS Biol. 2019;17(5). 10.1371/journal.pbio.3000246 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 166. Anon.: Not all scientists are raised equal. Nature. Astronomy. 2017;1(6):0167. 10.1038/s41550-017-0167 [DOI] [Google Scholar]
  • 167. Ballesteros-Rodríguez JL, De Saá-Pérez P, García-Carbonell N, et al. : The influence of team members’ motivation and leaders’ behaviour on scientific knowledge sharing in universities. Int. Rev. Adm. Sci. 2022;88(2):320–336. 10.1177/0020852320921220 [DOI] [Google Scholar]
  • 168. Fusulier B, Barbier P, Dubois-Shaik F: “Navigating” through a scientific career: A question of private and professional configurational supports. Eur. Educ. Res. J. 2017;16(2-3):352–372. 10.1177/1474904117691983 [DOI] [Google Scholar]
  • 169. Hinton A, Jr, Lambert WM: Moving diversity, equity, and inclusion from opinion to evidence. Cell Rep Med. 2022;3(4):100619. 10.1016/j.xcrm.2022.100619 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 170. Khalid S, Tadesse E: Faculty research productivity at women’s universities through the lens of preference theory. High. Educ. 2022;83(5):949–968. 10.1007/s10734-021-00717-4 [DOI] [Google Scholar]
  • 171. Hernandez R, Hoffmann-Longtin K, Patrick S, et al. : The Conscientious Use of Images Illustrating Diversity in Medical Education Marketing. Acad. Med. 2020;95(12):1807–1810. 10.1097/ACM.0000000000003503 [DOI] [PubMed] [Google Scholar]
  • 172. Hagan AK, Topçuoğlu BD, Gregory ME, et al. : Women are underrepresented and receive differential outcomes at asm journals: A six-year retrospective analysis. MBio. 2020;11(6):1–21. 10.1128/mBio.01680-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 173. Madzima TF, MacIntosh GC: Equity, diversity, and inclusion efforts in professional societies: intention versus reaction. Plant Cell. 2021;33(10):3189–3193. 10.1093/plcell/koab186 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 174. Marshall A, Pack AD, Owusu SA, et al. : Responding and navigating racialized microaggressions in STEM. Pathog Dis. 2021;79(5). 10.1093/femspd/ftab027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 175. Martinez LR, Boucaud DW, Casadevall A, et al. : Factors contributing to the success of NIH-designated underrepresented minorities in academic and nonacademic research positions. CBE Life Sci. Educ. 2018;17(2):ar32. 10.1187/cbe.16-09-0287 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 176. McGill BM, Foster MJ, Pruitt AN, et al. : You are welcome here: A practical guide to diversity, equity, and inclusion for undergraduates embarking on an ecological research experience. Ecol. Evol. 2021;11(8):3636–3645. 10.1002/ece3.7321 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 177. Mousa M: Academia is racist: Barriers women faculty face in academic public contexts. Higer Educ Q. 2021;76:741–758. 10.1111/hequ.12343 [DOI] [Google Scholar]
  • 178. Prasad A: Why are there still so few black scientists in the UK? The Observer (London). 2021 10/04/2021. [Google Scholar]
  • 179. Simpson JS, Giwa S, Denis VS: In times of racial injustice, university education should not be ‘neutral’. The Conversation. 2021. Reference Source [Google Scholar]
  • 180. Smith-Carrier TA, Benbow S, Lawlor A, et al. : “My only solution is to work later and sleep less”: exploring the perspectives of parenting in academia in Ontario, Canada. Equal Diversity Incl. 2021;40(8):930–946. 10.1108/EDI-12-2020-0357 [DOI] [Google Scholar]
  • 181. Zambas SI, Dutch S, Gerrard D: Factors influencing Maori student nurse retention and success: An integrative literature review. Nurse Educ. Today. 2020;91:104477. 10.1016/j.nedt.2020.104477 [DOI] [PubMed] [Google Scholar]
  • 182. Zhuwao S, Ngirande H, Ndlovu W, et al. : Gender diversity, ethnic diversity and employee performance in a South African higher education institution. SA J. Hum. Resour. Manag. 2019;17:17. 10.4102/sajhrm.v17i0.1061 [DOI] [Google Scholar]
  • 183. Mathieson C:2017. Reference Source
  • 184. Foxx AJ, Meléndez KPF, Hariharan J, et al. : Advancing equity and inclusion in microbiome research and training. mSystems. 2021;6(5):e0115121. 10.1128/mSystems.01151-21 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 185. Etzkorn KB, Braddock A: Are you my mentor? A study of faculty mentoring relationships in US higher education and the implications for tenure. Int. J. Mentor. Coach. Educ. 2020;9(3):221–237. 10.1108/IJMCE-08-2019-0083 [DOI] [Google Scholar]
  • 186. Callwood KAA, Weiss M, Hendricks R, et al. : Acknowledging and Supplanting White Supremacy Culture in Science Communication and STEM: The Role of Science Communication Trainers. Front. commun. 2022;7:7. 10.3389/fcomm.2022.787750 [DOI] [Google Scholar]
  • 187. Culpepper D, Reed AM, Enekwe B, et al. : A New Effort to Diversify Faculty: Postdoc-to-Tenure Track Conversion Models. Front. Psychol. 2021;12. 10.3389/fpsyg.2021.733995 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 188. Grahe JE, Cuccolo K, Leighton DC, et al. : Open Science Promotes Diverse, Just, and Sustainable Research and Educational Outcomes. Psychol. Learn. Teach. 2020;19(1):5–20. 10.1177/1475725719869164 [DOI] [Google Scholar]
  • 189. Gutierrez-Wu J, Lawrence C, Jamison S, et al. : An evaluation of programs designed to increase representation of diverse faculty at academic medical centers. J. Natl. Med. Assoc. 2022;114:278–289. 10.1016/j.jnma.2022.01.012 [DOI] [PubMed] [Google Scholar]
  • 190. Hagan AK, Pollet RM, Libertucci J: Suggestions for improving invited speaker diversity to reflect trainee diversity. J Microbiol Biol Educ. 2020;21(1). 10.1128/jmbe.v21i1.2105 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 191. Hoy KE, Fitzgibbon BM, Brem AK: Lessons from an initiative to address gender bias. elife. 2021;10(12):15. 10.7554/eLife.75818 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 192. Anon: Slate that disputes command of USP proposes body to take care of inclusion and diversity. CE Noticias Financieras English. 2021. 06/10/2021. [Google Scholar]
  • 193. Batty D, Davis N: Why science breeds a culture of sexism. The Guardian. 2018. Reference Source
  • 194. Binns C: How to make universities more inclusive? Hire more working-class academics. The Conversation. 2020. Reference Source [Google Scholar]
  • 195. Lambert WM, Wells MT, Cipriano MF, et al. : Research culture: Career choices of underrepresented and female postdocs in the biomedical sciences. elife. 2020;9:9. 10.7554/eLife.48774 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 196. Lee A: Toward a conceptual model of hierarchical microaggression in higher education settings: a literature review. Educ. Rev. 2022;74(2):321–352. 10.1080/00131911.2020.1793735 [DOI] [Google Scholar]
  • 197. Leišytė L, Deem R, Tzanakou C: Inclusive universities in a globalized world. Soc. Incl. 2021;9(3):1–5. 10.17645/si.v9i3.4632 [DOI] [Google Scholar]
  • 198. Mehta D, Bediako Y, Winde CM, et al. : Ways to increase equity, diversity and inclusion. elife. 2020;9(07):07. 10.7554/eLife.60438 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 199. O’Meara K, Nyunt G, Templeton L, et al. : Meeting to transgress The role of faculty learning communities in shaping more inclusive organizational cultures. Equal. Divers. Incl. 2019;38(3):286–304. 10.1108/EDI-09-2017-0184 [DOI] [Google Scholar]
  • 200. Picardi I: The glass door of academia: Unveiling new gendered bias in academic recruitment. Soc. Sci. 2019;8(5). 10.3390/socsci8050160 [DOI] [Google Scholar]
  • 201. Frketich J: McMaster vows to increase diversity among researchers. The Hamilton Spectator (Ontario, Canada). 2019 31/05/2019. [Google Scholar]
  • 202. Law SF, Croucher G: Most of Australia’s uni leaders are white, male and grey. This lack of diversity could be a handicap. The Conversation. 2020. Reference Source [Google Scholar]
  • 203. McIntyre A: Vice-chancellor marks one year at Leeds Trinity. Ilkley Gazette. 2021 02/11/2021. [Google Scholar]
  • 204. Stack M: Why I’m not surprised Nobel Laureate Donna Strickland isn’t a full professor. The Conversation. 2018. Reference Source [Google Scholar]
  • 205. Woolston: Satisfaction in science Nature. 2018;562(7728):611–614. [DOI] [PubMed] [Google Scholar]
  • 206. Farrugia G, Zorn CK, Williams AW, et al. : A Qualitative Analysis of Career Advice Given to Women Leaders in an Academic Medical Center. JAMA Netw. Open. 2020;3(7):e2011292. 10.1001/jamanetworkopen.2020.11292 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 207. Linková M: Academic excellence and gender bias in the practices and perceptions of scientists in leadership and decision-making positions. Gend Vyzk/Gend Res. 2017;18(1):42–66. 10.13060/25706578.2017.18.1.349 [DOI] [Google Scholar]
  • 208. Noble CE, Amey MJ, Colon LA, et al. : Building a Networked Improvement Community: Lessons in Organizing to Promote Diversity, Equity, and Inclusion in Science, Technology, Engineering, and Mathematics. Front. Psychol. 2021;12. 10.3389/fpsyg.2021.732347 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 209. Schipull EM, Quichocho XR, Close EW, editors. “Success Together”: Physics departmental practices supporting LGBTQ plus women and women of color. Physics Education Research (PER) Conference; 2019 2019 Jul 24-25; Provo, UT. 2019.
  • 210. Vega BE: “What Is the Real Belief on Campus?” Perceptions of Racial Conflict at a Minority-Serving Institution and a Historically White Institution. Teach. Coll. Rec. 2021;123(9):144–170. 10.1177/01614681211051997 [DOI] [Google Scholar]
  • 211. Huang CKK, Wilson K, Neylon C, et al. : Mapping open knowledge institutions: an exploratory analysis of Australian universities. PeerJ. 2021;9:e11391. 10.7717/peerj.11391 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 212. Susi T, Shalvi S, Srinivas M: ‘I’ll work on it over the weekend’: high workload and other pressures faced by early-career researchers. Nature. 2019. 10.1038/d41586-019-01914-z [DOI] [Google Scholar]
  • 213. Akbar A, Picard M: Academic integrity in the Muslim world: a conceptual map of challenges of culture. Int. J. Educ. Integr. 2020;16(1). 10.1007/s40979-020-00060-8 [DOI] [Google Scholar]
  • 214. Page T, Bull A, Chapman E: Making Power Visible: “Slow Activism” to Address Staff Sexual Misconduct in Higher Education. Violence Against Women. 2019;25(11):1309–1330. 10.1177/1077801219844606 [DOI] [PubMed] [Google Scholar]
  • 215. Cresiski RH, Ghent CA, Rutledge JC, et al. : Developing a State University System Model to Diversify Faculty in the Biomedical Sciences. Front. Psychol. 2022;13. 10.3389/fpsyg.2022.734145 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 216. Correa Vera YE, Montoya Monsalve JN, editors. Women’s Access to Research: Mexico. International Conference on Gender Research (ICGR); 2018 2018 Apr 12-13; ISCAP, P Porto, Porto, PORTUGAL. 2018.
  • 217. Chapman A: Using the assessment process to overcome Imposter Syndrome in mature students. J. Furth. High. Educ. 2017;41(2):112–119. 10.1080/0309877X.2015.1062851 [DOI] [Google Scholar]
  • 218. Lee JE, Sung JH, Sarpong D, et al. : Knowledge Management for Fostering Biostatistical Collaboration within a Research Network: The RTRN Case Study. Int. J. Environ. Res. Public Health. 2018;15(11):12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 219. Fox N: 142 Open Science: Improving Access and Reducing Bias in Science. J. Anim. Sci. 2021;99:75–76. 10.1093/jas/skab235.136 [DOI] [Google Scholar]
  • 220. Campbell-Whatley G, O’Brien C, Reddig K, et al. : Non-majority student perceptions of diversity and inclusion at a PWI and an HBCU. J. Multicult. Educ. 2021;15(3):253–269. 10.1108/JME-03-2021-0028 [DOI] [Google Scholar]
  • 221. Lundwall RA: Changing institutional incentives to foster sound scientific practices: One department. Infant Behav. Dev. 2019;55:69–76. 10.1016/j.infbeh.2019.03.006 [DOI] [PubMed] [Google Scholar]
  • 222. Sotomayor-Beltran C, Zarate Segura GW: Peruvian Scientific Production Affected by Predatory Journals. Int. Inf. Libr. Rev. 2022;54(1):32–38. 10.1080/10572317.2020.1869902 [DOI] [Google Scholar]
  • 223. Bothwell E: US research culture stuck in past, says cancer expert. The Times Higher Education Supplement. 2017 08/07/2017. [Google Scholar]
  • 224. Abeysiriwardana PC, Jayasinghe-Mudalige UK: Role of key performance indicators on agile transformation of performance management in research institutes towards innovative commercial agriculture. J. Sci. Technol. Policy Manage. 2021;13:213–243. 10.1108/JSTPM-10-2020-0151 [DOI] [Google Scholar]
  • 225. Adefuye AO, Coetzee L, Janse van Vuuren C, et al. : Medical Educators’ Perceptions of Research Culture in a Faculty of Health Sciences: A South African Study. Teach. Learn. Med. 2021;33(5):509–524. 10.1080/10401334.2020.1847653 [DOI] [PubMed] [Google Scholar]
  • 226. Franzen SRP, Chandler C, Lang T: Health research capacity development in low and middle income countries: Reality or rhetoric? A systematic meta-narrative review of the qualitative literature. BMJ Open. 2017;7(1):e012332. 10.1136/bmjopen-2016-012332 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 227. Hoffmann K, Berg S, Koufogiannakis D: Understanding factors that encourage research productivity for academic librarians. Evid. Based Libr. Inf. Pract. 2017;12(4):102–128. 10.18438/B8G66F [DOI] [Google Scholar]
  • 228. Köse MF, Korkmaz M: Why are some universities better? An evaluation in terms of organizational culture and academic performance. High. Educ. Res. Dev. 2019;38(6):1213–1226. 10.1080/07294360.2019.1634679 [DOI] [Google Scholar]
  • 229. Luqman MS, Rehman JU, Islam ZU, et al. : Effect of organizational climate upon the job performance of instructors’ physical education. Pedagogy Phys. Cult. Sports. 2020;24(2):72–76. 10.15561/26649837.2020.0204 [DOI] [Google Scholar]
  • 230. Mbeo MA, Rambe P, editors. Managing academic resistance to research of academics at a university of technology. 15th International Conference on Intellectual Capital, Knowledge Management and Organisational Learning, ICICKM 2018; Academic Conferences and Publishing International Limited. 2018.
  • 231. Olesen AP, Amin L, Mahadi Z: Malaysian researchers talk about the influence of culture on research misconduct in higher learning institutions. Accountability in Research-Policies and Quality Assurance. 2017;24(8):469–482. 10.1080/08989621.2017.1399358 [DOI] [PubMed] [Google Scholar]
  • 232. Papatsiba V, Cohen E: Institutional hierarchies and research impact: new academic currencies, capital and position-taking in UK higher education. Br. J. Sociol. Educ. 2020;41(2):178–196. 10.1080/01425692.2019.1676700 [DOI] [Google Scholar]
  • 233. Saplan DMM: An innovation to heighten research culture in selected colleges of nursing in Region IX, Philippines. Int. J. Innov. Creat Change. 2020;12(6):307–322. [Google Scholar]
  • 234. Shen W, Jiang J: Institutional prestige, academic supervision and research productivity of international PhD students: Evidence from Chinese returnees. J. Sociol. 2021;59:552–579. 10.1177/14407833211055225 [DOI] [Google Scholar]
  • 235. Suson RL, Capuno R, Manalastas R, et al. : Educational research productivity road map: Conclusions from the identified research barriers and variables. Cypriot J. Educ. Sci. 2020;15(5):1160–1175. 10.18844/cjes.v15i5.5162 [DOI] [Google Scholar]
  • 236. Vachon B, Curran JA, Karunananthan S, et al. : Changing research culture toward more use of replication research: a narrative review of barriers and strategies. J. Clin. Epidemiol. 2021;129:21–30. 10.1016/j.jclinepi.2020.09.027 [DOI] [PubMed] [Google Scholar]
  • 237. Vuong QH, Napier NK, Ho TM, et al. : Effects of work environment and collaboration on research productivity in Vietnamese social sciences: evidence from 2008 to 2017 scopus data. Stud. High. Educ. 2019;44(12):2132–2147. 10.1080/03075079.2018.1479845 [DOI] [Google Scholar]
  • 238. Matthews D: Research funders urge caution over demanding ‘excellence’. The Times Higher Education Supplement. 2020 23/07/2020. [Google Scholar]
  • 239. Warren C: ‘Professors eat their own young’: how competition can stifle good science. The Guardian. 2018. [Google Scholar]
  • 240. Bishop DVM: The psychology of experimental psychologists: Overcoming cognitive constraints to improve research: The 47th Sir Frederic Bartlett Lecture. Q. J. Exp. Psychol. 2020;73(1):1–19. 10.1177/1747021819886519 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 241. Chandler N, Heidrich B, Kasa R: Everything changes? A repeated cross-sectional study of organisational culture in the public sector. Evidence-Based Hrm-a Global Forum for Empirical Scholarship. 2017;5(3):283–296. 10.1108/EBHRM-03-2017-0018 [DOI] [Google Scholar]
  • 242. Henry C, Md Ghani NA, Hamid UMA, et al. : Factors contributing towards research productivity in higher education. Int. J. Eval. Res. Educ. 2020;9(1):203–211. 10.11591/ijere.v9i1.20420 [DOI] [Google Scholar]
  • 243. Waters AM, LeBeau RT, Young KS, et al. : Towards the enhancement of quality publication practices in clinical psychological science. Behav. Res. Ther. 2020;124:103499. 10.1016/j.brat.2019.103499 [DOI] [PubMed] [Google Scholar]
  • 244. Heuritsch J: Towards a democratic university: A call for reflexive evaluation and a participative culture. 2021b.
  • 245. Kouper I, Raymond AH, Giroux S: An Exploratory Study of Research Data Governance in the U.S. Open Inf. Sci. 2020;4(1):122–142. [Google Scholar]
  • 246. Ajjawi R, Crampton PES, Rees CE: What really matters for successful research environments? A realist synthesis. Med. Educ. 2018;52(9):936–950. 10.1111/medu.13643 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 247. Chuanfu C, Qiushi L: Library Development in an Open Society. J. Lib. Sci. China. 2020;46(1):16–37. [Google Scholar]
  • 248. Sarabipour S: Virtual conferences raise standards for accessibility and interactions. elife. 2020;9(11):04. 10.7554/eLife.62668 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 249. Adetayo AJ: The Nexus of Social Media Use and Research Productivity of Lecturers in Private Universities in Ogun State, Nigeria. Libr. Philos. Pract. 2021;2021:1–14. [Google Scholar]
  • 250. Causadias JM, Korous KM, Cahill KM, et al. : The Importance of Research About Research on Culture: A Call for Meta-research on Culture. Cult. Divers. Ethn. Minor. Psychol. 2021. [DOI] [PubMed] [Google Scholar]
  • 251. Palotie P, Nurkka P, Juvonen S, editors. The quality matters - the experiences of a project manager training 10th Annual International Conference of Education, Research and Innovation (ICERI); 2017 2017 Nov 16-18; Seville, SPAIN. 2017.
  • 252. Varma S: Why learn business ethics?-Students’ conceptions of the use and exchange value of applied business ethics. Asian J. Bus. Ethics. 2019;8(1):107–125. 10.1007/s13520-019-00090-7 [DOI] [Google Scholar]
  • 253. Crewe R, Gevers W: How to approach the revolution in scholarly publishing. The Conversation. 2019. Reference Source [Google Scholar]
  • 254. Curry S: It’s time for academics to take back control of research journals. The Guardian. 2017. [Google Scholar]
  • 255. Fyfe A, Coate K, Curry S: Untangling academic publishing: A history of the relationship between commercial interests, academic prestige and the circulation of research. Zendo. 2017. [Google Scholar]
  • 256. Heuritsch J: Reflexive Behaviour: How publication pressure affects research quality in Astronomy. 2021.
  • 257. Kirchherr J: Why we can’t trust academic journals to tell the scientific truth. The Guardian. 2017. [Google Scholar]
  • 258. Leyser O, Kingsley D, Grange J: The science ‘reproducibility crisis’ – and what can be done about it. The Conversation. 2017. Reference Source [Google Scholar]
  • 259. Heng K, Hamid MO, Khan A: Factors influencing academics’ research engagement and productivity: A developing countries perspective. Issues Educ. Res. 2020;30(3):965–987. [Google Scholar]
  • 260. Gonzalez-Diaz R, Acevedo-Duque Á, Martin-Fiorino V, et al. : Latin American professors’ research culture in the digital age. Comunicar. 2022;30(70):71–83. 10.3916/C70-2022-06 [DOI] [Google Scholar]
  • 261. Lourdes ESL, Frontera WR, Huertas A: 4143 HiREC Endowment: Building Models in Research Capacity for Infrastructure Sustainability and Productivity. J. Clin. Transl. Sci. 2020;4(s1):62–63. 10.1017/cts.2020.214 [DOI] [Google Scholar]
  • 262. Roesdiono E, Saptandari PEP, Suminar DR: Employee retention at ‘Precious’ English language course in Surabaya. Masyarakat Kebudayaan Dan Politik. 2019;32(1):95–104. 10.20473/mkp.V32I12019.95-104 [DOI] [Google Scholar]
  • 263. Robson SG, Baum MA, Beaudry JL, et al. : Promoting open science: A holistic approach to changing behaviour. Collabra Phychol. 2021;7(1). 10.1525/collabra.30137 [DOI] [Google Scholar]
  • 264. Munafò MR, Chambers C, Collins A, et al. : The reproducibility debate is an opportunity, not a crisis. BMC. Res. Notes. 2022;15(1):43. 10.1186/s13104-022-05942-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 265. Anon.: Psychology accused of ‘collective self-deception’ over results. The Times Higher Educations Supplement. 2019 12/12/2019. [Google Scholar]
  • 266. Dominik M, Nzweundji JG, Ahmed N, et al. : Open Science-For Whom? Data Sci. J. 2022;21(1). 10.5334/dsj-2022-001 [DOI] [Google Scholar]
  • 267. Edelmann N, Schoßböck J: Open access perceptions, strategies, and digital literacies: A case study of a scholarly-led journal. Publ. 2020;8(3). 10.3390/publications8030044 [DOI] [Google Scholar]
  • 268. Garcia-Guerrero M, Ramirez-Montoya MS, Garcia-Penalvo FJ, editors. Towards an Open Science technological ecosystem for a Mexican University. 8th International Conference on Technological Ecosystems for Enhancing Multiculturality, TEEM 2020, October 21, 2020 - October 23, 2020; 2020; Virtual, Online, Spain: Association for Computing Machinery.
  • 269. Gold ER, Ali-Khan SE, Allen L, et al. : An open toolkit for tracking open science partnership implementation and impact [version 2; peer review: 2 approved]. Gates Open Res. 2019;3:1442. 10.12688/gatesopenres.12958.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 270. Hammatt Z: Spotlight on research integrity: international insights on strengthening research culture in the forensic sciences and beyond. Forensic Sci. Res. 2021;6(4):281–282. 10.1080/20961790.2021.2015114 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 271. Hatch A, Curry S: Changing how we evaluate research is difficult, but not impossible. elife. 2020;9(08):12. 10.7554/eLife.58654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 272. Koroshetz WJ, Behrman S, Brame CJ, et al. : Framework for advancing rigorous research. elife. 2020;9:9. 10.7554/eLife.55915 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 273. Koterwas A, Dwojak-Matras A, Kalinowska K: Dialogical teaching of research integrity: an overview of selected methods. Facet. 2021;6:2138–2154. 10.1139/facets-2021-0045 [DOI] [Google Scholar]
  • 274. Ma L: Money, morale, and motivation: A study of the Output-Based Research Support Scheme in University College Dublin. Res. Eval. 2019;28(4):304–312. 10.1093/reseval/rvz017 [DOI] [Google Scholar]
  • 275. Marques M, Powell JJW, Zapp M, et al. : How does research evaluation impact educational research? Exploring intended and unintended consequences of research assessment in the United Kingdom, 1986–2014. Eur. Educ. Res. J. 2017;16(6):820–842. 10.1177/1474904117730159 [DOI] [Google Scholar]
  • 276. Mebane CA, Sumpter JP, Fairbrother A, et al. : Scientific integrity issues in Environmental Toxicology and Chemistry: Improving research reproducibility, credibility, and transparency. Integr. Environ. Assess. Manag. 2019;15(3):320–344. 10.1002/ieam.4119 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 277. Severin A, Egger M, Eve MP, et al. : Discipline-specific open access publishing practices and barriers to change: an evidence-based review. F1000Res. 2018;7:1925. 10.12688/f1000research.17328.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 278. Stracke CM: Open Science and Radical Solutions for Diversity, Equity and Quality in Research: A Literature Review of Different Research Schools, Philosophies and Frameworks and Their Potential Impact on Science and Education.Lecture Notes in Educational Technology: Springer.2020; pp.17–37.
  • 279. Tecwyn EC: Doing reliable research in comparative psychology: Challenges and proposals for improvement. J. Comp. Psychol. 2021;135(3):291–301. 10.1037/com0000291 [DOI] [PubMed] [Google Scholar]
  • 280. Williams M, Mullane K, Curtis MJ: Addressing Reproducibility: Peer Review, Impact Factors, Checklists, Guidelines, and Reproducibility Initiatives. Research in the Biomedical Sciences: Transparent and Reproducible: Elsevier. 2018;197–306. 10.1016/B978-0-12-804725-5.00005-7 [DOI] [Google Scholar]
  • 281. Woolston C: Australian junior scientists report damaging lack of support at work. Nature. 2020;579:457–458. 10.1038/d41586-020-00687-0 [DOI] [PubMed] [Google Scholar]
  • 282. Abbott LE, Andes A, Pattani AC, et al. : Authorship Not Taught and Not Caught in Undergraduate Research Experiences at a Research University. Sci. Eng. Ethics. 2020;26(5):2555–2599. 10.1007/s11948-020-00220-6 [DOI] [PubMed] [Google Scholar]
  • 283. Baker S: Managers who ‘fetishise’ certain journals warp incentive culture. The Times Higher Education Supplement. 2019 14/11/2019. [Google Scholar]
  • 284. Banks GC, Field JG, Oswald FL, et al. : Answers to 18 Questions About Open Science Practices. J. Bus. Psychol. 2019;34(3):257–270. 10.1007/s10869-018-9547-8 [DOI] [Google Scholar]
  • 285. Baskin P: Top-tier US universities push for open science. Times. High. Educ. 2022 20/04/2022. [Google Scholar]
  • 286. Bonn NA, Pinxten W: Rethinking success, integrity, and culture in research (part 2) - a multi-actor qualitative study on problems of science. Research Integrity and Peer Review. 2021;6(1). 10.1186/s41073-020-00105-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 287. Bornmann L, Guns R, Thelwall M, et al. : Which aspects of the open science agenda are most relevant to scientometric research and publishing? An opinion paper. Quantitative Sci Stud. 2021;2(2):438–453. 10.1162/qss_e_00121 [DOI] [Google Scholar]
  • 288. Center for Open Science: Effort to repeat key cancer biology experiments reveals challenges and opportunities to improve replicability. The Breeze: James Madison University;2021 07/12/2021. [Google Scholar]
  • 289. Gersten P: EPA Transparency Rule Will Bolster Science and Improve Rulemaking. Competitive Enterprise Institute;2018 16/07/2018. [Google Scholar]
  • 290. Miguel E: Evidence on research transparency in economics. J. Econ. Perspect. 2021;35(3):193–214. 10.1257/jep.35.3.193 [DOI] [Google Scholar]
  • 291. Mullard A: Half of top cancer studies fail high-profile reproducibility effort. Nature. 2021;600:368–369. 10.1038/d41586-021-03691-0 [DOI] [PubMed] [Google Scholar]
  • 292. Stall S, Yarmey L, Cutcher-Gershenfeld J, et al. : Make scientific data FAIR. Nature. 2019;570:27–29. 10.1038/d41586-019-01720-7 [DOI] [PubMed] [Google Scholar]
  • 293. Tegbaru D, Braverman L, Zietman AL, et al. : ASTRO Journals’ Data Sharing Policy and Recommended Best Practices. Adv. Radiat. Oncol. 2019;4(4):551–558. 10.1016/j.adro.2019.08.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 294. Zuiderwijk A, Shinde R, Jeng W: What drives and inhibits researchers to share and use open research data? A systematic literature review to analyze factors influencing open research data adoption. PLoS One. 2020;15(9 September):e0239283. 10.1371/journal.pone.0239283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 295. Cumyn A, Ouellet K, Côté AM, et al. : Role of Researchers in the Ethical Conduct of Research: A Discourse Analysis From Different Stakeholder Perspectives. Ethics Behav. 2019;29(8):621–636. 10.1080/10508422.2018.1539671 [DOI] [Google Scholar]
  • 296. Feng GC: Research Performance Evaluation in China: A Big Data Analysis. SAGE Open. 2020;10(1):215824401990125. 10.1177/2158244019901257 [DOI] [Google Scholar]
  • 297. Labib K, Roje R, Bouter L, et al. : Important Topics for Fostering Research Integrity by Research Performing and Research Funding Organizations: A Delphi Consensus Study. Sci. Eng. Ethics. 2021;27(4):47. 10.1007/s11948-021-00322-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 298. Martin-Sardesai A, Guthrie J, Tooley S, et al. : History of research performance measurement systems in the Australian higher education sector. Account. Hist. 2019;24(1):40–61. 10.1177/1032373218768559 [DOI] [Google Scholar]
  • 299. Suls J, Rothman AJ, Davidson KW: Now Is the Time to Assess the Effects of Open Science Practices With Randomized Control Trials. Am. Psychol. 2021;1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 300. Flake JK: Strengthening the foundation of educational psychology by integrating construct validation into open science reform. Educ. Psychol. 2021;56(2):132–141. 10.1080/00461520.2021.1898962 [DOI] [Google Scholar]
  • 301. Holst MR, Faust A, Strech D: Do German university medical centres promote robust and transparent research? A cross-sectional study of institutional policies. Health Res. Policy Syst. 2022;20(1):39. 10.1186/s12961-022-00841-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 302. Horn L: Promoting Responsible Research Conduct: A South African Perspective. J. Acad. Ethics. 2017;15(1):59–72. 10.1007/s10805-016-9272-8 [DOI] [Google Scholar]
  • 303. Moher D, Naudet F, Cristea IA, et al. : Assessing scientists for hiring, promotion, and tenure. PLoS Biol. 2018;16(3):e2004089. 10.1371/journal.pbio.2004089 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 304. Paxton A, Tullett A: Open Science in Data-Intensive Psychology and Cognitive Science. Policy Insights Behav. Brain Sci. 2019;6(1):47–55. 10.1177/2372732218790283 [DOI] [Google Scholar]
  • 305. Satalkar P, Perneger T, Shaw D: Accommodating an Uninvited Guest: Perspectives of Researchers in Switzerland on ‘Honorary’ Authorship. Sci. Eng. Ethics. 2020;26(2):947–967. 10.1007/s11948-019-00162-8 [DOI] [PubMed] [Google Scholar]
  • 306. Ščepanović R, Labib K, Buljan I, et al. : Practices for Research Integrity Promotion in Research Performing Organisations and Research Funding Organisations: A Scoping Review. Sci. Eng. Ethics. 2021;27(1):4. 10.1007/s11948-021-00281-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 307. Schmidt R, Curry S, Hatch A: Creating SPACE to evolve academic assessment. elife. 2021;10(09):23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 308. Schroter S, Montagni I, Loder E, et al. : Awareness, usage and perceptions of authorship guidelines: An international survey of biomedical authors. BMJ Open. 2020;10(9):e036899. 10.1136/bmjopen-2020-036899 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 309. Stremersch S, Winer RS, Camacho N: Faculty Research Incentives and Business School Health: A New Perspective from and for Marketing. J. Mark. 2021;85(5):1–21. 10.1177/00222429211001050 [DOI] [Google Scholar]
  • 310. Li D, Li Y: Masked Resistance in Neoliberal Academia: Academics’ Responses to the Research Assessment Exercise 2020 in Hong Kong. High Educ. Pol. 2021;36:270–288. 10.1057/s41307-021-00255-9 [DOI] [Google Scholar]
  • 311. Chubb J, Cowling P, Reed D: Speeding up to keep up: exploring the use of AI in the research process. AI Soc. 2021;37:1439–1457. 10.1007/s00146-021-01259-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 312. Curtis GJ, Slade C, Bretag T, et al. : Developing and evaluating nationwide expert-delivered academic integrity workshops for the higher education sector in Australia. High. Educ. Res. Dev. 2021;41:665–680. 10.1080/07294360.2021.1872057 [DOI] [Google Scholar]
  • 313. Fussy DS: The hurdles to fostering research in Tanzanian universities. High. Educ. 2019;77(2):283–299. 10.1007/s10734-018-0276-8 [DOI] [Google Scholar]
  • 314. Helgesson G, Bülow W: Research Integrity and Hidden Value Conflicts. J. Acad. Ethics. 2021;21:113–123. 10.1007/s10805-021-09442-0 [DOI] [Google Scholar]
  • 315. Munafò MR, Nosek BA, Bishop DVM, et al. : A manifesto for reproducible science. Nat. Hum. Behav. 2017;1(1). 10.1038/s41562-016-0021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 316. Aleman-Juarez A, Becerra-Mariscal AE, Garcia-Higuera MC, editors. Revista de intergridad academica: An effort to foster academic integrity in Universidad Panamericana 10th International Conference on Education and New Learning Technologies (EDULEARN); 2018 2018 Jul 02-04; Palma, SPAIN. 2018.
  • 317. Antes AL, Kuykendall A, DuBois JM: The lab management practices of “Research Exemplars” that foster research rigor and regulatory compliance: A qualitative study of successful principal investigators. PLoS One. 2019;14(4):e0214595. 10.1371/journal.pone.0214595 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 318. Brunt MW, Weary DM: Perceptions of laboratory animal facility managers regarding institutional transparency. PLoS One. 2021;16(7):e0254279. 10.1371/journal.pone.0254279 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 319. Elliott KC, Resnik DB: Making open science work for science and society. Environ. Health Perspect. 2019;127(7):75002. 10.1289/EHP4808 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 320. Gallagher RV, Falster DS, Maitner BS, et al. : Open Science principles for accelerating trait-based science across the Tree of Life. Nat. Ecol. Evol. 2020;4(3):294–303. 10.1038/s41559-020-1109-6 [DOI] [PubMed] [Google Scholar]
  • 321. Kraft-Todd GT, Rand DG: Practice what you preach: Credibility-enhancing displays and the growth of open science. Organ. Behav. Hum. Decis. Process. 2021;164:1–10. 10.1016/j.obhdp.2020.10.009 [DOI] [Google Scholar]
  • 322. Mullane K, Curtis MJ, Williams M: Biomedical Research in the 21st Century: Multiple Challenges in Resolving Reproducibility Issues. Research in the Biomedical Sciences: Transparent and Reproducible. Elsevier;2018;307–353. [Google Scholar]
  • 323. Ofori G: Professionalism in built environment research: beyond integrity and good practice. Eng. Constr. Archit. Manag. 2021;29:3617–3646. 10.1108/ECAM-02-2020-0118 [DOI] [Google Scholar]
  • 324. Roche DG, O’Dea RE, Kerr KA, et al. : Closing the knowledge-action gap in conservation with open science. Conserv. Biol. 2021;36. 10.1111/cobi.13835 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 325. Roje R, Tomić V, Buljan I, et al. : Development and implementation of research integrity guidance documents: Explorative interviews with research integrity experts. Account. Res. 2021;30:293–330. 10.1080/08989621.2021.1989676 [DOI] [PubMed] [Google Scholar]
  • 326. Satalkar P, Shaw D: How do researchers acquire and develop notions of research integrity? A qualitative study among biomedical researchers in Switzerland. BMC Med. Ethics. 2019;20(1):72. 10.1186/s12910-019-0410-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 327. Tang L, Cao C, Lien D, et al. : The Effects of Anti-corruption Campaign on Research Grant Reimbursement: Regression Discontinuity Evidence from China. Sci. Eng. Ethics. 2020;26(6):3415–3436. 10.1007/s11948-020-00265-7 [DOI] [PubMed] [Google Scholar]
  • 328. Tijdink JK, Horbach SPJM, Nuijten MB, et al. : Towards a Research Agenda for Promoting Responsible Research Practices. J. Empir. Res. Hum. Res. Ethics. 2021;16(4):450–460. 10.1177/15562646211018916 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 329. Cervini E: Transparency key to cutting dodgy research: Dutch expert. The Australian. 2018 06/06/2018. [Google Scholar]
  • 330. Fidler F, Fraser H: Our survey found ‘questionable research practices’ by ecologists and biologists – here’s what that means. The Conversation. 2018. Reference Source [Google Scholar]
  • 331. Macleod M: Want research integrity? Stop the blame game. Nature. 2021;599:533. 10.1038/d41586-021-03493-4 [DOI] [PubMed] [Google Scholar]
  • 332. Munafò M: Raising research quality will require collective action. Nature. 2019;576:183. 10.1038/d41586-019-03750-7 [DOI] [PubMed] [Google Scholar]
  • 333. Valkenburg G, Dix G, Tijdink J, et al. : Expanding Research Integrity: A Cultural-Practice Perspective. Sci. Eng. Ethics. 2021;27(1):10. 10.1007/s11948-021-00291-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 334. Zwart H, Ruud ter M: Addressing research integrity challenges: from penalising individual perpetrators to fostering research ecosystem quality care. Life Sci. Soc. Policy. 2019;15(1):1–5. 10.1186/s40504-019-0093-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 335. Feinberg M, Sutherland W, Nelson SB, et al. : The New Reality of Reproducibility: The Role of Data Work in Scientific Research. Proc ACM Hum Comput Interact. 2020;4(CSCW1):1–22. 10.1145/3392840 [DOI] [Google Scholar]
  • 336. Gilmore RO, Diaz MT, Wyble BA, et al. : Progress toward openness, transparency, and reproducibility in cognitive neuroscience. Annals of the New York Academy of Sciences. Blackwell Publishing Inc.;2017; pp.5–18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 337. Gurgu E, Tonis RB-M, Avram LG, et al. : Applicability of the ethics management tools in Romanian academia. Indep. J. Manag. Prod. 2020;11(7):2709–2732. 10.14807/ijmp.v11i7.1205 [DOI] [Google Scholar]
  • 338. Leonelli S: Global data quality assessment and the situated nature of “best” research practices in biology. Data Sci. J. 2017;16. 10.5334/dsj-2017-032 [DOI] [Google Scholar]
  • 339. Mische SM, Fisher NC, Meyn SM, et al. : A review of the scientific rigor, reproducibility, and transparency studies conducted by the ABRF research groups. J. Biomol. Tech. 2020;31(1):11–26. 10.7171/jbt.20-3101-003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 340. Moher D: COVID-19 and the research scholarship ecosystem: help! J. Clin. Epidemiol. 2021;137:133–136. 10.1016/j.jclinepi.2021.03.032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 341. Rastogi S: Making ASU ethics committees more productive: Responsible research needs more than developing the guidelines. J. Ayurveda Integr. Med. 2021;12(1):191–194. 10.1016/j.jaim.2020.10.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 342. Rhaiem M, Amara N: Determinants of research efficiency in Canadian business schools: evidence from scholar-level data. Scientometrics. 2020;125(1):53–99. 10.1007/s11192-020-03633-z [DOI] [Google Scholar]
  • 343. Satalkar P, Shaw D: Is failure to raise concerns about misconduct a breach of integrity? Researchers’ reflections on reporting misconduct. Account. Res. 2018;25(6):311–339. 10.1080/08989621.2018.1493577 [DOI] [PubMed] [Google Scholar]
  • 344. Spitschan M, Schmidt MH, Blume C: Transparency And Open Science Principles In Reporting Guidelines In Sleep Research And Chronobiology Journals [Version 1; Peer Review: 3 Approved With Reservations]. Wellcome Open Res. 2020;5:1–25. 10.12688/wellcomeopenres.16111.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 345. Stagge JH, Rosenberg DE, Abdallah AM, et al. : Assessing data availability and research reproducibility in hydrology and water resources. Sci. Data. 2019;6:6. 10.1038/sdata.2019.30 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 346. Christensen G, Freese J, Miguel E: Transparent and reproducible social science research: How to do open science. University of California Press;2019;1–272. [Google Scholar]
  • 347. Woutersen-Windhouwer S, Rodríguez EM, Sondervan J, et al. : Consolidating institutional repositories in a digital, free, open access publication platform for all scholarly output. LIBER Q. 2020;30(1):1–15. 10.18352/lq.10323 [DOI] [Google Scholar]
  • 348. Zinchenko V, Ostapenko S, Udovichenko H: Introduction of Academic Honesty as a Necessary Prerequisite and an Important Component of Quality Education for Future Economists. Revista Romaneasca Pentru Educatie Multidimensionala. 2021;13(1):81–95. 10.18662/rrem/13.1/361 [DOI] [Google Scholar]
  • 349. Ansar, editor Implementation of Total Quality Management in Higher Education (A Case of State University of Gorontalo, Indonesia). 9th International Conference for Science Educators and Teachers (ICSET); 2017 2017 Sep 13-15; Indonesia. 2017.
  • 350. Chapman AL, Greenhow C: Citizen-scholars: Social media and the changing nature of scholarship. Publ. 2019;7(1). 10.3390/publications7010011 [DOI] [Google Scholar]
  • 351. Dougherty MR, Slevc LR, Grand JA: Making Research Evaluation More Transparent: Aligning Research Philosophy, Institutional Values, and Reporting. Perspect. Psychol. Sci. 2019;14(3):361–375. 10.1177/1745691618810693 [DOI] [PubMed] [Google Scholar]
  • 352. Olsen J, Mosen J, Voracek M, et al. : Research practices and statistical reporting quality in 250 economic psychology master’s theses: a meta-research investigation. R. Soc. Open Sci. 2019;6(12):190738. 10.1098/rsos.190738 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 353. Beugelsdijk S, Witteloostuijn A, Meyer KE: A new approach to data access and research transparency (DART). J. Int. Bus. Stud. 2020;51(6):887–905. 10.1057/s41267-020-00323-z [DOI] [Google Scholar]
  • 354. Wingen T, Berkessel JB, Englich B: No Replication, No Trust? How Low Replicability Influences Trust in Psychology. Soc. Psychol. Personal. Sci. 2020;11(4):454–463. 10.1177/1948550619877412 [DOI] [Google Scholar]
  • 355. Bhattacharya N, Langhout RD, Vaccarino-Ruiz SS, et al. : "Being a team of five strong women horizontal ellipsis we had to make an impression:" The College Math Academy as an intervention into mathematics education. Am. J. Community Psychol. 2021;70:228–241. 10.1002/ajcp.12573 [DOI] [PubMed] [Google Scholar]
  • 356. Blatch-Jones A, Lakin K, Thomas S: A scoping review on what constitutes a good research culture.(dat aset). OSF. 2024. [DOI] [PMC free article] [PubMed]
F1000Res. 2024 Dec 17. doi: 10.5256/f1000research.171769.r331577

Reviewer response for version 3

Stephen Curry 1

My thanks to the authors for providing a revised version of their article in constructive response to my comments. I take their point that a scoping review is more of a survey than an analysis of practice and think that we are of one mind in hoping to see in future analyses the critical evaluation of policies and processes that aim to enhance our research cultures.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

No

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Yes

Are the conclusions drawn adequately supported by the results presented in the review?

Partly

Reviewer Expertise:

Research assessment; research on research.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2024 Oct 17. doi: 10.5256/f1000research.171769.r331579

Reviewer response for version 3

Elisabeth Grey 1

No further comments, the authors have addressed the reviewers comments.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Yes

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

Health behaviour, health communication, qualitative methods, systematic reviews

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2024 Jul 24. doi: 10.5256/f1000research.168087.r300823

Reviewer response for version 2

Elizabeth Gadd 1

Thanks to the authors for working hard to implement the recommendations of my review. I still couldn't see any references to the Vitae Research Culture Framework either in the references or the text which might be something worth revisiting given its significance in the research culture space.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Partly

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

Research assessment; research culture; scholarly communication; open research.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2024 Sep 10.
Amanda Blatch-Jones 1

Comment : Thanks to the authors for working hard to implement the recommendations of my review. I still couldn't see any references to the Vitae Research Culture Framework either in the references or the text which might be something worth revisiting given its significance in the research culture space.

Response : Thank you for picking this up. It has now been added to the introduction and referenced accordingly.

F1000Res. 2024 Jul 16. doi: 10.5256/f1000research.168087.r300822

Reviewer response for version 2

Steven De Peuter 1

Thank you for taking into account my comments and those of the other reviewers. I consider this version a substantial improvement from the previous. Allow me to formulate some additional minor comments that, when addressed, may further add to the paper’s clarity.

There is some inconsistency between, on the one hand, the description of the purpose of the paper as formulated in the abstract and, on the other hand, the final paragraph of the Background section and the final sentence of the Methods section. Whereas the former places emphasis on poor research culture (“ The purpose of the scoping review was to explore ‘What does the evidence say about the ‘problem’ with ‘poor’ research culture, what are the benefits of ‘good’ research culture, and what does ‘good’ look like?’”), the Background and Method section focus more on good research culture. Furthermore, the text of the Results section primarily describes identified problematic aspects of the research culture, whereas the tables list considerations that will most likely improve the research culture and/or foster good culture. I definitely appreciate the positive approach of the considerations/recommendations so I wouldn’t change them. I think adding one or two sentences about where/how the different aspects of research culture are dealt with will assist the reader in taking in the extensive amount of information contained in the paper.

Minor:

BACKGROUND

The subject and the verbs of the first sentence of the third paragraph of the Background section are not aligned:

“consequences … does not only effect …, it” […consequences DO not only Affect, THEY … affect … reduce … affect; please also note the use of effect instead of affect]

METHODS

Eligibility criteria - participants: The second sentence is odd, starting with “To be inclusive of…” followed by “to ensure”

RESULTS

Research quality and accountability: “suggested a link between open research and reproducibility that could lead to public distrust” please specify how you see this link. I find it hard to imagine how openness would lead to public distrust, thinking it would make more sense to have a link between lack of openness and public distrust.

Typos:

Table 3

theme 3 statement 2: space missing before opening bracket; better to use “reflecting” than “reflect”

theme 3 statement 5: closing bracket missing

table 4

theme 1 first statement: “break down” instead of breakdown

theme 1 statement 4: maintain … THAT are fair

theme 2 statement 1: individual researchers’ compliance

theme 2 statement 6: systems that explicitly capture (remove ‘s’) behaviors

Theme 3 statement 3: …to promote open science practices such AS Center for Open Science

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Yes

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

Research integrity, research culture, behavior change, health psychology, change management

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2024 Sep 10.
Amanda Blatch-Jones 1

Reviewer's comment: There is some inconsistency between, on the one hand, the description of the  purpose of the paper as formulated in the abstract and, on the other hand, the final paragraph of the Background section and the final sentence of the Methods section. Whereas the former places emphasis on poor research culture (“ The purpose of the scoping review was to explore ‘What does the evidence say about the ‘problem’ with ‘poor’ research culture, what are the benefits of ‘good’ research culture, and what does ‘good’ look like?’”), the Background and Method section focus more on  good research culture.

Author response: Thank you we have made all three areas (abstract, background and methods section the same) the same to be consistent about the focus of the review.

Reviewer's comment: Furthermore, the text of the Results section primarily describes identified problematic aspects of the research culture, whereas the tables list considerations that will most likely improve the research culture and/or foster  good culture. I definitely appreciate the positive approach of the considerations/recommendations so I wouldn’t change them. I think adding one or two sentences about where/how the different aspects of research culture are dealt with will assist the reader in taking in the extensive amount of information contained in the paper.

Author response: Thank you for your comment. To put the considerations into context, the review scoped the ‘problems’ to determine probable considerations/recommendations, to understand what the benefits of a good research culture are and what it looks like (addressing the research questions).

Reviewer's comment: BACKGROUND

The subject and the verbs of the first sentence of the third paragraph of the Background section are not aligned: “consequences … does not only effect …, it” […consequences DO not only Affect, THEY … affect … reduce … affect; please also note the use of  effect instead of  affect]

METHODS

Eligibility criteria - participants: The second sentence is odd, starting with “To be inclusive of…” followed by “to ensure”

RESULTS

Research quality and accountability: “suggested a link between open research and reproducibility that could lead to public distrust” please specify how you see this link. I find it hard to imagine how openness would lead to public distrust, thinking it would make more sense to have a link between  lack of openness and public distrust.

Author response: Thank you for drawing our attention to these three areas within the article. We have adjusted the sentence/s accordingly based on your suggestions. 

Thank you for highlighting the typos and we have now corrected them.

F1000Res. 2024 Jul 4. doi: 10.5256/f1000research.161809.r271033

Reviewer response for version 1

Stephen Curry 1

This is a review of the peer-reviewed and grey literature on research culture issues at research institutions that aims to explore the evidence base for (i) claims of poor research culture, (ii) the benefits of a ‘good’ research culture, and (iii) what ‘good’ might might look like.

The review is systematic in its consideration of the literature published between 2017 and 2022 and certainly addresses an important and topical area. However, I have a number of concerns about the design and execution of the study.

First, the aims lack focus. As stated, they are to “explore the interplay between research culture, open research, career paths, recognition and rewards and EDI”. This maps out an extremely broad range of issues and doesn’t clearly articulate the desired endpoints.

A second concern is the fact that the literature surveyed is confined to a 5-year period that ended over two years ago. Given the topicality of the subject, I find this a strange limitation. What reassurance can the authors offer that their review is not already out of date?

Third, and perhaps most critically, the report is largely descriptive and lacks an analytical edge that I think would add considerably to the value and impact of the piece. I was left wondering who is going to read this and what will they take away? The main conclusion in the abstract is that research institutions and funders need to work together, a finding that seems obvious given the systemic nature of the issues under discussion. What is new here that we didn’t know before the review was conducted?

I suspect the lack of analysis may reflect the fact that the interactions between open research, EDI etc and research culture are extremely difficult to isolate and distinguish and that there have been relatively few efforts to evaluate whether interventions have had positive or negative effects on research culture. The problem is made more difficult because of the existence of external influences (e.g. funder policies, league tables, international competition) on institutional culture. Nevertheless, even to highlight the absence of such evaluation efforts would be a valuable point to make – and I hope that the authors might address this question in a revised version of the paper.  

I have a few additional comments:

In the first paragraph of the introduction, I think it would be more appropriate to present the ‘actions’ that have been taken in chronological order.

Later in the introduction, it is stated that “attempts on reform requires commitment from everyone”. While I agree with this claim, it sits oddly with the study design, which is focused only on research institutions. This is one of several instances where I lost sight of the coherence of the arguments being presented.

In the first paragraph of the section on Security and Career Progression, the authors identify “concerns over job security, career progression and sustainability…” but it is not clear to me what is meant by sustainability in this context.

Later in this section it is stated that “The evidence suggests that offering potential solutions or supportive actions for academic institutions and the research community may enhance and stabilise career paths, particularly those in the early career stage, including those in technical and managerial roles.” This is a rather vague and weak statement. What solutions have been identified? Who is responsible for them and how effective are they? What does it mean to enhance a career path?

On page 19 it is stated (with regard to the replication crisis) that “Determining where effort is most needed and what changes are required, not only provides opportunity for the research ecosystem but also how RPOs and RFOs can mandate open research practices, and therefore coordinate change at both research integrity and researcher integrity level…”. This is another rather vague claim where analysis is lacking. What specific changes might be made? Could the authors also address the very live debates around the merits and demerits of using mandates?

In the Discussion, the sentence “The increasing competitiveness within the research environment, with research funding organisations (RFOs) placing greater focus on impact rather than creativity and innovation, is causing a global initiative for cultural change” doesn’t make sense to me. Is it not increasing awareness of the harmful impacts of research competition that is leading many stakeholders across the world to focus attention on improving research culture. This is just one example of what I find to be a rather fuzzy style of writing. This sense is compounded by the repetition of the phrase “the evidence suggests”. As noted above, I would like to see the authors doing a better job of sifting and weighing the evidence.

The last paragraph of the Conclusions is not really a conclusion. It is to my mind a description of a situation that was evident before reading this review. The first paragraph begins with the statement that “The review has shown that there is a wealth of evidence suggesting how and where changes are needed to establish a global cultural change to the research ecosystem. ” I think it would add a great deal of value to the review if the authors could identify what they think are the most important changes. This would have the potential to focus the attention of the sector on the most urgent actions to be undertaken.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

No

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Yes

Are the conclusions drawn adequately supported by the results presented in the review?

Partly

Reviewer Expertise:

Research assessment, EDI, metascience, structural biology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

F1000Res. 2024 Aug 19.
Amanda Blatch-Jones 1

Unfortunately we did not receive your review until we submitted a revised version. We will of course address your comments in version 3, when we have received all of the reviewers comments. Thank you again for your comments and suggestions for improvements.

F1000Res. 2024 Sep 10.
Amanda Blatch-Jones 1

In addition to our previous comments we would like to add that we have addressed your comments in line with the other comments and feedback received. Thank you for your comments. 

First, the aims lack focus. As stated, they are to “explore the interplay between research culture, open research, career paths, recognition and rewards and EDI”. This maps out an extremely broad range of issues and doesn’t clearly articulate the desired endpoints.

Thank you for your comment. The scoping review was kept broad for the purposes of the review and the related areas highlighted in the Wellcome report. On this basis, we kept the review broad to capture relevant evidence (and contribute to the wider piece of work the review contributed to).

A second concern is the fact that the literature surveyed is confined to a 5-year period that ended over two years ago. Given the topicality of the subject, I find this a strange limitation. What reassurance can the authors offer that their review is not already out of date?

We appreciate your concern around the period; however, this was chosen to consider existing literature in the space, the Wellcome report and initiatives in research culture. The period covered relevant references and included reports of changes during COVID-19 pandemic. As this was a scoping review to determine the existing evidence, we were only covering the specified areas within that period.

Third, and perhaps most critically, the report is largely descriptive and lacks an analytical edge that I think would add considerably to the value and impact of the piece. I was left wondering who is going to read this and what will they take away? The main conclusion in the abstract is that research institutions and funders need to work together, a finding that seems obvious given the systemic nature of the issues under discussion. What is new here that we didn’t know before the review was conducted?

The review provides updated literature from the Wellcome report and supports the existing evidence that although there are further developments in this space, there is still a lack of collaborative working. The statements provided in the tables gives greater clarity around what these developments are and how they could be considered to foster and incentivise what a good research culture looks like. As this was a scoping review, analytical content or assessment was out of scope.

I suspect the lack of analysis may reflect the fact that the interactions between open research, EDI etc and research culture are extremely difficult to isolate and distinguish and that there have been relatively few efforts to evaluate whether interventions have had positive or negative effects on research culture. The problem is made more difficult because of the existence of external influences (e.g. funder policies, league tables, international competition) on institutional culture. Nevertheless, even to highlight the absence of such evaluation efforts would be a valuable point to make – and I hope that the authors might address this question in a revised version of the paper.  

As noted in the review, research culture is in itself complex due to multiple factors at play. The review highlights these complexities and the range of areas required to promote and encourage a good research culture. We agree with your comment and have highlighted these concerns within the revised version, thank you.

In the first paragraph of the introduction, I think it would be more appropriate to present the ‘actions’ that have been taken in chronological order.

Later in the introduction, it is stated that “attempts on reform requires commitment from everyone”. While I agree with this claim, it sits oddly with the study design, which is focused only on research institutions. This is one of several instances where I lost sight of the coherence of the arguments being presented.

Thank you for your comment. Addressing this point in the introduction is a valid point, demonstrating how the Wellcome report highlighted the need for greater commitment from not just research institutions (and demonstrating the complexity).

In the first paragraph of the section on Security and Career Progression, the authors identify “concerns over job security, career progression and sustainability…” but it is not clear to me what is meant by sustainability in this context.

Thank you. We have added some examples of what we mean by sustainability in this context.

Later in this section it is stated that “The evidence suggests that offering potential solutions or supportive actions for academic institutions and the research community may enhance and stabilise career paths, particularly those in the early career stage, including those in technical and managerial roles.” This is a rather vague and weak statement. What solutions have been identified? Who is responsible for them and how effective are they? What does it mean to enhance a career path?

We have referred the reader to the table, which provides the evidence for this section. We didn’t elaborate within the text as we would be duplicating what is reported in table 2. Several solutions are reported in the table, and as reported, a range of individuals are responsible for initiating them (individuals themselves, research organisations, departments, HR etc).

On page 19 it is stated (with regard to the replication crisis) that “Determining where effort is most needed and what changes are required, not only provides opportunity for the research ecosystem but also how RPOs and RFOs can mandate open research practices, and therefore coordinate change at both research integrity and researcher integrity level…”. This is another rather vague claim where analysis is lacking. What specific changes might be made? Could the authors also address the very live debates around the merits and demerits of using mandates?

Thank you for your comment. Like the above statement, the scoping review provided a summary of the evidence found rather than analysing the evidence (another type of review approach would be needed for this). The purpose here was to highlight and assess the scope of the literature and map it to specific areas (the four areas reported in the Wellcome report).

In the Discussion, the sentence “The increasing competitiveness within the research environment, with research funding organisations (RFOs) placing greater focus on impact rather than creativity and innovation, is causing a global initiative for cultural change” doesn’t make sense to me. Is it not increasing awareness of the harmful impacts of research competition that is leading many stakeholders across the world to focus attention on improving research culture. This is just one example of what I find to be a rather fuzzy style of writing. This sense is compounded by the repetition of the phrase “the evidence suggests”. As noted above, I would like to see the authors doing a better job of sifting and weighing the evidence.

This section has been revised in a previous version. However, weighing or providing an analytical account of the included evidence is out of scope for scoping reviews. Scoping reviews aim to understand ‘What has been done previously?’ and ‘What does the literature say?’ compared to systematic reviews that ask the question ‘Does this intervention work for this group of individuals?

The last paragraph of the Conclusions is not really a conclusion. It is to my mind a description of a situation that was evident before reading this review. The first paragraph begins with the statement that “The review has shown that there is a wealth of evidence suggesting how and where changes are needed to establish a global cultural change to the research ecosystem. ” I think it would add a great deal of value to the review if the authors could identify what they think are the most important changes. This would have the potential to focus the attention of the sector on the most urgent actions to be undertaken.

Thank you for your comment. We have extended the conclusions and included the Vitae citation.

However, we have not directed the reader to specific priorities as we feel this would add bias to the review. As already noted there are several areas in the tables under the four areas that would be considered to some as priority but may not be to someone else. On this basis, it would be the readers decision to understand what is priority to them and their institution based on what is feasible and within their control.

F1000Res. 2024 May 30. doi: 10.5256/f1000research.161809.r277505

Reviewer response for version 1

Elizabeth Gadd 1

Thank you for the opportunity to review this scoping review on what constitutes a good research culture, and thank you to the authors for taking the time to share their review with a wider audience through this piece.

I make a number of minor comments against some of the article's headings below, however I think there are some more fundamental issues that it would be helpful to address to secure the scientific soundness of this article and therefore its contribution to the literature. 

1) Clarity & consistency around the dimensions of research culture being investigated

It's not clear how the particular lenses of open research, career research paths (recognition & awards) & EDI mentioned in the background section were chosen given the research question appears to put no boundaries around the elements of poor research culture & the benefits of a good culture and what it looks like. In the methods section, the dimensions of research culture under investigation appear to have changed to 'four key areas highlighted from existing published work from the Wellcome Trust'. The argument given is that it will ensure consistency and continuity to predefined areas already established by the research environment.' (I'm not sure to what the authors refer when they use the phrase 'the research environment' here.) It's unclear at this point what these four areas are, and why they were selected. Again, why be guided by the WT if the research question is to consider the problems and benefits of poor/good research cultures more broadly?  It would be helpful if a stronger case was made for the dimensions of research culture being used to analyse the literature given the specific research questions of the study.

2) The use of the research questions as a study frame

Having stated the research questions, they don't seem to provide a strong framework for the rest of the article. For example, Figure 2 summarises the evidence relating to 'what makes a good research culture' but not relating to the other elements of the research question (what are the problems with research culture and what benefits does it bring). If all three questions were being considered together, the heading of the figure could be changed.

The research questions are not referred back to in the findings, discussion or conclusions, which leads to a loss of structure and clarity. 

3) Superficial and incomplete analyses of the literature reviewed

Some of the evidence summaries feel superficial and possibly incomplete. Take as an example the sentence: "Evidence suggests that this [evaluating academic performance based on the use of inadequate proxies] can result in a lack of workload oversight, a culture discouraging of appreciation, that in turn makes researchers feel pressured to be successful, often resulting in a significant amount of time in pursuit of success at the cost of their wellbeing."  I know this literature quite well, and I don't think a lack of workload oversight and a culture of discouraging appreciation are the key issues with the overuse of publication metrics. 

Again, in the Wellbeing & equality of opportunity section the authors write: 'Researchers are incentivized to attain research excellence, which can often result in hyper-competitiveness and unfair working practices.' However, it's generally agreed that the problem lies not so much in the pursuit of excellence so much as how narrowly excellence is defined.

I provide some other examples below but this is not a complete list. 

4) Poor phraseology

The findings of the review are often obscured by somewhat tortuous phrasing and unclear writing. For example, in the research quality and accountability statements table, one statement reads: 'Develop a coordinated approach to incentivize open access policies to optimise a positive cultural shift based on Government recognition of UK Research and Innovation’s position on open access research practice, (including European and international position and status of progression/advancement in open research)'. It's not clear to me what this is saying, nor whether reference to one nation's policy position is meaningful.

Again, in the Wellbeing & equality of opportunity section, one sentence reads: 'As the evidence has shown, working relationship challenges in research culture require structural changes by transforming people, places, and practices.'

I provide some other examples below, but this is by no means a complete list.

I think it would be helpful if the authors scrutinise every sentence to ask, is this strictly accurate? How might this be misinterpreted? Am I representing the authors of the literature carefully? Have we identified the major themes? 

5) Stronger discussion & conclusions

Finally, I find the discussion section rather unstructured and unclear. New points are introduced in the discussion that are not reported in the findings, e.g., reference to digital tools. The reader is not left with a clear sense as to what the authors proposed answers to the research questions are. 

Minor corrections

Background

Minor Correction: "Funding organisations such as UK Research and Innovation (UKRI) enhanced its 2021-2022 allocation of research culture funding to Higher Education Providers (HEPs) to further explore research processes and experiences of working in research, through piloting new initiatives or enhancing existing activities."  - this funding is from Research England to English HEPs:

Minor: "The consequences and challenges associated to an inadequate research culture is well evidence" - should be 'associated with' and 'are well evidenced'

Methods

Minor: The term 'non-academic staff' is largely seen as derogatory - defining a group of people by what they are not. Research-enabling staff is a term in more common parlance now. Or professional services if you are looking more broadly.

Search strategy

Minor: citations should be references I think?

Data extraction & evidence selection

Minor: Citation needed for Rayyan

Minor: I appreciate the work was carried out prior to the Vitae Research Culture study which identified 4 different core domains, however it would be good to mention this work as there is a lot of overlap with this paper.

  • How research is managed and undertaken

  • How research ensures value

  • How people are supported

  • How individuals engage with others

Minor: the numbers in the PRISMA flow diagram don't add up. The authors should take another look at this.

Characteristics of the included studies

Minor: It should read 'conference papers' not 'conference proceedings'.

Minor: UK is part of Europe. Is the 17 a subset of the 36 or separate to?

Summarising the evidence

Minor: Could be clearer as to what you mean by 'career type'. Career pathway? Job family?

Minor: I'm not sure what the term 'statements' refers to in Table 2. 'Statement' implies a citation from the literature, but these are very complex so I don't think that's what's being provided. 

Wellbeing and equality of opportunity

Minor: just be careful with phrasing - 'The pandemic also initiated ‘kindness in research’' - I think you mean that the pandemic led to calls for more kindness in research? When writing reviews of this type, it's important to be strictly accurate as to exactly what was being suggested.

Minor: Para beginning 'These practices' - it's not clear to what practices this refers?

Research quality & accountability

Minor: This isn't quite accurate. 'the evidence...highlighted several issues inhibiting open research practices, which some have termed as a ‘replication or reproducibility crisis’. I think you mean that a link was made between open research and reproducibiity, but not that open research practices were termed a 'replication or reproducibilty crisis'? 

Discussion

Minor: The report mentioned here: 'As noted in the recent Research and Development report on people and culture strategy, high quality research and innovation requires an acknowledgment of the full range of people needed. 8

is not a Research & Development report, but the BEIS R&D People & Culture Strategy.

Minor: To what research group does this refer? 'The health of the research group and those that lead them has been identified as an area that universities need to pay more attention to'.

Minor: The term 'impact' should be clarified throughout the article. In REF the term is used to describe non-academic impact. However, in the following sentence I think it refers to citation impact? ''The increasing competitiveness within the research environment, with research funding organisations (RFOs) placing greater focus on impact rather than creativity and innovation, is causing a global initiative for cultural change.' Either way, I'm not sure this sentence is strictly accurate.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Partly

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

Research assessment; research culture; scholarly communication; open research.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

F1000Res. 2024 Jun 18.
Amanda Blatch-Jones 1

Reviewer comment: 1)  Clarity & consistency around the dimensions of research culture being investigated

It's not clear how the particular lenses of open research, career research paths (recognition & awards) & EDI mentioned in the background section were chosen given the research question appears to put no boundaries around the elements of poor research culture & the benefits of a good culture and what it looks like.

Author response: These areas were chosen as a result of the Wellcome Trust survey and the areas reported in their report. The review focused on what the solutions could be rather than focusing on the barriers and challenges to a good research culture (due to the existing coverage in the literature). The aim of the review was to therefore consider the evidence about solutions and what the research community could consider. However, we have amended the last paragraph to add some additional context to address your comment.

Reviewer comment: In the methods section, the dimensions of research culture under investigation appear to have changed to 'four key areas highlighted from existing published work from the Wellcome Trust'. The argument given is that it will ensure consistency and continuity to predefined areas already established by the research environment.' (I'm not sure to what the authors refer when they use the phrase 'the research environment' here.) It's unclear at this point what these four areas are, and why they were selected. Again, why be guided by the WT if the research question is to consider the problems and benefits of poor/good research cultures more broadly?  It would be helpful if a stronger case was made for the dimensions of research culture being used to analyze the literature given the specific research questions of the study.

Author response: We have revised the manuscript to be more descriptive of what the four areas are, along with what we mean by research environment (changed to research community based on the participants and respondents to the Wellcome Trust research cultures work).

Reviewer comment: 2) The use of the research questions as a study frame

Having stated the research questions, they don't seem to provide a strong framework for the rest of the article. For example, Figure 2 summarises the evidence relating to 'what makes a good research culture' but not relating to the other elements of the research question (what are the problems with research culture and what benefits does it bring). If all three questions were being considered together, the heading of the figure could be changed.

Author response: The challenges and problems around research culture are well documented in the literature and we approached the research questions simultaneously, with more focus on solutions and what good research culture could look like. For each of the four areas, we have provided a summary of the challenges to address this part of the research question, with the main emphasis being the second part of the research question. The tables and figure 2 purposively focus on what constitutes a good research culture to address the challenges and barriers, to encourage a cultural shift with actionable actions. The purpose of the review was to focus on solutions rather than what the current challenges are, as these are well documented.

Reviewer comment: The research questions are not referred back to in the findings, discussion or conclusions, which leads to a loss of structure and clarity. 

Author response: We have made this clearer in the revised manuscript and referred back to the research questions.

Reviewer comment: 3) Superficial and incomplete analyses of the literature reviewed

Some of the evidence summaries feel superficial and possibly incomplete. Take as an example the sentence: "Evidence suggests that this [evaluating academic performance based on the use of inadequate proxies] can result in a lack of workload oversight, a culture discouraging of appreciation, that in turn makes researchers feel pressured to be successful, often resulting in a significant amount of time in pursuit of success at the cost of their wellbeing."  I know this literature quite well, and I don't think a lack of workload oversight and a culture of discouraging appreciation are the key issues with the overuse of publication metrics. 

Again, in the Wellbeing & equality of opportunity section the authors write: 'Researchers are incentivized to attain research excellence, which can often result in hyper-competitiveness and unfair working practices.' However, it's generally agreed that the problem lies not so much in the pursuit of excellence so much as how narrowly excellence is defined.

I provide some other examples below but this is not a complete list. 

Author response: Thank you for your comments and feedback. We have revised the two areas you mentioned and have carefully considered and reviewed the rest of the manuscript.

Reviewer comment: 4) Poor phraseology

The findings of the review are often obscured by somewhat tortuous phrasing and unclear writing. For example, in the research quality and accountability statements table, one statement reads: 'Develop a coordinated approach to incentivize open access policies to optimise a positive cultural shift based on Government recognition of UK Research and Innovation’s position on open access research practice, (including European and international position and status of progression/advancement in open research)'. It's not clear to me what this is saying, nor whether reference to one nation's policy position is meaningful.

Author response: Thank you. We have amended the statement to make it clearer to the reader.

Reviewer comment: Again, in the Wellbeing & equality of opportunity section, one sentence reads: 'As the evidence has shown, working relationship challenges in research culture require structural changes by transforming people, places, and practices.'

Author response: We have amended the sentence to be more cohesive.

Reviewer comment: I provide some other examples below, but this is by no means a complete list.

I think it would be helpful if the authors scrutinize every sentence to ask, is this strictly accurate? How might this be misinterpreted? Am I representing the authors of the literature carefully? Have we identified the major themes? 

Author response: Thank you. We have reviewed the manuscript and made several changes to make it more readable and coherent.

Reviewer comment: 5) Stronger discussion & conclusions

Finally, I find the discussion section rather unstructured and unclear. New points are introduced in the discussion that are not reported in the findings, e.g., reference to digital tools. The reader is not left with a clear sense as to what the authors proposed answers to the research questions are. 

Author response: We have revised the discussion and conclusion to make it clearer to the reader and follow a more structured approach.

Reviewer comment: Minor corrections

Background

Minor Correction: "Funding organizations such as UK Research and Innovation (UKRI) enhanced its 2021-2022 allocation of research culture funding to Higher Education Providers (HEPs) to further explore research processes and experiences of working in research, through piloting new initiatives or enhancing existing activities."  - this funding is from Research England to English HEPs:

Author response: Thank you. We have addressed this correction and amended the sentence accordingly.

Reviewer comment: Minor: "The consequences and challenges associated to an inadequate research culture is well evidence" - should be 'associated with' and 'are well evidenced'

Author response: Thank you, we have amended accordingly.

Reviewer comment: Methods

Minor: The term 'non-academic staff' is largely seen as derogatory - defining a group of people by what they are not. Research-enabling staff is a term in more common parlance now. Or professional services if you are looking more broadly.

Author response: Thank you. We have replaced with research-enabling staff due to the scope of the review.

Reviewer comment: Search strategy

Minor: citations should be references I think?

Author response: We have amended the manuscript to refer to references rather than citations to make it clearer to the reader.

Reviewer comment: Data extraction & evidence selection

Minor: Citation needed for Rayyan

Author response: A link to Rayyan is now included.

Reviewer comment: Minor: I appreciate the work was carried out prior to the Vitae Research Culture study which identified 4 different core domains, however it would be good to mention this work as there is a lot of overlap with this paper.

  • How research is managed and undertaken

  • How research ensures value

  • How people are supported

  • How individuals engage with others

Author response: This has now been included in the manuscript as part of the overall introduction and discussion.

Reviewer comment: Minor: the numbers in the PRISMA flow diagram don't add up. The authors should take another look at this.

Author response: Thank you for noticing this. We have rectified the error in the PRISMA flow diagram and have updated accordingly.

Reviewer comment: Characteristics of the included studies

Minor: It should read 'conference papers' not 'conference proceedings'.

Author response: We have amended to reflect your comment.

Reviewer comment: Minor: UK is part of Europe. Is the 17 a subset of the 36 or separate to?

Author response: We separated UK from Europe so that we could see what initiatives were specifically being conducted in the UK as funding, academic institutions etc work differently across country. As reported the 17 UK are separate to Europe, so the total across Europe was 43). We have adjusted the manuscript to be more concise.

Reviewer comment: Summarizing the evidence

Minor: Could be clearer as to what you mean by 'career type'. Career pathway? Job family?

Author response: We have provided an explanation with examples on the first mention of career type.

Reviewer comment: Minor: I'm not sure what the term 'statements' refers to in Table 2. 'Statement' implies a citation from the literature, but these are very complex so I don't think that's what's being provided. 

Author response: We have changed ‘statements’ for all tables and have amended with key areas and considerations associated to [what the theme was].  

Reviewer comment: Wellbeing and equality of opportunity

Minor: just be careful with phrasing - 'The pandemic also initiated ‘kindness in research’' - I think you mean that the pandemic led to calls for more kindness in research? When writing reviews of this type, it's important to be strictly accurate as to exactly what was being suggested.

Minor: Para beginning 'These practices' - it's not clear to what practices this refers?

Author response: Thank you. We have amended the sentences accordingly.

Reviewer comment: Research quality & accountability

Minor: This isn't quite accurate. 'the evidence...highlighted several issues inhibiting open research practices, which some have termed as a ‘replication or reproducibility crisis’. I think you mean that a link was made between open research and reproducibility, but not that open research practices were termed a 'replication or reproducibility crisis'? 

Author response: Thank you. We have amended the sentence accordingly.

Reviewer comment: Discussion

Minor: The report mentioned here: 'As noted in the recent Research and Development report on people and culture strategy, high quality research and innovation requires an acknowledgment of the full range of people needed. 8 '  is not a Research & Development report, but the BEIS R&D People & Culture Strategy.

Author response: We have amended the manuscript accordingly.

Reviewer comment: Minor: To what research group does this refer? 'The health of the research group and those that lead them has been identified as an area that universities need to pay more attention to'.

Author response: We have provided more details to make it clearer to the reader.

Reviewer comment: Minor: The term 'impact' should be clarified throughout the article. In REF the term is used to describe non-academic impact. However, in the following sentence I think it refers to citation impact? ''The increasing competitiveness within the research environment, with research funding organizations (RFOs) placing greater focus on impact rather than creativity and innovation, is causing a global initiative for cultural change.' Either way, I'm not sure this sentence is strictly accurate.

Author response: We have adjusted and amended the manuscript where necessary.

F1000Res. 2024 May 28. doi: 10.5256/f1000research.161809.r277499

Reviewer response for version 1

Elisabeth Grey 1

Thank you for asking me to review this interesting scoping review on research culture in research institutions. The manuscript is well-written and comprehensive, providing clear details on the methods and supplementary materials to enable other researchers to replicate the searches. I only have a few very minor suggestions that I think would help clarify a few things in the text:

In the Abstract, there are two stated aims, one under Background and one under Aims – these are not quite the same and I think it would be better to stick with one or the other (the first matches what is in the main text).

Inclusion criteria or Types of sources – I think this needs a statement on the types of initiative that were studied e.g., ‘all initiatives aimed, partly or wholly, at improving research culture were included’. Or this may need to broader if reports were included about initiatives that did not specifically aim to improve research culture, but the impact on this was measured.

In the PRISMA flow diagram, the reasons for exclusion are only provided for the academic records – could they be added for the grey records too?

You mention that many of the articles were relevant to more than one of the four focus areas – could you add a little to the Methods to explain how you decided which area to categorise a report under in these cases? Or were they included in the synthesis for each category they related to (would be good to state this)?

There is a typo in the fourth paragraph under ‘Research quality and accountability’ – ‘algin’?

Table 4 and Table 5 have the same title – I think Table 5 should be Key concepts and statements associated with research quality and accountability

It struck me that none of the concepts under ‘Security and career progression’ seemed to relate to job security, only career progression. This would be worth highlighting – ultimately to improve job security, research institutions and funders need to rethink how research positions are funded. Innovation is needed here but this review suggests that nothing is happening on this front.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Yes

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

Health behaviour, health communication, qualitative methods, systematic reviews

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2024 Jun 18.
Amanda Blatch-Jones 1

Reviewer response: In the Abstract, there are two stated aims, one under Background and one under Aims – these are not quite the same and I think it would be better to stick with one or the other (the first matches what is in the main text).

Author response: Thank you. We have replaced the aims with the following: The purpose of the scoping review was to explore ‘ What does the evidence say about the ‘problem’ with ‘poor’ research culture, what are the benefits of ‘good’ research culture, and what does ‘good’ look like?’

Reviewer response: Inclusion criteria or Types of sources – I think this needs a statement on the types of initiative that were studied e.g., ‘all initiatives aimed, partly or wholly, at improving research culture were included’. Or this may need to broader if reports were included about initiatives that did not specifically aim to improve research culture, but the impact on this was measured.

Author response: Thank you. We have included and revised your suggestion: All initiatives aimed, partly or wholly, at enhancing or assessing research culture were included.

Reviewer response: In the PRISMA flow diagram, the reasons for exclusion are only provided for the academic records – could they be added for the grey records too?

Author response: The flow diagram has been amended to include the exclusions and reasons.

Reviewer response: You mention that many of the articles were relevant to more than one of the four focus areas – could you add a little to the Methods to explain how you decided which area to categorise a report under in these cases? Or were they included in the synthesis for each category they related to (would be good to state this)?

Author response: We have added more detail about the four areas and how we allocated each article to an area or areas. “Both reviewers applied the articles under one of the four areas during extraction, based on the content and context of the article. Some articles were relevant to more than one category, which was reflected in the data extraction table. The reviewers independently checked the included articles to ensure that they were included appropriately across the four areas.”

Reviewer response: There is a typo in the fourth paragraph under ‘Research quality and accountability’ – ‘algin’?

Author response: Thank you. This has now been amended.

Reviewer response: Table 4 and Table 5 have the same title – I think Table 5 should be Key concepts and statements associated with research quality and accountability

Author response: Thank you for pointing this out. Table 5 title has been changed accordingly.

Reviewer response: It struck me that none of the concepts under ‘Security and career progression’ seemed to relate to job security, only career progression. This would be worth highlighting – ultimately to improve job security, research institutions and funders need to rethink how research positions are funded. Innovation is needed here but this review suggests that nothing is happening on this front.

Author response: Thank you. We have added the following sentence to the second paragraph under table 2. “To improve job security, research institutions and funding organizations need to readdress how research positions are funded, particularly in the early career stage.”

Innovation was discussed in the some of the articles and these are reflected in the appropriate statements. We have tried to be inclusive to the areas that were most discussed, innovation for this area was more limited than the others (possibly due to challenges, barriers and competing interests around job security and progression). It is a valid point and thank you for bringing it up.

F1000Res. 2024 May 23. doi: 10.5256/f1000research.161809.r277506

Reviewer response for version 1

Steven De Peuter 1

I have read this scoping review with interest. The authors have compiled and synthesized an impressive collection of works, both from academic sources and from popular sources. I was pleasantly surprised to see that they even included two podcasts.

The authors not only review aspects of the research culture that are problematic. They also search the literature for evidence of what constitutes a good research culture and what can be done to promote it. That they limit their search to recently published material is not problematic: only recently has the shift been made from “codification and compliance” and from preventing the bad from happening towards promoting a healthy climate. It allows researchers and policy makers to get a better view on what is currently known about good research culture. The paper’s recommendations are clear and impressively complete, excellently summarizing the collected evidence, both in the text and in the clearly structured and comprehensive tables. The structure of the themes is also intuitive.

I applaud the authors for their work and I want to emphasize that I consider this a relevant, solid, and quite exhaustive review. I have, however, a number of (minor) comments that I list below. Their purpose is solely to improve the relevance and reach of the paper, which I believe deserves a wide audience.

 

  • Background, Discussion, Conclusions

The Background section is very much to the point. For readers who are familiar with the topic of research culture, it is sufficient to have the high-level overview of the main points that the paper currently provides. For interested readers who are less familiar with the topic the background section may be too high-level. The overview remains abstract and could benefit from more specific information and examples. For example, what is “the potential negative impact of a poor research culture / the consequences and challenges associated to an inadequate research culture”? What are some recommendations from the “international actions to address the underlying drivers of poor research culture”? (Which drivers are there?)

Related to this, I think the Dicussion section would benefit from a brief recap of the main findings in the first paragraph(s), instead of just stating “From the evidence, it was clear that there were several initiatives to seek a cultural change across the research institutions/Higher Education Institutions.” The same applies to the conclusions. The authors correctly and rightfully emphasize the fact that “research institutions cannot act in isolation”, but in my opinion some of the findings deserve equal emphasis – and therefore being mentioned in the conclusions. In general, I think one of the conclusions could also be that there is a lot that can be done and that the evidence base for promoting a good research culture is substantial.

When reading the paper, it felt a bit like I was reading a – very well written – internal report for policy makers who are knowledgeable of the potential problems with(in) research culture. I think it can be leveraged to also appeal to a broader audience.

 

  • Methods

The Types of sources section confused me when I first read it, leading me to think that only empirical papers (“studies”) were included. Further on, it became evident that the authors included a wide variety of contributions. I suggest adding a first sentence to this section describing this, then continue by detailing the various types of studies and data that were included as it is currently documented.

 

  • Results

The PRIMSA flow diagram (Figure 1) is incorrect. The total of the “Full-text articles excluded, with reasons (n = 513)” differs from the sum of the specific reasons (sum = 670). It appears that the latter is correct, because 924 papers screened – 670 excluded equals 254 included. Please note that there is still one paper that seems to have disappeared: Figure 1 and the main text mention 253 included papers, not 254.

Unfortunately, in spite of the impressive amount of information that is confined in the Tables and despite my admiration for the work the authors must have put into presenting the evidence this way, there are inconsistencies between the number of references that are mentioned with the statements and the last column of the tables. You could consider this comment as an obsessive form of nitpicking from my part. I am aware of that. However, I believe that having a complete overview of the evidence associated with each statement will allow future readers to consult the relevant sources.

Table 2

Theme  Promote fair and transparent process for career progression

Statement 2: number of references with statement = 39; last column = 35

Statement 3: number of references with statement = 29; last column = 30

Statement 6: number of references with statement = 20; last column = 21

Theme  Reduce hyper competition and provide a culture of kindness

Statement 2: number of references with statement = 23; last column = 24

Theme  Cultivate a culture of support that fosters a diverse set of skills and career pathways

Statement 1: number of references with statement = 33; last column = 34

Statement 4: number of references with statement = 26; last column = 27

Table 3

Theme  Embed and support an inclusive culture

Statement 1: number of references with statement = 44; last column = 43

Statement 2: number of references with statement = 40; last column = 41

Theme  Investing in people to reduce burden and improve wellbeing

Statement 1: number of references with statement = 39; last column = 42

Statement 3: number of references with statement = 24; last column = 27

Table 4

Theme  Everyone feeling valued and having equality of opportunities to contribute

Statement 2: number of references with statement = 25; last column = 24

Table 5

Theme  Creation and facilitation

Statement 1: number of references with statement = 73; last column = 74

Statement 2: number of references with statement = 54 (!!!); last column = 71

Statement 3: number of references with statement = 45; last column = 46

Statement 4: number of references with statement = 43; last column = 44

Theme  Fostering transparency and visibility

Statement 2: number of references with statement = 49; last column = 51

Statement 3: number of references with statement = 37; last column = 38

Statement 6: number of references with statement = 12; last column = 13

 

  • Study strengths and limitations

First paragraph: I would suggest to also include the percentage of articles from the USA, analogous to Canada and other international countries.

 

  • General comments

Some of the sentences feel odd. For example, in Wellbeing and equality of opportunity, second paragraph, “The evidence suggests that these issues have an impact not only at the institutional level such as having a lack of diversity in organisational leaderships, but also for individuals, leading to a lack of role models and peer mentors skills shortages in particular disciplines, sectors and roles, and drives off talent.” is a run-on and feels like a collation of several sentences. Please check.

Some of the Statements in the tables are also long and may better be divided into several shorter sentences. Some examples:

Table 2, Statement 3 under theme Reduce hyper competition and provide a culture of kindness

“Consider ways to demonstrate support for other researchers to secure funding as part of progression (and review current reward systems), ensuring education, teaching and research are equally prioritised”: who is referred to by “other”?

Table 5, under theme Fostering transparency and visibility Statements 2 and 7 feel odd. It seems like parts of the statements are missing. Please reformulate.

 

  • Typo’s

Abbreviations list

COPE is the “Committee on Publication Ethics”, not “of” – the same typo is in Table 5 (theme “Fostering transparency and visibility” number 3 “Gain greater understanding…”)

ENRI: do the authors mean European Network of Research Integrity Offices (ENRIO - https://www.enrio.eu/ ), or maybe ENERI, the “European Network for Research Ethics and Integrity” ( https://eneri.eu)? If corrected, please also correct the mention of ENRI in Table 5 (same place as COPE) and in the last paragraph before the Discussion section.

KPI à capitalize “Performance”

Background

3d paragraph: The consequences of poor research culture does (change into “do”) not only impact researchers, it also effects (change into “affects”) research support staff…

Results

Security and career progression 3d paragraph: “ The review suggests that the problem is reinforced by a culture where researchers are incentivized to produce many funding applications and academic publications where high rejection rates” this sentence seems to be missing a verb.

Research quality and accountability – open and trustworthy research 4th paragraph: change “algin” into “align”

Tables

In Table 2, under theme Cultivate a culture of support that fosters a diverse set of skills and career pathway the references of Statement 8 are not included as links (they are also between brackets). This may be a formatting problem beyond the authors’ control, though.

In Table 3, under theme Embed and support an inclusive culture Statement 6: …including shift (change into “shifting”) institutional practice…

In Table 3, under theme Making use of and learning from existing tools and initiatives to support cultural change there is no space before the opening bracket in Statement 2

In Table 5, under theme Incentives and innovation Statement 1 mentions (at the end) “open assess movement”. Do the authors maybe mean “open access movement”?

In Table 5, under theme Fostering transparency and visibility Statement 5 please change “CREDiT” into “CRediT”

Other

Seeing “life-work balance” mentioned in Table 3 made me smile. However, in the section Wellbeing and equality of opportunity and in the Discussion section the authors shift to work-life balance, also using “work/life balance” in the discussion. Please be consistent.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Not applicable

If this is a Living Systematic Review, is the ‘living’ method appropriate and is the search schedule clearly defined and justified? (‘Living Systematic Review’ or a variation of this term should be included in the title.)

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Yes

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

Research integrity, research culture, behavior change, health psychology, change management

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

F1000Res. 2024 Jun 18.
Amanda Blatch-Jones 1

Background: The overview remains abstract and could benefit from more specific information and examples. For example, what is “the potential negative impact of a poor research culture / the consequences and challenges associated to an inadequate research culture”? What are some recommendations from the “international actions to address the underlying drivers of poor research culture”? (Which drivers are there?)

We have amended the first paragraph to provide more content and greater clarity for the reader.

Related to this, I think the Discussion section would benefit from a brief recap of the main findings in the first paragraph(s), instead of just stating “From the evidence, it was clear that there were several initiatives to seek a cultural change across the research institutions/Higher Education Institutions.”

We have added to the first part of the discussion emphasising some of the key points as suggested.

The same applies to the conclusions. The authors correctly and rightfully emphasize the fact that “research institutions cannot act in isolation”, but in my opinion some of the findings deserve equal emphasis – and therefore being mentioned in the conclusions. In general, I think one of the conclusions could also be that there is  a lot that can be done and that the evidence base for promoting a good research culture is substantial.

Thank you for your comments and we have included your suggested conclusion comment into the manuscript. We have also amended the sentence “research institutions cannot act in isolation.”

When reading the paper, it felt a bit like I was reading a – very well written – internal report for policy makers who are knowledgeable of the potential problems with(in) research culture. I think it can be leveraged to also appeal to a broader audience.

Thank you for your feedback. We have made notable changes to the manuscript which we hope provides greater coverage for a broader audience.  

Methods: The  Types of sources section confused me when I first read it, leading me to think that  only empirical papers (“studies”) were included. Further on, it became evident that the authors included a wide variety of contributions. I suggest adding a first sentence to this section describing this, then continue by detailing the various types of studies and data that were included as it is currently documented.

Thank you for your suggestion. We have included an opening sentence for this sub-heading. “Several types of contributions were used for the scoping review, which included articles, reports, blogs and web-based articles from both empirical studies and grey literature.” 

Results: The PRIMSA flow diagram (Figure 1) is incorrect. The total of the “Full-text articles excluded, with reasons (n = 513)” differs from the sum of the specific reasons (sum = 670). It appears that the latter is correct, because 924 papers screened – 670 excluded equals 254 included. Please note that there is still one paper that seems to have disappeared: Figure 1 and the main text mention 253 included papers, not 254.

Unfortunately, in spite of the impressive amount of information that is confined in the Tables and despite my admiration for the work the authors must have put into presenting the evidence this way, there are inconsistencies between the number of references that are mentioned with the statements and the last column of the tables. You could consider this comment as an obsessive form of nitpicking from my part. I am aware of that. However, I believe that having a complete overview of the evidence associated with each statement will allow future readers to consult the relevant sources.

Thank you for pointing this out on the PRISMA flow diagram. Having gone back to the reference manager the error has been corrected. The number of exclusions were 671 and the missing article was not recorded. This has now been amended.

Thank you for your thoughtful comment and paying particular attention to the mismatch between the number of references cited for each statement and the count of these references in the tables. We really appreciate your attention to detail and have made the relevant changes and have double checked these for consistency.

Table 2

Theme  Promote fair and transparent process for career progression

Statement 2: number of references with statement = 39; last column = 35

Statement 3: number of references with statement = 29; last column = 30

Statement 6: number of references with statement = 20; last column = 21

Theme  Reduce hyper competition and provide a culture of kindness

Statement 2: number of references with statement = 23; last column = 24

Theme  Cultivate a culture of support that fosters a diverse set of skills and career pathways

Statement 1: number of references with statement = 33; last column = 34

Statement 4: number of references with statement = 26; last column = 27

Thank you. We have adjusted the frequencies and have doubled checked all the other statements for clarity.

Table 3

Theme  Embed and support an inclusive culture

Statement 1: number of references with statement = 44; last column = 43

Statement 2: number of references with statement = 40; last column = 41

Theme  Investing in people to reduce burden and improve wellbeing

Statement 1: number of references with statement = 39; last column = 42

Statement 3: number of references with statement = 24; last column = 27

Thank you. We have adjusted the frequencies and have doubled checked all the other statements for clarity.

Table 4

Theme  Everyone feeling valued and having equality of opportunities to contribute

Statement 2: number of references with statement = 25; last column = 24

Thank you. We have adjusted the frequencies and have doubled checked all the other statements for clarity.

Table 5

Theme  Creation and facilitation

Statement 1: number of references with statement = 73; last column = 74

Statement 2: number of references with statement =  54 (!!!); last column = 71

Statement 3: number of references with statement = 45; last column = 46

Statement 4: number of references with statement = 43; last column = 44

Theme  Fostering transparency and visibility

Statement 2: number of references with statement = 49; last column = 51

Statement 3: number of references with statement = 37; last column = 38

Statement 6: number of references with statement = 12; last column = 13

Thank you. We have adjusted the frequencies and have doubled checked all the other statements for clarity.

Study strengths and limitations: First paragraph: I would suggest to also include the percentage of articles from the USA, analogous to Canada and other international countries.

These figures and sentence has been adjusted to reflect the accuracy of the percentages in table 1.

General comments: Some of the sentences feel odd. For example, in  Wellbeing and equality of opportunity, second paragraph, “The evidence suggests that these issues have an impact not only at the institutional level such as having a lack of diversity in organisational leaderships, but also for individuals, leading to a lack of role models and peer mentors skills shortages in particular disciplines, sectors and roles, and drives off talent.” is a run-on and feels like a collation of several sentences. Please check. (1)

Some of the Statements in the tables are also long and may better be divided into several shorter sentences. Some examples:

Table 2, Statement 3 under theme  Reduce hyper competition and provide a culture of kindness

“Consider ways to demonstrate support for other researchers to secure funding as part of progression (and review current reward systems), ensuring education, teaching and research are equally prioritised”: who is referred to by “other”? (2)

Table 5, under theme  Fostering transparency and visibility Statements 2 and 7 feel odd. It seems like parts of the statements are missing. Please reformulate. (3 and 4)

Thank you for your general comments on some of the sentences in the manuscript. We have amended these, which hopefully makes more sense for the reader.

 

  1. “The evidence suggests that these wellbeing issues can have an impact at an institutional level, resulting in a lack of diversity across leadership roles, a shortage of role models and peer mentors, and driving off talent due to staff leaving academia.”

  2. ‘other’ has been taken out as that was a typo error. Thank you for drawing us to this statement.

Due to the structure of the statements and how they emerged as part of the synthesis, it would be challenging to go back and re-evaluate these statements. We understand that some of them are longer than others, as we attempted to capture sufficient information to enable the reader to understand the content and context.

Statement 2 has been amended “Actively encouraging researchers to make their research more accessible and open through sharing protocols and data openly and transparently, could foster greater knowledge exchange opportunities.”

Statement 7 has also been amended “Become a signatory of initiatives such as DORA and seek to engage with local and international networks such as the Reproducibility Network.”

Typo’s:

Abbreviations list

COPE is the “Committee on Publication Ethics”, not “of” – the same typo is in Table 5 (theme “Fostering transparency and visibility” number 3 “Gain greater understanding…”)

ENRI: do the authors mean European Network of Research Integrity  Offices (ENRIO -  https://www.enrio.eu/ ), or maybe  ENERI, the “European Network for Research Ethics and Integrity” ( https://eneri.eu)? If corrected, please also correct the mention of ENRI in Table 5 (same place as COPE) and in the last paragraph before the Discussion section.

KPI à capitalize “Performance”

Background

3d paragraph: The consequences of poor research culture does (change into “do”) not only impact researchers, it also effects (change into “affects”) research support staff…

Results

Security and career progression 3d paragraph: “ The review suggests that the problem is reinforced by a culture where researchers are incentivized to produce many funding applications and academic publications where high rejection rates” this sentence seems to be missing a verb.

Research quality and accountability – open and trustworthy research 4th paragraph: change “algin” into “align”

Tables

In Table 2, under theme  Cultivate a culture of support that fosters a diverse set of skills and career pathway the references of Statement 8 are not included as links (they are also between brackets). This may be a formatting problem beyond the authors’ control, though.

In Table 3, under theme  Embed and support an inclusive culture Statement 6: …including shift (change into “shifting”) institutional practice…

In Table 3, under theme  Making use of and learning from existing tools and initiatives to support cultural change there is no space before the opening bracket in Statement 2

In Table 5, under theme  Incentives and innovation Statement 1 mentions (at the end) “open assess movement”. Do the authors maybe mean “open access movement”?

In Table 5, under theme  Fostering transparency and visibility Statement 5 please change “CREDiT” into “CRediT”

Other

Seeing “life-work balance” mentioned in Table 3 made me smile. However, in the section  Wellbeing and equality of opportunity and in the Discussion section the authors shift to work-life balance, also using “work/life balance” in the discussion. Please be consistent.

Thank you for your additional suggestions on the typo’s in the manuscript. We have addressed all your comments accordingly.

For the references, on statement 8, it is a formatting issue outside of our control (a request to F1000 has been made in the revised manuscript)

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Citations

    1. Blatch-Jones A, Lakin K, Thomas S: A scoping review on what constitutes a good research culture.(dat aset). OSF. 2024. [DOI] [PMC free article] [PubMed]

    Data Availability Statement

    All underlying data are available as part of the article and no additional source data are required.

    Underlying data

    OSF: A scoping review on what constitutes a good research culture. https://osf.io/wjhcf/. 356

    This project contains the following underlying data:

    • Fig 1 PRISMA flow diagram (PRISMA)

    • Fig 2 themed areas diagram (four themed areas diagram)

    • S1 Appendix search terms and key words (search terms and key words)

    • S2 Appendix PRISMA ScR checklist (completed checklist)

    • S1 Table database searches examples (search strategies used)

    • S2 Table database lit articles (complete list of included articles in the review)

    • S3 Table grey lit articles (complete list of included articles from the grey literature in the review)

    Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

    Extended data

    Reporting guidelines

    OSF repository: PRISMA ScR checklist and flow chart for “A scoping review on what constitutes a good research culture.” https://osf.io/wjhcf/. 356

    Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).


    Articles from F1000Research are provided here courtesy of F1000 Research Ltd

    RESOURCES