Skip to main content
Open Research Europe logoLink to Open Research Europe
. 2023 Sep 18;3:150. [Version 1] doi: 10.12688/openreseurope.16237.1

Addressing disparities in European Social Sciences & Humanities research on climate, energy and mobility: insights from a Call for Evidence survey and analysis workshops on the challenges and opportunities of working in Southern and Central & Eastern Europe

Chris Foulds 1,a, Ami Crowther 1, Alevgul H Sorman 2,3, Violeta Cabello 2, Dóra Bálint 4, Gergely Tagai 4, Viktor Varjú 4, Rosie Robison 1, Ester Galende Sánchez 2, Kristina Zindulková 2
PMCID: PMC10646341  PMID: 37969248

Abstract

Despite the efforts of the EU, disparities remain in terms of the participation of Social Sciences and Humanities (SSH) researchers from both Southern and Central & Eastern Europe in research collaborations, as compared to Northern and Western European scholars. To better understand these disparities, the EU Horizon Europe SSH CENTRE project ran a Call for Evidence over December 2022 to March 2023. Specifically, respondents were asked about the challenges they faced in conducting SSH research on climate, energy and/or mobility, as well as the ways in which these challenges could be addressed. The Call’s online survey was focused on maximising diversity, and it gathered views and experiences of 137 Southern and Central & Eastern European SSH researchers. The sample was balanced across genders (71 men, 66 women) and the three main themes (82 energy, 88 climate, 53 mobility), and included at least one respondent from each of the 27 target countries. The highest numbers of respondents were from Hungary (19) and Spain (21).

To ensure that interpretation and analysis of the data was grounded in regional contexts, we ran two parallel analysis workshops hosted in a hybrid format (combining online and in-person participants): one in Pécs for Central & Eastern European SSH researchers (34 participants); and one in Bilbao for Southern European SSH researchers (26 participants). These workshops focused on discussing the relationship between SSH-STEM disciplines, analysing the institutional contexts, and discussing the implications for domestic and EU research funding relations. During the workshops, data collected through the survey were collectively analysed and the most important reflections were gathered into a common structure of ‘Challenges’ and ‘Ways forward’. Key messages from the workshop are being distilled into a Position Statement that focuses on the common elements while also emphasising possible differences between Southern and Central & Eastern Europe.

Keywords: Research geographies, Fragmentation, Research and innovation policy, Universities, Career pathways, Funding, Mixed methods.

Plain language summary

Research on people and society (i.e. the Social Sciences and Humanities [SSH]) is essential if policymakers and practitioners are to deliver the changes that are urgently needed to address sustainability challenges. Yet, in comparison to the Technical and Natural Sciences (Science, Technology, Engineering, and Mathematics [STEM] disciplines) there are fewer opportunities for SSH research to contribute towards solutions. We would argue that this imbalance is exacerbated within Southern and also Central & Eastern European geographies, which have too often been in the shadow of the more dominant Northern and Western European geographies. For example, it has been shown that most of the funding, project consortia, policy advice, etc. opportunities (and thus prestige) are often associated with Northern and Western universities, or at least those that are closer to the Brussels policy bubble.

The ‘Social Sciences and Humanities for Climate, Energy aNd Transport Research Excellence’ (SSH CENTRE) project undertook a Call for Evidence to obtain the views and experiences of SSH researchers in Southern and Central & Eastern Europe. Insights from the Call for Evidence survey are being developed into a Position Statement that will be submitted to the European Commission with recommendations for how the geographical imbalance mentioned previously can best be addressed within SSH research and innovation policy making. This Data Note details the Call for Evidence’s online survey approach, including what questions were asked, why we asked them, and who responded. We also present our analytical approach which involved using these survey data as a prompt for two regional workshop discussions (involving participation of regional researchers only), which further deepened our understanding of the steps necessary to tackling these challenges.

Introduction

It is increasingly acknowledged that Social Sciences and Humanities (SSH) research insights and evidence are essential if societies are to better understand the implications of, as well as influences behind, sustainability challenges ( Foulds & Robison, 2018; Ingeborgrud et al., 2020; Sovacool et al., 2015). It is in these contexts that dialogue has begun between research and innovation policy actors and SSH researchers, on how institutions need to evolve to help fulfil SSH’s unfulfilled potential ( e.g. Foulds et al., 2022; Krupnik et al., 2022; Ryghaug et al., 2023; Robison & Foulds, 2021).

It is certainly a positive sign that SSH is being taken more seriously and that key institutions ( e.g. European Commission) are starting to do more to establish and deliver upon SSH commitments in research and innovation programmes. However, evidence shows that the experiences of such programmes vary, and thus the expectations and distributional effects are not equal ( Royston & Foulds, 2021; Silvast & Foulds, 2022). This Note focuses on a particular issue in this respect, namely: current SSH research environments (on e.g. climate, energy and mobility) are dominated by scholars and institutions situated in Northern (N) and Western (W) Europe, with researchers from Southern and Central & Eastern Europe being less represented. There is thus a need to better balance research opportunities and participation across these different regions of Europe.

Reflecting calls to address such fragmentation issues, the Horizon Europe ‘Social Sciences and Humanities for Climate, Energy aNd Transport Research Excellence’ (SSH CENTRE) project 1 is writing a Position Statement that will be shared with the European Commission (Directorate-General for Research & Innovation). The Position Statement will focus on how SSH in Southern and Central & Eastern Europe can be better supported, with particular focus placed on supporting research focused on EU climate, energy and mobility policy.

The Position Statement will draw upon insights obtained through: (1) an online survey that focused on the experience of researchers within Southern and Central & Eastern Europe; and (2) two evaluation workshops (one in Bilbao, Spain; one in Pécs, Hungary) which supported the analysis and validation of the survey, as participants discussed challenges and ways forward for SSH within their respective geographies. This Data Note documents these data collection and analysis processes.

This Data Note is structured as follows: first, we outline and justify the methods that were used to collect insights on challenges, institutional contexts and funding relations. We then briefly set out the analysis undertaken and the process through which the survey data informed workshop discussions and the subsequent write-up of a Position Statement. The Data Note ends with a reflection on ethical considerations.

Methods

Research instrument selection

Responses to the Call for Evidence were collected through a web-based survey, using the Limesurvey software 2 . The focus of the survey was on breadth and thus exposure to a variety of perspectives; in-depth insight was not the purpose of this survey. The use of online surveys, rather than other in-person methods, was fundamental in enabling access to the wide range of Southern and Central & Eastern European SSH communities, helping to capture a diversity of views, experiences and perspectives ( Wyatt, 2000).

Research instrument design

Country selection. As the Call for Evidence is part of a Horizon Europe project that develops understandings of how to better incorporate SSH insights into EU policy decisions, our starting point for countries to consider was: the 27 EU Member States; 16 non-EU Member States that are associated with Horizon Europe 3 ; plus the UK, which is seeking association post-Brexit and is currently participating in Horizon Europe via its UKRI guarantee. We also excluded countries that have recently had their EU research and innovation partnerships revoked ( e.g. Russia, Belarus).

Next, given our Call for Evidence’s focus on researchers with experience working (or who have received research training) in Southern or Central & Eastern Europe, we sought to establish which of these countries would be included within the scope of our survey. However, as there is no universally accepted framework for the regional grouping of European countries ( i.e. which are Southern or Central & Eastern), we developed our own categorisation system. Our final categorisation is available at Varjú et al. (2023), with 27 countries deemed to be eligible; 14 in Southern and 13 in Central & Eastern Europe.

In developing our regional categorisations, we studied existing categorisations for Southern and Central & Eastern Europe countries ( e.g. Central Intelligence Agency factbook 4 , United Nations 5 , University of Central Florida libraries 6 ) to identify commonalities in how different countries were treated. The variation across these existing categorisations highlighted the difficulty of developing these categories. For example, some countries can be considered as either Southern or Central & Eastern depending on the categorisation used ( e.g. Slovenia, Bulgaria). Furthermore, in some cases, we also observed that, for example, the category Central Europe did not exist, only Eastern Europe.

The survey sample. The target group to complete the Call for Evidence survey was SSH researchers, although researchers with a STEM background were also able to respond. Recruitment occurred predominantly through a snowball sampling approach as the survey was shared through the SSH CENTRE consortium partners’ research networks. The aim was to obtain insights and perspectives from researchers across Southern and Central & Eastern Europe with a diverse range of characteristics ( e.g. gender, career stage, and SSH disciplines), rather than aim to achieve a statistically representative sample. As such, the snowball sampling approach was complemented by using publicly available databases of researchers ( e.g. Researchgate) and authors in relevant SSH journals ( e.g. Journal of Transport Geography, Sociology) to help identify individuals, which could plug gaps in our sample ( e.g. countries that at one time we had no responses for).

A total of 137 survey responses were collected between 16 December 2022 and 28 March 2023. A summary of the respondents’ main characteristics is available in Table 1.

Table 1. Main characteristics of Call for Evidence survey respondents.

Southern European
respondents (n=68)
Central & Eastern
European respondents (n=69)
All respondents (n=137)
Country breakdown * Spain (21)
Italy (13)
Portugal (6)
Greece (5)
Israel (5)
Turkey (4)
North Macedonia (3)
Albania (2)
Cyprus (2)
Malta (2)
Serbia (2)
Bosnia and Herzegovina (1)
Kosovo (1)
Montenegro (1)
Hungary (19)
Slovenia (9)
Poland (8)
Czechia (7)
Estonia (6)
Romania (6)
Ukraine (3)
Bulgaria (2)
Croatia (2)
Latvia (2)
Republic of Moldova (2)
Slovakia (2)
Lithuania (1)
Spain (21)
Hungary (19)
Italy (13)
Slovenia (9)
Poland (8)
Czechia (7)
Estonia (6)
Portugal (6)
Romania (6)
Greece (5)
Israel (5)
Turkey (4)
North Macedonia (3)
Ukraine (3)
Albania (2)
Bulgaria (2)
Croatia (2)
Cyprus (2)
Latvia (2)
Malta (2)
Republic of Moldova (2)
Serbia (2)
Slovakia (2)
Bosnia and Herzegovina (1)
Kosovo (1)
Lithuania (1)
Montenegro (1)
Broad disciplinary research field SSH (51)
STEM (4)
SSH-STEM interface (13)
SSH (53)
STEM (4)
SSH-STEM interface (12)
SSH (104)
STEM (8)
SSH-STEM interface (25)
Social Sciences and Humanities
(SSH) discipline(s) **
Economics (9)
Human Geography (5)
Environmental Social Science (7)
Politics (5)
Sociology (6)
Psychology (5)
Business (2)
Planning (2)
History (1)
Science and Tech Studies (2)
Social Policy (1)
Communication Studies (2)
Development (1)
Education (2)
Law (2)
Social Anthropology (2)
Philosophy (1)
Economics (11)
Human Geography (11)
Environmental Social Science (7)
Politics (7)
Sociology (2)
Psychology (1)
Business (2)
Planning (2)
History (3)
Science and Tech Studies (1)
Social Policy (2)
Development (1)
Education (2)
Law (2)
Economics (20)
Human Geography (16)
Environmental Social Science (14)
Politics (12)
Sociology (8)
Psychology (6)
Business (4)
Planning (4)
History (4)
Science and Tech Studies (3)
Social Policy (3)
Communication Studies (2)
Development (2)
Education (2)
Law (4)
Social Anthropology (2)
Philosophy (1)
Sustainability research area(s) ** Climate (41)
Energy (42)
Mobility (30)
Climate (47)
Energy (39)
Mobility (23)
Climate (88)
Energy (82)
Mobility (53)
Gender *** Man (37)
Woman (31)
Prefer to self-describe (0)
Man (34)
Woman (35)
Prefer to self-describe (0)
Man (71)
Woman (66)
Prefer to self-describe (0)
Career stage Current postgraduate student (2)
Current postgraduate
researcher (4)
Early Career Researcher (14)
Established Researcher (17)
Senior Researcher (31)
Current postgraduate student (2)
Current postgraduate
researcher (5)
Early Career Researcher (16)
Established Researcher (24)
Senior Researcher (22)
Current postgraduate student (4)
Current postgraduate researcher
(9)
Early Career Researcher (30)
Established Researcher (41)
Senior Researcher (53)

* Based on the answer to the following survey question: “I am answering these questions in relation to the following country” ( i.e. it was not based on their nationality or where they were currently living).

** Respondents could tick more than one answer.

*** Their gender was not assumed. A survey question asked the respondents to explicitly self-assign their genders.

The number of responses is well-balanced between Southern (68 responses) and Central & Eastern (69) Europe countries. Importantly, we received at least one response from every one of the 27 eligible countries. The highest number of respondents were from Spain (21) and Hungary (19), where the two analysis and validation workshops on the survey responses took place. Responses were also fairly balanced in terms of gender representation (71 men, 66 women).

The majority of respondents held PhD degrees, with responses from senior researchers (54), established researchers (31) and early career researchers (30) dominating the responses. Among Southern European respondents, there was a higher share of those who identified themselves as senior researchers (31 out of 69), while in the case of Central & Eastern Europe a similar number of respondents represented senior (22) and established researchers (24).

The research domain of respondents was predominantly SSH (104 out of 137), although 25 respondents identified as interdisciplinary researchers (i.e. spanning both SSH and STEM to various extents). The number of responses from purely STEM researchers was low (8). Across the Southern and Central & Eastern European respondents, there were similar levels of responses from SSH, STEM and interdisciplinary researchers. Considering the disciplines covered in the survey, the most represented SSH disciplines were Economics (20), Human Geography (16), Environmental Social Science (14), and Politics (12). At least one response was also submitted from each of the disciplines of Communication Studies, Development, Education, Law, Social Anthropology, and Philosophy.

Constructing survey questions. The Call for Evidence survey was structured around four sections: (1) the nature of collaboration between SSH and STEM; (2) the position of SSH in the countries’ institutional systems (compared to STEM); (3) the position of SSH in funding opportunities; and (4) ease or difficulties in joining EU research projects/funding. The survey included both qualitative and quantitative questions, with the combination of these questions enabling insights that both provided an overall picture of respondents and their characteristics (including e.g. age, gender, career stage), as well as richer detail related to their views and experiences ( Esturo et al., 2023). The survey questions provided respondents with the opportunity to reflect on how they could be supported during collaborative research with STEM, in institutional settings, and also in terms of funding opportunities. The full set of survey questions are available at Varjú et al. (2023).

The questions were developed through an iterative process. The survey was initially piloted (16 November – 13 December 2022) with selected SSH CENTRE consortium members based in Southern and Central & Eastern geographies, particularly with a focus on completion duration and comprehension of survey questions. Several rounds of iterations helped improve question styles, unique country identifiers, as well as how to cater for a range of disciplinary fields.

Survey analysis, workshop validation procedures and identification of recommendations

The survey responses were discussed and validated during two regional hybrid workshops, en route to recommendations being produced for submission to the European Commission (in the form of a Position Statement with 12 recommendations). The three data analysis and validation steps are now detailed.

Step 1 - Interpreting survey responses

Step 1 of analysing and validating the gathered 137 survey responses involved two analyses. First, a thematic analysis was conducted on the qualitative survey data, particularly focusing on the open questions ( i.e. related to experiences and perspectives). Second, basic descriptive statistics were performed on the quantitative data, primarily concerning the demographic information of the survey respondents.

Both of these analyses aimed to identify common issues across the responses from Southern and Central & Eastern Europe, as well as within each region individually.

The outcomes of these analyses yielded two main results. Firstly, several priority discussion themes inductively emerged, supported by relevant quotations, which served as focal points for Step 2. For Southern Europe, three priority themes were identified: (i) SSH visibility and SSH-STEM relations; (ii) institutional support; and (iii) funding. For Central & Eastern Europe, a similar three were also identified: (i) roles and position of SSH in Central & Eastern European countries in energy, climate and mobility; (ii) funding; and (iii) solutions. Secondly, information about the respondents' sample and background was provided, offering valuable context for understanding the identified priority themes and quotations.

Step 2 - Collective data analysis and discussion via workshops

Two hybrid analysis workshops were held consecutively: one in Southern Europe in Bilbao 7 , and one in Central & Eastern Europe in Pécs 8 . Participation in the workshop was by invitation, to help ensure diverse geographical and disciplinary representation, as well as a gender balance. Each workshop participant had experience of undertaking research within Southern or Central & Eastern Europe. They also either identified as an SSH researcher or were supportive of engaging with SSH research. Before the workshop, all participants needed to have completed the Call for Evidence survey too.

The majority of the workshops’ 60 participants 9 were identified through SSH CENTRE consortium contacts or searches of relevant research institutions in Southern and Central & Eastern Europe. When wanting to address particular gaps in either geography or discipline, relevant survey respondents (who consented to being contacted about the workshop) were invited. Collectively, the participants of the workshops had experience working in at least 18 SSH research disciplines, as well as research environments in 23 different Southern and Central & Eastern European countries.

Inspired by previous experiences on participatory analysis of mixed quantitative and qualitative data ( e.g. Di Felice et al., 2021), the workshops were a means of situating the Call for Evidence and collectively analysing and interpreting answers with a wider invited audience of Southern or Central & Eastern European researchers. Participants of both workshops therefore were also invited to be co-authors of the Position Statement, as the conclusions and recommendations were co-designed (see ‘Step 3’ section below). Co-hosting the workshops with partners beyond the project’s consortium also helped provide the means to situate the debate with researchers from across the region, thereby bringing in diverse perspectives from research/action spaces on-the-ground.

Both workshops followed a similar structure: following a presentation of the survey respondent sample descriptive statistics, we interrogated and began with the primary themes identified in Step 1. We presented the themes in-depth - including e.g. challenges, tensions, opportunities, perceptions, unanswered questions, etc. - and evidenced these with a range of quotations that were sourced from respondents in their region ( i.e. either Southern or Central & Eastern Europe). It was important that the workshop’s analysis and validation discussion remained at the regional level, thereby ensuring that local contexts could be better accounted for.

Then, smaller breakout groups (of five-eight people) were formed to provide the space for participants to reflect (via facilitated negotiation) on the themes presented. These reflections were summarised in writing by facilitators. Regrouping at plenary sessions then enabled knowledge exchange from the breakout groups as well as provided a space for collective deliberation and aligning priorities.

The outcomes of Step 2 were thus in-depth, detailed facilitator notes that synthesised and validated priority issues, to better support SSH in Southern or Central & Eastern Europe. The personal nature of these in-depth discussions (relating to e.g. career experiences) meant that these data could not be meaningfully anonymised and thus were not publicly shared.

Step 3 - Identifying recommendations in the form of a Position Statement

During Step 2, in the plenary sessions, there was an emphasis on (i) noting points of divergence and convergence across the workshop participants, and (ii) discussing overarching key messages and ways in which recommendation statements could potentially be narrated. The two sets of written outputs (together with the original survey response and analysis) then informed the development of a draft Position Statement that captured challenges experienced by SSH researchers in Southern and Central & Eastern Europe, as well as suggested actions that funders and research institutions in particular can take, through 12 recommendations. This draft Position Statement was circulated to workshop participants for feedback and final refinement in May 2023. The Position Statement will be shared with the European Commission (Directorate-General for Research & Innovation).

Ethics and consent

The survey, and its analysis method, was approved by the School Research Ethics Panel located within Anglia Ruskin University’s Global Sustainability Institute (reference number of ETH2223-0756; approval date of 11 November 2022). This process ensured that the questions asked and data collected: complied with the university’s ethical requirements; ensured written informed consent; and was compliant with the EU General Data Protection Regulation (GDPR).

The front matter of the survey outlined (1) the purpose of the survey; (2) the type of data that would be collected ( e.g. Name/Contact Details, Age, Gender, Experiences); (3) how this data would be used; and (4) who would have access to the data. In order to proceed to the survey itself, survey respondents were required to tick boxes related to consent statements, with this ensuring informed consent was obtained. These statements included agreeing to participate in the survey, understanding who would be able to access the data (complying with GDPR), and understanding that the data would be anonymised. The survey was designed to only include questions that provided relevant and required data, thus adhering to the principle of data minimisation too.

The anonymisation of the data occurred in two phases. The first phase included going through the qualitative responses to open-ended questions and removing all references to places, projects and organisations that could be used to identify an individual respondent. The second phase of anonymisation involved separating the demographic data collected ( e.g. age, gender, career stage) from the other survey responses that focused on respondent experiences. The demographic data was then randomised, so that there would be no cross-referencing ( i.e. between the respondent demographic and the respondent experiences questions), thus reducing the likelihood of individual respondents being identifiable.

Acknowledgements

We thank all the survey respondents for sharing their experiences and views, as well as the participants of our two analysis workshops for their insights and deliberations. We also thank Wikitoki and the Central European Initiative for kindly co-hosting the workshops. Finally, we are grateful to our SSH CENTRE partner colleagues for their input at consortium meetings and for their assistance in disseminating the survey.

Funding Statement

This research was financially supported by the European Union’s Horizon Europe research and innovation programme under the grant agreement No 101069529 (Social Sciences and Humanities for Climate, Energy and Transport Research Excellence [SSH CENTRE]) and by UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee [grant No 10038991].

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; peer review: 3 approved, 1 approved with reservations]

Footnotes

7 Co-hosted by the Basque Centre for Climate Change and Wikitoki on 17 March 2023. 26 participants attended the workshop, with a gender breakdown of 16 women and 10 men.

8 Co-hosted by the Institute for Regional Studies and the Central European Initiative on 28 March 2023. 34 participants attended the workshop, with a gender breakdown of 19 women and 15 men.

9 Note that the sum listed here may not correspond to the names of the authors in the Position Statement, as several workshop participants abstained from authorship.

Data availability

All data and materials are available on Zenodo.

Underlying data

This project contains the following data:

  •       ○  The full, anonymised version of the survey export file (xlsx) from Limesurvey, including consent statements and all participant responses.

Extended data

This project contains the following data:

  •       ○  The contents of the survey ( i.e. survey front matter and all survey questions), as well as the list of selected countries that were classified as Southern European or Central & Eastern European for the purposes of this research project.

This project contains the following data:

  •       ○  The agendas and consent form used in the two hybrid workshops, as part of collectively analysing the Call for Evidence survey data/findings and distilling relevant recommendations.

Data are available under the terms of the Creative Commons Attribution 4.0 International licence (CC-BY 4.0).

References

  1. Di Felice LJ, Cabello V, Madrid-Lopez C, et al. : Quantitative Storytelling: Science, Narratives, and Uncertainty in Nexus Innovations. Sci Technol Human Values. 2021;48(4):861–887. 10.1177/01622439211053819 [DOI] [Google Scholar]
  2. Esturo A, Lizundia E, Sáez de Cámara E: Fruit Juice Industry’s Transition Towards Sustainability from the Viewpoint of the Producers. Sustainability. 2023;15(4): 3066. 10.3390/su15043066 [DOI] [Google Scholar]
  3. Foulds C, Robison R: Mobilising the energy-related social sciences and humanities.In: Foulds, C., Robison, R. (Eds.) Advancing Energy Policy: Lessons on the integration of Social Sciences and Humanities.Cham: Palgrave Macmillan.2018;1–11. 10.1007/978-3-319-99097-2_1 [DOI] [Google Scholar]
  4. Foulds C, Royston S, Berker T, et al. : An agenda for future interdisciplinary Social Sciences and Humanities research on energy efficiency: 100 priority research questions. Humanit Soc Sci Commun. 2022;9(1): 223. 10.1057/s41599-022-01243-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Ingeborgrud L, Heidenreich S, Ryghaug M, et al. : Expanding the scope and implications of energy research: a guide to key themes and concepts from the Social Sciences and Humanities. Energy Res Soc Sci. 2020;63: 101398. 10.1016/j.erss.2019.101398 [DOI] [Google Scholar]
  6. Krupnik S, Wagner A, Vincent O, et al. : Beyond technology: A research agenda for social sciences and humanities research on renewable energy in Europe. Energy Res Soc Sci. 2022;89: 102536. 10.1016/j.erss.2022.102536 [DOI] [Google Scholar]
  7. Robison R, Foulds C: Social Sciences and Humanities for the European Green Deal. 10 recommendations from the EU Energy SSH Innovation Forum.Cambridge: Energy-SHIFTS,2021. Reference Source [Google Scholar]
  8. Royston S, Foulds C: The making of energy evidence: How exclusions of Social Sciences and Humanities are reproduced (and what researchers can do about it). Energy Res Soc Sci. 2021;77: 102084. 10.1016/j.erss.2021.102084 [DOI] [Google Scholar]
  9. Ryghaug M, Subotički I, Smeds E, et al. : A Social Sciences and Humanities research agenda for transport and mobility in Europe: key themes and 100 research questions. Transport Reviews. 2023;43(4):755–779. 10.1080/01441647.2023.2167887 [DOI] [Google Scholar]
  10. Silvast A, Foulds C: Sociology of interdisciplinarity: dynamics of energy research.Cham: Palgrave Macmillan,2022. 10.1007/978-3-030-88455-0 [DOI] [Google Scholar]
  11. Sovacool BK, Ryan SE, Stern PC, et al. : Integrating social science in energy research. Energy Res Soc Sci. 2015;6:95–99. 10.1016/j.erss.2014.12.005 [DOI] [Google Scholar]
  12. Varjú V, Bálint D, Cabello V, et al. : SSH CENTRE: T1.3.1 Call for evidence survey extended data. Zenodo. 2023. 10.5281/zenodo.8080979 [DOI] [Google Scholar]
  13. Wyatt JC: When to Use Web-based Surveys. J Am Med Inform Assoc. 2000;7(4):426–430. 10.1136/jamia.2000.0070426 [DOI] [PMC free article] [PubMed] [Google Scholar]
Open Res Eur. 2023 Nov 14. doi: 10.21956/openreseurope.17531.r36051

Reviewer response for version 1

Federica Rotondo 1

Summary:

The “data note” focuses on the disparities in terms of research opportunities and participation for SSH and STEM researchers to contribute to projects addressing sustainability challenges. Particular attention is given to the imbalance between Southern and Central & Eastern European countries (less represented) and Northern and Western European countries (highly predominant).

The work develops a three steps approach. At first an on-line survey is elaborated and diffused to better understand the experience of researchers in Southern and Central & Eastern European countries. After that, two hybrid workshops are organised to discuss the survey results and to outline possibile ways forward for SSH researchers based in different locations. Finally insights of the activities lead towards the elaboration of a Position Statement that will be shared with the European Commission, including some recommendation to address the geographical imbalance of SSH research and to support SSH researchers of central/eastern/southern European countries

General comments and specific issues:

Overall, the contribution is well structured and presents original features. Some improvements can be made in the direction of better specifying methods and materials at different steps of your work. Moreover the anonymous version of the survey outcomes is not accesible to the author of this review. Below are some useful points for the implementation of the paper.

  • About the sentence “it has been shown that most of the funding, project consortia, policy advice, etc. opportunities (and thus prestige) are often associated with Northern and Western universities, or at least those that are CLOSER to the Brussels policy bubble”.  Do you mean geographically closer? Or, for example, politically closer? You should either detail or reframe the sentence.

  • About the country selection: to better clarify your categorisation of countries you could specify the criteria you adopted to categorise a country as part of southern/central/Eastern Europe. For example: by looking at the pdf "country groups_3" (https://zenodo.org/records/8080979) it seems that you included Czech Republic, Slovakia, Hungary and Slovenia but not Austria. The reason is not fully clear.

  • On the survey sample: to better understand the snowball sampling phase it would be helpful to explicit what are the disciplines of researchers involved in the SSH CENTRE consortium partners and to report what are the disciplines of the 137 respondents.

  • On step 1: the priority themes that emerged from the interpretation of survey responses could be expanded. I would like to better understand what the respondents refer to by mentioning "SSH visibility" or "SSH-STEM relation" or what is the different claims about "funding" in Southern European and in Central & Eastern Europe.

  • On step 2: you could specify, in a table or graph, what are the 18 SSH research disciplines and the 23 Southern and Central & Eastern European countries of the participants of the workshops. Since you pointed out that the discussion remained at the regional level, I think you should better explain what you mean by regional level.

  • About step 2 outcomes: you could better specify how the discussions lead to the synthesis and validation of priority issues. After the discussion how the priority issues eventually change? Based on which criteria? Could you also better specify the role of facilitator?

  • About step 3: it would be useful to understand the general structure of the draft position statements that circulated to workshop participants for feedback. How did you take into account the regional specificities?

Are sufficient details of methods and materials provided to allow replication by others?

Partly

Is the rationale for creating the dataset(s) clearly described?

Yes

Are the datasets clearly presented in a useable and accessible format?

Partly

Are the protocols appropriate and is the work technically sound?

Yes

Reviewer Expertise:

Urban planning, urban policy and design

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2023 Nov 14. doi: 10.21956/openreseurope.17531.r35497

Reviewer response for version 1

Giulia Sonetti 1

The article provides a comprehensive overview of a survey conducted to understand the dynamics of SSH and STEM collaborations in Southern and Central & Eastern Europe. The rationale for creating the dataset is well-articulated, focusing on exploring the nature of collaboration, institutional positioning, funding opportunities, and ease of joining EU research projects.

The methods employed for data collection and analysis are robust, involving a mixed-methods approach with qualitative and quantitative elements. The iterative development of survey questions and pilot testing adds to the credibility of the process. However, for replication purposes, the authors could provide more detailed information on the specific methodologies for thematic analysis and statistical analysis.

While the dataset's composition is described in terms of the type of responses collected, information on the format and accessibility of the dataset for public use is somewhat lacking. To enhance the utility of this research, the authors should consider providing clear details on how the dataset is formatted and where it can be accessed.

Overall, the study is well-conducted and provides valuable insights into SSH and STEM collaborations in the European context. To enhance its scientific soundness and replicability, minor improvements in detailing the analytical methods and clarifying the dataset's presentation are recommended.

Are sufficient details of methods and materials provided to allow replication by others?

Partly

Is the rationale for creating the dataset(s) clearly described?

Yes

Are the datasets clearly presented in a useable and accessible format?

Yes

Are the protocols appropriate and is the work technically sound?

Yes

Reviewer Expertise:

Transdisciplinarity, Sustainability Science

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2023 Nov 14. doi: 10.21956/openreseurope.17531.r36049

Reviewer response for version 1

Thomas Berker 1

Thank you for the opportunity to try out this open peer review process, which was a new experience for me. That the review is openly accessible together with the article allows me to comment without forcing the authors to respond or alter their text. This is why I divide the following remarks between "methodological reflections" that may or may not be useful for the authors and the reader and recommendations for minor changes that in my view would improve the text.

Short summary:

This data note describes and justifies the methodological choices made in a research project on the challenges and opportunities of working in Southern and Central/Eastern European SSH research on climate, energy and mobility. The empirical work consisted of an online survey (N=137) and two hybrid workshops (N=60).

Recommendations:

  • The sampling strategy was nonprobabilistic and based on self-selection and snowball sampling. Both are pragmatic and effective but snowball sampling has the effect that networks of the people selected initially will dominate the sample. Effects of this should be discussed in the data note.

  • Is it possible that in addition to snowball sampling, elements of purposive sampling and maybe also a weak form of quota sampling were employed? The latter is hinted at when the goal 'to achieve a diverse range of characteristics' (gender, career stage, disciplines) is mentioned (p.4). Did you do active work to fill specific quotas (e.g., of women) or am I misunderstanding this remark?

  • Probably to broaden participation, a weak criterion for being able to talk about/for Southern/Eastern/Central European SSH was used: "some time studying at postgraduate level or working as a researcher". Question 19 [Q_2a]a asks whether respondents currently live in the country they are answering for, while the following questions are open for respondents that may only have had short stays there, potentially many years ago. What is the reason for including both types of questions? It does make a difference whether one is answering after having left the country or not, but was this difference used in the analysis? More information in the data note on these questions of definition would be useful.

  • Why did you include STEM researchers in the sample? Surely not to compare experiences between STEM and SSH respondents (the STEM group is too tiny for this)?

  • The relation between workshops and the survey remains somewhat unclear. First you did a thematic analysis of the survey results which produced quotes that could be used as 'focal points' for the workshops. Additionally, very broad priority themes (e.g., 'funding', 'visibility', 'STEM-SSH-relations') were identified that were discussed at the workshops. But the terms 'collective data analysis' and 'validation' hint at a stronger relation. The outcome here, 'in-depth, detailed facilitator notes' (that cannot be published) seems like a weak outcome of the 'collaborative analysis' and 'validation'. It might be advisable to avoid these terms or to define better what they mean in the context in which they are used here.

Methodological reflections:

In any empirical study, how the object of inquiry is constructed should be carefully justified. The danger to create a method artifact, i.e. to construct objects that say more about the methodological choices than about anything else, is always real. The assumption that SSH researchers from Southern and from Central/Eastern Europe experience a set of common problems compared to their Western and Northern European colleagues makes only sense if one accepts the premise that they are a group - or maybe two groups - with common features and working under similar conditions. The authors acknowledge that Eastern, Central and Southern European are categories that are understood differently and may entail unclear boundaries and overlaps. The chosen solution - a catalogue of countries based on pragmatic, institutional and political reasoning - is good enough. However, what may be more problematic is that these broad categories include very different countries with widely different research landscapes, histories, economic contexts, etc. And then there are obviously disparities within countries and also within institutions and between different SSH disciplines. In this context it may be particularly problematic that the snowball sampling for the survey started with consortium members, i.e. researchers that are engaged in an ongoing collaboration with powerful European research nodes that - not accidentally - reside in Western Europe.

Moreover, large parts of European SSH research were excluded from the empirical inquiry through the assumption that the English language is the lingua franca in all academic contexts, which is particularly untrue in SSH. The authors were aware of the danger that they may end up creating a research object, which may or may not say anything about SSH research in Southern and Central/Eastern Europe. The workshops in Hungary and Spain were explicitly framed as a way to validate and situate the debate in a specific region, e.g. by including local researchers that were not part of the consortium. Ideally, these workshops would have allowed to shed light on disparities in European SSH in their specific, multi-dimensional form (within institutions, between disciplines, between institutions, between regions, etc.). However, situated accounts like this would not be able to become position statements and generate input suitable for the European Commission. But they would avoid the temptation to 'see like a (transnational) state', which constructs its objects according to its priorities. The objects Southern and Central/Eastern Europe make a lot of sense in the context of European economic integration. Whether they are good objects for an empirical investigation of inequality in European research is another question - a question which is not answered by this data note.

Are sufficient details of methods and materials provided to allow replication by others?

Yes

Is the rationale for creating the dataset(s) clearly described?

Yes

Are the datasets clearly presented in a useable and accessible format?

Yes

Are the protocols appropriate and is the work technically sound?

Yes

Reviewer Expertise:

Science and technology studies, sociology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2023 Nov 3. doi: 10.21956/openreseurope.17531.r35499

Reviewer response for version 1

Osman Arrobbio 1

The EU Horizon Europe SSH CENTRE project aimed to understand and address disparities in the participation of Social Sciences and Humanities (SSH) researchers from different European regions in climate, energy, and mobility research. More precisely, this research project addresses the underrepresentation of SSH researchers from Southern and Central & Eastern Europe.

The authors collected 137 responses from Southern and Central & Eastern Europe SSH researchers, conducted two regional workshops, and are preparing a Position Statement with recommendations for the European Commission to address these disparities.

A web-based survey was used to collect responses from SSH researchers in Southern and Central & Eastern Europe.

The survey and its analysis were approved by an ethics panel. Informed consent was obtained through a clear explanation of the survey's purpose and data handling, with active agreement from respondents. Data minimization principles were followed to collect only necessary data.

Snowball sampling and publicly available databases were used for recruitment.

The survey questions covered collaboration, institutional support, funding, and participation in EU projects.

Data analysis and validation were done in three steps:

  • Step 1 involved thematic analysis and descriptive statistics.

  • Step 2 consisted of two regional workshops in Southern and Central & Eastern Europe to discuss the survey data.

  • Step 3 focused on identifying recommendations for a Position Statement.

The workshops involved participants from various disciplines (mainly SSH) and countries from the investigated European regions, and the findings informed the development of the Position Statement.

The author can find below some comments and suggestions (neither listed in order of importance nor appearance):

  1. On the use of “European” or “Europe” (for example, in sentences like “[…] it gathered views and experiences of 137 Southern and Central & Eastern European SSH researchers”). Please consider that I am not a native English speaker, but I wonder whether the use of “Europe” would make clearer to the reader that those SSH researchers are from S and C&E Europe and may thus not necessarily have a S or C&E European nationality.

  2. Through which channel(s) were people invited to participate to the survey? E.g. through personal contacts, through communications on websites?

  3. “[…] those who identified themselves as senior researchers (31 out of 69) […]” Maybe it is 31 out of 68?

  4. “[…] while in the case of Central & Eastern Europe a similar number of respondents represented senior (22) and established researchers (24).” Add “out of 69”?

  5. “The research domain of respondents was predominantly SSH (104 out of 137)”. What about making clear that the research domain was self-reported by respondents?

  6. I would make clear that the survey was in English.

  7. “The highest number of respondents were from Spain (21) and Hungary (19) […]”. This does not completely correspond to what is written in one of the notes to Table 1, where it says that “Based on the answer to the following survey question: ‘I am answering these questions in relation to the following country’ (i.e. it was not based on their nationality or where they were currently living).” I suggest rephrasing it like this (or any other more elegant form): “The highest number of responses were related to Spain (21) and Hungary (19)”.

  8. “At least one response was also submitted from each of the disciplines of Communication Studies, Development, Education, Law, Social Anthropology, and Philosophy”. If I have well understood, this list contains the least represented disciplines. However, from what I see in Table 1 there are some disciplines (Science and Tech Studies; Social Policy) that are less represented than Law. Please, check those figures in Table 1 and modify the list (in the reported sentence and/or the ordering of disciplines in Table 1).

  9. Table 1. Section ‘Social Sciences and Humanities (SSH) discipline(s)’. Please, specify whether this question was posed only to those who self-defined as SSH researchers?

  10. Table 1. Section ‘Sustainability Research Areas’. Please check the figures related to Energy.

  11. Table 1. I wonder if you could also add the age of respondents.

  12. You listed the three priority themes for both regions. Are these priorities listed by importance? In case I would specify it.

  13. “The majority of the workshops’ 60 participants were identified through SSH CENTRE consortium contacts […]”. Would it be possible to include the composition of the SSH CENTRE consortium (e.g., among the supplementary materials)?

  14. Not an expert on this, but please consider if it is necessary/useful to remove some data (e.g. from open-ended answers) from the supplementary material. I mean, in order to decrease even more the possibility for respondents to be identifiable.

  15. In the paragraph where you describe the workshops structure, I suggest you to say that the agendas can be found among the supplementary materials.

  16. Workshops were held in a hybrid (online and in person) format. Did this create difficulties? If yes, how did you manage them?

  17. Among the supplementary materials, I suggest you clean up the xlsx file a little bit to make it more quickly usable. For example, some respondents used “Czeck Republik” and others “Czekia”. Maybe you could decide on just one formulation. Also, some countries have two “versions” depending on whether respondents add or not a space after the name of the country. (e.g. the cases of Israel and Greece).

Are sufficient details of methods and materials provided to allow replication by others?

Partly

Is the rationale for creating the dataset(s) clearly described?

Yes

Are the datasets clearly presented in a useable and accessible format?

Partly

Are the protocols appropriate and is the work technically sound?

Yes

Reviewer Expertise:

Sociology of the environment. Sociology of energy.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    All data and materials are available on Zenodo.

    Underlying data

    This project contains the following data:

    •       ○  The full, anonymised version of the survey export file (xlsx) from Limesurvey, including consent statements and all participant responses.

    Extended data

    This project contains the following data:

    •       ○  The contents of the survey ( i.e. survey front matter and all survey questions), as well as the list of selected countries that were classified as Southern European or Central & Eastern European for the purposes of this research project.

    This project contains the following data:

    •       ○  The agendas and consent form used in the two hybrid workshops, as part of collectively analysing the Call for Evidence survey data/findings and distilling relevant recommendations.

    Data are available under the terms of the Creative Commons Attribution 4.0 International licence (CC-BY 4.0).


    Articles from Open Research Europe are provided here courtesy of European Commission, Directorate General for Research and Innovation

    RESOURCES