Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
letter
. 2021 Mar 15;6:58. [Version 1] doi: 10.12688/wellcomeopenres.16535.1

Towards a feminist philosophy of engagements in health-related research

Sonja Erikainen 1,a, Ellen Stewart 1, Sarah Chan 1, Sarah Cunningham-Burley 1, Sophie Ilson 1, Gabrielle King 1, Carol Porteous 1, Stephanie Sinclair 1
PMCID: PMC8837807  PMID: 35211657

Abstract

Engagement with publics, patients, and stakeholders is an important part of the health research environment in the UK and beyond today, and different ‘engaged’ health research modalities have proliferated in recent years. Yet, the conceptual landscape currently surrounding engagement is contested. There is no consensus on what, exactly, ‘engaging’ means, what it should look like, and what the aims, justifications, or motivations for it should be. In this paper, we set out what we see as important, outstanding challenges around the practice and theory of engaging and consider the tensions and possibilities that the diverse landscape of engaging evokes. We examine the roots, present modalities and institutional frameworks that have been erected around engaging, including how they shape and delimit how engagements are framed, enacted, and justified. We inspect the related issue of knowledge production within and through engagements, addressing whether engagements can, or should, be framed as knowledge producing activities. We then unpack the question of how engagements are or could be valued and evaluated, emphasising the plural ways in which ‘value’ can be conceptualised and generated. We conclude by calling for a philosophy of engagements that can capture the diversity of related practices, concepts and justifications around engagements, and account for the plurality of knowledges and kinds of value that engagements engender, while remaining flexible and attentive to the structural conditions under which engagements occur. Such philosophy should be a feminist one, informed by feminist epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing. This will enable a synergy of empirical, epistemic, and normative considerations in developing accounts of engaging in both theory and praxis. Modestly, here, we hope to carve out the starting points for this work.

Keywords: engagement, involvement, health research, feminist, epistemology, evaluation

Disclaimer

The views expressed in the article are those of the author(s). Publication in Wellcome Open Research does not imply endorsement by Wellcome.

From patient involvement panels to twitter chats to citizens’ juries, public engagement is part of the health research environment in the UK today. The terms ‘engagement’ and ‘involvement’ are part of a spacious conceptual landscape where multiple terms are used simultaneously and in overlapping ways across academic, policy and public discourses. These include ‘public,’ ‘patient,’ ‘community,’ or ‘stakeholder’ ‘participation,’ knowledge ‘communication,’ ‘exchange,’ and ‘co-production.’ These terms are also connected with phenomena such as ‘citizen science’ and ‘lifelong learning.’ While the different concepts collate diverse, sometimes conflicting practices, mechanisms and frameworks for conceptualising and enacting the relationship between science and wider society, it is no longer considered acceptable for the practice of health research to be ‘un’-engaged.

There is no consensus on what, exactly, ‘engaging’ means, or what it should look like, and this gives rise to a need for critical interrogation of the concepts and practices around engaging (c.f. Crowe et al., 2020; Stilgoe et al., 2014). Different terms frame the people who are to be engaged with, and their roles, in different ways that performatively shape practices of engaging, including, for example, whether they are ‘involved’ in, ‘engaged’ with, or ‘co-producers’ of research. While many terms centre the ‘public’ as those who are engaged with, others focus on specific groups such as ‘patients’ or ‘stakeholders.’ There has also been a shift away from the notion of a singular, undifferentiated public with a unified perspective, towards a recognition of publics as plural, acknowledging the diversity of groups and individuals who are not framed only in contrast to health professionals/researchers (c.f. Felt & Fochler, 2010). Concurrently, despite the multiplicity of terms used to describe engaging and engagement, those who are doing the engaging are rarely explicitly specified. Rather, their identities remain implicit yet presumed, i.e. scientists, health professionals, researchers. Yet a distinction is generally drawn between the ‘engagers’ and the ‘engagees’ as the two sides in the science/society relationship. The central role of public engagement professionals, who often plan and undertake the engaging, is also frequently left silent across all these conceptualisations.

There is no consensus on what the aims, justifications, or motivations of engaging are, or should be. Notably, Fiorino (1990) distinguished between substantive rationales, where engagements are being justified because they lead to better ends through dialogue; instrumental rationales, where engagements are undertaken to achieve some other pre-defined end, such as ‘better trust in science’; and normative rationales, where engagements are justified because they are the ‘right thing’ to do. This distinction has retained analytic purchase subsequently (e.g. StIrling, 2008). While the different justifications for engaging are not always as clear in practice as such a typology suggests, typologies can nonetheless highlight how different positions sit in tension to each other.

The proliferation of different ‘engaged’ health research modalities, and the contested conceptual landscape currently surrounding public engagement, raise the quite simple questions of what, exactly, is going on here, and how should we navigate and make sense of this melee of concepts and practices? In this paper, we, an interdisciplinary group of social science and humanities scholars working within health-related research, build on our different disciplinary perspectives and experiences to set out what we see as important, outstanding challenges around the practice and theory of engaging. The paper was generated through many discussions and collective writing, motivated by our shared concern around the manifestations of engaging in a context where public engagement has been persuasively mainstreamed. This has occurred despite the lack of consensus highlighted above, and the underplayed epistemic dimensions, power relations, and varied value frames that characterise engaging. Our aim here is to move beyond questions of terminology to consider the tensions and possibilities that the diverse landscape of engaging evokes; we will not create another typology or argue for the use of specific terms over others. To signal this attempt at synthesis that challenges and moves us forward, we will use the term ‘engagements,’ both for practical reasons, as an umbrella concept that can capture the plural, interlaced and overlapping practices that circulate in this space. ‘Engagements’ function as ‘problem concept’ that can be worked with yet has many uses and no settled meaning (see also Parry et al., 2012). Notwithstanding the conceptual and practical ambiguity of the object, there is analytic value in considering the broad range of engagements together, allowing reflection on the intrinsic tensions, discomforts, and possibilities around doing and researching engagements.

In what follows, we consider the roots, present modalities and institutional frameworks that have been erected around engagements, including how these shape and delimit how engagements are framed, enacted, and justified. We also consider the implications of this for developing alternative practices and frameworks that could enable flexibility and contextually relevant diversity. We examine the related issue of knowledge production within and through engagements, addressing whether engagements can, or should, be framed as knowledge producing activities, what kinds of knowledge they might generate, and who is (and is not) positioned as a knowledge producer, within the confines of wider power relations and epistemic hierarchies that constrain the roles that can be attributed to different actors. We then unpack how engagements are or could be valued and evaluated, emphasising the plural ways in which ‘value’ can be conceptualised and generated by different actors involved in engagements, and how this plurality limits the ability to fix or measure value from engagements.

We conclude by calling for a philosophy of engagements that can capture the diversity of related practices, concepts and justifications around engagements, and account for the plurality of knowledges, knowledge producers and kinds of value that engagements engender, while remaining flexible and attentive to the structural conditions under which engagements occur (see also Mockford et al., 2012; Rowland et al., 2017). We argue that this philosophy should be a feminist one, informed by feminist epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing. This will enable a synergy of empirical, epistemic and normative considerations in developing accounts of engagements in both theory and praxis. Modestly, we hope to carve out the starting points for this work.

The roots, manifestations, and mainstreaming of ‘engaged research’

The current landscape of engagements within health-related research has been significantly crafted by changing social and institutional contexts, policies, and wider questions of research governance. Among the most influential developments have been the changing relationship between doctors and patients, partially driven by patient and health advocacy and activist movements since the 1960s, including the women’s liberation health movement, HIV/AIDS activism and disability and mental health movements. These have all demanded and provided access to and created their own health knowledge, giving rise to some of the first ‘expert patients,’ as patients and activists became disillusioned with professionals’ ability to treat them and the control exerted over the definition and management of their bodies, health and illness by healthcare professionals ( Berghs et al., 2020; Epstein, 1996; Murphy, 2012; Rosenberg & Rosenberg, 2018). This sparked a shift in the relationship between patients and healthcare organisations as well as between research participants and research institutions, as patients and participants increasingly demanded recognition of their agency and rights, including to participate in healthcare and health research decision-making. Another influential shift has been that towards transparency in having publics involved in governance and ethical decision-making, including following medical malpractice cases and in the development of controversial technologies that raised questions about, and undermined, public trust in science. For example, IVF techniques in the 1980s incited public debate in the UK about the responsibilities that scientists and science itself (should) have towards society. This served to catalyse increased involvement of publics in science governance and public debate on who should have the authority to make decisions about ethical questions raised by science in a context of disagreement and value pluralism ( Moore, 2010).

Developments like these constitute a background against which engagements have become increasingly mainstreamed, and institutionalised. Today, patients and publics are participating in health research and healthcare in more diverse ways than before through mandates for engaged research, beyond being (merely) recipients of information and services from health professionals. For example, the UK National Institute for Health Research (NIHR) has made ‘patient and public involvement’ a requirement for research funding, with other funders following suit. Recently, the NIHR, among others, have also begun to use the term ‘co-production,’ entailing a conceptual shift towards more egalitarian and collaborative models as an avenue for improving health research engagements ( NIHR, 2015). The NIHR has been influential in defining, through guidance and policy, what constitutes ‘good’ engagements, especially through their INVOLVE programme, which initially supported engagements in the National Health Service (NHS). INVOLVE (2012) published resources setting terms of ‘good practice’ in engagements, including guidance for researchers on how to involve publics. Other organisations, such as the Jefferson centre in the US also define ‘best practice’, in this case in relation to the approach to citizens juries that they promote ( Jefferson Centre, 2020). More generally, engagements are increasingly tethered to institutional practices, including universities setting up their own structures and processes, guided and supported by the National Co-ordinating Centre for Public Engagement. The University of Edinburgh where we work, for example, is involved in several networks around engagements, including the Beltane Public Engagement Network ( Beltane, 2020), the Scottish Public Engagement Network ( ScotPEN, 2020), as well as its own structures of professional public engagement support.

The notions and frameworks of ‘good’ and ‘best’ practice promoted by different organisations are often credentialed modes of knowledge (coming from and legitimated by authoritative institutions) and advocated either implicitly or explicitly as the ‘right’ knowledge. Notably, they tend also to be delineated in ways that align with the institutions’ broader objectives and agendas. For example, drives to improve engagements, including ‘good’ or ‘best’ practice frameworks in the UK, have coincided with recommendations to measure success from engagements in the context of the Research Excellence Framework (REF). REF assesses research quality including an evaluation of its impact, which is defined in terms of the effects, changes, or benefits achieved ‘beyond academia’ ( REF2021, 2019). In this context, engagements are being framed not only in terms of more egalitarian or collaborative research, but also as a way to realise research impact, often as defined in the REF ( Paylor & McKevitt, 2019; Smith et al., 2020). This may be a cause for caution both around the underlying motivations that drive institutional engagements and what the promotion of engagements ‘does’ in practice ( Paylor & McKevitt, 2019; Smith et al., 2020).

Indeed, the aims, justifications and motivations for engagements are often unclear in this context: shifts towards ‘co-production’ advanced by some organisations may be formally justified by substantive aims of improving research through such engagements, or normative aims of enabling more egalitarian and collaborative research, yet the practical motivations that foreground engagements may not necessarily match the rationales that are formally used to justify them ( Esmail et al., 2015). For example, Paylor & McKevitt (2019) have argued that a form of ‘authoritative instrumentalism’ underpins the NIHR’s and others’ shift to ‘co-production,’ where engagements are seen as something to be implemented to deliver particular kinds of instrumental outcomes. This is precisely because ‘co-production’ has gained institutional currency in the context of policy initiatives highlighting and prioritising the impact of research outside academia (see also Williams et al., 2020).

Similar tensions, shaped by the institutionalisation of engagements, can also extend to local practices of engagements undertaken ‘on the ground’ within research projects. While the formal rationale for engagements within research projects may be normative or substantive motivations to ‘do the right thing’ or improve research outcomes, the practical motivations driving engagements may be more instrumental, shaped by institutions’ and research funding bodies’ requirements for incorporating engagements within research ( Paylor & McKevitt, 2019). The institutionalised framework through which engagements are mandated can appear monopolistic, unhelpfully closing down debate and space for appreciating the ambiguities around engagements, when practices are still being developed and should be reflected upon and questioned. As Paylor & McKevitt (2019) have suggested, engagements can become an impoverished sphere of activity where researchers are undertaking them because it is a funding requirement without the opportunity to reflect more fully on why. Moreover, mainstream institutionalised models of ‘good’ or ‘best’ engagement practice may at times have the effect of quietening down alternative ways of thinking about engagements or side-lining them in such a way that alternative spaces and activities come to be understood in opposition to mainstream models. This is especially so when models of and claims to ‘good’ or ‘best’ practice are transported into new contexts, in ways that can make it more difficult to diversify and develop alternative engagements that would better account for cultural and local differences.

For example, ‘patient and public involvement’ is now a requirement of joint funding through the UK Medical Research Council (MRC) and NIHR Global Health partnerships in Low- and Middle-income Countries (LMIC). The framework that has been applied, however, raises questions around whether it is appropriate to take models for engagements developed in High-income Countries (HICs) and directly apply them in LMICs, especially without building on the experiences from research undertaken in these countries as their usefulness may be limited due to local differences. These differences can include structural barriers to participation in public involvement initiatives such as physical access, poverty, and social or cultural exclusion of different marginalised groups in many settings (e.g. Bolsewicz Alderman et al., 2013). Indeed, it may seem that engagement activities are being absorbed by large HIC institutions, leaving limited space for alterative conceptualisations and enactments of engagements, including the development of culturally and locally appropriate frames. The Global Challenges Research Fund (GCRF), however, now requires equitable partnership building with LMIC partners as a way to address challenges around HIC-LMIC power relations in research contexts ( UKRI, 2020), also increasing opportunities for local engagement frameworks. It remains to be seen how these local frames develop in the new partnerships that are being forged.

These issues are connected with other limitations for realising engagements, especially co-production, via institutionally funded academic research. While there are exceptions (c.f. Collins et al., 2020), decision-making about research questions and design, for example, still tends to remain in researchers’ hands. Publics or patients are usually involved with more limited questions like design of patient information sheets, and typically only on a study-by-study basis, constraining temporally sustained engagements with research more broadly conceived ( Paylor & McKevitt, 2019). Also, despite the increasing availability of guidance documents on how to conduct engagements, the creation of engagement mandates has not led to the formalisation of training for researchers and healthcare professionals in the skills to carry out ‘good’ engagements. This has facilitated the commercialisation and professionalisation of engagements where ‘independent’ engagement practitioners and organisations are sometimes employed to undertake engagements on researchers’ behalf (see Bherer et al., 2017; Pallett, 2019). Yet, professional roles to carry out engagements, within both universities and independent professional engagement agencies, may not have clear career development pathways, leading to a situation where skilled and experienced engagement professionals may need to leave these roles to progress, limiting the learning and experience that can be achieved. This is especially problematic because much of the relevant knowledge is gained through experience, making the informal as well as formal sharing of experiences important for learning from, and improving, engagements.

What is needed in this context, then, is reflexivity both about the contextually conditioned nature of mainstreamed, institutionally authorised models of engagements, and about the actual motivations and stated justifications around engagements that are being deployed within the confines of institutionalisation. The mainstreaming of engagements has opened positive, potentially empowering spaces for bringing new actors and voices into science, which can challenge conventional epistemic and power hierarchies in science governance. However, institutionalising engagements carries the danger of homogenising and ‘fixing’ engagements into particular, authorised models of ‘good’ or ‘best’ practice. This may problematically silence alternative ways of imagining and enacting engagements, and constrain the critical space left for dynamism. We call for critical, theoretical and practical reflection on the models, motivations, and justifications based on which engagements are currently undertaken. Such reflection must connect with the relationship between engagements and knowledge production to which we now turn.

Engagements and knowledge production

The institutionally shaped nature of engagements raises questions about engagements’ epistemic dimensions: what do engagements, at different moments of the research process, do to processes of knowledge production? To what extent are engagements knowledge producing activities, and should they be? What sorts of knowledge might be produced and shared, by whom, for whom, and for what purposes? These questions are centrally connected with the value and positions attributed to different types of knowledge and knowledge producers within engagements and research processes.

Institutional framings and structures around scientific knowledge production tend to delimit what counts as knowledge producing activity, and the types of knowledge that can be generated. Firstly, research governance frameworks often explicitly differentiate between research and engagements, where the former is, for example, subject to ethical oversight while the latter may not be. While being exempt from oversight procedures can be liberating in permitting creativity and experimentation, it can limit what knowledge engagements are able (or allowed) to generate. There are difficulties converting insights from engagements into valid(ated) knowledge, for example, if the engagements have not undergone the institutional ethical review process required for research with human participants, which presents a barrier to publishing findings especially in peer-reviewed journals. Engagements undoubtedly generate knowledge, but when the epistemic orientations surrounding these practices fail to recognise the value of this knowledge and institutional structures are not conducive, it may not be captured in a usable way, limiting the possibilities for learning from engagements. This raises questions around whether an unequal relationship with respect to knowledge is always implicit in mainstream conceptualisations of engagements: is the differentiation between research and engagement being made via an equation of research with (valid) knowledge production, and relegation of engagements as not (valid) knowledge producing activities? How are these boundaries drawn, why, and by whom?

Secondly, institutional framings and structures around scientific knowledge production tend to delimit, either explicitly or implicitly, the kind of roles that differently positioned actors can occupy in relation to knowledge; i.e. who ‘counts’ as or is permitted to be a knowledge producer. As feminist theorists, among others, have long argued, mainstream scientific epistemologies have privileged forms of knowledge production that (claim to) transcend contextual differences and the particularities of subjective experiences, even though all (including scientific) knowledge arises from particular perspectives in ways that make it context-dependent and value-laden (e.g. Alcoff & Potter, 1993; Antony, 2018; Grasswick, 2011). The ‘expert’ perspective of trained career scientists has, however, been universal ised, presented as objective, and as paradigmatic of (valid) ‘knowledge,’ with the effect that the knowledges of non-scientists, and especially knowledge arising from subjective experience, have been positioned as not knowledge in the proper sense; ‘improper knowledge.’ Relatedly, various types of engagements often implicitly position certain actors as holders or producers of knowledge, while others are framed as receivers or as sources of data.

This raises the epistemic issue of positionality (i.e. how people are positioned and position themselves) in knowledge production processes. In recent decades, the epistemic privilege of the conventional ‘expert’ perspective has been challenged including through the emergence of what have been termed ‘professional layperson’ and ‘lay expert’ roles. Those occupying these roles are generally defined in opposition to (conventional) ‘experts’ but are also, by the very nature of their role, taken to possess a particular expertise: positional experience and ability to navigate the engagements environment and effectively provide ‘lay perspectives’ that are expected and looked-for within these contexts ( Kerr et al., 2007). A further twist on these roles occurs when academics (e.g. bioethicists or social scientists) or professionals with expertise in healthcare and research are cast as ‘laypersons’ and therefore (expected to) represent ‘lay perspectives’ in relation to health-related knowledge in engagement contexts ( Kerr et al., 2007). Similarly, the notion of expertise-by-experience is now commonplace across a range of health governance contexts, but can also generate conflicted, confusing, and sometimes impossible roles for participants ( Meriluoto, 2018). This also raises potentially difficult questions about the extent to which having a particular epistemic standpoint (e.g. patienthood and, as an effect of that position, expertise on illness through experience) means that a person knows ‘more’ or ‘better.’ Inhabiting a particular social location does not necessarily mean that the knowledge arising from that location is more valuable than other, differently located knowledges ( Wylie, 2003).

Further related questions are raised by approaches to research that promise more active roles for participants, including ‘co-production’ or participatory research. For example, some have considered whether research participants should be included as co-authors on academic outputs, to recognise the often direct and invaluable contributions they make to knowledge production, and the challenges around doing this in practice within academic publishing structures (c.f. Bain & Payne, 2015). An example of a related innovative approach is the Frontiers for Young Minds journal, reviewed by a board of children and teenagers with the aim of enabling young people and scientists to work together to create academic articles ( Frontiers, 2020). This is also connected with the issue of how participants’ ‘lived experience’ should be situated within academic environments ( Banfield et al., 2018). Participants’ role in research, as more than mere sources of data, may demand that they should be recognised as knowledge producers, but incorporating these non-conventional actors into the existing academic hierarchies can provoke perhaps uncomfortable questions about the purpose and worth of academic training and legitimacy of academic credentials. We can also ask whether recognition through co-authorship is the format that would be most meaningful to participants, or whether this mode of recognition is, itself, built on the priorities of academics. Indeed, there may be a need to develop different modes of recognition beyond the academic epistemic and value frameworks.

We contend that feminist methodological tools and theoretical approaches (c.f. Fonow & Cook, 1991; Ramazanogly & Holland, 2002) can help with the above kinds of challenges. While related bodies of feminist theory are diverse, reflecting the plurality of feminisms more generally, there are some widely shared epistemic tendencies within this diversity and plurality that offer avenues for thinking differently about the epistemic tensions around different kinds of engagements. Feminist epistemologies and methodologies have long sought to destabilise traditional power differentials between researchers and research participants by exposing and reclaiming experiences as epistemically salient, often positioning subjective experiences (especially of marginalised groups) as key to knowledge production. They have emphasised the situatedness and contextuality of all knowledge claims, beginning from the assumption of knowledge plurality and equity, while conceptualising sound knowledge production in general as requiring dialogical engagement with this plurality and partiality. This demands reflexivity from those positioned as ‘experts’ on what shapes their own epistemic starting points and interpretations ( Code, 1988; Haraway, 1988; Harding, 1986; Harding, 1991).

Applying this to engagements entails recognition and endorsement of the fact that there are potentially multiple sets of knowledge at play within any given engagement – not (just) singular ‘lay’ and ‘scientist’ but plural knowledges and positions from which knowledge is generated, including those of facilitators, practitioners, funders or commissioners, etc. – and that knowledge progresses dialogically. Conceptualising engagements centrally as practices of knowledge production focuses attention both on the epistemic processes and end products, implying that our valuations of engagement should orient around how different knowledge is generated through engaged research and by whom. These issues are also connected with the question of how and why engagements are valued and evaluated.

Valuing and evaluating engagements

As practices and processes of engagements have been mainstreamed, calls for evaluation of engagements have also grown (c.f. Oliver et al., 2019) but the processes of evaluating are often not well documented in existing literature ( Esmail et al., 2015). Formal mechanisms for evaluating engagements are, however, increasingly required by funding bodies and institutions, and expected by other stakeholders. These may include qualitative, quantitative, or mixed approaches to develop understanding of individuals’ and groups’ perceptions of engagements, increase awareness, or improve participation rates. The UK Research and Innovation (UKRI) evaluation guide, for example, lists evaluation techniques based on social and market research methods like surveys, interviews, focus groups and discussions with target groups or wider publics ( UKRI, 2011). Yet, the formalisation of evaluating engagements raises further questions around how and why evaluations are undertaken, to whose benefit, whose views are represented and whose may be excluded.

Formal evaluation guidelines often define evaluation, implicitly or explicitly, in terms of determining and improving the quality and impact of engagements, where ‘impact’ is often framed in relation to effects, changes, or benefits ‘beyond academia,’ as delineated in the REF. The UK MRC (2020), for example, describes evaluation as something that is done by measuring the learning or changes in thinking that those who take part in engagement activities gain from these activities, and by measuring their inspiration to know more or get involved in further activities. The information that is collected through evaluation is usually seen as a means to increase the value of engagement activities, while ‘value’ is associated with ‘impact.’ Further, models of evaluating engagements tend to draw from evidence-based intervention models, where engagements are seen as akin to an intervention to be evaluated. Conceptualising engagements as interventions or tasks with pre-defined objectives to fulfil, however, does not fully capture the inherently human aspect of engagements, including relationships, exchange of knowledge and ideas that often results in profound and insightful experiences for those involved ( Komporozos-Athanasiou et al., 2016). Institutional framings of evaluation can have the effect of not only delimiting what (proper) ‘evaluation’ should look like, but also pre-defining the purpose of evaluation as impact and quality assessment, in ways that can silence the potential of evaluation exercises to produce valuable insight and knowledge, in their own right.

Indeed, what the purpose or ‘value’ of engagements’ evaluation is or should be, what kinds of activities and methods (should) count, legitimately, as ‘evaluation,’ and for whom has been contested, as has the distinction between ‘evaluation’ and ‘research.’ Purtell et al. (2012), for example, have critiqued the drive to emphasise impact and measurement of engagements without due reflection on the purpose or rationale of engagements in the first place. Boivin et al. (2018), moreover, found that publics are often not involved in the development and design of the evaluation tools in the first place.

Feminist approaches to evaluation, on the other hand, have applied alternative modes and frameworks of (e)valu(at)ing. These include empowering, multi-vocal and appreciative inquiry methods which aim to elucidate social inequalities and increase the capacity of individuals and groups to effectively represent their views on both engagements and research activities through evaluation (c.f. Patton, 2002). Some have stressed how individuals from different social backgrounds approach information and evaluation processes in different ways, showing not just that impact has (or has not) occurred, but also why and how people are affected, how they interpret, perceive, and, indeed, value information in the context of their own lives ( Sielbeck-Bowen et al., 2002). Action-based paradigms have sought to link the results of evaluations with wider questions of social justice, by mobilising evaluation findings to address structural and procedural processes through which some voices and forms of knowledge are prioritised at the expense of others ( Mertens, 1999). This requires rethinking both evaluation and engagements as forms of action that simultaneously assess, inquire, and aim to act upon inclusion and exclusion processes within research, engagement and evaluation processes.

These approaches highlight that evaluation may serve multiple purposes, including social, cultural, political and financial; and, that the ‘value’ of engagements is less an intrinsic singular property and more something that is multi-directional and actively created through engagements and evaluation processes. Moreover, different ideas about the purpose and value of engagements and evaluation may also conflict, as different groups and individuals might prioritise differently (also leaving open the possibility that some engagements may not have value to any participants). For institutions, engagements may carry value in their potential to improve research quality and produce more accessible outputs and opportunities for knowledge sharing, but they also carry symbolic and financial value in showcasing research ‘impact’ beyond academia, and increasing success in research funding. Value may also be gained, however, by those taking part in engagements, for example through offering a sense of purpose to someone who faces life disruptions as a consequence of disease or illness, or the value in creating and fostering relationships between others who are engaging and also with researchers ( Komporozos-Athanasiou et al., 2016). These kinds of value may be hard to measure, or immaterial in substance, despite being important to those engaging.

These different forms of value are shaped and constrained by the wider social and structural contexts in which they are generated, and in which research and engagements occur. Systemic structural inequalities, including along the lines of gender, race, class, (dis)ability, sexuality, immigration status and other socially significant differences simultaneously embed the institutional contexts in which research and engagements are undertaken, and delimit who participates (and does not) in engagements, whose voices are heard and views represented in evaluations ( Sielbeck-Bowen et al., 2002). These structural forces – both of the funding and political landscapes, and the wider societal structures that embed them – are not always stabile, creating challenges in obtaining consensus, and leading to changing emphasis and value in engagements around who should be engaged with, why, and what it means to engage. Interesting critical questions are also raised when the symbolic value gained by institutions is considered. Boylan et al. (2019) have provided insight into the identities of scientists for whom responsibility for engagements is assumed: early-career researchers, postgraduate students and, often, women. Such disparities in gender and career hierarchy raise additional concerns around how engagements may or may not be valued in ways that reflect wider epistemic and gender hierarchies. These include the mainstream scientific epistemic paradigm that has simultaneously devalued, gendered (as ‘women’s work’), and positioned as epistemically inferior, social scientific and humanities approaches to producing knowledge, including the methods primarily used in evaluation of engagements.

Engagements should be conceptualised in ways that are grounded in acknowledgement and analysis of the array of different kinds of value that they can embody and generate. Simultaneously they should recognise that one cannot fully measure whether, how and for whom engagements have had value without reflecting on the processes and justifications of engaging, and the wider social structural conditions under which they occur. Engagements serve multiple purposes and result in multiple kinds of value for all actors involved in the activities. Thus, we advocate for an approach that builds on this insight to centre the question of value independent of its capacity to be fixed and measured, to understand and explicate how the value of these processes is plural. Building on feminist epistemological frames and approaches to (e)valu(at)ing enables active concern both for the plural ways in which ‘value’ manifests, and for how, why, and what kinds of information are produced through evaluation, as well as how this information is epistemically positioned in relation to research and ‘knowledge.’ Variation in how engagements are evaluated is, notably, not intrinsically negative, but it is necessary to identify and reflect on tensions and discomforts that arise when different forms of value are prioritised, and to ask what value is obtained, by whom, and what social and structural conditions shape this.

Conclusion: towards a feminist philosophy of engagements

This paper has aimed to set out what we see as important outstanding questions and issues around engagements, especially in the UK context but also beyond. We have used the notion of ‘engagements’ as a problem concept that can nonetheless capture the plural and overlapping ways in which engagements are enacted. We move beyond attempts to delineate definitions or the scope of what does or should count as engagements, in order to focus on the tensions and possibilities that the multiplicity of engagements evoke.

In considering the roots, current manifestations and mainstreaming of engagements especially within institutional contexts, we argue that there is a need to remain reflexive about how these contexts condition the possibilities for engagements, and we call for critical inquiry into the models, motivations and justifications through which engagements are currently enacted. We are concerned with engagements’ epistemic dimensions, especially questions around how engagements are situated in relation to knowledge production. Thus, we call for ongoing inquiry into the kind(s) of knowledge engagements can or should produce, how this knowledge is or should be captured, who is and is not positioned as a knowledge producer, and what kinds of power relations condition the roles attributed to different subjects. We are also concerned about how engagements are and could be evaluated by different actors, to whose benefit, and how ‘value’ is being conceptualised in these processes, and call for recognition of the diverse kinds of value that engagements can bring to different actors involved, including how people can be and are affected by engagements. This inevitably entails understanding ‘value’ as plural, limiting its capacity to be fixed or measured.

In conclusion, we argue that there is a need for a ‘philosophy of engagements’: one where ‘philosophy’ entails inquiry into what kind of activity something is and how we should do it, and where the term ‘engagements’ remains problematised but necessarily plural, to leave space open for the creative potential of engagements for exploring new approaches that can enable us to re-think what engagements are, could be, and how to do them. We argue that this philosophy should be a feminist one, informed by feminist approaches to social power relations, knowledge production, value generation, and their relationship. This is because translating existing feminist theoretical and methodological tools into the context of engagements, can help us to address the central outstanding questions and tensions that we have found through our work and experience around engagements.

Firstly, a feminist philosophy of engagements should centre the feminist notion of reflexivity as a key tool in designing and enacting engagements, because this can enable one to critically interrogate the epistemic starting points and presumptions that shape how engagements are conceptualised and undertaken, and how these starting points direct the kinds of knowledges that can (and cannot) be produced through them, especially within institutional confines. Actively practicing reflexivity can also enable us to shed critical light on the contextually conditioned nature of institutionally authorised models of engagements, and identify and address possible tensions between different motivations and stated justifications around engagements. We should embed reflexivity into how we conceptualise engagements, and how and why we enact them, because this can enable us to not only acknowledge how institutional pressures and predefined ‘best practice’ models may influence our own practices and motivations for undertaking engagements, but it can also enable us to challenge these pressures and models to develop alternative ways of imagining and enacting engagements. Doing so is especially pertinent when understood in the wider context where systemic structural inequalities and hierarches delimit the practical realities of who is included in (and excluded from) engagements. Thus, we recommend reflexivity as both a conceptual and practical tool to develop critical analysis of existing engagement models and alternative frameworks of engagements.

Secondly, and relatedly, a feminist philosophy of engagements should centre feminist notions of positionality as this can facilitate critical interrogation of knowledge production both in research and engagements, including in relation to (e)valu(at)ing engagements. In conceptualising, designing and enacting engagements, we should start with the feminist insight that all knowledge, including scientific knowledge, arises from a perspective that is shaped by the knowledge producers’ social location. This insight leads to an understanding of knowledge as situated, plural and partial, which is turn will enable us to ask critical questions about who are (and are not) recognised as knowledge producers, and which knowledges are (and are not) valid(ated) in research and engagements. These questions should include interrogation of the very distinction between research and engagements as separate(d) activities, and the extent to which we should see them as such. We recommend applying the tool of positionality to understand engagements because it can enable us to recognise, unpack, and name the active roles that many different actors play in the generation of knowledges from research and engagements, and the plural kinds of value attributed to them. Reversely, it can also enable us to identify which positionalities and knowledges are not being represented. By emphasising positionality in all knowledge production, we can begin to destabilise conventional epistemic and power differentials between researchers and research participants and expose participants’ knowledge as epistemically salient and valuable.

A feminist philosophy of engagements advanced along these lines would necessarily focus centrally on the processes as well as end products of engagements, unpacking how engagements serve multiple purposes, generate plural knowledges, and carry manifold kinds of value that require recognition and critical interrogation. Notably, the above outlined issues are characterised by the intertwining of empirical, epistemic and normative questions around engagements. Thus, a feminist philosophy of engagements will inevitably require dialogical engagement with this multiplicity and plurality via interdisciplinary modes of thinking, to facilitate the concurrent integration of the empirical, epistemic, and normative spheres in developing accounts of engagements both in theory and praxis. This paper has aimed to carve out the starting points for this work, showing how feminist perspectives offer avenues for thinking differently about engagements, within and beyond institutionalised models.

Data availability

No data are associated with this article.

Acknowledgements

We thank all members of the Centre for Biomedicine, Self and Society for their support and input into various different discussions that have informed and shaped this paper.

Funding Statement

This work was supported by the Wellcome Trust [209519, <a href=https://doi.org/10.35802/209519>https://doi.org/10.35802/209519</a>]

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; peer review: 1 approved, 1 not approved]

References

  1. Alcoff L, Potter E, (eds): Feminist Epistemologies.New York & London: Routledge,1993. Reference Source [Google Scholar]
  2. Antony L: A mind of one’s own: feminist essays on reason and objectivity.NewYork: Routledge.2018. Reference Source [Google Scholar]
  3. Bain AL, Payne WJ: Queer de-participation: reframing the co-production of scholarly knowledge. Qual Res. 2015;16(3):330–340. 10.1177/1468794115619002 [DOI] [Google Scholar]
  4. Banfield M, Randall R, O’Brien M, et al. : Lived experience researchers partnering with consumers and carers to improve mental health research: Reflections from an Australian initiative. Int J Ment Health Nurs. 2018;27(4):1219–1229. 10.1111/inm.12482 [DOI] [PubMed] [Google Scholar]
  5. Beltane: About Beltane.2020. (accessed 22/12/2020). Reference Source [Google Scholar]
  6. Berghs M, Chataika T, El-Lahib Y, et al. : The Routledge handbook of disability activism.New York: Routledge.2020. Reference Source [Google Scholar]
  7. Bherer L, Gauthier M, Simard L: The professionalization of public participation.New York & London: Routledge.2017. Reference Source [Google Scholar]
  8. Boivin A, L’Espérance A, Gauvin FP, et al. : Patient and public engagement in research and health system decision making: A systematic review of evaluation tools. Health Expect. 2018;21(6):1075–1084. 10.1111/hex.12804 [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Bolsewicz Alderman K, Hipgrave D, Jimenez-Soto E: Public Engagement in Health Priority Setting in Low- and Middle-Income Countries: Current Trends and Considerations for Policy. PLoS Med. 2013;10(8):e1001495. 10.1371/journal.pmed.1001495 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Boylan AM, Locock L, Thomson R, et al. : "About sixty per cent I want to do it": Health researchers' attitudes to, and experiences of, patient and public involvement (PPI)-A qualitative interview study. Health Expect. 2019;22(4): 721–730. 10.1111/hex.12883 [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Code L: Experience, knowledge, and responsibility.In: Griffiths, M. & Whitford, M.(eds) Feminist perspectives in philosophy. London: Palgrave Macmillan.1988;187–204. 10.1007/978-1-349-19079-9_11 [DOI] [Google Scholar]
  12. Collins S, Brueton R, Graham TG, et al. : Parenting Science Gang: radical co-creation of research projects led by parents of young children. Res Involv Engagem. 2020;6:9. 10.1186/s40900-020-0181-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Crowe S, Adebajo A, Esmael H, et al. : ‘All hands-on deck’, working together to develop UK standards for public involvement in research. Res Involv Engagem. 2020;6:53. 10.1186/s40900-020-00229-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Epstein S: Impure science: AIDS, activism, and the politics of knowledge.Los Angeles & London: University of California Press. Med Soc (Berkeley). 1996;1–446. [PubMed] [Google Scholar]
  15. Esmail L, Moore E, Rein A: Evaluating patient and stakeholder engagement in research: moving from theory to practice. J Comp Eff Res. 2015;4(2):133–145. 10.2217/cer.14.79 [DOI] [PubMed] [Google Scholar]
  16. Felt U, Fochler M: Machineries for making publics: inscribing and de-scribing publics in public engagement. Minerva. 2010;48(3):219–238. 10.1007/s11024-010-9155-x [DOI] [Google Scholar]
  17. Fiorino DJ: Citizen Participation and Environmental Risk: A Survey of Institutional Mechanisms. Sci Technol Human Values. 1990;15(2):226–43. 10.1177/016224399001500204 [DOI] [Google Scholar]
  18. Fonow MM, Cook JA: Beyond methodology: feminist scholarship as lived research. Bloomington & Indianapolis: Indiana University Press.1991. Reference Source [Google Scholar]
  19. Frontiers: Frontiers for Young Minds.2020. (accessed 24/10/2020). Reference Source [Google Scholar]
  20. Grasswick HE: Feminist epistemology and philosophy of science: power in knowledge.London & New York: Springer.2011. 10.1007/978-1-4020-6835-5 [DOI] [Google Scholar]
  21. Haraway D: Situated knowledges: The science question in feminism and the privilege of partial perspective. Feminist Studies. 1988;14(3):575–599. 10.2307/3178066 [DOI] [Google Scholar]
  22. Harding S: The science question in feminism.Ithaca & London: Cornell University Press.1986. Reference Source [Google Scholar]
  23. Harding S: Whose science? Whose knowledge? Thinking from women’s lives.Ithaca: Cornell University Press.1991. Reference Source [Google Scholar]
  24. INVOLVE: Briefing notes for researchers: public involvement, in NHS, public health and social care research.2012; (accessed 20/01/2020). Reference Source [Google Scholar]
  25. Jefferson Centre: Home;2020. (accessed 22/01/2020). Reference Source [Google Scholar]
  26. Kerr A, Cunningham-Burley S, Tutton R: Shifting subject positions: experts and lay people in public dialogue. Soc Stud Sci. 2007;37(3):385–411. 10.1177/0306312706068492 [DOI] [Google Scholar]
  27. Komporozos-Athanasiou A, Fidge N, Adams M, et al. : Citizen Participation as Political Ritual: Towards a Sociological Theorizing of ‘Health Citizenship’. Sociology. 2016;52(4):744–761. 10.1177/0038038516664683 [DOI] [Google Scholar]
  28. Meriluoto T: Case-study – experts-by-experience in Finnish social welfare.In: Brandsen, T., Verschuere, B. & Steen, T. (eds). Co-production and co-creation: engaging citizens in public services. New York: Routledge.2018. Reference Source [Google Scholar]
  29. Mertens DM: Inclusive evaluation: Implications of transformative theory for evaluation. Am J Eval. 1999;20(1):1–14. 10.1016/S1098-2140(99)80105-2 [DOI] [Google Scholar]
  30. Mockford C, Staniszewska S, Griffiths F: The impact of patient and public involvement on UK NHS health care: A systematic review. Int J Qual Health Care. 2012;24(1):28–38. 10.1093/intqhc/mzr066 [DOI] [PubMed] [Google Scholar]
  31. Moore A: Public bioethics and public engagement: the politics of “proper talk.” Public Underst Sci. 2010;19(2):197–211. 10.1177/0963662508096781 [DOI] [PubMed] [Google Scholar]
  32. MRC: Public engagement evaluation guidance.2020; (accessed 24/01/2020). Reference Source [Google Scholar]
  33. Murphy M: Seizing the Means of Reproduction: Entanglements of Feminism, Health, and Technoscience.Durham & London: Duke University Press,2012. 10.2307/j.ctv125jmpm [DOI] [Google Scholar]
  34. NIHR: Going the extra mile: improving the nation’s health and wellbeing through public Involvement in research.2015; (accessed 24/01/2010). Reference Source [Google Scholar]
  35. Oliver K, Kothari A, Mays N: The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Syst. 2019;17(1):33. 10.1186/s12961-019-0432-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Pallett H: The new evidence-based policy: public participation between ‘hard evidence’ and democracy in practice. Evidence & Policy. 2019;16(2): 209–227. 10.1332/174426419X15704985880872 [DOI] [Google Scholar]
  37. Patton MQ: Feminist, yes, but is it evaluation? New Dir Eval. 2002;96:97–108. 10.1002/ev.69 [DOI] [Google Scholar]
  38. Parry S, Faulkner W, Cunningham-Burley S, et al. : Heterogeneous agendas around public engagement in stem cell research: the case for maintaining plasticity. Science and Technology Studies. 2012;12(2):61–80. 10.23987/sts.55276 [DOI] [Google Scholar]
  39. Paylor J, McKewitt C: The possibilities and limits of “co-producing” research. Front Sociol. 2019;4:23. 10.3389/fsoc.2019.00023 [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Purtell R, Rickard W, Wyatt K: Should we? Could we? Measuring Involvement.In: Barnes, M. & Cotterell, P. (eds) Critical perspectives on user involvement.Policy Press,2012. 10.1332/policypress/9781847427519.003.0020 [DOI] [Google Scholar]
  41. Ramazanogly C, Holland J: Feminist Methodology: Challenges and Choices.London: Sage,2002. Reference Source [Google Scholar]
  42. REF2021: Guidance on submissions.2019; (accessed 24/01/2020). Reference Source [Google Scholar]
  43. Rosenberg SJ, Rosenberg J: Community mental health: challenges for the 21 st century.New York: Routledge,2018. Reference Source [Google Scholar]
  44. Rowland P, McMillan S, McGillicuddy P, et al. : What is “the patient perspective” in patient engagement programs? Implicit logics and parallels to feminist theories. Health (London). 2017;21(1):76–92. 10.1177/1363459316644494 [DOI] [PubMed] [Google Scholar]
  45. ScotPEN: About Us.2020; (accessed 24/10/2020). Reference Source [Google Scholar]
  46. Sielbeck-Bowen KA, Brisolara S, Seigart D, et al. : Exploring feminist evaluation: the ground from which we rise. New Dir Eval. 2002;96:3–8. 10.1002/ev.62 [DOI] [Google Scholar]
  47. Smith KE, Bandola-Gill J, Meer N, et al. : The impact agenda: controversies, consequences and challenges.Bristol: Polity Press,2020. 10.2307/j.ctv11g95dd [DOI] [Google Scholar]
  48. Stilgoe J, Lock SJ, Wilsdon J: Why should we promote public engagement with science? Public Underst Sci. 2014;23(1):4–15. 10.1177/0963662513518154 [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Stirling A: “Opening up” and “closing down”: power, participation and pluralism in the social appraisal of technology. Sci Technol Human Values. 2008;33(2):262–294. 10.1177/0162243907311265 [DOI] [Google Scholar]
  50. UKRI: Evaluation: practical guidelines. Guide for evaluating public engagement activities.2011; (accessed 24/01/2020). Reference Source [Google Scholar]
  51. UKRI: Equitable Partnerships.2020; (accessed 22/12/2020). Reference Source [Google Scholar]
  52. Williams O, Sarre S, Papoulias SC, et al. : Lost in the shadows: reflections on the dark side of co-production. Health Res Policy Syst. 2020;18(1):43. 10.1186/s12961-020-00558-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Wylie A: Why standpoint matters.In: Figueroa, R. & Harding, S. (eds) Science and Other Cultures: Issues in Philosophies of Science and Technology.New York: Routledge,2003;26–48. Reference Source [Google Scholar]
Wellcome Open Res. 2021 Apr 28. doi: 10.21956/wellcomeopenres.18221.r43065

Reviewer response for version 1

Kieran C O'Doherty 1

Thank you for the invitation to review the article, “Towards a feminist philosophy of engagements in health-related research.” The article provides a brief overview and history of the growing emphasis on engagements in health research and argues for grounding ongoing work on engagements on feminist epistemologies and methodologies. The argument for such a feminist philosophy is quite short but, given the authors’ aims “to carve out the starting points for this work,” this does not necessarily detract from the value of the proposal. The argument presented by the authors is compelling and, I believe, an important contribution to scholarship and practice of public engagement. The proposal is also bold and challenges some assumptions that are commonly held as a foundation for the production of scientific knowledge. I feel that these challenges are a welcome, potentially disruptive provocation, and ultimately a constructive contribution.

I have some minor suggestions for improvements of the manuscript, as well as some thoughts on parts of the argument, which I detail below.

The authors state that, “The ‘expert’ perspective of trained career scientists has, however, been universalised, presented as objective, and as paradigmatic of (valid) ‘knowledge,’ with the effect that the knowledges of non-scientists, and especially knowledge arising from subjective experience, have been positioned as not knowledge in the proper sense; ‘improper knowledge.’ Relatedly, various types of engagements often implicitly position certain actors as holders or producers of knowledge, while others are framed as receivers or as sources of data.” I agree with the general point. However, I feel that the implied criticism (that the knowledges of non-scientists and that arising from subjective experience should not be regarded as ‘improper knowledge’) needs to be articulated more clearly, and presented with some nuance. For instance, the case that experiential knowledge of illness is a relevant form of knowledge is probably easier to argue than, say, in the case of public engagement on vaccination, whether beliefs about a putative link between autism and the MMR vaccine should be regarded as “proper knowledge.” I don’t have an answer to this question, so I certainly don’t expect the authors of this article to provide one. However, I feel that readers who are not sympathetic to the argument presented by the authors will need a more developed argument to be convinced that there is a problem with the view that scientists are holders of “proper knowledge” and those without such training are only holders of “proper knowledge” insofar as this agrees with accepted scientific knowledge.

The authors state that, “Further, models of evaluating engagements tend to draw from evidence-based intervention models, where engagements are seen as akin to an intervention to be evaluated.” I believe that this statement requires some qualification and possibly supporting evidence. There are a number of frameworks for evaluation of public engagement that do not conceive of public engagement activity as an intervention. I am thinking here, for example, about the work of Julia Abelson and Ray de Vries and their respective colleagues. It may certainly be that dominant form of evaluations view engagement as an intervention but, if this is so, some qualification would be helpful as to the kind of evaluations the authors have in mind and where they are being deployed.

Finally, the authors refer to reflexivity several times and reflexivity is also identified as a key principle (or notion) proposed as part of a feminist philosophy of engagements. I feel this is an important point, but its force is somewhat reduced by failing to explain what, precisely, the authors mean by reflexivity. Because there is so much scholarship on reflexivity, the term is associated with different meanings (see for example, Slaney, Tafreshi, & Wu, 2019 1 , for an overview of different notions of reflexivity). Clearly explicating what the authors associate with the term would strengthen their point.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

public engagement with science & technology; public deliberation; social psychology; health psychology; bioethics

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

References

  • 1. : Philosophical Reflexivity in Psychological Science: Do We Have It? Does It Matter?.2019; 10.1007/978-3-030-25308-0_11 237-256 10.1007/978-3-030-25308-0_11 [DOI] [Google Scholar]
Wellcome Open Res. 2022 Jan 5.
Sonja Erikainen 1

We thank the reviewer for their useful comments and feedback, which we believe have enabled us to improve the paper significantly. We have addressed the comments and feedback as follows:

Comment: I feel that the implied criticism (that the knowledges of non-scientists and that arising from subjective experience should not be regarded as ‘improper knowledge’) needs to be articulated more clearly, and presented with some nuance. For instance, the case that experiential knowledge of illness is a relevant form of knowledge is probably easier to argue than, say, in the case of public engagement on vaccination, whether beliefs about a putative link between autism and the MMR vaccine should be regarded as “proper knowledge.” […] I feel that readers who are not sympathetic to the argument presented by the authors will need a more developed argument to be convinced that there is a problem with the view that scientists are holders of “proper knowledge” and those without such training are only holders of “proper knowledge” insofar as this agrees with accepted scientific knowledge.

Response: We have now added a paragraph into the ‘engagements and knowledge production’ section that specifically addresses this issue and outlines out take on it (p. 13-14). 

Comment: The authors state that, “Further, models of evaluating engagements tend to draw from evidence-based intervention models, where engagements are seen as akin to an intervention to be evaluated.” I believe that this statement requires some qualification and possibly supporting evidence. There are a number of frameworks for evaluation of public engagement that do not conceive of public engagement activity as an intervention. I am thinking here, for example, about the work of Julia Abelson and Ray de Vries and their respective colleagues. It may certainly be that dominant form of evaluations view engagement as an intervention but, if this is so, some qualification would be helpful as to the kind of evaluations the authors have in mind and where they are being deployed.

Response: We agree that this statement was somewhat too simplistic / reductive, and we have now omitted the statement.

Comment: Finally, the authors refer to reflexivity several times and reflexivity is also identified as a key principle (or notion) proposed as part of a feminist philosophy of engagements. I feel this is an important point, but its force is somewhat reduced by failing to explain what, precisely, the authors mean by reflexivity. […] Clearly explicating what the authors associate with the term would strengthen their point.

Response: We have now added a new section on feminist epistemology, where we explicate what we mean by ‘reflexivity’ (and ‘positionality’), and how we apply the notion(s) in this paper (pp. 4-6).

Wellcome Open Res. 2021 Apr 8. doi: 10.21956/wellcomeopenres.18221.r43203

Reviewer response for version 1

Mary Madden 1

Employing ‘engagement’ as an umbrella term for imperatives and activities ‘in the health research environment in the UK and beyond’, the article points to a need for critical interrogation of the concepts and practices around ‘engaging’. The authors call for a philosophy of engagements ‘informed by feminist epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing.’ They contend that ‘feminist methodological tools and theoretical approaches’ can help with the kinds of challenges they identify.

While welcoming more critique in this area and agreeing that feminist epistemology has potentially much to offer in this field, I found little substantive to get hold of here. The authors are arguing for more ‘critical inquiry’ but provide limited in depth critical engagement with the existing philosophy of involvement or engagement, or with the empirical work in the field. The article aspires to ‘move beyond questions of terminology’ to ‘focus on the tensions and possibilities that the multiplicity of engagements evoke’. ‘Engagements’ is said to function as a ‘problem concept’ that ‘can be worked with yet has many uses and no settled meaning…there is analytic value in considering the broad range of engagements together, allowing reflection on the intrinsic tensions, discomforts, and possibilities around doing and researching engagements.’ Maybe, but it also risks compounding vagueness. The article promises a consideration of ‘the roots, present modalities and institutional frameworks that have been erected around engagements,’ but provides a generalised critique/impression of the field not well grounded in specific concepts, practices and places. In order to grasp what was on offer and ‘navigate and make sense of this melee of concepts and practices’, I wanted more clarity on the range of concepts and activities conflated under ‘engagements’. For me, the loss of specificity did not help produce a ‘synthesis that challenges and moves us forward’.

A call for a philosophy of engagements can imply there are none already there and risks contributing to the constant ‘forgetting’ of knowledge work already undertaken (cf feminist philosopher Mary Daly and current debates about ‘race’).  I wanted deeper, more scholarly engagement with the existing material. There are philosophies of ‘engagement’ in political philosophy (citizen involvement in democratic politics) and a long history of attempts to apply these in the history of participatory approaches to research.  In activism there is much to draw on in the work of environmental movements, ‘development’ politics, community work, informal education, feminist organising, disability politics, anti-racism, ‘patient’ movements- patient and health advocacy and activist movements. Knowledge about feminist and other epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing are mentioned here but not actively engaged with. The authors note that ‘engagement activities are being absorbed by large HIC institutions, leaving limited space for alterative conceptualisations and enactments of engagements, including the development of culturally and locally appropriate frame’ without discussing the history of ‘alternative conceptualisation and enactments’ in low and middle income countries. It is also perhaps worth noting the differences in the work arising from STS (often about basic science and technologies linked to health) and from applied health research. Also it is worth considering a more critical approach to the ‘causality’/progress of activisms or scientific breakthroughs in particular locations: ‘This sparked a shift in the relationship between patients and healthcare organisations as well as between research participants and research institutions, as patients and participants increasingly demanded recognition of their agency and rights, including to participate in healthcare and health research decision-making’. Were/are people demanding ‘rights’ or specific services/activities? How/ has this been met - a citizen’s rights agenda or a market/consumerist response?

Engagement practices are said to be ‘shaped and constrained by the wider social and structural contexts in which they are generated, and in which research and engagements occur’ but there is no sense given of what these actually are or how this works. ‘These structural forces – both of the funding and political landscapes, and the wider societal structures that embed them – are not always stable, creating challenges in obtaining consensus, and leading to changing emphasis and value in engagements around who should be engaged with, why, and what it means to engage. Interesting critical questions are also raised when the symbolic value gained by institutions is considered.’ There is no ‘consensus’ on what ‘engagements’ mean because it covers a set of terms deployed to mean different things. It is not clear why or if ‘consensus’ should be a goal given the messy history and complexity of democratic politics and patient and public involvement in research and the power imbalances (conflicts) therein (see Madden & Speed, 2017 1 ).

The institutional angle introduced in the, ‘engagements and knowledge production’ section offers the potential for more focused grounding. Funded health research features the complex, simultaneous involvement of numerous institutions (see e.g. Madden et al 2020 2 ).  One of the key issues in UK applied health research has been to  distinguish active involvement in the research process from being a participant in a study or taking an interest in/being told about research findings (engagement). A key difference is being able to shape a process/make decisions (power to influence the process) within an increasingly corporatised health research agenda (politicians and corporations are not mentioned as actors in the field but healthcare is a key market and political football). It is not clear to me why disregarding this power distinction is helpful in furthering critique. It might be worth considering how the ‘mainstreaming’ referred to corresponds with institutionalisation. INVOLVE started as a separate campaigning organisation. NIHR Involvement has now taken over from INVOLVE and has re-launched key resources previously produced by INVOLVE. The James Lind Alliance is also now in-house and not campaigning from outside.

The point about a differentiation between research and engagement made ‘via an equation of research with (valid) knowledge production, and relegation of engagements as not (valid) knowledge producing activities’ needs more clarity. Public engagement with the products of research processes can be exercises in dissemination or ‘impact’ and/or PR/marketing/recruitment exercise for universities. To conduct research on engagement (with the products of research) of the quality of the original research in order to determine the impact or assess the value of such engagement activity is complex and often not in the budget, hence quicker, cheaper market research activities. Points about whether/how (performative) academic metrics like REF in the current mode of production meet people’s real life health concerns in particular contexts are worth pursuing in more depth.

As it stands the current ‘alternative’ recommended philosophy and its application in ‘engagement’ practices is unclear beyond calls for reflexivity and taking an open mind to evaluation methods (arguably both are already [research] practice norms). It would be useful to clarify whether and how the recommended form of reflexivity differs from that already recommended as standard in qualitative health research texts and evidence that it is absent in current work. The authors ‘contend that feminist methodological tools and theoretical approaches can help with the above kinds of challenges.’ They ‘recommend reflexivity as both a conceptual and practical tool’. It is not clear why this is recommended at the end rather than argued through and applied from the outset.  Doing this would mean applying the emphasis on ‘the situatedness and contextuality of knowledge claims called for’ and more of the reflexivity demanded ‘from those positioned as ‘experts’ on what shapes their own epistemic starting points and interpretations’.

I wanted to know how/if the feminist ‘epistemic issue of positionality’ referred to here differs from Foucauldian versions. The argument that engagements are required but not valued academic work and carried out by women could be made more clearly. It would be useful to know if there is empirical data available on the growth of PPI/E research labour (as part of research posts) and as a profession (often in marketing departments as part of ‘engagement’)?

 ‘Feminist approaches to evaluation’ are said to ‘have applied alternative modes and frameworks of (e)valu(at)ing… enable[ing] active concern both for the plural ways in which ‘value’ manifests, and for how, why, and what kinds of information are produced through evaluation, as well as how this information is epistemically positioned in relation to research and ‘knowledge.’ Feminist epistemology is another rich field of debate (and major disagreement) and it would be helpful to locate this specifically at this stage of the (gendered) ‘paradigm wars’. Many, including Anne Oakley are concerned with appropriate methods of evaluation rather than ‘alternatives’ per se.  It is a truism (rather than an intrinsically feminist point) ‘that evaluation may serve multiple purposes, including social, cultural, political and financial; and, that the ‘value’ of engagements is less an intrinsic singular property and more something that is multi-directional and actively created through engagements and evaluation processes.’

Madden, M, Speed, E. Beware Zombies and Unicorns: Toward Critical Patient and Public Involvement in Health Research in a Neoliberal Context.   Frontiers in Sociology 2017 2:7    https:10.3389/fsoc.2017.00007    ISSN=2297-7775 1

Madden, M, Morris, S, Ogden, M, Lewis, D, Stewart, D, McCambridge, J. Producing co‐production: Reflections on the development of a complex intervention. Health Expect. 2020; 23: 659– 669. https://doi.org/10.1111/hex.13046  2

Oakley, A (2000) Experiments in Knowing: Gender and Method in the Social Sciences.The New Press 3

Does the article adequately reference differing views and opinions?

Partly

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Partly

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Partly

Is the rationale for the Open Letter provided in sufficient detail?

Partly

Reviewer Expertise:

Qualitative health research. PPI. Ex community worker. PhD Women's Studies

I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.

References

  • 1. : Beware Zombies and Unicorns: Toward Critical Patient and Public Involvement in Health Research in a Neoliberal Context. Frontiers in Sociology .2017;2: 10.3389/fsoc.2017.00007 10.3389/fsoc.2017.00007 [DOI] [Google Scholar]
  • 2. : Producing co-production: Reflections on the development of a complex intervention. Health Expect .23(3) : 10.1111/hex.13046 659-669 10.1111/hex.13046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. : Experiments in Knowing: Gender and Method in the Social Sciences. The New Press .2000;
Wellcome Open Res. 2022 Jan 5.
Sonja Erikainen 1

We thank the reviewer for their useful comments and feedback, which we believe have enabled us to improve the paper significantly. We have addressed the comments and feedback as follows:

We are very grateful for reviewer one’s extensive engagement with our paper and arguments. Yet, their comments and feedback pull towards many different directions, and we found that addressing them all comprehensively was not possible – the paper would be at risk of losing coherence and direction if we were to pull on all these threads. Their comments and feedback, in many ways because of their wide-ranging nature, have, however, been extremely helpful in enabling us to reflect on and clarify the aims and scope of this paper and better define its parameters and limitations. Thus, a key way in which we have responded to reviewer one is to take a wider lesson across all their comments, and more explicitly and clearly define the scope and terms of our arguments. To do this, we have revised the introduction, added a new section on feminist theory, and revised the other sections in light of this new content. Beyond this, our responses to their comments are as follows:

Comment: I found little substantive to get hold of here. […] The article […] provides a generalised critique/impression of the field not well grounded in specific concepts, practices and places. In order to grasp what was on offer and ‘navigate and make sense of this melee of concepts and practices’, I wanted more clarity on the range of concepts and activities conflated under ‘engagements’. For me, the loss of specificity did not help produce a ‘synthesis that challenges and moves us forward’.

Response: We have added some new, more specific examples across the paper, to provide more to ‘get a hold of’ empirically. We have also added a new section (pp. 4-6) to elaborate on our conceptualisation and use of the feminist theoretical concepts we are working with. However, we have retained our use of ‘engagements’ as a problem concept despite the ambiguity and loss of specificity this invites, because one notable point of the paper is to avoid (and, indeed, argue against) fixing or delimiting what ‘engaging’ can (or should) mean, to leave space open for different and alternative ways to think about and enact engagements. Our aim in doing so is precisely to challenge and move beyond terminological delineations and quibbles, and provoke readers to think more expansively (and creatively) about the wide range of things that can be ‘engagements.’ We did, however, omit the notion of ‘synthesis,’ as the reviewer is right in suggesting that what we produce here is, less a synthesis, and more a provocation.

Comment: A call for a philosophy of engagements can imply there are none already there and risks contributing to the constant ‘forgetting’ of knowledge work already undertaken […] I wanted deeper, more scholarly engagement with the existing material. There are philosophies of ‘engagement’ in political philosophy (citizen involvement in democratic politics) and a long history of attempts to apply these in the history of participatory approaches to research. In activism there is much to draw on in the work of environmental movements, ‘development’ politics, community work, informal education, feminist organising, disability politics, anti-racism, ‘patient’ movements- patient and health advocacy and activist movements.

Response: We have now added an acknowledgement of the existence of other philosophies of engagement (from political philosophy) (pp. 5-6) but have not engaged with these in any depth, because our focus is on the application of feminist theory to the sphere of engagements.

We have added more content concerning activist movements and patient mobilisations (pp. 6-7) (also as a way to provide more specific examples into the paper), but not in relation to philosophy of engagements directly as the connection between the kinds of activist movements highlighted by the reviewer and philosophy, as conceptualised in this paper, is only indirect.

Comment: Knowledge about feminist and other epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing are mentioned here but not actively engaged with.

Response: We have now added a new section on feminist theory into the paper (pp. 4-6), which grounds the paper within feminist epistemology as its theoretical basis, and we have applied this across the paper better.

Comment: The authors note that ‘engagement activities are being absorbed by large HIC institutions, leaving limited space for alterative conceptualisations and enactments of engagements, including the development of culturally and locally appropriate frame’ without discussing the history of ‘alternative conceptualisation and enactments’ in low and middle income countries. It is also perhaps worth noting the differences in the work arising from STS (often about basic science and technologies linked to health) and from applied health research. Also it is worth considering a more critical approach to the ‘causality’/progress of activisms or scientific breakthroughs in particular locations. Were/are people demanding ‘rights’ or specific services/activities? How/ has this been met - a citizen’s rights agenda or a market/consumerist response?

Response: We have now revised the relevant section about alternative conceptualisations, including by adding new content on engagements in LMICs and clarifying our arguments related to this (p. 10) (and as a way to provide more specific examples into the paper).

We have not added content on the difference between STS and applied health research, as this is beyond the scope of the paper and does not directly contribute towards its aims.

We expanded the section on the legacy of activism to better highlight the wider scope of relevant activism (pp. 6-7) (and as a way to address the above comment concerning activist movements and patient mobilisations).

Comment: Engagement practices are said to be ‘shaped and constrained by the wider social and structural contexts in which they are generated, and in which research and engagements occur’ but there is no sense given of what these actually are or how this works.

Response: There was already a statement of what the relevant social structures are, but this has been slightly expanded by providing some examples of how social and structural conditions place barriers to participation (p. 17). We have also expanded the related argument about gender and career hierarches around who undertakes the labour of engaging and why (p. 17).

Comment: There is no ‘consensus’ on what ‘engagements’ mean because it covers a set of terms deployed to mean different things. It is not clear why or if ‘consensus’ should be a goal given the messy history and complexity of democratic politics and patient and public involvement in research and the power imbalances (conflicts) therein

Response: We fully agree and did not intend to argue that consensus is or should be to goal – merely that it is difficult to reach. We have, however, now deleted the relevant statement to avoid any misunderstanding in this regard.

Comment: One of the key issues in UK applied health research has been to distinguish active involvement in the research process from being a participant in a study or taking an interest in/being told about research findings (engagement). A key difference is being able to shape a process/make decisions (power to influence the process) within an increasingly corporatised health research agenda (politicians and corporations are not mentioned as actors in the field but healthcare is a key market and political football). It is not clear to me why disregarding this power distinction is helpful in furthering critique. It might be worth considering how the ‘mainstreaming’ referred to corresponds with institutionalisation.

Response: We already devote significant space across the paper to interrogating and challenging the distinction between research and engagements, including the many roles that participants can occupy in both (from being a research participant in the conventional sense to being an ‘engagee’ or participating in engagement activities to being a co-producer of knowledge able to make decisions and set agendas). We do not feel that more content on this would add to the paper – indeed, distinctions and power relations embedded in the roles that participants are (and are not) allowed to occupy in the processes of research and engagements are not disregarded in this paper – they are one of our areas of focus.

While the politics and corporatisation / marketisation of health research are not our focus, we have added an acknowledgement of some of the ways in which corporatisation / marketisation shapes the health research landscape and agendas, through an example of ‘expanded access’ (p. 7). This example is specifically about the question of patients’ and patient advocacy groups’ power to make decisions and influence research processes.

We have added the word ‘consequently’ in the statement, “in universities, developments like the above constitute the background against which engagements have become increasingly mainstreamed and, consequently, institutionalised,” to highlight that institutionalisation of engagements in universities followed from the developments that have made engagements more mainstream (p. 8). 

Comment: The point about a differentiation between research and engagement made ‘via an equation of research with (valid) knowledge production, and relegation of engagements as not (valid) knowledge producing activities’ needs more clarity.

Response: We have revised this sentence to make it clearer (p. 12)

Comment: Points about whether/how (performative) academic metrics like REF in the current mode of production meet people’s real life health concerns in particular contexts are worth pursuing in more depth.

Response: This is beyond the scope of this paper, and thus we have not pursued this in more depth.

Comment: As it stands the current ‘alternative’ recommended philosophy and its application in ‘engagement’ practices is unclear beyond calls for reflexivity and taking an open mind to evaluation methods (arguably both are already [research] practice norms). It would be useful to clarify whether and how the recommended form of reflexivity differs from that already recommended as standard in qualitative health research texts and evidence that it is absent in current work. […] It is not clear why [reflexivity] is recommended at the end rather than argued through and applied from the outset. Doing this would mean applying the emphasis on ‘the situatedness and contextuality of knowledge claims called for’ and more of the reflexivity demanded ‘from those positioned as ‘experts’ on what shapes their own epistemic starting points and interpretations’.

Response: We have added a new section on feminist theory into the paper (pp. 4-6), which grounds the paper within feminist epistemology as its theoretical basis. This includes elaboration and clarification on the notion of ‘reflexivity’ (and ‘positionality’) that we advocate for, and how they also shape and condition our own knowledge claims. We have then applied this theoretical basis across the paper better (including arguing for and showing the applicability of both reflexivity and positionality throughout the paper), to more directly show how a feminist philosophy offers a different basis and angle for thinking about the kinds of challenges and issues that, we argue, characterise the landscape of engagements.

Comment: I wanted to know how/if the feminist ‘epistemic issue of positionality’ referred to here differs from Foucauldian versions.

Response: It has now been clarified that feminist notions of positionality – including ours – often tend to be built on Haraway’s version (p. 5). Elaboration of Foucauldian theory is beyond the scope of this paper.

Comment: The argument that engagements are required but not valued academic work and carried out by women could be made more clearly. It would be useful to know if there is empirical data available on the growth of PPI/E research labour (as part of research posts) and as a profession (often in marketing departments as part of ‘engagement’)?

Response: We have added further detail on the gendered labour of engagements and the related power relations around how this labour is (not) valued (p. 17). 

Empirical data / detail on the growth of PPI/E research labour and profession is outside the scope of this paper beyond the content we already provide on this.

Comment: Feminist epistemology is another rich field of debate (and major disagreement) and it would be helpful to locate this specifically at this stage of the (gendered) ‘paradigm wars’

Response: We have now added a new section on feminist epistemology and more directly shown how our arguments are located within and build on feminist epistemology (and which feminist tools we build on, more specifically) (pp. 4-6). We are, however, not sure to which particular ‘paradigm wars’ the reviewer here refers and thus unable to locate our arguments in this regard (for there have been and continue to be many paradigm wars within and against different feminisms).

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    No data are associated with this article.


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES