Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
letter
. 2022 Feb 10;6:58. Originally published 2021 Mar 15. [Version 2] doi: 10.12688/wellcomeopenres.16535.2

Towards a feminist philosophy of engagements in health-related research

Sonja Erikainen 1,a, Ellen Stewart 1, Angela Marques Filipe 1, Sarah Chan 1, Sarah Cunningham-Burley 1, Sophie Ilson 1, Gabrielle King 1, Carol Porteous 1, Stephanie Sinclair 1, Jamie Webb 1
PMCID: PMC8837807  PMID: 35211657

Version Changes

Revised. Amendments from Version 1

We thank the reviewers for their useful comments and feedback, which we believe have enabled us to improve the paper significantly. They have enabled us to reflect on and clarify the aims and scope of this paper, better define its parameters and limitations, and more explicitly and clearly define the terms of our arguments. In addition to making various major and minor changes across the paper, we have revised the introduction, added a new section on feminist theory, and revised the other sections in light of this new content.

Abstract

Engagement with publics, patients, and stakeholders is an important part of the health research environment today,and different modalities of ‘engaged’ health research have proliferated in recent years. Yet, th ere is no consensus on what, exactly, ‘engaging’ means, what it should look like, and what the aims, justifications, or motivations for it should be. In this paper, we set out what we see as important, outstanding challenges around the practice and theory of engaging and consider the tensions and possibilities that the diverse landscape of engaging evokes. We examine the roots, present modalities and institutional frameworks that have been erected around engaging, including how they shape and delimit how engagements are framed, enacted, and justified. We inspect the related issue of knowledge production within and through engagements, addressing whether engagements can, or should, be framed as knowledge producing activities. We then unpack the question of how engagements are or could be valued and evaluated, emphasising the plural ways in which ‘value’ can be conceptualised and generated. We conclude by calling for a philosophy of engagements that can capture the diversity of related practices, concepts and justifications around engagements, and account for the plurality of knowledges and value that engagements engender, while remaining flexible and attentive to the structural conditions under which engagements occur. Such philosophy should be a feminist one, informed by feminist epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing. Especially, translating feminist tools of reflexivity and positionalityinto the sphere of engagements can enable a synergy of empirical, epistemic and normative considerations in developing accounts of engaging in both theory and praxis. Modestly, here, we hope to carve out the starting points for this work.

Keywords: engagement, involvement, health research, feminist, epistemology, evaluation

Disclaimer

The views expressed in the article are those of the author(s). Publication in Wellcome Open Research does not imply endorsement by Wellcome.

From patient involvement panels to twitter chats to citizens’ juries, public engagement is part of the health research environment today, in the UK and beyond. The terms ‘engagement’ and ‘involvement’ are part of a spacious and expansive conceptual landscape where multiple terms are used simultaneously and in overlapping ways across academic, policy and public discourses. Sometimes, different terms are used interchangeably to capture practices that follow different, even contrasting logics ( Duschinsky & Paddison, 2018), including ‘public,’ ‘patient,’ ‘community,’ or ‘stakeholder’ ‘participation,’ knowledge ‘communication,’ ‘exchange,’ and ‘co-production.’ While the different terms collate diverse practices, mechanisms and communities to change the relationship between science and wider society, it is no longer considered acceptable for health research to be ‘un’-engaged.

There is no consensus on what, exactly, ‘engaging’ means or should look like, so we need critical interrogation of the concepts and practices around engaging (see e.g. Crowe et al., 2020; Stilgoe et al., 2014). Different terms frame the people who are to be engaged with, and their roles, in different ways. There are not merely labels, but act to shape practices of engaging, including, for example, whether people are ‘involved’ in, ‘engaged’ with, or ‘co-producers’ of research. While many terms centre the ‘public’ as those who are engaged with, others focus on specific groups such as ‘patients.’ There has also been a shift away from the notion of a singular, undifferentiated public with a unified perspective (e.g., beyond the notion of a singular ‘patient perspective,’ see Rowland et al., 2017), towards a recognition of publics as plural, acknowledging diversity (see Felt & Fochler, 2010). Concurrently, despite the multiplicity of terms used to describe engaging and engagement, those who are doing the engaging are rarely explicitly specified. Rather, their identities remain implicit yet presumed, i.e. scientists, health professionals, researchers, and, increasingly, dedicated public engagement practitioners. Yet a distinction is generally drawn between the ‘engagers’ and the ‘engagees’ as the two sides in the science/society relationship. The central role of public engagement practitioners who often plan and undertake the engaging, is notably silent across these conceptualisations.

There are additionally competing accounts of the aims, or motivations of engaging. One influential account from Fiorino (1990) distinguished between substantive rationales, where engagements are justified because they lead to better ends through dialogue; instrumental rationales, where engagements are undertaken to achieve some other pre-defined end, such as ‘better trust in science’; and normative rationales, where engagements are justified because they are the ‘right thing’ to do. This distinction has retained analytic purchase subsequently (e.g. Stirling, 2008). While the different justifications for engaging are not always as clear in practice, typologies can nonetheless highlight how different positions sit in tension to each other.

Our aim in this paper is not to resolve the above challenges, create another typology nor to argue for the use of specific terms over others. We do not aim to delimit what does or does not (or should or should not) count, legitimately, as ‘engaging.’ Rather, we hope to consider the tensions and possibilities of the diverse landscape of engaging. We use the term ‘engagements,’ both to signal this goal, and for practical reasons, as an umbrella concept that can capture the plural, interlaced and overlapping practices that circulate in this space. ‘Engagements’ in this paper functions as ‘problem concept’ that can be worked with yet has many uses and no settled meaning (see also Parry et al., 2012). While this may result in a loss of specificity, we contend that there is analytic value in considering the broad range of engagements together, allowing reflection on the intrinsic tensions, discomforts, and possibilities around doing and researching engagements.

The proliferation of different ‘engaged’ health research modalities, and the contested conceptual landscape currently surrounding public engagement, raise the quite simple questions of what, exactly, is going on here, and how should we navigate and make sense of this melee of concepts and practices? In this paper, we, an interdisciplinary group of social science and humanities health scholars, build on our different disciplinary perspectives and experiences to chart what we see as important, outstanding challenges around the practice and theory of engaging. We consider the roots, present modalities and institutional frameworks that have been erected around engagements, including how the mainstreaming of engagements can shape and delimit how engagements are framed, enacted, and justified. We examine the related issue of knowledge production within and through engagements, addressing whether engagements can, or should, be framed as knowledge producing activities, what kinds of knowledge they might generate, and who is (and is not) positioned as a knowledge producer, within the confines of wider power relations and epistemic hierarchies that constrain the roles that can be attributed to different actors. We then unpack how engagements are or could be valued and evaluated, emphasising the plural ways in which ‘value’ can be conceptualised and generated by different actors involved in engagements, and how this plurality limits the ability to fix or measure value from engagements.

Our key aim is to make the case for a philosophy of engagements, where philosophy entails inquiry into what kind of activity something is and how we should do it. We call for a philosophy that can capture the diversity of related practices, concepts and justifications around engagements, and account for the plurality of knowledges, knowledge producers and kinds of value that engagements engender, while remaining flexible and attentive to the structural conditions under which engagements occur (see also Mockford et al., 2012; Rowland et al., 2017). We argue that the translation of existing feminist epistemological and methodological tools to equitable modes of research participation, knowledge production, and valuing into the sphere of engagements can enable the construction of precisely such a philosophy. Because of this, we start this paper with a consideration of the feminist tools of reflexivity and positionality, to embed our arguments within feminist epistemology and show how and why these tools provide a different les to engagements. We conclude that our proposed feminist philosophy of engagements can enable a synergy of empirical, epistemic and normative considerations in developing accounts of engagements in both theory and praxis. Modestly, here, we hope to carve out the starting points for this work.

Feminist reflexivity and positionality

While feminist theory is not a singular, but a plural entity composed of diverse (sometimes contradictory) theoretical lenses, perspectives, and commitments, it is nonetheless possible to draw out epistemic tendencies and theoretical tools that are widely (if not universally) shared across feminist scholarship. In doing so, we build on Ackerly & True (2008) to argue that a feminist-informed approach synergising theoretical insights across of feminisms can enable one to foreground considerations that can be applied by everyone, regardless of one’s relationship with feminist theory more broadly. For our purposes, these considerations are twofold and interrelated: feminist notions of reflexivity and positionality, both of which are derived from wider feminist epistemology.

Feminist epistemologies and methodologies have long sought to destabilise traditional power differentials within the processes of knowledge production (e.g. Alcoff & Potter, 1993; Code, 1988; Haraway, 1988; Harding, 1986; Harding, 1991; Hill Collins, 2000; Sandoval, 2000; Oakley, 2000). This includes the questions of how knowledge is produced, what counts as knowledge proper, and who is (allowed to be) a knowledge producer. Feminist scholars have challenged the proclaimed neutrality, objectivity, and epistemic superiority of scientific knowledge by showing how all (including scientific) knowledge arises from a particular and partial perspective. In science, this perspective has conventionally been that of a white, highly educated, middle-class European or North American male who occupies a professional role in science and builds knowledge based on positivist epistemology. Feminist epistemologies have shone light on how dominant epistemic paradigms privilege some knowers and ways of knowing while marginalising and silencing others, and they have highlighted and sought to subvert the power relations embedded in this process. This has included exposing and re-claimed subjective experiences as epistemically salient, often by positioning experiences (especially of marginalised groups) as key to knowledge production rather than as a hindrance to it.

Feminist notions of positionality arise out of these epistemological insights, emphasising the situatedness and contextuality as well as incompleteness of all knowledge claims. While there are multiple and differing feminist conceptualisations of positionality (see Nencel, 2014; Simandan, 2019), many build on Haraway’s (1988) notion of situatedness or ‘positioning’ as a key practice grounding knowledge ( Simandan, 2019). Positioning knowledge enables one to see the kinds of power (including social, institutional, epistemic, etc.) that enabled the making of the knowledge claims. Positioning entails making visible and interrogating the significance of one’s location within power relations – ‘positioned’ knowledge cannot claim universality but rather sees the world from a specific location, in ways that are explicitly particular and embodied ( Rose, 1997). Foregrounding positionality, then, entails starting from the assumption of knowledge plurality and partiality, while conceptualising sound knowledge production as requiring both ‘positioning’ and dialogical engagement with plurality and partiality.

Feminist notions of reflexivity are intimately connected with positionality and have significantly influenced conceptualisations of reflexivity as a methodological tool more generally (see Lumsden, 2019). As with positionality, conceptualisations of reflexivity both within and beyond feminist theory are plural and contested ( Lumsden, 2019; Pillow, 2003; Slaney et al., 2019), but reflexivity as a means of accountability has been a key distinguishing feature of feminist epistemology ( Linabary et al., 2020). Feminist notions of reflexivity have especially emphasised the examination and interruption of power relations embedded in the processes and products of knowledge. They have centred around interrogating the positionality of the knowledge producer, including how the knowledge producer’s location within wider relations of power delimits the knowledge that is produced ( Linabary et al., 2020; Lumsden, 2019; Pillow, 2003). This includes interrogating and interrupting conventional epistemic hierarchies between researchers and participants, and ‘the knower’ and ‘the known.’ Feminist reflexivity has been framed as a way of doing research or producing knowledge differently: while reflexivity will not obliterate unequal power relations, it can highlight the epistemic starting points that constrain how we interpret the world, and it can foreground the messy and sometimes uncomfortable ways in which the knowledges we produce fail to be innocent of these power relations ( Pillow, 2003).

While the above is a selective outline of feminist theoretical tools, we contend that it offers a useful starting point to interrogate engagements. Feminist notions of reflexivity and positionality have mostly been conceived for and applied in the context of research. Transferring them into the context of engagements can enable a feminist philosophy of engagements.

Ours is not the first philosophy of engagements – indeed, several philosophies have been proposed and applied, perhaps most prominently including those derived from political philosophy and theories of democratic participation, such as deliberative democracy that form the basis of public engagement approaches like citizen juries and assemblies (see Delli Carpini et al., 2004; Webler & Renn, 2013). Others have mapped the multiple philosophical perspectives that have shaped approaches to engagements in science and technology studies (see Delgado et al., 2010; Durant, 2011). However, a philosophy grounded in feminist epistemology offers a productively different basis upon which to build engagements.

Our arguments and analysis were generated through many discussions within our Research Centre, motivated by our shared concern around engaging in a context where public engagement has been persuasively mainstreamed, despite the lack of consensus on definitional issues. Like all knowledge claims, however, our arguments and analysis arise from a particular perspective; namely, that of an international group of scholars and public engagement professionals, all but two of whom are women and all of whom have white privilege and institutionally legitimated positions in an interdisciplinary health research centre in a ‘Russell group’ university in an English-speaking high-income country. The knowledge that we strive to produce is also partial, shaped and constrained by who and where are located – epistemically, socially, and geographically. This paper, correspondingly, is not intended to generate final statements or universalisable basis for how to do or think about engagements, but rather, a situated and incomplete perspective that, we hope, can offer a productive provocation.

The roots, manifestations, and mainstreaming of ‘engaged research’

The current landscape of engagements with health-related research has been significantly crafted by changing social and institutional contexts, policies, and wider questions of research governance. While our intention here is not to provide a comprehensive genealogy of engagements, we wish to outline some key areas and shifts that we consider especially pertinent for making sense of engagements now.

Among the most influential developments is the changing relationship between researchers/doctors and patients, partially driven by patient and health advocacy and activist movements since the 1960s. For example, especially in HICs, the women’s health movement has since the 1960s demanded and provided women with access to knowledge about their own bodies and health when this knowledge had previously been the near exclusive purview of (primarily male) healthcare professionals ( Murphy, 2012). The HIV/AIDS activist movement in the 1980s gave rise to some of the first “expert patients,” as patient activists became disillusioned with medical professionals’ ability to treat them, and begun teaching themselves about medical science, conducting their own community-based research, and creating their own knowledge about the disease based on experience as well as science ( Epstein, 1996). Similarly, disability and mental health activists have challenged medical models of disability and mental health, and the control that medical professionals have exerted over the definition and management of their lives, arguing for their right to make decisions about their own bodies ( Berghs at al., 2020; Rosenberg & Rosenberg, 2018). These movements, together with other forms of patient activism, sparked a shift in the relationship between patients and healthcare organisations and research participants and research institutions, as patients and participants increasingly demanded recognition of their agency and rights, including to participate in healthcare and research decision-making.

In the context of regulation, a valuable example of how these shifting relationships shaped the research landscape is the case of ‘expanded access’ and the regulatory approval process in the US. Expanded access is the use of an as yet unlicensed medical product outside of a clinical trial for therapeutic benefit for serious or life-threatening conditions for which approved treatment options have been exhausted ( FDA, 2021). A milestone in the history of expanded access was the case of Josh Hardy in 2014, a boy with an aggressive form of kidney cancer, whose family requested access to brincidofovir, an investigational product produced by the biotechnology company Chimerix. While Chimerix initially refused this request, a public campaign led by Hardy’s family caused Chimerix, in collaboration with the FDA, to organise an additional open-label trial with Hardy as the first enrollee ( Moch, 2017). This case sparked both regulatory and practice shifts around expanded access in the US (see Caplan et al., 2018; FDA, 2020; Woollett & Jackson, 2017) and more proactive ethical reflection within the pharmaceutical industry regarding equitable expanded access – a development that engaged patient advocates have encouraged. Part of this has been the adage, adopted from the disability advocacy community, of ‘nothing about us without us’. Yet, closer relationship between industry and patient groups also carries risks. Patient advocacy groups can become co-opted as advocates for the interests of pharmaceutical corporations, pushing for their particular products to gain regulatory approval, even when clinical benefit has not been well established. For example, the Biogen Alzheimer’s drug Aduhelm was recently approved by the FDA through its Accelerated Approval regulatory pathways and with support from the Alzheimer’s Association patient advocacy group, which is partially funded by Biogen ( Ault, 2021). This was despite little evidence of the drug’s clinical benefit, following several failed trials, and despite critics arguing that its approval may harm patients, is expensive, and may direct resources away from more effective care (e.g. Ramachandran & Ross, 2021).

These examples highlight the power of disruptive patient advocacy in regulation as well as knowledge production, but also how patient advocacy can be co-opted by traditional power structures, including commercial or market interests, in ways that may result in patients struggling to access expensive treatments with little evidence of efficacy. In the context of both commercially and publicly funded research, however, engaging patients and publics has been one way of addressing challenges of accountability and transparency. It may relate to particular forms of activism and ways of responding to broader social and political aims such as those of inclusion, social change, and health justice as is the case of rare diseases and developmental disabilities ( Filipe et al., 2021; Rabeharisoa et al., 2014).

In universities, developments like the above constitute a background against which engagements have become increasingly mainstreamed and, consequently, institutionalised. Today, patients and publics are participating in health research and healthcare in more diverse ways than before through mandates for engaged research. For example, the UK National Institute for Health Research (NIHR) has made ‘patient and public involvement’ a requirement for research funding, with other funders following suit. Recently, the NIHR, among others, have also begun to use the term ‘co-production,’ entailing a rhetorical shift towards more egalitarian and collaborative models as an avenue for improving health research engagements ( NIHR, 2015). The NIHR has been influential in defining, through guidance and policy, what constitutes ‘good’ engagements, especially through their INVOLVE programme, which initially supported engagements in the National Health Service (NHS). INVOLVE (2012) published resources setting terms of ‘good practice’ in engagements, including guidance for researchers on how to involve publics. Other organisations, such as the Jefferson centre in the US also define ‘best practice’, in this case in relation to their approach to citizens juries ( Jefferson Centre, 2020). More generally, engagements are increasingly tethered to institutional practices, including universities setting up their own structures and processes, guided and supported by the National Co-ordinating Centre for Public Engagement. The University of Edinburgh (where we work), for example, is involved in several initiatives including the Beltane Public Engagement Network ( Beltane, 2020), the Scottish Public Engagement Network ( ScotPEN, 2020), as well as its own structures of professional public engagement support.

The frameworks of ‘good’ and ‘best’ practice promoted by different organisations are often credentialed modes of knowledge (coming from and legitimated by authoritative institutions). Notably, they tend also to be delineated in ways that align with the institutions’ broader objectives and agendas. For example, drives to improve engagements, including ‘good’ or ‘best’ practice frameworks in the UK, have coincided with recommendations to measure success from engagements in the context of the Research Excellence Framework (REF). REF assesses research quality including an evaluation of its impact, which is defined in terms of the effects, changes, or benefits achieved ‘beyond academia.’ In this context, engagements are being framed not only in terms of more egalitarian or collaborative research, but also as an instrumental route to achieve research impact ( Paylor & McKevitt, 2019; Smith et al., 2020). This raises questions around the underlying motivations that drive institutional engagements and what the promotion of engagements ‘does’ in practice ( Paylor & McKevitt, 2019; Smith et al., 2020).

Indeed, the aims, justifications and motivations for engagements are often unclear in this context. Shifts towards ‘co-production’ advanced by some organisations may be formally justified by substantive aims of improving research through such engagements, or normative aims of enabling more egalitarian and collaborative research (see Filipe et al., 2017). Yet the practical motivations that foreground engagements may not necessarily match these rationales ( Esmail et al., 2015). Paylor & McKevitt (2019) have argued that a form of ‘authoritative instrumentalism’ underpins the NIHR’s and others’ shift to ‘co-production,’ where engagements are seen as something to be implemented to deliver particular kinds of instrumental outcomes. This is precisely because ‘co-production’ has gained institutional currency in policy initiatives highlighting and prioritising the impact of research outside academia (see also Williams et al., 2020), despite there being no consensus on what co-production means or entails ( Filipe et al., 2017).

Similar tensions, shaped by the institutionalisation of engagements, can also extend to the more micro sphere of engagements undertaken ‘on the ground’ within research projects. While the formal rationale for engagements within research projects may be normative or substantive motivations to ‘do the right thing’ or improve research outcomes, the practical motivations driving engagements may be more instrumental, shaped by institutions’ and research funding bodies’ requirements for incorporating engagements within research ( Paylor & McKevitt, 2019). As Paylor & McKevitt (2019) have suggested, engagements can become an impoverished sphere of activity where researchers are undertaking them because it is a funding requirement without the opportunity to reflect more fully on why. Moreover, mainstream institutionalised models of ‘good’ or ‘best’ engagement practice, while seeking to improve the quality and quantity of involvement happening, may in fact quieten down alternative ways of thinking, so that alternative spaces and activities come to be understood in opposition to mainstream models.

This is especially so when models of and claims to ‘good’ or ‘best’ practice are transported into new contexts, in ways that can make it more difficult to diversify and develop alternative engagements that would better account for cultural and local differences. For example, ‘patient and public involvement’ is now a requirement of joint funding through the UK Medical Research Council (MRC) and NIHR Global Health partnerships in low- and middle-income Countries (LMIC). The framework that has been applied, however, raises questions around whether it is appropriate to take models for engagements developed in HICs and directly apply them in LMICs without building on the experiences from research undertaken in these countries (see e.g. Bolsewicz Alderman et al., 2013). Indeed, engagement activities are being absorbed by large HIC institutions, leaving limited space for alternative conceptualisations and enactments of engagements, including frames based on local perspectives and needs. The Global Challenges Research Fund (GCRF), however, now requires equitable partnership building with LMIC partners as a way to address challenges around HIC-LMIC power relations in research contexts ( UKRI, 2020), creating opportunities for more appropriate, bottom up, local engagement frameworks.

Some health-related research in LMICs has grappled with the contested relationship between the priorities of researchers and the priorities of study participants. This has led to work that attempts to be genuinely participatory, co-led by local communities and driven by their needs, often carried out under the umbrella of ‘participatory action research (PAR)’ and, in some contexts, that of ‘community engagement’ which has otherwise been advocated in global health governance and research agendas (e.g., WHO, 2017). For example, local communities in rural South Africa have been engaged in identifying problems and developing action plans to secure clean drinking water ( Participedia, 2020a), and address under-five mortality ( Participedia, 2020b). In Nepal, participatory interventions led by women’s groups addressed poor birth outcomes for women throughout rural areas of the country – work which researchers attributed to a 30% decrease in neonatal deaths in the communities running these interventions ( Participedia, 2021). Comparatively, however, research-action methodologies and epistemologies from the South have remained far less visible to the engagement scholarship produced in European and North American contexts, even in scholarship seeking to “situate” research engagements and interventions ( Filipe, 2017). In South America and especially Brazil, for instance, there is long history of alternative approaches to engagement whose roots can be traced back to the critical pedagogies of emancipation and democratic participation developed by Freire (1996) and Boal (2000). Where more participatory and less institutionally directed research approaches have been applied within LMICs, there are also ongoing challenges for these approaches to have ‘impact’ in informing policy or secure adequate resources for long term, rather than one-off, projects. Attention to these alternative approaches can, however, highlight that the models of research and engagement that are prioritised and applied in institutional contexts (especially) in HICs are an active institutional choice and driven by power dynamics, including around what is considered an appropriate subject of knowledge work and who should set research agendas.

These issues relate to other limitations for participatory engagements, especially co-production, within academic research. While there are exceptions (including the above types of PAR research, but see also e.g. Collins et al., 2020), decision-making about research questions and design, for example, still tends, to remain in researchers’ hands. Publics or patients are usually involved with more limited questions like design of patient information sheets, and typically only on a study-by-study basis, constraining temporally sustained engagements with research more broadly conceived ( Paylor & McKevitt, 2019). Despite the increasing availability of guidance documents on how to conduct engagements, engagement mandates have not led to the formalisation of training for researchers and healthcare professionals in the skills to carry out ‘good’ engagements. This has facilitated the commercialisation and professionalisation of engagements where ‘independent’ engagement practitioners and organisations are sometimes employed to undertake engagements on researchers’ behalf (see Bherer et al., 2017; Pallett, 2019). Yet, professional roles to carry out engagements, within both universities and independent professional engagement agencies, may not have clear career development pathways. A more processual and experimental approach to engagement requires, paradoxically perhaps, the deployment of adequate resources at the infrastructural level (including funding, time, and space) as well as cultural and institutional forms of validation (whether by means of formal accreditation, monetary remuneration, and/or symbolic valorisation of engagement-related labour; see Filipe et al., 2017).

We contend that the feminist tools of reflexivity and positionality can enable us to approach and think differently about the roots, manifestations and mainstreaming of engagements. This includes the contextually conditioned nature of institutionally authorised models of engagements, and the actual motivations and stated justifications around engagements that are being deployed within the confines of institutions. While the mainstreaming of engagements has opened positive, potentially empowering spaces for bringing in new actors and voices into science, institutionalising engagements carries the danger of homogenising and ‘fixing’ engagements into particular, authorised models of ‘good’ or ‘best’ practice. In theorising and enacting engagements, foregrounding positionality and reflexivity enables us to see how mainstreamed institutional models of engagements are embedded in and may reinforce wider power and epistemic structures. This includes interrogation of the relationship between the engager and the engagee, how we conceptualise ‘engaged research,’ and the roles of different actors in the process. We can and should also interrogate the justifications that drive engagements – both our own and more widely – and the implicit as well as explicit motives and interests that engagements may support. We thus call for critical, theoretical and practical reflexivity on the models, motivations, and justifications based on which engagements are undertaken, and for ‘positioning’ engagements as situated activities and processes that are always undertaken from a partial perspective and remain contextual in ways that challenge universalising claims to ‘best practice.’

Engagements and knowledge production

The institutional context of engagements prompts questions about engagements’ epistemic dimensions: what do engagements, at different moments of the research process, do to processes of knowledge production? To what extent are engagements knowledge producing activities, and should they be? What sorts of knowledge might be produced and shared, by whom, for whom, and for what purposes? These questions are centrally connected with the value and positions attributed to different types of knowledge and knowledge producers within engagements and research processes.

Institutional framings and structures around scientific knowledge production tend to delimit what counts as knowledge producing activity, and the types of knowledge that can be generated. Firstly, research governance frameworks often explicitly differentiate between research and engagements, where the former is, for example, subject to ethical oversight while the latter may not be. While being exempt from oversight procedures can be liberating in permitting creativity and experimentation, it can limit what knowledge engagements are able (or allowed) to generate. There are difficulties converting insights from engagements into valid(ated) knowledge, for example, if the engagements have not undergone the institutional ethical review process required for research with human participants, which presents a barrier to publishing findings especially in peer-reviewed journals. Engagements undoubtedly generate knowledge, but when institutional structures are not conducive, it may not be captured in a usable way, limiting the possibilities for learning. How is the boundary between research and engagement drawn, why, and by whom?

Secondly, institutional framings and structures around scientific knowledge production tend to delimit, explicitly or implicitly, the kind of roles that differently positioned actors can occupy in relation to knowledge; i.e. who ‘counts’ as or is permitted to be a knowledge producer. As noted above, feminist theorists among others have long argued that mainstream scientific epistemologies have privileged the ‘expert’ perspective of trained career scientists – a perspective which has been universal ised, presented as objective, and as paradigmatic of (valid) ‘knowledge.’ The effect has been that the knowledges of non-scientists, and especially knowledge arising from subjective experience, have been positioned as not knowledge in the proper sense; ‘improper knowledge.’ Relatedly, various types of engagements often implicitly position certain actors as holders or producers of knowledge, while others are framed as receivers or as sources of data.

In recent decades, however, the epistemic privilege of the conventional ‘expert’ perspective has been challenged including through the emergence of what have been termed ‘professional layperson’ and ‘lay expert’ roles. Those occupying these roles are generally defined in opposition to (conventional) ‘experts’ but are also, by the very nature of their role, taken to possess a particular expertise: positional experience and ability to navigate the engagements environment and effectively provide ‘lay perspectives’ that are expected and looked-for within these contexts ( Kerr et al., 2007). A further twist on these roles occurs when academics (e.g. bioethicists or social scientists) or professionals with expertise in healthcare and research are cast as ‘laypersons’ and therefore (expected to) represent ‘lay perspectives’ in relation to health-related knowledge in engagement contexts ( Kerr et al., 2007). Similarly, the notion of expertise-by-experience is now commonplace across a range of health governance contexts, but can also generate conflicted, confusing, and sometimes impossible roles for participants ( Meriluoto, 2018). This also raises potentially difficult questions about the extent to which having a particular epistemic standpoint (e.g. patienthood and, as an effect of that position, expertise on illness through experience) means that a person knows ‘more’ or ‘better.’ Inhabiting a particular social location does not necessarily mean that the knowledge arising from that location is more valuable than other, differently located knowledges ( Wylie, 2003), but rather, it reminds of the importance of adopting an epistemological perspective that can engage with a range of epistemic points of view (see also Ackerly & True, 2008).

Such dialogue is especially important when considering challenges around alternative knowledge and epistemic communities, including patient groups, that have the potential to cause harm, such as anti-vaccination groups. Knowledge produced within anti-vaccination groups is often framed as, simply, misinformation and those who promote this information are often framed as, simply, misinformed. Yet, anti-vaccination groups themselves tend to be distrustful of scientific ‘experts’ and their knowledge, and frame their own knowledge as a form of patient empowerment, alternative expertise, and as ‘another way of knowing’ (see e.g. Duchsherer et al., 2020; Kata, 2012). Mainstream intervention tactics aiming to address anti-vaccination by countering ‘misinformation’ through scientific ‘facts’ are unlikely to be successful, precisely for the above reasons: these tactics are based on the presumed superiority of scientific knowledge over alterative knowledges, which are in turn framed as not proper knowledge (i.e. as misinformation) – an epistemic power dynamic that anti-vaccination groups generally reject ( Kata, 2012). Thus, effectively engaging with these kinds of potentially harmful alterative knowledges likely requires different tactics that engage with rather than simply discount the epistemic perspectives of those who promote these knowledges. This does not mean embracing potentially harmful knowledges, but rather a dialogical engagement with these knowledges and the epistemic perspectives from which alterative knowledge claims are made. This includes the social and epistemic power relations that may cause anti-vaccination promoters to distrust scientific experts in the first place.

Further related questions are raised by the issue of how participants’ ‘lived experience’ should be situated within academic environments ( Banfield et al., 2018). Participants’ active roles (e.g. in PAR or co-production research) as more than mere sources of data may demand that they should be directly recognised as knowledge producers, for example through co-authorship of academic papers (see e.g. Bain & Payne, 2015). Yet, incorporating these non-conventional actors into the existing academic hierarchies can be challenging and provoke perhaps uncomfortable questions about the purpose and worth of academic training and credentials. We should also ask whether recognition through modes like co-authorship is meaningful to participants, or whether it is, itself, built on the priorities of academics. Indeed, there may be a need to develop different modes of recognition beyond the academic epistemic and value frameworks.

We contend that feminist methodological tools and theoretical approaches can help with the above kinds of challenges. Reflexivity and positioning knowledges, both our own and those of ‘others,’ enables one to think differently about the relationship between engagements and knowledge production, and about the epistemic tensions around different kinds of knowledges and how we can or should engage with (rather than dismiss or work against) these tensions. When one foregrounds the situatedness and contextuality of all knowledge claims and begins from the assumption of knowledge plurality, conceptualising knowledge production in general as requiring dialogical engagement with epistemic plurality becomes imperative. This, in turn, can enable one to interrogate and, potentially, intervene in the epistemic power relations and hierarchies that delimit how engagements are framed in relation to knowledge and how ‘knowledge’ itself is conceptualised and validated. This demands reflexivity from those positioned as ‘experts’ on what shapes their own epistemic starting points and interpretations as well as genuine effort to see the world from another’s point of view ( Haraway, 1988), including from the point of view of those whose knowledges are contradictory or oppositional to one’s own.

Applying this to engagements can enable the building of more reciprocal forms of engaging and it entails recognition and interrogation of the fact that there are potentially multiple sets of knowledges at play within any given engagement – not (just) singular ‘lay’ or ‘patient’ and ‘scientist’ but plural knowledges and positions from which knowledge is generated, including those of facilitators, practitioners, funders or commissioners, etc. – and that knowledge progresses dialogically. Conceptualising engagements, through a feminist lens as centrally epistemic practices focuses attention on the epistemic starting points and processes as well as end products of engagements, implying that our valuations of engagement should orient around how different knowledges are generated through engaged research, where, from which positions, and by whom. These issues are also connected with the question of how and why engagements are valued and evaluated.

Valuing and evaluating engagements

As practices and processes of engagements have been mainstreamed, calls for their evaluation have also grown (see e.g. Oliver et al., 2019). Processes of evaluating engagements are often not well documented in existing literature ( Esmail et al., 2015). Formal mechanisms for evaluating engagements are, however, increasingly required by funding bodies and institutions, and expected by other stakeholders to develop understanding of individuals’ and groups’ perceptions of engagements, increase awareness, or improve participation rates. The UK Research and Innovation (UKRI) evaluation guide, for example, lists evaluation techniques based on social and market research methods like surveys, interviews, focus groups and discussions with target groups or wider publics ( UKRI, 2011). Yet, the formalisation of evaluating engagements raises further questions around how and why evaluations are undertaken, to whose benefit, whose views are represented and whose may be excluded.

Formal evaluation guidelines often define evaluation, implicitly or explicitly, in terms of determining and improving the impact of engagements, where ‘impact’ is often framed in relation to changes or benefits ‘beyond academia,’ as delineated in the REF. The UK MRC (2020), for example, considers that evaluation is done through measuring learning, changes in thinking, and inspiration to know more or get involved by those who are engaged. The information that is collected through evaluation is usually seen as means to increase the value of engagement activities, while ‘value’ is associated with ‘impact.’ Conceptualising engagements in this way as may not, however, fully capture the inherently human aspect of engagements, including relationships, exchange of knowledge and ideas that often results in profound and insightful experiences for those involved, and may not be measurable ( Komporozos-Athanasiou et al., 2016). Institutional framings of evaluation can have the effect of not only delimiting what (proper) ‘evaluation’ should look like, but also pre-defining the purpose of evaluation as impact and quality assessment, in ways that can silence the potential of evaluation exercises to produce valuable insight and knowledge, on their own right. Purtell et al. (2012) have critiqued the drive to emphasise impact and measurement of engagements without due reflection on the purpose or rationale of engagements in the first place. Boivin et al. (2018), moreover, found that publics are often not involved in the development and design of the evaluation tools in the first place.

Feminist approaches to evaluation have applied alternative modes and frameworks of (e)valu(at)ing including multi-vocal and appreciative inquiry methods which aim to elucidate social inequalities and increase the capacity of individuals and groups to effectively represent their views on both engagements and research activities through evaluation. Patton (2002) among others has mapped how feminist evaluation approaches have redefined conventional conceptualisations of evaluation. This includes framing evaluation principally as a means towards greater social justice, using evaluation processes and findings to foster positive change, and challenging conventional criteria for assessing evaluations, including objectivity and the neutrality or independence of the evaluator. Feminist evaluators have also highlighted how different epistemic starting points and rationales for evaluation give rise to different criteria for judging quality and value. Some have stressed how individuals from different social backgrounds approach information and evaluation processes in different ways, showing not just that impact has (or has not) occurred, but also why and how people are affected, how they interpret, perceive, and, indeed, value information in the context of their own lives ( Sielbeck-Bowen et al., 2002). Action-based paradigms have sought to mobilise evaluation findings to address structural and procedural processes through which some voices and forms of knowledge are prioritised at the expense of others ( Mertens, 1999). This requires rethinking both evaluation and engagements as forms of action that simultaneously assess, inquire, and aim to act upon inclusion and exclusion processes within research, engagement and evaluation. For example, Beardsley & Hughes Miller (2002) developed a feminist framework to evaluate a women’s substance abuse education programme based on the principle of collaboratively incorporating participants’ voice into the design and implementation of the evaluation, to circumvent epistemic power hierarchies and translate the process and findings into participants’ empowerment.

The above highlights that evaluation may serve multiple purposes and that the ‘value’ of engagements is less an intrinsic singular property. Instead, it is multi-directional and actively created through engagements and evaluation processes. Beyond the kinds of value gained by institutions – such as potential to improve research quality, symbolic and financial value in showcasing research ‘impact’ beyond academia and increasing success in research funding – value may be gained by participants for example through empowerment or sense of purpose ( Komporozos-Athanasiou et al., 2016). These kinds of value may be hard to measure, or immaterial in substance, but nonetheless important to those engaging.

The value gained is also shaped and constrained by the wider social and structural contexts in which it is generated, and in which research and engagements occur. Systemic structural inequalities, including along the lines of gender, race, class, (dis)ability, sexuality, immigration status and other socially significant differences simultaneously embed the institutional contexts in which research and engagements are undertaken, delimit who participates (and does not) in engagements, and whose voices are heard, and views represented in evaluations ( Sielbeck-Bowen et al., 2002). For example, people from low-income backgrounds with low educational attainment are significantly less likely to participate in engagements for reasons like lack of resources, confidence, and time, while women are disproportionately disadvantaged by caring responsibilities, and asylum seekers more likely to face language barriers to participation (see What Works Scotland, 2017).

Related critical questions are also raised when the symbolic value gained by institutions is considered in relation to the institutional and social positions of those who undertake the labour of engaging. In addition to public engagement professionals, Boylan et al. (2019) have provided insight into the identities of scholars for whom responsibility for engagements is assumed: early-career researchers, postgraduate students and, often, women. They highlighted that the responsibility of engaging tends to be disproportionately borne by junior female staff on fixed-term contracts and qualitative researchers, in ways related to perceptions about the kinds of skills and work that are required for engaging, like empathy and emotional labour. This can include managing the emotional reactions of and care towards those who are engaged with – areas which are socially gendered feminine and, relatedly, perceived as ‘soft skills’ ( Boylan et al., 2019). Such disparities in gender and career hierarchy raise additional concerns around how engagements may or may not be valued in ways that reflect wider epistemic and gender hierarchies. These include the mainstream scientific epistemic paradigm that has simultaneously devalued, gendered (as ‘women’s work’), and positioned as epistemically inferior social scientific and humanities approaches to producing knowledge, including the methods primarily used in evaluation of engagements.

When we apply the feminist epistemic tools of positionality and reflexivity, evaluation becomes grounded in interrogation of the different kinds of value that engagements can embody and generate for differently positioned subjects. This requires the recognition that one cannot fully measure the value of engagements without reflecting on the processes and justifications of engaging, and the wider social power relations and structural conditions under which they occur, including questions around which voices have been included and excluded in engagements. Engagements serve multiple purposes and can result in multiple kinds of value for different people involved. Taking a feminist perspective encourages one to build on this insight to centre the question of value independent of its capacity to be fixed and measured, to understand and explicate how the value of these processes is plural and situated. Building on feminist epistemological frames and approaches to (e)valu(at)ing enables active concern both for the plural ways in which ‘value’ manifests, and for how the kinds of information are produced through evaluation are epistemically positioned in relation to research and ‘knowledge.’ Variation in how engagements are evaluated is, notably, not intrinsically negative, but is necessary to identify and reflect on tensions and discomforts that arise when different forms of value are prioritised, and to ask what value is obtained, by whom, and what social and structural conditions shape this.

Conclusion: towards a feminist philosophy of engagements

This paper has aimed to set out, from our situated perspective, what we see as important outstanding questions and issues around engagements. We have used the notion of ‘engagements’ as a problem concept that can nonetheless capture the plural and overlapping ways in which engagements are enacted, moving beyond attempts to delineate definitions or the scope of what does or should count as engagements to focus on the tensions and possibilities that the multiplicity of engagements evoke.

In considering the roots, current manifestations and mainstreaming of engagements especially within institutional contexts, we argue that there is a need to remain reflexive about how these contexts condition the possibilities for engagements, and we call for critical inquiry into the models, motivations and justifications through which engagements are currently enacted. We are concerned with engagements’ epistemic dimensions, especially questions around how engagements are situated in relation to knowledge production. Thus, we call for ongoing inquiry into the kind(s) of knowledge engagements can or should produce, how this knowledge is or should be captured, who is and is not positioned as a knowledge producer, and what kinds of power relations condition the roles attributed to different subjects. We are also concerned about how engagements are and could be (e)valu(at)ed by different actors, to whose benefit, and how ‘value’ is being conceptualised in these processes. We call for recognition of the diverse kinds of value that engagements can bring to different actors involved, understanding ‘value’ as plural, limiting its capacity to be fixed or measured.

We argue that there is a need for a feminist philosophy of engagements, where ‘philosophy’ entails inquiry into what kind of activity something is and how we should do it, and ‘engagements’ remains problematised but necessarily plural, to leave space open for creative re-thinking of what engagements are or could be. ‘Feminist,’ in turn, entails a philosophy informed by feminist epistemology, including emphasis on social power relations, knowledge production, value generation, and their relationship. We argue that translating existing feminist theoretical and methodological tools into the context of engagements can help us to address the outstanding questions and tensions that we have mapped.

Firstly, feminist notions of positionality can facilitate critical interrogation of knowledge production both in research and engagements, including in relation to (e)valu(at)ing engagements. Starting with the insight that all knowledge arises from a particular perspective shaped by the knowledge producers’ position leads to an understanding of knowledge as situated, plural and partial. This enables us to ask critical questions about who are (not) recognised as knowledge producers, and which knowledges are (not) valid(ated) in research and engagements, including questions about the very distinction between research and engagements as separate(d) activities. This can enable us to recognise, unpack, and name the active roles that many different actors play in the generation of knowledges from research and engagements, and the plural kinds of value attributed to them, and to ask questions about which positionalities and knowledges are not being represented. This can also destabilise conventional epistemic and power differentials between researchers and research participants and expose participants’ knowledge as epistemically salient and valuable.

Secondly, feminist reflexivity can enable us to interrogate critically the epistemic starting points and presumptions that shape how engagements are conceptualised and undertaken, and how these starting points direct the kinds of knowledges that can (not) be produced through them, especially within institutional confines. This can shed critical light on the contextually conditioned nature of institutionally authorised models of engagements, and possible tensions between different motivations and justifications around engagements. Embedding reflexivity into how we conceptualise engagements, and how and why we enact them, can enable us to not only acknowledge how institutional pressures and pre-defined ‘best practice’ models may influence our own practices and motivations for engaging, but it can also enable us to challenge these pressures and models to develop alternative ways of imagining and enacting engagements. Doing so is especially pertinent when understood in the wider context where systemic structural inequalities and hierarches delimit the practical realities of who is included in (and excluded from) engagements.

A feminist philosophy of engagements advanced along these lines would focus, centrally, on the processes as well as end products of engagements, unpacking how engagements serve multiple purposes, generate plural knowledges, and carry manifold kinds of value that require recognition and interrogation. It would require dialogical engagement with this multiplicity and plurality via interdisciplinary modes of thinking to facilitate the concurrent integration of empirical, epistemic, and normative dimensions in developing accounts of engagements both in theory and praxis. This paper has aimed to carve out the starting points for this work, showing how a feminist philosophy offers avenues for thinking differently about engagements, within and beyond institutionalised models.

Data availability

No data are associated with this article.

Acknowledgements

We thank all members of the Centre for Biomedicine, Self and Society for their support and input into various different discussions that have informed and shaped this paper. We also thank the reviewers for Wellcome Open for their useful comments and feedback, which have enabled us to improve this paper.

Funding Statement

This work was supported by the Wellcome Trust [209519, <a href=https://doi.org/10.35802/209519>https://doi.org/10.35802/209519</a>]

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 2 approved]

References

  1. Ackerly B, True J: Reflexivity in Practice: Power and Ethics in Feminist Research on International Relations. Int Stud Rev. 2008;10(4):693–707. 10.1111/j.1468-2486.2008.00826.x [DOI] [Google Scholar]
  2. Alcoff L, Potter E: Feminist Epistemologies.New York & London: Routledge,1993. Reference Source [Google Scholar]
  3. Ault A: Alzheimer's Association Denies Conflict in Aducanumab Support.Medscape.2021; (accessed 1/11/21). Reference Source [Google Scholar]
  4. Bain AL, Payne WJ: Queer de-participation: reframing the co-production of scholarly knowledge. Qual Res. 2015;16(3):330–340. 10.1177/1468794115619002 [DOI] [Google Scholar]
  5. Banfield M, Randall R, O’Brien M, et al. : Lived experience researchers partnering with consumers and carers to improve mental health research: Reflections from an Australian initiative. Int J Ment Health Nurs. 2018;27(4):1219–1229. 10.1111/inm.12482 [DOI] [PubMed] [Google Scholar]
  6. Beardsley RM, Hughes Miller M: Revisioning the process: a case study in feminist program evaluation. New Directions for Evaluation. 2002;96(SI):57–70. 10.1002/ev.66 [DOI] [Google Scholar]
  7. Beltane: About Beltane.2020; (accessed 22/12/2020). Reference Source [Google Scholar]
  8. Berghs M, Chataika T, El-Lahib Y, et al. : The Routledge handbook of disability activism.New York: Routledge,2020. Reference Source [Google Scholar]
  9. Bherer L, Gauthier M, Simard L: The professionalization of public participation.New York & London: Routledge.2017. Reference Source [Google Scholar]
  10. Boal A: Theater of the Oppressed.London: Pluto Press,2000. Reference Source [Google Scholar]
  11. Boivin A, L’Espérance A, Gauvin FP, et al. : Patient and public engagement in research and health system decision making: A systematic review of evaluation tools. Health Expect. 2018;21(6):1075–1084. 10.1111/hex.12804 [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Bolsewicz Alderman K, Hipgrave D, Jimenez-Soto E: Public Engagement in Health Priority Setting in Low- and Middle-Income Countries: Current Trends and Considerations for Policy. PLoS Med. 2013;10(8):e1001495. 10.1371/journal.pmed.1001495 [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Boylan AM, Locock L, Thomson R, et al. : "About sixty per cent I want to do it": Health researchers' attitudes to, and experiences of, patient and public involvement (PPI)-A qualitative interview study. Health Expect. 2019;22(4): 721–730. 10.1111/hex.12883 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Caplan AL, Teagarden JR, Kearns L, et al. : Fair, Just and Compassionate: A Pilot for Making Allocation Decisions for Patients Requesting Experimental Drugs Outside of Clinical Trials. J Med Ethics. 2018;44(11):761–67. 10.1136/medethics-2016-103917 [DOI] [PubMed] [Google Scholar]
  15. Code L: Experience, knowledge, and responsibility.In: Griffiths, M. & Whitford, M.(eds) Feminist perspectives in philosophy. London: Palgrave Macmillan.1988;187–204. 10.1007/978-1-349-19079-9_11 [DOI] [Google Scholar]
  16. Collins S, Brueton R, Graham TG, et al. : Parenting Science Gang: radical co-creation of research projects led by parents of young children. Res Involv Engagem. 2020;6:9. 10.1186/s40900-020-0181-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Crowe S, Adebajo A, Esmael H, et al. : ‘All hands-on deck’, working together to develop UK standards for public involvement in research. Res Involv Engagem. 2020;6:53. 10.1186/s40900-020-00229-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Delgado A, Kjølberg KL, Wickson F: Public engagement coming of age: from theory to practice in STS encounters with nanotechnology. Public Underst Sci. 2010;20(6):826–854. 10.1177/0963662510363054 [DOI] [Google Scholar]
  19. Delli Carpini MX, Cook FL, Jacobs LR: Public deliberation, discursive participation, and citizen engagement: a review of the empirical literature. Annu Rev Polit Sci. 2004;7:315–344. 10.1146/annurev.polisci.7.121003.091630 [DOI] [Google Scholar]
  20. Duchsherer A, Jason M, Platt CA, et al. : Immunized against science: narrative community building among vaccine refusing/hesitant parents. Public Underst Sci. 2020;29(4):419–435. 10.1177/0963662520921537 [DOI] [PubMed] [Google Scholar]
  21. Durant D: Models of democracy in social studies of science. Soc Stud Sci. 2011;41(5):691–714. 10.1177/0306312711414759 [DOI] [Google Scholar]
  22. Duschinsky R, Paddison C: "The final arbiter of everything": A genealogy of concern with patient experience in Britain. Soc Theor Health. 2018;16(1):94–110. 10.1057/s41285-017-0045-2 [DOI] [Google Scholar]
  23. Epstein S: Impure science: AIDS, activism, and the politics of knowledge.Los Angeles & London: University of California Press. Med Soc (Berkeley). 1996;1–446. [PubMed] [Google Scholar]
  24. Esmail L, Moore E, Rein A: Evaluating patient and stakeholder engagement in research: moving from theory to practice. J Comp Eff Res. 2015;4(2):133–145. 10.2217/cer.14.79 [DOI] [PubMed] [Google Scholar]
  25. FDA: 21st Century Cures Act.2020; (accessed 19/06/2021). Reference Source [Google Scholar]
  26. FDA: Expanded Access.2021; (accessed 19/06/2021). Reference Source [Google Scholar]
  27. Felt U, Fochler M: Machineries for making publics: inscribing and de-scribing publics in public engagement. Minerva. 2010;48(3):219–238. 10.1007/s11024-010-9155-x [DOI] [Google Scholar]
  28. Filipe AM: Situated Interventions in Health Care? Refiguring the Normative Place and Experimental Practice of Social Science. Sci Cult. 2017;26(3):418–423. 10.1080/09505431.2017.1315930 [DOI] [Google Scholar]
  29. Filipe AM, Bogossian A, Zulla R, et al. : Developing a Canadian framework for social determinants of health and well-being among children with neurodisabilities and their families: an ecosocial perspective. Disabil Rehabil. 2021;43(26):3856–3867. 10.1080/09638288.2020.1754926 [DOI] [PubMed] [Google Scholar]
  30. Filipe A, Renedo A, Marston C: The co-production of what? Knowledge, values, and social relations in health care. PLoS Biol. 2017;15(5):e2001403. 10.1371/journal.pbio.2001403 [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Fiorino DJ: Citizen Participation and Environmental Risk: A Survey of Institutional Mechanisms. Sci Technol Human Values. 1990;15(2):226–43. 10.1177/016224399001500204 [DOI] [Google Scholar]
  32. Freire P: Pedagogy of the Oppressed.England: Penguin Education,1996;164. Reference Source [Google Scholar]
  33. Haraway D: Situated knowledges: The science question in feminism and the privilege of partial perspective. Feminist Studies. 1988;14(3):575–599. 10.2307/3178066 [DOI] [Google Scholar]
  34. Harding S: The science question in feminism.Ithaca & London: Cornell University Press.1986. Reference Source [Google Scholar]
  35. Harding S: Whose science? Whose knowledge? Thinking from women’s lives.Ithaca: Cornell University Press.1991. Reference Source [Google Scholar]
  36. Hill Collins P: Black feminist thought: knowledge, Consciousness, and the politics of empowerment. New York: Routledge,2000. Reference Source [Google Scholar]
  37. INVOLVE: Briefing notes for researchers: public involvement, in NHS, public health and social care research.2012; (accessed 20/01/2020). Reference Source [Google Scholar]
  38. Jefferson Centre: Home.2020. (accessed 22/01/2020). Reference Source [Google Scholar]
  39. Kata A: Anti-vaccine activists, Web 2.0, and the postmodern paradigm--an overview of tactics and tropes used online by the anti-vaccination movement. Vaccine. 2012;30(25):3778–3789. 10.1016/j.vaccine.2011.11.112 [DOI] [PubMed] [Google Scholar]
  40. Kerr A, Cunningham-Burley S, Tutton R: Shifting subject positions: experts and lay people in public dialogue. Soc Stud Sci. 2007;37(3):385–411. 10.1177/0306312706068492 [DOI] [Google Scholar]
  41. Komporozos-Athanasiou A, Fidge N, Adams M, et al. : Citizen Participation as Political Ritual: Towards a Sociological Theorizing of ‘Health Citizenship’. Sociology. 2016;52(4):744–761. 10.1177/0038038516664683 [DOI] [Google Scholar]
  42. Linabary JR, Corple DJ, Cooky C: Of wine and whiteboards: enacting feminist reflexivity in collaborative research. Qual res. 2020;21(5):719–735. 10.1177/1468794120946988 [DOI] [Google Scholar]
  43. Lumsden K: Reflexivity: theory, method, and practice.New York: Routledge,2019. Reference Source [Google Scholar]
  44. Meriluoto T: Case-study: experts-by-experience in Finnish social welfare.In: Brandsen, T., Verschuere, B. & Steen, T. (eds). Co-production and co-creation: engaging citizens in public services. New York: Routledge.2018. Reference Source [Google Scholar]
  45. Mertens DM: Inclusive evaluation: Implications of transformative theory for evaluation. Am J Eval. 1999;20(1):1–14. 10.1016/S1098-2140(99)80105-2 [DOI] [Google Scholar]
  46. Moch KI: Ethical crossroads: expanded access, patient advocacy, and the #SaveJosh social media campaign. Med Access @ Point Care. 2017;1(1):e119–e130. 10.5301/maapoc.0000019 [DOI] [Google Scholar]
  47. Mockford C, Staniszewska S, Griffiths F, et al. : The impact of patient and public involvement on UK NHS health care: A systematic review. Int J Qual Health Care. 2012;24(1):28–38. 10.1093/intqhc/mzr066 [DOI] [PubMed] [Google Scholar]
  48. MRC: Public engagement evaluation guidance.2020; (accessed 24/01/2020). Reference Source [Google Scholar]
  49. Murphy M: Seizing the Means of Reproduction: Entanglements of Feminism, Health, and Technoscience.Durham & London: Duke University Press,2012. 10.1215/9780822395805 [DOI] [Google Scholar]
  50. Nencel L: Situating reflexivity: voices, positionalities and representations in feminist ethnographic texts. Women’s Studies International Forum. 2014;43:75–83. 10.1186/s12961-019-0432-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. NIHR: Going the extra mile: improving the nation’s health and wellbeing through public Involvement in research.2015; (accessed 24/01/2010). Reference Source [Google Scholar]
  52. Oakley A: Experiments in knowing: gender and method in the social sciences.Cambridge: Polity Press,2000. Reference Source [Google Scholar]
  53. Oliver K, Kothari A, Mays N: The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Syst. 2019;17(1):33. 10.1186/s12961-019-0432-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Pallett H: The new evidence-based policy: public participation between ‘hard evidence’ and democracy in practice. Evidence & Policy. 2019;16(2): 209–227. 10.1332/174426419X15704985880872 [DOI] [Google Scholar]
  55. Parry S, Faulkner W, Cunningham-Burley S, et al. : Heterogeneous agendas around public engagement in stem cell research: the case for maintaining plasticity. Science and Technology Studies. 2012;12(2):61–80. 10.23987/sts.55276 [DOI] [Google Scholar]
  56. Participedia: Developing a learning platform to address under-five mortality in rural South Africa.2020a; (accessed 19/06/21). Reference Source [Google Scholar]
  57. Participedia: Developing Community Participation for Clean Water in Rural South Africa.2020b; (accessed 19/06/21). Reference Source [Google Scholar]
  58. Participedia: Participatory Intervention on Birth Outcomes with Women's Groups in Nepal.2021; (accessed 19/06/21). Reference Source [Google Scholar]
  59. Patton MQ: Feminist, yes, but is it evaluation? New Dir Eval. 2002;96:97–108. 10.1002/ev.69 [DOI] [Google Scholar]
  60. Paylor J, McKewitt C: The possibilities and limits of “co-producing” research. Front Sociol. 2019;4:23. 10.3389/fsoc.2019.00023 [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Pillow W: Confession, catharsis, or cure? Rethinking the uses of reflexivity as methodological power in qualitative research. Int J Qual Stud Educ. 2003;16(2):175–196. 10.1080/0951839032000060635 [DOI] [Google Scholar]
  62. Purtell R, Rickard W, Wyatt K: Should we? Could we? Measuring Involvement.In: Barnes, M. & Cotterell, P. (eds) Critical perspectives on user involvement.Policy Press,2012. 10.1332/policypress/9781847427519.003.0020 [DOI] [Google Scholar]
  63. Rabeharisoa V, Callon M, Filipe AM, et al. : From ‘politics of numbers’ to ‘politics of singlarisation’: Patients’ activism and engagement in research on rare diseases in France and Portugal. BioSocieties. 2014;9:194–217. 10.1057/biosoc.2014.4 [DOI] [Google Scholar]
  64. Ramachandran R, Ross JS: New Alzheimer's drug sets dangerous precedent.CNN.2021; (accessed 19/06/2021). Reference Source [Google Scholar]
  65. REF2021: Guidance on submissions.2019; (accessed 24/01/2020). Reference Source [Google Scholar]
  66. Rose G: Situating knowledges: positionality, reflexivity and other tactics. Prog Hum Geog. 1997;21(3):305–320. 10.1191/030913297673302122 [DOI] [Google Scholar]
  67. Rosenberg SJ, Rosenberg J: Community mental health: challenges for the 21 st century.New York: Routledge,2018. Reference Source [Google Scholar]
  68. Rowland P, McMillan S, McGillicuddy P, et al. : What is “the patient perspective” in patient engagement programs? Implicit logics and parallels to feminist theories. Health (London). 2017;21(1):76–92. 10.1177/1363459316644494 [DOI] [PubMed] [Google Scholar]
  69. Sandoval C: Methodology of the oppressed.Minneapolis: University of Minnesota press,2000. Reference Source [Google Scholar]
  70. ScotPEN: About Us.2020; (accessed 24/10/2020). Reference Source [Google Scholar]
  71. Sielbeck-Bowen KA, Brisolara S, Seigart D, et al. : Exploring feminist evaluation: the ground from which we rise. New Dir Eval. 2002;96:3–8. 10.1002/ev.62 [DOI] [Google Scholar]
  72. Simandan D: Revisiting positionality and the thesis of situated knowledge, Dialogues in Human Geography.2019;9(2):129–149. Reference Source [Google Scholar]
  73. Slaney K, Tafreshi D, Wu C: Philosophical Reflexivity in Psychological Science: Do We Have It? Does It Matter?. In: O’Doherty, K., Osbeck, L., Schraube, E., & Yen, F. Psychological studies of science and technology. Palgrave Macmillan.2019;237–256. 10.1007/978-3-030-25308-0_11 [DOI] [Google Scholar]
  74. Smith KE, Bandola-Gill J, Meer N, et al. : The impact agenda: controversies, consequences and challenges.Bristol: Polity Press,2020. 10.2307/j.ctv11g95dd [DOI] [Google Scholar]
  75. Stilgoe J, Lock SJ, Wilsdon J: Why should we promote public engagement with science? Public Underst Sci. 2014;23(1):4–15. 10.1177/0963662513518154 [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Stirling A: “Opening up” and “closing down”: power, participation and pluralism in the social appraisal of technology. Sci Technol Human Values. 2008;33(2):262–294. 10.1177/0162243907311265 [DOI] [Google Scholar]
  77. UKRI: Evaluation: practical guidelines. Guide for evaluating public engagement activities.2011; (accessed 24/01/2020). Reference Source [Google Scholar]
  78. UKRI: Equitable Partnerships.2020; (accessed 22/12/2020). Reference Source [Google Scholar]
  79. Webler T, Renn O: A Brief primer on participation: philosophy and practice.In: Renn, O., Webler, T., & Wiedemann, P. Fairness and competence in citizen participation: evaluating models for environmental discourse.Springer,2013. [Google Scholar]
  80. What Works Scotland: ‘Hard to reach’ or ‘easy to ignore’? Promoting equality in community engagement.Evidence Review.2017; (accessed 05/09/2021). Reference Source [Google Scholar]
  81. WHO: WHO community engagement framework for quality, people-centred and resilient health services.World Health Organization.2017; [accessed 13/01/2021]. Reference Source [Google Scholar]
  82. Woollett G, Jackson J: Manufacturer’s Compassionate Use Policies: Companies with Posted Policies More Than Doubled Since September 2016.Avalere.2017; (accessed 19/06/2021). Reference Source [Google Scholar]
  83. Williams O, Sarre S, Papoulias SC, et al. : Lost in the shadows: reflections on the dark side of co-production. Health Res Policy Syst. 2020;18(1):43. 10.1186/s12961-020-00558-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Wylie A: Why standpoint matters.In: Figueroa, R. & Harding, S. (eds) Science and Other Cultures: Issues in Philosophies of Science and Technology.New York: Routledge,2003;26–48. Reference Source [Google Scholar]
Wellcome Open Res. 2022 Feb 11. doi: 10.21956/wellcomeopenres.19447.r48617

Reviewer response for version 2

Mary Madden 1

Congratulations on what is now a focused, reflexive and substantive contribution. I enjoyed reading it and hope it serves as a useful provocation. Note, it was not my expectation that the authors would expand on all the 'threads' in the initial review comments but to point out areas where this reader felt things were left hanging. They have managed this very successfully by tightening the focus and structure of the argument in the revision. The piece also benefits from the inclusion of grounded examples of engagement.

The ‘paradigm wars’ referred to in the original comments were ongoing crude qualitative/quantitative divisions (discussed in the Oakley work referenced). 

There are typos in the following sentences if you want to give it a final polish:

  • There are not merely labels, but act to shape practices of engaging

  • show how and why these tools provide a different les to engagements

Does the article adequately reference differing views and opinions?

Partly

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Partly

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Partly

Is the rationale for the Open Letter provided in sufficient detail?

Partly

Reviewer Expertise:

Qualitative health research. PPI. Ex community worker. PhD Women's Studies

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2022 Feb 10. doi: 10.21956/wellcomeopenres.19447.r48616

Reviewer response for version 2

Kieran C O'Doherty 1

I thank the authors for attending to my comments.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

public engagement with science & technology; public deliberation; social psychology; health psychology; bioethics

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2021 Apr 28. doi: 10.21956/wellcomeopenres.18221.r43065

Reviewer response for version 1

Kieran C O'Doherty 1

Thank you for the invitation to review the article, “Towards a feminist philosophy of engagements in health-related research.” The article provides a brief overview and history of the growing emphasis on engagements in health research and argues for grounding ongoing work on engagements on feminist epistemologies and methodologies. The argument for such a feminist philosophy is quite short but, given the authors’ aims “to carve out the starting points for this work,” this does not necessarily detract from the value of the proposal. The argument presented by the authors is compelling and, I believe, an important contribution to scholarship and practice of public engagement. The proposal is also bold and challenges some assumptions that are commonly held as a foundation for the production of scientific knowledge. I feel that these challenges are a welcome, potentially disruptive provocation, and ultimately a constructive contribution.

I have some minor suggestions for improvements of the manuscript, as well as some thoughts on parts of the argument, which I detail below.

The authors state that, “The ‘expert’ perspective of trained career scientists has, however, been universalised, presented as objective, and as paradigmatic of (valid) ‘knowledge,’ with the effect that the knowledges of non-scientists, and especially knowledge arising from subjective experience, have been positioned as not knowledge in the proper sense; ‘improper knowledge.’ Relatedly, various types of engagements often implicitly position certain actors as holders or producers of knowledge, while others are framed as receivers or as sources of data.” I agree with the general point. However, I feel that the implied criticism (that the knowledges of non-scientists and that arising from subjective experience should not be regarded as ‘improper knowledge’) needs to be articulated more clearly, and presented with some nuance. For instance, the case that experiential knowledge of illness is a relevant form of knowledge is probably easier to argue than, say, in the case of public engagement on vaccination, whether beliefs about a putative link between autism and the MMR vaccine should be regarded as “proper knowledge.” I don’t have an answer to this question, so I certainly don’t expect the authors of this article to provide one. However, I feel that readers who are not sympathetic to the argument presented by the authors will need a more developed argument to be convinced that there is a problem with the view that scientists are holders of “proper knowledge” and those without such training are only holders of “proper knowledge” insofar as this agrees with accepted scientific knowledge.

The authors state that, “Further, models of evaluating engagements tend to draw from evidence-based intervention models, where engagements are seen as akin to an intervention to be evaluated.” I believe that this statement requires some qualification and possibly supporting evidence. There are a number of frameworks for evaluation of public engagement that do not conceive of public engagement activity as an intervention. I am thinking here, for example, about the work of Julia Abelson and Ray de Vries and their respective colleagues. It may certainly be that dominant form of evaluations view engagement as an intervention but, if this is so, some qualification would be helpful as to the kind of evaluations the authors have in mind and where they are being deployed.

Finally, the authors refer to reflexivity several times and reflexivity is also identified as a key principle (or notion) proposed as part of a feminist philosophy of engagements. I feel this is an important point, but its force is somewhat reduced by failing to explain what, precisely, the authors mean by reflexivity. Because there is so much scholarship on reflexivity, the term is associated with different meanings (see for example, Slaney, Tafreshi, & Wu, 2019 1 , for an overview of different notions of reflexivity). Clearly explicating what the authors associate with the term would strengthen their point.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

public engagement with science & technology; public deliberation; social psychology; health psychology; bioethics

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

References

  • 1. : Philosophical Reflexivity in Psychological Science: Do We Have It? Does It Matter?.2019; 10.1007/978-3-030-25308-0_11 237-256 10.1007/978-3-030-25308-0_11 [DOI] [Google Scholar]
Wellcome Open Res. 2022 Jan 5.
Sonja Erikainen 1

We thank the reviewer for their useful comments and feedback, which we believe have enabled us to improve the paper significantly. We have addressed the comments and feedback as follows:

Comment: I feel that the implied criticism (that the knowledges of non-scientists and that arising from subjective experience should not be regarded as ‘improper knowledge’) needs to be articulated more clearly, and presented with some nuance. For instance, the case that experiential knowledge of illness is a relevant form of knowledge is probably easier to argue than, say, in the case of public engagement on vaccination, whether beliefs about a putative link between autism and the MMR vaccine should be regarded as “proper knowledge.” […] I feel that readers who are not sympathetic to the argument presented by the authors will need a more developed argument to be convinced that there is a problem with the view that scientists are holders of “proper knowledge” and those without such training are only holders of “proper knowledge” insofar as this agrees with accepted scientific knowledge.

Response: We have now added a paragraph into the ‘engagements and knowledge production’ section that specifically addresses this issue and outlines out take on it (p. 13-14). 

Comment: The authors state that, “Further, models of evaluating engagements tend to draw from evidence-based intervention models, where engagements are seen as akin to an intervention to be evaluated.” I believe that this statement requires some qualification and possibly supporting evidence. There are a number of frameworks for evaluation of public engagement that do not conceive of public engagement activity as an intervention. I am thinking here, for example, about the work of Julia Abelson and Ray de Vries and their respective colleagues. It may certainly be that dominant form of evaluations view engagement as an intervention but, if this is so, some qualification would be helpful as to the kind of evaluations the authors have in mind and where they are being deployed.

Response: We agree that this statement was somewhat too simplistic / reductive, and we have now omitted the statement.

Comment: Finally, the authors refer to reflexivity several times and reflexivity is also identified as a key principle (or notion) proposed as part of a feminist philosophy of engagements. I feel this is an important point, but its force is somewhat reduced by failing to explain what, precisely, the authors mean by reflexivity. […] Clearly explicating what the authors associate with the term would strengthen their point.

Response: We have now added a new section on feminist epistemology, where we explicate what we mean by ‘reflexivity’ (and ‘positionality’), and how we apply the notion(s) in this paper (pp. 4-6).

Wellcome Open Res. 2021 Apr 8. doi: 10.21956/wellcomeopenres.18221.r43203

Reviewer response for version 1

Mary Madden 1

Employing ‘engagement’ as an umbrella term for imperatives and activities ‘in the health research environment in the UK and beyond’, the article points to a need for critical interrogation of the concepts and practices around ‘engaging’. The authors call for a philosophy of engagements ‘informed by feminist epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing.’ They contend that ‘feminist methodological tools and theoretical approaches’ can help with the kinds of challenges they identify.

While welcoming more critique in this area and agreeing that feminist epistemology has potentially much to offer in this field, I found little substantive to get hold of here. The authors are arguing for more ‘critical inquiry’ but provide limited in depth critical engagement with the existing philosophy of involvement or engagement, or with the empirical work in the field. The article aspires to ‘move beyond questions of terminology’ to ‘focus on the tensions and possibilities that the multiplicity of engagements evoke’. ‘Engagements’ is said to function as a ‘problem concept’ that ‘can be worked with yet has many uses and no settled meaning…there is analytic value in considering the broad range of engagements together, allowing reflection on the intrinsic tensions, discomforts, and possibilities around doing and researching engagements.’ Maybe, but it also risks compounding vagueness. The article promises a consideration of ‘the roots, present modalities and institutional frameworks that have been erected around engagements,’ but provides a generalised critique/impression of the field not well grounded in specific concepts, practices and places. In order to grasp what was on offer and ‘navigate and make sense of this melee of concepts and practices’, I wanted more clarity on the range of concepts and activities conflated under ‘engagements’. For me, the loss of specificity did not help produce a ‘synthesis that challenges and moves us forward’.

A call for a philosophy of engagements can imply there are none already there and risks contributing to the constant ‘forgetting’ of knowledge work already undertaken (cf feminist philosopher Mary Daly and current debates about ‘race’).  I wanted deeper, more scholarly engagement with the existing material. There are philosophies of ‘engagement’ in political philosophy (citizen involvement in democratic politics) and a long history of attempts to apply these in the history of participatory approaches to research.  In activism there is much to draw on in the work of environmental movements, ‘development’ politics, community work, informal education, feminist organising, disability politics, anti-racism, ‘patient’ movements- patient and health advocacy and activist movements. Knowledge about feminist and other epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing are mentioned here but not actively engaged with. The authors note that ‘engagement activities are being absorbed by large HIC institutions, leaving limited space for alterative conceptualisations and enactments of engagements, including the development of culturally and locally appropriate frame’ without discussing the history of ‘alternative conceptualisation and enactments’ in low and middle income countries. It is also perhaps worth noting the differences in the work arising from STS (often about basic science and technologies linked to health) and from applied health research. Also it is worth considering a more critical approach to the ‘causality’/progress of activisms or scientific breakthroughs in particular locations: ‘This sparked a shift in the relationship between patients and healthcare organisations as well as between research participants and research institutions, as patients and participants increasingly demanded recognition of their agency and rights, including to participate in healthcare and health research decision-making’. Were/are people demanding ‘rights’ or specific services/activities? How/ has this been met - a citizen’s rights agenda or a market/consumerist response?

Engagement practices are said to be ‘shaped and constrained by the wider social and structural contexts in which they are generated, and in which research and engagements occur’ but there is no sense given of what these actually are or how this works. ‘These structural forces – both of the funding and political landscapes, and the wider societal structures that embed them – are not always stable, creating challenges in obtaining consensus, and leading to changing emphasis and value in engagements around who should be engaged with, why, and what it means to engage. Interesting critical questions are also raised when the symbolic value gained by institutions is considered.’ There is no ‘consensus’ on what ‘engagements’ mean because it covers a set of terms deployed to mean different things. It is not clear why or if ‘consensus’ should be a goal given the messy history and complexity of democratic politics and patient and public involvement in research and the power imbalances (conflicts) therein (see Madden & Speed, 2017 1 ).

The institutional angle introduced in the, ‘engagements and knowledge production’ section offers the potential for more focused grounding. Funded health research features the complex, simultaneous involvement of numerous institutions (see e.g. Madden et al 2020 2 ).  One of the key issues in UK applied health research has been to  distinguish active involvement in the research process from being a participant in a study or taking an interest in/being told about research findings (engagement). A key difference is being able to shape a process/make decisions (power to influence the process) within an increasingly corporatised health research agenda (politicians and corporations are not mentioned as actors in the field but healthcare is a key market and political football). It is not clear to me why disregarding this power distinction is helpful in furthering critique. It might be worth considering how the ‘mainstreaming’ referred to corresponds with institutionalisation. INVOLVE started as a separate campaigning organisation. NIHR Involvement has now taken over from INVOLVE and has re-launched key resources previously produced by INVOLVE. The James Lind Alliance is also now in-house and not campaigning from outside.

The point about a differentiation between research and engagement made ‘via an equation of research with (valid) knowledge production, and relegation of engagements as not (valid) knowledge producing activities’ needs more clarity. Public engagement with the products of research processes can be exercises in dissemination or ‘impact’ and/or PR/marketing/recruitment exercise for universities. To conduct research on engagement (with the products of research) of the quality of the original research in order to determine the impact or assess the value of such engagement activity is complex and often not in the budget, hence quicker, cheaper market research activities. Points about whether/how (performative) academic metrics like REF in the current mode of production meet people’s real life health concerns in particular contexts are worth pursuing in more depth.

As it stands the current ‘alternative’ recommended philosophy and its application in ‘engagement’ practices is unclear beyond calls for reflexivity and taking an open mind to evaluation methods (arguably both are already [research] practice norms). It would be useful to clarify whether and how the recommended form of reflexivity differs from that already recommended as standard in qualitative health research texts and evidence that it is absent in current work. The authors ‘contend that feminist methodological tools and theoretical approaches can help with the above kinds of challenges.’ They ‘recommend reflexivity as both a conceptual and practical tool’. It is not clear why this is recommended at the end rather than argued through and applied from the outset.  Doing this would mean applying the emphasis on ‘the situatedness and contextuality of knowledge claims called for’ and more of the reflexivity demanded ‘from those positioned as ‘experts’ on what shapes their own epistemic starting points and interpretations’.

I wanted to know how/if the feminist ‘epistemic issue of positionality’ referred to here differs from Foucauldian versions. The argument that engagements are required but not valued academic work and carried out by women could be made more clearly. It would be useful to know if there is empirical data available on the growth of PPI/E research labour (as part of research posts) and as a profession (often in marketing departments as part of ‘engagement’)?

 ‘Feminist approaches to evaluation’ are said to ‘have applied alternative modes and frameworks of (e)valu(at)ing… enable[ing] active concern both for the plural ways in which ‘value’ manifests, and for how, why, and what kinds of information are produced through evaluation, as well as how this information is epistemically positioned in relation to research and ‘knowledge.’ Feminist epistemology is another rich field of debate (and major disagreement) and it would be helpful to locate this specifically at this stage of the (gendered) ‘paradigm wars’. Many, including Anne Oakley are concerned with appropriate methods of evaluation rather than ‘alternatives’ per se.  It is a truism (rather than an intrinsically feminist point) ‘that evaluation may serve multiple purposes, including social, cultural, political and financial; and, that the ‘value’ of engagements is less an intrinsic singular property and more something that is multi-directional and actively created through engagements and evaluation processes.’

Madden, M, Speed, E. Beware Zombies and Unicorns: Toward Critical Patient and Public Involvement in Health Research in a Neoliberal Context.   Frontiers in Sociology 2017 2:7    https:10.3389/fsoc.2017.00007    ISSN=2297-7775 1

Madden, M, Morris, S, Ogden, M, Lewis, D, Stewart, D, McCambridge, J. Producing co‐production: Reflections on the development of a complex intervention. Health Expect. 2020; 23: 659– 669. https://doi.org/10.1111/hex.13046  2

Oakley, A (2000) Experiments in Knowing: Gender and Method in the Social Sciences.The New Press 3

Does the article adequately reference differing views and opinions?

Partly

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Partly

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Partly

Is the rationale for the Open Letter provided in sufficient detail?

Partly

Reviewer Expertise:

Qualitative health research. PPI. Ex community worker. PhD Women's Studies

I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.

References

  • 1. : Beware Zombies and Unicorns: Toward Critical Patient and Public Involvement in Health Research in a Neoliberal Context. Frontiers in Sociology .2017;2: 10.3389/fsoc.2017.00007 10.3389/fsoc.2017.00007 [DOI] [Google Scholar]
  • 2. : Producing co-production: Reflections on the development of a complex intervention. Health Expect .23(3) : 10.1111/hex.13046 659-669 10.1111/hex.13046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. : Experiments in Knowing: Gender and Method in the Social Sciences. The New Press .2000;
Wellcome Open Res. 2022 Jan 5.
Sonja Erikainen 1

We thank the reviewer for their useful comments and feedback, which we believe have enabled us to improve the paper significantly. We have addressed the comments and feedback as follows:

We are very grateful for reviewer one’s extensive engagement with our paper and arguments. Yet, their comments and feedback pull towards many different directions, and we found that addressing them all comprehensively was not possible – the paper would be at risk of losing coherence and direction if we were to pull on all these threads. Their comments and feedback, in many ways because of their wide-ranging nature, have, however, been extremely helpful in enabling us to reflect on and clarify the aims and scope of this paper and better define its parameters and limitations. Thus, a key way in which we have responded to reviewer one is to take a wider lesson across all their comments, and more explicitly and clearly define the scope and terms of our arguments. To do this, we have revised the introduction, added a new section on feminist theory, and revised the other sections in light of this new content. Beyond this, our responses to their comments are as follows:

Comment: I found little substantive to get hold of here. […] The article […] provides a generalised critique/impression of the field not well grounded in specific concepts, practices and places. In order to grasp what was on offer and ‘navigate and make sense of this melee of concepts and practices’, I wanted more clarity on the range of concepts and activities conflated under ‘engagements’. For me, the loss of specificity did not help produce a ‘synthesis that challenges and moves us forward’.

Response: We have added some new, more specific examples across the paper, to provide more to ‘get a hold of’ empirically. We have also added a new section (pp. 4-6) to elaborate on our conceptualisation and use of the feminist theoretical concepts we are working with. However, we have retained our use of ‘engagements’ as a problem concept despite the ambiguity and loss of specificity this invites, because one notable point of the paper is to avoid (and, indeed, argue against) fixing or delimiting what ‘engaging’ can (or should) mean, to leave space open for different and alternative ways to think about and enact engagements. Our aim in doing so is precisely to challenge and move beyond terminological delineations and quibbles, and provoke readers to think more expansively (and creatively) about the wide range of things that can be ‘engagements.’ We did, however, omit the notion of ‘synthesis,’ as the reviewer is right in suggesting that what we produce here is, less a synthesis, and more a provocation.

Comment: A call for a philosophy of engagements can imply there are none already there and risks contributing to the constant ‘forgetting’ of knowledge work already undertaken […] I wanted deeper, more scholarly engagement with the existing material. There are philosophies of ‘engagement’ in political philosophy (citizen involvement in democratic politics) and a long history of attempts to apply these in the history of participatory approaches to research. In activism there is much to draw on in the work of environmental movements, ‘development’ politics, community work, informal education, feminist organising, disability politics, anti-racism, ‘patient’ movements- patient and health advocacy and activist movements.

Response: We have now added an acknowledgement of the existence of other philosophies of engagement (from political philosophy) (pp. 5-6) but have not engaged with these in any depth, because our focus is on the application of feminist theory to the sphere of engagements.

We have added more content concerning activist movements and patient mobilisations (pp. 6-7) (also as a way to provide more specific examples into the paper), but not in relation to philosophy of engagements directly as the connection between the kinds of activist movements highlighted by the reviewer and philosophy, as conceptualised in this paper, is only indirect.

Comment: Knowledge about feminist and other epistemological and methodological approaches to equitable modes of research participation, knowledge production, and valuing are mentioned here but not actively engaged with.

Response: We have now added a new section on feminist theory into the paper (pp. 4-6), which grounds the paper within feminist epistemology as its theoretical basis, and we have applied this across the paper better.

Comment: The authors note that ‘engagement activities are being absorbed by large HIC institutions, leaving limited space for alterative conceptualisations and enactments of engagements, including the development of culturally and locally appropriate frame’ without discussing the history of ‘alternative conceptualisation and enactments’ in low and middle income countries. It is also perhaps worth noting the differences in the work arising from STS (often about basic science and technologies linked to health) and from applied health research. Also it is worth considering a more critical approach to the ‘causality’/progress of activisms or scientific breakthroughs in particular locations. Were/are people demanding ‘rights’ or specific services/activities? How/ has this been met - a citizen’s rights agenda or a market/consumerist response?

Response: We have now revised the relevant section about alternative conceptualisations, including by adding new content on engagements in LMICs and clarifying our arguments related to this (p. 10) (and as a way to provide more specific examples into the paper).

We have not added content on the difference between STS and applied health research, as this is beyond the scope of the paper and does not directly contribute towards its aims.

We expanded the section on the legacy of activism to better highlight the wider scope of relevant activism (pp. 6-7) (and as a way to address the above comment concerning activist movements and patient mobilisations).

Comment: Engagement practices are said to be ‘shaped and constrained by the wider social and structural contexts in which they are generated, and in which research and engagements occur’ but there is no sense given of what these actually are or how this works.

Response: There was already a statement of what the relevant social structures are, but this has been slightly expanded by providing some examples of how social and structural conditions place barriers to participation (p. 17). We have also expanded the related argument about gender and career hierarches around who undertakes the labour of engaging and why (p. 17).

Comment: There is no ‘consensus’ on what ‘engagements’ mean because it covers a set of terms deployed to mean different things. It is not clear why or if ‘consensus’ should be a goal given the messy history and complexity of democratic politics and patient and public involvement in research and the power imbalances (conflicts) therein

Response: We fully agree and did not intend to argue that consensus is or should be to goal – merely that it is difficult to reach. We have, however, now deleted the relevant statement to avoid any misunderstanding in this regard.

Comment: One of the key issues in UK applied health research has been to distinguish active involvement in the research process from being a participant in a study or taking an interest in/being told about research findings (engagement). A key difference is being able to shape a process/make decisions (power to influence the process) within an increasingly corporatised health research agenda (politicians and corporations are not mentioned as actors in the field but healthcare is a key market and political football). It is not clear to me why disregarding this power distinction is helpful in furthering critique. It might be worth considering how the ‘mainstreaming’ referred to corresponds with institutionalisation.

Response: We already devote significant space across the paper to interrogating and challenging the distinction between research and engagements, including the many roles that participants can occupy in both (from being a research participant in the conventional sense to being an ‘engagee’ or participating in engagement activities to being a co-producer of knowledge able to make decisions and set agendas). We do not feel that more content on this would add to the paper – indeed, distinctions and power relations embedded in the roles that participants are (and are not) allowed to occupy in the processes of research and engagements are not disregarded in this paper – they are one of our areas of focus.

While the politics and corporatisation / marketisation of health research are not our focus, we have added an acknowledgement of some of the ways in which corporatisation / marketisation shapes the health research landscape and agendas, through an example of ‘expanded access’ (p. 7). This example is specifically about the question of patients’ and patient advocacy groups’ power to make decisions and influence research processes.

We have added the word ‘consequently’ in the statement, “in universities, developments like the above constitute the background against which engagements have become increasingly mainstreamed and, consequently, institutionalised,” to highlight that institutionalisation of engagements in universities followed from the developments that have made engagements more mainstream (p. 8). 

Comment: The point about a differentiation between research and engagement made ‘via an equation of research with (valid) knowledge production, and relegation of engagements as not (valid) knowledge producing activities’ needs more clarity.

Response: We have revised this sentence to make it clearer (p. 12)

Comment: Points about whether/how (performative) academic metrics like REF in the current mode of production meet people’s real life health concerns in particular contexts are worth pursuing in more depth.

Response: This is beyond the scope of this paper, and thus we have not pursued this in more depth.

Comment: As it stands the current ‘alternative’ recommended philosophy and its application in ‘engagement’ practices is unclear beyond calls for reflexivity and taking an open mind to evaluation methods (arguably both are already [research] practice norms). It would be useful to clarify whether and how the recommended form of reflexivity differs from that already recommended as standard in qualitative health research texts and evidence that it is absent in current work. […] It is not clear why [reflexivity] is recommended at the end rather than argued through and applied from the outset. Doing this would mean applying the emphasis on ‘the situatedness and contextuality of knowledge claims called for’ and more of the reflexivity demanded ‘from those positioned as ‘experts’ on what shapes their own epistemic starting points and interpretations’.

Response: We have added a new section on feminist theory into the paper (pp. 4-6), which grounds the paper within feminist epistemology as its theoretical basis. This includes elaboration and clarification on the notion of ‘reflexivity’ (and ‘positionality’) that we advocate for, and how they also shape and condition our own knowledge claims. We have then applied this theoretical basis across the paper better (including arguing for and showing the applicability of both reflexivity and positionality throughout the paper), to more directly show how a feminist philosophy offers a different basis and angle for thinking about the kinds of challenges and issues that, we argue, characterise the landscape of engagements.

Comment: I wanted to know how/if the feminist ‘epistemic issue of positionality’ referred to here differs from Foucauldian versions.

Response: It has now been clarified that feminist notions of positionality – including ours – often tend to be built on Haraway’s version (p. 5). Elaboration of Foucauldian theory is beyond the scope of this paper.

Comment: The argument that engagements are required but not valued academic work and carried out by women could be made more clearly. It would be useful to know if there is empirical data available on the growth of PPI/E research labour (as part of research posts) and as a profession (often in marketing departments as part of ‘engagement’)?

Response: We have added further detail on the gendered labour of engagements and the related power relations around how this labour is (not) valued (p. 17). 

Empirical data / detail on the growth of PPI/E research labour and profession is outside the scope of this paper beyond the content we already provide on this.

Comment: Feminist epistemology is another rich field of debate (and major disagreement) and it would be helpful to locate this specifically at this stage of the (gendered) ‘paradigm wars’

Response: We have now added a new section on feminist epistemology and more directly shown how our arguments are located within and build on feminist epistemology (and which feminist tools we build on, more specifically) (pp. 4-6). We are, however, not sure to which particular ‘paradigm wars’ the reviewer here refers and thus unable to locate our arguments in this regard (for there have been and continue to be many paradigm wars within and against different feminisms).

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    No data are associated with this article.


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES