Abstract
Objective
To identify factors acting as barriers or enablers to the process of healthcare consent for people with intellectual disability and to understand how to make this process equitable and accessible.
Data sources
Databases: Embase, MEDLINE, PsychINFO, PubMed, SCOPUS, Web of Science and CINAHL. Additional articles were obtained from an ancestral search and hand-searching three journals.
Eligibility criteria
Peer-reviewed original research about the consent process for healthcare interventions, published after 1990, involving adult participants with intellectual disability.
Synthesis of results
Inductive thematic analysis was used to identify factors affecting informed consent. The findings were reviewed by co-researchers with intellectual disability to ensure they reflected lived experiences, and an easy read summary was created.
Results
Twenty-three studies were included (1999 to 2020), with a mix of qualitative (n=14), quantitative (n=6) and mixed-methods (n=3) studies. Participant numbers ranged from 9 to 604 people (median 21) and included people with intellectual disability, health professionals, carers and support people, and others working with people with intellectual disability. Six themes were identified: (1) health professionals’ attitudes and lack of education, (2) inadequate accessible health information, (3) involvement of support people, (4) systemic constraints, (5) person-centred informed consent and (6) effective communication between health professionals and patients. Themes were barriers (themes 1, 2 and 4), enablers (themes 5 and 6) or both (theme 3).
Conclusions
Multiple reasons contribute to poor consent practices for people with intellectual disability in current health systems. Recommendations include addressing health professionals’ attitudes and lack of education in informed consent with clinician training, the co-production of accessible information resources and further inclusive research into informed consent for people with intellectual disability.
PROSPERO registration
CRD42021290548.
Keywords: Decision making, Healthcare quality improvement, Patient-centred care, Quality improvement, Standards of care
What is already known on this topic
People with intellectual disability are frequently excluded from decision-making processes and not provided equal opportunity for informed consent, despite protections outlined in the United Nations Convention on the Rights of Persons with Disabilities.
People with intellectual disability have the capacity and desire to make informed medical decisions, which can improve their well-being, health satisfaction and health outcomes.
What this review study adds
Health professionals lack adequate training in valid informed consent and making reasonable adjustments for people with intellectual disability, and continue to perpetuate assumptions of incapacity.
Health information provided to people with intellectual disability is often inaccessible and insufficient for them to make informed decisions about healthcare.
The role of support people, systemic constraints, a person-centred approach and ineffective healthcare communication also affect informed consent.
How this review might affect research, practice or policy
Health professionals need additional training on how to provide a valid informed consent process for people with intellectual disability, specifically in using accessible health information, making reasonable adjustments (e.g., longer/multiple appointments, options of a support person attending or not, using plain English), involving the individual in discussions, and communicating effectively with them.
Inclusive research is needed to hear the voices and opinions of people with intellectual disability about healthcare decision-making and about informed consent practices in specific healthcare settings.
Introduction
Approximately 1% of the world’s population have intellectual disability.1 Intellectual disability is medically defined as a group of neurodevelopmental conditions beginning in childhood, with below average cognitive functioning and adaptive behaviour, including limitations in conceptual, social and practical skills.2 People with intellectual disability prefer an alternative strength-based definition, reflected in the comment by Robert Strike OAM (Order of Australia Medal): ‘We can learn if the way of teaching matches how the person learns’,3 reinforcing the importance of providing information tailored to the needs of a person with intellectual disability. A diagnosis of intellectual disability is associated with significant disparities in health outcomes.4–7 Person-centred decision-making and better communication have been shown to improve patient satisfaction,8 9 the physician–patient relationship10 and overall health outcomes11 for the wider population. Ensuring people with intellectual disability experience informed decision-making and accessible healthcare can help address the ongoing health disparities and facilitate equal access to healthcare.
Bodily autonomy is an individual’s power and agency to make decisions about their own body.12 Informed consent for healthcare enables a person to practice bodily autonomy and is protected, for example, by the National Safety and Quality Health Service Standards (Australia),13 Mental Capacity Act (UK)14 and the Joint Commission Standards (USA).15 In this article, we define informed consent according to three requirements: (1) the person is provided with information they understand, (2) the decision is free of coercion and (3) the person must have capacity.16 For informed consent to be valid, this process must be suited to the individual’s needs so that they can understand and communicate effectively. Capacity is the ability to give informed consent for a medical intervention,17 18 and the Mental Capacity Act outlines that ‘a person must be assumed to have capacity unless it is established that he lacks capacity’ and that incapacity can only be established if ‘all practicable steps’ to support capacity have been attempted without success.14 These assumptions of capacity are also decision-specific, meaning an individual’s ability to consent can change depending on the situation, the choice itself and other factors.17
Systemic issues with healthcare delivery systems have resulted in access barriers for people with intellectual disability,19 despite the disability discrimination legislation in many countries who are signatories to the United Nations (UN) Convention on the Rights of Persons with Disabilities.20 Patients with intellectual disability are not provided the reasonable adjustments that would enable them to give informed consent for medical procedures or interventions,21 22 despite evidence that many people with intellectual disability have both the capacity and the desire to make their own healthcare decisions.21 23
To support people with intellectual disability to make independent health decisions, an equitable and accessible informed consent process is needed.24 However, current health systems have consistently failed to provide this.21 25 To address this gap, we must first understand the factors that contribute to inequitable and inaccessible consent. To the best of our knowledge, the only current review of informed consent for people with intellectual disability is an integrative review by Goldsmith et al.26 Many of the included articles focused on assessment of capacity27–29 and research consent.30–32 The review’s conclusion supported the functional approach to assess capacity, with minimal focus on how the informed consent processes can be improved. More recently, there has been a move towards ensuring that the consent process is accessible for all individuals, including elderly patients33 and people with aphasia.34 However, there remains a paucity of literature about the informed consent process for people with intellectual disability, with no systematic reviews summarising the factors influencing the healthcare consent process for people with intellectual disability.
Aims
To identify barriers to and enablers of the informed healthcare consent process for people with intellectual disability, and to understand how this can be made equitable and accessible.
Methods
A systematic literature review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P) systematic literature review protocol.35 The PRISMA 2020 checklist36 and ENhancing Transparency in REporting the synthesis of Qualitative research (ENTREQ) reporting guidelines were also followed.37 The full study protocol is included in online supplemental appendix 1.
bmjqs-2023-016113supp001.pdf (206KB, pdf)
No patients or members of the public were involved in this research for this manuscript.
Search strategy
A search strategy was developed to identify articles about intellectual disability, consent and healthcare interventions, described in online supplemental appendix 2. Multiple databases were searched for articles published between January 1990 to January 2022 (Embase, MEDLINE, PsychINFO, PubMed, SCOPUS, Web of Science and CINAHL). These databases include healthcare and psychology databases that best capture relevant literature on this topic, including medical, nursing, social sciences and bioethical literature. The search was limited to studies published from 1990 as understandings of consent have changed since then.38 39 This yielded 4853 unique papers which were imported into Covidence, a specialised programme for conducting systematic reviews.40
bmjqs-2023-016113supp002.pdf (151.1KB, pdf)
Study selection
Citation screening by abstract and titles was completed by two independent researchers (MD and EEP). Included articles had to:
Examine the informed consent process for a healthcare intervention for people with intellectual disability.
Have collected more than 50% of its data from relevant stakeholders, including adults with intellectual disability, families or carers of a person with intellectual disability, and professionals who engage with people with intellectual disability.
Report empirical data from primary research methodology.
Be published in a peer-reviewed journal after January 1990.
Be available in English.
Full text screening was completed by two independent researchers (MD and EEP). Articles were excluded if consent was only briefly discussed or if it focused on consent for research, capacity assessment, or participant knowledge or comprehension. Any conflicts were resolved through discussion with an independent third researcher (IS).
Additional studies were identified through an ancestral search and by hand-searching three major journals relevant to intellectual disability research. Journals were selected if they had published more than one included article for this review or in previous literature reviews conducted by the research team.
Quality assessment
Two independent researchers (MD and IS) assessed study quality with the QualSyst tool,41 which can assess both qualitative and quantitative research papers. After evaluating the distribution of scores, a threshold value of 55% was used, as suggested by QualSyst41 to exclude poor-quality studies but capture enough studies overall. Any conflicts between the quality assessment scores were resolved by a third researcher (EEP). For mixed-method studies, both qualitative and quantitative quality scores were calculated, and the higher value used.
Data collection
Two independent researchers (MD and JH) reviewed each study and extracted relevant details, including study size, participant demographics, year, country of publication, study design, data analysis and major outcomes reported. Researchers used standardised data collection forms designed, with input from senior researchers with expertise in qualitative research (IS and EEP), to extract data relevant to the review’s research aims. The form was piloted on one study, and a second iteration made based on feedback. These forms captured data on study design, methods, participants, any factors affecting the process of informed consent and study limitations. Data included descriptions and paragraphs outlining key findings, the healthcare context, verbatim participant quotes and any quantitative analyses or statistics. Missing or unclear data were noted.
Data analysis
A pilot literature search showed significant heterogeneity in methodology of studies, limiting the applicability of traditional quantitative analysis (ie, meta-analysis). Instead, inductive thematic analysis was chosen as an alternative methodology42 43 that has been used in recent systematic reviews examining barriers and enablers of other health processes.44 45 The six-phase approach described by Braun and Clarke was used.46 47 A researcher (MD) independently coded the extracted data of each study line-by-line, with subsequent data grouped into pre-existing codes or new concepts when necessary. Codes were reviewed iteratively and grouped into categories, subthemes and themes framed around the research question. Another independent researcher (JH) collated and analysed the data on study demographics, methods and limitations. The themes were reviewed by two senior researchers (EEP and IS).
Qualitative methods of effect size calculations have been described in the literature,48 49 which was captured in this review by the number of studies that identified each subtheme, with an assigned frequency rating to compare their relative significance. Subthemes were given a frequency rating of A, B, C or D if they were identified by >10, 7–9, 4–6 or <3 articles, respectively. The overall significance of each theme was estimated by the number of studies that mentioned it and the GRADE framework, a stepwise approach to quality assessment using a four-tier rating system. Each study was evaluated for risk of bias, inconsistency, indirectness, imprecision and publication bias.50 51 Study sensitivity was assessed by counting the number of distinct subthemes included.52 The quality of findings was designated high, moderate or low depending on the frequency ratings, the QualSyst score and the GRADE scores of studies supporting the finding. Finally, the relative contributions of each study were evaluated by the number of subthemes described, guided by previously reported methods for qualitative reviews.52
Co-research
The findings were reviewed by two co-researchers with intellectual disability (JL and SS), with over 30 years combined experience as members and employees of a self-advocacy organisation. Guidance on the findings and an easy read summary was produced in line with best-practice inclusive research53 54 over multiple discussions. Input from two health professional researchers (MD and EEP) provided data triangulation and sense-checking of findings.
Results
Twenty-three articles were identified (figure 1): 14 qualitative, 6 quantitative and 3 mixed-methods. Two papers included the same population of study participants: McCarthy55 and McCarthy,56 but had different research questions. Fovargue et al 57 was excluded due to a quality score of 35%. Common quality limitations were a lack of verification procedures to establish credibility and limited researcher reflexivity. No studies were excluded due to language requirements (as all were in English) or age restrictions (all studies had majority adult participants).
Figure 1.
PRISMA 2020 flowchart for the systematic review.36
Studies were published from 1999 to 2020 and involved participant populations from the UK (n=18), USA (n=3), Sweden (n=1) and Ireland (n=1). Participant numbers ranged from 9 to 604 (median 21), and participants included people with intellectual disability (n=817), health professionals (n=272), carers and support people (n=48), and other professionals that work with people with intellectual disability (n=137, community service agency directors, social workers, administrative staff and care home staff). Ages of participants ranged from 8 to 84 years, though only Aman et al 58 included participants <18 years of age. This study was included as the article states very few children were included. Studies examined consent in different contexts, including contraception and sexual health (6/23 articles),58–60 medications (5/23 articles),58–62 emergency healthcare,63 cervical screening,64 community referrals,58–61 65 mental health,66 hydrotherapy,64 blood collection67 and broad decision-making consent without a specific context.65 68–71 A detailed breakdown of each study is included in online supplemental appendix 3.
bmjqs-2023-016113supp003.pdf (113KB, pdf)
Six major themes were identified from the studies, summarised in figure 2. An overview of included studies showing study sensitivity, effect size, QualSyst and GRADE scores is given in online supplemental appendix 4. Studies with higher QualSyst and GRADE scores contributed more to this review’s findings and tended to include more subthemes; specifically, Rogers et al,66 Sowney and Barr,63 Höglund and Larsson,72 and McCarthy55 and McCarthy.56 Figure 3 gives the easy read version of theme 1, with the full easy read summary in online supplemental appendix 5.
Figure 2.
Summary of the identified six themes and subthemes.
Figure 3.
Theme 1 of the easy read summary.
bmjqs-2023-016113supp004.pdf (75.2KB, pdf)
bmjqs-2023-016113supp005.pdf (26.5MB, pdf)
Theme 1—Health professionals’ attitudes and lack of education about informed consent
Health professionals’ attitudes and practices were frequently (18/21) identified as factors affecting the informed consent process, with substantial evidence supporting this theme. Studies noted the lack of training for health professionals in supporting informed consent for people with intellectual disability, their desire for further education, and stereotypes and discrimination perpetuated by health professionals.
Lack of health professional education on informed consent and disability discrimination legislation
Multiple studies reported inconsistent informed consent practices, for various reasons: some reported that health professionals ‘forgot’ to or ‘did not realise consent was necessary’,63 73 but inconsistent consent practices were also attributed to healthcare providers’ unfamiliarity with consent guidelines and poor education on this topic. Carlson et al 73 reported that only 44% of general practitioners (GPs) were aware of consent guidelines, and there was the misconception that consent was unnecessary for people with intellectual disability. Similarly, studies of psychologists66 and nurses63 found that many were unfamiliar with their obligations to obtain consent, despite the existence of anti-discrimination legislation. People with intellectual disability describe feeling discriminated against by health professionals, reflected in comments such as ‘I can tell, my doctor just thinks I’m stupid – I'm nothing to him’.74 Poor consent practices by health professionals were observed in Goldsmith et al,67 while health professionals surveyed by McCarthy 56 were unaware of their responsibility to provide accessible health information to women with intellectual disability. Improving health professional education and training was suggested by multiple studies as a way to remove this barrier.63 65–67 69 73
Lack of training on best practices for health professions caring for people with intellectual disability
A lack of training in caring for and communicating with people with intellectual disability was also described by midwives,72 psychologists,66 nurses,63 pharmacists61 and GPs.56 72 75 Health professionals lacked knowledge about best practice approaches to providing equitable healthcare consent processes through reasonable adjustments such as accessible health information,56 60 66 longer appointments times,60 72 simple English62 67 and flexible approaches to patient needs.63 72
Health professionals’ stereotyping and assumptions of incapacity
Underlying stereotypes contributed to some health professionals’ (including nurses,63 GPs56 and physiotherapists64) belief that people with intellectual disability lack capacity and therefore, do not require opportunities for informed consent.56 64 In a survey of professionals referring people with intellectual disability to a disability service, the second most common reason for not obtaining consent was ‘patient unable to understand’.73
Proxy consent as an inappropriate alternative
People with intellectual disability are rarely the final decision-maker in their medical choices, with many health providers seeking proxy consent from carers, support workers and family members, despite its legal invalidity. In McCarthy’s study (2010), 18/23 women with intellectual disability said the decision to start contraception was made by someone else. Many GPs appeared unaware that proxy consent is invalid in the UK.56 Similar reports came from people with intellectual disability,55 56 60 64 69 76 health professionals (nurses, doctors, allied health, psychologists),56 63 64 66 77 support people64 77 and non-medical professionals,65 73 and capacity was rarely documented.56 62 77
Exclusion of people with intellectual disability from decision-making discussions
Studies described instances where health professionals made decisions for their patients with intellectual disability or coerced patients into a choice.55 72 74 76 77 In Ledger et al 77 , only 62% of women with intellectual disability were involved in the discussion about contraception, and only 38% made the final decision, and others stated in Wiseman and Ferrie 74 : ‘I was not given the opportunity to explore the different options. I was told what one I should take’. Three papers outlined instances where the choices of people with intellectual disability were ignored despite possessing capacity65 66 69 and when a procedure continued despite them withdrawing consent.69
Theme 2—Inadequate accessible health information
Lack of accessible health information
The lack of accessible health information was the most frequently identified subtheme (16/23 studies). Some studies reported that health professionals provided information to carers instead,60 avoided providing easy read information due to concerns about ‘offending’ patients75 or only provided verbal information.56 67 Informed consent was supported when health professionals recognised the importance of providing medical information64 and when it was provided in an accessible format.60 Alternative approaches to health information were explored, including virtual reality68 and in-person education sessions,59 with varying results. Overall, the need to provide information in different formats tailored to an individual’s communication needs, rather than a ‘one size fits all’ approach, was emphasised by both people with intellectual disability60 and health professionals.66
Insufficient information provided
Studies described situations where insufficient information was provided to people with intellectual disability to make informed decisions. For example, some people felt the information from their GP was often too basic to be helpful (Fish et al 60) and wanted additional information on consent forms (Rose et al 78).
Theme 3—The involvement of support people
Support people (including carers, family members and group home staff) were identified in 11 articles as both enablers of and barriers to informed consent. The antagonistic nature of these findings and lower frequency of subthemes are reflected in the lower quality assessments of evidence.
Support people facilitated communication with health professionals
Some studies reported carers bridging communication barriers with health to support informed consent.63 64 McCarthy 56 found 21/23 of women with intellectual disability preferred to see doctors with a support person due to perceived benefits: ‘Sometimes I don’t understand it, so they have to explain it to my carer, so they can explain it to me easier’. Most GPs in this study (93%) also agreed that support people aided communication.
Support people helped people with intellectual disability make decisions
By advocating for people with intellectual disability, carers encouraged decision-making,64 74 provided health information,74 77 emotional support76 and assisted with reading or remembering health information.55 58 76 Some people with intellectual disability explicitly appreciated their support person’s involvement,60 such as in McCarthy’s55 study where 18/23 participants felt supported and safer when a support person was involved.
Support people impeded individual autonomy
The study by Wiseman and Ferrie 74 found that while younger participants with intellectual disability felt family members empowered their decision-making, older women felt family members impaired their ability to give informed consent. This was reflected in interviews with carers who questioned the capacity of the person with intellectual disability they supported and stated they would guide them to pick the ‘best choice’ or even over-ride their choices.64 Studies of psychologists and community service directors described instances where the decision of family or carers was prioritised over the wishes of the person with intellectual disability.65 66 Some women with intellectual disability in McCarthy’s studies (2010, 2009)55 56 appeared to have been coerced into using contraception by parental pressures or fear of losing group home support.
Theme 4—Systemic constraints within healthcare systems
Time restraints affect informed consent and accessible healthcare
Resource limitations create time constraints that impair the consent process and have been identified as a barrier by psychologists,66 GPs,56 hospital nurses63 and community disability workers.73 Rogers et al 66 highlighted that a personalised approach that could improve informed decision-making is restricted by inflexible medical models. Only two studies described flexible patient-centred approaches to consent.60 72 A survey of primary care practices in 2007 reported that most did not modify their cervical screening information for patients with intellectual disability because it was not practical.75
Inflexible models of consent
Both people with intellectual disability76 and health professionals66 recognised that consent is traditionally obtained through one-off interactions prior to an intervention. Yet, for people with intellectual disability, consent should ideally be an ongoing process that begins before an appointment and continues between subsequent ones. Other studies have tended to describe one-off interactions where decision-making was not revisited at subsequent appointments.56 60 72 76
Lack of systemic supports
In one survey, self-advocates highlighted a lack of information on medication for people with intellectual disability and suggested a telephone helpline and a centralised source of information to support consent.60 Health professionals also want greater systemic support, such as a health professional specialised in intellectual disability care to support other staff,72 or a pharmacist specifically to help patients with intellectual disability.61 Studies highlighted a lack of guidelines about healthcare needs of people with intellectual disabilities such as contraceptive counselling72 or primary care.75
Theme 5—Person-centred informed consent
Ten studies identified factors related to a person-centred approach to informed consent, grouped below into three subthemes. Health professionals should tailor their practice when obtaining informed consent from people with intellectual disability by considering how these subthemes relate to the individual. Each subtheme was described five times in the literature with a relative frequency rating of ‘C’, contributing to overall lower quality scores.
Previous experience with decision-making
Arscott et al 71 found that the ability of people with intellectual disability to consent changed with their verbal and memory skills and in different clinical vignettes, supporting the view of ‘functional’ capacity specific to the context of the medical decision. Although previous experiences with decision-making did not influence informed consent in this paper, other studies suggest that people with intellectual disability accustomed to independent decision-making were more able to make informed medical decisions,66 70 and those who live independently were more likely to make independent healthcare decisions.56 Health professionals should be aware that their patients with intellectual disability will have variable experience with decision-making and provide individualised support to meet their needs.
Variable awareness about healthcare rights
Consent processes should be tailored to the health literacy of patients, including emphasising available choices and the option to refuse treatment. In some studies, medical decisions were not presented to people with intellectual disability as a choice,64 and people with intellectual disability were not informed of their legal right to accessible health information.56
Power differences and acquiescence
Acquiescence by people with intellectual disability due to common and repeated experiences of trauma—that is, their tendency to agree with suggestions made by carers and health professionals, often to avoid upsetting others—was identified as an ongoing barrier. In McCarthy’s (2009) interviews with women with intellectual disability, some participants implicitly rejected the idea that they might make their own healthcare decisions: ‘They’re the carers, they have responsibility for me’. Others appeared to have made decisions to appease their carers: ‘I have the jab (contraceptive injection) so I can’t be blamed for getting pregnant’.55 Two studies highlighted that health professionals need to be mindful of power imbalances when discussing consent with people with intellectual disability to ensure the choices are truly autonomous.61 66
Theme 6—Effective communication between health professionals and patients
Implementation of reasonable adjustments for verbal and written information
Simple language was always preferred by people with intellectual disability.60 67 Other communication aids used in decision-making included repetition, short sentences, models, pictures and easy read brochures.72 Another reasonable adjustment is providing the opportunity to ask questions, which women with intellectual disability in McCarthy’s (2009) study reported did not occur.55
Tailored communication methods including non-verbal communication
Midwives noted that continuity of care allows them to develop rapport and understand the communication preferences of people with intellectual disability.72 This is not always possible; for emergency nurses, the lack of background information about patients with intellectual disability made it challenging to understand their communication preferences.63 The use of non-verbal communication, such as body language, was noted as underutilised62 66 and people with intellectual disability supported the use of hearing loops, braille and sign language.60
Discussion
To the best of our knowledge, this is the first systematic review investigating the barriers and enablers of the informed consent process for healthcare procedures for people with intellectual disability. The integrative review by Goldsmith et al 26 examined capacity assessment and shares only three articles with this systematic review.69 71 73 Since the 2000s, there has been a paradigm shift in which capacity is no longer considered a fixed ability that only some individuals possess38 39 but instead as ‘functional’: a flexible ability that changes over time and in different contexts,79 reflected in Goldsmith’s review. An individual’s capacity can be supported through various measures, including how information is communicated and how the decision-making process is approached.18 80 By recognising the barriers and enablers identified in this review, physicians can help ensure the consent process for their patients with intellectual disability is both valid and truly informed. This review has highlighted the problems of inaccessible health information, insufficient clinical education on how to make reasonable adjustments and lack of person-centred trauma-informed care.
Recommendations
Health professionals require training in the informed consent process for people with intellectual disability, particularly in effective and respectful communication, reasonable adjustments and trauma-informed care. Reasonable adjustments include offering longer or multiple appointments, using accessible resources (such as easy read information or shared decision-making tools) and allowing patient choices (such as to record a consultation or involve a support person). Co-researchers reported that many people with intellectual disability prefer to go without a support person because they find it difficult to challenge their decisions and feel ignored if the health professional only talks to the support person. People with intellectual disability also feel they cannot seek second opinions before making medical decisions or feel pressured to provide consent, raising the possibility of coercion. These experiences contribute to healthcare trauma. Co-researchers raised the importance of building rapport with the person with intellectual disability and of making reasonable adjustments, such as actively advocating for the person’s autonomy, clearly stating all options including the choice to refuse treatment, providing opportunities to contribute to discussions and multiple appointments to ask questions and understand information. They felt that without these efforts to support consent, health professionals can reinforce traumatic healthcare experiences for people with intellectual disability. Co-researchers noted instances where choices were made by doctors without discussion and where they were only given a choice after requesting one and expressed concern that these barriers are greater for those with higher support needs.
Co-researchers showed how these experiences contributed to mistrust of health professionals and poorer health outcomes. In one situation, a co-researcher was not informed of a medication’s withdrawal effects, resulting in significant side-effects when it was ceased. Many people with intellectual disability describe a poor relationship with their health professionals, finding it difficult to trust health information provided due to previous traumatic experiences of disrespect, coercion, lack of choice and inadequate support. Many feel they cannot speak up due to the power imbalance and fear of retaliation. Poor consent practices and lack of reasonable adjustments directly harm therapeutic alliances by reducing trust, contribute to healthcare trauma and lead to poorer health outcomes for people with intellectual disability.
Additional education and training for health professionals is urgently needed in the areas of informed consent, reasonable adjustments and effective communication with people with intellectual disability. The experiences of health professionals within the research team confirmed that there is limited training in providing high-quality healthcare for people with intellectual disability, including reasonable adjustments and accessible health information. Co-researchers also suggested that education should be provided to carers and support people to help them better advocate for people with intellectual disability.
Health information should be provided in a multimodal format, including written easy read information. Many countries have regulation protecting the right to accessible health information and communication support to make an informed choice, such as UK’s Accessible Information Standard,81 and Australia’s Charter of Health Care Rights,24 yet these are rarely observed. Steps to facilitate this include routinely asking patients about information requirements, system alerts for an individual’s needs or routinely providing reasonable adjustments.82 Co-researchers agreed that there is a lack of accessible health information, particularly about medications, and that diagrams and illustrations are underutilised. There is a critical need for more inclusive and accessible resources to help health professionals support informed consent in a safe and high-quality health system. These resources should be created through methods of inclusive research, such as co-production, actively involving people with intellectual disability in the planning, creation, and feedback process.53
Strengths and limitations
This systematic review involved two co-researchers with intellectual disability in sense-checking findings and co-creating the easy read summary. Two co-authors who are health professionals provided additional sense-checking of findings from a different stakeholder perspective. In future research, this could be extended by involving people with intellectual disability in the design and planning of the study as per recommendations for best-practice inclusive research.53 83
The current literature is limited by low use of inclusive research practices in research involving people with intellectual disability, increasing vulnerability to external biases (eg, inaccessible questionnaires, involvement of carers in data collection, overcompliance or acquiescence and absence of researcher reflexivity). Advisory groups or co-research with people with intellectual disability were only used in five studies.58 60 68 74 76 Other limitations include unclear selection criteria, low sample sizes, missing data, using gatekeepers in patient selection and predominance of UK-based studies—increasing the risk of bias and reducing transferability. Nine studies (out of 15 involving people with intellectual disability) explicitly excluded those with severe or profound intellectual disability, reflecting a selection bias; only one study specifically focused on people with intellectual disability with higher support needs. Studies were limited to a few healthcare contexts, with a focus on consent about sexual health, contraception and medications.
The heterogeneity and qualitative nature of studies made it challenging to apply traditional meta-analysis. However, to promote consistency in qualitative research, the PRISMA and ENTREQ guidelines were followed.36 37 Although no meta-analyses occurred, the duplication of study populations in McCarthy 2009 and 2010 likely contributed to increased significance of findings reported in both studies. Most included studies (13/23) were published over 10 years ago, reducing the current relevance of this review’s findings. Nonetheless, the major findings reflect underlying systemic issues within the health system, which are unlikely to have been resolved since the articles were published, as the just-released final report of the Australian Royal Commission into Violence, Abuse, Neglect and Exploitation of People with Disability highlights.84 There is an urgent need for more inclusive studies to explore the recommendations and preferences of people with intellectual disability about healthcare choices.
Conclusion
Informed consent processes for people with intellectual disability should include accessible information and reasonable adjustments, be tailored to individuals’ needs and comply with consent and disability legislation. Resources, guidelines and healthcare education are needed and should cover how to involve carers and support people, address systemic healthcare problems, promote a person-centred approach and ensure effective communication. These resources and future research must use principles of inclusive co-production—involving people with intellectual disability at all stages. Additionally, research is needed on people with higher support needs and in specific contexts where informed consent is vital but under-researched, such as cancer screening, palliative care, prenatal and newborn screening, surgical procedures, genetic medicine and advanced therapeutics such as gene-based therapies.
Footnotes
Contributors: MD, EEP and IS conceived the idea for the systematic review. MD drafted the search strategy which was refined by EEP and IS. MD and EEP completed article screening. MD and IS completed quality assessments of included articles. MD and JH completed data extraction. MD drafted the original manuscript. JL and SS were co-researchers who sense-checked findings and were consulted to formulate dissemination plans. JL and SS co-produced the easy read summary with MD, CM, JH, EEP and IS. MD, JLS, EEP and IS reviewed manuscript wording. All authors critically reviewed the manuscript and approved it for publication. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. MD is the guarantor responsible for the overall content of this manuscript.
Funding: This systematic literature review was funded by the National Health & Medical Research Council (NHMRC), Targeted Call for Research (TCR) into Improving health of people with intellectual disability. Research grant title "GeneEQUAL: equitable and accessible genomic healthcare for people with intellectual disability". NHMRC application ID: 2022/GNT2015753.
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Data availability statement
Data are available upon reasonable request. Additional data and materials such as data collection forms, data extraction and analysis templates and QualSyst assessment data can be obtained by contacting the corresponding author.
Ethics statements
Patient consent for publication
Not applicable.
Ethics approval
Not applicable.
References
- 1. Maulik PK, Mascarenhas MN, Mathers CD, et al. Prevalence of intellectual disability: a meta-analysis of population-based studies. Res Dev Disabil 2011;32:419–36. 10.1016/j.ridd.2010.12.018 [DOI] [PubMed] [Google Scholar]
- 2. World Health Organisation . International classification of diseases 11th revision. 2022. Available: https://icd.who.int/en2022
- 3. Council for Intellectual Disability . About us: Council for intellectual disability. 2023. Available: https://cid.org.au/about-us/ [Accessed 6 Feb 2023].
- 4. Hatton C, Emerson E. Introduction: health disparities, health inequity, and people with intellectual disabilities. In: International review of research in developmental disabilities: Elsevier. 2015: 1–9. [Google Scholar]
- 5. Emerson E, Baines S, Allerton L. Health inequalities and people with learning disabilities in the UK. Tizard Learning Disability Rev 2011;16:42–8. 10.5042/tldr.2011.0008 [DOI] [Google Scholar]
- 6. Shogren KA, Wehmeyer ML, Reese RM, et al. Promoting self-determination in health and medical care: a critical component of addressing health disparities in people with intellectual disabilities. Policy Practice Intel Disabi 2006;3:105–13. 10.1111/j.1741-1130.2006.00061.x [DOI] [Google Scholar]
- 7. Krahn GL, Fox MH. Health disparities of adults with intellectual disabilities: what do we know? what do we do? J Appl Res Intellect Disabil 2014;27:431–46. 10.1111/jar.12067 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Cordasco KM. Obtaining informed consent from patients: brief update review. Agency for Healthcare Research and Quality Rockville,MD, 2013: 461–70. [Google Scholar]
- 9. Hallock JL, Rios R, Handa VL. Patient satisfaction and informed consent for surgery. Am J Obstet Gynecol 2017;217:181. 10.1016/j.ajog.2017.03.020 [DOI] [PubMed] [Google Scholar]
- 10. Little M, Jordens CFC, McGrath C, et al. Informed consent and medical ordeal: a qualitative study. Intern Med J 2008;38:624–8. 10.1111/j.1445-5994.2008.01700.x [DOI] [PubMed] [Google Scholar]
- 11. Brenner LH, Brenner AT, Horowitz D. Beyond informed consent: educating the patient. Clin Orthop Relat Res 2009;467:348–51. 10.1007/s11999-008-0642-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. United Nations Population Fund . What is bodily Autotomy? n.d. Available: https://www.unfpa.org/sowp-2021/autonomy2023
- 13. Australian Commission on Safety and Quality in Health Care . Factsheet for clinicians - informed consent in healthcare. National Safety and Quality Health Service Standards 2020. [Google Scholar]
- 14. Oyebode F. The mental capacity act 2005. Clin Med 2006;6:130–1. 10.7861/clinmedicine.6-2-130 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. The Joint Commission . Informed consent: more than getting a signature. In: Quick Safety. 2016: 1–3. [Google Scholar]
- 16. Beauchamp TL, Childress JF. Principles of BIOMEDICAL ethics: Edicoes Loyola. 1994.
- 17. New South Wales Attorney General . Capacity Toolkit: information for government and community workers, professionals, families and Carers in New South Wales. Sydney: New South Wales Attorney General’s Department, 2008. [Google Scholar]
- 18. Dunn LB, Jeste DV. Enhancing informed consent for research and treatment. Neuropsychopharmacology 2001;24:595–607. 10.1016/S0893-133X(00)00218-9 [DOI] [PubMed] [Google Scholar]
- 19. Marks BA, Heller T. Bridging the equity gap: health promotion for adults with intellectual and developmental disabilities. Nurs Clin North Am 2003;38:205–28. 10.1016/s0029-6465(02)00049-x [DOI] [PubMed] [Google Scholar]
- 20. United Nations General Assembly . Convention on the rights of persons with disabilities. GA Res 2006;61:106. [Google Scholar]
- 21. Strnadová I, Loblinzk J, Scully JL, et al. ‘I am not a number!’ opinions and preferences of people with intellectual disability about genomic healthcare. Eur J Hum Genet 2023;31:1057–65. 10.1038/s41431-023-01282-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Wark S, MacPhail C, McKay K, et al. Informed consent in a vulnerable population group: supporting individuals aging with intellectual disability to participate in developing their own health and support programs. Aust Health Rev 2017;41:436–42. 10.1071/AH15235 [DOI] [PubMed] [Google Scholar]
- 23. Strnadová I, Nevin SM, Scully JL, et al. The opinions and experiences of people with intellectual disability regarding genetic testing and genetic medicine: a systematic review. Genet Med 2022;24:535–48. 10.1016/j.gim.2021.11.013 [DOI] [PubMed] [Google Scholar]
- 24. Australian Commission on Safety and Quality in Health Care . Australian Charter of Healthcare rights-. 2020.
- 25. Keywood K, Fovargue S, Flynn M. Best practice? Health Care Decision Making by, WIth and For Adults with Learning Disabilities. 1999.
- 26. Goldsmith L, Skirton H, Webb C. Informed consent to healthcare interventions in people with learning disabilities–an integrative review. J Adv Nurs 2008;64:549–63. 10.1111/j.1365-2648.2008.04829.x [DOI] [PubMed] [Google Scholar]
- 27. Cea CD, Fisher CB. Health care decision-making by adults with mental retardation. Ment Retard 2003;41:78–87. [DOI] [PubMed] [Google Scholar]
- 28. Dean E, Turner S, Cash J, et al. Assessing the capacity to give consent. Nurs Times 1998;94:58–60. [PubMed] [Google Scholar]
- 29. Morris CD, Niederbuhl JM, Mahr JM. Determining the capability of individuals with mental retardation to give informed consent. Am J Ment Retard 1993;98:263–72. [PubMed] [Google Scholar]
- 30. Arscott K, Dagnan D, Kroese BS. Consent to psychological research by people with an intellectual disability. Research Intellect Disabil 1998;11:77–83. 10.1111/j.1468-3148.1998.tb00035.x [DOI] [Google Scholar]
- 31. Fisher CB, Cea CD, Davidson PW, et al. Capacity of persons with mental retardation to consent to participate in randomized clinical trials. Am J Psychiatry 2006;163:1813–20. 10.1176/ajp.2006.163.10.1813 [DOI] [PubMed] [Google Scholar]
- 32. Dye L, Hare DJ, Hendy S. Capacity of people with intellectual disabilities to consent to take part in a research study. Research Intellect Disabil 2007;20:168–74. 10.1111/j.1468-3148.2006.00310.x [DOI] [Google Scholar]
- 33. Giampieri M. Communication and informed consent in elderly people. Minerva Anestesiol 2012;78:236–42. [PubMed] [Google Scholar]
- 34. Stanley GJ. Inclusive Design: Exploring Accessible Informed Consent for People With Aphasia. Auckland University of Technology, 2022. [Google Scholar]
- 35. Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg 2021;88:105906. 10.1016/j.ijsu.2021.105906 [DOI] [PubMed] [Google Scholar]
- 37. Tong A, Flemming K, McInnes E, et al. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol 2012;12:181. 10.1186/1471-2288-12-181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Grisso T, Appelbaum PS. Assessing competence to consent to treatment. In: Assessing competence to consent to treatment: A guide for physicians and other health professionals. USA: Oxford University Press, 12 February 1998. 10.1093/oso/9780195103724.001.0001 [DOI] [Google Scholar]
- 39. Sturman ED. The capacity to consent to treatment and research: a review of standardized assessment tools. Clin Psychol Rev 2005;25:954–74. 10.1016/j.cpr.2005.04.010 [DOI] [PubMed] [Google Scholar]
- 40. Covidence systematic review software. Melbourne, Australia, [Google Scholar]
- 41. Kmet LM, Cook LS, Lee RC. Standard quality assessment criteria for evaluating primary research papers from a variety of fields. 2004. 10.7939/R37M04F16 [DOI]
- 42. Proudfoot K. Inductive/deductive hybrid thematic analysis in mixed methods research. Journal of Mixed Methods Research 2023;17:308–26. 10.1177/15586898221126816 [DOI] [Google Scholar]
- 43. Webb C, Roe B. Reviewing research evidence for nursing practice. In: Reviewing research evidence for nursing practice: Systematic reviews. John Wiley & Sons, January 2007. 10.1002/9780470692127 [DOI] [Google Scholar]
- 44. Regmi K, Jones L. A systematic review of the factors–enablers and barriers–affecting e-learning in health sciences education. BMC Med Educ 2020;20:91.:91. 10.1186/s12909-020-02007-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Papadopoulos I, Koulouglioti C, Lazzarino R, et al. Enablers and barriers to the implementation of socially assistive humanoid robots in health and social care: a systematic review. BMJ Open 2020;10:e033096. 10.1136/bmjopen-2019-033096 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology 2006;3:77–101. 10.1191/1478088706qp063oa [DOI] [Google Scholar]
- 47. Clarke V, Braun V. Thematic analysis. 2015. 10.1007/978-1-4614-5583-7 [DOI]
- 48. Onwuegbuzie AJ. Effect sizes in qualitative research: a Prolegomenon. Qual Quant 2003;37:393–409. 10.1023/A:1027379223537 [DOI] [Google Scholar]
- 49. Nassaji H. Effect sizes in quantitative and qualitative research. Language Teaching Research 2021;25:681–4. 10.1177/13621688211040882 [DOI] [Google Scholar]
- 50. BMJ Best Practice . What is GRADE?: BMJ. 2023. Available: https://bestpractice.bmj.com/info/toolkit/learn-ebm/what-is-grade/2023
- 51. Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924–6. 10.1136/bmj.39489.470347.AD [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol 2008;8:1–10.:45. 10.1186/1471-2288-8-45 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Strnadová I, Dowse L, Garcia-Lee B. Doing research Inclusively: Co-production in action. 2022.
- 54. Vargas C, Whelan J, Brimblecombe J, et al. Co-creation, co-design, co-production for public health: a perspective on definition and distinctions. Public Health Res Pract 2022;32. 10.17061/phrp3222211 [DOI] [PubMed] [Google Scholar]
- 55. McCarthy M. ‘I have the jab so I can't be blamed for getting pregnant’: contraception and women with learning disabilities. Women’s Studies International Forum 2009;32:198–208. 10.1016/j.wsif.2009.05.003 [DOI] [Google Scholar]
- 56. McCarthy M. Exercising choice and control - women with learning disabilities and contraception. Brit J Learn Disabil 2010;38:293–302. 10.1111/j.1468-3156.2009.00605.x [DOI] [Google Scholar]
- 57. Fovargue S, Keywood K, Flynn M. Participation in health care decision-making by adults with learning disabilities. Mental Health & Learning Disabilities Care 2000;3:341–4. [Google Scholar]
- 58. Aman MG, Benson BA, Farmer CA, et al. Project MED: effects of a medication education booklet series for individuals with intellectual disabilities. Intellect Dev Disabil 2007;45:33–45. 10.1352/1934-9556(2007)45[33:PMEOAM]2.0.CO;2 [DOI] [PubMed] [Google Scholar]
- 59. Ferguson L, Murphy GH. The effects of training on the ability of adults with an intellectual disability to give informed consent to medication. J Intellect Disabil Res 2014;58:864–73. 10.1111/jir.12101 [DOI] [PubMed] [Google Scholar]
- 60. Fish R, Hatton C, Chauhan U. ‘Tell me what they do to my body’: a survey to find out what information people with learning disabilities want with their medications. Brit J Learn Disabil 2017;45:217–25. 10.1111/bld.12196 [DOI] [Google Scholar]
- 61. Graham YNH, Gerrard D, Laight S, et al. More than medication: evaluating the role of the pharmacist independent prescriber in a community team for learning disabilities and behaviours deemed to be challenging. Brit J Learn Disabil 2020;48:232–41. 10.1111/bld.12323 [DOI] [Google Scholar]
- 62. Huneke NTM, Gupta R, Halder N, et al. Difficult decisions: are intellectually disabled patients given enough information to consent to medical treatment J Intellect Disabil 2012;16:265–74. 10.1177/1744629512462179 [DOI] [PubMed] [Google Scholar]
- 63. Sowney M, Barr O. The challenges for nurses communicating with and gaining valid consent from adults with intellectual disabilities within the accident and emergency care service. J Clin Nurs 2007;16:1678–86. 10.1111/j.1365-2702.2006.01642.x [DOI] [PubMed] [Google Scholar]
- 64. Ferguson M, Jarrett D, Terras M. Inclusion and healthcare choices: the experiences of adults with learning disabilities. Brit J Learn Disabil 2011;39:73–83. 10.1111/j.1468-3156.2010.00620.x [DOI] [Google Scholar]
- 65. Fisher K, Haagen B, Orkin F. Acquiring medical services for individuals with mental retardation in community-based housing facilities. Appl Nurs Res 2005;18:155–9. 10.1016/j.apnr.2004.08.006 [DOI] [PubMed] [Google Scholar]
- 66. Rogers E, Pilch M, McGuire BE, et al. Psychologists' perspectives on supported decision making in Ireland. J Intellect Disabil Res 2020;64:234–45. 10.1111/jir.12712 [DOI] [PubMed] [Google Scholar]
- 67. Goldsmith L, Woodward V, Jackson L, et al. Informed consent for blood tests in people with a learning disability. J Adv Nurs 2013;69:1966–76. 10.1111/jan.12057 [DOI] [PubMed] [Google Scholar]
- 68. Hall V, Conboy-Hill S, Taylor D. Using virtual reality to provide health care information to people with intellectual disabilities: acceptability, usability, and potential utility. J Med Internet Res 2011;13:e91. 10.2196/jmir.1917 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69. Hart SL. Meaningful choices: consent to treatment in general health care settings for people with learning disabilities. Journal of Learning Disabilities for Nursing, Health, and Social Care 1999;3:20–6. 10.1177/146900479900300104 [DOI] [Google Scholar]
- 70. O’Dell R, Leafman J, Nehrenz GM, et al. Health care decision making and adults with intellectual disability: a descriptive survey. AJOB Primary Research 2012;3:8–13. 10.1080/21507716.2011.640654 [DOI] [Google Scholar]
- 71. Arscott K, Dagnan D, Kroese BS. Assessing the ability of people with a learning disability to give informed consent to treatment. Psychol Med 1999;29:1367–75. 10.1017/s0033291799008715 [DOI] [PubMed] [Google Scholar]
- 72. Höglund B, Larsson M. Midwives' work and attitudes towards contraceptive counselling and contraception among women with intellectual disability: focus group interviews in Sweden. The European Journal of Contraception & Reproductive Health Care 2019;24:39–44. 10.1080/13625187.2018.1555640 [DOI] [PubMed] [Google Scholar]
- 73. Carlson T, Hames A, English S, et al. Referrals to a learning disability service and consent to treatment. Tizard Learning Disability Review 2004;9:11–7. 10.1108/13595474200400013 [DOI] [Google Scholar]
- 74. Wiseman P, Ferrie J. Reproductive (In)justice and inequality in the lives of women with intellectual disabilities in Scotland. Scand J Disabil Res 2020;22:318–29. 10.16993/sjdr.677 [DOI] [Google Scholar]
- 75. Wood R, Douglas M. Cervical screening for women with learning disability: current practice and attitudes within primary care in edinburgh. Brit J Learn Disabil 2007;35:84–92. 10.1111/j.1468-3156.2007.00440.x [DOI] [Google Scholar]
- 76. Walmsley J, Earle S, Tilley E, et al. The experiences of women with learning disabilities on contraception choice. Primary Health Care 2016;26:28–32. 10.7748/phc.2016.e1139 [DOI] [Google Scholar]
- 77. Ledger S, Earle S, Tilley E, et al. Contraceptive decision-making and women with learning disabilities. Sexualities 2016;19:698–724. 10.1177/1363460715620576 [DOI] [Google Scholar]
- 78. Rose D, Cook A, Khatkar HS, et al. Ensuring clients have the capacity to consent to treatment. Learning Disability Practice 2013;16:31–5. 10.7748/ldp2013.03.16.2.31.e1403 [DOI] [Google Scholar]
- 79. Wong JG, Clare CH, Holland AJ, et al. The capacity of people with a 'mental disability' to make a health care decision”. Psychol Med 2000;30:295–306. 10.1017/s0033291700001768 [DOI] [PubMed] [Google Scholar]
- 80. Beauchamp TL. Informed consent: its history, meaning, and present challenges. Camb Q Healthc Ethics 2011;20:515–23. 10.1017/S0963180111000259 [DOI] [PubMed] [Google Scholar]
- 81. England National Health Service . Accessible information standard. making health and social care.Dcb1605 Ed. 2015.
- 82. National Health Service England . Accessible information standard: specification V.1.1. London: NHS England, 2017. [Google Scholar]
- 83. Kornbluh M. Combatting challenges to establishing trustworthiness in qualitative research. Qualitative Research in Psychology 2015;12:397–414. 10.1080/14780887.2015.1021941 [DOI] [Google Scholar]
- 84. Royal Commission into Violence, Abuse, Neglect and Exploitation of People with Disability . Executive summary, Our vision for an inclusive Australia and recommendations. Commonwealth of Australia; 2023. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjqs-2023-016113supp001.pdf (206KB, pdf)
bmjqs-2023-016113supp002.pdf (151.1KB, pdf)
bmjqs-2023-016113supp003.pdf (113KB, pdf)
bmjqs-2023-016113supp004.pdf (75.2KB, pdf)
bmjqs-2023-016113supp005.pdf (26.5MB, pdf)
Data Availability Statement
Data are available upon reasonable request. Additional data and materials such as data collection forms, data extraction and analysis templates and QualSyst assessment data can be obtained by contacting the corresponding author.



