Skip to main content
JNCI Cancer Spectrum logoLink to JNCI Cancer Spectrum
. 2024 Jun 18;8(4):pkae047. doi: 10.1093/jncics/pkae047

Clinical trial recruitment of people who speak languages other than English: a Children’s Oncology Group report

Melissa P Beauchemin 1,2,, Maria Ortega 3, Sheila J Santacroce 4, Joanna M Robles 5, Jenny Ruiz 6, Anurekha G Hall 7, Justine M Kahn 8,9, Cecilia Fu 10, Manuela Orjuela-Grimm 11,12, Grace C Hillyer 13, Samrawit Solomon 14, Wendy Pelletier 15, Raul Montiel-Esparza 16, Lindsay J Blazin 17, Cassie Kline 18, Alix E Seif 19, Paula Aristizabal 20, Lena E Winestone 21, Maria C Velez 22
PMCID: PMC11272047  PMID: 38889291

Abstract

Background

Persons who speak languages other than English are underrepresented in clinical trials, likely in part because of inadequate multilevel resources. We conducted a survey of institutions affiliated with the Children’s Oncology Group (COG) to characterize current research recruitment practices and resources regarding translation and interpretation services.

Methods

In October 2022, a 20-item survey was distributed electronically to institutions affiliated with COG to assess consent practices and resources for recruiting participants who speak languages other than English to COG trials. Descriptive statistics were used to summarize responses; responses were compared by institution size and type as well as respondent role.

Results

The survey was sent to 230 institutions, and the response rate was 60% (n = 139). In total, 60% (n = 83) of those respondents had access to short-form consent forms. Full consent form translation was required at 50% of institutions, and 12% of institutional review boards restricted use of centrally translated consent forms. Forty-six percent (n = 64) of institutions reported insufficient funding to support translation costs; 19% (n = 26) had access to no-cost translation services. Forty-four percent (n = 61) were required to use in-person interpreters for consent discussions; the most frequently cited barrier (56%) to obtaining consent was lack of available in-person interpreters. Forty-seven percent (n = 65) reported that recruiting persons who speak languages other than English to clinical trials was somewhat or very difficult.

Conclusions

Institutions affiliated with COG face resource-specific challenges that impede recruitment of participants who speak languages other than English for clinical trials. These findings indicate an urgent need to identify strategies aimed at reducing recruitment barriers to ensure equitable access to clinical trials.


In 2019, nearly 68 million persons in the United States reported speaking a language other than English at home, almost half of whom reported speaking English less than “very well” (1,2) Across the United States, the most commonly spoken languages are Spanish, Chinese (including Cantonese, Mandarin, and other dialects), French, Tagalog, and Vietnamese (1). The linguistic diversity of the US population is increasing; however, current system-level resources and practices hinder progress toward inclusive and effective health care for persons who speak languages other than English. Patients who speak languages other than English experience a breadth of health-care inequities, including underenrollment in clinical trials, decreased access to primary care, increased utilization of emergency care, and a higher incidence of treatment-related adverse events (3-6). Individuals who speak languages other than English express decreased satisfaction with health care, decreased understanding of their medical problems, increased medical complications, and worse quality of goals for care discussions (7-10).

Cancer clinical trials offer patients access to the newest technologies and treatments and are critical to advancing therapeutic options and improving clinical outcomes. Appropriate representation of minoritized and underrepresented populations in clinical research, including persons who speak languages other than English, is necessary to ensure equitable access to novel treatments and generalizable research findings (11). In May 2023, the National Institutes of Health Clinical Trial Diversity Act (12) was passed to enhance the inclusion of women, racially and ethnically diverse individuals, and people of all ages in National Institutes of Health–funded research, building on prior legislation initiated in 1994 (13), but underrepresentation of racial and ethnic minority populations and individuals of low-socioeconomic status persists (14-16). Reasons for disparities in clinical trial participation are multilevel (17), and structural and system-level barriers, such as rigid eligibility requirements, lack of trial availability, and resources required to conduct clinical trials, are commonly cited reasons for lower enrollment rates. In addition, economic costs and financial barriers, mistrust of the health-care system, limited health literacy, provider lack of awareness of clinical trials, or provider-patient language discordance may hinder patients’ access to and inclusion in clinical trials (18,19). If offered, however, most patients will agree to participate in cancer clinical trials (20).

Clinical trial participation among diverse patients representing the US population is a high priority for the National Cancer Institute (NCI)–funded Children’s Oncology Group (COG) (21). Though clinical trial participation has historically been higher in pediatric oncology than in adult oncology, lower participation rates have been reported among Hispanic patients and those who speak languages other than English, especially as pediatric patient grows older (22-24). Currently, the capacity of COG-affiliated institutions to obtain parental permission and consent from persons who speak languages other than English for treatment or supportive care clinical trials is not known. The purpose of this study was to characterize current research recruitment practices and resources regarding translation and interpretation for enrollment in COG clinical trials.

Methods

A cross-sectional survey was distributed in October 2022 using Research Electronic Data Capture to principal investigators and lead clinical research associates at COG-affiliated institutions (25). Surveys are frequently administered to this group of individuals, who are responsible for COG clinical trials at 230 unique institutions across the United States, Canada, and Australia.

Survey development

The survey was developed by the Language Equity Working Group within the COG Diversity and Health Disparities Committee (26). The working group designed a 20-question survey (Supplementary Methods, available online) to assess site-level characteristics, research recruitment practices, resources, and regulatory requirements for gaining consent from individuals who speak languages other than English to clinical trials, including use of interpreter services and short-form consent documents, an alternative to using a translated study consent form intended for unexpected enrollment of someone speaking a language other than English (27). To guide development of the survey, given the complexities and changing landscape of terminology and definitions regarding language, literacy, and inclusion, we developed a list of definitions with the understanding that preferred terminology regarding language equity is evolving (Supplementary Table 1, available online) (2,28-30). This study was approved by the Columbia University Institutional Review Board (IRB No. AAAU1679).

Study participants and procedures

The survey was distributed to all COG principal investigators and lead clinical research associates by the central COG Communications office, requesting 1 response per institution. After a brief description of the survey, the respondent was prompted to click forward, signaling their consent to study participation. Upon request, a copy of the consent was emailed to the respondent. Respondents were able to save and return to complete their survey. No compensation was provided to study participation.

Data analysis

The data were exported, and duplicate site responses were removed, prioritizing the COG principal investigator response. Descriptive statistics were used to report the respondent’s individual and institutional characteristics as well as survey item responses in aggregate using frequencies and ranges. We compared responses by respondent-level and institutional-level characteristics—specifically, we categorized institution size (≥100 vs <100 new pediatric cancer cases per year), type (academic, nonacademic), and respondent role (physician, nonphysician). We compared responses within each category using χ2 tests; P < .05 was considered statistically significant. We also conducted a sensitivity analysis to explore whether the results would differ if the non-COG principal investigator respondent were prioritized.

Results

Participant characteristics

The survey was sent to 230 COG institutions. We received 151 responses, but 12 were removed as duplicates at the site level. Overall, the institutional response rate was 60% (n = 139); 72% (n = 100) of respondents were from academic medical centers, and 71% (n = 99) were from small to medium-sized institutions seeing fewer than 100 new pediatric cancer cases each year (Table 1). Most respondents were located in the United States (n = 118 [85%]); 9% (n = 13) were in Canada, and 5% (n = 7) were in Australia. The respondent was most often a physician (n = 79 [57%]); 26% (n = 36) were clinical research associates, 9% (n = 12) were research nurses, and 8% (n = 11) were NCI Community Oncology Research Program administrators. Participants ranked the top 3 languages other than English most frequently spoken at their institution. By country, the most common language other than English spoken was Spanish in the United States, French in Canada, and Chinese in Australia (Figure 1). Health literacy screening for parents or patients 18 years of age or older was conducted at 24% (n = 33) of sites.

Table 1.

Characteristics of responding Children’s Oncology Group institutions (N = 139)

Characteristic No. (%)
Size of institution
 <100 new pediatric cancer cases/y 99 (71)
 ≥100 new pediatric cancer cases/y 40 (29)
Type of institution
 Academic medical center 100 (72)
 Nonacademic community or public hospital 23 (17)
 Nonacademic private hospital 12 (9)
 Military hospital 2 (1)
 Other 2 (1)
Locationa
 United States 118 (85)
 Canada 13 (9)
 Australia 7 (5)
Affiliated with Clinical Translational Science Award
 Yes 20 (14)
 No 54 (39)
 Don’t know 65 (47)
Respondent discipline/rolea
 Physician 79 (57)
 Clinical research associate 36 (26)
 Nurse 12 (9)
 National Cancer Institute Community Oncology Research Program administrator 11 (8)
Most common language other than English spoken by patients, by country of respondent site (see also Figure 1)a
 United States—Spanish 107/117 (91)
 Canada—French 6/13 (46)
 Australia—Chinese 3/6 (50)
Bilingual/multilingual clinicians
 None 24 (17)
 1% to <10% 38 (27)
 10%-25% 46 (33)
 >25% 25 (18)
If ≥1%, certified multilingual clinicians
 Yes 32/109 (29)
Health literacy screening for parents or patients ≥18 y of age
 Yes 33 (24)
a

May not sum to total due to missing response (n = 1).

Figure 1.

Figure 1.

Ranking of languages other than English spoken by the patient population, by respondent.

a “Other” includes Cambodian, Hindi, Hmong, Indigenous Cree, Creole, Karen, Kurdish, Urdu, and unspecified/not reported (n = 4).

Consent documents and regulatory requirements

Half (69/139) of IRBs required consent forms to be translated for participants who speak languages other than English to enable them to enroll in the clinical trial; 17% (23/139) of respondents were not sure if there were translation requirements at their centers. Among those centers with requirements, in 49% (34/69) of institutions, translated consent forms depended on anticipated accrual of participants who speak languages other than English based on local demographics, and 29% (20/69) were required to have a translated consent form regardless of projected accrual of participants who speak languages other than English. Costs for translation were covered at 19% (26/139) of the institutions, whereas others had a process to apply for funds (28/139 [20%]) (Figure 2A). Forty-six percent (64/139) of institutions did not have funds available to cover the costs of translation. Translation services were available on-site at 24% of institutions (34/139), whereas 48% (67/139) needed to send translation requests to an outsourced translation service (Figure 2B). The remaining 27% (n = 38) were unsure of how translation services were accessed.

Figure 2.

Figure 2.

Available resources for translation of consent documents (A) and the translation process (B).

In total, 58% of institutions (81/139) always or sometimes used centrally translated consent forms provided by the NCI Central IRB, but 12% (17/139) reported that their local IRB would not allow use of these translated forms, and 6% (9/139) were unaware of these translated consent forms (Table 2). Nonacademic institutions more often reported always using Central IRB–translated consent forms when available than academic institutions did (62% vs 38%, P = .02).

Table 2.

Regulatory requirements for gaining consent from participants who speak languages other than English (N = 139), by institution size, institution type, and role of the respondent

Institution size
Institution type
Respondent role
Total, No. (%) Small institution (n = 99) Large Institution (n = 40) P Academic institution (n = 100) Nonacademic institution (n = 39) P Other a (n = 59) Physician (n = 79) P
Short-form consent forms available
 Yes 83 (60) 53 (54) 30 (75) .02 61 (61) 22 (56) .57 39 (66) 43 (54) .19
 No 55 (40) 45 (45) 10 (25) 38 (38) 17 (44) 20 (44) 35 (45)
 Missing 1 (<1) 1 (1) 0 (0) 1 (1) 0 (0) 0 (0) 1 (1)
 Among institutions that use a short-form consent form (n = 83)
  No. of languages available in the short-form consent form .28 .002 .03
   ≤10 48 (58) 33 (62) 15 (50) 29 (48) 19 (86) 18 (46) 30 (70)
   >10 35 (42) 20 (38) 15 (50) 32 (53) 3 (14) 21 (54) 13 (30)
  Comfort using short-form consent form .64 >.99 .016
   Comfortable 71 (93) 43 (81) 28 (93) 53 (87) 18 (82) 29 (74) 41 (95)
   Uncomfortable 5 (7) 4 (8) 1 (3) 4 (6) 1 (5) 5 (13) 0 (0)
   Missing 0 (0) 6 (11) 1 (3) 4 (6) 3 (14) 5 (13) 2 (5)
   Never used short-form consent form 7 (8)
 Percentage of speakers of languages other than English who provided consent using the short-form consent form .19 .16 .31
  None 7 (8) 6 (11) 1 (3) 5 (8) 2 (9) 4 (10) 3 (6)
  1%-50% 38 (46) 26 (49) 12 (40) 24 (39) 14 (64) 21 (54) 17 (40)
  ≥51% 35 (42) 19 (36) 16 (53) 29 (48) 6 (27) 13 (33) 21 (49)
  Missing 3 (4) 2 (4) 1 (3) 3 (5) 0 (0) 1 (3) 2 (5)
IRB requires translation of consent documents
 Yes 69 (50) 50 (51) 19 (48) .31 56 (56) 13 (33) .04 35 (59) 34 (43) .13
 No 46 (33) 30 (30) 16 (40) 30 (30) 16 (41) 15 (25) 30 (38)
 Not sure 23 (16) 19 (19) 4 (10) 13 (13) 10 (26) 8 (13) 15 (19)
 Missing 1 (1) 0 (0) 1 (2) 1 (1) 0 (0) 1 (3) 0 (0)
 Among institutions where the institutional review board requires translation of consent forms (n = 69)
  IRB requirements for use of translated consent documents .23 .61 .026
   For protocol with a certain percentage of patients from specific backgrounds 34 (49) 24 (48) 10 (53) 26 (46) 8 (62) 13 (37) 21 (62)
   Any protocol with participants who speak languages other than English 20 (29) 17 (34) 3 (16) 17 (30) 3 (23) 10 (29) 10 (29)
   Other 15 (22) 9 (18) 6 (32) 13 (23) 2 (15) 12 (34) 3 (9)
  Institution allows Central IRB–approved translated consent documents
   Always 61 (44) 49 (49) 12 (30) .06 37 (38) 24 (62) .02 27 (46) 34 (43) .22
   Sometimes 20 (14) 15 (15) 5 (13) 16 (16) 4 (10) 8 (14) 11 (14)
   IRB does not allow these translations 17 (12) 12 (12) 5 (13) 16 (16) 1 (93) 7 (12) 10 (13)
   Not aware that these translations exist 9 (6) 7 (7) 2 (5) 5 (5) 4 (10) 1 (2) 8 (10)
   Other 30 (22) 15 (15) 15 (38) 24 (24) 6 (15) 16 (27) 14 (18)
   Missing 2 (1) 1 (1) 1 (1) 2 (2) 0 (0) 0 (0) 2 (2)
  Requirement that in-person interpreters be used
   Yes 61 (44) 40 (40) 21 (53) .34 44 (44) 17 (44) .24 25 (42) 36 (46) .93
   No 71 (51) 53 (54) 18 (45) 53 (53) 18 (46) 31 (53) 39 (49)
   Not sure 7 (5) 6 (6) 1 (3) 3 (3) 4 (10) 3 (5) 4 (5)
a

Other: CRA, Nurse, NCORP Administrator. IRB = institutional review board.

Short-form consent documents were used for participants who speak languages other than English at 60% of institutions (83/139). Among these 83 institutions, 42% (n = 35) had short forms available in more than 10 languages, and 42% (n = 35) reported obtaining consent from at least half of the participants who speak languages other than English using a short form (Table 2). Large institutions more often used short forms than did small institutions (75% vs 54%, P = .02). Of the 83 institutions that used short forms, 85% (n = 71) were comfortable using short forms.

Availability of interpreter and language-concordant services

In total, 81% (113/139) of institutions had access to trained medical interpreters, and 77% (107/139) reported access to in-person interpreter services (Table 3). Large institutions more often had access to in-person interpreter services than did small institutions (94% vs 71%, P < .01). Fifty-one percent (71/139) of institutions reported that more than 10% of their oncology clinicians were bilingual or multilingual. Among institutions with at least 1% multilingual provider, thirty percent (n = 32) endorsed having a process for multilingual clinician certification. In addition, 57% (n = 79) reported that their team (research or clinical) included bilingual staff, and 57% of these 79 (n = 44) had a certification process for bilingual staff; noncertified interpreters were rarely or never used (90% [n = 125]). Regarding regulatory requirements for interpretation during informed consent discussions, 44% (61/139) of institutions were required to use in-person interpreters.

Table 3.

Availability of interpretation and language-concordant services (N = 139)

Characteristic No. (%)
Specifically trained medical interpreters available
 Yes 113 (81)
 No 17 (12)
 Unsure 7 (5)
Access to medical interpreter servicesa
 In-person interpreters available 107 (77)
 Interpreter services available through on-demand application 86 (62)
 Telephone interpreter services available 76 (55)
 No interpreter services available 0 (0)
Certification process for bilingual or multilingual clinicians (n = 109)
 Yes 32 (29)
 No 53 (49)
 Unsure 22 (20)
Clinical or research staff who are bilingual
 Yes 79 (57)
 No 51 (37)
 Unsure 5 (4)
Certification process for bilingual staff (n = 77)
 Yes 44 (57)
 No 18 (23)
 Unsure 15 (20)
How often are noncertified interpreters used for consent?
 Always 0 (0)
 Often 12 (9)
 Rarely 57 (41)
 Never 68 (49)
In-person interpreters required for informed clinical trial consent from patients speaking languages other than English
 Yes 61 (44)
 No 71 (51)
 Unsure 7 (5)
Perceived difficulty in obtaining consent from patients speaking languages other than English for clinical trials
 Very difficult 11 (8)
 Somewhat difficult 54 (39)
 Not too difficult 39 (28)
 Not difficult at all 34 (25)
a

Numbers may not sum to 100% because of an option to select all that apply.

Perceptions of consenting participants or surrogate decision makers who speak languages other than English

Seventy-five percent (104/139) of institutions reported some level of difficulty in gaining consent from participants who speak languages other than English, with 47% (65/139) rating gaining consent “somewhat difficult” or “very difficult” (Table 3). Among the institutions that reported some level of difficulty, the most commonly endorsed barriers to obtaining consent were lack of available in-person interpreters (56% [58/104]), time (52% [54/104]), required institutional resources (50% [52/104]), and clinician comfort (34% [35/104]) (Figure 3). Overall, most (83% [116/139]) reported that lack of interpreter services did not affect their ability to enroll participants who speak languages other than English, but when we examined responses from the 65 institutions that reported a “somewhat” or “very” difficult time gaining consent from participants who speak languages other than English, this proportion decreased from 85% to 72% (47/65).

Figure 3.

Figure 3.

Factors contributing to difficulty in obtaining consent from participants who speak languages other than English.a

a Respondents were allowed to select more than 1 answer; percentages may not sum to 100%. Represents 104 institutions that endorsed some level of difficulty gaining consent from participants who speak languages other than English to participate in clinical trials.

Discussion

This study assessed institutional capacity, resources, and barriers to inclusion of participants or surrogate decision makers who speak languages other than English in pediatric cancer clinical trials. We found that although half of IRBs require translated consent forms, most COG institutions also use short-form consent documents, highlighting the multiple layers of regulatory resources required to offer inclusive approaches to enroll participants who speak languages other than English in cancer clinical trials. In addition, although interpreter services are often available, in-person interpreter requirements from the IRB may impede institutions, particularly small institutions, from equitably enrolling participants who speak languages other than English in clinical trials. Overall, our findings demonstrate that current processes and resources at many COG-affiliated institutions may impair equitable access to clinical trials and contribute to the underrepresentation of persons who speak languages other than English in pediatric cancer clinical trials (22).

Regulatory barriers were reported regarding consent form requirements for enrollment of participants who speak languages other than English. A tension existed between the regulatory requirements to ensure availability of translated consent forms and the allowance of or restrictions on using short forms. Translation service requirements have historically been expensive and time-consuming, delaying the opportunity to enroll persons who speak languages other than English in a trial (31). Translating consent forms is a multistep process that tends to require costs that are rarely covered in research budgets. In our survey, nearly half of institutions did not have access to translation cost coverage, potentially rendering it impossible to offer clinical trials to populations that speak languages other than English. Recently, NCI-sponsored protocols facilitated translating consent forms into Spanish to alleviate institutional barriers to translation or short-form use, but this service does not uniformly cover translation of all study materials (eg, surveys, ancillary studies, study reports [results] and assessments), and in our study, some institutions—more often academic rather than nonacademic institutions—reported restrictions related to using centrally translated documents. This finding is concerning, especially given that prior research has demonstrated that clinicians consider a lack of adequately translated consent forms as a major barrier to enrolling adults with cancer who speak languages other than English (32).

In their current form, short-form consent documents are inadequate for communicating the purpose of the research or the details of participation (27). The inability to use these documents at 40% of institutions in our study, however, likely further hinders recruitment of persons who speak languages other than English. Current consent documents are often lengthy, intimidating, and difficult to digest, affecting comprehension of informed consent and decision-making abilities, particularly in individuals with low health literacy or individuals who speak languages other than English (33,34). An abbreviated document, such as a visual aid, may be more effective in communicating complex information and may offer flexibility for research participants, similar to telehealth or virtual consent allowances (35,36). In prior research, potential participants for a clinical trial more thoroughly read a shortened document with illustrations than they did a full consent document, regardless of primary language (37). Our findings support the need to continue the broader discussion of how to balance time and attention constraints with provision of comprehensive study information (38,39).

Additional investment, either from the NCI, institutions, foundations, companies, or other study sponsors, should be allocated to ensure that translated consent forms and study documents are available and acceptable for use to support institutions in activating clinical trials and addressing regulatory barriers. The Belmont Report encouraged equitable selection of study participants and mandated autonomy in the informed consent process (40). To ensure autonomy and to avoid excluding individuals who speak languages other than English, institutions should ideally have translated research study documents to match the languages spoken by the patients in their catchment area. For institutions where a high proportion of patients speak Spanish or another common language, efforts should be made to have consents forms, surveys, and related study materials available in that language whenever possible.

Availability of high-quality, professional medical interpreters is critical for clinical trial informed consent (41). In our study, most institutions had access to medical interpreter services through a combination of in-person, online, and telephone-based services. Even with access to interpreter services, however, lack of in-person interpreters, a requirement for gaining consent from participants who speak languages other than English at nearly half of institutions, was the most frequently cited barrier to recruiting these participants. This finding suggests that even with access to interpreter services, additional barriers, including regulatory requirements for in-person interpretation and practical challenges coordinating interpreter availability in a busy clinic or inpatient setting, where consent discussions often occur, remain a challenge. This finding is consistent with a qualitative study of pediatric oncology clinicians, where 1 of the top barriers to enrolling persons who speak languages other than English was clinician-patient language discordance (42). Lack of in-person interpreters may lead to situations where the clinicians or patient and family do not feel sufficiently supported to discuss or receive information about clinical trials. Moreover, a suboptimal discussion may ensue that leads to a diminished patient-clinician therapeutic alliance (43). A 2006 survey of clinicians, parents, and interpreters identified similar concerns, noting that availability of interpreters as well as using simpler, easy-to-understand language were necessary to reduce barriers to care (44). Having readily available, trained professional interpreters improved the informed consent process in a study of hospitalized patients undergoing invasive surgical procedures (45). Pediatric oncology settings are similarly complex, with initial treatment options often presented to the family in an acute, inpatient setting. Because linguistically concordant health care may improve access to and engagement with the health-care system and, by extension, cancer therapy (46), additional training may be warranted to ensure that high-quality consent discussions are feasible.

In pediatric oncology, barriers and facilitators of communication have been well described for English-speaking families (47). Recent studies have outlined potential strategies to improve clinical trial participation, including optimizing the research infrastructure at an institution, developing and testing shared decision-making interventions, and provision of additional psychosocial support to people considering participation for themselves or a family member (48,49). The next critical step is to apply—or adapt, if necessary—these innovative strategies to focus on pediatric patients and their parents who speak languages other than English as they consider treatment options for cancer, including participation in a clinical trial.

Our data suggest that most institutions have access to some resources, including interpreter services or translated consent documents; these resources can be expanded upon or adapted to ensure consistent access to and offering of clinical trials. Certainly, the culture of pediatric oncology is an exemplar of clinical trial participation and success, as past decades have shown, and has led to current successes in many pediatric cancer treatments to date (50,51). A recent study, however, showed an overall decline in participation in COG clinical trials over time (24); thus, efforts aimed at improving communication with potential participants about research trials are urgently needed.

Dedicated, multilevel interventions are needed to address current disparities in access to high-quality health care, including clinical trials (17,47,52,53). Rethinking our current informed consent process, which uses lengthy, complicated, and often overwhelming documents, should be considered regardless of language spoken (38,39). In addition to the availability of translated consent forms, the health-care system should prioritize designated time and space for long discussions, training in cultural competence to reduce clinician discomfort while gaining consent from participants who speak languages other than English, and access to high-quality interpreter services that represent the languages most commonly spoken among local patients (54). Without these resources, addressing clinical trial underrepresentation will be difficult. In addition, institutions should ensure that all available resources to support diverse enrollment within their local infrastructure or centrally are used; the ability to use Central IRB–translated consent documents or access translation services should be prioritized, as well. Another example is the integration of patient navigators, a valuable resource that may increase access to, understanding of, and consent to participate in cancer clinical trials (46,52). Depending on the local context of and persons an institution serves, attention should be given to hiring staff who can provide linguistically concordant care; training procedures for multilingual staff and clinicians might also be shared across institutions to reduce resource burdens (55). The implications from our study are not only relevant for the pediatric oncology community but more broadly across cancer care settings, where inclusion in clinical trials and generalizability of findings are critical (56).

We used an interdisciplinary team to develop our survey instrument, using previously established modes of survey distribution to reach diverse and geographically distributed COG-affiliated institutions across the United States, Canada, and Australia. Our study has some limitations, however, including the potential for nonresponse or recall difficulties. As this was a voluntary survey study without full participation from all COG-affiliated institutions, the results may not be fully representative of the COG consortia and do not represent the experiences of institutions not affiliated with COG. In addition, the responses relied on the knowledge of the lead clinical research associate or COG principal investigator and represent only the perspective of those individuals delivering care, not those individuals receiving it. Further, we did not survey medical interpreters, IRB staff, or other administrators, limiting the scope of understanding of institutional and regulatory barriers. Moreover, we did not conduct an evaluation of costs associated with interpretation and translation services, which could help develop future interventions and policy. Some institutions may serve a larger population of people who speak languages other than English or where a language other than English is the dominant language; however, most institutions represent geographic locations where English is the most common language. Finally, the landscape of language equity, communication, language preference, and therapeutic misconception is rapidly evolving. Although we did not use a validated instrument as one does not currently exist to assess this specific topic, the survey was developed with this in mind and used multidisciplinary expertise to provide insight into a complex issue. This study highlights actionable barriers to gaining consent from persons who speak languages other than English and will inform areas for further investigation and interventions to provide equitable informed consent processes for all children with cancer and their families.

COG-affiliated institutions face multiple resource-specific challenges that create barriers to recruitment and enrollment of participants or surrogate decision makers who speak languages other than English in cancer clinical trials. Our findings offer directions to focus future strategic efforts to reduce recruitment barriers to COG clinical trials and ensure equitable clinical trial representation and improved outcomes for all.

Supplementary Material

pkae047_Supplementary_Data

Contributor Information

Melissa P Beauchemin, Division of Research and Scholarship, Columbia University School of Nursing, New York, NY, USA; Herbert Irving Comprehensive Cancer Center, Columbia University Irving Medical Center, New York, NY, USA.

Maria Ortega, Children’s Hospital of Philadelphia, Division of Oncology, Philadelphia, PA, USA.

Sheila J Santacroce, School of Nursing and Linberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.

Joanna M Robles, Pediatric Oncology, Wake Forest University Health Sciences, Winston Salem, NC, USA.

Jenny Ruiz, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA.

Anurekha G Hall, University of Washington School of Medicine and Seattle Children’s Hospital, Seattle, WA, USA.

Justine M Kahn, Herbert Irving Comprehensive Cancer Center, Columbia University Irving Medical Center, New York, NY, USA; Pediatric Oncology, Columbia University Irving Medical Center, New York City, NY, USA.

Cecilia Fu, Keck School of Medicine, Children’s Hospital of Los Angeles, Los Angeles, CA, USA.

Manuela Orjuela-Grimm, Herbert Irving Comprehensive Cancer Center, Columbia University Irving Medical Center, New York, NY, USA; Pediatric Oncology, Columbia University Irving Medical Center, New York City, NY, USA.

Grace C Hillyer, Herbert Irving Comprehensive Cancer Center, Columbia University Irving Medical Center, New York, NY, USA.

Samrawit Solomon, Division of Research and Scholarship, Columbia University School of Nursing, New York, NY, USA.

Wendy Pelletier, University of Calgary, Calgary, AB, Canada.

Raul Montiel-Esparza, Department of Pediatrics, Stanford Medicine, Palo Alto, CA, USA.

Lindsay J Blazin, Division of Oncology, Riley Children’s Hospital, Indianapolis, IN, USA.

Cassie Kline, Children’s Hospital of Philadelphia, Division of Oncology, Philadelphia, PA, USA.

Alix E Seif, Children’s Hospital of Philadelphia, Division of Oncology, Philadelphia, PA, USA.

Paula Aristizabal, Division of Pediatric Hematology/Oncology, Department of Pediatrics, University of California San Diego/Rady Children’s Hospital San Diego and Moores Cancer Center, La Jolla, CA, USA.

Lena E Winestone, Division of Allergy, Immunology & BMT, University of California San Francisco Benioff Children’s Hospitals, San Francisco, CA, USA.

Maria C Velez, Children’s Hospital New Orleans/Louisiana State University Health Sciences Center, New Orleans, LA, USA.

Data availability

All data referenced in this publication are available upon reasonable request.

Author contributions

Melissa Parsons Beauchemin, PhD, RN, CPNP (Conceptualization; Data curation; Formal analysis; Methodology; Project administration; Writing—original draft); Paula Aristizabal, MD (Methodology; Writing—review & editing); Alix E. Seif, MD (Methodology; Writing—review & editing); Cassie Kline, MD (Writing—review & editing); Lindsay J. Blazin, MD (Methodology; Visualization; Writing—review & editing); Raul Montiel-Esparza, MD (Writing—review & editing); Wendy Pelletier, MSW (Conceptualization; Methodology; Writing—review & editing); Samrawit Solomon, BA (Methodology; Project administration; Writing—review & editing); Lena E. Winestone, MD (Conceptualization; Methodology; Writing—review & editing); Grace C. Hillyer, EdD (Data curation; Formal analysis; Methodology; Writing—original draft; Writing—review & editing); Cecilia Fu, MD (Writing—review & editing); Justine M. Kahn, MD (Conceptualization; Investigation; Methodology; Writing—review & editing); Anurekha G. Hall, MD (Methodology; Visualization; Writing—review & editing); Jenny Ruiz, MD (Investigation; Methodology; Writing—review & editing); Joanna M. Robles, MD (Conceptualization; Methodology; Writing—review & editing); Sheila J. Santacroce, PhD (Conceptualization; Methodology; Writing—review & editing); Maria Ortega, MPH, MBS (Data curation; Formal analysis; Writing—original draft); Manuela Orjuela-Grimm, MD (Conceptualization; Methodology; Writing—review & editing); Maria C. Velez, MD (Conceptualization; Investigation; Methodology; Writing—review & editing).

Funding

This research was funded by the COG NCI Community Oncology Research Program Research Base Grant (5UG1CA189955) and the NCTN Operations Center Grant (U10CA180886). Disclaimer: The content is solely the responsibility of the authors and is not intended to represent the views of the National Institutes of Health. Melissa P. Beauchemin was supported by TRANSFORM: KL2TR001874. Justine M. Kahn is supported by The Leukemia & Lymphoma Society Scholar in Clinical Research Program.

Conflicts of interest

We have no conflicts of interest to disclose.

References

  • 1. Dietrich S, Hernandez E.. Language Use in the United States: 2019. 2022. https://www.census.gov/content/dam/Census/library/publications/2022/acs/acs-50.pdf. Accessed March 8, 2024.
  • 2. Ortega P, Shin TM.. Language Is Not A Barrier—It Is An Opportunity To Improve Health Equity Through Education. 2021. https://www.healthaffairs.org/content/forefront/language-not-barrier-opportunity-improve-health-equity-through-education. Accessed July 30, 2021.
  • 3. Divi C, Koss RG, Schmaltz SP, Loeb JM.. Language proficiency and adverse events in US hospitals: a pilot study. Int J Qual Health Care. 2007;19(2):60-67. doi: 10.1093/intqhc/mzl069. [DOI] [PubMed] [Google Scholar]
  • 4. Cohen AL, Rivara F, Marcuse EK, McPhillips H, Davis R.. Are language barriers associated with serious medical events in hospitalized pediatric patients? Pediatrics. 2005;116(3):575-579. doi: 10.1542/peds.2005-0521. [DOI] [PubMed] [Google Scholar]
  • 5. Halvorson EE, Thurtle DP, Easter A, Lovato J, Stockwell D.. Disparities in adverse event reporting for hospitalized children. J Patient Saf. 2022;18(6):e928-e933. doi: 10.1097/pts.0000000000001049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Gulati RK, Hur K.. Association between limited English proficiency and healthcare access and utilization in California. J Immigr. Minor Health. 2022;24(1):95-101. doi: 10.1007/s10903-021-01224-5. [DOI] [PubMed] [Google Scholar]
  • 7. Kerfeld CI, Hoffman JM, Ciol MA, Kartin D.. Delayed or forgone care and dissatisfaction with care for children with special health care needs: the role of perceived cultural competency of health care providers. Matern Child Health J. 2011;15(4):487-496. doi: 10.1007/s10995-010-0598-3. [DOI] [PubMed] [Google Scholar]
  • 8. Ngui EM, Flores G.. Satisfaction with care and ease of using health care services among parents of children with special health care needs: the roles of race/ethnicity, insurance, language, and adequacy of family-centered care. Pediatrics. 2006;117(4):1184-1196. doi: 10.1542/peds.2005-1088. [DOI] [PubMed] [Google Scholar]
  • 9. Williams KM, Dougherty D, Plagens C, Shah NR, Tubbs D, Ehrlich PF.. Limited English proficiency can negatively impact disease/treatment in children with cancer compared to those who are English proficient-an institutional study. J Pediatr Surg. 2024;59(5):800-803. doi: 10.1016/j.jpedsurg.2024.01.021. [DOI] [PubMed] [Google Scholar]
  • 10. Silva MD, Genoff M, Zaballa A, et al. Interpreting at the end of life: a systematic review of the impact of interpreters on the delivery of palliative care services to cancer patients with limited English proficiency. J Pain Symptom Manag. 2016;51(3):569-580. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Staples JN, Lester J, Li A, et al. Language as a barrier to cancer clinical trial accrual: Assessing consenting team knowledge and practices for cancer clinical trial consent among low English fluency patients. Appl Cancer Res. 2018;38(1):14. doi: 10.1186/s41241-018-0065-9. [DOI] [Google Scholar]
  • 12. Congress.gov. H.R.3503 - NIH Clinical Trial Diversity Act of 2023. 2023. https://www.congress.gov/bill/118th-congress/house-bill/3503/text?s=1&r=1. Accessed July 19, 2023.
  • 13. NIH Grants & Funding. NIH Policy and Guidelines on the Inclusion of Women and Minorities as Subjects in Clinical Research. https://grants.nih.gov/policy/inclusion/women-and-minorities.htm1994; https://grants.nih.gov/policy/inclusion/women-and-minorities/guidelines.htm. Accessed July 19, 2023.
  • 14. Murthy VH, Krumholz HM, Gross CP.. Participation in cancer clinical trials: race-, sex-, and age-based disparities. JAMA. 2004;291(22):2720-2726. doi: 10.1001/jama.291.22.2720. [DOI] [PubMed] [Google Scholar]
  • 15. Ma MA, Gutiérrez DE, Frausto JM, Al-Delaimy WK.. Minority representation in clinical trials in the United States: trends over the past 25 years. Mayo Clinic Proc. 2021;96(1):264-266. doi: 10.1016/j.mayocp.2020.10.027. [DOI] [PubMed] [Google Scholar]
  • 16. Turner BE, Steinberg JR, Weeks BT, Rodriguez F, Cullen MR.. Race/ethnicity reporting and representation in US clinical trials: a cohort study. Lancet Reg Health—Am. 2022;11:100252. doi: 10.1016/j.lana.2022.100252. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Hamel LM, Penner LA, Albrecht TL, Heath E, Gwede CK, Eggly S.. Barriers to clinical trial enrollment in racial and ethnic minority patients with cancer. Cancer Control. 2016;23(4):327-337. doi: 10.1177/107327481602300404. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Simon C, Zyzanski SJ, Eder M, Raiz P, Kodish ED, Siminoff LA.. Groups potentially at risk for making poorly informed decisions about entry into clinical trials for childhood cancer. J Clin Oncol. 2003;21(11):2173-2178. doi: 10.1200/jco.2003.03.003. [DOI] [PubMed] [Google Scholar]
  • 19. Roy M, Purington N, Liu M, Blayney DW, Kurian AW, Schapira L.. Limited English proficiency and disparities in health care engagement among patients with breast cancer. J Clin Oncol Oncol Pract. 2021;17(12):e1837-e45. doi: 10.1200/op.20.01093. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Unger JM, Hershman DL, Till C, et al. “When offered to participate”: a systematic review and meta-analysis of patient agreement to participate in cancer clinical trials. J Natl Cancer Inst 2020;113(3):244-257. doi: 10.1093/jnci/djaa155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Hawkins DS, Gore L.. Children's Oncology Group's 2023 blueprint for research. Pediatr Blood Cancer. 2023;70(suppl 6):e30569. doi: 10.1002/pbc.30569. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Aristizabal P, Singer J, Cooper R, et al. Participation in pediatric oncology research protocols: racial/ethnic, language and age-based disparities. Pediatr Blood Cancer. 2015;62(8):1337-1344. doi: 10.1002/pbc.25472. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Lund MJ, Eliason MT, Haight AE, Ward KC, Young JL, Pentz RD.. Racial/ethnic diversity in children's oncology clinical trials: ten years later. Cancer. 2009;115(16):3808-3816. doi: 10.1002/cncr.24437. [DOI] [PubMed] [Google Scholar]
  • 24. Faulk KE, Anderson-Mellies A, Cockburn M, Green AL.. Assessment of enrollment characteristics for Children's Oncology Group (COG) upfront therapeutic clinical trials 2004-2015. PLoS One. 2020;15(4):e0230824. doi: 10.1371/journal.pone.0230824. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Withycombe JS, Alonzo TA, Wilkins-Sanchez MA, Hetherington M, Adamson PC, Landier W.. The Children's Oncology Group: organizational structure, membership, and institutional characteristics. J Pediatr Oncol Nurs. 2019;36(1):24-34. doi: 10.1177/1043454218810141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Winestone LE, Beauchemin MP, Bona K, et al. ; Diversity and Health Disparities Committee Children's Oncology Group's 2023 blueprint for research: diversity and health disparities. Pediatric Blood Cancer. 2023;70(suppl 6):e30592. doi: 10.1002/pbc.30592. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. NIH Office of Intramural Research. Short Form Consents 2019. 2023. https://ohsrp.nih.gov/confluence/display/ohsrp/Short+Form+Consents?desktop=true&macroName=report-table. Accessed November 1, 2023.
  • 28. LEP.gov. Limited English Proficiency.https://www.lep.gov/n.d. [cited 2023 July 19]. Available from: https://www.lep.gov/.
  • 29. Ortega P, Shin TM, Martínez GA.. Rethinking the term "Limited English Proficiency" to improve language-appropriate healthcare for all. J Immigr Minor Health. 2022;24(3):799-805. doi: 10.1007/s10903-021-01257-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Yeboah D, McDaniel C, Lion KC.. Language matters: why we should reconsider the term "Limited English Proficiency". Hosp Pediatr. 2023;13(1):e11-e3. doi: 10.1542/hpeds.2022-007014. [DOI] [PubMed] [Google Scholar]
  • 31. Guo XM, Neuman MK, Vallejo A, Matsuo K, Roman LD.. An absence of translated consent forms limits oncologic clinical trial enrollment for limited English proficiency participants. Gynecol Oncol. 2024;180:86-90. doi: 10.1016/j.ygyno.2023.11.025. [DOI] [PubMed] [Google Scholar]
  • 32. Jorge S, Masshoor S, Gray HJ, Swisher EM, Doll KM.. Participation of patients with limited English proficiency in gynecologic oncology clinical trials. J Natl Compr Canc Netw. 2023;21(1):27-32.e2. doi: 10.6004/jnccn.2022.7068. [DOI] [PubMed] [Google Scholar]
  • 33. Aristizabal P, Ma AK, Kumar NV, et al. Assessment of factors associated with parental perceptions of voluntary decisions about child participation in leukemia clinical trials. JAMA Netw Open. 2021;4(5):e219038. doi: 10.1001/jamanetworkopen.2021.9038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Aristizabal P, Nataraj S, Ma AK, et al. Social determinants of health and informed consent comprehension for pediatric cancer clinical trials. JAMA Netw Open. 2023;6(12):e2346858-e. doi: 10.1001/jamanetworkopen.2023.46858. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Lichtenstein MR, Beauchemin MP, Hillyer GC, et al. Assessing oncology patient interest in using telehealth for routine cancer care and clinical trials. J Clin Oncol Oncol Pract. 2023;19(suppl 11):525. doi: 10.1200/OP.2023.19.11_suppl.525. [DOI] [Google Scholar]
  • 36. Meghiref Y, Parnot C, Duverger C, et al. The use of telemedicine in cancer clinical trials: connect-patient-to-doctor prospective study. JMIR Cancer. 2022;8(1):e31255. doi: 10.2196/31255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Bloswick AMSC, Skowron A.. Will shorter informed consent forms with visual aids improve understanding of the document in adult and elderly populations of clinical trials? Ethics Med. 2019;35(1):43-44. [Google Scholar]
  • 38. Manta CJ, Ortiz J, Moulton BW, Sonnad SS.. From the patient perspective, consent forms fall short of providing information to guide decision making. J Patient Saf. 2021;17(3):e149-e154. doi: 10.1097/pts.0000000000000310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Berger O, Grønberg B, Sand K, Kaasa S, Loge J.. The length of consent documents in oncological trials is doubled in twenty years. Ann Oncol. 2009;20(2):379-385. [DOI] [PubMed] [Google Scholar]
  • 40. Department of Health Education and Welfare. The Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research. Bethesda, MD. 1978. Available from: https://www.hhs.gov/ohrp/regulations-and-policy/belmont-report/read-the-belmont-report/index.html. Accessed July 19, 2023. [PubMed]
  • 41. Karliner LS, Jacobs EA, Chen AH, Mutha S.. Do professional interpreters improve clinical care for patients with limited English proficiency? A systematic review of the literature. Health Serv Res. 2007;42(2):727-754. doi: 10.1111/j.1475-6773.2006.00629.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Russo C, Stout L, House T, Santana VM.. Barriers and facilitators of clinical trial enrollment in a network of community-based pediatric oncology clinics. Pediatr Blood Cancer. 2020;67(4):e28023. doi: 10.1002/pbc.28023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Maul L, Regenstein M, Andres E, Wright R, Wynia MK.. Using a risk assessment approach to determine which factors influence whether partially bilingual physicians rely on their non-English language skills or call an interpreter. Jt Comm J Qual Patient Saf. 2012;38(7):328-336. doi: 10.1016/S1553-7250(12)38043-4. [DOI] [PubMed] [Google Scholar]
  • 44. Abbe M, Simon C, Angiolillo A, Ruccione K, Kodish ED.. A survey of language barriers from the perspective of pediatric oncologists, interpreters, and parents. Pediatr Blood Cancer. 2006;47(6):819-824. doi: 10.1002/pbc.20841. [DOI] [PubMed] [Google Scholar]
  • 45. Lee JS, Pérez-Stable EJ, Gregorich SE, et al. Increased access to professional interpreters in the hospital improves informed consent for patients with limited English proficiency. J Gen Intern Med. 2017;32(8):863-870. doi: 10.1007/s11606-017-3983-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Genoff MC, Zaballa A, Gany F, et al. Navigating language barriers: a systematic review of patient navigators' impact on cancer screening for limited English proficient patients. J Gen Intern Med. 2016;31(4):426-434. doi: 10.1007/s11606-015-3572-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Sisk BA, Harvey K, Friedrich AB, et al. Multilevel barriers and facilitators of communication in pediatric oncology: a systematic review. Pediatr Blood Cancer. 2022;69(1):e29405. doi: 10.1002/pbc.29405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Siembida EJ, Loomans-Kropp HA, Trivedi N, et al. Systematic review of barriers and facilitators to clinical trial enrollment among adolescents and young adults with cancer: identifying opportunities for intervention. Cancer. 2020;126(5):949-957. doi: 10.1002/cncr.32675. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Robertson EG, Wakefield CE, Signorelli C, et al. Strategies to facilitate shared decision-making about pediatric oncology clinical trial enrollment: a systematic review. Patient Educ Couns. 2018;101(7):1157-1174. doi: 10.1016/j.pec.2018.02.001. [DOI] [PubMed] [Google Scholar]
  • 50. Smith MA, Altekruse SF, Adamson PC, Reaman GH, Seibel NL.. Declining childhood and adolescent cancer mortality. Cancer. 2014;120(16):2497-2506. doi: 10.1002/cncr.28748. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Pui CH, Yang JJ, Hunger SP, et al. Childhood acute lymphoblastic leukemia: progress through collaboration. J Clin Oncol. 2015;33(27):2938-2948. doi: 10.1200/jco.2014.59.1636. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Sae-Hau M, Disare K, Michaels M, et al. Overcoming barriers to clinical trial participation: outcomes of a national clinical trial matching and navigation service for patients with a blood cancer. J Clin Oncol Oncol Pract 2021;17(12):e1866-e1878. doi: 10.1200/op.20.01068. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53. Aristizabal P, Winestone LE, Umaretiya P, Bona K.. Disparities in pediatric oncology: the 21st century opportunity to improve outcomes for children and adolescents with cancer. Am Soc Clin Oncol Educ Book. 2021;41:e315-e326. doi: 10.1200/edbk_320499. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Khoong EC, Fernandez A.. Addressing gaps in interpreter use: time for implementation science informed multi-level interventions. J Gen Intern Med. 2021;36(11):3532-3536. doi: 10.1007/s11606-021-06823-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Aristizabal P. Diverse populations and enrollment in pediatric cancer clinical trials: challenges and opportunities. Pediatr Blood Cancer. 2020;67(11):e28296. doi: 10.1002/pbc.28296. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Espinoza-Gutarra MR, Duma N, Aristizabal P, et al. The problem of Hispanic/Latinx under-representation in cancer clinical trials. J Clin Oncol Oncol Pract. 2022;18(5):380-384. doi: 10.1200/op.22.00214. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

pkae047_Supplementary_Data

Data Availability Statement

All data referenced in this publication are available upon reasonable request.


Articles from JNCI Cancer Spectrum are provided here courtesy of Oxford University Press

RESOURCES