Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2016 Oct 1.
Published in final edited form as: Clin Trials. 2015 Sep 15;12(5):503–510. doi: 10.1177/1740774515597701

The ethics and regulatory landscape of including vulnerable populations in pragmatic clinical trials

Mary Jane Welch 1, Rachel Lally 2, Jennifer E Miller 3,4, Stephanie Pittman 1, Lynda Brodsky 5, Arthur L Caplan 6, Gina Uhlenbrauck 7, Darcy M Louzao 7, James H Fischer 8, Benjamin Wilfond 9,10
PMCID: PMC4662375  NIHMSID: NIHMS705977  PMID: 26374681

Abstract

Policies have been developed to protect vulnerable populations in clinical research, particularly the US federal research regulations (45 CFR 46 subparts B, C, and D). These policies generally recognize vulnerable populations to include pregnant women, fetuses, neonates, children, prisoners, persons with physical handicaps or mental disabilities, and disadvantaged persons. The aim has been to protect these populations from harm, often by creating regulatory and ethical checks that may limit their participation in many clinical trials. The recent increase in pragmatic clinical trials (PCTs) raises at least two questions about this approach. First, is exclusion itself a harm to vulnerable populations, as these groups may be denied access to understanding how health interventions work for them in clinical settings? Second, are groups considered vulnerable in traditional clinical trials also vulnerable in PCTs? We argue first, that excluding vulnerable subjects from participation in PCTs can be harmful by preventing acquisition of data to meaningfully inform clinical decision-making in the future. Second, we argue that protections for vulnerable subjects in traditional clinical trial settings may not be translatable, feasible, or even ethical to apply in PCTs. We conclude by offering specific recommendations for appropriately protecting vulnerable research subjects in PCTs, focusing on pregnant women, fetuses, neonates, children, prisoners, persons with physical handicaps or mental disabilities, and disadvantaged persons.

Keywords: Vulnerable subjects, pragmatic clinical trials, cluster randomized trials, research ethics, regulation, research with pregnant women, research with children, research with prisoners, research with diminished capacity, research with disadvantaged populations

Introduction

Vulnerable persons are those “who are relatively (or absolutely) incapable of protecting their own interests.”1 Research scandals have underscored the need for additional safeguards for those considered vulnerable,2, a resulting in policies created to safeguard and protect specific groups from harm. However, pragmatic clinical trials (PCTs) offer a reason to revisit the concept of harm in research for vulnerable populations.

This article discusses ethical and regulatory considerations for vulnerable populations in PCTs. PCTs have been defined as trials that “1) select clinically relevant alternative interventions to compare, 2) include a diverse population of study participants, 3) recruit participants from heterogeneous practice settings, and 4) collect data on a broad range of health outcomes.”3 PCTs streamline and simplify trial design to answer “questions that inform decision-makers about health and healthcare.”4 Features frequently found in PCTs, such as randomization at the group level, reliance on electronic health record (EHR) data, the availability of safety data, and comparisons of approved forms of medical care, may contribute to some PCTs meeting the criteria for minimal risk to human research subjects. Furthermore, for minimal risk PCTs, the additional protections afforded vulnerable subjects, primarily in the informed consent process, may be unnecessary or overly complicated.5 A reevaluation of current regulations and institutional practices is prudent, as not all safeguards for vulnerable subjects may be appropriate, feasible, or ethical in PCTs.6

Traditionally, protecting research participants from harm was closely aligned with excluding them from research, but is exclusion itself harmful? We argue that the principle of justice, commonly interpreted as preventing an inequitable burden of research, should also prevent inequitable access to research and its potential benefits for vulnerable populations.7 A turning point for this reconceptualization of harm started with AIDS research in the 1980s by patients advocating for access to life-saving experimental interventions.8 This shift continued in research for cancer9 and is evident in demands for expanded drug access on the grounds of compassionate use10 and a desire to understand not only whether drugs and interventions are safe and effective, but also whether they are superior to other options. More recently, PCTs have the potential to provide access to useful knowledge beyond traditional clinical research, including vulnerable populations.11

General considerations for vulnerable populations in PCTs

Research regulations

From a regulatory perspective, human subjects research in the United States is conducted principally under the federal regulations overseen by the Office for Human Research Protections (OHRP),12 and of the Food and Drug Administration (FDA),13 in accordance with state and local laws, and is grounded by the ethical principles described in the Belmont Report.14 The following populations are identified by specific regulations as needing additional protection: pregnant women, fetuses, neonates, children, and prisoners. Persons with physical handicaps or mental disabilities, and disadvantaged persons, are cited in the regulations. The Belmont Report adds three additional populations: racial minorities, the very sick, and the institutionalized.15 The protections afforded by these policies have been criticized on the grounds they may be too broad or too narrow, too restrictive or not restrictive enough.16

These policies were developed for traditional clinical trials that test novel interventions. PCTs are also designed to answer important questions; however, they may compare two routine medical treatments or collect data from medical records of routine care, thus meeting the federal definition of minimal risk. Approaches need to be identified that would support the design and approval of PCTs that include vulnerable subjects, while still safeguarding their interests.

Rethinking vulnerability

It is time to transition from viewing vulnerability as intrinsic to a specific population, to viewing vulnerability as situational, where the individual participant and study characteristics and circumstances intersect. In a characterization of pediatric vulnerability, Kipnis sets forth seven vulnerability characteristics17 that can be extended to all vulnerable populations (Table 1). For example, those with a critical illness may have situational vulnerability “in which medical exigency prevents the education and deliberation needed to decide whether to participate in the study.” Another example is persons who are economically disadvantaged, where allocational vulnerability applies because individuals may find it next to impossible to decide not to participate in a trial in light of the proposed benefits offered. These examples show that individuals are not inherently vulnerable simply due to membership in a group; instead, characteristics of the individual in the context of the study are more relevant to determining vulnerability and thus the need for extra protection.

Table 1.

Individual characteristics of vulnerability to consider by population

Population Incapacitationala Juridicb Deferentialc Sociald Situationale Medicalf Allocationalg
Children X X X X X X X
Disadvantaged persons X X X X
Human fetuses X X
Institutionalized X X X X X X
Neonates X X
Persons with physical handicaps/mental disabilities X X X X X X
Pregnant women X Historically and non-US X
Prisoners X X X X X
Racial minorities X X X
The very sick X X X X X

Note: Italicized populations are those covered by additional regulations.

Framework adapted from Kipnis17:

a

Lacks “the capacity to deliberate about and decide whether to participate in the study.”

b

“Liable to the authority of others who may have an independent interest in that participation.”

c

“Given to patterns of deferential behavior that may mask an underlying unwillingness to participate.”

d

Belongs “to a group whose rights and interests have been socially disvalued.”

e

“In a situation in which medical exigency prevents the education and deliberation needed to decide whether to participate in the study.”

f

Has “been selected, in part, because of the presence of a serious health-related condition for which there are no satisfactory remedies.”

g

“Lacking in subjectively important social goods that will be provided as a consequence of participation in the research.”

Ethical argument for inclusion

Central to the argument for inclusion of vulnerable participants in PCTs is allowing equitable access to the knowledge gained from research. Groups such as children and pregnant women have been described as “therapeutic orphans” due to the lack of data to support safety and efficacy of treatments in these populations.18 For example, in a large study examining prescription drug use in pregnant women from 1996 to 2000, 38% used a category C prescription medication for which safety during pregnancy had not been established.19 Prescription and over-the-counter drug use in pregnant women have increased markedly over the past several decades,20 and yet there remains a great disparity in available data despite efforts made to expand the inclusion of pregnant women in research.21 Similar arguments have been made in the case of children.22 PCTs, with minimal risk, can differentiate best practice from theoretical assumptions by using large datasets such as EHR and health insurance data; the research of maternal influenza vaccines and birth outcomes is one example.23,24

A primary reason people are considered vulnerable is the question of their ability to provide informed consent (ethical principle of respect for autonomy). PCT designs may make this question less relevant11 when consent is modified. This in no way diminishes the obligation to inform participants. Instead, we advocate consulting with stakeholders, including participants, to modify consent language, design processes to minimize vulnerability, and ensure respect for participants. The integration of stakeholders during all aspects of PCTs will contribute to the integrity and legitimacy of PCTs and build trust in the research process. Specific considerations related to vulnerable populations are discussed in the following sections.

Pregnant women, fetuses, and non-viable neonates or neonates of uncertain viability

Sponsors and institutional review boards (IRBs) are often hesitant to include pregnant women in research for a variety of reasons, including “fear of harm to the fetus and threat of legal liability”25; consequently, the federal regulations that define pregnant women, fetuses, and neonates as a vulnerable population are generally conservatively interpreted. These regulations (45 CFR 46, Subpart B) focus on individual involvement of subjects in interventional trials where the “subject is simultaneously the unit of randomization, the unit of experimentation, and the unit of observation.”26 Therefore, it can be difficult for IRBs to apply the regulations to research that does not fit into this “standard” design, for example cluster randomized trials (CRTs). In a CRT, “organizational, social, or geographically-defined units rather than individuals are randomized between or among comparator interventions.”27

An approach for certain CRTs would be to appropriately use the regulations and the definition of human subject research. OHRP defines a human subject as a living individual about whom an investigator obtains data through intervention or interaction with the individual or identifiable private information.12 If CRTs study groups rather than individuals and the data are collected in aggregate, they may not meet the regulatory definition of human subjects research, and additional safeguards would not apply.28

Recent recommendations provide guidance on the ethical design, conduct, and regulatory issues of CRTs.28,29 These recommendations address vulnerable subjects and help clarify considerations for IRBs. For example, if a CRT is minimal risk and the investigator or the IRB have no direct knowledge of the inclusion of vulnerable subjects, it is acceptable to assume the study does not include vulnerable groups.28

Highlighting the concern regarding inclusion of vulnerable populations in PCTs and/or CRTs, even when the trial involves randomization between interventions defined as “standard of care,” is the recent controversy surrounding the Surfactant, Positive Pressure, and Oxygenation Randomized Trial (SUPPORT).30,31 The trial randomly assigned infants to a higher or lower target oxygen saturation range within levels used in clinical settings to determine the optimal saturation to reduce the incidence of retinopathy of prematurity and death. OHRP determined that randomization to specific oxygen levels, even though within standard of care, increased risk to the subjects;32 however, it is important to note that neonatologists “generally...do not make individualized decisions about oxygen saturation targets for each patient” and that they “always treat babies by [that NICU's] protocol.”33 The trial results, along with those of companion trials outside the United States, helped change practice. However, OHRP determined that the informed consent did not adequately describe the potential risks of the study.32 The controversies surrounding SUPPORT illustrate the need to reconsider issues of informed consent, outcomes, and risk in PCTs, while also considering the life-saving improvements in medical care that can result from inclusion of vulnerable populations in such research.33-37

Prisoners

The historical abuse of prisoners in research is well documented.38-41 Nevertheless, the literature offers rationale for the broader inclusion of prisoners in medical research. Reasons include a rapidly increasing number of prisoners in the United States,42,43 differences in the comparative effectiveness of medical treatments in prison settings, an aging prison population,44 and the need to augment health resources for prisoners.45

It is the potential of coercion that results from loss of options in captivity46 and the prevalence of mental illness47 that distinguishes prisoners as a uniquely vulnerable group. Prisoners are protected by a separate Subpart in the regulations (45 CFR 46 Subpart C).12 Research with prisoners must be minimal risk, study aspects of issues or conditions particularly affecting prisoners as a class, or study practices which have the intent and reasonable probability of improving the health or well-being of the subject.

Subpart C defines a prisoner as “an individual involuntarily confined or detained in a penal institution,” covering multiple situations, including those detained “pending arraignment, trial, or sentencing.”12 Furthermore, it seeks to protect persons incarcerated before and after enrollment. Yet, the vulnerability of these groups is different. Those for whom the opportunity to enroll occurs before incarceration may not face coercion risks; however, they may face different risks due to the feasibility of continuing study activities after confinement.

Similarly, identifiable records of persons who are incarcerated are defined as prisoners and thus subject to Subpart C. However, prisoner records research would not involve coercion if it meets the same regulatory criteria for waiver of consent as non-prison research. Yet the regulations do not protect those on parole and probation, although they may be vulnerable to the same coercive risks as incarcerated persons because they may face the same loss of options.

For the non-prison population, the design and nature of PCTs may render informed consent unnecessary except to decline participation due to minor but meaningful effects on patients’ interests.48 Regulations permit the requirement for informed consent to be weighed against “practicability.” Likewise, the additional protections afforded prisoners primarily through the consent process may not be “practicable” in settings where there is no choice because there is only one clinically relevant option.

The protections of Subpart C address the potential to induce or coerce consent to participate; therefore, if coercion in the consent process does not pertain, Subpart C may not be relevant. This is the case when consent was freely given prior to incarceration, or with medical records research if a waiver of consent was granted. Conversely, ethical considerations afforded prisoners should be extended to persons on parole or probation, as proposed by the Institute of Medicine.47 There is now a waiver for epidemiological research involving prisoners that studies incidence and potential risks of specific diseases.49 The desire to include prisoner data may be viewed as “an acknowledgment of overly restrictive requirements.”50

Children

Children are a vulnerable population addressed in the federal regulations (45 CFR 46 Subpart D; 21 CFR 50 Subpart D).12,13 As a group, “children” cover a wide range of ages, risk exposures, legal implications, and expectations for autonomy. From a regulatory perspective, research with children must fall into one of three risk categories: minimal risk, greater than minimal risk with a potential for direct benefit, or a minor increment over minimal risk with no benefit but likely to yield generalizable knowledge about the minor's disorder or condition. These categories dictate the types of protection required. Any research not in one of these categories must undergo additional regulatory review by the Department of Health and Human Services and is subject to public comment prior to approval. Research with non-vulnerable adults, in contrast, relies on only risk minimization and assessment of risk-to-benefit ratio. Many PCTs fall into the categories of minimal risk or greater than minimal risk with a potential for direct benefit, thereby aligning more closely with the required considerations of research with children, and reducing the need for special protections.

In an attempt to protect children from research risks, they are often excluded; however, this may leave researchers and clinicians with incomplete evidence, or evidence based on adult data, as to how to treat minors.51 That being said, even parents who are supportive of pediatric research are sometimes concerned that research may interfere with their child's care.52,53

The involvement of young children in research is dictated by parental permission, while older children are increasingly involved in participation decisions through an assent process. It is important that the level of child involvement in research decisions is varied in accordance with the child's level of development.54 In addition, the context and risk level of the research should be considered when involving children in research decisions, particularly in PCTs where the line between research and clinical care may be blurred. Because PCTs randomize minors to approved treatments, which they could receive outside of the research and inherently have some prospect of benefit, the risks of research are reduced to those associated with randomization versus clinician judgment rather than the overall risks of a novel intervention. Furthermore, CRTs that are conducted in hospitals or clinics may include children as indirect research participants. This means they are affected by the intervention through their exposure to the environment in which the intervention is being deployed.55 It is important for their data to be included in the research outcomes, yet the risk to the minor is not direct. Thus, if the principal investigator or the IRB is not aware that children are included in the study, the level of oversight for the CRT should be appropriate.

Persons with diminished capacity to consent

Capacity is a functional determination and is an important indicator of an individual's ability to exercise autonomous choice.56 Capacity is different than competence. Competence is a legal determination of a person's ability to understand and react. It is determined by a judge.57

Research that involves participants who may have diminished capacity to consent is not addressed by specific regulations as are other identified vulnerable groups. However, “balancing the obligation to respect the rights of those with mental impairments to be treated as autonomous members of the moral community, with the need to ensure that ill-informed or incompetent decisions will not place their welfare in jeopardy” is necessary.58

In studies directed at individuals, it is essential to assess the capacity to consent of all potential participants.59 In other words, a broad determination cannot be made based on diagnosis or membership in a particular population. The methods to determine capacity in PCTs should increase in rigor as the degree of risk to the participant increases.60 In studies that are minimal risk, as many PCTs are, asking the participant to restate their understanding of the risks and what they are being asked to do may suffice. In studies involving greater than minimal risk, a formal assessment tool or a third-party clinical assessment may be required to assure the subject has the capacity to consent. The need for additional safeguards does not depend on why adults are unable to consent, only that they are unable to consent.61

For PCTs involving standard clinical treatments (e.g., a comparison of two commonly used, FDA-approved medications used for labeled indications), one possible approach is to follow medical practice by identifying a surrogate decision-maker based on relationship to the participant. In the case of lower-risk studies, independent community/patient representatives could provide guidance on the design and oversight of a study. This approach may be ideal in CRTs, where a group, and not the individual, is the subject of study. State laws regarding who may serve as a proxy for those who lack capacity to consent will be necessary to consider.

Disadvantaged populations

In real-world healthcare settings, patients can be medically and socially complex. As a result, unique considerations emerge for PCTs. Beyond the vulnerable populations discussed above, PCTs often include other disadvantaged populations, such as patients with multiple medical and mental health comorbidities, those with critical and acute illnesses, the uninsured and underinsured, as well as those with unstable social situations and limited financial resources.

Since PCTs are regularly conducted during a patient's routine clinical care, the cost of participating, such as co-payments and deductibles, may be borne by the participant, either directly or through their insurance scheme. This can pose a participation barrier for the underinsured, uninsured, or those with limited financial resources. Patients with financial hardships may not wish to participate in studies that carry risks of randomization to a study arm with more numerous, costly, or burdensome hospital or clinic visits than another arm. Financial difficulty may also pose a challenge for patients to stay enrolled in a trial. For example, discontinuation of phone services has been described as a barrier to long-term follow-up in PCTs,62 and could create difficulties for the patient to contact the doctor if needed. These enrollment and retention challenges can bias trial results.

Investigators, study sponsors, and IRBs should strongly consider the potential benefits of including the underinsured or uninsured, economically and otherwise disadvantaged subjects in trials and engage stakeholders to seek potential solutions to participation barriers during study development. These populations should not be routinely screened out from trials since, as previously stated, it is important to include their data for generalizability of study results. Researchers should investigate approaches to help support the inclusion of all subjects.

Conclusion

It is necessary to follow regulations and ethical principles to conduct responsible and compliant clinical research. The regulations codify protections for several vulnerable populations. For traditional, greater than minimal risk research, this approach is logical. However, these same regulatory requirements may create barriers for vulnerable subjects to participate in PCTs, resulting in an evidence gap for populations of patients. Thus, it is also logical to evaluate different approaches that will allow ethical, compliant research, yet avoid potential barriers to the important knowledge that PCTs can provide.63

As stated by Carol Levine, research ethics was “born in scandal and reared in protectionism.”8 As a result, ethics and regulatory initiatives often aim more to protect vulnerable subjects from harm than to consider the importance of the inclusion of their data. This emphasis on preventing harm may make sense for traditional clinical trials, where the drugs, products, and interventions being studied are often new and unapproved by the FDA. PCTs generally study approved interventions already in clinical use. Therefore, the ethical focus may expand beyond only preventing harm to vulnerable populations to providing an understanding of how approved medical interventions work in their specific situations, settings, communities, and environments. In all cases, however, a risk/benefit evaluation is necessary.

All research, regardless of type, should begin by considering the risk posed by the study design before considering additional safeguards.64 Considerations of who the targeted study population will be, should also determine the need for additional safeguards. PCTs should be designed so that those in special populations are able to be included in the broad and representative study population. If a study is minimal risk, appropriate safeguards for potential vulnerable subjects should match that risk. Independent community/patient representatives, such as patient advisory boards to researchers or prisoner representatives on IRBs (45 CFR 46.304(a,b)), could help provide guidance during study development and throughout a study.12 It is also important to ensure the information learned from the PCTs is publicly disseminated to contribute to generalizable knowledge and honor the participation of vulnerable subjects.

Our recommendations regarding vulnerable subjects in PCTs are summarized in Table 2. Evidence is critically needed to inform decisions made in clinical practice.4,5 Although new treatments continue to be required, patients and the healthcare community also deserve answers to questions about the appropriateness of current therapies. Many more questions need to be answered from real-world situations using PCTs. The real world includes people who are in categories identified as vulnerable subjects. It is important that their information informs real-world results.

Table 2.

Recommendations for vulnerable populations in PCTs

• When designing a PCT, inclusion of participants who may be members of a vulnerable category should be considered, and how the ethical and regulatory requirements will be assessed and managed should be addressed in the study.
• There should not be a differential burden of research nor differential access to research for one group relative to any other. Therefore, being part of a vulnerable population should not be an exclusion criterion.
• In general, PCTs not targeting vulnerable subjects should not seek to identify vulnerable subjects within the study for the sole purpose to exclude them. This could stigmatize the vulnerable group and risk violating confidentiality and loss of research data for that group.
• PCTs where a vulnerable population is the focus of the study rather than a member of a larger group, should address the protections for that group. PCTs where vulnerable subjects are included as part of a larger population should be evaluated based on the level of risk and the characteristics being studied.
• Revisit the regulations to consider the characteristics of the participants and the incremental risk of the research design to determine the need for added protection for vulnerable populations.

PCT, pragmatic clinical trial.

Acknowledgements

We thank Peg Hill-Callahan for her helpful input.

Funding

This work is supported by the National Institutes of Health (NIH) Common Fund, through a cooperative agreement (U54 AT007748) from the Office of Strategic Coordination within the Office of the NIH Director. The views presented here are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health or the authors’ institutions.

Abbreviations

The following abbreviations are used in this manuscript:

CRT

cluster randomized trial

EHR

electronic health record

FDA

US Food and Drug Administration

IRB

institutional review board

OHRP

Office for Human Research Protections

PCT

pragmatic clinical trial

SUPPORT

Surfactant, Positive Pressure, and Oxygenation Randomized Trial

Footnotes

a

This paper will use the term subjects when referencing the research regulations, but will otherwise use the term participants when discussing individuals enrolled in research.

Declaration of conflicting interests

The authors declare that there is no conflict of interest.

References

  • 1.Levine RJ. Ethics and regulation of clinical research. 2nd ed. Yale University Press; New Haven, CT: 1988. [Google Scholar]
  • 2.Lederer SE. Subjected to science: human experimentation in America before the second World War. Johns Hopkins University Press; Baltimore, MD: 1997. [PubMed] [Google Scholar]
  • 3.Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003;290:1624–1632. doi: 10.1001/jama.290.12.1624. [DOI] [PubMed] [Google Scholar]
  • 4.Califf RM, Sugarman J. Exploring the ethical and regulatory issues in pragmatic clinical trials. Clin Trials. doi: 10.1177/1740774515598334. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Sugarman J, Califf RM. Ethics and regulatory complexities for pragmatic clinical trials. JAMA. 2014;311:2381–2382. doi: 10.1001/jama.2014.4164. [DOI] [PubMed] [Google Scholar]
  • 6.McKinney RE, Jr, Beskow LM, Ford DE, et al. Effective use of altered informed consent in pragmatic clinical research. Clin Trials. doi: 10.1177/1740774515597688. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kahn JP, Mastroianni AC, Sugarman J, editors. Beyond consent: seeking justice in research. Oxford University Press; New York, NY: 1998. [Google Scholar]
  • 8.Levine C. Has AIDS changed the ethics of human subjects research? Law Med Health Care. 1988;16:167–173. doi: 10.1111/j.1748-720x.1988.tb01942.x. [DOI] [PubMed] [Google Scholar]
  • 9.Mastroianni A, Kahn J. Swinging on the pendulum: shifting views of justice in human subjects research. Hastings Cent Rep. 2001;31:21–28. [PubMed] [Google Scholar]
  • 10.Brower V. Food and Drug Administration responds to pressure for expanded drug access. J Natl Cancer Inst. 2014;106:dju171. doi: 10.1093/jnci/dju171. [DOI] [PubMed] [Google Scholar]
  • 11.Caplan AL, Plunkett C, Levin B. Selecting the right tool for the job. Am J Bioeth. 2015;15:4–10. doi: 10.1080/15265161.2015.1010993. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.US Department of Health and Human Services Protection of human subjects. 2009 45 CFR Sect. 46. [Google Scholar]
  • 13.US Food and Drug Administration Protection of human subjects. 2014 21 CFR Sect. 50. [Google Scholar]
  • 14.National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research [12 December 2014];The Belmont Report: ethical principles and guidelines for the protection of human subjects of research. http://www.hhs.gov/ohrp/humansubjects/guidance/belmont.html (1979) [PubMed]
  • 15.DuBois JM. Vulnerability in research. In: Amdur RJ, Bankert EA, editors. Institutional review board: management and function. 2nd ed. Jones and Bartlett; Sudbury, MA: 2006. pp. 337–340. [Google Scholar]
  • 16.Levine C, Faden R, Grady C, et al. The limitations of “vulnerability” as a protection for human research participants. Am J Bioeth. 2004;4:44–49. doi: 10.1080/15265160490497083. [DOI] [PubMed] [Google Scholar]
  • 17.Kipnis K. Seven vulnerabilities in the pediatric research subject. Theor Med Bioeth. 2003;24:107–120. doi: 10.1023/a:1024646912928. [DOI] [PubMed] [Google Scholar]
  • 18.Shirkey H. Therapeutic orphans. J Pediatr. 1968;72:119–120. doi: 10.1016/s0022-3476(68)80414-7. [DOI] [PubMed] [Google Scholar]
  • 19.Andrade SE, Gurwitz JH, Davis RL, et al. Prescription drug use in pregnancy. Am J Obstet Gynecol. 2004;191:398–407. doi: 10.1016/j.ajog.2004.04.025. [DOI] [PubMed] [Google Scholar]
  • 20.Mitchell AA, Gilboa SM, Werler MM, et al. Medication use during pregnancy, with particular focus on prescription drugs: 1976-2008. Am J Obstet Gynecol. 2011;205:51.e1–51.e8. doi: 10.1016/j.ajog.2011.02.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Foulkes MA, Grady C, Spong CY, et al. Clinical research enrolling pregnant women: a workshop summary. J Womens Health (Larchmt) 2011;20:1429–1432. doi: 10.1089/jwh.2011.3118. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Institute of Medicine Committee on Clinical Research Involving Children . Ethical conduct of clinical research involving children. National Academies Press; Washington, DC: 2004. [PubMed] [Google Scholar]
  • 23.Munoz FM, Greisinger AJ, Wehmanen OA, et al. Safety of influenza vaccination during pregnancy. Am J Obstet Gynecol. 2005;192:1098–1106. doi: 10.1016/j.ajog.2004.12.019. [DOI] [PubMed] [Google Scholar]
  • 24.Kawai AT, Li L, Kulldorff M, et al. [16 February 2015];Mini-Sentinel CBER/PRISM surveillance protocol: influenza vaccines and pregnancy outcomes. http://www.mini-sentinel.org/work_products/PRISM/Mini-Sentinel_PRISM_Influenza-Vaccines-and-Pregnancy-Outcomes-Protocol.pdf (28 March 2014)
  • 25.Blehar MC, Spong C, Grady C, et al. Enrolling pregnant women: issues in clinical research. Womens Health Issues. 2013;23:e39–e45. doi: 10.1016/j.whi.2012.10.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Weijer C, Grimshaw JM, Taljaard M, et al. Ethical issues posed by cluster randomized trials in health research. Trials. 2011;12:100. doi: 10.1186/1745-6215-12-100. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Mann H, Reyes M. Identifying the human research subject in cluster randomized controlled trials. IRB. 2008;30:14–18. [PubMed] [Google Scholar]
  • 28.Secretary's Advisory Committee on Human Research Protections [20 January 2015];Recommendations on regulatory issues in cluster studies. http://www.hhs.gov/ohrp/sachrp/mtgings/mtg03-14/clusterstudiesrecommendations.html (2014)
  • 29.Weijer C, Grimshaw JM, Eccles MP, et al. The Ottawa Statement on the ethical design and conduct of cluster randomized trials. PLoS Med. 2012;9:e1001346. doi: 10.1371/journal.pmed.1001346. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Lantos JD. Learning the right lessons from the SUPPORT study controversy. Arch Dis Child Fetal Neonatal Ed. 2014;99:F4–F5. doi: 10.1136/archdischild-2013-304916. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Magnus D, Caplan AL. Risk, consent, and SUPPORT. N Engl J Med. 2013;368:1864–1865. doi: 10.1056/NEJMp1305086. [DOI] [PubMed] [Google Scholar]
  • 32.Office for Human Research Protections [23 January 2015];Determination letter to the University of Alabama at Birmingham: the Surfactant, Positive Pressure, and Oxygenation Randomized Trial (SUPPORT) http://www.hhs.gov/ohrp/detrm_letrs/YR13/jun13a.pdf (4 June 2013)
  • 33.Lantos JD, Feudtner C. SUPPORT and the ethics of study implementation: lessons for comparative effectiveness research from the trial of oxygen therapy for premature babies. Hastings Cent Rep. 2015;45:30–40. doi: 10.1002/hast.407. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Silverman HJ, Dreyfuss D. Were there “additional foreseeable risks” in the SUPPORT study? Lessons not learned from the ARDSnet clinical trials. Hastings Cent Rep. 2015;45:21–29. doi: 10.1002/hast.403. [DOI] [PubMed] [Google Scholar]
  • 35.Nelson RM. SUPPORT: risks, harms, and equipoise. Hastings Cent Rep. 2015;45:40–42. doi: 10.1002/hast.415. [DOI] [PubMed] [Google Scholar]
  • 36.Fleischman AR. The controversy over SUPPORT continues and the hyperbole increases. Hastings Cent Rep. 2015;45:42–44. doi: 10.1002/hast.416. [DOI] [PubMed] [Google Scholar]
  • 37.Shepherd L. SUPPORT and comparative effectiveness trials: what's at stake? Hastings Cent Rep. 2015;45:44–45. doi: 10.1002/hast.417. [DOI] [PubMed] [Google Scholar]
  • 38.Miller FG. The Stateville Penitentiary malaria experiments: a case study in retrospective ethical assessment. Perspect Biol Med. 2013;56:548–567. doi: 10.1353/pbm.2013.0035. [DOI] [PubMed] [Google Scholar]
  • 39.Hornblum AM. They were cheap and available: prisoners as research subjects in twentieth century America. BMJ. 1997;315:1437–1441. doi: 10.1136/bmj.315.7120.1437. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Pont J. Ethics in research involving prisoners. Int J Prison Health. 2008;4:184–197. doi: 10.1080/17449200802473107. [DOI] [PubMed] [Google Scholar]
  • 41.Semeniuk I, Reverby S. A shocking discovery. Nature. 2010;467:645. doi: 10.1038/467645a. [DOI] [PubMed] [Google Scholar]
  • 42.Glaze LE, Herberman EJ. Correctional populations in the United States, 2012. Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice; Washington, DC: 2013. [Google Scholar]
  • 43.Sánchez-Jankowski M. Islands in the street: gangs and American urban society. University of California Press; Los Angeles, CA: 1992. [Google Scholar]
  • 44. [21 January 2015];Human Rights Watch. Old behind bars: the aging prison population in the United States. http://www.hrw.org/sites/default/files/reports/usprisons0112webwcover_0_0.pdf (2012)
  • 45.Willmott D, van Olphen J. Challenging the health impacts of incarceration: the role for community health workers. Calif J Health Promot. 2005;3:38–48. [Google Scholar]
  • 46.Hawkins JS, Emanuel EJ. Clarifying confusions about coercion. Hastings Cent Rep. 2005;35:16–19. [PubMed] [Google Scholar]
  • 47.Intstitute of Medicine Committee on Ethical Considerations for Revisions to DHHS Regulations for Protection of Prisoners Involved in Research . Ethical considerations for research involving prisoners. National Academies Press; Washington, DC: 2007. [Google Scholar]
  • 48.Faden RR, Beauchamp TL, Kass NE. Informed consent, comparative effectiveness, and learning health care. N Engl J Med. 2014;370:766–768. doi: 10.1056/NEJMhle1313674. [DOI] [PubMed] [Google Scholar]
  • 49.US Department of Health and Human Services Waiver of the applicability of certain provisions of Department of Health and Human Services Regulations for Protection of Human Research Subjects for Department of Health and Human Services conducted or supported epidemiologic research involving prisoners as subjects. Fed Regist. 2003;68:36929–36931. [Google Scholar]
  • 50.Kratochvil CJ, Prentice ED, Gordon BG, et al. Regulatory issues of research involving prisoners. In: Amdur RJ, Bankert EA, editors. Institutional review board: management and function. Jones and Bartlett; Sudbury, MA: 2006. [Google Scholar]
  • 51.Caldwell PHY, Murphy SB, Butow PN, et al. Clinical trials in children. Lancet. 2004;364:803–811. doi: 10.1016/S0140-6736(04)16942-0. [DOI] [PubMed] [Google Scholar]
  • 52.Morris MC, Besner D, Vazquez H, et al. Parental opinions about clinical research. J Pediatr. 2007;151:532–537. doi: 10.1016/j.jpeds.2007.04.032. [DOI] [PubMed] [Google Scholar]
  • 53.Abernethy LE, Paulsen EL, Monuteaux MC, et al. Parental perceptions of clinical research in the pediatric emergency department. Pediatr Emerg Care. 2013;29:897–902. doi: 10.1097/PEC.0b013e31829e7f47. [DOI] [PubMed] [Google Scholar]
  • 54.Miller VA, Nelson RM. A developmental approach to child assent for nontherapeutic research. J Pediatr. 2006;149:S25–S30. doi: 10.1016/j.jpeds.2006.04.047. [DOI] [PubMed] [Google Scholar]
  • 55.Smalley JB, Merritt MW, Al-Khatib SM, et al. Ethical responsibilities toward indirect and collateral participants in pragmatic clinical trials. Clin Trials. doi: 10.1177/1740774515597698. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Janicak PG, Bonavich PR. The borderland of autonomy: medical-legal criteria for capacity to consent. J Psychiatry Law. 1980;8:361–387. doi: 10.1177/009318538000800403. [DOI] [PubMed] [Google Scholar]
  • 57.Black HC. Black's law dictionary. 2nd ed. West Publishing Co.; St. Paul, MN: 1910. [Google Scholar]
  • 58.Fisher CB. Goodness-of-fit ethic for informed consent to research involving adults with mental retardation and developmental disabilities. Ment Retard Dev Disabil Res Rev. 2003;9:27–31. doi: 10.1002/mrdd.10052. [DOI] [PubMed] [Google Scholar]
  • 59.Craven R. Protecting research participants with impaired decision-making capacity. Lancet Neurol. 2010;9:952–953. doi: 10.1016/S1474-4422(10)70232-5. [DOI] [PubMed] [Google Scholar]
  • 60.Association for the Accreditation of Human Research Protection Programs [23 January 2015];Tip sheet 26: reviewing research involving adult participants with diminished functional abilities related to capacity to consent. http://www.aahrpp.org/apply/resources/tip-sheets (2001-2012)
  • 61.Wendler D, Prasad K. Core safeguards for clinical research with adults who are unable to consent. Ann Intern Med. 2001;135:514–523. doi: 10.7326/0003-4819-135-7-200110020-00011. [DOI] [PubMed] [Google Scholar]
  • 62.Friedly JL, Bauer Z, Comstock BA, et al. Challenges conducting comparative effectiveness research: the Clinical and Health Outcomes Initiative in Comparative Effectiveness (CHOICE) experience. Comp Eff Res. 2014;4:1–12. [Google Scholar]
  • 63.Silva DS, Goering PN, Jacobson N, et al. Off the beaten path: conducting ethical pragmatic trials with marginalized populations. IRB. 2011;33:6–11. [PubMed] [Google Scholar]
  • 64.DuBois JM, Beskow L, Campbell J, et al. Restoring balance: a consensus statement on the protection of vulnerable research participants. Am J Public Health. 2012;102:2220–2225. doi: 10.2105/AJPH.2012.300757. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES