Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2016 Aug 1.
Published in final edited form as: Clin Transl Sci. 2015 Jan 10;8(4):362–366. doi: 10.1111/cts.12259

EngageUC: Developing an Efficient and Ethical Approach to Biobanking Research at the University of California

Sarah B Garrett 1, Barbara A Koenig 2, Arleen Brown 3, Jen R Hult 1,4, Elizabeth A Boyd 5, Sarah Dry 6, Daniel Dohan 1; in collaboration with UC BRAID
PMCID: PMC4499012  NIHMSID: NIHMS649154  PMID: 25581047

Abstract

Biorepositories, or biobanks, provide researchers with access to biological samples and associated data in support of translational research. Efficient operation and ethical stewardship of biobanks involves coordinated efforts among multiple stakeholders including researchers who manage and use the repository, institutional officials charged with its oversight, and patients and volunteers who contribute samples and data. As advancements in translational research increasingly involve more data derived from larger numbers of diverse samples, the size and governance challenges facing biorepositories have grown. We describe an approach to developing efficient and ethical biobank governance that includes all major stakeholders. This model provides a pathway for addressing the technical and ethical challenges that must be resolved to ensure biorepositories continue to support translational research.

INTRODUCTION

Biorepositories (or biobanks) contribute to medical discovery by providing researchers with ready access to large numbers of tissue and fluid samples and associated clinical data. In the last decade, academic centers, health systems, industry, and governments have promoted the growth and consolidation of biobanks, as researchers have sought larger numbers of samples from diverse populations. Growth and consolidation of biobanks is part of a broader trend emphasizing the use of “big data” to advance biomedical research and improve health.

Along with growth and consolidation has come a recognition of the technical and ethical challenges in managing and governing biobanks. From a technical perspective, biorepositories have developed in an uncoordinated fashion as researchers and institutions pursued local research opportunities and needs. Collection, storage, analysis, and distribution of samples varies across banks – variation that can create uneven quality and administrative inefficiency, both of which result in needless costs and delays for clinical and translational research.1 Developing common technical standards for collecting and sharing samples and data has the potential to advance biobanking.2

Biobank governance is also a challenge as practices often focus on statutory compliance rather than the ethical priorities of patients or research volunteers.3,4 Current regulations developed in an era when biobank research occurred at a smaller scale, and their application in the current research environment creates uncertainty in ethical arenas such as obtaining consent for unspecified future uses of samples, accessing remnant or legacy samples, linking sample-derived data with medical records, determining when and how to return individual results, and sharing samples and data across institutions and borders.511 Empirical bioethics can provide a foundation to address these issues by illuminating patients’ and volunteers’ understandings in these domains and exploring how priorities for personal and health privacy are shifting in the age of the internet and big data.

Several domestic and international consortia have convened researcher, institutional, and community stakeholders to discuss the techniques and ethics of larger-scale biobanking, e.g. in the Clinical and Translational Science Award Consortium, eMERGE projects, P3G, and ISBER.12 Here we contribute to these discussions by outlining the approach of EngageUC, which seeks to establish an approach to harmonize biobanking policies and practices across five University of California (UC) campuses. A UC biorepository could potentially include samples from the estimated 13 million ethnically diverse Californians who have clinical or research relationships with UC.

EngageUC builds on five existing NIH Clinical & Translational Science Award (CTSA) centers and the University of California Biomedical Research Acceleration, Integration & Development (UC BRAID) consortium, and leverages the system-wide policy-making capacity of the UC Office of the President (UCOP). The opportunity to leverage BRAID and UCOP make EngageUC unique, but we argue that EngageUC’s strategy to accelerate research advances previous work and is generalizable. This strategy builds on Kingdon’s theories of public policy change and has two central features. First, to address current challenges facing biobankers – and to anticipate future challenges – EngageUC seeks to develop new policy that is evidence-based. Second, to create a favorable atmosphere for change, EngageUC engages and convenes a wide range of stakeholders, including researchers who build, use, and maintain biobanks; administrators charged with regulation and oversight; and members of the public whose blood, tissue, medical records, and other data are stored and shared.

METHODS

EngageUC employs a multi-method design that integrates evidence about stakeholders’ perspectives and operational best-practices to create a harmonized and single platform for contemporary biorepository research.

Sites

The sites for EngageUC are the five UC medical center campuses (UC Davis, UC Irvine, UC Los Angeles, UC San Diego, and UC San Francisco). The five UC centers are geographically and administratively distinct and have many distinct practices and policies related to research and biorepositories. The campuses employ hundreds of researchers and possess clinical data from approximately 13 million current and recent patients. These patients are largely drawn from California’s population of 38 million, which is notable for its diversity with respect to race and ethnicity, nativity and geographical ancestry, socioeconomic status and educational attainment, languages spoken and health literacy, and rural and urban residence. EngageUC also includes the University of California Office of the President (UCOP), which provides central administration for the UC system, and the UC BRAID consortium. UC BRAID is a collaborative network of leaders, faculty, administrators, and UCOP partners focused on advancing clinical and translational research infrastructure to accelerate health improvement. Established in 2010, BRAID has developed UC-wide governance and infrastructure to support clinical and translational research, including IRB reliance, contracting support, and the UC Research eXchange (ReX) informatics infrastructure that provides researchers secure access to 11.8 million patient records across the UC health system. UC BRAID also includes a biobanking workgroup, which has been closely integrated with EngageUC. UCOP is funded by UCOP and the five medical center campuses and governed by an Executive Committee composed of the Principal Investigators of the five UC CTSA centers. Each PI has a senior university leadership position and is thus integrated into university administration. EngageUC has worked closely with the UC BRAID Executive Committee and the Biobanking and Regulatory (IRB) workgroups.

RESULTS

EngageUC has three distinct components: 1. engaging stakeholders to develop a common platform of biobank governance; 2. developing new evidence about best practices for consenting Californians who participate in biobanking as research subjects; and 3. translating and integrating guidance on governance and evidence about consenting into UC-wide policy. See Table 1 for an overview of the stakeholders, their roles vis-à-vis UC biobanking, and the ways in which they were engaged by this project.

Table 1.

Overview of EngageUC Stakeholders

Stakeholder Group Role in UC Biobanking Mode of Engagement
Ordinary Californians (Including UC patients and research volunteers) Current or potential donors; Potential beneficiaries of biobank research discoveries
  • *

    DCE event

  • *

    Consenting trial subjects

  • *

    Stakeholder workshop

Biobankers Manage biobanks; implement policies and procedures related to sample and data handling, oversight, and sharing
  • *

    BRAID working group

  • *

    Stakeholder workshop

Institutional officials (including IRB directors) Regulatory oversight of biobank policies and operations
  • *

    Focus groups & interviews

  • *

    Stakeholder workshop

UC Researchers
  • *

    Facilitate sample donation

  • *

    End-users of samples and data

  • *

    Consenting trial subjects

  • *

    Stakeholder workshop

UC Leaders (UCOP and individual UC campuses) Fund and oversee biobank operations
  • *

    BRAID executive committee

  • *

    Stakeholder workshop

Engaging Stakeholders: Public Deliberative Community Engagement

Ordinary Californians are the ultimate stakeholders in the public University of California system and its research and clinical activities. Therefore, EngageUC places a premium on understanding public perspectives on the role, practices, and governance of UC biobanks. Engaging the public in discussions and decisions about biobanking is crucial because the public’s interests and viewpoints may differ from those of the expert stakeholders in research institutions.13 However, directly soliciting public opinion, e.g. via surveys or focus groups, may produce sub-optimal results because few members of the public have the specialized knowledge necessary to provide meaningful input on complex questions surrounding biobank governance. Over the last two decades, techniques for deliberative democracy have been developed that address the challenge of eliciting meaningful engagement by ordinary members of the public on technical or specialized issues facing governments. EngageUC adopted Deliberative Community Engagement (DCE), which has been successful in previous projects focused on biobanking. In DCE, 20–30 individuals are purposefully selected to represent a particular population – in this case, the population of California. These representatives are then educated so that they can serve as informed deliberants to discuss, debate, develop, and potentially achieve consensus on specific recommendations about biobanking practice and governance. EngageUC convened two four-day face-to-face deliberations with two separate groups of representative deliberants: one in Southern California (Los Angeles, June, 2013) and one in Northern California (San Francisco, September/October, 2013).

Identifying and Educating Deliberants

To recruit a representative group of deliberants, EngageUC partnered with the California Health Interview Survey (CHIS), a UCLA-based research program that has surveyed large, systematic samples of Californians on a variety of health-related issues since 2001. EngageUC opted to recruit potential deliberants from CHIS’ existing database of Californians who had already completed a CHIS survey and had indicated a willingness to be contacted for future research. We sought 35 individuals for each site, assuming that 25 would ultimately attend each event. EngageUC investigators worked with CHIS to develop purposeful sampling frames with separate strata and recruitment targets based on sex, age, education, and race/ethnicity. Recruitment in Los Angeles included an additional focus on Native Americans and mono-lingual Spanish-speakers; the San Francisco event focused on recruiting Asian-Americans.14,15 Fifty-one deliberants were ultimately recruited. In Los Angeles, 8 of the 26 deliberants were monolingual Spanish speakers, and the LA DCE occurred with simultaneous English-Spanish translation. All 25 San Francisco deliberants were fluent in English.

To facilitate deliberant education, the EngageUC team developed a briefing book that was made available as text and voice recording (for low-literacy participants) in English and Spanish. The briefing book described how biorepositories operate, how they are governed (including sample and data ownership under California law, NIH and other federal regulation of genomic data, and the operations of IRBs), and presented differing perspectives on challenges facing biobanks (e.g. the need for larger numbers of samples to support contemporary research, issues surrounding genetic privacy and re-identification, dilemmas such as return of incidental findings, and case studies of ethical dilemmas including the Henrietta Lacks and Havasupai tribe cases). The briefing book was made available to deliberants three weeks before the first DCE meeting. During the first day of the in-person DCE, deliberants engaged experts in biobank research, operations, and governance – experts drawn from UC faculty and administration, health systems, and patient advocacy organizations. Experts presented prepared remarks and addressed deliberant questions. Experienced facilitators guided panel discussions during which deliberants explored issues of particular interest or concern. In Los Angeles, one presentation was conducted in Spanish with simultaneous translation to English.

Deliberation and Voting

During the next two days of the DCE at each site, a team of experienced facilitators met with the deliberants to discuss issues raised by the EngageUC team and by the deliberants themselves about biobanking practice and governance. The format for these deliberations involved: a brief large-group meeting where facilitators introduced a particular theme for deliberation, e.g. sharing samples and data; a small group meeting of 8–9 deliberants lasting 60–90 minutes to discuss the issue; and a large group session during which each small group shared and discussed their ideas and conclusions. For example, the opening session focused on hopes and concerns for biobanking in California. In small groups, deliberants jotted ideas on Post-It notes and then reviewed and discussed among themselves. At the end of each small group, deliberants summarized their discussion for presentation during the large group meeting that followed. In Los Angeles, one small group was conducted in Spanish, and all large group sessions were simultaneously translated in English and Spanish. To document the deliberation, all sessions were audio-recorded and EngageUC team members observed and took detailed ethnographic field notes during each session.

After each day of deliberation, the EngageUC and facilitation teams met to review the day’s discussion. The teams identified areas of consensus and debate and then framed these areas as recommendations to be voted upon, e.g. “UC biobanks should include oversight by a group of ordinary Californians.” To the extent possible, the language used by deliberants themselves was preserved. During the final day of the DCE, the lead facilitator reviewed these recommendations with the deliberants. Deliberants discussed and refined the language of each recommendation and then used an audience response system to anonymously vote on whether to endorse its final wording. Following each vote, a facilitator invited deliberants to discuss the reasoning behind their vote. All propositions, discussions, votes, and justifications for votes were recorded for later analysis and became an important product of the DCE.1618

Engaging Stakeholders: UC Biobankers

Even before the DCE took place, UC BRAID established infrastructure for identifying clinical and translation needs across the five UC medical center campuses. In 2012, the BRAID biobanking group brought together biorepository leaders at the five campuses to review policies and recommend best practices for biorepository research at UC, and to create a biorepository network across the five campuses. The biobank stakeholders included pathologists, research scientists, and biorepository staff members. EngageUC provided additional resources, foci, and inputs for this group, and has communicated continuously with BRAID throughout the course of the project

The products of the biobanking group engagement were documents describing standard operating practices (SOPs) and professional governance. The biobankers achieved consensus to adopt SOPs based on national (NIH and CAP) and international (ISBER) standards. A model for professional governance proved more challenging. The group was divided about whether to create a “path to excellence” for all biobanks or to focus only on those biorepositories at each campus which were interested in becoming “UC-recognized” biobanks. This discussion reflects the reality that each UC campus, like academic centers across the US, may have hundreds of biobanks. In the end, the group decided the “path to excellence” approach was preferable as it would create a formal approach to help all biobanks improve their operations and standards. The group agreed that there would need to be incentives for biobanks to participate; possible incentives included education about relevant standards, assistance with SOPs, help with CAP accreditation preparation, and institutional funding. Currently, the group is developing a research survey to understand what types of samples and associated data are most desired by UC researchers, so that a pilot test of a UC biorepository network can occur.

Engaging Stakeholders: UC Institutional Officials

The final stakeholder group are UC administrators (IRB directors, Institutional Officials, research Chancellors at each campus and officials at UCOP) who oversee donor consent and biorepository operations. The goal for institutional official engagement was to understand current practices and needs for oversight and to explore whether these officials might consider implementation of system-wide practices, for example a universal form for obtaining donor consent.

In Summer 2013, meetings with IRB directors and their affiliates were convened at each campus to directly engage those who are responsible for the oversight of research involving biospecimens and for establishing campus policies and procedures for biobanks and researchers. These group interviews focused on concerns over the continued uncoordinated activities of campus biobanks, the need for consistent and clear processes for both clinicians collecting samples as well as faculty who desire to conduct research with biospecimens, the need to develop consent documents that clearly communicate the research benefits and risks associated with biospecimen donation, and the challenge of implementing policy changes across the system. One example of these discussions: IRB directors endorsed their willingness to undertake development of UC-wide standard consent materials. Broader themes related to biobank governance will be addressed during the translational phase of EngageUC (see below).

Best Practices for Consent

UC patients and research volunteers asked to contribute samples are important stakeholders in biobanking, and obtaining their meaningful informed consent for donation should follow evidence-based best practices. EngageUC contributes to this evidence base by building on the results of the DCE to design a randomized trial of different procedures for obtaining informed consent for UC clinics and research biobanks. The EngageUC trial includes three arms: IRB-approved methods currently used in the UC system (arm 1), versus a simplified Community-Informed System wide Consent (CISC) the team developed based on DCE interest in a simpler consent process (arm 2), versus the combination of CISC with an educational video about biobanking, which responds to the DCE consensus that multi-media approaches for educating potential biobank contributors is preferred to relying on text alone (arm 3).

The EngageUC trial of informed consent practices partners with outpatient clinics and research sites that are already conducting specimen collection. Randomization is on a per-site basis to guard against contamination that would occur if site staff were asked to present different patients with different consent forms. The outcomes to be assessed include: 1. the proportion of patients/volunteers who consent to biobank participation; 2. Patient biobank knowledge and trust in biomedical researchers as measured by two short surveys; and 3. qualitative interviews about the consent process with patients/volunteers (about the informed consent experience and reasons for consenting or declining) and with clinic staff (about perceptions of effectiveness and feasibility of each arm). While other studies have investigated these questions using simulated consent scenarios,19,20 EngageUC seeks to provide actionable evidence about consent practices through the use of a randomized design in a naturalistic setting.2123

Translation into Practice

In BRAID and elsewhere, UC stakeholders have expressed support for a coordinated UC biobank effort. Preliminary results from the DCE suggest ordinary Californians also support UC biobanking and see value in developing UC’s capacity for biorepository research. The EngageUC translational effort seeks to transform these positive intentions into actual UC policy that reflects stakeholder interests and incorporates best practices for consent. To that end, EngageUC is sponsoring a workshop at which selected deliberants, UC biobankers, and campus and UCOP administrators will meet and develop a roadmap for creating UC biobanking policies across the five UC medical center campuses.

We anticipate key challenges in translating stakeholder perspectives and consent best-practices into UC-wide use include the following: How should system-wide biobank governance be coordinated with campus-based governance? Should UC strive for policy harmonization or should it encourage campus-specific innovation? What are the next steps for engaging the public in the development of a biobank governance framework? The roadmap meeting will provide a forum for stakeholders to discuss their interests and concerns with one another with the goal of finding agreement where possible and identifying conflicts that cannot be resolved.

DISCUSSION

EngageUC adds to a growing literature about best practices for biorepositories to support contemporary biomedical research. Translational research increasingly requires large numbers of high-quality specimens linked to clinical data. Specimens collected, prepared, analyzed, and linked to clinical records using high-quality procedures and transparent governance advance science by ensuring researchers can reliably interpret findings derived from large study populations. When researchers are uncertain of procedures used to produce data, they cannot reliably interpret their own analyses. When data are poorly governed, researchers cannot confidently create the large datasets they need. EngageUC outlines an approach to address the ethical and policy challenges in creating biorepositories that are high quality and well governed.

As more and larger national and regional biobanks have been established,2426 research on these institutions and their practices has followed. Several scholars have conducted studies that feature individual aspects of the research we present here. These include deliberative community engagement activities;16,18 the evaluation of different consent materials for potential bio-bank donors;22,23,27 and deliberations among geneticists, biobank leaders and other experts regarding practices and policies of large-scale biobanking.28

Additionally, scholars have made dedicated attempts to create a dialog between decision-makers and the public. For example, in a 2009 Vancouver, Canada, DCE, O’Doherty et al (2012) collaborated with senior bio-library cancer registry personnel from the provincial biobank to create a workbook that would guide lay deliberants to structure their discussions and recommendations so as to be "both politically legitimate and practically relevant."18,29 The Mayo Clinic “formalized and extended” early deliberation-based interactions between the public and decision-makers by later recruiting participants to serve on advisory boards for its biobank and the affiliated Rochester Epidemiology Project.30,31 Other efforts to bring biobanking decision-makers together with the public and other stakeholders are found domestically and abroad as well.32,33

While other projects have sought to improve operations of a single institution, EngageUC aims to improve biobanking system-wide—something that requires new policy. Kingdon and Thurber (1984) argue that creating policy is a tri-fold challenge: first, a problem must be identified; second, a solution must be developed; and third political will must be mustered to implement change.34 Policy change occurs only when the three “streams” of problem, policy, and politics converge.

For UC biobanks, governance is a central element of the problem stream. Academic silos make it difficult for researchers to generate large datasets, and weak institutional governance makes it difficult to break down silos. Governance must be not only be institutionally potent but also be trustworthy in the eyes of the patients and public who contribute samples and data.

The UC BRAID biobanking initiative developed one element of the policy stream: standard operating procedures (SOP) that all UC biobanks can follow. EngageUC’s empirical work seeks to create additional elements of the policy stream, including evidence about how to establish governance structures that ordinary Californians find trustworthy as well as a rigorous examination of which procedures produce true informed consent from patients and research volunteers.

Engagement is key for the political stream. EngageUC repeatedly engages all biobanking stakeholders. Repeated engagement provides opportunities to remind academic stakeholders from campus and central administration that ordinary Californians expect research advancements from UC. Public interest and scrutiny can help provide the political will to overcome disciplinary silos and institutional inertia.

CONCLUSION

Biobanks play a central role in medical research, and the scientific community has an opportunity and obligation to create operational and governance frameworks that ensure biobanks facilitate research rather than encumber it. No two biobanks are exactly alike. We do not argue that the specific activities employed by EngageUC will be helpful or appropriate in all circumstances. But our strategic approach – which emphasizes evidence-based solutions and iterative stakeholder engagement, including of the general public – may offer a blueprint for developing efficient biobank operations and trustworthy governance.

Acknowledgment

We gratefully acknowledge the support, advice, and input from members of the UC BRAID Executive Committee (Lars Berglund, Steven Dubinett, Gary Firestein, Deborah Grady, and Daniel Mercola) as well as S. Claiborne Johnston, Rachael Sak, Giuseppe Cavaleri, Holly Longstaff, and Michael Burgess.

Engaging University of California Stakeholders for Biorespository Research is funded by NIH UL1 TR000004-07S2 (National Center for Advancing Translational Sciences).

References

  • 1.Petersen LA, Simpson K, Sorelle R, Urech T, Chitwood SS. How variability in the institutional review board review process affects minimal-risk multisite health services research. Ann. Intern. Med. 2012;156(10):728–735. doi: 10.7326/0003-4819-156-10-201205150-00011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Jewell SD, Hansel DE. Developing and Organizing an Institutional Biospecimen Repository. Northfield, IL: 2014. [Google Scholar]
  • 3.Cassileth BR, Zupkis RV, Sutton-Smith K, March V. Informed consent - Why are its goals imperfectly realized? N. Engl. J. Med. 1980;302(16):896–900. doi: 10.1056/NEJM198004173021605. [DOI] [PubMed] [Google Scholar]
  • 4.Annas GJ. Reforming Informed Consent to Genetic Research. JAMA. 2001;286(18):2326. doi: 10.1001/jama.286.18.2326. [DOI] [PubMed] [Google Scholar]
  • 5.Clayton EW, Smith M, Fullerton SM, et al. Confronting real time ethical, legal, and social issues in the Electronic Medical Records and Genomics (eMERGE) Consortium. Genet. Med. 2010;12(10):616–620. doi: 10.1097/GIM.0b013e3181efdbd0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.McGuire AL, Beskow LM. Informed consent in genomics and genetic research. Annu. Rev. Genomics Hum. Genet. 2010;11:361–381. doi: 10.1146/annurev-genom-082509-141711. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Cambon-Thomsen A, Rial-Sebbag E, Knoppers BM. Trends in ethical and legal frameworks for the use of human biobanks. Eur. Respir. J. 2007;30(2):373–382. doi: 10.1183/09031936.00165006. [DOI] [PubMed] [Google Scholar]
  • 8.Malin B, Loukides G, Benitez K, Clayton EW. Identifiability in biobanks: models, measures, and mitigation strategies. Hum. Genet. 2011;130(3):383–392. doi: 10.1007/s00439-011-1042-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Wolf SM, Crock BN, Van Ness B, et al. Managing incidental findings and research results in genomic research involving biobanks and archived data sets. Genet. Med. 2012;14(4):361–384. doi: 10.1038/gim.2012.23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Wolf SM, Lawrenz FP, Nelson CA, et al. Managing incidental findings in human subjects research: analysis and recommendations. J. Law. Med. Ethics. 2008;36(2):219–248. 211. doi: 10.1111/j.1748-720X.2008.00266.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Elger BS, Caplan AL. Consent and anonymization in research involving biobanks: differing terms and norms present serious barriers to an international framework. EMBO Rep. 2006;7(7):661–666. doi: 10.1038/sj.embor.7400740. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Harris JR, Burton P, Knoppers BM, et al. Toward a roadmap in global biobanking for health. Eur. J. Hum. Genet. 2012;20(11):1105–1111. doi: 10.1038/ejhg.2012.96. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Caulfield T, Upshur R, Daar A. DNA databanks and consent: A suggested policy option involving an authorization model. BMC Med. Ethics. 2003;4(1):1. doi: 10.1186/1472-6939-4-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.California Health Interview Survey. CHIS 2009 Methodology Series: Report 1 - Sample Design. Los Angeles, CA: 2011. Available at: http://healthpolicy.ucla.edu/Documents/NewsroomPDF/CHIS2009_method1.pdf. [Google Scholar]
  • 15.California Health Interview Survey. CHIS 2009 Methodology Series: Report 2 – Data Collection Methods. Los Angeles, CA: 2011. Available at: http://healthpolicy.ucla.edu/Documents/NewsroomPDF/CHIS2009_method2.pdf. [Google Scholar]
  • 16.Burgess M, Young M. Biobanking in British Columbia: discussions of the future of personalized medicine through deliberative public engagement. 2008;5:285–296. doi: 10.2217/17410541.5.3.285. [DOI] [PubMed] [Google Scholar]
  • 17.O’Doherty KC, Burgess M, Secko DM. Sequencing the salmon genome: A deliberative public engagement. 2010;6(1):16–33. [Google Scholar]
  • 18.O’Doherty KC, Hawkins AK, Burgess MM. Involving citizens in the ethics of biobank research: informing institutional policy through structured public deliberation. Soc. Sci. Med. 2012;75(9):1604–1611. doi: 10.1016/j.socscimed.2012.06.026. [DOI] [PubMed] [Google Scholar]
  • 19.Bickmore TW, Pfeifer LM, Paasche-Orlow MK. Using computer agents to explain medical documents to patients with low health literacy. Patient Educ. Couns. 2009;75(3):315–320. doi: 10.1016/j.pec.2009.02.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Flory J, Emanuel E. Interventions to improve research participants’ understanding in informed consent for research: a systematic review. JAMA. 2004;292(13):1593–1601. doi: 10.1001/jama.292.13.1593. [DOI] [PubMed] [Google Scholar]
  • 21.Ridgeway JL, Han LC, Olson JE, et al. Potential bias in the bank: what distinguishes refusers, nonresponders and participants in a clinic-based biobank? Public Health Genomics. 2013;16(3):118–126. doi: 10.1159/000349924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Han LC, Ridgeway JL, Ziegenfuss JY, et al. Annual Meeting of the American Society of Bioethics and Humanities. Washington, DC: 2012. Is more always better? The impact of simplified informed consent on response rates and comprehension in a clinic-based biobank. [Google Scholar]
  • 23.Oliver JM, Slashinski MJ, Wang T, Kelly PA, Hilsenbeck SG, McGuire AL. Balancing the risks and benefits of genomic data sharing: genome research participants’ perspectives. Public Health Genomics. 2012;15(2):106–114. doi: 10.1159/000334718. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Austin MA, Harding S, McElroy C. Genebanks: A Comparison of Eight Proposed International Genetic Databases. Public Health Genomics. 2003;6(1):37–45. doi: 10.1159/000069544. [DOI] [PubMed] [Google Scholar]
  • 25.Swede H, Stone CL, Norwood AR. National population-based biobanks for genetic research. Genet. Med. 2007;9(3):141–149. doi: 10.1097/gim.0b013e3180330039. [DOI] [PubMed] [Google Scholar]
  • 26.Secko DM, Preto N, Niemeyer S, Burgess MM. Informed consent in biobank research: a deliberative approach to the debate. Soc. Sci. Med. 2009;68(4):781–789. doi: 10.1016/j.socscimed.2008.11.020. [DOI] [PubMed] [Google Scholar]
  • 27.Beskow LM, Dean E. Informed consent for biorepositories: assessing prospective participants’ understanding and opinions. Cancer Epidemiol. Biomarkers Prev. 2008;17(6):1440–1451. doi: 10.1158/1055-9965.EPI-08-0086. [DOI] [PubMed] [Google Scholar]
  • 28.Fullerton SM, Wolf WA, Brothers KB, et al. Return of individual research results from genome-wide association studies: experience of the Electronic Medical Records and Genomics (eMERGE) Network. Genet. Med. 2012;14(4):424–431. doi: 10.1038/gim.2012.15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.O’Doherty K, Hawkins AK. Structuring public engagement for effective input in policy development on human tissue banking. Public Health Genomics. 2010;13:197–206. doi: 10.1159/000279621. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Olson JE, Ryu E, Johnson KJ, et al. The Mayo Clinic Biobank: a building block for individualized medicine. Mayo Clin. Proc. 2013;88(9):952–962. doi: 10.1016/j.mayocp.2013.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Burgess MM. From “trust us” to participatory governance: Deliberative publics and science policy. Public Underst. Sci. 2014;23(1):48–52. doi: 10.1177/0963662512472160. [DOI] [PubMed] [Google Scholar]
  • 32.McCarty CA, Chapman-Stone D, Derfus T, Giampietro PF, Fost N. Community consultation and communication for a population-based DNA biobank: the Marshfield clinic personalized medicine research project. Am. J. Med. Genet. A. 2008;146A(23):3026–3033. doi: 10.1002/ajmg.a.32559. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Molster C, Maxwell S, Youngs L, et al. An Australian approach to the policy translation of deliberated citizen perspectives on biobanking. Public Health Genomics. 2012;15(2):82–91. doi: 10.1159/000334104. [DOI] [PubMed] [Google Scholar]
  • 34.Kingdon JW, Thurber JA. Agendas, Alternatives, and Public Policies. Boston: Little, Brown; 1984. [Google Scholar]

RESOURCES