ABSTRACT
There is a growing realization that graduate education in the biomedical sciences is successful at teaching students how to conduct research but falls short in preparing them for a diverse job market, communicating with the public, and remaining versatile scientists throughout their careers. Major problems with graduate level education today include overspecialization in a narrow area of science without a proper grounding in essential critical thinking skills. Shortcomings in education may also contribute to some of the problems of the biomedical sciences, such as poor reproducibility, shoddy literature, and the rise in retracted publications. The challenge is to modify graduate programs such that they continue to generate individuals capable of conducting deep research while at the same time producing more broadly trained scientists without lengthening the time to a degree. Here we describe our first experiences at Johns Hopkins and propose a manifesto for reforming graduate science education.
KEYWORDS: Ph.D., education, graduate
Imagination is more important than knowledge.
—Albert Einstein
THE CURRENT SYSTEM IS IN NEED OF REFORM
In recent years, there have been numerous calls to reform graduate biomedical science education, particularly at the doctoral level (1–17). Currently, many institutions favor densely packed curricula with fast-paced instruction focused on detailed subject matter and a high test frequency in an attempt to shorten the time to a degree. Despite the risk of cognitive overload and low information retention rates, little room is left for skill training in critical thinking, creative problem solving, and putting what was learned into a larger context that creates meaning. Many current biomedical and health science programs are effective at educating individuals capable of carrying out deep scientific investigations in highly specialized areas; however, they often lack the breadth of expertise and skills necessary to allow their graduates to move to other fields of science or participate in the science-relevant areas needed by society at large. In essence, our biomedical education system tends to produce graduates best suited for postdoctoral training, which tends to further specialize them (3, 9, 18). Although numbers might be slowly declining (19, 20), many students in science, engineering, and health still report commitment to pursuing an academic research career (21). Yet only a subset are likely to be employed in academic occupations in the long term (3–5, 19–23), with the numbers of positions for tenure track faculty being on a decline over more than 2 decades (22, 24). In response to those trends, policymakers and some members of the research community have argued for a reduction in the number of students entering graduate schools (2, 3). However, we agree with those opinions in the field that emphasize the need for a stable scientific workforce because of a high demand for engaged science practitioners in many areas of society (19, 20, 23, 25–29). Besides academia, there are job options in such fields as industry, advocacy, government, education, communication, social work, and community service, etc. (10, 11, 14–17, 19–29). This complex ecosystem requires individual adaptability and “outside-the-box” thinking, as well as better career counseling and research training options on the pre- and postdoctoral levels (1, 3–12, 15–31).
Currently, scientific training is largely dependent on a local mentorship culture, which takes place for the most part in the form of apprenticeships during practical thesis work. The burden in this system falls largely on the individual thesis adviser to teach the skills of good research practice (1, 12). Unfortunately, given the variability in thesis projects and institutional environments and variability in the ability of mentors to teach the relevant material, the training experiences of individual students can differ significantly (32). Hence, there is no guarantee that this guild-like education system delivers the required instructional quality to all trainees (1).
Recently, several institutions and agencies, among others, the American Academy of Microbiology and the National Academies of Sciences, Engineering and Medicine (10, 11, 14–17), have reevaluated current problems of the biomedical sciences and made recommendations on how to better prepare graduate students, as well as their mentors, for the complex workforce requirements inside and outside academia. Suggestions for essential core competencies complemented other calls and initiatives for reform (1, 3–17, 28, 33–40). These included the need to enrich current graduate education with preprofessional competency training in skills required by academic and nonacademic sectors. Based thereupon, in this and earlier essays, we and others argue that graduate students in the biomedical disciplines need to be trained formally (as opposed to solely through individual mentoring by their thesis advisors) in interdisciplinary, critically philosophical thinking skills. We claim that the goal of true science education reform efforts should be to train and mentor a new leadership of practitioners, whose members are
broadly interested, creative, and self-directed (9), as were some scientists in the era of Louis Pasteur, Marie Curie, Albert Einstein, and Linus Pauling (41–43);
versed in epistemology, sound research conduct and error analysis, according to the “3R” norms of good scientific practice—rigor, responsibility, and reproducibility (12);
skilled in reasoning using mathematical, statistical, and programming methods and able to tackle logical fallacies (10–12, 14–16);
committed to high ethical standards, mentorship, and teamwork (7, 11–16);
effective leaders, teachers, and communicators on the expert level, as well as with the public (33, 35);
able to think innovatively and across disciplinary boundaries (18, 43–45); and
aware of the diversity of societal tasks that need to be mastered by science practitioners today (19, 23).
Training modules on rigor and reproducibility, as well as other educational resources on scientific survival skills have been produced and are publicly available (46–49). However, the mere provision of materials is only a first step and, by itself, unlikely to be effective. Rather, they need to be implemented into specifically designed learning experiences, and their effectiveness needs to be evaluated by outcome-oriented educational research. Without validated guidelines on how to utilize available resources in the classroom, the quality of teaching practices can vary widely. This might arguably contribute to the widespread reproducibility issues that exist (32). Following recent funding initiatives by the National Institutes of Health (50–52), the National Science Foundation (53, 54), and the Burroughs Wellcome Fund (55), several educational institutions have engaged in efforts to modify and supplement existing graduate science programs (26, 36, 50). First evaluation reports from these efforts are being published (56).
A “NEW” PHILOSOPHY BASED ON CLASSIC TENETS
Can there be “one” comprehensive educational concept to solve all of the issues mentioned above? Probably not. Graduate school orientations, missions, values, and organizational structures are too diverse to be homogenized into one standardized instruction model, similar to the “core curricula” or “distributional requirements” of many undergraduate institutions. In fact, such standardization may not be desirable on the graduate level since heterogeneity in educational approaches can lead to experimentation and innovation. One might even argue that one of the current problems in graduate education is a lack of diversity from program to program.
More than two centuries after the scientific revolution, we have learned much about what constitutes good science, but these insights are frequently not formally integrated into the regular curricula used to train scientists. Today’s doctoral education in the biomedical sciences is largely homogenized around a set of required courses, rotations in potential training laboratories, and laboratory work with relatively little room for educational experimentation. In going forward, one immediate step could be to define and test frameworks in some institutional settings that can inform and provide incentives for interested educators in other organizations. A repeating theme brought up among undergraduate and graduate science educators across all disciplines is the need for more critically reflective practice (57, 58). Since a critically rationalist approach, a term coined by Karl Popper (59), is at the heart of doing science, we agree with the suggestion that science education should be geared toward a stronger emphasis on philosophical elements, thereby putting the “Ph. back into Ph.D.” education (1, 9, 12, 60–63). Teaching graduate students how to critically “think and do science” could help to bridge the gap between the fundamentals taught in undergraduate institutions and the requirements of competency-based thesis work on the graduate level.
However, in our view, it is not sufficient to merely prescribe critically philosophic elements for inclusion in graduate curricula to reform the educational framework in science. Instead, what is needed is a combination of rationalism with critically reflective practice (64, 65); genuine meaning making in a relevant, active learning context (66–69); and passionate engagement (70) to create powerful learning experiences. To develop a mindset of reflective practice, students should have frequent opportunities to exercise the various facets of critical thinking, comprising challenging assumptions, evaluation and reasoning, creative problem solving, and communication (71, 72). To apply these skills in relevant contexts, previous reform efforts in higher education have emphasized how important it is to “teach science like we do science” (73, 74; see also http://www.biophysics.org/Publications/Newsletter/PastIssues/December2011/56thAnnualMeeting/tabid/3731/Default.aspx); besides becoming accustomed to rigorous research methodology, students need to develop an unvarnished, realistic view of the frequently erroneous decision-making processes and daily research practices in the biomedical sciences (73, 74). It is thereby critical to create an awareness of the epistemic limits of science (75, 76) and address error sources such as logical fallacies or sloppiness in experimental design (12, 13, 77, 78), just as much as cases of misconduct (79). On the other hand, there must be sufficient room for learning from the fun side of scientific blunders, serendipitous discoveries (45, 80), and success stories. To facilitate authentic experiences (69), learners could use self-chosen projects of their interest or aspects of their thesis work to apply central scientific concepts such as deductive and inductive reasoning. Moreover, students may be given opportunities to practice mindfulness, self-awareness, and communication skills in real-world situations such as community outreach settings (81, 82).
It is the sense of meaningfulness emerging from intrinsically motivated, active learning processes that provokes deep thoughts, sparks curiosity, and elicits the desire for self-directed exploration (83); and it is a learner’s passion that may lead to truthful and sustained commitment, potentially transformational experiences, and fulfilling lifelong careers (70, 84, 85).
A PILOT PROGRAM AT THE JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH
In the spirit of this philosophy of graduate science education, we describe here our early experiences implementing a novel Ph.D. track at the Johns Hopkins Bloomberg School of Public Health to help students experience how to broadly and critically “think science.” On the basis of an earlier essay (9), we called this approach the “R3 program,” referring to the norms of good scientific practice, the three R’s: rigor, responsibility, and reproducibility, that form the core of our educational efforts (http://www.jhsph.edu/departments/w-harry-feinstone-department-of-molecular-microbiology-and-immunology/academics-and-degree-programs/R3-PhD-program/index.html). A central goal is to preserve what works well in the current system, namely, in-depth laboratory training through hands-on mentored laboratory rotations and thesis work while reducing the density of highly specialized courses in the curriculum. Thus, we markedly decreased students’ overall course loads and partially filled the freed-up curricular room with protected time for critically creative reflection, collaborative problem solving, and dedicated time for practicums in settings outside academia (Tables 1 and 2). First-year courses emphasize practical aspects of epistemology, logic, reasoning, error analysis; and rigor and redundancy in experimental design; as well as ethics, integrity, and social responsibility. Fundamentals in probability, statistics, programming, and computational data analysis are taught with regard to the actual needs in students’ prospective lab environments (Table 1).
TABLE 1 .
Term 1a | Terms 2 and 3 | Term 4 |
---|---|---|
How do we know? Theory and Practice of Scienceb | Critical Dissection of the Scientific Literature | Electives - Options |
Introduction to critical thinking in science (epistemology, logic, the 3R’s) | Primary literature journal club Interdisciplinary discussion series including case studies and “error detective games” |
Rotation-oriented, subject matter courses to support thesis preparation Extradepartmental electives |
Anatomy of Scientific Errorc | Practical Ethics in Science & Society I & II |
Part-time Practicums - Options Community outreach Science policy & advocacy Entrepreneurship Ethics in practice Science writing Teaching & mentoring Team skills Communicating with the media and the public |
Errors versus misconduct in scientific practice | Questions of integrity and morality at theinterfaces of ethics and epistemology | |
Research Design Practice-oriented, experimental methods and redundancy in research design Overview of laboratory research Scientific Reasoning I Introductory logic in data science; induction & deduction; correlation & causality Laboratory-rotation oriented vignettes and problem sets |
Training in Science Communication Presenting effectively Writing for publication and funding Leadership through persuasive speaking Non-verbal communication Scientific Reasoning II & III Mathematical and statistical foundations and applications; programming basics Research-oriented, real-world cases and problem sets |
At the Johns Hopkins Bloomberg School of Public Health, a term is 8 weeks long. All four terms include laboratory rotations.
How do we know? Theory & Practice of Science; course information, https://courseplus.jhu.edu/core/index.cfm/go/about.schedule/coid/9185/.
Anatomy of Scientific Error; course information, https://courseplus.jhu.edu/core/index.cfm/go/about.schedule/coid/9489/.
TABLE 2 .
Training | Content, purpose | Termsa offered |
---|---|---|
Thesis-oriented subject matter electives | Individual selection of learning options (regular coursework, preapproved, open online offerings, technical practice training, self-study) to strengthen students’ subject matter basis in their chosen field of thesis research | 1–4 |
Innovation series | Seminars and distinguished lectures on “thinking science outside the box” | 1–4, monthly |
Communication | Continuous practice in communication skills for conversations with the public, media, and professional audiences; publications and grants; presentations; advocacy | 1–4, biweekly |
Team and leadership skills | Experiential competency development in emotional intelligence, cultural sensitivity and mindfulness, group dynamics, team citizenship and leadership, goal setting, conflict resolution, peer leadership | Periodical, 1–3-day workshops, flexible terms |
Teaching and mentoring | Practice experience in teaching and mentoring, teaching assistance and instructional competency education, structured mentoring of younger students, assistance with thesis and career development | Flexible terms |
Science history | Story-telling seminar series for faculty, fellows, students, and staff; narrative skills, community formation | 1–4, monthly |
Part-time practicums | Additional practicum and workshop experiences, offering opportunities to collect preprofessional insights into areas such as industry, education, and community outreach, administration, policy and advocacy, communication, writing, and publishing, etc. | Flexible terms |
Mentored career planning and professional development plan | Peer-, alumnus-, and practitioner-mentored discussion communities; regular expert panels on career advising; compilation of individual development plan synchronized with thesis committee checkpoints | Continuous, 3 checkpoints/yr |
At the Johns Hopkins Bloomberg School of Public Health, a term is 8 weeks long.
Many students (as well as practitioners) might feel unsure about how topics that do not appear to be immediately relevant to concrete subject matter, and procedural training could help them advance in their graduate careers or thesis research. The traditional overemphasis on teaching details and technical procedures at the expense of more generalized scientific competence may have the unintended consequence of creating the notion that memorized facts and technical skills are needed to successfully compete in the job market. However, given today’s ubiquitous internet access through computers and smart mobile devices, most individuals have almost immediate access to much of humanity’s accumulated knowledge. In a situation where knowledge is easily available, it may be more important to learn how to process this information than to commit details to memory. Consequently, the goal of the R3 program is to teach critically creative thinking, logical reasoning, and strategic decision making that would enhance students’ ability to valuably utilize the information that is readily available and assess its reliability. The current focus on overspecialization may contribute to insufficient communication skills, suffocation of exploratory curiosity and innovative potential, and the prevalent lack of appreciation of the actual “Ph.” in Ph.D. training (1, 9).
To build trust among students, educators, and mentors, a new curriculum like the R3 program needs to handle a balancing act; it needs to provide sufficient subject matter education such that students and their thesis advisers feel confident that the preparation received is sufficiently deep to enable students to successfully complete a thesis without lengthening training. At the same time, the curriculum must provide enough protected time to allow students to broadly and creatively explore their interests, engage in interdisciplinary dialogue, and explore alternative pathways outside academic research (5, 31, 36). To that end, we designed the first year of our R3 track (Table 1) by focusing on practically relevant, competency-building courses, while concurrent journal clubs and laboratory rotation schedules provide opportunities for continuous application. This curricular format allows students to explore and deepen their interests while providing real-world research examples. In addition, students make informed decisions about their fields of thesis research and connect with their future advisers and mentors early in the curriculum. Toward the end of the first academic year, the program provides room for a set of preselected subject matter electives. In agreement with the future thesis adviser, these electives convey introductory background knowledge and facilitate the transition into a student’s chosen field of thesis research. Moreover, protected time is built into the last weeks of the first academic year and the following summer break for students to explore fields of professional science practice outside academia, such as practicums in teaching, mentoring and leadership; science communication; business and entrepreneurship; science policy and advocacy; community outreach, or applied ethics.
Second-year training (Table 2) is less structured and puts a greater emphasis on professional competency training and enabling students to apply the skills learned in the first academic year to their thesis work. A wide array of discipline-specific learning options, e.g., in the form of self-study modules or preapproved open online courses, provide individualized, targeted opportunities to strengthen students’ subject matter basis in their chosen fields of thesis research. In communities of continuous practice, students intensify teaching, mentoring, and leadership competencies. Cross-disciplinary seminar series provide opportunities to communicate students’ work in preprofessional settings or at venues open to the public. Interdepartmental think tanks allow students to develop and debate innovative ideas for collaborations outside the narrow box of their thesis research field. In agreement with the thesis adviser, advanced graduate students may have additional opportunities for part-time career exploration inside or outside academic settings. Close collaboration between program directorship and participating faculty and the support of individual thesis advisers are of particular importance here (31).
At this early implementation stage, any experiences are naturally anecdotal and subject to change upon revision and improvement of the program. During our first pilot administration, enrollment comprised between 20 and 30 students per course, with participants from a variety of biomedical and health science disciplines. In every course, skill mastery is assessed through several lenses, such as discussion contributions, reflections, problem solving, project presentations, and peer feedback. To document individual student progression through the program and achievement of R3 core competencies, we selected a set of key course assessments, among others,
a project describing revolutionary discoveries or important innovations in science, thereby evaluating their broader significance and historical or contemporary context;
case study problems derived from real-world data that allow students to search for scientific errors and practice reasoning;
thesis-related experimental design projects that imply demonstration of rigorous research methodology and justification of the design chosen;
an argumentative debate of ethical dilemmas, including peer evaluation of the points made; and
a project that requires oral and written communication of students’ thesis aspects to peers from other disciplines and the general public.
Every student will assemble a reflection-evidence-type portfolio (86) of their key assignments, composed over the duration of the program. Together with formal examinations due to accreditation requirements, a list of scholarly accomplishments, as well as evaluative observations by the thesis adviser, this system will provide a holistic picture of individual R3 students’ progression over time.
A MANIFESTO FOR REFORMING GRADUATE BIOMEDICAL SCIENCE EDUCATION
Critical thinking in science needs to be accessibly conveyed to be thought provoking and motivating (75, 87, 88). Particularly advanced learners on the graduate and postgraduate levels need a clear practice orientation (83), which is not a trivial goal to achieve with an interdisciplinary audience. To meet as many of our learners’ needs as possible, we propose the implementation of a set of guidelines to help reform graduate biomedical science education. We acknowledge up front that the proposed manifesto is a compilation of previously established principles and theoretical frameworks for good educational practice. Although well known and adopted in other disciplines, they have not been widely implemented in graduate biomedical scientific training thus far, underlining the need for faculty support and mentoring (31).
(i) Active learning strategies.
The flipped classroom model involves the use of short, recorded, conceptual presentations that students can follow at their own pace and time (89). This format reserves the majority of the contact time with instructors and peers for a range of active learning strategies, such as critical reflection, discussions, problem solving, and collaborative group work (66, 69, 87, 88, 90–94). Diversification of instructional and assessment methods allows accommodation of a wide range of learner needs and preferences (95) and may positively influence learning processes (96).
(ii) Facilitating emotional and cognitive connections.
Being able to relate to the material taught is important for students (83). Supplementing the often technical primary and textbook literature on scientific topics through broadly applicable and accessibly written background resources can help open doors to subjects that otherwise might be difficult to connect to. For instance, editorials or op-eds, news and views columns of general science journals, podcasts, or TED Talk videos can help students relate theoretical science concepts to their life reality or current events (97). Moreover, the combination of role modeling (98) and storytelling (99–101) can be a powerful tool, e.g., by sharing personal experiences from one’s own scientific practice when discussing reproducibility or by portraying the life and work of prominent contemporary or historic figures such as Antoine and Marie de Lavoisier when introducing the concept of a scientific revolution. Alternatively, students may be asked to write short stories about serendipitous events or developments in science, such as Fleming’s discovery of penicillin.
(iii) Thought-provoking questions and interdisciplinary dialogue.
Students are hungry for thinking intensely, critically, and broadly about how science works, what can be done to enhance reproducibility, and where ethical limits of scientific practice should be (102). This can be facilitated through group discussions that cover controversial issues in science or pertinent topics of public debate (65, 82, 87, 103). For instance, by asking open-ended questions in connection with peer critique, student teams could, e.g.,
-
∘
select among alternative experimental setups to collect evidence for the effect of a drug and judge the quality of the expected evidence,
-
∘
develop ideas for demonstrating redundancy in experimental design and justify their chosen strategies before their evaluating peers, and
-
∘
formulate and explain their train of thought about seemingly simple yet complex questions such as the following. What is science? Is there always a clear demarcation line between science and pseudoscience? What can we validly conclude from data sets? How do we cope with contradictions between what science makes possible and its moral limits?
Depending on respondents’ specialties, answers may be skewed toward the quantitative perspective for life scientists or a stronger inclusion of mixed-method aspects in the social or environmental sciences. Such perceived dichotomies are means to elicit engaged debates where student teams are asked to advocate for opposing viewpoints (82). Sparking interest and dialogue among participants from various science backgrounds and levels of experience, such conversations can stimulate cross-disciplinary fertilization (18, 104, 105) and thwart tendencies to think in narrow terms (67, 68, 72, 88, 91).
(iv) Application and exploration through meaningful project work.
To help students synthesize and integrate their experiences from reflections and discussions and provide incentives for creative, self-directed, and in-depth exploration, graduate science programs should include frequent project work. In agreement with the instructor, students may be allowed to choose topics of their preference (e.g., “tell us about a paradigm shift in science that fascinates you and incorporate the concepts we covered over the duration of the course”). Providing incentives to apply the concepts learned to students’ own interests respects their diversity of talents (69), adds relevance (67, 70, 106), and motivates them to strive for their full potential (70, 84). This holds particularly true in experiential environments (66, 101) that allow students to discover their passions for their professional future. Besides academic research in laboratory rotations, this may be facilitated, e.g., during practicum experiences in the areas of communication, advocacy, community work, teaching, entrepreneurship, or science policy (19, 23, 29, 31, 36) (Tables 1 and 2).
(v) Continuous communities of practice.
Critical thinking and scientific survival skills such as analysis, reasoning, evaluation, communication, and teamwork function like muscles: They need to be constantly exercised and nourished to stay in shape. Science education programs should therefore promote continuous, deliberate practice activities (107, 108) for students, as well as experienced practitioners, to foster sustained skill development. Periodically offered journal clubs, in combination with problem-solving exercises in a case study format (82), could be organized as competitive detective games, including prizes (82, 109). Focusing on error analysis and communication, interdisciplinary teams could be tasked with finding flaws in experimental design, logic, and statistical methods of a selected set of publications and engage in a scientific discourse for the best argumentation. Aiming to enhance participants’ motivation and willingness to think beyond the rim of their own field research, such collaborative formats might help to build confidence and generate a sense of collegiality and mutual appreciation for other fields of science (68, 94, 98, 110).
TOWARD LONG-TERM OUTCOMES
Given concerns that graduate biomedical education is already taking too long (2, 10, 111), a potential criticism of the approach suggested here is that additional didactic instruction would increase the overall course load, reduce the time for research, and lengthen the time to a degree. In fact, the increasing time to independence for scientists was identified as a critical problem in the current biomedical research enterprise (2, 3, 30, 111). To avoid lengthening the time to a degree, we suggest that a significant portion of the currently mandatory, specialized courses that populate graduate curricula in the biomedical sciences be replaced with critical-thinking courses (Tables 1 and 2). Specialized knowledge necessary to productively pursue thesis work can be obtained through thesis-oriented electives or by self-study during the research-centered years of Ph.D. training (Table 2). Certainly, students who are highly interested in the specialized areas of their chosen research can be expected to largely self-master those fields with limited specific classroom instruction. Furthermore, we hope and posit that enhanced mastery of critical thinking tools and good research practices will lead students to make better choices for thesis research projects and carry out research more efficiently (112), which in turn could reduce training time (10, 11). In fact, our experience is that much of the time spent on Ph.D. research is used as students try to find projects and make them work. Better training in critical thinking could allow students to make better choices earlier, which could reduce the time to graduation (11). Hence, our proposal to reform graduate science education should, in our view, not lengthen training time and could, in fact, shorten it through enhanced efficiencies.
In the future, carefully validated, comprehensive observations and performance evaluations might provide further insights into potential strength and weaknesses of our approach; for instance, will the R3 program’s strong emphasis on critically creative reflection be able to attract an increasing number of learners from currently underrepresented groups into the biomedical disciplines (113, 114)? How will students with differing learning preferences perform? Will R3 graduates score above average in the quality of their scholarly products?
Broader impacts on the scientific enterprise level might only become visible after years of historical outcome data collection. Potentially, a more widespread adoption of the R3 approach to graduate science education across many disciplines might eventually contribute to an amelioration of some of the most prominent problems in the sciences, such as poor reproducibility, shoddy literature, and the rise in retracted publications (115–121). Although the causes of these problems are doubtlessly complex and causality is very difficult to establish, it is reasonable to assume that a better and more broadly trained scientific workforce could produce better science. This, in turn, could also help humanity confront some of the major challenges it is facing, including climate change, the failing green revolution, the threat of pandemics, and the need for new energy sources (122).
THE R3 APPROACH TO “TEACHING AND THINKING SCIENCE”—A BRIDGE BUILDER AND CATALYST?
Watching students’ engaged discussions, which seemed unimpeded by disciplinary boundaries, we often observed the cross-fertilization, curiosity, and passion for science that educators long to see in their learners. These are the moments when being a science teacher is particularly rewarding. Some of the most impressive dialogues we witnessed between students took place in a class session on practical ethics: We talked about the moral dilemmas that can arise, e.g., in the field of genetic engineering, if scientists just focus on pushing the epistemic boundaries of what is “possible” but do not take adequate ethical considerations into account. It was gratifying to observe how eager the students were to think broadly and open their minds to horizons that went way beyond learning the next detail of, e.g., a pathogen’s life cycle, a biochemical pathway, or other minutiae that tend to dominate graduate biomedical science education. One of the students concluded a reflective essay with a quote from Henry Augustus Rowland, the first president of the American Physical Society: “Science may not be able to provide a complete code of ethics, but it does teach that every action carries a consequence—to be felt either by ourselves or by others, in our own time or the generations to come” (123). That is, our students remind us of the three R’s of good scientific practice: scientists’ responsibility to keep the potential outcomes and consequences of their work in mind and to make every effort possible that their experimental practice follows requirements for scientific rigor in order to enable reproducibility of their work (12, 124).
Reflecting on the many rich, engaged, and deep interactions we have had in our R3 courses thus far, it comes to mind how often we circled back to the ideas behind Albert Einstein’s famous quote at the beginning of this article. It gets right to the heart of what graduate science education should foster, i.e., scientists’ never-ending curiosity, the desire to think outside the box and to search for new insights. However, Einstein also reminds us that the privilege to engage in research comes with a strong ethical commitment to practice science rigorously (125). All practitioners across the disciplines must take Einstein’s admonition “not [to] conceal any part of what one has recognized to be the truth” as a constant appeal to do the best we can to ensure that our research and that of our students follows the norms of the three R’s.
Our responsibilities as educating practitioners do not end there. We need to think in bigger dimensions if we are to make a real difference in the current system. Initiatives such as the R3 track may help provide other educators with ideas on how to enhance critical-thinking strategies and to nurture passionate engagement in students at all stages of science education, not only the graduate level. Aspiring, broadly educated young scientists might act as open-minded catalysts and take the R3 way of thinking science with them after graduation. Committed science educators could collaborate across institutional boundaries and engage in high-quality educational research to agree on valid performance indicators and measure long-term learning outcomes to test the effectiveness of novel approaches to science education such as the R3 program. Equally important is, in our view, that the communities of science practitioners, educators, and philosophers reengage in regular dialogues and collaborate more actively to discuss joint efforts to fundamentally reform our science education system. These may include interdisciplinary, long-term communities of practice to exchange experiences in teaching science with philosophy elements in a practice-orientated, interest-sparking, and curiosity-sustaining manner. Finally, bridge-building colloquia should be held regularly to overcome the deepening communication divide that has grown between science and philosophy to revitalize the notion that science without philosophy is incomplete.
I have no special talents. I am only passionately curious.
—Albert Einstein
ACKNOWLEDGMENTS
We thank James Yager and Anne Belcher for critically reading the manuscript and for many helpful suggestions. G.B. acknowledges the Master of Education in the Health Professions program, particularly Toni Ungaretti and Bonnie Robeson, at the Johns Hopkins School of Education for generous advice and feedback in the early stages of the R3 program’s development.
Footnotes
Citation Bosch G, Casadevall A. 2017. Graduate biomedical science education needs a new philosophy. mBio 8:e01539-17. https://doi.org/10.1128/mBio.01539-17.
REFERENCES
- 1.Casadevall A, Fang FC. 2012. Reforming science: methodological and cultural reforms. Infect Immun 80:891–896. doi: 10.1128/IAI.06183-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Bourne HR. 2013. A fair deal for PhD students and postdocs. eLife 2:e01139 https://doi.org/10.7554/eLife.01139. doi: 10.7554/eLife.01139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Alberts B, Kirschner MW, Tilghman S, Varmus H. 2014. Rescuing US biomedical research from its systemic flaws. Proc Natl Acad Sci U S A 111:5773–5777. doi: 10.1073/pnas.1404402111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Leshner AI. 2015. Rethinking graduate education. Science 349:349. doi: 10.1126/science.aac9592. [DOI] [PubMed] [Google Scholar]
- 5.McDowell GS, Gunsalus KTW, MacKellar DC, Mazzilli SA, Pai VP, Goodwin PR, Walsh EM, Robinson-Mosher A, Bowman TA, Kraemer J, Erb ML, Schoenfeld E, Shokri L, Jackson JD, Islam A, Mattozzi MX, Krukenberg KA, Polka JK. 2014. Shaping the future of research: a perspective from junior scientists. F1000Res 3:291 https://doi.org/10.12688/f1000research.5878.2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kimble J, Bement WM, Chang Q, Cox BL, Drinkwater NR, Gourse RL, Hoskins AA, Huttenlocher A, Kreeger PK, Lambert PF, Mailick MR, Miyamoto S, Moss RL, O’Connor-Giles KM, Roopra A, Saha K, Seidel HS. 2015. Strategies from UW-Madison for rescuing biomedical research in the US. eLife 4:e09305 https://doi.org/10.7554/eLife.09305. doi: 10.7554/eLife.09305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Singh S, Gammie A, Lorsch JR. 2016. Catalyzing the modernization of graduate education. Microbe 11:96–97. doi: 10.1128/microbe.11.96.1. [DOI] [Google Scholar]
- 8.Gould J. 2015. How to build a better PhD. Nature 528:22–25. doi: 10.1038/528022a. [DOI] [PubMed] [Google Scholar]
- 9.Casadevall A. 2015. Put the “Ph” back in PhD. Johns Hopkins Bloomberg School of Public Health, Baltimore, MD: http://magazine.jhsph.edu/2015/summer/forum/rethinking-put-the-ph-back-in-phd/index.html. [Google Scholar]
- 10.American Academy of Microbiology 2016. Promoting responsible scientific research. American Academy of Microbiology, Washington, DC: https://www.asm.org/images/Colloquia-report/Promoting_Responsible_Scientific_Research.pdf. [PubMed] [Google Scholar]
- 11.Casadevall A, Ellis LM, Davies EW, McFall-Ngai M, Fang FC. 2016. A framework for improving the quality of research in the biological sciences. mBio 7:e01256-16. doi: 10.1128/mBio.01256-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Casadevall A, Fang FC. 2016. Rigorous science: a how-to guide. mBio 7:e01902-16. doi: 10.1128/mBio.01902-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Flier JS. 2017. Irreproducibility of published bioscience research: diagnosis, pathogenesis and therapy. Mol Metab 6:2–9. doi: 10.1016/j.molmet.2016.11.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.National Academies of Sciences, Engineering and Medicine (NASEM) 2017. Fostering integrity in research. National Academies Press, Washington, DC. [PubMed] [Google Scholar]
- 15.National Academies of Sciences, Engineering and Medicine 2017. National Academies of Sciences, Engineering and Medicine Committee on Revitalizing Graduate STEM Education for the 21st Century discussion document. National Academies Press, Washington, DC: http://sites.nationalacademies.org/pga/bhew/graded/pga_180817. [Google Scholar]
- 16.National Science Foundation 2016. Strategic framework for investments in graduate education. National Science Foundation, Arlington, VA: https://www.nsf.gov/pubs/2016/nsf16074/nsf16074.pdf. [Google Scholar]
- 17.National Institutes of Health 2012. Biomedical Research Workforce Working Group report. National Institutes of Health, Bethesda, MD: https://acd.od.nih.gov/documents/reports/Biomedical_research_wgreport.pdf. [Google Scholar]
- 18.Casadevall A, Fang FC. 2014. Specialized science. Infect Immun 82:1355–1360. doi: 10.1128/IAI.01530-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Sauermann H, Roach M. 2012. Science PhD career preferences: levels, changes, and advisor encouragement. PLoS One 7:e36307. doi: 10.1371/journal.pone.0036307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Roach M, Sauermann H. 2017. The declining interest in an academic career. PLoS One 12:9. doi: 10.1371/journal.pone.0184130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Woolston C. 2017. Graduate survey: a love-hurt relationship. Nature 550:549–552. doi: 10.1038/nj7677-549a. [DOI] [Google Scholar]
- 22.National Science Foundation, National Center for Science and Engineering Statistics 2016. Doctorate recipients from U.S. universities: 2015. Special report NSF 17-306. National Science Foundation, Arlington, VA: http://www.nsf.gov/statistics/2017/nsf17306/. [Google Scholar]
- 23.Anonymous. 2017. Many junior scientists need to take a hard look at their job prospects. Nature 550:429. doi: 10.1038/550429a. [DOI] [PubMed] [Google Scholar]
- 24.National Science Foundation 2013. Doctorates in all SEH fields in the workforce. National Science Foundation, Arlington, VA: https://nsf.gov/nsb/sei/infographic2/#data. [Google Scholar]
- 25.Turk-Bicakci L, Berger A, Haxton C, American Institutes for Research . 2014. The nonacademic careers of STEM Ph.D. holders. American Institutes for Research, Washington, DC: http://www.air.org/sites/default/files/downloads/report/STEM%20nonacademic%20careers%20April14.pdf. [Google Scholar]
- 26.Offord C. 1 January 2017. Addressing biomedical science’s PhD problem. The Scientist. http://www.the-scientist.com/?articles.view/articleNo/47732/title/Addressing-Biomedical-Science-s-PhD-Problem.
- 27.Marder E. 2014. Living science: looking out for future scientists. eLife 3:e04901. doi: 10.7554/eLife.04901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Nicholson BJ, Eckert LR. 2014. A response to the NIH Biomedical Research Workforce Working Group report. American Society for Biochemistry and Molecular Biology, Rockville, MD: http://www.asbmb.org/asbmbtoday/201409/Education/. [Google Scholar]
- 29.Kuo M. 2016. Postdocs leaving the lab. American Association for the Advancement of Science, Washington, DC: http://www.sciencemag.org/careers/2016/11/postdocs-leaving-lab. [Google Scholar]
- 30.Pickett CL, Corb BW, Matthews CR, Sundquist WI, Berg JM. 2015. Toward a sustainable biomedical research enterprise: finding consensus and implementing recommendations. Proc Natl Acad Sci U S A 112:10832–10836. doi: 10.1073/pnas.1509901112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Callier V. 1 May 2016. Making the most of school. The Scientist. http://www.the-scientist.com/?articles.view/articleNo/45880/title/Making-the-Most-of-School/.
- 32.Blow N. 2017. From the editor. Biotechniques 62:89 http://www.biotechniques.com/BiotechniquesJournal/2017/March/From-the-Editor/biotechniques-365683.html. [Google Scholar]
- 33.Brownell SE, Price JV, Steinman L. 2013. Science communication to the general public: why we need to teach undergraduate and graduate students this skill as part of their formal scientific training. J Undergrad Neurosci Educ 12:E6–E10. [PMC free article] [PubMed] [Google Scholar]
- 34.American Society for Cell Biology 2014. How can scientists enhance rigor in conducting basic research and reporting research results? American Society for Cell Biology, Bethesda, MD: http://www.ascb.org/wp-content/uploads/2015/11/How-can-scientist-enhance-rigor.pdf. [Google Scholar]
- 35.Feliú-Mójer M. 2015. Effective communication, better science. Scientific American. https://blogs.scientificamerican.com/guest-blog/effective-communication-better-science/.
- 36.Meyers FJ, Mathur A, Fuhrmann CN, O’Brien TC, Wefes I, Labosky PA, Duncan DS, August A, Feig A, Gould KL, Friedlander MJ, Schaffer CB, Van Wart A, Chalkley R. 2016. Origin and implementation of the broadening experiences in scientific training programs. FASEB J 30:507–514. doi: 10.1096/fj.15-276139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Yamamoto K, Bassler BL, Cech T, Charo RA, Fishman M, Horvitz HR, Hyman S, Landis S, Marrack P, Tilghman S, Varmus HE, Zerhouni E. 2016. A vision and pathway for the NIH. National Institutes of Health, Bethesda, MD: http://www.nihvp.org/wp-content/uploads/2016/11/vision-and-pathway-for-the-nih.pdf. [Google Scholar]
- 38.Munafò MR, Nosek BA, Bishop DVM, Button KS, Chambers CD, Percie du Sert N, Simonsohn U, Wagenmakers EJ, Ware JJ, Ioannidis JPA. 2017. A manifesto for reproducible science. Nat Hum Behav 1:0021. doi: 10.1038/s41562-016-0021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Chronicle of Higher Education 2017. How wide is the divide? Chronicle of Higher Education, Washington, DC: http://images.results.chronicle.com/Web/TheChronicleofHigherEducation/%7B2db11846-d155-40a2-a894-2cbbedc8afd3%7D_2016_CollegeToCareer_Infographic_v6.pdf. [Google Scholar]
- 40.Brookes R, Wong B, Ho S. 2017. Why scientists should have leadership skills. Scientific American. https://blogs.scientificamerican.com/observations/why-scientists-should-have-leadership-skills/.
- 41.Quinn S. 1995. Marie Curie: a life. Simon & Schuster, New York, NY. [Google Scholar]
- 42.Frank P, Isaka S. 1989. Einstein: his life and times. Da Capo Press, New York, NY. [Google Scholar]
- 43.Harman O, Dietrich MR. 2013. Outsider scientists: routes to innovation in biology. University of Chicago Press, Chicago, IL. [Google Scholar]
- 44.Melero E, Palomeras N. 2012. The renaissance of the ‘renaissance man’?: specialists vs. generalists in teams of inventors. Business economics series, working paper 12-01. Universidad Carlos III de Madrid, Madrid, Spain. [Google Scholar]
- 45.Casadevall A, Fang FC. 2016. Revolutionary science. mBio 7:e00158. doi: 10.1128/mBio.00158-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.National Institutes of Health 2017. Rigor and reproducibility—training. National Institutes of Health, Bethesda, MD: https://www.nih.gov/research-training/rigor-reproducibility/training. [Google Scholar]
- 47.Springer Nature Collection 2017. Scientific rigour and reproducibility. Springer, New York, NY: https://www.nature.com/collections/byblhcfwhw?WT.mc_id=FBK_NA_517_ReproducibilityWebCollection. [Google Scholar]
- 48.American Association for the Advancement of Science 2017. Career development. American Association for the Advancement of Science, Washington, DC: https://www.aaas.org/programs/career-development. [Google Scholar]
- 49.NIH 2017. BEST: broadening experiences in scientific training. 2014—present. For students and postdocs—make a plan. National Institutes of Health, Bethesda, MD: http://www.nihbest.org/for-students-postdocs/make-a-plan/. [Google Scholar]
- 50.National Institutes of Health 2017. 2014—present. BEST: broadening experiences in scientific training. National Institutes of Health, Bethesda, MD: http://www.nihbest.org. [Google Scholar]
- 51.National Institutes of Health, General Medical Sciences 2014. Innovative programs to enhance research training (IPERT). Funding opportunity announcement PA-17-070. National Institutes of Health, Bethesda, MD: https://www.nigms.nih.gov/Research/mechanisms/Pages/IPERT.aspx. [Google Scholar]
- 52.National Institutes of Health, General Medical Sciences 2015. Administrative supplements to NIGMS predoctoral training grants. Funding opportunity announcement PA-15-136. National Institutes of Health, Bethesda, MD. [Google Scholar]
- 53.National Science Foundation 2017. National Science Foundation research traineeship (NRT) program. National Science Foundation, Washington, DC: https://www.nsf.gov/funding/pgm_summ.jsp?pims_id=505015. [Google Scholar]
- 54.National Science Foundation 2017. Innovations in Graduate Education (IGE) program. National Science Foundation, Washington, DC: https://www.nsf.gov/funding/pgm_summ.jsp?pims_id=505473. [Google Scholar]
- 55.Burroughs Wellcome Fund 2017. Grant programs: career guidance for trainees. Burroughs Wellcome Fund, Research Triangle Park, NC: https://www.bwfund.org/grant-programs/career-guidance/career-guidance-trainees. [Google Scholar]
- 56.St Clair R, Hutto T, MacBeth C, Newstetter W, McCarty NA, Melkers J. 2017. The “new normal”: adapting doctoral trainee career preparation for broad career paths in science. PLoS One 12:e0177035. doi: 10.1371/journal.pone.0177035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Siegel H. 1989. The rationality of science, critical thinking, and science education. Synthese 80:9–41. doi: 10.1007/BF00869946. [DOI] [Google Scholar]
- 58.Holmes NG, Wieman CE, Bonn DA. 2015. Teaching critical thinking. Proc Natl Acad Sci U S A 112:11199–11204. doi: 10.1073/pnas.1505329112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Popper KR. 1959. The logic of scientific discovery. Hutchinson, London, United Kingdom. [Google Scholar]
- 60.Grayson DJ. 2006. Rethinking the content of physics courses. Phys Today 59:31–36. doi: 10.1063/1.2186279. [DOI] [Google Scholar]
- 61.Prather CM, Choate DM, Michel MJ, Crowl TA. 2009. Putting the “Ph” back into “PhD”: framing graduate research in a theoretical context. Front Ecol Environ 7:389–390. doi: 10.1890/1540-9295-7.7.389. [DOI] [Google Scholar]
- 62.Blachowicz J. 2009. How science textbooks treat scientific method: a philosopher’s perspective. Br J Philos Sci 60:303–344. doi: 10.1093/bjps/axp011. [DOI] [Google Scholar]
- 63.Grüne-Yanoff T. 2014. Teaching philosophy of science to scientists: why, what and how. Eur J Philos Sci 4:115–134. doi: 10.1007/s13194-013-0078-x. [DOI] [Google Scholar]
- 64.Brookfield SD. 2000. The concept of critically reflective practice, p 33–50. In Wilson AL, Hayes ER (ed), Handbook of adult and continuing education. Jossey-Bass, San Francisco, CA. [Google Scholar]
- 65.Kahlke R, White J. 2013. Critical thinking in health sciences education: considering “three waves.” Creat Educ 4:21–29. doi: 10.4236/ce.2013.412A1004. [DOI] [Google Scholar]
- 66.Dewey J. 1963. Experience and education. Collier, New York, NY. [Google Scholar]
- 67.Piaget J. 1972. Intellectual evolution from adolescence to adulthood. Hum Dev 15:1–12. doi: 10.1159/000271225. [DOI] [Google Scholar]
- 68.Vygotsky L. 1978. Mind in society. The development of higher psychological processes. Harvard University Press, Cambridge, MA. [Google Scholar]
- 69.Chickering AW, Gamson ZF. 1987. Seven principles for good practice in undergraduate education. AAHE Bull March:3–7. http://www.lonestar.edu/multimedia/SevenPrinciples.pdf. [Google Scholar]
- 70.Rogers C, Freiberg A. 1994. Freedom to learn, 3rd ed Pearson, Upper Saddle; River, NJ. [Google Scholar]
- 71.Stein B, Haynes A, Redding M, Ennis T, Cecil M. 2007. Assessing critical thinking in STEM and beyond, p 79–82. In Iskander M. (ed), Innovations in e-learning, instruction technology, assessment and engineering education. Springer, New York, NY. [Google Scholar]
- 72.Paul R, Elder L. 2014. Miniature guide to critical thinking concepts and tools, 7th ed Foundation for Critical Thinking, Tomales, CA. [Google Scholar]
- 73.Medawar P. 1963. Is the scientific paper a fraud? Listener 70:377–378. [Google Scholar]
- 74.Howitt SM, Wilson AN. 2014. Revisiting “Is the Scientific Paper a Fraud?”: the way textbooks and scientific research articles are being used to teach undergraduate students could convey a misleading image of scientific research EMBO Rep 15:481–484. doi: 10.1002/embr.201338302. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Holmes J. 24 August 2015. The case for teaching ignorance. New York Times, New York, NY: https://www.nytimes.com/2015/08/24/opinion/the-case-for-teaching-ignorance.html. [Google Scholar]
- 76.Firestein S. 2012. Ignorance: how it drives science. Oxford University Press, New York, NY. [Google Scholar]
- 77.Ioannidis JP. 2005. Why most published research findings are false. PLoS Med 2:e124. doi: 10.1371/journal.pmed.0020124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Casadevall A, Steen RG, Fang FC. 2014. Sources of error in the retracted scientific literature. FASEB J 28:3847–3855. doi: 10.1096/fj.14-256735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Fang FC, Steen RG, Casadevall A. 2012. Misconduct accounts for the majority of retracted scientific publications. Proc Natl Acad Sci U S A 109:17028–17033. doi: 10.1073/pnas.1212247109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Casadevall A, Fang FC. 2015. (A)Historical science. Infect Immun 83:4460–4464. doi: 10.1128/IAI.00921-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Astin AW, Vogelgesang LJ, Ikeda EK, Yee JA. 2000. How service learning affects students. Higher Education Research Institute, Los Angeles, CA. [Google Scholar]
- 82.Nilson LB. 2016. Teaching at its best: a research-based resource for college instructors. Wiley, New York, NY. [Google Scholar]
- 83.Knowles MS. and associates. 1984. Andragogy in action: applying modern principles of adult learning. Jossey-Bass, San Francisco, CA. [Google Scholar]
- 84.Maslow AH. 1970. Motivation and personality, 2nd ed HarperCollins, New York, NY. [Google Scholar]
- 85.Mezirow J. 1991. Transformative dimensions of adult learning. Jossey-Bass, San Francisco, CA. [Google Scholar]
- 86.Plaza CM, Draugalis JR, Slack MK, Skrepnek GH, Sauer KA. 2007. Use of reflective portfolios in health sciences education. Am J Pharm Educ 71:34. doi: 10.5688/aj710234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Brookfield SD. 2012. Teaching for critical thinking. Tools and techniques to help students question their assumptions. John Wiley & Sons/Jossey-Bass, San Francisco, CA. [Google Scholar]
- 88.Nosich GM. 2012. Learning to think things through: A guide to critical thinking across the curriculum, 4th ed Prentice Hall, Upper Saddle River, NJ. [Google Scholar]
- 89.Bishop JL, Verleger MA. 2013. The flipped classroom: a survey of the research, 120th ASEE National Conference & Exposition, 23 to 26 June 2013 http://www.asee.org/file_server/papers/attachment/file/0003/3259/6219.pdf. [Google Scholar]
- 90.Freeman S, Eddy SL, McDonough M, Smith MK, Okoroafor N, Jordt H, Wenderoth MP. 2014. Active learning increases student performance in science, engineering, and mathematics. Proc Natl Acad Sci U S A 111:8410–8415. doi: 10.1073/pnas.1319030111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Brookfield SD, Preskill S. 2016. The discussion book. Jossey-Bass, San Francisco, CA. [Google Scholar]
- 92.Duch BJ, Groh SE, Allen DE. 2001. The power of problem-based learning. Stylus Publishing, LLC, Sterling, VA. [Google Scholar]
- 93.Michaelsen LK, Parmelee DX, McMahon KK, Levine RE. 2008. Team-based learning for health professions education. Stylus Publishing, LLC, Sterling, VA. [Google Scholar]
- 94.Mazur E. 1997. Peer instruction. Prentice Hall, Upper Saddle River, NJ. [Google Scholar]
- 95.Burgstahler SE. 2015. Universal design in higher education: from principles to practice, 2nd ed Harvard Education Press, Cambridge, MA. [Google Scholar]
- 96.Capp MJ. 2017. The effectiveness of universal design for learning: a meta-analysis of literature between 2013 and 2016. Int J Inclusive Educ 21:791–807. doi: 10.1080/13603116.2017.1325074. [DOI] [Google Scholar]
- 97.Carleton College Science Education Resource Center 2015. Teaching quantitative reasoning with the news. Carleton College, Northfield, MN: http://serc.carleton.edu/sp/library/teaching_news/index.html. [Google Scholar]
- 98.Bandura A. 1986. Social foundations of thought and action: a social cognitive theory. Prentice-Hall, Englewood Cliffs, NJ. [Google Scholar]
- 99.Clark MC, Rossiter M. 2008. Narrative learning in adulthood. New Dir Adult Contin Educ 2008:61–70. doi: 10.1002/ace.306. [DOI] [Google Scholar]
- 100.Alda A. 2017. If I understood you, would I have this look on my face? Random House, New York, NY. [Google Scholar]
- 101.Lee P, Caffarella RS. 1994. Methods and techniques for engaging learners in experiential learning activities. In Jackson L, Caffarella RS (ed), Experiential learning: a new approach. Jossey-Bass, San Francisco, CA. [Google Scholar]
- 102.Belz K. 2017. Critical class. Johns Hopkins Bloomberg School of Public Health, Baltimore, MD: http://magazine.jhsph.edu/2017/summer/briefings/critical-class/. [Google Scholar]
- 103.Fogler HS, LeBlanc SE, Rizzo BR. 2014. Strategies for creative problem solving, 3rd ed Pearson Education, Upper Saddle River, NJ. [Google Scholar]
- 104.Lattuca LR, Voigt LJ, Fath KQ. 2004. Does interdisciplinarity promote learning? Theoretical support and researchable questions. Rev High Educ 28:23–48. doi: 10.1353/rhe.2004.0028. [DOI] [Google Scholar]
- 105.Kavanagh L, Cokley J. 2011. A learning collaboration between engineering and journalism undergraduate students prompts interdisciplinary behaviour. Adv Eng Educ 1–21. [Google Scholar]
- 106.Whitman N. 1993. A review of constructivism: understanding a relatively new theory. Fam Med 25:517–521. [PubMed] [Google Scholar]
- 107.Ericsson KA, Krampe RT, Tesch-Römer C. 1993. The role of deliberate practice in the acquisition of expert performance. Psychol Rev 100:363–406. doi: 10.1037/0033-295X.100.3.363. [DOI] [Google Scholar]
- 108.Deslauriers L, Schelew E, Wieman C. 2011. Improved learning in a large-enrollment physics class. Science 332:862–864. doi: 10.1126/science.1201783. [DOI] [PubMed] [Google Scholar]
- 109.Wu WH, Hsiao HC, Wu PL, Lin CH, Huang SH. 2012. Investigating the learning-theory foundations of game-based learning: a meta-analysis. J Comput Assist Learn 28:265–279. doi: 10.1111/j.1365-2729.2011.00437.x. [DOI] [Google Scholar]
- 110.Bosch G, Werapitiya D, Shiff CJ, Sullivan DJ. 2012. Engaging student participation in journal club discussions: use of Wikis in a blended learning approach. In 18th Annual Sloan Consortium International Conference on Online Learning, 10 to 12 October 2012, Orlando, FL Online Learning Consortium, Newburyport, MA. http://secure.onlinelearningconsortium.org/conference/2012/aln/engaging-student-participation-journal-club-discussions-use-wikis-blended-learni. [Google Scholar]
- 111.Daniels RJ. 2015. A generation at risk: young investigators and the future of the biomedical workforce. Proc Natl Acad Sci U S A 112:313–318. doi: 10.1073/pnas.1418761112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 112.Nisbett RE, Fong GT, Lehman DR, Cheng PW. 1987. Teaching reasoning. Science 238:625–631. doi: 10.1126/science.3672116. [DOI] [PubMed] [Google Scholar]
- 113.Kuchment A. 2013. To attract more girls to STEM, bring more storytelling to science. Scientific American. https://blogs.scientificamerican.com/budding-scientist/to-attract-more-girls-to-stem-bring-storytelling-to-science/.
- 114.World Economic Forum, Zaringhalam M, Gadjanski I, Holford M. 22 February 2017. Too hot, too cold. What porridge can tell us about women in science. World Economic Forum, New York, NY: https://www.weforum.org/agenda/2017/02/women-in-science/. [Google Scholar]
- 115.Begley CG, Ellis LM. 2012. Drug development: raise standards for preclinical cancer research. Nature 483:531–533. doi: 10.1038/483531a. [DOI] [PubMed] [Google Scholar]
- 116.Prinz F, Schlange T, Asadullah K. 2011. Believe it or not: how much can we rely on published data on potential drug targets? Nat Rev Drug Discov 10:712 https://www.nature.com/nrd/journal/v10/n9/pdf/nrd3439-c1.pdf. doi: 10.1038/nrd3439-c1. [DOI] [PubMed] [Google Scholar]
- 117.Baker M. 2016. 1,500 scientists lift the lid on reproducibility. Nature 533:452–454. doi: 10.1038/533452a. [DOI] [PubMed] [Google Scholar]
- 118.Lorsch JR, Collins FS, Lippincott-Schwartz J. 2014. Fixing problems with cell lines. Science 346:1452–1453. doi: 10.1126/science.1259110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 119.eLifesciences Publications 2017. Reproducibility project: cancer biology. eLife Sciences Publications, Ltd, Cambridge, United Kingdom: https://elifesciences.org/collections/9b1e83d1/reproducibility-project-cancer-biology. [Google Scholar]
- 120.Bik EM, Casadevall A, Fang FC. 2016. The prevalence of inappropriate image duplication in biomedical research publications. mBio 7:e00809-16. doi: 10.1128/mBio.00809-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 121.Steen RG, Casadevall A, Fang FC. 2013. Why has the number of scientific retractions increased? PLoS One 8:e68397. doi: 10.1371/journal.pone.0068397. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.Casadevall A, Fang FC. 2015. Is science in crisis? Baltimore Sun, Baltimore, MD: http://www.baltimoresun.com/news/opinion/oped/bs-ed-science-crisis-20150725-story.html. [Google Scholar]
- 123.Rowland HA. 1916. Discovery, or—the spirit and service of science. Macmillan & Co. Ltd, London, United Kingdom. [Google Scholar]
- 124.National Institutes of Health 2016. Rigor and reproducibility. National Institutes of Health, Bethesda, MD: https://www.nih.gov/research-training/rigor-reproducibility. [Google Scholar]
- 125.National Academy of Sciences 2017. The right to search for truth implies also a duty; one must not conceal any part of what one has recognized to be the truth. National Academies Press, Washington, DC: http://www.nasonline.org/about-nas/visiting-nas/nas-building/the-einstein-memorial.html. [Google Scholar]