Abstract
To make time in class for group activities devoted to critical thinking, we integrated a series of short online lectures into the homework assignments of a large, introductory biology course at a research university. The majority of students viewed the online lectures before coming to class and reported that the online lectures helped them to complete the in-class activity and did not increase the amount of time they devoted to the course. In addition, students who viewed the online lecture performed better on clicker questions designed to test lower-order cognitive skills. The in-class activities then gave the students practice analyzing the information in groups and provided the instructor with feedback about the students’ understanding of the material. On the basis of the results of this study, we support creating hybrid course models that allow students to learn the fundamental information outside of class time, thereby creating time during the class period to be dedicated toward the conceptual understanding of the material.
Keywords: clickers, elearning, active learning, undergraduate, online learning
THE lecture hall is no longer the primary portal for the dissemination of information. Instead, the college classroom must embrace a new role as a place where students can work with instructors and peers to apply and evaluate the wealth of information that is available (Handelsman et al. 2004, 2007; Ebert-May and Hodder 2008). Students actively engaged in constructing their own learning demonstrate increased learning gains and enhanced retention of course material when compared to students who listen to traditional lectures (Udovic et al. 2002; Knight and Wood 2005; Deslauriers et al. 2011). Engagement in active-learning exercises like small group learning requires students to communicate their thought processes. Instructors can then gauge whether the course learning objectives are being achieved and can identify and address student misconceptions (Klymkowsky et al. 2003; Allen and Tanner 2005; Phillips et al. 2008). Implementation of active learning in the science classroom recognizes the value of diversity and increases student retention (Felder 1993; Buncick et al. 2001). Given these benefits, national agencies have promoted the inclusion of active learning in undergraduate science education (National Research Council 2000, 2003; Aaas 2011), which raises questions about how to implement active learning while maintaining sufficient coverage of the fundamental information.
Instructors have been experimenting with new delivery methods, moving away from the traditional in-class lecture and out-of-class problem set model. For example, many instructors are now incorporating online learning components, which have been shown to improve both student attitudes and academic performance (Grabe and Christopherson 2008; McFarlin 2008; Vatovec and Balser 2009). Other models, like team-based learning, flip the standard paradigm and instead require students to read information outside of class to prepare for in-class activities (Foertsch et al. 2002). On the basis of these ideas in an attempt to addre0000000ss the content–process tension, we created a hybrid course model in which students viewed an online lecture before class and then participated in group, problem-solving exercises during the in-class time.
The hybrid model was implemented in the first semester of a large, introductory biology course that focused on ecology, evolution, and genetics. For each of the 10 class periods, we produced online lectures and designed in-class activities that targeted the session’s learning objectives. Many of the topics, especially those relating to genetics, are notoriously difficult for students to understand (Marbach-Ad and Stavy 2000). By implementing the active-learning exercises, we accomplished two important objectives. First, the instructors were able to clarify student misconceptions and assess what concepts students struggled to understand, and second, the students engaged in challenging problems designed to help the students develop higher-order cognitive skills.
To understand the impact on student learning and their perceived value of the activities, we asked the following questions about the hybrid course model:
Did students view the online lectures before participating in the in-class activities?
Did viewing the online lectures help students to achieve the session learning objectives?
Did students value online lectures as a learning tool?
Did the addition of the online lectures increase the amount of time that students spent on the course?
To answer the questions, we used a mixed-method approach that included student performance on clicker questions, surveys, assignments, and other metrics, the results of which indicated that the hybrid course model effectively created time for active learning in the classroom.
Materials and Methods
Class demographics
We implemented this project in the first-semester lecture course of a four-semester undergraduate biology program, Biology Core Curriculum at the University of Wisconsin (Madison, WI) (http://www.biocore.wisc.edu) (Batzli 2005). Through a competitive application process, students are selected to participate in this program and are informed that the curriculum will require them to learn to work productively in groups and to develop critical thinking skills. The three-credit ecology, evolution, and genetics course enrolls ∼130 students each fall and is the foundation for subsequent biology courses. The course meets three times per week for 50 min in a large, stadium-style lecture hall; most instructors delivered a typical instructor-centered lecture with out-of-class problem sets. For 10 of 42 lecture periods equally dispersed throughout the semester, we implemented the new teaching intervention that included online lectures to be viewed outside of class time, in combination with in-class group problem-solving activities. The graduate teaching assistants reviewed the information presented in lecture during the weekly 16 student discussion sections. Summative assessments included two midsemester exams and one final exam composed of short-answer essay questions. The instructors designed the examination questions to test students’ understanding of the content from the out-of-class lectures and their critical thinking skills based on those developed during participation in the group activities. The students in this course are sophomore honor students majoring in the biological sciences and frequently continue on to complete postgraduate degrees.
Implementation of the hybrid model
The online lectures were developed by the instructors to provide students with the basic knowledge that was needed to participate in the in-class activity. To produce the online lectures, instructors created a PowerPoint presentation and then recorded the associated sound file (*.wav type). In some cases, the sound file was edited using WavePad 3.05. The sound file was converted into an audio file (*.mp3 type) in iTunes and was combined with the PowerPoint presentation). The final presentations were posted on the course website and introduced to students as a required resource to be viewed prior to the class period when the active learning event occurred. The genetics topics included mitosis, meiosis, recombination, quantitative genetics, and probability. The online lectures and their associated learning objectives can be accessed from the Scientific Teaching Digital Library at http://scientificteaching.wisc.edu/library/units/003/.
To evaluate student use of the online lectures, we asked students at the start of each class period whether they viewed the online lecture before class and whether they planned to view the online lecture before the examination. To assess understanding related to the learning objectives based on the online lectures, students answered a series of questions using an electronic audience-response system, or “clickers.” The cognitive level of the clicker questions was ranked using the Blooming Biology Tool (Crowe et al. 2008). The clicker questions, the designated cognitive level, and associated learning objectives can be found in Supporting Information, Figure S1. For each of the clicker questions, we compared the average number of students choosing the correct answer of those who viewed the online lecture to those who did not and we looked at whether this difference was statistically significant (P-value <0.05) by using the Mann–Whitney test on the Vassar Stats Website (http://vassarstats.net). When students performed poorly on the clicker questions, we encouraged peer discussion and if necessary provided additional instruction (Levesque 2011).
After the assessment with the clicker questions, students spent the balance of the 50-min class period participating in group activities. The faculty instructors and teaching fellows (Miller et al. 2008) designed these activities to extend the students’ conceptual understanding of the information presented in the online lecture and to help the students develop critical thinking skills. Many of the activities involved drawing since this is one of the most effective ways to elicit student misconceptions (Dikmenli 2010). The worksheet associated with the cell division topic is included in Figure S2 and other genetics-themed worksheets can be access from the Scientific Teaching Digital library at http://scientificteaching.wisc.edu/library/units/003/. Four students worked together in each assigned group, and the faculty instructor, the teaching fellow, and teaching assistants circulated around the classroom to guide the students as they processed the material. An integral part of the class period included a discussion where students presented their solutions to the class, using a document camera.
The information from the group worksheets was assessed on the examination and students received points toward their overall grade for participating in the in-class activities. For two of the class periods, we gave the students the choice between viewing the instructor-produced online lecture and/or doing an equivalent reading. We surveyed students to find out which of the resources they chose to use to prepare for class. Further information, regarding student use of and attitudes toward the online lectures, was collected at the end of the course survey.
Results
We implemented a hybrid course model into an introductory biology course. Students viewed online lectures before coming to class and then participated in activities in class (Figure 1A). Instructors spent between 3 and 5 hr developing online lectures, which provided students with the basic facts. The online lectures for the cell division unit included an introduction to what occurs during each of the stages of mitosis and meiosis. At the beginning of the class period, students answered five clicker questions testing student understanding of the material covered in the online lectures. Groups of students then worked with the instructor to create drawings integrating information from the lectures with fundamental genetics concepts. These in-class activities allowed the instructors to help the students build a conceptual framework and to elicit and discuss student misconceptions.
Figure 1 .
Hybrid course model. (A) Students were assigned to view an online lecture before coming to class. In class, students answered a series of clicker question to assess whether they could demonstrate the learning objectives associated with the online lectures and then participated in group activities designed to build critical thinking skills. (B) Instructor aiding a group of students with an in-class activity. (C) Presentation of the students’ solution to the cell division in-class activity.
Use of online lectures
Students were surveyed at the beginning of the class period to determine whether they viewed the online lecture. Over the 5 years that we have used this model, we have found that between 70% and 85% of students viewed the online lecture before coming to class and that 97–99% of students plan on viewing the lectures before the examination. When students were asked why they did not view the online lecture before coming to class, the most common response was that they did not have enough time due to other coursework.
Achievement of learning objectives from online lectures
During the class period, we used clickers to assess whether students attained the learning objectives associated with the online, preclass lecture. Responses to questions that tested lower-order cognitive skills, such as knowledge and comprehension, indicated that students who viewed the online lectures performed better than those who had not viewed them; five of the seven questions reached statistical significance (P < 0.05) (Figure 2). Results from the five questions that focused on the higher-order cognitive skills (application and analysis), however, showed no difference in performance between the students who had and had not viewed the online lecture. These results support the idea that the online lectures helped the students to achieve the lower-order cognitive skills, but that the online lectures were not sufficient for the students to demonstrate the higher-order cognitive skills.
Figure 2 .
Students who viewed the online lecture before class performed better on the questions designed to test lower-order cognitive skills. For each clicker question the number of students that answered the question correctly was grouped by whether the students had viewed the online lecture before coming to class. The seven clicker questions on the left side were designed to test lower-order cognitive skills and the final six questions were designed to test higher-order cognitive skills. Clicker questions showing a statistically significant difference (P-value <0.05) between students viewing the online lecture and those students who did not view the corresponding lecture are indicated with an “*”.
Identification of student misconceptions during in-class activities
To help the students to develop higher-order cognitive skills, the rest of the class period was devoted to group problem-solving activities and reporting out, with instructor facilitation as needed (Figure 1, B and C). During the group work time, students continually modified their responses as they gathered more information and solved the problems at hand. For the cell division unit, students drew a heterozygous, diploid cell, which they showed undergoing mitosis and meiosis, and then were asked to use their diagram to illustrate independent assortment of alleles. The heavily edited student worksheets (Figure S3) illustrate how students’ answers were evolving during the activity—indicators of their problem-solving skills and application of their knowledge. Instead of lecturing, instructors were available to clarify instructions and to address student misconceptions. Common misconceptions that we identified during the cell division unit are included in Figure S2.
Value of the online lectures
Students’ answers to survey questions support that the students valued the online lectures as a learning tool. We found that 95–98% of students reported that the online lectures were helpful or very helpful toward the completion of that day’s in-class activities. Most of the students reported attentively viewing the online lectures with only 6% reporting that they watched the online lecture while doing other things. We found that the students preferred viewing the online lecture over doing an out-of-class reading, with <5% choosing to do the reading instead of viewing the online lecture and 85% of the students viewing the online lecture before coming to class.
At the end of the course survey, students responded to an open-ended question to relate the value of the online lectures to their learning: 64% of students’ comments were positive, 26% were mixed, and 10% were negative. A representative example of a positive quote illustrates how students valued the paired online lecture and in-class activity: “It let us learn the information and then apply those new concepts in in-class activities.” The students’ comments identified additional advantages of the online lectures. One student noted, “I also liked the ability to pause and digest the material at my own pace.” Another pointed out that the pairing was “Very helpful because I could watch the online lecture at my own time (i.e., 4:30 am) and could use the online lecture to review confusing information.” These comments indicate that the online lectures allow the students to learn the information at their own pace.
A low percentage of students had negative comments regarding the incorporation of the online lectures. One concern was the length of the online lectures. The students preferred that the length of online lectures be limited to ≤20 min to maximize student engagement. This prompted us to create two lectures, one on mitosis and one on meiosis, for the cell division unit. An additional concern was a perception that the online lectures significantly increased the student workload outside of class. To address this concern, we compared the number of hours students reported spending outside of the class each week to the number of hours estimated in the previous year. The only major change between the 2 years was the addition of online lectures. We found no significant difference in student reported workload in years with or without online lectures. In both cases, 75% of students reported spending <6 hr per week studying for the course, which contradicts the perception that the online lectures increased workload outside class time.
Discussion
Students used and valued online lectures in an introductory biology course. Students who viewed the online lectures before class performed better on lower-order cognitive learning objectives. Moving content from the class period to the online format allowed instructors to use class time to help students achieve the higher-order cognitive learning objectives and to assess student understanding of essential concepts. The curriculum restructuring did not reduce the amount of course content or alter the amount of time students reported spending on the course. The results of this study support the implementation of a hybrid course model, combining online lectures with in-class group problem solving.
Like others, we found the online format offers benefits not found in traditional lectures, including the flexibility for students to view and review the lectures at their convenience (Cardall et al. 2008). Instructors also appreciate the increased flexibility offered by online learning (Mayadas et al. 2009). A meta-analysis of online learning from the Department of Education suggests that students perform well in online learning situations and even better when online learning was paired with face-to-face instruction (Office of Planning, Evaluation, and Policy Development 2010). Therefore, we promote combining online and in-class learning activities and outline recommendations for effective development and implementation of a hybrid course curriculum in Table 1.
TABLE I.
Tips for effective development and implementation of a hybrid course
Maximize student engagement |
1. Align online lectures and in-class activities with the course learning goals. |
2. Keep the online lectures short (15–20 min). |
3. Post online lectures at least 2 days prior to the in-class activity. |
4. Use clickers to assess whether students have achieved the learning objectives associated with the online lectures and follow challenging questions with peer discussion. |
5. Use in-class group work to extend the students’ conceptual understanding of the material and to address students’ misconceptions. |
6. Hold students accountable for material in the online lectures and in-class activities on summative assessments. |
Minimize instructor input |
1. Create slides and record lecture using PowerPoint. |
2. Use online lectures with a subset of the class periods. |
3. Choose topics from less rapidly evolving fields so the same presentation or a minimally modified presentation can be used for multiple years. |
The success of active learning is associated with effective pedagogical approaches to curricular design (Andrews et al. 2011). We took a constructivist approach to active learning, accepting that students must integrate new information with their existing knowledge frameworks (Chi 2009). We designed the in-class worksheets to identify common student misconceptions and to emphasize conceptual frameworks rather than isolated facts. During the implementation phase, students presented multiple answers to the worksheets. By comparing and contrasting answers, we were able to appropriately address student misconceptions. Addressing these misconceptions was critical because the subsequent topics in the course built upon information covered in these units. Instructors emphasized that the skills students were developing during the in-class activity would be assessed on the course examinations. This is one strategy that has been reported to help address student resistance to curricular change (Silverthorn 2006).
Our study has several limitations. We did not assess whether the hybrid model was associated with learning gains or improved retention; however, other researchers have established these benefits of small group learning (Springer et al. 1999). Students in this study selectively enrolled in the honors course knowing that participation in the curriculum would require active learning and group problem solving. Students in this course may have different abilities and motivation levels than other class populations, which may limit the generalizability of this study.
Curricular innovations are rarely effective in all situations (Tanner 2011). Instructors must modify the model to meet the needs of their student population, classroom environment, and resources. One addition to the hybrid model, implemented in a computer science course, was to have students complete an online, graded quiz after viewing the online lecture. The quiz motivated students to view the lectures and helped the instructor to identify topics requiring additional coverage during the class period (Moses and Litzkow 2005).
In conclusion, there are meaningful benefits associated with curricular redesign that integrates online lectures and in-class active learning exercises. This hybrid course model allows instructors to effectively identify student misconceptions of key concepts and to devote in-class time to developing students’ higher-order cognitive skills.
Supplementary Material
Acknowledgments
A.J.P. assessed the hybrid model while participating in the Wisconsin Program for Scientific Teaching. Phillip Simon and Zomary Flores provided significant help designing a subset of the online lectures. This program was supported by the Howard Hughes Medical Institute Professors Program awarded to Jo Handelsman [Institutional Review Board (IRB) protocol 2006-0516, exempt from review] and the National Science Foundation–Course, Curriculum, and Laboratory Improvement, awarded to Jo Handelsman and S.M. (no. 0618821, IRB protocol 2006-0413, exempt from review).
Footnotes
Communicating editor: A. P. Mitchell
Literature Cited
- Allen D., Tanner K., 2005. Infusing active learning into the large enrollment biology class: seven strategies, from simple to complex. CBE Life Sci. Educ. 4: 262–268 [DOI] [PMC free article] [PubMed] [Google Scholar]
- American Association for the Advancement of Science, 2011. Vision & Change in Undergraduate Biology Education: A Call to Action. American Association for the Advancement of Science, Washington, DC
- Andrews T. M., Leonard M. J., Colgrove C. A., Kalinowski S. T., 2011. Active learning not associated with student learning in a random sampling of college biology courses. CBE Life Sci. Educ. 10: 394–405 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Batzli J. M., 2005. A unique approach? Four semesters of biology core curriculum. CBE Life Sci. Educ. 4: 125–128 [Google Scholar]
- Buncick M. C., Betts P. G., Horgan D. D., 2001. Using demonstrations as a contextual road map: enhancing course continuity and promoting active engagement in introductory college physics. Int. J. Sci. Educ. 23: 1237–1256 [Google Scholar]
- Cardall S., Krupat E., Ulrich M., 2008. Live lectures vs. video-recorded lecture: Are students voting with their feet? Acad. Med. 83(12): 1174–1178 [DOI] [PubMed] [Google Scholar]
- Chi T. H. M., 2009. Active-constructive-interactive: a conceptual framework for differentiating learning activities. Topics Cogn. Sci. 1: 73–105 [DOI] [PubMed] [Google Scholar]
- Crowe A., Dirks C., Wenderoth M. P., 2008. Biology in bloom: implementing Bloom’s taxonomy to enhance student learning in biology. CBE Life Sci. Educ. 7: 368–380 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Deslauriers L., Schelew E., Wieman C., 2011. Improved learning in a large-enrollment physics class. Science 332(6031): 862–864 [DOI] [PubMed] [Google Scholar]
- Dikmenli M., 2010. Misconceptions of cell division held by student teachers in biology: a drawing analysis. Sci. Res. Essay 5(2): 235–247 [Google Scholar]
- Ebert-May D., Hodder J., 2008. Pathways to Scientific Teaching. Ecological Society of America. Sinauer Associates, Sunderland, MA [Google Scholar]
- Felder R. M., 1993. Reaching the second tier: learning and teaching styles in college science education. J. Coll. Sci. Teach. 23: 286–290 [Google Scholar]
- Foertsch J., Moses G., Strikwerda J., Litzkow M., 2002. Reversing the lecture/homework paradigm using eTEACH web-based streaming video software. J. Eng. Educ. 91: 267–274 [Google Scholar]
- Grabe M., Christopherson K., 2008. Optional student use of online lecture resources: resource preferences, performance and lecture attendance. J. Comput. Assist. Learn. 24: 1–10 [Google Scholar]
- Handelsman J., Ebert-May D., Beichner R., Bruns P., Chang A., et al. , 2004. Policy forum: scientific teaching. Science 304: 521–522 [DOI] [PubMed] [Google Scholar]
- Handelsman J., Miller S., Pfund C., 2007. Scientific Teaching. W. H. Freeman, New York: [DOI] [PubMed] [Google Scholar]
- Klymkowsky M. W., Garvin-Doxas K., Zeilik M., 2003. Bioliteracy and teaching efficacy: what biologists can learn from physicists. Cell Biol. Educ. 2: 155–161 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knight J. K., Wood W. B., 2005. Teaching more by lecturing less. Cell Biol. Educ. 4: 298–310 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levesque A. A., 2011. Using clickers to facilitate development of problem-solving skills. CBE Life Sci. Educ. 10(4): 406–417 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marbach-Ad G., Stavy R., 2000. Students’ cellular and molecular explanations of genetic phenomena. J. Biol. Educ. 34: 200–205 [Google Scholar]
- Mayadas A. F., Bourne J., Bacsich P., 2009. Online education today. Science 323: 85–89 [DOI] [PubMed] [Google Scholar]
- McFarlin B. K., 2008. Hybrid lecture-online format increases student grades in an undergraduate exercise physiology course at a large urban university. Adv. Physiol. Educ. 32: 86–91 [DOI] [PubMed] [Google Scholar]
- Miller S., Pfund C., Pribbenow C. M., Handelsman J., 2008. Scientific teaching in practice. Science 322: 1329–1330 [DOI] [PubMed] [Google Scholar]
- Moses G., Litzkow M., 2005. In-class active learning and frequent assessment reform of nuclear reactor theory course, F1C-26 35th ASEE/IEEE Frontiers in Education Conference, Indianapolis, IN [Google Scholar]
- National Research Council, 2000. How People Learn: Brain, Mind, Experience, and School, Expanded Edition, edited by Bransford J. D., Brown A. L., Cocking R. R. National Academy Press, Washington, DC [Google Scholar]
- National Research Council, 2003. Evaluating and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics, edited by Fox M. A., Hackerman N. National Academy Press, Washington, DC [Google Scholar]
- Office of Planning, Evaluation, and Policy Development, 2010. Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. Department of Education, Washington, DC [Google Scholar]
- Phillips A. R., Robertson A. L., Batzli J. M., Harris M. A., Miller S., 2008. Aligning goals, assessments, and activities: an approach to teaching PCR and gel electrophoresis. CBE Life Sci. Educ. 7: 96–106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Silverthorn D. U., 2006. Teaching and learning in the interactive classroom. Adv. Physiol. Educ. 30: 135–140 [DOI] [PubMed] [Google Scholar]
- Springer L., Stanne M. E., Donovan S. S., 1999. Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: a meta-analysis. Rev. Educ. Res. 69(1): 21–51 [Google Scholar]
- Tanner K., 2011. Reconsidering “what works”. CBE Life Sci. Educ. 10: 329–333 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Udovic D., Morris D., Dickman A., Postlethwait J., Wetherwax P., 2002. Workshop biology: demonstrating the effectiveness of active learning in a non-majors biology course. Bioscience 52: 272–281 [Google Scholar]
- Vatovec C., Balser T., 2009. Podcasts as tools in introductory environmental studies. J. Microbiol. Biol. Educ. 10: 19–24 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.