TABLE 2.

Think-aloud theme frequencies^a

	Faculty			Students
Themes/subthemes	No. out of 6	Percent	Average instance ± SEM	No. out of 11	Percent	Average instance ± SEM
Thinking tools
Rereading text one or more times	6	100	33 ± 8.7	11	100	10 ± 3.1
Summarizing or recapping	6	100	14.7 ± 4.8	11	100	4.6 ± 1.1
Using a reference point/prior knowledge	6	100	7.5 ± 1.9	6	55	2 ± 0.86
Underlining a key piece of information	4	67	8 ± 3.4	7	64	6.9 ± 3.2
Taking notes	4	67	5.2 ± 2.7	5	45	2 ± 0.89
Relying on definition provided	0	0	0	5	45	0.45 ± 0.16
Science literacy and process skills
Understanding research design +	6	100	10.9 ± 2.1	11	100	3.1 ± 0.73
Evaluating a scientific argument	6	100	9.2 ± 2.1	2	18	0.55 ± 0.37
Analysis +	6	100	13.6 ± 0.71	8	73	5.6 ± 0.97
Understanding research design −	3	50	0.50 ± 0.22	9	82	1.7 ± 0.38
Participant comprehension difficulties
Due to unknown vocabulary/jargon	4	67	1.50 ± 0.73	8	72	3.40 ± 1.2
Due to lack of knowledge/incorrect knowledge	4	67	0.67 ± 0.21	6	55	0.73 ± 0.24
Participant becomes distracted focusing on a small detail	2	33	0.33 ± 0.21	2	19	0.27 ± 0.19
Due to wording/sentence structure	1	17	0.17 ± 0.17	6	55	0.73 ± 0.31

^aSubthemes are listed below themes in order of prevalence for faculty. The number and percentage of participants who demonstrated a subtheme as well as average instance are shown. N = 6 (faculty); N = 11 (students); SEM = standard error of the mean; + means that it was done correctly, and - means that it was done incorrectly.