. 2018 Fall;17(3):ar39. doi: 10.1187/cbe.16-11-0332

TABLE 4.

Critical Thinking Assessment Test (CAT) results by course

	Skill category^a				BI 125		BI 225		BI/CH 308
Question	E	P	C	Co	Delta^b	Effect size^c	Delta^b	Effect size^c	Delta^b	Effect size^c
Summarize the pattern of results in a graph without making inappropriate inferences.	X				*0.28**	*0.67*	0.21		*0.39***	*1.10*
Evaluate how strongly correlational-type data support a hypothesis.	X			X	0.11		*0.83**	*0.78*	0.17
Provide alternative explanations for a pattern of results that has many possible causes.			X	X	0.1		0.26		*0.62***	*0.68*
Identify additional information needed to evaluate a hypothesis.		X	X	X	−0.1		−0.06		−0.15
Evaluate whether spurious information strongly supports a hypothesis.	X				0		0.06		−0.05
Provide alternative explanations for spurious associations.			X	X	0.2		0.16		0.06
Identify additional information needed to evaluate a hypothesis.		X	X	X	0.03		−0.05		−0.28^†	−0.51
Determine whether an invited inference is supported by specific information.	X				0.04		0.15^†	0.32	0.05
Provide relevant alternative interpretations for a specific set of results.			X	X	0.14		0.11		0.06
Separate relevant from irrelevant information when solving a real-world problem.	X	X			−0.03		0.1		*0.44**	*0.57*
Use and apply relevant information to evaluate a problem.	X	X		X	0.28^†	0.40	*0.59**	*0.79*	0
Use basic mathematical skills to help solve a real-world problem.		X			0.01		0.15		*0.22**	*0.73*
Identify suitable solutions for a real-world problem using relevant information.	X	X			0.1		*0.63**	*0.59*	*0.67**	*0.61*
Identify and explain the best solution for a real-world problem using relevant information.	X	X	X		0.42		0.47		0.34
Explain how changes in a real-world problem situation might affect the solution.		X	X	X	−0.06		0		0.22
CAT total score					1.51^†	0.29	*3.56**	*0.52*	*2.74**	*0.46*

Bold and italic indicate significant differences (p < 0.05). Italic only indicates marginal differences (0.05 < p < 0.10).

^aSkills categories assessed by each question: E, evaluate and interpret information; P, problem solving; C, creative thinking; Co, effective communication.

^bGains or losses (deltas) are reported as the difference between pretest and posttest means for each question or total score. Significant differences were assessed by paired, two-tailed Student’s t tests.

^cMean difference divided by pooled group SD (0.1–0.3, small effect; 0.3–0.5, moderate effect; >0.5, large effect).

*p < 0.05.

**p < 0.01.

^†0.05 < p < 0.10.