Table 4.
Logical justifications | Illogical justifications | ||||||||
---|---|---|---|---|---|---|---|---|---|
Student population | n | Pre mean (SD) | Post mean (SD) | Significance | ES | Pre mean (SD) | Post mean (SD) | Significance | ES |
Question A | |||||||||
CCNYb | 48 | 1.9 (1.4) | 2.0 (1.9) | ns | — | 0.8 (0.9) | 0.9 (0.8) | ns | — |
Full semester | 45 | 2.4 (1.4) | 3.3 (1.4) | 0.000 | 0.7 | 0.3 (0.6) | 0.2 (0.5) | 0.040 | 0.3 |
Partial semester | 63 | 1.8 (1.2) | 2.5 (1.4) | 0.002 | 0.4 | 0.4 (0.7) | 0.3 (0.6) | ns | — |
Private | 42 | 2.6 (1.3) | 3.2 (1.3) | 0.011 | 0.5 | 0.3 (0.6) | 0.1 (0.4) | 0.020 | 0.4 |
Public | 66 | 1.8 (1.3) | 2.6 (1.6) | 0.000 | 0.6 | 0.5 (0.6) | 0.4 (0.6) | ns | — |
Pool of all | 108 | 2.1 (1.3) | 2.8 (1.5) | 0.000 | 0.5 | 0.4 (0.6) | 0.3 (0.6) | 0.020 | 0.2 |
Question B | |||||||||
CCNYb | 48 | 0.8 (1.2) | 3.4 (1.9) | 0.001 | 1.6 | 1.8 (1.2) | 0.4 (1.2) | 0.001 | 1.2 |
Full semester | 45 | 1.3 (1.1) | 3.0 (1.6) | 0.000 | 1.2 | 1.0 (1.0) | 0.3 (0.6) | 0.003 | 1.0 |
Partial semester | 63 | 0.8 (1.0) | 2.4 (1.6) | 0.000 | 1.2 | 1.3 (0.8) | 0.6 (0.7) | 0.000 | 0.9 |
Private | 42 | 1.3 (1.1) | 3.0 (1.3) | 0.000 | 1.4 | 1.1 (1.0) | 0.2 (0.6) | 0.000 | 0.9 |
Public | 66 | 0.8 (1.0) | 2.4 (1.7) | 0.000 | 1.1 | 1.3 (0.8) | 0.6 (0.7) | 0.000 | 0.9 |
Pool of all | 108 | 1.0 (1.1) | 2.6 (1.6) | 0.000 | 1.2 | 1.2 (0.9) | 0.5 (0.7) | 0.000 | 1.2 |
Question C | |||||||||
CCNYb | 48 | 1.5 (0.7) | 2.9 (1.2) | 0.021 | 1.4 | 0.7 (0.4) | 0.3 (0.5) | 0.023 | 0.9 |
Full semester | 45 | 1.7 (1.0) | 2.5 (1.4) | 0.000 | 0.7 | 0.8 (0.9) | 0.3 (0.6) | 0.001 | 0.7 |
Part semester | 63 | 1.3 (1.3) | 1.6 (1.2) | ns | — | 0.6 (0.7) | 0.5 (0.7) | ns | — |
Private | 42 | 1.7 (1.0) | 2.5 (1.3) | 0.000 | 0.7 | 0.7 (0.8) | 0.1 (0.4) | 0.001 | 0.8 |
Public | 66 | 1.4 (1.3) | 1.7 (1.4) | 0.030 | 0.2 | 0.5 (0.7) | 0.5 (0.7) | ns | — |
Pool of all | 108 | 1.5 (1.2) | 2.0 (0.5) | 0.000 | 0.5 | 0.6 (0.7) | 0.4 (0.6) | 0.012 | 0.3 |
Question D | |||||||||
CCNYb | 48 | 0.8 (1.3) | 1.1 (1.9) | ns | — | 1.7 (1.0) | 1.1 (0.8) | 0.001 | 0.7 |
Full semester | 45 | 1.3 (0.8) | 1.7 (0.9) | 0.012 | 0.5 | 1.3 (1.0) | 1.7 (0.9) | ns | — |
Partial semester | 63 | 0.9 (0.8) | 1.3 (0.9) | 0.000 | 0.5 | 1.1 (0.9) | 1.0 (0.8) | ns | — |
Private | 42 | 1.2 (0.6) | 1.7 (0.9) | 0.004 | 0.6 | 1.3 (1.0) | 0.9 (0.9) | 0.029 | 0.4 |
Public | 66 | 1.0 (0.9) | 1.4 (0.9) | 0.002 | 0.4 | 1.1 (0.9) | 1.1 (0.7) | ns | — |
Pool of all | 108 | 1.1 (0.8) | 1.5 (0.9) | 0.000 | 0.5 | 1.2 (0.9) | 1.0 (0.8) | ns | — |
aCTT questions A, C, and D were from the Field-tested Learning Assessment Guide; question B was written by the PIs for the CTT. Each question was used previously at CCNY (Hoskins et al., 2007). CIs 1, 3, and 7 were full-semester implementations; the others ranged from 4 to 10 wk. CIs 1, 2, and 7 are private institutions; the others are public. Pool of all = CI 1–7. Significance determined using paired t test (Excel); p values < 0.05 were considered significant.
bOriginal CCNY cohort; pool of three CCNY implementations; all were full-semester and taught by S.G.H. in 2004–2005.