Table 6.
Study Determinants and Ratings (Single-Case Design).
| Study | Clear manipulation of independent variable(s)? | 3 attempts to demonstrate intervention effect? | Sufficient interassessor agreement reported? | Sufficient number of phases present based on design? | Sufficient number of data points per condition or phase? | Evaluation result |
|---|---|---|---|---|---|---|
| Beck, Burns, and Lau (2009) | Yes | Yes | Yesa | Yes | No; ≤ 3 points per condition | DNMS |
| Burke, Hagan-Burke, and Sugai (2003) | Yes | Yes | Yes | Yes | No; ≤ 3 points per condition | DNMS |
| Kamps, Barbetta, Leonard, and Delquadri (1994)b | Yes | Yes | Yesa | Yes | Yes for comprehension and duration | MS for comprehension and duration of social interaction |
| Lane, Little, Redding-Rhodes, Phillips, and Welsh (2007) | Yes | Yes | Yesa | Yes | Yes | MS |
| Lane et al. (2002)a | Visual analysis only available for 2 students; M, SD, and effect sizes given for all students on all dependent variables | NA | ||||
| Lingo, Slaton, and Jolivette (2006) | Yes; instructional-level oral reading fluency and errors | Yes; instructional-level oral reading fluency and errors | Yesa; instructional-level oral reading fluency and errors | Yes; instructional-level oral reading fluency and errors | Yes for four/seven students; instructional-level oral reading fluency and errors | MS, MSWR |
| Yes; grade-level oral reading fluency and errors | Yes; grade-level oral reading fluency and errors | Yesa; grade-level oral reading fluency and errors | Yes; grade-level oral reading fluency and errors | No; grade-level oral reading fluency and errors | MSWR | |
| Yes; appropriate behavior | Yes; for three/ eight students; appropriate behavior | Yesa; appropriate behavior | Yes; instructional-level fluency (four/seven students) | No | DNMS in gened setting; MSWR for three/eight students in Special Education setting | |
| Scott and Shearer- Lingo (2002) | Yes | No | Yesa | Yes | No | DNMS |
| Wehby, Falk, Barton-Arwood, Lane, and Cooley (2003) | Yes | Yes | Yesa | Yes | No; NWF Yes for four/ eight of students; sound blends No; letter ID No; sight words Yes for six/ eight; time attending Yes for six/eight inappropriate behavior | MSWR for NWF MS and MSWR for blends MSWR for letter ID MSWR for sight word MS and MSWR for time attending MS and MSWR for inappropriate behavior |
Note. DNMS = Does not meet WWC Standards; MS = Meets WWC Standards; MSWR = Meets WWC Standards With Reservations; NWF = nonsense word fluency; ID = Intellectual Disability. WWC = What Works Clearinghouse.
a
Percentage of interassessor agreement was not reported for each condition/phase.
b
Visual analysis not available for one or more dependent variables.