Abstract
The study of thinking is made difficult by the fact that many of the relevant stimuli and responses are not apparent. Although the use of verbal reports has a long history in psychology, it is only recently that Ericsson and Simon's (1993) book on verbal reports explicated the conditions under which such reports may be reliable and valid. We review some studies in behavior analysis and cognitive psychology that have used talk-aloud reporting. We review particular methods for collecting reliable and valid verbal reports using the “talk-aloud” method as well as discuss alternatives to the talk-aloud procedure that are effective under different task conditions, such as the use of reports after completion of very rapid task performances. We specifically caution against the practice of asking subjects to reflect on the causes of their own behavior and the less frequently discussed problems associated with providing inappropriate social stimulation to participants during experimental sessions.
Full text
PDF















Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Ahlum-Heath M. E., Di Vesta F. J. The effect of conscious controlled verbalization of a cognitive strategy on transfer in problem solving. Mem Cognit. 1986 May;14(3):281–285. doi: 10.3758/bf03197704. [DOI] [PubMed] [Google Scholar]
- Bristow D., Fristoe M. Learning of Blissymbols and manual signs. J Speech Hear Disord. 1984 May;49(2):145–151. doi: 10.1044/jshd.4902.145. [DOI] [PubMed] [Google Scholar]
- Ceci S. J., Bruck M. Suggestibility of the child witness: a historical review and synthesis. Psychol Bull. 1993 May;113(3):403–439. doi: 10.1037/0033-2909.113.3.403. [DOI] [PubMed] [Google Scholar]
- Critchfield T. S., Perone M. Verbal self-reports of delayed matching to sample by humans. J Exp Anal Behav. 1990 May;53(3):321–344. doi: 10.1901/jeab.1990.53-321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Devany J. M., Hayes S. C., Nelson R. O. Equivalence class formation in language-able and language-disabled children. J Exp Anal Behav. 1986 Nov;46(3):243–257. doi: 10.1901/jeab.1986.46-243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- GAGNE R. M., SMITH E. C., Jr A study of the effects of verbalization on problem solving. J Exp Psychol. 1962 Jan;63:12–18. doi: 10.1037/h0048703. [DOI] [PubMed] [Google Scholar]
- Lane S. D., Critchfield T. S. Verbal self-reports of emergent relations in a stimulus equivalence procedure. J Exp Anal Behav. 1996 Mar;65(2):355–374. doi: 10.1901/jeab.1996.65-355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lindsley O. R. Is fluency free-operant response-response chaining? Behav Anal. 1996 Fall;19(2):211–224. doi: 10.1007/BF03393165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Loftus E. F., Hoffman H. G. Misinformation and memory: the creation of new memories. J Exp Psychol Gen. 1989 Mar;118(1):100–104. doi: 10.1037//0096-3445.118.1.100. [DOI] [PubMed] [Google Scholar]
- Loftus E. F. Memory distortion and false memory creation. Bull Am Acad Psychiatry Law. 1996;24(3):281–295. [PubMed] [Google Scholar]
- doi: 10.1901/jeab.1986.45-351. [DOI] [PMC free article] [Google Scholar]
- Perone M. Laboratory lore and research practices in the experimental analysis of human behavior: Use and abuse of subjects' verbal reports. Behav Anal. 1988 Spring;11(1):71–75. doi: 10.1007/BF03392458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Russo J. E., Johnson E. J., Stephens D. L. The validity of verbal protocols. Mem Cognit. 1989 Nov;17(6):759–769. doi: 10.3758/bf03202637. [DOI] [PubMed] [Google Scholar]
- Sidman M. Reading and auditory-visual equivalences. J Speech Hear Res. 1971 Mar;14(1):5–13. doi: 10.1044/jshr.1401.05. [DOI] [PubMed] [Google Scholar]
- Sidman M., Tailby W. Conditional discrimination vs. matching to sample: an expansion of the testing paradigm. J Exp Anal Behav. 1982 Jan;37(1):5–22. doi: 10.1901/jeab.1982.37-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Storms M. D. Videotape and the attribution process: reversing actors' and observers' points of view. J Pers Soc Psychol. 1973 Aug;27(2):165–175. doi: 10.1037/h0034782. [DOI] [PubMed] [Google Scholar]
- Wulfert E., Dougher M. J., Greenway D. E. Protocol analysis of the correspondence of verbal behavior and equivalence class formation. J Exp Anal Behav. 1991 Nov;56(3):489–504. doi: 10.1901/jeab.1991.56-489. [DOI] [PMC free article] [PubMed] [Google Scholar]