Abstract
OBJECTIVE: To determine if a preceptor and timely, individualized feedback improves the performance of physicians in searching MEDLINE using GRATEFUL MED in clinical settings. DESIGN: Randomized controlled trial. SETTING: A 300 bed primary to tertiary care teaching hospital. Computers were installed in wards and clinics of 6 major clinical services, and the emergency room, intensive care and neonatal intensive care units. SUBJECTS: All physicians and physicians-in-training from the departments of Medicine, Family Medicine, Surgery, Psychiatry, Pediatrics, and Obstetrics and Gynecology were included if they made patient care decisions for at least 8 weeks during the study period. INTERVENTION: All participants were given a 1-hour training class and 1 hour of individualized searching with 1 of the 2 study librarians. After training, participants were randomized to a control group who received no further intervention or to an intervention group in which each person chose a clinical preceptor experienced in MEDLINE searching and received individualized feedback by a study librarian on their first 10 searches, indicating search quality and providing suggestions for improvement. Feedback was mailed the first week day after the search was done. MAIN MEASURES: Baseline characteristics by study group, department and level of training, study participation rates, and searching rates. MAIN RESULTS: 308 of 392 eligible physicians joined the study. Participation was almost 80% with some variation by department and level of training. Excellent balance in the baseline characteristics was achieved for the 2 groups, as well as for the number who did first searches. Intervention group participants searched MEDLINE more often than did controls (3.5 searches per month vs 2.5 per month for controls, P = 0.046). The recall and precision for first searches for both groups was significantly less than that of librarians. The analysis of study data will be completed by September 1991. CONCLUSIONS: Clinicians are willing to do self-service searching of MEDLINE in clinical settings but their precision and recall are less than a trained librarian at baseline. Search skills enhancements are needed and the effect of feedback and preceptors is being tested. SOURCE OF FUNDING: U.S. National Library of Medicine and Ontario Ministry of Health.
Full text
PDF




Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Bonham M. D., Nelson L. L. An evaluation of four end-user systems for searching MEDLINE. Bull Med Libr Assoc. 1988 Jan;76(1):22–31. [PMC free article] [PubMed] [Google Scholar]
- Bowen M. On-line literature retrieval as a continuing medical education course. Bull Med Libr Assoc. 1977 Jul;65(3):384–386. [PMC free article] [PubMed] [Google Scholar]
- Haynes R. B., Davis D. A., McKibbon A., Tugwell P. A critical appraisal of the efficacy of continuing medical education. JAMA. 1984 Jan 6;251(1):61–64. [PubMed] [Google Scholar]
- Haynes R. B., McKibbon K. A., Walker C. J., Ramsden M. F. Rapid evolution of microcomputer use in a faculty of health sciences. CMAJ. 1991 Jan 1;144(1):24–28. [PMC free article] [PubMed] [Google Scholar]
- Haynes R. B., McKibbon K. A., Walker C. J., Ryan N., Fitzgerald D., Ramsden M. F. Online access to MEDLINE in clinical settings. A study of use and usefulness. Ann Intern Med. 1990 Jan 1;112(1):78–84. doi: 10.7326/0003-4819-112-1-78. [DOI] [PubMed] [Google Scholar]
- Marshall J. G. End-user training: does it make a difference? Med Ref Serv Q. 1989 Fall;8(3):15–26. doi: 10.1300/J115v08n03_02. [DOI] [PubMed] [Google Scholar]
- McKibbon K. A., Haynes R. B., Baker L. M., Flemming T., Walker C. Teaching clinicians to search MEDLINE: description and evaluation of a short course. Res Med Educ. 1986;25:231–236. [PubMed] [Google Scholar]
- McKibbon K. A., Haynes R. B., Dilks C. J., Ramsden M. F., Ryan N. C., Baker L., Flemming T., Fitzgerald D. How good are clinical MEDLINE searches? A comparative study of clinical end-user and librarian searches. Comput Biomed Res. 1990 Dec;23(6):583–593. doi: 10.1016/0010-4809(90)90042-b. [DOI] [PubMed] [Google Scholar]
- Poisson E. H. End-user searching in medicine. Bull Med Libr Assoc. 1986 Oct;74(4):293–299. [PMC free article] [PubMed] [Google Scholar]
- Sewell W., Teitelbaum S. Observations of end-user online searching behavior over eleven years. J Am Soc Inf Sci. 1986 Jul;37(4):234–245. doi: 10.1002/(SICI)1097-4571(198607)37:4<234::AID-ASI9>3.0.CO;2-A. [DOI] [PubMed] [Google Scholar]
- Walker C. J., McKibbon K. A., Haynes R. B., Ramsden M. F. Problems encountered by clinical end users of MEDLINE and GRATEFUL MED. Bull Med Libr Assoc. 1991 Jan;79(1):67–69. [PMC free article] [PubMed] [Google Scholar]
- Wallingford K. T., Humphreys B. L., Selinger N. E., Siegel E. R. Bibliographic retrieval: a survey of individual users of MEDLINE. MD Comput. 1990 May-Jun;7(3):166–171. [PubMed] [Google Scholar]
- Williamson J. W., German P. S., Weiss R., Skinner E. A., Bowes F., 3rd Health science information management and continuing education of physicians. A survey of U.S. primary care practitioners and their opinion leaders. Ann Intern Med. 1989 Jan 15;110(2):151–160. doi: 10.7326/0003-4819-110-2-151. [DOI] [PubMed] [Google Scholar]
