Abstract
BACKGROUND: It is crucial that research findings are implemented in general practice if high-quality care is to be achieved. Multifaceted interventions are usually assumed to be more effective than single interventions, but this hypothesis has yet to be tested for general practice care. This review evaluates the effectiveness of interventions in influencing the implementation of guidelines and adoption of innovations in general practice. A systematic literature study was carried out using MEDLINE searches for the period from January 1980 until June 1994, and 21 medical journals were searched manually. Randomized controlled trials and controlled before and after studies (with pre- and post-intervention measurements in all groups) were selected for the analysis. Clinical area, interventions used, methodological characteristics and effects on clinical behaviour were noted independently by two researchers using a standardized scoring form. Of 143 studies found, 61 were selected for the analysis, covering 86 intervention groups that could be compared with a control group without the intervention. Information transfer alone was effective in two out of 18 groups, whereas combinations of information transfer and learning through social influence or management support were effective in four out of eight and three out of seven groups respectively. Information linked to performance was effective in 10 out of 15 groups, but the combination of information transfer and information linked to performance was effective in only three out of 20 groups. Some, but not all, multifaceted interventions are effective in inducing change in general practice. Social influence and management support can improve the effectiveness of information transfer, but information linked to performance does not necessarily do so. The variation in the effectiveness of interventions needs further analysis.
Full text
PDF![991](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3706/1409988/105466e40a3d/brjgenprac00089-0045.png)
![992](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3706/1409988/fc9833798c9a/brjgenprac00089-0046.png)
![993](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3706/1409988/5f4e0278c0e8/brjgenprac00089-0047.png)
![994](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3706/1409988/01fc043dcf26/brjgenprac00089-0048.png)
![995](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3706/1409988/25a00363daac/brjgenprac00089-0049.png)
![996](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3706/1409988/130dbd2b70e7/brjgenprac00089-0050.png)
![997](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3706/1409988/da63085e8f3f/brjgenprac00089-0051.png)
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Adams E. K. Effect of increased Medicaid fees on physician participation and enrollee service utilization in Tennessee, 1985-1988. Inquiry. 1994 Summer;31(2):173–187. [PubMed] [Google Scholar]
- Anderson C. M., Chambers S., Clamp M., Dunn I. A., McGhee M. F., Sumner K. R., Wood A. M. Can audit improve patient care? Effects of studying use of digoxin in general practice. BMJ. 1988 Jul 9;297(6641):113–114. doi: 10.1136/bmj.297.6641.113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Armenian H. K., Dajani A. W., Fakhro A. M. Impact of peer review and itemized records on care in a health center in Bahrain. QRB Qual Rev Bull. 1981 Sep;7(9):6–11. [PubMed] [Google Scholar]
- Axt-Adam P., van der Wouden J. C., van der Does E. Influencing behavior of physicians ordering laboratory tests: a literature study. Med Care. 1993 Sep;31(9):784–794. doi: 10.1097/00005650-199309000-00003. [DOI] [PubMed] [Google Scholar]
- Backe B., Jacobsen G. General practitioners' compliance with guidelines for antenatal care. Scand J Prim Health Care. 1994 Jun;12(2):100–105. doi: 10.3109/02813439409003683. [DOI] [PubMed] [Google Scholar]
- Badger L. W., Rand E. H. Unlearning psychiatry: a cohort effect in the training environment. Int J Psychiatry Med. 1988;18(2):123–135. doi: 10.2190/ck2t-ljw5-vy0r-bg45. [DOI] [PubMed] [Google Scholar]
- Baker D., Klein R., Carter R. Impact of the 1990 contract for general practitioners on night visiting. Br J Gen Pract. 1994 Feb;44(379):68–71. [PMC free article] [PubMed] [Google Scholar]
- Barnett G. O., Winickoff R. N., Morgan M. M., Zielstorff R. D. A computer-based monitoring system for follow-up of elevated blood pressure. Med Care. 1983 Apr;21(4):400–409. doi: 10.1097/00005650-198304000-00003. [DOI] [PubMed] [Google Scholar]
- Barnett G. O., Winickoff R., Dorsey J. L., Morgan M. M., Lurie R. S. Quality assurance through automated monitoring and concurrent feedback using a computer-based medical information system. Med Care. 1978 Nov;16(11):962–970. doi: 10.1097/00005650-197811000-00007. [DOI] [PubMed] [Google Scholar]
- Barton M. B., Schoenbaum S. C. Improving influenza vaccination performance in an HMO setting: the use of computer-generated reminders and peer comparison feedback. Am J Public Health. 1990 May;80(5):534–536. doi: 10.2105/ajph.80.5.534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bautz J. B., Schectman J. M., Elinsky E. G., Pawlson L. G. Magnetic resonance imaging. Diffusion of technology in an ambulatory setting. Int J Technol Assess Health Care. 1992 Spring;8(2):301–308. doi: 10.1017/s0266462300013519. [DOI] [PubMed] [Google Scholar]
- Berwick D. M., Coltin K. L. Feedback reduces test use in a health maintenance organization. JAMA. 1986 Mar 21;255(11):1450–1454. [PubMed] [Google Scholar]
- Bingham R. L., Plante D. A., Bronson D. L., Tufo H. M., McKnight K. Establishing a quality improvement process for identification of psychosocial problems in a primary care practice. J Gen Intern Med. 1990 Jul-Aug;5(4):342–346. doi: 10.1007/BF02600403. [DOI] [PubMed] [Google Scholar]
- Bowman M. A., Russell N. K., Boekeloo B. O., Rafi I. Z., Rabin D. L. The effect of educational preparation on physician performance with a sexually transmitted disease-simulated patient. Arch Intern Med. 1992 Sep;152(9):1823–1828. [PubMed] [Google Scholar]
- Bradlow J., Coulter A. Effect of fundholding and indicative prescribing schemes on general practitioners' prescribing costs. BMJ. 1993 Nov 6;307(6913):1186–1189. doi: 10.1136/bmj.307.6913.1186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brink S. G. Provider reminders. Changing information format to increase infant immunizations. Med Care. 1989 Jun;27(6):648–653. doi: 10.1097/00005650-198906000-00007. [DOI] [PubMed] [Google Scholar]
- Brown R. L. Evaluation of a continuing medical education program for primary care physicians on the management of alcoholism. J Med Educ. 1988 Jun;63(6):482–484. doi: 10.1097/00001888-198806000-00013. [DOI] [PubMed] [Google Scholar]
- Buntinx F., Knottnerus J. A., Crebolder H. F., Seegers T., Essed G. G., Schouten H. Does feedback improve the quality of cervical smears? A randomized controlled trial. Br J Gen Pract. 1993 May;43(370):194–198. [PMC free article] [PubMed] [Google Scholar]
- Buntinx F., Winkens R., Grol R., Knottnerus J. A. Influencing diagnostic and preventive performance in ambulatory care by feedback and reminders. A review. Fam Pract. 1993 Jun;10(2):219–228. doi: 10.1093/fampra/10.2.219. [DOI] [PubMed] [Google Scholar]
- Burack R. C., Gimotty P. A., George J., Stengle W., Warbasse L., Moncrease A. Promoting screening mammography in inner-city settings: a randomized controlled trial of computerized reminders as a component of a program to facilitate mammography. Med Care. 1994 Jun;32(6):609–624. doi: 10.1097/00005650-199406000-00006. [DOI] [PubMed] [Google Scholar]
- Cauffman J. G., Rasgon I. M., Mayne J. C., Schubert W. F., Forsyth R. A., Lenoski E. F. Relationship between quality of CME instruction and changes in physicians' patient-management plans. J Med Educ. 1985 Jun;60(6):486–488. doi: 10.1097/00001888-198506000-00011. [DOI] [PubMed] [Google Scholar]
- Cheney C., Ramsdell J. W. Effect of medical records' checklists on implementation of periodic health measures. Am J Med. 1987 Jul;83(1):129–136. doi: 10.1016/0002-9343(87)90507-9. [DOI] [PubMed] [Google Scholar]
- Cherkin D., Deyo R. A., Berg A. O., Bergman J. J., Lishner D. M. Evaluation of a physician education intervention to improve primary care for low-back pain. I. Impact on physicians. Spine (Phila Pa 1976) 1991 Oct;16(10):1168–1172. doi: 10.1097/00007632-199110000-00007. [DOI] [PubMed] [Google Scholar]
- Chodroff C. H. Cancer screening and immunization quality assurance using a personal computer. QRB Qual Rev Bull. 1990 Aug;16(8):279–287. doi: 10.1016/s0097-5990(16)30381-5. [DOI] [PubMed] [Google Scholar]
- Cockburn J., Ruth D., Silagy C., Dobbin M., Reid Y., Scollo M., Naccarella L. Randomised trial of three approaches for marketing smoking cessation programmes to Australian general practitioners. BMJ. 1992 Mar 14;304(6828):691–694. doi: 10.1136/bmj.304.6828.691. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen D. I., Littenberg B., Wetzel C., Neuhauser D. Improving physician compliance with preventive medicine guidelines. Med Care. 1982 Oct;20(10):1040–1045. doi: 10.1097/00005650-198210000-00006. [DOI] [PubMed] [Google Scholar]
- Cohen S. J., Weinberger M., Hui S. L., Tierney W. M., McDonald C. J. The impact of reading on physicians' nonadherence to recommended standards of medical care. Soc Sci Med. 1985;21(8):909–914. doi: 10.1016/0277-9536(85)90147-9. [DOI] [PubMed] [Google Scholar]
- Coulter A., Bradlow J. Effect of NHS reforms on general practitioners' referral patterns. BMJ. 1993 Feb 13;306(6875):433–437. doi: 10.1136/bmj.306.6875.433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Creighton P. A., Evans A. M. Audit of practice based cervical smear programme: completion of the cycle. BMJ. 1992 Apr 11;304(6832):963–966. doi: 10.1136/bmj.304.6832.963. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cummings K. M., Frisof K. B., Long M. J., Hrynkiewich G. The effects of price information on physicians' test-ordering behavior. Ordering of diagnostic tests. Med Care. 1982 Mar;20(3):293–301. doi: 10.1097/00005650-198203000-00006. [DOI] [PubMed] [Google Scholar]
- Curry L., Purkis I. E. Validity of self-reports of behavior changes by participants after a CME course. J Med Educ. 1986 Jul;61(7):579–584. doi: 10.1097/00001888-198607000-00005. [DOI] [PubMed] [Google Scholar]
- Curry R. W., Jr, Crandall L. A., Coggins W. J. The referral process: a study of one method for improving communication between rural practitioners and consultants. J Fam Pract. 1980 Feb;10(2):287–291. [PubMed] [Google Scholar]
- Curtis P., Skinner B., Varenholt J. J., Addison L., Resnick J., Kebede M. Papanicolaou smear quality assurance: providing feedback to physicians. J Fam Pract. 1993 Mar;36(3):309–312. [PubMed] [Google Scholar]
- Davidson R. A., Fletcher S. W., Retchin S., Duh S. A nurse-initiated reminder system for the periodic health examination. Implementation and evaluation. Arch Intern Med. 1984 Nov;144(11):2167–2170. [PubMed] [Google Scholar]
- Davies P. G., Davies J. M. Continuing medical education undertaken by general practitioners using the rural registrar scheme. Med J Aust. 1991 Aug 5;155(3):157–159. doi: 10.5694/j.1326-5377.1991.tb142182.x. [DOI] [PubMed] [Google Scholar]
- Davis D. A., Thomson M. A., Oxman A. D., Haynes R. B. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. JAMA. 1992 Sep 2;268(9):1111–1117. [PubMed] [Google Scholar]
- Dickinson J. C., Warshaw G. A., Gehlbach S. H., Bobula J. A., Muhlbaier L. H., Parkerson G. R., Jr Improving hypertension control: impact of computer feedback and physician education. Med Care. 1981 Aug;19(8):843–854. doi: 10.1097/00005650-198108000-00004. [DOI] [PubMed] [Google Scholar]
- Dietrich A. J., O'Connor G. T., Keller A., Carney P. A., Levy D., Whaley F. S. Cancer: improving early detection and prevention. A community practice randomised trial. BMJ. 1992 Mar 14;304(6828):687–691. doi: 10.1136/bmj.304.6828.687. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Difford F. Reducing prescribing costs through computer controlled repeat prescribing. J R Coll Gen Pract. 1984 Dec;34(269):658–660. [PMC free article] [PubMed] [Google Scholar]
- Dowling P. T., Alfonsi G., Brown M. I., Culpepper L. An education program to reduce unnecessary laboratory tests by residents. Acad Med. 1989 Jul;64(7):410–412. doi: 10.1097/00001888-198907000-00017. [DOI] [PubMed] [Google Scholar]
- Emslie C., Grimshaw J., Templeton A. Do clinical guidelines improve general practice management and referral of infertile couples? BMJ. 1993 Jun 26;306(6894):1728–1731. doi: 10.1136/bmj.306.6894.1728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Erramouspe J. Impact of education by clinical pharmacists on physician ambulatory care prescribing of generic versus brand-name drugs. DICP. 1989 Oct;23(10):770–773. doi: 10.1177/106002808902301005. [DOI] [PubMed] [Google Scholar]
- Evans C. E., Haynes R. B., Birkett N. J., Gilbert J. R., Taylor D. W., Sackett D. L., Johnston M. E., Hewson S. A. Does a mailed continuing education program improve physician performance? Results of a randomized trial in antihypertensive care. JAMA. 1986 Jan 24;255(4):501–504. [PubMed] [Google Scholar]
- Ewart C. K., Li V. C., Coates T. J. Increasing physicians' antismoking influence by applying an inexpensive feedback technique. J Med Educ. 1983 Jun;58(6):468–473. doi: 10.1097/00001888-198306000-00004. [DOI] [PubMed] [Google Scholar]
- Fang W. L., Mills A. S., Wanebo H. J., Zfass A. M. The impact of an educational workshop on colorectal screening practices. J Cancer Educ. 1987;2(1):27–30. doi: 10.1080/08858198709527855. [DOI] [PubMed] [Google Scholar]
- Ferguson K. J., Caplan R. M., Williamson P. S. Factors associated with behavior change in family physicians after CME presentation. J Med Educ. 1984 Aug;59(8):662–666. doi: 10.1097/00001888-198408000-00007. [DOI] [PubMed] [Google Scholar]
- Fleming D. M., Lawrence M. S. Impact of audit on preventive measures. Br Med J (Clin Res Ed) 1983 Dec 17;287(6408):1852–1854. doi: 10.1136/bmj.287.6408.1852. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foley E. C., D'Amico F., Merenstein J. H. Improving mammography recommendation: a nurse-initiated intervention. J Am Board Fam Pract. 1990 Apr-Jun;3(2):87–92. [PubMed] [Google Scholar]
- Frame P. S., Kowulich B. A., Llewellyn A. M. Improving physician compliance with a health maintenance protocol. J Fam Pract. 1984 Sep;19(3):341–344. [PubMed] [Google Scholar]
- Freeman S. W., Chambers C. V. Compliance with universal precautions in a medical practice with a high rate of HIV infection. J Am Board Fam Pract. 1992 May-Jun;5(3):313–318. [PubMed] [Google Scholar]
- Fullard E., Fowler G., Gray M. Promoting prevention in primary care: controlled trial of low technology, low cost approach. Br Med J (Clin Res Ed) 1987 Apr 25;294(6579):1080–1082. doi: 10.1136/bmj.294.6579.1080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gehlbach S. H., Wilkinson W. E., Hammond W. E., Clapp N. E., Finn A. L., Taylor W. J., Rodell M. S. Improving drug prescribing in a primary care practice. Med Care. 1984 Mar;22(3):193–201. doi: 10.1097/00005650-198403000-00002. [DOI] [PubMed] [Google Scholar]
- German P. S., Shapiro S., Skinner E. A., Von Korff M., Klein L. E., Turner R. W., Teitelbaum M. L., Burke J., Burns B. J. Detection and management of mental health problems of older patients by primary care providers. JAMA. 1987 Jan 23;257(4):489–493. [PubMed] [Google Scholar]
- Geyman J. P., Gordon M. J. Learning outcomes and practice changes after a postgraduate course in office orthopedics. J Fam Pract. 1982 Jul;15(1):131–136. [PubMed] [Google Scholar]
- Gilio C., Buntinx F., De Kezel O., Scheys I. The influence of a desk-top analyser on the number of laboratory tests used in daily general practice. A randomized controlled trial. Fam Pract. 1993 Jun;10(2):118–123. doi: 10.1093/fampra/10.2.118. [DOI] [PubMed] [Google Scholar]
- Grant G. B., Gregory D. A., van Zwanenberg T. D. Development of a limited formulary for general practice. Lancet. 1985 May 4;1(8436):1030–1032. doi: 10.1016/s0140-6736(85)91625-3. [DOI] [PubMed] [Google Scholar]
- Greco P. J., Eisenberg J. M. Changing physicians' practices. N Engl J Med. 1993 Oct 21;329(17):1271–1273. doi: 10.1056/NEJM199310213291714. [DOI] [PubMed] [Google Scholar]
- Grilli R., Lomas J. Evaluating the message: the relationship between compliance rate and the subject of a practice guideline. Med Care. 1994 Mar;32(3):202–213. doi: 10.1097/00005650-199403000-00002. [DOI] [PubMed] [Google Scholar]
- Grimshaw J. M., Russell I. T. Achieving health gain through clinical guidelines II: Ensuring guidelines change medical practice. Qual Health Care. 1994 Mar;3(1):45–52. doi: 10.1136/qshc.3.1.45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grimshaw J. M., Russell I. T. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993 Nov 27;342(8883):1317–1322. doi: 10.1016/0140-6736(93)92244-n. [DOI] [PubMed] [Google Scholar]
- Grimshaw J., Freemantle N., Wallace S., Russell I., Hurwitz B., Watt I., Long A., Sheldon T. Developing and implementing clinical practice guidelines. Qual Health Care. 1995 Mar;4(1):55–64. doi: 10.1136/qshc.4.1.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grol R. Implementing guidelines in general practice care. Qual Health Care. 1992 Sep;1(3):184–191. doi: 10.1136/qshc.1.3.184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grol R., Mokkink H., Schellevis F. The effects of peer review in general practice. J R Coll Gen Pract. 1988 Jan;38(306):10–13. [PMC free article] [PubMed] [Google Scholar]
- Groveman H. D., Sanowski R. A., Klauber M. R. Training primary care physicians in flexible sigmoidoscopy--performance evaluation of 17,167 procedures. West J Med. 1988 Feb;148(2):221–224. [PMC free article] [PubMed] [Google Scholar]
- Gruesser M., Bott U., Ellermann P., Kronsbein P., Joergens V. Evaluation of a structured treatment and teaching program for non-insulin-treated type II diabetic outpatients in Germany after the nationwide introduction of reimbursement policy for physicians. Diabetes Care. 1993 Sep;16(9):1268–1275. doi: 10.2337/diacare.16.9.1268. [DOI] [PubMed] [Google Scholar]
- Gunther P. G., Bingham R. L. A continuous quality improvement cycle for teaching the identification of psychosocial problems to general internal medicine residents. Acad Med. 1993 Apr;68(4):308–310. doi: 10.1097/00001888-199304000-00022. [DOI] [PubMed] [Google Scholar]
- Gutiérrez G., Guiscafré H., Bronfman M., Walsh J., Martínez H., Muñoz O. Changing physician prescribing patterns: evaluation of an educational strategy for acute diarrhea in Mexico City. Med Care. 1994 May;32(5):436–446. [PubMed] [Google Scholar]
- Hallas J., Harvald B., Worm J., Beck-Nielsen J., Gram L. F., Grodum E., Damsbo N., Schou J., Kromann-Andersen H., Frølund F. Drug related hospital admissions. Results from an intervention program. Eur J Clin Pharmacol. 1993;45(3):199–203. doi: 10.1007/BF00315383. [DOI] [PubMed] [Google Scholar]
- Hamley J. G., Brown S. V., Crooks J., Knox J. D., Murdoch J. C., Patterson A. W. Prescribing in general practice and the provision of drug information. J R Coll Gen Pract. 1981 Nov;31(232):654–660. [PMC free article] [PubMed] [Google Scholar]
- Harris C. M., Fry J., Jarman B., Woodman E. Prescribing--a case for prolonged treatment. J R Coll Gen Pract. 1985 Jun;35(275):284–287. [PMC free article] [PubMed] [Google Scholar]
- Hemenway D., Killen A., Cashman S. B., Parks C. L., Bicknell W. J. Physicians' responses to financial incentives. Evidence from a for-profit ambulatory care center. N Engl J Med. 1990 Apr 12;322(15):1059–1063. doi: 10.1056/NEJM199004123221507. [DOI] [PubMed] [Google Scholar]
- Hershey C. O., Porter D. K., Breslau D., Cohen D. I. Influence of simple computerized feedback on prescription charges in an ambulatory clinic. A randomized clinical trial. Med Care. 1986 Jun;24(6):472–481. doi: 10.1097/00005650-198606000-00002. [DOI] [PubMed] [Google Scholar]
- Inui T. S., Yourtee E. L., Williamson J. W. Improved outcomes in hypertension after physician tutorials. A controlled trial. Ann Intern Med. 1976 Jun;84(6):646–651. doi: 10.7326/0003-4819-84-6-646. [DOI] [PubMed] [Google Scholar]
- Ives T. J., Frey J. J., Furr S. J., Bentz E. J. Effect of an educational intervention on oral cephalosporin use in primary care. Arch Intern Med. 1987 Jan;147(1):44–47. [PubMed] [Google Scholar]
- Jennett P. A., Laxdal O. E., Hayton R. C., Klaassen D. J., Swanson R. W., Wilson T. W., Spooner H. J., Mainprize G. W., Wickett R. E. The effects of continuing medical education on family doctor performance in office practice: a randomized control study. Med Educ. 1988 Mar;22(2):139–145. doi: 10.1111/j.1365-2923.1988.tb00424.x. [DOI] [PubMed] [Google Scholar]
- Johnston M. E., Langton K. B., Haynes R. B., Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994 Jan 15;120(2):135–142. doi: 10.7326/0003-4819-120-2-199401150-00007. [DOI] [PubMed] [Google Scholar]
- Jones R. H., Lydeard S., Dunleavey J. Problems with implementing guidelines: a randomised controlled trial of consensus management of dyspepsia. Qual Health Care. 1993 Dec;2(4):217–221. doi: 10.1136/qshc.2.4.217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kibbe D. C., Bentz E., McLaughlin C. P. Continuous quality improvement for continuity of care. J Fam Pract. 1993 Mar;36(3):304–308. [PubMed] [Google Scholar]
- Kimberlin C. L., Berardo D. H., Pendergast J. F., McKenzie L. C. Effects of an education program for community pharmacists on detecting drug-related problems in elderly patients. Med Care. 1993 May;31(5):451–468. doi: 10.1097/00005650-199305000-00007. [DOI] [PubMed] [Google Scholar]
- Klein L. E., Charache P., Johannes R. S. Effect of physician tutorials on prescribing patterns of graduate physicians. J Med Educ. 1981 Jun;56(6):504–511. doi: 10.1097/00001888-198106000-00007. [DOI] [PubMed] [Google Scholar]
- Kottke T. E., Brekke M. L., Solberg L. I., Hughes J. R. A randomized trial to increase smoking intervention by physicians. Doctors Helping Smokers, Round I. JAMA. 1989 Apr 14;261(14):2101–2106. [PubMed] [Google Scholar]
- Kronsbein P., Jörgens V., Mühlhauser I., Scholz V., Venhaus A., Berger M. Evaluation of a structured treatment and teaching programme on non-insulin-dependent diabetes. Lancet. 1988 Dec 17;2(8625):1407–1411. doi: 10.1016/s0140-6736(88)90595-8. [DOI] [PubMed] [Google Scholar]
- Lane D. S., Polednak A. P., Burg M. A. Effect of continuing medical education and cost reduction on physician compliance with mammography screening guidelines. J Fam Pract. 1991 Oct;33(4):359–368. [PubMed] [Google Scholar]
- Lassen L. C., Kristensen F. B. Peer comparison feedback to achieve rational and economical drug therapy in general practice: a controlled intervention study. Scand J Prim Health Care. 1992 Mar;10(1):76–80. doi: 10.3109/02813439209014040. [DOI] [PubMed] [Google Scholar]
- Lee D. W., Gillis K. D. Physician responses to Medicare physician payment reform: preliminary results on access to care. Inquiry. 1993 Winter;30(4):417–428. [PubMed] [Google Scholar]
- Levinson W., Roter D. The effects of two continuing medical education programs on communication skills of practicing primary care physicians. J Gen Intern Med. 1993 Jun;8(6):318–324. doi: 10.1007/BF02600146. [DOI] [PubMed] [Google Scholar]
- Madlon-Kay D. J. Improvement in family physician recognition and treatment of hypercholesterolemia. Arch Intern Med. 1989 Aug;149(8):1754–1755. [PubMed] [Google Scholar]
- Mandel I., Franks P., Dickinson J. Improving physician compliance with preventive medicine guidelines. J Fam Pract. 1985 Sep;21(3):223–224. [PubMed] [Google Scholar]
- Marton K. I., Tul V., Sox H. C., Jr Modifying test-ordering behavior in the outpatient medical clinic. A controlled trial of two educational interventions. Arch Intern Med. 1985 May;145(5):816–821. [PubMed] [Google Scholar]
- Mazze R., Deeb L., Palumbo P. J. Altering physicians' practice patterns--a nationwide educational experiment: evaluation of the Clinical Education Program of the American Diabetes Association. Diabetes Care. 1986 Jul-Aug;9(4):420–425. doi: 10.2337/diacare.9.4.420. [DOI] [PubMed] [Google Scholar]
- McAlister N. H., Covvey H. D., Tong C., Lee A., Wigle E. D. Randomised controlled trial of computer assisted management of hypertension in primary care. Br Med J (Clin Res Ed) 1986 Sep 13;293(6548):670–674. doi: 10.1136/bmj.293.6548.670. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McDonald C. J., Hui S. L., Smith D. M., Tierney W. M., Cohen S. J., Weinberger M., McCabe G. P. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984 Jan;100(1):130–138. doi: 10.7326/0003-4819-100-1-130. [DOI] [PubMed] [Google Scholar]
- McDonald C. J., Wilson G. A., McCabe G. P., Jr Physician response to computer reminders. JAMA. 1980 Oct 3;244(14):1579–1581. [PubMed] [Google Scholar]
- McPhee S. J., Bird J. A., Jenkins C. N., Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Arch Intern Med. 1989 Aug;149(8):1866–1872. doi: 10.1001/archinte.149.8.1866. [DOI] [PubMed] [Google Scholar]
- Mendelson M. Automated reminders do not always improve follow-up of abnormal test results. Comput Biol Med. 1986;16(2):131–134. doi: 10.1016/0010-4825(86)90036-3. [DOI] [PubMed] [Google Scholar]
- Mugford M., Banfield P., O'Hanlon M. Effects of feedback of information on clinical practice: a review. BMJ. 1991 Aug 17;303(6799):398–402. doi: 10.1136/bmj.303.6799.398. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nesbitt T. S., Davidson R. C., Paliescheskey M., Fox-Garcia J., Arevalo J. A. Trends in maternity care by graduates and the effect of an intervention. Fam Med. 1994 Mar;26(3):149–153. [PubMed] [Google Scholar]
- Norton P. G., Dempsey L. J. Self-audit: its effect on quality of care. J Fam Pract. 1985 Oct;21(4):289–291. [PubMed] [Google Scholar]
- Oakeshott P., Kerry S. M., Williams J. E. Randomized controlled trial of the effect of the Royal College of Radiologists' guidelines on general practitioners' referrals for radiographic examination. Br J Gen Pract. 1994 May;44(382):197–200. [PMC free article] [PubMed] [Google Scholar]
- Ornstein S. M., Garr D. R., Jenkins R. G., Rust P. F., Arnon A. Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. J Fam Pract. 1991 Jan;32(1):82–90. [PubMed] [Google Scholar]
- Oxman A. D., Clarke M. J., Stewart L. A. From science to practice. Meta-analyses using individual patient data are needed. JAMA. 1995 Sep 13;274(10):845–846. doi: 10.1001/jama.274.10.845. [DOI] [PubMed] [Google Scholar]
- Palm B. T., Kant A. C., van den Bosch W. J., Vooijs G. P., van Weel C. Preliminary results of a general practice based call system for cervical cancer screening in The Netherlands. Br J Gen Pract. 1993 Dec;43(377):503–506. [PMC free article] [PubMed] [Google Scholar]
- Palmer R. H., Louis T. A., Hsu L. N., Peterson H. F., Rothrock J. K., Strain R., Thompson M. S., Wright E. A. A randomized controlled trial of quality assurance in sixteen ambulatory care practices. Med Care. 1985 Jun;23(6):751–770. doi: 10.1097/00005650-198506000-00001. [DOI] [PubMed] [Google Scholar]
- Payne B. C., Lyons T. F., Neuhaus E., Kolton M., Dwarshius L. Method of evaluating and improving ambulatory medical care. Health Serv Res. 1984 Jun;19(2):219–245. [PMC free article] [PubMed] [Google Scholar]
- Perera D. R., LoGerfo J. P., Shulenberger E., Ylvisaker J. T., Kirz H. L. Teaching sigmoidoscopy to primary care physicians: a controlled study of continuing medical education. J Fam Pract. 1983 Apr;16(4):785–788. [PubMed] [Google Scholar]
- Pinkerton R. E., Tinanoff N., Willms J. L., Tapp J. T. Resident physician performance in a continuing education format. Does newly acquired knowledge improve patient care? JAMA. 1980 Nov 14;244(19):2183–2185. [PubMed] [Google Scholar]
- Pommerenke F. A., Weed D. L. Physician compliance: improving skills in preventive medicine practices. Am Fam Physician. 1991 Feb;43(2):560–568. [PubMed] [Google Scholar]
- Pond C. D., Mant A., Kehoe L., Hewitt H., Brodaty H. General practitioner diagnosis of depression and dementia in the elderly: can academic detailing make a difference? Fam Pract. 1994 Jun;11(2):141–147. doi: 10.1093/fampra/11.2.141. [DOI] [PubMed] [Google Scholar]
- Poses R. M., Cebul R. D., Wigton R. S., Centor R. M., Collins M., Fleischli G. Controlled trial using computerized feedback to improve physicians' diagnostic judgments. Acad Med. 1992 May;67(5):345–347. doi: 10.1097/00001888-199205000-00017. [DOI] [PubMed] [Google Scholar]
- Rich E. C., Schlossberg L., Luxenberg M., Korn J. Influence of a preventive care educational intervention on physician knowledge, attitudes, beliefs, and practice. Prev Med. 1989 Nov;18(6):847–855. doi: 10.1016/0091-7435(89)90020-0. [DOI] [PubMed] [Google Scholar]
- Robinson J. D. Pharmacokinetics service for ambulatory patients. Am J Hosp Pharm. 1981 Nov;38(11):1713–1716. [PubMed] [Google Scholar]
- Robinson M. B. Evaluation of medical audit. J Epidemiol Community Health. 1994 Oct;48(5):435–440. doi: 10.1136/jech.48.5.435. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rodney W. M., Albers G. Flexible sigmoidoscopy: primary care outcomes after two types of continuing medical education. Am J Gastroenterol. 1986 Feb;81(2):133–137. [PubMed] [Google Scholar]
- Rodney W. M., Beaber R. J., Johnson R., Quan M. Physician compliance with colorectal cancer screening (1978-1983): the impact of flexible sigmoidoscopy. J Fam Pract. 1985 Mar;20(3):265–269. [PubMed] [Google Scholar]
- Rodney W. M., Chopivsky P., Quan M. Adult immunization: the medical record design as a facilitator for physician compliance. J Med Educ. 1983 Jul;58(7):576–580. [PubMed] [Google Scholar]
- Ross A. K., Lawton W. A. Evaluation of a course for general practitioners on muscles and joints. Br Med J (Clin Res Ed) 1984 Feb 25;288(6417):609–612. doi: 10.1136/bmj.288.6417.609. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rosser W. W., Palmer W. H. Dissemination of guidelines on cholesterol. Effect on patterns of practice of general practitioners and family physicians in Ontario. Ontario Task Force on the Use and Provision of Medical Services. Can Fam Physician. 1993 Feb;39:280–284. [PMC free article] [PubMed] [Google Scholar]
- Rosser W. W. Using the perception-reality gap to alter prescribing patterns. J Med Educ. 1983 Sep;58(9):728–732. doi: 10.1097/00001888-198309000-00008. [DOI] [PubMed] [Google Scholar]
- Schaap N. P., Houben M. H., Driessen W. M., van Spreeuwel J. P. Endoscopisch onderzoek van de tractus digestivus als service voor de huisarts; ervaringen in de regio Eindhoven. Ned Tijdschr Geneeskd. 1993 Jun 5;137(23):1142–1146. [PubMed] [Google Scholar]
- Schaffner W., Ray W. A., Federspiel C. F., Miller W. O. Improving antibiotic prescribing in office practice. A controlled trial of three educational methods. JAMA. 1983 Oct 7;250(13):1728–1732. [PubMed] [Google Scholar]
- Schectman J. M., Elinsky E. G., Bartman B. A. Primary care clinician compliance with cholesterol treatment guidelines. J Gen Intern Med. 1991 Mar-Apr;6(2):121–125. doi: 10.1007/BF02598306. [DOI] [PubMed] [Google Scholar]
- Schectman J. M., Elinsky E. G., Pawlson L. G. Effect of education and feedback on thyroid function testing strategies of primary care clinicians. Arch Intern Med. 1991 Nov;151(11):2163–2166. [PubMed] [Google Scholar]
- Shapiro S., German P. S., Skinner E. A., VonKorff M., Turner R. W., Klein L. E., Teitelbaum M. L., Kramer M., Burke J. D., Jr, Burns B. J. An experiment to change detection and management of mental morbidity in primary care. Med Care. 1987 Apr;25(4):327–339. doi: 10.1097/00005650-198704000-00006. [DOI] [PubMed] [Google Scholar]
- Shaughnessy A. F., D'Amico F. Long-term experience with a program to improve prescription-writing skills. Fam Med. 1994 Mar;26(3):168–171. [PubMed] [Google Scholar]
- Sibley J. C., Sackett D. L., Neufeld V., Gerrard B., Rudnick K. V., Fraser W. A randomized trial of continuing medical education. N Engl J Med. 1982 Mar 4;306(9):511–515. doi: 10.1056/NEJM198203043060904. [DOI] [PubMed] [Google Scholar]
- Smith D. A., Schnall P. L. Improved hypertension control using a surveillance system in a neighborhood health center. Med Care. 1980 Jul;18(7):766–774. doi: 10.1097/00005650-198007000-00006. [DOI] [PubMed] [Google Scholar]
- Soumerai S. B., Avorn J. Economic and policy analysis of university-based drug "detailing". Med Care. 1986 Apr;24(4):313–331. doi: 10.1097/00005650-198604000-00003. [DOI] [PubMed] [Google Scholar]
- Soumerai S. B., McLaughlin T. J., Avorn J. Quality assurance for drug prescribing. Qual Assur Health Care. 1990;2(1):37–58. doi: 10.1093/intqhc/2.1.37. [DOI] [PubMed] [Google Scholar]
- Stross J. K., Bole G. G. Evaluation of a continuing education program in rheumatoid arthritis. Arthritis Rheum. 1980 Jul;23(7):846–849. doi: 10.1002/art.1780230711. [DOI] [PubMed] [Google Scholar]
- Stross J. K., Hiss R. G., Watts C. M., Davis W. K., Macdonald R. Continuing education in pulmonary disease for primary-care physicians. Am Rev Respir Dis. 1983 Jun;127(6):739–746. doi: 10.1164/arrd.1983.127.6.739. [DOI] [PubMed] [Google Scholar]
- Sullivan R. J., Jr, Estes E. H., Jr, Stopford W., Lester A. J. Adherence to explicit strategies for common medical conditions. Med Care. 1980 Apr;18(4):388–399. doi: 10.1097/00005650-198004000-00004. [DOI] [PubMed] [Google Scholar]
- Szczepura A., Wilmot J., Davies C., Fletcher J. Effectiveness and cost of different strategies for information feedback in general practice. Br J Gen Pract. 1994 Jan;44(378):19–24. [PMC free article] [PubMed] [Google Scholar]
- Tierney W. M., Hui S. L., McDonald C. J. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986 Aug;24(8):659–666. doi: 10.1097/00005650-198608000-00001. [DOI] [PubMed] [Google Scholar]
- Tierney W. M., McDonald C. J., Hui S. L., Martin D. K. Computer predictions of abnormal test results. Effects on outpatient testing. JAMA. 1988 Feb 26;259(8):1194–1198. [PubMed] [Google Scholar]
- Tierney W. M., McDonald C. J., Martin D. K., Rogers M. P. Computerized display of past test results. Effect on outpatient testing. Ann Intern Med. 1987 Oct;107(4):569–574. doi: 10.7326/0003-4819-107-4-569. [DOI] [PubMed] [Google Scholar]
- Tierney W. M., Miller M. E., McDonald C. J. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990 May 24;322(21):1499–1504. doi: 10.1056/NEJM199005243222105. [DOI] [PubMed] [Google Scholar]
- Tracey J. M. Peer review. Part 2: The influence of internal and external standards on outcome. N Z Med J. 1991 Feb 27;104(906):66–67. [PubMed] [Google Scholar]
- Tse M., Bridges-Webb C., Bauman A. The impact of a mass communications campaign on the reported management of asthma by general practitioners. Fam Pract. 1993 Sep;10(3):263–267. doi: 10.1093/fampra/10.3.263. [DOI] [PubMed] [Google Scholar]
- Varma J. R., Schuman B. M., Miller M. D., Murphy D. The practice outcomes of a course in flexible sigmoidoscopy for primary care physicians. J Med Assoc Ga. 1991 Dec;80(12):711–714. [PubMed] [Google Scholar]
- Verby J. E., Holden P., Davis R. H. Peer review of consultations in primary care: the use of audiovisual recordings. Br Med J. 1979 Jun 23;1(6179):1686–1688. doi: 10.1136/bmj.1.6179.1686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weingarten M. A., Bazel D., Shannon H. S. Computerized protocol for preventive medicine: a controlled self-audit in family practice. Fam Pract. 1989 Jun;6(2):120–124. doi: 10.1093/fampra/6.2.120. [DOI] [PubMed] [Google Scholar]
- Weisman C. S., Morlock L. L., Teitelbaum M. A., Klassen A. C., Celentano D. D. Practice changes in response to the malpractice litigation climate. Results of a Maryland physician survey. Med Care. 1989 Jan;27(1):16–24. doi: 10.1097/00005650-198901000-00002. [DOI] [PubMed] [Google Scholar]
- Wensing M., Grol R. Single and combined strategies for implementing changes in primary care: a literature review. Int J Qual Health Care. 1994 Jun;6(2):115–132. doi: 10.1093/intqhc/6.2.115. [DOI] [PubMed] [Google Scholar]
- Whewell P. J., Gore V. A., Leach C. Training general practitioners to improve their recognition of emotional disturbance in the consultation. J R Coll Gen Pract. 1988 Jun;38(311):259–262. [PMC free article] [PubMed] [Google Scholar]
- White P. T., Pharoah C. A., Anderson H. R., Freeling P. Randomized controlled trial of small group education on the outcome of chronic asthma in general practice. J R Coll Gen Pract. 1989 May;39(322):182–186. [PMC free article] [PubMed] [Google Scholar]
- Winickoff R. N., Coltin K. L., Morgan M. M., Buxbaum R. C., Barnett G. O. Improving physician performance through peer comparison feedback. Med Care. 1984 Jun;22(6):527–534. doi: 10.1097/00005650-198406000-00003. [DOI] [PubMed] [Google Scholar]
- Winkens R. A., Pop P., Grol R. P., Kester A. D., Knottnerus J. A. Effect of feedback on test ordering behaviour of general practitioners. BMJ. 1992 Apr 25;304(6834):1093–1096. doi: 10.1136/bmj.304.6834.1093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yeo G. T., de Burgh S. P., Letton T., Shaw J., Donnelly N., Swinburn M. E., Phillips S., Bridges-Webb C., Mant A. Educational visiting and hypnosedative prescribing in general practice. Fam Pract. 1994 Mar;11(1):57–61. doi: 10.1093/fampra/11.1.57. [DOI] [PubMed] [Google Scholar]
- Zaat J. O., van Eijk J. T., Bonte H. A. Laboratory test form design influences test ordering by general practitioners in The Netherlands. Med Care. 1992 Mar;30(3):189–198. doi: 10.1097/00005650-199203000-00001. [DOI] [PubMed] [Google Scholar]
- Zapka J. G., Harris D. R., Hosmer D., Costanza M. E., Mas E., Barth R. Effect of a community health center intervention on breast cancer screening among Hispanic American women. Health Serv Res. 1993 Jun;28(2):223–235. [PMC free article] [PubMed] [Google Scholar]