Abstract
The reliability and validity of the North American paediatric appropriateness evaluation protocol (PAEP) for use in paediatric practice in Britain was tested. The protocol was applied to 418case records of consecutive emergency admissions to three Yorkshire district general hospitals. The PAEP ratings were then compared with a clinical consensus opinion obtained from two expert panels. Altogether 32% of the admissions were rated inappropriate by the PAEP and 36% by the panels. Validity of the PAEP, as measured by agreement beyond chance with the expert panel rating, was only moderate with a κ of 0.29 (95% confidence interval 0.11 to 0.47). The PAEP has limited validity for evaluating British paediatric practice. Utilisation review instruments developed in differing clinical cultures should be used with caution until shown to be valid for the practice setting under review.
Full Text
The Full Text of this article is available as a PDF (120.2 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Coulter I., Adams A., Shekelle P. Impact of varying panel membership on ratings of appropriateness in consensus panels: a comparison of a multi- and single disciplinary panel. Health Serv Res. 1995 Oct;30(4):577–591. [PMC free article] [PubMed] [Google Scholar]
- Feinstein A. R., Cicchetti D. V. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543–549. doi: 10.1016/0895-4356(90)90158-l. [DOI] [PubMed] [Google Scholar]
- Inglis A. L., Coast J., Gray S. F., Peters T. J., Frankel S. J. Appropriateness of hospital utilization. The validity and reliability of the Intensity-Severity-Discharge Review System in a United Kingdom acute hospital setting. Med Care. 1995 Sep;33(9):952–957. [PubMed] [Google Scholar]
- Kemper K. J., Fink H. D., McCarthy P. L. The reliability and validity of the pediatric appropriateness evaluation protocol. QRB Qual Rev Bull. 1989 Mar;15(3):77–80. doi: 10.1016/s0097-5990(16)30269-x. [DOI] [PubMed] [Google Scholar]
- Kemper K. J. Medically inappropriate hospital use in a pediatric population. N Engl J Med. 1988 Apr 21;318(16):1033–1037. doi: 10.1056/NEJM198804213181605. [DOI] [PubMed] [Google Scholar]
- Kreger B. E., Restuccia J. D. Assessing the need to hospitalize children: pediatric appropriateness evaluation protocol. Pediatrics. 1989 Aug;84(2):242–247. [PubMed] [Google Scholar]
- Restuccia J. D. The evolution of hospital utilization review methods in the United States. Int J Qual Health Care. 1995 Sep;7(3):253–260. doi: 10.1093/intqhc/7.3.253. [DOI] [PubMed] [Google Scholar]
- Scott E. A., Black N. Appropriateness of cholecystectomy in the United Kingdom--a consensus panel approach. Gut. 1991 Sep;32(9):1066–1070. doi: 10.1136/gut.32.9.1066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith H. E., Sheps S., Matheson D. S. Assessing the utilization of in-patient facilities in a Canadian pediatric hospital. Pediatrics. 1993 Oct;92(4):587–593. [PubMed] [Google Scholar]
- Strumwasser I., Paranjpe N. V., Ronis D. L., Share D., Sell L. J. Reliability and validity of utilization review criteria. Appropriateness Evaluation Protocol, Standardized Medreview Instrument, and Intensity-Severity-Discharge criteria. Med Care. 1990 Feb;28(2):95–111. doi: 10.1097/00005650-199002000-00001. [DOI] [PubMed] [Google Scholar]
- Thompson W. D., Walter S. D. A reappraisal of the kappa coefficient. J Clin Epidemiol. 1988;41(10):949–958. doi: 10.1016/0895-4356(88)90031-5. [DOI] [PubMed] [Google Scholar]
- Werneke U., MacFaul R. Evaluation of appropriateness of paediatric admission. Arch Dis Child. 1996 Mar;74(3):268–273. doi: 10.1136/adc.74.3.268. [DOI] [PMC free article] [PubMed] [Google Scholar]