Abstract
Objetivo
Diseñar un cuestionario para evaluar el cumplimiento de criterios de calidad de sitios web sanitarios y analizar su fiabilidad.
Diseño
Estudio descriptivo de la fiabilidad de un cuestionario.
Participantes
Veinte sitios web relacionados con salud.
Emplazamiento
Internet.
Mediciones principales
El cuestionario se diseñó a partir de los criterios del código de conducta e-Europe 2002, comparándolos con los del AMA, Summit, e-Health Code of Ethics, normativa y directrices vigentes. Las dimensiones estudiadas fueron la transparencia y la ausencia de conflicto de intereses, autoría, protección de datos, actualización, responsabilidad y accesibilidad. Se elaboró un cuestionario preliminar, se midió la fiabilidad, se efectuaron ajustes y se diseñó el definitivo. Se evaluó nuevamente la fiabilidad utilizando 26 sitios web por parte de 3 investigadores. La concordancia se midió con el índice kappa de Cohen.
Resultados
En el cuestionario diseñado se incluyeron todas las directrices de calidad de la guía Europea e-Europe 2002, la normativa Europea y los aspectos relevantes contemplados por otros códigos. Se obtuvo una fiabilidad aceptable (kappa ≥ 0,60) para 12 de los 18 criterios incluidos. Los aspectos menos concordantes fueron actualización (kappa = 0,310) y accesibilidad (búsqueda de contenidos y acceso para discapacitados).
Conclusiones
Se obtuvo un cuestionario con una fiabilidad aceptable.
Palabras clave: e-Health, Calidad, Internet
Abstract
Objectives
To design a questionnaire to evaluate compliance with quality criteria on health web sites and to analyse its reliability.
Design
A descriptive study on the reliability of a questionnaire.
Participants
Twenty web sites on health topics.
Setting
Internet.
Main measurements
The questionnaire was based on analysis of content of the criteria of the e-Europe 2002 code of conduct, comparing these with the criteria underlying the AMA, the Summit code and the e-Health Code of Ethics regulations and current directives. The dimensions studied were transparency, absence of conflicts of interest, authorship, data protection, updating, accountability, and accessibility. A preliminary questionnaire was drawn up for a pilot test conducted by 3 researchers for 20 web sites, its reliability was appraised, adjustments were made and the definitive questionnaire was designed. Reliability was evaluated again for 26 web sites evaluated by 3 researchers. To evaluate concordance in the answers of the participants, Cohen’s Kappa index with a 95% confidence level was used.
Results
All the quality directives of e- Europe 2002, the European regulations and relevant points from other questionnaires were included in the questionnaire designed. Reliability was acceptable (kappa ≥0.60) for 12 of the 18 quality criteria included. The least concordant aspects of the questionnaire were information update (kappa =0.310) and accessibility (search for contents and access for persons with disability).
Conclusions
Reliability of the questionnaire designed was acceptable.
Key words: e-Health, Quality, Internet
Footnotes
Fuente de financiación: Red de Centros de Epidemiología y Salud Pública.
Bibliografía
- 1.Makus R. Ethics and Internet healthcare: an ontological reflection. Camb Q Healthc Ethics. 2001;10:127–136. doi: 10.1017/s0963180101002031. [DOI] [PubMed] [Google Scholar]
- 2.Meric F., Bernstam E.V., Mirza N.Q., Hunt K.K., Ames F.C., Ross M.I. Breast cancer on the world wide web: cross sectional survey of quality of information and popularity of websites. BMJ. 2002;324:577–581. doi: 10.1136/bmj.324.7337.577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Resnik D. Patient access to medical information in the computer age: ethical concerns and issues. Camb Q Healthc Ethics. 2001;10:147–154. doi: 10.1017/s0963180101002055. [DOI] [PubMed] [Google Scholar]
- 4.Crocco A.G., Villasis-Keever M., Jadad A.R. Analysis of cases of harm associated with use of health information on the internet. JAMA. 2002;287:2869–2871. doi: 10.1001/jama.287.21.2869. [DOI] [PubMed] [Google Scholar]
- 5.Jadad A.R., Gagliardi A. Rating health information on the Internet: navigating to knowledge or to Babel? JAMA. 1998;279:611–614. doi: 10.1001/jama.279.8.611. [DOI] [PubMed] [Google Scholar]
- 6.Kim P., Eng T.R., Deering M.J., Maxfield A. Published criteria for evaluating health related web sites: review. BMJ. 1999;318:647–649. doi: 10.1136/bmj.318.7184.647. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Gagliardi A., Jadad A.R. Examination of instruments used to rate quality of health information on the internet: chronicle of a voyage with an unclear destination. BMJ. 2002;324:569–573. doi: 10.1136/bmj.324.7337.569. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Eysenbach G., Powell., Kuss O., Sa E. Empirical studies assessing the quality of health information for consumers on the World Wide Web: a systematic review. JAMA. 2002;287:2691–2695. doi: 10.1001/jama.287.20.2691. [DOI] [PubMed] [Google Scholar]
- 9.Bernstam E.V., Shelton D., Walji M., Meric-Bernstam F. Instruments to asses the quality of health information on the World Wide Web: What can our patients actually use? Int J Med Inform. 2005;74:13–19. doi: 10.1016/j.ijmedinf.2004.10.001. [DOI] [PubMed] [Google Scholar]
- 10.Commission of the European Communities. e-Europe 2002: Quality criteria for health related websites [documento en internet]. Bruselas, 2002 [citado 10 Oct 2004]. Disponible en: http://europa.eu.int/information_society/eeurope/ehealth/doc/communication_acte_en_fin.pdf [DOI] [PMC free article] [PubMed]
- 11.Wilson P., Risk A. How to find the good and avoid the bad or ugly: A short guide to tools for rating quality of health information on the Internet. BMJ. 2002;324:598–599. doi: 10.1136/bmj.324.7337.598. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Winker MA, Flanagin A, Chi-Lum B, White J, Andrews K; Kennett RL; DeAngelis KD, Musacchio RA, Guidelines for Medical and Health Information Sites on the Internet: Principles Governing AMA Web Sites [documento en internet]. Chicago, 2000 [citado 10 Oct 2004]. Disponible en: http://www.ama-assn.org/ama/pub/category/1905.html [DOI] [PubMed]
- 13.Internet Healthcare Coalition. Código de Ética de e-Salud [documento en internet]. Newtown, 2000 [citado 10 Oct 2004]. Disponible en: http://www.ihealthcoalition.org/ethics/spanish-code.html
- 14.Ambre J, Guard R, Perveiler FM, Renner J, Rippen H. Criteria for Assessing the Quality of Health Information on the Internet [documento en internet]. Washington, 1997 [citado 10 Oct 2004]. Disponible en: http://hitiweb.mitretek.org/docs/crite-ria.html
- 15.European Community. E-Europe 2002: Quality Criteria for Health-related Website [documento en internet]. Bruselas, 1997 [citado 10 Oct 2004]. Disponible en: http://europa.eu.int/information_society/eeurope/ehealth/doc/communication_acte_en_f in.pdf
- 16.Sarrias R, Mayer MA, Latorre M. Accredited Medical web: an experience in Spain. J Med Internet Res [revista en internet] 2000; 2 Suppl 2:e5 [citado 10 Oct 2004]. Disponible en: http://www.jmir.org/2000/suppl2/e5/
- 17.Ávila de Tomás J.F., Portillo B.E., Pajares J.M. Calidad en la información biomédica existente en Internet. Aten Primaria. 2001;28:674–679. doi: 10.1016/S0212-6567(01)70483-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Rancaño I., Rodrigo J.A., Villa R., Abdelsater M., Días R., Álvarez D. Evaluación de las páginas web en lengua española útiles para el médico de atención primaria. Aten Primaria. 2003;31:575–584. doi: 10.1016/S0212-6567(03)79219-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Baur C, Deering MJ. Proposed Frameworks to Improve the Quality of Health Web Sites: Review. MedGenMed 2000 [citado 10 Oct 2004]. Disponible en: http://www.medscape.com/medsca-pe/GeneralMedicine/journal/2000/v02.n05/mg m0926.baur/mgm0926.baur-01.h [PubMed]
- 20.Risk A, Dzenowagis J. Review of Internet Health Information Quality Initiatives. J Med Internet Res [revista en internet] 2001;3(4):e28 [citado 10 Jul 2005]. Disponible en: http://www.jmir.org/2001/4/e28/ [DOI] [PMC free article] [PubMed]
- 21.Organización de cooperación y desarrollo económico –OCDE. Guidelines for consumer protection in the context of ElectronicCommerce [documento en internet]. París, 2000 [citado 10 Ene 2005]. Disponible en: http://www1.oecd.org/publications/e-book/ 9300023e.pdf
- 22.Organización europea de consumidores -BEUC. e-Confidence project [documento en internet]. Bruselas, 2001 [citado 10 Ene 2005]. Disponible en: http://europa.eu.int/comm/consumers/cons_int/ecommerce/e-conf_working_annexe.pdf
- 23.World Wide Web Consortium (W3C) Recommendations [documento en internet] [citado 10 Nov 2005]. Disponible en: http://www.w3.org/TR/1999/WAI-WEBCONTENT-19990324/wai-pageauth.html
- 24.Antequera J.M. La ‘e-gestion’ en la sociedad de la información: internet y nuevas tecnologías en el desarrollo del objeto social de la empresa en el siglo XXI. La «e-Health». In: Antequera J.M., Arias E., editors. Sistema sanitario y recursos humanos. Díaz de Santos; Madrid: 2005. pp. 469–492. [Google Scholar]
- 25.EFQM; Bruselas: 2003. European Foundation Quality Management EFQM de Excelencia: versión para el Sector Público y las Organizaciones del Voluntariado. [Google Scholar]
- 26.Cianfrani C., Tsiakals J., West J. AENOR; Madrid: 2002. ISO 9001: 2000 comentada. [Google Scholar]
- 27.Casas J., Repullo J.R., Donado J. La encuesta como técnica de investigación. Elaboración de cuestionarios y tratamiento estadístico de los datos (II) Aten Primaria. 2003;31:592–600. doi: 10.1016/S0212-6567(03)79222-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Silva-Castro M.M., Bermúdez-Tamayo C., García Gutiérrez J.F., Jiménez Pernett J., Tuneu L., Azpilicueta I. Recursos web utilizados por los farmacéuticos para realizar atención farmacéutica. Seguim Farmacoter. 2004;2:19–23. [Google Scholar]
- 29.Fleiss J.L. 2nd ed. John Wiley & Sons Inc; New York: 1981. Statistical Methods for Rates and Proportions. [Google Scholar]
- 30.Sagaram S., Walji M., Meric-Bernstam F., Johnson C., Bernstam E.V. Inter-observer agreement for quality measures applied to online health information. MedInfo. 2004;11:1308–1312. [PubMed] [Google Scholar]
- 31.Coeira E. Information epidemics, economics, and immunity on the Internet:We still know so little about the effect of information on public health. BMJ. 1998;317:1469–1972. doi: 10.1136/bmj.317.7171.1469. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Silberg W.M., Lundberg G.D., Musacchio R.A. Assessing, controlling, and assuring the quality of medical information on the internet: caveant lector et viewor-let the reader and viewer beware. JAMA. 1997;277:1244–1245. [PubMed] [Google Scholar]
- 33.Purcell G.P., Wilson P., Delamothe T. The quality of health information on the internet. BMJ. 2002;324:557–558. doi: 10.1136/bmj.324.7337.557. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Delamothe T., Smith R., Keller M.A., Witscher B. Netprints: The next phase in the evolution of biomedical publishing. BMJ. 1999;319:1515–1516. doi: 10.1136/bmj.319.7224.1515. [DOI] [PMC free article] [PubMed] [Google Scholar]