Abstract
There is widespread concern about the quality, reproducibility and translatability of studies involving research animals. Although there are a number of reporting guidelines available, there is very little overarching guidance on how to plan animal experiments, despite the fact that this is the logical place to start ensuring quality. In this paper we present the PREPARE guidelines: Planning Research and Experimental Procedures on Animals: Recommendations for Excellence. PREPARE covers the three broad areas which determine the quality of the preparation for animal studies: formulation, dialogue between scientists and the animal facility, and quality control of the various components in the study. Some topics overlap and the PREPARE checklist should be adapted to suit specific needs, for example in field research. Advice on use of the checklist is available on the Norecopa website, with links to guidelines for animal research and testing, at https://norecopa.no/PREPARE.
Keywords: guidelines, planning, design, animal experiments, animal research
Résumé
Il existe de nombreuses inquiétudes au sujet de la qualité, de la reproductibilité et de la traduisibilité des études impliquant des animaux de laboratoire. Bien que de nombreuses orientations en matière de reporting soient disponibles, il existe très peu de principes directeurs sur la manière de planifier les expérimentations animales, malgré le fait qu'il semble logique d'étudier cette question pour pouvoir assurer la qualité des expériences. Dans cet article, nous présentons le document intitulé « PRÉPARATION : Lignes directrices pour la planification de la recherche et des procédures d'expérimentation animale : Recommandations en matière d'excellence ». Le document « PRÉPARATION » couvre les trois principaux domaines qui déterminent la qualité de la préparation des études menées sur les animaux : l'élaboration des études, le dialogue entre les scientifiques et le laboratoire animal, et le contrôle de la qualité des différentes composantes de ces études. Certains sujets peuvent se recouper et la check-list du document « PRÉPARATION » doit donc être adaptée en fonction des besoins spécifiques, par exemple pour les travaux de recherche sur le terrain. Des conseils sur l'utilisation de la check-list sont disponibles sur le site Internet de Norecopa https://norecopa.no/PREPARE, qui inclut notamment des liens vers les lignes directrices relatives à la recherche et à l'expérimentation animales.
Abstract
Bedenken zu Qualität, Reproduzierbarkeit und Übertragbarkeit von Studien mit Versuchstieren sind weit verbreitet. Es existieren zwar verschiedene Berichtsleitlinien, doch allgemeingültige Richtlinien bezüglich der Planung von Tierexperimenten gibt es kaum – trotz der Tatsache, dass dies der logische Ausgangspunkt für die Gewährleistung von Qualität ist. In diesem Dokument präsentieren wir die PREPARE-Richtlinien: Planning Research and Experimental Procedures on Animals: Recommendations for Excellence (Planung von Forschung und Versuchen mit Tieren: Empfehlungen für Excellence). PREPARE berücksichtigt die drei umfassenden Bereiche, die die Qualität der Vorbereitung von Tierstudien bestimmen: Erarbeitung, Dialog zwischen Wissenschaftlern und Tiereinrichtung sowie Qualitätskontrolle der einzelnen Komponenten der Studie. Dabei überlappen sich einige Themen, und die PREPARE-Checkliste sollte an die konkreten Erfordernisse angepasst werden, zum Beispiel in der Feldforschung. Hinweise zur Nutzung der Checkliste sind auf der Norecopa Website zu finden, darunter Links zu Richtlinien für Tierforschung und Tierversuche: https://norecopa.no/PREPARE.
Resumen
Existe una preocupación generalizada sobre la calidad, reproducibilidad y aplicación de los estudios con animales de investigación. A pesar de que existe una serie de directrices disponibles, no hay muchas normas globales sobre cómo planificar los experimentos con animales, a pesar del hecho de que ese es el punto más lógico para empezar a garantizar la calidad. En este estudio presentamos las directrices de PREPARACIÓN: Planificación de procedimientos experimentales y de investigación con animales: recomendaciones para conseguir la excelencia. Este estudio cubre las tres áreas generales que determinan la calidad de la preparación de estudios con animales: formulación, diálogo entre científicos y las instalaciones para animales, y el control de calidad de los distintos componentes del estudio. Algunos temas se solapan y la lista de comprobación del estudio de preparación debería adaptarse a las necesidades específicas, por ejemplo en la investigación de campo. Para asesoramiento sobre el uso de la lista de comprobación viste la página web de Norecopa, con enlaces a directrices para la realización de pruebas e investigación con animales, en https://norecopa.no/PREPARE.
Introduction
The quality of animal-based studies is under increasing scrutiny, for good scientific and ethical reasons. Studies of papers reporting animal experiments have revealed alarming deficiencies in the information provided,1,2 even after the production and journal endorsement of reporting guidelines.3 There is also widespread concern about the lack of reproducibility and translatability of laboratory animal research.4–7 This can, for example, contribute towards the failure of drugs when they enter human trials.8 These issues come in addition to other concerns, not unique to animal research, about publication bias, which tends to favour the reporting of positive results and can lead to the acceptance of claims as fact.9 This has understandably sparked a demand for reduced waste when planning experiments involving animals.10–12 Reporting guidelines alone cannot solve the problem of wasteful experimentation, but thorough planning will increase the likelihood of success and is an important step in the implementation of the 3Rs of Russell & Burch (replacement, reduction, refinement).13 The importance of attention to detail at all stages is, in our experience, often underestimated by scientists. Even small practical details can cause omissions or artefacts that can ruin experiments which in all other respects have been well-designed, and generate health risks for all involved. There is therefore, in our opinion, an urgent need for detailed but overarching guidelines for researchers on how to plan animal experiments which are safe and scientifically sound, address animal welfare and contain links to the best guidance available on more specific topics.
The purpose of this paper is to provide planning guidelines, fulfilling a comparable role to reporting guidelines such as ARRIVE14 and others.15–19 We have called them PREPARE (Planning Research and Experimental Procedures on Animals: Recommendations for Excellence). They are designed to be applicable to all types of animal research and testing, including field studies, but they also contain topics concerning the management of animal facilities, since in-house experiments are dependent upon their quality. Some elements will be more relevant than others, but experimental bias and inappropriate statistical methodology are frequent causes of poor study design. PREPARE seeks to address the needs of all stakeholders: the animals, their caretakers and animal technologists, technical staff, scientists and designated responsible persons, including named veterinarians, training and competency officers and facility managers. PREPARE should also prove helpful for those evaluating proposals for animal studies, including funding bodies, ethical review boards, national committees and regulatory authorities. A more detailed discussion of these guidelines, with links to global resources is available at https://norecopa.no/PREPARE. A comparison between the ARRIVE and PREPARE checklists may also be found there.
The PREPARE guidelines cover 15 main topics as shown in Table 1.
Table 1.
The PREPARE guidelines short checklist.
Topic | Recommendation |
---|---|
(A) Formulation of the study | |
1. Literature searches | □ Form a clear hypothesis, with primary and secondary outcomes. |
□ Consider the use of systematic reviews. | |
□ Decide upon databases and information specialists to be consulted, and construct search terms. | |
□ Assess the relevance of the species to be used, its biology and suitability to answer the experimental questions with the least suffering, and its welfare needs. | |
□ Assess the reproducibility and translatability of the project. | |
2. Legal issues | □ Consider how the research is affected by relevant legislation for animal research and other areas, e.g. animal transport, occupational health and safety. |
□ Locate relevant guidance documents (e.g. EU guidance on project evaluation). | |
3. Ethical issues, harm–benefit assessment and humane endpoints | □ Construct a lay summary. |
□ In dialogue with ethics committees, consider whether statements about this type of research have already been produced. | |
□ Address the 3Rs (replacement, reduction, refinement) and the 3Ss (good science, good sense, good sensibilities20). | |
□ Consider pre-registration and the publication of negative results. | |
□ Perform a harm–benefit assessment and justify any likely animal harm. | |
□ Discuss the learning objectives, if the animal use is for educational or training purposes. | |
□ Allocate a severity classification to the project. | |
□ Define objective, easily measurable and unequivocal humane endpoints. | |
□ Discuss the justification, if any, for death as an endpoint. | |
4. Experimental design and statistical analysis | □ Consider pilot studies, statistical power and significance levels. |
□ Define the experimental unit and decide upon animal numbers. | |
□ Choose methods of randomization, prevent observer bias, and decide upon inclusion and exclusion criteria. | |
(B) Dialogue between scientists and the animal facility | |
5. Objectives and timescale, funding and division of labour | □ Arrange meetings with all relevant staff when early plans for the project exist. |
□ Construct an approximate timescale for the project, indicating the need for assistance with preparation, animal care, procedures and waste disposal/decontamination. | |
□ Discuss and disclose all expected and potential costs. | |
□ Construct a detailed plan for division of labour and expenses at all stages of the study. | |
6. Facility evaluation | □ Conduct a physical inspection of the facilities, to evaluate building and equipment standards and needs. |
□ Discuss staffing levels at times of extra risk. | |
7. Education and training | □ Assess the current competence of staff members and the need for further education or training prior to the study. |
8. Health risks, waste disposal and decontamination | □ Perform a risk assessment, in collaboration with the animal facility, for all persons and animals affected directly or indirectly by the study. |
□ Assess, and if necessary produce, specific guidance for all stages of the project. | |
□ Discuss means for containment, decontamination, and disposal of all items in the study. | |
(C) Quality control of the components in the study | |
9. Test substances and procedures | □ Provide as much information as possible about test substances. |
□ Consider the feasibility and validity of test procedures and the skills needed to perform them. | |
10. Experimental animals | □ Decide upon the characteristics of the animals that are essential for the study and for reporting. |
□ Avoid generation of surplus animals. | |
11. Quarantine and health monitoring | □ Discuss the animals' likely health status, any needs for transport, quarantine and isolation, health monitoring and consequences for the personnel. |
12. Housing and husbandry | □ Attend to the animals' specific instincts and needs, in collaboration with expert staff. |
□ Discuss acclimatization, optimal housing conditions and procedures, environmental factors and any experimental limitations on these (e.g. food deprivation, solitary housing). | |
13. Experimental procedures | □ Develop refined procedures for capture, immobilization, marking, and release or rehoming. |
□ Develop refined procedures for substance administration, sampling, sedation and anaesthesia, surgery and other techniques. | |
14. Humane killing, release, reuse or rehoming | □ Consult relevant legislation and guidelines well in advance of the study. |
□ Define primary and emergency methods for humane killing. | |
□ Assess the competence of those who may have to perform these tasks. | |
15. Necropsy | □ Construct a systematic plan for all stages of necropsy, including location, and identification of all animals and samples. |
A more detailed discussion, with references and links, is available at https://norecopa.no/PREPARE, together with a downloadable pdf version of this checklist in several languages.
The guidance in this paper should be adapted to the individual research project, animal species and location. The topics in the checklist in Table 1 will not be relevant to all projects, some topics overlap, and they may have to be addressed in a different order to that in the table.
Division of labour, costs and responsibility
Some elements will be the responsibility of the animal facility itself, rather than the individual research group, since they determine the standard of the facility as a whole. However, a research project often raises questions which are not covered by the facility’s normal work routines. These include activities which have potential health and safety risks. Early and open dialogue between the facility and research group, to create a good atmosphere for collaboration, is therefore essential. For example, if a facility cannot safely conduct an experiment without structural changes or investment in new equipment, this should be discussed with the research group at an early stage, however tempting it may be to start collaboration on a prestigious project. Animal welfare and ethics committees can be a useful forum for some of this dialogue.21 A set of general planning guidelines such as PREPARE can be used to help formulate a contract between the research group and the facility. This ensures prior agreement on two significant practical issues: the parameters to be recorded during the study, and the division of labour and costs between the facility and the research group. Failure to do this may result in lost data, making it impossible to publish the research findings, adding to the waste of resources and animal lives. An example of a contract based upon the PREPARE guidelines is given on the website.
The relationship between PREPARE and other guidelines
Over recent years, guidelines have been produced on many subjects related to the use of research animals including harm–benefit assessment, study design, capture, transport, breeding, housing, identification and marking, administration of substances, blood sampling, anaesthesia and analgesia, surgery, humane endpoints and humane killing.
The PREPARE guidelines build upon guidance that was developed at the Norwegian School of Veterinary Science over a 20-year period,22 and they are intended to be an overarching set of recommendations to promote good practice. A comprehensive and curated global list of individual guidelines, databases, information centres and discussion forums can be found on Norecopa’s website in the 3R Guide database (https://norecopa.no/3r-guide-database), which is linked to the online version of PREPARE.
The European Union (EU) Directive 2010/63 refers to guidelines for education, training and competence, and for the housing, care and use of research animals.23 Guidance documents from the European Commission, endorsed by the Member States, are a valuable source of information on these topics,24 and may also prove to be useful to non-EU countries. For example, Appendix 1 of the Guidance on Project Evaluation and Retrospective Assessment contains preformulated questions for building a project application template, including harm–benefit assessment.25 These topics have been embedded in PREPARE.
The relationship between PREPARE and ARRIVE
The speaker notes for ARRIVE26 state that they ‘provide a logical checklist with all the things that need to be considered when designing an experiment’. There are, in our experience when planning animal research, a number of additional points which need to be addressed at the planning stage, but which are easily overlooked or dismissed as unimportant. This was our motivation for the construction of the PREPARE guidelines. Attention to detail not only helps promote excellent study quality and optimal animal welfare, but also the safety of humans and animals affected directly or indirectly by the work. Particular considerations highlighted in the PREPARE guidelines, which are not so prominent in the ARRIVE guidelines, include a harm–benefit assessment; health risks, waste disposal and decontamination; quarantine and health monitoring; the use of humane endpoints; the fate of the animals (humane killing, release, re-use or re-homing); and necropsy.
A Swiss study indicates that journal endorsement alone does not ensure guideline use: half of the researchers who had last published in a journal endorsing ARRIVE had never heard of the guidelines.27 Emphasis on reporting guidelines in the EU Commission’s Guidance on a common education and training framework28 and in recommendations produced by other authorities will hopefully improve this situation.
Concluding remarks
It is our hope that the PREPARE guidelines will draw scientists’ attention to the wide range of factors which require consideration at the planning stage. This should lead to an increase in scientific validity, reproducibility and animal welfare. Improving the quality of publications will also facilitate systematic reviews, thereby generating new knowledge through the synthesis of evidence, without the use of animals.29,30
Planning guidelines have greater potential than reporting guidelines for assisting funders, regulators and ethical review committees in the assessment of applications for new projects. We therefore propose that funders make adoption of the principles in PREPARE or similar guidelines a condition of funding.
As with the ARRIVE (reporting) guidelines, the PREPARE (planning) guidelines are neither meant to be mandatory, absolutely prescriptive, nor a standard formula. Biomedical subspecialities may find it useful to produce their own supplementary guidelines, such as Australian scientists have done for osteoarthritis research31 and the STAIR conferences32 for stroke models. The Strategic Planning Poster from FRAME (Fund for the Replacement of Animals in Medical Experiments) provides a flowchart with good general advice on planning animal research.33 PREPARE is designed to provide a detailed, universally relevant checklist which reduces the risk of problems, artefacts or misunderstandings arising once studies have begun. Furthermore, it can serve as the basis for a contract for the distribution of labour between the animal facility and research group. This will also reduce the risk of the researchers being unable to respond to journals’ requests for more observations in an experiment, which can lead to manuscript rejection, wasting both animal lives and human resources.
‘It is perfectly true, as philosophers say, that life must be understood backwards. But they forget the other proposition, that it must be lived forwards.’ (Søren Kirkegaard 1813–1855)34
Acknowledgements
Early versions of these guidelines were inspired by the pioneering work of Öbrink and coworkers.35,36 An earlier version of the contract between researchers and the animal facility was published in compendia in Laboratory Animal Science produced by the Norwegian School of Veterinary Science.22 We thank Anton Krag, Norwegian Animal Protection Alliance, Oslo; Dr Ute Weyer, Animal and Plant Health Agency, UK; Professor Malcolm Macleod, Centre for Clinical Brain Sciences, University of Edinburgh, and the referees for their valuable advice during the preparation and review of this paper.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
References
- 1.Kilkenny C, Parsons N, Kadyszewski E, et al. Survey of the quality of experimental design, statistical analysis and reporting of research using animals. PLoS One 2009; 4: e7824–e7824. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Smith JA, Birke L, Sadler D. Reporting animal use in scientific papers. Lab Anim 1997; 31: 312–317. [DOI] [PubMed] [Google Scholar]
- 3.Avey MT, Moher D, Sullivan KJ, et al. The devil is in the details: incomplete reporting in preclinical animal research. PLoS One 2016; 11: e0166733–e0166733. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Begley CG, Ellis LM. Drug development: raise standards for preclinical cancer research. Nature 2012; 483: 531–533. [DOI] [PubMed] [Google Scholar]
- 5.Garner JP. The significance of meaning: why do over 90% of behavioral neuroscience results fail to translate to humans, and what can we do to fix it? ILAR J 2014; 55: 438–456. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Howells DW, Sena ES, Macleod MR. Bringing rigour to translational medicine. Nat Rev Neurol 2014; 10: 37–43. [DOI] [PubMed] [Google Scholar]
- 7.van der Worp HB, Howells DW, Sena ES, et al. Can animal models of disease reliably inform human studies? PLoS Med 2010; 7: e1000245–e1000245. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Prinz F, Schlange T, Asadullah K. Believe it or not: how much can we rely on published data on potential drug targets? Nat Rev Drug Discov 2011; 10: 712–712. [DOI] [PubMed] [Google Scholar]
- 9.Nissen SB, Magidson T, Gross K, et al. Publication bias and the canonization of false facts. eLife 2016; 5: e21451–e21451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Chalmers I, Bracken MB, Djulbegovic B, et al. How to increase value and reduce waste when research priorities are set. Lancet 2014; 383: 156–165. [DOI] [PubMed] [Google Scholar]
- 11.Macleod MR, Michie S, Roberts I, et al. Biomedical research: increasing value, reducing waste. Lancet 2014; 383: 101–104. [DOI] [PubMed] [Google Scholar]
- 12.Munafò MR, Nosek BA, Bishop DVM, et al. A manifesto for reproducible science. Nat Hum Behav 2017; 1: 0021–0021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Russell WMS, Burch RL. The principles of humane experimental technique, Wheathampstead: Universities Federation for Animal Welfare, 1959. [Google Scholar]
- 14.Kilkenny C, Browne WJ, Cuthill IC, et al. Improving bioscience research reporting: The ARRIVE Guidelines for Reporting Animal Research. PLoS Biol 2010; 8: e1000412–e1000412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Brattelid T, Smith AJ. Guidelines for reporting the results of experiments on fish. Lab Anim 2000; 34: 131–135. [DOI] [PubMed] [Google Scholar]
- 16.Hooijmans CR, Leenaars M, Ritskes-Hoitinga M. A gold standard publication checklist to improve the quality of animal studies, to fully integrate the three Rs, and to make systematic reviews more feasible. Altern Lab Anim 2010; 38: 167–182. [DOI] [PubMed] [Google Scholar]
- 17.National Research Council (NRC). Guidance for the description of animal research in scientific publications. Washington, DC: National Academies Press, 2011. [PubMed]
- 18.Altman DG, Simera I, Hoey J, et al. EQUATOR: reporting guidelines for health research. Lancet 2008; 371: 1149–1150. [DOI] [PubMed] [Google Scholar]
- 19.Reporting life sciences research, https://www.nature.com/authors/policies/reporting.pdf (2015, accessed 26 July 2017).
- 20.The three Ss. https://norecopa.no/3s (2016, accessed 26 July 2017).
- 21.Different systems of ethical review, https://science.rspca.org.uk/sciencegroup/researchanimals/ethicalreview/differentsystems (accessed 26 July 2017).
- 22.Hem A, Eide DM, Engh E, Smith AJ. Compendium in laboratory animal science, Oslo: Norwegian School of Veterinary Science, 2010. [Google Scholar]
- 23.Directive 2010/63/EU of the European Parliament and of the Council of 22 September 2010 on the protection of animals used for scientific purposes, http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2010:276:0033:0079:en:PDF (2010, accessed 26 July 2017).
- 24.Guidance documents to fulfil the requirements under the Directive 2010/63/EU, http://ec.europa.eu/environment/chemicals/lab_animals/pubs_guidance_en.htm (2016, accessed 26 July 2017).
- 25.Working document on project evaluation and retrospective assessment, http://ec.europa.eu/environment/chemicals/lab_animals/pdf/guidance/project_evaluation/en.pdf (2013, accessed 26 July 2017).
- 26.The ARRIVE guidelines: speaker notes, http://www.nc3rs.org.uk/sites/default/files/documents/Guidelines/ARRIVE%20Guidelines%20Speaker%20Notes.pdf (accessed 26 July 2017).
- 27.Reichlin TS, Vogt L, Wurbel H. The researchers' view of scientific rigor – survey on the conduct and reporting of in vivo research. PLoS One 2016; 11: e0165999–e0165999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.National Competent Authorities for the implementation of Directive 2010/63/EU on the protection of animals used for scientific purposes. A working document on the development of a common education and training framework to fulfil the requirements under the Directive, http://ec.europa.eu/environment/chemicals/lab_animals/pdf/guidance/education_training/en.pdf (2014, accessed 26 July 2017).
- 29.Lund H, Brunnhuber K, Juhl C, et al. Towards evidence based research. BMJ 2016; 355: i5440–i5440. [DOI] [PubMed] [Google Scholar]
- 30.Leenars M, Ritske-Hoitinga M, Griffin G and Ormandy E. Background to the Montréal Declaration on the Synthesis of Evidence to Advance the 3Rs Principles in Science, as adopted by the 8th World Congress on Alternatives and Animal Use in the Life Sciences, Montréal, Canada on August 25, 2011. In: ALTEX Proceedings of the 8th world congress on alternatives and animal use in the life sciences, Montréal, Canada, 21–25 August 2011, pp 35–38. Heidelberg: Springer. http://www.altex.ch/resources/035038_GriffinL41.pdf.
- 31.Smith MM, Clarke EC, Little CB. Considerations for the design and execution of protocols for animal research and treatment to improve reproducibility and standardization: DEPART well-prepared and ARRIVE safely. Osteoarthritis Cartilage 2016; 25: 354–363. [DOI] [PubMed] [Google Scholar]
- 32.STAIR consensus conferences, http://www.thestair.org (accessed 26 July 2017).
- 33.Strategic Planning for Research Programmes, http://www.frame.org.uk/planning (accessed 26 July 2017).
- 34.Søren Kierkegaard, https://en.wikiquote.org/wiki/Søren_Kierkegaard (accessed 26 July 2017).
- 35.Obrink KJ, Rehbinder C. Animal definition: a necessity for the validity of animal experiments? Lab Anim 2000; 34: 121–130. [DOI] [PubMed] [Google Scholar]
- 36.Öbrink K, Waller M. Försöksdjurskunskap, Lund, Sweden: Student literatur, 1996. [Google Scholar]