Skip to main content
Journal of the American Association for Laboratory Animal Science : JAALAS logoLink to Journal of the American Association for Laboratory Animal Science : JAALAS
letter
. 2021 Jan;60(1):3.

Letter to the Editor

George J DeMarco 1
PMCID: PMC7831343  PMID: 34353412

Dear Editors,

The purpose of this letter is to point out 3 problems I noted in a manuscript published by Andrews and colleagues in the Sept 20, 2020 issue of JAALAS.1

First, the authors report that 3 experienced individuals scored rabbits for pain using a Grimace Scale.8 Although the scorers were blind to the treatment that each rabbit had received, the authors did not provide any information regarding inter-rater consistency. Without this assessment, it cannot be determined whether rater bias or inter-rater error has skewed the results, as discussed in relevant statistical literature.2,7

Second, the authors state in the statistical methods that a trend was declared if the P value was less than 0.10 but greater than 0.05. The term trend has several definitions that are all rooted in identifying temporal or spatial changes in some value. As applied in this paper, the term trend and the use of a P value of less than 0.10 to identify a trend is not valid.4,5 To determine if a trend exists in a data set, a trend analysis must be conducted. Numerous statistically valid methods can be applied for this purpose.6,9,11 The only conclusion that can be drawn from a P > 0.05 in the analysis that was used is that the probability is greater than 1 in 20 that a difference between groups this size or larger might occur by chance alone.

Third, figures 2 through 5 have error bars that are not defined as far as I can tell. These bars could represent standard deviation, standard error, or even range. If these data are intended as a basis for dosing recommendations, then reporting confidence intervals (CI) would be most appropriate and helpful.3,10 Providing CI would allow readers to determine dosing concentrations and intervals that would provide appropriate analgesic blood levels of drug over time for the most animals.

Reference

  • 1.Andrews DD, Fajt VR, Baker KC, Blair RV, Jones SH, Dobek GL. 2020. A comparison of buprenorphine, sustained-release buprenorphine, and high-concentration buprenorphine in male New Zealand white rabbits. J Am Assoc Lab Anim Sci 59:546–556. 10.30802/AALAS-JAALAS-19-000132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Bravo G, Potvin L. 1991. Estimating the reliability of continuous measures with Cronbach's alpha or the intraclass correlation coefficient: toward the integration of two traditions. J Clin Epidemiol 44:381–390. 10.1016/0895-4356(91)90076-L. [DOI] [PubMed] [Google Scholar]
  • 3.du Prel J-B, Hommel G, Röhrig B, Blettner M. 2009. Confidence interval or p-value?: part 4 of a series on evaluation of scientific publications. Dtsch Arztebl Int 106:335–339. DOI: 10.3238/arztebl.2009.0335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Gibbs NM, Gibbs SV. 2015. Misuse of 'trend' to describe 'almost significant' differences in anaesthesia research. Br J Anaesth 115:337–339. 10.1093/bja/aev149. [DOI] [PubMed] [Google Scholar]
  • 5.Goodman S. 2008. A dirty dozen: twelve p-value misconceptions. Semin Hematol 45:135–140. [DOI] [PubMed] [Google Scholar]
  • 6.Hess A, Iyer H, Malm W. 2001. Linear trend analysis: a comparison of methods. Atmos Environ 35:5211–5222. 10.1016/S1352-2310(01)00342-9. [DOI] [Google Scholar]
  • 7.Koo TK, Li MY. 2016. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163. 10.1016/j.jcm.2016.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Langford DJ, Bailey AL, Chanda ML, Clarke SE, Drummond TE, Echols S, Glick S, Ingrao J, Klassen-Ross T, Lacroix-Fralish ML, Matsumiya L, Sorge RE, Sotocinal SG, Tabaka JM, Wong D, van den Maagdenberg A MJM, Farrari MD, Craig KD, Mogil JS. 2010. Coding of facial expressions of pain in the laboratory mouse. Nat Methods 7:447–449. 10.1038/nmeth.1455. [DOI] [PubMed] [Google Scholar]
  • 9.Luo P, He B, Takara K, Razafindrabe B H N, Nover D, Yamashiki Y. 2011. Spatiotemporal trend analysis of recent river water quality conditions in Japan. J Environ Monit 13:2819–2829. 10.1039/C1EM10339C. [DOI] [PubMed] [Google Scholar]
  • 10.O'Brien SF, Yi QL. 2016. How do I interpret a confidence interval? Transfusion 56:1680–1683. 10.1111/trf.13635. [DOI] [PubMed] [Google Scholar]
  • 11.Zhang Y, Davis R. 2013. Principal trend analysis for time-course data with applications in genomic medicine. Ann Appl Stat 7:2205–2228. [Google Scholar]
J Am Assoc Lab Anim Sci. 2021 Jan;60(1):3.

Response to George J DeMarco Letter to the Editor:

David Andrews 1

Dear Drs Compton and Toth,

We thank Dr DeMarco for the thorough read of our paper, “A Comparison of Buprenorphine, Sustained-release Buprenorphine, and High-concentration Buprenorphine in Male New Zealand White Rabbits.” We agree that inter-observer reliability would have been desirable for our experiment; however, this was difficult to perform given the number of observers (3) and the nature of data acquisition. The reviewers did not note this as a shortcoming of the methods, or we might have been able to address it in the manuscript. We also appreciate Dr DeMarco’s references in relation to using the word “trend.” Although “trend” has been used in other literature to refer to a P value that approaches statistical significance, we agree with his point. Finally, to his question about the error bars in Figures 2 through 5, these are standard deviation (SD), which is consistent with the text of the paper. This was inadvertently left out of the figure legends, and we regret the oversight.

Sincerely,

Reference

  • 1.Andrews DD, Fajt VR, Baker KC, Blair RV, Jones SH, Dobek GL. 2020. A comparison of buprenorphine, sustained-release buprenorphine, and high-concentration buprenorphine in male New Zealand white rabbits. J Am Assoc Lab Anim Sci 59:546–556. 10.30802/AALAS-JAALAS-19-000132. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the American Association for Laboratory Animal Science : JAALAS are provided here courtesy of American Association for Laboratory Animal Science

RESOURCES