Dear Editors,
The purpose of this letter is to point out 3 problems I noted in a manuscript published by Andrews and colleagues in the Sept 20, 2020 issue of JAALAS.1
First, the authors report that 3 experienced individuals scored rabbits for pain using a Grimace Scale.8 Although the scorers were blind to the treatment that each rabbit had received, the authors did not provide any information regarding inter-rater consistency. Without this assessment, it cannot be determined whether rater bias or inter-rater error has skewed the results, as discussed in relevant statistical literature.2,7
Second, the authors state in the statistical methods that a trend was declared if the P value was less than 0.10 but greater than 0.05. The term trend has several definitions that are all rooted in identifying temporal or spatial changes in some value. As applied in this paper, the term trend and the use of a P value of less than 0.10 to identify a trend is not valid.4,5 To determine if a trend exists in a data set, a trend analysis must be conducted. Numerous statistically valid methods can be applied for this purpose.6,9,11 The only conclusion that can be drawn from a P > 0.05 in the analysis that was used is that the probability is greater than 1 in 20 that a difference between groups this size or larger might occur by chance alone.
Third, figures 2 through 5 have error bars that are not defined as far as I can tell. These bars could represent standard deviation, standard error, or even range. If these data are intended as a basis for dosing recommendations, then reporting confidence intervals (CI) would be most appropriate and helpful.3,10 Providing CI would allow readers to determine dosing concentrations and intervals that would provide appropriate analgesic blood levels of drug over time for the most animals.
Reference
- 1.Andrews DD, Fajt VR, Baker KC, Blair RV, Jones SH, Dobek GL. 2020. A comparison of buprenorphine, sustained-release buprenorphine, and high-concentration buprenorphine in male New Zealand white rabbits. J Am Assoc Lab Anim Sci 59:546–556. 10.30802/AALAS-JAALAS-19-000132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Bravo G, Potvin L. 1991. Estimating the reliability of continuous measures with Cronbach's alpha or the intraclass correlation coefficient: toward the integration of two traditions. J Clin Epidemiol 44:381–390. 10.1016/0895-4356(91)90076-L. [DOI] [PubMed] [Google Scholar]
- 3.du Prel J-B, Hommel G, Röhrig B, Blettner M. 2009. Confidence interval or p-value?: part 4 of a series on evaluation of scientific publications. Dtsch Arztebl Int 106:335–339. DOI: 10.3238/arztebl.2009.0335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Gibbs NM, Gibbs SV. 2015. Misuse of 'trend' to describe 'almost significant' differences in anaesthesia research. Br J Anaesth 115:337–339. 10.1093/bja/aev149. [DOI] [PubMed] [Google Scholar]
- 5.Goodman S. 2008. A dirty dozen: twelve p-value misconceptions. Semin Hematol 45:135–140. [DOI] [PubMed] [Google Scholar]
- 6.Hess A, Iyer H, Malm W. 2001. Linear trend analysis: a comparison of methods. Atmos Environ 35:5211–5222. 10.1016/S1352-2310(01)00342-9. [DOI] [Google Scholar]
- 7.Koo TK, Li MY. 2016. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163. 10.1016/j.jcm.2016.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Langford DJ, Bailey AL, Chanda ML, Clarke SE, Drummond TE, Echols S, Glick S, Ingrao J, Klassen-Ross T, Lacroix-Fralish ML, Matsumiya L, Sorge RE, Sotocinal SG, Tabaka JM, Wong D, van den Maagdenberg A MJM, Farrari MD, Craig KD, Mogil JS. 2010. Coding of facial expressions of pain in the laboratory mouse. Nat Methods 7:447–449. 10.1038/nmeth.1455. [DOI] [PubMed] [Google Scholar]
- 9.Luo P, He B, Takara K, Razafindrabe B H N, Nover D, Yamashiki Y. 2011. Spatiotemporal trend analysis of recent river water quality conditions in Japan. J Environ Monit 13:2819–2829. 10.1039/C1EM10339C. [DOI] [PubMed] [Google Scholar]
- 10.O'Brien SF, Yi QL. 2016. How do I interpret a confidence interval? Transfusion 56:1680–1683. 10.1111/trf.13635. [DOI] [PubMed] [Google Scholar]
- 11.Zhang Y, Davis R. 2013. Principal trend analysis for time-course data with applications in genomic medicine. Ann Appl Stat 7:2205–2228. [Google Scholar]
