Abstract
A scale with robust statistical validation is essential to diagnose pain and improve decision making for analgesia. This blind, randomised, prospective and opportunist study aimed to develop an ethogram to evaluate behaviour and validate a scale to assess acute ovine postoperative pain. Elective laparoscopy was performed in 48 healthy sheep, filmed at one preoperative and three postoperative moments, before and after rescue analgesia and 24 hours after. The videos were randomised and assessed twice by four evaluators, with a one-month interval between evaluations. Statistical analysis was performed using R software and differences were considered significant when p <0.05. Based on the multiple association, a unidimensional scale was adopted. The intra- and inter-observer reliability ranged from moderate to very good (intraclass correlation coefficient ≥ 0.53). The scale presented Spearman correlations > 0.80 with the numerical, simple descriptive, and visual analogue scales, and a correlation of 0.48 with the facial expression scale. According to the mixed linear model, the scale was responsive, due to the increase and decrease in pain scores of all items after surgery and analgesic intervention, respectively. All items on the scale demonstrated an acceptable Spearman item-total correlation (0.56–0.76), except for appetite (0.25). The internal consistency was excellent (Cronbach's α = 0.81) and all items presented specificity > 0.72 and sensitivity between 0.61–0.90, except for appetite. According to the Youden index, the cut-off point was ≥ 4 out of 12, with a diagnostic uncertainty zone of 4 to 5. The area under the curve > 0.95 demonstrated the excellent discriminatory capacity of the instrument. In conclusion, the Unesp-Botucatu pain scale in sheep submitted to laparoscopy is valid, reliable, specific, sensitive, with excellent internal consistency, accuracy, discriminatory capacity, and a defined cut-off point.
Introduction
The lack of valid and reliable instruments to recognise and quantify pain in farm animals compromises their welfare state and limits the use of analgesics in these species [1–4]. Sheep are subjected to several surgical painful procedures often without appropriate use of anaesthesia or analgesia [5–7]. The sheep species is an experimental model for humans due to its similarity in size and weight. In 2014 60,209 sheep were used in research in the European Union, an increase of 108% compared to 2011. Pigs followed by sheep are more commonly used than dogs and non-human primates as non-rodent models for research and teaching [8,9].
Although there are several experimental methods to assess nociception [10–14] they are unreliable and difficult to use in unhabituated clinical patients. Actigraphy can be used to monitor sheep activity from a distance, however, this method requires specific equipment [15]. Other physiological measures, such as hair cortisone concentration [16], heart rate variability [17], blood pressure, ocular and rectal temperature, electromyography, and electroencephalography are not clinically feasible and some require physical restraint [18].
The behavioural expression of pain replaces the absence of verbal expression of the animals. Behaviour is easy to observe, does not require equipment and restraint of the animal, does not generate stress, and has no cost, thus being applicable both clinically and experimentally [19].
In contrast to cattle and goats, when sheep suffer pain under restraint they tend to remain more silent [20] and only express pain behaviours when released [21]. These behaviours are: reduced interaction with the environment and with other animals, gait abnormalities, lameness, stamping feet on the ground, turning of the head, hyporexia, abnormal vocalisation, lip-licking movement, curved lips, gnashing of teeth, tremors, and strong tail wagging [5,20–22].
Two analyses are essential to develop and validate a pain scale: validity indicates whether the instrument effectively measures the attribute which it was designed for [23], and reliability guarantees equivalence of results when the measure is evaluated by the same observer on different occasions or by different observers on the same occasion [24]. The scale must also be responsive; scores should increase after a painful stimulus and reduce after analgesia [25]. Behaviour-based pain scales have been developed in dogs [23,26–28], cats [25,29], horses [24,30,31], cattle [19], and pigs [32]. The most commonly used scales to measure postoperative pain in sheep are still unidimensional, such as the numerical (NS), simple descriptive (SDS), and visual analogue scales (VAS) [33]. However, these instruments exclusively evaluate the intensity of pain, whereas multidimensional or composite scales include sensory, motor and emotional qualities and may be developed to differentiate specific types of pain [29].
To develop the scales a species-specific ethogram is produced to quantify the duration and/or frequency of the behaviours present before and after a painful stimulus. Although previous studies have reported the behavioural descriptors of pain based on an ethogram after a nociceptive stimulus [5,11,20–22,34–40], to our knowledge, there are no validated behavioural scales in the literature to detect acute pain in sheep following solid statistical analysis. The instruments already developed to evaluate acute pain in sheep were based on behavioural changes in lambs submitted to orchiectomy and tail cutting [20] or facial expression in sheep with pododermatitis and mastitis [41]. Another facial scale (sheep grimace) was published after the beginning of our research [42]. To improve the reliability of pain measurement it is necessary to develop an instrument with in-depth statistical validation, as reported in cats [29], cattle [19], horses [24], and pigs [32], by using a blind and random methodology with evidence of validity, reliability, sensitivity, specificity, and a defined analgesic intervention point [43].
The main objective of this study was to validate a behavioural scale to assess acute pain in sheep undergoing soft tissue surgery (laparoscopy). The authors first constructed an ethogram and included pain behaviours described in the literature, then used videos from this study for further refinement and to define a cut-off point for analgesic intervention. The authors hypothesise that the final scale produced in the current study is reliable and demonstrates content, construct, and criterion validities.
Material and methods
This was a blind, randomised, prospective and opportunist study. The study was approved by the Ethics Committee on Animal Use from the School of Veterinary Medicine and Animal Science, São Paulo State University (Unesp), Botucatu, São Paulo, Brazil, under protocol 0027/2017 and followed the recommendations of ARRIVE [44] adapted to the experimental design. For the pilot study, five sheep separate from the main study were filmed and evaluated before and after laparoscopy, to choose the best anaesthetic protocol and to test the positioning of the digital camera (Gopro Hero5 Black®) as well as other adjustments, to optimise the quality of filming. For the main study, 48 sheep of the breeds Bergamacia (n = 17), Lacaune (n = 18), and Dorper (n = 13) (Ovis aries species, dairy line) from the institution were used; 3.5 ± 1.8 (1.5–6) years of age and weighing 58.5 ± 17.3 (34–92) kg. As inclusion criteria, the sheep were considered healthy through clinical and laboratory evaluation (haematocrit, plasma protein, glucose and lactate). During the study period 4 to 5 or 2 to 3 sheep were housed in large (3 x 2 x 1.1m, length x width x height) or small (2.2 x 2 x 1.2m) pens respectively, where they had previously been routinely housed to be protected from rain or low temperatures. The sheep were habituated to the pens for 24 hours before the start of the study, during which they fasted for feed, and for 12 hours they fasted for water. After completion of the study, the animals were maintained for reproduction in a semi-extensive system and were not used for any other research.
Immediately before surgery, 30,000 IU/kg of benzathine penicillin (Pentabiótico®, Zoetis, São Paulo, SP, Brazil) was administered intramuscularly (IM). After dissociative anaesthesia with 0.5 mg/kg of diazepam (Compaz®, Cristália, Itapira, SP, Brazil) and 5 mg/kg of ketamine (Cetamin®, Syntec; Santana de Parnaíba, SP, Brazil) administered intravenously (IV), lumbosacral epidural anaesthesia was performed with 0.1 ml/kg (1 mg/kg) of 1% lidocaine without vasoconstrictor (Xylestesin®, Cristália, Itapira, SP, Brazil) and anaesthetic infiltration with up to 2.5 mg/kg of 1% lidocaine without vasoconstrictor (Xylestesin®, Cristália, Itapira, SP, Brazil) at the incision site and subsequent introduction of a trocar. When the animals demonstrated any sympathetic response related to the surgery, characterised by an increase of more than 20% in heart rate concerning the value observed before the beginning of the surgery or signs of pain characterised by any movement, dissociative anaesthesia was supplemented with 5 mg/kg of ketamine IV.
In all animals, the same experienced surgeon performed a laparoscopy for follicular aspiration and replacement of follicular cells [45], by inserting three trocars (5 mm) in three retro-umbilical regions. The postoperative analgesic intervention was performed after the M2 evaluation, with 0.5 mg/kg meloxicam 2% (Maxicam®, Ourofino, Cravinhos, SP, Brazil) and 0.2 mg/kg morphine (Dimorf®, Cristália, Itapira, SP, Brazil) IV in separate syringes.
Data collection
Two to six animals underwent surgery per day. The procedures started at 9 am and the evaluations of the last animals ended around 7 pm; the 24-hour measurement (M4) occurred the next day. The study was carried out in the months of April and May 2017, with mean daily temperature and humidity of the environment varying between 16–24°C and 68–92%, respectively. The location had the following geographic coordinates: latitude - 22°51’ S; longitude - 48°26’ O; altitude—818 m.
Video recordings from 48 sheep were taken at the following moments: M1—one hour before surgery; M2—at the predicted time of greatest pain, between three and four hours after the end of surgery; M3—one hour after the analgesic intervention; and M4–24 hours after surgery (Fig 1).
The in-person observer (NEOFS) made these recordings using a digital camera positioned on a tripod placed outside the pens. The observer turned on the camera and distanced themself at least 10 m from the pens to minimise the effect of human presence on the sheep behaviour. At the end of each recording, the observer approached the sheep and took frontal, lateral and oblique photographs of the sheep’s face with a digital camera (Sony Alpha A6500®). These photographs were used to assess the facial pain scale [41].
To analyse the pain-related behaviour in sheep, the research was divided into the following phases: 1) elaboration of an ethogram to characterise the behaviour of the animals before and after the painful procedure (S1 Table); 2) content validation of the normal and pain behaviours based on previous studies, the pilot study, and the ethogram [5,11,20,34–38]. (S2 Table); 3) production of a pre-refinement scale (S3 Table—scale 1), used to evaluate the videos, by four observers blind to the moments; 4) statistical analysis of the pre-refinement scale (S3 Table) evaluated by the observers according to the criteria in Table 1; 5) refinement criteria applied to the scale (S4 Table), based on the statistical analysis of Table 1; 6) validation of the final scale (scale 2) after refinement (Table 3) and presentation of data analysis in the results (Fig 2).
Table 1. Statistical methods for refinement (R) and validation (V) of the Unesp-Botucatu sheep acute pain composite scale (USAPS).
Type of analysis | Description | Statistical test |
---|---|---|
Content validation R | The following steps were performed: 1) a list of pain-related behaviours reported in the literature and 2) behaviours observed in the ethogram were scored by 3) a committee composed of three veterinarians experienced in assessing pain in ruminants which analysed each subitem within each item of the scale into relevant (+1), do not know (0), or irrelevant (-1). | All the values of each subitem (-1, 0, or 1) were added and the total was divided by the number of observers. Items with a total score > 0.5 were included in the scale [46]. |
Distribution of scores V* | Distribution of the frequency of the presence of the scores 0, 1, and 2 of each item at each moment and in all moments grouped (MG). | Descriptive analysis. |
Multiple association RV* | The multiple association of the items with each other was analysed at all moments grouped (MG) using analysis of main components, to define the number of dimensions determined by different variables that establish the scale extension. | Principal component analysis (“princomp” and “get_pca_var” functions from the “stats” and “factoextra” packages respectively). According to the Kaiser criterion [47], representative dimensions of the components were selected with eigenvalue > 1 and variance > 20 and each item on the scale with a load value ≥ of 0.50 or ≤ - 0.50. For the biplot, confidence ellipses were produced with significant levels of 95% to show the density of scores at each moment. |
Intra-observer reliability RV | Repeatability—the level of agreement of each observer with themself was estimated by comparing the two phases of assessment, using the scores of each item, the total sum of the USAPS, NS, SDS, VAS, and the need for rescue analgesia. | For the scores of the items of the USAPS and the NS and SDS, and the need for rescue analgesia, the weighted kappa coefficient (kw) was used; the disagreements were weighted according to their distance to the square of perfect agreement. The 95% confidence interval (CI) kw (“cohen.kappa” function of the “psych” package) was estimated. For the VAS, the intraclass correlation coefficient (ICC) type "agreement" was used and its 95% CI ("icc" function of the "irr" package) [48–50]. For the sum of the USAPS, the consistency type ICC and its 95% CI were used. Interpretation of kw and ICC: very good 0.81–1.0; good 0.61–0.80; moderate 0.41–0.60; reasonable 0.21–0.4 and poor < 0.2. [29,51,52]. The kw and ICC > 0.50 were used as a criterion to refine the scale. |
Inter-observer reliability RV* | Reproducibility (agreement matrix)—a matrix was generated to assess the level of agreement among all observers, using the scores for each item, the total sum of the USAPS, NS, SDS, VAS, and the need for rescue analgesia. | |
Criterion validity RV* | 1) Concurrent criterion validity (relationship with a validated instrument)—the correlation of the sum of the USAPS was estimated with the NS, SDS, VAS, and facial expression scale of all grouped moments. | Spearman rank correlation coefficient (rs; “rcorr” function of the “Hmisc” package). Interpretation of the degree of correlation rs (p < 0.05): 0–0.35 low correlation; 0.35–0.7 moderate correlation; 0.7–1.0 high correlation [29]. |
2) Concurrent criterion validity—the agreement between each observer vs all other observers (reproducibility). | Please see description above for inter-observer reliability. | |
3) Predictive criterion validity—was assessed by the number of sheep that should receive rescue analgesia according to the Youden index (described below) in the moment of greatest pain (M2). | Descriptive analysis. | |
Construct validity RV* | Responsiveness: 1) Ethogram—the proportion of each behaviour duration concerning the total recording time of 20 minutes observed by the in-person researcher at the four moments of the evaluation was compared over time (M1 vs M2 vs M3 vs M4). | The data distribution was assessed by graphs of boxes and histograms (“boxplot” and “histogram” functions of the “graphics” and “lattice” packages, respectively). As data were considered nonparametric, the Friedman test (function "friedman.test" of the package "stats") was used for comparisons over time. The p-value was corrected with the Bonferroni procedure (function "pairwiseSignTest" of the package "rcompanion") [19,29]. |
2) Scale—the scores of each item and the total score of the USAPS, NS, SDS, VAS, and the need for rescue analgesia over time were compared. | For the dichotomous variable need for rescue analgesia logistic regression analysis (“glm” function of the “stats” package) was applied using the post hoc Tukey test (“lsmeans” function of the “lsmeans” package). The model residuals (“residuals” function of the “stats” package) for the dependent variables USAPS, NS, SDS and VAS showed Gaussian distribution according to the quantile-quantile and histogram graphs (“qqnorm” and “histogram” functions of the “stats” and “lattice” packages, respectively), thus, mixed linear models (“lme” function of the “nlme” package) were applied. The residual distribution was not normal for other dependent variables (interaction, activity, locomotion, head position, appetite, and posture), therefore, generalised mixed linear models (“glmer" function of the "lme4" package) were applied. In both cases, the Bonferroni test was the post hoc test used [19,29]. Moments, breeding, observers and phases were included for all models as fixed effects and the individuals were considered a random effect. For these variables, differences were compared applying the post hoc test and, only to USAPS, moments, breeding and observers were used. | |
Construct validity was determined using the three hypothesis test: 1) if the scale really measures pain, the score after surgery (M2) should be higher than the preoperative score (M1 < M2); 2) the score should decrease after analgesia (M2 > M3); 3) and over time (M2 > M4). | ||
Item-total correlation RV* | The correlation of each item with the total score, excluding the evaluated item, was estimated to analyse homogeneity, the inflationary items and the relevance of each item of the scale. The analysis was performed for all grouped moments (MG). | Spearman rank correlation coefficient (r; “rcorr” function of the “Hmisc” package). Interpretation of correlation r: suitable values 0.3–0.7 [52]. Items were accepted if r > 0,3. |
Internal consistency RV* | The consistency (interrelation) of the scores of each item on the scale was estimated. The analysis was performed for all grouped moments (MG). | Cronbach's alpha coefficient (α; "cronbach" function of the "psy" package) [51] Interpretation: 0.60–0.64, minimally acceptable; 0.65–0.69 acceptable; 0.70–0.74 good; 0.75–0.80 very good; and >0.80 excellent [53]. |
Specificity
RV* and Sensitivity RV* |
The scores of the USAPS at M1 (for specificity) and M2 (for sensitivity) were transformed into dichotomous variables (score "0"—the absence of pain expression behaviour for a given item; scores "1" and "2"—the presence of pain) and applied to the equation. | |
Sp = specificity. TN = true negative [scores that represented painless behaviours (0) at the time when the animals were expected to have no pain, since it was before surgery—M1]. FP = false positive [scores that represented pain (1 or 2) in M1]. | ||
S = sensitivity. TP = true positive [scores that represented pain expression behaviours (1 or 2) at the time the animals were expected to have pain since it was after surgery–M2]. FN = false negative [scores representing painless behaviours (0) at M2]. | ||
Interpretation: excellent 95–100%; good 85–94.9%; moderate 70–84.9%; not specific or not sensitive < 70%. Only items ≥ 70% were included [52]. | ||
The pain-free (M1) and the most intense pain (M2) moments were used as the true values and each item of the USAPS as a predictive value to build a receiver operating characteristic curve (ROC) (ROC; “roc” function of the “pROC” package). The area under the curve (AUC) and its 95% confidence interval (CI) was calculated replicating the original ROC curve 1,001 times by the bootstrap method (“ci.coords and “ci.auc” functions of “pROC” package). | ||
Rescue analgesic point V* | The need for analgesia according to the clinical experience, after the observers had watched the videos, was used as the true value and the total score of the USAPS as a predictive value to build a ROC curve. The cut-off point for rescue analgesia was determined based on the Youden index and its diagnostic uncertainty zone using all moments of pain assessment on the USAPS. Cut-off point was represented by the Youden index using all moments of pain assessment on the USAPS, NS, SDS and VAS. The AUC was calculated and indicates the discriminatory capacity of the test. The frequency and percentage of animals scored in the diagnostic uncertainty zone of the cut-off point for the USAPS, NS, SDS, VAS were calculated using descriptive statistical analysis. |
|
YI = Youden Index; S = sensitivity; Sp = specificity. Analysis of the ROC curve (ROC; “roc” function of the “pROC” package) and the AUC: graphical representation of the relationship between the “TP” (S) and the “FP” (1-Sp). YI is the point of greatest sensitivity and specificity simultaneously, determined by the ROC curve. Interpretation: AUC ≥ 0.95—high discriminatory capacity of the scale [54]. The diagnostic uncertainty zone was determined by two methods, calculating: 1) the 95% CI replicating the original ROC curve 1,001 times by the bootstrap method (“ci.coords” and “ci.auc” functions of “pROC” package); 2) the interval between the sensitivity and specificity values of 0.90. The highest interval of one of these two methods was considered the diagnostic uncertainty zone, which indicates the diagnostic accuracy [55,56]. |
Scales: numerical (NS), simple descriptive (SDS), visual analogue (VAS).
*The validation analyses were performed using the scores given at all time-points by all evaluators grouped in phases 1 and 2. Statistical analysis was performed using R software in the RStudio integrated development environment [57]. For all analyses, an α of 5% was considered, MG—data of grouped moments (M1 + M2 + M3 + M4)
Table 3. Final validated Unesp-Botucatu sheep acute composite pain scale (USAPS).
Item | Subitem (descriptors) | Score | Links to videos |
---|---|---|---|
Interaction | Active, attentive to the environment, interacts and/or follows other animals | 0 | https://www.youtube.com/watch?v=4fOJWD-uNbg&t=9s |
Apathetic: may remain close to other animals, but interacts little | 1 | https://www.youtube.com/watch?v=EEyMC_VIMpk | |
Very apathetic: isolated or not interacting with other animals, not interested in the environment | 2 | https://www.youtube.com/watch?v=5NsthhKoEP4 | |
Locomotion | Moves about freely, without altered locomotion; when stopped, the pelvic limbs are parallel to the thoracic limbs | 0 | https://www.youtube.com/watch?v=W0Hw2Ibqbyk |
Moves about with restriction and/or short steps and/or pauses and/or lameness; when stopped, the thoracic or pelvic limbs may be more open and further back than normal | 1 | https://www.youtube.com/watch?v=i8FxBj-yQhw | |
Difficulty and/or reluctant to get up and/or not moving and/or walking abnormally and/or limping; may lean against a surface | 2 | https://www.youtube.com/watch?v=dPdT9VMJTi0 | |
Head Position | Head above the withers or eating | 0 | https://www.youtube.com/watch?v=W8mi15I1dr8 |
Head at the height of the withers | 1 | https://www.youtube.com/watch?v=8xSUmoXaiZY | |
Head below the withers (except when eating) | 2 | https://www.youtube.com/watch?v=YRxpWSTsqpw | |
Posture | Arched back | https://www.youtube.com/watch?v=gloa-38gTW8 | |
Extends the head and neck | https://www.youtube.com/watch?v=rNh_aFePKAE | ||
Lying down with head resting on the ground or close to the ground | https://www.youtube.com/watch?v=LT6BJzhZO9E | ||
Moves the tail quickly (except when breastfeeding) and repeatedly and/or keeps the tail straight (except to defecate/urinate) | https://www.youtube.com/watch?v=91RbQMsa8Mg | ||
Absence of these behaviours | 0 | ||
Presence of one of the related behaviours | 1 | ||
Presence of two or more of the related behaviours | 2 | ||
Activity | Moves normally | 0 | https://www.youtube.com/watch?v=dDx9FesiA2M |
Restless, moves more than normal or lies down and gets up frequently | 1 | https://www.youtube.com/watch?v=3MjccV2yV74 | |
Moves less frequently or only when stimulated using a stick or does not move | 2 | https://www.youtube.com/watch?v=EvLDBJo93jo | |
Appetite | Normorexia and/or rumination present | 0 | https://www.youtube.com/watch?v=no1VeiFglUE |
Hyporexia | 1 | https://www.youtube.com/watch?v=aIEY1UkqQ-k | |
Anorexia | 2 | https://www.youtube.com/watch?v=YV40N-OHuNI |
Ethogram
The observer (NEOFS) watched the 20-minute videos of all moments described in Fig 1 twice (48 animals x 4 moments = 192 videos; a total of 64 hours). The observer watched the videos for the first time for recognition and selection of the relevant pain behaviours. During the second viewing, the observer registered the duration of the behaviours according to the focal animal method [58]. The observer calculated the proportion of each behaviour duration concerning the total recording time of 20 minutes. The ethogram was composed of these behaviours (S1 Table) and used to build the pain scale. Next, the videos were edited with the inclusion of the predominant behaviours for a period of about three minutes at each moment. The edited videos were evaluated by four observers for the scale validation process.
Pain scale video evaluation
The videos were made available to the observers on a virtual platform. The four moments were randomised for each animal and the observers were blind to the moment the videos were recorded. At the end of the observation of each video, the observers, based on their clinical experience, answered whether or not they would administer rescue analgesia (0 = no and 1 = yes to administer rescue analgesia). These data were used to determine the cut-off point related to the need for analgesic intervention. Next, pain scores were determined using three unidimensional scales (NS, SDS, and VAS), the composite pain scale (S3 Table) and the facial scale by observing the photographs included at the end of each video recording [41].
The NS ranges from "0" to "10", where "0" represents no pain and "10" the worst possible or imaginable pain; the SDS ranges from 1—no pain, 2—mild pain, 3—moderate pain, and 4—severe pain; and the VAS is based on a straight line 100 mm long, where “0” represents the animal without pain and “100” the worst possible pain [23,26,27].
Statistical analysis
Statistical analysis was performed using R software in the RStudio integrated development environment [57]. For all analyses, an α of 5% was considered. Table 1 presents the methods for the refinement and statistical validation process of the proposed scale. The pre-refinement scale used for evaluation of the videos (S3 Table) was submitted to statistical analysis according to Table 1. To produce the validated final scale, the inclusion and exclusion criteria of items and subitems followed ten statistical tests (S4 Table): 1) ethogram (significantly longer duration of each behaviour according to the Friedman test at M2 vs the other moments); 2) content validation (S2 Table); 3) at least 15% frequency of occurrence of each behaviour at M2; 4) multiple association (principal component analysis); 5) intra-observer reliability; 6) inter-observer reliability; 7) construct validity—higher score of the behaviour at M2 vs at least two of the three moments (M1, M3 and M4) according to Friedman test; 8) item-total correlation; 9) internal consistency; 10) specificity and sensitivity. The behaviours that met the criteria stipulated in more than 50% of these statistical tests were accepted and included in the final scale.
The statistical analysis used for the validation of the scale encompassed data from phases 1 and 2 of all observers.
Results
Behaviour data (ethogram)
S1 Table contains the behaviours recorded in the ethogram and Table 2 contains the percentage duration of each behaviour. When the moment of greatest pain (M2 –postoperative) was compared to the moment when sheep were supposedly pain-free (M1—basal), the following differences were observed: the duration of “normal interaction”, “normal locomotion”, and “head above the withers” decreased and the duration of “reduced and absent locomotion” and “arch the back” increased. After the rescue analgesia (M3), compared to M2, the duration of "eat" and "normal interaction" increased, and the duration of "normal and reduced/altered locomotion" and "head below the withers" decreased. "Eat" increased at M3 compared to M2. It was not possible to compare appetite between M2 vs M1 because sheep were fasting before surgery.
Table 2. Median and range of the percentage duration of behaviours of 48 sheep before and after laparoscopy.
Moments | M1 | M2 | M3 | M4 | ||||
---|---|---|---|---|---|---|---|---|
Behaviour category | Median | Range | Median | Range | Median | Range | Median | Range |
Eat | 0c | 0–0 | 11b | 0–82 | 31.25a | 0–86 | 34ab | 0–71 |
Ruminate | 0b | 0–24 | 0ab | 0–41 | 4.04a | 0–20 | 4a | 0–44 |
Drink | 0 | 0–7 | 0 | 0–26 | 0 | 0–16 | 0 | 0–2 |
Urinate | 0 | 0–9 | 0 | 0–12 | 0 | 0–21 | 0 | 0–5 |
Defecate | 0 | 0–0 | 0 | 0–19 | 0 | 0–0 | 0 | 0–0 |
Normal interaction | 44a | 0–100 | 0b | 0–91 | 7.15a | 0–95 | 61a | 0–97 |
Reduced interaction | 0a | 0–97 | 8a | 0–94 | 0a | 0–100 | 0b | 0–97 |
Absent interaction | 0 | 0–100 | 0 | 0–100 | 0 | 0–30 | 0 | 0–88 |
Normal locomotion | 23a | 0–57 | 0b | 0–68 | 0c | 0–47 | 14a | 0–50 |
Reduced/altered locomotion | 0b | 0–21 | 0a | 0–25 | 0b | 0–40 | 0a | 0–47 |
Absent/abnormal locomotion | 0b | 0–70 | 2a | 0–100 | 0ab | 0–60 | 0b | 0–30 |
Head above the withers | 11a | 0–80 | 0b | 0–50 | 0b | 0–67 | 21a | 0–86 |
Head at the height of the withers | 0 | 0–68 | 0 | 0–78 | 0 | 0–87 | 0 | 0–81 |
Head below the withers | 10a | 0–70 | 13a | 0–81 | 6.46b | 0–60 | 5b | 0–25 |
Standing still in normal posture | 61b | 33–89 | 67ab | 0–94 | 73.87a | 0–100 | 74ab | 10–92 |
Standing in altered posture | 5a | 0–31 | 6a | 0–37 | 1.04ab | 0–60 | 0b | 0–8 |
Kick and stamp the limbs on the ground | 0b | 0–0 | 0ab | 0–5 | 0b | 0–0 | 0a | 0–14 |
Lying down with extension of the head and neck and/or limb(s) | 0ab | 0–31 | 0a | 0–38 | 0ab | 0–60 | 0b | 0–11 |
Lying down | 0 | 0–31 | 0 | 0–90 | 0 | 0–35 | 0 | 0–44 |
Lying down with head turned back | 0 | 0–0 | 0 | 0–0 | 0 | 0–0 | 0 | 0–0 |
Lying with head supported on or close to the ground | 0 | 0–28 | 0 | 0–100 | 0 | 0–32 | 0 | 0–0 |
Look at affected area | 0 | 0–0 | 0 | 0–0 | 0 | 0–0 | 0 | 0–0 |
Lick the affected area | 0 | 0–0 | 0 | 0–0 | 0 | 0–0 | 0 | 0–0 |
Quick and repeated tail movements | 0 | 0–40 | 0 | 0–0 | 0 | 0–0 | 0 | 0–0 |
Keep the tail straight | 0 | 0–22 | 0 | 0–6 | 0 | 0–0 | 0 | 0–50 |
Arch the back | 0b | 0–0 | 0a | 0–34 | 0ab | 0–13 | 0ab | 0–7 |
Body tremors | 0 | 0–0 | 0 | 0–11 | 0 | 0–0 | 0 | 0–0 |
The proportion of duration of each behavioural category was calculated based on the total time of each period of evaluation (20 mins). Different letters express significant differences between moments (values in bold express differences at M2 compared to M1, or M3, or M4) with a>b>c, according to the Friedman test (p <0.05) [19,29]. M1: preoperative; M2—postoperative, before rescue analgesia; M3—postoperative, after rescue analgesia; M4 - 24h after surgery.
Pain scale data
According to the inclusion/exclusion refinement criteria (S4 Table), the following sub-items were excluded: “walks backwards", "walks in a circle”, "kicks and stamps limbs on the ground", "extends one or more limbs, “body tremors”, and “crawls in ventral recumbence, without getting up.”
The final version of the USAPS containing six items (five with three subitems and one with four subitems) was validated (Table 3).
Distribution of scores
The distribution of scores “0”, “1” and “2” occurred as expected, according to the degree of pain. The score “0” predominated at moments M1, M3 and M4. Scores “1” and “2” were more frequent in M2 and decreased in M3. Only the item “activity” of score “1” was not representative. The most frequent postures in M2 were “extends the head and neck” and “lying down with head resting (or close) on (to) the ground” (Fig 3).
Principal component analysis
The multiple association among the items of the scale evaluated through principal component analysis selected the main component 1, representative of one dimension, providing the mathematical reason why the scale is unidimensional (Table 4; Fig 4).
Table 4. Load values, eigenvalues and variance of the USAPS items based on principal components analysis.
Dimensions | 1 | 2 |
---|---|---|
Items | Load value | Load value |
Interaction | 0.88 | 0.01 |
Locomotion | 0.85 | -0.14 |
Head position | 0.78 | 0.00 |
Posture | 0.60 | -0.13 |
Activity | 0.84 | -0.12 |
Appetite | 0.31 | 0.95 |
Eigenvalue | 3.26 | 0.94 |
Variance | 54.25 | 15.77 |
USAPS–Unesp-Botucatu sheep acute composite pain scale. The structure was determined considering items with a load value ≥ 0.50 or ≤ -0.50 (in bold), with representative dimension (eigenvalue > 1 and variance > 20%) [47].
Intra-observer reliability
Repeatability ranged from reasonable to good for each item on the USAPS (except for appetite for evaluator 4 which was poor) and from good to very good for their total score at all moments assessed (Table 5).
Table 5. Intra-observer reliability of the USAPS, unidimensional scales and rescue analgesia indication in sheep.
Evaluator | 1 | 2 | 3 | 4 | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Items | kw | Min | Max | kw | Min | Max | kw | Min | Max | kw | Min | Max |
Interaction | 0.64 | 0.55 | 0.74 | 0.66 | 0.63 | 0.70 | 0.52 | 0.41 | 0.64 | 0.65 | 0.56 | 0.74 |
Locomotion | 0.71 | 0.64 | 0.79 | 0.65 | 0.59 | 0.73 | 0.48 | 0.36 | 0.60 | 0.61 | 0.52 | 0.71 |
Head position | 0.67 | 0.57 | 0.76 | 0.71 | 0.67 | 0.74 | 0.48 | 0.36 | 0.60 | 0.59 | 0.49 | 0.68 |
Posture | 0.41 | 0.22 | 0.60 | 0.67 | 0.67 | 0.67 | 0.48 | 0.34 | 0.62 | 0.58 | 0.55 | 0.61 |
Activity | 0.54 | 0.44 | 0.64 | 0.65 | 0.58 | 0.71 | 0.56 | 0.47 | 0.66 | 0.47 | 0.35 | 0.59 |
Appetite | 0.55 | 0.44 | 0.66 | 0.61 | 0.52 | 0.69 | 0.38 | -0.08 | 0.84 | 0.15 | -0.04 | 0.35 |
Rescue analgesia | 0.67 | 0.56 | 0.77 | 0.75 | 0.65 | 0.85 | 0.53 | 0.41 | 0.65 | 0.53 | 0.40 | 0.65 |
Numerical scale | 0.80 | 0.80 | 0.80 | 0.85 | 0.85 | 0.85 | 0.58 | -0.19 | 1 | 0.72 | 0.72 | 0.72 |
SDS | 0.78 | 0.78 | 0.78 | 0.77 | 0.77 | 0.77 | 0.61 | 0.61 | 0.61 | 0.67 | 0.61 | 0.74 |
Scales | ICC | CI | ICC | CI | ICC | CI | ICC | CI | ||||
USAPS | 0.77 | 0.71 | 0.82 | 0.84 | 0.79 | 0.88 | 0.65 | 0.56 | 0.72 | 0.72 | 0.64 | 0.78 |
VAS | 0.80 | 0.74 | 0.85 | 0.81 | 0.76 | 0.86 | 0.55 | 0.44 | 0.64 | 0.71 | 0.63 | 0.77 |
USAPS—Unesp-Botucatu sheep acute composite pain scale; SDS—simple descriptive scale; VAS—visual analogue scale. kw−weighted kappa coefficient; ICC—intraclass correlation coefficient; CI—Confidence interval. Interpretation of reliability—very good 0.81–1.0; good 0.61–0.80; moderate 0.41–0.60; reasonable 0.21–0.4; poor <0.2 [29,51,52]. Bold type corresponds to values > 0.50.
Inter-observer reliability
Inter-observer agreement for all items of the USAPS was moderate for all observers, except for posture and appetite which were reasonable for one observer (S5 Table). The total USAPS matrix agreement was moderate or good. USAPS was the only scale agreement > 0.50 for all observers (Table 6).
Table 6. Inter-observer matrix agreement of the USAPS, unidimensional scales and rescue analgesia indication.
Evaluator | 1 | 2 | 3 | 1 | 2 | 3 | 1 | 2 | 3 |
---|---|---|---|---|---|---|---|---|---|
Scales—kw | Numerical scale | Simple descriptive scale | Rescue analgesia | ||||||
2 | 0.40 | 0.68 | 0.51 | ||||||
3 | 0.44 | 0.69 | 0.52 | 0.59 | 0.49 | 0.65 | |||
4 | 0.72 | 0.46 | 0.49 | 0.67 | 0.65 | 0.47 | 0.55 | 0.47 | 0.43 |
Scales—ICC | USAPS | VAS | |||||||
2 | 0.65 | 0.24 | |||||||
3 | 0.57 | 0.74 | 0.33 | 0.64 | |||||
4 | 0.70 | 0.63 | 0.53 | 0.70 | 0.40 | 0.46 |
USAPS—Unesp-Botucatu sheep acute composite pain scale; VAS—visual analogue. kw−weighted kappa coefficient; ICC—intraclass correlation coefficient; Interpretation of reliability: very good 0.81–1.0; good 0.61–0.80; moderate 0.41–0.60; reasonable 0.21–0.4; poor < 0.2 [29,51,52]. Bold type corresponds to values > 0.50.
Criterion validity
Concurrent criterion validity
There was a high correlation between USAPS and NS (r = 0.83), SDS (r = 0.81), and VAS (r = 0.81), and moderate correlation with the facial scale (r = 0.48) (Fig 5).
Construct validity (responsiveness)
The scores for all items and the total score of USAPS were significantly higher at M2 than at M1, M3, and M4, demonstrating their responsiveness. The differences between moments for the total scores of USAPS, the NS, SDS, and VAS were M2 > M3 > M1 > M4 (Table 7; Fig 6).
Table 7. Responsiveness of the USAPS, rescue analgesia and unidimensional pain scales, between the four perioperative moments.
Moments | ||||||||
---|---|---|---|---|---|---|---|---|
Scales | M1 | M2 | M3 | M4 | ||||
Items | Median | Amplitude | Median | Amplitude | Median | Amplitude | Median | Amplitude |
Interaction | 0c | 0–2 | 1a | 0–2 | 1b | 0–2 | 0d | 0–2 |
Locomotion | 0c | 0–2 | 2a | 0–2 | 1b | 0–2 | 0c | 0–2 |
Head position | 0c | 0–2 | 1a | 0–2 | 1b | 0–2 | 0d | 0–2 |
Posture | 0c | 0–2 | 1a | 0–2 | 0b | 0–2 | 0c | 0–2 |
Activity | 0c | 0–2 | 2a | 0–2 | 1b | 0–2 | 0d | 0–2 |
Appetite | 2c | 0–2 | 1a | 0–2 | 0b | 0–2 | 0d | 0–2 |
USAPS | 2c | 0–11 | 8a | 0–12 | 4b | 0–11 | 0d | 0–10 |
Rescue analgesia | 0c | 0–1 | 1a | 0–1 | 1b | 0–1 | 0c | 0–1 |
NS | 2c | 1–8 | 6a | 1–10 | 3,5b | 1–10 | 1c | 1–9 |
SDS | 1c | 1–3 | 3a | 1–4 | 2b | 1–4 | 1c | 1–4 |
VAS | 10c | 0–80 | 58a | 0–100 | 28b | 0–100 | 6c | 0–91 |
USAPS—Unesp-Botucatu sheep acute composite pain scale; RA—Rescue analgesia (0—no; 1—yes); NS (1–10), SDS (1–4) and VAS (0–100). Different letters express significant differences between moments where a > b > c > d, according to the mixed linear model [19,29]. M1: preoperative; M2: postoperative, before rescue analgesia; M3: postoperative, after rescue analgesia; M4: 24h postoperative.
Evaluators and breeds (as fixed effects) influenced the total score of the USAPS. When pain scores of USAPS were compared separately for breeds, the differences in the total scores of Bergamacia and Lacaune sheep (n = 18) were the same as for all sheep together (M2 > M3 > M1 > M4; Table 7, Fig 6). The differences in the total scores of Dorper sheep were M2 > M3 = M1 > M4. There was no difference in M2 scores between the breeds. Results from two evaluators were the same as for all sheep and evaluators together (M2 > M3 > M1 > M4; Table 7, Fig 6). Results from the other two evaluators were M2 > M3 = M1 > M4, like observed for the Dorper sheep breed. The scores among evaluators were different at M2 [7 (0–12) < 8 (0–12) = 8 (0–12) < 9 (0–12)].
Item-total correlation
The correlation coefficient of item score with the total score (item-total score) ranged from 0.56 to 0.76, therefore all items were accepted, except appetite (Table 8).
Table 8. Item-total correlation and internal consistency of the USAPS.
Items Tests |
Item-total (Spearman) | Internal consistency (Cronbach’s α) |
---|---|---|
Full scale | 0.81 | |
Excluding each item below | ||
Interaction | 0.76 | 0.73 |
Locomotion | 0.72 | 0.74 |
Head position | 0.62 | 0.77 |
Posture | 0.56 | 0.80 |
Activity | 0.71 | 0.75 |
Appetite | 0.25 | 0.85 |
USAPS: Unesp-Botucatu sheep acute composite pain scale. Interpretation of Spearman's rank correlation coefficient (r): 0.3–0.7: acceptable values in bold [52]. Interpretation of the Cronbach's α coefficient values: 0.60–0.64 minimally acceptable; 0.65–0.69 acceptable; 0.70–0.74 good; 0.75–0.80 very good; > 0.80 excellent [53]; bold values > 0.70.
Internal consistency
The Cronbach's α coefficient was 0.81, which indicates that the instrument presents excellent internal consistency and reinforces the possibility of using the full-scale score to interpret the results obtained. Internal consistency was excellent when appetite (0.85) was excluded and very good when all other individual items were excluded, showing that all items contributed similarly and significantly to the total score (Table 8).
Specificity and sensitivity
All items of the USAPS were specific, except “appetite.” All items presented moderate to good sensitivity, except “appetite” and “posture” that were not sensitive (Table 9).
Table 9. Specificity and sensitivity of the USAPS.
Items Tests |
Specificity (%) | Sensitivity (%) | AUC | Min. | Max. |
---|---|---|---|---|---|
Interaction | 72 | 84 | 0.78 | 0.75 | 0.81 |
Locomotion | 76 | 90 | 0.83 | 0.80 | 0.86 |
Head position | 74 | 82 | 0.78 | 0.75 | 0.81 |
Posture | 82 | 61 | 0.72 | 0.69 | 0.75 |
Activity | 73 | 89 | 0.81 | 0.78 | 0.84 |
Appetite | 46 | 52 | 0.49 | 0.45 | 0.52 |
Interpretation of specificity and sensitivity: excellent 95–100%; good 85–94.9%; moderate 70–84.9%; not specific or sensitive <70%; bold values ≥ 70% [52].
ROC Curve, Youden index, cut-off point and diagnostic uncertainty zone of the USAPS
In the analysis of the receiver operating characteristic (ROC) curve to determine the cut-off point for diagnosing pain and recommending analgesia, the Youden index was ≥ 4 of 12 for all grouped evaluators. The interval between the sensitivity and specificity values of 0.90 was between 3.8 and 4. The resampling confidence interval for the Youden index was between 3.5 and 4.5. Based on the resampling result, the diagnostic uncertainty zone scores ranged from 4 to 5; therefore < 4 indicates pain-free sheep (true negative) and > 5 indicates sheep suffering pain (true positive). The area under the curve was 0.96 (0.95–0.97), indicating that the USAPS presents excellent discriminatory capacity (Fig 7; S6 Table). After exclusion of appetite, the Youden index remained the same (≥ 4 of 10) and so did the area under the curve (0.96).
For the unidimensional scales, the cut-off points for rescue analgesia defined by the ROC curve and the Youden index were ≥ 4 for SN, ≥ 2 for SDS and ≥ 26 for VAS (Table 10). Complete data are available in supporting information (S6 Table).
Table 10. Scores, specificity, sensitivity and Youden index corresponding to rescue analgesia indication of the USAPS and unidimensional scales.
Scale | Score | Specificity | Sensitivity | Youden index |
---|---|---|---|---|
USAPS | 4 | 0.88 | 0.92 | 0.80 |
NS | 4 | 0.97 | 0.93 | 0.90 |
SDS | 2 | 0.84 | 0.99 | 0.83 |
VAS | 26 | 0.94 | 0.94 | 0.88 |
Scales: USAPS—Unesp-Botucatu sheep acute composite pain scale; NS–numerical; SDS—simple descriptive; VAS—visual analogue.
The percentage of animals present in the diagnostic uncertainty zone was low at all moments (13%; 12–15) (Table 11).
Table 11. Percentage of sheep present in the diagnostic uncertainty zone according to the Youden index of the USAPS.
Evaluator | |||||
---|---|---|---|---|---|
Moments | 1 | 2 | 3 | 4 | All |
M1 | 13 | 17 | 15 | 18 | 15 |
M2 | 13 | 13 | 9 | 3 | 9 |
M3 | 22 | 19 | 20 | 24 | 21 |
M4 | 15 | 5 | 5 | 7 | 8 |
MG | 15 | 13 | 12 | 13 | 13 |
Calculation based on 48 sheep evaluated twice by four evaluators. USAPS: Unesp-Botucatu sheep acute composite pain scale. M1—preoperative; M2—postoperative, before rescue analgesia; M3—postoperative, after rescue analgesia; M4 - 24h postoperative; MG—data of grouped moments (M1 + M2 + M3 + M4). The diagnostic uncertainty zone was 3.5–4.5; < 4 indicates pain-free sheep (true negative) and > 5 indicates sheep suffering pain (true positive).
Predictive criterion validity
Considering the Youden index, 88% (81–96) of sheep would receive rescue analgesia in the moment of most intense pain (M2). Unnecessary analgesia would be indicated in 29% (24–36) of sheep at M1, demonstrating that the scale was sensitive in distinguishing pain and specific in distinguishing sheep not suffering pain (Table 12).
Table 12. Percentage of sheep rescue analgesia was indicated according to clinical experience and to the Youden index of the USAPS.
Evaluator | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Moments | 1 | 2 | 3 | 4 | All | |||||
RA | Exp | YI | Exp | YI | Exp | YI | Exp | YI | Exp | YI |
M1 | 16 | 29 | 10 | 25 | 21 | 24 | 25 | 36 | 18 | 29 |
M2 | 92 | 92 | 80 | 82 | 79 | 81 | 97 | 96 | 87 | 88 |
Calculation based on 48 sheep evaluated twice for all evaluators (96 assessments). RA–indication of rescue analgesia according to clinical experience scored at the end of each video analysis (Exp) and according to the Youden index of the USAPS (score ≥ 4). USAPS—UNESP-Botucatu sheep composite acute pain scale. M1—preoperative; M2—postoperative, before rescue analgesia; Youden index ≥ 4 is representative of the cut-off point for the indication of rescue analgesia (see Table 10 for results of Youden index).
Discussion
The creation of valid species-specific tools to assess pain is a prerequisite for recognising the phenomenon and determining the need and effectiveness of analgesic treatment. From this perspective, the behavioural pain scale proposed herein is a reliable and valid instrument with a defined analgesic intervention point, which can be used to assess postoperative abdominal pain in sheep. This instrument demonstrates potential clinical applicability to guide decision making for analgesia indication when necessary, and potential experimental applicability for translational studies and those comparing the analgesic efficacy of drugs [1].
The validation process of an instrument to assess pain is based on the investigation of behaviours and, when possible, of species-specific physiological data present during pain situations, followed by a comparison of these changes with the state of normality [19,29,32]. This methodology was followed in the current study; an ethogram was constructed during the preoperative period when animals were supposedly devoid of pain, followed by the postoperative period when animals probably had severe pain, followed by rescue analgesia for pain reduction and reassessment after 24 hours. Thus, the experimental design tested the instrument at different pain intensities. The ethogram, together with the pain expression behaviours in sheep described in the literature, served as a basis for the construction of the scale. After content analysis, the first instrument was defined to include relevant behaviours and exclude irrelevant behaviours, to make the instrument as simple and representative as possible.
Filming using video cameras adds value to the data as it enables to archive of the material for future research and minimises the influence of the observer in the evaluation, avoiding possible observer-related behavioural changes that the animal may present which are inherent to the presence of the observer. On the other hand, it is often not possible in a clinical situation to make a remote assessment, and the presence of the observer could interfere with the animals' behaviour [59,60]. Thus, it is still necessary to validate the proposed scale in clinical situations and with the presence of the observer, to ensure that these results are reproducible.
According to the ethogram sheep in pain ate less than after rescue analgesia, which justified the introduction of appetite as one of the criteria evaluated on the scale. At the preoperative moment, this behaviour was not present because animals were fasting. Decreased appetite is a common finding in sheep submitted to castration and laparoscopy [20,38,45,61,62].
In the current study, laparoscopy led to behavioural alterations indicative of acute pain. Sheep reduced their locomotion and interaction with the environment, lowered their head, and arched their back. Some of these behaviours only returned to normal 24 hours after surgery. These behaviours were similar to those previously reported in lambs undergoing different painful stimuli [21], like mulesing [63] and orchiectomy [64,65]. During severe pain limb, tail, and head movements and full extension of the pelvic limbs occur; during moderate pain vocalisation, standing, sitting, and lying positions with the partial extension of the pelvic limbs or tremor are observed; and during mild pain or no pain postures may be normal [20].
Vocalisation could be a possible indicator of pain, like in other ruminants such as cattle [19,66–68] and goats [68]. However, in sheep, this behaviour is more related to social isolation and restraint. Except at times when the feed was supplied, vocalisation was not observed in the current study and is not an indicator of postoperative pain in adult sheep submitted to laparoscopy, as reported previously in lambs undergoing castration and tail docking [20,69]. Different from the current study, the majority of studies that evaluated acute pain in sheep used lambs [5,20–22,61,63–65], which could limit the extrapolation of the results to adult animals. Some behaviours more specific to lambs mentioned in the literature, such as “jumping like a rabbit”, did not occur, as they are more frequent in young animals up to about 5 months of age than in adult animals. Common behaviour in cattle [19] and cited in lambs [20,61] “look at the flank and lick the painful area” was not observed in the adult sheep in the current work.
Validity and reliability are essential attributes for an instrument to identify and quantify pain in animals. The instrument was subjected to a blinded and random methodology, through the same experimental design and recognised scientific robustness [43] already used in cats [29], cattle [19], horses [24], and pigs [32]. Observers familiar with the behaviour of ruminants validated the content of the scale by assessing the representativeness of each item. This analysis measures the extent to which the instrument reflects the phenomenon of interest, in this case, pain [29,30,70]. The evaluators were selected for their experience to improve the reliability and accuracy of the tool based on repeatability and reproducibility [70].
The initially proposed scale contained 33 variables including items, subitems and sub-divisions (S3 Table). Some of these were excluded according to the criteria of the statistical tests (Table 1). The scale refinement identified the 12 most relevant and appropriate items and sub-items to measure pain in sheep and was essential to improve the quality of the validated final scale into a simpler and more objective version [71].
The analysis of score distribution provides an overview of the occurrence of each score at each moment to indicate the importance of each score. The results were as expected since the score 0 (absence of pain) prevailed before and 24h after the surgery, scores 1 and 2 occurred more in the postoperative period and after the rescue analgesia, and the score 2 was more present after surgery, suggesting a greater intensity of pain. The results of each item generally followed the results of the sum of the scale. Only score 1 of the "activity" item was not so evident, showing that it is rare for sheep to move about more than normal or to lie down and get up frequently, as occurs in other species [19,24,29,32]. A considerable percentage of the score 0 (normorexia and/or ruminating) when sheep were fasting at M1 may be a confounding error. The bedding of the stalls was rice straw and the fact that sheep searched for food on the ground possibly provided the impression they were eating and/or ruminating.
The principal component analysis relates the variables of the tool in a grouped manner and calculates the number of dimensions determined by different variables [29] to establish the extension or dimensionality of the scale [72]. These variables are related so that the items that define specific parts of the construct are grouped by multiple association [33]. The Kaiser criterion selected one component, therefore the scale is unidimensional [52], like in cattle [19] and pigs [32]. An instrument is multidimensional, like in cats [25,29], when in addition to pain intensity, it includes qualitative and temporal characteristics, such as sensory, motor, emotional, and cognitive dimensions, which have a high correlation in the experience of pain [29,33,72]. In a validation of the acute pain scale in lambs, the principal component analysis generated two principal components [20]. Unidimensional scales are not as satisfactory as those with more than one dimension, as they only assess the intensity of pain. However, because they are simple, they are easily applicable. In the current study, it is premature to conclude about the number of dimensions of the proposed pain scale in mathematical terms, since only one statistical model was evaluated. The scale includes several biological aspects of pain, such as physiological (appetite), sensory or motor (posture, activity), emotional (interaction with other animals and attention to the environment), and temporal (response to analgesia) [29]; therefore, in biological terms, the USAPS is multidimensional. Future studies addressing different pain models, such as orthopaedic, may or may not confirm if this scale is applicable for other types of pain.
The intra- and inter-observer reliability for each item and the total score of the sheep scale was similar to that of cattle [19] and pigs [32], lower than in cats [29] and higher than in horses [24]. When compared with other instruments developed in the sheep species, the scale proposed here presented reliability similar to the scale reported in lambs subjected to acute pain [20]. Compared to a sheep locomotion scale (with a score ranging from 0 to 6) that demonstrated very good intra (91%) and inter-observer (93%) reliability [73], the proposed instrument showed lower results, in which the item “locomotion” presented good intra-observer reliability for most observers and only moderate inter-observer reliability. Another study, in which 10 veterinarians and 10 sheep farmers scored a locomotion scale, obtained very good and good values for intra- and inter-observer reliability, however, the reliability for individual locomotion scores varied from reasonable to moderate [74].
Validity indicates that the instrument can accurately measure what is proposed. There are three types of validity: content analysis, described before, criterium and construct. Criterion validity assesses the measuring efficiency of a scale and includes concurrent and predictive criterion validity. Concurrent validity compares the instrument to existing validated scales [19,24,29,32], by evaluating the instrument and the criterion simultaneously and predictive validity evaluates the criterion after the test. Both methods were used in this study [75]. Every new instrument needs to be compared with another already established and validated tool [43]. For this context, previous instruments were developed for pain assessment in sheep based on behavioural body changes [20] and facial expression [41,42]. The former instrument was not used for comparison because some behaviours were common to our study and correlation would be inflated. Therefore, the facial expression scale was used as a previously validated gold standard model for testing concurrent criterion validity. A second method compared the proposed instrument with the unidimensional scales, following the same criteria applied in cats [29], cattle [19], horses [24] and pigs [32]. The USAPS showed a high correlation with the unidimensional scales, as previously reported for validated scales in other species [19,24,29,32] and a claudication scale in sheep [76]. Otherwise, correlation with the facial scale was only moderate possibly because other breeds of sheep were used in this study and their facial morphology was different from the original study [41].
Construct validity reflects the responsiveness of the scale and examines whether the instrument detects predictable differences between groups or moments [33]. The method tests the hypothesis that time and surgical and analgesic intervention should alter pain scores [29] and has been used to validate scales in veterinary medicine [19,24,29,32]. In this study, the differences observed in the pain scores between the moments, and especially at the expected moment of greatest pain compared to the other moments, confirm that the proposed scale is responsive both to identify intense degrees of pain, as well as moderate degrees, which occurred after rescue analgesia. In cattle, the alterations between scores (M2>M4 = M3 = M1) [19] were slightly different from sheep, where the pain at M4 decreased after M3 and was even lower than M1 (M2>M3>M1>M4). The increase and decrease in pain scores after surgery and rescue analgesia, respectively, also occurred in cats [29], horses [24] and pigs [32], however, differently from sheep, in these species pain scores tended to increase after 24hs. This is possibly related to the different surgical, anaesthetic and analgesic protocols among these species or because the USAPS responds differently. The USAPS scores were lower at 24h postoperatively than the preoperative scores because sheep did not have access to food before surgery, therefore appetite was scored as anorexia for most sheep at this moment.
Although the evaluators and the breeds, unlike the phases, influenced the total score of the USAPS, the differences in results among breeds and evaluators were observed only between the preoperative and 24h postoperative time points. For some breeds and evaluators these scores were not different and for others, the scores at 24h were lower than the preoperative scores. This does not appear to have relevance, showing that, apparently, the scale worked well regardless of the breeds.
Except for appetite, all items of the proposed scale presented an acceptable item-total correlation, as in pigs [32], which demonstrates their relevance and ensures the homogeneity of the tool. The internal consistency of the proposed scale was excellent and similar to cats—0.86 [29], cattle—0.87 [19] and pigs—0.82 [32], which ensures that the scores of the scale items can be added and the total score will be representative of the pain intensity [29]. The similarity of the values when excluding each item demonstrates that they have a similar tendency and importance [53]. The scale was specific for five of six items and sensitive for four. Postural changes were not as frequent compared to the other items.
The analysis of the ROC curve [54] estimated the cut-off point for analgesic intervention in sheep as in previously validated pain scales in cats [29], cattle [19] and pigs [32]. The determination of scores indicative of the need to use analgesics helps professionals in clinical decisions, confirms or not the efficacy of analgesic treatment [29], and may be used to define welfare in animals. The cut-off point was ≥ 4 and the diagnostic uncertainty zone of all evaluators ensures that sheep with a score of > 5 of a total of 12 points are really in pain, while those with a score < 4 do not have pain. The low percentage of animals within the zone of diagnostic uncertainty ensures good reliability in making decisions about the indication for rescue analgesia in animals that present pain and, therefore, should receive analgesia. Thus, the proposed scale presents excellent diagnostic accuracy. Although the definition of the score referring to the analgesic intervention point is a good tool, it is emphasised that even if the scores are < 4, in some cases additional analgesia may be necessary according to the clinical evaluation, at the discretion of the observer. The cut-off point was > 4/10 in cattle [19], ≥ 6/18 in pigs [32], and for the subscale “expression of pain” in cats it was > 2/12 [29].
Appetite was not approved for most of the validation criteria used in this study, and the reason why it was arbitrarily maintained in the scale was based on the fact that lack of appetite is widely described as a sign of pain in sheep [20,45,62], and other species [19,24,29,32] and it is the only physiological variable of USAPS, which could contribute to its biological multidimensionality. Considering that the Youden index was the same without using the appetite data, one can choose either to use or not this information according to each circumstance, without interfering in decision making concerning rescue analgesia.
Previous studies assessed pain scales in sheep submitted to laparoscopy. In one study the mean pain score was 0.3 of 9 [45] and in another study a pain scale ranging from 0 to 6 based on decreased appetite, limited mobility, and back arching, was insensitive, with 90% of animals with a “0” score and 10% with “1” [62]. A recent empirical study on pain in sheep after cardiac surgery was scored; for scores of 0-2/25 there was no intervention, 3-9/25 rescue analgesia was performed, and ≥ 10/25 multimodal analgesia was performed [77].
In line with the low percentage of animals within the diagnostic uncertainty zone, the high areas under the curve observed in this study (≥ 0.95) indicate that the scale has high discriminatory capacity [55]; it correctly classifies individuals with or without pain, results that resembled cattle [19], pigs [32] and the subscale “expression of pain” in cats [29]. The predictive criterion validity was confirmed by the finding that 88% of sheep should receive rescue analgesia after surgery (M2) based on the Youden Index. Therefore the tool would adequately foresee that sheep were experiencing pain and help decision making to provide analgesia to improve animal welfare. Although the cut-off point may be helpful, decision making about rescue analgesia should be taken based on clinical experience and context analysis, to ensure that sheep suffering from mild pain would be treated accordingly.
Limitations
The current study had some limitations. The main one is that the in-person researcher edited the short videos assessed by the blind evaluators through selecting the most frequent behaviours observed in the ethogram representative of each period of observation and condensed the videos to 3 min. Although this method has been previously used to validate pain scales in cats [29], cattle [19], pigs [32] and horses [24] it is still controversial and presents advantages and disadvantages. The advantages were that because the editor was the in-person evaluator and the main author of the study (PhD student), he was the observer most familiarised with the behaviours. This guaranteed the inclusion of relevant pain behaviours. The disadvantages were that short videos might not represent the full behaviour of that particular period and in real life some behaviours may be observed only when sheep are assessed for 20 minutes. This method provides data to assess intra and inter-observer reliability and to perform all calculations for the validation of the scales and is useful to guarantee that all relevant behaviours are included in the scale development, but does not ensure that the scale is clinically applicable in real life. Another limitation is that video analysis does not necessarily equate to in-person real-time analysis. Video observation has the disadvantage of lacking some details observed in real-time, while, as an advantage it can be reviewed. A previous study in cats used the same methodology by editing short videos for initial validation of the scale [29]. The scale demonstrated validity after clinical in-person use of the instrument. Like in cats [29] the USAPS will require in-person validation to guarantee it is a valid instrument for clinical use.
The USAPS was validated only for a specific type of soft tissue surgery (abdominal—laparoscopy) and in females. Further studies are needed to test this tool in different procedures, such as orthopaedic surgery and clinical circumstances, to ensure its versatility. To establish that the instrument is valid under field conditions, clinical validation with less experienced observers is also required. Since the majority of the studies that evaluated acute pain in sheep were in lambs, this can limit the collation of data, which means the instrument needs to be tested in lambs.
Some limitations relate specifically to the videos. Although the study was blinded, some videos may have suggested the moment they were taken: at baseline, the sheep were fasting, with no available feed, hence it was difficult for the observers to interpret if the animals did not eat due to lack of food or if they really had anorexia or if they were ruminating. Around 21% of the videos at M3 were filmed at night with artificial light, which could suggest that they corresponded to M3; variations in the circadian cycle could alter some behaviours such as activity, so the reduction in activity may not be related to pain or discomfort, but to the natural reduction in activity at night [78]; given the small difference in the size of the stalls, the density of animals varied slightly, which could influence interaction and locomotion behaviours; the dark wool of some animals may also have made it difficult to evaluate some items in the videos/photos, making the analysis less accurate, especially on the facial scale.
To improve data reliability, the authors suggest that observers attend a training period, as in laboratory animals instruction and training have improved pain recognition [79].
Conclusion
It is concluded that, after refinement of the originally proposed scale, the Unesp-Botucatu composite scale to assess acute postoperative abdominal pain in sheep (USAPS) is a valid, reliable, specific and sensitive instrument, with excellent internal consistency and discriminatory capacity. The well-defined cut-off point for rescue analgesia supports the indication and type of analgesic therapy. To assess the clinical and experimental applicability of the scale and ensure its versatility, it is recommended that it be evaluated in other surgical procedures and in lambs.
Supporting information
Data Availability
All relevant data are within the manuscript and its Supporting Information files.
Funding Statement
SPLL - Financial support from the São Paulo Research Foundation – FAPESP (Process 2010/08967-0 and 2017/12815-0). http://www.fapesp.br/en/. NEOFS - Grant from Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brazil (CAPES). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Lizarraga I, Chambers JP. Use of analgesic drugs for pain management in sheep. N Z Vet J. 2012;60: 87–94. 10.1080/00480169.2011.642772 [DOI] [PubMed] [Google Scholar]
- 2.Lorena SERS, Luna SPL, Lascelles BDX, Corrente JE. Attitude of Brazilian veterinarians in the recognition and treatment of pain in horses and cattle. Vet Anaesth Analg. 2013;40: 410–418. 10.1111/vaa.12025 [DOI] [PubMed] [Google Scholar]
- 3.Huxley JN, Whay HR. Current attitudes of cattle practitioners to pain and the use of analgesics in cattle. Vet Rec. 2006;159: 662–668. 10.1136/vr.159.20.662 [DOI] [PubMed] [Google Scholar]
- 4.Hewson CJ, Dohoo IR, Lemke KA, Barkema HW. Canadian veterinarians’ use of analgesics in cattle, pigs, and horses in 2004 and 2005. Can Vet J. 2007;48: 155–164. 10.4141/cjas68-021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Futro A, Masłowska K, Dwyer CM. Ewes direct most maternal attention towards lambs that show the greatest pain-related behavioural responses. PLoS One. 2015;10: 1–15. 10.1371/journal.pone.0134024 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.West D, Bruere N, Ridler A. The sheep: health disease and production. 4th ed. New Zealand: Massey University Press; 2018. [Google Scholar]
- 7.Dolan S, Kelly JG, Monteiro AM, Nolan AM. Up-regulation of metabotropic glutamate receptor subtypes 3 and 5 in spinal cord in a clinical model of persistent inflammation and hyperalgesia. Pain. 2003;106: 501–512. 10.1016/j.pain.2003.09.017 [DOI] [PubMed] [Google Scholar]
- 8.Taylor K, Rego L. EU statistics on animal experiments for 2014. Altern to Anim Exp. 2016;33 10.14573/altex.1609291 [DOI] [PubMed] [Google Scholar]
- 9.Gigliuto C, De Gregori M, Malafoglia V, Raffaeli W, Compagnone C, Visai L, et al. Pain assessment in animal models: do we need further studies? J Pain Res. 2014;7: 227–236. 10.2147/JPR.S59161 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Dolan S, Gunn MD, Crossan C, Nolan AM. Activation of metabotropic glutamate receptor 7 in spinal cord inhibits pain and hyperalgesia in a novel formalin model in sheep. Behav Pharmacol. 2011;22: 582–588. 10.1097/FBP.0b013e3283478802 [DOI] [PubMed] [Google Scholar]
- 11.Wilkes D, Li G, Angeles CF, Patterson JT, Huang LYM. A large animal neuropathic pain model in sheep: A strategy for improving the predictability of preclinical models for therapeutic development. J Pain Res. 2012;5: 415–424. 10.2147/JPR.S34977 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Stubsjøen SM, Bohlin J, Skjerve E, Valle PS, Zanella AJ. Applying fractal analysis to heart rate time series of sheep experiencing pain. Physiol Behav. 2010;101: 74–80. 10.1016/j.physbeh.2010.04.018 [DOI] [PubMed] [Google Scholar]
- 13.Ong RM, Morris JP, O’Dwyer JK, Barnett JL, Hemsworth PH, Clarke IJ. Behavioural and EEG changes in sheep in response to painful acute electrical stimuli. Aust Vet J. 1997;75: 189–193. 10.1111/j.1751-0813.1997.tb10064.x [DOI] [PubMed] [Google Scholar]
- 14.Mather LE, Cousins MJ, Huang YF, Pryor ME, Barratt SM. Lack of secondary hyperalgesia and central sensitisation in an acute sheep model. Reg Anesth Pain Med. 2000;25: 174–180. 10.1053/rapm.2000.0250174 [DOI] [PubMed] [Google Scholar]
- 15.McLennan KM, Skillings EA, Rebelo CJB, Corke MJ, Pires Moreira MA, Morton AJ, et al. Technical note: Validation of an automatic recording system to assess behavioural activity level in sheep (Ovis aries). Small Rumin Res. 2015;127: 92–96. 10.1016/j.smallrumres.2015.04.002 [DOI] [Google Scholar]
- 16.Stubsjøen SM, Bohlin J, Dahl E, Knappe-Poindecker M, Fjeldaas T, Lepschy M, et al. Assessment of chronic stress in sheep (part I): The use of cortisol and cortisone in hair as non-invasive biological markers. Small Rumin Res. 2015;132: 25–31. 10.1016/j.smallrumres.2015.09.015 [DOI] [Google Scholar]
- 17.Stubsjøen SM, Knappe-Poindecker M, Langbein J, Fjeldaas T, Bohlin J. Assessment of chronic stress in sheep (part II): Exploring heart rate variability as a non-invasive measure to evaluate cardiac regulation. Small Rumin Res. 2015;133: 30–35. 10.1016/j.smallrumres.2015.10.026 [DOI] [Google Scholar]
- 18.Jongman EC, Morris JP, Barnett JL, Hemsworth PH. EEG changes in 4-week-old lambs in response to castration, tail docking and mulesing. Aust Vet J. 2000;78: 339–343. 10.1111/j.1751-0813.2000.tb11789.x [DOI] [PubMed] [Google Scholar]
- 19.de Oliveira FA, Luna SPL, do Amaral JB, Rodrigues KA, Sant’Anna AC, Daolio M, et al. Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle. BMC Vet Res. 2014;10: 1–14. 10.1186/1746-6148-10-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Molony V, Kent JE, McKendrick IJ. Validation of a method for assessment of an acute pain in lambs. Appl Anim Behav Sci. 2002;76: 215–238. 10.1016/S0168-1591(02)00014-X [DOI] [Google Scholar]
- 21.Molony V, Kent JE. Assessment of acute pain in farm animals using behavioral and physiological measurements. J Anim Sci. 1997;75: 266–272. 10.2527/1997.751266x [DOI] [PubMed] [Google Scholar]
- 22.Grant C. Behavioural responses of lambs to common painful husbandry procedures. Appl Anim Behav Sci. 2004;87: 255–273. 10.1016/j.applanim.2004.01.011 [DOI] [Google Scholar]
- 23.Morton CM, Reid J, Scott EM, Holton LL, Nolan AM. Application of a scaling model to establish and validate an interval level pain scale for assessment of acute pain in dogs. Am J Vet Res. 2005;66: 2154–2166. 10.2460/ajvr.2005.66.2154 [DOI] [PubMed] [Google Scholar]
- 24.Taffarel MO, Luna SPL, de Oliveira FA, Cardoso GS, Alonso JM, Pantoja JC, et al. Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses. BMC Vet Res. 2015;11 10.1186/s12917-015-0322-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Brondani JT, Luna SPL, Padovani CR. Refinement and initial validation of a multidimensional composite scale for use in assessing acute postoperative pain in cats. Am J Vet Res. 2011;72: 174–183. 10.2460/ajvr.72.2.174 [DOI] [PubMed] [Google Scholar]
- 26.Firth AM, Haldane SL. Development of a scale to evaluate postoperative pain in dogs. J Am Vet Med Assoc. 1999;214: 651–659. [PubMed] [Google Scholar]
- 27.Holton L, Reid J, Scott EM, Pawson P, Nolan A. Development of a behaviour-based scale to measure acute pain in dogs. Vet Rec. 2001;148: 525–531. 10.1136/vr.148.17.525 [DOI] [PubMed] [Google Scholar]
- 28.Reid J, Nolan AM, Hughes JML, Lascelles D, Pawson P, Scott EM. Development of the short-form Glasgow composite measure pain scale (CMPS-SF) and derivation of an analgesic intervention score. Anim Welf. 2007;16: 97–104. [Google Scholar]
- 29.Brondani JT, Mama KR, Luna SPL, Wright BD, Niyom S, Ambrosio J, et al. Validation of the English version of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in cats. BMC Vet Res. 2013;9: 1 10.1186/1746-6148-9-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Bussieres G, Jacques C, Lainay O, Beauchamp G, Leblond A, Cadore J-L, et al. Development of a composite orthopaedic pain scale in horses. Res Vet Sci. 2008;85: 294–306. 10.1016/j.rvsc.2007.10.011 [DOI] [PubMed] [Google Scholar]
- 31.Sutton GA, Paltiel O, Soffer M, Turner D. Validation of two behaviour-based pain scales for horses with acute colic. Vet J. 2013;197: 646–650. 10.1016/j.tvjl.2013.04.007 [DOI] [PubMed] [Google Scholar]
- 32.Luna SPL, de Araújo AL, da Nóbrega Neto PI, Brondani JT, de Oliveira FA, Azerêdo LMdS, et al. Validation of the UNESP-Botucatu pig composite acute pain scale (UPAPS). PLoS ONE. 2020; 15(6): e0233552 10.1371/journal.pone.0233552 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Netemeyer R, Bearden W, Sharma S. Scaling procedures: issues and applications. London: Sage Publications; 2003. 10.4135/9781412985772 [DOI] [Google Scholar]
- 34.Thornton PD, Waterman-Pearson AE. Behavioural responses to castration in lambs. Anim Welf. 2002;11: 203–212. [Google Scholar]
- 35.Melches S, Mellema SC, Doherr MG, Wechsler B, Steiner A. Castration of lambs: a welfare comparison of different castration techniques in lambs over 10 weeks of age. Vet J. 2007;173: 554–563. 10.1016/j.tvjl.2006.01.006 [DOI] [PubMed] [Google Scholar]
- 36.Molony V, Kent JE, Viñuela-Fernández I, Anderson C, Dwyer CM. Pain in lambs castrated at 2days using novel smaller and tighter rubber rings without and with local anaesthetic. Vet J. 2012;193: 81–86. 10.1016/j.tvjl.2011.09.030 [DOI] [PubMed] [Google Scholar]
- 37.Guesgen MJ, Beausoleil NJ, Minot EO, Stewart M, Stafford KJ, Morel PCH. Lambs show changes in ear posture when experiencing pain. Anim Welf. 2016;25: 171–177. 10.7120/09627286.25.2.171 [DOI] [Google Scholar]
- 38.Kent JE, Molony V, Graham MJ. Comparison of methods for the reduction of acute pain produced by rubber ring castration or tail docking of 3-week-old lambs. Vet J. 1998;155: 39–51. 10.1016/S1090-0233(98)80033-6 [DOI] [PubMed] [Google Scholar]
- 39.Taylor Small AH, Belson S, Holm M, Colditz IG. Efficacy of a buccal meloxicam formulation for pain relief in Merino lambs undergoing knife castration and tail docking in a randomised field trial. Aust Vet J. 2014;92: 381–388. 10.1111/avj.12241 [DOI] [PubMed] [Google Scholar]
- 40.McGlone JJ, Stobart RH. A quantitative ethogram of behavior of yearling ewes during two hours post-parturition. Appl Anim Behav Sci. 1986;16: 157–164. 10.1016/0168-1591(86)90108-5 [DOI] [Google Scholar]
- 41.McLennan KM, Rebelo CJB, Corke MJ, Holmes MA, Leach MC, Constantino-Casas F. Development of a facial expression scale using footrot and mastitis as models of pain in sheep. Appl Anim Behav Sci. 2016;176: 19–26. 10.1016/j.applanim.2016.01.007 [DOI] [Google Scholar]
- 42.Häger C, Biernot S, Buettner M, Glage S, Keubler LM, Held N, et al. The Sheep Grimace Scale as an indicator of postoperative distress and pain in laboratory sheep. PLoS One. 2017;12: e0175839 10.1371/journal.pone.0175839 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Merola I, Mills DS. Systematic review of the behavioural assessment of pain in cats. J Feline Med Surg. 2016;18: 60–76. 10.1177/1098612X15578725 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Kilkenny C, Browne W, Cuthill IC, Emerson M, Altman DG. Animal research: reporting in vivo experiments: the ARRIVE guidelines. Br J Pharmacol. 2010;160: 1577–1579. 10.1111/j.1476-5381.2010.00872.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Teixeira PPM, Padilha LC, Motheo TF, Silva MAMM, Oliveira MEFF, da Silva ASLL, et al. Ovariectomy by laparotomy, a video-assisted approach or a complete laparoscopic technique in Santa Ines sheep. Small Rumin Res. 2011;99: 199–202. 10.1016/j.smallrumres.2011.04.008 [DOI] [Google Scholar]
- 46.Suraseranivongse S, Santawat U, Kraiprasit K, Petcharatana S, Prakkamodom S, Muntraporn N. Cross‐validation of a composite pain scale for preschool children within 24 hours of surgery. BJA Br J Anaesth. 2001;87: 400–405. 10.1093/bja/87.3.400 [DOI] [PubMed] [Google Scholar]
- 47.Kaiser HF. The varimax criterion for analytic rotation in factor analysis. Psychometrika. 1958; 23: 187–200. 10.1007/BF02289233 [DOI] [Google Scholar]
- 48.Schuster C. A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales. Educ Psychol Meas. 2004;64: 243–253. 10.1177/0013164403260197 [DOI] [Google Scholar]
- 49.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33: 159–174. 10.2307/2529310 [DOI] [PubMed] [Google Scholar]
- 50.Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70: 213–220. 10.1037/h0026256 [DOI] [PubMed] [Google Scholar]
- 51.Altman DG. Practical statistics for medical research. 1st ed. London: Chapman and Hall; 1991. 10.1002/sim.4780101015 [DOI] [Google Scholar]
- 52.Streiner D, Norman G, Cairney J. Health measurement scales: A practical guide to their development and use. 5th ed. New York: Oxford University Press Inc; 2015. 10.1093/acprof:oso/9780199231881.003.0006 [DOI] [Google Scholar]
- 53.Streiner DL. Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80: 99–103. 10.1207/S15327752JPA8001_18 [DOI] [PubMed] [Google Scholar]
- 54.Streiner DL, Cairney J. What’s under the ROC? An introduction to receiver operating characteristics curves. Can J Psychiatry. 2007;52: 121–128. 10.1177/070674370705200210 [DOI] [PubMed] [Google Scholar]
- 55.Cannesson M, Le Manach Y, Hofer CK, Goarin JP, Lehot J-J, Vallet B, et al. Assessing the diagnostic accuracy of pulse pressure variations for the prediction of fluid responsiveness: a “gray zone” approach. Anesthesiology. 2011;115: 231–241. 10.1097/ALN.0b013e318225b80a [DOI] [PubMed] [Google Scholar]
- 56.Celeita-Rodríguez N, Teixeira-Neto FJ, Garofalo NA, Dalmagro TL, Girotto CH, Oliveira GCV, et al. Comparison of the diagnostic accuracy of dynamic and static preload indexes to predict fluid responsiveness in mechanically ventilated, isoflurane anesthetised dogs. Vet Anaesth Analg. 2019;46: 276–288. 10.1016/j.vaa.2018.12.004 [DOI] [PubMed] [Google Scholar]
- 57.RstudioTeam. RStudio Team. 2016. Available: http://www.rstudio.com/
- 58.Martin P, Bateson PPG. Measuring behaviour: An introductory guide, 2nd ed. New York, NY, US: Cambridge University Press; 1993. 10.1017/CBO9781139168342 [DOI] [Google Scholar]
- 59.Pinho RH, Leach MC, Rocha FDL, Armani DJC, Ferreira-Souza G, Dissenha A, et al. Influence of the presence or absence of an observer on pain assessment in rabbits submitted to orthopaedic surgery. AVA autumn meeting. Ghent; 2019. p. 120. [Google Scholar]
- 60.Sorge RE, Martin LJ, Isbester KA, Sotocinal SG, Rosen S, Tuttle AH, et al. Olfactory exposure to males, including men, causes stress and related analgesia in rodents. Nat Methods. 2014;11: 629–32. 10.1038/nmeth.2935 [DOI] [PubMed] [Google Scholar]
- 61.Assessment Adams J. and management of pain in small ruminants. Livestock. 2017; 22: 324–328. 10.12968/live.2017.22.6.324 [DOI] [Google Scholar]
- 62.Teixeira PPM, Padilha LC, Oliveira MEF, Motheo TF, da Silva ASL, Barros FFPC, et al. Laparoscopic ovum collection in sheep: gross and microscopic evaluation of the ovary and influence on ooctye production. Anim Reprod Sci. 2011;127: 169–175. 10.1016/j.anireprosci.2011.08.001 [DOI] [PubMed] [Google Scholar]
- 63.Paull DR, Lee C, Atkinson SJ, Fisher AD. Effects of meloxicam or tolfenamic acid administration on the pain and stress responses of Merino lambs to mulesing. Aust Vet J. 2008;86: 303–311. 10.1111/j.1751-0813.2008.00325.x [DOI] [PubMed] [Google Scholar]
- 64.Mellor DJ, Stafford KJ, Todd SE, Lowe TE, Gregory NG, Bruce RA, et al. A comparison of catecholamine and cortisol responses of young lambs and calves to painful husbandry procedures. Aust Vet J. 2002;80: 228–233. 10.1111/j.1751-0813.2002.tb10820.x [DOI] [PubMed] [Google Scholar]
- 65.Dinniss AS, Stafford KJ, Mellor DJ, Bruce RA, Ward RN. The behaviour pattern of lambs after castration using a rubber ring and/or castrating clamp with or without local anaesthetic. N Z Vet J. 1999;47: 198–203. 10.1080/00480169.1999.36143 [DOI] [PubMed] [Google Scholar]
- 66.Currah JM, Hendrick SH, Stookey JM. The behavioral assessment and alleviation of pain associated with castration in beef calves treated with flunixin meglumine and caudal lidocaine epidural anaesthesia with epinephrine. Can Vet J 2009;50: 375–382. [PMC free article] [PubMed] [Google Scholar]
- 67.Millman ST. Behavioral responses of cattle to pain and implications for diagnosis, management, and animal welfare. Vet Clin North Am Food Anim Pract. 2013;29: 47–58. 10.1016/j.cvfa.2012.11.007 [DOI] [PubMed] [Google Scholar]
- 68.Watts Stookey. Vocal behaviour in cattle: the animal’s commentary on its biological processes and welfare. Appl Anim Behav Sci. 2000;67: 15–33. 10.1016/s0168-1591(99)00108-2 [DOI] [PubMed] [Google Scholar]
- 69.Ferguson DM, Lee C, Fisher A. Advances in sheep welfare. 1st ed. Melbourne: Woodhead publishing; 2017. 10.1016/C2015-0-00983-2 [DOI] [Google Scholar]
- 70.DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39: 155–164. 10.1111/j.1547-5069.2007.00161.x [DOI] [PubMed] [Google Scholar]
- 71.Boateng GO, Neilands TB, Frongillo EA. Best practices for developing and validating scales for health, social, and behavioral research: a primer. Frontiers 2018;6: 1–18. 10.3389/fpubh.2018.00149 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Gracely RH. Evaluation of multi-dimensional pain scales. Pain. 1992; 48: 297–300. 10.1016/0304-3959(92)90076-n [DOI] [PubMed] [Google Scholar]
- 73.Kaler J, Wassink GJ, Green LE. The inter- and intra-observer reliability of a locomotion scoring scale for sheep. Vet J. 2009;180(2):189–94. 10.1016/j.tvjl.2007.12.028 [DOI] [PubMed] [Google Scholar]
- 74.Angell JW, Cripps PJ, Grove-White DH, Duncan JS. A practical tool for locomotion scoring in sheep: reliability when used by veterinary surgeons and sheep farmers. Vet Rec. 2015;176: 521 10.1136/vr.102882 [DOI] [PubMed] [Google Scholar]
- 75.Pasquali L. Psychometrics. Rev. esc. enferm. USP. 2009;43: 992–999. 10.1590/S0080-62342009000500002 [DOI]
- 76.Welsh EM, Gettinby G, Nolan AM. Comparison of a visual analogue scale and a numerical rating scale for assessment of lameness, using sheep as a model. Am J Vet Res. 1993;54: 976–983. [PubMed] [Google Scholar]
- 77.Izer JM, LaFleur RA, Weiss WJ, Wilson RP. Development of a pain scoring system for use in sheep surgically implanted with ventricular assist devices. J Investig Surg. 2018;1939: 1–10. 10.1080/08941939.2018.1457191 [DOI] [PubMed] [Google Scholar]
- 78.Wyse CA, Zhang X, McLaughlin M, Biello SM, Hough D, Bellingham M, et al. Circadian rhythms of melatonin and behaviour in juvenile sheep in field conditions: Effects of photoperiod, environment and weaning. Physiol Behav. 2018;194: 362–370. 10.1016/j.physbeh.2018.06.001 [DOI] [PubMed] [Google Scholar]
- 79.Roughan JV, Flecknell PA. Evaluation of a short duration behaviour-based postoperative pain scoring system in rats. Eur J Pain. 2003;7: 397–406. 10.1016/S1090-3801(02)00140-4 [DOI] [PubMed] [Google Scholar]