Skip to main content
PLOS One logoLink to PLOS One
. 2020 Jun 1;15(6):e0233552. doi: 10.1371/journal.pone.0233552

Validation of the UNESP-Botucatu pig composite acute pain scale (UPAPS)

Stelio Pacca Loureiro Luna 1,*,#, Ana Lucélia de Araújo 2,¤a,#, Pedro Isidro da Nóbrega Neto 3,, Juliana Tabarelli Brondani 1,¤b,, Flávia Augusta de Oliveira 2,¤c,, Liliane Marinho dos Santos Azerêdo 3,, Felipe Garcia Telles 1,, Pedro Henrique Esteves Trindade 1,
Editor: Francesco Staffieri4
PMCID: PMC7263847  PMID: 32480399

Abstract

The creation of species-specific valid tools for pain assessment is essential to recognize pain and determine the requirement and efficacy of analgesic treatments. This study aimed to assess behaviour and investigate the validity and reliability of an acute pain scale in pigs undergoing orchiectomy. Forty-five pigs aged 38±3 days were castrated under local anaesthesia. Behaviour was video-recorded 30 minutes before and intermittently up to 24 hours after castration. Edited footage (before surgery, after surgery before and after rescue analgesia, and 24 hours postoperatively) was analysed twice (one month apart) by one observer who was present during video-recording (in-person researcher) and three blinded observers. Statistical analysis was performed using R software and differences were considered significant when p<0.05. Intra and inter-observer agreement, based on intra-class correlation coefficient, was good or very good between most observers (>0.60), except between observers 1 and 3 (moderate agreement 0.57). The scale was unidimensional according to principal component analysis. The scale showed acceptable item-total Spearman correlation, excellent predictive and concurrent criterion validity (Spearman correlation ≥ 0.85 between the proposed scale versus visual analogue, numerical rating, and simple descriptive scales), internal consistency (Cronbach’s α coefficient >0.80 for all items), responsiveness (the pain scores of all items of the scale increased after castration and decreased after intervention analgesia according to Friedman test), and specificity (> 95%). Sensitivity was good or excellent for most of the items. The optimal cut-off point for rescue analgesia was ≥ 6 of 18. Discriminatory ability was excellent for all observers according to the area under the curve (>0.95). The proposed scale is a reliable and valid instrument and may be used clinically and experimentally to assess postoperative acute pain in pigs. The well-defined cut-off point supports the evaluator´s decision to provide or not analgesia.

Introduction

Pigs have two main utility purposes for humankind: meat source and translational medicine. With regard to livestock, pork is by far the most consumed meat globally, 25% and 100% above chicken and beef respectively [1]. However, among production animals, pigs are the most neglected with regard to pain assessment and treatment. While approximately 80% of Canadian veterinarians considered their knowledge sufficient to assess pain in large animals [2], only 32% of pig veterinarians considered their knowledge adequate in this area [2]. Approximately 40% of UK veterinarians working with swine consider that “it is difficult to recognise pain in pigs” [3]. This probably justifies the fact that among large animals, the swine species receive considerably less analgesics than bovine and equine species [2]. For example, in Canada, after orchiectomy less than 0.001% of piglets receive analgesia, compared with 7% of beef and 19% of dairy calves younger than 6 months of age [2].

Orchiectomy is one of the most frequent surgical procedures in pigs, however the majority of piglets are castrated without anaesthesia [4,5]. Although this practice promotes physiological and behavioural changes strongly suggestive of acute pain [68], the main argument to sustain this animal-welfare compromising practice is the small profit margin of the industry [2,3]. This paradigm has been challenged by the fact that pigs treated with anaesthesia and analgesia showed increased short [9] and long-term weight gain [10], when compared to pigs castrated without anaesthesia, thus, providing an economic benefit to producers [10].

Translational medicine is the other side of the coin for using pigs. Swine have progressively replaced the use of dogs and non-human primates as non-rodent models for research and teaching, due to several limitations related to using other species, including ethical issues [11,12]. The number of pigs used for research in Canada in 2018 was 32,231, against 14,283 dogs and 8,522 non-human primates [13]. These numbers were 6,569 in USA in 2017 [14], and 72,749 in Europe in 2014 [15]. The similar anatomophysiological characteristics of swine compared to man, make them promising animal models for several purposes [11,12,16], including xenotransplantation [11,12], and accurate models for pain studies [17], including neuropathic pain [18].

The scenario of the use of analgesics in pigs used for research is not that different from that used in livestock. As animal models for humans, pigs experience a similar degree of pain under experimental painful conditions; therefore pain should be mitigated based on ethical grounds. A recent review about the use of analgesia in pigs submitted to experimental surgery showed that from 233 studies that met the inclusion criteria, information on postoperative analgesia and pain assessment was reported in only 37% and 10% of them respectively [19], showing that pain measurement and treatment were either neglected or not reported. This finding suggests the great necessity for the development of pain assessment tools to fill this gap and guarantee the welfare of pigs undergoing research. Recognition and assessment of pain, followed by analgesic treatment, guarantees one of the three “Rs”, i.e., refinement, in pigs submitted to painful procedures [19].

The lack of a validated instrument to assess pain in pigs may account for the restricted use of analgesics in these species in both production and research. The development of species-specific validated pain assessment instruments is essential to recognize and quantify pain and to determine the requirement and efficacy of analgesic treatment in animals [17].

Pain or nociception may be assessed through objective or subjective methods [20]. The advantages of subjective methods based on pain-related behaviour analysis are that it is not invasive, does not require equipment or restraint, and may be assessed by remote observation. These features suggest that pain-related behaviour is the principal and easiest tool to evaluate pain in animals.

The validation process should encompass the investigation of species-specific behaviour [2021,22] followed by assessment of intra and inter-rater reliability, content validity, which assesses if each item is representative, responsiveness or construct validity, internal consistency, item-total correlation, criterion validity, specificity, sensitivity, and definition of a cut-off point for analgesic intervention [2023].

Although the authors recognize the great effort paid in assessing and describing pain-related behaviours in pigs, to our knowledge, to date, there is no validated behavioural instrument developed to assess pain in these species, like those validated in the most common domestic species, such as dogs [24,25], cats [21,26], cattle [22], and horses [2729]. Recent studies have assessed facial expression to develop a Grimace scale for pigs [30,31], however to our knowledge neither a facial or behavioural pain scale have yet been fully validated. Therefore, this study aimed to develop and validate a scale to assess postoperative acute pain in pigs undergoing castration based on behavioural analysis.

Methods

The study was approved by the Ethical Committee for the Use of Animals in Research of the School of Veterinary Medicine and Animal Science, Unesp, Botucatu, Brazil, under protocol number 102/2014 and follows the Brazilian Federal legislation of CONCEA (National Council for the Control of Animal Experimentation). This is a prospective, randomized, and blind study conducted at the University farms of the authors´ institutions.

Inclusion criteria were based on clinical examination and laboratorial assessment (haemogram and serum biochemistry—plasma urea, creatinine, alkaline phosphatase, and glutamic pyruvic transaminase) to guarantee they were healthy. Pigs that were not clinically healthy or did not present normal laboratorial data were excluded. Pigs that presented any postoperative complications, clinical problems, such as diarrhoea, or were bruised due to fights during the 24 hours of assessment were excluded.

Pigs were selected from the University commercial production. A pilot study was carried out with 12 piglets aged 35 days, submitted to castration only to define the experimental protocol and to recognize pain-related behaviours. For the main study, 45 Landrace, Large White, Duroc, and Hampshire male pigs were randomly selected. The pigs were aged 38±3 days (range 35–41 days) and weighed 11.06 ± 2.28 kg. Groups of five pigs were allocated in suspended collective iron pens 15 days prior to the surgical procedure for adaptation to the personnel and environment. The pens measured 2.40 x 1.50 x 1.50 meters (length x width x height), and were located side by side, separated by bars. The piglets received commercial feed three times a day and water was available ad libitum in nipple drinkers.

Familiarity with the in-person researcher started during the maternity period when piglets were 14 days old. After a week of contact with the piglets, by cleaning the pen and providing food, the in-person researcher initiated direct friendly contact inside the stall, for 15 minutes three times a day, without making any sudden movement, or using vocal communication, so that the piglets could spontaneously approach.

After the adaptation period, procedures were performed between 8 and 10 AM. The pigs were physically restrained and after local antisepsis, they were submitted to bilateral local anaesthesia with 0.5 mL of 1% lidocaine without vasoconstrictor (Xylestesin®, Cristália, Itapira, São Paulo, Brazil) injected subcutaneously at each incision line, parallel to the scrotum shaft, followed by 1 mL injected intratesticularly at each testicle. After five minutes, orchiectomy was performed by the same surgeon. Four hours after the surgical procedure, the in-person researcher injected analgesic rescue with 2 mg/kg of flunixin meglumine (Flunixin®, Chemitec, São Paulo, Brazil) and 0.5 mg/kg of morphine (Dimorf®, Cristália, Itapira, São Paulo, Brazil) intramuscularly (IM) in the cervical region. At the end of the observation period of 24 hours, the animals received 2 mg/kg of flunixin meglumine IM, once a day for two consecutive days. The in-person researcher treated the surgical wounds topically with silver sulfadiazine (Bactrovet®, König, São Paulo, São Paulo, Brazil), once a day for five days and assessed the surgical wound every 48 hours thereafter, for 10 days.

The pigs were evaluated from 24 hours to 16 hours before surgery and at 2, 4, 6, 8, and 24 hours after castration. Cameras were positioned on the ceiling of the pens to record 30-minute recordings at each of these moments, for a total of 135 hours. The pigs had no visual contact with the in-person researcher. After video recording, if the food was not available at the feeder, the researcher provided a small amount of food, and a short period of video was recorded to evaluate appetite. After the end of the field study pigs were kept until 145 days of age when they were submitted to humane slaughter accomplished by electrical stunning, followed by exsanguination, according to the Brazilian Federal legislation (Ministry of Agriculture).

The videos from the main study were observed for the first time for recognition of different behaviours and elaboration of an ethogram, based on previous studies [6,8,3234]. After this first analysis, four moments were selected as the most representative as described in Fig 1. The footage corresponding to each of these moments was observed again to measure the duration and frequency of each pain-related behaviour.

Fig 1. Timeline of interventions, drugs and pain assessments performed for validation of the Unesp-Botucatu pig composite acute pain scale (UPAPS).

Fig 1

The scale was developed according to the analysis of the relevance of pain-related behaviours previously described in the literature [6,8,3235] and behaviours observed both in the pilot study and during video edition by the in-person researcher.

Once the initial proposed scale had been defined, content validity was assessed by three evaluators experienced in assessing pain in other domestic species, who scored each behaviour according to the degree of importance related to pain (-1 = irrelevant item; 0 = do not know; 1 = relevant item). Items which reached an average score ≥ 0.5 were included in the scale [21,22,36] From this point the scale was considered ready for video analysis. The proposed scale was composed of six behavioural items. Each item presented four descriptive levels. A numerical score was attributed from 0 to 3, where “0” reflected normal animal state (free of pain) and “3”, the maximum value, corresponded to accentuated behavioural alteration. The maximum score of the entire scale was 18 points.

The in-person researcher edited each of the four 30-minute videos into 4-minute videos representing the 4 moments previously described (Fig 1). The 180 edited videos were analysed by four observers, two men (SPLL and PINN) and two women (FAO and ALA). The first two are the senior authors, with above 20-year experience in anaesthesia and pain assessment in farm animals. FAO developed the cattle postoperative pain scale [22] and ALA was considered the “gold-standard” as she was the in-person researcher responsible for video recording and editing as well as creation of the ethogram. All observers watched the videos in a random order, without knowledge about the moment they were observing (blind analysis).

After watching each video, the observers, based on their clinical experience, initially stated if they would provide rescue analgesia at that moment or not. Subsequently, they were required to ascribe a score for the visual analogue scale (VAS), numerical rating scale (NRS; 0 “no pain” to 10 “worst possible pain”), the simple descriptive scale (SDS; 0—no pain to 3—intense pain) and UPAPS. After one month, each observer blindly analysed the footage again with a new order of moments and pigs, to establish the intra-observer reliability.

Statistical analysis

For the ethogram analysis the time spent in minutes and the percentage of each behaviour before and after surgery were compared by the Friedman test. Differences were considered significant when p < 0.05.

Validation of the pain scale was processed as described before [21,37]. The intra- and inter-observer reliability were assessed by comparing the data between the first and second analysis for each observer and by comparing the degree of agreement among different observers respectively. To define, for the sum of the scores, the inter-and intra-observer reliability, the intra-class correlation coefficient (ICC) was used. ICC = 1 indicates high reliability (no error), whereas ICC = 0 indicates no reliability. The 95% confidence interval (CI) was calculated for each ICC value with 95% CI [22] at all moments assembled. The weighted kappa coefficient was used to calculate the correlation of each item of the scale among the observers, encompassing all moments of assessment. The values obtained were interpreted by Altman’s classification as: 0.81–1.0 very good; 0.61–0.8 good; 0.41–0.6 moderate; 0.21–0.4 reasonable; and <0.2 poor [38].

The criterion validity was analysed by concurrent and predictive validity. Concurrent validity was investigated by comparing the scores obtained by the proposed scale against those determined by VAS, NRS, and SDS [21,22,39]. The interpretation of the Spearman’s correlation coefficient was defined by the calculation of the results of each observer, as well as for all observers together. A second method to measure concurrent criterion validity was by assessing the agreement between the gold-standard assessor and the other observers. The weighted kappa coefficient was calculated with a CI of 95% [40] for each item of the scale, encompassing all assessment moments. For the total score of UPAPS, the intraclass correlation coefficient (ICC) type "consistency" was used, and its 95% CI. The results of the kappa coefficient and ICC were interpreted [37] according to Altman’s classification [38].

Predictive criterion validity was evaluated by the number of pigs that should receive rescue analgesia consistent with the Youden Index (described below) at first moment after surgery when pigs should express the most intense pain (M2). Fisher´s exact test was used to compare the indications of rescue analgesia based on the Youden index vs clinical experience.

Principal component analysis defined the number of factors (dimensions or domains) determined by different variables and establish the extension of the scale [37,41,42]. The appreciation of the main components subsidized the execution of the principal component analysis and the factors were based on Kaiser’s criterion, which indicates maintenance of all components with eigenvalues > 1 [43]. The factorial structure was confirmed when items showed a factor load ≥ 0.50 or ≤ -0.50.

Item-total correlation based on the Spearman coefficient was performed to assess homogeneity and relevance of each item of the scale. Each item was correlated with the sum of all scale items, excluding that item, to avoid inflating the results. Values between 0.3 and 0.7 were accepted [23].

The internal consistency of the scale, to determine the interrelation among the items in the instrument, was assessed by calculation of Cronbach’s alpha coefficient [44]. Values were considered as follows: 0.60–0.64, minimally acceptable; 0.65–0.69, acceptable; 0.70–0.74, good; 0.75–0.80, very good; and > 0.80, excellent [45].

Construct validity was determined by the hypothesis test methodology. The first hypothesis is that if the scale truly measures pain, the scoring after surgery should be higher than the preoperative score (M1 versus M2). The second and third hypotheses are that the score should decrease after analgesia and over time (M2 versus M3 and M2 versus M4, respectively). The values were expressed in medians and significance was analysed by the Friedman’s test [21,22]. According to this analysis, it was possible to assess the response capacity (responsiveness) of the scale.

Specificity was assessed at M1, considering that the piglets were free of pain and reflected the true negative results. The scores at M1 were transformed into dichotomous items and entered into the equation: Specificity = TN/TN+FP, where TN = number of true negatives (score 0, indicating that piglets were not expressing pain); FP = false positives (scores 1, 2, or 3, indicating that piglets were expressing pain before surgery, when they should be supposedly pain-free). Sensitivity was calculated at M2, considering that this was the time pain would be the greatest and reflect the true positive results. Likewise for specificity, scores at M2 were transformed into dichotomous variables and the following equation applied: Sensitivity = TP/TP+FN, where TP = true positives (scores 1, 2, or 3, indicating that piglets were expressing pain after surgery, as expected), FN = false negatives (score 0, indicating that piglets were not expressing pain, when they should be expressing pain after surgery). Specificity and sensitivity were considered excellent when 95–100%; good when 85–94.9%; moderate when 70–84.9%; and not-specific or not-sensitive when <70% [29].

The frequency distribution of the presence of scores 0, 1, 2, and 3 of each item at each moment was assessed by descriptive statistical analysis according to the 2nd phase of the gold standard video analysis.

The data relative to the indication of rescue analgesia were used to determine the optimal cut-off point, that is, the minimum score suggestive of the need for analgesic rescue or intervention. This determination was based on the Youden index, which determines the highest sensitivity and specificity value concurrently from the Receiver Operating Characteristic (ROC) curve [21,22], providing a graphic image of the relation between the “true positives” (sensitivity) and the “false positives” (specificity). The discriminatory capacity of the test was determined by the area under the curve (AUC) [46,47]. AUC values above 0.9 represent high precision. In addition, the diagnostic uncertainty zone was determined by two methods [48,49]: 1) calculating the 95% confidence interval (CI) by replicating the original ROC curve 1000 times according to the bootstrap method and 2) calculating the sensitivity and specificity value > 0 90. The lowest and highest values of these two methods among all evaluators was assumed to be the diagnostic uncertainty zone [50].

For determination of pain, intensity scores of the 2nd phase from all observers were classified as no pain, mild, moderate or intense pain, at the time of most intense pain (M2). Non-hierarchical cluster analysis was performed, applying the “maximum” distance and the “Ward.D2“ method using the total score of UPAPS and NS [51], followed by the Kruskal-Wallis test to assess the difference between the groups.

Statistical analysis was performed using R software in the Rstudio integrated development environment (Version 1.0.143—©2009–2016, Rstudio, Inc.). Differences were considered significant when p <0.05.

Results

Seventy-eight pigs were castrated, but only data from 45 pigs were processed. Six pigs were excluded due to problems in capturing the footage images and the others due to the previously mentioned exclusion criteria. The surgeries and 135 hours of video recordings were carried out with success. Footage from 40 out of 45 pigs was used for the ethogram because in 5 pigs footages were recorded for slightly less than 30 minutes at some moments; therefore data from these 5 five pigs were excluded from the ethogram analysis. For validation of the scale, 180 videos of approximately 4-minute durations were edited and footage of the main study from 45 pigs were used. There were no postoperative complications in these pigs.

Behaviour data

The behaviours observed in the ethogram are described in Table 1.

Table 1. Description of the behaviours evaluated in the ethogram of pigs submitted to orchiectomy (adapted from the literature [6, 8, 32, 33, 34]).

Behaviour Description
Normal
Stand inactive Standing still, without expression of other normal behaviours
Walk Walking
Sit Seated.
Lie down At rest, lying down
Sleep Sleeping
Eat Eating from the trough
Drink Drinking water
Root Exploring the environment, rooting around the pen, or lying down
Urinate/defecate Act of urinating or defecating
Friendly social interactions
Lick Perform small chewing movements while touching another animal
Smell Smelling another piglet standing or lying down
Aggressive social interaction
Fight Direct physical confrontation, with head butts, pushes, bites and chases, in rapid and continuous succession
Stereotypical behaviour
Bite Biting parts of the pen (bars, trough)
Run/Agitated Visibly stressed, running around the pen; disturbed, with escapist behaviour
Behaviour indicative of pain
Altered posture Presenting one or more repetitions of abnormal behaviours: standing kicking, scratching/rubbing the affected area (surgical wound), protecting the affected area (surgical wound), contracted muscles, arched back, and energetic tail wagging
Difficulty walking Difficulty walking, apparent discomfort in the perineal region, contraction of scrotal region, and energetic tail wagging
Lie down alone Quiet, lying alone in the pen, not allowing interaction
Lie down uncomfortably Changes posture with apparent discomfort, tail wagging and/or rubbing the affected area (surgical wound) on the floor

Where normal behaviours are concerned, piglets spend a longer time eating and drinking water after rescue analgesia, compared to before rescue analgesia (Table 2). When compared to values before surgery, piglets spent a shorter time walking, resting, sleeping, rooting, and interacting and a longer time in abnormal posture, walking with difficulty, and lying alone or with discomfort after surgery. Rescue analgesia reverted the duration of these behaviours to values observed before surgery, except for resting and sleeping, which remained lower after rescue analgesia compared to before surgery.

Table 2. Median and amplitude of the number of minutes/30 minutes of normal behaviours, friendly social interactions, aggressive social interactions, stereotypical behaviours, and pain-related behaviours in piglets submitted to castration (n = 40).

Items of the Ethogram M1 (%) M2 (%) M3 (%) M4 (%)
Eat 23ab (0–91) 21b (0–51) 30a (7–93) 24ab 1–68)
Drink 2b (0–9) 1b (0–9) 4a (0–20) 2ab (0–12)
Stand 3a (0–18) 1ab (0–23) 0b (0–10) 1ab (0–8)
Walk 7a (0–38) 2b (0–19) 8a (0–50) 3ab (0–23)
Lie down at rest 22a (3–79) 9b (0–41) 5b (0–68) 13b (0–56)
Sleep 0a 0–70) 0b (0–11) 0b (0–23) 0ab (0–50)
Sit 0 (0–1) 0 (0–1) 0 (0–1) 0 (0–10)
Root 7ab (0–23) 1c (0–27) 9a (0–40) 4bc (0–19)
Urinate/defecate 0 (0–3) 0 (0–4) 0 (0–3) 0 (0–2)
Interact 5a (0–40) 0c (0–10) 3ab (0–41) 0bc (0–20)
Fight 0 (0–6) 0 (0–7) 0 (0–17) 0 (0–12)
Bite the bars or objects 0 (0–6) 0 (0–7) 0 (0–60) 0 (0–17)
Stand: altered posture 0c (0–0) 6a (0–20) 0b (0–20) 6a (0–24)
Altered walk 0c (0–0) 4a (0–17) 0b (0–14) 2a (0–32)
Run/agitated 0 (0–0) 0 (0–11) 0 (0–27) 0 (0–16)
Lie down alone 0c (0–4) 16a (0–78) 0bc (0–49) 0b (0–59)
Lie down uncomfortably 0d (0–0) 20a (0–70) 0c (0–24) 8b (0–57)

M1: preoperative; M2: postoperative, before rescue analgesia; M3: postoperative, after rescue analgesia; M4: 24 hours postoperative.

a,b,c,d different superscript letters indicate statistical difference between time periods, where a>b>c>d.

Pain scale data

The scale constructed for video analysis was composed of six items, each with four sub-items, providing a maximum score of 18 points (Table 3).

Table 3. The UNESP-Botucatu composite pain scale for assessing postoperative pain in pigs.

Item Score/criterion Links to videos
Posture (0) normal (any position, apparent comfort, relaxed muscles) https://youtu.be/-loODGUwmS0
(1) changes posture, with discomfort https://youtu.be/V5zEiuJnF_g
(2) changes posture, with discomfort, and protects the affected area https://youtu.be/PAZplCKxuhk
(3) quiet, tense, and back arched https://youtu.be/qubgsQeoQ-8
Interaction and interest in the surroundings (0) interacts with other animals; interested in the surroundings https://youtu.be/OwbrMRogO-I
(1) only interacts if stimulated by other animals; interested in the surroundings. https://youtu.be/IPdIeVaeDlY
(2) occasionally moves away from the other animals, but accepts approaches; shows little interest in the surroundings https://youtu.be/kQ0gZ4CF5Zk
(3) moves or runs away from other animals and does not allow approaches; disinterested in the surroundings https://youtu.be/ZrHZZlLk7Q4
Activity (0) moves normally https://youtu.be/3_Rt3MT1pHE
(1) moves with less frequency https://youtu.be/lJDfz7KqApY
(2) moves constantly, restless https://youtu.be/cfET4CN4g0w
(3) reluctant to move or does not move https://youtu.be/X7_uDln8ih0b
Appetite (0) normorexia https://youtu.be/HWymAEgtaO4
(1) hyperexia https://youtu.be/QJ4z-TqDnjw
(2) hyporexia https://youtu.be/SNgFH5Yt-1A
(3) anorexia https://youtu.be/pYWA1VwSHYo
Attention to the affected area A. elevates pelvic limb or alternates the support of the pelvic limb https://youtu.be/ndrx0h_nc-Y
B. scratches or rubs the painful area https://youtu.be/qVkDWKdTjEk
C. moves and/or runs away and/or jumps after injury of the affected area https://youtu.be/RV0c3bIFfdc
D. sits with difficulty https://youtu.be/Qq0e1CbRQYU
(0) all the above behaviours are absent
(1) presence of one of the above behaviours
(2) presence of two of the above behaviours
(3) presence of three or all the above behaviours
Miscellaneous behaviours A. wags tail continuously and intensely https://youtu.be/cfrD0bN5BK4
B. bites the bars or objects https://youtu.be/xyw9O14h9dg
C. the head is below the line of the spinal column. https://youtu.be/qKQRqY0hCY4
D. presents difficulty in overcoming obstacles (example: other animal) https://youtu.be/6ucHv8245N4
(0) all the above behaviours are absent
(1) presence of one of the above behaviours
(2) presence of two of the above behaviours
(3) presence of three or all the above behaviours

Intra-observer reliability

The intra-observer reliability, including all assessed moments, was good for all evaluators, except for attention to the affected area and miscellaneous behaviours which was moderate for evaluator 3 (Table 4).

Table 4. Intra-observer reliability or agreement (confidence interval) for each item of the UPAPS.

Items of the scale* Observers
Gold standard Evaluator 1 Evaluator 2 Evaluator 3
Posture 0.8 (0,72–0.87) 0.79 (0.70–0.87) 0.64 (0.49–0.78) 0.65 (0.48–0.82)
Interaction 0.69 (0.57–0.80) 0.78 (0.69–0.86) 0.66 (0.52–0.81) 0.68 (0.58–0.79)
Activity 0.62 (0.51–0.74) 0.63 (0.51–0.75) 0.68 (0.53–0.83) 0.67 (0.55–0.80)
Appetite 0.62 (0.42–0.82) 0.78 (0.64–0.91) 0.70 (0.49–0.90) 0.76 (0.63–0.89)
Attention to the area 0.72 (0.63–0.81) 0.63 (0,52–0,75) 0.67 (0.55–0.78) 0.54 (0.40–0.68)
Miscellaneous 0.66 (0.55–0.76) 0.69 (0.60–0.78) 0.70 (0.59–0.80) 0.54 (0.40–0.69)
Total score** 0.88 (0.84–0.91) 0.85 (0.80–0.89) 0.79 (0.72–0.84) 0.82 (0.76–0.86)

UPAPS: UNESP-Botucatu pig composite acute pain scale. The weighted Kappa coefficient was used to calculate the correlation of each item of the scale, encompassing all moments of the 2nd assessment phase. For the total score of UPAPS, the intraclass correlation coefficient type "consistency" was used, and its 95% CI. Interpretation: 0.81–1.0 = very good; 0.61–0.80 = good; 0.41–0.60 = moderate; 0.21–0.40 = reasonable; < 0.20 = poor(38).

Inter-observer reliability

Reproducibility based on matrix correlation ranged from moderate (Observer 1 vs. 3) to very good (Observer 1 vs. Gold standard) (Table 5).

Table 5. Matrix intraclass coefficient (confidence interval 95%) of the sum of the scores of the UPAPS.

Observer 1 Observer 2 Observer 3
Gold standard 0.81 (0.76–0.86) 0.80 (0.74–0.85) 0.62 (0.52–0.70)
Observer 1 0.71 (0.63–0.77) 0.57 (0.47–0.66)
Observer 2 0.75 (0.68–0.81)

UPAPS: UNESP-Botucatu pig composite acute pain scale. Interpretation: 0.81–1.0 = very good; 0.61–0.80 = good; 0.41–0.60 = moderate; 0.21–0.40 = reasonable; < 0.20 = poor(38).

Criterion validity

Concurrent criterion validity based on the agreement between the gold-standard evaluator and the other observers

The criterion validity based on the agreement between the gold-standard evaluator and the three other observers was good or very good for the total score of the UPAPS and the kappa correlation coefficient ranged from reasonable to good for each item of the scale (Table 6).

Table 6. Inter-observer reliability (confidence interval) between the gold standard and other observers of the UPAPS.
Items of the scale* Gold standard vs
Observer 1 Observer 2 Observer 3
Posture 0.66 (0.55–0.76) 0.51 (0.62–0.74 0.44 (0.32–0.55)
Interaction 0.75 (0.65–0.85) 0.71 0.59–0.83) 0.53 (0.38–0.67)
Activity 0.53 (0.40–0.65) 0.69 (0.58–0.81 0.53 (0.42–0.64)
Appetite 0.61 (0.43–0.80) 0.76 (0.60–0.91) 0.55 (0.34–0.76)
Attention to the area 0.64 (0.53–0.76) 0.63 (0.52–0.74) 0.36 (0.24–0.48)
Miscellaneous 0.62 (0.53–0.71) 0.57 (0.46–0.68) 0.43 (0.34–0.53)
Total score** 0.81 (0.76–0.86) 0.80 (0.74–0.85) 0.62 (0.52–0.70)

UPAPS: UNESP-Botucatu pig composite acute pain scale.

*The weighted Kappa coefficient was used to calculate the correlation of each item of the scale. For the total score of UPAPS, the intraclass correlation coefficient type "consistency" was used, and its 95% CI. The agreement between the gold standard evaluator and other observers was assessed encompassing all moments of the 2nd assessment phase. Interpretation: 0.81–1.0 = very good; 0.61–0.80 = good; 0.41–0.60 = moderate; 0.21–0.40 = reasonable; < 0.20 = poor(38).

Concurrent criterion validity based on the correlation between the UPAPS and unidimensional scales

High correlations were observed between the scores of the proposed scale and the VAS (r = 0.846), NRS (r = 0.878), and SDS (0.854) (Table 7) for all evaluators.

Table 7. Spearman correlation between the UPAPS and the Visual Analogue Scale (VAS), Numerical Rating Scale (NRS), and Simple Descriptive Scale (SDS).
Scale Observers
Gold-standard Evaluator 1 Evaluator 2 Evaluator 3 All
VAS 0.91 0.89 0.78 0.83 0.85
NRS 0.93 0.90 0.83 0.83 0.88
SDS 0.91 0.88 0.78 0.83 0.85

UPAPS: UNESP-Botucatu pig composite acute pain scale. P value = 0.

Predictive criterion validity

Indication of rescue analgesia was higher when based on the Youden index compared to clinical experience (Table 8). According to the Youden index, all the grouped evaluators would indicate rescue analgesia in 84% (71–98%) of the pigs in M2 (Table 8), thus confirming predictive criterion validity. Otherwise, needless analgesia would be indicated in 6% (0–11%) of the pigs at M1. Therefore, UPAPS demonstrated sensitivity to diagnose pain and specificity to differentiate pigs not suffering pain.

Table 8. Percentage of pigs for which rescue analgesia was indicated according to clinical experience and according to the Youden index of the UPAPS.
Observers Gold 1 2 3 All
RA Exp YI Exp YI Exp YI Exp YI Exp YI
M1 0 0 0 11 0 2 0 9 0 6
M2 96 98 84 91 47 76 47 71 68* 84*

Calculation based on 45 pigs for each observer and 180 pigs for all evaluators. RA—indication of rescue analgesia according to clinical experience scored at the end of each video analysis (Exp) and according to the Youden index of the UPAPS (score ≥ 4). UPAPS—UNESP-Botucatu pig composite acute pain scale. Gold—gold standard observer; M1—preoperative; M2—postoperative, before rescue analgesia. Youden index ≥ 4 is representative of the cut-off point for indication of rescue analgesia (see Tables 15 and 16 and Fig 5 for results of Youden index).

* expresses difference between Exp and YI according to Fisher’s Exact Test (p = 0.0008).

Principal component analysis

The principal component analysis produced a factor with a value of 3.47. All items presented an acceptable factor load (Table 9, Fig 2).

Table 9. Principal component analysis showing load, eigenvalue, and variance after the analysis of the main components with the Kaiser criterion of the UPAPS.

Items of the Scale Factor Load* Dimension 1 Factor Load* Dimension 2
Posture -0.88 0.07
Interaction and interest in the surroundings -0.82 -0.20
Activity -0.84 -0.11
Appetite -0.50 -0.76
Attention to the surgical wound -0.75 0.38
Miscellaneous -0.71 0.40
Eigenvalue 3.47 0.94
Variance 57.88 15.59

UPAPS: UNESP-Botucatu pig composite acute pain scale. The principal component analysis defines the number of dimensions determined by different variables that establish the scale extension. Two factors, dimensions or domains, were defined for UPAPS.

*Factor load represents the correlation between the items and the factors. The factor loads in bold indicate the variables which contribute to each factor. The factorial structure was confirmed when items showed a factor load ≥ 0.50 or ≤ -0.50 (in bold) (43). The item appetite showed the lowest factor load in dimension 1, but a high factor load in dimension 2, and considering that, in the ethogram, time spent eating was lower at the moment of pain compared to the moment after rescue analgesia, this item was maintained in the scale. Please see Fig 2 for a graphical example.

Fig 2. Principal component analysis of the items of the UPAPS.

Fig 2

UPAPS—UNESP-Botucatu pig composite acute pain scale. Data were obtained from the gold standard observer analysis at four evaluation moments. Each number corresponds to one pig and each colour corresponds to one moment (M1—green, pigs 1 to 45; M2—red, pigs 46 to 90, correspond to pigs from 1 to 45 of M1; M3—blue, pigs 91 to 135, correspond to pigs from 1 to 45 of M1 and M4—yellow, pigs 136 to 180, correspond to pigs from 1 to 45 of M1). The ellipses were constructed according to the pain assessment moments (M2—red, M3—blue, and M4—yellow). The ellipse corresponding to the moments pigs were suffering intense (M2) and moderate pain (M4) are positioned at the left side of the figure. On the opposite side are the ellipses corresponding to the moments pigs were probably not suffering pain (M1 and M3). All items on the scale were influenced by pain (M2 and M4) since their vectors are positioned in the direction of these ellipses.

Correlation coefficient of item score with total score (item-total score)

The item-total correlation for all moments varied from 0.42 to 0.87 (Table 10). All items were accepted as they were above 0.3 (23).

Table 10. Item-total correlation between each item score and total score for the UPAPS.

Item MA
Excluding each item below
Posture 0.87
Interaction and interest in the surroundings 0.64
Activity 0.83
Appetite 0.42
Attention to the surgical wound 0.79
Miscellaneous 0.73

UPAPS: UNESP-Botucatu pig composite acute pain scale. Interpretation of Spearman’s item-total correlation coefficient: Values above 0.3 were considered acceptable (23). MA—data from moments grouped (M1 + M2 + M3 + M4).

Internal consistency

The Cronbach’s α coefficient above 0.80 for all items indicated excellent internal consistency and reinforced the possibility of using the total score to interpret the results (Table 11).

Table 11. Internal consistency of the UPAPS.

Item MA
Full scale 0.89
Excluding each item below
Posture 0.84
Interaction and interest in the surroundings 0.87
Activity 0.86
Appetite 0.90
Attention to the surgical wound 0.86
Miscellaneous 0.88

UPAPS: UNESP-Botucatu pig composite acute pain scale. Cronbach’s α coefficient was calculated for the total score and by excluding each item of the scale. Values for the α coefficient were regarded as follows: 0.60–0.64, minimally acceptable; 0.65–0.69, acceptable; 0.70–0.74, good; 0.75–0.80, very good; and > 0.80, excellent (45). MA—data from moments grouped (M1 + M2 + M3 + M4).

Construct validity (responsiveness)

When compared to the basal values (M1), except for observer 2, pain scores increased significantly after surgery (M2), decreased after analgesia (M3), and were intermediate (greater than M1 and M3, but smaller than M2) 24 hours after the surgery (M4) (Table 12). Therefore, the scale shows excellent responsiveness, as it was even possible to differentiate intense (M2) from moderate pain (M4).

Table 12. Medians (range) of the total scores (0–18) of the UPAPS assessed at the 2nd phase of video analysis.

Moments Observers
Gold-standard Evaluator 1 Evaluator 2 Evaluator 3
M1 0 (0–1)c 0 (0–6)c 0 (0–6)b 0 (0–5)c
M2 8 (1–17)a 6 (0–16)a 5 (0–14)a 6 (0–16)a
M3 0 (0–4)c 1 (0–12)c 0 (0–4)b 0 (0–3)c
M4 4 (0–12)b 3 (0–13)b 1 (0–9)b 2 (0–102)b

UPAPS: UNESP-Botucatu pig composite acute pain scale. Differences in pain scores for each observer between moments, being a > b > c according to the Friedman test (p < 0.05).

When each item was considered separately, gold standard observer scores increased significantly after surgery and decreased after rescue analgesia, showing that all items presented responsiveness and, therefore, construct validity (S1 Table). All sub-items of attention to affected area and miscellaneous behaviours showed responsiveness except scratching or rubbing the painful area, biting the bars, and difficulty in overcoming obstacles.

Specificity and sensitivity

Specificity was excellent for all items (> 95%). Sensitivity was excellent for posture and activity and good for attention to the affected area and miscellaneous behaviours. Interaction and interest in the surroundings and appetite did not demonstrate sensitivity (Table 13).

Table 13. Specificity (in M1) and sensitivity (in M2) of each item of the UPAPS assessed according to the 2nd phase of the gold standard video analysis.

Items Specificity (%)1 Sensitivity (%)2
Posture 100 98
Interaction and interest in the surroundings 100 62
Activity 100 96
Appetite 100 31
Attention to the affected area 100 89
Miscellaneous 96 93

UPAPS: UNESP-Botucatu pig composite acute pain scale.

1Gold standard observer scores recorded at M1 (preoperative) were changed to dichotomous items. Specificity = TN/TN+FP, where TN = number of true negatives (score 0); FP = number of false positives (scores 1, 2, or 3).

2Gold standard observer scores recorded at M2 (postoperative, before rescue analgesia) were changed to dichotomous items. Sensitivity = TP/TP+FN, where TP = number of true positives (scores 1, 2 or 3), FN = number of false negatives (score 0). Specificity and sensitivity were classified as excellent (95–100%), good (85–94,9%), moderate (70–84,9%), or non-sensitive or non-specific (<70) [29].

Distribution of scores

The range of scores was distributed as expected according to pain degree (Figs 3 and 4). Scores 0 predominated before surgery (M1) as expected because pigs were not suffering pain. Scores 1, 2, and 3 predominated at 4 and 24 hours after surgery (M2 and M4), corresponding to the moments of intense and moderate pain. Except for miscellaneous behaviour, only scores of 1 were present after rescue analgesia (M3), corresponding to mild pain and reflecting pain reduction after analgesia. The number of scores of 3 was greater at M2 than at M4, confirming that pain was the most intense after surgery and before rescue analgesia (M2).

Fig 3. Frequency of the presence of scores of each item of the UPAPS.

Fig 3

Legend: posture (top left), interaction and interest in the surroundings (top right), activity (bottom left) and appetite (bottom right).

Fig 4. Frequency of the presence of scores of each item of the UPAPS.

Fig 4

Legend: sum of the scores (top left) and individual scores (bottom left) of attention to the affected area and sum of the scores (top right) and individual scores (bottom right) of miscellaneous behaviours.

ROC Curve for determination of the cut-off point of the UPAPS

The cut-off score for pain diagnosis and recommendation for analgesia determined by the Youden index at the 2nd phase of video analysis was ≥ 4, ≥ 6, ≥ 4, and ≥ 5 for the gold standard, 1, 2, and 3 evaluators respectively, and ≥ 4 for all grouped observers within the scoring margin of 0–18 points (Fig 5 and Table 14). When considering all observers grouped, the interval between the sensitivity and specificity values of 0.90 was between 3.7 and 4.7 (individual values ranged between 2.4 and 5.6). Resampling confidence interval (Bootstrap) for the Youden index was between 3.5 and 4.5 (individual values ranged between 2.5 to 5.5). The calculated diagnostic uncertainty zone of all observers suggests that the threshold score for detecting truly positive (really suffering pain) pigs is ≥ 6, whereas the cut-off score for detecting truly negative (painless) pigs is ≤ 3. Area under the curve (AUC) values of all evaluators grouped was 0.98 (individual values ranged between 0.96–1), pointing out that the tool has excellent discriminatory ability (Fig 5).

Fig 5. ROC curve and AUC (left) and two-graphic ROC curve with the diagnostic uncertainty zone for the UPAPS (right).

Fig 5

Legend: UPAPS—UNESP-Botucatu pig composite acute pain scale. Receiver Operating Characteristic (ROC) curve with 95% confidence interval (CI) calculated from 1000 replications and area under the curve (AUC) (A—left). Two-graphic ROC curve, CI of the 1000 replications and of sensitivity and specificity > 0.90 applied to estimate the diagnostic uncertainty zone of the cut-off point using all moments of pain assessment scored by all observers in the 2nd evaluation phase, according to the Youden index for the UPAPS (B—right).

Table 14. Specificity, sensitivity, and Youden index of each observer for each scale score of the UPAPS (A); 95% confidence intervals of 1000 replications and of sensitivity and specificity > 0.90 applied to estimate the diagnostic uncertainty zone of the cut-off point of each evaluator, according to the Youden index (B).

A Gold standard observer Observer 1 Observer 2 Observer 3 All observers
Score Spec Sens Youden index Spec Sens Youden index Spec Sens Youden index Spec Sens Youden index Spec Sens Youden index
4 0.96 1 0.96 0.89 1 0.89 0.86 0.94 0.80 0.87 0.91 0.78 0.89 0.98 0.87
5 0.99 0.91 0.90 0.93 0.96 0.89 0.91 0.88 0.79 0.93 0.91 0.84 0.94 0.92 0.86
6 1 0.77 0.77 0.98 0.91 0.90 0.94 0.81 0.75 0.97 0.78 0.75 0.97 0.82 0.79
B Confidence interval Confidence interval Confidence interval Confidence interval Confidence interval
Est Min Max Est Min Max Est Min Max Est Min Max Est Min Max
Replication CI -- 3.5 4.5 -- 3.5 5.5 -- 3.5 5.5 -- 2.5 5.5 3.5 3.5 4.5
CI of sens and spec > 0.90 -- 2.4 4.55 -- 3.8 5.6 -- 4.1 4.3 -- 4 4.6 -- 3.7 4.7
AUC 01 0.99 1 0.99 0.99 1 0.96 0.93 0.99 0.97 0.95 1 0.98 0.97 0.99
Cut-off point 3.5 -- -- 5.5 -- -- 3.5 -- -- 4.5 -- -- 3.5 3.5 4.5

UPAPS—UNESP-Botucatu pig composite acute pain scale; Spec—specificity; Sens—sensitivity; CI—confidence interval; AUC—area under the curve; Est—estimated; Min—minimum; Max—maximum

The cut-off points for rescue analgesia of unidimensional scales defined by the ROC curve and the Youden index were ≥ 3 for NRS, ≥ 2 for SDS and ≥ 33 for VAS (Table 15).

Table 15. Scores, specificity, sensitivity, and Youden index corresponding to rescue analgesia indication of the UPAPS and unidimensional scales.

Scales Score≥ Diagnostic uncertainty zone Specificity Sensitivity Youden index
UPAPS 4 3–6 0.89 0.98 0.87
NRS (1–10) 3 2–4 0.94 0.98 0.91
SDS (0–3) 2 1–2 0.97 0.92 0.89
VAS 33 21–39 0.96 0.97 0.92

UPAPS—UNESP-Botucatu pig composite acute pain scale; NRS—numerical rate scale; SDS—simple descriptive scale; VAS—visual analogue.

The mean percentage of pigs showing scores inside the diagnostic uncertainty zone was 10%. According to each observer at M2, from 13 to 29% of pigs would fit in the diagnostic uncertainty zone (Table 16).

Table 16. Percentage of pigs present in the diagnostic uncertainty zone according to the Youden index of the UPAPS (scores 4 or 5).

Observer (number of pigs) Gold (45) 1 (45) 2 (45) 3 (45) All (180)
M1 0 7 2 2 3
M2 22 13 18 29 21
M3 2 0 0 2 1
M4 20 18 13 09 15
MA 11 9 8 11 10

UPAPS—UNESP-Botucatu pig composite acute pain scale; Gold—gold standard observer; M1—preoperative; M2—postoperative, before rescue analgesia; M3—postoperative, after rescue analgesia; M4—24h postoperative; MA—data of grouped moments (M1 + M2 + M3 + M4).

Total UPAPS scores were separated into four grades of pain intensity (Fig 6). Median (range) values were: no pain (1; 0–2), mild (5; 3–6), moderate (8; 7–9) and intense pain (12; 10–17) (Fig 7). Based on this grading, in the moment of most intense pain (M2), considering the results of all observers grouped 11% of pigs were classified as no pain and 37% as mild, 28% as moderate and 24% as intense pain.

Fig 6. Dendogram created by the non-hierarchical cluster analysis based on the total score of the UPAPS.

Fig 6

Legend: UPAPS—UNESP-Botucatu pig composite acute pain scale. The scores were graded into 4 groups: no pain (0–2), mild (3–6), moderate (7–9) and intense pain (10–17).

Fig 7. Box plot of the scores related to pain intensity of the UPAPS.

Fig 7

Legend: UPAPS—UNESP-Botucatu pig composite acute pain scale. Data were grouped at the time of most intense pain (M2). According to the median, minimum and maximum scores obtained by the non-hierarchical cluster analysis, the scores were graded into 4 groups: no pain (0–2), mild (3–6), moderate (7–9) and intense pain (10–17). Different letters indicate statistical difference according to the Kruskal-Wallis test, with a> b> c > d.

Discussion

Pigs are submitted to painful procedures in rural and research environments, usually without proper anaesthesia and/or analgesia, possibly due to the absence of an easy-to-use and valid instrument to assess pain in this species [17]. This gap has been filled here, as this study validated a scale to assess postoperative pain in pigs according to required validation criteria [52,53].

The ethogram was relevant to identify and/or confirm pain-related behaviours in pigs undergoing castration and supported the construction of the pain scale. The video recordings provided data to validate the instrument to be applied both in farms and research facilities. The proposed pain scale showed good or very good intra and inter-observer agreement, content, construct and criterion validity, adequate item-total correlation, excellent internal consistency, responsiveness, and specificity, good sensitivity and a defined cut-off point for analgesic intervention [2023].

The adaptation of the piglets to the in-person researcher was apparently opportune. Pigs have the ability to recognize individuals from the first weeks of life and, when socialized with humans, their fear reduces [54,55]. The period of adaptation to the in-person researcher probably contributed to make the pain-related behavioural changes of the pigs more apparent. Appetite increased after rescue analgesia. Overall, normal behaviours decreased, and abnormal behaviours increased after surgery, before rescue analgesia. Extensive literature is available regarding pain-related behaviours in pigs [6,8,32,33,56] and it is beyond the scope of this study to perform an in-depth analysis of these behaviours. The ethogram was performed to confirm, under our experimental conditions, the behaviours described in other facilities and provide additional supporting data to build the pain assessment instrument. It was clear that surgical castration promoted pain-related behavioural changes, even considering that piglets were castrated with local anaesthesia. This finding reinforces the need for proper use of anaesthetics and analgesics in the peri-operative period in pigs [56].

This study showed that the UPAPS was reliable and valid to evaluate postoperative pain after castration in pigs. Reliability indicates the precision of the tool based on the reproducibility [57]. Evaluators’ experience improves reliability [58] and instruction and training improved the recognition of pain in laboratory animals [59]. The observers of this study had experience in pain assessment in other species, but not in pigs, and they were untrained before the observations. The inter and intra-observer agreement results guarantees the scale´s efficiency to provide consistent results among observers and when the instrument is assessed twice by the same observer respectively [23].

Validity indicates that the instrument can precisely quantify what is proposed. Validity composes the ‘three Cs’: content, criterion, and construct validities [23].

The content validity guarantees that the tool approaches the essential domains or embraces all aspects of the variable to be measured [23]. This was grounded by the appreciation of experienced veterinarians in the field, who analysed the representativeness of each item in relation to the scale as a whole [22,37], the ethogram findings and pain-related behaviours described in the literature [6,8,32,33,56].

The systematic evaluation of the tool should be carried out through comparison with a pre-existing external criterion which has already been validated and is therefore considered the gold-standard [60]. Considering the non-existence of a valid tool to assess pain in pigs, the same methodology applied to cats [21] and cattle [22] was adopted and concurrent criterion validity was based on the agreement between the pain scores attributed by the evaluators and a gold-standard evaluator, intensely involved in the planning and execution of the experimental part of the study. The excellent correlation between the scores of the proposed scale versus the VAS, NRS, and SDS, confirmed the concurrent criterion validity of the scale. Although these scales have not been validated in pigs, they have been used to assess pain in veterinary medicine [21,22,61].

Predictive criterion validity was established by the finding that according to the Youden index, 84% of the pigs would be treated with rescue analgesia at the moment of the most intense pain [M2]; therefore, the instrument predicted well that pigs were experiencing pain at this moment and improved decision making when compared to clinical experience, especially for observers 2 and 3.

The proposed scale generated only one factor and, therefore, from a statistical point of view, it is considered unidimensional, like in cattle [22]. The dimensions and domains of the tool were determined by principal component analysis, which is normally used to relate the tool’s variables in a grouped manner [62]. An instrument is multidimensional when it includes other pain experiences, rather than only intensity. These features comprise quality and temporal characteristics, such as sensory, affective, and cognitive dimensions. Regarding pain, these three dimensions show the same trend and therefore, a high correlation. A classic example of a multidimensional scale is the McGill Pain Questionnaire that includes sensory, affective, evaluative, and miscellaneous components [63,64], however the number of its dimensions vary between different studies, patient categories, and statistical models used [65]. It is precocious to make assumptions about the dimension of the instrument presented here, as only one type of pain was assessed (soft tissue) and only one statistical model performed, however different biological “dimensions” of pain are included in the pig scale, such as physiologic (appetite), sensory (posture, activity, attention to the affected area, and miscellaneous), affective (interaction and interest in the surroundings), and temporal (response to analgesia). Future studies using different pain models and statistical approaches may either confirm or not if the scale is multidimensional.

The primary criteria of principal component analysis was to reject items with a correlation coefficient < 0.5 [43]. Appetite was maintained as it was present in dimension 2 and, according to the ethogram, the time spent eating was lower when pigs were suffering pain. Hyporexia is classically considered an important behaviour in animals experiencing pain [10].

All items showed acceptable item–total correlation, indicating their individual relevance, and assuring scale homogeneousness [23]. The internal consistency was excellent, like in cattle [22]. This variable is another measure of reliability of the tool [57] and ensures that the scores of the items that compose the scale may be summed, to guarantee that the total score is representative of pain intensity [21]. The values of items were equivalent, indicating that they have similar tendencies [41].

Construct validity is tested by the responsiveness of the scale. The instrument was able to differentiate degrees of pain, such as mild/moderate and intense, and therefore detected the predictable alterations in the construct [57]. The expected result that the use of analgesics would reduce pain was confirmed by the reduction in scores after rescue analgesia [21,22]. It was remarkable that pain was present again at 24 hours postoperatively. By this time the effect of the analgesics had abated, as the elimination half-life of flunixin and morphine is 7.5 hours [5.6–13 hours] [66] and 65 minutes respectively [67].

Like in cats [21] and cattle [22], the analysis of the ROC curve determined the score required for the analgesic intervention in pigs [47]. The high AUC indicated that the scale presents optimum accuracy, in other words, the tool correctly qualifies individuals with and without pain [46,47]. Similar results were found in the validation of pain scales in cats [21] and cattle [22], using the same methodology.

The definition of the scores which suggest the need for analgesics to control pain, substantiates and increases the confidence in decision-making for pig specialist veterinarians and researchers who are not confident about pain assessment and treatment [2, 3]. Pain mitigation guarantees both the pig’s welfare and improves productive performance [10] in the rural environment and may avoid short and long term hyperalgesia, which could compromise scientific results [68], based on the principle that “happy animals make good science” [69].

The cut-off score for determining pain for analgesic recommendation varied among raters from ≥ 4 to ≥ 6. This could be attributed to their experience, nevertheless, all raters presented high accuracy of the test. Considering the diagnostic uncertainty zone of all raters grouped, it can be assumed that animal rating scores ≥ 6 of a total of 18 points, correspond to pigs that are truly in pain (true positives) and those with scores ≤ 3 are true negatives and without pain. The adoption of this methodology improves the accuracy of pain diagnosis and provision of analgesia. However, even when the scores are < 6, the discernment between using or not using analgesics must always be grounded on observers’ decisions. This was the case of 10% of pigs in the moment of the most intense pain.

So far, to our knowledge there is no information in the literature about the calculation of pain-intensity ranking in animals, except empirically [24]. This data is relevant for the classification of pain intensity in different types of surgery and for decision making for selecting analgesic protocols. The upper limit of mild pain scores and the diagnostic uncertainty zone was the same (6), warranting that pigs undergoing moderate pain should receive analgesia.

The main limitations of this study were that the instrument was validated only for a specific type of surgery (orchiectomy), in piglets, and by using video analysis. Although castration is probably the most common procedure producing intense pain in swine in the rural environment, further studies are demanded to test this tool in different painful procedures, like orthopaedic surgery, as well as in clinical circumstances, to ensure its versatility. Another limitation is that it is not possible to extrapolate our results to pigs of different ages. Although in pre-weaning pigs ranging from 3 to 17 days of age undergoing castration, there were no age-dependent differences in pain-related behaviours [8,70], pain-related behaviour changes were more evident in older pigs aged 7 weeks than those aged 2 weeks [71]. In the present study, the pigs were 38 days old, which is an intermediate age between pre-weaning and adult life and this was a similar age to pigs that display clearer pain-related behaviours compared to younger pigs [71]. A third limitation is that video analysis is not the same as in-person analysis. Observation by video may miss some details observed in real-time, otherwise avoids inhibition of disturbance behaviour caused by the presence of the observer as reported in horses [72]. Video analysis provides material to develop the ethogram, may be reviewed and watched as many times as necessary and is an important step to validate a scale, as reported in cats [37], cattle [22], and horses [27], especially to assess intra-observer reliability. According to our previous study in cats, results from video analysis were also reproducible in a clinical scenario [21,37].

Conclusion

The UNESP-Botucatu composite scale for assessing post-operative pain in pigs (UPAPS) is a valid, reliable, responsive, specific, and sensitive tool, with excellent internal consistency and discriminatory ability, and may be used as an instrument to assess acute pain in pigs submitted to orchiectomy. The well-defined cut-off point supports the evaluator´s decision to provide or not analgesia.

Supporting information

S1 Table. Medians (range) of the score of each item of the UPAPS assessed at the 2nd phase of video analysis by the gold standard observer.

(DOCX)

S1 Data. Data of the pigs.

(XLSX)

S1 Fig

(JPG)

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

SPLL - Financial support from the Foundation for Research Support of the State of São Paulo – FAPESP (Process 2010/08967-0 and 2017/12815-0). http://www.fapesp.br/en/ ALA - Grant from REUNI -http://reuni.mec.gov.br/ The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.United States Department of Agriculture. Livestock and poultry: world markets and trade. 2019; 21p. https://apps.fas.usda.gov/psdonline/circulars/livestock_poultry.pdf
  • 2.Hewson CJ, Dohoo IR, Lemke KA, Barkema HW. Canadian veterinarians’ use of analgesics in cattle, pigs, and horses in 2004 and 2005. Can Vet J = La Rev Vet Can. 2007;48(2):155–64. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ison SH, Rutherford KMD. Attitudes of farmers and veterinarians towards pain and the use of pain relief in pigs. Vet J. 2014;202(3):622–7. 10.1016/j.tvjl.2014.10.003 [DOI] [PubMed] [Google Scholar]
  • 4.von Borell E, Baumgartner J, Giersing M, Jäggin N, Prunier A, Tuyttens FAM, et al. Animal welfare implications of surgical castration and its alternatives in pigs. animal. 2009;3(11):1488–96. 10.1017/S1751731109004728 [DOI] [PubMed] [Google Scholar]
  • 5.Sutherland M. Welfare implications of invasive piglet husbandry procedures, methods of alleviation and alternatives: a review. N Z Vet J. 2015;63(1):52–7. 10.1080/00480169.2014.961990 [DOI] [PubMed] [Google Scholar]
  • 6.Sutherland MA, Davis BL, Brooks TA, McGlone JJ. Physiology and behaviour of pigs before and after castration: effects of two topical anesthetics. animal. 2010;4(12):2071–9. 10.1017/S1751731110001291 [DOI] [PubMed] [Google Scholar]
  • 7.Yun J, Ollila A, Valros A, Larenza-Menzies P, Heinonen M, Oliviero C, et al. Behavioural alterations in piglets after surgical castration: effects of analgesia and anaesthesia. Res Vet Sci. 2019;125:36–42. 10.1016/j.rvsc.2019.05.009 [DOI] [PubMed] [Google Scholar]
  • 8.Carroll JA, Berg EL, Strauch TA, Roberts MP, Kattesh HG. Hormonal profiles, behavioural responses, and short-term growth performance after castration of pigs at three, six, nine, or twelve days of age. J Anim Sci. 2006;84(5):1271–8. 10.2527/2006.8451271x [DOI] [PubMed] [Google Scholar]
  • 9.Malavasi LM, Nyman G, Augustsson H, Jacobson M, Jensen-Waern M. Effects of epidural morphine and transdermal fentanyl analgesia on physiology and behaviour after abdominal surgery in pigs. Lab Anim. 2006;40(1):16–27. 10.1258/002367706775404453 [DOI] [PubMed] [Google Scholar]
  • 10.Telles FG, Luna SPL, Teixeira G, Berto DA. Long-term weight gain and economic impact in pigs castrated under local anaesthesia. Vet Anim Sci. 2016;1–2:36–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Swindle MM, Makin A, Herron AJ, Clubb FJ, Frazier KS. Swine as models in biomedical research and toxicology testing. Vet Pathol. 2012;49(2):344–56. 10.1177/0300985811402846 [DOI] [PubMed] [Google Scholar]
  • 12.Gasthuys E, Vandecasteele T, De Bruyne P, Vande Walle J, De Backer P, Cornillie P, et al. The Potential use of piglets as human pediatric surrogate for preclinical pharmacokinetic and pharmacodynamic drug testing. Curr Pharm Des. 2016,;22(26):4069–85. 10.2174/1381612822666160303111031 [DOI] [PubMed] [Google Scholar]
  • 13.Canadian Council on Animal Care. Animal data report. 2019. p. 12. https://www.ccac.ca/Documents/AUD/2018-Animal-Data-Report.pdf
  • 14.United States Department of Agriculture. Annual Report Animal Usage by Fiscal Year. 2017. p. 10. https://www.aphis.usda.gov/animal_welfare/downloads/reports/Annual-Report-Animal-Usage-by-FY2017.pdf
  • 15.Taylor K, Rego L. EU statistics on animal experiments for 2014. ALTEX. 2016;33(4):465–8. 10.14573/altex.1609291 [DOI] [PubMed] [Google Scholar]
  • 16.Gutierrez K, Dicks N, Glanzner WG, Agellon LB, Bordignon V. Efficacy of the porcine species in biomedical research. Front Genet. 2015;6(SEP). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Cobianchi L, Gigliuto C, de Gregori M, Malafoglia V, Raffaeli W, Compagnone C, et al. Pain assessment in animal models: do we need further studies? J Pain Res. 2014;7:227 10.2147/JPR.S59161 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Castel D, Sabbag I, Brenner O, Meilin S. Peripheral Neuritis Trauma in Pigs: A Neuropathic Pain Model. J Pain. 2016;17(1):36–49. 10.1016/j.jpain.2015.09.011 [DOI] [PubMed] [Google Scholar]
  • 19.Bradbury AG, Eddleston M, Clutton RE. Pain management in pigs undergoing experimental surgery; a literature review (2012–4). Br J Anaesth. 2016; 116:37–45. 10.1093/bja/aev301 [DOI] [PubMed] [Google Scholar]
  • 20.Ison SH, Eddie Clutton R, Di Giminiani P, Rutherford KMD. A review of pain assessment in pigs. Front Vet Sci. 2016; 3 10.3389/fvets.2016.00108 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Brondani JT, Mama KR, Luna SPL, Wright BD, Niyom S, Ambrosio J, et al. Validation of the English version of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in cats. BMC Vet Res. 2013;9(1):143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.de Oliveira FA, Luna SPL, do Amaral JB, Rodrigues KA, Sant’Anna AC, Daolio M, et al. Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle. BMC Vet Res. 2014;10(1):200. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 5th ed Oxford: Oxford University Press; 2015. [Google Scholar]
  • 24.Reid J, Nolan A, Hughes L, Scott EM. Development of the short-form Glasgow Composite Measure Pain Scale (CMPS-SF) and derivation of analgesic intervention score. Anim Welf. 2007;16:97–104. [Google Scholar]
  • 25.Firth AM, Haldane SL. Development of a scale to evaluate postoperative pain in dogs. J Am Vet Med Assoc. 1999;214(5):651–9. [PubMed] [Google Scholar]
  • 26.Reid J, Scott EM, Calvo G, Nolan AM. Definitive Glasgow acute pain scale for cats: validation and intervention level. Vet Rec. 2017;180(18):449. [DOI] [PubMed] [Google Scholar]
  • 27.Taffarel MO, Luna SPL, de Oliveira FA, Cardoso GS, de M Alonso J, Pantoja JC, et al. Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses. BMC Vet Res. 2015;11(1):83. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Sutton GA, Paltiel O, Soffer M, Turner D. Validation of two behaviour-based pain scales for horses with acute colic. Vet J. 2013;197(3):646–50. 10.1016/j.tvjl.2013.04.007 [DOI] [PubMed] [Google Scholar]
  • 29.Bussières G, Jacques C, Lainay O, Beauchamp G, Leblond A, Cadoré JL, et al. Development of a composite orthopaedic pain scale in horses. Res Vet Sci. 2008;85(2):294–306. 10.1016/j.rvsc.2007.10.011 [DOI] [PubMed] [Google Scholar]
  • 30.Di Giminiani P, Brierley VLMH, Scollo A, Gottardo F, Malcolm EM, Edwards SA, et al. The assessment of facial expressions in piglets undergoing tail docking and castration: toward the development of the piglet grimace scale. Front Vet Sci. 2016;3:100 10.3389/fvets.2016.00100 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Viscardi A V., Hunniford M, Lawlis P, Leach M, Turner P V. Development of a piglet grimace scale to evaluate piglet pain using facial expressions following castration and tail docking: a pilot study. Front Vet Sci. 2017;4:51 10.3389/fvets.2017.00051 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Torrey S, Devillers N, Lessard M, Farmer C, Widowski T. Effect of age on the behavioural and physiological responses of piglets to tail docking and ear notching. J Anim Sci. 2009;87(5):1778–86. 10.2527/jas.2008-1354 [DOI] [PubMed] [Google Scholar]
  • 33.Sutherland MA, Davis BL, McGlone JJ. The effect of local or general anesthesia on the physiology and behaviour of tail docked pigs. Animal. 2011;5(8):1237–46. 10.1017/S175173111100019X [DOI] [PubMed] [Google Scholar]
  • 34.Hay M, Vulin A, Génin S, Sales P, Prunier A. Assessment of pain induced by castration in piglets: behavioural and physiological responses over the subsequent 5 days. Appl Anim Behav Sci. 2003;82(3):201–18. [Google Scholar]
  • 35.Leidig MS, Hertrampf B, Failing K, Schumann A, Reiner G. Pain and discomfort in male piglets during surgical castration with and without local anaesthesia as determined by vocalisation and defence behaviour. Appl Anim Behav Sci. 2009;116(2–4):174–8. [Google Scholar]
  • 36.Suraseranivongse S, Santawat U, Kraiprasit K, Petcharatana S, Prakkamodom S, Muntraporn N. Cross-validation of a composite pain scale for preschool children within 24 hours of surgery. Br J Anaesth. 2001;87(3):400–5. 10.1093/bja/87.3.400 [DOI] [PubMed] [Google Scholar]
  • 37.Brondani JT, Luna SPL, Padovani CR. Refinement and initial validation of a multidimensional composite scale for use in assessing acute postoperative pain in cats. Am J Vet Res. 2011;72(2):174–83. 10.2460/ajvr.72.2.174 [DOI] [PubMed] [Google Scholar]
  • 38.Altman D. Some common problems in medical research In: Altman D editor. Pratical statistics for medical research. London: Chapman & Hall/CRC; 1990. pp. 404–8. [Google Scholar]
  • 39.Gauvain-Piquard Rodary, Rezvani Serbouti. The development of the DEGR(R): a scale to assess pain in young children with cancer. Eur J Pain. 1999;3(2):165–76. 10.1053/eujp.1999.0118 [DOI] [PubMed] [Google Scholar]
  • 40.Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213–20. 10.1037/h0026256 [DOI] [PubMed] [Google Scholar]
  • 41.Jensen MP. Questionnaire validation: a brief guide for readers of the research literature. Clin J Pain. 2003;19(6):345–52. 10.1097/00002508-200311000-00002 [DOI] [PubMed] [Google Scholar]
  • 42.Büttner W, Finke W. Analysis of behavioural and physiological parameters for the assessment of postoperative analgesic demand in newborns, infants and young children: A comprehensive report on seven consecutive studies. Paediatr Anaesth. 2000;10(3):303–18. 10.1046/j.1460-9592.2000.00530.x [DOI] [PubMed] [Google Scholar]
  • 43.Kaiser HF. The varimax criterion for analytic rotation in factor analysis. Psychometrika. 1958;23(3):187–200. [Google Scholar]
  • 44.Crombach L. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–333. [Google Scholar]
  • 45.Streiner DL. Starting at the beginning: An introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80(1):99–103. 10.1207/S15327752JPA8001_18 [DOI] [PubMed] [Google Scholar]
  • 46.Deyo RA, Diehr P, Patrick DL. Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials. 1991;12(4 Suppl):142S–158S. 10.1016/s0197-2456(05)80019-4 [DOI] [PubMed] [Google Scholar]
  • 47.Streiner DL, Cairney J. What’s under the ROC? An introduction to receiver operating characteristics curves. Can J Psychiatry. 2007;52(2):121–8. 10.1177/070674370705200210 [DOI] [PubMed] [Google Scholar]
  • 48.Cannesson M, Le Manach Y, Hofer CK, Goarin JP, Lehot JJ, Vallet B, et al. Assessing the diagnostic accuracy of pulse pressure variations for the prediction of fluid responsiveness: A “gray zone” approach. Anesthesiology. 2011;115(2):231–41. 10.1097/ALN.0b013e318225b80a [DOI] [PubMed] [Google Scholar]
  • 49.Gall O, Champigneulle B, Schweitzer B, Deram T, Maupain O, Montmayeur Verchere J, et al. Postoperative pain assessment in children: a pilot study of the usefulness of the analgesia nociception index. Br J Anaesth. 2015;115(6):890–5. 10.1093/bja/aev361 [DOI] [PubMed] [Google Scholar]
  • 50.Mallat J, Meddour M, Durville E, Lemyze M, Pepy F, Temime J, et al. Decrease in pulse pressure and stroke volume variations after mini-fluid challenge accurately predicts fluid responsiveness. Br J Anaesth. 2015;115(3):449–56. 10.1093/bja/aev222 [DOI] [PubMed] [Google Scholar]
  • 51.Trindade PHE, Hartmann E, Keeling LJ, Andersen PH, de C Ferraz G, Paranhos da Costa MJR. Effect of work on body language of ranch horses in Brazil. PLoS One. 2020; 15(1):e0228130 10.1371/journal.pone.0228130 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Belshaw Z, Asher L, Harvey ND, Dean RS. Quality of life assessment in domestic dogs: An evidence-based rapid review. Vet J. 2015;206(2):203–12. 10.1016/j.tvjl.2015.07.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Merola I, Mills DS. Systematic review of the behavioural assessment of pain in cats. J Feline Med Surg. 2016;18:60–76. 10.1177/1098612X15578725 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Hötzel MJ, de Souza GP, Machado Filho LCP, Irgang R, Probst R. Stress and recognition of humans in weanling piglets. Biotemas. 2007;24(4):91–8. [Google Scholar]
  • 55.Tanida H, Miura A, Tanaka T, Yoshimoto T. Behavioral response to humans in individually handled weanling pigs. Appl Anim Behav Sci. 1995;42(4):249–59. [Google Scholar]
  • 56.Sutherland MA, Davis BL, Brooks TA, Coetzee JF. The physiological and behavioural response of pigs castrated with and without anesthesia or analgesia. J Anim Sci. 2012;90(7):2211–21. 10.2527/jas.2011-4260 [DOI] [PubMed] [Google Scholar]
  • 57.Crellin D, Sullivan TP, Babl FE, O’Sullivan R, Hutchinson A. Analysis of the validation of existing behavioural pain and distress scales for use in the procedural setting. Paediatr Anaesth. 2007;17(8):720–33. 10.1111/j.1460-9592.2007.02218.x [DOI] [PubMed] [Google Scholar]
  • 58.Mayer RS, Chen IH, Lavender SA, Trafimow JH, Andersson GB. Variance in the measurement of sagittal lumbar spine range of motion among examiners, subjects, and instruments. Spine. 1995;20(13):1489–93. 10.1097/00007632-199507000-00008 [DOI] [PubMed] [Google Scholar]
  • 59.Roughan J V., Flecknell PA. Evaluation of a short duration behaviour-based post-operative pain scoring system in rats. Eur J Pain. 2003;7(5):397–406. 10.1016/S1090-3801(02)00140-4 [DOI] [PubMed] [Google Scholar]
  • 60.Kelsey JL, Whittemore AS. Methods in observational epidemiology. 2nd ed Kelsey JL, Whittemore AS, editors. New York: Oxford University Press; 1996. 432p. [Google Scholar]
  • 61.Holton LL, Scott EM, Nolan AM, Reid J, Welsh E, Flaherty D. Comparison of three methods used for assessment of pain in dogs. J Am Vet Med Assoc. 1998;212:61–6. [PubMed] [Google Scholar]
  • 62.DeVon H a., Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155–64. 10.1111/j.1547-5069.2007.00161.x [DOI] [PubMed] [Google Scholar]
  • 63.Melzack R. The McGill Pain Questionnaire: major properties and scoring methods. Pain. 1975;1(3):277–99. 10.1016/0304-3959(75)90044-5 [DOI] [PubMed] [Google Scholar]
  • 64.Ho K, Spence J, Murphy MF. Review of pain-measurement tools In: Annals of Emergency Medicine. Mosby Inc; 1996. p. 427–32. 10.1016/s0196-0644(96)70223-8 [DOI] [PubMed] [Google Scholar]
  • 65.Holroyd KA, Holm JE, Keefe FJ, Turner JA, Bradley LA, Murphy WD, et al. A multi-center evaluation of the McGill Pain Questionnaire: results from more than 1700 chronic pain patients. Pain. 1992;48(3):301–11. 10.1016/0304-3959(92)90077-o [DOI] [PubMed] [Google Scholar]
  • 66.Pairis-Garcia MD, Karriker LA, Johnson AK, Kukanich B, Wulf L, Sander S, et al. Pharmacokinetics of flunixin meglumine in mature swine after intravenous, intramuscular and oral administration. BMC Vet Res. 2013;9(1):165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Risdahl JM, Chao C, Murtaugh MP, Peterson PK, Molitor TW. Acute and chronic morphine administration in swine. Pharmacol Biochem Behav. 1992;43(3):799–806. 10.1016/0091-3057(92)90411-8 [DOI] [PubMed] [Google Scholar]
  • 68.Di Giminiani P, Edwards SA, Malcolm EM, Leach MC, Herskin MS, Sandercock DA. Characterization of short- and long-term mechanical sensitisation following surgical tail amputation in pigs. Sci Rep. 2017. December 1;7(1). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Poole T. Happy animals make good science. Lab Anim. 1997;31:116–24. 10.1258/002367797780600198 [DOI] [PubMed] [Google Scholar]
  • 70.Taylor AA, Weary DM, Lessard M, Braithwaite L. Behavioural responses of piglets to castration: the effect of piglet age. Appl Anim Behav Sci. 2001;73(1):35–43. 10.1016/s0168-1591(01)00123-x [DOI] [PubMed] [Google Scholar]
  • 71.McGlone JJ, Hellman JM. Local and general anesthetic effects on behaviour and performance of two- and seven-week-old castrated and uncastrated piglets. J Anim Sci. 1988;66(12):3049–58. 10.2527/jas1988.66123049x [DOI] [PubMed] [Google Scholar]
  • 72.Torcivia C, McDonnell S. In-person caretaker visits disrupt ongoing discomfort behavior in hospitalized equine orthopedic surgical patients. Anim. 2020;10(2):210. [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Francesco Staffieri

22 Jan 2020

PONE-D-19-30670

Validation of the UNESP-Botucatu composite pain scale for assessing postoperative pain in pigs

PLOS ONE

Dear Prof Stelio Pacca Loureiro Luna,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Dear Authors,

it seems that both the reviewer have some minor related to your study. Please provide a complete response or amend the manuscript accordingly their suggestions if possible.

We would appreciate receiving your revised manuscript by Mar 07 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Francesco Staffieri

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Dear Authors,

it seems that both the reviewer have some minor related to your study. Please provide a complete response or amend the manuscript accordingly their suggestions if possible

Journal Requirements:

When submitting your revision, we need you to address these additional requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In your Methods section, please provide additional details regarding the animals used in your study and ensure you have described the source. For more information regarding PLOS' policy on materials sharing and reporting, see https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-materials.

3. In your Methods section, please include a comment about the state of the animals following this research. Were they euthanized or housed for use in further research? If any animals were sacrificed by the authors, please include the method of euthanasia and describe any efforts that were undertaken to reduce animal suffering.

4. Please amend the manuscript submission data (via Edit Submission) to include author Flávia Augusta de Oliveira.

5. Please ensure that you refer to Figure 2 and 5 in your text as, if accepted, production will need this reference to link the reader to the figure.

6. Please upload a new copy of Figure 5 as the detail is not clear. Please follow the link for more information: http://blogs.PLOS.org/everyone/2011/05/10/how-to-check-your-manuscript-image-quality-in-editorial-manager/

7. We note you have included a table to which you do not refer in the text of your manuscript. Please ensure that you refer to Table 2 in your text; if accepted, production will need this reference to link the reader to the Table.

8. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study reports the development and validation of the UNESP-Botucatu composite pain scale for assessing postoperative pain in pigs. It includes an ethogram for the development of the scale and the validation based on video footage from 45 piglets undergoing castration. Four moments were assessed by 4 different observers. Validation of the scale and definition of the cut-off for administration of rescue analgesia were performed based on solid statistics. The study is well designed, conducted and reported.

Most of this reviewer’s comments were made for improving the readability and fluidity of the text as well as for providing more details and clarifying some points of the methodology and results sections.

Abstract:

Line 1: Perhaps change “mandatory” to “essential”?

Line 3: change to “treatments”

Line 5: change “submitted to” to “undergoing”

Lines 6-9: Suggest changing to: “Behavior was video-recorded 30 minutes before and intermittently up to 24 hours after castration. Edited footage (before surgery, after surgery before and after rescue analgesia, and 24 hours postoperatively) was analysed twice (one month apart) by one observer who was present during video-recording and three blinded observers”.

Line 13: Suggest changing to: “except between observers 1 and 3 (moderate agreement; 0.57)”

Line 14: Remove “the” from “based on the principal component”

Introduction:

The Introduction is very nice and it touches the most important points pertaining to the study. However, it is overly long. Please edit the introduction to shorten the amount of text.

Page 3, Line 7: Change to: “…respectively. However, among..”

Page 3, Lines 15-16: Please clarify that the data on beef and dairy cattle refer to animals undergoing the same procedure (castration?).

Pages 3 and 4, Lines 24-2: Suggest changing to: “This paradigm has been challenged by the fact that pigs treated with anaesthesia and analgesia showed increased short- and long-term weight gain when compared with pigs castrated without anaesthesia; thus, providing an economic benefit to producers.”

Page 4, Lines 6-8: Please split this sentence in two (one for Canada and another for USA and Europe).

Page 4, Line 21: Change “determination” for “assessment”

Page 5, Lines 4-13: Suggest deleting this paragraph. It does not add much relevant information.

Page 6, Line 4: Please correct: “this species” (singular)

Page 6, Lines 1-14: There is a link missing between these paragraphs. Please edit this section to shorten and link them.

Page 5, Lines 20-24 and Page 6, Lines 15-18: These two sections should be together.

Materials and methods

Page 7, Line 12: Was food also available ad libitum? Please clarify

Page 7, Line 14: Please remove the comma “..maternity period when piglets”

Page 7, Lines 14-16: Was the observer actively making physical contact with the piglets in the first week? Please clarify what you mean by “friendly contact with the piglets”. Also, I am not sure what you mean by “the observer followed the daily routine of the sector”.

Page 7, Line 22: 1 mL divided into two doses of 0.5 mL into each testicle? Please clarify.

Page 8, Line 8: When you say “evaluator”, I assume you refer to the observer who had been familiarizing with the pigs. It does not seem that this individual was actually ‘evaluating’ pain, correct?

Please clarify the presence of the observer. Was it only to set the camera? Was he/she the one evaluating the surgical wound and/or giving the medications?

Please also specify the sex of this individual and the other 3 observers.

Page 8, Lines 10-17: How long were the selected footage for each moment? I assume the individual who edited the footage was the same familiarizing with the pigs and doing the video recording?

Also, you might want to use “;” instead of “,” between moments and put explanations between parenthesis to facilitate the reading since this sentence has 7 lines. Consider removing the information being repeated in Figure 1.

Page 9 Line 5: Do you mean “behaviours observed in the pilot study?”. It seems like there is something missing here.

Page 9 Line 5: “were accepted”. Do you mean that they were included in the scale?

Page 9 Lines 13-16: What do you mean by “variable counting scale”?

Page 9 Lines 17-20: Please remove. You already partially said this. No need to repeat. Only clarify on page 8 lines 10-17 that the edited videos were each 4 minutes long.

Page 11 Lines 12-13: Description of the Altman’s classification should be reported in line 3 since this is the first time you refer to it.

Results

Table 1: I don’t see the explanation for the Asterix. Please include it.

The behavior “rubbing the affected area on the floor” is described under ‘Altered posture’ and ‘Lie down uncomfortably’. How did the observer choose to classify this behavior since it is described under two different categories?

Table 2: “percentage presence”? Please reword.

Please explain the superscript letters.

Page 18 Line 5: Correct “Table 2”. Not “Table 1”.

Table 3: Excellent idea to have the videos in the table! Please recheck the links as some videos are not working.

Table 4: You already explained in the title that values are reported as ICC (CI), so perhaps you can consider deleting the second line of the table [ICC (CI].

If the ICC used for evaluating criterion validity is the ICC between the gold standard and the other observers, how come the ICC between gold standard and gold standard is 0.88? I would expect it to be 1. The same would be for ICC between Observer 1 and Observer 1, and so on. It might be that I don’t understand the statistics of this, but regardless, it’s probably a good idea to explain it a bit more.

Criterion validity would only consider the ICC between the gold standard and each of the other observers, correct? In that case, do you need to report the ICC between observers 1, 2 and 3?

Table 8: Please add the explanation of the Asterix in the table legend.

Perhaps it would be nice to also explain what these ‘dimensions’ are in the legend.

Page 26, Line 1: Please remove ‘the’ from “analysis at the four”.

Table 11: In Page 10, Lines 6-7, it is not clear that the scores used for definition of the cut-off for rescue analgesia were only the scores from the second phase of video analysis. Please clarify.

Page 32 Lines 9-11. This sentence is confusing. Please reword.

Discussion

Page 37 Line 4: Correct “this species”

Page 37 Line 22: Remove “only”

Page 38 Line 5: Consider changing “tool is carried out” for “tool should be carried out”

Page 38 Lines 17-20: This sentence is confusing. Please rephrase.

Page 38 Lines 22-24: Do you mean that the observers were selected because they had experience in pain scoring in cattle? This section is not clear. Indeed, detailed information on the sex and level of training of observers is not clear in the M&M. I even wonder if you need to discuss them here or if clearly explaining them in the M&M is enough. I’ll leave this to your discretion.

Page 39 Lines 4-8: You used this as an additional means of assessing construct validity, correct? In that case, this paragraph should be linked to Page 38 Lines 3-11. It seems a bit lost herein.

Page 39 Lines 16-17: I don’t see a link for the sentence “Therefore, … factor analysis”. Please reword or delete this sentence.

Page 41 Lines 6-9: In this sentence you refer to production and research animals. But the sentence is constructed in a manner that only refers to production animals. Please reword.

Page 42 Line 2: Suggest changing to: “pain-related behavior changes were more evident”

Page 42 Lines 6-12: Perhaps add a small sentence related to the advantage of video analysis as the presence of the observer might affect pain-related behaviors?

Reviewer #2: Dear Authors,

thank you very much for your paper. it covers a very useful topic and is very well conducted, despite the huge amount of data analyzed and discussed.

I have only a few suggestions, that I attach below:

INTRODUCTION

Lines 15-16 (pag. 5): I would eliminate the sentence: Providing that a pain-related behaviour scale is validated, the instrument should present reliability, specificity, and sensitivity.

Line 24 (pag. 5): for cats, I would add the reference by Reid et al.: Definitive Glasgow acute pain scale for cats - validation and intervention level

METHODS

Lines 24 (pag 6)-2 (pag 7): I would move the sentence: “A pilot study was carried out with 12 piglets aged 35 days, submitted to castration to define the experimental protocol. For the main study, 45 Landrace, Large White, Duroc, and Hampshire male pigs were randomly selected. The pigs were aged 1 38±3 days (range2 35 – 41 days) and weighed 11.06 ± 2.28 kg” after the inclusion and exclusion criteria at the end of line 8 (pag. 7)

Line 17 (pag. 8): move here, after “(M4)”, the citation to fig. 1

Line 19: eliminate citation to fig. 1 here

Line 8 (page 10): the sentence should be changed as follow: Subsequently, they were required to ascribe a score for the developed scale as well as the visual analogue scale (VAS), numerical rating scale (NRS), where….

STATISTICAL ANALYSIS

Line 21-22 (pag. 10): As here you are talking about inter-observer reliability and not about criterion validity, I would change the sentence: “comparing the gold-standard assessments against the other observers respectively” in “comparing the degree of agreement among different observers”.

Lines 12-13 (pag. 11): I would delete here the specifications about the Altman’s classification and move it at the end of line 3.

Lines 18-20 (page 11): Is this sentence correct?

Line 2 (pag 13): delete “S” before “< 70%”

RESULTS:

Tab 1: What “*” means?

Tab. 2: the legend should read: “Median and amplitude of the presence (number of minutes of each behaviour/30 minutes) of normal behaviours,….

Line 5 (pag. 18): eliminate the citation to Table 1 here. At the end of the paragraph (line 10) you should cite Table 2.

Line 1-11 (pag 21): the title and the paragraph, as well as table 4, is a bit confusing: in the title you put altogether intra- and inter-observer reliability and criterion validity, in the text you mix criterion validity (first part of the sentence (lines 3-4) with inter-observer reliability (lines 4-5) and you do not mention at all intra-observer reliability.

Later on, you have dedicated paragraphs on Intra-observer reliability and Criterion validity (see my comments to line 9 of pag 22).

Line 9 (pag. 22) the title of the paragraph should read “Criterion validity”!

Line 1 (pag. 23): the Title of table 6 should refer to criterion validity and not to inter-observer reliability

Line 10 (pag. 23): I Would keep in the title only “Concurrent validity”

Line 12 (pag. 25): fig. 2 is not cited in the text. Maybe you can cite it together with Table 8 (pag. 24)

Line 12 (pag. 27): move “(table 10)” at the end of the following sentence (line 14).

Line 19 (pag. 32): fig. 4 is not cited in the text. Maybe you can cite it together with Fig. 3 (line 11)

Line 4 (pag. 33): it should read “Fig 5”!?!

DISCUSSION

Line 8 (pag. 38): I would refer to “construct validity” and not to concurrent validity as you are referring to the comparison with the “gold standard” and not with VAS, NAS and SDS.

Line 5 (pag. 39): in order to avoid confusion, I would use the term “concurrent validity” instead of “reliability”.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Giorgia della Rocca

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jun 1;15(6):e0233552. doi: 10.1371/journal.pone.0233552.r002

Author response to Decision Letter 0


6 Mar 2020

Additional Editor Comments (if provided):

Dear Authors,

it seems that both the reviewer have some minor related to your study. Please provide a complete response or amend the manuscript accordingly their suggestions if possible

The authors appreciate the reviewers for taking the time to review this manuscript carefully.

In the meantime the manuscript was reviewed, the authors developed a further analysis of data. We would appreciate the permission of the editor to include data regarding the predictive criterion validity (Table 8), the Youden indexes of the unidimensional scales (Table 16), the percentage of pigs present in the diagnostic uncertainty zone (Table 17) and finally, the most essential data in our opinion, the classification of pain intensity according non-hierarchical cluster analysis (Fig 6 and 7). The authors believe these inclusions will strengthen the validation process.

To compensate these inclusions, the Introduction section and Table 15 were reduced and individual data from Fig 5 were grouped in one graph instead of 4.

All corrections were performed as suggested. Please see the comments below.

Journal Requirements:

When submitting your revision, we need you to address these additional requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Answer: these links do not seem to work, but we followed instructions for authors

2. In your Methods section, please provide additional details regarding the animals used in your study and ensure you have described the source. For more information regarding PLOS' policy on materials sharing and reporting, see https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-materials.

Answer: This information was included (page 6, line 7)

3. In your Methods section, please include a comment about the state of the animals following this research. Were they euthanized or housed for use in further research? If any animals were sacrificed by the authors, please include the method of euthanasia and describe any efforts that were undertaken to reduce animal suffering.

Answer: This information was included (page 7 – line 14-17). After the end of the field study pigs were kept until 145 days of age when they were submitted to humane slaughter accomplished by electrical stunning, followed by exsanguination, according to the Brazilian Federal legislation (Ministry of Agriculture).

4. Please amend the manuscript submission data (via Edit Submission) to include author Flávia Augusta de Oliveira.

Answer: Flavia Oliveira was included

5. Please ensure that you refer to Figure 2 and 5 in your text as, if accepted, production will need this reference to link the reader to the figure.

Answer: corrected

6. Please upload a new copy of Figure 5 as the detail is not clear. Please follow the link for more information: http://blogs.PLOS.org/everyone/2011/05/10/how-to-check-your-manuscript-image-quality-in-editorial-manager/

Answer: All figures were uploaded after using PACE

7. We note you have included a table to which you do not refer in the text of your manuscript. Please ensure that you refer to Table 2 in your text; if accepted, production will need this reference to link the reader to the Table.

Answer: included

8. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Answer: included

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study reports the development and validation of the UNESP-Botucatu composite pain scale for assessing postoperative pain in pigs. It includes an ethogram for the development of the scale and the validation based on video footage from 45 piglets undergoing castration. Four moments were assessed by 4 different observers. Validation of the scale and definition of the cut-off for administration of rescue analgesia were performed based on solid statistics. The study is well designed, conducted and reported.

Most of this reviewer’s comments were made for improving the readability and fluidity of the text as well as for providing more details and clarifying some points of the methodology and results sections.

The authors appreciate the reviewer for taking the time to review this manuscript carefully.

In the meantime the manuscript was reviewed, the authors developed a further analysis of data. We would appreciate the permission of the reviewer to include data regarding the predictive criterion validity (Table 8), the Youden indexes of the unidimensional scales (Table 16), the percentage of pigs present in the diagnostic uncertainty zone (Table 17) and finally, the most essential data in our opinion, the classification of pain intensity according non-hierarchical cluster analysis (Fig 6 and 7). The authors believe these inclusions will strengthen the validation process.

To compensate these inclusions, the Introduction section and Table 15 were reduced and individual data from Fig 5 were grouped in one graph instead of 4.

All corrections were performed as suggested. Please see the comments below.

Abstract:

Line 1: Perhaps change “mandatory” to “essential”?

Line 3: change to “treatments”

Line 5: change “submitted to” to “undergoing”

Lines 6-9: Suggest changing to: “Behavior was video-recorded 30 minutes before and intermittently up to 24 hours after castration. Edited footage (before surgery, after surgery before and after rescue analgesia, and 24 hours postoperatively) was analysed twice (one month apart) by one observer who was present during video-recording and three blinded observers”.

Line 13: Suggest changing to: “except between observers 1 and 3 (moderate agreement; 0.57)”

Line 14: Remove “the” from “based on the principal component”

Answer: All corrections were performed.

Introduction:

The Introduction is very nice and it touches the most important points pertaining to the study. However, it is overly long. Please edit the introduction to shorten the amount of text.

Answer: Introduction section was reduced of about 25%.

Page 3, Line 7: Change to: “…respectively. However, among..”

Page 3, Lines 15-16: Please clarify that the data on beef and dairy cattle refer to animals undergoing the same procedure (castration?).

Pages 3 and 4, Lines 24-2: Suggest changing to: “This paradigm has been challenged by the fact that pigs treated with anaesthesia and analgesia showed increased short- and long-term weight gain when compared with pigs castrated without anaesthesia; thus, providing an economic benefit to producers.”

Page 4, Lines 6-8: Please split this sentence in two (one for Canada and another for USA and Europe).

Page 4, Line 21: Change “determination” for “assessment”

Page 5, Lines 4-13: Suggest deleting this paragraph. It does not add much relevant information.

Page 6, Line 4: Please correct: “this species” (singular)

Page 6, Lines 1-14: There is a link missing between these paragraphs. Please edit this section to shorten and link them.

Page 5, Lines 20-24 and Page 6, Lines 15-18: These two sections should be together.

Answer: All corrections were performed and introduction was condensed.

Materials and methods

Page 7, Line 12: Was food also available ad libitum? Please clarify

Answer: Information was included. They were fed three times a day and food was also offered during the perioperative pain assessment moments (page 6, line 15; oage 7, line 12-14)).

Page 7, Line 14: Please remove the comma “..maternity period when piglets”

Page 7, Lines 14-16: Was the observer actively making physical contact with the piglets in the first week? Please clarify what you mean by “friendly contact with the piglets”. Also, I am not sure what you mean by “the observer followed the daily routine of the sector”.

Answer: more detail was included to make things clearer. “After a week of contact with the piglets, by cleaning the pen and providing food, the in-person researcher initiated direct friendly contact inside the stall, for 15 minutes three times a day, without making any sudden movement, or using vocal communication, so that the piglets could spontaneously approach” (page 6, line 18-21. The pigs by this stage were playing with the in-person researcher, by smelling, nibbling and pulling clothes and hair.

Page 7, Line 22: 1 mL divided into two doses of 0.5 mL into each testicle? Please clarify.

Answer: This was clarified. Pigs received 0.5 mL of 1% lidocaine at each incision line, and 1 mL injected intratesticularly at each testicle (page 6, line 24-25 and page 7, line 1).

Page 8, Line 8: When you say “evaluator”, I assume you refer to the observer who had been familiarizing with the pigs. It does not seem that this individual was actually ‘evaluating’ pain, correct?

Answer: The local (in-person) observer was replaced by in-person researcher to avoid misinterpretation throughout the manuscript.

Please clarify the presence of the observer. Was it only to set the camera? Was he/she the one evaluating the surgical wound and/or giving the medications?

Answer: The local (in-person) observer was replaced by in-person researcher to avoid misinterpretation throughout the manuscript.

Please also specify the sex of this individual and the other 3 observers.

Answer: included. One man and three women.

Page 8, Lines 10-17: How long were the selected footage for each moment? I assume the individual who edited the footage was the same familiarizing with the pigs and doing the video recording?

Answer: This was included in line 10-11 (Page 7). This information was included again in line 17, page 8.

Also, you might want to use “;” instead of “,” between moments and put explanations between parenthesis to facilitate the reading since this sentence has 7 lines. Consider removing the information being repeated in Figure 1.

Answer: This sentence was removed and all information included in Figure 1 as suggested.

Page 9 Line 5: Do you mean “behaviours observed in the pilot study?”. It seems like there is something missing here.

Answer: “The scale was developed according to the analysis of the relevance of pain-related behaviours previously described in the literature[6,8,32-35] and behaviours observed both in the pilot study and during video edition by the in-person researcher.” (page 8, line 4-6)

Page 9 Line 5: “were accepted”. Do you mean that they were included in the scale?

Answer: Yes. Corrected

Page 9 Lines 13-16: What do you mean by “variable counting scale”?

Answer: excluded because this is irrelevant and to avoid misinterpretation.

Page 9 Lines 17-20: Please remove. You already partially said this. No need to repeat. Only clarify on page 8 lines 10-17 that the edited videos were each 4 minutes long.

Answer: partially deleted (page 8, line 17-18)

Page 11 Lines 12-13: Description of the Altman’s classification should be reported in line 3 since this is the first time you refer to it.

Answer: corrected

Results

Table 1: I don’t see the explanation for the Asterix. Please include it.

Answer: asterisks were deleted as they mean nothing

The behavior “rubbing the affected area on the floor” is described under ‘Altered posture’ and ‘Lie down uncomfortably’. How did the observer choose to classify this behavior since it is described under two different categories?

Answer: Please accept our apologies for this mistake. This behaviour was classified as ‘altered posture’ when pigs rubbed the affected area against any structure (like the grid) only when standing; therefore ‘on the floor’ was deleted from here. Otherwise, when pigs rubbed the affected area specifically on the floor when they were lying down, this behaviour was included in the item ‘Lie down uncomfortably’. For the item ‘Attention to the affected area’ of the scale, the behaviour ‘scratches/rubs the painful area’ was scored both when pigs scratched on the floor or against any surface, like the grid.

Table 2: “percentage presence”? Please reword.

Answer: corrected

Please explain the superscript letters.

Answer: included

Page 18 Line 5: Correct “Table 2”. Not “Table 1”.

Table 3: Excellent idea to have the videos in the table! Please recheck the links as some videos are not working.

Answer: The authors acknowledge your comment. We rechecked again and they are all working in Google Chrome and Internet explorer. If the reviewer copy and paste straight to the browser they should work. Could the reviewer please be kind enough to let us know which link is not working?

Table 4: You already explained in the title that values are reported as ICC (CI), so perhaps you can consider deleting the second line of the table [ICC (CI].

Answer: deleted

If the ICC used for evaluating criterion validity is the ICC between the gold standard and the other observers, how come the ICC between gold standard and gold standard is 0.88? I would expect it to be 1. The same would be for ICC between Observer 1 and Observer 1, and so on. It might be that I don’t understand the statistics of this, but regardless, it’s probably a good idea to explain it a bit more.

Answer: Please accept our apologies. We double checked the data. The inter-observer data were correct, but the intra-observer was not. This was amended and duplicate data were removed to facilitate reading (now this is Table 6 as Criterion validity data were placed together, according to Reviewer 2 suggestion)

Criterion validity would only consider the ICC between the gold standard and each of the other observers, correct? In that case, do you need to report the ICC between observers 1, 2 and 3?

Answer: If the reviewer agrees, the authors think it is interesting to inform the correlation among all observers for comparison as well, however as mentioned before duplicate data were removed to facilitate reading (now this is Table 6 as Criterion validity data were placed together, according to Reviewer 2 suggestion).

Table 8: Please add the explanation of the Asterix in the table legend.

Perhaps it would be nice to also explain what these ‘dimensions’ are in the legend.

Answer: Now table 9. Asterisk was included in the legend, and so was additional information regarding this analysis. Please see the explanation of the legend of Figure 2 as well.

Page 26, Line 1: Please remove ‘the’ from “analysis at the four”.

Answer: corrected

Table 11: In Page 10, Lines 6-7, it is not clear that the scores used for definition of the cut-off for rescue analgesia were only the scores from the second phase of video analysis. Please clarify.

Answer: The authors presume the reviewer is referring to Table 14 (now Table 15)? This information was included. Only one ROC curve by grouping all observers replaced the individual ROC curves.

Page 32 Lines 9-11. This sentence is confusing. Please reword.

Answer: Amended (page 30, line 4-11).

Discussion

Page 37 Line 4: Correct “this species”

Page 37 Line 22: Remove “only”

Page 38 Line 5: Consider changing “tool is carried out” for “tool should be carried out”

Answer: Amended

Page 38 Lines 17-20: This sentence is confusing. Please rephrase.

Answer: The sentence was excluded, and the paragraph was shortened. Content validation was not only based on “expert” opinion, but also included the ethogram findings and behaviour described in the literature (page 36, line 10-14).

Page 38 Lines 22-24: Do you mean that the observers were selected because they had experience in pain scoring in cattle? This section is not clear. Indeed, detailed information on the sex and level of training of observers is not clear in the M&M. I even wonder if you need to discuss them here or if clearly explaining them in the M&M is enough. I’ll leave this to your discretion.

Answer: More detailed information regarding the observers were include in Methods section (page 9, line 1-6) and the paragraph was rephrased (page 36, line 2-5).

Page 39 Lines 4-8: You used this as an additional means of assessing construct validity, correct? In that case, this paragraph should be linked to Page 38 Lines 3-11. It seems a bit lost herein.

Answer: Thanks for pointing that. This part is related to criterion validity. These sentences were placed together and followed the order of results to maintain consistency (page 36, line 15-24, page 37, line 1-2.

Page 39 Lines 16-17: I don’t see a link for the sentence “Therefore, … factor analysis”. Please reword or delete this sentence.

Answer: deleted

Page 41 Lines 6-9: In this sentence you refer to production and research animals. But the sentence is constructed in a manner that only refers to production animals. Please reword.

Answer: the paragraph was shortened and rephrased (page 39, line 1-7).

Page 42 Line 2: Suggest changing to: “pain-related behavior changes were more evident”

Answer: corrected (page 40, line 7)

Page 42 Lines 6-12: Perhaps add a small sentence related to the advantage of video analysis as the presence of the observer might affect pain-related behaviors?

Answer: included (page 40, line 10-18)

Reviewer #2: Dear Authors,

thank you very much for your paper. it covers a very useful topic and is very well conducted, despite the huge amount of data analyzed and discussed.

I have only a few suggestions, that I attach below:

The authors appreciate the reviewer for taking the time to review this manuscript carefully.

In the meantime the manuscript was reviewed, the authors developed a further analysis of data. We would appreciate the permission of the reviewer to include data regarding the predictive criterion validity (Table 8), the Youden indexes of the unidimensional scales (Table 16), the percentage of pigs present in the diagnostic uncertainty zone (Table 17) and finally, the most essential data in our opinion, the classification of pain intensity according non-hierarchical cluster analysis (Fig 6 and 7). The authors believe these inclusions will strengthen the validation process.

To compensate these inclusions, the Introduction section and Table 15 were reduced and individual data from Fig 5 were grouped in one graph instead of 4.

All corrections were performed as suggested. Please see the comments below.

INTRODUCTION

Lines 15-16 (pag. 5): I would eliminate the sentence: Providing that a pain-related behaviour scale is validated, the instrument should present reliability, specificity, and sensitivity.

Answer: deleted as requested

Line 24 (pag. 5): for cats, I would add the reference by Reid et al.: Definitive Glasgow acute pain scale for cats - validation and intervention level

Answer: included

METHODS

Lines 24 (pag 6)-2 (pag 7): I would move the sentence: “A pilot study was carried out with 12 piglets aged 35 days, submitted to castration to define the experimental protocol. For the main study, 45 Landrace, Large White, Duroc, and Hampshire male pigs were randomly selected. The pigs were aged 1 38±3 days (range2 35 – 41 days) and weighed 11.06 ± 2.28 kg” after the inclusion and exclusion criteria at the end of line 8 (pag. 7)

Answer: changed as requested (page 6, line 7-11).

Line 17 (pag. 8): move here, after “(M4)”, the citation to fig. 1

Answer: The description of moments were maintained only in Fig 1 as requested by Reviewer 1. The citation of Fig 1 was inserted in line 20, page 7.

Line 19: eliminate citation to fig. 1 here

Answer: excluded

Line 8 (page 10): the sentence should be changed as follow: Subsequently, they were required to ascribe a score for the developed scale as well as the visual analogue scale (VAS), numerical rating scale (NRS), where….

Answer: We apologize but it is necessary to maintain as before as the observers first scored the unidimensional scales and then the proposed scale. We condensed the explanation about the scores and placed between brackets (page 9, line 8-14).

STATISTICAL ANALYSIS

Line 21-22 (pag. 10): As here you are talking about inter-observer reliability and not about criterion validity, I would change the sentence: “comparing the gold-standard assessments against the other observers respectively” in “comparing the degree of agreement among different observers”.

Answer: amended (page 9, line 22-23)

Lines 12-13 (pag. 11): I would delete here the specifications about the Altman’s classification and move it at the end of line 3.

Answer: corrected

Lines 18-20 (page 11): Is this sentence correct?

Answer: Corrected to “The factorial structure was confirmed when items showed a factor load ≥ 0.50 or ≤ -0.50” (page 10, line 24-25).

Line 2 (pag 13): delete “S” before “< 70%”

Answer: corrected

RESULTS:

Tab 1: What “*” means?

Answer: asterisks were deleted as they mean nothing

Tab. 2: the legend should read: “Median and amplitude of the presence (number of minutes of each behaviour/30 minutes) of normal behaviours,….

Answer: corrected

Line 5 (pag. 18): eliminate the citation to Table 1 here. At the end of the paragraph (line 10) you should cite Table 2.

Answer: corrected

Line 1-11 (pag 21): the title and the paragraph, as well as table 4, is a bit confusing: in the title you put altogether intra- and inter-observer reliability and criterion validity, in the text you mix criterion validity (first part of the sentence (lines 3-4) with inter-observer reliability (lines 4-5) and you do not mention at all intra-observer reliability.

Later on, you have dedicated paragraphs on Intra-observer reliability and Criterion validity (see my comments to line 9 of pag 22).

Answer: Thanks for pointing that. Table 4 was changed to Table 6 and positioned in Criterion validity section to keep consistency.

Line 9 (pag. 22) the title of the paragraph should read “Criterion validity”!

Answer: corrected as described above. Matrix correlation is Criterion validity

Line 1 (pag. 23): the Title of table 6 should refer to criterion validity and not to inter-observer reliability

Answer: Table 6 (now Table 5) is not Criterion validity, therefore table 4 (now Tale 6 - Matrix coefficient) was positioned in Criterion validity section to maintain coherence, as previously described.

Line 10 (pag. 23): I Would keep in the title only “Concurrent validity”

Answer: changed to Criterion validity because a new data were incorporated, therefore, criterion validity was subdivided in concurrent and predictive criterion validity page 21, line 6).

Line 12 (pag. 25): fig. 2 is not cited in the text. Maybe you can cite it together with Table 8 (pag. 24)

Answer: included

Line 12 (pag. 27): move “(table 10)” at the end of the following sentence (line 14).

Answer: replaced

Line 19 (pag. 32): fig. 4 is not cited in the text. Maybe you can cite it together with Fig. 3 (line 11)

Answer: Fig. 3 and 4 were cited in the first sentence (page 30, line 4)

Line 4 (pag. 33): it should read “Fig 5”!?!

Answer: corrected

DISCUSSION

Line 8 (pag. 38): I would refer to “construct validity” and not to concurrent validity as you are referring to the comparison with the “gold standard” and not with VAS, NAS and SDS.

Answer: In this study there were two approaches to perform concurrent criterion validity. One was by comparing the scale against the unidimensional scales and the other one was to compare the gold standard assessment against the other observers. Construct validity is related to responsiveness (Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 5th ed. Oxford: Oxford University Press; 2015)

Line 5 (pag. 39): in order to avoid confusion, I would use the term “concurrent validity” instead of “reliability”.

Answer: Thanks for your suggestion. This was corrected (page 36, line 23).

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Francesco Staffieri

2 Apr 2020

PONE-D-19-30670R1

Validation of the UNESP-Botucatu pig composite acute pain scale (UPAPS)

PLOS ONE

Dear Prof Stelio Pacca Loureiro Luna

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

Dear Authors,

please provide an adequate answer to the minor critiques of the first reviewer.

==============================

We would appreciate receiving your revised manuscript by May 17 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Francesco Staffieri

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Dear Authors,

please provide an adequate answer to the minor critiques of the first reviewer.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for addressing the concerns raised in the first review. The manuscript has much improved and there are only minor comments now. The main thing I think is still missing is a clear description of what constituted the pilot study and what constituted the validation study. The authors are congratulated on advancing pig welfare with this research.

Page 2 Line 12. Please removed ‘of’ from: “most of observers”

Page 2 Lines 18-19: Please reword: “increase and decrease in pain scores of all items of the scale after castration and intervention analgesia, respectively, according to..)

Page 6 Line 24: I would assume you need to specific the manufacturer for the lidocaine. Please check the Journal’s instructions. Same for the other drugs.

Page 7 Lines 18-19 Is this the pilot study? Please clarify

Page 7 Lines 21-22: Replace “time in seconds spent on” by “duration”

Fig 1 legend: Reword: “..moments used for validation”

Page 8 Line 17 Please reword “The in-person researcher edited each of the four 30-minute videos into 4-minute videos representing the 4 moments..”

Page 9 Line 3: Change to ‘Developed”

Page 10 Line 12: “confidence interval” – You already defined this abbreviation on line 1 of the same page.

Page 13 Lines 10-13: This is still a bit confusing, and I think it is because it is not entirely clear from M&M what was the pilot study for development of the ethogram and what was the validation study. Please make sure this is clear in the M&M and in the results. Consider rewording this sentence.

Page 16 Line 7-9: The words “after surgery” should be at the end of the sentence in line 9.

Page 16 Line 13-14: In Page 8 line 13, you refer to ‘six behavioral categories’, here you refer to ‘items’. Please standardize the wording.

Table 3. Posture (3); Interaction (0, 1,2,3); Activity (0, 2, 3); Appetite (0,1,2,3); Attention (B, C,D); Miscellaneous (A, B, C, D): the link does not work, but copying and pasting the web address works.

Table 13 – Is this table really necessary in the manuscript? Perhaps as supplementary material?

Page 36 Line 4: ‘before the observations’

Page 37 Line 1: You are repeating the same information from line 18 in the previous page

Reviewer #2: Dear Authors, thanks so much for your revision. Now the paper sounds really good!!

I only have remained 2 small observations, but it's up to you if make the changes or not (in the case I have misunderstood).

1) In M&M you report that video-observers are asked to state if they would provide rescue analgesia and to ascribe a score for VAS, NAS and SDS, but you don't report that they also had to score the UPAPS!!.

So, I would read line 9-12 (page 9) as: "they were required to ascribe a score for the visual analogue scale (VAS), numerical rating scale (NRS; 0 “no pain” to 10 “worst possible pain”), and the simple descriptive scale (SDS; 0 - no pain to 3 - intense pain), AND THEN TO SCORE THE PROPOSED SCALE.

2) In my experience, Table 5 shows results for Concurrent criterion validity (i.e. comparison between the gold standard and each observer), and not for inter-observer reliability that, as stated in lines 22-23 (page 9) refers to the degree of agreement among observers. It's true that also the agreement between the gold standard and each single observer can be part of the inter-observer reliability, but in this table data showing inter-observer reliability (comparison among the 3 observers) are non shown... Indeed, in the first line of table 6 (that is cited in the text as showing data for criterion validity), you repeat results shown in table 5... And I'm still not able to understand the following 2 lines of table 6... are you comparing here data among observers? And if yes, why Observer 2 is not matched with Observer 1?

Still a bit confusing...

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Giorgia della Rocca

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jun 1;15(6):e0233552. doi: 10.1371/journal.pone.0233552.r004

Author response to Decision Letter 1


8 Apr 2020

Answers to reviewers

Reviewers' comments:

Reviewer #1: Thank you for addressing the concerns raised in the first review. The manuscript has much improved and there are only minor comments now. The main thing I think is still missing is a clear description of what constituted the pilot study and what constituted the validation study. The authors are congratulated on advancing pig welfare with this research.

Answer: the authors are very grateful for the suggestions which were fully incorporated.

Page 2 Line 12. Please removed ‘of’ from: “most of observers”

Answer: corrected (page 2, line 13)

Page 2 Lines 18-19: Please reword: “increase and decrease in pain scores of all items of the scale after castration and intervention analgesia, respectively, according to..)

Answer: corrected and rephrased (page 2, line 18-19)

Page 6 Line 24: I would assume you need to specific the manufacturer for the lidocaine. Please check the Journal’s instructions. Same for the other drugs.

Answer: included (page 7, line 6-7, 12, 15-16)

Page 7 Lines 18-19 Is this the pilot study? Please clarify

Answer: “from the main study” was included (page 8, line 3)

Page 7 Lines 21-22: Replace “time in seconds spent on” by “duration”

Answer: corrected (page 8, line 7)

Fig 1 legend: Reword: “..moments used for validation”

Answer: corrected to “Timeline of interventions, drugs and pain assessments performed for validation of the Unesp-Botucatu pig composite acute pain scale (UPAPS)” (page 8; line 9)

Page 8 Line 17 Please reword “The in-person researcher edited each of the four 30-minute videos into 4-minute videos representing the 4 moments..”

Answer: corrected (page 9, line 1-2)

Page 9 Line 3: Change to ‘Developed”

Answer: corrected (page 9, line 5)

Page 10 Line 12: “confidence interval” – You already defined this abbreviation on line 1 of the same page.

Answer: ‘confidence interval’ was excluded from here

Page 13 Lines 10-13: This is still a bit confusing, and I think it is because it is not entirely clear from M&M what was the pilot study for development of the ethogram and what was the validation study. Please make sure this is clear in the M&M and in the results. Consider rewording this sentence.

Answer: “A pilot study was carried out with 12 piglets aged 35 days, submitted to castration only to define the experimental protocol and to recognize pain-related behaviours.” (page 6; line 15-16);

“Footage from 40 out of 45 pigs was used for the ethogram because in 5 pigs footages were recorded for slightly less than 30 minutes at some moments; therefore data from these 5 five pigs were excluded from the ethogram analysis. For validation of the scale, 180 videos of approximately 4-minute durations were edited and footage of the main study from 45 pigs were used” (page 13; line 17-21).

Page 16 Line 7-9: The words “after surgery” should be at the end of the sentence in line 9.

Answer: corrected (page 16, line 9)

Page 16 Line 13-14: In Page 8 line 13, you refer to ‘six behavioral categories’, here you refer to ‘items’. Please standardize the wording.

Answer: ‘categories’ was replaced by ‘items’ in all cases

Table 3. Posture (3); Interaction (0, 1,2,3); Activity (0, 2, 3); Appetite (0,1,2,3); Attention (B, C,D); Miscellaneous (A, B, C, D): the link does not work, but copying and pasting the web address works.

Answer: all links are working correctly now without the need to copy and paste. We had to press ‘enter’ after the link to work out.

Table 13 – Is this table really necessary in the manuscript? Perhaps as supplementary material?

Answer: Table 13 was excluded from the main text and included as supplementary material (S1 Table) as required (page 28, line 9)

Page 36 Line 4: ‘before the observations’

Answer: corrected (page 37, line 5)

Page 37 Line 1: You are repeating the same information from line 18 in the previous page

Answer: “and this methodology has already been used in other studies in cats [21], cattle [22], and horses[27]” was excluded

Reviewer #2: Dear Authors, thanks so much for your revision. Now the paper sounds really good!!

I only have remained 2 small observations, but it's up to you if make the changes or not (in the case I have misunderstood).

The authors are very grateful for the previous and present suggestions which were fully incorporated.

1) In M&M you report that video-observers are asked to state if they would provide rescue analgesia and to ascribe a score for VAS, NAS and SDS, but you don't report that they also had to score the UPAPS!!.

So, I would read line 9-12 (page 9) as: "they were required to ascribe a score for the visual analogue scale (VAS), numerical rating scale (NRS; 0 “no pain” to 10 “worst possible pain”), and the simple descriptive scale (SDS; 0 - no pain to 3 - intense pain), AND THEN TO SCORE THE PROPOSED SCALE.

Answer: thanks for addressing that. This was included (page 9, line 14).

2) In my experience, Table 5 shows results for Concurrent criterion validity (i.e. comparison between the gold standard and each observer), and not for inter-observer reliability that, as stated in lines 22-23 (page 9) refers to the degree of agreement among observers. It's true that also the agreement between the gold standard and each single observer can be part of the inter-observer reliability, but in this table data showing inter-observer reliability (comparison among the 3 observers) are non shown... Indeed, in the first line of table 6 (that is cited in the text as showing data for criterion validity), you repeat results shown in table 5... And I'm still not able to understand the following 2 lines of table 6... are you comparing here data among observers? And if yes, why Observer 2 is not matched with Observer 1?

Still a bit confusing...

Answer: Although both Tables 5 and 6 report results of inter-observer reliability, the authors agree that for the concurrent criterion validity, results from the Gold standard should be compared to the other observers; therefore Tables 5 and 6 were swapped to consider this suggestion. We hope it is clearer now.

Table 5 (previous Table 6) expresses agreements among all observers. The comparison between Observer 1 and 2 is in the intersection between the 3rd line and 3rd column of table 5 (previous table 6).

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Francesco Staffieri

8 May 2020

Validation of the UNESP-Botucatu pig composite acute pain scale (UPAPS)

PONE-D-19-30670R2

Dear Dr. Stelio Pacca Loureiro Luna,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Francesco Staffieri

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: Dear Authors, thank you very much for your review. All my comments have been addressed and I'm fully happy with this new version.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: Yes: Giorgia della Rocca

Acceptance letter

Francesco Staffieri

13 May 2020

PONE-D-19-30670R2

Validation of the UNESP-Botucatu pig composite acute pain scale (UPAPS)

Dear Dr. Luna:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Francesco Staffieri

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Medians (range) of the score of each item of the UPAPS assessed at the 2nd phase of video analysis by the gold standard observer.

    (DOCX)

    S1 Data. Data of the pigs.

    (XLSX)

    S1 Fig

    (JPG)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES