Skip to main content
PLOS One logoLink to PLOS One
. 2023 Feb 2;18(2):e0280995. doi: 10.1371/journal.pone.0280995

Artificial intelligence algorithms predict the efficacy of analgesic cocktails prescribed after orthopedic surgery

Gerhard Fritsch 1,2,*, Heinz Steltzer 3,4, Daniel Oberladstaetter 1, Carolina Zeller 4, Hermann Prossinger 5
Editor: Gennady S Cymbalyuk6
PMCID: PMC9894442  PMID: 36730239

Abstract

Background

Mixtures (‘cocktails’) of various analgesics are more effective in controlling post-operative pain because of potential synergetic effects. Few studies have investigated such effects in large combinations of analgesics and no studies have determined the probabilities of effectiveness.

Methods

We used one-hot encoding of the categorical variables reported pain levels and the administered cocktails (from a total of eight analgesics) and then applied an unsupervised neural network and then the unsupervised DBSCAN algorithm to detect clusters of cocktails. We used Bayesian statistics to classify the effectiveness of these cocktails.

Results

Of the 61 different cocktails administered to 750 patients, we found that four combinations of three to four analgesics were by far the most effective. All these cocktails contained Metamizole and Paracetamol; three contained Hydromorphone and two contained Diclofenac and one Diclofenac-Orphenadrine. The ML probability that these cocktails decreased pain levels ranged from 0.965 to 0.981. Choice of a most effective cocktail involves choosing the optimum in a 4-dimensional parameter space: maximum probability of efficacy, confidence interval about maximum probability, fraction of patients with increase in pain levels, relative number of patients with successful pain level decrease.

Conclusions

We observed that administering one analgesic or at most two is not effective. We found no statistical indicators that interactions between analgesics in the most effective cocktails decreased their effectiveness. Pairs of most effective cocktails differed by the addition of only one analgesic (Diclofenac-Orphenadrine for one pair and Hydromorphone for the other). We conclude that the listed cocktails are to be recommended.

Introduction

The alleviation of postoperative pain by administering analgesics after orthopedic surgery is a major issue in perioperative medicine. Especially in cases of shoulder surgery (e.g. rotator cuff repair), total joint replacement and extremity trauma, pain levels are expected to be high; it is therefore imperative to apply highly effective strategies with the aim to enhance recovery, avoid patient discomfort and suffering, and reduce the risk of pain-related complications [13].

In multimodal pain therapy, physicians usually administer combinations of two or more analgesics [4, 5]. Due to possible pharmacological interactions among these, the prediction of efficacy is rarely known. Interactions can be based on mechanisms of action (e.g. pharmacodynamics on receptors) or pharmacokinetic pathways. For instance, up to 95% of Diclofenac is bound to serum albumin after absorption and renal elimination takes place after hydroxylation by CYP 3A4 and glucuronidation in the liver. Clinical effects are achieved by the blockade of cyclooxygenase I and II, resulting in decreased synthesis of plostaglandins. Acetaminophen also exhibits its action through the cyclooxygenase pathway in inhibiting prostaglandin synthesis. Opioids, on the other hand, act via receptors, which are specific for these analgesics and they are eliminated after hydroxylation by CYP 3A4 in the liver. Thus the combination of more than 2 drugs can be unclear and confusing for the clinician regarding the net-effect of prescriptions.

Postoperative prescriptions contain opioids and non-opioids with various pharmacokinetic and pharmacodynamic properties. To our knowledge, data about how these properties may change when administered in combinations of more than two is sparse and rarely, if ever, published [611]. A serious challenge to any statistical evaluation of analgesic medications with large numbers of combinations of analgesics arises: drawing conclusions using conventional statistical methods is fiendishly difficult. We use artificial intelligence methods [1215] to overcome this difficulty.

We use (artificial) neural networks (NNs) for our data analysis; specifically, we use the unsupervised neural networks (Fig 1) called autoencoders. These unsupervised neural networks generate output that mimics the input to high precision (hence their name: autoencoders) by minimizing the loss (the sum of squares of the differences between input and output, averaged over the training set). We then use the weightings of the code layer for each input feature vector as the coordinates of the dimension-reduced feature vector (Fig 1). Feature vectors are described in the next paragraph.

Fig 1. A symbolic rendition of an autoencoder.

Fig 1

The 11 inputs (in the drawing) are represented by blue arrows from left to right. The inputs are conventionally labelled neurons (hence the name “neural network”). Each input neuron (light blue) has as many outputs as there are neurons in the next layer (8 in the drawing, represented as yellow discs). Each ‘yellow’ neuron thus has 11 inputs (represented as thin black lines, called edges). Each neuron in the yellow layer has as many outputs as there are neurons in the next layer: 6 outputs for each ‘yellow’ neuron and therefore 8 inputs for each ‘green’ neuron of the next layer. And so it continues: each ‘green’ neuron has as many outputs as there are neurons in the next layer (consisting of two ‘orange’ neurons) and each ‘orange’ neuron has 6 inputs. The light blue neurons on the left are called the input layer, the light blue neurons on the right are called the output layer. The (two) yellow layers, the (two) green layers and the (one) orange layer are called the hidden layers. An autoencoder always has the same number of output neurons as it has input neurons. The number of hidden layers is part of the design by the engineer constructing the autoencoder, as well as the number of neurons in each hidden layer. The numerical values along the black edges between neurons are determined by an algorithm. The autoencoder attempts to produce an output equal to the input (hence the name ‘autoencoder’) without being an identity mapping. An important feature for modern autoencoders is the ability to cut (set to zero) certain interconnections (edges), or make them numerically very small (usually by using a sigmoid function). The central layer is called the code. If the inputs are the feature vectors, then the numerical values of the code are the components of the dimension-reduced feature vector. In the drawing: the input feature vector has 11 dimensions and the dimension-reduced feature vector has 2 components. Mathematically: if this is a successful autoencoder, it has detected linear combinations between the components of the (input) feature vector that can be represented by two variables in a 2D space.

The pain levels are categorical variables, as are the analgesics administered. We use one-hot encoding to generate a 38-dimensional feature vector for each patient (see Methods section). These feature vectors are not independent. A dimension reduction algorithm (a neural-network autoencoder) finds independencies and maps the result onto a two-dimensional manifold, a planar map. Each patient is a point in this plane, and the points are not randomly distributed; rather, they are clustered. Of the many clustering algorithms at our disposal, we use the DBSCAN clustering algorithm [16], because applying it to the points identifies clusters of cocktails with many analgesics in common. The interdependencies generate clusters containing highly effective analgesics; a discovery which cannot, as we discuss below, be found in any other way (there are 61 different cocktails of analgesics and a total of 750×2 = 1500 pain level registrations). We have attached a GLOSSARY (S1 File) containing a more detailed description.

The data set in this study consists of categorical (nominal) variables. Multinomial logistic regression is therefore not possible, unless one makes two assumptions: one, it is possible to distinguish between explanatory and dependent variables, and two, it is possible to map the categories of the explanatory variables into cardinal integers. Both these assumptions are violated [17], so we need not enter the discussion of how to deal with the issue of the ‘curse of dimensionality’ [18]. Because the relations between the various categorical variables cannot be assumed to be linear, nonlinear mappings, if found, will have too many parameters [19]. Autoencoders deal with all the above problems automatically: they incorporate nonlinear mappings, dimension-reduce the input feature vectors, and also operate on categorical variables, because these have been transformed into feature vectors via one-hot encoding [13].

Methods

The study was performed after approval by the local ethics committee (Ethikkommission der Krankenanstalten der AUVA; No.13/2020, July 1st, 2020). The need for informed consent was waved by the ethics committee due to the retrospective character of the study. Data were fully anonymized before the analyze.

The data was collected prospectively in conjunction with the peri- and postoperative pain-visits between March 2018 and December 2019 in one single emergency hospital and was analyzed retrospectively. Patients underwent various orthopedic procedures (Table 1) during the routine operating-room-schedule between 8 am and 4 pm. Inclusion Criteria were: shoulder surgery, hip- or knee replacement surgery, repair of the anterior cruciate ligament, spine surgery, amputation of limb and complex reconstructive procedures. Patients were excluded only if the data was incomplete. Diclofenac (2 × 75 mg within 24 hours), Metamizole (3 × 1000 mg within 24 hours), Diclofenac/Orphenadrine (2 × 75 mg / 2 × 30 mg within 24 hours), and Paracetamol (3 × 1000 mg within 24 hours) were administered intravenously according to a fixed dose-plan. Hydromorphone (2 × 2 mg modified release—or 2 × 4 mg modified release for patients with body mass/weight > 80 kg within 24 hours), Tramadol (2 × 150 mg within 24 hours) and Dexibuprofen (2 × 400 mg within 24 hours) were prescribed orally; Piritramide (75 mg; only on demand) was administered subcutaneously. Hydromorphone (1.3 mg or 2.6 mg, depending on body mass/weight) was prescribed as rescue medication for patients who had also received the modified dose of Hydromorphone. Date of birth, date of operation and biological sex (not gender) of each patient was also recorded, as well as the mode of anesthesia. Maximum pain levels during movement directly after operation and minimum pain levels during physicians’ visits as felt by the patients were documented. This part of the data set thus consists of the lists of which combinations of 8 analgesics (Table 3) were administered to 750 patients (421 males and 329 females; 52% general anesthesia, 48% regional anesthesia) in this hospital. Patients were asked as to their perceived pain levels on the 11-part ordinal numeric rating scale (NRS) as categorical entries from 0 (“A”) to 10 (“K”) in both of the aforementioned cases: (a) maximum pain during motion/flexing prior to the pain visit, and (b) pain at rest at the time of the pain visit between 8 am and 2 pm on postoperative Day 1.

Table 1. Orthopedic procedures.

Orthopedic procedures Number of Cases
Surgery of peripheral nerves 14
Spine surgery 20
Shoulder surgery 179
Bone surgery upper limb 118
Bone surgery hand 21
Shoulder arthroplasty 20
Surgery elbow 37
Soft tissue surgery upper extremity 10
Femur neck 55
Calf bone surgery 42
Bone surgery foot 20
Hip arthroplasty 37
Knee surgery 315
Knee arthroplasty 32
Ankle surgery 13
Soft tissue surgery calf 37
Metal removal 35
Amputation lower extremity 7
Soft tissue surgery (other) 92
Total 1104

The listing of the orthopedic procedures performed during the study period (March 2018–December 2019). The number of orthopedic procedures is larger than the number of patients, because some patients had more than one orthopedic procedure.

Table 3. Analgesics and their distribution in clusters.

Analgesic Abbreviation Number of patients with administered analgesic
Piritramide Pir 21
Hydromorphone Hyd 547
Tramadol Tra 17
Dexibuprofen Dex 6
Diclofenac-Orphenadrine DiO 396
Metamizole Met 647
Diclofenac Dic 264
Paracetamol (Acetaminophen) Par 694
Cluster Number of Patients Number of Registrations Number of Cocktails
1 49 31 2
2 449 241 20
3 54 34 5
4 38 37 21
5 128 88 13
6 32 21 1
Cluster Cocktail Number of Patients Fraction in Cluster (%) Fraction Overall (%)
1 Met-DiO-Hyd 39 80 5
2 Met-Par 40 9 5
Hyd-Met-Par 88 20 12
DiO-Met-Par 39 9 5
Hyd-DiO-Met-Par 164 37 22
3 Hyd-Dic-Par 49 91 7
4 various (22) 38 - 5.1
5 Met-Dic-Par 47 37 6
Hyd-Met-Dic-Par 42 33 6
6 Dic-Par 32 100 4

Top panel: A listing of all eight analgesics administered at least once to at least one patient. Because several patients received cocktails of more than one analgesic, the right column total exceeds 750, the number of patients. Central panel: The distribution of the 750 patients, 452 registrations, and 61 cocktails in the six clusters obtained by dimension-reducing the feature vectors onto a 2-dimensional manifold using an autoencoder and clustering the registrations using the DBSCAN algorithm. The cocktails are graphed as 241 points in Fig 2. Lower panel: The most occurring cocktails (i.e. administered to above 4% of the 750 patients), as distributed by cluster. None of these cocktails consists of a single analgesic. Cluster #4 consists of 22 cocktails, but none have a fraction above 1%. Only Cluster #1 has a cocktail without Par. Cluster #2 always has Met and Par in its most-occurring cocktails. Cluster #5 always has Met-Dic-Par triple in its most-occurring cocktails. The cocktail Dic-Par forms its own cluster.

If the ages of patients are normally distributed, then ‘age’ would be a confounding variable; we must test this possibility. The ages of the patients were calculated to the nearest day using a Gregorian calendar algorithm that outputs the number of days between the date of birth and the date of the operation (this method avoids statistical uncertainties due to rounding errors that occur when ages are given in years). Conventional descriptors and point estimators are listed in Table 2. The ages were converted to fractions of years and then an AI algorithm, KDE (kernel density estimation) [13], was used to find the likelihood distribution (pdf) of the ages. Mode (age at maximum likelihood) and expectation value (E=01xpdf(x)dx) of this distribution were calculated, as well as the uncertainty interval HDI95% (highest density interval at 95% confidence [20]; further details in Glossary). This interval is defined as having endpoints with equal likelihood and 95% probability of age; it is the uncertainty measure that is necessary when the distribution is not a parametric one [20]. The resulting pdf shows that ages of patients are very close to being uniformly distributed, so age need not be considered a confounding variable.

Table 2. Patients’ age.

Descriptor Age (years)
Range 7.9–97.8
Mode 52.1
Expectation Ε 47.4
HDI95% 14.5–81.0
Arithmetic mean 47.3

The descriptors of the ages of the patients. Ages (in days) were calculated as the difference between date of birth and date of operation/surgery, using a Gregorian calendar algorithm and then converted to years. The distribution of ages has been estimated using kernel density estimation (KDE) and is far from normal; indeed, it is far from any parametric (continuous) distribution. We note that (1) the mode and the expectation value are far apart, indicating that the age distribution is not symmetric; (2) the arithmetic mean is not a good estimator of the expectation value, despite 750 data points (3) the confidence interval HDI95% (details in the Glossary and in reference [20]) shows that at 95% confidence, very few ages are not included in the KDE distribution.

We use one-hot encoding [13] to convert the categorical variables (both pain levels and identifiers of analgesics) to feature vectors. Converting pain levels encoded as ordinal numbers to cardinal numbers does not lead to proper statistical analyses [17]. (Ordinal numbers are used as indices. Thus, the intervals between ordinal pain levels are not numerically defined. “It should be pointed out that numbers may be arbitrarily associated with each category, but this fact in no way justifies the use of the usual arithmetic operations on these numbers.” [17]) For example: if a patient registers pain levels “H”, and “B” at the two times specified above, then the pain level vectors are (0,0,0,0,0,0,0,1,0,0,0)T, and (0,1,0,0,0,0,0,0,0,0,0)T respectively. For each analgesic, the encoding vector is either (1,0)T (if not administered) or (0,1)T (if administered). In the analysis presented in this paper, pain level shifts from the upper extreme (maximum directly after operation during movement) to the lower extreme (minimum at visit while at rest), may depend on which cocktails were administered. The (categorical) registration vectors for each analgesic and for each pain level are individually orthonormal, ensuring independency and ensuring no pre-defined metric. For each patient, the feature vector resulting from concatenation of the registration vectors has dimension 2×8+11+11 = 38. Because the 38-dimensional feature vectors of the 750 patients are not orthogonal, interdependencies exist. We find these by using an unsupervised artificial intelligence algorithm involving a neural network [13, 14]; more specifically, we use an autoencoder with seven layers in order to detect the registrations of each patient on a 2-dimensional manifold. We then apply the DBSCAN clustering algorithm [16] to find clustering patterns in the outcomes. Finally, we investigate how registrations are distributed within these clusters.

Because there is an inherent uncertainty as to whether an administered cocktail is effective, we need a Bayesian approach to determine not only this uncertainty, but also the ML probability, which is the mode of the probability (in Bayesian statistics, probability is a random variable) that a shift to lower pain levels is to be expected. The maximum likelihood of shifts to lower pain levels is determined by first inventorying the number of decreases (n1) and the number of increases or zero shift (n2) for each analgesic cocktail and then calculating the mode of the Beta function Bε(n1+1, n2+1). The mode informs us of the ML probability of finding a shift to lower pains levels. The uncertainty of the mode—the HDI95% interval [20]—is determined by the area under the likelihood function that has the same likelihoods at the interval ends and area = 0.95. If the HDI95% interval includes s=12, then the shifts to lower pain levels for the specified cocktail are not significant at a 95% confidence interval.

Results

The number of possible cocktails for 8 analgesics is {82}=127, where {nk} denotes a Stirling number of the second kind [21]. Of these 127 possible cocktails, only 61 were administered (Table 2). A list of all 61 cocktails (including the inventories of their pain level shifts) is too large for inclusion in this manuscript.

At visit without movement, only the pain levels A–J were communicated by the patients. We observed that the 2-dimensional registrations cluster in only six clusters (Fig 2). These six clusters are characterized by specific cocktails (Fig 3 shows a part of the cocktail spectra in Cluster #2) that have some analgesics in common. Not all medications occurred in each cluster, and no cocktail occurred in more than one cluster. We also observed that rarely occurring cocktails (i.e. cocktails administered to at most 4 patients) occurred predominantly in only one cluster (Cluster #4; Table 3); indeed, this one cluster contained only rarely occurring cocktails. Table 3 also lists the distribution of the most frequently occurring cocktails occurring in Clusters #1–#3 and #5–#6.

Fig 2. The 452 registrations of the 750 feature vectors after dimension reduction using the AI algorithm autoencoder, the 6 clusters obtained with the DBSCAN clustering algorithm are color-coded.

Fig 2

Not all clusters are localized (there are points of Cluster #4 above and below the other clusters). Some points have a high multiplicity (Table 2); therefore, some cluster members may be rendered by one point, which may be the registrations of many patients. The x- and y-coordinates are for calculation and statistical analysis purposes only; they have no interpretable, holistic meaning.

Fig 3. A selection of pain distributions reported by patients in Cluster #2.

Fig 3

For each cocktail there are two columns. In each column, the number of patients registering their pain levels (left: motionless during visit, right: maximum while flexing shortly after operation) are written in squares with color-coded borders (red: lowest; purple: highest). The border color encodes the fraction of pain registrations for the administered cocktail. For example, 36 patients registered pain level “H” (ordinal number “7”) after operation when administered the Par-Met-DiO-Hyd cocktail. At visit, the minimum pain was pain level “C” (ordinal number “2”) for 46 patients. The color coding shows the dramatic decrease in pain levels for the cocktails Par-Met-Hyd and Par-Met-DiO-Hyd (roughly “H”→“B” for both these cocktails).

Every cocktail in every cluster showed a decrease in pain levels, albeit of different magnitude for different cocktails and with differing frequencies. In each cluster, only one or two cocktails were administered most frequently (not shown).

Discussion

In our investigation we could show the efficacy of different combinations of postoperative pain medications. A combination of 4 drugs revealed to be the most effective. It consisted of Hydromorphone, Metamizole, Paracetamol and Diclofenac/Orphendrine. We observed that the cocktail Hyd-DiO-Met-Par outperforms the others, although Met-Dic-Par is a close contender. Hyd-DiO-Met-Par has the highest probability (0.981) of effectively decreasing the pain levels, with a mode of 34 shifts at 4 pain levels downward. The fraction of patients that report an increase in pain level shifts is small (1.8%), much lower than all the others, except for Met-Dic-Par. We observe that DiO-Met-Par also exhibits a very high performance, comparable to Hyd-DiO-Met-Par; the former lacks Hyd. We conclude that the statistical analysis infers that adding Hyd to the cocktail DiO-Met-Par will increase its performance, albeit not very much. This outcome can be explained by the strength of Hydromorphone, the only opioid in this cocktail. In former studies combinations of analgesics have already been proven to be effective [611]. Only the number of drugs in combination has been much lower than in our study. The maximum number was 3, whereas in our investigation we studied a total of 8 different prescriptions.

Analyzing the effects of various cocktails on pain level decrease or increase (if observed) is a multivariate problem. Furthermore, because the random variables pain level and cocktail label are categorical, parametric distributions of continuous random variables are impossible—therefore point estimators, such as means and standard deviations, are undefined. If we were to compare the distributions of the 11 pain levels for each of the 61 cocktails (within each cocktail, the pain level distribution is a Dirichlet distribution), we would have to pore over 61 multivariate distributions, few of which have the same number of random variables. The output would have to be in a stacked/layered table form; and, unfortunately, we humans cannot envision pdfs of distributions in more than 3D. The exercise of poring over 61 Dirichlet distributions is not only very tiring, but also error-prone. Consequently, we let a neural network analyze the data for us, as it is intelligent and far superior to human analysis skills for the sheer number of possible outcomes. In the AI approach we implement, namely using an (unsupervised) autoencoder and the DBSCAN clustering algorithm, we discover clusters, pain shifts within each cluster, and the distributions of the administered cocktails—all “in one go.”

The feature vectors of patients have internal dependencies, which the autoencoder discovered (and we could not). We do not classify outcomes (how the pain level shifts related to cocktails administered) by training the neural network on a training set of known outcomes; this latter approach would be supervised learning. On the contrary, we did not know any of the outcomes beforehand; they were all discovered by the neural network. Furthermore, we used the (highly effective) clustering algorithm DBSCAN, which finds clusters (and how many) in an unsupervised manner. We find that the combination of the autoencoder and the DBSCAN algorithm clustered cocktails together with common analgesics as ingredients in cocktail clusters. This is very surprising result was not foreseen, but discovered by the statistical analysis.

Cocktails with certain combinations of analgesics cluster. The (perhaps surprising) insight: in all clusters (except Cluster #4, which contains the quasi-noise signal), the cocktails with a strong signal consist of a base combination of a few of the eight analgesics plus perhaps one or some other further one. We therefore address the issue of whether the addition of an analgesic to the base combination is (medically) indeed necessary. For example, in Cluster #2, a base cocktail is Hyd-Met-Par, and another cocktail in the same cluster contains Hyd-DiO-Met-Par. We therefore ask whether this addition of DiO to the cocktail is medically necessary. The cocktail Hyd-DiO-Met-Par is not more effective than Hyd-Met-Par (in a statistical sense): the pain shift (decrease) is statistically just as large. We note that discovering this particular cocktail pair (and the attendant comparability of pain level shifts) is impossible without the implementation of neural networks.

Clinicians might expect this phenomenon (presumably the reason why some in this hospital administered cocktails). The concept of combining non-opioids with opioids in the application of multimodal postoperative pain-therapy is thus confirmed by our analysis [4, 10]. When comparing different high-performing cocktails, we need to consider four parameters together (thus the evaluation is a four-dimensional problem): (1) the mode of the probability of effectiveness, (2) the HDI95% uncertainty, (3) the fraction of patients that experience an increase in pain level shifts, and (4) the mode of the pain level shifts. Given the combinations of these four parameters, the cocktail Hyd-DiO-Met-Par outperforms all others.

We had no control over which cocktails were administered; this study is not a controlled trial because it included a large number of different surgical procedures in a hetrogenious patient-sample avoiding the use of a conventional study protocol (this study allows neural networks to show their full analytic strength, thereby possibly avoiding placebo-type trials). Trained neural networks produce output by finding non-linear weightings of many inputs; thus avoiding fragmentation of studies that include fragmentation due to many confounding factors and the curse of dimensionality. In the hospital, certain cocktails are preferred by some clinicians, while others have other preferences. The number of different cocktails is larger than the number of clinicians administering these, so we cannot uniquely map cocktails with clinicians (nor would the Ethics Committee allow us to do so). Again: unsupervised neural networks that dimension-reduce the data and clusters outputted by DBSCAN shows the power of our approach over controlled studies involving one or two (rarely three) cocktails and perhaps a placebo group. The data set containing a large number (61) of different cocktails ensures that our analysis outcome is not skewed due to the lack of some cocktails not being administered. In fact, of the 127 possible cocktails, most cocktails not administered were rare pairs (21 pairs—~34%—of 61 cocktails were in Cluster #4). We also note that 61 of 127−8 = 115 cocktails were administered (far better than 6111554%, because no cocktails with more than four analgesics were administered), so we argue that cocktail diversity and effectiveness was more than reasonably monitored.

Pain medications in our study were not fixed in the study protocol; this would be a limitation when data is analyzed with frequency tables. Although the study-sample size was large, some effects of cocktails could perhaps not be discovered as their signal could have been below the noise level in the analysis of this data set. This would only be a limitation if one were to assume that every small effect has an explanation—but noise effects do not. Given the power of neural networks of detecting small effects, the hypothesis that what we observed as noise is actually an effect that cannot be detected due to small sample size must be considered a far-fetched speculation. Because no clinicians in this hospital administered cocktails with more than four analgesics, a limitation in our conclusion might be the implication that cocktails with more than four analgesics can be more effective—an objection we also consider borderline, because of the extremely high efficacy of many of the cocktails with three or four analgesics (Table 4).

Table 4. Pain level shift and analgesic cocktails.

Cluster Cocktail mode shift HDI95% % Pain Level Shift Distributions
−4Δ −3Δ −2Δ −1Δ +1Δ +2Δ +3Δ +4Δ +5Δ +6Δ +7Δ +8Δ +9Δ +10Δ
1 Met-DiO-Hyd 0.973 0.881–0.999 2.6 1 2 2 4 5 12 8 3 2
2 Met-Par 0.994 0.836–0.991 5.0 1 1 4 6 8 4 7 4 3 2
Hyd-Met-Par 0.965 0.910–0.991 3.4 1 1 1 3 9 10 19 22 8 3 6 4 1
DiO-Met-Par 1.000 0.926–1.000 0 1 2 6 9 12 4 3 2
Hyd-DiO-Met-Par 0.981 0.950–0.995 1.8 1 1 1 7 17 11 21 34 24 26 11 7 2 1
3 Hyd-Dic-Par 0.933 0.835–0.983 6.1 1 1 1 4 3 6 13 8 7 2 2 1
4 various - - -
5 Met-Dic-Par 0.977 0.898–0.999 2.1 1 3 7 6 7 10 7 2 1 1 2
Hyd-Met-Dic-Par 0.976 0.894–0.999 2.4 1 4 5 8 6 4 8 4 2
6 Dic-Par 0.933 0.807–0.989 6.2 2 2 4 4 7 4 5 2 1 1

Likelihoods of decrease in pain level shifts (Δ) and their distributions, categorized by clusters. The shifts are not numerical values, because the pain levels are categorical variables. The column labelled modeshift lists the ML probability of observing a pain level shift that is not an increase in reported pain levels; the column labelled HDI95% shows the uncertainty interval of this ML probability (details in the Methods section). We observe that all ML probabilities are very close to 1.00…, so we conclude that the cocktails listed here are very effective. % is the fraction of patients for this cocktail that reported an increase in pain levels between maximum at motion and minimum at visit despite being administered the cocktail listed in this row. The numbers are the number of patients reporting the pain level shift specified in the rectangle. We note that a few patients report an increase in pain levels (negative pain level shifts), and several no pain level shift.

Conclusion

We analyzed the effectiveness of 61 analgesic cocktails administered to 750 patients undergoing many different orthopedic surgical procedures using several unsupervised artificial intelligence algorithms. The cocktails were mixtures of two to four analgesics and we found that the three most effective cocktails were (from highest to lowest): (a) Hyd-DiO-Met-Par, (b) Met-Dic-Par, and (c) DiO-Met-Par. For the clinician (but not for the patient), medication/cocktail choice is a four-dimensional challenge: (1) The ML probability (the mode) of lowering pain levels; (2) The uncertainty (the CI) of the ML probability of pain level shift to lower pain levels; (3) The mode of the frequency of patients reporting the large pain level shifts to lower pain levels; (4) The small fraction of patients not experiencing a pain level shift to lower pain levels. For the clinician, the importance of the four criteria listed above are not to be underestimated, nor should any one of them be neglected when making a therapeutic decision. For the patient, on the other hand, the ML probability and its CI is of marginal importance.

We do not supply a prescriptive regimen for all or many clinical situations. We do, however, present a method that shows that many confounders may have no effect when choosing an optimal pain reduction therapy.

Supporting information

S1 Fig. An example of the descriptors of an unsymmetrical distribution.

For ease and clarity of description, we show the pdf (the likelihood function Λ(s)) of a Beta distribution, namely that of a Bayesian likelihood. The maximum likelihood is the mode, and the expectation is Ε. The confidence interval HDI95% is shown via a double-ended arrow. The likelihoods at the ends (s1 and s2) of the confidence interval are equal: Λ(s1) = Λ(s2). The shaded area is 95%.

(TIF)

S1 Data

(XLSX)

S1 File. Glossary.

(DOCX)

Acknowledgments

We thank Ernst Reitbichler and the anesthesia nursing-team at the TZW Lorenz Boehler for their contribution in collecting data and Christopher Lockie, MD for language editing.

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

This scientific work was supported by the Austrian Working Insurance Company (AUVA), Wienerbergstrasse 11, 1100 Wien, Austria.

References

  • 1.Gerbershagen HJ, Pogatzki-Zahn E, Aduckathil S, Peelen LM, Kappen TH, van Wijck JM et al. Procedure-specific Risk Factor Analysis for the Development of Severe Postoperative Pain. Anesthesiology 2014;120:1237–1245. doi: 10.1097/ALN.0000000000000108 [DOI] [PubMed] [Google Scholar]
  • 2.Gerbershagen HJ, Rothaug J, Kalkman CJ, Meissner W. Determination of moderate-to-severe postoperative pain on the numeric rating scale: a cut-off point analysis applying four different methods. Br J Anaesth 2011;107:619–26. doi: 10.1093/bja/aer195 [DOI] [PubMed] [Google Scholar]
  • 3.Schwenkglenks M, Gerbershagen HJ, Taylor RS, Pogatzki-Zahn E, Komann M,Rothaug J et al. Correlates of satisfaction with pain treatment in the acute postoperative period: Results from the international PAIN OUT registry. Pain 2014;155:1401–1411. doi: 10.1016/j.pain.2014.04.021 [DOI] [PubMed] [Google Scholar]
  • 4.Chou R, Gordon DB, de Leon-Casasola OA, Rosenberg JM, Bickler S, Brennan T et al. Management of Postoperative Pain: A Clinical Practice Guideline From the American Pain Society, the American Society of Regional Anesthesia and Pain Medicine, and the American Society of Anesthesiologists’ Committee on Regional Anesthesia, Executive Commi. J Pain 2016;17:131–157. doi: 10.1016/j.jpain.2015.12.008 [DOI] [PubMed] [Google Scholar]
  • 5.Toma O, Persoons B, Pogatzki‐Zahn E, Van de Velde M, Joshi GP, Schug S, et al. PROSPECT guideline for rotator cuff repair surgery: systematic review and procedure‐specific postoperative pain management recommendations. Anaesthesia 2019;74:1320–1331. doi: 10.1111/anae.14796 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Bailey E, Worthington H V, van Wijk A, Yates JM, Coulthard P, Afzal Z. Ibuprofen and/or paracetamol (acetaminophen) for pain relief after surgical removal of lower wisdom teeth. Cochrane Database Syst Rev 2013. doi: 10.1002/14651858.CD004624.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Derry CJ, Derry S, Moore RA. Single dose oral ibuprofen plus paracetamol (acetaminophen) for acute postoperative pain. Cochrane Database Syst Rev 2013. doi: 10.1002/14651858.CD010210.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Herring BO, Ader S, Maldonado A, Hawkins C, Kearson M, Camejo M. Impact of intravenous acetaminophen on reducing opioid use after hysterectomy. Pharmacotherapy 2014;34 Suppl 1:27S–33S. doi: 10.1002/phar.1513 [DOI] [PubMed] [Google Scholar]
  • 9.Litkowski LJ, Christensen SE, Adamson DN, Van Dyke T, Han S-H, Newman KB. Analgesic efficacy and tolerability of oxycodone 5 mg/ibuprofen 400 mg compared with those of oxycodone 5 mg/acetaminophen 325 mg and hydrocodone 7.5 mg/acetaminophen 500 mg in patients with moderate to severe postoperative pain: a randomized, double-blin. Clin Ther 2005;27:418–29. doi: 10.1016/j.clinthera.2005.04.010 [DOI] [PubMed] [Google Scholar]
  • 10.Moore RA, Derry CJ, Derry S, Straube S, McQuay HJ. A conservative method of testing whether combination analgesics produce additive or synergistic effects using evidence from acute pain and migraine. Eur J Pain 2012;16:585–591. doi: 10.1016/j.ejpain.2011.08.009 [DOI] [PubMed] [Google Scholar]
  • 11.Moore RA, Gay-Escoda C, Figueiredo R et al. Dexketoprofen/Tramadol: randomized double-blind trial and confirmation of empirical theory of combination analgesics in acute pain. The Journal of Headache and Pain 2015;16:60–73. doi: 10.1186/s10194-015-0541-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Hashimoto DA, Witkowski E, Gao L, Meireles O, Rosman G Artificial Intelligence in Anesthesiology: Current Techniques, Clinical Applications, and Limitations. Anesthesiology. 2020;132: 379–394. doi: 10.1097/ALN.0000000000002960 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Murphy KP. Machine Learning—A Probabilistic Perspective. MIT Press; 2012. [Google Scholar]
  • 14.Strang G. (2019) Linear Algebra and Learning from Data. Wellesley-Cambridge Press, Wellesley, MA, USA. 432 p. [Google Scholar]
  • 15.Tighe PJ, Harle CA, Hurley RH, Aytug H, Boezaart AP, Fillingim RB. Teaching a Machine to Feel Postoperative Pain: Combining High-Dimensional Clinical Data with Machine Learning Algorithms to Forecast Acute Postoperative Pain. Pain Medicine 2015;16: 1386–1401. doi: 10.1111/pme.12713 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Ester M,Kriegel HP, Sander J, Xu X. A density-based algorithm for discovering clusters in large spatial databases with noise. KDD-96 Proceedings.1996. pp. 226–231. [Google Scholar]
  • 17.Bablock H. Jr. (1960) Social Statistics. McGraw-Hill Book Company Inc., New York, N.Y., USA. [Google Scholar]
  • 18.Bellman R.E. (1961) Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton, NJ, USA. [Google Scholar]
  • 19.Sun L., Ji S., Ye J. (2014) Multi-Label Dimensionality Reduction. Taylor & Francis, CRC Press, Boca Raton, FL, USA. [Google Scholar]
  • 20.Kruschke JK. Doing Bayesian data analysis: A tutorial with R, JAGS, and Stan, second edition. 2014 p. [Google Scholar]
  • 21.Weisstein Eric W. "Stirling Number of the Second Kind." From MathWorld—A Wolfram Web Resource. https://mathworld.wolfram.com/StirlingNumberoftheSecondKind.html (accessed June, 1st 2021). https://mathworld.wolfram.com/StirlingNumberoftheSecondKind.html (accessed June, 1st 2021). [Google Scholar]

Decision Letter 0

Gennady S Cymbalyuk

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

4 Feb 2022

PONE-D-21-40117Artificial intelligence algorithms predict the efficacy of analgesic cocktails prescribed after orthopedic surgeryPLOS ONE

Dear Dr. Fritsch,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please, revise methods section to clarify clinical variables  and discussion to contextualize the clinical limitations of this paper as requested by the reviewer 1. 

Specific comments:

1. line 21 consider "potential" instead of "claimed" - efficacious synergy has been established.

2. line 46 - be specific about certain aspects of orthopaedic surgery - particularly the interest in "outpatient" total joints in the US, extremity trauma, and shoulder surgery (e.g. rotator cuff repair) are the most painful orthopedic surgeries. This is where pain control is most needed.

3. line 50 - This sentence requires a little more explanation. What specific efficacy are you speaking about?

4. line 57 - It would be useful to in 1 or 2 sentences explain why conventional logistic regression cannot answer this question. Those unfamiliar with ML will not understand this.

5. line 59 - the first part of this sentence is confusing. Specifically the part "to learning algorithms labelled AI (artificial intelligence); the latter". You could get rid of that and the sentence is less confusing to read for the novice. ML really comes in 3 types - supervised, unsupervised, and reinforcement learning. In general lines 59-67 don't add much to this introduction. When you talk about unsupervised neural networks it isn't clear how the "output mimics the input". For example supervised ML is more task driven problems, unsupervised is more data driven type problems. Can you give an example of how the output mimics the input.

6. line 68 - "We elaborate:" isn't common phrasing.

7. lines 70-73 - A figure or two would make this much easier to understand. If the goal of the paper is to help the clinician understand and appreciate (and believe) what ML can do for clinical medicine they will not understand this or likely take the time to try and understand it.

8. line 87 what is the "crossed" anterior ligament. Please, provide a table with the exact number of patients getting specific procedures. Because not all of these surgeries are equally as painful and pain cocktails used in spine surgery will inherently differ from those used in TJA. So this is potentially confounding.

9. was this data collected retrospectively or prospectively or a retrospective analysis of a prospective database?

10. Any study of pain medicine and the efficacy should include any preoperative narcotic or controlled substance use as this can have major effects on postoperative pain medicine utilization. Was there any attempt to quantify or control this?

11. Line 102 its about 50/50 general to regional anesthesia. Its important to note if the is neuroaxial (spinal/epidural), or peripheral nerve blocks like femoral nerve or saphenous nerve or iPACK for TKA. This is critical information along with the drugs that were used in the blocks. They all have different onset and duration times which will affect the utilization and efficacy of the scheduled pain meds and will differ between surgeries, surgeons, and anesthesiologists.

12. line 105 - please clarify points "a" what is "maximum flexing" - this sounds painful.

13. Were NRS only collected until 2pm on POD 1?

14. Table 1 - what is HDI 95%?.. Why is there so much descriptive detail about the patients' ages. Age is but just one variable in an orthopaedic study.

15. Line 195 - this just drops off, its an incomplete sentence.

16. line 235 -. Generally summarize what you found in 1 paragraph, 2nd paragraph how is it the same with what is in the literature, 3rd paragraph how is it different than what is in the literature, 4th - what other interesting variables that you found that have never been looked at before, 5th limitations, 6th conclusion.

17. Please, clarify the purpose and the implications of the autoencoder part of the analysis. Does the resultant two-dimensional representation of the input data contain any generalized knowledge or does it just directly encode the input? The encoding accuracy, e.g. the measured by the variance explained, is also not reported. It is therefore not unlikely that the clusters encode the most abundant combinations of analgesics in cocktails whereas the X and Y coordinates in the clusters encode the pre-and post-analgesia pain levels, which may be correlated. This can be tested via encoding the analgesics cocktail components without corresponding pain levels and seeing whether the five clusters are formed again. Third, there seem to be no conclusions derived from the obtained clusters. What would belonging to a certain cluster mean except for a high overlap in the list of the cocktail’s components? One way to use this embedding is to predict the pain reduction efficacy and significance for the cocktails not involved in the study via training another network on the two-dimensional embedding of the inputs. Finally, no argument is presented as to why autoencoder was used instead of simpler yet more interpretable alternatives such as CMDS, MDS, or Isomap.

Minor comments:

Please change “ML statistics” to “statistics”, and “AI” to “ML”.

Explain the choice of parameters for DBSCAN. For example, it seems reasonable to split cluster #2 into two clusters and to merge clusters #5 and #6 into one cluster.

Captions for Fig.1 and Fig. 2 appear swapped.

Contrary to the claim in the paper, cocktail choices are not a random (as in: i.i.d.) variable.

Please explain why the abundance of common ingredients in the same clusters deems surprising.

Please submit your revised manuscript by Mar 19 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Gennady S. Cymbalyuk, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. You indicated that you had ethical approval for your study. In your Methods section, please ensure you have also stated whether you obtained consent from parents or guardians of the minors included in the study or whether the research ethics committee or IRB specifically waived the need for their consent.

4. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

5. Thank you for stating the following in the Competing Interests section: 

[The authors received financial support by the AUVA (Austrian working injury insurance company)]. 

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. 

Please respond by return email with your amended Competing Interests Statement and we will change the online submission form on your behalf.

6. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

7. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

[We thank Ernst Reitbichler and the anesthesia nursing-team at the TZW Lorenz Boehler for their contribution in collecting data and Christopher Lockie, MD for language editing. The authors declare they have no conflicts of interest.

This study was enabled by financial support of the AUVA medical head office.]

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

 [GF recieved financial support by the AUVA (Austrian general working injury insurance company); the AUVA was not involved in any step of the generation of this scientific work;]

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I congratulate the authors on what appears to be a technically heavy use of ML in an orthopaedic patient population. I am primarily a clinician (orthopedist) who has written about AI/ML but am by no means an expert. Any critiques I make regarding the TECHNOLOGY aspects of AI/ML are coming from someone with an intermediate fund of knowledge with the novice reader in mind.

I agree with the authors final statement that "For the patient, on the other hand, the ML

probability and its CI is of marginal importance". In other words, I don't know how this will change clinical practice - this is not a clinically impactful paper. But that may not be the authors' intent and shouldn't necessarily take away from what they did. This paper certainly had a feel of "here's how you COULD use ML to try and solve a clinical problem" as if it were written by somebody getting an advanced degree in AI/ML and this is their capstone project. And if that was the authors intention then I think there may be strength to publishing this paper. Because it is difficult for me to really ascertain the clinical impact of what was done here based on the clinical weaknesses. This very well could be a groundbreaking approach to analyzing a complex medical/pharmaceutical problem with ML but I have no way of knowing that.

There are many clinical variables to consider and are unanswered in the methods section. 1. many of these drugs I am not familiar with as they are not available in the US where I practice so I am uncertain of their efficacy. I recently sat on the American Association of Orthopaedic Surgeons CPG for "Pharmacologic, Physical, and Cognitive Pain Alleviation for Musculoskeletal Extremity/Pelvis Surgery" available at https://www.aaos.org/globalassets/quality-and-practice-resources/dod/painalleviationcpg.pdf. I had to look them up the drugs the authors listed that are unavailable in the US include Metamizole (NSAID), Dexibuprofen (NSAID), Piritramide (opioid). Furthermore it would appear that some patients received more than one type of opioid and/or NSAID - it is not common for patients in the US to receive more than one dose of 2 different types of NSAIDs - they may get celecoxib preoperatively and toradol postoperatively in the first 24 hours but I can't tell what was done here. 2. NSAIDs are the backbone of any multimodal pain pathway for orthopaedic surgery. I'm not aware that any one type of NSAID is superior to another NSAID. Infact in the AAOS CPG only Cox-2 inhibitors had enough high quality evidence to even qualify for inclusion in our review. 3. Probably most importantly the primary outcome (pain NRS) is becoming less emphasized in the US. We are fast tracking many orthopaedic surgeries (especially TJA) to discharge in less than 24 hours. I can't remember the last time I asked a patient to put a pain number on the knee or hip that I just effectively split or stretched tendons, sawed the bone, and jammed metal into. Our attitudes regarding pain have changed from "the fifth vital sign" with the recent US opioid epidemic. I think we have a pain control (pain expectation) problem in the US and shouldn't be emphasizing pain scores. MUCH more useful metrics include morphine equivalent dosing (MED), time to ambulation, distance ambulation, time to discharge, rescue pain medication use, etc. and must be taken at time points beyond the first 23 hours. Additionally a pain regimes ability to reduce NRS is only as important as its ability to avoid nausea/vomiting (opioid side effect), GI complications beyond N/V (gastric bleeding), decreased renal function (NSAID side effect), ability to use NSAIDs in cardiac, GI, renal patients, sedation, delirium, etc. Sedated and over-narcotized patients frequently will report less pain right before they have a hypoxic event.

I think the authors really need to re-frame this paper with the extreme clinical limitations in mind - this is not a clinical paper. I would frame this paper in the introduction as "here's how you could solve a complex medical challenge with ML", because it doesn't answer the question. But you would need to give a better explanation as THAT being the reason for performing this study and be honest up front that in no way is ML going to answer the question of "which of the 61 pain cocktails is most efficacious in 750 variable orthopaedic patients". And its possible that's what you did do but it was a technically difficult paper to read and not for the clinical orthopedist and you need to contextualize the clinical limitations of this paper.

Specific comments:

1. line 21 consider "potential" instead of "claimed" - efficacious synergy has been established.

2. line 46 - I would be specific about certain aspects of orthopaedic surgery - particularly the interest in "outpatient" total joints in the US, extremity trauma, and shoulder surgery (e.g. rotator cuff repair) are the most painful orthopedic surgeries. This is where pain control is most needed.

3. line 50 - I'm thinking in very clinically practical terms. I feel like this sentence requires a little more explanation. In the US we are frequently using toradol, oxycontin, NSAIDS, tylenol, etc. all together and we know that using them together is better than using any one of these drugs. What specific efficacy are you speaking about? Are you saying to what specific pain score or patient related outcome measure?

4. line 57 - I think it would be useful to in 1 or 2 sentences explain why conventional logistic regression cannot answer this question. Those unfamiliar with ML will not understand this.

5. line 59 - the first part of this sentence is confusing. Specifically the part "to learning algorithms labelled AI (artificial intelligence); the latter". I think you could get rid of that and the sentence is less confusing to read for the novice. ML really comes in 3 types - supervised, unsupervised, and reinforcement learning. In general lines 59-67 don't add much to this introduction. When you talk about unsupervised neural networks it isn't clear how the "output mimics the input". For example supervised ML is more task driven problems, unsupervised is more data driven type problems. Can you give an example of how the output mimics the input.

6. line 68 - "We elaborate:" isn't common phrasing.

7. lines 70-73 - I think a figure or two would make this much easier to understand. If the goal of the paper is to help the clinician understand and appreciate (and believe) what ML can do for clinical medicine they will not understand this or likely take the time to try and understand it. This is a major hurdle we need to overcome in order to bring AI to clinical medicine.

8. line 87 what is the "crossed" anterior ligament. There are 2 bundles in the ACL and 2 bundles in the PCL. The ACL and PCL together are known as the cruciate ligaments. While it is common to have an ACL reconstruction a ACL and PCL reconstruction in the same surgery (outside of a traumatic multi-ligament/knee dislocation) is very rare. Also what defines "complex reconstructive procedures". Are these revision TKAs and THAs or some sort of crushed extremity or other trauma. I think what will be helpful here is a table with the exact number of patients getting whatever procedures. For example TKA n = 68, ACL n = 45, ACL & MCL = 13, spine fusion (note if it was cervical or lumbar at a minimum) n = 45. Because not all of these surgeries are equally as painful and pain cocktails used in spine surgery will inherently differ from those used in TJA. So this is potentially confounding. I don't know how the vast number of cocktails (61) in a relatively small number of patients (750) is going to generate enough sampling for the ML.

9. was this data collected retrospectively or prospectively or a retrospective analysis of a prospective database?

10. Any study of pain medicine and the efficacy should include any preoperative narcotic or controlled substance use as this can have major effects on postoperative pain medicine utilization. Was there any attempt to quantify or control this?

11. Line 102 its about 50/50 general to regional anesthesia. Its important to note if the is neuroaxial (spinal/epidural), or peripheral nerve blocks like femoral nerve or saphenous nerve or iPACK for TKA. This is critical information along with the drugs that were used in the blocks. They all have different onset and duration times which will affect the utilization and efficacy of the scheduled pain meds and will differ between surgeries, surgeons, and anesthesiologists.

12. line 105 - please clarify points "a" what is "maximum flexing" - this sounds painful.

13. Were NRS only collected until 2pm on POD 1?

14. Table 1 - what is HDI 95%?..its clear I don't understand what is going on but why is there so much descriptive detail about the patients' ages. Age is but just one variable in an orthopaedic study.

15. Line 195 - this just drops off, its an incomplete sentence.

16. line 235 - I wouldn't open up the discussion with a question. Generally summarize what you found in 1 paragraph, 2nd paragraph how is it the same with what is in the literature, 3rd paragraph how is it different than what is in the literature, 4th - what other interesting variables that you found that have never been looked at before, 5th limitations, 6th conclusion.

Reviewer #2: In the paper, the authors investigate the highly important question of the efficacy of analgesics cocktails. Whereas their data is of high quality and the statistics on it are correct, the other part of the work which involves the low-dimensional embedding of the data remains inconclusive. I, therefore, recommend a revision. Please find the details below.

In this work, the authors predict the efficacy of various analgesic cocktails in reducing pain levels. To this end, the authors have collected a large-scale dataset of the patients’ reported pain levels before and after the use of analgesia. They used an autoencoder to obtain a two-dimensional embedding of the “cocktail components – pain levels” data points and used DBSCAN to cluster this embedding. The authors then have identified the most efficient cocktails via computing the statistics of whether pain levels were significantly decreased.

The goal of this work is highly important, and so is the collected dataset, as the data and analysis performed here help identify the more efficient analgesia.

The statistical analysis, to my understanding, is correct. The strength of the work is that the authors were able to identify analgesia with the most pronounced and statistically significant effect on reducing pain levels. These results can be readily used in clinical practice.

I am a bit less convinced of the purpose and the implications of the autoencoder part of the analysis. First – unless I am missing something here – it is unrelated to the rest of the analysis. Second, there is no argument presented as to whether the resultant two-dimensional representation of the input data contains any generalized knowledge or just directly encodes the input. The encoding accuracy, e.g. the measured by the variance explained, is also not reported. It is therefore not unlikely that the clusters encode the most abundant combinations of analgesics in cocktails whereas the X and Y coordinates in the clusters encode the pre-and post-analgesia pain levels, which may be correlated. This can be tested via encoding the analgesics cocktail components without corresponding pain levels and seeing whether the five clusters are formed again. Third, there seem to be no conclusions derived from the obtained clusters. What would belonging to a certain cluster mean except for a high overlap in the list of the cocktail’s components? One way to use this embedding is to predict the pain reduction efficacy and significance for the cocktails not involved in the study via training another network on the two-dimensional embedding of the inputs. Finally, no argument is presented as to why autoencoder was used instead of simpler yet more interpretable alternatives such as CMDS, MDS, or Isomap.

Minor comments:

Please change “ML statistics” to “statistics”, and “AI” to “ML”.

Explain the choice of parameters for DBSCAN. For example, it seems reasonable to split cluster #2 into two clusters and to merge clusters #5 and #6 into one cluster.

Captions for Fig.1 and Fig. 2 appear swapped.

Contrary to the claim in the paper, cocktail choices are not a random (as in: i.i.d.) variable.

Please explain why the abundance of common ingredients in the same clusters deems surprising.

Overall, I found the study interesting and relevant. The dataset on the effects of analgesics cocktails and the statistics on this dataset is ready for publication. The embedding part needs more clarity to be conclusive – along the lines mentioned above. I, therefore, recommend a revision.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Thomas Myers, MD, MPT

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Gennady S Cymbalyuk

19 Jul 2022

PONE-D-21-40117R1Artificial intelligence algorithms predict the efficacy of analgesic cocktails prescribed after orthopedic surgeryPLOS ONE

Dear Dr. Fritsch,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please, edit the discussion to emphasize the technical side of the study and mitigate the strong conclusions claiming this manuscript to be a clinically relevant study. Please, acknowledge the limitations listed by the reviewers. Please, edit the statements in lines 350-352. Please, provide your responses with specific line number additions and bolded text so the changes could be easily seen in the manuscript. 

Please submit your revised manuscript by Sep 02 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Gennady S. Cymbalyuk, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I appreciate the effort the authors undertook to produce this manuscript. Its is difficult to tell if my previous comments were incorporated as there isn't a line by line response that I was able to find. I am going to suggest this be required in the future for any reviews to make this process easier for both parties.

I feel that this is a a technically sophisticated study and worth publishing based on the pretense that this is what someone *may* use AI/ML for in orthopaedics. I think it has major inherent weaknesses due to the breath of included orthopaedic surgeries each with their own type of patient population and I would caution the authors in making too strong of conclusions. For example a clinically relevant study would be looking at the combination of pain cocktails and nerve blocks (femoral, saphenous, iPACK, etc.) around only a TKA population. Including pediatric "knee surgery", athletic ACL, TKA, knee fractures is a very different type of study with many different surgeries. We would also need to knw if patients received general vs. neuroaxial blocks (e.g. spinals and how good is the clinician providing the spinal). Furthermore, there was no ability for the authors to control for a number of patient level confounding factors such as previous narcotic use, previous drugs of abuse, fear avoidance behaviors (kinesiophobia s/p surgery), depression/anxiety, fibromylagia, etc. Finally, you have to base your outcomes on more than numerical pain scores. There needs to be some quantification of patient reported outcomes, morphine equivalent doses of rescue med taken, etc.

Therefore, I would frame the discussion in this light and you must acknowledge these limitations. AI/ML is not going to compensate for a strong study design accounting for the the issues that I've previously mentioned - I would strongly disagree with the statements in lines 350-352 if that is what the authors are implying.

Any future edits need to incorporate these suggestions with specific line number additions and bolded text so I can see what has changed in the manuscript. Thanks you for your efforts!

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Thomas Myers, MD, MPT

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Feb 2;18(2):e0280995. doi: 10.1371/journal.pone.0280995.r004

Author response to Decision Letter 1


4 Sep 2022

the answers on the comments of the reviewers are attached in the rebuttal letter attached to the manuscript

Decision Letter 2

Gennady S Cymbalyuk

20 Sep 2022

PONE-D-21-40117R2Artificial intelligence algorithms predict the efficacy of analgesic cocktails prescribed after orthopedic surgeryPLOS ONE

Dear Dr. Fritsch,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Could you address the concerns of the reviewer by accepting that the list of factors requested by the reviewer are important and could be included in future applications?

Please submit your revised manuscript by Nov 04 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Gennady S. Cymbalyuk, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: No

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I read the manuscript starting on page 45 because it was label "revised manuscript with track changes". That being said the only text with red font was in 351 - 356, and another section after this.

I haven't changed my thoughts on this paper since my last set of comments. Overall I feel that this paper speaks to the techniques of machine learning as much as it does sound clinical science. I think this paper's strength and publication worthiness is based on the fact that this is what someone *may* use machine learning for in orthopaedics/anesthesia. It DOES NOT show which pain medications are best to use for any specific (subspecialty) orthopaedic surgery.

I don't think this study answers the clinical questions of what pain regimens are best after orthopedic surgery. I have copy and pasted my previous comment below for the editors (in quotations). Thank you for your efforts.

"I feel that this is a a technically sophisticated study and worth publishing based on the pretense that this is what someone *may* use AI/ML for in orthopaedics. I think it has major inherent weaknesses due to the breath of included orthopaedic surgeries each with their own type of patient population and I would caution the authors in making too strong of conclusions. For example a clinically relevant study would be looking at the combination of pain cocktails and nerve blocks (femoral, saphenous, iPACK, etc.) around only a TKA population. Including pediatric "knee surgery", athletic ACL, TKA, knee fractures is a very different type of study with many different surgeries. We would also need to know if patients received general vs. neuroaxial blocks (e.g. spinals and how good is the clinician providing the spinal). Furthermore, there was no ability for the authors to control for a number of patient level confounding factors such as previous narcotic use, previous drugs of abuse, fear avoidance behaviors (kinesiophobia s/p surgery), depression/anxiety, fibromylagia, etc. Finally, you have to base your outcomes on more than numerical pain scores. There needs to be some quantification of patient reported outcomes, morphine equivalent doses of rescue med taken, etc."

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 3

Gennady S Cymbalyuk

13 Jan 2023

Artificial intelligence algorithms predict the efficacy of analgesic cocktails prescribed after orthopedic surgery

PONE-D-21-40117R3

Dear Dr. Fritsch,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Gennady S. Cymbalyuk, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: nothing further to add i would refer to my previous comments. I would leave the publication of this paper up to the editors.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Thomas Myers

**********

Acceptance letter

Gennady S Cymbalyuk

20 Jan 2023

PONE-D-21-40117R3

Artificial intelligence algorithms predict the efficacy of analgesic cocktails prescribed after orthopedic surgery

Dear Dr. Fritsch:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Gennady S. Cymbalyuk

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. An example of the descriptors of an unsymmetrical distribution.

    For ease and clarity of description, we show the pdf (the likelihood function Λ(s)) of a Beta distribution, namely that of a Bayesian likelihood. The maximum likelihood is the mode, and the expectation is Ε. The confidence interval HDI95% is shown via a double-ended arrow. The likelihoods at the ends (s1 and s2) of the confidence interval are equal: Λ(s1) = Λ(s2). The shaded area is 95%.

    (TIF)

    S1 Data

    (XLSX)

    S1 File. Glossary.

    (DOCX)

    Attachment

    Submitted filename: PONE_answers_to_the_reviewers.docx

    Attachment

    Submitted filename: PONE-D-21-40117R3_response_to_reviewers.pdf

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES