Abstract
Pain is a significant public health problem as the number of individuals with a history of pain globally keeps growing. In response, many synergistic research areas have been coming together to address pain-related issues. This work reviews and analyzes a vast body of pain-related literature using the keyword co-occurrence network (KCN) methodology. In this method, a set of KCNs is constructed by treating keywords as nodes and the co-occurrence of keywords as links between the nodes. Since keywords represent the knowledge components of research articles, analysis of KCNs will reveal the knowledge structure and research trends in the literature. This study extracted and analyzed keywords from 264,560 pain-related research articles indexed in IEEE, PubMed, Engineering Village, and Web of Science published between 2002 and 2021. We observed rapid growth in pain literature in the last two decades: the number of articles has grown nearly threefold, and the number of keywords has grown by a factor of 7. We identified emerging and declining research trends in sensors/methods, biomedical, and treatment tracks. We also extracted the most frequently co-occurring keyword pairs and clusters to help researchers recognize the synergies among different pain-related topics.
Author summary
Pain is a public health problem affecting people’s daily lives. Researchers are rapidly expanding pain-related studies across different synergistic fields to understand pain. Literature reviews are crucial to analyzing existing knowledge and advancing the research in an impactful direction. However, a manual review of the vast literature is impossible. Here, we develop a keyword co-occurrence network-based automated literature review method to gain insights from an extensive body of published literature. We found rapid growth in pain literature in the last two decades: the number of articles has grown threefold, and the number of keywords has increased by a factor of seven. We also found that with the availability of large-scale personal datasets, many techniques from machine learning and statistical modeling have been widely applied to pain assessment and management. In addition, chronic pain, pain management, and opioid concepts have been the study research focus over the years. In the last few years, researchers have focused on the quality of life of patients experiencing pain, self-management of pain, and therapy methods. Our study sheds light on the pain literature’s knowledge structure and research trends.
1. Introduction
Pain is an uncomfortable sensory and emotional experience that serves as a symptom of various medical conditions [1–3]. Pain occurs due to multiple causes (e.g., broken bone, strained muscle, or surgery), at different body locations (e.g., back pain, muscle pain, knee pain, or chest pain), and in various forms (e.g., acute pain, chronic pain, or intermittent pain) [4,5]. In the United States, 20.4% of adults have chronic pain, and 7.4% of adults report that their lives are significantly impacted by chronic pain, according to the 2019 National Health Interview Survey [6,7]. Health economists estimated that the annual cost of chronic pain in the USA is around $635 billion, which exceeds the yearly cost due to diabetes ($188 billion), cancer ($243 billion), or heart disease ($309 billion) [8].
Recognizing pain as a public health problem, researchers are rapidly expanding pain-related studies across different synergistic fields. Since 2002, roughly 291,560 pain-related articles have been published in the scientific literature indexed in IEEE, Web of Science, Engineering Village, and PubMed. It is essential to review the literature to assist researchers cognizant of existing knowledge, identify knowledge gaps, advance research in an impactful direction, and generate new knowledge [9]. However, a manual review of the vast amount of literature is complex and time-consuming. A feasible approach is needed to employ an automated literature review process to gain insights from the vast literature. Network methodologies are promising and viable approaches in providing an efficient, high-level, and automatic literature review process to the researchers. The network analysis can reveal hidden patterns and relationships between interconnected and interrelated components of a large-scale complex system [10]. The aim of the network methodology for the literature review process is to extract meaningful information from the underlying literature, provide knowledge maps and structures, and discover research trends using various literature components such as authors, institutes, citations, or keywords [11]. Network-based methods are generally called bibliometric networks. The following are the most studied bibliometric networks: (1) Collaboration Networks, (2) Citation Networks, and (3) Keyword Co-occurrence Networks (KCNs) [12–14]. For the automatic literature review, KCNs are more apt than collaboration and citation networks because KCNs reveal the relations among knowledge elements, the relative importance of knowledge elements, emerging topics, and the evolution of the subject over time [11,14].
This study uses KCNs to review and analyze "pain" literature automatically. It analyzes various network parameters considering centrality, affinity, and cohesiveness among the keywords to provide a knowledge map of pain research. To build KCNs, we extracted keywords from 264,560 articles indexed in IEEE, PubMed, Engineering Village, and Web of Science between 2002 and 2021. By applying text mining techniques, we eliminated irrelevant and redundant keywords. We classified keywords into three tracks: sensors/methods-related keywords (e.g., electromyography, biomarker, machine learning), biomedical-related keywords (e.g., chronic pain, back pain, acute pain), and treatment-related keywords (e.g., surgery, acupuncture, medication) to organize the literature review for easy understanding. To the best of our knowledge, no automated literature review method has been employed to gain insights from the vast amount of pain-related literature.
This paper is organized as follows. The background section explores the pain-related review papers published in the literature. The methods section presents an overview of the KCN-based approach to review and explore an extensive amount of literature. It also describes the data collection and preprocessing tasks employed to build KCNs. The results and discussion section identifies and describes the emerging topics and their implications in pain research. The conclusion section summarizes the findings and limitations of this work and comments on the future direction of this work.
2. Background
This section reviews existing studies on pain-related research from various angles. The existing literature review studies can be categorized in multiple ways. One broad categorization is to group them into the following: (1) pain assessment, (2) pain characterization, and intervention [15].
Pain assessment
The articles have explored automatic pain assessment [16–18]. In current clinical settings, patients typically self-report their pain level using the Verbal Rating Scale (VRS), Visual Analogue Scale (VAS), and Numerical Rating Scale (NRS) [19–21]. These self-reported pain measurements are subjective and often impractical when patients are not in an alert state or unable to communicate their pain level [22,23]. Infants, toddlers, and adults with communication or cognitive deficits may be unable to convey their pain levels verbally [24]. Researchers have explored the physiological signals and behavioral responses for objective pain measurement [1,25–29]. Werner et al. [30] presented a survey of automated pain recognition-related papers indexed in the Web of Science. They emphasized the advancements in non-contact and contact-based automatic pain recognition techniques that use facial expression, voice, physiology, and multimodal information. Lötsch et al. [31] published a review on machine learning in pain research to raise knowledge of the approaches in ongoing and upcoming projects. Wagemakers et al. [32] provided an in-depth analysis of the devices and methods for objectively measuring patients’ pain. Chen et al. [33] reviewed various wearable physiological and behavioral sensors that may help build automated monitoring systems for pain detection in clinical settings. Zamzmi et al. [34,35] reviewed classification tasks, databases, and features for automated pain assessment in infants and provided pain assessment techniques in children considering physiological and behavioral scope.
Pain characterization and intervention
Several researchers have tried to understand the mechanism of pain and develop methods for better treatment of a specific type of pain [36–41]. Koechlin et al. [42] presented a systematic review of the role of emotion regulation in chronic pain. They examined the risk and protective factors contributing to chronic pain management. IsHak et al. [43] examined studies that addressed pain comorbid with depression through a systematic review. They observed that depression and pain are highly related and may worsen physical and psychological symptoms. Shraim et al. [44] performed a comprehensive systematic review in which they synthesized a mechanism-based classification system for pain experienced in the musculoskeletal system. They evaluated methods to distinguish three categories of pain mechanisms: nociceptive, neuropathic, and nociplastic pain [45]. Urits et al. [46] conducted an exhaustive literature review of low back pain and examined the pathophysiology, diagnosing methods, and treatment strategies. Finnerup et al. [47] reviewed the neuropathic pain concept with emphasis on its mechanism and treatments. Caes et al. [15] evaluated articles on pediatric pain research.
This study aims to provide a comprehensive overview of pain research published in the last two decades and to highlight the major findings and trends in the field. Through this process, researchers can acquire a more profound comprehension of the subject matter, pinpoint potential research areas, and determine promising directions for further exploration. We consider that the scientific research publications reflect the emerging trends in pain research, and we employed a KCN-based method to comprehensively analyze thousands of pain-related articles indexed in IEEE, PubMed, Engineering Village, and Web of Science databases. This approach addresses the challenges posed by traditional literature review approaches in terms of time and effort to capture insights from a vast body of literature.
3. Methods
3.1 Overview of the existing methods
In literature, a few studies utilized KCNs to analyze research fields. Lee et al. [48] developed a KCN for “regional innovation systems (RIS)” literature and collected 432 articles to investigate the development of RIS research and future research directions. They used centrality-related network features. Li et al. [49] built a KCN using the complex-network-related keywords extracted from 5,944 articles published between 1990 and 2013 to analyze the trends and relationships between knowledge elements. They evaluated the networks considering the degree, clustering coefficient, and shortest path principles to understand the evolution of the articles.
Radhakrishnan et al. [50] created a novel KCN-based method to help researchers review scientific literature. As a case study, they built KCNs for “nano-related environmental, health, and safety (EHS) risk” literature. They collected keywords from 627 papers published between 2000 and 2013. They used network parameters such as degree, strength, average weight, weighted nearest neighbor’s degree, and clustering coefficient for statistical analysis of KCNs.
Yuan et al. [14] presented a KCN-based analysis of the data science trends in the manufacturing literature. They extracted keywords from a collection of 84,041 articles published between 2000 and 2020. They categorized the keywords according to the nine pillars of Industry 4.0 to understand the emerging topics in this smart manufacturing research.
Weerasekara et al. [51] reviewed the evolution of industry 4.0 for asset life cycle management for sustainability concepts using KCN-based techniques. They extracted keywords from 3,896 articles and analyzed the research trends.
The studies mentioned above share a common objective of assisting researchers in comprehending the trends in specific literature, as well as guiding them in identifying areas of focus and future research directions. In the present work, we adopted these complex network-related metrics from Radhakrishnan et al. [50] to build algorithms for reviewing and analyzing large-scale pain research literature.
3.2. Data Collection and processing procedure
This section discusses the steps of the proposed approach to extract and analyze the keywords, which are the uncontrolled terms specified by the authors of the articles.
Step 1: Select the databases of research articles.
Step 2: Develop an information-extraction procedure to collect the corpus of keywords from the research articles indexed in the selected databases.
Step 3: Convert the corpus into a list of unique words using natural language processing methods.
Step 4: Generate adjacency matrices and weighted adjacency matrices for four-year windows: 2002–2006, 2007–2011, 2012–2016, and 2017–2021.
Step 5: Construct KCNs from the adjacency matrices and weighted adjacency matrices.
Step 6: Review and analysis of pain literature using the KCNs.
Article search
To create the KCNs of pain research articles, we searched for articles that included the term “pain” in the articles’ titles and keywords (corpus) defined by the authors. These articles are quarried from IEEE, Engineering Village, and Web of Science with a scope of 2002 to 2021. The National Center for Biotechnology Information (NCBI) provides the Entrez system, currently covering a variety of biomedical data among 38 databases, including the PubMed database. We wrote a Python code to connect the Entrez system to request and retrieve our targeted data from the PubMed database. This search resulted in a total of 184,174 articles from PubMed. We searched for the articles through manual queries from the other three databases. This resulted in 888, 6622, and 229,758 articles from IEEE, Engineering Village, and Web of Science, respectively. Then all the titles and keywords of these articles were extracted and prepared for the next step.
Article screening
We removed duplicate articles within and across databases. This process eliminated 156,882 articles leaving 264,560 articles for the next stage. The majority of the redundant corpus was between Web of Science and PubMed. Approximately half of the articles from both databases were duplicates.
Text indexing
The corpus of keywords from the articles is unstructured data. We processed this data to bring it into a structured data format through the following procedure (see Fig 1)
Fig 1. The process of data collection, processing, and cleaning by text mining techniques.
Converted all keywords to lowercase to make them case-uniform, e.g., changed “Neuropathic Pain” to “neuropathic pain.”
Extracted individual keywords separated by delimiters such as “:;-/”, e.g., changed “machine learning; SVM” to “machine learning” and “SVM.”
Removed punctuation marks within the keywords: e.g., changed “1,3,4 –Oxadiazole” to “134 –Oxadiazole.”
Tokenized keywords involving multiple words separated by spaces and hyphens, e.g., changed “neuropathic-pain” to “neuropathic” and “pain.”
Extracted stem words by converting every single word into its root using language rules, e.g., extracted “neuropath” from “neuropathic.”
Converted all nouns with plural forms into a singular form, e.g., removed “s,” “es,” or changed “children” to “child.”
Transformed the verbs in the noun form, verbs in the past tense to root words, e.g., changed words ending “ed” and “ing” to their root words.
Changed terms with postfix, “ly,” “est,” “ation,” or “ment” to their root form, e.g., simplified “assessment” to “assess.”
Concatenated back processed words with a blank space between words to form original keywords, e.g., concatenated “neuropath” and “pain” to form “neuropath pain.” This gave us sets of keywords constructed with tokenized and stemmed words.
Dropped all the terms of length one or two letters which, to our knowledge, did not play a crucial part in our analysis.
Adjacency matrix and frequency table
Using the indexed corpus from the procedure described above, we generated a document frequency table, multiple adjacency matrices of co-occurring keywords, and a dictionary including those before and after stemming. For example, we present the top 10 frequently used words before and after stemming in Table 1.
Table 1. The keywords before and after stemming from the latest year window (2017–2021).
| Original Keywords (before stemming) |
Stemmed Keywords (after stemming) |
|---|---|
| painfulness; painful; pains; pained; pain | pain |
| chronic pains; chronic pain | chronic pain |
| low back pains; low back pain | low back pain |
| pain managers; pain management; pain managements | pain manag |
| neuropathic pains; neuropathic pain | neuropath pain |
| opioides; opioid; opioide; opioids | opioid |
| postop pain; postoperative pain | postop pain |
| analgesia | analgesia |
| quality life | qualiti life |
| abdominal pains; abdominal pain | abdomin pain |
3.3 Network
This section outlines the steps involved in creating the KCN. A network is a set of connected entities. In network theory, entities in the graph are named nodes or vertices, and the connections between the entities are called links or edges [52]. We use “edges” and “links” throughout the study interchangeably. This study creates KCNs, which explore the knowledge structure of the body of scientific literature by investigating the relations among keywords in the field [50]. In a KCN, nodes represent the keywords collected from the articles, and the edges represent the co-occurrences between pairs of keywords. An edge connects a pair of nodes (keywords) if the keywords co-occur in an article.
Fig 2 illustrates an example of a KCN. Nodes are the top five frequently used keywords in the pain literature between 2017 and 2021, namely, pain, chronic pain, low back pain, pain management, and neuropathic pain. If a link connects a pair of words, then these keywords co-occur or vice versa. The thickness of the link indicates the number of times the keywords co-occur in the pool of articles: the heavier the link, the higher the co-occurrence counts. For example, pain and chronic pain co-occurred 290 times, but low back pain and neuropathic pain co-occurred only 19 times.
Fig 2. The KCN for the five most frequently used keywords during 2017–2021.
Nodes (entities) are the keywords of the articles, edges (links) are the co-occurrences of pairs of keywords, and the link thickness denotes the number of times the keywords co-occur in the pool of articles.
In this study, the relationship between keywords does not have a direction. A link simply represents that keyword i co-occurs with keyword j. Therefore, a KCN is an undirected network. In addition, it is a weighted network since the connections among nodes have weights assigned to them, which are the number of times the keyword pairs co-occur.
A network can be represented as an adjacency matrix; it is a symmetric matrix with a size of n×n, where n is the number of nodes (i.e., keywords) [52]. In the adjacency matrix, if keywords i and j co-occur in an article, aij = 1, otherwise aij = 0 and the diagonal elements are assigned zero [52]. A KCN network can be treated as a weighted network by adding weights to links; in that case, the adjacency matrix becomes the weighted adjacency matrix, in which wij denotes the weight of the link connecting nodes i and j; in other words, wij indicates the co-occurrence frequency of nodes (keywords) i and j [50]. Since a KCN is undirected, wij = wji.
3.1. Network parameters
This study aims to investigate the KCN considering the nodes’ and edges’ statistical features, centrality, affinity, and cohesiveness.
(1) Degree
A node’s degree is the total number of direct links the node has with the other nodes [53]. It is a centrality metric that measures a node’s importance in a graph [54]. The degree of node i is defined as follows:
| (1) |
where Vi represents the set of nodes connected to node i and aij denotes the element of the adjacency matrix indicating the presence or absence of the connection between node i and node j.
An intuitive inference about the degree is that nodes with more connections are more central to the network. However, in a weighted graph, this is not always the case. In addition to the links, the weights of the links are to be considered.
(2) Strength
A node’s strength is the sum of the weights of all links connected to the node. It indicates the importance of a node considering both degree and weight [55]. The strength of a node i is calculated as follows:
| (2) |
where Vi is the set of nodes connected to node i; wij is the weight of the link between nodes i and j in the weighted adjacency matrix.
(3) Average weight as a function of endpoint degree
The average weight as a function of endpoint degree indicates changes in the frequency of co-occurrence of the edges between pairs of nodes as the product of the degrees of end nodes of edges changes [14,50]. It determines the relative change in the edge weights as the number of edges connected to the end nodes changes [56]. The endpoint degree of an edge between node i and node j is defined as the product of degrees of nodes connected to the edge, i.e., kikj. Let Qij be the set weights of all edges whose endpoint degree is equal to kikj.
where and n is the total number of nodes in the network. The average weight 〈wij〉 is defined as the average of all weights wab ∈ Qij.
| (3) |
where |Qij| is the cardinality of the set. Here is an example of how to implement Eq 3:
Step 1: Find the degree of each node
e.g., k1 = 1, k2 = 60, k3 = 20, k4 = 3
Step 2: Find the weight of each edge
e.g., w12 = 30; w13 = 35; w14 = 40; w23 = 50; w24 = 25; w34 = 100;
Step 3: Find the end degree of each edge eij e.g., k1k2 = 60; k1k3 = 20; k1k4 = 3; k2k3 = 120; k2k4 = 180; k3k4 = 60;
Step 4: Consider a node pair i and j and compute its end degree
e.g., k1k2 = 60
Step 5: Find the weights of all the node-pairs which have the same end degree as kikj(e.g., k1k2)
e.g., k1k2 = 60; w12 = 30;
k3k4 = 60; w34 = 100;
Step 6: Take the average of weights of node-pairs that have the same end degree as kikj (e.g., k1k2)
e.g., <w12>
Step 7: Apply Steps 4–6 for each pair of nodes i and j in the network
The average weight as a function of the endpoint degree explains the nature of the association between nodes of different degrees. If <wij> increases with kikj, links among the keywords with high-degree are more prevalent than the links among the keywords with low-degree. Conversely, if <wij> reduces with kikj, links between the keywords with low-degree are more prevalent than links between the keywords with high-degree.
(4) Average weighted nearest neighbor’s degree as a function of the degree
The average weighted nearest neighbor’s degree as a function of the degree measures the affinity among a node’s direct neighbors. It demonstrates if a node in the network has similar network characteristics as its neighbors regarding degree. An increasing trend in this function implies that nodes with high-degree are prone to bind to other nodes with high-degree, in which case the network has assortative behavior. On the other hand, a decreasing trend shows that nodes with high-degree bind mostly to nodes with low-degree, in which case the network exhibits disassortative behavior [55]. It is calculated as follows:
| (4) |
where si is the node strength, Vi is the set of nodes connected to node i, wij is the weight of the link between node i and j, and kj is the degree of node i.
(5) Weighted clustering coefficient as a function of degree
The weighted clustering coefficient quantifies the local cohesiveness of a node; it characterizes the node’s connection density to its neighbors [50,55]. In the current study, since the network is a weighted graph, the geometric average of the subgraph edge weights is used to define the clustering coefficient [57].
| (5) |
where ki is the degree of node i, Vi is the set of nodes connected to node i, the maximum weight in the network = wij/max(w) normalizes the weights wij [58]. If the multiple nodes have the same degree, then the weighted clustering coefficient corresponding to the degree is averaged over the nodes. In other words, the multiple weighted clustering coefficients corresponding to a degree are averaged. After computing the weighted clustering coefficient using Eq 5, it is plotted as a function of degree.
4. Results and discussion
This section aims to analyze the knowledge components, structure, and research trends in the pain literature, provide a high-level overview and emphasize the potential future focus of the area. We organized the results and discussion into four subsections: (1) Frequently used pain-related keywords, (2) KCN analysis of pain-related literature, (3) Pain research trends, and (4) Association patterns among pain-related keywords.
4.1. Frequently used pain-related keywords
The strength metric (see Eq 2) indicates a keyword’s popularity considering the total count of co-occurrences with other keywords. Using strength, Table 2A illustrates the top 20 keywords ranked by their strength in the 2017–2021 time window. It is evident that in this time window, the researchers concentrated on pain, chronic pain, pain management, low back pain, neuropathic pain, and opioid concepts. Table 2B demonstrates the top 20 frequently co-occurring keyword pairs. In the years 2017 through 2021, researchers were interested in synergistic topics of “pain, opioid,” “pain, analgesia,” “pain, anxiety,” “pain, quality,” and “pain, depression.” Opioid and analgesia ranked positions 1 and 2 when it comes to their association with pain; in addition, opioid and analgesic co-occurred considerably as well. A similar three-way trend is observed among anxiety, depression, and pain.
Table 2. A Top 20 keywords ranked by strength, B The top 20 frequently co-occurring pairs.
| Keyword | Strength | Keyword Pairs | Co-occurrence |
|---|---|---|---|
| pain | 66282 | pain, opioid | 881 |
| chronic pain | 22376 | pain, analgesia | 756 |
| pain management | 13413 | pain, anxiety | 688 |
| low back pain | 13037 | pain, quality life | 681 |
| neuropathic pain | 12768 | pain, depression | 610 |
| opioid | 11354 | pain, osteoarthritis | 544 |
| analgesia | 7508 | depression, anxiety | 532 |
| quality life | 6690 | pain, inflammation | 531 |
| postoperative pain | 6544 | chronic pain, opioid | 498 |
| depression | 6515 | pain, cancer | 442 |
| anxiety | 5863 | pain management, opioid | 426 |
| osteoarthritis | 5158 | chronic pain, pain management | 392 |
| back pain | 4942 | pain, postoperative | 360 |
| inflammation | 4655 | pain, analgesic | 341 |
| abdominal pain | 4484 | pain, fatigue | 335 |
| rehabilitation | 4457 | pain, pain management | 317 |
| neck pain | 4144 | pain, nociceptive | 306 |
| analgesic | 3908 | opioid, analgesic | 292 |
| acute pain | 3749 | chronic pain, pain | 290 |
| systematic review | 3544 | pain, fibromyalgia | 281 |
Fig 3 presents the network of the top 20 keywords ranked by strength. Nodes are keywords, and edges are the co-occurrences of the pairs of keywords. Node size represents its strength; the bigger the size, the higher the strength.
Fig 3. Network of the top 20 keywords ranked by strength during 2017–2021.
Nodes are the keywords; edges are the co-occurrences of the pairs of keywords.
4.2. KCN Analysis of pain-related keywords
The summary of the topological properties of KCNs of four time windows is presented in Table 3 and Figs 4 and 5.
Table 3. Network statistics of KCN for four time periods: 2002–2006, 2007–2011, 2012–2017, and 2017–2021.
The main finding is that pain literature has grown extensively. New concepts and new connections between concepts are introduced to the pain literature.
| Metric | 2002–2006 | 2007–2011 | 2012–2016 | 2017–2021 |
|---|---|---|---|---|
| Number of Articles | 35,876 | 51,613 | 73,560 | 103,511 |
| Number of Nodes (Keywords) | 1,534 | 2,797 | 6,377 | 11,532 |
| Number of Links (Co-occurrences) | 19,927 | 48,518 | 152,808 | 346,266 |
| Average Network Degree | 25.98 | 34.69 | 47.92 | 60.05 |
| Max Degree | 1,259 | 2,187 | 4,871 | 8,407 |
| Average Network Strength | 45.40 | 56.92 | 79.80 | 106.84 |
| Max Strength | 7,706 | 13,607 | 31,918 | 66,282 |
| Average Network Weight | 1.75 | 1.64 | 1.67 | 1.78 |
| Max Weight | 165 | 211 | 393 | 881 |
Fig 4. Number of articles, number of keywords, and number of co-occurrences over the four time windows.
Fig 5. Node degree, node strength, and link weights over the four time windows.
From Fig 4, we see that the number of articles published in 2017–2021 is approximately 3 times the number in 2002–2006. During the same period, the number of unique keywords grew by a factor of 7. These statistics reveal that pain literature has expanded vastly, and new concepts have proliferated considerably in the past 20 years. In addition, the number of edges increased by a factor of 17 within the last two decades, indicating the drastic proliferation of synergies between pain-related topics.
The increasing trends in the average degree and average strength confirm the introduction of new keywords to the pain literature from diverse research fields (see Fig 5). The maximum degree and the maximum strength show that the keyword "pain" has formed strong connections with other keywords in the pain-related literature.
Average network weight is calculated as the sum of the weights of all links in the network divided by the total number of links. This metric remained almost the same over the four time windows. Slight fluctuations in the average weight are due to different growth patterns in the sum of weights and the number of links. On the other hand, maximum weight has a study of growth over time.
Fig 6A and 6B show the boxplots of degree and strength. These distributions indicate the emergence of some specific keywords/topics into prominence over time. The first and the third quartile of the number of associations a keyword formed with other keywords are 16 and 52, with a median of 20. The first and the third quartile of the number of co-occurrences between pairs of keywords are 32 and 72, with a median of 19. Some extreme cases include pain management with 3264 associations with other keywords and 13413 co-occurrences in total in the last year window. A close examination of the changes in the maximum weight reveals that “Pain-Analgesia” is the most frequently co-occurring keyword pair in the first three-time periods, while the “Pain-Opioid” pair dominated the 2017–2021 period.
Fig 6.
The distribution of the KCN A degree, B strength, and C weight.
Fig 6C illustrates the keywords’ weights distribution. The skewed distribution reveals that the cross-fertilization of topics has become extensive in recent years (2017–2021). In addition, many new keywords were introduced to the literature, which were listed only 1 or 2 times and did not form many associations with other keywords. This is the reason why the median of the weight distribution is 1.
The "average weight as a function of endpoint degree" is shown in Fig 7A. It shows an increasing trend with time. The increasing trend for this metric indicates that high-degree keywords are more likely to co-occur with other high-degree keywords. Additional network properties need to be examined in parallel to confirm this conclusion. The high value for kikj (degree of node i times degree of node j) may have resulted from two different possibilities: the multiplication of two high-degree nodes (e.g., kikj = 100*100 = 10,000) or the multiplication of one ultra-high-degree node and one low-degree node (e.g., kikj = 10,000*1 = 10,000). The first case would happen when researchers frequently use the same pair of keywords (e.g., pain and opioid, pain and analgesia). The second case would happen when researchers synergize a trendy topic with an emerging topic (e.g., pain and big data, pain and neural networks). The association between high and low-degree nodes needs to be checked to differentiate between these two cases. Therefore, the "average weighted nearest neighbor’s degree" metric is examined to understand if a node and its neighbors have similar network characteristics in terms of degree.
Fig 7.
A Average weight as a function of endpoint degree, B Average weighted nearest neighbor’s degree as a function of the degree. Both the x-axis and the y-axis are on the logarithmic scale. The primary takeaway is that high-degree nodes have connections with both other high-degree nodes and low-degree nodes since nodes do not have similar network characteristics as their neighbors in terms of degree.
Fig 7B shows the "average weighted nearest neighbor’s degree" vs. "degree." The time windows 2012–2016 and 2017–2021 have a slight rising trend. On the other hand, there is no such upward trend in the time windows 2002–2006 and 2007–2011; the trend is flat, but the average weighted nearest neighbor’s degree fluctuates with the degree. This flat trend suggests the absence of any significant topological relationship between the "average weighted nearest neighbor’s degree" and "degree." These observations contradict the fact that high-degree nodes are more likely to bind to the other high-degree nodes, and low-degree nodes bind to the other low-degree nodes. The reason is that the "average weighted nearest neighbor’s degree" demonstrates that nodes do not have similar network characteristics as their neighbors regarding degree. It indicates that high-degree keywords bind not only with other high-degree but also with the low-degree nodes. For instance, the "pain" keyword is the highest-degree node which connects 11,532 other keywords. It links to the other high-degree nodes like chronic pain, opioid, and pain management as well as to 2,393 low-degree nodes like agent-based modeling, ankle surgery, lavender oil, traumatic stress, and sexual assault, whose degree is less than 20.
Not only does the highest-degree node, which is the "pain," associate with other high-degree nodes such as "chronic pain," "back pain," and "opioid," but also with new emerging topics such as "machine learning," "neural network," "regression," and "measurement." The patterns in Fig 7B confirm that new topics and connections have emerged in the pain literature over time.
Fig 8 shows the weighted clustering coefficient across different values of degree. Over the four time windows, there is a declining trend in the clustering coefficient, indicating that nodes with a small degree constitute dense clusters more with other small-degree nodes than with high-degree ones. However, high-degree nodes have strong connections with both other high-degree and low-degree nodes. In addition, the clustering coefficient of the 2017–2021 period is always less than that of other time windows. It is evident that in recent years, some nodes have grown as high-degree nodes. For instance: “chronic pain” is one of the highest-degree keywords, and over time, the numbers of keywords connected to “chronic pain” are 303, 738, 2422, and 4611, respectively, in the four time windows.
Fig 8. Weighted clustering coefficient as a function of degree for four time windows.
Both the x-axis and the y-axis are on the logarithmic scale. The main takeaway is that nodes with smaller degrees constitute more dense clusters with other smaller degree nodes; however, nodes with high-degree have a strong connection with both nodes with high-degree and low-degree.
Table 4 demonstrates the keywords that have the highest connection density to the neighbor keywords from 2017 to 2021, as measured by the weighted clustering coefficient (See Eq 5). "Clinical decision pathway, noncardiac, intensive critical care, chest pain syndrome, and aha clinical practice guidelines" topics are frequently used with a similar set of keywords in the articles, such as "obesity, sleep, physical activity, lifestyle, chronic pain, diet, cancer survivor, stress, and psychological factor."
Table 4. Top 5 keywords that have the highest connection density to the neighbor keywords, as calculated by the weighted clustering coefficient.
| Original Keywords | Clustering Coefficient | Neighbors |
|---|---|---|
| clinical decision pathway | 0.00702 | [obesity, sleep, physical activity, lifestyle, chronic pain, diet, cancer survivor, stress, psychological factor, pain location, pain drawing, pain extent, frozen shoulder, pain sensitivity, questionnaire, experimental pain testing, pain perception, wound] |
| noncardiac | 0.00638 | [obesity, sleep, physical activity, lifestyle, chronic pain, diet, cancer survivor, stress, psychological factor, pain location, pain drawing, pain extent, frozen shoulder, pain sensitivity, questionnaire, experimental pain testing, pain perception, wound] |
| intensive critical care | 0.00614 | [obesity, sleep, physical activity, lifestyle, chronic pain, diet, cancer survivor, stress, psychological factor, pain location, pain drawing, pain extent] |
| chest pain syndrome | 0.00571 | [obesity, sleep, physical activity, lifestyle, chronic pain, diet, cancer survivor, stress, psychological factor, pain location, pain drawing, pain extent, frozen shoulder, pain sensitivity, questionnaire, experimental pain testing, pain perception, wound, breast cancer, pain] |
| aha clinical practice guidelines | 0.00561 | [obesity, sleep, physical activity, lifestyle, chronic pain, diet, cancer survivor, stress, psychological factor, pain location, pain drawing, pain extent, frozen shoulder, pain sensitivity, questionnaire, experimental pain testing, pain perception, wound] |
4.3. Pain research trends
To further analyze the evolution of pain literature visually, each keyword is placed in one of three following categories for the only purpose of easy visualization:
Sensors/methods-related keywords (e.g., electromyography, biomarker, machine learning)
Biomedical-related keywords (e.g., chronic pain, back pain)
Treatment-related keywords (e.g., surgery, acupuncture)
Figs 9, 10 and 11 show the emerging and declining keywords in sensors/methods, biomedical, and treatment categories, respectively. The rankings are assigned based on the keywords’ frequency in a specific time window. If a keyword’s rank improved from 2002–2006 to 2017–2021 or if a new keyword entered the top 20, then the keyword is considered an emerging topic. On the other hand, if a keyword’s rank decreased or dropped below the top 20, the keyword is considered a declining topic. The left-side panel of each figure presents the emerging topics, and the right-side panel shows the declining topics. If keywords are in the right-side panel (declining keywords), it is not that they are less important; it only means that researchers have been more focused on keywords in the left-side panel (emerging keywords) in recent years.
Fig 9. Emerging (left panel) and declining (right panel) keywords in the sensors/methods category from 2002–2006 to 2017–2021.
Numbers next to keywords represent the rank, and numbers in parentheses represent the frequency of keywords. The total number of unique keywords is 1,534 between 2002 and 2006 and 11,532 between 2017 and 2021.
Fig 10. Emerging (left panel) and declining (right panel) keywords in the biomedical category from 2002–2006 to 2017–2021.
Numbers next to keywords represent the rank, and numbers in parentheses represent the frequency of keywords. The total number of unique keywords is 1,534 between 2002 and 2006 and 11,532 between 2017 and 2021.
Fig 11. Emerging (left panel) and declining (right panel) keywords in the treatment category from 2002–2006 to 2017–2021.
Numbers next to keywords represent the rank, and numbers in parentheses represent the frequency of keywords. The total number of unique keywords is 1,534 between 2002 and 2006 and 11,532 between 2017 and 2021.
Fig 9 represents the trends in the sensors/methods category. Pain management, visual analog scale, random control trial, pain control, electromyography, and pain measurement concepts have been the research focus over the years. Pain assessment and pain intensity topics climbed up in the ranking drastically. Specifically, machine learning and biomarkers have become one of the leading research topics. In 2002–2006, these keywords had never been mentioned in the pain literature; however, during 2017–2021, the machine learning keyword was listed 239 times, and the biomarker keyword was listed 238 times. This change means that researchers have prioritized these topics in recent years. Micro dialysis, magnetoencephalography, electrophysiology, electrical stimuli, and pressure pain threshold subjects were highly used in 2002–2006, but they have not been the main focus of research during 2017–2021.
The research community has investigated pain assessment and management approaches for the past two decades. The full potential of pain data was largely untapped in 2002–2006 because machine learning methods were not actively explored in pain research. Machine learning and statistical modeling techniques have been widely applied to pain assessment and management, starting with the 2012–2016 time window. Pain researchers explored model building (e.g., deep learning, support vector machines), decision making (e.g., treatment, patient quality of life), and pain measurement (e.g., machine learning, biomarker). However, other modeling methods, such as linear regression, have also been quite common since 2002. We observed that sensors and predictive models have become more common in pain assessment and management. We anticipate that these trends will continue to evolve and play an increasingly important role in the future. Another promising direction for future research is the investigation of integrating multiple sensing modalities, including new sensing methods such as wearable devices, to develop more efficient pain management and assessment options.
Fig 10 shows the trends in the biomedical category. The data reveals that acute pain, musculoskeletal pain, chronic low back pain, cancer pain, and postoperative pain have become increasingly popular over the years and have been actively studied in the last two decades. Dorsal root ganglion, visceral pain, capsaicin, spinal cord, nociceptive, and allodynia have lost popularity over the last two decades. Meanwhile, chronic pain, neck pain, abdominal pain, low back pain, neuropathic pain, analgesia, back pain, and inflammation have retained their rank on the frequency list and have stayed as the focus of the researchers all through. While we believe this trend will continue, we also anticipate that researchers will explore new avenues of research to address persistent pain conditions such as chronic low back pain, neck pain, abdominal pain, and neuropathic pain. Understanding the mechanisms underlying these conditions is crucial for developing more effective treatments and therapies for patients. We expect this research direction to be pursued in the future, as it holds great potential for advancing pain management.
Fig 11 presents the trends in the treatment category. Opioids, rehabilitation, analgesics, surgery, exercise, acupuncture, and morphine treatments have remained active research topics in recent years. Laser and laser-evoked potential treatment techniques have lost researchers’ attention over time. Meanwhile, researchers have directed their interest toward self-management, cognitive behavioral therapy, physical activity, and opioid analgesic topics. The significant changes and trends in keywords since 2002 also reveal the emergence of new technologies for pain management. The early work in the medical field for pain management and assessment has focused on treatment methods such as chemotherapy, but the current research has emphasized patient wellness. With the availability of large-scale personal datasets and the development of wearable instruments, the recent work has focused on the quality of life of individual patients, self-management of pain, and plethora of therapy methods. We believe these approaches have revolutionary potential, and further research in these areas could lead to more effective pain management techniques. In addition, expanding the use of artificial intelligence and predictive modeling techniques could improve pain treatment outcomes; therefore, it can be another direction.
To provide a comprehensive and focused representation of the field, Table 5 presents an overview of each category of pain research. This table highlights the significant findings and research directions within each category.
Table 5. Significant findings and specific research directions are highlighted within each category.
| Category | Overview | Future Directions |
|---|---|---|
| Sensor/Methods | The trend in pain assessment and management has shifted toward the use of machine learning and biomarkers. | Investigating the integration of multiple sensing modalities and incorporating new sensing methods, such as wearable devices, can provide more efficient pain management and assessment options. |
| Biomedical | Research has focused on acute and chronic pain, musculoskeletal pain, cancer pain, and postoperative pain. | Expanding the research efforts towards understanding the mechanisms of persistent pain conditions such as chronic low back pain, neck pain, abdominal pain, and neuropathic pain can enhance the understanding of pain and its underlying mechanisms and help in developing more effective treatments and therapies for patients. |
| Treatment | Researchers have shifted their focus towards patient-centered pain management, emphasizing patient wellness and quality of life. | In order to improve pain treatment, it could be beneficial to investigate novel pain management strategies that prioritize patient-centric care, such as self-management techniques, behavioral interventions, and physical activity. Additionally, exploring new treatment options for persistent pain conditions may be worthwhile. Furthermore, using artificial intelligence and predictive modeling techniques could be expanded to enhance pain treatment outcomes. |
Table 6 offers a more detailed examination of the existing categories (sensors/methods, biomedical, treatment), considering research, real-world evidence, technology applied to pain, and societal impact perspectives. This expansion aims to provide researchers with enhanced advantages and a comprehensive framework to support their work.
Table 6. The categories are further examined, taking into account research, real-world evidence, technology applied to pain, and societal impact perspectives.
| Category | Research | Real-world evidence | Technology applied to pain | Societal impact |
|---|---|---|---|---|
| Sensor/Methods | Machine learning and biomarkers are becoming increasingly popular. | Understanding pain intensity is a key focus of pain assessment. | Automated machine learning models and biomarkers are investigated as alternatives to solely relying on patient-dependent methods for pain assessment. | Proper pain management and assessment are critical to ensure patients receive appropriate treatment. |
| Biomedical | Researchers are focusing on chronic pain. | Cancer pain is a significant concern. | Not applicable. | Persistent pain is becoming an increasingly significant issue for society. |
| Treatment | Patient-centered pain management has become increasingly crucial. | Therapy and physical exercise are commonly used to manage pain. | The focus on laser treatments for pain management is declining, whereas research on exercise activities is increasing. | Opioids remain a prominent topic of research in pain management. |
4.4. Association patterns among Pain-Related keywords
We have conducted affinity analysis [59] on pain-related articles. Using the Apriori algorithm [60,61], the affinity analysis first finds all combinations of items (also referred to as itemsets) that occur in a large set of transactions with probabilities greater than a desired threshold. Next, the affinity analysis formulates the rule of co-occurrence of items in the transaction set. Typically, the rules take the form “IF antecedent itemset THEN consequent itemset.” The strength of each rule is assessed using several measures, such as support count, confidence, and lift. Table 7 presents these measures for the top 15 rules ranked by their lift. In our study, the support count of a rule is the number of pain-related articles (published from 2002 to 2021) that contain both the antecedent and the consequent keyword(s). The confidence of a rule is the conditional probability of the consequent keyword(s) appearing in the article set, given the presence of antecedent keyword(s) in the article set. The lift of a rule indicates the strength/efficiency of the rule informing the occurrence of the consequent keyword(s). In other words, the lift is the ratio of the chance of seeing the consequent keyword(s) in an article if we use the rule to the chance of seeing the consequent keyword(s) without the insights from the rule. With a lift greater than 1, we have a greater chance of seeing the consequent keyword(s) in the literature if we know that the
Table 7. The association rules are found in the keywords listed in the pain literature in the past two decades (2002–2021).
| Antecedent Keyword(s) |
Consequent Keyword(s) |
Support Count | Confidence | Lift |
|---|---|---|---|---|
| bladder pain syndrome | interstitial cystitis | 281 | 0.78 | 425.53 |
| acute coronary syndrome | chest pain | 327 | 0.56 | 79.07 |
| pain; knee | osteoarthritis | 214 | 0.57 | 69.82 |
| chronic constriction injury | neuropathic pain | 250 | 0.76 | 31.39 |
| postoperative/postop | pain | 537 | 0.85 | 6.76 |
| fatigue | pain | 648 | 0.73 | 5.80 |
| cancer | pain | 763 | 0.66 | 5.28 |
| functional/functionality/function | pain | 348 | 0.66 | 5.27 |
| dementia | pain | 225 | 0.65 | 5.18 |
| parkinson disease | pain | 237 | 0.65 | 5.17 |
| nociception/nociceptive | pain | 772 | 0.61 | 4.87 |
| knee; osteoarthritis | pain | 214 | 0.61 | 4.87 |
| sleep | pain | 382 | 0.61 | 4.86 |
| inflammation | pain | 1126 | 0.56 | 4.44 |
| TRPV | pain | 282 | 0.55 | 4.38 |
antecedent keyword(s) appeared in the literature.
We set the minimum support count as 200 and the minimum confidence as 0.55. These settings are determined using computational and practical considerations. The Apriori algorithm yielded 15 association rules that meet the support count and confidence criteria set by the authors (Table 5).
To illustrate the results above, consider the first row in Table 5. It presents the rule “IF bladder pain syndrome, THEN interstitial cystitis.” It means if bladder pain syndrome appeared in an article, then interstitial cystitis will also appear in the article with a confidence of 0.78 and a lift of 425.53. Similarly, the second row in the table leads to the following rule: “IF acute coronary syndrome, THEN chest pain,” with a confidence of 0.56 and a lift of 79.07. These rules provide researchers with information on the association between keywords, or in other words, the affinity among topics in pain-related articles.
5. Conclusion
Pain is a significant medical issue that affects millions of people every day. Pain-related research has grown extensively across different fields in the last two decades. The vast amount of literature on pain-related research makes the traditional literature review process tedious and impractical. Using a KCN approach, this study provides a macro-level picture of the current pain literature.
In this study, we collected 264,560 articles published between 2002 and 2021 from IEEE, Web of Science, PubMed, or Engineering Village by comprehensively searching pain research articles. We extracted all the keywords from these articles and applied data cleaning and text processing techniques to remove duplicates, tokenize keywords, and extract stem words. From these keywords, we constructed adjacency and weighted adjacency matrices. Using these matrices, we built KCNs and analyzed the network features, such as centrality, affinity, and cohesiveness, to understand the knowledge components, structure, research trends, and emerging research topics.
The KCN-based analysis showed that pain literature had grown tremendously in the past two decades. The number of articles and keywords has increased by a factor of 3 and 7, respectively. The number of co-occurrences of keywords has grown at more than twice the speed of keywords growth. We identified the emerging and declining topics in the following categories: (1) sensors/methods, (2) biomedical, and (3) treatment. The Results and Discussion section presented the research trend and insights.
The categorization process of the keywords as sensors/methods, biomedical, and treatment has limitations. This study classified a keyword into only one of the three categories; it did not consider overlapping membership. Moreover, the categorization, for the purpose of visualization of the emerging and declining trends, was performed manually, banking on the domain knowledge of the authors. Therefore, the categorization is likely to be subjective. Future work will consider classifying a keyword into more than one category and expanding the categories in addition to sensors/methods, biomedical, and treatment. It will automate the classification of a keyword in categories using built-in dictionaries in Python, such as PyMedTermino. Furthermore, various methods exist for structuring the categories, and we intend to investigate these alternatives in our future research. In addition, future work will expand the keywords by extracting all words from the abstract. Lastly, in future work, the KCN-based methods will be extended to analyze the connections between the authors of the articles to reveal potential collaboration patterns across pain-related fields.
Data Availability
The data sets generated during the current study are available in Kaggle https://www.kaggle.com/datasets/burcuozek/kcnpainpaper (DOI: 10.34740/kaggle/ds/2837644).
Funding Statement
This work was supported by the National Science Foundation (Award 1838796 granted to Sagar Kamarthi as a Co-PI, https://www.nsf.gov/awardsearch/showAward?AWD_ID=1838796&HistoricalAwards=false). The funders had no role in study design, data collection, and analysis, the decision to publish, or preparation of the manuscript.
References
- 1.Pouromran F, Radhakrishnan S, Kamarthi S. Exploration of physiological sensors, features, and machine learning models for pain intensity estimation. Plos One. 2021;16(7). ARTN e0254108. doi: 10.1371/journal.pone.0254108 WOS:000674301400140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Raja SN, Carr DB, Cohen M, Finnerup NB, Flor H, Gibson S, et al. The revised International Association for the Study of Pain definition of pain: concepts, challenges, and compromises. Pain. 2020;161(9):1976–82. doi: 10.1097/j.pain.0000000000001939 WOS:000571186100006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Semwal A, Londhe ND, editors. S-PANET: A Shallow Convolutional Neural Network for Pain Severity Assessment in Uncontrolled Environment. 2021 IEEE 11th Annual Computing and Communication Workshop and Conference (CCWC); 2021: IEEE. [Google Scholar]
- 4.Korwisi B, Barke A, Rief W, Treede R-D, Kleinstäuber M. Chronic pain in the 11th revision of the International Classification of Diseases: users’ questions answered. Pain. 2021. doi: 10.1097/j.pain.0000000000002551 [DOI] [PubMed] [Google Scholar]
- 5.Kumar KH, Elavarasi P. Definition of pain and classification of pain disorders. Journal of Advanced Clinical and Research Insights. 2016;3(3):87–90. [Google Scholar]
- 6.Yong RJ, Mullins PM, Bhattacharyya N. Prevalence of chronic pain among adults in the United States. Pain. 2022;163(2):E328–E32. doi: 10.1097/j.pain.0000000000002291 WOS:000742403300026. [DOI] [PubMed] [Google Scholar]
- 7.Zelaya CE, Dahlhamer JM, Lucas JW, Connor EM. Chronic Pain and High-impact Chronic Pain Among U.S. Adults, 2019. NCHS Data Brief. 2020;(390):1–8. . [PubMed] [Google Scholar]
- 8.Gaskin DJ, Richard P. The Economic Costs of Pain in the United States. J Pain. 2012;13(8):715–24. doi: 10.1016/j.jpain.2012.03.009 WOS:000307627600001. [DOI] [PubMed] [Google Scholar]
- 9.Winchester CL, Salji M. Writing a literature review. Journal of Clinical Urology. 2016;9(5):308–12. doi: 10.1177/2051415816650133 [DOI] [Google Scholar]
- 10.Boccaletti S, Latora V, Moreno Y, Chavez M, Hwang DU. Complex networks: Structure and dynamics. Phys Rep. 2006;424(4–5):175–308. doi: 10.1016/j.physrep.2005.10.009 WOS:000237803800001. [DOI] [Google Scholar]
- 11.Su HN, Lee PC. Mapping knowledge structure by keyword co-occurrence: a first look at journal papers in Technology Foresight. Scientometrics. 2010;85(1):65–79. doi: 10.1007/s11192-010-0259-8 WOS:000280947400006. [DOI] [Google Scholar]
- 12.Perianes-Rodriguez A, Waltman L, van Eck NJ. Constructing bibliometric networks: A comparison between full and fractional counting. J Informetr. 2016;10(4):1178–95. doi: 10.1016/j.joi.2016.10.006 WOS:000389548900022. [DOI] [Google Scholar]
- 13.van Eck NJ, Waltman L. Visualizing Bibliometric Networks. In: Ding Y, Rousseau R, Wolfram D, editors. Measuring Scholarly Impact: Methods and Practice. Cham: Springer International Publishing; 2014. p. 285–320. [Google Scholar]
- 14.Yuan CX, Li GY, Kamarthi S, Jin XN, Moghaddam M. Trends in intelligent manufacturing research: a keyword co-occurrence network based review. J Intell Manuf. 2022;33(2):425–39. doi: 10.1007/s10845-021-01885-x WOS:000739266100001. [DOI] [Google Scholar]
- 15.Caes L, Boerner KE, Chambers CT, Campbell-Yeo M, Stinson J, Birnie KA, et al. A comprehensive categorical and bibliometric analysis of published research articles on pediatric pain from 1975 to 2010. Pain. 2016;157(2):302–13. doi: 10.1097/j.pain.0000000000000403 . [DOI] [PubMed] [Google Scholar]
- 16.Hu XS, Nascimento TD, DaSilva AF. Shedding light on pain for the clinic: a comprehensive review of using functional near-infrared spectroscopy to monitor its process in the brain. Pain. 2021;162(12):2805–20. doi: 10.1097/j.pain.0000000000002293 WOS:000720056200004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Lee J, Mawla I, Kim J, Loggia ML, Ortiz A, Jung CJ, et al. Machine learning based prediction of clinical pain using multimodal neuroimaging and autonomic metrics. Pain. 2019;160(3):550–60. doi: 10.1097/j.pain.0000000000001417 WOS:000462395500003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Pollatos O, Dietel A, Herbert BM, Wankner S, Wachsmuth C, Henningsen P, et al. Blunted autonomic reactivity and increased pain tolerance in somatoform patients. Pain. 2011;152(9):2157–64. doi: 10.1016/j.pain.2011.05.024 WOS:000294113100031. [DOI] [PubMed] [Google Scholar]
- 19.Chauny JM, Paquet J, Lavigne G, Marquis M, Daoust R. Evaluating acute pain intensity relief: challenges when using an 11-point numerical rating scale. Pain. 2016;157(2):355–60. doi: 10.1097/j.pain.0000000000000382 WOS:000378257600011. [DOI] [PubMed] [Google Scholar]
- 20.Karcioglu O, Topacoglu H, Dikme O, Dikme O. A systematic review of the pain scales in adults: Which to use? Am J Emerg Med. 2018;36(4):707–14. doi: 10.1016/j.ajem.2018.01.008 WOS:000431713500034. [DOI] [PubMed] [Google Scholar]
- 21.Pouromran F, Lin Y, Kamarthi S. Personalized Deep Bi-LSTM RNN Based Model for Pain Intensity Classification Using EDA Signal. Sensors (Basel). 2022;22(21). Epub 20221022. doi: 10.3390/s22218087 ; PubMed Central PMCID: PMC9654781. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Piartli P, Rapalis A, Kaniusas E, Jankauskaitė L, Marozas V, editors. Pain Recognition from Finger Plethysmography using Neural Networks. 2021 International Conference BIOMDLORE; 2021: IEEE. [Google Scholar]
- 23.Hadjiat Y, Arendt-Nielsen L. Digital health in pain assessment, diagnosis, and management: Overview and perspectives. Frontiers in Pain Research. 2023;4. doi: 10.3389/fpain.2023.1097379 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Yang G, Jiang M, Ouyang W, Ji G, Xie H, Rahmani AM, et al. IoT-based remote pain monitoring system: From device to cloud platform. IEEE journal of biomedical and health informatics. 2017;22(6):1711–9. doi: 10.1109/JBHI.2017.2776351 [DOI] [PubMed] [Google Scholar]
- 25.Jiang MZ, Mieronkoski R, Syrjala E, Anzanpour A, Terava V, Rahmani AM, et al. Acute pain intensity monitoring with the classification of multiple physiological parameters. J Clin Monit Comput. 2019;33(3):493–507. doi: 10.1007/s10877-018-0174-8 WOS:000467908500018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Kachele M, Amirian M, Thiam P, Werner P, Walter S, Palm G, et al. Adaptive confidence learning for the personalization of pain intensity estimation systems. Evol Syst-Ger. 2017;8(1):71–83. doi: 10.1007/s12530-016-9158-4 WOS:000398452600006. [DOI] [Google Scholar]
- 27.Lucey P, Cohn JF, Prkachin KM, Solomon PE, Matthews I, editors. Painful data: The UNBC-McMaster shoulder pain expression archive database. 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG); 2011: IEEE. [Google Scholar]
- 28.Velana M, Gruss S, Layher G, Thiam P, Zhang Y, Schork D, et al. The SenseEmotion Database: A Multimodal Database for the Development and Systematic Validation of an Automatic Pain- and Emotion-Recognition System. Lect Notes Artif Int. 2017;10183:127–39. doi: 10.1007/978-3-319-59259-6_11 WOS:000433001500011. [DOI] [Google Scholar]
- 29.Walter S, Gruss S, Ehleiter H, Tan JW, Traue HC, Werner P, et al. The BioVid Heat Pain Database Data for the Advancement and Systematic Validation of an Automated Pain Recognition System. 2013 Ieee International Conference on Cybernetics (Cybconf). 2013. WOS:000340924600022. [Google Scholar]
- 30.Werner P, Lopez-Martinez D, Walter S, Al-Hamadi A, Gruss S, Picard RW. Automatic Recognition Methods Supporting Pain Assessment: A Survey. Ieee T Affect Comput. 2022;13(1):530–52. doi: 10.1109/Taffc.2019.2946774 WOS:000766268600041. [DOI] [Google Scholar]
- 31.Lotsch J, Ultsch A. Machine learning in pain research. Pain. 2018;159(4):623–30. doi: 10.1097/j.pain.0000000000001118 WOS:000451219000003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Wagemakers SH, van der Velden JM, Gerlich AS, Hindriks-Keegstra AW, van Dijk JFM, Verhoeff JJC. A Systematic Review of Devices and Techniques that Objectively Measure Patients’ Pain. Pain Physician. 2019;22(1):1–13. WOS:000462493900006. [PubMed] [Google Scholar]
- 33.Chen J, Abbod M, Shieh JS. Pain and Stress Detection Using Wearable Sensors and Devices-A Review. Sensors-Basel. 2021;21(4). ARTN 1030. doi: 10.3390/s21041030 WOS:000624645500001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Subramaniam SD, Doss B, Chanderasekar LD, Madhavan A, Rosary AM. Scope of physiological and behavioural pain assessment techniques in children—a review. Healthc Technol Lett. 2018;5(4):124–9. doi: 10.1049/htl.2017.0108 WOS:000442373300004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Zamzmi G, Pai C-Y, Goldgof DB, Kasturi R, Sun Y, Ashmeade T. Machine-based Multimodal Pain Assessment Tool for Infants: A Review. ArXiv. 2016;abs/1607.00331. [Google Scholar]
- 36.Gamwell KL, Kollin SR, Gibler RC, Bedree H, Bieniak KH, Jagpal A, et al. Systematic evaluation of commercially available pain management apps examining behavior change techniques. Pain. 2021;162(3):856–65. doi: 10.1097/j.pain.0000000000002090 WOS:000656631900022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Hohenschurz-Schmidt D, Kleykamp BA, Draper-Rodi J, Vollert J, Chan J, Ferguson M, et al. Pragmatic trials of pain therapies: a systematic review of methods. Pain. 2022;163(1):21–46. doi: 10.1097/j.pain.0000000000002317 WOS:000731609000005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Miettinen T, Mantyselka P, Hagelberg N, Mustola S, Kalso E, Lotsch J. Machine learning suggests sleep as a core factor in chronic pain. Pain. 2021;162(1):109–23. doi: 10.1097/j.pain.0000000000002002 WOS:000607336300010. [DOI] [PubMed] [Google Scholar]
- 39.Moore RA, Fisher E, Finn DP, Finnerup NB, Gilron I, Haroutounian S, et al. Cannabinoids, cannabis, and cannabis-based medicines for pain management: an overview of systematic reviews. Pain. 2021;162(Suppl 1):S67–s79. doi: 10.1097/j.pain.0000000000001941 . [DOI] [PubMed] [Google Scholar]
- 40.Moayedi M, Davis KD. Theories of pain: from specificity to gate control. Journal of neurophysiology. 2013;109(1):5–12. doi: 10.1152/jn.00457.2012 [DOI] [PubMed] [Google Scholar]
- 41.Hadjiat Y, Marchand S. Virtual Reality and the Mediation of Acute and Chronic Pain in Adult and Pediatric Populations: Research Developments. Frontiers in Pain Research. 2022;3. doi: 10.3389/fpain.2022.840921 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Koechlin H, Coakley R, Schechter N, Werner C, Kossowsky J. The role of emotion regulation in chronic pain: A systematic literature review. J Psychosom Res. 2018;107:38–45. doi: 10.1016/j.jpsychores.2018.02.002 WOS:000428359300007. [DOI] [PubMed] [Google Scholar]
- 43.IsHak WW, Wen RY, Naghdechi L, Vanle B, Dang J, Knosp M, et al. Pain and Depression: A Systematic Review. Harvard Rev Psychiat. 2018;26(6):352–63. doi: 10.1097/HRP.0000000000000198 WOS:000450433400005. [DOI] [PubMed] [Google Scholar]
- 44.Shraim MA, Masse-Alarie H, Hall LM, Hodges PW. Systematic Review and Synthesis of Mechanism-based Classification Systems for Pain Experienced in the Musculoskeletal System. Clin J Pain. 2020;36(10):793–812. doi: 10.1097/AJP.0000000000000860 WOS:000570185900008. [DOI] [PubMed] [Google Scholar]
- 45.Shraim MA, Masse-Alarie H, Hodges PW. Methods to discriminate between mechanism-based categories of pain experienced in the musculoskeletal system: a systematic review. Pain. 2021;162(4):1007–37. doi: 10.1097/j.pain.0000000000002113 WOS:000656633100005. [DOI] [PubMed] [Google Scholar]
- 46.Urits I, Burshtein A, Sharma M, Testa L, Gold PA, Orhurhu V, et al. Low Back Pain, a Comprehensive Review: Pathophysiology, Diagnosis, and Treatment. Curr Pain Headache R. 2019;23(3). ARTN 23. doi: 10.1007/s11916-019-0757-1 WOS:000460819800002. [DOI] [PubMed] [Google Scholar]
- 47.Finnerup NB, Kuner R, Jensen TS. Neuropathic Pain: From Mechanisms to Treatment. Physiol Rev. 2021;101(1):259–301. doi: 10.1152/physrev.00045.2019 WOS:000588730800005. [DOI] [PubMed] [Google Scholar]
- 48.Lee PC, Su HN. Investigating the structure of regional innovation system research through keyword co-occurrence and social network analysis. Innov-Manag Policy P. 2010;12(1):26–40. doi: 10.5172/impp.12.1.26 WOS:000279055000004. [DOI] [Google Scholar]
- 49.Li HJ, An HZ, Wang Y, Huang JC, Gao XY. Evolutionary features of academic articles co-keyword network and keywords co-occurrence network: Based on two-mode affiliation network. Physica A. 2016;450:657–69. doi: 10.1016/j.physa.2016.01.017 WOS:000372387800061. [DOI] [Google Scholar]
- 50.Radhakrishnan S, Erbis S, Isaacs JA, Kamarthi S. Novel keyword co-occurrence network-based methods to foster systematic reviews of scientific literature. Plos One. 2017;12(3). ARTN e0172778. doi: 10.1371/journal.pone.0172778 WOS:000399094700010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Weerasekara S, Lu ZY, Ozek B, Isaacs J, Kamarthi S. Trends in Adopting Industry 4.0 for Asset Life Cycle Management for Sustainability: A Keyword Co-Occurrence Network Review and Analysis. Sustainability-Basel. 2022;14(19). ARTN 12233. doi: 10.3390/su141912233 WOS:000867218000001. [DOI] [Google Scholar]
- 52.Newman MEJ. Analysis of weighted networks. Phys Rev E. 2004;70(5). ARTN 056131. doi: 10.1103/PhysRevE.70.056131 WOS:000225970700043. [DOI] [PubMed] [Google Scholar]
- 53.Zhang JL, Luo Y. Degree Centrality, Betweenness Centrality, and Closeness Centrality in Social Network. Adv Intel Sys Res. 2017;132:300–3. WOS:000417222100068. [Google Scholar]
- 54.Jia Y, Lu V, Hoberock J, Garland M, Hart JC. Chapter 2—Edge v. Node Parallelism for Graph Centrality Metrics. In: Hwu W-mW, editor. GPU Computing Gems Jade Edition. Boston: Morgan Kaufmann; 2012. p. 15–28. [Google Scholar]
- 55.Barrat A, Barthelemy M, Pastor-Satorras R, Vespignani A. The architecture of complex weighted networks. P Natl Acad Sci USA. 2004;101(11):3747–52. doi: 10.1073/pnas.0400087101 WOS:000220314500008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Hevey D. Network analysis: a brief overview and tutorial. Health Psychol Behav. 2018;6(1):301–28. doi: 10.1080/21642850.2018.1521283 WOS:000472538400018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Onnela JP, Saramaki J, Kertesz J, Kaski K. Intensity and coherence of motifs in weighted complex networks. Phys Rev E. 2005;71(6). ARTN 065103 doi: 10.1103/PhysRevE.71.065103 WOS:000230275000003. [DOI] [PubMed] [Google Scholar]
- 58.Saramaki J, Kivela M, Onnela JP, Kaski K, Kertesz J. Generalizations of the clustering coefficient to weighted complex networks. Phys Rev E. 2007;75(2). ARTN 027105 doi: 10.1103/PhysRevE.75.027105 WOS:000244532000070. [DOI] [PubMed] [Google Scholar]
- 59.Agrawal R, Mannila H, Srikant R, Toivonen H, Verkamo AI. Fast discovery of association rules. In: Usama M, Piatetsky-Shapiro G, Smyth P, Uthurusamy R, editors. Advances in knowledge discovery and data mining. 12. Menlo Park, CA: AAAI press; 1996. p. 307–28. [Google Scholar]
- 60.Agrawal R, Imieliński T, Swami A. Mining association rules between sets of items in large databases. SIGMOD Rec. 1993;22(2):207–16. doi: 10.1145/170036.170072 [DOI] [Google Scholar]
- 61.Bayardo RJ, Agrawal R, editors. Mining the most interesting rules. KDD ’99: Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining; 1999 1999: ACM Press. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data sets generated during the current study are available in Kaggle https://www.kaggle.com/datasets/burcuozek/kcnpainpaper (DOI: 10.34740/kaggle/ds/2837644).











