Abstract
Background and aim
Orofacial neuropathic pain is a medical condition caused by a lesion or dysfunction of the nervous system and is one of the most challenging for dental clinicians to diagnose. Anticonvulsants, antidepressants, analgesics, nonsteroidal anti-inflammatory drugs, and other classes of medications are frequently used to treat this condition. Our study aimed to build a machine learning-based classifier to predict the need for anticonvulsant drugs in patients with orofacial neuropathic pain.
Materials and methods
A machine learning tool that was trained and tested on patients for predicting and detecting algorithms, which would in turn predict the need for anticonvulsants in the treatment of orofacial neuropathic pain, was employed in this study.
Results
Three machine learning algorithms successfully detected and predicted the need for anticonvulsants to treat patients with orofacial neuropathic pain. All three models showed a high accuracy, that is, 97%, 94%, and 89%, in predicting the need for anticonvulsants.
Conclusion
Machine learning algorithms can accurately predict the need for anticonvulsant drugs for treating orofacial neuropathic pain. Further research is needed to validate these findings using larger sample sizes and imaging modalities.
Keywords: neuralgia, artificial intelligence, machine learning, anticonvulsants, orofacial neuropathic pain
Introduction
Orofacial neuropathic pain is a medical disorder induced by damage to the orofacial somatosensory nervous system. It may be spontaneous or a result of a local injury or systemic disease, making differential diagnosis challenging [1, 2]. By its primary fundamental cause, orofacial pain can generally be divided into three categories: somatic, neuropathic, and psychological. Several identified conditions such as periodontal and pulpal diseases, oral ulcers, Eagle's syndrome, burning mouth syndrome, headaches, temporomandibular joint disorders, oral cancer, and neuropathic pathologies can cause orofacial discomfort. Multiple forms of orofacial neuropathic pain including trigeminal neuralgia, atypical odontalgia, nonodontogenic neuropathic orofacial pain, postherpetic neuralgia, atypical odontalgia, and glossopharyngeal neuralgia have been identified [3]. Depending on the underlying cause, orofacial neuropathic pain may be persistent or episodic and other characteristic symptoms may vary substantially. Since dentists rarely consider neuropathic pain as a potential cause, differential diagnosis and early identification of orofacial neuropathic pain are essential to avoid unnecessary dental procedures. Although the pathophysiological mechanisms underlying orofacial neuropathic pain are not completely understood, it is believed to share several characteristics with other peripheral neuropathies.
A multidisciplinary approach involving psychological, pharmacological, and physiological therapy is necessary to manage orofacial neuropathic pain. Currently, pharmacological intervention is regarded as the cornerstone of neuropathic pain management. Anticonvulsants, antidepressants, analgesics, nonsteroidal anti-inflammatory drugs, and other classes of medications are frequently used to treat neuropathy. Among them, anticonvulsants have shown efficacy in treating orofacial neuropathy. Gabapentin is a commonly used medication that modulates calcium channels and reduces the neurotransmitter production of pain. Due to their efficacy and safety profiles, these medicines are frequently used as the initial treatment options. Carbamazepine and ox-carbamazepine are commonly used medications that block sodium channels and inhibit abnormal nerve discharge. These drugs are also used in the treatment of other medical conditions such as diabetes, cancer, and multiple sclerosis [4].
Machine learning brings several advantages when addressing the need for anticonvulsants in patients with pain. Firstly, it enables personalized treatment plans by analyzing diverse patient data and identifying patterns influencing treatment outcomes. This personalized approach improves the likelihood of successful pain management by tailoring treatment strategies to individual patients [5]. Additionally, machine learning models offer enhanced accuracy by considering multiple variables simultaneously and identifying subtle relationships that may not be apparent through traditional methods. This leads to more accurate predictions and recommendations, aiding healthcare providers in making informed decisions regarding anticonvulsant prescriptions.
Another advantage is the efficient allocation of resources. By identifying patients who are more likely to benefit from anticonvulsant treatment, machine learning models help optimize resource utilization. This ensures that limited resources, such as medications, are directed toward patients with a higher probability of positive treatment outcomes [6, 7]. Machine learning contributes to more efficient resource allocation in pain management by minimizing unnecessary treatments and associated costs. Overall, machine learning is a valuable decision-support tool, offering objective and evidence-based recommendations for anticonvulsant usage, improving treatment efficacy, and optimizing resource utilization in patients with pain. This study aims to contribute to this area of research by exploring the predictive accuracy of machine learning algorithms in the need for anticonvulsants for treating orofacial neuropathic pain patients.
Materials and methods
The study received approval from the ethical committee of Saveetha Dental College and Hospitals. Orofacial neuralgia patients were selected from a database administered by dental information software at Saveetha Dental College and Hospitals. A cohort of 178 individuals, who were receiving anticonvulsant medication for orofacial neuropathic pain, were recruited based on the data in the Dental Information Archiving Software (DIAS). The gathered data was subjected to normalization and the elimination of outliers. Then, the procedure of data preparation and exploratory analysis was carried out. The dataset was partitioned into two categories: 80% for training, which served as the representative sample, and 20% for testing. The models were trained and evaluated using manual labeling by professionals as a reference [7, 8].
The study was carried out using the Orange data mining tool. It is an open source software hosted under general public license (GPL) on GitHub and uses common Python open-source libraries for scientific computing (Figure 1). Models were constructed using the Orange artificial intelligence (AI) tool. Different algorithms like decision tree, AdaBoost, and neural network were used to predict the accuracy and validation using a confusion matrix. Precision and recall were also analyzed for this clinical study [9].
Figure 1. Workflow of the machine learning model with widgets procured from Orange (data mining software).
ROC: receiver operating characteristic
AdaBoost
AdaBoost, short for adaptive boosting, is an ensemble learning technique introduced by Freund and Schapire in 1997. It is widely used for binary classification problems and is considered one of the first foundational boosting algorithms. The core idea behind boosting algorithms is combining multiple weak learners (usually simple models) to create a single strong learner to make accurate predictions. The algorithm is designed to improve the prediction power of the model by iteratively focusing on the misclassified instances from previous models [10].
Decision tree
A decision tree is a supervised learning algorithm used in machine learning for regression tasks and classification tasks. It is a popular and intuitive algorithm representing a hierarchical, tree-like structure consisting of nodes and branches. The decision tree starts at the root node and branches into internal nodes based on specific conditions or features. Each internal node represents a decision based on a feature, and each branch represents the possible outcomes or values of that feature. The process continues recursively until the leaf nodes are reached, which are the final decision points or predictions.
Random Forest
Random Forest is a powerful ensemble machine learning algorithm for the classification and regression tasks. It is an extension of the decision tree algorithm and leverages the collective predictions of multiple decision trees to arrive at a final result [10].
Confusion matrix
A confusion matrix is a tabular representation utilized for assessing the efficacy of a classification algorithm through the comparison of predicted labels with the true labels presented in a given dataset. The provided information offers a comprehensive analysis of the true positives, true negatives, false positives, and false negatives, facilitating a more comprehensive assessment of the algorithm's performance.
Area under the curve (AUC)-receiver operating characteristic (ROC) curve
The classification models are evaluated using area under the curve-receiver operating characteristic (AUC-ROC) curve. The AUC-ROC metric can determine a model's ability to distinguish classes. Models with higher AUCs perform better. AUC-ROC curves are often used to graphically show the relationship and trade-off between sensitivity and specificity for every possible cut-off for a test or combination of tests. One way to assess model accuracy is using the AUC value. A good model has a separability AUC near 1. A model with a low AUC has the worst separability [11].
Results
Orange data mining is a framework for data analysis with clustering, classification, and interactive data and model visualization components. Orange and the extensions are open source. Figure 1 shows the workflow of Orange with widgets. Orange data analysis workflows are defined by widget selection and connections.
Machine learning results show an accuracy of 97%, 94% and 89% as shown in Table 1. These results confirm that AdaBoost, decision tree, and Random Forest have good predictability. Tables 2-4 show the confusion matrixes for AdaBoost, decision tree, and Random Forest. Figures 2-4 show the ROC curves for carbamazepine, gabapentin, and ox-carbamazepine.
Table 1. Validation of test data for all the chosen algorithms with an AUC of 97%, 94%, and 89%.
AUC: Area under the curve
AdaBoost: Algorithm for the classification and regression tasks
CA: Class accuracy
Decision tree: Decision tree algorithm used for regression tasks and classification tasks
Random Forest: Algorithm for collective predictions of multiple decision trees
| Model | AUC | CA | F1 | Precision | Recall | Specificity |
| AdaBoost | 0.975 | 0.824 | 0.816 | 0.845 | 0.824 | 0.692 |
| Decision tree | 0.944 | 0.765 | 0.715 | 0.754 | 0.765 | 0.569 |
| Random Forest | 0.897 | 0.824 | 0.791 | 0.791 | 0.824 | 0.692 |
Table 2. Confusion matrix for AdaBoost.
Confusion matrix: Tabular representation utilized for assessing the efficacy of a classification algorithm
AdaBoost: Algorithm for the classification and regression tasks
| Carbamazepine | Carbamazepine, gabapentin | Carbamazepine, ox-carbamazepine | Gabapentin | Ox-carbamazepine | Σ | |
| Carbamazepine | 22 | 0 | 0 | 0 | 0 | 23 |
| Carbamazepine, gabapentin | 1 | 0 | 0 | 0 | 0 | 1 |
| Carbamazepine, ox-carbamazepine | 0 | 0 | 0 | 0 | 0 | 0 |
| Gabapentin | 3 | 1 | 0 | 5 | 0 | 8 |
| Ox-carbamazepine | 2 | 0 | 0 | 0 | 0 | 2 |
| Σ | 27 | 1 | 0 | 5 | 0 | 34 |
Table 4. Confusion matrix for the Random Forest.
Random Forest: Algorithm for collective predictions of multiple decision trees
| Carbamazepine | Carbamazepine, Gabapentin | Carbamazepine, ox-carbamazepine | Gabapentin | Ox-carbamazepine | Σ | |
| Carbamazepine | 23 | 0 | 0 | 0 | 0 | 23 |
| Carbamazepine, Gabapentin | 1 | 0 | 0 | 0 | 0 | 1 |
| Carbamazepine, ox-carbamazepine | 0 | 0 | 0 | 0 | 0 | 0 |
| Gabapentin | 2 | 1 | 0 | 5 | 0 | 8 |
| Ox-Carbamazepine | 2 | 0 | 0 | 0 | 0 | 2 |
| Σ | 28 | 1 | 0 | 5 | 0 | 34 |
Table 3. Confusion matrix for the decision tree.
Decision tree: Decision tree algorithm used for regression tasks and classification tasks
| Carbamazepine | Carbamazepine, gabapentin | Carbamazepine, ox-carbamazepine | Gabapentin | Ox-carbamazepine | Σ | |
| Carbamazepine | 23 | 0 | 0 | 0 | 0 | 23 |
| Carbamazepine, gabapentin | 1 | 0 | 0 | 0 | 0 | 1 |
| Carbamazepine, ox-carbamazepine | 0 | 0 | 0 | 0 | 0 | 0 |
| Gabapentin | 4 | 1 | 0 | 3 | 0 | 8 |
| Ox-carbamazepine | 2 | 0 | 0 | 0 | 0 | 2 |
| Σ | 30 | 1 | 0 | 3 | 0 | 34 |
Figure 2. ROC curve for carbamazepine.
ROC: Receiver operating characteristic
Figure 3. ROC curve for gabapentin.
ROC: receiver operating characteristic
Figure 4. ROC curve for ox-carbamazepine.
ROC: receiver operating characteristic
Discussion
Orofacial neuropathic pain is a severe disorder that requires proper diagnosis and management. It affects a person's quality of life and can be activated by touch, temperature changes, and movement. The underlying causes vary but often involve nerve dysfunction or injury. The commonly reported conditions include trigeminal neuralgia, glossopharyngeal neuralgia, postherpetic neuralgia, and periodic migrainous neuralgia. Pain is typically burning, shooting, or electric shock-like, accompanied by numbness, tingling, or altered sensations [12].
The current treatment approaches for orofacial neuropathic pain involve a multimodal approach that includes pharmacotherapy, physical therapies, and psychological interventions. Drugs from different classes, including anticonvulsants, antidepressants, opioids, and nonsteroidal anti-inflammatory drugs, are commonly used to treat orofacial neuropathy [13]. Topical agents such as lidocaine patches and capsaicin cream offer localized pain relief by numbing the affected area or desensitizing the nerve fibers. In severe cases, opioids are used but are limited due to the risk of dependence and potential side effects. Physical therapy includes jaw exercises that improve jaw muscle function, reduce muscle tension, and enhance jaw joint stability. Psychological interventions such as cognitive-behavioral therapy help patients to develop coping strategies, change negative thought patterns, and manage pain related to anxiety and depression. Anticonvulsants play a crucial role in the management of orofacial neuropathic pain. Medications such as gabapentin, carbamazepine, pregabalin, and ox-carbamazepine are widely used as they are effective in reducing the pain by stabilizing hyper-excitable nerves and modulating pain signal transmission in the central nervous system by targeting voltage-gated calcium channels and inhibiting excessive release of excitatory neurotransmitters. Anticonvulsants help normalize neuronal activity and alleviate orofacial neuropathic pain. They are often used in combination therapy, working synergistically with other medications to enhance pain relief. They are initially given at low doses and then titrated gradually to minimize side effects. While the efficacy of anticonvulsant drugs varies among individuals, these medications have demonstrated significant benefits in reducing pain intensity, improving sleep, and enhancing the overall quality of life for patients suffering from chronic orofacial neuropathic pain [14].
Machine learning techniques have revolutionized the field of drug discovery and prediction, offering valuable insights and accelerating the identification of potential therapeutic agents. Machine learning models can extract complex patterns and predict drug efficacy, toxicity, and personalized treatment by integrating and analyzing diverse datasets such as patients' clinical information. One significant application of machine learning in drug prediction is target identification. The machine learning models can identify potential targets associated with specific diseases by mining large-scale clinical data [15]. Furthermore, machine learning algorithms enable virtual screening and drug repurposing by leveraging the existing drug data to predict efficacy against new targets. This approach saves time and resources and increases the chances of discovering new therapeutic applications for the existing drugs. There are fledgling studies using machine learning that show potential in supporting clinicians in making management decisions to treat orofacial neuralgia. Machine learning models are trained by the given clinical data [16].
Our study retrieved a sample size of 178 orofacial neuralgia patients' clinical data, and a machine learning model using Orange software was used. Different algorithms like a decision tree, AdaBoost, and a neural network (Random Forest) were used to predict the accuracy and validation using a confusion matrix (Tables 2-4). Precision and recall were also analyzed for this clinical study. The ROC curve is a crucial tool in image analysis, as it shows the false-positive rate (FPR) and true-positive rate (TPR), with the curve shape indicating an increase in sensitivity with an increase in false-positive rate. Multiple curves represent different models or threshold settings and the area under the curve (AUC) quantifies test performance. Our predicted model showed an accuracy of 97% (Table 1), which is comparatively higher than that in the study conducted by Daniel Lopez-Martinez et al. [17] who reported a maximum accuracy of 72% in machine learning for pain assessment and management, concluding that the tailored model showed a good outcome. This prediction model will help clinicians and pain specialists in advising anti-convulsants for the treatment of orofacial pain.
Limitations
The study is subject to certain limitations. Accurately collecting all important parameters that impact therapy response is challenging due to the variability of neuropathic pain syndromes within the orofacial area. Pain perception and modulation include intricate interactions among biological, psychological, and social components, which may not be adequately captured by machine learning algorithms due to their multifactorial nature. Despite these limitations, machine learning exhibits a potential for augmenting personalized therapy methodologies for orofacial neuropathic pain by identifying predictive biomarkers and optimizing therapeutic strategies.
Conclusions
In our study, we introduced a machine learning approach to predict the need for anticonvulsants in patients with orofacial neuropathic pain. Our predicted model had a high degree of accuracy of 97% in predicting the need for anticonvulsants. The insights generated by our model have significant value as a reference point for orofacial pain specialists and neurologists and can be of great assistance when deciding on treatment regimens. In addition, the predicted machine learning model is readily accessible as it utilizes standard computers and open-source software, making its adoption in hospitals a viable option.
The authors have declared that no competing interests exist.
Author Contributions
Concept and design: Ramya Ramadoss, Pradeep Kumar Yadalam, Karthikeyan Ramalingam, Ramya Suresh
Acquisition, analysis, or interpretation of data: Ramya Ramadoss, Pradeep Kumar Yadalam, Karthikeyan Ramalingam, Ramya Suresh
Drafting of the manuscript: Ramya Ramadoss, Pradeep Kumar Yadalam, Karthikeyan Ramalingam, Ramya Suresh
Critical review of the manuscript for important intellectual content: Ramya Ramadoss, Pradeep Kumar Yadalam, Karthikeyan Ramalingam, Ramya Suresh
Supervision: Ramya Ramadoss, Pradeep Kumar Yadalam, Karthikeyan Ramalingam, Ramya Suresh
Human Ethics
Consent was obtained or waived by all participants in this study. Scientific Review Board, Saveetha Dental College issued approval SRB/SDC/OBIO-2101/23/047
Animal Ethics
Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue.
References
- 1.Orofacial neuropathic pain - basic research and their clinical relevancies. Shinoda M, Imamura Y, Hayashi Y, Noma N, Okada-Ogawa A, Hitomi S, Iwata K. Front Mol Neurosci. 2021;14:691396. doi: 10.3389/fnmol.2021.691396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Orofacial pain management: an overview of the potential benefits of palmitoylethanolamide and other natural agents. Santonocito S, Donzella M, Venezia P, Nicolosi G, Mauceri R, Isola G. Pharmaceutics. 2023;15:1193. doi: 10.3390/pharmaceutics15041193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Preclinical orofacial pain assays and measures and chronic primary orofacial pain research: where we are and where we need to go. Sadighparvar S, Al-Hamed FS, Sharif-Naeini R, Meloto CB. Front Pain Res (Lausanne) 2023;4:1150749. doi: 10.3389/fpain.2023.1150749. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Genetics of musculoskeletal (TMD) and neuropathic orofacial pain: a narrative review. Korczeniewska OA, Kohli D, Dabek K, Diehl SR, Benoliel R. Front Oral Maxillofac Med. 2023 [Google Scholar]
- 5.Neuropathic orofacial pain. Christoforou J, Balasubramaniam R, Klasser GD. Curr Oral Health Rep. 2015;2:148–157. [Google Scholar]
- 6.Neuropathic orofacial pain: facts and fiction. Baad-Hansen L, Benoliel R. Cephalalgia. 2017;37:670–679. doi: 10.1177/0333102417706310. [DOI] [PubMed] [Google Scholar]
- 7.Machine learning in pain medicine: an up-to-date systematic review. Matsangidou M, Liampas A, Pittara M, Pattichi CS, Zis P. Pain Ther. 2021;10:1067–1084. doi: 10.1007/s40122-021-00324-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Machine learning for predicting chronic diseases: a systematic review. Delpino FM, Costa ÂK, Farias SR, Chiavegatto Filho AD, Arcêncio RA, Nunes BP. Public Health. 2022;205:14–25. doi: 10.1016/j.puhe.2022.01.007. [DOI] [PubMed] [Google Scholar]
- 9.Machine learning based classification of EEG signal for detection of child epileptic seizure without snipping. Sethy PK, Panigrahi M, Vijayakumar K, Behera SK. Int J Speech Tech. 2021;26:559–570. [Google Scholar]
- 10.Exploring AdaBoost and Random Forests machine learning approaches for infrared pathology on unbalanced data sets. Tang J, Henderson A, Gardner P. Analyst. 2021;146:5880–5891. doi: 10.1039/d0an02155e. [DOI] [PubMed] [Google Scholar]
- 11.Machine learning-based processing of unbalanced data sets for computer algorithms. Zhou Q, Qi Y, Tang H, Wu P. Open Comput Sci. 2023 [Google Scholar]
- 12.Comparing different supervised machine learning algorithms for disease prediction. Uddin S, Khan A, Hossain ME, Moni MA. BMC Med Inform Decis Mak. 2019;19:281. doi: 10.1186/s12911-019-1004-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Update on neuropathic pain treatment for trigeminal neuralgia. The pharmacological and surgical options. Al-Quliti KW. Neurosciences (Riyadh) 2015;20:107–114. doi: 10.17712/nsj.2015.2.20140501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.The efficacy of anticonvulsants on orofacial pain: a systematic review. Martin WJ, Forouzanfar T. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 2011;111:627–633. doi: 10.1016/j.tripleo.2011.01.033. [DOI] [PubMed] [Google Scholar]
- 15.Prediction of antiepileptic drug treatment outcomes of patients with newly diagnosed epilepsy by machine learning. Yao L, Cai M, Chen Y, Shen C, Shi L, Guo Y. Epilepsy Behav. 2019;96:92–97. doi: 10.1016/j.yebeh.2019.04.006. [DOI] [PubMed] [Google Scholar]
- 16.Machine-learning for the prediction of one-year seizure recurrence based on routine electroencephalography. Lemoine É, Toffa D, Pelletier-Mc Duff G, et al. Sci Rep. 2023;13:12650. doi: 10.1038/s41598-023-39799-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Deep reinforcement learning for optimal critical care pain management with morphine using dueling double-deep Q networks. Lopez-Martinez D, Eschenfeldt P, Ostvar S, Ingram M, Hur C, Picard R. Annu Int Conf IEEE Eng Med Biol Soc. 2019 doi: 10.1109/EMBC.2019.8857295. [DOI] [PubMed] [Google Scholar]




