Figure 3. Prediction model performance and importance per predictive variable.
(A) Visualization of the performance of our prediction model. Our prediction model performs with an average area under the curve (AUC) of the receiver operating curve (ROC, blue line) of 0.78 (standard deviation: 0.08). All the dots on the ROC represent a threshold between 0 and 1 for accepting a probability to be a weak responder to be true. Every threshold leads to a different true positive rate and false positive rate. The red circle represents the threshold corresponding with B. The orange line represents chance level in which true positive rates equal true negative rates. (B) Confusion Matrix of the example when 0.29 is chosen as a threshold for accepting the probability to be a weak responder (red circle in A). The true positive rate of 0.80 results in 24 out of 30 true weak responders getting a true weak prediction. The false positive rate of 0.24 results in 14 out of 59 true strong responders getting a false weak prediction. The classification accuracy is 0.78 with 69 out of 89 correct predicted patients. (C) Relative influence of all preoperative predictive variables. The blue bars represent the normalized Odds Ratios. The heights represent the effect on prediction outcome of a 1 unit increase in the specific variable, while all other variables stay equal. AUC, area under the curve; DBS, deep brain stimulation; H&Y, Hoehn & Yahr scale; LEDD, levodopa equivalent daily dosage; Levodopa response, difference between UPDRS III off-medication minus UPDRS III on-medication; off, off-medication; on, on-medication; ROC, receiver operate characteristic; TEED, total electrical energy delivered; UPDRS, Unified Parkinson Disease Rating Scale; PD, Parkinson’s disease.