Table 13.
Sentiment classification on different datasets according to the different number of distinct windows (before random selection).
| Android | |||||||
|---|---|---|---|---|---|---|---|
| Model | Metric\window | 1 | 2 | 3 | 4 | 5 | 6 |
| WJST | Accuracy1 | 0.8375 | 0.78 | 0.7925 | 0.7425 | 0.725 | 0.9075 |
| Accuracy2 | 0.83 | 0.77 | 0.7775 | 0.735 | 0.725 | 0.9075 | |
| Perplexity | 18.3948 | 16.7266 | 16.7303 | 16.166 | 15.9499 | 15.1128 | |
| Topic_Coh | −1.4063 | −0.9279 | −0.5547 | −1.2929 | −1.7475 | −0.746 | |
| WJST1 | Accuracy1 | 0.8975 | 0.8525 | 0.81 | 0.8675 | 0.755 | 0.8025 |
| Accuracy2 | 0.8825 | 0.83 | 0.7925 | 0.8675 | 0.75 | 0.7875 | |
| Perplexity | 19.3734 | 18.0031 | 16.6787 | 16.8518 | 16.1015 | 16.5461 | |
| Topic_Coh | −2.2084 | −1.6272 | −0.1870 | −0.7753 | −1.328 | −1.7836 | |
|
| |||||||
| Automotive | |||||||
| WJST | Accuracy1 | 0.7775 | 0.74 | 0.755 | 0.735 | 0.7375 | 0.69 |
| Accuracy2 | 0.7725 | 0.745 | 0.7475 | 0.745 | 0.725 | 0.685 | |
| Perplexity | 23.6365 | 21.7712 | 21.2008 | 20.9688 | 20.5095 | 19.6748 | |
| Topic_Coh | −1.1684 | −1.7095 | −1.6542 | −0.2824 | −1.7604 | −0.1311 | |
| WJST1 | Accuracy1 | 0.805 | 0.8125 | 0.8 | 0.7575 | 0.78 | 0.7725 |
| Accuracy2 | 0.805 | 0.7975 | 0.79 | 0.755 | 0.78 | 0.7725 | |
| Perplexity | 23.2684 | 22.2601 | 21.4357 | 20.8092 | 20.5091 | 20.2379 | |
| Topic_Coh | −1.7318 | −0.5912 | −1.1883 | −0.7637 | −0.62 | −0.5134 | |
|
| |||||||
| Electronic | |||||||
| WJST | Accuracy1 | 0.845 | 0.7675 | 0.8625 | 0.7325 | 0.7775 | 0.7325 |
| Accuracy2 | 0.845 | 0.7575 | 0.875 | 0.7275 | 0.7825 | 0.7225 | |
| Perplexity | 22.561 | 22.0462 | 20.5489 | 20.7952 | 20.7495 | 20.0283 | |
| Topic_Coh | −0.8471 | −0.6207 | −2.0442 | −1.4345 | −0.786 | −0.9412 | |
| WJST1 | Accuracy1 | 0.8025 | 0.875 | 0.79 | 0.8675 | 0.8625 | 0.835 |
| Accuracy2 | 0.7975 | 0.87 | 0.8 | 0.865 | 0.8625 | 0.8375 | |
| Perplexity | 23.5903 | 23.546 | 22.6012 | 22.8559 | 21.8897 | 21.4464 | |
| Topic_Coh | −0.8251 | −0.9581 | −1.1683 | −1.2189 | −0.8492 | −0.3402 | |
|
| |||||||
| Movie | |||||||
| WJST | Accuracy1 | 0.855 | 0.815 | 0.7225 | 0.6575 | 0.7 | 0.765 |
| Accuracy2 | 0.845 | 0.7975 | 0.71 | 0.6625 | 0.685 | 0.765 | |
| Perplexity | 24.5779 | 24.5153 | 23.1145 | 23.1209 | 23.2709 | 22.2328 | |
| Topic_Coh | −0.4063 | −0.0216 | −0.0751 | −2.5351 | −0.0888 | −0.0791 | |
| WJST1 | Accuracy1 | 0.9725 | 0.9775 | 0.97 | 0.965 | 0.575 | 0.595 |
| Accuracy2 | 0.96 | 0.965 | 0.9625 | 0.955 | 0.5875 | 0.5725 | |
| Perplexity | 26.117 | 25.09 | 24.6302 | 23.9778 | 22.7068 | 22.3572 | |
| Topic_Coh | −0.1348 | −0.1348 | −0.1348 | −0.0315 | −0.0378 | −0.0106 | |
|
| |||||||
| Average section | |||||||
| WJST | Accuracy1 | 0.8287 | 0.7756 | 0.7831 | 0.7168 | 0.735 | 0.7737 |
| Accuracy2 | 0.8231 | 0.7675 | 0.7775 | 0.7175 | 0.7293 | 0.77 | |
| Perplexity | 22.2925 | 21.2648 | 20.3986 | 20.2627 | 20.1199 | 19.2621 | |
| Topic_Coh | −0.957 | −0.8199 | −1.082 | −1.3862 | −1.0956 | −0.4743 | |
| WJST1 | Accuracy1 | 0.8693 | 0.8793 | 0.8425 | 0.8643 | 0.7431 | 0.7512 |
| Accuracy2 | 0.8612 | 0.8656 | 0.8362 | 0.8606 | 0.745 | 0.7425 | |
| Perplexity | 23.0872 | 22.2248 | 21.3364 | 21.1236 | 20.3017 | 20.1469 | |
| Topic_Coh | −1.225 | −0.8278 | −0.6696 | −0.6973 | −0.7087 | −0.6619 | |