Table 7.
Kernel | Weight | Feature Space | 2008 | 2014 | Combined 2008/2014 | % Change 2008, 2014 | % Change 2008, Comb. | % Change 2014, Comb. |
---|---|---|---|---|---|---|---|---|
RBF | tf-idf | Min & CUI | 0.932†† | 0.957 | 0.964 | 2.63** | 3.48** | 0.83 |
RBF | tf-idf | Min, Lex & CUI | 0.946†† | 0.959 | 0.963 | 1.30 | 1.78** | 0.47 |
RBF | tf-idf | Lex & CUI | 0.926†† | 0.958 | 0.959 | 3.46** | 3.56** | 0.10 |
RBF | tf-idf | Min & Lex | 0.939†† | 0.956 | 0.959 | 1.81** | 2.09** | 0.27 |
Linear | tf-idf | Min, Lex & CUI | 0.939†† | 0.941†† | 0.958 | 0.19 | 2.08** | 1.88** |
Linear | tf-idf | Min & CUI | 0.934†† | 0.945†† | 0.956† | 1.22 | 2.41** | 1.18 |
Linear | tf-idf | Lex | 0.907†† | 0.946†† | 0.956 | 4.23** | 5.32** | 1.05 |
Linear | tf-idf | Lex & CUI | 0.910†† | 0.942†† | 0.955 | 3.46** | 4.95** | 1.44 |
RBF | tf-idf | Lex | 0.927†† | 0.958 | 0.954† | 3.27** | 2.91** | −0.35 |
RBF | Count | Min | 0.870†† | 0.949†† | 0.954 | 9.11** | 9.72** | 0.55 |
RBF | tf-idf | Min | 0.909†† | 0.956† | 0.953†† | 5.15** | 4.86** | −0.27 |
RBF | Count | Min & Lex | 0.880†† | 0.946†† | 0.953 | 7.43** | 8.25** | 0.77 |
RBF | Count | Min, Lex & CUI | 0.880†† | 0.942†† | 0.953 | 7.08** | 8.37** | 1.20 |
Linear | tf-idf | Min | 0.927†† | 0.952†† | 0.949†† | 2.63** | 2.33** | −0.29 |
Linear | tf-idf | Min & Lex | 0.911†† | 0.949†† | 0.948†† | 4.13** | 4.08** | −0.05 |
RBF | Count | Lex & CUI | 0.877†† | 0.950†† | 0.948†† | 8.39** | 8.12** | −0.24 |
RBF | Count | Lex | 0.911†† | 0.950†† | 0.948†† | 4.27** | 4.02** | −0.24 |
Linear | Count | Min & CUI | 0.842†† | 0.943†† | 0.946†† | 11.99** | 12.26** | 0.24 |
Linear | Count | Lex & CUI | 0.916†† | 0.946†† | 0.945†† | 3.28** | 3.09** | −0.19 |
Linear | Count | Lex | 0.830†† | 0.946†† | 0.943†† | 13.99** | 13.64** | −0.31 |
Linear | Count | Min | 0.830†† | 0.943†† | 0.943†† | 13.72** | 13.68** | −0.03 |
RBF | Count | Min & CUI | 0.870†† | 0.949†† | 0.943†† | 9.06** | 8.36** | −0.65 |
Linear | Count | Min, Lex & CUI | 0.796†† | 0.944†† | 0.942†† | 18.53** | 18.27** | −0.22 |
Linear | Count | Min & Lex | 0.850†† | 0.944†† | 0.942†† | 11.06** | 10.82** | −0.22 |
RBF | tf-idf | CUI | 0.869†† | 0.866†† | 0.883†† | −0.29 | 1.64 | 1.94 |
Linear | tf-idf | CUI | 0.864†† | 0.844†† | 0.877†† | −2.32 | 1.50 | 3.91** |
RBF | Count | CUI | 0.882†† | 0.789†† | 0.812†† | −10.52** | −7.88** | 2.96 |
Linear | Count | CUI | 0.811†† | 0.799†† | 0.804†† | −1.47 | −0.95 | 0.53 |
* percent change significant at alpha = 0.05
percent change significant at alpha = 0.1
statistically significantly different from highest performing model (emphasized above) at alpha = 0.05
statistically significantly different from highest performing model (emphasized above) at alpha =0.1
Note: For visual reference, models which are not statistically significantly different from the emphasized model at alpha = 0.1 are shaded in dark grey. Models which are not statistically significantly different from the emphasized model at alpha = 0.05 are shaded in light grey