Skip to main content
. 2020 Jun 3;117(48):30046–30054. doi: 10.1073/pnas.1907367117

Table 3.

Results of structural probes on the WSJ SD test set (baselines in the top half, models hypothesized to encode syntax below)

Distance Depth
Method UUAS (%) DSpr. Root% NSpr.
Linear 48.9 0.58 2.9 0.27
Proj0 59.8 0.73 64.4 0.75
BERT 81.7 0.87 90.1 0.89