Skip to main content
. Author manuscript; available in PMC: 2021 Nov 5.
Published in final edited form as: Proc AAAI Conf Artif Intell. 2021 May 18;35(16):14138–14148.

Figure 4:

Figure 4:

The proposed architecture of efficient self-attention via Nyström approximation. Each box represents an input, output, or intermediate matrix. The variable name and the size of the matrix are inside each box.