Skip to main content
. 2023 Jan 1;7(1):22–47. doi: 10.1162/netn_a_00281

Figure 3. .

Figure 3. 

The attention mechanism within the spatial block. Similarity between the features of each voxel (query) and other voxels (keys) within the FC network is calculated through the dot product process and is reweighted during the training process to create the attention weights for the input sequence.