Fig. 3.

Results of experiment 1. Training occurred over 1,500 iterations. Each iteration included 100 training games (during which the agent learned), followed by 200 test games to evaluate performance (during which the agent did not learn). The 200 test games were divided into four categories of 50 games each. Each data point shows the mean score among the 50 test games within a test category, and among 5 simulated subjects, spatially smoothed with a 10-iteration moving average. Lighter margin around darker line reflects SE of intersubject variability. (A) Performance on attention tracking task (how well the attention spotlight remained aligned on the ball through the game), for which the agent could earn a maximum of 5 points per game. The blue line denotes performance under normal conditions, identical to the conditions experienced in training. The orange line denotes performance under attention-disabled conditions, wherein the attention spotlight did not reduce visual noise in the subtended area. (B) Performance on ball-catching task (whether the paddle was aligned with the ball by the end of the game), for which the agent could earn a maximum of 2 points per game. The blue line denotes performance under normal conditions, identical to the conditions experienced in training. The orange line denotes performance under attention-disabled conditions, wherein the attention spotlight did not reduce visual noise in the subtended area.