Fig. 3.

Adviser Neural Network Architecture. A reinforcement learning trained network receives the internal state (angle vector) and the sensor information as input. With this composite “image” the network has to learn to generate changes (predictions) in the protein folding that improve the probability of obtaining useful structures.