Figure 1.

The evolution of deep learning techniques over time.

The concept of neural networks originated in the 1940s and expanded with the development of shallow neural networks in the 1960s. Several artificial intelligence winters stemmed from intellectual roadblocks in the field. Eventually, the supervised and unsupervised deep learning methods widely utilized in modern research arose, as deep neural networks became a critical component of computing (Emmert-Streib et al., 2020- for a more in-depth history, see this review as well as Schmidhuber, 2015).