FIGURE 1.
Integrative framework for ethological neuroscience using machine learning. This schematic summarizes stages for quantification and interpretation of animal behavior with contemporary computational tools. Left: behavioral repertoires range from naturalistic and species-typical actions to conditioned and socially coordinated behaviors, illustrating ecological and cognitive diversity across animal models. Center: multimodal data recording integrates multi-camera video capture, sensory environment monitoring (e.g., sound, odor), physiological measures (e.g., pupil dynamics) and neuronal recordings (electrophysiology, imaging). Middle–right: data analysis pipelines apply pose estimation and feature extraction to video and physiological signals, followed by classifiers and pattern-discovery algorithms (e.g., SVM, k-NN, CNNs) to identify behavioral units and trajectories. Right: the final column explicitly links analysis outputs to explanatory levels, from body kinematics, through actions and movement trajectories, to neural activity. Showing how machine learning uncovers behavioral sequences, hierarchical structure, and joint latent spaces that bridge behavior and brain activity.
