Table 1. Complete descriptions of the movies annotated by human observers.

Movie names	Length	Well # used for training	Genotypes of flies	Genotypes of target flies (wing clipped), if different	Sex combination
033015_NPF3-CsChrimsonattP40MG-2.avi	8 min. 30 sec.	1, 2, 12	w/Y; 20XUAS-CsChrimson:mVenus in attP40/+; NPF-GAL4/+		♂ vs. ♂
041815_1_m_g_Otd-FLPoChrimsonmvenusattP2_f2a20.avi	8 min. 30 sec.	4, 9	w, Tk-GAL41/Y; Otd-nls:FLPo in attP40/+; 20XUAS>stop>CsChrimson:mVenus in attP2/+		♂ vs. ♂
042015_12_m_g_Otd-FLPo ChrimsonmvenusattP2_f10a10.avi	8 min. 30 sec.	3, 10, 11	w, Tk-GAL41/Y; Otd-nls:FLPo in attP40/+; 20XUAS>stop>CsChrimson:mVenus in attP2/+		♂ vs. ♂
042415_4_m_g_Otd-FLPoChrimson TdTomattP2_CsHeis_F2a20.avi	8 min. 30 sec.	1, 4, 9	w, Tk-GAL41/Y; Otd-nls:FLPo in attP40/+; 20XUAS>myr:TopHAT2>CsChrimson:tdTomato in attP2/+	Wild-type (Canton-S) ♂	♂ vs. ♂
042815_assay1.avi	30 min.	6, 7, 9, 12	Wild-type (Canton-S) ♂		♂ vs. ♂
042815_assay4.avi	30 min.	1, 5, 7	Wild-type (Canton-S) ♂	Wild-type (Canton-S) ♀	♂ vs. ♀
050815_assay9.avi	30 min.	9, 11	Wild-type (Canton-S) ♀	Wild-type (Canton-S) ♀	♀ vs. ♀
082615_CSMH_SF.avi	30 min.	1, 3, 5, 7	Wild-type (Canton-S) ♀	Wild-type (Canton-S) ♀	♀ vs. ♀
100815_4.avi	10 min.	1, 4, 10, 12	w, Tk-GAL41/w; Otd-nls:FLPo in attP40/+; 20XUAS>myr:TopHAT2>CsChrimson:tdTomato in attP2, fru4-40/fruM	+/Y; +; fruF/fru4-40	Other (fruM ♀ vs fruF ♂)
2016_02_15_CsMH_M_SH2.avi	5 min.	1	Wild-type (Canton-S) ♂	Wild-type (Canton-S) ♂	♂ vs. ♂
2016_02_15_CsMH_M_SH3.avi	5 min.	2	Wild-type (Canton-S) ♂	Wild-type (Canton-S) ♂	♂ vs. ♂

• Well # was counted from left to right, top to bottom.

• A fly that carries 2 X chromosomes and fru^M/fru^4-40 alleles at the fru locus is called “fruM female”. A fly that carries 1 X chromosome and 1 Y chromosome, and fru^F/fru^4-40 alleles at the fru locus, is called “fruF male”. These nomenclatures are adapted from [22, 24].