Table A1.

Asymptomatic computation of weight parameters used by an inexpensive version of the Inception module.

Operation number	Input shape	Output shape	Number of weight parameters (asymptomatically)
Operation 1	$\sqrt{N}\times \sqrt{N}\times M$	$\sqrt{N}\times \sqrt{N}\times F_1$	$F_1\times M\times 1\times 1=F_1\times M= \mathcal{O}(F_{1}M)$
Operation 2	$\sqrt{N}\times \sqrt{N}\times M$	$\sqrt{N}\times \sqrt{N}\times F_2$	$F_2\times M\times 1\times 1=F_2\times M=\mathcal{O}(F_{2}M)$
Operation 3	$\sqrt{N}\times \sqrt{N}\times M$	$\sqrt{N}\times \sqrt{N}\times F_3$	$F_3\times M\times 1\times 1=F_3\times M=\mathcal{O}(F_{3}M)$
Operation 4	$\sqrt{N}\times \sqrt{N}\times M$	$\sqrt{N}\times \sqrt{N}\times M$	0 (max-pooling operation does not require any weight parameters)
Operation 5	$\sqrt{N}\times \sqrt{N}\times F_2$	$\sqrt{N}\times \sqrt{N}\times F_5$	$F_2\times F_5\times 3\times 3=9\times F_2\times F_5=\mathcal{O}(F_2{F}_5)$
Operation 6	$\sqrt{N}\times \sqrt{N}\times F_3$	$\sqrt{N}\times \sqrt{N}\times F_6$	$F_3\times F_6\times 5\times 5=25\times F_3\times F_6=\mathcal{O}(F_3{F}_6)$
Operation 7	$\sqrt{N}\times \sqrt{N}\times M$	$\sqrt{N}\times \sqrt{N}\times F_7$	$F_7\times M\times 1\times 1=F_7\times M=\mathcal{O}(F_{7}M)$