Table 1.

Comparison of different neural network models based on the number of layers.

Layer Name	Output Size	18-Layer	34-Layer	50-Layer	101-Layer	152-Layer
conv1	112 × 112	7 × 7, 64, stride 2
		3 × 3 max pool, stride 2
conv2_x	56 × 56	$\left[\begin{array}{c}3\times 3,64\\ 3\times 3,64\end{array}\right]$× 2	$\left[\begin{array}{c}3\times 3,64\\ 3\times 3,64\end{array}\right]$× 3	$\left[\begin{array}{c}1\times 1,64\\ 3\times 3,64\\ 1\times 1,256\end{array}\right]$× 3	$\left[\begin{array}{c}1\times 1,64\\ 3\times 3,64\\ 1\times 1,256\end{array}\right]$× 3	$\left[\begin{array}{c}1\times 1,64\\ 3\times 3,64\\ 1\times 1,256\end{array}\right]$× 3
conv3_x	28 × 28	$\left[\begin{array}{c}3\times 3,128\\ 3\times 3,128\end{array}\right]$× 2	$\left[\begin{array}{c}3\times 3,128\\ 3\times 3,128\end{array}\right]$× 4	$\left[\begin{array}{c}1\times 1,128\\ 3\times 3,128\\ 1\times 1,512\end{array}\right]$× 4	$\left[\begin{array}{c}1\times 1,128\\ 3\times 3,128\\ 1\times 1,512\end{array}\right]$× 4	$\left[\begin{array}{c}1\times 1,128\\ 3\times 3,128\\ 1\times 1,512\end{array}\right]$× 8
conv4_x	14 × 14	$\left[\begin{array}{c}3\times 3,256\\ 3\times 3,256\end{array}\right]$× 2	$\left[\begin{array}{c}3\times 3,256\\ 3\times 3,256\end{array}\right]$× 6	$\left[\begin{array}{c}1\times 1,256\\ 3\times 3,256\\ 1\times 1,1024\end{array}\right]$× 6	$\left[\begin{array}{c}1\times 1,256\\ 3\times 3,256\\ 1\times 1,1024\end{array}\right]$× 23	$\left[\begin{array}{c}1\times 1,256\\ 3\times 3,256\\ 1\times 1,1024\end{array}\right]$× 36
conv5_x	7 × 7	$\left[\begin{array}{c}3\times 3,512\\ 3\times 3,512\end{array}\right]$× 2	$\left[\begin{array}{c}3\times 3,512\\ 3\times 3,512\end{array}\right]$× 3	$\left[\begin{array}{c}1\times 1,512\\ 3\times 3,512\\ 1\times 1,2048\end{array}\right]$× 3	$\left[\begin{array}{c}1\times 1,512\\ 3\times 3,512\\ 1\times 1,2048\end{array}\right]$× 3	$\left[\begin{array}{c}1\times 1,512\\ 3\times 3,512\\ 1\times 1,2048\end{array}\right]$× 3
	1 × 1	Average pool, 1000-d fc, softmax
FLOPs		$1.8\times {10}^9$	$3.6\times {10}^9$	$3.8\times {10}^9$	$7.6\times {10}^9$	$11.3\times {10}^9$