TABLE III.

Quantitative result of all methods on the evaluation data. The first and second rows (‘average’, ‘median’ etc.) correspond to the aggregation method within each image pair and over all image pairs, respectively. The table is sorted by ARMrTRE (in bold). Rank corresponds to workshop results, missing numbers = insufficient information.

method	rank	Average rTRE		Median rTRE		Max rTRE		Robustness		Median rTRE	Max rTRE	Average time [min]
		Average	Median	Average	Median	Average	Median	Average	Median	Average Rank
		(AArTRE)		(AMrTRE)		(AMxrTRE)		R		(ARMrTRE)	(ARMxrTRE)
initial		0.1340	0.0684	0.1354	0.0665	0.2338	0.1157	-	-	-		-
MEVIS	1	0.0044	0.0027	0.0029	0.0018	0.0251	0.0188	0.9880	1.0000	2.84	5.04	0.17
AGH	3	0.0053	0.0032	0.0036	0.0019	0.0283	0.0225	0.9821	1.0000	3.42	6.00	6.55
UPENN	2	0.0042	0.0029	0.0029	0.0019	0.0239	0.0190	0.9898	1.0000	3.47	4.29	1.60
CKVST	4	0.0043	0.0032	0.0027	0.0023	0.0239	0.0189	0.9883	1.0000	4.41	5.27	7.80
TUB	5	0.0089	0.0029	0.0078	0.0021	0.0280	0.0178	0.9845	1.0000	4.53	3.81	0.02
TUNI	6	0.0064	0.0031	0.0048	0.0021	0.0287	0.0204	0.9823	1.0000	5.32	5.80	9.73
DROP*		0.0861	0.0042	0.0867	0.0028	0.1644	0.0273	0.8825	0.9892	7.06	7.43	3.99
ANTs*		0.0991	0.0072	0.0992	0.0058	0.1861	0.0351	0.7889	0.9714	9.23	7.79	48.24
RVSS*		0.0472	0.0063	0.0448	0.0046	0.1048	0.0275	0.8155	0.9928	9.65	8.42	5.25
bUnwarpJ*		0.1097	0.0290	0.1105	0.0260	0.1995	0.0727	0.7899	0.9310	9.67	9.37	10.57
Elastix*		0.0964	0.0074	0.0956	0.0054	0.1857	0.0353	0.8477	0.9722	10.04	8.88	3.50
UA	10	0.0536	0.0100	0.0506	0.0082	0.1124	0.0353	0.8209	0.9853	10.28	8.83	1.70
NiftyReg*		0.1120	0.0372	0.1136	0.0355	0.2010	0.0714	0.7427	0.8519	11.08	10.08	0.14

^{* =}methods added by the organizers.