Table 2.
Verification results of ACAS Xu networks.
ACAS XU ![]() |
SAT | UNSAT | UNK | TIMEOUT | TIME(s) | ||
---|---|---|---|---|---|---|---|
1 h | 2 h | 10 h | |||||
Reluplex | 3 | 42 | 0 | 2 | 0 | 0 | 28454 |
Marabou | 3 | 42 | 0 | 1 | 0 | 0 | 19466 |
Marabou DnC | 3 | 42 | 0 | 3 | 3 | 1 | 111880 |
ReluVal | 3 | 42 | 0 | 0 | 0 | 0 | 416 |
Zonotope | 0 | 2 | 43 | 0 | 0 | 0 | 3 |
Abstract Domain | 0 | 0 | 45 | 0 | 0 | 0 | 8 |
NNV Exact Star | 3 | 42 | 0 | 0 | 0 | 0 | 1371 |
NNV Appr. Star | 0 | 29 | 16 | 0 | 0 | 0 | 52 |
ACAS XU ![]() |
|||||||
Reluplex | 3 | 42 | 0 | 0 | 0 | 0 | 11880 |
Marabou | 3 | 42 | 0 | 0 | 0 | 0 | 8470 |
Marabou DnC | 3 | 42 | 0 | 2 | 2 | 0 | 25110 |
ReluVal | 3 | 42 | 0 | 0 | 0 | 0 | 27 |
Zonotope | 0 | 1 | 44 | 0 | 0 | 0 | 5 |
Abstract Domain | 0 | 0 | 45 | 0 | 0 | 0 | 7 |
NNV Exact Star | 3 | 42 | 0 | 0 | 0 | 0 | 470 |
NNV Appr. Star | 0 | 32 | 13 | 0 | 0 | 0 | 19 |