Table 5:

Comparisons of execution and verification results. The definition of each execution is defined in Table 4. Five use cases are assigned according to the combination of executions. In the fifth column and below are the number of files for each reproducibility scale defined in Table 2: level 3 is “Fully Reproduced,” level 2 is “Acceptable Difference,” level 1 is “Unacceptable Difference,” and level 0 is “Not Reproduced.”

ID	Source execution	Target execution	Use case	Level 3	Level 2	Level 1	Level 0
C1	GATK_1st	GATK_2nd	Same environment	0	5	0	0
C2	GATK_1st	GATK_mac	Different environment	0	0	0	5
C3	JGA_1st	JGA_2nd	Same environment	0	4	0	0
C4	JGA_1st	JGA_mac	Different environment	0	0	0	4
C5	RNA-seq_1st	RNA-seq_2nd	Same environment	20	5	0	0
C6	RNA-seq_1st	RNA-seq_mac	Different environment	0	0	0	25
C7	RNA-seq_1st	RNA-seq_v3.6	Different version	13	12	0	0
C8	RNA-seq_1st	RNA-seq_small	Missing dataset	8	5	7	5
C9	RNA-seq_1st	RNA-seq_2nd	All output files	557	306	1	8