Algorithm 1 Layer-wise PSM

1:$l.latency:$ Execution time on CPU or GPU per layer 2:$l.FPBPdatacopy:$ Data transfer time on FP and BP per layer 3:$l.UPdatacopy:$ Data transfer time on UP per layer 4:for $i=0\to net.numberOfLayers$ do 5:    $l=net.layers\left[i\right]$ 6:    $min=\infty$ 7:    if $l.update$$is$$True$ then 8:        $l.processor=0$ 9:        for $j=0\to 8$ do 10:           $temp=l.latency\left[i\right]+l.FPBPdatacopy\left[j\right]+l.UPdatacopy\left[j\right]$ 11:           if $min>temp$ then 12:               $min=temp$ 13:               $net.processors\left[i\right]=j$ 14:    else 15:        for $j=0\to 4$ do 16:           $temp=l.latency\left[i\right]+l.FPBPdatacopy\left[j\right]$ 17:           if $min>temp$ then 18:               $min=temp$ 19:               $net.processors\left[i\right]=j$  return $net.processors$