Skip to main content
. Author manuscript; available in PMC: 2017 Oct 1.
Published in final edited form as: Neural Comput. 2016 Aug 24;28(10):2063–2090. doi: 10.1162/NECO_a_00876
  computation_time = pc.step_time()
  max_comp_time = pc.step_time() + pc.step_wait()
  avg_comp_time = pc.allreduce(computation_time, 1)/nhost
  load_balance = avg_comp_time/max_comp_time