Figure 2.

General scheme of the load balancing problem. (A) Workload imbalance condition. The overall computation performance will be reduced to the heavily loaded node if the number of sequence threads cannot be equally scheduled to the individual nodes. There will be one more thread on a heavily loaded node than on a lightly loaded node. (B) The idle node-seeking task algorithm (INSTA) overcomes load imbalance through timely assignment of new jobs to sleeping nodes, resulting in the equal distribution of work threads to all nodes.