Confused on MaxConcurrency

[josh-chan]

• setup a workerpool with 10 Concurrency,
• I have 5 servers running the worker process
• most of time, only 1 server is running 10 jobs, other servers are idle

I expect every server has 10 concurrency jobs running. how can I do this?

[josh-chan]

@taylorchu how about v2 handle this?

[taylorchu]

In v2, we don't have perfect load balancing but the workload should be more evenly distributed.

Some details in v2:

1. because each worker will prefetch multiple jobs in bulk by a fixed amount of execution time (to reduce load on redis and
   kernel system calls), it depends on how the max execution time per job is defined. For example, if we prefetch 60s chunk of jobs, and your max execution time is 10s. each worker goroutine will fetch at most 6 jobs. This might cause the other workers to be idle if you only have 6 jobs in total, but this should be a rare case.
2. in a normal case, all 5 * 10 = 50 worker goroutines will compete evenly on who can run that 10 concurrent jobs across 5 servers at any given time.