Use more than one GPU to increase translations speed

[edvardasast]

Hi,

I would like to use more than one GPU to increase translations speed is it possible? I am using docker container with GPU support.
As you could see in the screenshot bellow now it is using only one GPU at a time.
https://imgur.com/a/OuBoAWg

[martin-kirilov]

Could you try adding --gpus all to your nvidia-docker run command? Something like:
nvidia-docker run --gpus all -p 8888:8888 opus-mt-gpu:latest

[edvardasast]

Could you try adding --gpus all to your nvidia-docker run command? Something like: nvidia-docker run --gpus all -p 8888:8888 opus-mt-gpu:latest

Yes, I have done that, but it looks that system is not for multi gpu processing because it use only one GPU at a time and if I increase load translations speed dropping, but system do not start to use more GPUs for processing requests.