About training duration

[RohollahHS]

Hi, could you please clarify how long (days) it took to train MaskGIT on ImageNet 256x256 with 8 A100 GPUs? Unfortunately, I couldn't understand the training duration from the description provided.

Thanks

[llvictorll]

Hello,

Training the model requires 768 GPU hours. This means that using a single GPU, the model would take 768 hours to train. However, with 8 GPUs, the training time would be reduced to 768/8 = 96 hours to reach similar performance.

I hope this clarification helps.

Best regards,
Victor