Small Scale Training - POC

[Rane90]

Hi,

Thank you for creating this great repo.

Is there any code to train a model on a small-scale dataset? I don't have the resources to train this model ("Training VAR-d16 for 200 epochs on ImageNet 256x256 costs 2.5 days on 16 A100s"), and I would like to have some form of POC.

Would it work for, say, CIFAR10? As the resolution is very small (32x32).

Is there any available code/script for this? Has anyone else tried this?

Thanks