Dall-E training with low ressources (cuda memory error)

[Carlsans]

Hi, I'm trying to train a picture set ( about 400) with train_vae and train_dalle scripts. The VAE went well but the dalle is just buging. I have only 4Gb of graphic memory, is there a way to do training anyway. Would a 500 $ investment for a 12Gb video card be a good idea ? Thanks :)