Replies: 1 comment 1 reply
-
50000 steps is enough to train a new model from scratch. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Using dreambooth for training,I have a dataset of 500 pics, which includes 5 concepts. Firstly, I trained it with 25000 steps, and it's performance was not so good, so i resumed training another 25000 steps, the model failed and outputed a mess. And then, i trained the model with 500 pics 50000 steps one time, it performed well. But i have no idea if it will get better after another steps.
So i have two questiones, the first is training a model with (A+B) steps one time performs as well as A steps trained and another B steps? The second is if resuming training for another too many steps such as 10000 steps will destroy the model's performance?
Due to the consumption of computational unit and runtime limits in colab, i can't train a model from zero with too too too many steps everytime to see if it get better.
Beta Was this translation helpful? Give feedback.
All reactions