should the value update_after_step be larger then the value of warmup steps?

[JohnHerry]

Thanks for the work, I have no experience about ema training before, so there are many init values to make an EMA object. Is that all default value are best for normalliy use cases? eg. If I have a training instance that contains tens of thousands steps, will it make difference on the update_after-step parameter? thanks.