Using EMA on the generator markedly improves the validation loss

[erogol]

Since there was to much fluctuation in the validation loss, I tried EMA with the generator parameters and it improved the validation loss and subjective quality a lot

[erogol]

there are bing jumps when commitment loss reduces suddenly due to probably reassignment of the codebooks

[jishengpeng]

Since there was to much fluctuation in the validation loss, I tried EMA with the generator parameters and it improved the validation loss and subjective quality a lot

Thanks for the reminder, we will try EMA in WavTokenizer2.