New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

train_llava关于保存权重文件的问题 #196

Open

weiaicunzai opened this issue Oct 31, 2024 · 0 comments

weiaicunzai commented Oct 31, 2024

请问一下, train_llava保存权重是保存最后一个epoch的权重吗？

感谢大佬的开源。我主要是小模型的经验比较多。小模型的话，会有个验证集，训练时候保存每轮在验证集最高的权重。但是大模型目前代码中没有看到有验证集，好像是直接就训练完保存了。这样如何确保保存训练中最好的一个权重呢？

保存权重相关代码

    trainer.train()
    trainer.save_state()
    trainer.save_model(output_dir=training_args.output_dir)

The text was updated successfully, but these errors were encountered:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment