Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

怎么设置random seed控制train dpo随机性 #953

Open
pingbowen23 opened this issue Oct 20, 2024 · 2 comments
Open

怎么设置random seed控制train dpo随机性 #953

pingbowen23 opened this issue Oct 20, 2024 · 2 comments

Comments

@pingbowen23
Copy link

这是我的dpo文件,文件中 242行, seed=None
1
这是xtuner的train.py文件,文件中有--seed 参数
2

如果我想控制dpo的随机性 如何正确设置seed? 应该在哪个文件修改?

@gom168
Copy link

gom168 commented Nov 18, 2024

有解决吗?我设置了seed以后dpo还是有随机性,但是用orpo训练就可以保证没有随机性了

@pingbowen23
Copy link
Author

有解决吗?我设置了seed以后dpo还是有随机性,但是用orpo训练就可以保证没有随机性了

没有解决,dpo的loss还是有随机性;也没人回复。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants