Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bbh测试集之前可以测,现在测不了了 #202

Closed
charliedream1 opened this issue Nov 14, 2024 · 3 comments
Closed

bbh测试集之前可以测,现在测不了了 #202

charliedream1 opened this issue Nov 14, 2024 · 3 comments
Labels
bug Something isn't working native

Comments

@charliedream1
Copy link

bbh测试集之前可以测,现在测不了了。会提示不在支持的测试集列表内

@wangxingjun778
Copy link
Collaborator

BBH前期有多个用户有report在使用中会出现import出错的问题(目前看是偶发,可能跟环境有关),在0.6.0版本做了临时移除,防止在以上环境block评测链路;
可以使用如下版本:
pip install evalscope==0.6.0rc0 来使用BBH (跟0.6.0的唯一区别只有BBH)

偶发问题我们会尽快定位。

@charliedream1
Copy link
Author

@Yunnglin Yunnglin added bug Something isn't working native labels Nov 26, 2024
@Yunnglin
Copy link
Collaborator

bbh目前可以使用了,请安装最新版本evalscope

由于长时间未收到活动,我们将关闭此问题。如果您有任何疑问,请随时重新打开它。如果EvalScope对您有所帮助,欢迎给我们点个STAR以示支持,谢谢!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working native
Projects
None yet
Development

No branches or pull requests

3 participants