Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于复现实验结果出现偏差 #3

Open
lssshuang opened this issue Jan 8, 2024 · 1 comment
Open

关于复现实验结果出现偏差 #3

lssshuang opened this issue Jan 8, 2024 · 1 comment

Comments

@lssshuang
Copy link

作者您好,我将您的代码下载下来,并按照论文提到的参数配置跑实验,发现实验结果并没有您论文里写的那么高,其中在nell数据集下跑出的结果是0.432,您能说一下参数配置和达到最好效果的epoch是多少吗,期待您的回复,感谢

@RManLuo
Copy link
Owner

RManLuo commented Jan 8, 2024

您好,感谢您对我们工作的兴趣。相同现象我们也有发现,由于neural process需要从分布中采样,所以在训练过程中会导致产生一定波动。根据我们的经验,在当前种子设置下,运行5次左右应该能达到论文汇报的结果。同时,您也可以采用我们公开的checkpoint进行结果复现。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants