New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Questions about atari evaluation protocol #54

Open

jmkim0309 opened this issue Aug 16, 2021 · 0 comments

jmkim0309 commented Aug 16, 2021

Hi @lespeholt, thank you for this great work.

I have some questions about Atari evaluation protocol as follows:

Did you use separate evaluation episodes for testing? If you did, how many evaluation episodes were used?
How many random seeds are used and averaged for evaluation?
Did you use sticky action for training or testing?
Did you use life-loss heuristic for training or testing?
At the evaluation phase, did you use mode of the policy or sample of the policy?
What is the standard evaluation protocol for Atari 57?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment