Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation doesn't show results for al_harvest and clean_up substrates, and unable to get evaluation working when use_attention is True #20

Open
juandavidvargas19 opened this issue Oct 23, 2023 · 0 comments

Comments

@juandavidvargas19
Copy link

We are starting to test attention mechanisms and we get no evaluation result both with the evaluation.py file as well as with the local_evaluation.py file. We use a working without attention configs.py file and set the attention parameters. We deactivate use_lstm and set use_attention. The evaluation.py results can be seen here: https://drive.google.com/drive/folders/1s2OIwmb_bFjUoJ9O_OnI2BG-GL_fk_gU?usp=sharing. Also, there is a sample here of the result when submitting as well as when doing local evaluation.
error_submission_oct_18.txt
output (1).txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant