Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question: How are experiment results accessed when doing the paper writeup? #147

Open
neil-vqa opened this issue Nov 7, 2024 · 1 comment

Comments

@neil-vqa
Copy link

neil-vqa commented Nov 7, 2024

Thank you for your contribution to the LLM open source community.

I've been going through the code for several hours now, so from what I understand, the experiment.py file will save the experiment outputs in a final_info.json file. So, I've been looking for how this final_info.json file will be accessed in the perform_writeup function, but I can't seem to see where it is, so that I can access the experimental results. Please can you point out or enlighten me how this works? How can I access the experimental results when performing the writeup? My goal is to tweak the writeup prompt but I need the experiment results. Thank you!

@conglu1997
Copy link
Collaborator

Via the notes.txt file :) Also via the aider context.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants