-
Notifications
You must be signed in to change notification settings - Fork 50
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hard-Coded and Unnecessary segments should be removed #158
Comments
I believe we should deeply review the RL brains removing any unnecessary code and generalising them to easily train-test the agents. What do you think? It's important to already consider this issue for #157! We could add a table in the documentation (Github pages webpage) with the information about available brains and how to train-test them. I thinks it's kind of difficult to understand the RL brains now. Tell me what do you think! |
I agree with your suggestion. Just a concern, the DQN implementation by @dcharrezt is not applicable with the current settings as it is in Keras. So I propose we completely shift to pytorch as that will resolve the Keras issue and also ease up the CUDA and Tensorborad integration. I will start working on this, just some minor updates to #157 are pending on my end. |
With this changes that you suggest, the DQN implementation would be just in PyTorch? |
Current Setup:
There is a lot of hard coding which brings a lot of problems when trying to generalize the framework across multiple settings.
To be introduced:
Code will be cleaned and hardcoded segments will be removed, proper parameterization in Configs will be used for all the variables and hyperparameters.
Major Changes:
The overall task of running custom settings with the default config template will be much easy after this.
Eventually, this will be progressed with #157 and will also resolve #43
The text was updated successfully, but these errors were encountered: