Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ll7/issue48 retrain the robot with a reward that penalizes quick action changes #54

Merged
Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
d40acce
fix: adjust input and output parameters, delete deprecated seed method
JuliusMiller Aug 28, 2024
2eba09b
add punish_action_reward
ll7 Aug 28, 2024
13ef7ec
extend the reward dictionary to include information about the action …
ll7 Aug 28, 2024
b4e4188
create new train script for ppo with action punish
ll7 Aug 28, 2024
d876549
remove setting last action too early
ll7 Aug 28, 2024
e85ac16
increase timesteps to be trained
ll7 Aug 28, 2024
eec41b0
Add git_submodule.sh script for recursive submodule update
ll7 Sep 11, 2024
9778259
chore: Add SLURM user queue script
ll7 Sep 11, 2024
904d4fe
chore: Add SLURM training script
ll7 Sep 11, 2024
1e1c3a4
chore: Update SLURM training script to include PPO training for robot_sf
ll7 Sep 11, 2024
0a76b3e
feat: Update SLURM training script to specify slurm server for robot_…
ll7 Sep 11, 2024
964b073
chore: Add .gitignore file for SLURM directory for *.out files
ll7 Sep 11, 2024
0e3ba9d
chore: Add SLURM load_module.sh script
ll7 Sep 11, 2024
09d7269
train 10m steps
ll7 Sep 13, 2024
c280e3b
add sbatch note
ll7 Sep 13, 2024
39c81ae
chore: Add .cursorrules file
ll7 Sep 17, 2024
155252e
chore: Update SLURM training script to specify job name and partition…
ll7 Sep 17, 2024
42aa3a2
add retrained model for evaluation
ll7 Sep 17, 2024
41e8e34
do not ignore global models
ll7 Sep 17, 2024
0e46529
chore: Refactor SLURM training script for robot_sf
ll7 Sep 17, 2024
defd7a5
chore: Update env_test.py to handle termination and truncation in tes…
ll7 Sep 23, 2024
825c9ff
Update sb3_test.py to include additional information in the observati…
ll7 Sep 23, 2024
f4f0ce0
chore: Update robot_env.py
ll7 Sep 23, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
train 10m steps
  • Loading branch information
ll7 committed Sep 13, 2024
commit 09d72697eaadddcd6a998ccde9ec8f18797e2ee9
2 changes: 1 addition & 1 deletion SLURM/slurm_PPO_robot_sf.py
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ def make_env():

logger.info("start learning")
model.learn(
total_timesteps=6_000_000,
total_timesteps=10_000_000,
progress_bar=True,
callback=combined_callback
)
Expand Down