Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
FarukhS52 authored Oct 15, 2024
1 parent 58a1ae2 commit 0cefdfc
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/nextqa/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ CUDA_VISIBLE_DEVICES=0 python aria/train.py --config examples/nextqa/config_lora
```

## Full Params
Full paramater finetuning is feasible with 8 H100 GPUs, using `ZeRO3` and `Offload Parameter`. The command is as following:
Full parameter finetuning is feasible with 8 H100 GPUs, using `ZeRO3` and `Offload Parameter`. The command is as following:
```bash
accelerate launch --config_file recipes/accelerate_configs/zero3_offload.yaml aria/train.py --config examples/nextqa/config_full.yaml --output_dir [YOUR_OUT_DIR]
```
Expand Down

0 comments on commit 0cefdfc

Please sign in to comment.