Bump accelerate from 0.28.0 to 0.29.3

[dependabot]

Bumps accelerate from 0.28.0 to 0.29.3.

Release notes

Sourced from accelerate's releases.

v0.29.3: Patchfix

• Fixes issue with backend refactor not working on CPU-based distributed environments by @​jiqing-feng: huggingface/accelerate#2670
• Fixes issue where load_checkpoint_and_dispatch needs a strict argument
• by @​SunMarc: huggingface/accelerate#2641

Full Changelog: huggingface/accelerate@v0.29.2...v0.29.3

v0.29.2: Patchfix

• Fixes xpu missing parenthesis huggingface/accelerate#2639
• Fixes XLA and performance degradation on init with the state huggingface/accelerate#2634

v0.29.1: Patchfix

Fixed an import which would cause running accelerate CLI to fail if pytest wasn't installed

v0.29.0: NUMA affinity control, MLU Support, and DeepSpeed Improvements

Core

• Accelerate can now optimize NUMA affinity, which can help increase throughput on NVIDIA multi-GPU systems. To enable it either follow the prompt during accelerate config, set the ACCELERATE_CPU_AFFINITY=1 env variable, or manually using the following:

from accelerate.utils import set_numa_affinity
For GPU 0
set_numa_affinity(0)

Big thanks to @​stas00 for the recommendation, request, and feedback during development

• Allow for setting deterministic algorithms in set_seed by @​muellerzr in huggingface/accelerate#2569
• Fixed the test script for TPU v2/v3 by @​vanbasten23 in huggingface/accelerate#2542
• Cambricon MLU device support introduced by @​huismiling in huggingface/accelerate#2552
• A big refactor was performed to the PartialState and AcceleratorState to allow for easier future-proofing and simplification of adding new devices by @​muellerzr in huggingface/accelerate#2576
• Fixed a reproducibility issue in distributed environments with Dataloader shuffling when using BatchSamplerShard by @​universuen in huggingface/accelerate#2584
• notebook_launcher can use multiple GPUs in Google Colab if using a custom instance that supports multiple GPUs by @​StefanTodoran in huggingface/accelerate#2561

Big Model Inference

• Add log message for RTX 4000 series when performing multi-gpu inference with device_map which can lead to hanging by @​SunMarc in huggingface/accelerate#2557
• Fix load_checkpoint_in_model behavior when unexpected keys are in the checkpoint by @​fxmarty in huggingface/accelerate#2588

DeepSpeed

• Fix issue with the mapping of main_process_ip and master_addr when not using standard as deepspeed launcher by @​asdfry in huggingface/accelerate#2495
• Improve deepspeed env gen by checking for bad keys, by @​muellerzr and @​ricklamers in huggingface/accelerate#2565
• We now support custom deepspeed env files. Like normal deepspeed, set it with the DS_ENV_FILE environmental variable by @​muellerzr in huggingface/accelerate#2566
• Resolve ZeRO-3 Initialization Failure in already-started distributed environments by @​sword865 in huggingface/accelerate#2578

What's Changed

• Fix test_script.py on TPU v2/v3 by @​vanbasten23 in huggingface/accelerate#2542
• Add mapping main_process_ip and master_addr when not using standard as deepspeed launcher by @​asdfry in huggingface/accelerate#2495
• split_between_processes for Dataset by @​geronimi73 in huggingface/accelerate#2433
• Include working driver check by @​muellerzr in huggingface/accelerate#2558
• 🚨🚨🚨Move to using tags rather than latest for docker images and consolidate image repos 🚨 🚨🚨 by @​muellerzr in huggingface/accelerate#2554
• Add Cambricon MLU accelerator support by @​huismiling in huggingface/accelerate#2552
• Add NUMA affinity control for NVIDIA GPUs by @​muellerzr in huggingface/accelerate#2535

... (truncated)

Commits

• e82de12 Release: v0.29.3
• 02f6abc add strict arg to load_checkpoint_and_dispatch (#2641)
• fa0bd40 fix backend check (#2670)
• 39e0a8e Release: v0.29.2
• 759a933 Patch for v0.29.2
• 2107783 Release: v0.29.1
• 12eed81 Fixup
• ec88c8f Release: v0.29.0
• 7531e8c Unpin hub (#2625)
• 8e439de Link to bash in env reporting (#2623)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #89.