Releases: rapidsai/dask-cuda
Releases · rapidsai/dask-cuda
v21.12.00
🐛 Bug Fixes
- Remove automatic
doc
labeler (#807) @pentschev - Add create_cuda_context UCX config from Distributed (#801) @pentschev
- Ignore deprecation warnings from pkg_resources (#784) @pentschev
- Fix parsing of device by UUID (#780) @pentschev
- Avoid creating CUDA context in LocalCUDACluster parent process (#765) @pentschev
- Remove gen_cluster spill tests (#758) @pentschev
- Update memory_pause_fraction in test_spill (#757) @pentschev
📖 Documentation
- Add troubleshooting page with PCI Bus ID issue description (#777) @pentschev
🚀 New Features
- Handle UCX-Py FutureWarning on UCX < 1.11.1 deprecation (#799) @pentschev
- Pin max
dask
&distributed
versions (#794) @galipremsagar - Update to UCX-Py 0.23 (#752) @pentschev
🛠️ Improvements
- Fix spill-to-disk triggered by Dask explicitly (#800) @madsbk
- Fix Changelog Merge Conflicts for
branch-21.12
(#797) @ajschmidt8 - Use unittest.mock.patch for all os.environ tests (#787) @pentschev
- Logging when RMM allocation fails (#782) @madsbk
- Tally IDs instead of device buffers directly (#779) @madsbk
- Avoid proxy object aliasing (#775) @madsbk
- Test of sizeof proxy object (#774) @madsbk
- gc.collect when spilling on demand (#771) @madsbk
- Reenable explicit comms tests (#770) @madsbk
- Simplify JIT-unspill and writing docs (#768) @madsbk
- Increase CUDAWorker close timeout (#764) @pentschev
- Ignore known but expected test warnings (#759) @pentschev
- Spilling on demand (#756) @madsbk
- Revert "Temporarily skipping some tests because of a bug in Dask (#753)" (#754) @madsbk
- Temporarily skipping some tests because of a bug in Dask (#753) @madsbk
- Removing the
FrameProxyObject
workaround (#751) @madsbk - Use cuDF Frame instead of Table (#748) @madsbk
- Remove proxy object locks (#747) @madsbk
- Unpin
dask
&distributed
in CI (#742) @galipremsagar - Update SSHCluster usage in benchmarks with new CUDAWorker (#326) @pentschev
v21.10.00
🐛 Bug Fixes
- Drop test setting UCX global options via Dask config (#738) @pentschev
- Prevent CUDA context errors when testing on single-GPU (#737) @pentschev
- Handle
ucp
import error duringinitialize()
(#729) @pentschev - Check if CUDA context was created in distributed.comm.ucx (#722) @pentschev
- Fix registering correct dispatches for
cudf.Index
(#718) @galipremsagar - Register
percentile_lookup
forFrameProxyObject
(#716) @galipremsagar - Leave interface unset when ucx_net_devices unset in LocalCUDACluster (#711) @pentschev
- Update to UCX-Py 0.22 (#710) @pentschev
- Missing fixes to Distributed config namespace refactoring (#703) @pentschev
- Reset UCX-Py after rdmacm tests run (#702) @pentschev
- Skip DGX InfiniBand tests when "rc" transport is unavailable (#701) @pentschev
- Update UCX config namespace (#695) @pentschev
- Bump isort hook version (#682) @charlesbluca
📖 Documentation
- Update more docs for UCX 1.11+ (#720) @pentschev
- Forward-merge branch-21.08 to branch-21.10 (#707) @jakirkham
🚀 New Features
- Warn if CUDA context is created on incorrect device with
LocalCUDACluster
(#719) @pentschev - Add
--benchmark-json
option to all benchmarks (#700) @charlesbluca - Remove Distributed tests from CI (#699) @pentschev
- Add device memory limit argument to benchmarks (#683) @charlesbluca
- Support for LocalCUDACluster with MIG (#674) @akaanirban
🛠️ Improvements
- Pin max
dask
anddistributed
versions to2021.09.1
(#735) @galipremsagar - Implements a ProxyManagerDummy for convenience (#733) @madsbk
- Add
__array_ufunc__
support forProxyObject
(#731) @galipremsagar - Use
has_cuda_context
from Distributed (#723) @pentschev - Fix deadlock and simplify proxy tracking (#712) @madsbk
- JIT-unspill: support spilling to/from disk (#708) @madsbk
- Tests: replacing the obsolete cudf.testing._utils.assert_eq calls (#706) @madsbk
- JIT-unspill: warn when spill to disk triggers (#705) @madsbk
- Remove max version pin for
dask
&distributed
on development branch (#693) @galipremsagar - ENH Replace gpuci_conda_retry with gpuci_mamba_retry (#675) @dillon-cullinan
v21.08.00
🐛 Bug Fixes
- Use aliases to check for installed UCX version (#692) @pentschev
- Don't install Dask main branch in CI for 21.08 release (#687) @pentschev
- Skip test_get_ucx_net_devices_raises on UCX >= 1.11.0 (#685) @pentschev
- Fix NVML index usage in CUDAWorker/LocalCUDACluster (#671) @pentschev
- Add --protocol flag to dask-cuda-worker (#670) @jacobtomlinson
- Fix
assert_eq
related imports (#663) @galipremsagar - Small tweaks to make compatible with dask-mpi (#656) @jacobtomlinson
- Remove Dask version pin (#647) @pentschev
- Fix CUDA_VISIBLE_DEVICES tests (#638) @pentschev
- Add
make_meta_dispatch
handling (#637) @galipremsagar - Update UCX-Py version in CI to 0.21.* (#636) @pentschev
📖 Documentation
- Deprecation warning for ucx_net_devices='auto' on UCX 1.11+ (#681) @pentschev
- Update documentation on InfiniBand with UCX >= 1.11 (#669) @pentschev
- Merge branch-21.06 (#622) @pentschev
🚀 New Features
- Treat Deprecation/Future warnings as errors (#672) @pentschev
- Update parse_bytes imports to resolve deprecation warnings (#662) @pentschev
🛠️ Improvements
- Pin max
dask
&distributed
versions (#686) @galipremsagar - Fix DGX tests warnings on RMM pool size and file not closed (#673) @pentschev
- Remove dot calling style for pytest (#661) @quasiben
- get_device_memory_objects(): dispatch on cudf.core.frame.Frame (#658) @madsbk
- Fix
21.08
forward-merge conflicts (#655) @ajschmidt8 - Fix conflicts in
643
(#644) @ajschmidt8
v21.06.00
🐛 Bug Fixes
- Handle
import
ing relocated dispatch functions (#623) @jakirkham - Fix DGX tests for UCX 1.9 (#619) @pentschev
- Add PROJECTS var (#614) @ajschmidt8
📖 Documentation
- Bump docs copyright year (#616) @charlesbluca
- Update RTD site to redirect to RAPIDS docs (#615) @charlesbluca
- Document DASK_JIT_UNSPILL (#604) @madsbk
🚀 New Features
- Disable reuse endpoints with UCX >= 1.11 (#620) @pentschev
🛠️ Improvements
- Adding profiling to dask shuffle (#625) @arunraman
- Update
CHANGELOG.md
links for calver (#618) @ajschmidt8 - Fixing Dataframe merge benchmark (#617) @madsbk
- Fix DGX tests for UCX 1.10+ (#613) @pentschev
- Update docs build script (#612) @ajschmidt8
v0.19.0
🐛 Bug Fixes
- Pin Dask and Distributed <=2021.04.0 (#585) @pentschev
- Unblock CI by xfailing test_dataframe_merge_empty_partitions (#581) @pentschev
- Install Dask + Distributed from
main
(#546) @jakirkham - Replace compute() calls on CuPy benchmarks by persist() (#537) @pentschev
📖 Documentation
- Add standalone examples of UCX usage (#551) @charlesbluca
- Improve UCX documentation and examples (#545) @charlesbluca
- Auto-merge branch-0.18 to branch-0.19 (#538) @GPUtester
🚀 New Features
- Add option to enable RMM logging (#542) @charlesbluca
- Add capability to log spilling (#442) @pentschev
🛠️ Improvements
- Fix UCX examples for InfiniBand (#556) @charlesbluca
- Fix list to tuple conversion (#555) @madsbk
- Add column masking operation for CuPy benchmarking (#553) @jakirkham
- Update Changelog Link (#550) @ajschmidt8
- cuDF-style operations & NVTX annotations for local CuPy benchmark (#548) @charlesbluca
- Prepare Changelog for Automation (#543) @ajschmidt8
- Add --enable-rdmacm flag to benchmarks utils (#539) @pentschev
- ProxifyHostFile: tracking of external objects (#527) @madsbk
- Test broadcast merge in local_cudf_merge benchmark (#507) @rjzamora
v0.18.0
Breaking Changes 🚨
Bug Fixes 🐛
- Fix device synchronization in local_cupy benchmark (#518) @pentschev
- Proxify register lazy (#492) @madsbk
- Work on deadlock issue 431 (#490) @madsbk
- Fix usage of --dashboard-address in dask-cuda-worker (#487) @pentschev
- Fail if scheduler starts with '-' in dask-cuda-worker (#485) @pentschev
Documentation 📖
- Add device synchonization for local CuPy benchmarks with Dask profiling (#533) @charlesbluca
New Features 🚀
Improvements 🛠️
- Update stale GHA with exemptions & new labels (#531) @mike-wendt
- Add GHA to mark issues/prs as stale/rotten (#528) @Ethyling
- Add operations/arguments to local CuPy array benchmark (#524) @charlesbluca
- Explicit-comms house cleaning (#515) @madsbk
- Fixing fixed-attribute-proxy-object-test (#511) @madsbk
- Prepare Changelog for Automation (#509) @ajschmidt8
- remove conditional check to start conda uploads (#504) @jolorunyomi
- ProxyObject: ignore initial fixed attribute errors (#503) @madsbk
- JIT-unspill: fix potential deadlock (#501) @madsbk
- Hostfile: register the removal of an existing key (#500) @madsbk
- proxy_object: cleanup type dispatching (#497) @madsbk
- Redesign and implementation of dataframe shuffle (#494) @madsbk
- Add --threads-per-worker option to benchmarks (#489) @pentschev
- Extend CuPy benchmark with more operations (#488) @pentschev
- Auto-label PRs based on their content (#480) @jolorunyomi
- CI: cleanup style check (#477) @madsbk
- Individual CUDA object spilling (#451) @madsbk
- FIX Move codecov upload to gpu build script (#450) @dillon-cullinan
- Add support for connecting a CUDAWorker to a cluster object (#428) @jacobtomlinson
v0.17.0
v0.16.0
v0.15.0
v0.15.0 Release