Bump Python and RAPIDS versions (#16)

* Bump Python version Signed-off-by: Ryan Wolf <[email protected]> * Change pinned rapids to lower bound Signed-off-by: Ryan Wolf <[email protected]> * Remove wildcard suffix Signed-off-by: Ryan Wolf <[email protected]> * Only bump dask-cuda Signed-off-by: Ryan Wolf <[email protected]> * Update min rapids version Signed-off-by: Ryan Wolf <[email protected]> * Use latest RAPIDS versions Signed-off-by: Ryan Wolf <[email protected]> * Fix notation Signed-off-by: Ryan Wolf <[email protected]> * Move to bounds Signed-off-by: Ryan Wolf <[email protected]> * Free space on test worker Signed-off-by: Ryan Wolf <[email protected]> * Add python version in readme Signed-off-by: Ryan Wolf <[email protected]> --------- Signed-off-by: Ryan Wolf <[email protected]>
NVIDIA · Apr 2, 2024 · 4346c74 · 4346c74
1 parent 35d5f8f
commit 4346c74
Show file tree

Hide file tree

Showing 3 changed files with 12 additions and 6 deletions.
diff --git a/.github/workflows/test.yml b/.github/workflows/test.yml
@@ -22,6 +22,12 @@ jobs:
         python-version: ["3.10"]
     steps:
       - uses: actions/checkout@v4
+      - name: Optionally free up space on Ubuntu
+        run: |
+          sudo rm -rf /usr/share/dotnet
+          sudo rm -rf /opt/ghc
+          sudo rm -rf "/usr/local/share/boost"
+          sudo rm -rf "$AGENT_TOOLSDIRECTORY"
       - name: Set up Python ${{ matrix.python-version }}
         uses: actions/setup-python@v5
         with:

diff --git a/README.md b/README.md
@@ -37,7 +37,7 @@ These modules are designed to be flexible and allow for reordering with few exce
 
 ## Installation
 
-NeMo Curator currently requires a GPU with CUDA 12 or above installed in order to be used.
+NeMo Curator currently requires Python 3.10 and a GPU with CUDA 12 or above installed in order to be used.
 
 NeMo Curator can be installed manually by cloning the repository and installing as follows:
 ```

diff --git a/setup.py b/setup.py
@@ -36,7 +36,7 @@
         "Programming Language :: Python :: 3",
     ],
     packages=find_packages(),
-    python_requires=">=3.7",
+    python_requires=">=3.10, <3.11",
     install_requires=[
         "dask[complete]>=2021.7.1",
         "distributed>=2021.7.1",
@@ -55,10 +55,10 @@
         "comment_parser",
         "beautifulsoup4",
         "mwparserfromhell @ git+https://github.com/earwig/mwparserfromhell.git@0f89f44",
-        "cudf-cu12==23.10.*",
-        "dask-cudf-cu12==23.10.*",
-        "cugraph-cu12==23.10.*",
-        "dask-cuda==23.10.*",
+        "cudf-cu12>=24.2",
+        "dask-cudf-cu12>=24.2",
+        "cugraph-cu12>=24.2",
+        "dask-cuda>=24.2",
         "spacy>=3.6.0, <4.0.0",
         "presidio-analyzer==2.2.351",
         "presidio-anonymizer==2.2.351",