Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Azure ML XGBoost instructions to Ubuntu 24.04 #465

Open
wants to merge 33 commits into
base: main
Choose a base branch
from

Conversation

melodywang060
Copy link
Contributor

Addresses #464

@melodywang060 melodywang060 requested a review from a team as a code owner October 10, 2024 19:15
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@melodywang060 melodywang060 linked an issue Oct 10, 2024 that may be closed by this pull request
Copy link
Member

@jameslamb jameslamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this! Left some small suggestions. Please do check how this renders at https://github.com/rapidsai/deployment/blob/xgboost-azure/source/cloud/azure/aks.md after pushing, in case there are other missing/extra backticks that were missed.

It's cool that this worked on Ubuntu 24.04, given that we don't actively test any RAPIDS libraries on that operating system yet! (rapidsai/build-planning#74)

source/guides/azure/infiniband.md Outdated Show resolved Hide resolved
source/guides/azure/infiniband.md Outdated Show resolved Hide resolved
source/guides/azure/infiniband.md Outdated Show resolved Hide resolved
source/cloud/azure/aks.md Outdated Show resolved Hide resolved
@jameslamb
Copy link
Member

Also, since the PR title will become the commit message when this is squash-merged (https://github.com/rapidsai/deployment/commits/main/), could you give it a more descriptive title? Something like "Update Azure ML XGBoost instructions to Ubuntu 24.04".

@melodywang060 melodywang060 changed the title Xgboost azure Update Azure ML XGBoost instructions to Ubuntu 24.04 Oct 10, 2024
@melodywang060
Copy link
Contributor Author

Thanks for the review & suggestions @jameslamb ! I often forget to check the linting after making PRs - need to get into that habit 💪

@@ -0,0 +1,28 @@
{
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I strongly suspect that checking package-lock.json and package.json in here were unintentional (probably the result of running npm install prettier or similar). If I'm right about that, could you please remove them and add new rules to .gitignore to prevent that happening again?

@melodywang060
Copy link
Contributor Author

thanks for pointing that out @jameslamb! Just removed and added to .gitignore

@jameslamb jameslamb self-requested a review October 14, 2024 19:09
Copy link
Member

@jameslamb jameslamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've left a few more formatting changes for your consideration. Publishing those recommendations now, will look at the ReviewNB diff of the notebook next.

source/guides/azure/infiniband.md Show resolved Hide resolved
source/guides/azure/infiniband.md Outdated Show resolved Hide resolved
mamba create -n ucxpy {{ rapids_conda_channels }} {{ rapids_conda_packages }} ipython ucx-proc=*=gpu ucx ucx-py dask distributed numpy cupy pytest pynvml -y
mamba activate ucxpy
```
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't look right to me... were these removed by accident? Please check how this renders in the GitHub UI on your branch (https://github.com/rapidsai/deployment/blob/xgboost-azure/source/guides/azure/infiniband.md)... I can see there that removing this causes some text that's not intended to be code-formatting being represented in a code block.

Screenshot 2024-10-14 at 2 05 49 PM

In case you're new to working in markdown, I've found these really helpful:

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for the links!

@@ -1,741 +1,741 @@
{
Copy link
Member

@jameslamb jameslamb Oct 14, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm struggling to understand the diff for source/examples/xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb. git seems to think the entire file has been overwritten with new content, but it doesn't look that way to me. Given that all the "new" logs still have dates from Spring 2024, I suspect that you didn't re-run this notebook, and that maybe what's happening is something whitespace related (like maybe you opened this on a Windows machine and all the line endings were replaced).

Could you explain what you intended to change about this notebook? If the answer is "nothing", then you could just revert these changes like this:

git checkout main

git pull origin main

git checkout xgboost-azure

git checkout main -- ./source/examples/xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb

git add ./source

git commit -m "revert changes to xgboost-gpu-hpo-mnmg-parallel-k8s notebook"

git merge main

git push origin xgboost-azure

(those instructions assume you have rapidsai/deployment aliased as origin, which I'm guessing you do since this branch is on that repo and not coming from a fork).


Reply via ReviewNB

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This PR initially was intended to change the hardcoded configurations to "FILL-THIS-IN", but I think after trying to fix linting issues and running prettier, ruff, and black locally multiple times, somehow the file formatting got messed up. Do you think I should re-implement these changes and make a new PR instead?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't see any FILL THIS IN or similar in the diff for xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb ... are you sure you made updates like that there?

I recommend re-doing those changes in the way I described in my comment above. And then don't run any of those linters by invoking the tools directly... only use pre-commit to run them, like this from the root of the repo:

pre-commit run --all-files

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it, I'll work on that - thank you for the suggestions, very helpful 👍🏼

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, there was a typo in what I typed out. Should have been

git checkout main -- ./source/examples/xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb

Which is "get the state of that file from the main branch".

I'll send you some other commands to fix the conflicts here privately.

Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple formatting fixes are needed. I will go ahead and apply them. edit: I lack permissions.

I'm not sure if GitHub can even render these suggestions correctly. The four-backtick blocks need to use three backticks instead.

source/guides/azure/infiniband.md Show resolved Hide resolved
source/guides/azure/infiniband.md Outdated Show resolved Hide resolved
@jacobtomlinson
Copy link
Member

jacobtomlinson commented Oct 31, 2024

Thanks @bdice. I tweaked your suggestion block to use four backticks around the three backtick suggestion which got things working correctly.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Change Hardcoded Configurations to FILL-IN
4 participants