-
Notifications
You must be signed in to change notification settings - Fork 31
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update Azure ML XGBoost instructions to Ubuntu 24.04 #465
base: main
Are you sure you want to change the base?
Conversation
Co-authored-by: Jacob Tomlinson <[email protected]>
Co-authored-by: Jacob Tomlinson <[email protected]>
Co-authored-by: Jacob Tomlinson <[email protected]>
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for this! Left some small suggestions. Please do check how this renders at https://github.com/rapidsai/deployment/blob/xgboost-azure/source/cloud/azure/aks.md after pushing, in case there are other missing/extra backticks that were missed.
It's cool that this worked on Ubuntu 24.04, given that we don't actively test any RAPIDS libraries on that operating system yet! (rapidsai/build-planning#74)
Also, since the PR title will become the commit message when this is squash-merged (https://github.com/rapidsai/deployment/commits/main/), could you give it a more descriptive title? Something like "Update Azure ML XGBoost instructions to Ubuntu 24.04". |
Co-authored-by: James Lamb <[email protected]>
Co-authored-by: James Lamb <[email protected]>
Co-authored-by: James Lamb <[email protected]>
Co-authored-by: James Lamb <[email protected]>
Thanks for the review & suggestions @jameslamb ! I often forget to check the linting after making PRs - need to get into that habit 💪 |
package-lock.json
Outdated
@@ -0,0 +1,28 @@ | |||
{ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I strongly suspect that checking package-lock.json
and package.json
in here were unintentional (probably the result of running npm install prettier
or similar). If I'm right about that, could you please remove them and add new rules to .gitignore
to prevent that happening again?
thanks for pointing that out @jameslamb! Just removed and added to .gitignore |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I've left a few more formatting changes for your consideration. Publishing those recommendations now, will look at the ReviewNB diff of the notebook next.
mamba create -n ucxpy {{ rapids_conda_channels }} {{ rapids_conda_packages }} ipython ucx-proc=*=gpu ucx ucx-py dask distributed numpy cupy pytest pynvml -y | ||
mamba activate ucxpy | ||
``` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This doesn't look right to me... were these removed by accident? Please check how this renders in the GitHub UI on your branch (https://github.com/rapidsai/deployment/blob/xgboost-azure/source/guides/azure/infiniband.md)... I can see there that removing this causes some text that's not intended to be code-formatting being represented in a code block.
In case you're new to working in markdown, I've found these really helpful:
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks for the links!
@@ -1,741 +1,741 @@ | |||
{ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm struggling to understand the diff for source/examples/xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb
. git
seems to think the entire file has been overwritten with new content, but it doesn't look that way to me. Given that all the "new" logs still have dates from Spring 2024, I suspect that you didn't re-run this notebook, and that maybe what's happening is something whitespace related (like maybe you opened this on a Windows machine and all the line endings were replaced).
Could you explain what you intended to change about this notebook? If the answer is "nothing", then you could just revert these changes like this:
git checkout main git pull origin main git checkout xgboost-azure git checkout main -- ./source/examples/xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb git add ./source git commit -m "revert changes to xgboost-gpu-hpo-mnmg-parallel-k8s notebook" git merge main git push origin xgboost-azure
(those instructions assume you have rapidsai/deployment
aliased as origin
, which I'm guessing you do since this branch is on that repo and not coming from a fork).
Reply via ReviewNB
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This PR initially was intended to change the hardcoded configurations to "FILL-THIS-IN", but I think after trying to fix linting issues and running prettier, ruff, and black locally multiple times, somehow the file formatting got messed up. Do you think I should re-implement these changes and make a new PR instead?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't see any FILL THIS IN
or similar in the diff for xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb
... are you sure you made updates like that there?
I recommend re-doing those changes in the way I described in my comment above. And then don't run any of those linters by invoking the tools directly... only use pre-commit
to run them, like this from the root of the repo:
pre-commit run --all-files
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Got it, I'll work on that - thank you for the suggestions, very helpful 👍🏼
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry, there was a typo in what I typed out. Should have been
git checkout main -- ./source/examples/xgboost-gpu-hpo-mnmg-parallel-k8s/notebook.ipynb
Which is "get the state of that file from the main
branch".
I'll send you some other commands to fix the conflicts here privately.
Co-authored-by: James Lamb <[email protected]>
Co-authored-by: James Lamb <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A couple formatting fixes are needed. I will go ahead and apply them. edit: I lack permissions.
I'm not sure if GitHub can even render these suggestions correctly. The four-backtick blocks need to use three backticks instead.
Co-authored-by: Bradley Dice <[email protected]>
Thanks @bdice. I tweaked your suggestion block to use four backticks around the three backtick suggestion which got things working correctly. |
Addresses #464