Skip to content

Commit 1d76d6f

Browse files
authored
[auto-merge] branch-25.02 to branch-25.04 [skip ci] [bot] (#492)
auto-merge triggered by github actions on `branch-25.02` to create a PR keeping `branch-25.04` up-to-date. If this PR is unable to be merged due to conflicts, it will remain open until manually fix.
2 parents 1765e90 + e522404 commit 1d76d6f

14 files changed

+2155
-2583
lines changed

examples/ML+DL-Examples/Spark-DL/dl_inference/README.md

+5
Original file line numberDiff line numberDiff line change
@@ -99,6 +99,11 @@ The notebooks are ready to run! Each notebook has a cell to connect to the stand
9999
- `requirements.txt` installs pyspark>=3.4.0. Make sure the installed PySpark version is compatible with your system's Spark installation.
100100
- The notebooks require a GPU environment for the executors.
101101
- The PyTorch notebooks include model compilation and accelerated inference with TensorRT. While not included in the notebooks, Tensorflow also supports [integration with TensorRT](https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html), but as of writing it is not supported in TF==2.17.0.
102+
- Note that some Huggingface models may be gated and will require a login, e.g.,:
103+
```python
104+
from huggingface_hub import login
105+
login()
106+
```
102107

103108
**Troubleshooting:**
104109
If you encounter issues starting the Triton server, you may need to link your libstdc++ file to the conda environment, e.g.:

examples/ML+DL-Examples/Spark-DL/dl_inference/dataproc/setup/init_spark_dl.sh

+1-1
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,7 @@ if [[ "${ROLE}" == 'Master' ]]; then
4949
if gsutil -q stat gs://${SPARK_DL_HOME}/notebooks/**; then
5050
mkdir spark-dl-notebooks
5151
gcloud storage cp -r gs://${SPARK_DL_HOME}/notebooks/* spark-dl-notebooks
52-
gcloud storage cp gs://${SPARK_DL_HOME}/pytriton_utils.py spark-dl-notebooks/
52+
gcloud storage cp gs://${SPARK_DL_HOME}/pytriton_utils.py .
5353
else
5454
echo "Failed to retrieve notebooks from gs://${SPARK_DL_HOME}/notebooks/"
5555
exit 1

examples/ML+DL-Examples/Spark-DL/dl_inference/huggingface/conditional_generation_tf.ipynb

+132-157
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)