Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Method mergeOnHost is deprecated in KudoSerializer #12164

Open
amahussein opened this issue Feb 18, 2025 · 2 comments
Open

[BUG] Method mergeOnHost is deprecated in KudoSerializer #12164

amahussein opened this issue Feb 18, 2025 · 2 comments
Assignees
@razajafri
Labels
bug Something isn't working

Comments

@amahussein
Copy link
Collaborator

amahussein commented Feb 18, 2025 •
edited
Loading

Describe the bug

The nightly builds rapids_databricks_nightly-dev-github against DB330, DB 332, DB341, and DB350 fail due to a deprecated method in GpuShuffleCoalesceExec

[2025-02-18T15:25:06.433Z] [INFO] --- scala-maven-plugin:4.9.1:compile (scala-compile-first) @ rapids-4-spark-sql_2.12 ---

[2025-02-18T15:25:06.691Z] [INFO] Compiler bridge file: /home/ubuntu/spark-rapids/target/spark330db/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.10.0-bin_2.12.15__52.0-1.10.0_20240505T232140.jar

[2025-02-18T15:25:28.607Z] [INFO] compiling 477 Scala sources and 58 Java sources to /home/ubuntu/spark-rapids/sql-plugin/target/spark330db/classes ...

[Error] /home/ubuntu/spark-rapids/sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuShuffleCoalesceExec.scala:256: method mergeOnHost in class KudoSerializer is deprecated
@amahussein amahussein added ? - Needs Triage Need team to review and classify bug Something isn't working labels Feb 18, 2025
@razajafri razajafri mentioned this issue Feb 18, 2025
Closed
@razajafri
Copy link
Collaborator

Thanks for creating this. You beat me to it

@razajafri razajafri mentioned this issue Feb 18, 2025
Closed
@gerashegalov
Copy link
Collaborator

This affects all shim builds

@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Feb 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@razajafri razajafri

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Switch to using non-deprecated version of KudoSerializer::mergeOnHost() razajafri/spark-rapids
4 participants
@gerashegalov @mattahrens @razajafri @amahussein