You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Below unit test(scala test) is failing on Spark-4.0 in JoinsSuite
- Test broadcast hash join with ops *** FAILED ***
org.apache.spark.SparkArithmeticException: [ARITHMETIC_OVERFLOW] long overflow. Use 'try_subtract' to tolerate overflow and return NULL instead. If necessary set "spark.sql.ansi.enabled" to "false" to bypass this error. SQLSTATE: 22003
== DataFrame ==
"minus" was called from
com.nvidia.spark.rapids.JoinsSuite.$anonfun$new$3(JoinsSuite.scala:32)
at org.apache.spark.sql.errors.ExecutionErrors.arithmeticOverflowError(ExecutionErrors.scala:131)
at org.apache.spark.sql.errors.ExecutionErrors.arithmeticOverflowError$(ExecutionErrors.scala:117)
at org.apache.spark.sql.errors.ExecutionErrors$.arithmeticOverflowError(ExecutionErrors.scala:258)
Have to check if disabling ANSI mode fixes the test in the short term.
Describe the bug
Below unit test(scala test) is failing on Spark-4.0 in JoinsSuite
Have to check if disabling ANSI mode fixes the test in the short term.
Steps/Code to reproduce bug
Expected behavior
Test must either pass or skip with valid reason in the test suite.
The text was updated successfully, but these errors were encountered: