You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Below unit tests(scala tests) are failing in HashAggregatesSuite
Total Test failures: 112
Pasting the error message which have different reasons for the failure.
1. - IGNORE ORDER: test hash agg with shuffle *** FAILED ***
java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.aggregate.HashAggregateExec
HashAggregate(keys=[longs#326L], functions=[sum(more_longs#327L)], output=[longs#326L, sum(more_longs)#331L])
+- Exchange hashpartitioning(longs#326L, 2), ENSURE_REQUIREMENTS, [plan_id=730]
+- HashAggregate(keys=[longs#326L], functions=[partial_sum(more_longs#327L)], output=[longs#326L, sum#338L])
2. IGNORE ORDER, NOT ON GPU[HashAggregateExec,AggregateExpression,AttributeReference,Alias,Sum,Count]: PartMerge:countDistinct:sum:partOnly *** FAILED ***
java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.exchange.ShuffleExchangeExec
Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=12786]
+- HashAggregate(keys=[], functions=[merge_sum(more_longs#10581L), partial_count(distinct longs#10580L)], output=[sum#10590L, count#10593L])
+- HashAggregate(keys=[longs#10580L], functions=[merge_sum(more_longs#10581L)], output=[longs#10580L, sum#10590L])
+- Exchange hashpartitioning(longs#10580L, 2), ENSURE_REQUIREMENTS, [plan_id=12783]
+- HashAggregate(keys=[longs#10580L], functions=[partial_sum(more_longs#10581L)], output=[longs#10580L, sum#10590L])
+- GpuColumnarToRow false
+- GpuShuffleCoalesce 1073741824
We currently have an open issue to add support for aggregates in ANSI mode - #5114
All the tests in this test Suite fail with the same reason. We should disable ANSI mode for these tests.
Two approaches:
Disable ANSI mode for the complete Suite.
Disable ANSI mode in each failing test. 112 tests are failing in this Suite so modifying all these tests with the config would take time. The pro of doing this is we can enable certain tests once we support a particular function. For example if sum is supported and if there are tests that are testing only sum, then we could enable them.
Describe the bug
Below unit tests(scala tests) are failing in HashAggregatesSuite
Total Test failures: 112
Pasting the error message which have different reasons for the failure.
Steps/Code to reproduce bug
Expected behavior
Tests must either pass or skip with valid reason in the test suite.
The text was updated successfully, but these errors were encountered: