comphead commented on code in PR #4791:
URL: https://github.com/apache/datafusion-comet/pull/4791#discussion_r3532562483
##########
spark/src/test/scala/org/apache/comet/exec/CometAggregateSuite.scala:
##########
@@ -2150,4 +2159,112 @@ class CometAggregateSuite extends CometTestBase with
AdaptiveSparkPlanHelper {
}
}
+ // The test to reproduce `offset overflow` for aggregation queries, when
interim data
+ // get exploded 100x comparing to initial input size.
+ // It is not supposed to run on CI as the test requires significant RAM to
succeed
+ ignore("CUBE(9) + COUNT(DISTINCT) wide Utf8 keys: useLargeDataTypes
preserves correctness") {
Review Comment:
The entire CI is passed with `useLargeDataTypes` enabled.
on CI grade machines we cannot reproduce issue as we run out of memory
earlier than hit the offset limit
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
