dwsmith1983 commented on PR #6268: URL: https://github.com/apache/datafusion-comet/pull/6268#issuecomment-6007395851
The failure on every profile was `CometTaskMetricsSuite` "coalesced native scan reports rows and bytes from every partition it reads", which #6547 added after this branch last merged main. Its precondition read `outputPartitioning.numPartitions` on the executed scan and expected 4, and this PR makes a non-bucketed scan report `UnknownPartitioning(0)`. e4bdd8024 has the test read `perPartitionData.length`, the count the native RDD is sized from, which is what the check meant. The suite passes with the change on the Spark 4.1 profile. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
