viirya commented on issue #223: URL: https://github.com/apache/arrow-datafusion-comet/issues/223#issuecomment-2021209018
I re-think about this. Actually if there is any unsupported types like UInt64 from DataFusion partial aggregation state. Even we make partial and final aggregation as a whole, it doesn't solve the issue. It is because we need shuffle such unsupported arrays like UInt64. But we cannot arbitrarily assign an UInt64 array to Spark LongType like #216 did. Spark LongType is supported to be an Int64 array. Wronly binding an Uint64 array with LongType doesn't work with shuffle. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
