cloud-fan commented on pull request #32057: URL: https://github.com/apache/spark/pull/32057#issuecomment-818743773
AFAIK it's for historical reasons. `ObjectHashAggregateExec` was created to speed up certain aggregate functions that use java objects as states, and we made a very conservative trigger condition for `ObjectHashAggregateExec`. In general, I agree with what @tanelk said, but there is one issue that: `ObjectHashAggregateExec` is bad at memory estimation and may easily OOM. `SortAggregateExec` is more robust (but slower). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
