jorgecarleitao opened a new pull request #8503: URL: https://github.com/apache/arrow/pull/8503
This makes `merge` send batches to a receiver stream as they arrive and, thereby removing the need to wait for each thread to finish collecting all its batches. on micro-benchmarks, performance on non-grouped data improved by -8%, on other aggregate benches is between +2%-0%. This is the implementation of an idea fielded by @alamb here: https://github.com/apache/arrow/pull/8473/files#r506304982 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
