Dandandan opened a new pull request #9070: URL: https://github.com/apache/arrow/pull/9070
This is based on a earlier PR and is meant to help discussing a solution for https://issues.apache.org/jira/browse/ARROW-11030 The benchmark results look very promising, mostly removing the overhead of small bathes. For a very small batch size of 64, on tcph q 12: ``` Query 12 iteration 0 took 1726.5 ms Query 12 iteration 1 took 1722.5 ms Query 12 iteration 2 took 1781.3 ms Query 12 iteration 3 took 1830.6 ms ``` Master ``` Query 12 iteration 0 took 11925.1 ms ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
