zanmato1984 commented on PR #45918: URL: https://github.com/apache/arrow/pull/45918#issuecomment-2750436916
> @zanmato1984 I ran a test `hashjoin + hash aggr` (join type: RIGHT_OUTER, no key match). When each input batch was set to 1<<15, the `probe * build (4096 * 512)` scenario took only 17.8s (including data generation time), whereas the original serial way took 471.8s. (In this set of comparative tests, the value of kNumRowsPerScanTask was consistently set to `4 * 1024`). Thank you for the info. May I know the number of threads in your test? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
