milenkovicm commented on PR #1853: URL: https://github.com/apache/datafusion-ballista/pull/1853#issuecomment-4741301084
furthermore, when running Q2 with 256 partitions, executor takes around 460MB with this patch, and 550MB without (which might not be very good metrics to start with) but what i see with this PR: ``` Query 2 took 6.989 s and returned 100 rows Total time: 6.989 s ``` and without: ``` Query 2 took 12.037 s and returned 100 rows Total time: 12.037 s ``` (unless i made some kind of mess-up with test runs) Im running latest main with ``` cargo run --bin ballista-executor --release -- -c 4 --work-dir /path/to/work/dir./ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
