alamb commented on PR #11627: URL: https://github.com/apache/datafusion/pull/11627#issuecomment-2260519935
I implemented `covert_to_state` for `AVG` in https://github.com/apache/datafusion/pull/11734 so I could run the query shown in https://github.com/apache/datafusion/issues/6937 ```sql SELECT "WatchID", "ClientIP", COUNT(*) AS c, SUM("IsRefresh"), AVG("ResolutionWidth") FROM hits GROUP BY "WatchID", "ClientIP" ORDER BY c DESC LIMIT 10; ``` And doing so with 90 partitions I saw similar improvements main memory maxed out at 15GB Elapsed 16.446 seconds. Elapsed 16.301 seconds. This branch memory maxed out at 10G Elapsed 12.666 seconds. Elapsed 11.761 seconds. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
