Vova Vysotskyi created DRILL-7450:
-------------------------------------
Summary: Improve performance for ANALYZE command
Key: DRILL-7450
URL: https://issues.apache.org/jira/browse/DRILL-7450
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.17.0
Reporter: Vova Vysotskyi
Fix For: 1.17.0
In the scope of DRILL-7273 was introduced ANALYZE command for collecting
metadata and storing it to the metastore.
But current implementation uses too much memory and is low-performant. It uses
stream aggregate for collecting metadata, but all incoming data should be
sorted before producing the aggregation. Memory usage may be reduced by using
hash aggregate, so sort may not be produced and it should increase performance.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)