Dimitris Tsirogiannis created IMPALA-6901:
---------------------------------------------
Summary: Investigate memory consumption of table metrics in the
catalog
Key: IMPALA-6901
URL: https://issues.apache.org/jira/browse/IMPALA-6901
Project: IMPALA
Issue Type: Improvement
Components: Catalog
Affects Versions: Impala 3.0, Impala 2.12.0
Reporter: Dimitris Tsirogiannis
IMPALA-4886 introduced the concept of per-table metrics. In some cases (catalog
with 90K tables) it has been reported that the table metrics can consume almost
30% of catalog heap size. We should perform the following actions:
# Measure the impact of table metrics on memory usage.
# Tune/optimize table metrics to reduce their memory requirements. Some quick
fixes/ideas may include: a) replace/tune histogram based metrics with simpler
ones, b) eliminate metrics that are not considered particularly useful, c)
store detailed metrics only for "interesting" tables (e.g. large tables that
are heavily used).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
