[
https://issues.apache.org/jira/browse/HIVE-21312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16777729#comment-16777729
]
Zoltan Haindrich commented on HIVE-21312:
-----------------------------------------
[~gopalv]: very interesting; I didn't know that - however I think right now we
already utilizing counters much more than earlier so they should work better, I
think both workload management and reoptimization is relying heavily on them
and it seems there are also a few debug related - so I think it would make
sense to move this also there; because it needs files it needs filesystem
operations - and AFAIK the namenode don't really like small files.
https://github.com/apache/hive/blob/2daaed73de09b4b7987fd2d682140d7ee5637640/ql/src/test/results/clientpositive/llap/tez_input_counters.q.out#L2750
I don't see the counter based implementation - it have been removed when it
doesn't seemed beneficial?
> FSStatsAggregator::connect is slow
> ----------------------------------
>
> Key: HIVE-21312
> URL: https://issues.apache.org/jira/browse/HIVE-21312
> Project: Hive
> Issue Type: Improvement
> Components: Statistics
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Priority: Trivial
> Attachments: HIVE-21312.1.patch, HIVE-21312.2.patch
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
