Joe McDonnell created IMPALA-6530:
-------------------------------------

             Summary: Track time spent opening HDFS file handles
                 Key: IMPALA-6530
                 URL: https://issues.apache.org/jira/browse/IMPALA-6530
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
    Affects Versions: Impala 2.11.0, Impala 2.10.0
            Reporter: Joe McDonnell
            Assignee: Joe McDonnell


When the HDFS NameNode is overloaded, opening an HDFS file handle can become a 
time consuming operation and can become the bottleneck for the system. 
Currently, there is no statistic tracking time spent opening file handles. This 
limits the ability to determine the extent of the HDFS NameNode problem, 
especially when given only a single query profile.

Impala should have a statistic at the HDFS scan node level tracking time spent 
opening file handles.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to