Rajesh Balamohan created HIVE-25414:
---------------------------------------

             Summary: Optimise Hive::addWriteNotificationLog: Reduce FS call 
per notification
                 Key: HIVE-25414
                 URL: https://issues.apache.org/jira/browse/HIVE-25414
             Project: Hive
          Issue Type: Sub-task
            Reporter: Rajesh Balamohan


AddWriteNotification is slow due to FS interactions (i.e to get the set of 
insert file information). This can be avoided as FileStatus can be passed 
instead of Path from parent methods.

[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L3572]
 

[https://github.com/apache/hive/blob/96b39cd5190f0cfadb677e3f3b7ead1d663921b2/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L3620]

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to