Rajesh Balamohan created HIVE-24838:
---------------------------------------

             Summary: Reduce FS creation in Warehouse::getDnsPath for object 
stores
                 Key: HIVE-24838
                 URL: https://issues.apache.org/jira/browse/HIVE-24838
             Project: Hive
          Issue Type: Improvement
            Reporter: Rajesh Balamohan
         Attachments: Screenshot 2021-03-02 at 11.09.01 AM.png

[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/Warehouse.java#L143]

 

Warehouse::getDnsPath gets invoked from multiple places (e.g getDatabase() 
etc). In certain cases like dynamic partition loads, lot of calls FS 
instantiation calls can be avoided for object stores.

It would be good to check for BlobStorages and if so, it should be possible to 
avoid FS creation.

[https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/common/BlobStorageUtils.java#L33]

 

!Screenshot 2021-03-02 at 11.09.01 AM.png|width=372,height=296!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to