Rajesh Balamohan created HIVE-24695:
---------------------------------------

             Summary: Clean up session resources, if TezSession is unable to 
start
                 Key: HIVE-24695
                 URL: https://issues.apache.org/jira/browse/HIVE-24695
             Project: Hive
          Issue Type: Improvement
            Reporter: Rajesh Balamohan


There are cases when TezSessionState would not be able to start. (e.g resource 
constraints on YARN queues). 

However by this time, session directories & certain resources are localized. 
(e.g, hive-exec jars are stored in  
hdfs:///tmp/hive/hive/_tez_session_dir/*/hive-exec*.jar). When tezClient is not 
started, it does not clear up the resources. This leaks ~100MB data in HDFS per 
failure. 





--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to