Syed Shameerur Rahman created HIVE-23737:

             Summary: LLAP: Reuse dagDelete Feature Of Tez Custom Shuffle 
Handler Instead Of LLAP's dagDelete
                 Key: HIVE-23737
             Project: Hive
          Issue Type: Improvement
         Environment: *strong text*
            Reporter: Syed Shameerur Rahman
            Assignee: Syed Shameerur Rahman

LLAP have a dagDelete feature added as part of HIVE-9911, But now that Tez have 
added support for dagDelete in custom shuffle handler (TEZ-3362) we could 
re-use that feature in LLAP. 
There are some added advantages of using Tez's dagDelete feature rather than 
the current LLAP's dagDelete feature.

1) We can easily extend this feature to accommodate the upcoming features such 
as vertex and failed task attempt shuffle data clean up. Refer TEZ-3363 and 

2) It will be more easier to maintain this feature by separating it out from 
the Hive's code path. 

This message was sent by Atlassian Jira

Reply via email to