[
https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kuhu Shukla updated TEZ-3362:
-----------------------------
Attachment: TEZ-3362.001.patch
Attaching the first version of the patch. DagAppMaster sends the per node dag
directory delete http request. Currently the shuffle port is hard coded and
deletion is serial with complexity of O(num_of_nodes * num_of_dirs_per_node).
[~jeagles], Request for review/comments/improvements. Thanks a lot.
> Delete intermediate data at DAG level for Shuffle Handler
> ---------------------------------------------------------
>
> Key: TEZ-3362
> URL: https://issues.apache.org/jira/browse/TEZ-3362
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Jonathan Eagles
> Assignee: Kuhu Shukla
> Attachments: TEZ-3362.001.patch
>
>
> Applications like hive that use tez in session mode need the ability to
> delete intermediate data after a DAG completes and while the application
> continues to run.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
