[
https://issues.apache.org/jira/browse/TEZ-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated TEZ-4737:
------------------------------
Fix Version/s: 1.0.0
> Session DAG submission fails with FileAlreadyExistsException when the session
> outlives the TezClient
> ----------------------------------------------------------------------------------------------------
>
> Key: TEZ-4737
> URL: https://issues.apache.org/jira/browse/TEZ-4737
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Denys Kuzmenko
> Assignee: Denys Kuzmenko
> Priority: Major
> Fix For: 1.0.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> The serialized DAG plan file (tez-dag.pb<counter>) written for plans
> exceeding the IPC limit is named by a per-TezClient counter and never
> deleted. When the session and its staging directory outlive the TezClient
> instances, a new client generation recomputes the same file name and fails
> with FileAlreadyExistsException, permanently blocking oversized submissions
> on that session.
> {code:java}
> org.apache.hadoop.fs.FileAlreadyExistsException: Operation failed: "The
> specified path already exists.", 409, PUT,
> .../.tez/application_xxx_yyyy/tez-dag.pb1?resource=file
> at
> org.apache.tez.client.TezClient.submitDAGSession(TezClient.java:700)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
