[
https://issues.apache.org/jira/browse/TEZ-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsuyoshi OZAWA updated TEZ-1825:
--------------------------------
Attachment: TEZ-1825.1.patch
> Aborting jobs by "TezUncheckedException: Attempting to add duplicate resource"
> ------------------------------------------------------------------------------
>
> Key: TEZ-1825
> URL: https://issues.apache.org/jira/browse/TEZ-1825
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Tsuyoshi OZAWA
> Attachments: TEZ-1825.1.patch
>
>
> When I try spark-native-yarn, the job was aborted by TezUncheckedException.
> Why not skipping instead of aborting?
> {code}
> 14/12/06 17:49:43 INFO client.TezClient: Tez system stage directory
> hdfs://10.240.144.103:9000/tmp/ozawa/tez/staging/.tez/application_1417526888598_0035
> doesn't exist and is created
> org.apache.tez.dag.api.TezUncheckedException: Attempting to add duplicate
> resource: commons-collections4-4.0.jar
>
>
> at
> org.apache.tez.common.TezCommonUtils.addAdditionalLocalResources(TezCommonUtils.java:314)
> at org.apache.tez.dag.api.DAG.createDag(DAG.java:668)
>
>
>
> at
> org.apache.tez.client.TezClientUtils.prepareAndCreateDAGPlan(TezClientUtils.java:639)
> at
> org.apache.tez.client.TezClientUtils.createApplicationSubmissionContext(TezClientUtils.java:569)
>
>
> at
> org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:680)
> at
> org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:657)
>
>
>
> at org.apache.tez.client.TezClient.submitDAG(TezClient.java:349)
> at org.apache.spark.tez.DAGBuilder.run(DAGBuilder.java:164)
>
>
>
> at org.apache.spark.tez.DAGBuilder.access$000(DAGBuilder.java:60)
> at org.apache.spark.tez.DAGBuilder$1.execute(DAGBuilder.java:148)
>
>
>
> at
> org.apache.spark.tez.TezDelegate.submitApplication(TezDelegate.scala:83)
> at
> org.apache.spark.tez.TezJobExecutionContext.runJob(TezJobExecutionContext.scala:157)
>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
