Tsuyoshi OZAWA created TEZ-1825:
-----------------------------------
Summary: Aborting jobs by "TezUncheckedException: Attempting to
add duplicate resource"
Key: TEZ-1825
URL: https://issues.apache.org/jira/browse/TEZ-1825
Project: Apache Tez
Issue Type: Bug
Reporter: Tsuyoshi OZAWA
When I try spark-native-yarn, the job was aborted by TezUncheckedException. Why
not skipping instead of aborting?
{code}
14/12/06 17:49:43 INFO client.TezClient: Tez system stage directory
hdfs://10.240.144.103:9000/tmp/ozawa/tez/staging/.tez/application_1417526888598_0035
doesn't exist and is created
org.apache.tez.dag.api.TezUncheckedException: Attempting to add duplicate
resource: commons-collections4-4.0.jar
at
org.apache.tez.common.TezCommonUtils.addAdditionalLocalResources(TezCommonUtils.java:314)
at org.apache.tez.dag.api.DAG.createDag(DAG.java:668)
at
org.apache.tez.client.TezClientUtils.prepareAndCreateDAGPlan(TezClientUtils.java:639)
at
org.apache.tez.client.TezClientUtils.createApplicationSubmissionContext(TezClientUtils.java:569)
at
org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:680)
at
org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:657)
at org.apache.tez.client.TezClient.submitDAG(TezClient.java:349)
at org.apache.spark.tez.DAGBuilder.run(DAGBuilder.java:164)
at org.apache.spark.tez.DAGBuilder.access$000(DAGBuilder.java:60)
at org.apache.spark.tez.DAGBuilder$1.execute(DAGBuilder.java:148)
at
org.apache.spark.tez.TezDelegate.submitApplication(TezDelegate.scala:83)
at
org.apache.spark.tez.TezJobExecutionContext.runJob(TezJobExecutionContext.scala:157)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
