[
https://issues.apache.org/jira/browse/TEZ-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13908783#comment-13908783
]
Chen He commented on TEZ-871:
-----------------------------
Sure,
1)<property>
<name>tez.lib.uris</name>
<value>hdfs:/tez/tez-api-0.3.0-incubating-SNAPSHOT.jar,hdfs:/tez/lib/</value>
</property>
2) output of the hadoop classpath
/home/xx/hadoop-3.0.0-SNAPSHOT/etc/hadoop:/home/xx/hadoop-3.0.0-SNAPSHOT/etc/hadoop:/home/xx/hadoop-3.0.0-SNAPSHOT/etc/hadoop:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/common/lib/*:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/common/*:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/hdfs:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/hdfs/*:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/yarn/*:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/lib/*:/home/xx/hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/*:/contrib/capacity-scheduler/*.jar:/home/xx/hadoopConf/:/home/xx/tez:/home/xx/tez/commons-collections4-4.0.jar:/home/xx/tez/tez-api-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-common-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-dag-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-mapreduce-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-mapreduce-examples-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-runtime-internals-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-runtime-library-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-tests-0.3.0-incubating-SNAPSHOT.jar:/contrib/capacity-scheduler/*.jar:/home/xx/hadoopConf/:/home/xx/tez:/home/xx/tez/commons-collections4-4.0.jar:/home/xx/tez/tez-api-0.3.0-incubating-SNAPSHOT.jar:/homexx/tez/tez-common-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-dag-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-mapreduce-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-mapreduce-examples-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-runtime-internals-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-runtime-library-0.3.0-incubating-SNAPSHOT.jar:/home/xx/tez/tez-tests-0.3.0-incubating-SNAPSHOT.jar
3)\> hadoop fs -ls /tez/
-rw-r--r-- 1 chenhe supergroup 610259 2014-02-21 13:10
/tez/commons-collections4-4.0.jar
drwxr-xr-x - chenhe supergroup 0 2014-02-21 13:10 /tez/lib
-rw-r--r-- 1 chenhe supergroup 731581 2014-02-21 13:10
/tez/tez-api-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 23888 2014-02-21 13:10
/tez/tez-common-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 808035 2014-02-21 13:10
/tez/tez-dag-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 235462 2014-02-21 13:10
/tez/tez-mapreduce-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 195128 2014-02-21 13:10
/tez/tez-mapreduce-examples-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 107943 2014-02-21 13:10
/tez/tez-runtime-internals-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 317426 2014-02-21 13:10
/tez/tez-runtime-library-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 2354 2014-02-21 13:10
/tez/tez-tests-0.3.0-incubating-SNAPSHOT.jar
\> hadoop fs -ls /tez/lib
Found 19 items
-rw-r--r-- 1 chenhe supergroup 303139 2014-02-21 13:10
/tez/lib/avro-1.7.4.jar
-rw-r--r-- 1 chenhe supergroup 41123 2014-02-21 13:10
/tez/lib/commons-cli-1.2.jar
-rw-r--r-- 1 chenhe supergroup 610259 2014-02-21 13:10
/tez/lib/commons-collections4-4.0.jar
-rw-r--r-- 1 chenhe supergroup 1648200 2014-02-21 13:10
/tez/lib/guava-11.0.2.jar
-rw-r--r-- 1 chenhe supergroup 710492 2014-02-21 13:10
/tez/lib/guice-3.0.jar
-rw-r--r-- 1 chenhe supergroup 656365 2014-02-21 13:10
/tez/lib/hadoop-mapreduce-client-common-2.2.0.jar
-rw-r--r-- 1 chenhe supergroup 1455001 2014-02-21 13:10
/tez/lib/hadoop-mapreduce-client-core-2.2.0.jar
-rw-r--r-- 1 chenhe supergroup 21537 2014-02-21 13:10
/tez/lib/hadoop-mapreduce-client-shuffle-2.2.0.jar
-rw-r--r-- 1 chenhe supergroup 81743 2014-02-21 13:10
/tez/lib/jettison-1.3.4.jar
-rw-r--r-- 1 chenhe supergroup 533455 2014-02-21 13:10
/tez/lib/protobuf-java-2.5.0.jar
-rw-r--r-- 1 chenhe supergroup 995968 2014-02-21 13:10
/tez/lib/snappy-java-1.0.4.1.jar
-rw-r--r-- 1 chenhe supergroup 731581 2014-02-21 13:10
/tez/lib/tez-api-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 23888 2014-02-21 13:10
/tez/lib/tez-common-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 808035 2014-02-21 13:10
/tez/lib/tez-dag-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 235462 2014-02-21 13:10
/tez/lib/tez-mapreduce-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 195128 2014-02-21 13:10
/tez/lib/tez-mapreduce-examples-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 107943 2014-02-21 13:10
/tez/lib/tez-runtime-internals-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 317426 2014-02-21 13:10
/tez/lib/tez-runtime-library-0.3.0-incubating-SNAPSHOT.jar
-rw-r--r-- 1 chenhe supergroup 2354 2014-02-21 13:10
/tez/lib/tez-tests-0.3.0-incubating-SNAPSHOT.jar
4) Hadoop version is 3.0 (trunk build)
It works well if I use Tez on commit 25615ff32e52505ea3006161162fef1fc35b30bb
> DAGAppMaster failed to start service
> ------------------------------------
>
> Key: TEZ-871
> URL: https://issues.apache.org/jira/browse/TEZ-871
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Chen He
>
> 2014-02-21 10:31:41,733 INFO [ServiceThread:DAGClientRPCServer]
> org.apache.tez.dag.api.client.DAGClientServer: Instantiated
> DAGClientRPCServer at guardwritten-dl.corp.yahoo.com/10.74.90.55:39459
> 2014-02-21 10:31:41,740 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.tez.dag.app.DAGAppMaster failed in state STARTED; cause:
> org.apache.hadoop.service.ServiceStateException: java.lang.NoSuchMethodError:
> com.google.common.collect.Sets.newConcurrentHashSet()Ljava/util/Set;
> org.apache.hadoop.service.ServiceStateException: java.lang.NoSuchMethodError:
> com.google.common.collect.Sets.newConcurrentHashSet()Ljava/util/Set;
> at
> org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
> at
> org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1271)
> at
> org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1317)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at org.apache.tez.dag.app.DAGAppMaster$2.run(DAGAppMaster.java:1645)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1560)
> at
> org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:1641)
> at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:1515)
> Caused by: java.lang.NoSuchMethodError:
> com.google.common.collect.Sets.newConcurrentHashSet()Ljava/util/Set;
> at
> org.apache.tez.dag.app.rm.TaskScheduler.<init>(TaskScheduler.java:150)
> at
> org.apache.tez.dag.app.rm.TaskSchedulerEventHandler.createTaskScheduler(TaskSchedulerEventHandler.java:328)
> at
> org.apache.tez.dag.app.rm.TaskSchedulerEventHandler.serviceStart(TaskSchedulerEventHandler.java:336)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1209)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1227)
> 2014-02-21 10:31:41,742 INFO [main]
> org.apache.tez.dag.history.HistoryEventHandler: Stopping HistoryEventHandler
> 2014-02-21 10:31:41,743 INFO [main] org.apache.hadoop.ipc.Server: Stopping
> server on 46789
> 2014-02-21 10:31:41,745 INFO [IPC Server listener on 46789]
> org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 46789
> 2014-02-21 10:31:41,748 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2014-02-21 10:31:41,748 INFO [main] org.apache.hadoop.ipc.Server: Stopping
> server on 39459
> 2014-02-21 10:31:41,749 INFO [IPC Server listener on 39459]
> org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 39459
> 2014-02-21 10:31:41,749 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2014-02-21 10:31:41,749 FATAL [main] org.apache.tez.dag.app.DAGAppMaster:
> Error starting DAGAppMaster
> org.apache.hadoop.service.ServiceStateException: java.lang.NoSuchMethodError:
> com.google.common.collect.Sets.newConcurrentHashSet()Ljava/util/Set;
> at
> org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
> at
> org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1271)
> at
> org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1317)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at org.apache.tez.dag.app.DAGAppMaster$2.run(DAGAppMaster.java:1645)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1560)
> at
> org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:1641)
> at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:1515)
> Caused by: java.lang.NoSuchMethodError:
> com.google.common.collect.Sets.newConcurrentHashSet()Ljava/util/Set;
> at
> org.apache.tez.dag.app.rm.TaskScheduler.<init>(TaskScheduler.java:150)
> at
> org.apache.tez.dag.app.rm.TaskSchedulerEventHandler.createTaskScheduler(TaskSchedulerEventHandler.java:328)
> at
> org.apache.tez.dag.app.rm.TaskSchedulerEventHandler.serviceStart(TaskSchedulerEventHandler.java:336)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1209)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1227)
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
