[
https://issues.apache.org/jira/browse/TEZ-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308568#comment-17308568
]
Dhirendra Pandit edited comment on TEZ-4074 at 3/25/21, 10:23 AM:
------------------------------------------------------------------
Hi [~vinaypatil18],
Thanks for the hint, I have tried that option but still getting below error. My
Tez configuration file looks like below.
{code:java}
// code placeholder
<?xml version="1.0" encoding="UTF-8"?><?xml version="1.0"
encoding="UTF-8"?><?xml-stylesheet type="text/xsl"
href="configuration.xsl"?><configuration> <property>
<name>tez.lib.uris</name>
<value>${fs.defaultFS}/apps/tez-0.10.0/tez-0.10.0-minimal.tar.gz</value>
</property>
<property> <name>tez.queue.name</name> <value>default</value> </property>
<property> <name>tez.am.resource.memory.mb</name> <value>4096</value>
</property> <property> <name>tez.am.java.opts</name> <value>-server -Xmx3276m
-Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+UseParallelGC</value>
</property>
<property> <name>tez.runtime.io.sort.mb</name> <value>1024</value> </property>
<property> <name>tez.use.cluster.hadoop-libs</name>
<value>true</value> </property> <property>
<name>tez.am.launch.cluster-default.cmd-opts</name> <value>-cp
$HADOOP_HOME/share/hadoop/hdfs/lib/guava-27.0-jre.jar:$CLASSPATH -server
-Djava.net.preferIPv4Stack=true</value> </property> </configuration>
{code}
The error message is still the same.
{code:java}
// code placeholder
2021-03-25 11:21:53,167 [INFO] [main] |common.TezClassLoader|: Created
TezClassLoader with parent classloader:
sun.misc.Launcher$AppClassLoader@330bedb4, thread: 1, system classloader:
sun.misc.Launcher$AppClassLoader@330bedb4
2021-03-25 11:21:53,323 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster
for applicationId=application_1616667432739_0001, attemptNum=2,
AMContainerId=container_1616667432739_0001_02_000001, jvmPid=6811,
userFromEnv=init, cliSessionOption=true,
pwd=/tmp/hadoop-init/nm-local-dir/usercache/init/appcache/application_1616667432739_0001/container_1616667432739_0001_02_000001,
localDirs=/tmp/hadoop-init/nm-local-dir/usercache/init/appcache/application_1616667432739_0001,
logDirs=/opt/bigdata/hadoop3/hadoop-3.3.0/logs/userlogs/application_1616667432739_0001/container_1616667432739_0001_02_000001
2021-03-25 11:21:53,350 [ERROR] [main] |app.DAGAppMaster|: Error starting
DAGAppMaster
java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1380)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1361)
at
org.apache.tez.common.TezUtilsInternal.addUserSpecifiedTezConfiguration(TezUtilsInternal.java:84)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2396)
{code}
Kindly let me know if you can help me to resolve this problem.
Regards,
Dhirendra
was (Author: [email protected]):
Hi [~vinaypatil18],
Thanks for the hint, I have tried that option but still getting below error. My
Tez configuration file looks like below.
{code:java}
// code placeholder
<?xml version="1.0" encoding="UTF-8"?><?xml version="1.0"
encoding="UTF-8"?><?xml-stylesheet type="text/xsl"
href="configuration.xsl"?><configuration> <property>
<name>tez.lib.uris</name>
<value>${fs.defaultFS}/apps/tez-0.10.0/tez-0.10.0-minimal.tar.gz</value>
</property>
<property> <name>tez.queue.name</name> <value>default</value> </property>
<property> <name>tez.am.resource.memory.mb</name> <value>4096</value>
</property> <property> <name>tez.am.java.opts</name> <value>-server -Xmx3276m
-Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+UseParallelGC</value>
</property>
<property> <name>tez.runtime.io.sort.mb</name> <value>1024</value> </property>
<property> <name>tez.use.cluster.hadoop-libs</name>
<value>true</value> </property> <property>
<name>tez.am.launch.cluster-default.cmd-opts</name> <value>-cp
$HADOOP_HOME/share/hadoop/hdfs/lib/guava-27.0-jre.jar:$CLASSPATH -server
-Djava.net.preferIPv4Stack=true</value> </property> </configuration>
{code}
Kindly let me know if you can help me to resolve this problem.
Regards,
Dhirendra
> Tez does not run with Hadoop Trunk (3.3.0-snapshot)
> ---------------------------------------------------
>
> Key: TEZ-4074
> URL: https://issues.apache.org/jira/browse/TEZ-4074
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Ahmed Hussein
> Priority: Major
>
> Tez throws a runtime exception when compiled against Hadoop-3.3.0.
> With Tez running Guava (11.0.2) and Hadoop eunning Guava 27.0-jre (see
> HADOOP-16210), there is an incompatibility of Guava library.
> {code:java}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.136
> s <<< FAILURE! - in org.apache.tez.dag.app.TestSpeculation
> [ERROR] org.apache.tez.dag.app.TestSpeculation Time elapsed: 0.136 s <<<
> ERROR!
> java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at
> org.apache.tez.dag.app.TestSpeculation.setupSpeculation(TestSpeculation.java:86)
> {code}
> It looks like guava added single parameter optimizations which breaks
> compatibility with {{VAR_ARGS}}. So, even though it shows source
> compatibility it is throwing a runtime error due to binary incompatibility.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
