[
https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709320#comment-16709320
]
Eric Yang commented on YARN-9057:
---------------------------------
[~cheersyang] Thank you for the patch.
HADOOP_HOME/share/hadoop/yarn/csi/hadoop-yarn-csi-3.3.0-SNAPSHOT.jar has the
right content.
However, I get error message when launching application:
{code}
$ ./bin/yarn app -status abc
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/yarn/conf/YarnConfiguration
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
at java.lang.Class.getMethod0(Class.java:3018)
at java.lang.Class.getMethod(Class.java:1784)
at
sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.yarn.conf.YarnConfiguration
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 7 more
{code}
When I look in HADOOP_HOME/share/hadoop/yarn, hadoop-yarn-api-*.jar file is
missing. It copied hadoop-yarn-api-*.jar into:
{code}
$ tar tfvz hadoop-3.3.0-SNAPSHOT.tar.gz |grep yarn-api
-rw-rw-r-- eyang/eyang 3369775 2018-12-04 16:46
hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/csi/lib/hadoop-yarn-api-3.3.0-SNAPSHOT.jar
{code}
Seems like an unexpected behavior.
> CSI jar file should not bundle third party dependencies
> -------------------------------------------------------
>
> Key: YARN-9057
> URL: https://issues.apache.org/jira/browse/YARN-9057
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: build
> Affects Versions: 3.3.0
> Reporter: Eric Yang
> Assignee: Weiwei Yang
> Priority: Blocker
> Attachments: YARN-9057.001.patch
>
>
> hadoop-yarn-csi-3.3.0-SNAPSHOT.jar bundles all third party classes like a
> shaded jar instead of CSI only classes. This is generating error messages
> for YARN cli:
> {code}
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-csi-3.3.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
