Re: Flink yarn session exception

Thu, 16 Jul 2020 17:33:15 -0700 

你可以看看lib里面的包跟官网的要求是不是一样的



发自我的iPhone


------------------ Original ------------------
From: Rainie Li <[email protected]&gt;
Date: Fri,Jul 17,2020 1:06 AM
To: user-zh <[email protected]&gt;
Subject: Re: Flink yarn session exception



多谢，我set了这些envs:

export JAVA_HOME=/usr/lib/jvm/java-8-oracle
export PATH=$JAVA_HOME/bin:$PATH
export HADOOP_HOME=/usr/local/hadoop
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export HADOOP_CLASSPATH=`hadoop classpath`
export FLINK_CONF_DIR=/etc/flink-1.9.1/conf
export FLINK_LOG_DIR=/home/rainieli/

有什么问题吗？🙏


On Thu, Jul 16, 2020 at 1:12 AM Paul Lam <[email protected]&gt; wrote:

&gt; 日志里说得比较清楚了，classpath 里没有 Hadoop 的 lib。可以参考这个文档 [1] 来配置你的环境。
&gt;
&gt; 1.
&gt; 
https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/hadoop.html
&gt; <
&gt; 
https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/hadoop.html
&gt; &gt;
&gt; Best,
&gt; Paul Lam
&gt;
&gt; &gt; 2020年7月16日 15:46，Rainie Li <[email protected]&gt; 写道：
&gt; &gt;
&gt; &gt; 大佬们好，我是flink新手，正在用flink 1.9.1
&gt; &gt; Flink APP cannot run, APP log error,&nbsp; 想求教一下会是什么原因造成的，多谢🙏
&gt; &gt;
&gt; &gt; 2020-06-16 17:06:21,921 WARN&nbsp; 
org.apache.flink.client.cli.CliFrontend
&gt; 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
 - Could not load CLI class
&gt; &gt; org.apache.flink.yarn.cli.FlinkYarnSessionCli.
&gt; &gt; java.lang.NoClassDefFoundError:
&gt; &gt; org/apache/hadoop/yarn/exceptions/YarnException
&gt; &gt; at java.lang.Class.forName0(Native Method)
&gt; &gt; at java.lang.Class.forName(Class.java:264)
&gt; &gt; at
&gt; &gt;
&gt; 
org.apache.flink.client.cli.CliFrontend.loadCustomCommandLine(CliFrontend.java:1185)
&gt; &gt; at
&gt; &gt;
&gt; 
org.apache.flink.client.cli.CliFrontend.loadCustomCommandLines(CliFrontend.java:1145)
&gt; &gt; at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1070)
&gt; &gt; Caused by: java.lang.ClassNotFoundException:
&gt; &gt; org.apache.hadoop.yarn.exceptions.YarnException
&gt; &gt; at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
&gt; &gt; at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
&gt; &gt; at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
&gt; &gt; at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
&gt; &gt; ... 5 more
&gt; &gt; 2020-06-16 17:06:21,980 INFO&nbsp; org.apache.flink.core.fs.FileSystem
&gt; 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
 - Hadoop is not in the classpath/dependencies. The
&gt; extended
&gt; &gt; set of supported File Systems via Hadoop is not available.
&gt;
&gt;

回复