[
https://issues.apache.org/jira/browse/FLINK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592298#comment-16592298
]
ASF GitHub Bot commented on FLINK-9086:
---------------------------------------
ruankd commented on issue #5768: [FLINK-9086] Use INTERNAL_HADOOP_CLASSPATHS as
classpath for Yarn Session
URL: https://github.com/apache/flink/pull/5768#issuecomment-415904593
Ping.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Use INTERNAL_HADOOP_CLASSPATHS as classpath for launching Yarn cluster for
> Scala Shell
> --------------------------------------------------------------------------------------
>
> Key: FLINK-9086
> URL: https://issues.apache.org/jira/browse/FLINK-9086
> Project: Flink
> Issue Type: Improvement
> Components: Startup Shell Scripts
> Affects Versions: 1.4.0
> Reporter: Keda Ruan
> Priority: Major
> Labels: pull-request-available
>
> Some environments don't have hadoop jars in {{HADOOP_CLASSPATH}}, causing
> Flink Yarn cluster unable to start due to some jars missing. For example
> Flink 1.4.0 drops jersey dependency in its shaded hadoop jar, causing Yarn
> cluster unable to start:
> {quote}Exception in thread "main" java.lang.NoClassDefFoundError:
> com/sun/jersey/core/util/FeaturesAndProperties
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> {quote}
> Since there is a {{INTERNAL_HADOOP_CLASSPATHS}} in {{config.sh}} that has
> {{hadoop classpath}} result, we can utilize this and improve the user
> experience on starting Flink Yarn cluster for Scala Shell.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
