[
https://issues.apache.org/jira/browse/FLINK-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
linzhongjun updated FLINK-9793:
-------------------------------
Description:
We are using flink1.4.2 in our company. When the flink job is submitted to run
on yarn with yarn-cluster mode，we actually find that the
flink-dist_2.11-1.4.2.jar is uploaded to HDFS. The jars lies in different
directories e.g.,
1..flink/application_1525941455002_539197/flink-dist_2.11-1.4.2.jar
2..flink/application_1525941455002_539197/lib/flink-dist_2.11-1.4.2.jar
Through reviewing source code of flink and having some tests, we suppose that
the code below may have a bug in the Linux environment.
java.nio.file.Path file
!(file.getFileName().startsWith("flink-dist")
&&file.getFileName().endsWith("jar")) is Always be true
was:
Our company is using flink1.4.2，When the flink program is submitted to run on
yarn,To a yarn - cluster mode，We found that the flink-dist_2.11-1.4.2.jar was
repeatedly uploaded to HDFS，They are in different directories eg;
1..flink/application_1525941455002_539197/flink-dist_2.11-1.4.2.jar
2..flink/application_1525941455002_539197/lib/flink-dist_2.11-1.4.2.jar
Through source code analysis and testing, we found that this code has bugs in
the Linux environment。
java.nio.file.Path file
!(file.getFileName().startsWith("flink-dist")
&&file.getFileName().endsWith("jar")) is Always be true
Summary: When submitting a flink job with yarn-cluster, flink-dist*.jar
is repeatedly uploaded (was: When flink on yarn is submitted with
yarn-cluster, flink-dist*. Jar is repeatedly uploaded)
> When submitting a flink job with yarn-cluster, flink-dist*.jar is repeatedly
> uploaded
> -------------------------------------------------------------------------------------
>
> Key: FLINK-9793
> URL: https://issues.apache.org/jira/browse/FLINK-9793
> Project: Flink
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 1.4.2
> Reporter: linzhongjun
> Assignee: linzhongjun
> Priority: Minor
> Labels: patch
> Attachments: 20180710224808.png, 20180710224848.png,
> 20180710231518.png
>
>
> We are using flink1.4.2 in our company. When the flink job is submitted to
> run on yarn with yarn-cluster mode，we actually find that the
> flink-dist_2.11-1.4.2.jar is uploaded to HDFS. The jars lies in different
> directories e.g.,
> 1..flink/application_1525941455002_539197/flink-dist_2.11-1.4.2.jar
> 2..flink/application_1525941455002_539197/lib/flink-dist_2.11-1.4.2.jar
> Through reviewing source code of flink and having some tests, we suppose that
> the code below may have a bug in the Linux environment.
>
> java.nio.file.Path file
> !(file.getFileName().startsWith("flink-dist")
> &&file.getFileName().endsWith("jar")) is Always be true
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
