[
https://issues.apache.org/jira/browse/FLINK-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
linzhongjun updated FLINK-9793:
-------------------------------
Description:
Our company is using flink1.4.2,When the flink program is submitted to run on
yarn,To a yarn - cluster mode,We found that the flink-dist_2.11-1.4.2.jar was
repeatedly uploaded to HDFS,They are in different directories eg;
1..flink/application_1525941455002_539197/flink-dist_2.11-1.4.2.jar
2..flink/application_1525941455002_539197/lib/flink-dist_2.11-1.4.2.jar
Through source code analysis and testing, we found that this code has bugs in
the Linux environment。
java.nio.file.Path file
!(file.getFileName().startsWith("flink-dist")
&&file.getFileName().endsWith("jar")) is Always be true
was:
Our company is using flink1.4.2,When the flink program is submitted to run on
yarn,To a yarn - cluster mode,We found that the flink-dist_2.11-1.4.2.jar was
repeatedly uploaded to HDFS,They are in different directories eg;
1..flink/application_1525941455002_539197/flink-dist_2.11-1.4.2.jar
2..flink/application_1525941455002_539197/lib/flink-dist_2.11-1.4.2.jar
> When flink on yarn is submitted with yarn-cluster, flink-dist*. Jar is
> repeatedly uploaded
> ------------------------------------------------------------------------------------------
>
> Key: FLINK-9793
> URL: https://issues.apache.org/jira/browse/FLINK-9793
> Project: Flink
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 1.4.2
> Reporter: linzhongjun
> Priority: Major
> Labels: patch
> Attachments: 20180710224808.png, 20180710224848.png
>
>
> Our company is using flink1.4.2,When the flink program is submitted to run on
> yarn,To a yarn - cluster mode,We found that the flink-dist_2.11-1.4.2.jar was
> repeatedly uploaded to HDFS,They are in different directories eg;
> 1..flink/application_1525941455002_539197/flink-dist_2.11-1.4.2.jar
> 2..flink/application_1525941455002_539197/lib/flink-dist_2.11-1.4.2.jar
> Through source code analysis and testing, we found that this code has bugs in
> the Linux environment。
>
> java.nio.file.Path file
> !(file.getFileName().startsWith("flink-dist")
> &&file.getFileName().endsWith("jar")) is Always be true
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)