[
https://issues.apache.org/jira/browse/FLINK-29797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangmenglong updated FLINK-29797:
---------------------------------
Description:
If I set the value of *fs.default-scheme* to other scheme and run a job on yarn.
I got this exception:
{code:java}
Caused by: java.io.FileNotFoundException: File does not exist:
/tmp/application_1667097340114_0001-flink-conf.yaml9110057305807570477.tmp
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128)
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120)
at
org.apache.flink.yarn.YarnApplicationFileUploader.registerSingleLocalResource(YarnApplicationFileUploader.java:168)
at
org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1047)
at
org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:623)
at
org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:490)
... 24 more {code}
I think the cause of this problem may be
*tmpConfigurationFile.getAbsolutePath() !issue.png!*
was:
If I set the value of *fs.default-scheme* to other scheme and run a job on yarn.
I got this exception:
{code:java}
Caused by: java.io.FileNotFoundException: File does not exist:
/tmp/application_1667097340114_0001-flink-conf.yaml9110057305807570477.tmp
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128)
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120)
at
org.apache.flink.yarn.YarnApplicationFileUploader.registerSingleLocalResource(YarnApplicationFileUploader.java:168)
at
org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1047)
at
org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:623)
at
org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:490)
... 24 more {code}
I think the cause of this problem may be
*tmpConfigurationFile.getAbsolutePath()*
> can't run a job on yarn, if set fs.default-scheme
> -------------------------------------------------
>
> Key: FLINK-29797
> URL: https://issues.apache.org/jira/browse/FLINK-29797
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
> Affects Versions: 1.16.0
> Reporter: wangmenglong
> Priority: Major
> Attachments: issue.png
>
>
> If I set the value of *fs.default-scheme* to other scheme and run a job on
> yarn.
> I got this exception:
> {code:java}
> Caused by: java.io.FileNotFoundException: File does not exist:
> /tmp/application_1667097340114_0001-flink-conf.yaml9110057305807570477.tmp
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120)
> at
> org.apache.flink.yarn.YarnApplicationFileUploader.registerSingleLocalResource(YarnApplicationFileUploader.java:168)
> at
> org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1047)
> at
> org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:623)
> at
> org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:490)
> ... 24 more {code}
> I think the cause of this problem may be
> *tmpConfigurationFile.getAbsolutePath() !issue.png!*
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
