[
https://issues.apache.org/jira/browse/FLINK-22769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adrian Zhong updated FLINK-22769:
---------------------------------
Description:
If we pass `-yt ` a symbolic directory, we will get an exception:
!image-2021-05-25-18-35-00-319.png|width=666,height=105!
The root cause is not here but in YarnApplicationFileUploader :
{code:java}
final java.nio.file.Path shipPath = file.toPath();
final java.nio.file.Path parentPath = shipPath.getParent();
Files.walkFileTree(
shipPath.toRealPath(),
new SimpleFileVisitor<java.nio.file.Path>() {
@Override
public FileVisitResult visitFile(
java.nio.file.Path file, BasicFileAttributes attrs) {
localPaths.add(new Path(file.toUri())); //root cause: file is a
symbolic file, not any file under real path.
relativePaths.add(
new Path(
localResourcesDirectory,
parentPath.relativize(file).toString()));
return FileVisitResult.CONTINUE;
}
});
{code}
Please assign to me, I'd like to be a contributor.
Any other please *do not implement* or create pr before this issue being
assigned.
Note: this is not an os platform specific bug.
was:
If we pass `-yt ` a symbolic directory, we will get an exception:
!image-2021-05-25-18-35-00-319.png|width=666,height=105!
The root cause is not here but in YarnApplicationFileUploader :
{code:java}
final java.nio.file.Path shipPath = file.toPath();
final java.nio.file.Path parentPath = shipPath.getParent();
Files.walkFileTree(
shipPath.toRealPath(),
new SimpleFileVisitor<java.nio.file.Path>() {
@Override
public FileVisitResult visitFile(
java.nio.file.Path file, BasicFileAttributes attrs) {
localPaths.add(new Path(file.toUri())); //root cause: file is a
symbolic file, not any file under real path.
relativePaths.add(
new Path(
localResourcesDirectory,
parentPath.relativize(file).toString()));
return FileVisitResult.CONTINUE;
}
});
{code}
Please assign to me, I'd like to be a contributor.
Any other please *do not implement* or create pr before this issue being
assigned.
Note: this is not an os platform specific bug.
> yarnship do not support symbolic directory
> ------------------------------------------
>
> Key: FLINK-22769
> URL: https://issues.apache.org/jira/browse/FLINK-22769
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN
> Affects Versions: 1.12.2, 1.13.0, 1.13.1
> Reporter: Adrian Zhong
> Priority: Major
> Labels: Dependency, client, upload, yarn
> Attachments: image-2021-05-25-18-35-00-319.png
>
>
> If we pass `-yt ` a symbolic directory, we will get an exception:
> !image-2021-05-25-18-35-00-319.png|width=666,height=105!
> The root cause is not here but in YarnApplicationFileUploader :
> {code:java}
> final java.nio.file.Path shipPath = file.toPath();
> final java.nio.file.Path parentPath = shipPath.getParent();
> Files.walkFileTree(
> shipPath.toRealPath(),
> new SimpleFileVisitor<java.nio.file.Path>() {
> @Override
> public FileVisitResult visitFile(
> java.nio.file.Path file, BasicFileAttributes attrs) {
> localPaths.add(new Path(file.toUri())); //root cause: file is
> a symbolic file, not any file under real path.
> relativePaths.add(
> new Path(
> localResourcesDirectory,
> parentPath.relativize(file).toString()));
> return FileVisitResult.CONTINUE;
> }
> });
> {code}
> Please assign to me, I'd like to be a contributor.
> Any other please *do not implement* or create pr before this issue being
> assigned.
> Note: this is not an os platform specific bug.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
