[
https://issues.apache.org/jira/browse/FLINK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
konwu updated FLINK-17569:
--------------------------
Description:
Currently, HadoopRecoverableFsDataOutputStream#waitUntilLeaseIsRevoked method
is not support ViewFileSystem
and it will cause the same issue fail to recover after taskmanager failure
I try to resolve the real path and FileSystem of ViewFileSystem and it works
{code:java}
if (fs instanceof ViewFileSystem) {
ViewFileSystem vfs = (ViewFileSystem) fs;
Path resolvePath = vfs.resolvePath(path);
DistributedFileSystem dfs = (DistributedFileSystem)
resolvePath.getFileSystem(fs.getConf());
return waitUntilLeaseIsRevoked(dfs, resolvePath);
}
{code}
was:
Currently waitUntilLeaseIsRevoked method is not support ViewFileSystem and it
will case the same issue [fail to recover after taskmanager
failure|https://issues.apache.org/jira/browse/FLINK-11419]
I try to resolve the real path and FileSystem of ViewFileSystem and it works
{code:java}
if (fs instanceof ViewFileSystem) {
ViewFileSystem vfs = (ViewFileSystem) fs;
Path resolvePath = vfs.resolvePath(path);
DistributedFileSystem dfs = (DistributedFileSystem)
resolvePath.getFileSystem(fs.getConf());
return waitUntilLeaseIsRevoked(dfs, resolvePath);
}
{code}
> to support ViewFileSystem when wait lease revoke of hadoop filesystem
> ---------------------------------------------------------------------
>
> Key: FLINK-17569
> URL: https://issues.apache.org/jira/browse/FLINK-17569
> Project: Flink
> Issue Type: Bug
> Components: FileSystems
> Reporter: konwu
> Priority: Major
> Labels: pull-request-available
>
> Currently, HadoopRecoverableFsDataOutputStream#waitUntilLeaseIsRevoked method
> is not support ViewFileSystem
>
> and it will cause the same issue fail to recover after taskmanager failure
>
>
> I try to resolve the real path and FileSystem of ViewFileSystem and it works
> {code:java}
> if (fs instanceof ViewFileSystem) {
> ViewFileSystem vfs = (ViewFileSystem) fs;
> Path resolvePath = vfs.resolvePath(path);
> DistributedFileSystem dfs = (DistributedFileSystem)
> resolvePath.getFileSystem(fs.getConf());
> return waitUntilLeaseIsRevoked(dfs, resolvePath);
> }
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
