[
https://issues.apache.org/jira/browse/HADOOP-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783282#comment-13783282
]
Colin Patrick McCabe commented on HADOOP-9984:
----------------------------------------------
bq. Failure to auto-resolve any symlink causes an exception for the whole
operation. There had been prior discussion of supporting an option to ignore
symlink resolution failures. Is that out of scope right now and coming later in
HADOOP-9972?
Yeah, we've been discussing that in HADOOP-9972. My feeling right now is that
we should definitely allow users to provide an error handler for
{{globStatus}}, as well as the ability to skip resolving symlinks. We need a
{{globStatus}} error handler for other reasons as well, such as to improve
FSShell error handling I don't think {{listStatus}} needs an error handler
since users can always turn to {{listLinkStatus}} and do the resolution
themselves, which seems simpler. But it's best to discuss that on HADOOP-9972
:)
Thanks for testing this on Windows.
> FileSystem#globStatus and FileSystem#listStatus should resolve symlinks by
> default
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-9984
> URL: https://issues.apache.org/jira/browse/HADOOP-9984
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.1.0-beta
> Reporter: Colin Patrick McCabe
> Assignee: Colin Patrick McCabe
> Priority: Blocker
> Attachments: HADOOP-9984.001.patch, HADOOP-9984.003.patch,
> HADOOP-9984.005.patch, HADOOP-9984.007.patch, HADOOP-9984.009.patch,
> HADOOP-9984.010.patch, HADOOP-9984.011.patch, HADOOP-9984.012.patch
>
>
> During the process of adding symlink support to FileSystem, we realized that
> many existing HDFS clients would be broken by listStatus and globStatus
> returning symlinks. One example is applications that assume that
> !FileStatus#isFile implies that the inode is a directory. As we discussed in
> HADOOP-9972 and HADOOP-9912, we should default these APIs to returning
> resolved paths.
--
This message was sent by Atlassian JIRA
(v6.1#6144)