Jimmy Zuber created HADOOP-17105:

             Summary: S3AFS globStatus attempts to resolve symlinks
                 Key: HADOOP-17105
                 URL: https://issues.apache.org/jira/browse/HADOOP-17105
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs/s3
            Reporter: Jimmy Zuber

The S3AFileSystem implementation of the globStatus API has a setting configured 
to resolve symlinks. Under certain circumstances, this will cause additional 
file existence checks to be performed in order to determine if a FileStatus 
signifies a symlink. As symlinks are not supported in S3AFileSystem, these 
calls are unnecessary.

Code snapshot (permalink): 

Causes additional getFileStatus call here (permalink): 

Current code snippet:
   * Override superclass so as to disable symlink resolution and so avoid
   * some calls to the FS which may have problems when the store is being
   * inconsistent.
   * {@inheritDoc}
  public FileStatus[] globStatus(
      final Path pathPattern,
      final PathFilter filter)
      throws IOException {
    return Globber.createGlobber(this)

The fix should be pretty simple, just flip "withResolveSymlinks" to false.

This message was sent by Atlassian Jira

To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Reply via email to