Bug in S3N handling of directory markers using an object with a trailing "/"
causes jobs to fail
------------------------------------------------------------------------------------------------
Key: HADOOP-5836
URL: https://issues.apache.org/jira/browse/HADOOP-5836
Project: Hadoop Core
Issue Type: Bug
Components: fs/s3
Affects Versions: 0.18.3
Reporter: Ian Nowland
Some tools which upload to S3 and use a object terminated with a "/" as a
directory marker, for instance "s3n://mybucket/mydir/". If asked to iterate
that "directory" via listStatus(), then the current code will return an empty
file "", which the InputFormatter happily assigns to a split, and which later
causes a task to fail, and probably the job to fail.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
