Mark J Greene created HADOOP-10494:
--------------------------------------
Summary: Ensure Jets3tFileSystemStore respects URI path for block
files
Key: HADOOP-10494
URL: https://issues.apache.org/jira/browse/HADOOP-10494
Project: Hadoop Common
Issue Type: Improvement
Components: fs
Reporter: Mark J Greene
Priority: Trivial
The Jets3tFileSystemStore will currently store all block files in the root of
an S3 bucket. If you specify a path in your OutputFormat, those paths are
created, and some of the supporting meta files are stored there, but all block
files will reside in the root of the bucket.
We tracked this down to this method here, which does not use the provided URI
from the the job:
https://github.com/apache/hadoop-common/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/s3/Jets3tFileSystemStore.java#L381
--
This message was sent by Atlassian JIRA
(v6.2#6252)