[
https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16118177#comment-16118177
]
Yonger commented on HADOOP-14745:
---------------------------------
I create that path structure through s3cmd, and yes , we can't do this by s3a
itself.
But, s3 or s3-compatible storage allow them existed within the same folder, and
the common workload running on Hadoop on Ceph is data analysis, which means the
data in these storage should be store by other way instead of s3a, and read
data from storage through s3a, which can't stop this issue happen again.
> s3a getFileStatus can't return expect result when existing a file and
> directory with the same name
> --------------------------------------------------------------------------------------------------
>
> Key: HADOOP-14745
> URL: https://issues.apache.org/jira/browse/HADOOP-14745
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/s3
> Affects Versions: 2.8.0
> Reporter: Yonger
> Assignee: Yonger
>
> {code}
> [**** hadoop-aws]# /root/hadoop/s3cmd/s3cmd ls s3://test-aws-s3a/user/root/
> DIR s3://test-aws-s3a/user/root/ccc/
> 2017-08-08 07:04 0 s3://test-aws-s3a/user/root/ccc
> {code}
> if we expect to ccc is a directory by code :
> {code}
> Path test=new Path("ccc");
> fs.getFileStatus(test);
> {code}
> actually, it will tell us it is a file:
> {code}
> 2017-08-08 15:08:40,566 [JUnit-case1] DEBUG s3a.S3AFileSystem
> (S3AFileSystem.java:getFileStatus(1576)) - Getting path status for
> s3a://test-aws-s3a/user/root/ccc (user/root/ccc)
> 2017-08-08 15:08:40,566 [JUnit-case1] DEBUG s3a.S3AFileSystem
> (S3AStorageStatistics.java:incrementCounter(60)) - object_metadata_requests
> += 1 -> 3
> 2017-08-08 15:08:40,580 [JUnit-case1] DEBUG s3a.S3AFileSystem
> (S3AFileSystem.java:getFileStatus(1585)) - Found exact file: normal file
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
