[
https://issues.apache.org/jira/browse/HADOOP-13622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512833#comment-15512833
]
Steve Loughran commented on HADOOP-13622:
-----------------------------------------
no, no timetable.
What would be good would be some special section in
{{hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md}} on
"fs shell commands and object stores"
* why you can get not found exceptions on an {{-fs ls s3a://bucket }} URL if
you leave off the trailing / (it's because there's no homedir, and the shell
assumes its a relative path)
* distcp atomic not working
* why you should use {{fs -put -d}} to upload files without the rename
* why you should use {{-skipTrash}} when deleting things
* why you shouldn't put secrets in the URLs, e.g. s3n://awsId:secret@mybucket/
Looks also like the document doesn't even mention put's -d and -f options, so
it could do with a quick comparison of what usage info gets printed in a
{{hadoop fs}} message and what the docs say, updating the docs.
Would you be willing to do this?
> `-atomic` should not be supported while using `distcp` command in object file
> system
> ------------------------------------------------------------------------------------
>
> Key: HADOOP-13622
> URL: https://issues.apache.org/jira/browse/HADOOP-13622
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Yuanbo Liu
> Assignee: Yuanbo Liu
>
> After discussing with [[email protected]] in HADOOP-13593, I get the point
> that none of the object stores support atomic renames. So I file a new jira
> and ready to provide a patch to disable `distcp -atomic` in object file
> system.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
