[
https://issues.apache.org/jira/browse/HADOOP-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238913#comment-13238913
]
Daryn Sharp commented on HADOOP-7209:
-------------------------------------
bq. [...] other users just want to make sure the output path is removed before
launching the mapreduce job, they don't want to fail the script.
I'm still a bit confused. If the user wants to make sure the output directory
is removed prior to launching the MR job, I don't think they want {{rmdir
--ignore-fail-on-non-empty $path}}. An existing output directory will be
silently ignored. Pig will then launch a MR job that fails due to the existing
directory that wasn't removed. I must be misunderstanding the explanation...
I think the user wants to run {{rm -r -f $path}}?
> Extensions to FsShell
> ---------------------
>
> Key: HADOOP-7209
> URL: https://issues.apache.org/jira/browse/HADOOP-7209
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.20.3
> Reporter: Olga Natkovich
> Assignee: Daryn Sharp
> Fix For: 0.24.0
>
>
> Our project, Pig, exposes FsShell functionality to our end users through a
> shell command. We want to use this command with no modifications to make sure
> that whether you work with HDFS through Hadoop or Pig you get identical
> semantics.
> The main concern that has been recently raised by our users is that there is
> no way to ignore certain failures that they consider to be benign, for
> instance, removing a non-existent directory.
> We have 2 asks related to this issue:
> (1) Meaningful error code returned from FsShell (we use java class) so that
> we can take different actions on different errors
> (2) Unix like ways to tell the command to ignore certain behavior. Here are
> the commands that we would like to be expanded/implemented:
> * rm -f
> * rmdir ---ignore-fail-on-non-empty
> * mkdir -p
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
