[
https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15602374#comment-15602374
]
Steve Loughran commented on HDFS-9455:
--------------------------------------
* Anything raising an IOE should be interpreted as "something went wrong over
the wire", or at least in the FS client (auth, etc).
* the existing catching of Throwable is too broad...that can include things
like OOM other things which are very serious runtimes. Very much not "invalid
argument"
I think the handlers could go more like
# IOE -> rethrow
# Exception -> say "error"
# Throwable -> report as serious failure
> In distcp, Invalid Argument Error thrown in case of filesystem operation
> failure
> --------------------------------------------------------------------------------
>
> Key: HDFS-9455
> URL: https://issues.apache.org/jira/browse/HDFS-9455
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: distcp, security
> Reporter: Archana T
> Assignee: Daisuke Kobayashi
> Priority: Minor
> Attachments: HDFS-9455.01.patch
>
>
> When Filesystem Operation failure happens during discp,
> Wrong exception : Invalid Argument thrown along with distcp command Usage.
> {color:red}
> hadoop distcp webhdfs://IP:25003/test/testfile webhdfs://IP:25003/myp
> Invalid arguments: Unexpected end of file from server
> usage: distcp OPTIONS [source_path...] <target_path>
> OPTIONS
> -append Reuse existing data in target files and
> append new data to them if possible
> -async Should distcp execution be blocking
> -atomic Commit all changes or none
> -bandwidth <arg> Specify bandwidth per map in MB
> -delete Delete from target, files missing in source
> -diff <arg> Use snapshot diff report to identify the
> difference between source and target
> -f <arg> List of files that need to be copied
> -filelimit <arg> (Deprecated!) Limit number of files copied
> to <= n
> -i Ignore failures during copy
> .....
> {color}
> Instead Proper Exception has to be thrown.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
