[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15602374#comment-15602374 ]
Steve Loughran commented on HDFS-9455: -------------------------------------- * Anything raising an IOE should be interpreted as "something went wrong over the wire", or at least in the FS client (auth, etc). * the existing catching of Throwable is too broad...that can include things like OOM other things which are very serious runtimes. Very much not "invalid argument" I think the handlers could go more like # IOE -> rethrow # Exception -> say "error" # Throwable -> report as serious failure > In distcp, Invalid Argument Error thrown in case of filesystem operation > failure > -------------------------------------------------------------------------------- > > Key: HDFS-9455 > URL: https://issues.apache.org/jira/browse/HDFS-9455 > Project: Hadoop HDFS > Issue Type: Bug > Components: distcp, security > Reporter: Archana T > Assignee: Daisuke Kobayashi > Priority: Minor > Attachments: HDFS-9455.01.patch > > > When Filesystem Operation failure happens during discp, > Wrong exception : Invalid Argument thrown along with distcp command Usage. > {color:red} > hadoop distcp webhdfs://IP:25003/test/testfile webhdfs://IP:25003/myp > Invalid arguments: Unexpected end of file from server > usage: distcp OPTIONS [source_path...] <target_path> > OPTIONS > -append Reuse existing data in target files and > append new data to them if possible > -async Should distcp execution be blocking > -atomic Commit all changes or none > -bandwidth <arg> Specify bandwidth per map in MB > -delete Delete from target, files missing in source > -diff <arg> Use snapshot diff report to identify the > difference between source and target > -f <arg> List of files that need to be copied > -filelimit <arg> (Deprecated!) Limit number of files copied > to <= n > -i Ignore failures during copy > ..... > {color} > Instead Proper Exception has to be thrown. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org