Aki Tanaka created HADOOP-17042:
-----------------------------------
Summary: Hadoop distcp throws "ERROR: Tools helper
///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found"
Key: HADOOP-17042
URL: https://issues.apache.org/jira/browse/HADOOP-17042
Project: Hadoop Common
Issue Type: Improvement
Affects Versions: 3.1.3, 3.2.1
Reporter: Aki Tanaka
Attachments: HADOOP-17042.patch
On Hadoop 3.x, we see following "ERROR: Tools helper
///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found." message on the
first line of the command output when running Hadoop DistCp.
{code:java}
$ hadoop distcp /path/to/src /user/hadoop/
ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not
found.
2020-05-14 17:11:53,173 INFO tools.DistCp: Input Options:
DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false,
ignoreFailures=false, overwrite=false, append=false, useDiff=false,
useRdiff=false, fromSnapshot=null, toSnapshot=null, skipCRC=false, blocking=true
..
{code}
This message was added by HADOOP-12857 and it would be an expected behavior.
DistCp calls 'hadoop_add_to_classpath_tools hadoop-distcp' when [it
starts|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-distcp/src/main/shellprofile.d/hadoop-distcp.sh],
and the error is returned because the hadoop-distcp.sh does not exist in the
tools directory.
However, that error message confuses us. Since this is not an user end
configuration issue, I would think it's better to change the log level to debug
(hadoop_debug).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
