[
https://issues.apache.org/jira/browse/HADOOP-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15722174#comment-15722174
]
Fei Hui commented on HADOOP-13865:
----------------------------------
hi [[email protected]]
In hive source code Hadoop23Shims.java, it calls DistCp like this
public boolean runDistCp(Path src, Path dst, Configuration conf) throws
IOException {
DistCpOptions options = new DistCpOptions(Collections.singletonList(src),
dst);
options.setSyncFolder(true);
options.setSkipCRC(true);
options.preserve(FileAttribute.BLOCKSIZE);
try {
conf.setBoolean("mapred.mapper.new-api", true);
DistCp distcp = new DistCp(conf, options);
distcp.execute();
return true;
} catch (Exception e) {
throw new IOException("Cannot execute DistCp process: " + e, e);
} finally {
conf.setBoolean("mapred.mapper.new-api", false);
}
}
So i encounter the error 'java.lang.NoClassDefFoundError:
org/apache/hadoop/tools/DistCpOptions'
And i can solve the problem by setting HADOOP_CLASS
Because maybe many users encounter the problems, and maybe they spend much time
to solve it, so i open the issue and submit patch
i
> add tools to classpath by default in branch-2
> ---------------------------------------------
>
> Key: HADOOP-13865
> URL: https://issues.apache.org/jira/browse/HADOOP-13865
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 2.8.0, 2.7.3
> Reporter: Fei Hui
> Assignee: Fei Hui
> Attachments: HADOOP-13865-branch-2.001.patch
>
>
> when i run hive queries, i get errors as follow
> java.lang.NoClassDefFoundError: org/apache/hadoop/tools/DistCpOptions
> ...
> Maybe run other hadoop apps which using hadoop tools classes, will get
> similar erros
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
