[
https://issues.apache.org/jira/browse/HADOOP-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725170#comment-15725170
]
Steve Loughran commented on HADOOP-13865:
-----------------------------------------
Having checked with colleagues, "Hive uses distcp when the copy has to happen
across different filesystems (hdfs to s3 or across encryption zones) and when
the data to be copied is large (hive.exec.copyfile.maxsize; defaults to 32M)."
I think an issue with Hive in 2.x is that even if you don't do that, it's been
added to the shims so that unless distcp is on that CP, the shims don't load.
I'd consider that a Hive problem, as it should only worry about distcp when the
criteria are met. And, given it has a fallback, should be able to recover
> add tools to classpath by default in branch-2
> ---------------------------------------------
>
> Key: HADOOP-13865
> URL: https://issues.apache.org/jira/browse/HADOOP-13865
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 2.8.0, 2.7.3
> Reporter: Fei Hui
> Assignee: Fei Hui
> Attachments: HADOOP-13865-branch-2.001.patch
>
>
> when i run hive queries, i get errors as follow
> java.lang.NoClassDefFoundError: org/apache/hadoop/tools/DistCpOptions
> ...
> Maybe run other hadoop apps which using hadoop tools classes, will get
> similar erros
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
