This new method crossPlatformifyMREnv is newly added in 2.4.0 release,
which version of MR client are you using?
can you make sure you have the same version of client jars
Jian
On Wed, Jun 18, 2014 at 10:37 PM, Grandl Robert rgra...@yahoo.com.invalid
wrote:
Hi guys,
I don't know what I did
Hey Everyone,
There have been various bug fixes that have went into
branch-0.23 since the 0.23.10 release. We think its time to do a 0.23.11.
This is also the last planned release off of branch-0.23 we plan on doing.
The RC is available at:
I think we should include this issue in 2.4.1, so I uploaded a patch to
fix it. I'll appreciate your review.
Thanks,
Akira
(2014/06/18 12:13), Vinod Kumar Vavilapalli wrote:
There is one item [MAPREDUCE-5830 HostUtil.getTaskLogUrl is not backwards
binary compatible with 2.3] marked for 2.4.
Hmm,
Things are really weird. So If I don't add TEZ jars/conf in hadoop_classpath
simply running Mapreduce jobs works. If I add TEZ jars/conf to hadoop_classpath
and try to run mapreduce jobs, it fails with the exception:
14/06/19 14:46:40 INFO mapreduce.JobSubmitter: Cleaning up the staging
Hi Robert,
If you look at the tez jars, you will probably see a couple of mapreduce jars
that Tez depends on under TEZ_BASE_DIR/lib/. Are these jars inconsistent with
respect to the version of hadoop/mapreduce on the cluster?
— Hitesh
On Jun 19, 2014, at 2:59 PM, Grandl Robert
Hi Hitesh,
It seems tez is using 2.2 while hadoop-2.4 has 2-4 for mapreduce. .Is this
the problem ?
If yes, how can I fix ?
For tez-0.4 they are:
hadoop@nectar-11:~/rgrandl$ ls tez/tez-0.4.0-incubating/lib/
avro-1.7.4.jar
hadoop-mapreduce-client-core-2.2.0.jar
I tried to copy hadoop-mapreduce-client-2.4* from hadoop-2.4 to tez-0.4 and
also copy to hdfs in /apps/tez/lib, and run Hive. But even if I set
hive.execution.engine=tez or mr, jobs are running such as tez only :).
(framework.name=yarn)
I know I have tried before hive-0.13 and tez-0.5 and
HI Robert,
Copying the hadoop-mapreduce-*-2.4 jars to the tez dir was what I would have
recommended. Tez is compatible with both 2.2 and 2.4 so either set should work.
For everything running as tez, I am guessing somehow you have yarn-tez set in
one of the config files. For hive queries, I
Hitesh,
Thanks so much for your advices. You are right, there it seems to be an issue
with setting hive execution engine to mr after it is tez. I configure it in
hive-site.xml plus moving mapreduce-2.4 jars in tez-0.4 and now works just fine.
Hurray !
Thanks again for your help,
robert
Chris Trezzo created YARN-2183:
--
Summary: Cleaner service for cache manager
Key: YARN-2183
URL: https://issues.apache.org/jira/browse/YARN-2183
Project: Hadoop YARN
Issue Type: Sub-task
Jira: https://issues.apache.org/jira/browse/YARN-2144
Build: https://builds.apache.org/job/PreCommit-YARN-Build/4028/
###
## LAST 60 LINES OF THE CONSOLE
###
Jira: https://issues.apache.org/jira/browse/YARN-2179
Build: https://builds.apache.org/job/PreCommit-YARN-Build/4029/
###
## LAST 60 LINES OF THE CONSOLE
###
Jira: https://issues.apache.org/jira/browse/YARN-1709
Build: https://builds.apache.org/job/PreCommit-YARN-Build/4030/
###
## LAST 60 LINES OF THE CONSOLE
###
Jira: https://issues.apache.org/jira/browse/YARN-2074
Build: https://builds.apache.org/job/PreCommit-YARN-Build/4031/
###
## LAST 60 LINES OF THE CONSOLE
###
Jeff Zhang created YARN-2184:
Summary: ResourceManager may fail due to name node in safe mode
Key: YARN-2184
URL: https://issues.apache.org/jira/browse/YARN-2184
Project: Hadoop YARN
Issue Type:
15 matches
Mail list logo
