This sounds like an environment issue with your Hadoop installation.


Are the xml files in your classpath? Try “hadoop classpath” command and see
if they are.

Do you have HADOOP_CONF_DIR or YARN_CONF_DIR set in your env?



If you can submit an MR job from the command line (using “hadoop jar ….”
command) then you should be able to submit an MR on Tez job from the same
command line.



Bikas



*From:* Bala Krishna Gangisetty [mailto:[email protected]]
*Sent:* Tuesday, June 10, 2014 3:35 PM
*To:* [email protected]
*Subject:* Re: Tez configuration



-D option works fine. But through mapred-site.xmI is not working.



Tentatively I can use -D option. Eventually, I would like this config to be
picked from mapred-site.xml. I double checked the xml file that is in use
on client machine. But no luck.



On Tue, Jun 10, 2014 at 2:47 PM, Siddharth Seth <[email protected]> wrote:

Client node config.



On Tue, Jun 10, 2014 at 1:59 PM, Bala Krishna Gangisetty <[email protected]>
wrote:

Is the value for "mapreduce.framework.name" property picked from in client
node config, or  resource manager node config?





On Tue, Jun 10, 2014 at 1:41 PM, Siddharth Seth <[email protected]> wrote:

Bala,

Setting "mapreduce.framework.name" in mapred-site.xml should just work. Can
you verify that the correct mapred-site (or configuration directory is
being used).

Alternately, you can try setting it while launching a job.

e.g. for wordcount

hadoop jar <EXAMPLE_JAR_PATH> wordcount -Dmapreduce.framework.name=yarn-tez
<inDir> <outDir>



On Tue, Jun 10, 2014 at 1:36 PM, Bala Krishna Gangisetty <[email protected]>
wrote:

Hi folks,



I am trying to run a mapreduce program with Tez framework and without it.
The official doc says to alter "mapreduce.framework.name" property in
mapred-site.xml to switch across Tez and MR frameworks. Even after updating
property value to "yarn-tez" from "yarn", I see my mapreduce program is not
picking up Tez framework. All my jars location, class paths are being set
correctly. Is there some config pararmeter I am missing? or, Is "
mapreduce.framework.name" property in mapred-site.xml file honored?



--Bala G.

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Reply via email to