This is getting too common, so I've added it to the FAQ. http://wiki.apache.org/hadoop/FAQ#How_do_I_get_my_MapReduce_Java_Program_to_read_the_Cluster.27s_set_configuration_and_not_just_defaults.3F
On Thu, Jan 27, 2011 at 6:21 AM, Jun Young Kim <[email protected]> wrote: > Hi, > > I've set io.sort.mb to 400 in $HADOOP_HOME/conf/core-site.xml like this. > <property> > <name>mapreduce.task.io.sort.mb</name> > <value>400</value> > </property> > <property> > <name>dfs.block.size</name> > <value>536870912</value> > </property> > > but, after running my jar application I found the following result in a > logs/job_2010*_conf.xml > ... > <property> > <name> > io.sort.mb > </name> > <value> > 100 > </value> > </property> > <property> > <name> > fs.s3.block.size > </name> > <value> > 67108864 > </value> > </property> > ... > > other things are all different what I set. > > why my configuration didn't affect the running environment? > > -- > Junyoung Kim ([email protected]) > > -- Harsh J www.harshj.com
