Saptarshi Guha wrote:
Hello, I had previously emailed regarding heap size issue and have discovered that the hadoop-site.xml is not loading completely, i.e Configuration defaults = new Configuration(); JobConf jobConf = new JobConf(defaults, XYZ.class); System.out.println("1:"+jobConf.get("mapred.child.java.opts")); System.out.println("2:"+jobConf.get("mapred.map.tasks")); System.out.println("3:"+jobConf.get("mapred.reduce.tasks")); System.out.println("3:"+jobConf.get("mapred.tasktracker.reduce.tasks.maximum"));returns -Xmx200m, 2,1,2 respectively, even though the numbers in the hadoop-site.xml are very different. Is there a way for hadoop to dump the parameters read in from hadoop-site.xml and hadoop-default.xml?
Is your hadoop-site.xml present in the conf (HADOOP_CONF_DIR) directory? http://hadoop.apache.org/core/docs/r0.19.0/cluster_setup.html#Configuration -Amareshwari
