Hello,
I had previously emailed regarding heap size issue and have discovered
that the hadoop-site.xml is not loading completely, i.e
Configuration defaults = new Configuration();
JobConf jobConf = new JobConf(defaults, XYZ.class);
System.out.println("1:"+jobConf.get("mapred.child.java.opts"));
System.out.println("2:"+jobConf.get("mapred.map.tasks"));
System.out.println("3:"+jobConf.get("mapred.reduce.tasks"));
System.out.println("3:"+jobConf.get("mapred.tasktracker.reduce.tasks.maximum"));
returns -Xmx200m, 2,1,2 respectively, even though the numbers in the
hadoop-site.xml are very different.
Is there a way for hadoop to dump the parameters read in from
hadoop-site.xml and hadoop-default.xml?
--
Saptarshi Guha - [email protected]
