Sorry guys, I found it... it was hard-coded config in current BIXO framework (Cascading-based web crawler)
Fuad Efendi +1 416-993-2060 http://www.linkedin.com/in/liferay Tokenizer Inc. http://www.tokenizer.ca/ Data Mining, Vertical Search > -----Original Message----- > From: Fuad Efendi [mailto:[email protected]] > Sent: January-10-10 12:31 AM > To: [email protected] > Subject: OOM: I can't set -Xmx! > > > After deep investigation of specific OOMs, it seems I can't set - > Xmx1024m > for MapRed tasks; memory analysis (for Mappers & Reducers) always shows > magic > -Xmx (maximal heap size) is 536870912 bytes > > At the same time, for TaskTracker it shows > -Xmx (maximal heap size) is 1048576000 bytes > > > Strange! Hadoop 0.19.2, with hadoop-site.xml properly replicated in > cluster... > <property> > <name>mapred.child.java.opts</name> > <value>-server -Xms1g -Xmx1g</value> > > > Has anyone had anything like that? I can't set -Xmx! > > -Fuad > http://www.tokenizer.ca > >
