I usually do try and error. Start with some very large value and do a
binary search :)
--sebastian
On 03/09/2014 01:30 PM, Mahmood Naderan wrote:
Excuse me, I added the -Xmx option and restarted the hadoop services using
sbin/stop-all.sh && sbin/start-all.sh
however still I get heap size error. How can I find the correct and needed heap
size?
Regards,
Mahmood
On Sunday, March 9, 2014 1:37 PM, Mahmood Naderan <[email protected]> wrote:
OK I found that I have to add this property to mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xmx2048m</value>
</property>
Regards,
Mahmood
On Sunday, March 9, 2014 11:39 AM, Mahmood Naderan <[email protected]> wrote:
Hello,
I ran this command
./bin/mahout wikipediaXMLSplitter -d
examples/temp/enwiki-latest-pages-articles.xml -o wikipedia/chunks -c 64
but got this error
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
There are many web pages regarding this and the solution is to add "-Xmx 2048M" for
example. My question is, that option should be passed to java command and not Mahout. As result,
running "./bin/mahout -Xmx 2048M" shows that there is no such option. What should I do?
Regards,
Mahmood
