Uygar BAYAR wrote: > hi > thanks for the solution..it's solved my log problem but not my > http://www.nabble.com/java.lang.OutOfMemoryError%3A-Requested-array-size-exceeds-VM-limit-tf4562352.html > and gives this error message > > Exception in thread "main" java.io.IOException: Job failed! > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:604) > at org.apache.nutch.parse.ParseSegment.parse(ParseSegment.java:131) > at org.apache.nutch.parse.ParseSegment.main(ParseSegment.java:149) >
if it works on local jobrunner you possibly forgot to increase memory for spawned vm processes with hadoop conf like: <property> <name>mapred.child.java.opts</name> <value>-Xmx1000m</value> </property> -- Sami Siren
