I don't know if it is the same in 7.2 but in .8 there is a hadoop-env.sh file where you can uncomment the JAVA_OPTS variable and give the heap more memory. Either way the JVM must be started with more memory, something like this vm option -Xmx1024M for a 1Gig heap.
Dennis Bogdan Kecman wrote: > > Hi, > I have strange prob with nutch 0.7.2 not sure how to fix this, must be some > config tweak but tried few different settings and still have the same prob > ... > how to increare this "java heap space" ? > > thanks in advance > here is the log: > > > 060909 160139 SEVERE error writing output:java.lang.OutOfMemoryError: Java > heap space > java.lang.OutOfMemoryError: Java heap space > 060909 160139 SEVERE error writing output:java.io.IOException: key out of > order: 161408 after 161408 > java.io.IOException: key out of order: 161408 after 161408 > at org.apache.nutch.io.MapFile$Writer.checkKey(MapFile.java:134) > at org.apache.nutch.io.MapFile$Writer.append(MapFile.java:120) > at org.apache.nutch.io.ArrayFile$Writer.append(ArrayFile.java:39) > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.outputPage(Fetcher.java:280) > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.handleFetch(Fetcher.java:261) > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:193) > 060909 160139 SEVERE error writing output:java.io.IOException: key out of > order: 161408 after 161408 > java.io.IOException: key out of order: 161408 after 161408 > at org.apache.nutch.io.MapFile$Writer.checkKey(MapFile.java:134) > at org.apache.nutch.io.MapFile$Writer.append(MapFile.java:120) > at org.apache.nutch.io.ArrayFile$Writer.append(ArrayFile.java:39) > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.outputPage(Fetcher.java:280) > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.handleFetch(Fetcher.java:261) > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:193) > Exception in thread "main" java.lang.RuntimeException: SEVERE error logged. > Exiting fetcher. > at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:354) > at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:488) > at com.alteray.linex.aggregation.StartHere.main(StartHere.java:183) > 060909 160313 SEVERE error writing output:java.io.IOException: key out of > order: 161408 after 161408 > ... > ... > > ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
