Hi, Big thanks .. I found it .. For nutch 0.7.2 export NUTCH_HEAPSIZE=1500
Does the job (the nutch shell script automatically adds "m" at the parameter) Thanks again Bogdan > -----Original Message----- > From: Dennis Kubes [mailto:[EMAIL PROTECTED] > Sent: Monday, September 11, 2006 1:49 AM > To: [email protected] > Subject: Re: java.lang.OutOfMemoryError: Java heap space > > I don't know if it is the same in 7.2 but in .8 there is a > hadoop-env.sh file where you can uncomment the JAVA_OPTS > variable and give the heap more memory. Either way the JVM > must be started with more memory, something like this vm > option -Xmx1024M for a 1Gig heap. > > Dennis > > Bogdan Kecman wrote: > > > > Hi, > > I have strange prob with nutch 0.7.2 not sure how to fix > this, must be some config tweak but tried few different > settings and still have the same prob ... > > how to increare this "java heap space" ? > > > > thanks in advance > > here is the log: > > > > > > 060909 160139 SEVERE error writing > output:java.lang.OutOfMemoryError: > > Java heap space > > java.lang.OutOfMemoryError: Java heap space > > 060909 160139 SEVERE error writing > output:java.io.IOException: key out > > of order: 161408 after 161408 > > java.io.IOException: key out of order: 161408 after 161408 > > at > org.apache.nutch.io.MapFile$Writer.checkKey(MapFile.java:134) > > at > org.apache.nutch.io.MapFile$Writer.append(MapFile.java:120) > > at > org.apache.nutch.io.ArrayFile$Writer.append(ArrayFile.java:39) > > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.outputPage(Fetc > her.java:280) > > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.handleFetch(Fet > cher.java:261) > > at > > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:193) > > 060909 160139 SEVERE error writing > output:java.io.IOException: key out > > of order: 161408 after 161408 > > java.io.IOException: key out of order: 161408 after 161408 > > at > org.apache.nutch.io.MapFile$Writer.checkKey(MapFile.java:134) > > at > org.apache.nutch.io.MapFile$Writer.append(MapFile.java:120) > > at > org.apache.nutch.io.ArrayFile$Writer.append(ArrayFile.java:39) > > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.outputPage(Fetc > her.java:280) > > at > org.apache.nutch.fetcher.Fetcher$FetcherThread.handleFetch(Fet > cher.java:261) > > at > > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:193) > > Exception in thread "main" java.lang.RuntimeException: > SEVERE error logged. Exiting fetcher. > > at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:354) > > at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:488) > > at > > com.alteray.linex.aggregation.StartHere.main(StartHere.java:183) > > 060909 160313 SEVERE error writing > output:java.io.IOException: key out > > of order: 161408 after 161408 ... > > ... > > > > ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
