I had this issue on kernel 2.6, i upgraded to the latest release as noted by a redhat bug and it has fixed all of my java errors. Don't know if that is what you are seeing.
I'm able to analyze up to 75 million (and growing) without crashing. -byron --- Stefan Groschupf <[EMAIL PROTECTED]> wrote: > Hi, > > I notice something strange, I had a system crash > until fetching (our > admin made a mistake). > Then i had deleted the latest segment. > I try to continue fetching but until segment > generation i got a > OutOfMemoryError. > I tried different setups with -Xms and Xmx but > nothing changed. > My db is > 1 GB. > > here my the std.out: > [EMAIL PROTECTED]:~/nutch-0.5-dev$ bin/nutch generate db > segments -topN 1000 > 040615 001657 FetchListTool started > 040615 001657 topN:1000 > 040615 001658 loading > file:/home/nutch/nutch-0.5-dev/conf/nutch-default.xml > 040615 001658 loading > file:/home/nutch/nutch-0.5-dev/conf/nutch-site.xml > 040615 001659 Processing page 50000... > 040615 001659 Processing page 100000... > 040615 001659 Processing page 150000... > 040615 001659 Processing page 200000... > 040615 001700 Processing page 250000... > 040615 001700 Processing page 300000... > 040615 001700 Processing page 350000... > 040615 001700 Processing page 400000... > 040615 001701 Processing page 450000... > 040615 001701 Processing page 500000... > 040615 001701 Processing page 550000... > 040615 001701 Overall processing: Sorted 0 entries > in 0.0 seconds. > 040615 001701 Overall processing: Sorted NaN > entries/second > Exception in thread "main" > java.lang.OutOfMemoryError > > I wondering why it crashs until sorting and not > until parsing. > Is there may be a other error in the db? > Any idea how to solve the problem? Or should i > refetch all ? ;( > > Thanks for any hints. > Stefan > > > --------------------------------------------------------------- > enterprise information technology consulting > open technology: http://www.media-style.com > open source: http://www.weta-group.net > open discussion: http://www.text-mining.org > > > > ------------------------------------------------------- > This SF.Net email is sponsored by The 2004 > JavaOne(SM) Conference > Learn from the experts at JavaOne(SM), Sun's > Worldwide Java Developer > Conference, June 28 - July 1 at the Moscone Center > in San Francisco, CA > REGISTER AND SAVE! http://java.sun.com/javaone/sf > Priority Code NWMGYKND > _______________________________________________ > Nutch-developers mailing list > [EMAIL PROTECTED] > https://lists.sourceforge.net/lists/listinfo/nutch-developers > ------------------------------------------------------- This SF.Net email is sponsored by The 2004 JavaOne(SM) Conference Learn from the experts at JavaOne(SM), Sun's Worldwide Java Developer Conference, June 28 - July 1 at the Moscone Center in San Francisco, CA REGISTER AND SAVE! http://java.sun.com/javaone/sf Priority Code NWMGYKND _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
