On Tue, 27 Apr 2004, Joe R. Jah wrote: > Date: Tue, 27 Apr 2004 10:41:13 -0700 (PDT) > From: Joe R. Jah <[EMAIL PROTECTED]> > To: Lachlan Andrew <[EMAIL PROTECTED]> > Cc: [EMAIL PROTECTED] > Subject: [htdig-dev] Re: Htdig 3.2.0 in Debian Sarge? > > On Tue, 27 Apr 2004, Lachlan Andrew wrote: > > > Date: Tue, 27 Apr 2004 20:06:40 +1000 > > From: Lachlan Andrew <[EMAIL PROTECTED]> > > To: Joe R. Jah <[EMAIL PROTECTED]> > > Cc: [EMAIL PROTECTED] > > Subject: Re: Htdig 3.2.0 in Debian Sarge? > > > > Greetings Joe, > > > > Thanks for testing it. Did you do a "make clean" first? I'm not sure > > if it is the cause, but I think there is something flakey in > > ht://Dig's compile dependencies. I also got a crash (after about 20 > > seconds or 300 pages) if I compiled the patch in a directory that > > already had .o files, but that went away on a clean compile. > > Hi Lachlan, > > I made distclean, and started over. There wasn't any core dumps; however, > the dig went on a lot slower than expected; it was even slower than before > exclude_perform.1 patch. I killed the process. > > Patches present: > > DESTDIR.0 > TMPFILE.0 > operator[].0 > extension_filter.0 > robots.0 > fileSpace.1 > exclude_perform.1 > config_parser.1 > Soundex.0 > store_phrases.0 > > config: > store_phrases: false > > Any ideas? > > I plan to make another dig tonight, and profile it.
I randig again today. Here is the time comparison with other versions and/or patches: htdig-3.2.0b5: Total dig time: 01:37:35 == 5255 seconds With exclude_perform.0 Total dig time: 00:58:48 == 3528 seconds, or ~33% less time With exclude_perform.1 Total dig time: 00:57:35 == 3455 seconds, or ~34% less time With exclude_perform.1 and store_phrases.0 store_phrases: true Total dig time: 01:00:17 == 3617 seconds, or ~31% less time store_phrases: false Total dig time: 01:00:17 == 2941 seconds, or ~44% less time And since store_phrases.0 is meant to recreate digging speeds comparable to 3.1.6: htdig-3.1.6: Total dig time: 00:14:59 == 899 seconds, or ~83% less time The profiles are in ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profiles/ htdig.gmon.exclude_perform.1-store_phrases.0-false.gz htdig.gmon.exclude_perform.1-store_phrases.0-true.gz Regards, Joe -- _/ _/_/_/ _/ ____________ __o _/ _/ _/ _/ ______________ _-\<,_ _/ _/ _/_/_/ _/ _/ ......(_)/ (_) _/_/ oe _/ _/. _/_/ ah [EMAIL PROTECTED] ------------------------------------------------------- This SF.Net email is sponsored by: Oracle 10g Get certified on the hottest thing ever to hit the market... Oracle 10g. Take an Oracle 10g class now, and we'll give you the exam FREE. http://ads.osdn.com/?ad_id=3149&alloc_id=8166&op=click _______________________________________________ ht://Dig Developer mailing list: [EMAIL PROTECTED] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev
