On Mon, 30 Apr 2001, Gilles Detillieux wrote:

> Date: Mon, 30 Apr 2001 15:03:30 -0500 (CDT)
> From: Gilles Detillieux <[EMAIL PROTECTED]>
> To: Alexander Cohen <[EMAIL PROTECTED]>
> Cc: "Joe R. Jah" <[EMAIL PROTECTED]>,
>     Geoff Hutchison <[EMAIL PROTECTED]>,
>     [EMAIL PROTECTED]
> Subject: Re: [htdig-dev] Current Status as of snapshot 3.2.0b4-040801
> 
> According to Alexander Cohen:
> > > With different versions of htdig:
> > >
> > > 3.1.5           11 Minutes
> > > 3.2.0b3         9 1/2 hours
> > > 3.2.0b4-031201  29 hours and 20 minutes
> > > 3.2.0b4-040801  > 12 days
> > 
> > Is it just me or there a pattern developing here? ;]
> 
> There sure seems to be, but we're nowhere closer to knowing why this is
> happening.  It doesn't seem to be an issue with any systems other than
> BSDI.  Some profiling, to know where htdig is spending its time, could be
> quite helpful.  Joe, is there any possibility you could figure out how to
> compile the code on your system with profiling enabled, to get some stats
> on this?

I will try as soon as I get a chance; I am in the process of upgrading the
OS from BSDi4.0.1 to BSDi4.2.  So far I have tried 3.1.5 on a 4.2 test
box; it compiles without any BSDi specific patches/HOTOs.  It also indexes
about 30 percent faster, although I have less memory on the test box and a
slower IDE drive as opposed to SCSI's;) 

As for my old box, the indexing process for 3.2.0b4-040801 is still going;)
It hasn't even reached the midpoint after more than 20 days;(
_______________________________________________________________________
rundig: Start time: Thu Apr 12 20:26:36 PDT 2001
htdig: Start Digging: Thu Apr 12 20:26:36 PDT 2001
Current time:                 Mon Apr 30 22:55:11 PDT 2001
Working database:
-rw-r--r--  1 jjah  www   1400832 Apr 30 19:05 db.docdb.work
-rw-r--r--  1 jjah  www    638976 Apr 30 18:56 db.docs.index.work
-rw-r--r--  1 jjah  www   6774784 Apr 30 20:20 db.excerpts.work
-rw-r--r--  1 jjah  www   9704448 Apr 30 20:20 db.words.db.work
-rw-r--r--  1 jjah  www     16384 Apr 10 14:18 db.words.db.work_weakcmpr
Completed database:
-rw-r--r--  1 jjah  www   1400832 Mar 17 03:20 db.docdb
-rw-r--r--  1 jjah  www    671744 Mar 17 03:20 db.docs.index
-rw-r--r--  1 jjah  www  14311424 Mar 17 03:20 db.excerpts
-rw-r--r--  1 jjah  www  17485824 Mar 17 03:25 db.words.db
-rw-r--r--  1 jjah  www     16384 Mar 17 03:25 db.words.db_weakcmpr
_______________________________________________________________________


P.S.  On April 12 I had to kill the indexing process for a few hours; when
      I started digging again, it just took over from where it had left
      off without a hitch; pretty good, heh;)

Regards,

Joe
-- 
     _/   _/_/_/       _/              ____________    __o
     _/   _/   _/      _/         ______________     _-\<,_
 _/  _/   _/_/_/   _/  _/                     ......(_)/ (_)
  _/_/ oe _/   _/.  _/_/ ah        [EMAIL PROTECTED]


_______________________________________________
htdig-dev mailing list
[EMAIL PROTECTED]
http://lists.sourceforge.net/lists/listinfo/htdig-dev

Reply via email to