hello,

compared to version 3.1.5 the digging process (htdig) with version 3.2.0b4
is really slow.

There are about 32.000 Pages on our servers, 50% are PDFs and some are
ridiculous big (html files larger 500kB).

The stable version (3.1.5) needs about 1.5 hours to create the database from
scratch and the test installation (latest 3.2.0b4) more then 10 hours.

I know the 3.2 version of htdig is doing things that had been done by htmerge
in 3.1.5 but it quite slower than running both in the old version.

htsearch has become much faster in the new version. This is nice but i have
problems with corrupt databases and so the speed of htdig is important.

Where ist the bottleneck of htdig (3.2.*) ?



cu, Stefan
-- 
Stefan Nehlsen | ParlaNet Administration | [EMAIL PROTECTED] | +49 431 988-1260

_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a 
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html

Reply via email to