Hello,
There was (still is ?) a lot of problem on the US backbone
during those last few days....  That make me notice that the
indexer seems to do a DNS lookup for every URLs even if it just
indexed a document on the same server.

The indexer program may index without any problem several URLs
on the same server and suddently return a "Unknow host" for the
same hostname.

So maybe it would be a good idee to cache IP addresses so that
it won't have to do a lookup for each URLs during the same run.
That would also gain a lot of time probably...
(and it shouldn't be too hard to add : a simple hash table...:)

Cheers,
Yann Stettler

-- 
-------------------------------------------------------------------
Yann Stettler                              [EMAIL PROTECTED]
CohProg SaRL                               http://www.cohprog.com/
                             -=*=-
Anime and Manga Services                   http://www.animanga.com/
Free Email & website                       http://www.cels.org
______________
If you want to unsubscribe send "unsubscribe udmsearch"
to [EMAIL PROTECTED]

Reply via email to