Author: Dob.
Email: [EMAIL PROTECTED]
Message:
I need to index BIG site remotely and I don't want indexer retrieve all pages that
already indexed - can it check HEAD (timestamp/ETag) and if its same don't GET the
page?
ps. CVS seems broken..
pps. hint about internal DB: use BerkeleyDB (www.sleepycat.com) (default on most
unixes)
Reply: <http://search.mnogo.ru/board/message.php?id=1971>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
