http://crawler.archive.org/
I don't know how you guys feel, but it may be worth considering to migrate to this codebase for our crawling functions. The one simple motivation is that we have enough other work to do..... if we run into significant problems with our crawler then we think about migrating.
I understand. That's reasonable.
However, I had a look at the project, but it is in Java ... or am I wrong?
I don't propose we do this now, but keep it as an option.
I think that'd be good, even though I have put lots of efforts in the net library. It is up to you guys.
Ciao,
-Gabriele
--
Gabriele Bartolini: Web Programmer, ht://Dig & IWA/HWG Member, ht://Check maintainer
Current Location: Prato, Toscana, Italia
[EMAIL PROTECTED] | http://www.prato.linux.it/~gbartolini | ICQ#129221447
> "Leave every hope, ye who enter!", Dante Alighieri, Divine Comedy, The Inferno
------------------------------------------------------- This SF.net email is sponsored by: Perforce Software. Perforce is the Fast Software Configuration Management System offering advanced branching capabilities and atomic changes on 50+ platforms. Free Eval! http://www.perforce.com/perforce/loadprog.html _______________________________________________ ht://Dig Developer mailing list: [EMAIL PROTECTED] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev
