I too wrote a small web crawler in Java around an year back - well I would agree with you if you meant the ease of programming. But these are the advantages I still feel Java offers 1) A wide ready to use library - for parsing (although I had some problems with it in the initial stages). 2) A robust multi-threading capability - that is a must for a good crawler. 3) Platform independence - so that you could use your crawler from almost any platform. 4) The added advantage to give a crawler a GUI or an applet form unlike when using perl.
Bijoy --- Otis Gospodnetic <[EMAIL PROTECTED]> wrote: > > > --- Ed Bockelman <[EMAIL PROTECTED]> wrote: > > > > srinivas mohan wrote: > > > > > I am java programmer, presently making a web > > spider > > > program for a search engine.. > > > > I wouldn't think of Java as the first choice for a > > high-volume web spider. What are the advantages? > > Apparently AltaVista people would disagree. They > built > a web crawler called Mercator using Java. A paper > that > describes is available online. > > Otis > > > __________________________________________________ > Do You Yahoo!? > Get personalized email addresses from Yahoo! Mail - > only $35 > a year! http://personal.mail.yahoo.com/ > > -- > This message was sent by the Internet robots and > spiders discussion list ([EMAIL PROTECTED]). For > list server commands, send "help" in the body of a > message to "[EMAIL PROTECTED]". __________________________________________________ Do You Yahoo!? Get personalized email addresses from Yahoo! Mail - only $35 a year! http://personal.mail.yahoo.com/ -- This message was sent by the Internet robots and spiders discussion list ([EMAIL PROTECTED]). For list server commands, send "help" in the body of a message to "[EMAIL PROTECTED]".
