Having worked in Perl and Python, I'll recommend Python. Although I haven't been using it for long, I'm definitely more productive with it. Performance seems fine, though I haven't really pushed hard on it. I'm not seeing long, mysterious time-outs as I occasionally did with LWP. And I hit some weird bug in LWP a few weeks ago, which resulted in a strange error message that I eventually discovered was coming out of the expat DLL for XML. Instead of retrieving the page I wanted, it was misinterpreting a server error. I wish I could be more specific, but I never did figure out what was really going on. Following an LWP request through the debugger is a long and convoluted journey...
Nick > -----Original Message----- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On > Behalf Of srinivas mohan > Sent: Thursday, March 14, 2002 9:48 AM > To: [EMAIL PROTECTED] > Subject: [Robots] better language for writing a Spider ? > > > > Hello, > > I am working on a robot develpoment, in java,. > We are developing a search engine....almost the > complete engine is developed... > We used java for the devlopment...but the performance > of java api in fetching the web pages is too low, > basically we developed out own URL Connection , as > we dont have some features like timeout... > supported by the java.net.URLConnection api .. > > Though there are better spiders in java..like > Mercator..we could not achive a better performance > with our product... > > Now as the performance is low..we wanted to redevelop > our spider..in a language like c or perl...and use > it with our existing product.. > > I will be thankful if any one can help me choosing > the better language..where i can get better > performance.. > > Thanks in advance > Mohan > > > > __________________________________________________ > Do You Yahoo!? > Yahoo! Sports - live college hoops coverage > http://sports.yahoo.com/ > > -- > This message was sent by the Internet robots and spiders > discussion list ([EMAIL PROTECTED]). For list server commands, > send "help" in the body of a message to "[EMAIL PROTECTED]". -- This message was sent by the Internet robots and spiders discussion list ([EMAIL PROTECTED]). For list server commands, send "help" in the body of a message to "[EMAIL PROTECTED]".
