Sean M. Burke wrote:

> In short, if people want to see improvements to LWP, email me and say what 
> you want done


For robots, you need a call that says "fetch this URL, but get a maximum
of XX bytes and spend a maximum of YY seconds doing it."  Return status
should tell you whether it finished or timed out, and how many bytes
were actually retrieved.

BTW, have the LWP timeouts been fixed?  As recently as early 2000, they
were known to generally not work.  -Tim


--
This message was sent by the Internet robots and spiders discussion list 
([EMAIL PROTECTED]).  For list server commands, send "help" in the body of a message 
to "[EMAIL PROTECTED]".

Reply via email to