Anyone here figured out what Yahoo will tolerate in terms of spidering its
message header pages before it blocks the robot's IP address? Before I
start testing, I figured I'd see if anyone else here has already done so.
The duration of the block seems to lengthen, so testing could take a while.
On Fri, 2 Aug 2002, Nick Arnett wrote:
Anyone here figured out what Yahoo will tolerate in terms of spidering its
message header pages before it blocks the robot's IP address? Before I
start testing, I figured I'd see if anyone else here has already done so.
The duration of the block seems
