On Wednesday 18 May 2005 23.23, Nick Warne wrote:
> On Wednesday 18 May 2005 22:16, Tim Shoppa wrote:
> > > 206.239.35.28 averaged 144720 pkt/hr (sent 201 pkts in 5 seconds).
> >
> > I'm assuming this is to port 80?
> >
> > The way some pool servers serve stuff up on port 80 can cause traffic
> > to machines that don't serve stuff up on port 80.  If Google finds a
> > bunch of stuff at http://pool.ntp.org/ one day, it may come back the
> > next day and try to recursively fetch more content when pool.ntp.org
> > now points to a different machine!
>
> Bloody strange as I read on Groklaw today about similar google thing. 
> You can tell Googlebot to STOP IT, apparently 

The pool has a special problem:  every server operator can do what he wants 
with requests to http://pool.ntp.org/ - so even if some people put in a 
robots.txt with Disallow, another may well explicitely invite search 
engines... 

Nothing we can do, except convince every server operator that installing the 
redirect to www.pool.ntp.org is worthwhile.

cheers
-- vbi


-- 
featured product: the GNU Compiler Collection - http://gcc.gnu.org

Attachment: pgp3oehxdNTTy.pgp
Description: PGP signature

_______________________________________________
timekeepers mailing list
[email protected]
https://fortytwo.ch/mailman/cgi-bin/listinfo/timekeepers

Reply via email to