Mhh. I have not looked into this. But is not every desktop aggregator a robot?

Henry

On 25 Aug 2005, at 22:18, James M Snell wrote:
At the very least, aggregators should respect robots.txt. Doing so would allow publishers to restrict who is allowed to pull their feed.

- James


Reply via email to