We have lots of scrapers hitting /url and /rss/url very rapidly,
including TailRank. As per our ToS, this is not acceptable.
I'd need to get a better idea what you are using the data for and so on
before I can unblock this. Contact me offline.
Joshua
Kevin Burton wrote:
OK.
I'm trying to poll Delicious for all tags for a given URL. The API
doesn't provide this (if it does please tell me I'm wrong) so I'm
having to resort to the API.
In the RSS world more than once an hour is too aggressive. In this
case though I'm using it as a RESTian API so polling once per 5 seconds
seems reasonable especially since the Delicious API is once per second.
Now I'm banned and I can't get anyone at support to give me a way out
of this problem.
1. Can someone at delicous unban 64.34.161.37
and 64.34.179.237
2. Can someone tell me the correct threshold to sleep for ot avoid a
ban.
3. If there's a better way to do this let me know.
I seriously don't mind being polite but I just need to be told what
"polite" is in this situation :)
Kevin
--
Kevin A. Burton, Location - San Francisco, CA
AIM/YIM - sfburtonator, Web - http://www.feedblog.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412
_______________________________________________
discuss mailing list
[email protected]
http://lists.del.icio.us/cgi-bin/mailman/listinfo/discuss
|
_______________________________________________
discuss mailing list
[email protected]
http://lists.del.icio.us/cgi-bin/mailman/listinfo/discuss