We see this a lot: some variant of for every URL i know about, hit
delicious and we have had to put in autothrottling.
We're working on having an API for people to get at the tags and
bookmarks for sites they own -- any authentication ideas?
Joshua
On Mar 1, 2006, at 6:51 PM, l.m.orchard wrote:
Hey all - I'm playing around with using the per-URL RSS feeds to
implement some del integration on my blog, and I'm running into
throttling. I'd like to figure out how not to run afoul of it, if
it's possible at all. But, if this rig won't work at all, I'll
forget about it.
My goal is to query bookmark counts and bookmarks themselves, based
on blog entry permalink, and display that information next to entry
titles.
What I've got set up is this:
* I've got an RSS-to-JSON PHP script with a configurable cache age,
set to 1 hour for now.
* JS on my blog pages request a JSON feed from my RSS-to-JSON
script for each entry displayed.
* The RSS-to-JSON script is used to hit the per-URL RSS feed, based
on blog entry permalink.
So, if there are 8 entries shown on the index page, a hit will
result in 8 hits to my RSS-to-JSON script. If the cached RSS feed
is stale or not yet fetched for any of these entries, requests to
del are made. But, for every subsequent hit over the next hour (or
whatever max age I set), no requests should go through to
del.icio.us for feeds for these blog entries.
The general behavior, then, is that my server makes requests close-
clustered in time for RSS feeds on blog entry permalinks. But, the
cache should absorb repeat hits on any single feed. Also,
depending on visitor behavior on archived links, my server might
make a steady beat of hits to separate RSS feeds for entries not in
the cache. I'd guess that this would be less than one per second,
though, since my site's not really that popular.
When I first turned this stuff on, my server (decafbad.com,
67.19.3.234) made a slew of quick requests before it appeared to
settle down. But, it looks like it's all 503's for the last hour,
so I'm not sure if I'm temporarily or permanently throttled.
If permanently, then I say, D'oh. If temporarily, then I'm
wondering how this rig could be tweaked or reworked so as not to
anger the del.icio.us gods? Or, is it just a cracked idea that
needs to be scrapped?
--
[EMAIL PROTECTED]
http://www.decafbad.com
___
discuss mailing list
discuss@del.icio.us
http://lists.del.icio.us/cgi-bin/mailman/listinfo/discuss
--
joshua schachter
[EMAIL PROTECTED]
___
discuss mailing list
discuss@del.icio.us
http://lists.del.icio.us/cgi-bin/mailman/listinfo/discuss
