Hi, Just to re-ignite this thread,
I came across the following site: *http://www.onenewspage.co.uk*, it contradicts our initial assessment of Google getting "special treatment" as some of the stories form BBC are very fresh, like: "5 minutes ago", do you think these too get special treatment? (its hard to imagine they do?) Ive also checked all feeds from BBC and they do not include the fresh stories that the website above shows? - any thoughts? - Screen Scraping perhaps? Thanks. On 1 June 2010 20:50, Daniel Latter <[email protected]> wrote: > Thanks for the info Guys. > > > > On 28 May 2010 22:18, Pádraic Brady <[email protected]> wrote: > >> Google doesn't receive instant updates from BBC - it just retrieves the >> feed every few minutes. There's a difference between frequent polling and >> real-time updates. The first can be done with any platform - just use a GET >> request. The second requires active pings from a Publisher so a Hub can >> notify Subscribers. What you're describing is subtly different, that BBC >> feeds are updated after Google is notified? This could be a simple case of >> highly focused optimisation - allow Google access to fresh feed generation >> (filter by Google's domain) while the general public get a cached feed >> updated every 10-15 minutes. Would be simple to architect and ensures Google >> always get the fresh content ASAP for indexing. >> >> The only proactive instant update mechanisms getting wider usage are >> Pubsubhubbub and RSS Cloud. BBC implement neither at the moment, so you are >> stuck with polling for now, or using an offsite service (e.g. Superfeedr) >> which does 10 minute polling and updates via PuSH. >> >> Paddy >> >> Pádraic Brady >> >> http://blog.astrumfutura.com >> http://www.survivethedeepend.com >> OpenID Europe Foundation Irish Representative<http://www.openideurope.eu/> >> >> >> ------------------------------ >> *From:* Daniel Latter <[email protected]> >> *To:* Bradley Holt <[email protected]> >> *Cc:* Zend Framework General <[email protected]> >> *Sent:* Fri, May 28, 2010 12:47:12 PM >> *Subject:* Re: [fw-general] Feeds >> >> Maybe I am misunderstanding but how can I use PuSH for a BBC feed if they >> don't support it? because doesn't a publisher ping the hub to notify of an >> update? >> >> So saying that, I am wondering how Google Reader gets instant updates from >> a BBC feed? >> >> On 28 May 2010 01:21, Bradley Holt <[email protected]> wrote: >> >>> On Thu, May 27, 2010 at 7:42 PM, Daniel Latter <[email protected]>wrote: >>> >>>> Hi all, >>>> >>>> I'm processing feeds with Zend_Feed and I am wondering how to get >>>> instant feed updates like Google reader? >>>> >>>> For example, I consume a feed from bbc.co.uk and get a pubDate for each >>>> item, but if I look in Google reader at same feed I can see that it has >>>> been/gets updated almost instantly with new items? But the propoagtion to >>>> the feed takes much longer? >>>> >>>> Now I know about the pubsubhubbub class that ZF provides that enables >>>> "real time web" but that is still relatively new. >>>> >>>> >>> Why is its "newness" a reason not to use it? >>> >>> >>>> So I guess my question is how can I architect real time feed updates >>>> like Google Reader.? >>>> >>>> >>> I'd just use PubSubHubbub and not reinvent the wheel :-) >>> >>> >>>> Thanks >>>> Dan >>> >>> >>> >> >
