What struck me was the part where he says:
<quote>
Instead of the built-in, synchronous, feed fetching support in Feed Parser, I wrote a fetcher using Twisted Web for fetching the pages asynchronously and handling the HTTP result codes. I ended up writing a custom class that mimics the interface of Feed Parser's build-in fetcher because I needed to inject the received headers into the feed parsing code. For example, Feed Parser can rewrite relative links in the HTML found in the feed's items. Among other pointers, it uses the received HTTP headers for this. Objects of this custom class are created from the retrieved feed and headers.
</quote>
This may be an interesting way to get rid of the issue where zaobao pulls all of the feeds at one time. But I'm also thinking that the code could be used by any part of Chandler that needs to regularly pull from a web page.
anywho, just an FYI in case anyone else finds it interesting :)
--- Bear http://code-bear.com
Open Source Applications Foundation (OSAF) http://www.osafoundation.org
PGP Fingerprint = 9996 719F 973D B11B E111 D770 9331 E822 40B3 CD29
PGP.sig
Description: This is a digitally signed message part_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Open Source Applications Foundation "Dev" mailing list http://lists.osafoundation.org/mailman/listinfo/dev
