On 26 May 2014 09:26, Juliusz Chroboczek <j...@pps.univ-paris-diderot.fr>wrote:
> I prefer discussion to happen on the mailing list. Apologies... I fully intended to reply to the list but am now too used to "Reply-To:" headers doing the reply magic for me :-) Putting this back onto the list. > The biggest problem with this is you can't easily know if the caching > works > > and the urls will still be there when you try again later. There is a > > disturbing amount of uncacheable content, usually for no apparent reason. > > Polipo doesn't work like that. It caches everything, except > "Cache-Control: no-store". It later performs a revalidation, and will > only serve the cached data if the server says it's okay. > > So if you run with relaxTransparency, the data should be in cache. Ah... yeah, the magic "cache everything forever" setting :-) The problem with that is it applies to everything and for these kinds of use-case you really only want it to apply for the specific urls you pre-fetched. In my experience there are plenty of sites that do things like set all Expires and LastModified headers to "now" for even static content, and it would be nice to have something like minExpiresAge and/or minAge settings to force a minimum level of caching. It would also be nice to be able to apply these kinds of settings on a per-url-regex basis like you can with squid, so that you can work around known bad cachebuster urls. Of course, features like this are only really useful if you can identify bad cachebuster urls. With no request hit/miss logging, you can't really do that :-) Just re-read what I wrote above and it sounds like I'm whinging, which is totally not intended. Polipo is awesome and I'm really glad to see it making progress again. I just wanted to throw in my 2c wishlist :-) -- Donovan Baarda <a...@minkirri.apana.org.au> ------------------------------------------------------------------------------ The best possible search technologies are now affordable for all companies. Download your FREE open source Enterprise Search Engine today! Our experts will assist you in its installation for $59/mo, no commitment. Test it for FREE on our Cloud platform anytime! http://pubads.g.doubleclick.net/gampad/clk?id=145328191&iu=/4140/ostg.clktrk _______________________________________________ Polipo-users mailing list Polipo-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/polipo-users