Hi Eliezer, I can't help you much with the details of how you can get Squid to work with the data in the metalink files.
Maybe I can help with some pointers on what you are trying to do. If you would care to explain the approach: what data will squid look at, what will squid then do? Greets, Bram On Fri, Jan 25, 2013 at 7:26 AM, Anthony Bryan <[email protected]> wrote: > On Fri, Jan 25, 2013 at 12:04 AM, Eliezer Croitoru <[email protected]> > wrote: >> Hey, >> >> As for now there are couple very good clients which makes use of metalinks. >> >> I have seen that some mirrorbrain based servers are actually publishing >> metalinks files in their headers. >> Fedora just redirect you to the nearest mirror.. >> >> I am writing an add-on for squid http cache proxy server that will allow it >> to take advantage on the data that in the metalinks files for better cache. > > Eliezer, thanks for writing & apologies for not replying to your other > message quicker...but yes, this is what I was going to say, that from > a regular download you can get to a metalink automatically via HTTP > header, or from metalink you can get to the canonical link or file > actually being mirrored (by a whitelist or somesuch?) > > also, check out the short 3 message thread ('Forward proxies and > CDN/mirrors') on the HTTP list > http://lists.w3.org/Archives/Public/ietf-http-wg/2012AprJun/0409.html > > the HTTP list might be the best place to ask since there aren't a > whole lot of proxy people here, more metalink focus here, but there > are on the HTTP list. > > > & here are some other links I already sent you: > > I don't know enough about squid, but the basic idea is that people are > downloading identical files (same hash/content) from multiple > locations (different URLs). you want these duplicate entries to be > consolidated. sites that use metalinks give the info to consolidate > them in an automatic way while other sites don't. > > maybe check out the info on the Apache Traffic Server plugin for > metalink: https://cwiki.apache.org/confluence/display/TS/Metalink > > it gives some links for squid stuff: > > http://thread.gmane.org/gmane.comp.web.squid.devel/15803 > http://thread.gmane.org/gmane.comp.web.squid.devel/16335 > http://www.hpl.hp.com/techreports/2004/HPL-2004-29.pdf > > http://wiki.jessen.ch/index/How_to_cache_openSUSE_repositories_with_Squid > > -- > (( Anthony Bryan ... Metalink [ http://www.metalinker.org ] > )) Easier, More Reliable, Self Healing Downloads > > -- > You received this message because you are subscribed to the Google Groups > "Metalink Discussion" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/metalink-discussion?hl=en. > For more options, visit https://groups.google.com/groups/opt_out. > > -- You received this message because you are subscribed to the Google Groups "Metalink Discussion" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. Visit this group at http://groups.google.com/group/metalink-discussion?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
