Re: Feature Request: Metalink support (mirror list file)
Here's a refresher on Metalink: 'Metalink makes complex download pages obsolete by replacing long lists of download mirrors and BitTorrent trackers with a single .metalink file. As you might have already guessed, a .metalink file is a file that tells a download manager all the different ways it can download a file. The file itself takes the form of an open XML standard that can list an unlimited number of HTTP and FTP sources as well as BitTorrent trackers and ed2k and magnet links.' (http://www.downloadsquad.com/2006/08/28/metalinks-integrated-bittorrent-htt p-and-ftp-downloads/) OpenOffice.org and around ten Linux/BSD distributions are using it for their ISO downloads. Right now, there are 4 clients covering Unix/Mac/Win. I think this could be a pretty useful feature for wget. Here's what metalinks look like: metalink version=3.0 xmlns=http://www.metalinker.org/; files file name=example.ext verification hash type=md5example-md5-hash/hash hash type=sha1example-sha1-hash/hash /verification resources url type=ftpftp://ftp.example1.com/example.ext/url url type=httphttp://www.example1.com/example.ext/url url type=bittorrenthttp://www.ex.com/example.ext.torrent/url url type=magnet/ url type=ed2k/ /resources /file /files /metalink (( Anthony Bryan )) Metalink [ http://www.metalinker.org ]
Re: Feature Request: Metalink support (mirror list file)
Hi, I wrote about metalink a few months ago. It's an XML file that lists Mirrors, p2p, checksums, other info for download managers. aria2 [ http://aria2.sourceforge.net/ ] now supports metalink. aria2 is a unix command line download utility with resuming and segmented downloading that also supports bittorrent. GetRight on Windows and Speed Download on Mac also support metalink. OpenOffice uses metalinks to distribute their free office suite [ http://distribution.openoffice.org/p2p/magnet.html ]. Metalinks for other projects are available at http://metalink.packages.ro/ Here's what the metalinks look like: metalink version=3.0 xmlns=http://www.metalinker.org/; files file name=example.ext verification hash type=md5example-md5-hash/hash hash type=sha1example-sha1-hash/hash /verification resources url type=ftpftp://ftp.example1.com/example.ext/url url type=ftpftp://ftp.example2.com/example.ext/url url type=httphttp://www.example1.com/example.ext/url url type=httphttp://www.example2.com/example.ext/url url type=httphttp://www.example3.com/example.ext/url url type=bittorrenthttp://www.ex.com/example.ext.torrent/url url type=magnet/ url type=ed2k/ /resources /file /files /metalink I'd be interested in any comments. Anthony Bryan http://www.metalinker.org/
Re: Feature Request: Metalink support (mirror list file)
anthony l. bryan wrote: Hi, I realize this may be out of the scope of wget, so I hope I don't offend anyone. that's a very interesting proposal, actually. but is metalink a widely used format to describe resource availability from multiple URLs? -- Aequam memento rebus in arduis servare mentem... Mauro Tortonesi http://www.tortonesi.com University of Ferrara - Dept. of Eng.http://www.ing.unife.it GNU Wget - HTTP/FTP file retrieval tool http://www.gnu.org/software/wget Deep Space 6 - IPv6 for Linuxhttp://www.deepspace6.net Ferrara Linux User Group http://www.ferrara.linux.it
Feature Request: Metalink support (mirror list file)
Hi, I realize this may be out of the scope of wget, so I hope I don't offend anyone. I wanted to request support for .metalink files. Metalink is a way to store ftp/http mirror info along with p2p checksums. (p2p info is dropped if the client doesn't support it). It's a relatively simple XML file for storing info for segmented/multi-threaded downloads for download managers. Right now, GetRight (Windows) and FlashGot (Firefox extension) support it. I think its especially nice for large ISOs. A download manager will get a chunk or segment from multiple servers, which makes things pretty fast if you have a good connection. .metalink files look like this one for Fedora Core 5: metalink version=3.0 xmlns=http://www.metalinker.org/; files file name=FC-5-i386-DVD.iso size4370640896/size verification hash type=md5ed9a852cf77250c3ae111c621d350af5c0b0a29b/hash /verification license nameGPL/name summaryShort explanation of license/summary urlhttp://www.gnu.org/copyleft/gpl.html/url /license resources url type=bittorrent preference=100 http://torrent.fedoraproject.org/torrents/bordeaux-DVD-i386.torrent url type=ftp location=us preference=90 ftp://ftp.ndlug.nd.edu/pub/fedora/linux/core/5/i386/iso/FC-5-i386-DVD.iso /url url type=http location=us preference=80 http://mirror.linux.duke.edu/pub/fedora/linux/core/5/i386/iso/FC-5-i386-DVD. iso /url url type=ftp location=us preference=80 ftp://limestone.uoregon.edu/fedora/5/i386/iso/FC-5-i386-DVD.iso /url url type=ftp location=ca preference=80 ftp://ftp.telus.net/pub/fedora/linux/core/5/i386/iso/FC-5-i386-DVD.iso /url url type=http location=ca preference=90 http://less.cogeco.net/pub/fedora/linux/core/5/i386/iso/FC-5-i386-DVD.iso /url url type=ftp location=ca preference=80 ftp://mirror.arcticnetwork.ca/pub/fedora/linux/core/5/i386/iso/FC-5-i386-DVD .iso /url /resources /file /files /metalink There's more info a demo of it in action at http://www.metalinker.org/ Anthony Bryan
