Re: howto mirror subset of CPAN?
Using Rsync and a bit o' Perl I have developed a latest version only mirror of CPAN. Its very crude but if people are interested I could clean it up a bit and let you have it. I still find that its hard to strip CPAN down to fit on a CD ... but I am certain that there is some stuff in there that is so specialized that it could be safely excluded. Aside from a slow TCP/IP link - I like having the disk when I am running around with just my laptop or at a site where I don't have outside internet access. J On May 23, 2002 11:36 am, Boyd Moore wrote: Because of slow tcp/ip connection, I would like to burn a cdrom of only the last 2-3 versions of all the modules in the CPAN library. This cdrom would be used to access CPAN on a intranet that has no outside connections. Could you advise on how to selectively download the modules? I can think of some ways using filters on the ls-al.gz file to drive a rsync or ftp session, but maybe there is a better way. Thanks.
Re: howto mirror subset of CPAN?
* Jay Lawrence ([EMAIL PROTECTED]) [26 May 2002 01:12]: Using Rsync and a bit o' Perl I have developed a latest version only mirror of CPAN. Its very crude but if people are interested I could clean it up a bit and let you have it. I still find that its hard to strip CPAN down to fit on a CD ... but I am certain that there is some stuff in there that is so specialized that it could be safely excluded. It's easiest if you use the 02packages.details.txt.gz file as a source. Sure, you don't get anything that isn't in it, but that which isn't in it usually isn't worth getting =) Fits on a CD with no trouble. In fact, if you burn your CD without finalising, you'll be able to fit a few iterations of full grabs onto it. I've even got a script you can use. Available from http://eh.org/~koschei/code/perl/ Note that it uses the LWP Parallel module, and you may want to tweak the settings slightly. I was using it for getting a copy from an on-site mirror, and as such it wasn't a problem getting multiple modules at once. cheers, -- iain. http://eh.org/~koschei/ msg00336/pgp0.pgp Description: PGP signature
Re: howto mirror subset of CPAN?
On Sat, May 25, 2002 at 10:13:20AM -0400, Jay Lawrence wrote: Using Rsync and a bit o' Perl I have developed a latest version only mirror of CPAN. Its very crude but if people are interested I could clean it up a bit and let you have it. For a mere $20, with profits going to YAS? I still find that its hard to strip CPAN down to fit on a CD ... but I am certain that there is some stuff in there that is so specialized that it could be safely excluded. If whatever OS you're usually using is happy with bzip2 compressed files, then you may be able to cram another 5 to 10% on the CD by turning all the tar.gz files to tar.bz2. You may also make some savings by re-packing zips as tar.gz files, and even more as tar.bz2 Nicholas Clark -- Even better than the real thing:http://nms-cgi.sourceforge.net/
