As a follow on to this, if you are going to gpg encrypt the files because you need to keep them and you have to secure the data, compress first, then encrypt. Doing it the other way around doesn't do you any good. Also, don't mangle the file name so the .gz/.bz2/.pgp/.gpg is in the middle of the file name. Please let the tool put it's suffix at the end of the file.
This message is brought to you by having to deal with the mess left by someone else not doing it that way. On Mon, Jun 16, 2014 at 2:27 PM, andrew mcelroy <[email protected]> wrote: > I found myself having to compress a million files less than 12k in size > each. > tar was likely to take the better part of a full working day (possibly > longer, I killed the process and didn't use pv (another great asleep at the > prompt topic). > > Enter: pbzip2 > http://compression.ca/pbzip2/ > > I'll let the website do it's own talking. It's a parallel bzip2 > implementation which can auto detect the number of cores it has to work > with. Fantastic stuff. > > Respectfully, > Andrew McElroy > > -- > -- > You received this message because you are subscribed to the Google Groups > "NLUG" group. > To post to this group, send email to [email protected] > To unsubscribe from this group, send email to > [email protected] > For more options, visit this group at > http://groups.google.com/group/nlug-talk?hl=en > > --- > You received this message because you are subscribed to the Google Groups > "NLUG" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- -- You received this message because you are subscribed to the Google Groups "NLUG" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en --- You received this message because you are subscribed to the Google Groups "NLUG" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
