I found myself having to compress a million files less than 12k in size each. tar was likely to take the better part of a full working day (possibly longer, I killed the process and didn't use pv (another great asleep at the prompt topic).
Enter: pbzip2 http://compression.ca/pbzip2/ I'll let the website do it's own talking. It's a parallel bzip2 implementation which can auto detect the number of cores it has to work with. Fantastic stuff. Respectfully, Andrew McElroy -- -- You received this message because you are subscribed to the Google Groups "NLUG" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en --- You received this message because you are subscribed to the Google Groups "NLUG" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
