On Thu, 25 Aug 2011 09:45:38 -0400
gene heskett <[email protected]> wrote:

> Making amanda use its parallelism might be a challenging 
> project however.

Actually, not challenging at all. According to the man page,
http://www.zlib.net/pigz/pigz.pdf:

  Pigz compresses using threads to make use of multiple processors and
  cores. The input is broken up into 128 KB chunks with each compressed
  in parallel. The individual check value for each chunk is also
  calculated in parallel. The compressed data is written in order to
  the output, and a combined check value is calculated from the
  individual check values.

  The compressed data format generated is in the gzip, zlib, or
  single-entry zip format using the deflate compression method. The
  compression produces partial raw deflate streams which are
  concatenated by a single write thread and wrapped with the
  appropriate header and trailer, where the trailer contains the
  combined check value.

  ...

  The number of compress threads is set by default to the number of
  online processors, which can be changed using the -p option.


-- 

Charles Curley                  /"\    ASCII Ribbon Campaign
Looking for fine software       \ /    Respect for open standards
and/or writing?                  X     No HTML/RTF in email
http://www.charlescurley.com    / \    No M$ Word docs in email

Key fingerprint = CE5C 6645 A45A 64E4 94C0  809C FFF6 4C48 4ECD DFDB

Reply via email to