I'm not addressing the "directly compressed" approach since I don't
have any direct experience with it.

On Wed, Apr 18, 2012 at 18:18, Chris McCraw <[email protected]> wrote:
> with a cpu load of about 40% of a single CPU core.  logrotate
> currently takes about 12 hours to single-threadedly, consecutively,
> compress and rotate these logs.

How many other processor cores are available on the system doing the
compression?  Have you looked at pigz or pbzip2?  The prior is by one
of the authors of the near-omnipresent zlib, and works quite well.
They both do, actually.

Perhaps less of an option but still potentially a solution, have you
considered compressed filesystems?  ZFS-on-Linux is coming along quite
nicely and has runtime-configurable compression; btrfs does
transparent compression as well.  Filesystem-level compression doesn't
help if you're moving archives around between filesystems, but in my
uses it's been quite handy.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards

Reply via email to