On Fri, Mar 25, 2011 at 7:08 AM, Charles Polisher <[email protected]>wrote:

>
> Consider using pigz for the compression step.
>
>  + Much (7x?) faster than gzip
>

gzip is fairly fast already, but also does a poor job at compressing huge
repetitive text dumps compared to the (MUCHHHHHHH slower) bzip2 and
(MUCHHHHHH^3 slower) 7zip LZMA which are what we use.

-- brion
_______________________________________________
Wikitech-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Reply via email to