On 7/30/09 2:53 PM, "Tom Lane" <t...@sss.pgh.pa.us> wrote:

> Scott Carey <sc...@richrelevance.com> writes:
>> Gzip does have some quirky performance behavior depending on the chunk size
>> of data you stream into it.
> 
> Can you enlarge on that comment?  I'm not sure that pg_dump is aware
> that there's anything to worry about there.
> 
>                         regards, tom lane
> 

For example, one of the things that gzip does is calculate the crc of the
item being compressed.  Calculating that incrementally is less efficient
than doing it in bulk.
For whatever reason, some other internals of gzip tend to perform much
better if submitting say, 4k or 8k or 16k chunks rather than little bits at
a time.  But I'm sure some of that also depends on what library you're using
since they all vary somewhat.


-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance

Reply via email to