Re: [PERFORM] pg_basebackup running slow

2016-10-14 Thread Michael Paquier 
On Fri, Oct 14, 2016 at 10:21 PM, Samir Magar  wrote:
> What is the settings for max_wal_sender?
> you can try increasing this parameter to improve backup performance.

max_wal_senders has no influence on the performance of a base backup
taken as a base backup is just sent through one single WAL sender
process. What matters here is the network bandwidth.
-- 
Michael


-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] pg_basebackup running slow

2016-10-14 Thread Stephen Frost 
Vaze,

* Swapnil Vaze (swapvaz...@gmail.com) wrote:
> We are using postgresql 9.2 on redhat linux instance over openstack cloud.
> 
> Database is around 441 GB.
> 
> We are using below command to take backup:
> 
> pg_basebackup -v -D /pgbackup/$bkupdir -Ft -z -c fast
> 
> Backup size created is around 84GB.
> 
> However, it is taking almost 10 hr 21 minutes to complete.
> 
> Looking for speed improvement?

pg_basebackup is single-threaded and the compression is pretty
CPU-intensive.  You could try reducing the compression level, but that
will make the backups larger, of course.  Also, there's a limit to how
far that will get you- once you get to "no compression", that's just as
fast as pg_basebackup can run.

If you're interested in a backup tool which can operate in parallel, you
might want to look at pgbackrest.

Thanks!

Stephen


signature.asc
Description: Digital signature

Re: [PERFORM] pg_basebackup running slow

2016-10-14 Thread Samir Magar 
What is the settings for max_wal_sender?
you can try increasing this parameter to improve backup performance.


Thanks,
Samir Magar

On Fri, Oct 14, 2016 at 6:05 PM, Swapnil Vaze  wrote:

> Hello,
>
>
>
> We are using postgresql 9.2 on redhat linux instance over openstack cloud.
>
>
>
> Database is around 441 GB.
>
>
>
> We are using below command to take backup:
>
>
>
> pg_basebackup -v -D /pgbackup/$bkupdir -Ft -z -c fast
>
>
>
> Backup size created is around 84GB.
>
>
>
> However, it is taking almost 10 hr 21 minutes to complete.
>
>
>
> Looking for speed improvement?
>
>
>
> Thanks& Regards,
>
> Vaze Swapnil
>

[PERFORM] pg_basebackup running slow

2016-10-14 Thread Swapnil Vaze 
Hello,



We are using postgresql 9.2 on redhat linux instance over openstack cloud.



Database is around 441 GB.



We are using below command to take backup:



pg_basebackup -v -D /pgbackup/$bkupdir -Ft -z -c fast



Backup size created is around 84GB.



However, it is taking almost 10 hr 21 minutes to complete.



Looking for speed improvement?



Thanks& Regards,

Vaze Swapnil