Re: [GENERAL] Any work on better parallelization of pg_dump?

2016-08-29 Thread Alvaro Herrera
Jehan-Guillaume de Rorthais wrote: > > Yeah. I recall there being some stupid limitation in ALTER TABLE .. ADD > > CONSTRAINT USING INDEX to create a primary key from a previously > > existing unique index, which would be very good to fix (I don't recall > > what it was, but it was something

Re: [GENERAL] Any work on better parallelization of pg_dump?

2016-08-29 Thread Jehan-Guillaume de Rorthais
On Mon, 29 Aug 2016 13:13:17 -0300 Alvaro Herrera wrote: > Jehan-Guillaume de Rorthais wrote: > > On Mon, 29 Aug 2016 13:38:03 +0200 > > hubert depesz lubaczewski wrote: > > > > > Hi, > > > we have rather uncommon case - DB with ~ 50GB of data, but

Re: [GENERAL] Any work on better parallelization of pg_dump?

2016-08-29 Thread hubert depesz lubaczewski
On Mon, Aug 29, 2016 at 01:13:17PM -0300, Alvaro Herrera wrote: > > > This happens on Pg 9.5. Are there any plans to make getting schema > > > faster for such cases? Either by parallelization, or at least by getting > > > schema for all tables "at once", and having pg_dump "sort it out", > > >

Re: [GENERAL] Any work on better parallelization of pg_dump?

2016-08-29 Thread Alvaro Herrera
Jehan-Guillaume de Rorthais wrote: > On Mon, 29 Aug 2016 13:38:03 +0200 > hubert depesz lubaczewski wrote: > > > Hi, > > we have rather uncommon case - DB with ~ 50GB of data, but this is > > spread across ~ 8 tables. > > > > Running pg_dump -Fd -jxx dumps in parallel,

Re: [GENERAL] Any work on better parallelization of pg_dump?

2016-08-29 Thread Jehan-Guillaume de Rorthais
On Mon, 29 Aug 2016 13:38:03 +0200 hubert depesz lubaczewski wrote: > Hi, > we have rather uncommon case - DB with ~ 50GB of data, but this is > spread across ~ 8 tables. > > Running pg_dump -Fd -jxx dumps in parallel, but only data, and MOST of > the time is spent on

[GENERAL] Any work on better parallelization of pg_dump?

2016-08-29 Thread hubert depesz lubaczewski
Hi, we have rather uncommon case - DB with ~ 50GB of data, but this is spread across ~ 8 tables. Running pg_dump -Fd -jxx dumps in parallel, but only data, and MOST of the time is spent on queries that run sequentially, and as far as I can tell, get schema of tables, and sequence values.