Re: [HACKERS] [PERFORM] pg_dump and thousands of schemas

2012-11-08 Thread Denis
Tom Lane-2 wrote Denis lt; socsam@ gt; writes: Tom Lane-2 wrote Hmmm ... so the problem here isn't that you've got 2600 schemas, it's that you've got 183924 tables. That's going to take some time no matter what. I wonder why pg_dump has to have deal with all these 183924 tables, if I

[PERFORM] Thousands databases or schemas

2012-11-08 Thread Denis
We have a web application where we create a schema or a database with a number of tables in it for each customer. Now we have about 2600 clients. The problem we met using a separate DB for each client is that the creation of new DB can take up to 2 minutes, that is absolutely unacceptable. Using

Re: [PERFORM] Thousands databases or schemas

2012-11-08 Thread Samuel Gendler
On Thu, Nov 8, 2012 at 1:36 AM, Denis soc...@gmail.com wrote: P.S. Not to start a holywar, but FYI: in a similar project where we used MySQL now we have about 6000 DBs and everything works like a charm. You seem to have answered your own question here. If my recollection of a previous

Re: [PERFORM] Thousands databases or schemas

2012-11-08 Thread Denis
Samuel Gendler wrote On Thu, Nov 8, 2012 at 1:36 AM, Denis lt; socsam@ gt; wrote: P.S. Not to start a holywar, but FYI: in a similar project where we used MySQL now we have about 6000 DBs and everything works like a charm. You seem to have answered your own question here. If my

Re: [PERFORM] Thousands databases or schemas

2012-11-08 Thread Pavel Stehule
Hello 2012/11/8 Denis soc...@gmail.com: Samuel Gendler wrote On Thu, Nov 8, 2012 at 1:36 AM, Denis lt; socsam@ gt; wrote: P.S. Not to start a holywar, but FYI: in a similar project where we used MySQL now we have about 6000 DBs and everything works like a charm. You seem to have

Re: [PERFORM] Thousands databases or schemas

2012-11-08 Thread Mark Thornton
On 08/11/12 09:36, Denis wrote: We have a web application where we create a schema or a database with a number of tables in it for each customer. Now we have about 2600 clients. The problem we met using a separate DB for each client is that the creation of new DB can take up to 2 minutes, that

Re: [PERFORM] HT on or off for E5-26xx ?

2012-11-08 Thread Shaun Thomas
On 11/07/2012 09:16 PM, David Boreham wrote: bash-4.1$ /usr/pgsql-9.2/bin/pgbench -T 600 -j 48 -c 48 Unfortunately without -S, you're not really testing the processors. A regular pgbench can fluctuate a more than that due to writing and checkpoints. For what it's worth, our X5675's

Re: [PERFORM] HT on or off for E5-26xx ?

2012-11-08 Thread David Boreham
On 11/8/2012 6:58 AM, Shaun Thomas wrote: On 11/07/2012 09:16 PM, David Boreham wrote: bash-4.1$ /usr/pgsql-9.2/bin/pgbench -T 600 -j 48 -c 48 Unfortunately without -S, you're not really testing the processors. A regular pgbench can fluctuate a more than that due to writing and

Re: [PERFORM] Query completed in 1s in PG 9.1 and ~ 700s in PG 9.2

2012-11-08 Thread Rodrigo Rosenfeld Rosas
Em 07-11-2012 22:58, Tom Lane escreveu: Rodrigo Rosenfeld Rosasrr.ro...@gmail.com writes: Ok, I could finally strip part of my database schema that will allow you to run the explain query and reproduce the issue. There is a simple SQL dump in plain format that you can restore both on 9.1 and

Re: [PERFORM] Query completed in 1s in PG 9.1 and ~ 700s in PG 9.2

2012-11-08 Thread Alvaro Herrera
Rodrigo Rosenfeld Rosas escribió: Em 07-11-2012 22:58, Tom Lane escreveu: Rodrigo Rosenfeld Rosasrr.ro...@gmail.com writes: Ok, I could finally strip part of my database schema that will allow you to run the explain query and reproduce the issue. There is a simple SQL dump in plain format

Re: [PERFORM] Query completed in 1s in PG 9.1 and ~ 700s in PG 9.2

2012-11-08 Thread Rodrigo Rosenfeld Rosas
Em 08-11-2012 13:38, Alvaro Herrera escreveu: Rodrigo Rosenfeld Rosas escribió: Em 07-11-2012 22:58, Tom Lane escreveu: Rodrigo Rosenfeld Rosasrr.ro...@gmail.com writes: Ok, I could finally strip part of my database schema that will allow you to run the explain query and reproduce the

Re: [PERFORM] Thousands databases or schemas

2012-11-08 Thread Craig Ringer
On 11/08/2012 09:29 PM, Denis wrote: Ok guys, it was not my intention to hurt anyone's feelings by mentioning MySQL. Sorry about that. It's pretty silly to be upset by someone mentioning another DB product. I wouldn't worry. There simply was a project with a similar architecture built using