Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2011-01-27 Thread Jeff Janes
On Tue, Jan 25, 2011 at 5:32 PM, Bruce Momjian br...@momjian.us wrote: Robert Haas wrote: On Wed, Jan 19, 2011 at 12:07 PM, Bruce Momjian br...@momjian.us wrote: ? ? ? ?http://developer.postgresql.org/pgdocs/postgres/non-durability.html This sentence looks to me like it should be removed,

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2011-01-27 Thread Bruce Momjian
Jeff Janes wrote: On Tue, Jan 25, 2011 at 5:32 PM, Bruce Momjian br...@momjian.us wrote: Robert Haas wrote: On Wed, Jan 19, 2011 at 12:07 PM, Bruce Momjian br...@momjian.us wrote: ? ? ? ?http://developer.postgresql.org/pgdocs/postgres/non-durability.html This sentence looks to me

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2011-01-25 Thread Bruce Momjian
Robert Haas wrote: On Wed, Jan 19, 2011 at 12:07 PM, Bruce Momjian br...@momjian.us wrote: Chris Browne wrote: gentosa...@gmail.com (A B) writes: If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2011-01-20 Thread Robert Haas
On Wed, Jan 19, 2011 at 12:07 PM, Bruce Momjian br...@momjian.us wrote: Chris Browne wrote: gentosa...@gmail.com (A B) writes: If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur),

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2011-01-19 Thread Bruce Momjian
Chris Browne wrote: gentosa...@gmail.com (A B) writes: If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? Use /dev/null. It is web scale, and

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2011-01-19 Thread Fabrízio de Royes Mello
2011/1/19 Bruce Momjian br...@momjian.us FYI, we do have a documentation section about how to configure Postgres for improved performance if you don't care about durability: http://developer.postgresql.org/pgdocs/postgres/non-durability.html A sometime ago I wrote in my blog [1]

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-15 Thread Robert Haas
On Fri, Nov 5, 2010 at 8:12 AM, Jon Nelson jnelson+pg...@jamponi.net wrote: On Fri, Nov 5, 2010 at 7:08 AM, Guillaume Cottenceau g...@mnc.ch wrote: Marti Raudsepp marti 'at' juffo.org writes: On Fri, Nov 5, 2010 at 13:32, A B gentosa...@gmail.com wrote: I was just thinking about the case

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-15 Thread Andy Colson
On 11/15/2010 9:06 AM, Robert Haas wrote: In 9.1, I'm hopeful that we'll have unlogged tables, which will even better than turning these parameters off, and for which I just posted a patch to -hackers. Instead of generating WAL and writing WAL to the OS and then NOT trying to make sure it hits

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-15 Thread Robert Haas
On Mon, Nov 15, 2010 at 2:27 PM, Andy Colson a...@squeakycode.net wrote: On 11/15/2010 9:06 AM, Robert Haas wrote: In 9.1, I'm hopeful that we'll have unlogged tables, which will even better than turning these parameters off, and for which I just posted a patch to -hackers.  Instead of

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-08 Thread Lello, Nick
How about either:- a) Size the pool so all your data fits into it. b) Use a RAM-based filesystem (ie: a memory disk or SSD) for the data storage [memory disk will be faster] with a Smaller pool - Your seed data should be a copy of the datastore on disk filesystem; at startup time copy the

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-08 Thread Dimitri Fontaine
Lello, Nick nick.le...@rentrakmail.com writes: A bigger gain can probably be had if you have a tightly controlled suite of queries that will be run against the database and you can spend the time to tune each to ensure it performs no sequential scans (ie: Every query uses index lookups).

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-08 Thread Klaus Ita
Use a replicated setup? On Nov 8, 2010 4:21 PM, Lello, Nick nick.le...@rentrakmail.com wrote: How about either:- a) Size the pool so all your data fits into it. b) Use a RAM-based filesystem (ie: a memory disk or SSD) for the data storage [memory disk will be faster] with a Smaller pool -

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-06 Thread Craig Ringer
On 11/05/2010 07:32 PM, A B wrote: The server will just boot, load data, run, hopefully not crash but if it would, just start over with load and run. Have you looked at VoltDB? It's designed for fast in-memory use. -- Craig Ringer -- Sent via pgsql-performance mailing list

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Thom Brown
On 5 November 2010 10:59, A B gentosa...@gmail.com wrote: Hi there. If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? Turn off fsync and

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Thom Brown
On 5 November 2010 11:14, Thom Brown t...@linux.com wrote: On 5 November 2010 10:59, A B gentosa...@gmail.com wrote: Hi there. If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur),

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Guillaume Cottenceau
A B gentosaker 'at' gmail.com writes: Hi there. If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? Don't use PostgreSQL, just drop your data, you

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Szymon Guz
On 5 November 2010 11:59, A B gentosa...@gmail.com wrote: Hi there. If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? I'm just curious, what do

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread A B
Turn off fsync and full_page_writes (i.e. running with scissors). Also depends on what you mean by as fast as possible.  Fast at doing what?  Bulk inserts, selecting from massive tables? I guess some tuning has to be done to make it work well with the particular workload (in this case most

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Craig Ringer
On 05/11/10 18:59, A B wrote: Hi there. If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? Others have suggested appropriate parameters (running

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread A B
If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? I'm just curious, what do you need that for? regards Szymon I was just thinking about the

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread A B
If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? Others have suggested appropriate parameters (running with scissors). I'd like to add something

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Marti Raudsepp
On Fri, Nov 5, 2010 at 13:32, A B gentosa...@gmail.com wrote: I was just thinking about the case where I will have almost 100% selects, but still needs something better than a plain key-value storage so I can do some sql queries. The server will just boot, load data, run,  hopefully not crash

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Thom Brown
On 5 November 2010 11:36, Marti Raudsepp ma...@juffo.org wrote: On Fri, Nov 5, 2010 at 13:32, A B gentosa...@gmail.com wrote: I was just thinking about the case where I will have almost 100% selects, but still needs something better than a plain key-value storage so I can do some sql

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Marti Raudsepp
On Fri, Nov 5, 2010 at 13:11, Guillaume Cottenceau g...@mnc.ch wrote: Don't use PostgreSQL, just drop your data, you will end up with the same results and be even faster than any use of PostgreSQL. If anyone needs data, then just say you had data corruption, and that since 100% dataloss is

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Guillaume Cottenceau
Marti Raudsepp marti 'at' juffo.org writes: On Fri, Nov 5, 2010 at 13:11, Guillaume Cottenceau g...@mnc.ch wrote: Don't use PostgreSQL, just drop your data, you will end up with the same results and be even faster than any use of PostgreSQL. If anyone needs data, then just say you had data

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Guillaume Cottenceau
Marti Raudsepp marti 'at' juffo.org writes: On Fri, Nov 5, 2010 at 13:32, A B gentosa...@gmail.com wrote: I was just thinking about the case where I will have almost 100% selects, but still needs something better than a plain key-value storage so I can do some sql queries. The server will

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Jon Nelson
On Fri, Nov 5, 2010 at 7:08 AM, Guillaume Cottenceau g...@mnc.ch wrote: Marti Raudsepp marti 'at' juffo.org writes: On Fri, Nov 5, 2010 at 13:32, A B gentosa...@gmail.com wrote: I was just thinking about the case where I will have almost 100% selects, but still needs something better than a

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Devrim GÜNDÜZ
On Fri, 2010-11-05 at 11:59 +0100, A B wrote: If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? You can initdb to ramdisk, if you have enough RAM.

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Chris Browne
gentosa...@gmail.com (A B) writes: If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? Use /dev/null. It is web scale, and there are good tutorials.

Re: [PERFORM] Running PostgreSQL as fast as possible no matter the consequences

2010-11-05 Thread Mladen Gogala
Devrim GÜNDÜZ wrote: On Fri, 2010-11-05 at 11:59 +0100, A B wrote: If you just wanted PostgreSQL to go as fast as possible WITHOUT any care for your data (you accept 100% dataloss and datacorruption if any error should occur), what settings should you use then? You can initdb to