Merlin Moncure wrote:
> Postgres can handle multiple 1000 insert/sec but your hardware most
> likely can't handle multiple 1000 transaction/sec if fsync is on.
commit_delay or async commit should help a lot there.
http://www.postgresql.org/docs/8.3/static/wal-async-commit.html
http://www.postgre
> I have an application wherein a process needs to read data from a stream and
> store the records for further analysis and reporting. The data in the stream
> is in the form of variable length records with clearly defined fields – so
> it can be stored in a database or in a file. The only caveat i
On Tue, Nov 3, 2009 at 7:12 PM, Jay Manni wrote:
> Hi:
>
>
>
> I have an application wherein a process needs to read data from a stream and
> store the records for further analysis and reporting.
Where is the stream coming from? What happens if the process reading
the stream fails but the one ge
Jay Manni wrote:
The data in the stream is in the form of variable length records with
clearly defined fields ? so it can be stored in a database or in a
file. The only caveat is that the rate of records coming in the stream
could be several 1000 records a second.
There's a few limits to be
n Tue, Nov 3, 2009 at 10:12 PM, Jay Manni wrote:
> Hi:
>
> I have an application wherein a process needs to read data from a stream and
> store the records for further analysis and reporting. The data in the stream
> is in the form of variable length records with clearly defined fields – so
> it c
's not exactly what you were looking for... Just food for thought.
Best of luck!
David
From: Jay Manni
To: "pgsql-performance@postgresql.org"
Sent: Tue, November 3, 2009 7:12:29 PM
Subject: [PERFORM] High Frequency Inserts to Postgres Database vs Writ
On Tue, Nov 3, 2009 at 8:12 PM, Jay Manni wrote:
> Hi:
>
>
>
> I have an application wherein a process needs to read data from a stream and
> store the records for further analysis and reporting. The data in the stream
> is in the form of variable length records with clearly defined fields – so
>
Hi:
I have an application wherein a process needs to read data from a stream and
store the records for further analysis and reporting. The data in the stream is
in the form of variable length records with clearly defined fields - so it can
be stored in a database or in a file. The only caveat i
