On 2/14/07, Luke Lonergan <[EMAIL PROTECTED]> wrote:
Hi Merlin,
On 2/14/07 8:20 AM, "Merlin Moncure" <[EMAIL PROTECTED]> wrote:
> I am curious what is your take on the maximum insert performance, in
> mb/sec of large bytea columns (toasted), and how much if any greenplum
> was able to advance this over the baseline. I am asking on behalf of
> another interested party. Interested in numbers broken down per core
> on 8 core quad system and also aggreate.
Our approach is to attach a segment to each core, so we scale INSERT
linearly on number of cores. So the per core limit we live with is the
10-20MB/s observed here. We'd like to improve that so that we get better
performance with smaller machines.
We have demonstrated insert performance of 670 MB/s, 2.4TB/hour for
non-toasted columns using 3 load machines against 120 cores. This rate was
load machine limited.
WRT toasted bytea columns we haven't done any real benchmarking of those.
Do you have a canned benchmark we can run?
Interested in how fast you can insert binary objects (images, files,
etc). into the database as a file storage system. Ultimately the
insertions would all be done via libpq ExecPrepared/Params. A simple
benchmark such as insert a 1mb object via pg_bench over 20 or so
connections would be fine. Mostly interested in raw throughput per
core and especially interested if you can beat stock pg on the same
hardware.
merlin
---------------------------(end of broadcast)---------------------------
TIP 1: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get through to the mailing list cleanly
