Re: [PERFORM] batch inserts are "slow"

2005-05-03 Thread Dave Cramer
Kris is correct, This code was not added or even submitted to CVS. The purpose of this was to work out the bugs with people who are actually using copy. The api is a separate issue however. There's no reason that copy can't support more than one api. Dave Kris Jurka wrote: On Tue, 3 May 2005, J

Re: [PERFORM] batch inserts are "slow"

2005-05-03 Thread Christopher Petrilli
On 5/3/05, Tim Terlegård <[EMAIL PROTECTED]> wrote: > > Just as on Oracle you would use SQL*Loader for this application, you > > should use the COPY syntax for PostgreSQL. You will find it a lot > > faster. I have used it by building the input files and executing > > 'psql' with a COPY command, a

Re: [PERFORM] batch inserts are "slow"

2005-05-03 Thread Steve Wampler
Tim Terlegård wrote: >> >>Just as on Oracle you would use SQL*Loader for this application, you >>should use the COPY syntax for PostgreSQL. You will find it a lot >>faster. I have used it by building the input files and executing >>'psql' with a COPY command, and also by using it with a subproces

Re: [PERFORM] batch inserts are "slow"

2005-05-03 Thread Tim Terlegård
> > I'm converting an application to be using postgresql instead of oracle. > > There seems to be only one issue left, batch inserts in postgresql seem > > significant slower than in oracle. I have about 200 batch jobs, each > > consisting of about 14 000 inserts. Each job takes 1.3 seconds in > >

Re: [PERFORM] batch inserts are "slow"

2005-05-03 Thread Kris Jurka
On Tue, 3 May 2005, Josh Berkus wrote: > > There are several hacks floating around that add COPY capabilities to > > the pgjdbc driver. As they all are rather simple hacks, they have not > > been included in the cvs yet, but they tend to work fine. > > FWIW, Dave Cramer just added beta COPY cap

Re: [PERFORM] batch inserts are "slow"

2005-05-03 Thread Josh Berkus
People, > There are several hacks floating around that add COPY capabilities to > the pgjdbc driver. As they all are rather simple hacks, they have not > been included in the cvs yet, but they tend to work fine. FWIW, Dave Cramer just added beta COPY capability to JDBC. Contact him on the JDBC

Re: [PERFORM] batch inserts are "slow"

2005-05-03 Thread Markus Schaber
Hi, all, David Parker wrote: > We ran into the need to use COPY, but our application is also in Java. > We wrote a JNI bridge to a C++ routine that uses the libpq library to do > the COPY. The coding is a little bit weird, but not too complicated - > the biggest pain in the neck is probably gettin

Re: [PERFORM] batch inserts are "slow"

2005-05-02 Thread Chris Browne
[EMAIL PROTECTED] (Christopher Petrilli) writes: > On 5/2/05, Tim Terlegård <[EMAIL PROTECTED]> wrote: >> Howdy! >> >> I'm converting an application to be using postgresql instead of >> oracle. There seems to be only one issue left, batch inserts in >> postgresql seem significant slower than in o

Re: [PERFORM] batch inserts are "slow"

2005-05-02 Thread David Parker
11:11 AM >To: [EMAIL PROTECTED] >Cc: pgsql-performance@postgresql.org >Subject: Re: [PERFORM] batch inserts are "slow" > >> conn.setAutoCommit(false); >> pst = conn.prepareStatement("INSERT INTO tmp (...) VALUES >(?,?)"); for >> (int i

Re: [PERFORM] batch inserts are "slow"

2005-05-02 Thread Christopher Petrilli
On 5/2/05, Tim Terlegård <[EMAIL PROTECTED]> wrote: > > > Howdy! > > > > > > I'm converting an application to be using postgresql instead of oracle. > > > There seems to be only one issue left, batch inserts in postgresql seem > > > significant slower than in oracle. I have about 200 batch jobs, ea

Re: [PERFORM] batch inserts are "slow"

2005-05-02 Thread Tom Lane
=?iso-8859-1?Q?Tim_Terleg=E5rd?= <[EMAIL PROTECTED]> writes: > There seems to be only one issue left, batch inserts in postgresql seem > significant slower than in oracle. I have about 200 batch jobs, each > consisting of about 14 000 inserts. > conn.setAutoCommit(false); > pst = conn.prepareState

Re: [PERFORM] batch inserts are "slow"

2005-05-02 Thread Tim Terlegård
> > Howdy! > > > > I'm converting an application to be using postgresql instead of oracle. > > There seems to be only one issue left, batch inserts in postgresql seem > > significant slower than in oracle. I have about 200 batch jobs, each > > consisting of about 14 000 inserts. Each job takes 1.3

Re: [PERFORM] batch inserts are "slow"

2005-05-02 Thread Christopher Petrilli
On 5/2/05, Tim Terlegård <[EMAIL PROTECTED]> wrote: > Howdy! > > I'm converting an application to be using postgresql instead of oracle. > There seems to be only one issue left, batch inserts in postgresql seem > significant slower than in oracle. I have about 200 batch jobs, each > consisting of

Re: [PERFORM] batch inserts are "slow"

2005-05-02 Thread Christopher Kings-Lynne
conn.setAutoCommit(false); pst = conn.prepareStatement("INSERT INTO tmp (...) VALUES (?,?)"); for (int i = 0; i < len; i++) { pst.setInt(0, 2); pst.setString(1, "xxx"); pst.addBatch(); } pst.executeBatch(); conn.commit(); This snip takes 1.3 secs in postgresql. How can I lower that? You're