Re: [PERFORM] Copy performance issues

2010-08-20 Thread Sergey Konoplev
Hi, Try to split your data in small batches. It helped me in a similar situation recently. I was loading about a million rows into the table highly populated with indexes and different triggers and the batch size was 100 (using COPY). The only thing I did with DDL is droped FKs and recreated them

Re: [PERFORM] Copy performance issues

2010-08-18 Thread s anwar
On Wed, Aug 18, 2010 at 3:42 PM, Tom Lane wrote: > Saadat Anwar writes: > > I am having severe COPY performance issues after adding indices. What > used > > to take a few minutes (without indices) now takes several hours (with > > indices). I've tried to tweak the database configuration (based o

Re: [PERFORM] Copy performance issues

2010-08-18 Thread Greg Smith
s anwar wrote: 3. 8T RAID5 partition for database on a Dell PERC 5/E controller (I understand that I'll never get fast inserts/updates on it based on http://wiki.postgresql.org/wiki/SlowQueryQuestions but cannot change to a RAID0+1 for now). Database's filesystem is ext4 on LVM on

Re: [PERFORM] Copy performance issues

2010-08-18 Thread Tom Lane
Saadat Anwar writes: > I am having severe COPY performance issues after adding indices. What used > to take a few minutes (without indices) now takes several hours (with > indices). I've tried to tweak the database configuration (based on Postgres > documentation and forums), but it hasn't helped

[PERFORM] Copy performance issues

2010-08-18 Thread Saadat Anwar
I am having severe COPY performance issues after adding indices. What used to take a few minutes (without indices) now takes several hours (with indices). I've tried to tweak the database configuration (based on Postgres documentation and forums), but it hasn't helped as yet. Perhaps, I haven't inc

[PERFORM] Copy performance issues

2010-08-18 Thread s anwar
I am having severe COPY performance issues after adding indices. What used to take a few minutes (without indices) now takes several hours (with indices). I've tried to tweak the database configuration (based on Postgres documentation and forums), but it hasn't helped as yet. Perhaps, I haven't inc