Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-03-01 Thread Gary Fu
On 02/28/11 19:30, Andres Freund wrote: Hi, On Wednesday 23 February 2011 19:31:58 Gary Fu wrote: I'm testing on converting a big Sybase db to Pg. It took about 45 hours to convert all sybase tables (bcp) to Pg (copy) without index and reference. After that I built the index (one by one, seq

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Andres Freund
Hi, On Wednesday 23 February 2011 19:31:58 Gary Fu wrote: > I'm testing on converting a big Sybase db to Pg. It took about 45 hours > to convert all sybase tables (bcp) to Pg (copy) without index and > reference. After that I built the index (one by one, sequentially) and > it took about 25 hour

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Joshua D. Drake
On Mon, 2011-02-28 at 18:16 -0500, Gary Fu wrote: > > > It is set to 12GB. > > Do you recommend to set fsync to off ? It needs to restart the server. Not in production. JD > > Thanks, > Gary > -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Gary Fu
On 02/28/11 17:56, Andres Freund wrote: Hi, On Saturday, February 26, 2011 12:11:19 AM Gary Fu wrote: wal_buffers = 16MB sensible checkpoint_segments = 256 A setting that high seems unlikely to be beneficial... I suggest you configure log_checkpoints to monitor this. effective_cache_size

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Andres Freund
Hi, On Saturday, February 26, 2011 12:11:19 AM Gary Fu wrote: > wal_buffers = 16MB sensible > checkpoint_segments = 256 A setting that high seems unlikely to be beneficial... I suggest you configure log_checkpoints to monitor this. > effective_cache_size = 30GB Not likely to matter in this case.

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Gary Fu
On 02/28/11 17:32, Andy Colson wrote: Here are the more test results on the 3rd ref and parallel on 2nd and 3rd references: 325 mins on FK_FM_ALL_REF_FILE (334 mins previous) parallel results on 2nd and 3rd references: (much worse on 2nd ref) Here are some information on my system: 1:

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Andy Colson
Here are the more test results on the 3rd ref and parallel on 2nd and 3rd references: 325 mins on FK_FM_ALL_REF_FILE (334 mins previous) parallel results on 2nd and 3rd references: (much worse on 2nd ref) Here are some information on my system: 1:07pm 20 gfu@moddblads:/dump/gfu> free -m

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Gary Fu
On 02/25/11 18:11, Gary Fu wrote: On 02/25/11 17:22, Andy Colson wrote: On 2/23/2011 12:31 PM, Gary Fu wrote: Hi, I'm testing on converting a big Sybase db to Pg. It took about 45 hours to convert all sybase tables (bcp) to Pg (copy) without index and reference. After that I built the index (o

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-25 Thread Andy Colson
On 02/25/2011 05:11 PM, Gary Fu wrote: On 02/25/11 17:22, Andy Colson wrote: On 2/23/2011 12:31 PM, Gary Fu wrote: Hi, I'm testing on converting a big Sybase db to Pg. It took about 45 hours to convert all sybase tables (bcp) to Pg (copy) without index and reference. After that I built the ind

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-25 Thread Gary Fu
On 02/25/11 17:22, Andy Colson wrote: On 2/23/2011 12:31 PM, Gary Fu wrote: Hi, I'm testing on converting a big Sybase db to Pg. It took about 45 hours to convert all sybase tables (bcp) to Pg (copy) without index and reference. After that I built the index (one by one, sequentially) and it to

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-25 Thread Andy Colson
On 2/23/2011 12:31 PM, Gary Fu wrote: Hi, I'm testing on converting a big Sybase db to Pg. It took about 45 hours to convert all sybase tables (bcp) to Pg (copy) without index and reference. After that I built the index (one by one, sequentially) and it took about 25 hours and then I started to

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-25 Thread Tom Lane
Gary Fu writes: > I'm testing on converting a big Sybase db to Pg. It took about 45 hours > to convert all sybase tables (bcp) to Pg (copy) without index and > reference. After that I built the index (one by one, sequentially) and > it took about 25 hours and then I started to add the referen

[GENERAL] slow building index and reference after Sybase to Pg

2011-02-25 Thread Gary Fu
Hi, I'm testing on converting a big Sybase db to Pg. It took about 45 hours to convert all sybase tables (bcp) to Pg (copy) without index and reference. After that I built the index (one by one, sequentially) and it took about 25 hours and then I started to add the references (one by one),