Re: [PERFORM] Re: [HACKERS] [COMMITTERS] pgsql: Fix TransactionIdIsCurrentTransactionId() to use binary search

2008-04-26 Thread Robert Treat
On Friday 25 April 2008 17:32, Tom Lane wrote: Robert Treat [EMAIL PROTECTED] writes: Oddly some dtrace profiling gave me this, which is pretty different, but certainly doesn't have concerns about TransactionIdIsCurrentTransactionId which seems to pretty much destroy your thesis, no?

[PERFORM] Best practice to load a huge table from ORACLE to PG

2008-04-26 Thread Adonias Malosso
Hi All, I´d like to know what´s the best practice to LOAD a 70 milion rows, 101 columns table from ORACLE to PGSQL. The current approach is to dump the data in CSV and than COPY it to Postgresql. Anyone has a better idea. Regards Adonias Malosso

Re: [PERFORM] Oddly slow queries

2008-04-26 Thread Thomas Spreng
On 22.04.2008, at 17:25, Scott Marlowe wrote: On Tue, Apr 22, 2008 at 7:42 AM, Thomas Spreng [EMAIL PROTECTED] wrote: I think I'll upgrade PostgreSQL to the latest 8.3 version in the next few days anyway, along with a memory upgrade (from 1.5GB to 4GB) and a new 2x RAID-1 (instead of

Re: [PERFORM] Best practice to load a huge table from ORACLE to PG

2008-04-26 Thread Joshua D. Drake
Adonias Malosso wrote: Hi All, I´d like to know what´s the best practice to LOAD a 70 milion rows, 101 columns table from ORACLE to PGSQL. The current approach is to dump the data in CSV and than COPY it to Postgresql. Anyone has a better idea. Write a java trigger in Oracle that notes

Re: [PERFORM] Best practice to load a huge table from ORACLE to PG

2008-04-26 Thread Potluri Srikanth
But do we link oracle trigger to postgres trigger ? i mean : oracle trigger will take a note of what has been changed . but then how do we pass those changes to postgres trigger ? can u suggest any logic or algorithm ? Regards, Srikanth k Potluri +63 9177444783(philippines) On Sat

Re: [PERFORM] Best practice to load a huge table from ORACLE to PG

2008-04-26 Thread Joshua D. Drake
Potluri Srikanth wrote: But do we link oracle trigger to postgres trigger ? i mean : oracle trigger will take a note of what has been changed . but then how do we pass those changes to postgres trigger ? I am assuming you can use the java trigger from oracle to load the postgresql jdbc

Re: [PERFORM] Best practice to load a huge table from ORACLE to PG

2008-04-26 Thread Luke Lonergan
Yep ­ just do something like this within sqlplus (from http://www.dbforums.com/showthread.php?t=350614): set termout off set hea off set pagesize 0 spool c:\whatever.csv select a.a||','||a.b||','||a.c from a where a.a=whatever; spool off COPY is the fastest approach to get it into PG. - Luke

Re: [PERFORM] Re: [HACKERS] [COMMITTERS] pgsql: Fix TransactionIdIsCurrentTransactionId() to use binary search

2008-04-26 Thread Tom Lane
Robert Treat [EMAIL PROTECTED] writes: On Friday 25 April 2008 17:32, Tom Lane wrote: Robert Treat [EMAIL PROTECTED] writes: Oddly some dtrace profiling gave me this, which is pretty different, but certainly doesn't have concerns about TransactionIdIsCurrentTransactionId which seems to

Re: [PERFORM] Re: [HACKERS] [COMMITTERS] pgsql: Fix TransactionIdIsCurrentTransactionId() to use binary search

2008-04-26 Thread Robert Treat
On Saturday 26 April 2008 13:26, Tom Lane wrote: Robert Treat [EMAIL PROTECTED] writes: On Friday 25 April 2008 17:32, Tom Lane wrote: Robert Treat [EMAIL PROTECTED] writes: Oddly some dtrace profiling gave me this, which is pretty different, but certainly doesn't have concerns about

Re: [PERFORM] Best practice to load a huge table from ORACLE to PG

2008-04-26 Thread Craig Ringer
Joshua D. Drake wrote: Potluri Srikanth wrote: But do we link oracle trigger to postgres trigger ? i mean : oracle trigger will take a note of what has been changed . but then how do we pass those changes to postgres trigger ? I am assuming you can use the java trigger from oracle to load

Re: [PERFORM] Re: [HACKERS] [COMMITTERS] pgsql: Fix TransactionIdIsCurrentTransactionId() to use binary search

2008-04-26 Thread Tom Lane
Robert Treat [EMAIL PROTECTED] writes: On Saturday 26 April 2008 13:26, Tom Lane wrote: Oh, you failed to state that the dtrace output was post-patch. You need to show *pre* patch dtrace output if you want us to think it relevant. Please read up-thread. Sorry, I'd forgotten your previous

Re: [PERFORM] Best practice to load a huge table from ORACLE to PG

2008-04-26 Thread Jonah H. Harris
On Sat, Apr 26, 2008 at 9:25 AM, Adonias Malosso [EMAIL PROTECTED] wrote: I´d like to know what´s the best practice to LOAD a 70 milion rows, 101 columns table from ORACLE to PGSQL. The fastest and easiest method would be to dump the data from Oracle into CSV/delimited format using something