RE: PostgreSQL text file import performance

2007-04-08 Thread mrgmhale
fe > Sent: Saturday, April 07, 2007 6:12 PM > To: [EMAIL PROTECTED] > Subject: Re: PostgreSQL text file import performance > > > On Apr 7, 2007, at 5:21 PM, mrgmhale wrote: > > > So, how are other folks handling large text/csv file imports into > > remote > >

RE: PostgreSQL text file import performance

2007-04-07 Thread mrgmhale
] > Subject: Re: PostgreSQL text file import performance > > > On Apr 7, 2007, at 5:21 PM, mrgmhale wrote: > > > So, how are other folks handling large text/csv file imports into > > remote > > updateable views? > > Have you looked into PostgreSQL's COPY com

RE: PostgreSQL text file import performance

2007-04-07 Thread mrgmhale
y, April 07, 2007 7:55 PM > To: [EMAIL PROTECTED] > Subject: RE: PostgreSQL text file import performance > > > > Gil, just a comment or two on loading large files: > > > - INSERT INTO is much faster then append. Here's some stats I collected > when optimizing

RE: PostgreSQL text file import performance

2007-04-07 Thread mrgmhale
EMAIL PROTECTED] > Subject: Re: PostgreSQL text file import performance > > > On 4/7/07, mrgmhale <[EMAIL PROTECTED]> wrote: > > > > So, how are other folks handling large text/csv file imports into remote > > updateable views? > > You've run into

RE: PostgreSQL text file import performance

2007-04-07 Thread Bill Arnold
Gil, just a comment or two on loading large files: - INSERT INTO is much faster then append. Here's some stats I collected when optimizing the loading of large tables (IIRC these particular stats came from Paul McNett). *Append/Recall method (original code): *Pass 1 9.914 *Pass 2

Re: PostgreSQL text file import performance

2007-04-07 Thread Ted Roche
On 4/7/07, mrgmhale <[EMAIL PROTECTED]> wrote: > > So, how are other folks handling large text/csv file imports into remote > updateable views? You've run into one of the few areas where the BatchUpdate flag on the ODBC connection is actually a good idea. Check out the Hacker's Guide. You're also

Re: PostgreSQL text file import performance

2007-04-07 Thread Ed Leafe
On Apr 7, 2007, at 5:21 PM, mrgmhale wrote: > So, how are other folks handling large text/csv file imports into > remote > updateable views? Have you looked into PostgreSQL's COPY command? http://www.postgresql.org/docs/current/static/sql-copy.html -- Ed Leafe -- http://leafe.com -- h

PostgreSQL text file import performance

2007-04-07 Thread mrgmhale
This is a long one, more about some behavior I have found using PostgreSQL with VFP, and a bit hoping someone has come up with a solution better than the one I came up with off-the-cuff... Over the past many years I have been pulling raw data off various Unix and Linux minicomputers, and convertin