Re: [PERFORM] autocommit (true/false) for more than 1 million records

2014-08-27 Thread David Johnston
On Wed, Aug 27, 2014 at 1:02 AM, Alex Goncharov alex.goncharov@gmail.com wrote: Thank you, Kevin -- this is helpful. Thank you David, too. But it still leaves questions for me. Still... Alex Goncharov alex.goncharov@gmail.com wrote: How do I decide, before starting a COPY

Re: [PERFORM] autocommit (true/false) for more than 1 million records

2014-08-27 Thread Albe Laurenz
Alex Goncharov wrote: Thank you, Kevin -- this is helpful. But it still leaves questions for me. Alex Goncharov alex.goncharov@gmail.com wrote: The whole thing is aborted then, and the good 99 records are not making it into the target table. Right. This is one reason people often

Re: [PERFORM] autocommit (true/false) for more than 1 million records

2014-08-27 Thread Felipe Santos
This might also help: http://www.postgresql.org/docs/9.1/static/populate.html Bulk load tables from text files in almost all RDMS are log free (Postgres' COPY is one of them). The reason is that the database doesn't need to waste resources by writing the log because there's no risk of data loss.

Re: [PERFORM] autocommit (true/false) for more than 1 million records

2014-08-27 Thread Albe Laurenz
[about loadling large amounts of data] Felipe Santos wrote: This might also help: http://www.postgresql.org/docs/9.1/static/populate.html Bulk load tables from text files in almost all RDMS are log free (Postgres' COPY is one of them). The reason is that the database doesn't need to

Re: [PERFORM] autocommit (true/false) for more than 1 million records

2014-08-27 Thread Kevin Grittner
Alex Goncharov alex.goncharov@gmail.com wrote: Kevin Grittner kgri...@ymail.com wrote: The rows will all be in the table, but not visible to any other transaction. How much data can I fit there while doing COPY?  Not 1 TB? As has already been said, why not?  This is not some special