[PERFORM] update from performance question

2017-04-18 Thread Armand Pirvu (home)
Hi Running 9.5.2 I have the following update and run into a bit of a trouble . I realize the tables involved have quite some data but here goes UPDATE tf_transaction_item_person TRANS SET general_ledger_code = PURCH.general_ledger_code, general_ledger_code_desc =

Re: [PERFORM] Insert Concurrency

2017-04-18 Thread ROBERT PRICE
Thanks everyone, I decided to have the SQS process changed to create csv files in a S3 bucket. Then we have a process that will use the copy command to load the data. Process is loading 500,000 records in around 4 minutes which should be good enough for now. Going to look at pg_citus to get up

Re: [PERFORM] Insert Concurrency

2017-04-18 Thread David McKelvie
>> To understand recursion, one must first understand recursion. This makes no sense unless you also provide the base case. David -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription:

Re: [PERFORM] Insert Concurrency

2017-04-18 Thread Scott Marlowe
On Mon, Apr 17, 2017 at 8:55 PM, ROBERT PRICE wrote: > I come from an Oracle background and am porting an application to postgres. > App has a table that will contain 100 million rows and has to be loaded by a > process that reads messages off a SQS queue and makes web

Re: [PERFORM] Insert Concurrency

2017-04-18 Thread Claudio Freire
On Tue, Apr 18, 2017 at 2:45 AM, Daniel Blanch Bataller wrote: > > But if you are going to move a record at a time you are going to be limited > by the fastest transaction rate you can achieve, which is going to be a few > hundred per second, and limited at the