Re: [ADMIN] plsql gets "out of memory"

2011-09-02 Thread Scott Marlowe
On Fri, Sep 2, 2011 at 9:30 PM, Rural Hunter wrote: > Hi Kevin, > > I did another try with following additional changes based on our discussion: > 1. use the tcp connection > 2. turn off autovacuum > 3. turn off full_page_writes > > I could import more than 30G data in about 2 hours. That's totall

Re: [ADMIN] plsql gets "out of memory"

2011-09-02 Thread Rural Hunter
Hi Kevin, I did another try with following additional changes based on our discussion: 1. use the tcp connection 2. turn off autovacuum 3. turn off full_page_writes I could import more than 30G data in about 2 hours. That's totally acceptable performance to me with the current server capability

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Rural Hunter
Yes, seems so. I separated one of the tables having the problem and did a test. First, loaded it with original file and saw the same: invalid command then follows "out of memory". After I fixed those escape characters, the table could be loaded successfully. 于 2011/8/30 10:14, Scott Marlowe 写道

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Scott Marlowe
2011/8/29 Rural Hunter : > Hi all, > I'm a newbie here. I'm trying to test pgsql with my mysql data. If the > performance is good, I will migrate from mysql to pgsql. > I installed pgsql 9.1rc on my Ubuntu server. I'm trying to import a large > sql file dumped from mysql into pgsql with 'plsql -f'.

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Rural Hunter
Thank you. I didn't understand what 'vacuum freeze' actually does. I will check the detail to see if it's good for my situation. and I will also test the load by tcp connection. Thanks again for all your advices and they are really very helpful to me! 于 2011/8/30 0:06, Kevin Grittner 写道: Rura

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Kevin Grittner
Rural Hunter wrote: > 2011/8/29 23:18, Kevin Grittner: >> I also recommend a VACUUM FREEZE ANALYZE on the database unless >> most of these rows will be deleted or updated before you run a >> billion database transactions. Otherwise you will get a painful >> "anti-wraparound" autovacuum on everyt

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Rural Hunter
Hi Kevin, Thank you very much for the quick and detailed answers/suggestions. I will check and try them. 于 2011/8/29 23:18, Kevin Grittner 写道: Good (but don't forget to change that once the bulk load is done). You should probably also turn off full_page_writes and synchronous_commit. I've se

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Kevin Grittner
Rural Hunter wrote: > yes, the size of my database(around 200g) is very close to yours. > How long did it take you to migrate the data(100-200G)? I don't remember off-hand, and I'm not sure it's worth digging for the info because so much has changed in the intervening six years. Recent Postgre

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Rural Hunter
yes, the size of my database(around 200g) is very close to yours. How long did it take you to migrate the data(100-200G)? I thought about to write java code to transfer the data but it's a bit trivial. It would be the best if I can complete this with regular export/import way. if that won't wor

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Kevin Grittner
Rural Hunter wrote: > it's a problem of migrating vast data from mysql to pgsql. I don't know how helpful you'll find this, but when we migrated to PostgreSQL a few years ago, we had good luck with using Java to stream from one database to another. Be sure to include a lot of inserts in each

Re: [ADMIN] plsql gets "out of memory"

2011-08-29 Thread Rural Hunter
s out http://www.revsys.com/writings/postgresql-performance.html > Date: Mon, 29 Aug 2011 21:11:19 +0800 > From: [email protected] > To: [email protected] > Subject: [ADMIN] plsql gets "out of memory" > > Hi all, > I'm a newbie here. I'm trying to tes

[ADMIN] plsql gets "out of memory"

2011-08-29 Thread Rural Hunter
Hi all, I'm a newbie here. I'm trying to test pgsql with my mysql data. If the performance is good, I will migrate from mysql to pgsql. I installed pgsql 9.1rc on my Ubuntu server. I'm trying to import a large sql file dumped from mysql into pgsql with 'plsql -f'. The file is around 30G with bu

Re: [ADMIN] PLSQL

2003-02-26 Thread Rajesh Kumar Mallah
Hmm i did'nt know its already there. in anycase it does not tells abt the simplification that has been introduced in 7.3.x regarding SRFs. regds mallah. 4.25) How do I return multiple rows or columns from a function? You can return result sets from PL/pgSQL functions using refcursors. See

Re: [ADMIN] PLSQL

2003-02-26 Thread Robert Treat
You mean like http://www.postgresql.org/docs/faqs/FAQ.html#4.25 ? Robert Treat On Wed, 2003-02-26 at 02:13, Rajesh Kumar Mallah wrote: > > Hmmm Looks like this has become a FAQ :-) > > reds > mallah. > > On Tuesday 25 February 2003 09:24 pm, Robert Treat wrote: > > In version 7.3 they can do s

Re: [ADMIN] PLSQL

2003-02-25 Thread Robert Treat
In version 7.3 they can do so. There is a tutorial available at http://techdocs.postgresql.org/guides/SetReturningFunctions Robert Treat On Tue, 2003-02-25 at 10:33, Sidar Lopez Cruz wrote: > Can PostgreSQL functions return recordsets like stored procedures in > oracle? > > :-) Sidar Lopez Cruz

[ADMIN] PLSQL

2000-09-12 Thread Paulo Roberto Siqueira
Where can I find a tutorial on PL/SQL for postgres? Is there any documentation focused on it on postgres' site? Thank you