[GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread Zeeshan.Ghalib
Hello Guys, We are trying to migrate from Oracle to Postgres. One of the major requirement of our database is the ability to generate XML feeds and some of our XML files are in the order of 500MB+. We are getting Out of Memory errors when doing an update on a table. Here is some detail

Re: [GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread Thom Brown
On 5 July 2010 11:47, zeeshan.gha...@globaldatapoint.com wrote: Hello Guys, We are trying to migrate from Oracle to Postgres.  One of the major requirement of our database is the ability to generate XML feeds and some of our XML files are in the order of 500MB+. We are getting Out of

Re: [GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread Zeeshan.Ghalib
-Original Message- From: Thom Brown [mailto:thombr...@gmail.com] Sent: 05 July 2010 12:40 To: Zeeshan Ghalib Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Out of memory on update of a single column table containg just one row. Hi Zeeshan, Which version of PostgreSQL are

Re: [GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread Thomas Markus
Hi, i tried a simple test: create temp table _t as select repeat('x',382637520) as test; update _t set test=test||test; pg 8.3 32bit fails with [Error Code: 0, SQL State: 53200] ERROR: out of memory Detail: Failed on request of size 765275088. pg 8.4.4 64bit works fine so upgrade to 64bit

Re: [GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread Zeeshan.Ghalib
Hello Thom, Thanks for your quick response. So, is this there a restriction with 32-bit PostgreSQL, a bug or configuration issue? I will most definitely upgrade to 64-bit, because that's what we want anyway. However, I was curious what is the root cause of this problem? I am getting a bit

Re: [GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread Sam Mason
On Mon, Jul 05, 2010 at 01:52:20PM +, zeeshan.gha...@globaldatapoint.com wrote: So, is this there a restriction with 32-bit PostgreSQL, a bug or configuration issue? It's a restriction because of the 32bit address space. You've basically got between two and three GB of useful space left

Re: [GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread Zeeshan.Ghalib
Ok, that makes perfect sense. We will upgrade to 64-bit and continue our tests on the new build. By the way, is it safe to go ahead with Centos 5.5 or should we stick to the previous version 5.4? Thank you so much Sam and Thom for your speedy help :) Best regards, Zeeshan

[GENERAL] Out of memory on update of a single column table containg just one row.

2010-07-05 Thread zeeshan.ghalib
Hello Guys, We are trying to migrate from Oracle to Postgres. One of the major requirement of our database is the ability to generate XML feeds and some of our XML files are in the order of 500MB+. We are getting Out of Memory errors when doing an update on a table. Here is some detail