Re: [JDBC] java.lang.OutOfMemory Exception with a large number of inserts
You wrote: > Here's the offending loop. BTW, I messed up with the > total number of rows, it's ~6,000,000, not 600,000. [...] > while(dbResult.next()) Unfortunately, PostgreSQL clients always retrieve the entire resultset from the server before it is processed by the .next() loop. In your case this means that the 6.000.000 rows are first read by the Java client into one huge ResultSet. This will no doubt require much more than 50M of memory. Can't you perform this operation in one or more SQL statements or procedurally in PLSQL on the server, instead of retrieving all data to the client? Cheers, René Pijlman ---(end of broadcast)--- TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]
Re: [JDBC] java.lang.OutOfMemory Exception with a large number of inserts
On Wed, 3 Oct 2001 12:43:12 +0530, you wrote: >At one point in my program, I was inserting a large number of rows >(~600,000) using a prepared statement. Here are some things I noticed. Can you post a code snippet that reproduces the problem? Regards, René Pijlman <[EMAIL PROTECTED]> ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org
[JDBC] java.lang.OutOfMemory Exception with a large number of inserts
Hi. At one point in my program, I was inserting a large number of rows (~600,000) using a prepared statement. Here are some things I noticed. 1. It's very slow! :-) 2. Initially, the cpu monitor shows a high level of cpu utilisation, but this slowly drops off with a blip every second or so. Basically, things slow down as the process chugs along. 3. I eventually get a java.Lang.OutOfMemory exception after approx 1:00 - 1:30 hrs. I tried running the JVM with heap size set to 50 Mbytes. I still get the out of mem error. I can't use the 'load' command instead of individual inserts. Is there a faster/better way? Any ideas on how I can get rid of the out of mem errors? Thanks in advance --Arsalan - WAR IS PEACE FREEDOM IS SLAVERY IGNORANCE IS STRENGTH --1984 ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister command (send "unregister YourEmailAddressHere" to [EMAIL PROTECTED])
