Does it need to go through the app ?

If you are only using the WO app as an upload mechanism you could just write a class and some raw SQL to load the data straight into your DB.

Cutting out the overhead of instantiating objects will speed things up big time.

Simon


On 26 Sep 2007, at 10:13, Shravan Kumar.M wrote:

Hi Group,

A Short Story:

We recently had a problem of not able to upload a file having 40K number of records from our WebObjects application to the database. We used to get java.lang.OutOfMemoryError after uploading around 25K number of records. Alas! this errors should not occur... we gave a -Xmx of 500m as the VM arg, but even then, there was no luck in defeating this error.

Then, we thoroughly analyzed the Upload program and fixed the memory leak.

We were actually invoking "System.gc()" for every 100 records of upload and this statement is indeed executed successfully ;-) But, even after that, the unused memory is not freed and leading to java.lang.OutOfMemoryError .

Now we are able to upload around 70K number of records successfully without java.lang.OutOfMemoryError .

What actually we did to solve the above problem was, we disposed the editingcontext frequently and then invoke gc and thatz the 70K number of records started uploading camly.....

Issue:

Now, the problem we have is, it is taking around 2-3 hours to upload 70K number of records to the database using our WebObjects application, we would like to complete this upload with in half-an- hour or better... hope this is possible, NOT joking. So, can any please advise a Java/WebObjects solution to achieve this target. We use Java 1.4.2 and WO 5.2.4

Looking forward to your help.

Thanks & Rgds,
Shravan Kumar.M

"Let us learn from the past to profit by the present,and from the present to live better in the future."
--William WordsWorth
---------------------------------------------------------------


 _______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-dev mailing list      ([email protected])
Help/Unsubscribe/Update your Subscription:
http://lists.apple.com/mailman/options/webobjects-dev/simon_mclean% 40mac.com

This email sent to [EMAIL PROTECTED]

 _______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-dev mailing list      ([email protected])
Help/Unsubscribe/Update your Subscription:
http://lists.apple.com/mailman/options/webobjects-dev/archive%40mail-archive.com

This email sent to [EMAIL PROTECTED]

Reply via email to