Bugs item #3390825, was opened at 2011-08-12 17:57
Message generated for change (Comment added) made by kargor
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=843359&aid=3390825&group_id=167540
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Synchronisation / Invitation
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Stefan Rossbach (kargor)
Assigned to: Nobody/Anonymous (nobody)
Summary: Sharing Large projects result in OOM Exception
Initial Comment:
!ENTRY org.eclipse.core.jobs 4 2 2011-08-13 02:49:02.536
!MESSAGE An internal error occurred during: "Sharing project {1830266213=A}.".
!STACK 0
java.lang.OutOfMemoryError: Java heap space
at
org.apache.commons.io.output.ByteArrayOutputStream.needNewBuffer(ByteArrayOutputStream.java:124)
at
org.apache.commons.io.output.ByteArrayOutputStream.write(ByteArrayOutputStream.java:155)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1263)
at org.apache.commons.io.IOUtils.copy(IOUtils.java:1236)
at org.apache.commons.io.IOUtils.toByteArray(IOUtils.java:360)
at
org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1360)
at
de.fu_berlin.inf.dpp.net.internal.XMPPTransmitter.sendProjectArchive(XMPPTransmitter.java:868)
at
de.fu_berlin.inf.dpp.invitation.OutgoingProjectNegotiation.sendArchive(OutgoingProjectNegotiation.java:628)
at
de.fu_berlin.inf.dpp.invitation.OutgoingProjectNegotiation.start(OutgoingProjectNegotiation.java:125)
at
de.fu_berlin.inf.dpp.project.SarosSessionManager$OutgoingProjectJob.run(SarosSessionManager.java:678)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
Project archive size is 700 MB.
The project archive should not be load into memory, Instead chunks must be
read and transmitted.
----------------------------------------------------------------------
>Comment By: Stefan Rossbach (kargor)
Date: 2012-07-04 12:44
Message:
I think the upper bound is approx. 100 MB (with a max heap 512 MB for the
JVM).
To understand the full issue you have to know how garbage collection works,
and how the archive is reassembled on invitees side.
I already patch the inviter part, to send larger projects thus only
transferring the problem to the other machine.
Depending on how much plugins are activitated in the Eclipse IDE, I think
the maximum size that can be transferred can be in between 50 - 70 MB.
Depending on how many third party libraries you are using, or already
precompiled parts of the application that are needed to compile a component
of your application which you want to work on, this can become really
annoying.
Current workaround is to divide your current projects into multiple partial
shared projects. And resync over and over again until the whole project is
transmitted, so that in your final sync no more data is transferred. That
must be done for every single user, because inviting them in parallel will
increase the heap usage on the inviter side.
----------------------------------------------------------------------
Comment By: Alexander Waldmann (netcorps)
Date: 2012-07-04 02:18
Message:
The priority of this bug is at 5 as the probability of this happening is
low.
The statistics indicate that users mostly share projects up to 5MB
(compressed size).
This might be the case because saros is not able to handle bigger projects,
so it should definitely be worked on, but other things are more important
than this at the moment.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=843359&aid=3390825&group_id=167540
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Dpp-robot mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dpp-robot
