Bugs item #3512781, was opened at 2012-03-29 04:27
Message generated for change (Settings changed) made by kargor
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=843359&aid=3512781&group_id=167540

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Synchronisation / Invitation
Group: None
>Status: Closed
Resolution: Fixed
Priority: 5
Private: No
Submitted By: Björn Kahlert (bkahlert)
Assigned to: Stefan Rossbach (kargor)
Summary: Zip / Unzip takes too long

Initial Comment:
Zip and Unzip takes too long while inviting a user to a session

Zip: About 2-3 minutes for 12 MB on a HDD or SSD
Unzip: About 30 seconds for 12 MB on a HDD or SSD

----------------------------------------------------------------------

Comment By: Stefan Rossbach (kargor)
Date: 2012-04-02 16:11

Message:
And this is an answer from a developers point of view where the end user
provided poor or meaningless informations. Thanks. You provided no log
files, just a stupid picture. What do you think a developer would do. The
easiest way is just discarding such crap, If she / he would be a bit nicer,
she / he may test this, just to find out that there is no such behaviour
that you described <=> rejected.

----------------------------------------------------------------------

Comment By: Björn Kahlert (bkahlert)
Date: 2012-03-29 13:59

Message:
The bug has been detected during an acceptance test which is a form of
black box test.
The internals are of no interest and that's why the bug description is from
an end user's point of view.
Since the delay regularly occurs when the GUI is talking of compression
stuff the bug description is completely correct.
Cheers

----------------------------------------------------------------------

Comment By: Stefan Rossbach (kargor)
Date: 2012-03-29 13:48

Message:
That has nothing to do with the zip / unzip routines, Seems that some
workspace resource listeners do dumb stuff, also got an inconsistency
warning for serveral files ...

Currently the bug description is wrong, normally this is a performance
issue, but it is not even put under that category.

----------------------------------------------------------------------

Comment By: Björn Kahlert (bkahlert)
Date: 2012-03-29 06:39

Message:
Without VCS:
zip: 1:20min
unzip: 0:41min

Manually refreshing my workspace (all top level items / projects selected +
F5) takes less than a second.

I agree that it's very probably the checksum calculation that consumes a
large amount of time.
Still the zip/unzip problems remains.

----------------------------------------------------------------------

Comment By: Alexander Waldmann (netcorps)
Date: 2012-03-29 06:28

Message:
73MB project (saros: 5563 files). classical HDD

Time until "creating list of project files" progressbar disappears: 3
seconds (!)


Creating of filelist+CHECKSUMS (!!!): 80 seconds

Please do NOT compare filelist creation for creating a zip file with the
calculation of all checksums... as those are COMPLETELY different things.

----------------------------------------------------------------------

Comment By: Alexander Waldmann (netcorps)
Date: 2012-03-29 06:20

Message:
if i remember correctly, the filelist creation also includes reading the
SVN revision of the files, which would also explain why this takes so
long.. just zipping the files doesn't take that long.

@björn Can you try doing the zipping again in saros with VCS support
disabled please?

----------------------------------------------------------------------

Comment By: Alexander Waldmann (netcorps)
Date: 2012-03-29 06:19

Message:
For the filelist creation, the eclipse workspace is refreshed first. This
takes a significant amount of time.

I think it's not possible to skip this step, as we otherwise would fail
synchronising projects if eclipse marks them as "out of sync with the
diskstate".
Should still investigate why unzipping pauses and takes forever...

----------------------------------------------------------------------

Comment By: Björn Kahlert (bkahlert)
Date: 2012-03-29 05:52

Message:
@kargor
I was talking of zip AND unzip.
You are right that when ".project" was displayed another 25 seconds
passed.
Those seconds are not part of the measured we made.
So the whole process took even longer.



@netcorps
ZIP and UNZIP of 21.5 MB

ON MAC OS X / FINDER
file list creation: ~0:00 min
zip: 0:03 min
unzip: 0:02 min

ON JVM / SAROS
file list creation: 1:32 min
zip: 1:36 min (first run) 1:27 min (second run)
unzip: 1:21 min (first run) 0:54 min (second run)

----------------------------------------------------------------------

Comment By: Stefan Rossbach (kargor)
Date: 2012-03-29 05:30

Message:
DEBUG 2012-03-29 12:32:04,533 (FileZipper.java:158) Created project archive
 (12 MiB in 2s at 5779.47 KiB/s) at
/var/folders/3m/4p47cq955p142xmsnh0c_9lm0000gn/T/1101072894&&&&9153326936255955052.zip

Not a bug with Unzipping / zipping.

What you mean is this:

DEBUG 2012-03-29 12:17:35,962 (FileUtils.java:203) File written to disk:
src/de/fu_berlin/inf/dpp/ui/widgets/session/ChatRoomsComposite.java
DEBUG 2012-03-29 12:17:36,414 (ProjectDeltaVisitor.java:262) Resource
.project changed
DEBUG 2012-03-29 12:18:01,977 (FileUtils.java:203) File written to disk:
src/de/fu_berlin/inf/dpp/activities/business/IActivityReceiver.java

I have no clue while unzipping is suspended for 25 seconds.

----------------------------------------------------------------------

Comment By: Alexander Waldmann (netcorps)
Date: 2012-03-29 05:28

Message:
Can you try the following please:

zip a file with a zip application
unzip the created zip file to disk.

Now do the same with saros (run two instances of saros on your host, import
the files to a project and share it).

Is there a significant difference in processing times between saros
unzipping and the other app unzipping?

Zipping reads  multiple files but writes only one file
Unzipping reads one file but writes multiple files, including adding file
paths to the HDD tables etc, so it would not  surprise me that unzipping
could take longer than zipping.


----------------------------------------------------------------------

Comment By: Björn Kahlert (bkahlert)
Date: 2012-03-29 05:02

Message:
The problem occurred on Julia's, Stephan's and my computer.

----------------------------------------------------------------------

Comment By: Stefan Rossbach (kargor)
Date: 2012-03-29 04:40

Message:
Maybe you should buy a new PC

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=843359&aid=3512781&group_id=167540

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Dpp-robot mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dpp-robot

Reply via email to