[
https://issues.apache.org/jira/browse/COMPRESS-466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641124#comment-16641124
]
Jakob Sultan Ericsson commented on COMPRESS-466:
------------------------------------------------
Yes i realized that. :-) I have made working patch last week but I forgot to
update this on my fork. I can publish it later tonight.
I also tested to read everything in one go and parse from memory it was a bit
faster but not as much as I thought.
18s with only read from central directory and about 12s from memory.
> Opening of a very large zip file is extremely slow compared to
> java.util.zip.ZipFile
> ------------------------------------------------------------------------------------
>
> Key: COMPRESS-466
> URL: https://issues.apache.org/jira/browse/COMPRESS-466
> Project: Commons Compress
> Issue Type: Bug
> Components: Compressors
> Affects Versions: 1.18
> Environment: Tested both on Linux and OSX 10.13.6.
> Reporter: Jakob Sultan Ericsson
> Priority: Major
>
> We have a quite large zip file 35 gb and try to open this with ZipFile.
> {code:java}
> try (ZipFile zf = new ZipFile(new File("35gb.zip"))) {
> System.out.println("File opened..." + (System.currentTimeMillis()
> - start));
> }
> {code}
> This code takes about 300 000 - 400 000 ms (5-6 minutes).
> If I run this with JDK-builtin java.util.zip.ZipFile, same code takes 300 ms
> (less than a second).
> I'm not totally sure what it is the problem but I did some debugging and
> basically all time is spent in
> {code:java}
> private void resolveLocalFileHeaderData(final Map<ZipArchiveEntry,
> NameAndComment> entriesWithoutUTF8Flag)
> {code}
> Anything that can be done to improve this?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
