[ 
https://issues.apache.org/jira/browse/MINDEXER-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17965274#comment-17965274
 ] 

Olivier Lamy commented on MINDEXER-18:
--------------------------------------

This project has moved from Jira to GitHub Issues. This issue was migrated to 
[apache/maven-indexer#453|https://github.com/apache/maven-indexer/issues/453]. 

> Indexer is OOM prone while indexing large ZIP files
> ---------------------------------------------------
>
>                 Key: MINDEXER-18
>                 URL: https://issues.apache.org/jira/browse/MINDEXER-18
>             Project: Maven Indexer (Moved to GitHub Issues)
>          Issue Type: Improvement
>    Affects Versions: 4.0.0
>            Reporter: Tamas Cservenak
>            Assignee: Tamas Cservenak
>            Priority: Major
>             Fix For: 4.1.0
>
>
> Indexer is OOM prone while indexing large ZIP files.
> Users reported that indexer tends to OOM while indexing huge (400MB+) WAR and 
> other ZIP packed files.
> This is most likely related to JVM NIO bug:
> http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6280693
> Doing ZIP bencharks, searching for alternative ZIP solutions
> https://github.com/cstamas/zip-benchmarks
> More details:
> https://issues.sonatype.org/browse/NEXUS-4100
> Solution: Indexer accesses ZIP files over newly introduced ZipFacade, not 
> directly using Java's ZipFile anymore. This facade "decides" what 
> implementation should be used. Benchmarking showed Java's ZipFile as the 
> fastest one, but is OOM prone.
> Next one by speed is TrueZip, but is slower since it's pure java.
> The facade on ZIP files bigger than 100MB will use TrueZip, and on smaller 
> Java's ZIP solution, the threshold is configurable. See NEXUS-4100 for more.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to