[
https://issues.apache.org/jira/browse/ATLAS-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934912#comment-16934912
]
ASF subversion and git services commented on ATLAS-3396:
--------------------------------------------------------
Commit 032d9eb96445997891669d010227f1e6fa38a8e0 in atlas's branch
refs/heads/branch-2.0 from Ashutosh Mestry
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=032d9eb ]
ATLAS-3396: ZipSourceWithBackingStore implementation. Empty ZIP unit test fix.
(cherry picked from commit e6b9e9ad25b3b0538c0f864ab534cd16e9dd91b9)
> ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed
> -----------------------------------------------------------------------
>
> Key: ATLAS-3396
> URL: https://issues.apache.org/jira/browse/ATLAS-3396
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Affects Versions: 0.8.4
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Fix For: 0.8.4, trunk
>
> Attachments:
> ATLAS-3396-ZipSource-Memory-usage-improvement-for-la-branch-0.8.patch,
> ATLAS-3396-ZipSourceWithBackingDirectory-Implementat-master.patch
>
>
> *Background*
> _ZipSource_ is the container for working with Atlas-exported ZIP files. The
> current implementation fetches the contents of the entire ZIP file in memory.
> This greatly limits the size of ZIP files that can be imported.
> *Solution Guidance*
> New class _ZipSourceWIthBackingDirectory_, this will use a user-specified (or
> default) temporary directory to preserve the contents of the ZIP file. This
> will reduce the memory burden and large ZIP files can be imported.
> Minor refactoring to _ImportService_ will be necessary to support the new
> variation of _EntityImportStream._
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
