Ashutosh Mestry created ATLAS-3396:
--------------------------------------
Summary: ZipSource: Usage of In-memory Maps Limits the Size of
Imports Performed
Key: ATLAS-3396
URL: https://issues.apache.org/jira/browse/ATLAS-3396
Project: Atlas
Issue Type: Bug
Reporter: Ashutosh Mestry
Assignee: Ashutosh Mestry
*Background*
_ZipSource_ is the container for working with Atlas-exported ZIP files. The
current implementation fetches the contents of the entire ZIP file in memory.
This greatly limits the size of ZIP files that can be imported.
*Solution Guidance*
New class _ZipSourceWIthBackingDirectory_, this will use a user-specified (or
default) temporary directory to preserve the contents of the ZIP file. This
will reduce the memory burden and large ZIP files can be imported.
Minor refactoring to _ImportService_ will be necessary to support the new
variation of _EntityImportStream._
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
