[
https://issues.apache.org/jira/browse/ATLAS-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Mestry updated ATLAS-3762:
-----------------------------------
Description:
*Background*
One of the earlier commits replaced vertices and edges fetch with
_StreamSupport.stream_. This uses _Collect(toList),_ which causes all contents
to be fetched.
Using this causes large amount of data to be fetched.
*Solution*
Switch to iterators that will use lazy loading.
*Minor Refactoring*
Change the _getEdge_ to iterate on smaller dataset.
[~sidharthkmishra] Thanks for this simple but effective fix.
was:
*Background*
One of the earlier commits replaced vertices and edges fetch with
_StreamSupport.stream_. This uses _Collect(toList),_ which causes all contents
to be fetched.
Using this causes large amount of data to be fetched.
*Solution*
Switch to iterators that will use lazy loading.
*Minor Refactoring*
Change the _getEdge_ to iterate on smaller dataset.
> Entity Creation: Improve Vertices and Edges Fetch Using Genuine Iterators
> -------------------------------------------------------------------------
>
> Key: ATLAS-3762
> URL: https://issues.apache.org/jira/browse/ATLAS-3762
> Project: Atlas
> Issue Type: Improvement
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Attachments: ATLAS-3762-iterators-improvement.patch
>
>
> *Background*
> One of the earlier commits replaced vertices and edges fetch with
> _StreamSupport.stream_. This uses _Collect(toList),_ which causes all
> contents to be fetched.
> Using this causes large amount of data to be fetched.
> *Solution*
> Switch to iterators that will use lazy loading.
> *Minor Refactoring*
> Change the _getEdge_ to iterate on smaller dataset.
> [~sidharthkmishra] Thanks for this simple but effective fix.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
