[
https://issues.apache.org/jira/browse/IGNITE-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553988#comment-16553988
]
ASF GitHub Bot commented on IGNITE-8892:
----------------------------------------
GitHub user AMashenkov opened a pull request:
https://github.com/apache/ignite/pull/4415
IGNITE-8892: Fix CacheQueryFuture usage.
CacheQueryFuture does not collect results anymore.
So, we have to iterate on future instead of using get().
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gridgain/apache-ignite ignite-8892
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/ignite/pull/4415.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4415
----
commit 40a6f217f4d864458c3fb3ef5b5720480e51d4a5
Author: Andrey V. Mashenkov <andrey.mashenkov@...>
Date: 2018-07-24T09:15:14Z
IGNITE-8892: Fix CacheQueryFuture usage.
CacheQueryFuture does not collect results anymore.
So, we have to iterate on future instead of using get().
----
> Iterating over large dataset via ScanQuery can fails with OOME.
> ---------------------------------------------------------------
>
> Key: IGNITE-8892
> URL: https://issues.apache.org/jira/browse/IGNITE-8892
> Project: Ignite
> Issue Type: Bug
> Components: cache
> Reporter: Andrew Mashenkov
> Assignee: Andrew Mashenkov
> Priority: Critical
> Labels: OutOfMemoryError
> Fix For: 2.7
>
> Attachments: ScanQueryOOM.java, list-8892.jfr, list-master.jfr
>
>
> Seems, iterating over query iterator (ScanQuery at least, but may be other
> affected as well) on client node cause memory leakage.
> The use case is quite simple.
> Start server and client. Put much data into cache, then iterate over all
> entries via ScanQuery.
> Looks like JVM crashed due to OOM as GridCacheDistributedQueryFuture.allCol
> map contains to many entries.
> I've put 15kk entries into cache and client failed with OOM after iterating
> over 10kk entry.
> In heapdump I observer 10kk GridCacheDistributedQueryFuture entries.
> We have to check if collection cleared correctly and it is really need to
> collect all entries.
> PFA repro.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
