[
https://issues.apache.org/jira/browse/BLUR-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron McCurry closed BLUR-433.
------------------------------
Resolution: Fixed
https://git-wip-us.apache.org/repos/asf?p=incubator-blur.git;a=commit;h=90625d0235dd4d60a812be9fedfc12e0be1d817b
> Block Cache creating process fragmentation
> ------------------------------------------
>
> Key: BLUR-433
> URL: https://issues.apache.org/jira/browse/BLUR-433
> Project: Apache Blur
> Issue Type: Bug
> Components: Blur
> Affects Versions: 0.2.4
> Environment: Linux
> Reporter: Aaron McCurry
> Assignee: Aaron McCurry
> Priority: Blocker
> Fix For: 0.2.4
>
>
> During the life of a shard process if there is a lot of loading and unloading
> from the block cache due to tables coming and going as well as a lot of data
> updates fragmentation can occur in the process. The issue seems to be when
> the UnsafeCacheValue allocates many small chunks of memory and later releases
> them when the cache reuse queue over flows. The end result is that the shard
> process grows much larger than the off heap cache and heap combined. If the
> shard process is aggressively configured for the server it's on it can use
> too much memory and Linux will end up killing the process once the server is
> in jeopardy. This normally ends with a cascading failure of an entire shard
> cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)