[
https://issues.apache.org/jira/browse/PHOENIX-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619591#comment-16619591
]
ASF GitHub Bot commented on PHOENIX-4903:
-----------------------------------------
Github user joshelser commented on the issue:
https://github.com/apache/phoenix/pull/350
Sorry, I forgot to include the text to automatically close this in the
commit message. Can you click the "close pull request" button please, @ortutay?
> HashCache recreated on client for every RegionServer it is sent to
> ------------------------------------------------------------------
>
> Key: PHOENIX-4903
> URL: https://issues.apache.org/jira/browse/PHOENIX-4903
> Project: Phoenix
> Issue Type: Improvement
> Reporter: Marcell Ortutay
> Assignee: Marcell Ortutay
> Priority: Major
> Fix For: 4.15.0, 5.1.0
>
>
> To distribute the hash cache to region servers, the master node makes an
> `AddServerCacheRequest` RPC to each region servers. If there are N region
> servers, it makes N of these RPC's. For each of the region servers, it
> generates a serialized RPC message and sends it out. This happens
> concurrently, and the result is that it uses O(N) memory on the master.
> As an example, if the `AddServerCacheRequest` RPC message is 100MB, and you
> have a cluster of 100 nodes, it would use 10GB memory on the master,
> potentially resulting in an "OutOfMemory" exception.
> It would be better if the master could use O(1) memory for the RPC.
> I observed this behavior in Phoenix 4.14.1
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
