Marcell Ortutay created PHOENIX-4903: ----------------------------------------
Summary: Hash cache RPC uses O(N) memory on master Key: PHOENIX-4903 URL: https://issues.apache.org/jira/browse/PHOENIX-4903 Project: Phoenix Issue Type: Improvement Reporter: Marcell Ortutay To distribute the hash cache to region servers, the master node makes an `AddServerCacheRequest` RPC to each region servers. If there are N region servers, it makes N of these RPC's. For each of the region servers, it generates a serialized RPC message and sends it out. This happens concurrently, and the result is that it uses O(N) memory on the master. As an example, if the `AddServerCacheRequest` RPC message is 100MB, and you have a cluster of 100 nodes, it would use 10GB memory on the master, potentially resulting in an "OutOfMemory" exception. It would be better if the master could use O(1) memory for the RPC. I observed this behavior in Phoenix 4.14.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)