Ming Ma created YARN-3935:

             Summary: Support compression for RM HA ApplicationStateData
                 Key: YARN-3935
                 URL: https://issues.apache.org/jira/browse/YARN-3935
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Ming Ma

If we use ZK as the RM HA, it is possible for some application state to exceed 
the max object size imposed by ZK service. We can apply compression before 
storing the data to ZK.

We might want to add the compression functionality at RMStateStore layer so 
that different store implementations can use it.

The design might also want to take care of compatibility issue. After 
compression is enabled and RM restarts; the older state store should still be 
loaded properly.

This message was sent by Atlassian JIRA

Reply via email to