[
https://issues.apache.org/jira/browse/GOBBLIN-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Tiwari updated GOBBLIN-360:
------------------------------------
Fix Version/s: (was: 0.13.0)
> Helix not pruning old Zookeeper data
> ------------------------------------
>
> Key: GOBBLIN-360
> URL: https://issues.apache.org/jira/browse/GOBBLIN-360
> Project: Apache Gobblin
> Issue Type: Bug
> Reporter: Joel Baranick
> Assignee: Hung Tran
> Priority: Major
> Fix For: 0.12.0
>
>
> Helix version 0.6.7 is not correctly pruning old data in zookeeper at path
> {{/root/cluster/PROPERTYSTORE/TaskRebalancer}}. This causes the zookeeper
> cluster to keep using more disk and memory. At some point, the number of
> children in the folder exceeds the default zookeeper {{jute.maxbuffer}}
> setting and the contents of {{/root/cluster/PROPERTYSTORE/TaskRebalancer}}
> cannot be listed, deleted, etc. The only resolution at that point to reduce
> data is to add the {{-Djute.maxbuffer=9999999}} system parameter to all
> zookeeper servers and the zkCli application, restart the zookeeper processes,
> connect via zkCli, and cleanup the data. Once done, {{-Djute.maxbuffer}} can
> be removed from the zookeeper servers and the zkCli application. Then
> restart the zookeeper server processes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
