Joel Baranick created GOBBLIN-360:
-------------------------------------
Summary: Helix not pruning old Zookeeper data
Key: GOBBLIN-360
URL: https://issues.apache.org/jira/browse/GOBBLIN-360
Project: Apache Gobblin
Issue Type: Bug
Reporter: Joel Baranick
Helix version 0.6.7 is not correctly pruning old data in zookeeper at path
{{/root/cluster/PROPERTYSTORE/TaskRebalancer}}. This causes the zookeeper
cluster to keep using more disk and memory. At some point, the number of
children in the folder exceeds the default zookeeper {{jute.maxbuffer}} setting
and the contents of {{/root/cluster/PROPERTYSTORE/TaskRebalancer}} cannot be
listed, deleted, etc. The only resolution at that point to reduce data is to
add the {{-Djute.maxbuffer=9999999}} system parameter to all zookeeper servers
and the zkCli application, restart the zookeeper processes, connect via zkCli,
and cleanup the data. Once done, {{-Djute.maxbuffer}} can be removed from the
zookeeper servers and the zkCli application. Then restart the zookeeper server
processes.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
