Re: Upgrade ioitec ZkClient version

2019-06-27 Thread Hunter Lee
Upon discussion, the direction should actually be to move away from using IOItec's ZkClient due to the following reasons: 1. ZK version dependency 2. Helix's own ZKclient contains a lot of custom logic, different from ZkClient. We will proceed in this direction. Hunter On Thu, Jun 27, 2019 at 10

[GitHub] [helix] narendly opened a new issue #327: Change the way we trigger rebalance in purgeExpiredJobs

2019-06-27 Thread GitBox
narendly opened a new issue #327: Change the way we trigger rebalance in purgeExpiredJobs URL: https://github.com/apache/helix/issues/327 Currently, we use ResourceConfigs to trigger a rebalance. But this is causing Helix to write a ResourceConfig back to ZK, which is not desirable when a

Upgrade ioitec ZkClient version

2019-06-27 Thread Hunter Lee
This email is to suggest the version bump up of ZkClient library used by Helix. 1. We have noticed that sometimes ZK calls hang due to unknown reasons. This kind of issue seems to be commonly experienced by HBase users, but various fixes have been incorporated to ZK in versions 3.4+. The

[GitHub] [helix] narendly opened a new issue #326: Add getWorkflow(long timeout) in TaskDriver

2019-06-27 Thread GitBox
narendly opened a new issue #326: Add getWorkflow(long timeout) in TaskDriver URL: https://github.com/apache/helix/issues/326 Sometimes ZK hangs in the getWorkflow() call, and we could provide an API with a timeout to handle this at the application level. AC: 1. Add getWorkflow(lo