Re: [VOTE] Apache Helix 0.8.2 Release

2018-07-28 Thread Hunter Lee
+1 On Wed, Jul 25, 2018 at 4:46 PM, Wang Jiajun wrote: > Hi, > > This is to call for a vote on releasing the following candidate as Apache > Helix 0.8.2. This is the 14th release of Helix as an Apache project, as > well as the 10th release as a top-level Apache project. > > Apache Helix is a

Re: Warn messages in controller log

2018-11-27 Thread Hunter Lee
Hi Dlmuthu, Could you give us a bit more context? What kind of operations are you doing and what are the characteristics (config settings) for these workflows? On a cursory look, it seems that the workflow

Re: [VOTE] Apache Helix 0.8.3 Release

2018-11-26 Thread Hunter Lee
+1 On Mon, Nov 26, 2018 at 6:09 PM Lei Xia wrote: > +1 > > On Mon, Nov 26, 2018 at 5:48 PM Xue Junkai wrote: > > > Hi, > > > > > > This is to call for a vote on releasing the following candidate as Apache > > Helix 0.8.3. This is the 15th release of Helix as an Apache project, as > > well as

Re: Proposal: Moving Helix to Java 1.8 and upgrading Maven version

2019-03-27 Thread Hunter Lee
26, 2019 at 12:57 PM Wang Jiajun wrote: > +1 > > Best Regards, > Jiajun > > > On Mon, Mar 25, 2019 at 1:43 PM Lei Xia wrote: > > > +1 > > > > On Sun, Mar 24, 2019 at 10:56 PM Hunter Lee wrote: > > > > > I would like to st

Re: Sporadic delays in task execution

2019-03-22 Thread Hunter Lee
Let me add a caveat to my previous email. Although it comes with scalability improvements, there are currently a few known issues with the latest version. We'd encourage you to check back to make sure your current usage isn't affected. Hunter On Fri, Mar 22, 2019 at 12:35 PM Hunter Lee wrote

Proposal: Moving Helix to Java 1.8 and upgrading Maven version

2019-03-24 Thread Hunter Lee
I would like to start a discussion on making Java 8 a minimum requirement and upgrading the Maven version for Helix's next feature release. I'd like to see how people feel about it. Did some homework on this and dug up a few precedences that are also top-level Apache projects dependent on

Re: Scaling participants to improve throughput of task execution

2019-04-05 Thread Hunter Lee
Hi Dimuthu - 1. In Task Framework, tasks are units of work that are mutually independent - that is, Helix will schedule A and B without considering any dependency. By what you said about how task A depends on B, what did you actually mean? Is Task A blocking (sleeping) until some condition is met

Re: [ANNOUNCE] New Committer: Hunter Lee

2019-03-28 Thread Hunter Lee
Thanks everyone! Excited to be part of the group :) On Thu, Mar 28, 2019 at 7:31 PM Lei Xia wrote: > Welcome, Hunter! > > On Thu, Mar 28, 2019 at 5:54 PM Xue Junkai wrote: > > > Hi, All > > > > > > The Project Management Committee (PMC) for Apache Helix

Re: [VOTE] Apache Helix 0.8.4 Release

2019-02-28 Thread Hunter Lee
+1 On Thu, Feb 28, 2019 at 1:49 PM Wang Jiajun wrote: > +1 > > Best Regards, > Jiajun > > > On Wed, Feb 27, 2019 at 3:26 PM Lei Xia wrote: > > > +1 > > > > On Wed, Feb 27, 2019 at 2:07 PM Xue Junkai wrote: > > > > > Hi, > > > > > > > > > This is to call for a vote on releasing the following

Re: Apache Helix 0.8.3 (Major Release) - please read

2019-02-22 Thread Hunter Lee
It has come to our attention that there was a bug in Task Framework in 0.8.3. In short, Task Framework fails to honor instance tag constraints when assigning tasks. This is critical and may break other services built on Helix. In order to fix forward, I'd like to solicit advice on how to

Re: Sporadic delays in task execution

2019-03-22 Thread Hunter Lee
> > On Thu, Mar 21, 2019 at 5:27 PM Hunter Lee wrote: > > > Hi Dimuthu, > > > > What Junkai meant by touching the IdealState is this: > > > > 1) use Zooinspector to log into ZK > > 2) Locate the IDEALSTATES/ path > > 3) grab any ZNode under that pa

For PMC - enabling GitHub issues and wiki

2019-05-26 Thread Hunter Lee
Could a member of the PMC update the ticket for GitHub issues and wiki? This was discussed informally offline, so please mention that we do not have the record of it, but as long as the PMC could verify that we want this for Helix, the infra team should be able to go ahead and do it for us.

Re: Zookeeper connection errors in Helix Controller

2019-05-31 Thread Hunter Lee
Hey Dimuthu - We are actually in the process of preparing a new release, and this will come with the previously mentioned bug fixes in Task Framework. It also contains various ZK-related fixes - I don't know what your deployment schedule is but it might be worth the wait of another week or so.

[RESULT][VOTE] Apache Helix 0.9.0 Release

2019-06-14 Thread Hunter Lee
Thanks for voting on the 0.9.0 release. It has now exceeded 72 hours so I am closing the vote. Binding +1s: Kishore G. Lei Xia Junkai Xue Nonbinding +1s: Jiajun Wang Binding 0s: - Nonbinding 0s: - Binding -1s: - Nonbinding -1s: - The vote has passed, thanks a lot to everyone for voting!

Re: Multiple instance group tags for Job config

2019-06-24 Thread Hunter Lee
https://github.com/apache/helix/issues/323 On Mon, Jun 24, 2019 at 10:09 AM Hunter Lee wrote: > Hi all - > > Moving forward, let's use GitHub Issues over JIRA. It is closer to the > code itself and arguably easier to link to and work with the code. I have > created an issue ba

Re: Multiple instance group tags for Job config

2019-06-24 Thread Hunter Lee
Hi all - Moving forward, let's use GitHub Issues over JIRA. It is closer to the code itself and arguably easier to link to and work with the code. I have created an issue based on the JIRA Dimuthu provided for the time being. Hunter On Mon, Jun 24, 2019 at 8:56 AM DImuthu Upeksha wrote: > Hi

[VOTE] Apache Helix 0.9.0 Release

2019-06-11 Thread Hunter Lee
Hi, This is to call for a vote on releasing the following candidate as Apache Helix 0.9.0. This is the 17th release of Helix as an Apache project, as well as the 13th release as a top-level Apache project. Apache Helix is a generic cluster management framework that makes it easy to build

Enabling issues and wiki on Apache GitHub

2019-05-23 Thread Hunter Lee
Hi Apache infra - We would like to enable the issues feature and the wiki feature GitHub provides on Apache Helix's GitHub. How should we go about this? Thanks in advance! Hunter

Syncing from GitHub issues to Apache JIRA

2019-05-23 Thread Hunter Lee
Hi Apache Infra - I'm wondering if there is a way to sync the GitHub issues created with our corresponding Apache JIRA board. As in, if we create an issue/PR in GitHub, is there a tool/support available that creates a JIRA ticket as well? Or when Apache measures a project's activity, is there a

Re: Enabling issues and wiki on Apache GitHub

2019-05-23 Thread Hunter Lee
Created: https://issues.apache.org/jira/browse/INFRA-18471 Thanks! Hunter On Thu, May 23, 2019 at 4:49 PM Chris Lambertus wrote: > > > > > On May 23, 2019, at 4:46 PM, Hunter Lee wrote: > > > > Hi Apache infra - > > > > We would like to enable the iss

Re: Upgrade ioitec ZkClient version

2019-06-27 Thread Hunter Lee
at 10:28 AM Hunter Lee wrote: > This email is to suggest the version bump up of ZkClient library used by > Helix. > >1. We have noticed that sometimes ZK calls hang due to unknown >reasons. This kind of issue seems to be commonly experienced by HBase >users, but vario

Upgrade ioitec ZkClient version

2019-06-27 Thread Hunter Lee
This email is to suggest the version bump up of ZkClient library used by Helix. 1. We have noticed that sometimes ZK calls hang due to unknown reasons. This kind of issue seems to be commonly experienced by HBase users, but various fixes have been incorporated to ZK in versions 3.4+. The

Re: How to do Helix hot release?

2019-07-29 Thread Hunter Lee
This might be a question for Apache Infra. Let me also write a quick email and include the Helix dev mailing list. Hunter On Mon, Jul 29, 2019 at 4:20 PM Wang Jiajun wrote: > Hi Helix devs, > > I'm sending this mail for discussing Helix hot release. This is requested > by our customer Pinot

Re: [VOTE] Apache Helix 0.9.1 Release

2019-08-14 Thread Hunter Lee
+1 On Wed, Aug 14, 2019 at 2:07 PM Wang Jiajun wrote: > Hi, > > This is to call for a vote on releasing the following candidate as Apache > Helix 0.9.1. This is the 18th release of Helix as an Apache project, as > well as the 14th release as a top-level Apache project. > > Apache Helix is a

Re: Task is running periodically

2019-11-25 Thread Hunter Lee
Hi Dimuthu, Are you using periodicalRebalance? That might trigger a rebalance periodically even if there's no activity in the cluster. As for the ConcurrentModification exception, I believe there was a patch for that going from 0.8.2 to the latest on the upstream. Hunter On Mon, Nov 25, 2019

Re: [VOTE] Apache Helix 0.9.4 Release

2020-01-22 Thread Hunter Lee
It is up now. Hunter On Wed, Jan 22, 2020 at 8:48 AM Lei Xia wrote: > Thanks Hunter, the release notes link seems not work? > > > Lei > > On Tue, Jan 21, 2020 at 11:40 PM Hunter Lee wrote: > > > Hi, > > > > This is to call for a vote on releasing the

[ANNOUNCE] Apache Helix 0.9.4 Release

2020-01-27 Thread Hunter Lee
The Apache Helix Team is pleased to announce the 19th release, 0.9.4, of the Apache Helix project. Apache Helix is a generic cluster management framework that makes it easy to build partitioned, fault tolerant, and scalable distributed systems. The full release notes are available here:

Subject: [RESULT][VOTE] Apache Helix 0.9.4 Release

2020-01-27 Thread Hunter Lee
Thanks for voting on the 0.9.4 release. It has now exceeded 72 hours so I am closing the vote. Binding +1s: Lei Xia Junkai Xue Kishore G Nonbinding +1s: Binding 0s: Nonbinding 0s: Binding -1s: Nonbinding -1s: The vote has passed, thanks a lot to everyone for voting!

Review and try out new modules (helix-common and zookeeper-api)

2020-01-29 Thread Hunter Lee
Hi Helix users and devs- I sent out an email describing the separation of ZkClient into a separate module a few weeks ago and would like to follow up. I am currently getting https://github.com/apache/helix/pull/684 reviewed. Here is the changelist: 1. Remove IOItec import 2. Create helix-common

Re: Review and try out new modules (helix-common and zookeeper-api)

2020-02-05 Thread Hunter Lee
Since I haven't heard back from anyone for some time, I'll go ahead with the merge/review. Migration guide has been updated and published in the GitHub wiki. Hunter On Wed, Jan 29, 2020 at 7:30 PM Hunter Lee wrote: > Hi Helix users and devs- > > I sent out an email describing the s

Re: [VOTE] Apache Helix 0.9.300 Release

2020-01-21 Thread Hunter Lee
I am stopping the vote for 0.9.300 and re-creating 0.9.4. Hunter On Tue, Jan 21, 2020 at 4:58 PM Hunter Lee wrote: > Correction: > > Release notes: > https://helix.apache.org/0.9.300-docs/releasenotes/release-0.9.300.html > > This page will be updated shortly. All other links

Re: [VOTE] Apache Helix 0.9.300 Release

2020-01-21 Thread Hunter Lee
Correction: Release notes: https://helix.apache.org/0.9.300-docs/releasenotes/release-0.9.300.html This page will be updated shortly. All other links have already been made available. Hunter On Tue, Jan 21, 2020 at 4:57 PM Hunter Lee wrote: > Hi, > > This is to call for a vote on

[VOTE] Apache Helix 0.9.4 Release

2020-01-21 Thread Hunter Lee
Hi, This is to call for a vote on releasing the following candidate as Apache Helix 0.9.4. This is the 19th release of Helix as an Apache project, as well as the 15th release as a top-level Apache project. Apache Helix is a generic cluster management framework that makes it easy to build

Re: [VOTE] Apache Helix 0.9.5 Release

2020-05-11 Thread Hunter Lee
+1 On Mon, May 11, 2020 at 12:00 PM Xue Junkai wrote: > Hi, > > > This is to call for a vote on releasing the following candidate as Apache > Helix 0.9.5. This is the 22nd release of Helix as an Apache project, as > well as the 18th release as a top-level Apache project. This release is >

Re: [jira] [Created] (HELIX-823) run-helix-controller.sh command gives error

2020-05-20 Thread Hunter Lee
Hi, We are tracking this issue. This was caused by an issue in the auto-merge process. We'll be creating a fix shortly. Hunter On Wed, May 20, 2020 at 5:04 AM anil (Jira) wrote: > anil created HELIX-823: > -- > > Summary: run-helix-controller.sh command

Re: [VOTE] Apache Helix 0.9.8 Release

2020-10-14 Thread Hunter Lee
+1. Thanks for putting this together! On Wed, Oct 14, 2020 at 6:25 PM Wang Jiajun wrote: > Hi, > > This is to call for a vote on releasing the following candidate as Apache > Helix 0.9.8. This is the 23rd release of Helix as an Apache project, as > well as the 19th release as a top-level Apache

Re: Workflow task retry intervals

2020-08-19 Thread Hunter Lee
There is a field you could set. You could look in JobConfig to see which enum value you could set for task retries. It allows you to set two types of delays - 1. before starting a task, and 2. delay between retries. These are static values and we don't support exponential backoff yet. Hunter On

Re: [VOTE] Apache Helix 0.9.9 Release

2020-11-21 Thread Hunter Lee
+1 On Sat, Nov 21, 2020 at 7:43 AM Lei Xia wrote: > +1 > > On Fri, Nov 20, 2020 at 8:04 PM Xue Junkai wrote: > > > Hi, > > > > This is to call for a vote on releasing the following candidate as Apache > > Helix 0.9.9. This is the 24th release of Helix as an Apache project, as > > well as the

Re: [VOTE] Apache Helix 1.0.2 Release

2021-06-08 Thread Hunter Lee
+1 On Tue, Jun 8, 2021 at 1:10 PM Junkai Xue wrote: > Hi, > > > This is to call for a vote on releasing the following candidate as Apache > Helix 1.0.2. This is the 22nd release of Helix as an Apache project, as > well as the 18th release as a top-level Apache project. > > > Apache Helix is a

Re: [VOTE] Apache Helix 1.0.2 Release

2021-08-19 Thread Hunter Lee
+1 On Thu, Aug 19, 2021 at 2:34 PM Junkai Xue wrote: > Hi, > > > This is to call for a vote on releasing the following candidate as Apache > Helix 1.0.2. This is the 22nd release of Helix as an Apache project, as > well as the 18th release as a top-level Apache project. > > > Apache Helix is a

Re: Log4J

2021-12-16 Thread Hunter Lee
f that's just my laptop or if it's a legitimate problem > > introduced by this change, so any independent verification (maybe the PR > > hooks already do this) would be greatly appreciated. I'm going to try to > > test this in one of our dev environments, but would it would be

Re: Log4J

2021-12-15 Thread Hunter Lee
sure things don't break I > > suspect. > > > > ~Brent > > > > On Mon, Dec 13, 2021 at 1:42 PM Hunter Lee wrote: > > > >> This is being discussed. Feel free to post a patch if you're interested > >> (but do let us know so there's no duplicate eff

Re: Log4J

2021-12-13 Thread Hunter Lee
This is being discussed. Feel free to post a patch if you're interested (but do let us know so there's no duplicate effort being made here). On Fri, Dec 10, 2021 at 1:33 PM Brent wrote: > [Feel free to take this offline or out-of-band if this is an inappropriate > place to discuss this] > > Is

Re: [VOTE] Apache Helix 0.9.10 Release

2022-04-05 Thread Hunter Lee
+1 On Tue, Apr 5, 2022 at 1:10 PM Junkai Xue wrote: > Hi, > > We would like to do a retrospective vote for Apache Helix 0.9.10 since > 0.9.10 was a replacement of 0.9.9, which did not reflect the latest change > when it was released. > > Content wise, there is no change on release note for

Re: [VOTE] Apache Helix 1.0.3 Release

2022-04-18 Thread Hunter Lee
+1 On Mon, Apr 18, 2022 at 6:26 PM Junkai Xue wrote: > Hi, > > This is to call for a vote on releasing the following candidate as > Apache Helix 1.0.3. This is the 24th release of Helix as an Apache > project, as well as the 20th release as a top-level Apache project. > > Apache Helix is a

Re: [VOTE] Apache Helix 1.0.4 Release

2022-05-12 Thread Hunter Lee
+1 On Thu, May 12, 2022 at 1:34 AM Junkai Xue wrote: > Hi, > > This is to call for a vote on releasing the following candidate as > Apache Helix 1.0.4. This is the 25th release of Helix as an Apache > project, as well as the 21st release as a top-level Apache project. > > Apache Helix is a