[GitHub] helix pull request: [HELIX-525] Add integration tests to verify th...

2014-10-21 Thread lei-xia
Github user lei-xia commented on the pull request: https://github.com/apache/helix/pull/7#issuecomment-60014784 It is actually not necessary, thanks for pointing out. I updated it, also use TestNG dataprovider to supply RebalanceMode to avoid write one test method for each mode. I

[GitHub] helix pull request: [HELIX-584] SimpleDateFormat should not be use...

2015-03-20 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/20 [HELIX-584] SimpleDateFormat should not be used as singleton due to its race conditions You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia

[GitHub] helix pull request: [HELIX-578] NPE while deleting a job from a re...

2015-03-19 Thread lei-xia
Github user lei-xia closed the pull request at: https://github.com/apache/helix/pull/18 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

RE: Cutting a release 0.6.5 tonight

2015-03-11 Thread Lei Xia
Hi, Kishore I saw there are regression test failures from last two recent commits on 0.6.x branch, running from both local box and Linkedin's hudson jobs. Are we going to fix them before the release? Thanks Lei -- Lei Xia Software Engineer Data Infrastructure/Distributed Data Systems

[GitHub] helix pull request: Support deleting job from a job queue. The que...

2015-03-05 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/17 Support deleting job from a job queue. The queue has to be stopped before deleting jobs You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia

[GitHub] helix pull request: [HELIX-578] NPE while deleting a job from a re...

2015-03-18 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/18 [HELIX-578] NPE while deleting a job from a recurrent job queue. This is to fix the deletion job operation when trying to delete a job from a recurrent job queue. New unit test added. mvn

[GitHub] helix pull request: [HELIX-584] SimpleDateFormat should not be use...

2015-04-26 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/24 [HELIX-584] SimpleDateFormat should not be used as singleton due to its race conditions [HELIX-584] SimpleDateFormat should not be used as singleton due to its race conditions. You can merge

[GitHub] helix pull request: [HELIX-592] addCluster should respect overwrit...

2015-05-11 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/27 [HELIX-592] addCluster should respect overwriteExisitng when adding stateModel Definations. Congrui Ji has sent this fix before, and got some comments. But he is on vacation, and we (LinkedIn) do

[GitHub] helix pull request: [HELIX-592] addCluster should respect overwrit...

2015-05-12 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/27#discussion_r30178394 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixAdmin.java --- @@ -715,14 +715,26 @@ public ExternalView getResourceExternalView(String

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-06-22 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/31 [HELIX-599] Support creating/maintaining/routing resources with same names in different instance groups. More details on the problems and our proposed solution is on the jira description: https

[GitHub] helix pull request: [Helix-606] Add an option in IdealState to all...

2015-07-28 Thread lei-xia
Github user lei-xia commented on the pull request: https://github.com/apache/helix/pull/32#issuecomment-125834788 Merged with head and solved the conflicts. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

Questions on Helix branches

2015-07-27 Thread Lei Xia
) Are you going to keep developing new features and fix bugs on both branches, or only on 0.7 branch? Thanks, your suggestions will be appreciated! Best Lei -- *Lei Xia *Software Engineer Distributed Data Systems LinkedIn

[GitHub] helix pull request: [HELIX-613] Fix thread leaking problems in Tas...

2015-11-08 Thread lei-xia
Github user lei-xia commented on the pull request: https://github.com/apache/helix/pull/38#issuecomment-154924074 It is little bit tricky to add unit test to verify there is no leaking, also it takes some time to generate and detect leaking, which makes the unit tests takes even

[GitHub] helix pull request: [HELIX-613] Fix thread leaking problems in Tas...

2015-11-07 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/38 [HELIX-613] Fix thread leaking problems in TaskStateModel. Current TaskStateModel creates a thread-pool containing 40 threads for each instance of TaskStateModel, thus it creates 40 threads for each

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328333 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java --- @@ -73,6 +75,73 @@ public RoutingTableProvider

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328391 --- Diff: helix-core/src/main/java/org/apache/helix/model/ExternalView.java --- @@ -95,6 +105,32 @@ public String getResourceName() { return

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328348 --- Diff: helix-core/src/main/java/org/apache/helix/model/IdealState.java --- @@ -536,4 +574,16 @@ public boolean isEnabled() { public void enable

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328613 --- Diff: helix-core/src/test/java/org/apache/helix/integration/TestResourceGroupEndtoEnd.java --- @@ -0,0 +1,465 @@ +package org.apache.helix.integration

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328491 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java --- @@ -91,6 +160,52 @@ public RoutingTableProvider

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328471 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java --- @@ -73,6 +75,73 @@ public RoutingTableProvider

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328709 --- Diff: helix-core/src/main/java/org/apache/helix/tools/ClusterSetup.java --- @@ -363,6 +373,43 @@ public void addResourceToCluster(String clusterName

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328187 --- Diff: helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationPhase.java --- @@ -127,7 +127,9 @@ public void process(ClusterEvent

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328288 --- Diff: helix-core/src/main/java/org/apache/helix/model/IdealState.java --- @@ -55,7 +55,9 @@ MAX_PARTITIONS_PER_INSTANCE

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328375 --- Diff: helix-core/src/main/java/org/apache/helix/controller/stages/ResourceComputationStage.java --- @@ -62,6 +62,10 @@ public void process(ClusterEvent

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328534 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java --- @@ -91,6 +160,52 @@ public RoutingTableProvider

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328553 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java --- @@ -235,8 +376,94 @@ PartitionInfo get(String stateUnitKey

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r34328538 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java --- @@ -235,8 +376,94 @@ PartitionInfo get(String stateUnitKey

[GitHub] helix pull request: [HELIX-617] Job IdealState is generated even t...

2015-12-09 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/40 [HELIX-617] Job IdealState is generated even the job is not running and not removed when it is completed – Problem: In current task framework implementation, one IdealState and one

[GitHub] helix pull request: [HELIX-614] Fix the bug when job expiry time i...

2015-11-20 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/39 [HELIX-614] Fix the bug when job expiry time is shorter than job schedule interval in recurring job queue. When job expiry time is shorter than job schedule interval in recurring job queue

Re: reuse replicas after a failed participant reconnects

2016-06-06 Thread Lei Xia
t; input is highly appreciated. > > > -neutron > -- *Lei Xia *Senior Software Engineer Distributed Data Systems/Nuage & Helix LinkedIn l...@linkedin.com www.linkedin.com/in/lxia1

[GitHub] helix issue #45: Fixing an NPE when there is a session mismatch in HelixTask...

2016-06-16 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/45 Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] helix pull request: A few more task framework improvement

2016-01-11 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/41 A few more task framework improvement This pull request includes four diffs (with each described as below): 1. [HELIX-622] Add new resource configuration option to allow resource to disable

[GitHub] helix pull request: A few more task framework improvement

2016-02-10 Thread lei-xia
Github user lei-xia commented on the pull request: https://github.com/apache/helix/pull/41#issuecomment-182658641 Thanks for reviewing! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] helix pull request: A few more task framework improvement

2016-02-10 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/41#discussion_r52551298 --- Diff: helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java.rej --- @@ -0,0 +1,18 @@ +diff a/helix-core/src

[GitHub] helix pull request: A few more task framework improvement

2016-02-09 Thread lei-xia
Github user lei-xia commented on the pull request: https://github.com/apache/helix/pull/41#issuecomment-182151763 Ping for reviewing! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] helix pull request #46: All task framework changes

2016-08-16 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/46 All task framework changes This change contains all pending commits we have already committed and running within LinkedIn internally. You can merge this pull request into a Git repository

[GitHub] helix issue #68: Added new DataSource values LIVEINSTANCES and INSTANCES and...

2017-02-08 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/68 Could you please rebase to the latest HEAD? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

Re: [ANNOUNCE] Apache Helix 0.6.7 Release

2017-02-05 Thread Lei Xia
wrote: > Hi Lei, > > I don't see this jar in the maven repo.https://mvnrepository. > com/artifact/org.apache.helix/helix-core > > Can you please verify? > > On Thu, Jan 26, 2017 at 10:10 PM, Lei Xia <xiax...@gmail.com> wrote: > >> The Apache Helix Team i

Re: [VOTE] Apache Helix 0.6.7 Release

2017-01-26 Thread Lei Xia
__ > > From: kishore g <g.kish...@gmail.com> > > Sent: Sunday, January 22, 2017 7:03 PM > > To: dev@helix.apache.org > > Subject: Re: [VOTE] Apache Helix 0.6.7 Release > > > > +1 > > > > On Jan 22, 2017 6:30 PM, "Olivier Lamy&qu

[ANNOUNCE] Apache Helix 0.6.7 Release

2017-01-26 Thread Lei Xia
The Apache Helix Team is pleased to announce the 10th release, 0.6.7, of the Apache Helix project. Apache Helix is a generic cluster management framework that makes it easy to build partitioned, fault tolerant, and scalable distributed systems. The full release notes are available here:

[GitHub] helix issue #64: Delay the job scheduling when check job ready to schedule

2017-01-26 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/64 Can you rebase to the head of the branch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] helix pull request #71: [HELIX-653] Fix enable/disable partition in instance...

2017-02-09 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/71#discussion_r100397892 --- Diff: helix-core/src/main/java/org/apache/helix/util/HelixUtil.java --- @@ -68,6 +71,17 @@ public static String getZkName(String path) { return

[GitHub] helix issue #69: Import EvaluateCriteria change from master branch

2017-02-09 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/69 There is conflict, please rebase to the HEAD, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] helix pull request #47: Support user defined content store per workflow/job ...

2016-08-23 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r75894819 --- Diff: helix-core/src/main/java/org/apache/helix/task/UserContentStore.java --- @@ -0,0 +1,97 @@ +package org.apache.helix.task

[GitHub] helix pull request #47: Support user defined content store per workflow/job ...

2016-08-23 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r75894867 --- Diff: helix-core/src/main/java/org/apache/helix/task/UserContentStore.java --- @@ -0,0 +1,97 @@ +package org.apache.helix.task

[GitHub] helix pull request #47: Support user defined content store per workflow/job ...

2016-08-23 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r75894524 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +221,85 @@ protected static void setWorkflowContext(HelixManager manager

[GitHub] helix pull request #47: Support user defined content store per workflow/job ...

2016-08-23 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r75894351 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +221,85 @@ protected static void setWorkflowContext(HelixManager manager

[GitHub] helix pull request #47: Support user defined content store per workflow/job ...

2016-08-23 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r75893024 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +221,85 @@ protected static void setWorkflowContext(HelixManager manager

Re: A possible leak of ZkClient object in helix?

2016-09-06 Thread Lei Xia
/10/21 17:25:20.343 INFO [ClientCnxn] > > [main-SendThread(localhost:2181)] > > > [pinot-controller] [] Unable to read additional data from server > > sessionid > > > 0x1508cecdce10001, likely server has closed socket, closing socket > > > connection and attempting reconnect > > > 2015/10/21 17:25:20.443 INFO [ZkClient] [main-EventThread] > > > [pinot-controller] [] zookeeper state changed (Disconnected) > > > 2015/10/21 17:25:20.534 INFO [ClientCnxn] > > [main-SendThread(localhost:2181)] > > > [pinot-controller] [] Opening socket connection to server localhost/ > > > 127.0.0.1:2181 > > > 2015/10/21 17:25:20.535 INFO [ClientCnxn] > > [main-SendThread(localhost:2181)] > > > [pinot-controller] [] Socket connection established to localhost/ > > > 127.0.0.1:2181, initiating session > > > 2015/10/21 17:25:20.536 INFO [ClientCnxn] > > [main-SendThread(localhost:2181)] > > > [pinot-controller] [] Session establishment complete on server > localhost/ > > > 127.0.0.1:2181, sessionid = 0x1508cecdce10001, negotiated timeout = > > 3 > > > 2015/10/21 17:25:20.537 INFO [ZkClient] [main-EventThread] > > > [pinot-controller] [] zookeeper state changed (SyncConnected) > > > 2015/10/21 17:25:20.537 INFO [ClientCnxn] > > [main-SendThread(localhost:2181)] > > > [pinot-controller] [] Unable to read additional data from server > > sessionid > > > 0x1508cecdce10001, likely server has closed socket, closing socket > > > connection and attempting reconnect > > > 2015/10/21 17:25:20.637 INFO [ZkClient] [main-EventThread] > > > [pinot-controller] [] zookeeper state changed (Disconnected) > > > > > > > > > And so on. > > > > > > So, it does look like Helix is trying to shut down, and prints the > > > START:INVOKE, but it never prints the END:INVOKE for the same listener. > > > > > > Any ideas? > > > > > > -Subbu > > > > > > -- *Lei Xia *Senior Software Engineer Data Infra/Nuage & Helix LinkedIn l...@linkedin.com www.linkedin.com/in/lxia1

[GitHub] helix pull request #47: Support user defined content store per workflow/job/...

2016-08-31 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r77031881 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +222,103 @@ protected static void setWorkflowContext(HelixManager manager

[GitHub] helix pull request #47: Support user defined content store per workflow/job/...

2016-08-31 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r77031851 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +222,103 @@ protected static void setWorkflowContext(HelixManager manager

Re: A possible leak of ZkClient object in helix?

2016-09-08 Thread Lei Xia
er >> > > localhost/0:0:0:0:0:0:0:1:2181 >> > > 2015/10/21 17:25:20.341 INFO [ClientCnxn] >> > [main-SendThread(localhost:2181)] >> > > [pinot-controller] [] Socket connection established to >> > > localhost/0:0:0:0:0:0:0:1:2181, initiating

[GitHub] helix issue #49: New topology-aware auto rebalance strategy and some fixes t...

2016-09-12 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/49 Hi, Kishore. I am working on a wiki/doc to introduce new topology aware rebalance strategy with some of experimental results showing stats of distribution of partitions and movements during

[GitHub] helix pull request #52: [HELIX-631] AutoRebalanceStrategy does not work corr...

2016-09-15 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/52 [HELIX-631] AutoRebalanceStrategy does not work correctly all the time. What happened here is: Helix always assigns a random node for a new (unassigned) replica (logic in assignOrphans

[GitHub] helix pull request #51: [HELIX-635] GenericTaskAssignmentCalculator does not...

2016-09-19 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/51#discussion_r79500824 --- Diff: helix-core/src/main/java/org/apache/helix/task/JobConfig.java --- @@ -218,10 +211,6 @@ public int getMaxAttemptsPerTask() { return

[GitHub] helix pull request #51: [HELIX-635] GenericTaskAssignmentCalculator does not...

2016-09-19 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/51#discussion_r79500989 --- Diff: helix-core/src/main/java/org/apache/helix/task/JobConfig.java --- @@ -449,11 +446,6 @@ public Builder setMaxAttemptsPerTask(int v) { return

[GitHub] helix pull request #51: [HELIX-635] GenericTaskAssignmentCalculator does not...

2016-09-19 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/51#discussion_r79501230 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskConfig.java --- @@ -184,10 +186,12 @@ public Builder setTargetPartition(String targetPartition

[GitHub] helix pull request #49: New topology-aware auto rebalance strategy and some ...

2016-08-28 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/49 New topology-aware auto rebalance strategy and some minor fixes to the old AutoRebalanceStrategy This commit mainly contains a new topology-aware auto rebalance strategy based on CRUSH algorithm

[GitHub] helix pull request #47: Support user defined content store per workflow/job/...

2016-08-28 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r76550156 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +221,93 @@ protected static void setWorkflowContext(HelixManager manager

[GitHub] helix pull request #47: Support user defined content store per workflow/job/...

2016-08-24 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r76099094 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +221,93 @@ protected static void setWorkflowContext(HelixManager manager

[GitHub] helix pull request #47: Support user defined content store per workflow/job/...

2016-08-24 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r76099693 --- Diff: helix-core/src/main/java/org/apache/helix/task/WorkflowRebalancer.java --- @@ -120,6 +120,7 @@ public ResourceAssignment

[GitHub] helix pull request #47: Support user defined content store per workflow/job/...

2016-08-24 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r76099580 --- Diff: helix-core/src/main/java/org/apache/helix/task/JobRebalancer.java --- @@ -154,6 +154,7 @@ public ResourceAssignment

[GitHub] helix pull request #47: Support user defined content store per workflow/job/...

2016-08-24 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/47#discussion_r76098588 --- Diff: helix-core/src/main/java/org/apache/helix/task/TaskUtil.java --- @@ -220,6 +221,93 @@ protected static void setWorkflowContext(HelixManager manager

[GitHub] helix pull request #52: [HELIX-631] AutoRebalanceStrategy does not work corr...

2016-09-28 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/52#discussion_r81051316 --- Diff: helix-core/src/main/java/org/apache/helix/controller/rebalancer/strategy/AutoRebalanceStrategy.java --- @@ -177,15 +176,26 @@ private void

Generate Helix release 0.6.6

2016-09-28 Thread Lei Xia
Hi, Helix Developers I am going to work on releasing Helix 0.6.6 this week. Please let me know if you have any questions, comments and concerns. Thanks Best Lei

Re: Generate Helix release 0.6.6

2016-10-25 Thread Lei Xia
6 at 2:53 PM, kishore g <g.kish...@gmail.com> wrote: > Thanks Lei. Let us know when you have the release. We can test it. > > On Wed, Sep 28, 2016 at 6:43 PM, Lei Xia <l...@apache.org> wrote: > > > Hi, Helix Developers > > > >I am going to work on

Re: Generate Helix release 0.6.6

2016-10-25 Thread Lei Xia
Sent a wrong link, here is the staged binaries and src: https://dist.apache.org/repos/dist/dev/helix/0.6.6/. Lei On Tue, Oct 25, 2016 at 2:35 PM, kishore g <g.kish...@gmail.com> wrote: > Thanks Lei. I will test it tonight. > > On Tue, Oct 25, 2016 at 2:07 PM, Lei Xia <xiax..

[GitHub] helix pull request #55: [HELIX-636] Add Java API and REST API for clean up J...

2016-10-27 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/55#discussion_r85446689 --- Diff: helix-core/src/main/java/org/apache/helix/task/WorkflowRebalancer.java --- @@ -430,7 +430,7 @@ private void cleanupWorkflow(String workflow

[GitHub] helix pull request #55: [HELIX-636] Add Java API and REST API for clean up J...

2016-10-27 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/55#discussion_r85445965 --- Diff: helix-core/src/main/java/org/apache/helix/task/WorkflowRebalancer.java --- @@ -496,11 +496,10 @@ private void cleanupJob(final String job, String

[ANNOUNCE] Apache Helix 0.6.6 Release

2016-11-10 Thread Lei Xia
The Apache Helix Team is pleased to announce the 9th release, 0.6.6, of the Apache Helix project. Apache Helix is a generic cluster management framework that makes it easy to build partitioned, fault tolerant, and scalable distributed systems. The full release notes are available

[GitHub] helix pull request #56: [HELIX-543] Avoid moving partitions unnecessarily wh...

2016-10-25 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/56 [HELIX-543] Avoid moving partitions unnecessarily when auto-rebalancing. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia/helix helix-0.6

Re: Generate Helix release 0.6.6

2016-10-19 Thread Lei Xia
s the zookeeper client version we depend on. It will great to upgrade > the version if possible > > On Sun, Oct 2, 2016 at 2:53 PM, kishore g <g.kish...@gmail.com> wrote: > > > Thanks Lei. Let us know when you have the release. We can test it. > > > > On Wed

[GitHub] helix issue #59: helix-core: AutoRebalanceStrategy should sort by partition ...

2016-11-11 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/59 @mkscrg we already generated the 0.6.6 release, will include this fix into our next release. We will have more frequent releases from now on, and next release is expected to be out in another 1

Re: Merge 0.6.x and 0.7.x to new 0.8.x branch

2016-11-22 Thread Lei Xia
if you have any suggestions. Thanks Lei On Mon, Nov 21, 2016 at 10:28 PM, kishore g <g.kish...@gmail.com> wrote: > I like the overall idea. One concern is that it might be hard to maintain > backward compatibility with both 0.6 and 0.7. > > On Mon, Nov 21, 2016 at 10

Merge 0.6.x and 0.7.x to new 0.8.x branch

2016-11-21 Thread Lei Xia
Hi, All Helix 0.7.x branch has been there for a while, however, given it has back-incompatible API changes, most of our exiting customers are reluctant to move to 0.7. This forces us to maintain both branches, in addition, most of recent new features and important fixes (task framework

[GitHub] helix issue #61: Improvement for Task Framework Tutorial

2016-11-21 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/61 Can you rebase to the head? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] helix pull request #59: helix-core: AutoRebalanceStrategy should sort by par...

2016-11-17 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/59#discussion_r88552224 --- Diff: helix-core/src/main/java/org/apache/helix/controller/rebalancer/strategy/AutoRebalanceStrategy.java --- @@ -791,43 +795,61 @@ public String

[GitHub] helix issue #55: [HELIX-636] Add Java API and REST API for clean up JobQueue

2016-10-28 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/55 Can you rebase to branch head? There is merge conflict. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[VOTE] Apache Helix 0.6.6 Release

2016-11-02 Thread Lei Xia
Hi, This is to call for a vote on releasing the following candidate as Apache Helix 0.6.6. This is the 9th release of Helix as an Apache project, as well as the 5th release as a top-level Apache project. Apache Helix is a generic cluster management framework that makes it easy to build

Generate Helix release 0.6.7

2017-01-13 Thread Lei Xia
Hi, Helix Devs I am going to work on releasing Helix 0.6.7 this week. Please let me know if you have any questions, comments and concerns. Thanks Best Lei

Re: Generate Helix release 0.6.7

2017-01-13 Thread Lei Xia
sounds good. I will start building the release. Lei On Fri, Jan 13, 2017 at 9:57 PM, kishore g <g.kish...@gmail.com> wrote: > Not really, let's do the release. I just wanted to get the list of > bugs/enhancements. > > On Fri, Jan 13, 2017 at 8:18 PM, Lei Xia <l...

Re: Generate Helix release 0.6.7

2017-01-13 Thread Lei Xia
> What are the changes that will get into this release? > > On Fri, Jan 13, 2017 at 5:08 PM, Lei Xia <l...@apache.org> wrote: > > > Hi, Helix Devs > > > >I am going to work on releasing Helix 0.6.7 this week. Please let me > > know if you ha

[GitHub] helix issue #65: [HELIX-651] Add a method in HelixAdmin to set the InstanceC...

2017-01-12 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/65 Thanks, I will merge your change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] helix pull request #80: Minor fix on the asynchronous group callbacks.

2017-03-30 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/80 Minor fix on the asynchronous group callbacks. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia/helix helix-0.6.x Alternatively you can

[ANNOUNCE] New committer: Junkai Xue

2017-04-03 Thread Lei Xia
The Project Management Committee (PMC) for Apache Helix has asked Junkai Xue to become a committer and we are pleased to announce that he has accepted. Being a committer enables easier contribution to the project since there is no need to go via the patch submission process. This should enable

[GitHub] helix pull request #83: Update ivy files with new version name.

2017-04-05 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/83 Update ivy files with new version name. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia/helix helix-0.6.x Alternatively you can review

[GitHub] helix pull request #84: Bump to JDK 1.7.

2017-04-08 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/84 Bump to JDK 1.7. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia/helix helix-0.6.x Alternatively you can review and apply these changes

[GitHub] helix issue #74: Three bug fixings and improvements

2017-03-12 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/74 Could you rebase against the current head? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] helix pull request #76: Add a couple of moved/deprecated classes back to its...

2017-03-12 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/76 Add a couple of moved/deprecated classes back to its original package for back-compatible Add a couple of moved/deprecated classes back to its original package for back-compatible, marked them

[GitHub] helix issue #75: Ignore instances with no instance configuration

2017-03-08 Thread lei-xia
Github user lei-xia commented on the issue: https://github.com/apache/helix/pull/75 Thanks for fixing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

Latest Helix blog

2017-07-27 Thread Lei Xia
Hi, All This is the latest Helix blog we have published, https://engineering.linkedin.com/blog/2017/07/powering-helix_s-auto-rebalancer-with-topology-aware-partition-p, please feel free to share it. Maybe we should add a page to our Apache website to include all of the publications, talks

Our github repo is down?

2017-04-28 Thread Lei Xia
Seems our github repo is down? https://github.com/apache/helix, or it is just me can not access it? Lei

[GitHub] helix pull request #97: [HELIX-658] Bump Zookeeper version to 3.4.9.

2017-06-09 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/97 [HELIX-658] Bump Zookeeper version to 3.4.9. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia/helix github.lei.master Alternatively you

[GitHub] helix pull request #98: [HELIX-660]Configurable operation timeout for Helix ...

2017-06-09 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/98 [HELIX-660]Configurable operation timeout for Helix ZKClient. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia/helix helix-0.6.x

Re: [VOTE] Apache Helix 0.6.8 Release

2017-06-12 Thread Lei Xia
; [+1] -- "YES, release" > [0] -- "No opinion" > [-1] -- "NO, do not release" > > Thanks, > The Apache Helix Team > -- Lei Xia

Re: Branches rearrangement

2017-06-22 Thread Lei Xia
Thanks Junkai for working on this! Lei On Thu, Jun 22, 2017 at 4:23 PM, Xue Junkai wrote: > Hi All, > > Branch switches are done now! Now the development work will be started in > master branch, which is forked from helix-0.6.x. Please update your forked > repo or refork it

[GitHub] helix pull request #94: Add support of setting/updating of cluster/resource/...

2017-05-23 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/94 Add support of setting/updating of cluster/resource/instance configs from ConfigAccessor. This pull requests contains two commits: - Add support of setting/updating Cluster/Resource

[GitHub] helix pull request #89: [HELIX-655] Helix per-participant concurrent task th...

2017-05-31 Thread lei-xia
Github user lei-xia commented on a diff in the pull request: https://github.com/apache/helix/pull/89#discussion_r119443872 --- Diff: helix-core/src/main/java/org/apache/helix/model/InstanceConfig.java --- @@ -408,6 +410,18 @@ public void setInstanceEnabledForPartition(String

[GitHub] helix pull request #113: A few small features and improvements.

2017-10-06 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/113 A few small features and improvements. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lei-xia/helix master Alternatively you can review

[GitHub] helix pull request #109: Add state transition throttling feature.

2017-10-02 Thread lei-xia
GitHub user lei-xia opened a pull request: https://github.com/apache/helix/pull/109 Add state transition throttling feature. This pull request contains two changes: - Add state transition throttling feature with adding a new IntermediateStateCaluStage into the rebalance

  1   2   3   >