[GitHub] helix pull request #266: Propose design for aggregated cluster view service

2018-10-21 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/266#discussion_r226866903 --- Diff: designs/aggregated-cluster-view/design.md --- @@ -0,0 +1,353 @@ +Aggregated Cluster View Design

[GitHub] helix issue #248: helix manager should support getting metadata store connec...

2018-07-16 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/248 what is the purpose of this api and what will the caller do with the return value? ---

[GitHub] helix pull request #169: Two Performance Improvement for Rebalance pipeline

2018-03-27 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/169#discussion_r177523538 --- Diff: helix-core/src/main/java/org/apache/helix/common/caches/BasicClusterDataCache.java --- @@ -104,6 +108,52 @@ public void refresh(HelixDataAccessor

[GitHub] helix pull request #169: Two Performance Improvement for Rebalance pipeline

2018-03-27 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/169#discussion_r177523236 --- Diff: helix-core/src/main/java/org/apache/helix/common/caches/BasicClusterDataCache.java --- @@ -104,6 +108,52 @@ public void refresh(HelixDataAccessor

[GitHub] helix pull request #169: Two Performance Improvement for Rebalance pipeline

2018-03-27 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/169#discussion_r177522574 --- Diff: helix-core/src/main/java/org/apache/helix/common/caches/BasicClusterDataCache.java --- @@ -104,6 +108,52 @@ public void refresh(HelixDataAccessor

[GitHub] helix pull request #169: Two Performance Improvement for Rebalance pipeline

2018-03-27 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/169#discussion_r177523148 --- Diff: helix-core/src/main/java/org/apache/helix/common/caches/BasicClusterDataCache.java --- @@ -104,6 +108,52 @@ public void refresh(HelixDataAccessor

[GitHub] helix pull request #169: Two Performance Improvement for Rebalance pipeline

2018-03-27 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/169#discussion_r177522908 --- Diff: helix-core/src/main/java/org/apache/helix/common/caches/BasicClusterDataCache.java --- @@ -104,6 +108,52 @@ public void refresh(HelixDataAccessor

[GitHub] helix pull request #159: Improvements to Helix's Callback handling.

2018-03-26 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/159#discussion_r177275969 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java --- @@ -257,18 +308,22 @@ public void run

[GitHub] helix pull request #159: Improvements to Helix's Callback handling.

2018-03-26 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/159#discussion_r177260701 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java --- @@ -153,7 +195,12 @@ private void parseListenerProperties

[GitHub] helix pull request #159: Improvements to Helix's Callback handling.

2018-03-26 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/159#discussion_r177274948 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java --- @@ -168,41 +215,41 @@ private void parseListenerProperties

[GitHub] helix pull request #159: Improvements to Helix's Callback handling.

2018-03-26 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/159#discussion_r177257703 --- Diff: helix-core/src/main/java/org/apache/helix/common/DedupEventBlockingQueue.java --- @@ -0,0 +1,139 @@ +package org.apache.helix.common

[GitHub] helix pull request #159: Improvements to Helix's Callback handling.

2018-03-26 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/159#discussion_r177260018 --- Diff: helix-core/src/main/java/org/apache/helix/common/DedupEventBlockingQueue.java --- @@ -0,0 +1,139 @@ +package org.apache.helix.common

[GitHub] helix pull request #155: Features and improvements to Helix RoutingTableProv...

2018-03-21 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/155#discussion_r176172589 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableSnapshot.java --- @@ -0,0 +1,151 @@ +package org.apache.helix.spectator

[GitHub] helix pull request #155: Features and improvements to Helix RoutingTableProv...

2018-03-21 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/155#discussion_r176171189 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java --- @@ -576,8 +573,8 @@ public void handleDataChange(String dataPath

[GitHub] helix pull request #138: CallbackHandler to use either java config property ...

2018-03-02 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/138#discussion_r171987248 --- Diff: helix-core/src/test/java/org/apache/helix/TestListenerCallbackBatchMode.java --- @@ -122,21 +131,45 @@ public void testNonBatchedListener() throws

[GitHub] helix pull request #138: CallbackHandler to use either java config property ...

2018-03-02 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/138#discussion_r171987319 --- Diff: helix-core/src/test/java/org/apache/helix/TestListenerCallbackBatchMode.java --- @@ -122,21 +131,45 @@ public void testNonBatchedListener() throws

[GitHub] helix pull request #:

2018-01-17 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/commit/bada911c7f246cf685c30323e118402cca89111d#commitcomment-26928342 In helix-core/src/main/java/org/apache/helix/GroupCommit.java: In helix-core/src/main/java/org/apache/helix/GroupCommit.java

[GitHub] helix pull request #:

2018-01-17 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/commit/bada911c7f246cf685c30323e118402cca89111d#commitcomment-26928170 In helix-core/src/main/java/org/apache/helix/GroupCommit.java: In helix-core/src/main/java/org/apache/helix/GroupCommit.java

[GitHub] helix pull request #87: Make map in NotificationContext synchronized

2017-05-11 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/87#discussion_r116129454 --- Diff: helix-core/src/main/java/org/apache/helix/messaging/handling/HelixTaskExecutor.java --- @@ -143,6 +145,7 @@ public HelixTaskExecutor

[GitHub] helix issue #59: helix-core: AutoRebalanceStrategy should sort by partition ...

2017-04-15 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/59 Any update on this PR. I think we are seeing similar issues in one of our projects --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] helix pull request #82: Add Test for Batch Message ThreadPool

2017-04-04 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/82#discussion_r109814455 --- Diff: helix-core/src/test/java/org/apache/helix/messaging/handling/TestResourceThreadpoolSize.java --- @@ -113,6 +113,35 @@ public void

[GitHub] helix pull request #82: Add Test for Batch Message ThreadPool

2017-04-04 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/82#discussion_r109800436 --- Diff: helix-core/src/test/java/org/apache/helix/messaging/handling/TestResourceThreadpoolSize.java --- @@ -113,6 +113,35 @@ public void

[GitHub] helix pull request #81: Creating a separate threadpool to handle batchMessag...

2017-04-03 Thread kishoreg
GitHub user kishoreg opened a pull request: https://github.com/apache/helix/pull/81 Creating a separate threadpool to handle batchMessages batchMessages were using the same threadpool as sub tasks. This works as long the thread pool size is greater than the number of messages

[GitHub] helix pull request #78: Auto compress ZNode that are greater than 1MB

2017-03-28 Thread kishoreg
GitHub user kishoreg opened a pull request: https://github.com/apache/helix/pull/78 Auto compress ZNode that are greater than 1MB Previously, users had to explicitly set enableCompression=true in the ZNRecord to enable compression. This meant that the users had to anticipate

[GitHub] helix issue #77: Adding support to batch ZK callback optionally by setting s...

2017-03-28 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/77 I think it's a good idea to have one shared thread pool. Since we create one callback per helix entity type (idealstate, external view), I thought this is not a big overhead. One problem

[GitHub] helix pull request #77: Adding support to batch ZK callback optionally by se...

2017-03-24 Thread kishoreg
GitHub user kishoreg opened a pull request: https://github.com/apache/helix/pull/77 Adding support to batch ZK callback optionally by setting sys var asy… Supports batching of zk callbacks. Can be enabled optionally with a system flag (asyncBatchModeEnabled=true). In my

[GitHub] helix pull request #65: [HELIX-651] Add a method in HelixAdmin to set the In...

2017-01-09 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/65#discussion_r95282034 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixAdmin.java --- @@ -162,6 +162,20 @@ public InstanceConfig getInstanceConfig(String

[GitHub] helix pull request #65: [HELIX-651] Add a method in HelixAdmin to set the In...

2017-01-09 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/65#discussion_r95281496 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixAdmin.java --- @@ -162,6 +162,20 @@ public InstanceConfig getInstanceConfig(String

[GitHub] helix issue #58: helix-core: AutoRebalancer should include only numbered sta...

2016-11-02 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/58 This should fix it. One scenario, where this will result in undesirable output is when the entire cluster is restarted. Let's day P was on NODE_0 and NODE_1, we paused the controller

[GitHub] helix issue #49: New topology-aware auto rebalance strategy and some fixes t...

2016-08-31 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/49 this is great work Lei. Can you please paste the final mapping generated by default strategy v/s crush method. Also when would one chose one over the other. --- If your project is set up for it, you

[GitHub] helix issue #49: New topology-aware auto rebalance strategy and some fixes t...

2016-08-31 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/49 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] helix pull request #49: New topology-aware auto rebalance strategy and some ...

2016-08-31 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/49#discussion_r76988348 --- Diff: helix-core/src/main/java/org/apache/helix/controller/rebalancer/strategy/CrushRebalanceStrategy.java --- @@ -0,0 +1,174 @@ +package

[GitHub] helix issue #48: helix-ui improvements

2016-08-31 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/48 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] helix issue #48: helix-ui improvements

2016-08-25 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/48 Got it. Will review this. Are you guys using 0.6.x or 0.7.x --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] helix issue #48: helix-ui improvements

2016-08-25 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/48 @lei-xia can you also review this change. Subbu had a test case https://issues.apache.org/jira/browse/HELIX-631. Will be good to see if this change fixes that as well. --- If your project is set up

[GitHub] helix issue #48: helix-ui improvements

2016-08-25 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/48 this is awesome Greg, can you please create a separate PR for FULL_AUTO bug. I will review the changes tonight. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] helix issue #46: All task framework changes

2016-08-16 Thread kishoreg
Github user kishoreg commented on the issue: https://github.com/apache/helix/pull/46 Lgtm. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] helix pull request: fixed a bug at WriteLock caused by read-delete...

2016-05-25 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/44#issuecomment-221774907 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] helix pull request: A few more task framework improvement

2016-04-13 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/41#issuecomment-209564520 Thanks, will apply the change today On Wed, Apr 13, 2016 at 10:46 AM, Lei Xia <notificati...@github.com> wrote: > Rebased to the head.

[GitHub] helix pull request: A few more task framework improvement

2016-02-10 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/41#issuecomment-182482218 Will review this today --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] helix pull request: A few more task framework improvement

2016-02-10 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/41#issuecomment-182487167 Looks good, please try to split the changes into smaller RB's. Its very hard to review such a big RB. Can you address the RB comments. I will merge it --- If your

[GitHub] helix pull request: A few more task framework improvement

2016-02-10 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/41#discussion_r52488945 --- Diff: helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java.rej --- @@ -0,0 +1,18 @@ +diff a/helix-core/src

[GitHub] helix pull request: A few more task framework improvement

2016-02-10 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/41#discussion_r52489589 --- Diff: helix-core/src/main/java/org/apache/helix/task/JobRebalancer.java --- @@ -206,9 +205,23 @@ private ResourceAssignment computeResourceMapping(String

[GitHub] helix pull request: [HELIX-626] Enable maxRecipient in Criteria

2016-01-15 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/43#issuecomment-172105093 Is this intended to be used via curl or via java api?. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] helix pull request: [HELIX-626] Enable maxRecipient in Criteria

2016-01-15 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/43#issuecomment-172126774 Then a better api, is to provide a Filter api right. similar to File.list(dir, FileNameFilter) we can have a MessageSendFilter which has accept method that returns

[GitHub] helix pull request: [Helix-624] Fix NPE in TestMessageService.Test...

2016-01-13 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/42#issuecomment-171563196 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] helix pull request: [Helix-612] Bump up the version of zkClient an...

2016-01-11 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/36#issuecomment-170707954 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] helix pull request: [HELIX-613] Fix thread leaking problems in Tas...

2015-11-07 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/38#issuecomment-154778932 LGTM. Any test case to ensure that there is no leak? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] helix pull request: [HELIX-610] Makes sure TaskStateModel gets pro...

2015-09-08 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/35#issuecomment-138792278 This is an interesting change, why cant we do this on the client side? If you have the reference to StateModelFactory, you can call the shutdown method on each and every

[GitHub] helix pull request: [HELIX-609] Added new DataSource values LIVEIN...

2015-09-08 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/34#issuecomment-138783773 Thanks LGTM. Will apply the patch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] helix pull request: Added new DataSource values LIVEINSTANCES and ...

2015-09-07 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/34#issuecomment-138435680 Looks good, can you add a simple test case? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] helix pull request: [Helix-606] Add an option in IdealState to all...

2015-07-28 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/32#discussion_r35688508 --- Diff: helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java --- @@ -645,7 +645,7 @@ public boolean isLeader

[GitHub] helix pull request: Cleaned up ByteBuf usage in IPC

2015-07-19 Thread kishoreg
Github user kishoreg commented on the pull request: https://github.com/apache/helix/pull/33#issuecomment-122676485 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-03 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r33882177 --- Diff: helix-core/src/main/java/org/apache/helix/model/IdealState.java --- @@ -536,4 +574,16 @@ public boolean isEnabled() { public void enable

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-03 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r33881174 --- Diff: helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java --- @@ -73,6 +75,73 @@ public RoutingTableProvider

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-03 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r33881022 --- Diff: helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationPhase.java --- @@ -127,7 +127,9 @@ public void process(ClusterEvent

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-03 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r33881054 --- Diff: helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationPhase.java --- @@ -190,7 +192,8 @@ public void process(ClusterEvent

[GitHub] helix pull request: [HELIX-599] Support creating/maintaining/routi...

2015-07-03 Thread kishoreg
Github user kishoreg commented on a diff in the pull request: https://github.com/apache/helix/pull/31#discussion_r33881099 --- Diff: helix-core/src/main/java/org/apache/helix/model/IdealState.java --- @@ -55,7 +55,9 @@ MAX_PARTITIONS_PER_INSTANCE