[jira] [Commented] (HELIX-382) GenericHelixController should implement InstanceConfigChangeListener instead of ConfigChangeListener
[ https://issues.apache.org/jira/browse/HELIX-382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13902804#comment-13902804 ] Hudson commented on HELIX-382: -- UNSTABLE: Integrated in helix #1225 (See [https://builds.apache.org/job/helix/1225/]) [HELIX-382] GenericHelixController now implements InstanceConfigChangeListener, ConfigChangeListener delegates call to InstanceConfigChangeListener (kanak.b: rev 560097fbebb02096018614bbc8a09430d5a4bb4f) * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java > GenericHelixController should implement InstanceConfigChangeListener instead > of ConfigChangeListener > > > Key: HELIX-382 > URL: https://issues.apache.org/jira/browse/HELIX-382 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala > > The fact that GenericHelixController implements ConfigChangeListener instead > is causing confusion. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-360) ClusterAccessor#initClusterStructure uses (incorrect) duplicated code
[ https://issues.apache.org/jira/browse/HELIX-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13905925#comment-13905925 ] Hudson commented on HELIX-360: -- UNSTABLE: Integrated in helix #1226 (See [https://builds.apache.org/job/helix/1226/]) [HELIX-360] Remove code duplication for list of required paths (kanak: rev 0e310fa10971e9d6a14c450829fb162731bd7833) * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicResourceAccessor.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKUtil.java * helix-core/src/main/java/org/apache/helix/controller/stages/PersistAssignmentStage.java * helix-core/src/main/java/org/apache/helix/tools/NewClusterSetup.java * helix-core/src/main/java/org/apache/helix/api/accessor/ResourceAccessor.java * helix-core/src/test/java/org/apache/helix/api/accessor/TestAccessorRecreate.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicParticipantAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/ParticipantAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java > ClusterAccessor#initClusterStructure uses (incorrect) duplicated code > - > > Key: HELIX-360 > URL: https://issues.apache.org/jira/browse/HELIX-360 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > HelixAdmin and ClusterAccessor should call the same routine and it should > create a valid cluster structure. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-378) Add instance gauges to ClusterStatusMonitor
[ https://issues.apache.org/jira/browse/HELIX-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13906089#comment-13906089 ] Hudson commented on HELIX-378: -- UNSTABLE: Integrated in helix #1227 (See [https://builds.apache.org/job/helix/1227/]) [HELIX-378] Add instance gauges to ClusterStatusMonitor (kanak: rev 7cb6b86e12c24af7a370c17a8049515337865947) * helix-core/src/main/java/org/apache/helix/controller/stages/ReadClusterDataStage.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ResourceMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/InstanceMonitorMBean.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/InstanceMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/MessageQueueMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterStatusMonitor.java > Add instance gauges to ClusterStatusMonitor > --- > > Key: HELIX-378 > URL: https://issues.apache.org/jira/browse/HELIX-378 > Project: Apache Helix > Issue Type: New Feature >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Right now, ClusterStatusMonitor only gives counts for things like instances > up/down. We need finer granularity: which instance is up/down, what tags does > the instance have, etc. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-378) Add instance gauges to ClusterStatusMonitor
[ https://issues.apache.org/jira/browse/HELIX-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13906192#comment-13906192 ] Hudson commented on HELIX-378: -- UNSTABLE: Integrated in helix #1228 (See [https://builds.apache.org/job/helix/1228/]) [HELIX-378] Add instance gauges to ClusterStatusMonitor, fix test failure (kanak: rev ef6e9bbe0d624d810f02f6c74c01e57ed1d05787) * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java > Add instance gauges to ClusterStatusMonitor > --- > > Key: HELIX-378 > URL: https://issues.apache.org/jira/browse/HELIX-378 > Project: Apache Helix > Issue Type: New Feature >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Right now, ClusterStatusMonitor only gives counts for things like instances > up/down. We need finer granularity: which instance is up/down, what tags does > the instance have, etc. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-381) ClusterStateVerifier should support verifying a subset of resources
[ https://issues.apache.org/jira/browse/HELIX-381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13906484#comment-13906484 ] Hudson commented on HELIX-381: -- SUCCESS: Integrated in helix #1229 (See [https://builds.apache.org/job/helix/1229/]) [HELIX-381] ClusterStateVerifier can now work with a subset of resources (kanak: rev c8a644f4b72871de0186cb85338ddd6c39929a51) * helix-core/src/test/java/org/apache/helix/tools/TestClusterStateVerifier.java * helix-core/src/main/java/org/apache/helix/tools/ClusterStateVerifier.java > ClusterStateVerifier should support verifying a subset of resources > --- > > Key: HELIX-381 > URL: https://issues.apache.org/jira/browse/HELIX-381 > Project: Apache Helix > Issue Type: Improvement >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > By default, ClusterStateVerifier works at a whole-cluster scope. However, for > various reasons, and particularly in a multi-tenant cluster, it doesn't make > sense to work at that scope. It should allow taking in a variable number of > resources so that it can exclusively verify those. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-345) Speed up the controller pipelines
[ https://issues.apache.org/jira/browse/HELIX-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13907346#comment-13907346 ] Hudson commented on HELIX-345: -- SUCCESS: Integrated in helix #1230 (See [https://builds.apache.org/job/helix/1230/]) [HELIX-345] Speed up the controller pipeline (kanak: rev 51329f6f0bbb8a43cdfd06ffd3bf7ac5c8a93c68) * helix-core/src/main/java/org/apache/helix/task/TaskUtil.java * helix-core/src/main/java/org/apache/helix/api/Cluster.java * helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestRebalancePipeline.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationStage.java * helix-core/src/main/java/org/apache/helix/model/ResourceConfiguration.java * helix-core/src/main/java/org/apache/helix/controller/stages/ResourceComputationStage.java * helix-core/src/main/java/org/apache/helix/controller/stages/PersistContextStage.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/FullAutoRebalancerConfig.java * helix-core/src/main/java/org/apache/helix/model/IdealState.java * helix-core/src/main/java/org/apache/helix/tools/ClusterExternalViewVerifier.java * helix-core/src/test/java/org/apache/helix/integration/TestUserDefRebalancerCompatibility.java * helix-core/src/test/java/org/apache/helix/integration/TestReelectedPipelineCorrectness.java * helix-core/src/main/java/org/apache/helix/ConfigAccessor.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/SemiAutoRebalancerConfig.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageThrottleStage.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java * helix-core/src/test/java/org/apache/helix/api/TestNewStages.java * helix-core/src/main/java/org/apache/helix/controller/stages/PersistAssignmentStage.java * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/FullAutoRebalancer.java * helix-core/src/main/java/org/apache/helix/tools/YAMLClusterSetup.java * helix-core/src/main/java/org/apache/helix/controller/strategy/AutoRebalanceStrategy.java * helix-core/src/main/java/org/apache/helix/tools/ClusterStateVerifier.java * helix-core/src/main/java/org/apache/helix/api/config/ClusterConfig.java * helix-core/src/main/java/org/apache/helix/controller/stages/TaskAssignmentStage.java * helix-core/src/main/java/org/apache/helix/controller/stages/ReadClusterDataStage.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/RebalancerRef.java * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageSelectionStage.java * helix-core/src/main/java/org/apache/helix/controller/stages/CompatibilityCheckStage.java * helix-core/src/main/java/org/apache/helix/controller/stages/ClusterDataCache.java * helix-core/src/main/java/org/apache/helix/controller/stages/CurrentStateComputationStage.java * helix-core/src/test/java/org/apache/helix/Mocks.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/main/java/org/apache/helix/model/ResourceAssignment.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestResourceValidationStage.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/PartitionedRebalancerConfig.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/CustomRebalancerConfig.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixDataAccessor.java * helix-core/src/main/java/org/apache/helix/controller/stages/ResourceValidationStage.java * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/ResourceAccessor.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/RebalancerConfigHolder.java > Speed up the controller pipelines > - > > Key: HELIX-345 > URL: https://issues.apache.org/jira/browse/HELIX-345 > Project: Apache Helix > Issue Type: Bug >Affects Versions: 0.6.2-incubating, 0.7.0-incubating >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > ReadClusterDataStage can take some time. We should have techniques for > speeding it up like parallelizing or caching. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-383) Javadoc for HelixManager references nonexistent start() method
[ https://issues.apache.org/jira/browse/HELIX-383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13907690#comment-13907690 ] Hudson commented on HELIX-383: -- UNSTABLE: Integrated in helix #1231 (See [https://builds.apache.org/job/helix/1231/]) [HELIX-383] Fix Javadoc for HelixManager usage (kanak: rev 0beb0d9f34b3d96b98955aa47519bb5e7b37d4c9) * helix-core/src/main/java/org/apache/helix/HelixManager.java > Javadoc for HelixManager references nonexistent start() method > -- > > Key: HELIX-383 > URL: https://issues.apache.org/jira/browse/HELIX-383 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > See: > http://helix.apache.org/javadocs/0.6.2-incubating/reference/org/apache/helix/HelixManager.html -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-360) ClusterAccessor#initClusterStructure uses (incorrect) duplicated code
[ https://issues.apache.org/jira/browse/HELIX-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13909356#comment-13909356 ] Hudson commented on HELIX-360: -- FAILURE: Integrated in helix #1232 (See [https://builds.apache.org/job/helix/1232/]) [HELIX-360] Remove code duplication for list of required paths, minor fixes (kanak: rev 507feeb4f4a16a803e4497f0ee3e4482b2303045) * helix-core/src/main/java/org/apache/helix/manager/zk/ZKUtil.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicClusterAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicParticipantAccessor.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java * helix-core/src/main/java/org/apache/helix/util/HelixUtil.java * helix-core/src/main/java/org/apache/helix/api/accessor/ResourceAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicResourceAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/ParticipantAccessor.java > ClusterAccessor#initClusterStructure uses (incorrect) duplicated code > - > > Key: HELIX-360 > URL: https://issues.apache.org/jira/browse/HELIX-360 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > HelixAdmin and ClusterAccessor should call the same routine and it should > create a valid cluster structure. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-390) Race condition: Checking HelixManager#isConnected is unreliable
[ https://issues.apache.org/jira/browse/HELIX-390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13910691#comment-13910691 ] Hudson commented on HELIX-390: -- UNSTABLE: Integrated in helix #1233 (See [https://builds.apache.org/job/helix/1233/]) [HELIX-390] Force message handler registration even when ZK connection state is flaky (kanak: rev a302564a345f4c5ff92559fe9cad126acad740c9) * helix-core/src/main/java/org/apache/helix/messaging/DefaultMessagingService.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixParticipant.java * helix-core/src/main/java/org/apache/helix/manager/zk/ParticipantManagerHelper.java > Race condition: Checking HelixManager#isConnected is unreliable > --- > > Key: HELIX-390 > URL: https://issues.apache.org/jira/browse/HELIX-390 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > This led to a NPE in trying to execute state transitions due to the fact that > the state model was never re-registered after a post-GC reconnection. > The fix is to invoke the message handler's onConnected method in > handleNewSession, and to put all necessary on-connect logic inside this > method. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-392) Write a test to ensure that ZK connection loss is silent
[ https://issues.apache.org/jira/browse/HELIX-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914831#comment-13914831 ] Hudson commented on HELIX-392: -- UNSTABLE: Integrated in helix #1234 (See [https://builds.apache.org/job/helix/1234/]) [HELIX-392] Write a test to ensure that ZK connection loss is silent (kanak: rev c5d396dcbd11af36bfa1cd377d99b2cdab875ab4) * helix-core/src/test/java/org/apache/helix/integration/TestCorrectnessOnConnectivityLoss.java > Write a test to ensure that ZK connection loss is silent > > > Key: HELIX-392 > URL: https://issues.apache.org/jira/browse/HELIX-392 > Project: Apache Helix > Issue Type: Task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Participants and spectators should be able to happily function even when the > ZK servers are down. Add a test to ensure this is the case. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-381) ClusterStateVerifier should support verifying a subset of resources
[ https://issues.apache.org/jira/browse/HELIX-381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914929#comment-13914929 ] Hudson commented on HELIX-381: -- UNSTABLE: Integrated in helix #1235 (See [https://builds.apache.org/job/helix/1235/]) [HELIX-381] ClusterStateVerifier can now work with a subset of resources, test fix (kanak: rev 74b754c8d677b1ca62a6d4eb3af6f0ba446b3a9a) * helix-core/src/test/java/org/apache/helix/tools/TestClusterStateVerifier.java > ClusterStateVerifier should support verifying a subset of resources > --- > > Key: HELIX-381 > URL: https://issues.apache.org/jira/browse/HELIX-381 > Project: Apache Helix > Issue Type: Improvement >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > By default, ClusterStateVerifier works at a whole-cluster scope. However, for > various reasons, and particularly in a multi-tenant cluster, it doesn't make > sense to work at that scope. It should allow taking in a variable number of > resources so that it can exclusively verify those. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HELIX-396) Make REST api for /instances parseable
[
https://issues.apache.org/jira/browse/HELIX-396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13920418#comment-13920418
]
Hudson commented on HELIX-396:
--
UNSTABLE: Integrated in helix #1236 (See
[https://builds.apache.org/job/helix/1236/])
[HELIX-396] Make REST api for /instances parseable (kanak: rev
3399aadb901ac733f27b9aa4658280273095a21e)
*
helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestClusterManagementWebapp.java
*
helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/InstancesResource.java
> Make REST api for /instances parseable
> --
>
> Key: HELIX-396
> URL: https://issues.apache.org/jira/browse/HELIX-396
> Project: Apache Helix
> Issue Type: Improvement
>Reporter: Kanak Biscuitwala
>Assignee: Kanak Biscuitwala
>
> The current representation for /clusters/clusterName/instances is not
> parseable since it is a concatenation of two things that are parseable, i.e.
> [{instanceConfig1}, {instanceConfig2}]{"tag1": ["localhost_1"]}
> What we want instead is everything encapsulated in a single JSON object:
> {"instanceInfo": [{instanceConfig1}, {instanceConfig2}],
> "tagInfo": {"tag1": ["localhost_1"]}}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HELIX-397) Add tagging information to the REST GET response on /resourceGroups
[ https://issues.apache.org/jira/browse/HELIX-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13921866#comment-13921866 ] Hudson commented on HELIX-397: -- ABORTED: Integrated in helix #1237 (See [https://builds.apache.org/job/helix/1237/]) [HELIX-397] REST GET for resources should include tag information (kanak: rev cacc6b201559995f0c5407aded1ab27cb9c82004) * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestTagAwareness.java * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/ResourceGroupsResource.java > Add tagging information to the REST GET response on /resourceGroups > --- > > Key: HELIX-397 > URL: https://issues.apache.org/jira/browse/HELIX-397 > Project: Apache Helix > Issue Type: Improvement >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-397) Add tagging information to the REST GET response on /resourceGroups
[ https://issues.apache.org/jira/browse/HELIX-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13921992#comment-13921992 ] Hudson commented on HELIX-397: -- SUCCESS: Integrated in helix #1238 (See [https://builds.apache.org/job/helix/1238/]) [HELIX-397] REST GET for resources should include tag information, fix CI issue (kanak: rev eb9d69772e8e9fb0c9171035b61c13902b3d7d78) * helix-admin-webapp/src/test/java/org/apache/helix/tools/TestHelixAdminScenariosRest.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestClusterManagementWebapp.java * helix-admin-webapp/src/test/java/org/apache/helix/tools/AdminTestBase.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestTagAwareness.java > Add tagging information to the REST GET response on /resourceGroups > --- > > Key: HELIX-397 > URL: https://issues.apache.org/jira/browse/HELIX-397 > Project: Apache Helix > Issue Type: Improvement >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-394) Shutdown GenericHelixController#_eventThread when HelixManager disconnects
[ https://issues.apache.org/jira/browse/HELIX-394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923241#comment-13923241 ] Hudson commented on HELIX-394: -- UNSTABLE: Integrated in helix #1239 (See [https://builds.apache.org/job/helix/1239/]) [HELIX-394] Make cluster event thread a daemon thread (kanak: rev 6a2a5f67cd2b1791f74a2439822647470740274b) * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java > Shutdown GenericHelixController#_eventThread when HelixManager disconnects > -- > > Key: HELIX-394 > URL: https://issues.apache.org/jira/browse/HELIX-394 > Project: Apache Helix > Issue Type: Bug >Affects Versions: 0.6.2-incubating, 0.7.0-incubating >Reporter: Zhen Zhang >Assignee: Zhen Zhang > > In Helix 0.6.2.x and 0.7.x, we introduces GenericHelixController#_eventThread > to merge callbacks, but we are not shutting down the thread when a > HelixManager instance disconnects. This lefts a running thread. > To fix this, will add a shutdown method to GenericHelixController and > interrupts the thread. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-394) Shutdown GenericHelixController#_eventThread when HelixManager disconnects
[ https://issues.apache.org/jira/browse/HELIX-394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923309#comment-13923309 ] Hudson commented on HELIX-394: -- SUCCESS: Integrated in helix #1240 (See [https://builds.apache.org/job/helix/1240/]) [HELIX-394] Make cluster event thread a daemon thread, fix test (kanak: rev 15c191b21291cce76ba121f0b4337f7a78daee57) * helix-core/src/test/java/org/apache/helix/integration/TestReelectedPipelineCorrectness.java > Shutdown GenericHelixController#_eventThread when HelixManager disconnects > -- > > Key: HELIX-394 > URL: https://issues.apache.org/jira/browse/HELIX-394 > Project: Apache Helix > Issue Type: Bug >Affects Versions: 0.6.2-incubating, 0.7.0-incubating >Reporter: Zhen Zhang >Assignee: Zhen Zhang > > In Helix 0.6.2.x and 0.7.x, we introduces GenericHelixController#_eventThread > to merge callbacks, but we are not shutting down the thread when a > HelixManager instance disconnects. This lefts a running thread. > To fix this, will add a shutdown method to GenericHelixController and > interrupts the thread. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-398) Some helix-core tests are running again in the helix-admin-webapp set
[ https://issues.apache.org/jira/browse/HELIX-398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923449#comment-13923449 ] Hudson commented on HELIX-398: -- SUCCESS: Integrated in helix #1241 (See [https://builds.apache.org/job/helix/1241/]) [HELIX-398] Prevent helix-admin-webapp from running helix-core tests (kanak: rev bfda7c3dc743e2674dcb407f1aca05e892a74cc9) * helix-admin-webapp/src/test/java/org/apache/helix/tools/AdminTestBase.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/AdminTestBase.java * helix-admin-webapp/src/test/java/org/apache/helix/tools/TestResetInstance.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestResetInstance.java * helix-admin-webapp/src/test/java/org/apache/helix/tools/TestHelixAdminScenariosRest.java * helix-admin-webapp/src/test/java/org/apache/helix/tools/TestResetResource.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestHelixAdminScenariosRest.java * helix-admin-webapp/src/test/java/org/apache/helix/tools/TestResetPartitionState.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/AdminTestHelper.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestResetPartitionState.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestClusterManagementWebapp.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestResetResource.java * helix-admin-webapp/src/test/java/org/apache/helix/tools/AdminTestHelper.java * helix-admin-webapp/src/test/conf/testng.xml > Some helix-core tests are running again in the helix-admin-webapp set > - > > Key: HELIX-398 > URL: https://issues.apache.org/jira/browse/HELIX-398 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > The tests in org.apache.helix.tools are being repeated due to the test > configuration in helix-admin-webapp. This needs to be cleaned up so that each > test is run exactly once. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-399) Make TestConsecutiveZkSessionExpiry less flaky
[ https://issues.apache.org/jira/browse/HELIX-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924345#comment-13924345 ] Hudson commented on HELIX-399: -- SUCCESS: Integrated in helix #1242 (See [https://builds.apache.org/job/helix/1242/]) [HELIX-399] Make TestConsecutiveZkSessionExpiry less flaky (kanak: rev 6bd9fd571f5bc8768b4273d3bec7de3c50786de2) * helix-core/src/test/java/org/apache/helix/ZkUnitTestBase.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestConsecutiveZkSessionExpiry.java > Make TestConsecutiveZkSessionExpiry less flaky > -- > > Key: HELIX-399 > URL: https://issues.apache.org/jira/browse/HELIX-399 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-414) rsync recipe has invalid property store paths
[ https://issues.apache.org/jira/browse/HELIX-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947353#comment-13947353 ] Hudson commented on HELIX-414: -- SUCCESS: Integrated in helix #1243 (See [https://builds.apache.org/job/helix/1243/]) [HELIX-414] Fix property store paths for rsync recipe (kanak: rev 1e1449d70c336aa54e7ed047a423c361d086f8dd) * recipes/rsync-replicated-file-system/src/main/java/org/apache/helix/filestore/FileStoreStateModel.java > rsync recipe has invalid property store paths > -- > > Key: HELIX-414 > URL: https://issues.apache.org/jira/browse/HELIX-414 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > All paths need to be have / prepended and the ones in this recipe don't. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-410) ClusterStateVerifier does not parse "--resources" argument
[ https://issues.apache.org/jira/browse/HELIX-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947354#comment-13947354 ] Hudson commented on HELIX-410: -- SUCCESS: Integrated in helix #1243 (See [https://builds.apache.org/job/helix/1243/]) [HELIX-410] Fix parsing and filtering of resources in ClusterStateVerifier (kanak: rev d932c3ba2f36929dcfd7b674749d0b63dedd2b0d) * helix-core/src/test/java/org/apache/helix/tools/TestClusterStateVerifier.java * helix-core/src/main/java/org/apache/helix/tools/ClusterStateVerifier.java > ClusterStateVerifier does not parse "--resources" argument > -- > > Key: HELIX-410 > URL: https://issues.apache.org/jira/browse/HELIX-410 > Project: Apache Helix > Issue Type: Bug > Components: helix-core >Affects Versions: 0.6.2-incubating >Reporter: A Sebastian >Assignee: Kanak Biscuitwala > > ClusterStateVerifier.verifyState(String[] args) is supposed to take a > "--resources" argument but it fails to parse because the > ClusterStateVerifier.constructCommandLineOptions() does not add it as an > option. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-420) Main page must link to Apache License
[ https://issues.apache.org/jira/browse/HELIX-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950380#comment-13950380 ] Hudson commented on HELIX-420: -- UNSTABLE: Integrated in helix #1245 (See [https://builds.apache.org/job/helix/1245/]) [HELIX-420] Fix home and download pages to meet ASF standards (kanak: rev 0ae690e01f3c806ec9797424b2154105b59c67e7) * website/0.7.0-incubating/src/site/xdoc/download.xml.vm * website/0.6.3/src/site/xdoc/download.xml.vm * website/src/site/site.xml * website/0.6.1-incubating/src/site/xdoc/download.xml.vm * website/src/site/xdoc/download.xml.vm * website/0.6.2-incubating/src/site/xdoc/download.xml.vm > Main page must link to Apache License > - > > Key: HELIX-420 > URL: https://issues.apache.org/jira/browse/HELIX-420 > Project: Apache Helix > Issue Type: Bug >Reporter: Sebb >Assignee: Kanak Biscuitwala > > The main web page must have a prominent link to the Apache License. > Please see > http://www.apache.org/foundation/marks/pmcs.html#navigation -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-413) ClusterStateVerifier should always return true if called with 0 resources
[ https://issues.apache.org/jira/browse/HELIX-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13961340#comment-13961340 ] Hudson commented on HELIX-413: -- SUCCESS: Integrated in helix #1246 (See [https://builds.apache.org/job/helix/1246/]) [HELIX-413] Removed empty resource check in ClusterStateVerifier (kanak.b: rev fdc8e506368a47fa1836b7f3d888a8229749e186) * helix-core/src/main/java/org/apache/helix/tools/ClusterStateVerifier.java > ClusterStateVerifier should always return true if called with 0 resources > - > > Key: HELIX-413 > URL: https://issues.apache.org/jira/browse/HELIX-413 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Labels: newbie > Fix For: 0.7.1, 0.6.4 > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-423) Code duplication in controller leader election
[ https://issues.apache.org/jira/browse/HELIX-423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13961341#comment-13961341 ] Hudson commented on HELIX-423: -- SUCCESS: Integrated in helix #1247 (See [https://builds.apache.org/job/helix/1247/]) [HELIX-423] Remove election code duplication, fix metrics reset (kanak.b: rev 7937b8a27b8a209d974209f57d5578b3b9e007f2) * helix-core/src/main/java/org/apache/helix/manager/zk/DistributedLeaderElection.java * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestResetClusterMetrics.java * helix-core/src/test/java/org/apache/helix/participant/MockZKHelixManager.java * helix-core/src/test/java/org/apache/helix/participant/TestDistControllerElection.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixLeaderElection.java * helix-core/src/main/java/org/apache/helix/participant/DistClusterControllerElection.java > Code duplication in controller leader election > -- > > Key: HELIX-423 > URL: https://issues.apache.org/jira/browse/HELIX-423 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Fix For: 0.7.1, 0.6.4 > > > There are two (or more) versions of leader election: > DistributedLeaderElection, DistClusterControllerElection, and possibly others > that I'm missing. This isn't good because if there's any code change > required, it's very easy to miss doing it everywhere. > In particular, this is causing metrics to not be unregistered on leader > election because this was fixed in one place and not the other. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-425) 0.7 does not honor partition transition throttling correctly
[ https://issues.apache.org/jira/browse/HELIX-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965069#comment-13965069 ] Hudson commented on HELIX-425: -- UNSTABLE: Integrated in helix #1248 (See [https://builds.apache.org/job/helix/1248/]) HELIX-425: Porting the fix to handle partition level constraints from 0.6. to 0.7 (g.kishore: rev 1a2dd050ad16a9fdbf4989a6f66e0821f3f43ebf) * helix-core/src/main/java/org/apache/helix/api/config/ClusterConfig.java * helix-core/src/test/java/org/apache/helix/integration/TestPartitionLevelTransitionConstraint.java * helix-core/src/main/java/org/apache/helix/model/ClusterConstraints.java [HELIX-425]: Porting the fix to handle partition level constraints from 0.6. to 0.7 (g.kishore: rev 69db435724d7d3f6b2e6b208eadad8d6823fc320) * helix-core/src/test/java/org/apache/helix/integration/TestPartitionLevelTransitionConstraint.java [HELIX-425] Fixing formatting issues with the previous commit (g.kishore: rev cd1229e85d9241abd6746888d8acb9b4532fe1a5) * helix-core/src/main/java/org/apache/helix/model/ClusterConstraints.java * helix-core/src/test/java/org/apache/helix/integration/TestPartitionLevelTransitionConstraint.java * helix-core/src/main/java/org/apache/helix/api/config/ClusterConfig.java > 0.7 does not honor partition transition throttling correctly > > > Key: HELIX-425 > URL: https://issues.apache.org/jira/browse/HELIX-425 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala > > See http://markmail.org/message/t6codot5zjv3mah6 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-425) 0.7 does not honor partition transition throttling correctly
[ https://issues.apache.org/jira/browse/HELIX-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965549#comment-13965549 ] Hudson commented on HELIX-425: -- UNSTABLE: Integrated in helix #1250 (See [https://builds.apache.org/job/helix/1250/]) [HELIX-425] Fix bug in partition constraints causing CI failure (kanak: rev 2f04fcd0d8a38be60302adf8143973db239d1517) * helix-core/src/main/java/org/apache/helix/model/ClusterConstraints.java > 0.7 does not honor partition transition throttling correctly > > > Key: HELIX-425 > URL: https://issues.apache.org/jira/browse/HELIX-425 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala > > See http://markmail.org/message/t6codot5zjv3mah6 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-429) Upgrade restlet to 2.2.0
[ https://issues.apache.org/jira/browse/HELIX-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967635#comment-13967635 ] Hudson commented on HELIX-429: -- UNSTABLE: Integrated in helix #1251 (See [https://builds.apache.org/job/helix/1251/]) [HELIX-429] Upgrade restlet to 2.2.0 (kanak: rev a47ff2e1af6bd5b8868beb2ddf690f89596b4dea) * pom.xml * helix-core/pom.xml > Upgrade restlet to 2.2.0 > > > Key: HELIX-429 > URL: https://issues.apache.org/jira/browse/HELIX-429 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Fix For: 0.7.1, 0.6.4 > > > Restlet 2.1.4 can end up stalling requests intermittently and, worse, if > those stalls are canceled, CPU usage explodes. Restlet 2.2.0 has appeared to > have fixed those issues, so we should upgrade. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-427) Write a test for using preference lists as execution queues
[ https://issues.apache.org/jira/browse/HELIX-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968557#comment-13968557 ] Hudson commented on HELIX-427: -- UNSTABLE: Integrated in helix #1253 (See [https://builds.apache.org/job/helix/1253/]) [HELIX-427] Write a test for using preference lists as execution queues (kanak: rev 04a6021ed1ef4732c5e95f16255c8c639e7ba22d) * helix-core/src/test/java/org/apache/helix/integration/TestPreferenceListAsQueue.java > Write a test for using preference lists as execution queues > --- > > Key: HELIX-427 > URL: https://issues.apache.org/jira/browse/HELIX-427 > Project: Apache Helix > Issue Type: Task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-433) Untagging may fail in FULL_AUTO mode
[ https://issues.apache.org/jira/browse/HELIX-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974861#comment-13974861 ] Hudson commented on HELIX-433: -- UNSTABLE: Integrated in helix #1254 (See [https://builds.apache.org/job/helix/1254/]) [HELIX-433] Fix how FULL_AUTO responds to untagging (kanak: rev 5fd72204c27d7f5fc476fc5fb7dcf254da6ba13d) * helix-core/src/main/java/org/apache/helix/controller/strategy/AutoRebalanceStrategy.java * helix-core/src/test/java/org/apache/helix/integration/TestFullAutoNodeTagging.java > Untagging may fail in FULL_AUTO mode > > > Key: HELIX-433 > URL: https://issues.apache.org/jira/browse/HELIX-433 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > The full auto rebalance algorithm does not properly check nodes that are > untagged, leading to a possible NPE. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-427) Write a test for using preference lists as execution queues
[ https://issues.apache.org/jira/browse/HELIX-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974943#comment-13974943 ] Hudson commented on HELIX-427: -- UNSTABLE: Integrated in helix #1255 (See [https://builds.apache.org/job/helix/1255/]) [HELIX-427] Write a test for using preference lists as execution queues, fix CI (kanak.b: rev 884e071f3a9e2f25b241b4c6635052ebc23bb1b4) * helix-core/src/test/java/org/apache/helix/integration/TestPreferenceListAsQueue.java > Write a test for using preference lists as execution queues > --- > > Key: HELIX-427 > URL: https://issues.apache.org/jira/browse/HELIX-427 > Project: Apache Helix > Issue Type: Task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-416) Make the task framework more extensible
[ https://issues.apache.org/jira/browse/HELIX-416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057726#comment-14057726 ] Hudson commented on HELIX-416: -- UNSTABLE: Integrated in helix #1256 (See [https://builds.apache.org/job/helix/1256/]) [HELIX-416] Support recurring scheduled tasks (kanak: rev 0f79187d31c8769a668ba81f8bcc5e5831c659da) * helix-core/src/main/java/org/apache/helix/task/WorkflowContext.java * helix-core/src/main/java/org/apache/helix/task/WorkflowConfig.java * helix-core/src/main/java/org/apache/helix/task/TaskDriver.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/beans/WorkflowBean.java * helix-core/src/main/java/org/apache/helix/task/TaskConstants.java * helix-core/src/main/java/org/apache/helix/task/Workflow.java * helix-core/src/main/java/org/apache/helix/task/ScheduleConfig.java * helix-core/src/main/java/org/apache/helix/task/TaskUtil.java > Make the task framework more extensible > --- > > Key: HELIX-416 > URL: https://issues.apache.org/jira/browse/HELIX-416 > Project: Apache Helix > Issue Type: Improvement >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > The current task framework is good for the use case where we want to run > identical tasks according to a target resource's assignment. However, > realistically, we want things like: > - Each task partition can correspond to a different task > - Some task groups shouldn't have a status corresponding to them; they should > be able to take on additional task partitions dynamically > - There should be some notion of independence, in that a target resource (or > lack thereof) can say that arbitrary task partitions can be assigned to > arbitrary live participants > This is a pretty involved undertaking, so this will encompass some subtasks. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-440) Add scheduling layer to task framework
[ https://issues.apache.org/jira/browse/HELIX-440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057727#comment-14057727 ] Hudson commented on HELIX-440: -- UNSTABLE: Integrated in helix #1256 (See [https://builds.apache.org/job/helix/1256/]) [HELIX-440] One-time scheduling for task framework (kanak: rev 346d8a32ed91db9ce182d5cea911769a23654d0b) * helix-core/src/test/java/org/apache/helix/integration/task/TestIndependentTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/beans/WorkflowBean.java * helix-core/src/main/java/org/apache/helix/task/beans/ScheduleBean.java * helix-core/src/main/java/org/apache/helix/task/Workflow.java * helix-core/src/main/java/org/apache/helix/task/TaskUtil.java * helix-core/src/main/java/org/apache/helix/task/ScheduleConfig.java * helix-core/src/main/java/org/apache/helix/task/WorkflowConfig.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java > Add scheduling layer to task framework > -- > > Key: HELIX-440 > URL: https://issues.apache.org/jira/browse/HELIX-440 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > The task framework as-is is good for one-shot workflows, but it is useful to > also specify workflows that should run at a specific time, or even repeatedly > at a given cadence. > See https://cwiki.apache.org/confluence/display/HELIX/Scheduled+Tasks for > more information. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-438) Improve task framework retry logic
[ https://issues.apache.org/jira/browse/HELIX-438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057728#comment-14057728 ] Hudson commented on HELIX-438: -- UNSTABLE: Integrated in helix #1256 (See [https://builds.apache.org/job/helix/1256/]) [HELIX-438] Improve task framework retry logic (kanak: rev 0272e3701492fc738eadb878ddbc45b54d0ca62f) * helix-core/src/main/java/org/apache/helix/task/TaskRunner.java * helix-core/src/main/java/org/apache/helix/task/JobConfig.java * helix-core/src/test/java/org/apache/helix/integration/task/TestIndependentTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/beans/JobBean.java * helix-core/src/main/java/org/apache/helix/task/Workflow.java * helix-core/src/main/java/org/apache/helix/task/FixedTargetTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/GenericTaskRebalancer.java > Improve task framework retry logic > -- > > Key: HELIX-438 > URL: https://issues.apache.org/jira/browse/HELIX-438 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Support up to M local retries, N retries elsewhere (per task, configured per > job). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-439) Support thresholding for job success/failure
[ https://issues.apache.org/jira/browse/HELIX-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057729#comment-14057729 ] Hudson commented on HELIX-439: -- UNSTABLE: Integrated in helix #1256 (See [https://builds.apache.org/job/helix/1256/]) [HELIX-439] Support thresholding for job success/failure (kanak: rev c5921f4299cd3d6d6be1aed44053904e1aada53e) * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/test/java/org/apache/helix/integration/task/TestIndependentTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/JobConfig.java * helix-core/src/main/java/org/apache/helix/task/TaskConfig.java * helix-core/src/main/java/org/apache/helix/task/beans/TaskBean.java * helix-core/src/main/java/org/apache/helix/task/beans/JobBean.java * helix-core/src/main/java/org/apache/helix/task/Workflow.java > Support thresholding for job success/failure > > > Key: HELIX-439 > URL: https://issues.apache.org/jira/browse/HELIX-439 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Some jobs may not need every task to succeed. Either a sufficient proportion, > or certain specific tasks must succeed. Support the former at the job level > as a threshold, and the latter at the task level as a boolean. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-430) Restlet 2.2.0 causes failures
[ https://issues.apache.org/jira/browse/HELIX-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059085#comment-14059085 ] Hudson commented on HELIX-430: -- FAILURE: Integrated in helix #1257 (See [https://builds.apache.org/job/helix/1257/]) [HELIX-430] Fix test failures caused by restlet 2.2 (kanak: rev e914edb6b1796b82234a2555048654f3ae573369) * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestHelixAdminScenariosRest.java * helix-admin-webapp/helix-admin-webapp-0.7.1-incubating-SNAPSHOT.ivy * helix-core/helix-core-0.7.1-incubating-SNAPSHOT.ivy * pom.xml * helix-core/pom.xml > Restlet 2.2.0 causes failures > - > > Key: HELIX-430 > URL: https://issues.apache.org/jira/browse/HELIX-430 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Restlet 2.2.0 now returns 204 for empty responses, and seems to have broken > property transfer altogether. This needs to be resolved prior to future > releases. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-461) Add a partitions without top state metric
[ https://issues.apache.org/jira/browse/HELIX-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059089#comment-14059089 ] Hudson commented on HELIX-461: -- FAILURE: Integrated in helix #1257 (See [https://builds.apache.org/job/helix/1257/]) [HELIX-461] Add partitions without top state metric (kanak: rev 6d30c9c583b4b8aa1a74244269fa0f9f8ec87a40) * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestResourceMonitor.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterStatusMonitor.java * .gitignore * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ResourceMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ResourceMonitorMBean.java > Add a partitions without top state metric > - > > Key: HELIX-461 > URL: https://issues.apache.org/jira/browse/HELIX-461 > Project: Apache Helix > Issue Type: New Feature >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > We need a metric that measures how many partitions of a resource do not have > a replica in the "top" state, i.e. the state that is first in the state model > definition's priority list. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-455) Add REST API for submitting jobs
[ https://issues.apache.org/jira/browse/HELIX-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059088#comment-14059088 ] Hudson commented on HELIX-455: -- FAILURE: Integrated in helix #1257 (See [https://builds.apache.org/job/helix/1257/]) [HELIX-455] Add REST API for submitting jobs (kanak: rev 208f1fa5211774778fbe2f7ba2254b7c91eaa04c) * helix-admin-webapp/src/main/java/org/apache/helix/webapp/RestAdminApplication.java * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/WorkflowsResource.java > Add REST API for submitting jobs > > > Key: HELIX-455 > URL: https://issues.apache.org/jira/browse/HELIX-455 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > It should be a POST with YAML as input. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-444) add per-participant partition count gauges to helix
[ https://issues.apache.org/jira/browse/HELIX-444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059086#comment-14059086 ] Hudson commented on HELIX-444: -- FAILURE: Integrated in helix #1257 (See [https://builds.apache.org/job/helix/1257/]) [HELIX-444] add per-participant partition count gauges to helix, rb=21419 (kanak: rev 96aef71c899dc1f3956e1211fc1e9a7459a258d1) * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java * helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestResourceMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ResourceMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterStatusMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/PerInstanceResourceMonitorMBean.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/InstanceMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/PerInstanceResourceMonitor.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestClusterStatusMonitor.java * helix-core/src/main/java/org/apache/helix/api/State.java * helix-core/src/main/java/org/apache/helix/controller/stages/ClusterDataCache.java > add per-participant partition count gauges to helix > --- > > Key: HELIX-444 > URL: https://issues.apache.org/jira/browse/HELIX-444 > Project: Apache Helix > Issue Type: Improvement >Reporter: Zhen Zhang >Assignee: Zhen Zhang > > We need a way to pull the known down partition counts out of > DifferenceWithIdealState when an instance is offline, reducing the alert > volume to solely the down instance notification. Without metrics from helix > indicating the number of partitions hosted on a given participant, we can't > reason as to which "DifferenceWithIdealState" counts are supposed to be down > and which are an actually difference caused by something other than a node > outage. > These should be produced on a per-participant, per-resource basis (ie., > helix.i001.participantstatus.cluster.host.db.partitiongauge = 64 or whatever) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-94) Add the ability to enable and disable a resource
[ https://issues.apache.org/jira/browse/HELIX-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059090#comment-14059090 ] Hudson commented on HELIX-94: - FAILURE: Integrated in helix #1257 (See [https://builds.apache.org/job/helix/1257/]) [HELIX-94] Add the ability to enable and disable a resource, rb=20401 (kanak: rev c1af744af6088ad98fe2a8a5074f2c56199b6f82) * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/ResourceGroupResource.java * helix-core/src/main/java/org/apache/helix/model/IdealState.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/CustomRebalancer.java * helix-core/src/main/java/org/apache/helix/HelixAdmin.java * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/JsonParameters.java * helix-core/src/test/java/org/apache/helix/controller/strategy/TestNewAutoRebalanceStrategy.java * helix-core/src/main/java/org/apache/helix/participant/HelixCustomCodeRunner.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixAdmin.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestDisableResource.java * helix-core/src/main/java/org/apache/helix/tools/ClusterSetup.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/FallbackRebalancer.java * helix-core/src/test/java/org/apache/helix/integration/TestDisableResource.java * helix-core/src/test/java/org/apache/helix/integration/TestDisableCustomCodeRunner.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/FullAutoRebalancer.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/SemiAutoRebalancer.java * helix-core/src/test/java/org/apache/helix/controller/strategy/TestAutoRebalanceStrategy.java * helix-core/src/test/java/org/apache/helix/tools/TestClusterSetup.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkHelixAdmin.java * helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/SemiAutoRebalancerConfig.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/util/ConstraintBasedAssignment.java > Add the ability to enable and disable a resource > > > Key: HELIX-94 > URL: https://issues.apache.org/jira/browse/HELIX-94 > Project: Apache Helix > Issue Type: Sub-task > Components: helix-core >Affects Versions: 0.6.0-incubating >Reporter: Vinayak Borkar > > It would be useful to provide a way to enable and disable resource just as > there are ways to enable/disable partitions and instances. > Initially, when a new resource is created, it should start in the disabled > state. The user will be required to explicitly enable the resource in order > for it to participate in External View computation. This will provide a clean > interface for users to add new resources and configure them fully before they > are made "visible" to the cluster to provide an "atomic" view of a configured > resource. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-446) Remove ZkPropertyTransfer and restlet dependency from helix-core
[ https://issues.apache.org/jira/browse/HELIX-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059087#comment-14059087 ] Hudson commented on HELIX-446: -- FAILURE: Integrated in helix #1257 (See [https://builds.apache.org/job/helix/1257/]) [HELIX-446] Remove ZkPropertyTransfer and restlet dependency from helix-core (kanak: rev 85277291607154f6d63ce0a8e401e221e55cc95c) * helix-core/src/test/java/org/apache/helix/integration/TestZkCallbackHandlerLeak.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestAlertFireHistory.java * helix-core/src/main/java/org/apache/helix/controller/restlet/ZNRecordUpdate.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkStateChangeListener.java * helix-core/src/test/java/org/apache/helix/integration/TestDropResource.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZNRecordStreamingSerializer.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixDataAccessor.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestZkCallbackHandlerLeak.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZKPropertyTransferServer.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestDistributedControllerManager.java * helix-core/src/main/java/org/apache/helix/controller/restlet/ZNRecordUpdateResource.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixLeaderElection.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java * helix-core/src/main/java/org/apache/helix/controller/restlet/package-info.java * helix-core/src/main/java/org/apache/helix/controller/restlet/ZkPropertyTransferApplication.java * helix-core/src/test/java/org/apache/helix/integration/TestAutoRebalancePartitionLimit.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestLiveInstanceBounce.java * helix-core/src/main/java/org/apache/helix/controller/restlet/ZkPropertyTransferClient.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixParticipant.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestAlertActionTriggering.java * helix-core/src/test/java/org/apache/helix/integration/ZkStandAloneCMTestBaseWithPropertyServerCheck.java * helix-core/src/main/java/org/apache/helix/manager/zk/ParticipantManagerHelper.java * helix-core/src/test/java/org/apache/helix/integration/TestMessagingService.java * helix-core/src/test/java/org/apache/helix/integration/TestDisableNode.java * helix-core/pom.xml * helix-core/src/test/java/org/apache/helix/integration/manager/TestConsecutiveZkSessionExpiry.java * helix-core/src/test/java/org/apache/helix/integration/TestUserDefRebalancerCompatibility.java * helix-core/src/main/java/org/apache/helix/controller/restlet/ZKPropertyTransferServer.java * helix-core/src/main/java/org/apache/helix/controller/HelixControllerMain.java * helix-core/src/test/java/org/apache/helix/integration/TestDisablePartition.java * helix-core/src/main/java/org/apache/helix/PropertyType.java * helix-core/src/test/java/org/apache/helix/integration/TestSchedulerMessage.java * helix-core/src/test/java/org/apache/helix/integration/TestAutoRebalance.java * helix-core/src/test/java/org/apache/helix/integration/TestCustomizedIdealStateRebalancer.java > Remove ZkPropertyTransfer and restlet dependency from helix-core > > > Key: HELIX-446 > URL: https://issues.apache.org/jira/browse/HELIX-446 > Project: Apache Helix > Issue Type: Improvement >Reporter: Zhen Zhang >Assignee: Zhen Zhang > > Remove ZkPropertyTransfer from helix-core > Remove restlet dependency from helix-core -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-130) ZkDumper should provide a copy option
[ https://issues.apache.org/jira/browse/HELIX-130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059314#comment-14059314 ] Hudson commented on HELIX-130: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-130] Add a zk copy tool, rb=22986 (kanak: rev 7d04053d39c42c1425b0d780be088c2b1971652a) * helix-core/src/main/java/org/apache/helix/tools/ZkCopy.java * helix-core/pom.xml * helix-core/src/test/java/org/apache/helix/tools/TestZkCopy.java > ZkDumper should provide a copy option > - > > Key: HELIX-130 > URL: https://issues.apache.org/jira/browse/HELIX-130 > Project: Apache Helix > Issue Type: New Feature >Reporter: Zhen Zhang >Assignee: Zhen Zhang > Labels: newbie > > Normally people using zkdumper in order to copy some zk paths from source to > destination. it will be handy to provide a copy option in zkdumper instead of > using download and upload -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-445) NPE in ZkPathDataDumpTask
[ https://issues.apache.org/jira/browse/HELIX-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059311#comment-14059311 ] Hudson commented on HELIX-445: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-445] NPE in ZkPathDataDumpTask, rb=21504 (kanak: rev 33c2f15ca825e2d6bd5bc2b07093b3eaebbb84f3) * helix-core/src/test/java/org/apache/helix/integration/manager/MockParticipantManager.java * pom.xml * helix-core/src/main/java/org/apache/helix/PropertyKey.java * helix-core/src/main/java/org/apache/helix/monitoring/ZKPathDataDumpTask.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockJobIntf.java * helix-core/src/test/java/org/apache/helix/monitoring/TestParticipantMonitor.java * helix-core/src/test/java/org/apache/helix/integration/TestSchedulerMessage.java * helix-core/src/test/java/org/apache/helix/monitoring/TestZKPathDataDumpTask.java * helix-core/src/test/java/org/apache/helix/monitoring/TestStatCollector.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixCustomCodeRunner.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java * helix-core/pom.xml > NPE in ZkPathDataDumpTask > - > > Key: HELIX-445 > URL: https://issues.apache.org/jira/browse/HELIX-445 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Zhen Zhang > Original Estimate: 24h > Remaining Estimate: 24h > > NPE in ZkPathDataDumpTask -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-395) Remove old Helix alert/stat modules
[ https://issues.apache.org/jira/browse/HELIX-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059312#comment-14059312 ] Hudson commented on HELIX-395: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-395] Remove old Helix alert/stat modules (kanak: rev 38b439651b4f2ce33f1dbdb96b0f626a1ca49514) * helix-core/src/main/java/org/apache/helix/alerts/DecayAggregator.java * helix-core/src/main/java/org/apache/helix/util/HelixUtil.java * helix-core/src/main/java/org/apache/helix/HealthStateChangeListener.java * helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java * helix-core/src/main/java/org/apache/helix/alerts/AlertComparator.java * helix-core/src/main/java/org/apache/helix/healthcheck/PerformanceHealthReportProvider.java * helix-core/src/main/java/org/apache/helix/healthcheck/AggregationTypeFactory.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixParticipant.java * helix-core/src/main/java/org/apache/helix/alerts/Operator.java * helix-core/src/main/java/org/apache/helix/alerts/AlertValueAndStatus.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestSimpleAlert.java * helix-core/src/main/java/org/apache/helix/model/HealthStat.java * helix-core/src/main/java/org/apache/helix/HelixAdmin.java * helix-core/src/test/java/org/apache/helix/TestPerformanceHealthReportProvider.java * helix-core/src/main/java/org/apache/helix/alerts/ExpandOperator.java * helix-core/src/main/java/org/apache/helix/manager/zk/HelixConnectionAdaptor.java * helix-core/src/main/java/org/apache/helix/alerts/DivideOperator.java * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java * helix-core/src/main/java/org/apache/helix/HelixConnection.java * helix-core/src/main/java/org/apache/helix/healthcheck/ParticipantHealthReportCollector.java * helix-core/src/test/java/org/apache/helix/TestPerfCounters.java * helix-core/src/main/java/org/apache/helix/healthcheck/package-info.java * helix-core/src/main/java/org/apache/helix/healthcheck/DecayAggregationType.java * helix-core/src/main/java/org/apache/helix/alerts/Tuple.java * helix-core/src/main/java/org/apache/helix/PropertyPathConfig.java * helix-core/src/main/java/org/apache/helix/healthcheck/HealthStatsAggregationTask.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestExpandAlert.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockEspressoHealthReportProvider.java * helix-core/src/main/java/org/apache/helix/controller/stages/ReadHealthDataStage.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestStalenessAlert.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestSimpleWildcardAlert.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestWildcardAlert.java * helix-core/src/test/java/org/apache/helix/participant/MockZKHelixManager.java * helix-core/src/main/java/org/apache/helix/alerts/AlertParser.java * helix-core/src/main/java/org/apache/helix/healthcheck/ParticipantHealthReportTask.java * helix-core/src/main/java/org/apache/helix/alerts/Aggregator.java * helix-core/src/main/java/org/apache/helix/alerts/ExpressionParser.java * helix-core/src/main/java/org/apache/helix/healthcheck/StatHealthReportProvider.java * helix-core/src/main/java/org/apache/helix/alerts/MultiplyOperator.java * helix-core/src/main/java/org/apache/helix/healthcheck/HealthReportProvider.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestParseInfoFromAlert.java * helix-core/src/test/java/org/apache/helix/alerts/TestArrivingParticipantStats.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterAlertItem.java * helix-core/src/main/java/org/apache/helix/alerts/ExpressionOperatorType.java * helix-core/src/test/java/org/apache/helix/healthcheck/TestAddDropAlert.java * helix-core/src/main/java/org/apache/helix/alerts/AccumulateAggregator.java * helix-core/src/main/java/org/apache/helix/healthcheck/ParticipantHealthReportCollectorImpl.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockHealthReportParticipant.java * helix-core/src/test/java/org/apache/helix/alerts/TestBaseStatsValidation.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkCallbackHandler.java * helix-core/src/test/java/org/apache/helix/alerts/TestStatsMatch.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterAlertMBeanCollection.java * helix-core/src/main/java/org/apache/helix/alerts/StatsHolder.java * helix-core/src/test/java/org/apache/helix/TestParticipantHealthReportCollectorImpl.java * helix-core/src/test/java/org/apache/helix/alerts/TestAlertValidation.java * helix-core/src/test/java/org/apache/helix/controller/stages/DummyClusterManager.java * helix-core/src/test/java/org/apache/helix/alerts/TestAddAlerts.ja
[jira] [Commented] (HELIX-466) Speed up zkcopy by using asyn read/write
[ https://issues.apache.org/jira/browse/HELIX-466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059318#comment-14059318 ] Hudson commented on HELIX-466: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-466] Speed up zkcopy by using asyn read/write, rb=23241 (kanak: rev 28a8f20d8f88781e9798d4cfc6439246977716a0) * helix-core/src/main/java/org/apache/helix/tools/ZkCopy.java > Speed up zkcopy by using asyn read/write > > > Key: HELIX-466 > URL: https://issues.apache.org/jira/browse/HELIX-466 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Zhen Zhang > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-464) rabbitmq recipe is broken
[ https://issues.apache.org/jira/browse/HELIX-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059316#comment-14059316 ] Hudson commented on HELIX-464: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-464] rabbitmq recipe is broken, rb=23099 (kanak: rev 63f084bd2d1ebb06d41edc1aa74754410998878b) * recipes/rabbitmq-consumer-group/bin/log4j.xml * recipes/rabbitmq-consumer-group/pom.xml * recipes/rabbitmq-consumer-group/bin/send-message.sh * recipes/rabbitmq-consumer-group/bin/setup-cluster.sh * recipes/rabbitmq-consumer-group/bin/start-consumer.sh * recipes/rabbitmq-consumer-group/bin/start-cluster-manager.sh * recipes/rabbitmq-consumer-group/src/main/config/log4j.properties > rabbitmq recipe is broken > - > > Key: HELIX-464 > URL: https://issues.apache.org/jira/browse/HELIX-464 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Zhen Zhang > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-453) On session expiry/recovery, not all message types are re-registered
[ https://issues.apache.org/jira/browse/HELIX-453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059315#comment-14059315 ] Hudson commented on HELIX-453: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-453] On session expiry/recovery, not all message types are re-registered, rb=22432 (kanak: rev 0ee1cdc42d97068924c8d978e68ae78f606d44a5) * helix-core/src/test/java/org/apache/helix/integration/TestZkSessionExpiry.java * recipes/jobrunner-yarn/pom.xml * helix-core/src/main/java/org/apache/helix/messaging/handling/HelixTaskExecutor.java * recipes/helloworld-provisioning-yarn/pom.xml > On session expiry/recovery, not all message types are re-registered > --- > > Key: HELIX-453 > URL: https://issues.apache.org/jira/browse/HELIX-453 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Zhen Zhang > > When the session expires, we unregister all message types. When a new session > is started, we only add back state transition messages and scheduler task > messages. We should be able to add back everything that was registered and > not removed. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-463) Add gauges for participant and controller message queue sizes
[ https://issues.apache.org/jira/browse/HELIX-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059317#comment-14059317 ] Hudson commented on HELIX-463: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-463] Create useful message queue length jmx (kanak: rev 2ccaa6b434e48415cc56e6e9dbb663a5a289e960) * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/MessageQueueMonitor.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/MessageQueueMonitorMBean.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterStatusMonitor.java * helix-core/src/main/java/org/apache/helix/messaging/handling/HelixTaskExecutor.java * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterStatusMonitorMBean.java [HELIX-463] Create useful message queue length jmx, update count (kanak: rev c24a7301297382823f3063660d77e5af31f6f95e) * helix-core/src/main/java/org/apache/helix/messaging/handling/HelixTaskExecutor.java > Add gauges for participant and controller message queue sizes > - > > Key: HELIX-463 > URL: https://issues.apache.org/jira/browse/HELIX-463 > Project: Apache Helix > Issue Type: New Feature >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > There needs to be greater visibility into how long message queues are for > each Helix participant and controller. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-380) Incompatibility issue with HELIX_PROPERTYSTORE
[ https://issues.apache.org/jira/browse/HELIX-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059313#comment-14059313 ] Hudson commented on HELIX-380: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-380] Incompatibility issue with HELIX_PROPERTYSTORE, rb=18053 (kanak: rev 35e3ca10ef16f8e594ee5823978e5041afdbf987) * helix-core/src/main/java/org/apache/helix/store/zk/AutoFallbackPropertyStore.java * helix-core/src/test/java/org/apache/helix/store/zk/TestAutoFallbackPropertyStore.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkCacheBaseDataAccessor.java * helix-core/src/test/java/org/apache/helix/store/zk/TestZkManagerWithAutoFallbackStore.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkBaseDataAccessor.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java [HELIX-380] Incompatibility issue with HELIX_PROPERTYSTORE, HelixConnection port (kanak: rev 9524e510304152f249b51a19b12d287810be4712) * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java > Incompatibility issue with HELIX_PROPERTYSTORE > -- > > Key: HELIX-380 > URL: https://issues.apache.org/jira/browse/HELIX-380 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang > Fix For: 0.6.3 > > > We used HELIX_PROPERTYSOTRE in 0.6.1 and in 0.6.2 we switched back to > PROPERTYSTORE for the property store retrieved from ZkHelixManager. This > creates incompatibility issues when upgrading to 0.6.2. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-443) Race condition in Helix register/unregister MessageHandlerFactory
[
https://issues.apache.org/jira/browse/HELIX-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059310#comment-14059310
]
Hudson commented on HELIX-443:
--
FAILURE: Integrated in helix #1258 (See
[https://builds.apache.org/job/helix/1258/])
[HELIX-443] Race condition in Helix register/unregister MessageHandlerFactory,
rb=21248 (kanak: rev fdee2dd73dcb074a1e689e2431134edee9104768)
*
helix-core/src/main/java/org/apache/helix/messaging/handling/HelixTaskExecutor.java
> Race condition in Helix register/unregister MessageHandlerFactory
> -
>
> Key: HELIX-443
> URL: https://issues.apache.org/jira/browse/HELIX-443
> Project: Apache Helix
> Issue Type: Bug
>Reporter: Zhen Zhang
>Assignee: Zhen Zhang
>
> When zk session expiry happens, we will reset all the listeners including
> HelixTaskExecutor (which is a message listener on Helix participant). The
> reset() will call HelixTaskExecutor#unregisterMessageHandlerFactory() which
> has the logic that if the executor is not terminated in 200ms, it will throw
> an exception, which will in turn, skip removing MssageHandlerFactory from
> handler-factory map.
> {noformat}
> void unregisterMessageHandlerFactory(String type) {
> // shutdown executor-service. disconnect if fail
> ExecutorService executorSvc = _executorMap.remove(type);
> if (executorSvc != null) {
> List tasksLeft = executorSvc.shutdownNow();
> LOG.info(tasksLeft.size() + " tasks never executed for msgType: " +
> type + ". tasks: "
> + tasksLeft);
> try {
> if (!executorSvc.awaitTermination(200, TimeUnit.MILLISECONDS)) {
> LOG.error("executor-service for msgType: " + type
> + " is not fully terminated in 200ms. will disconnect
> helix-participant");
> throw new HelixException("fail to unregister msg-handler for
> msgType: " + type);
> }
> } catch (InterruptedException e) {
> LOG.error("interruped when waiting for executor-service shutdown for
> msgType: " + type, e);
> }
> }
> // reset state-model
> MessageHandlerFactory handlerFty = _handlerFactoryMap.remove(type);
> if (handlerFty != null) {
> handlerFty.reset();
> }
> }
> {noformat}
> When we re-connect to zk, we re-register message-handler factory, which first
> checks if the message-handler factory exists and then adds an executor:
> {noformat}
> public void registerMessageHandlerFactory(String type,
> MessageHandlerFactory factory,
> int threadpoolSize) {
> if (!_handlerFactoryMap.containsKey(type)) {
> if (!type.equalsIgnoreCase(factory.getMessageType())) {
> throw new HelixException("Message factory type mismatch. Type: " +
> type + " factory : "
> + factory.getMessageType());
> }
> _handlerFactoryMap.put(type, factory);
> ExecutorService executorSvc =
> Executors.newFixedThreadPool(threadpoolSize);
> _executorMap.put(type, executorSvc);
> LOG.info("Added msg-factory for type: " + type + ", threadpool size " +
> threadpoolSize);
> } else {
> LOG.warn("Fail to register msg-handler-factory for type: " + type + ",
> pool-size: "
> + threadpoolSize + ", factory: " + factory);
> }
> }
> {noformat}
> So if we fail to remove message-handler factory, we will fail to register
> executor, which will lead to NPE when we receive a message:
> {noformat}
> java.lang.NullPointerException
> at
> org.apache.helix.messaging.handling.HelixTaskExecutor.scheduleTask(HelixTaskExecutor.java:243)
> at
> org.apache.helix.messaging.handling.HelixTaskExecutor.onMessage(HelixTaskExecutor.java:531)
> at
> org.apache.helix.manager.zk.CallbackHandler.invoke(CallbackHandler.java:195)
> at
> org.apache.helix.manager.zk.CallbackHandler.handleChildChange(CallbackHandler.java:404)
> at org.I0Itec.zkclient.ZkClient$7.run(ZkClient.java:568)
> at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HELIX-465) ZkCopy skips paths already exist in destination namespace
[ https://issues.apache.org/jira/browse/HELIX-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059319#comment-14059319 ] Hudson commented on HELIX-465: -- FAILURE: Integrated in helix #1258 (See [https://builds.apache.org/job/helix/1258/]) [HELIX-465] ZkCopy skips paths already exist in destination namespace, rb=23184 (kanak: rev 506dc298df4ba8d569c3339d3f2ae9d1ca8895b3) * helix-core/src/main/java/org/apache/helix/tools/ZkCopy.java * helix-core/src/test/java/org/apache/helix/tools/TestZkCopy.java > ZkCopy skips paths already exist in destination namespace > - > > Key: HELIX-465 > URL: https://issues.apache.org/jira/browse/HELIX-465 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Zhen Zhang > > Normally the parent root node already exists in the destination namespace. > It's more convenient to skip copying the existing nodes instead of throw an > exception and stop copying. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-380) Incompatibility issue with HELIX_PROPERTYSTORE
[ https://issues.apache.org/jira/browse/HELIX-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059439#comment-14059439 ] Hudson commented on HELIX-380: -- FAILURE: Integrated in helix #1259 (See [https://builds.apache.org/job/helix/1259/]) [HELIX-380] Incompatibility issue with HELIX_PROPERTYSTORE, fix rat (kanak: rev 639f2f8a6aae8d239b1483b761686d3b600a4aca) * helix-core/src/test/java/org/apache/helix/store/zk/TestZkManagerWithAutoFallbackStore.java * helix-core/src/test/java/org/apache/helix/store/zk/TestAutoFallbackPropertyStore.java > Incompatibility issue with HELIX_PROPERTYSTORE > -- > > Key: HELIX-380 > URL: https://issues.apache.org/jira/browse/HELIX-380 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang > Fix For: 0.6.3 > > > We used HELIX_PROPERTYSOTRE in 0.6.1 and in 0.6.2 we switched back to > PROPERTYSTORE for the property store retrieved from ZkHelixManager. This > creates incompatibility issues when upgrading to 0.6.2. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-455) Add REST API for submitting jobs
[ https://issues.apache.org/jira/browse/HELIX-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062476#comment-14062476 ] Hudson commented on HELIX-455: -- UNSTABLE: Integrated in helix #1261 (See [https://builds.apache.org/job/helix/1261/]) [HELIX-455] Add REST API for submitting jobs, add license header (kanak: rev 00217c64d21023017c78c79939ca3a999da609f8) * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/WorkflowsResource.java > Add REST API for submitting jobs > > > Key: HELIX-455 > URL: https://issues.apache.org/jira/browse/HELIX-455 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > It should be a POST with YAML as input. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-448) Call onCallback for CustomCodeCallbackHandler for FINALIZE type
[ https://issues.apache.org/jira/browse/HELIX-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062478#comment-14062478 ] Hudson commented on HELIX-448: -- UNSTABLE: Integrated in helix #1261 (See [https://builds.apache.org/job/helix/1261/]) [HELIX-448] Call onCallback for CustomCodeCallbackHandler for FINALIZE (kanak: rev 67be36e02cf8197c9fa19986040636b960463a3f) * helix-core/src/test/java/org/apache/helix/integration/TestDisableCustomCodeRunner.java * helix-core/src/main/java/org/apache/helix/participant/CustomCodeInvoker.java > Call onCallback for CustomCodeCallbackHandler for FINALIZE type > --- > > Key: HELIX-448 > URL: https://issues.apache.org/jira/browse/HELIX-448 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Many use cases assume that onCallback will be invoked with type FINALIZE when > leadership is lost so that there is an opportunity to clean up. However, this > is not the case, and the previous leader has no idea that it's not leader > anymore. > Long term the right thing to do is to split onCallback into 3 different > methods, but for now, we should also invoke onCallback with the appropriate > type, since this seems to be the expected behavior. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-452) Increase frequency of status update cleanup
[ https://issues.apache.org/jira/browse/HELIX-452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062477#comment-14062477 ] Hudson commented on HELIX-452: -- UNSTABLE: Integrated in helix #1261 (See [https://builds.apache.org/job/helix/1261/]) [HELIX-452] Increase frequency of status update cleanup (kanak: rev ff900705fab53ebb386a91314faad7773ce964f0) * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java * helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java * helix-core/src/main/java/org/apache/helix/manager/zk/ControllerManagerHelper.java [HELIX-452] Increase frequency of status update cleanup, 0.7 fix (kanak: rev a9e96ea069c8eb7e106f14ca3331518048dd7cdd) * helix-core/src/main/java/org/apache/helix/monitoring/ZKPathDataDumpTask.java * helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java > Increase frequency of status update cleanup > --- > > Key: HELIX-452 > URL: https://issues.apache.org/jira/browse/HELIX-452 > Project: Apache Helix > Issue Type: Improvement >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-132) current-state and external-view are not cleaned up when a resource has been removed
[ https://issues.apache.org/jira/browse/HELIX-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063813#comment-14063813 ] Hudson commented on HELIX-132: -- SUCCESS: Integrated in helix #1262 (See [https://builds.apache.org/job/helix/1262/]) [HELIX-132] current-state and external-view are not cleaned up when a resource has been removed, rb=21666 (zzhang: rev b470ababa8727fc5534bc8dc00b3f4a3cd9076e8) * helix-core/src/main/java/org/apache/helix/controller/stages/ResourceComputationStage.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixDataAccessor.java * helix-core/src/test/java/org/apache/helix/integration/TestDrop.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java * helix-core/src/main/java/org/apache/helix/GroupCommit.java > current-state and external-view are not cleaned up when a resource has been > removed > --- > > Key: HELIX-132 > URL: https://issues.apache.org/jira/browse/HELIX-132 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Zhen Zhang > Labels: newbie > > we leave an empty current-state and external-view when a resource has been > dropped. for systems that frequently add/drop resources, this leave many > empty znodes under current-state and external-view. we need: > 1) fix this in helix > 2) have a tool that auto clean current-state and external-view for dropped > resources -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-473) TestLocalContainerProvider is slow and flaky
[ https://issues.apache.org/jira/browse/HELIX-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063939#comment-14063939 ] Hudson commented on HELIX-473: -- SUCCESS: Integrated in helix #1263 (See [https://builds.apache.org/job/helix/1263/]) [HELIX-473] Make TestLocalContainerProvider less flaky (kanak: rev 3c9697c4b8fa7748a8ffe2d798bc3effd72f0740) * helix-core/src/test/java/org/apache/helix/integration/TestLocalContainerProvider.java > TestLocalContainerProvider is slow and flaky > > > Key: HELIX-473 > URL: https://issues.apache.org/jira/browse/HELIX-473 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > This test starts and stops 10 participants, and the wait threshold isn't long > enough. Realistically, we don't even need to have that many participants to > verify correctness. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-472) Errors should be cleaned up less frequently
[ https://issues.apache.org/jira/browse/HELIX-472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064043#comment-14064043 ] Hudson commented on HELIX-472: -- UNSTABLE: Integrated in helix #1264 (See [https://builds.apache.org/job/helix/1264/]) [HELIX-472] Errors should be cleaned up less frequently (kanak: rev f952cb7606f6de91dbba4f5e4597e45259ec5bf6) * helix-core/src/test/java/org/apache/helix/integration/TestSchedulerMessage.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java * helix-core/src/main/java/org/apache/helix/monitoring/ZKPathDataDumpTask.java * helix-core/src/test/java/org/apache/helix/monitoring/TestZKPathDataDumpTask.java > Errors should be cleaned up less frequently > --- > > Key: HELIX-472 > URL: https://issues.apache.org/jira/browse/HELIX-472 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > As part of HELIX-452, we decreased the status update cleanup window to 15 > minutes and the error cleanup window to 45 minutes. This makes it more > troublesome trying to look back and find historical errors, and these are > proportional to numPartitions * numSessionsInWindow number of znodes (much > less than number of possible status updates). We should increase the error > cleanup threshold to a day. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-471) ResourceMonitor never unregistered even if the resource is dropped
[ https://issues.apache.org/jira/browse/HELIX-471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064042#comment-14064042 ] Hudson commented on HELIX-471: -- UNSTABLE: Integrated in helix #1264 (See [https://builds.apache.org/job/helix/1264/]) [HELIX-471] Unregister ResourceMonitor on drop (kanak: rev 8f90279b062408e08c17aa5473d41506f3e39ba3) * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestDropResourceMetricsReset.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterStatusMonitor.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java > ResourceMonitor never unregistered even if the resource is dropped > -- > > Key: HELIX-471 > URL: https://issues.apache.org/jira/browse/HELIX-471 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > When we drop a resource, we should remove the registered bean containing > metrics specific to that resource. Right now, it just stays around without > being updated. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-471) ResourceMonitor never unregistered even if the resource is dropped
[ https://issues.apache.org/jira/browse/HELIX-471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064105#comment-14064105 ] Hudson commented on HELIX-471: -- UNSTABLE: Integrated in helix #1265 (See [https://builds.apache.org/job/helix/1265/]) [HELIX-471] Unregister ResourceMonitor on drop, reduce test flakiness (kanak: rev e5e3a7d42e3f5b5f350bde91b12639a4795ccec5) * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestDropResourceMetricsReset.java > ResourceMonitor never unregistered even if the resource is dropped > -- > > Key: HELIX-471 > URL: https://issues.apache.org/jira/browse/HELIX-471 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > When we drop a resource, we should remove the registered bean containing > metrics specific to that resource. Right now, it just stays around without > being updated. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-471) ResourceMonitor never unregistered even if the resource is dropped
[ https://issues.apache.org/jira/browse/HELIX-471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064235#comment-14064235 ] Hudson commented on HELIX-471: -- SUCCESS: Integrated in helix #1266 (See [https://builds.apache.org/job/helix/1266/]) [HELIX-471] Unregister ResourceMonitor on drop, reduce more test flakiness (kanak: rev 3534e645202dedb215a10f744b9666c25d6a8c48) * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java > ResourceMonitor never unregistered even if the resource is dropped > -- > > Key: HELIX-471 > URL: https://issues.apache.org/jira/browse/HELIX-471 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > When we drop a resource, we should remove the registered bean containing > metrics specific to that resource. Right now, it just stays around without > being updated. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-475) Remove code duplication for Zk tests
[ https://issues.apache.org/jira/browse/HELIX-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14070717#comment-14070717 ] Hudson commented on HELIX-475: -- SUCCESS: Integrated in helix #1267 (See [https://builds.apache.org/job/helix/1267/]) [HELIX-475] Remove code duplication for Zk tests (zzhang: rev 410815d0fbbdceaffa0664be69266b1c74a3e985) * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestResetResource.java * helix-core/src/main/java/org/apache/helix/tools/ClusterStateVerifier.java * helix-core/src/test/java/org/apache/helix/integration/TestExternalViewUpdates.java * helix-core/src/test/java/org/apache/helix/integration/TestSwapInstance.java * helix-core/src/test/java/org/apache/helix/TestHelper.java * helix-core/src/test/java/org/apache/helix/integration/TestInstanceAutoJoin.java * helix-core/src/test/java/org/apache/helix/integration/TestEnablePartitionDuringDisable.java * helix-core/src/test/java/org/apache/helix/integration/TestZkCallbackHandlerLeak.java * helix-core/src/test/java/org/apache/helix/integration/TestAutoIsWithEmptyMap.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixCustomCodeRunner.java * helix-core/src/test/java/org/apache/helix/integration/TestCarryOverBadCurState.java * helix-core/src/test/java/org/apache/helix/integration/TestCMWithFailParticipant.java * helix-core/src/test/java/org/apache/helix/TestConfigAccessor.java * helix-core/src/test/java/org/apache/helix/integration/ZkStandAloneCMTestBase.java * helix-core/src/test/java/org/apache/helix/integration/TestStateTransitionTimeout.java * helix-core/src/test/java/org/apache/helix/tools/TestClusterStateVerifier.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkCacheSyncOpSingleThread.java * helix-core/src/test/java/org/apache/helix/api/accessor/TestAccessorRecreate.java * helix-core/src/test/java/org/apache/helix/tools/TestZkCopy.java * helix-core/src/test/java/org/apache/helix/integration/TestSchedulerMessage.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkHelixAdmin.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestResetInstance.java * helix-core/src/test/java/org/apache/helix/integration/TestFullAutoNodeTagging.java * helix-core/src/test/java/org/apache/helix/TestListenerCallback.java * helix-core/src/test/java/org/apache/helix/tools/TestHelixAdminCli.java * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java * helix-core/src/test/java/org/apache/helix/integration/TestInvalidAutoIdealState.java * helix-core/src/test/java/org/apache/helix/integration/TestMessageThrottle.java * helix-core/src/test/java/org/apache/helix/integration/task/TestTaskRebalancerStopResume.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/AdminTestBase.java * helix-core/src/test/java/org/apache/helix/integration/TestStandAloneCMMain.java * helix-core/src/test/java/org/apache/helix/participant/TestDistControllerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/TestHierarchicalDataStore.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestConsecutiveZkSessionExpiry.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkManagerFlappingDetection.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestDistributedControllerManager.java * helix-core/src/test/java/org/apache/helix/integration/TestSchemataSM.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestResetPartitionState.java * helix-core/src/test/java/org/apache/helix/integration/TestDisableResource.java * helix-core/src/test/java/org/apache/helix/integration/TestZkSessionExpiry.java * helix-core/src/test/java/org/apache/helix/testutil/ZkTestBase.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkHelixController.java * helix-core/src/test/java/org/apache/helix/integration/TestResetPartitionState.java * helix-core/src/test/java/org/apache/helix/TestHelixConfigAccessor.java * helix-core/src/test/java/org/apache/helix/lock/zk/TestZKHelixLock.java * helix-core/src/test/java/org/apache/helix/messaging/handling/TestConfigThreadpoolSize.java * helix-core/src/test/java/org/apache/helix/integration/TestRenamePartition.java * helix-core/src/test/java/org/apache/helix/integration/TestPartitionLevelTransitionConstraint.java * helix-core/src/test/java/org/apache/helix/integration/TestNonOfflineInitState.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkHelixAutoController.java * helix-core/src/test/java/org/apache/helix/TestZKCallback.java * helix-agent/src/test/java/org/apache/helix/agent/TestHelixAgent.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZKUtil.java * helix-core/src/test/java/org/apache/helix/integration/TestDistributedCMMain.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestMessageThrottleStage.java * heli
[jira] [Commented] (HELIX-389) Unify (Cluster|Resource|Participant)Accessor classes into a single Administrator class
[ https://issues.apache.org/jira/browse/HELIX-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072382#comment-14072382 ] Hudson commented on HELIX-389: -- SUCCESS: Integrated in helix #1268 (See [https://builds.apache.org/job/helix/1268/]) [HELIX-389] Unify accessor classes into a single class (kanak: rev ce1e926c9c485ac6e87a4c41a3cb5c35bd681e39) * helix-core/src/main/java/org/apache/helix/controller/stages/CurrentStateComputationStage.java * helix-core/src/test/java/org/apache/helix/integration/TestCustomizedIdealStateRebalancer.java * helix-core/src/test/java/org/apache/helix/api/accessor/TestAccessorRecreate.java * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java * helix-core/src/main/java/org/apache/helix/api/accessor/ControllerAccessor.java * helix-core/src/test/java/org/apache/helix/integration/TestLocalContainerProvider.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java * helix-core/src/main/java/org/apache/helix/controller/stages/ResourceComputationStage.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/tools/UpdateProvisionerConfig.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationStage.java * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestClusterStatusMonitor.java * helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java * helix-core/src/main/java/org/apache/helix/api/config/ResourceConfig.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/AppStatusReportGenerator.java * helix-core/src/test/java/org/apache/helix/api/TestNewStages.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixParticipant.java * helix-core/src/main/java/org/apache/helix/tools/NewClusterSetup.java * helix-core/src/main/java/org/apache/helix/model/IdealState.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicResourceAccessor.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixConnection.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicParticipantAccessor.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/SemiAutoRebalancer.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/FullAutoRebalancer.java * helix-core/src/main/java/org/apache/helix/api/accessor/ResourceAccessor.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestMessageThrottleStage.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestResourceComputationStage.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/tools/ContainerAdmin.java * recipes/user-defined-rebalancer/src/main/java/org/apache/helix/userdefinedrebalancer/LockManagerRebalancer.java * recipes/rsync-replicated-file-system/src/main/java/org/apache/helix/filestore/ChangeLogReader.java * helix-core/src/main/java/org/apache/helix/controller/stages/ClusterDataCache.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/FallbackRebalancer.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/AppMasterLauncher.java * helix-core/src/main/java/org/apache/helix/api/Resource.java * helix-core/src/main/java/org/apache/helix/HelixConnection.java * helix-core/src/main/java/org/apache/helix/HelixManager.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicClusterAccessor.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-examples/src/main/java/org/apache/helix/examples/LogicalModelExample.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixController.java * helix-core/src/test/java/org/apache/helix/api/TestUpdateConfig.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/participant/StatelessParticipantService.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestRebalancePipeline.java * helix-core/src/main/java/org/apache/helix/tools/ClusterSetup.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/PartitionedRebalancerConfig.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/HelixRebalancer.java * helix-core/src/main/java/org/apache/helix/api/accessor/ParticipantAccessor.java * recipes/jobrunner-yarn/src/main/java/org/apache/helix/provisioning/yarn/example/JobRunnerMain.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/CustomRebalancer.java > Unify (Cluster|Resource|Participant)Accessor classes into a single > Administrator class > -- > > Key: HELIX-389 > URL: https://issues.apache.org/jira/browse/HELIX-389 > Project: Apache Helix > Iss
[jira] [Commented] (HELIX-483) Simplify logical config classes
[ https://issues.apache.org/jira/browse/HELIX-483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077061#comment-14077061 ] Hudson commented on HELIX-483: -- UNSTABLE: Integrated in helix #1269 (See [https://builds.apache.org/job/helix/1269/]) [HELIX-483] Simplify logical config classes (kanak: rev ff958b19f0911ad337439616ada746eee7c95e23) * helix-core/src/main/java/org/apache/helix/api/Participant.java * helix-core/src/main/java/org/apache/helix/model/ResourceConfiguration.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestMsgSelectionStage.java * helix-core/src/main/java/org/apache/helix/api/Controller.java * helix-core/src/main/java/org/apache/helix/api/Resource.java * helix-core/src/test/java/org/apache/helix/api/TestUpdateConfig.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageSelectionStage.java * helix-core/src/main/java/org/apache/helix/controller/stages/ResourceComputationStage.java * helix-core/src/main/java/org/apache/helix/api/config/ResourceConfig.java * helix-core/src/test/java/org/apache/helix/controller/strategy/TestNewAutoRebalanceStrategy.java * helix-core/src/main/java/org/apache/helix/api/RunningInstance.java * helix-core/src/test/java/org/apache/helix/controller/stages/BaseStageTest.java * helix-core/src/main/java/org/apache/helix/api/Cluster.java * helix-core/src/test/java/org/apache/helix/integration/task/TestTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/api/config/ClusterConfig.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/NMCallbackHandler.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java * recipes/jobrunner-yarn/src/main/java/org/apache/helix/provisioning/yarn/example/JobRunnerMain.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/util/ConstraintBasedAssignment.java * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java * helix-core/src/main/java/org/apache/helix/controller/stages/CurrentStateComputationStage.java * helix-core/src/test/java/org/apache/helix/api/TestNamespacedConfig.java * helix-core/src/main/java/org/apache/helix/controller/stages/TaskAssignmentStage.java * helix-core/src/main/java/org/apache/helix/api/config/ParticipantConfig.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationStage.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/tools/ContainerAdmin.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/test/java/org/apache/helix/api/accessor/TestAtomicAccessors.java * helix-core/src/main/java/org/apache/helix/controller/stages/CompatibilityCheckStage.java * helix-core/src/main/java/org/apache/helix/model/InstanceConfig.java * helix-examples/src/main/java/org/apache/helix/examples/LogicalModelExample.java * helix-core/src/main/java/org/apache/helix/controller/stages/ContainerProvisioningStage.java > Simplify logical config classes > --- > > Key: HELIX-483 > URL: https://issues.apache.org/jira/browse/HELIX-483 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Labels: kanban > > There is a large amount of code duplication in the config classes and that > makes everything harder to maintain. We should keep these classes small and > just be essentially wrappers on the physical model, but with the benefit of > being an aggregation of multiple physical model classes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-477) Some YARN container start requests fail
[ https://issues.apache.org/jira/browse/HELIX-477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077280#comment-14077280 ] Hudson commented on HELIX-477: -- UNSTABLE: Integrated in helix #1270 (See [https://builds.apache.org/job/helix/1270/]) [HELIX-477] Properly fail and retry when YARN container start/stop fail (kanak: rev 9984a5ad25a883db7b442f27c39b6635083452f0) * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/NMCallbackHandler.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/YarnProvisioner.java > Some YARN container start requests fail > --- > > Key: HELIX-477 > URL: https://issues.apache.org/jira/browse/HELIX-477 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > We need to improve logging when container start fails so that we can identify > why it happens. We may also consider compensating for the failure to start by > allocating an additional container. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-373) Make it easier to do crud operations on high-level config classes
[ https://issues.apache.org/jira/browse/HELIX-373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078667#comment-14078667 ] Hudson commented on HELIX-373: -- SUCCESS: Integrated in helix #1271 (See [https://builds.apache.org/job/helix/1271/]) [HELIX-373] Simplify ClusterAccessor and logical updates (kanak: rev 961b9309059dcaa0ee8dd10eff0adf7f201b05fe) * helix-core/src/main/java/org/apache/helix/api/config/ParticipantConfig.java * helix-core/src/test/java/org/apache/helix/integration/TestLocalContainerProvider.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixConnection.java * helix-core/src/main/java/org/apache/helix/model/ClusterConfiguration.java * helix-examples/src/main/java/org/apache/helix/examples/LogicalModelExample.java * helix-core/src/test/java/org/apache/helix/api/TestNewStages.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/AppMasterLauncher.java * helix-core/src/test/java/org/apache/helix/api/accessor/TestAtomicAccessors.java * helix-core/src/main/java/org/apache/helix/api/config/ResourceConfig.java * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java * helix-core/src/main/java/org/apache/helix/model/ResourceConfiguration.java * helix-core/src/main/java/org/apache/helix/model/InstanceConfig.java * helix-core/src/main/java/org/apache/helix/api/accessor/AtomicClusterAccessor.java * helix-core/src/test/java/org/apache/helix/api/accessor/TestAccessorRecreate.java * helix-core/src/main/java/org/apache/helix/api/Participant.java * helix-core/src/test/java/org/apache/helix/api/TestUpdateConfig.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixParticipant.java * helix-core/src/main/java/org/apache/helix/api/config/ClusterConfig.java > Make it easier to do crud operations on high-level config classes > - > > Key: HELIX-373 > URL: https://issues.apache.org/jira/browse/HELIX-373 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Labels: kanban > > Right now there is a massive amount of code duplication in the config and > snapshot classes. Really these classes should be implemented in such a way > that they can still leverage the physical model underneath, but provide a > high-level logical aggregation of these to the user. That way we can have > ease of use while keeping the implementation simple. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-481) Update cluster cache when the provisioning stage updates configs
[ https://issues.apache.org/jira/browse/HELIX-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14079811#comment-14079811 ] Hudson commented on HELIX-481: -- SUCCESS: Integrated in helix #1272 (See [https://builds.apache.org/job/helix/1272/]) [HELIX-481] Keep controller cache in sync with container updates (kanak: rev 08371b561353c0b93fb6931f69d3ed01dbb634de) * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/YarnProvisioner.java * helix-core/src/main/java/org/apache/helix/controller/stages/ContainerProvisioningStage.java > Update cluster cache when the provisioning stage updates configs > > > Key: HELIX-481 > URL: https://issues.apache.org/jira/browse/HELIX-481 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > When the ContainerProvisioningStage updates the state of its instances, it > doesn't take into account the fact that the cache may not yet be refreshed to > take this change into account for the next pipeline run. Thus, the update > should be forced into the cache. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-374) Rebalancer config should be a complete user-specified concept
[ https://issues.apache.org/jira/browse/HELIX-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080475#comment-14080475 ] Hudson commented on HELIX-374: -- SUCCESS: Integrated in helix #1274 (See [https://builds.apache.org/job/helix/1274/]) [HELIX-374] Rebalancer config should be fully user-specified (kanak: rev ee8ef6a702de2b1490e6c09bff914adf6dbb7603) * helix-core/src/test/java/org/apache/helix/api/TestNewStages.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/RebalancerConfigHolder.java * helix-core/src/main/java/org/apache/helix/controller/stages/ResourceComputationStage.java * helix-core/src/main/java/org/apache/helix/monitoring/mbeans/ClusterStatusMonitor.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationStage.java * helix-core/src/test/java/org/apache/helix/controller/rebalancer/context/TestSerializeRebalancerContext.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/SemiAutoRebalancerConfig.java * helix-core/src/main/java/org/apache/helix/model/builder/IdealStateBuilder.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/tools/UpdateProvisionerConfig.java * helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/PartitionedRebalancerConfig.java * helix-core/src/test/java/org/apache/helix/integration/TestLocalContainerProvider.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/ReplicatedRebalancerConfig.java * helix-core/src/test/java/org/apache/helix/controller/stages/BaseStageTest.java * helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java * helix-core/src/test/java/org/apache/helix/integration/TestCustomizedIdealStateRebalancer.java * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java * helix-examples/src/main/java/org/apache/helix/examples/LogicalModelExample.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/BasicRebalancerConfig.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestResourceComputationStage.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/FullAutoRebalancerConfig.java * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestClusterStatusMonitor.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/CustomRebalancerConfig.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixConnection.java * helix-core/src/main/java/org/apache/helix/controller/stages/MessageSelectionStage.java * helix-core/src/main/java/org/apache/helix/model/IdealState.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/AppMasterLauncher.java * helix-core/src/test/java/org/apache/helix/integration/TestUserDefRebalancerCompatibility.java * helix-core/src/test/java/org/apache/helix/controller/stages/TestStagesWithLogicalAccessors.java * helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/RebalancerConfig.java > Rebalancer config should be a complete user-specified concept > - > > Key: HELIX-374 > URL: https://issues.apache.org/jira/browse/HELIX-374 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Labels: kanban > > Ideal state and rebalancer config are 1:1 right now so rebalancer config > isn't really adding any more value. Ideally, the rebalancer config should be > more of a supplement in that it's something that the user can provide along > with a resource, much like a state model definition. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-468) TaskDriver list should be more robust
[ https://issues.apache.org/jira/browse/HELIX-468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14082818#comment-14082818 ] Hudson commented on HELIX-468: -- SUCCESS: Integrated in helix #1276 (See [https://builds.apache.org/job/helix/1276/]) [HELIX-468] Make TaskDriver list output correct state (kanak: rev 8a37057142816b96640d22ee0dfac4b4dae704bc) * helix-core/src/main/java/org/apache/helix/task/JobContext.java * helix-core/src/main/java/org/apache/helix/task/TaskState.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/TaskDriver.java > TaskDriver list should be more robust > - > > Key: HELIX-468 > URL: https://issues.apache.org/jira/browse/HELIX-468 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Right now, TaskDriver#list can't print initialized, but non-running task > states. This information is all present, so we should just show it. > This change doesn't affect the correctness of the task framework itself, but > this is a useful utility for querying the progress of tasks, so it should be > made more reliable. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-376) Remove HelixConnection/HelixManager duplicate code
[ https://issues.apache.org/jira/browse/HELIX-376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085470#comment-14085470 ] Hudson commented on HELIX-376: -- SUCCESS: Integrated in helix #1277 (See [https://builds.apache.org/job/helix/1277/]) [HELIX-376] Remove HelixConnection/HelixManager duplicate code (zzhang: rev 02165c5203ffd226ad23d310ee3e027c9b761f65) * helix-core/src/test/java/org/apache/helix/monitoring/mbeans/TestResetClusterMetrics.java * helix-core/src/test/java/org/apache/helix/ZkTestHelper.java * helix-core/src/test/java/org/apache/helix/integration/task/TestTaskRebalancer.java * helix-core/src/test/java/org/apache/helix/tools/TestHelixAdminCli.java * helix-core/src/main/java/org/apache/helix/HelixAutoController.java * helix-core/src/test/java/org/apache/helix/integration/TestFullAutoNodeTagging.java * helix-core/src/test/java/org/apache/helix/integration/TestSessionExpiryInTransition.java * helix-core/src/test/java/org/apache/helix/participant/MockZKHelixManager.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestDistributedControllerManager.java * helix-core/src/test/java/org/apache/helix/controller/stages/DummyClusterManager.java * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/ControllerResource.java * helix-core/src/test/java/org/apache/helix/integration/TestDisableResource.java * helix-core/src/test/java/org/apache/helix/integration/TestDisable.java * recipes/jobrunner-yarn/src/main/java/org/apache/helix/provisioning/yarn/example/MyTaskService.java * helix-core/src/main/java/org/apache/helix/HelixService.java * helix-core/src/test/java/org/apache/helix/TestHelper.java * helix-core/src/main/java/org/apache/helix/messaging/DefaultMessagingService.java * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/ConfigResource.java * helix-core/src/test/java/org/apache/helix/TestZKCallback.java * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestParticipantManager.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixController.java * helix-core/src/test/java/org/apache/helix/tools/TestClusterStateVerifier.java * helix-core/src/test/java/org/apache/helix/mock/controller/MockController.java * helix-core/src/test/java/org/apache/helix/integration/TestInvalidResourceRebalance.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java * helix-admin-webapp/src/main/java/org/apache/helix/webapp/resources/ClusterResource.java * helix-core/src/test/java/org/apache/helix/integration/TestParticipantNameCollision.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java * helix-core/src/test/java/org/apache/helix/integration/TestRestartParticipant.java * helix-core/src/test/java/org/apache/helix/integration/manager/MockParticipantManager.java * helix-core/src/test/java/org/apache/helix/integration/manager/ClusterDistributedController.java * helix-core/src/test/java/org/apache/helix/integration/TestSchemataSM.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockController.java * helix-core/src/test/java/org/apache/helix/integration/TestCustomIdealState.java * helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkFlapping.java * helix-core/src/test/java/org/apache/helix/integration/TestResetInstance.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestZkCallbackHandlerLeak.java * helix-core/src/test/java/org/apache/helix/integration/TestInvalidAutoIdealState.java * helix-core/src/test/java/org/apache/helix/integration/TestEnablePartitionDuringDisable.java * helix-core/src/main/java/org/apache/helix/controller/stages/TaskAssignmentStage.java * helix-core/src/test/java/org/apache/helix/integration/TestBatchMessage.java * helix-core/src/test/java/org/apache/helix/integration/TestDistributedClusterController.java * helix-core/src/test/java/org/apache/helix/integration/TestReelectedPipelineCorrectness.java * helix-core/src/test/java/org/apache/helix/integration/TestAutoRebalance.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockParticipant.java * helix-core/src/test/java/org/apache/helix/integration/TestNonOfflineInitState.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZKLiveInstanceData.java * recipes/jobrunner-yarn/src/main/java/org/apache/helix/provisioning/yarn/example/JobRunnerMain.java * helix-core/src/test/java/org/apache/helix/integration/TestStandAloneCMMain.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockMultiClusterController.java * helix-core/src/main/java/org/apache/helix/controller/HelixControllerMain.java * helix-core/src/test/java/org/apache/helix/integration/TestDisableCustomCodeRunner.java * helix-core/src/tes
[jira] [Commented] (HELIX-492) Task should be its own rebalance mode
[ https://issues.apache.org/jira/browse/HELIX-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085469#comment-14085469 ] Hudson commented on HELIX-492: -- SUCCESS: Integrated in helix #1277 (See [https://builds.apache.org/job/helix/1277/]) [HELIX-492] Task should be its own rebalance mode (kanak: rev dd8226b8365c59ab44aa49eec6fd116f757bfbd2) * helix-core/src/main/java/org/apache/helix/model/IdealState.java * helix-core/src/main/java/org/apache/helix/task/TaskDriver.java > Task should be its own rebalance mode > - > > Key: HELIX-492 > URL: https://issues.apache.org/jira/browse/HELIX-492 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Right now the task framework creates a rebalancer with mode USER_DEFINED, > where since it's built in, it's not really user-defined, but rather > task-specific. There should be a new mode called "TASK" or similar. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-495) TestPreferenceListAsQueue is flaky
[ https://issues.apache.org/jira/browse/HELIX-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086716#comment-14086716 ] Hudson commented on HELIX-495: -- UNSTABLE: Integrated in helix #1278 (See [https://builds.apache.org/job/helix/1278/]) [HELIX-495] Make TestPreferenceListAsQueue non-flaky (kanak: rev 8ba16a8e26103ebddc04ab57cbac81b5226d6788) * helix-core/src/test/java/org/apache/helix/integration/TestPreferenceListAsQueue.java > TestPreferenceListAsQueue is flaky > -- > > Key: HELIX-495 > URL: https://issues.apache.org/jira/browse/HELIX-495 > Project: Apache Helix > Issue Type: Bug >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > This test should be rewritten so as to not depend on timing for correctness. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-486) Remove StateModelFactory/HelixStateModelFactory code duplication
[ https://issues.apache.org/jira/browse/HELIX-486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090070#comment-14090070 ] Hudson commented on HELIX-486: -- SUCCESS: Integrated in helix #1279 (See [https://builds.apache.org/job/helix/1279/]) [HELIX-484] Remove CallbackHandler/ZkCallbackHandler code duplication, [HELIX-486] Remove StateModelFactory/HelixStateModelFactory code duplication, rb=24332 (zzhang: rev 4ae1ff796a524766b22f5fc184952187dc9cc24b) * helix-core/src/test/java/org/apache/helix/integration/TestZkReconnect.java * helix-core/src/test/java/org/apache/helix/Mocks.java * helix-examples/src/main/java/org/apache/helix/examples/OnlineOfflineStateModelFactory.java * helix-core/src/test/java/org/apache/helix/TestHelixTaskExecutor.java * helix-core/src/main/java/org/apache/helix/participant/HelixCustomCodeRunner.java * helix-core/src/test/java/org/apache/helix/integration/manager/ZkTestManager.java * recipes/user-defined-rebalancer/src/main/java/org/apache/helix/userdefinedrebalancer/Lock.java * helix-core/src/main/java/org/apache/helix/api/id/StateModelDefId.java * recipes/rsync-replicated-file-system/src/main/java/org/apache/helix/filestore/FileStoreStateModelFactory.java * helix-core/src/main/java/org/apache/helix/participant/DistClusterControllerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestNonOfflineInitState.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockSchemataModelFactory.java * helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java * helix-core/src/main/java/org/apache/helix/api/StateTransitionHandlerFactory.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockMSModelFactory.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockParticipant.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/Consumer.java * helix-examples/src/main/java/org/apache/helix/examples/BootstrapHandler.java * helix-core/src/main/java/org/apache/helix/task/TaskRunner.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/HelixStateModelFactoryAdaptor.java * helix-core/src/main/java/org/apache/helix/tools/ClusterSetup.java * helix-core/src/test/java/org/apache/helix/integration/TestPartitionLevelTransitionConstraint.java * helix-core/src/main/java/org/apache/helix/controller/HelixControllerMain.java * helix-core/src/main/java/org/apache/helix/participant/GenericLeaderStandbyModel.java * helix-core/src/test/java/org/apache/helix/integration/TestResetResource.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockBootstrapStateModel.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/HelixStateModelFactory.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixParticipant.java * helix-examples/src/main/java/org/apache/helix/examples/ExampleProcess.java * helix-core/src/test/java/org/apache/helix/mock/participant/DummyProcess.java * helix-core/src/test/java/org/apache/helix/TestHelixTaskHandler.java * helix-examples/src/main/java/org/apache/helix/examples/MasterSlaveStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestResetInstance.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/StateModelParser.java * helix-examples/src/main/java/org/apache/helix/examples/LogicalModelExample.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/StateModel.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockSchemataStateModel.java * helix-core/src/main/java/org/apache/helix/participant/GenericLeaderStandbyStateModelFactory.java * recipes/task-execution/src/main/java/org/apache/helix/taskexecution/TaskStateModel.java * helix-core/src/test/java/org/apache/helix/participant/TestDistControllerStateModelFactory.java * helix-core/src/main/java/org/apache/helix/task/TaskStateModel.java * helix-core/src/test/java/org/apache/helix/participant/MockZKHelixManager.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixConnection.java * helix-core/src/main/java/org/apache/helix/participant/CustomCodeInvoker.java * helix-core/src/test/java/org/apache/helix/integration/TestStateTransitionTimeout.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockMultiClusterController.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/participant/StatelessServiceStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestPreferenceListAsQueue.java * helix-core/src/main/java/org/apache/helix/participant/HelixStateMachineEngine.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestHelixMultiClusterController.java * helix-admin-webapp/src/test/java/org/apache/helix
[jira] [Commented] (HELIX-422) Simplify creation of single jobs
[ https://issues.apache.org/jira/browse/HELIX-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090068#comment-14090068 ] Hudson commented on HELIX-422: -- SUCCESS: Integrated in helix #1279 (See [https://builds.apache.org/job/helix/1279/]) [HELIX-422] Simplify single job creation (kanak: rev edfc98edc07f3f732180e74f6c7983bee2192392) * helix-core/src/test/java/org/apache/helix/integration/task/TestTaskRebalancer.java * helix-core/src/test/java/org/apache/helix/integration/task/TestTaskRebalancerStopResume.java * recipes/jobrunner-yarn/src/main/java/org/apache/helix/provisioning/yarn/example/MyTask.java * helix-core/src/test/java/org/apache/helix/integration/task/TestIndependentTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/TaskUtil.java * helix-core/src/main/java/org/apache/helix/task/JobConfig.java * helix-core/src/test/java/org/apache/helix/integration/task/WorkflowGenerator.java * helix-core/src/main/java/org/apache/helix/task/Workflow.java > Simplify creation of single jobs > > > Key: HELIX-422 > URL: https://issues.apache.org/jira/browse/HELIX-422 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > We should be able to specify requirements for a job, even if not within the > confines of a workflow. We can do this by making it easier to make a > single-job workflow. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-484) Remove CallbackHandler/ZkCallbackHandler code duplication
[ https://issues.apache.org/jira/browse/HELIX-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090069#comment-14090069 ] Hudson commented on HELIX-484: -- SUCCESS: Integrated in helix #1279 (See [https://builds.apache.org/job/helix/1279/]) [HELIX-484] Remove CallbackHandler/ZkCallbackHandler code duplication, [HELIX-486] Remove StateModelFactory/HelixStateModelFactory code duplication, rb=24332 (zzhang: rev 4ae1ff796a524766b22f5fc184952187dc9cc24b) * helix-core/src/test/java/org/apache/helix/integration/TestZkReconnect.java * helix-core/src/test/java/org/apache/helix/Mocks.java * helix-examples/src/main/java/org/apache/helix/examples/OnlineOfflineStateModelFactory.java * helix-core/src/test/java/org/apache/helix/TestHelixTaskExecutor.java * helix-core/src/main/java/org/apache/helix/participant/HelixCustomCodeRunner.java * helix-core/src/test/java/org/apache/helix/integration/manager/ZkTestManager.java * recipes/user-defined-rebalancer/src/main/java/org/apache/helix/userdefinedrebalancer/Lock.java * helix-core/src/main/java/org/apache/helix/api/id/StateModelDefId.java * recipes/rsync-replicated-file-system/src/main/java/org/apache/helix/filestore/FileStoreStateModelFactory.java * helix-core/src/main/java/org/apache/helix/participant/DistClusterControllerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestNonOfflineInitState.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockSchemataModelFactory.java * helix-core/src/main/java/org/apache/helix/manager/zk/CallbackHandler.java * helix-core/src/main/java/org/apache/helix/api/StateTransitionHandlerFactory.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockMSModelFactory.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockParticipant.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/Consumer.java * helix-examples/src/main/java/org/apache/helix/examples/BootstrapHandler.java * helix-core/src/main/java/org/apache/helix/task/TaskRunner.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/HelixStateModelFactoryAdaptor.java * helix-core/src/main/java/org/apache/helix/tools/ClusterSetup.java * helix-core/src/test/java/org/apache/helix/integration/TestPartitionLevelTransitionConstraint.java * helix-core/src/main/java/org/apache/helix/controller/HelixControllerMain.java * helix-core/src/main/java/org/apache/helix/participant/GenericLeaderStandbyModel.java * helix-core/src/test/java/org/apache/helix/integration/TestResetResource.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockBootstrapStateModel.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/HelixStateModelFactory.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixParticipant.java * helix-examples/src/main/java/org/apache/helix/examples/ExampleProcess.java * helix-core/src/test/java/org/apache/helix/mock/participant/DummyProcess.java * helix-core/src/test/java/org/apache/helix/TestHelixTaskHandler.java * helix-examples/src/main/java/org/apache/helix/examples/MasterSlaveStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestResetInstance.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/StateModelParser.java * helix-examples/src/main/java/org/apache/helix/examples/LogicalModelExample.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/StateModel.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockSchemataStateModel.java * helix-core/src/main/java/org/apache/helix/participant/GenericLeaderStandbyStateModelFactory.java * recipes/task-execution/src/main/java/org/apache/helix/taskexecution/TaskStateModel.java * helix-core/src/test/java/org/apache/helix/participant/TestDistControllerStateModelFactory.java * helix-core/src/main/java/org/apache/helix/task/TaskStateModel.java * helix-core/src/test/java/org/apache/helix/participant/MockZKHelixManager.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixConnection.java * helix-core/src/main/java/org/apache/helix/participant/CustomCodeInvoker.java * helix-core/src/test/java/org/apache/helix/integration/TestStateTransitionTimeout.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockMultiClusterController.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/participant/StatelessServiceStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestPreferenceListAsQueue.java * helix-core/src/main/java/org/apache/helix/participant/HelixStateMachineEngine.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestHelixMultiClusterController.java * helix-admin-webapp/src/test/java/org/apache/helix
[jira] [Commented] (HELIX-498) Remove "incubator" name from the pom files
[ https://issues.apache.org/jira/browse/HELIX-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090270#comment-14090270 ] Hudson commented on HELIX-498: -- UNSTABLE: Integrated in helix #1280 (See [https://builds.apache.org/job/helix/1280/]) [HELIX-498] Update configurations and static files to reflect TLP (kanak: rev ecfedff24185001363e0795a4ca461e65bd5ac03) * website/trunk/pom.xml * helix-admin-webapp/DISCLAIMER * helix-examples/pom.xml * recipes/task-execution/pom.xml * recipes/rabbitmq-consumer-group/README.md * recipes/helloworld-provisioning-yarn/src/main/resources/hello_world_app_spec.yaml * recipes/pom.xml * recipes/helloworld-provisioning-yarn/pom.xml * helix-core/NOTICE * helix-core/helix-core-0.7.1-incubating-SNAPSHOT.ivy * helix-provisioning/pom.xml * recipes/jobrunner-yarn/pom.xml * website/0.6.2-incubating/pom.xml * helix-provisioning/NOTICE * helix-agent/NOTICE * helix-agent/pom.xml * helix-agent/DISCLAIMER * recipes/service-discovery/README.md * recipes/distributed-lock-manager/pom.xml * helix-core/DISCLAIMER * website/0.7.0-incubating/pom.xml * helix-admin-webapp/helix-admin-webapp-0.7.1-incubating-SNAPSHOT.ivy * pom.xml * recipes/jobrunner-yarn/src/main/resources/job_runner_app_spec.yaml * recipes/user-defined-rebalancer/pom.xml * website/pom.xml * helix-core/pom.xml * helix-admin-webapp/NOTICE * helix-examples/DISCLAIMER * recipes/user-defined-rebalancer/README.md * helix-admin-webapp/pom.xml * recipes/service-discovery/pom.xml * recipes/rsync-replicated-file-system/README.md * recipes/distributed-lock-manager/README.md * website/0.6.1-incubating/pom.xml * helix-core/helix-core-0.7.1-SNAPSHOT.ivy * recipes/rabbitmq-consumer-group/pom.xml * recipes/rsync-replicated-file-system/pom.xml * NOTICE * helix-admin-webapp/helix-admin-webapp-0.7.1-SNAPSHOT.ivy * HelixProposal.mediawiki * DISCLAIMER * recipes/task-execution/README.md * helix-examples/NOTICE * helix-provisioning/DISCLAIMER * website/0.6.3/pom.xml > Remove "incubator" name from the pom files > -- > > Key: HELIX-498 > URL: https://issues.apache.org/jira/browse/HELIX-498 > Project: Apache Helix > Issue Type: Bug >Reporter: kishore gopalakrishna >Assignee: Kanak Biscuitwala > > Apache Helix has graduated to TLP and we have to remove incubating suffix. > org.apache.helix > helix > 0.7.1-incubating-SNAPSHOT > pom > Apache Helix -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-485) Remove controller leader election duplicate code
[ https://issues.apache.org/jira/browse/HELIX-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097988#comment-14097988 ] Hudson commented on HELIX-485: -- UNSTABLE: Integrated in helix #1281 (See [https://builds.apache.org/job/helix/1281/]) HELIX-485: Remove controller leader election duplicate code (zzhang: rev 325fe8b147b7f9c139364f89044e2b78e141a7b9) * helix-core/src/test/java/org/apache/helix/participant/MockZKHelixManager.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockMultiClusterController.java * helix-core/src/test/java/org/apache/helix/participant/TestControllerElection.java * helix-core/src/main/java/org/apache/helix/manager/zk/DistributedLeaderElection.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockParticipant.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkCallbackHandler.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockController.java * helix-core/src/test/java/org/apache/helix/participant/TestDistControllerElection.java > Remove controller leader election duplicate code > > > Key: HELIX-485 > URL: https://issues.apache.org/jira/browse/HELIX-485 > Project: Apache Helix > Issue Type: Task >Reporter: Kanak Biscuitwala >Assignee: Zhen Zhang > Labels: kanban > Original Estimate: 24h > Remaining Estimate: 24h > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-499) Helix controller should listen for resource config changes
[ https://issues.apache.org/jira/browse/HELIX-499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101507#comment-14101507 ] Hudson commented on HELIX-499: -- SUCCESS: Integrated in helix #1282 (See [https://builds.apache.org/job/helix/1282/]) [HELIX-499] Controller should listen for all config changes (kanak: rev a298f23defb420aeee1a8d10b7f626433df97576) * helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java * helix-core/src/main/java/org/apache/helix/manager/zk/ControllerManagerHelper.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkCallbackHandler.java * helix-core/src/main/java/org/apache/helix/controller/stages/ClusterDataCache.java * helix-core/src/main/java/org/apache/helix/api/Cluster.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestZkCallbackHandlerLeak.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixController.java * helix-core/src/main/java/org/apache/helix/task/TaskUtil.java * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java * helix-core/src/main/java/org/apache/helix/controller/HelixControllerMain.java * helix-core/src/test/java/org/apache/helix/integration/TestZkCallbackHandlerLeak.java > Helix controller should listen for resource config changes > -- > > Key: HELIX-499 > URL: https://issues.apache.org/jira/browse/HELIX-499 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > This may not be 100% backwards compatible, but it's the right thing to do, as > right now people have to touch ideal states just to trigger a resource config > change update. This is particularly relevant for the task framework, as we > will be able to avoid reading the job/workflow configs repeatedly in the > controller. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-497) Support named queues of jobs
[ https://issues.apache.org/jira/browse/HELIX-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102877#comment-14102877 ] Hudson commented on HELIX-497: -- SUCCESS: Integrated in helix #1283 (See [https://builds.apache.org/job/helix/1283/]) [HELIX-497] Support named queues of jobs (kanak: rev 05a982a44d5f1533bdfde11c089a0ca87bd3b385) * helix-core/src/test/java/org/apache/helix/integration/task/TestTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/Workflow.java * helix-core/src/main/java/org/apache/helix/task/WorkflowContext.java * helix-core/src/main/java/org/apache/helix/task/TaskDriver.java * helix-core/src/main/java/org/apache/helix/task/JobQueue.java * helix-core/src/test/java/org/apache/helix/integration/task/TestUtil.java * helix-core/src/main/java/org/apache/helix/task/WorkflowConfig.java * helix-core/src/main/java/org/apache/helix/task/JobContext.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/TaskConfig.java * helix-core/src/main/java/org/apache/helix/task/TaskUtil.java * helix-core/src/main/java/org/apache/helix/task/TaskStateModel.java > Support named queues of jobs > > > Key: HELIX-497 > URL: https://issues.apache.org/jira/browse/HELIX-497 > Project: Apache Helix > Issue Type: Task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Original Estimate: 96h > Remaining Estimate: 96h > > This is effectively a way to dynamically grow workflow DAGs. Workflow is a > non-essential concept, and we should be able to support alternative > organizations of jobs. Here, we just need a way to persist a queue, add work > to it, and process that work. Then the cleanup should be at job level rather > than workflow level. Some other things that are useful are returning the > current queue, and (optionally) removing from the queue. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-502) App master and containers run out of memory
[ https://issues.apache.org/jira/browse/HELIX-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104865#comment-14104865 ] Hudson commented on HELIX-502: -- UNSTABLE: Integrated in helix #1284 (See [https://builds.apache.org/job/helix/1284/]) [HELIX-502] Start containers with more memory by default (kanak: rev 363c049e3ad874269ca765d9407b4f6623a56e70) * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/AppStatusReportGenerator.java * helix-core/src/main/java/org/apache/helix/model/InstanceConfig.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/YarnProvisioner.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/yarn/AppLauncher.java > App master and containers run out of memory > --- > > Key: HELIX-502 > URL: https://issues.apache.org/jira/browse/HELIX-502 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > We're seeing our app master and dummy containers for recipes failing with out > of memory issues. We should start them with more memory. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-501) Skip website module in build
[ https://issues.apache.org/jira/browse/HELIX-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104866#comment-14104866 ] Hudson commented on HELIX-501: -- UNSTABLE: Integrated in helix #1284 (See [https://builds.apache.org/job/helix/1284/]) [HELIX-501] Skip website module in build by default (kanak: rev 010fe5c513884ef7299ed0257ffec61d46c7b90f) * pom.xml > Skip website module in build > > > Key: HELIX-501 > URL: https://issues.apache.org/jira/browse/HELIX-501 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > Right now all maven commands will build the website module, which is a no-op > and just clutters the output of the build. We should just disable this for > speedup and decrease in confusion. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-503) ivy files are out of sync with dependencies
[ https://issues.apache.org/jira/browse/HELIX-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104864#comment-14104864 ] Hudson commented on HELIX-503: -- UNSTABLE: Integrated in helix #1284 (See [https://builds.apache.org/job/helix/1284/]) [HELIX-503] Bring ivy files in sync with dependencies (kanak: rev 0e36354bb0709495268e855e1c95a3d86189aa52) * helix-core/helix-core-0.7.1-SNAPSHOT.ivy > ivy files are out of sync with dependencies > --- > > Key: HELIX-503 > URL: https://issues.apache.org/jira/browse/HELIX-503 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > > We've added things like guava and snakeyaml, while changing/removing restlet > and josql. The ivy file should be brought in sync with these changes. > Here's a wiki page for automating this process: > https://cwiki.apache.org/confluence/display/HELIX/Generate+ivy+from+pom -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-329) HelixAutoController isn't a very clear name, consider renaming
[ https://issues.apache.org/jira/browse/HELIX-329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106258#comment-14106258 ] Hudson commented on HELIX-329: -- UNSTABLE: Integrated in helix #1285 (See [https://builds.apache.org/job/helix/1285/]) [HELIX-329] HelixAutoController isn't a very clear name, consider renaming (zzhang: rev 0746d07872cf3fb07ec2995adff7980e11e2a8b3) * helix-core/src/test/java/org/apache/helix/participant/TestDistControllerStateModelFactory.java * helix-admin-webapp/src/test/java/org/apache/helix/webapp/TestHelixAdminScenariosRest.java * helix-core/src/test/java/org/apache/helix/participant/TestMultiClusterControllerStateModel.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkHelixMultiClusterController.java * helix-core/src/test/java/org/apache/helix/integration/TestAddNodeAfterControllerStart.java * helix-core/src/main/java/org/apache/helix/HelixConnection.java * helix-core/src/main/java/org/apache/helix/controller/HelixControllerMain.java * helix-core/src/test/java/org/apache/helix/participant/TestDistControllerStateModel.java * helix-core/src/test/java/org/apache/helix/integration/TestAddClusterV2.java * helix-core/src/main/java/org/apache/helix/HelixManager.java * helix-core/src/main/java/org/apache/helix/participant/DistClusterControllerStateModelFactory.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixConnection.java * helix-core/src/test/java/org/apache/helix/integration/TestMultiClusterController.java * helix-core/src/main/java/org/apache/helix/participant/MultiClusterControllerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestConsecutiveZkSessionExpiry.java * helix-core/src/test/java/org/apache/helix/manager/zk/TestZkHelixAutoController.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixManager.java * helix-core/src/main/java/org/apache/helix/participant/MultiClusterControllerStateModel.java * helix-core/src/test/java/org/apache/helix/integration/TestReelectedPipelineCorrectness.java * helix-core/src/main/java/org/apache/helix/participant/DistClusterControllerStateModel.java * helix-core/src/test/java/org/apache/helix/participant/TestMultiClusterControllerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestDistributedCMMain.java * helix-core/src/test/java/org/apache/helix/manager/zk/MockMultiClusterController.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestHelixMultiClusterController.java * helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java > HelixAutoController isn't a very clear name, consider renaming > -- > > Key: HELIX-329 > URL: https://issues.apache.org/jira/browse/HELIX-329 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Zhen Zhang > Original Estimate: 24h > Remaining Estimate: 24h > > In 0.7.0 Helix introduced new role classes, of which HelixAutoController is > one, representing CONTROLLER_PARTICIPANT. This name doesn't really describe > what the role represents, so it might be best to rename. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-482) Support "smarter" task failure strategies
[ https://issues.apache.org/jira/browse/HELIX-482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114272#comment-14114272 ] Hudson commented on HELIX-482: -- ABORTED: Integrated in helix #1286 (See [https://builds.apache.org/job/helix/1286/]) [HELIX-482] Support delayed task reassignment (kanak: rev b87d72f00f3367dc5f0b91d0556d25b310fadabf) * helix-core/src/main/java/org/apache/helix/task/JobConfig.java * helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java * helix-core/src/test/java/org/apache/helix/integration/task/TestIndependentTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/beans/JobBean.java * helix-core/src/main/java/org/apache/helix/task/JobContext.java > Support "smarter" task failure strategies > - > > Key: HELIX-482 > URL: https://issues.apache.org/jira/browse/HELIX-482 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Fix For: 0.7.1, 0.6.4 > > > It would be interesting to support exponential backoff on task failures, and > even take containers away if the tasks are being backed off. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-470) Add performant IPC (Helix actors)
[
https://issues.apache.org/jira/browse/HELIX-470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114309#comment-14114309
]
Hudson commented on HELIX-470:
--
ABORTED: Integrated in helix #1287 (See
[https://builds.apache.org/job/helix/1287/])
[HELIX-470] Netty-based IPC layer (brandt.greg: rev
f2475fa9a6123052fea2588cdd4e439ddc7af020)
* helix-ipc/src/main/java/org/apache/helix/resolver/ResolverRoutingTable.java
* helix-core/src/main/java/org/apache/helix/spectator/RoutingTableProvider.java
* helix-ipc/src/main/config/log4j.properties
* helix-ipc/src/assemble/assembly.xml
* helix-ipc/src/main/java/org/apache/helix/resolver/AbstractHelixResolver.java
* helix-ipc/src/main/java/org/apache/helix/resolver/HelixResolver.java
* helix-ipc/src/main/java/org/apache/helix/resolver/HelixAddress.java
* helix-ipc/NOTICE
* helix-ipc/src/main/java/org/apache/helix/ipc/HelixIPCMessageManager.java
* helix-ipc/src/test/resources/run_benchmark.sh
* helix-ipc/pom.xml
* helix-ipc/src/test/java/org/apache/helix/resolver/TestZKHelixResolver.java
* helix-ipc/src/main/java/org/apache/helix/resolver/zk/ZKHelixResolver.java
* helix-ipc/src/test/resources/build_benchmark.sh
* helix-ipc/src/main/java/org/apache/helix/resolver/HelixMessageScope.java
* helix-ipc/src/main/java/org/apache/helix/ipc/HelixIPCService.java
* helix-ipc/src/test/java/org/apache/helix/ipc/benchmark/BenchmarkDriver.java
* helix-core/src/test/java/org/apache/helix/TestHelper.java
* helix-ipc/LICENSE
* helix-ipc/src/main/java/org/apache/helix/ipc/netty/NettyHelixIPCService.java
* pom.xml
* helix-ipc/src/main/java/org/apache/helix/ipc/HelixIPCCallback.java
* helix-ipc/src/test/java/org/apache/helix/ipc/TestNettyHelixIPCService.java
> Add performant IPC (Helix actors)
> -
>
> Key: HELIX-470
> URL: https://issues.apache.org/jira/browse/HELIX-470
> Project: Apache Helix
> Issue Type: Improvement
> Components: helix-core
>Affects Versions: 0.7.1, 0.6.4
>Reporter: Greg Brandt
> Fix For: 0.7.1
>
>
> Helix is missing a high-performance way to exchange messages among resource
> partitions, with a user-friendly API.
> Currently, the Helix messaging service relies on creating many nodes in
> ZooKeeper, which can lead to ZooKeeper outages if messages are sent too
> frequently.
> In order to avoid this, high-performance NIO-based {{HelixActors}} should be
> implemented (in rough accordance with the actor model). {{HelixActors}}
> exchange messages asynchronously without waiting for a response, and are
> partition/state-addressable.
> The API would look something like this:
> {code}
> public interface HelixActor {
> void send(Partition partition, String state, T message);
> void register(String resource, HelixActorCallback callback);
> }
> public interface HelixActorCallback {
> void onMessage(Partition partition, State state, T message);
> }
> {code}
> {{#send}} should likely support wildcards for partition number and state, or
> its method signature might need to be massaged a little bit for more
> flexibility. But that's the basic idea.
> Nothing is inferred about the format of the messages - the only metadata we
> need to be able to interpret is (1) partition name and (2) state. The user
> provides a codec to encode / decode messages, so it's nicer to implement
> {{HelixActor#send}} and {{HelixActorCallback#onMessage}}.
> {code}
> public interface HelixActorMessageCodec {
> byte[] encode(T message);
> T decode(byte[] message);
> }
> {code}
> Actors should support somewhere around 100k to 1M messages per second. The
> Netty framework is a potential implementation candidate, but should be
> thoroughly evaluated w.r.t. performance.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HELIX-506) Ensure that tasks are not placed on targets with pending transitions
[ https://issues.apache.org/jira/browse/HELIX-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114308#comment-14114308 ] Hudson commented on HELIX-506: -- ABORTED: Integrated in helix #1287 (See [https://builds.apache.org/job/helix/1287/]) [HELIX-506] Ensure that tasks are not placed on targets with pending states (kanak: rev 59b4bbb0b4f45b8b8d350a3dac43748dc52a5b5b) * helix-core/src/main/java/org/apache/helix/task/GenericTaskRebalancer.java * helix-core/src/main/java/org/apache/helix/task/FixedTargetTaskRebalancer.java > Ensure that tasks are not placed on targets with pending transitions > > > Key: HELIX-506 > URL: https://issues.apache.org/jira/browse/HELIX-506 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Kanak Biscuitwala > Fix For: 0.7.1, 0.6.4 > > > It may be possible that a task is scheduled/rescheduled somewhere that the > target is in process of changing. The task rebalancer should hold off placing > these. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HELIX-470) Add performant IPC (Helix actors)
[
https://issues.apache.org/jira/browse/HELIX-470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114378#comment-14114378
]
Hudson commented on HELIX-470:
--
SUCCESS: Integrated in helix #1288 (See
[https://builds.apache.org/job/helix/1288/])
[HELIX-470] Netty-based IPC layer, add TestNG config (kbiscuitwala: rev
2a671a116db8f02de4d2208e03241d62935b9fc2)
* helix-ipc/src/test/conf/testng.xml
> Add performant IPC (Helix actors)
> -
>
> Key: HELIX-470
> URL: https://issues.apache.org/jira/browse/HELIX-470
> Project: Apache Helix
> Issue Type: Improvement
> Components: helix-core
>Affects Versions: 0.7.1, 0.6.4
>Reporter: Greg Brandt
> Fix For: 0.7.1
>
>
> Helix is missing a high-performance way to exchange messages among resource
> partitions, with a user-friendly API.
> Currently, the Helix messaging service relies on creating many nodes in
> ZooKeeper, which can lead to ZooKeeper outages if messages are sent too
> frequently.
> In order to avoid this, high-performance NIO-based {{HelixActors}} should be
> implemented (in rough accordance with the actor model). {{HelixActors}}
> exchange messages asynchronously without waiting for a response, and are
> partition/state-addressable.
> The API would look something like this:
> {code}
> public interface HelixActor {
> void send(Partition partition, String state, T message);
> void register(String resource, HelixActorCallback callback);
> }
> public interface HelixActorCallback {
> void onMessage(Partition partition, State state, T message);
> }
> {code}
> {{#send}} should likely support wildcards for partition number and state, or
> its method signature might need to be massaged a little bit for more
> flexibility. But that's the basic idea.
> Nothing is inferred about the format of the messages - the only metadata we
> need to be able to interpret is (1) partition name and (2) state. The user
> provides a codec to encode / decode messages, so it's nicer to implement
> {{HelixActor#send}} and {{HelixActorCallback#onMessage}}.
> {code}
> public interface HelixActorMessageCodec {
> byte[] encode(T message);
> T decode(byte[] message);
> }
> {code}
> Actors should support somewhere around 100k to 1M messages per second. The
> Netty framework is a potential implementation candidate, but should be
> thoroughly evaluated w.r.t. performance.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HELIX-470) Add performant IPC (Helix actors)
[
https://issues.apache.org/jira/browse/HELIX-470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114716#comment-14114716
]
Hudson commented on HELIX-470:
--
ABORTED: Integrated in helix #1290 (See
[https://builds.apache.org/job/helix/1290/])
[HELIX-470] Netty-based IPC layer, fix pom (kanak: rev
1b0d0e45f0ca0fc29c210a5339b4acf44865c36c)
* helix-ipc/pom.xml
> Add performant IPC (Helix actors)
> -
>
> Key: HELIX-470
> URL: https://issues.apache.org/jira/browse/HELIX-470
> Project: Apache Helix
> Issue Type: Improvement
> Components: helix-core
>Affects Versions: 0.7.1, 0.6.4
>Reporter: Greg Brandt
> Fix For: 0.7.1
>
>
> Helix is missing a high-performance way to exchange messages among resource
> partitions, with a user-friendly API.
> Currently, the Helix messaging service relies on creating many nodes in
> ZooKeeper, which can lead to ZooKeeper outages if messages are sent too
> frequently.
> In order to avoid this, high-performance NIO-based {{HelixActors}} should be
> implemented (in rough accordance with the actor model). {{HelixActors}}
> exchange messages asynchronously without waiting for a response, and are
> partition/state-addressable.
> The API would look something like this:
> {code}
> public interface HelixActor {
> void send(Partition partition, String state, T message);
> void register(String resource, HelixActorCallback callback);
> }
> public interface HelixActorCallback {
> void onMessage(Partition partition, State state, T message);
> }
> {code}
> {{#send}} should likely support wildcards for partition number and state, or
> its method signature might need to be massaged a little bit for more
> flexibility. But that's the basic idea.
> Nothing is inferred about the format of the messages - the only metadata we
> need to be able to interpret is (1) partition name and (2) state. The user
> provides a codec to encode / decode messages, so it's nicer to implement
> {{HelixActor#send}} and {{HelixActorCallback#onMessage}}.
> {code}
> public interface HelixActorMessageCodec {
> byte[] encode(T message);
> T decode(byte[] message);
> }
> {code}
> Actors should support somewhere around 100k to 1M messages per second. The
> Netty framework is a potential implementation candidate, but should be
> thoroughly evaluated w.r.t. performance.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HELIX-514) ZkBaseDataAccessor#set() should throw BadVersionException instead of return false in case of version mismatch
[ https://issues.apache.org/jira/browse/HELIX-514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14126430#comment-14126430 ] Hudson commented on HELIX-514: -- FAILURE: Integrated in helix #1292 (See [https://builds.apache.org/job/helix/1292/]) [HELIX-514] ZkBaseDataAccessor#set() should throw BadVersionException instead of return false in case of version mismatch, rb=25453 (zzhang: rev ef2fac3b939daa38a2f9f8199265fa51538ec1b6) * helix-core/src/main/java/org/apache/helix/manager/zk/ZkBaseDataAccessor.java * helix-core/src/main/java/org/apache/helix/manager/zk/HelixGroupCommit.java > ZkBaseDataAccessor#set() should throw BadVersionException instead of return > false in case of version mismatch > - > > Key: HELIX-514 > URL: https://issues.apache.org/jira/browse/HELIX-514 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Zhen Zhang > > ZkBaseDataAccessor#set() should throw BadVersionException instead of return > false in case of version mismatch, since caller (e.g. > HelixGroupCommit#commit()) may need to distinguish between fatal error and > transient error (e.g. version mismatch) so it can retry. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-515) Prepare website for 0.6.4 and 0.7.1 releases
[ https://issues.apache.org/jira/browse/HELIX-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134932#comment-14134932 ] Hudson commented on HELIX-515: -- FAILURE: Integrated in helix #1294 (See [https://builds.apache.org/job/helix/1294/]) [HELIX-515] Prepare website for 0.6.4 and 0.7.1 releases (kanak.b: rev de9197fa9f84caff4f3168200b889d2494c03341) * website/trunk/src/site/markdown/tutorial_health.md * website/0.7.1/src/site/markdown/tutorial_accessors.md * website/0.6.4/src/site/markdown/tutorial_user_def_rebalancer.md * website/trunk/src/site/markdown/tutorial_propstore.md * website/0.7.1/src/site/markdown/tutorial_throttling.md * website/src/site/apt/releasenotes/release-0.7.1.apt * website/0.6.4/src/site/markdown/tutorial_admin.md * pom.xml * website/0.6.4/src/site/markdown/recipes/rabbitmq_consumer_group.md * website/0.6.4/src/site/markdown/index.md * website/trunk/src/site/markdown/tutorial_rebalance.md * website/trunk/src/site/markdown/recipes/service_discovery.md * website/trunk/src/site/markdown/recipes/rabbitmq_consumer_group.md * website/trunk/src/test/conf/testng.xml * website/0.6.4/src/site/apt/privacy-policy.apt * website/src/site/apt/releasenotes/release-0.6.4.apt * website/0.7.1/src/site/markdown/tutorial_participant.md * website/trunk/src/site/markdown/recipes/user_def_rebalancer.md * website/0.6.4/src/site/markdown/tutorial_rebalance.md * website/0.6.4/src/site/markdown/tutorial_agent.md * website/trunk/src/site/markdown/recipes/lock_manager.md * website/0.7.1/src/test/conf/testng.xml * website/trunk/src/site/markdown/Building.md * website/0.7.1/src/site/markdown/tutorial_spectator.md * website/0.7.1/src/site/markdown/Quickstart.md * website/trunk/src/site/resources/download.cgi * website/0.7.1/src/site/markdown/recipes/lock_manager.md * website/0.7.1/src/site/resources/.htaccess * website/src/site/xdoc/download.xml.vm * website/0.6.4/src/site/markdown/Tutorial.md * website/0.7.1/src/site/markdown/recipes/user_def_rebalancer.md * website/0.7.1/src/site/markdown/tutorial_propstore.md * website/0.6.4/src/site/resources/images/RSYNC_BASED_PFS.png * website/trunk/src/site/markdown/tutorial_controller.md * website/0.6.4/src/site/markdown/tutorial_propstore.md * website/0.7.1/src/site/markdown/tutorial_admin.md * website/0.6.4/src/site/apt/releasenotes/release-0.6.4.apt * website/trunk/src/site/apt/privacy-policy.apt * website/0.6.4/src/site/markdown/recipes/service_discovery.md * website/0.6.4/src/site/markdown/Quickstart.md * website/0.7.1/src/site/resources/download.cgi * website/src/site/markdown/index.md * website/trunk/src/site/markdown/index.md * website/trunk/src/site/markdown/Features.md * website/0.7.1/src/site/markdown/Features.md * website/0.6.4/src/site/resources/download.cgi * website/trunk/src/site/resources/.htaccess * website/0.6.4/src/site/markdown/tutorial_throttling.md * website/trunk/src/site/markdown/tutorial_user_def_rebalancer.md * website/0.6.4/src/site/markdown/Building.md * website/0.6.4/src/site/site.xml * website/0.7.1/src/site/resources/images/RSYNC_BASED_PFS.png * website/trunk/src/site/markdown/tutorial_accessors.md * website/trunk/src/site/markdown/tutorial_admin.md * website/0.6.4/src/site/markdown/recipes/task_dag_execution.md * website/0.7.1/src/site/markdown/Building.md * website/0.6.4/src/site/markdown/tutorial_participant.md * website/trunk/src/site/markdown/tutorial_participant.md * website/0.7.1/src/site/markdown/tutorial_user_def_rebalancer.md * website/0.7.1/src/site/markdown/tutorial_controller.md * website/src/site/markdown/Concepts.md * website/trunk/src/site/site.xml * website/src/site/site.xml * website/0.7.1/src/site/markdown/tutorial_agent.md * website/trunk/src/site/resources/images/PFS-Generic.png * website/0.6.4/src/site/markdown/tutorial_spectator.md * website/trunk/src/site/markdown/tutorial_spectator.md * website/src/site/resources/.htaccess * website/0.7.1/src/site/markdown/index.md * website/0.7.1/pom.xml * website/trunk/src/site/markdown/recipes/rsync_replicated_file_store.md * website/0.7.1/src/site/markdown/tutorial_rebalance.md * website/0.7.1/src/site/markdown/tutorial_yaml.md * website/0.6.4/src/site/markdown/recipes/lock_manager.md * website/0.6.4/src/site/markdown/tutorial_messaging.md * website/0.7.1/src/site/site.xml * website/trunk/src/site/markdown/tutorial_throttling.md * website/0.6.4/pom.xml * website/trunk/src/site/markdown/tutorial_state.md * website/0.6.4/src/site/xdoc/download.xml.vm * website/0.7.1/src/site/markdown/tutorial_state.md * website/trunk/src/site/markdown/tutorial_yaml.md * website/trunk/src/site/markdown/Tutorial.md * website/trunk/src/site/markdown/tutorial_messaging.md * website/0.7.1/src/site/apt/privacy-policy.apt * website/0.6.4/src/site/resources/images/PFS-Generic.png * website/trunk/src/site/xdoc/download.xml.vm * website/0.6.4/src/site/markdown/tutorial_state.md * website/trunk/src/site/resources/images/RSYNC_BA
[jira] [Commented] (HELIX-489) Write or rewrite examples using the new API
[ https://issues.apache.org/jira/browse/HELIX-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145097#comment-14145097 ] Hudson commented on HELIX-489: -- SUCCESS: Integrated in helix #1296 (See [https://builds.apache.org/job/helix/1296/]) [HELIX-489] Convert rabbitmq to use new API, rb=25927 (zzhang: rev 00dc16db36c90fea005fd5ff7fe2122c6ab283c3) * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/Consumer.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerStateTransitionHandlerFactory.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerStateModel.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerThread.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerTransitionHandler.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerTransitionHandlerFactory.java > Write or rewrite examples using the new API > --- > > Key: HELIX-489 > URL: https://issues.apache.org/jira/browse/HELIX-489 > Project: Apache Helix > Issue Type: Sub-task >Reporter: Kanak Biscuitwala >Assignee: Xia Lei > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-519) Add integration tests to ensure that "kill-switch" for Helix tasks work as expected
[ https://issues.apache.org/jira/browse/HELIX-519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155517#comment-14155517 ] Hudson commented on HELIX-519: -- UNSTABLE: Integrated in helix #1297 (See [https://builds.apache.org/job/helix/1297/]) [HELIX-519] Add integration tests to ensure that kill-switch for Helix tasks work as expected, rb=26212 (zzhang: rev cfacbbac33d302d80968e7f11fe3b69468a17606) * helix-core/src/test/java/org/apache/helix/integration/task/TestTaskRebalancerStopResume.java * helix-core/src/main/java/org/apache/helix/task/TaskDriver.java * helix-core/src/test/java/org/apache/helix/integration/task/TestUtil.java * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java > Add integration tests to ensure that "kill-switch" for Helix tasks work as > expected > --- > > Key: HELIX-519 > URL: https://issues.apache.org/jira/browse/HELIX-519 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Zhen Zhang > Original Estimate: 72h > Remaining Estimate: 72h > > 1. Integration test is written to verify that any currently running helix > task just stops after "pause" command is issued(this will be done through a > separate tool). Since the job at head of queue is paused, no other job in the > queue should be scheduled. > 2. Integration test is written to verify that no new helix task gets > scheduled until "resume/start" command is issued again > 3. Integration test is written to verify that if we cancel the job at head of > queue, other jobs in the queue get scheduled as per normal queue semantics. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-539) Add ivy file for helix-agent
[ https://issues.apache.org/jira/browse/HELIX-539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199051#comment-14199051 ] Hudson commented on HELIX-539: -- FAILURE: Integrated in helix #1301 (See [https://builds.apache.org/job/helix/1301/]) [HELIX-539] Add ivy file to helix-agent, rb=27638 (zzhang: rev ac9d18d4dbfe22a021603d7b0355b53b70a333bd) * helix-admin-webapp/helix-admin-webapp-0.7.2-SNAPSHOT.ivy * helix-core/helix-core-0.7.2-SNAPSHOT.ivy * helix-core/helix-core-0.7.1-SNAPSHOT.ivy * helix-admin-webapp/helix-admin-webapp-0.7.1-SNAPSHOT.ivy * helix-agent/helix-agent-0.7.2-SNAPSHOT.ivy > Add ivy file for helix-agent > > > Key: HELIX-539 > URL: https://issues.apache.org/jira/browse/HELIX-539 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-537) org.apache.helix.task.TaskStateModel should have a shutdown method.
[
https://issues.apache.org/jira/browse/HELIX-537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207707#comment-14207707
]
Hudson commented on HELIX-537:
--
FAILURE: Integrated in helix #1302 (See
[https://builds.apache.org/job/helix/1302/])
[HELIX-537] Shutdown executors (kanak.b: rev
e96ea8e20e6a2ceff0a6fbf915d96257137ccda3)
*
helix-core/src/main/java/org/apache/helix/messaging/handling/HelixTaskExecutor.java
* helix-core/src/main/java/org/apache/helix/task/TaskStateModel.java
> org.apache.helix.task.TaskStateModel should have a shutdown method.
> ---
>
> Key: HELIX-537
> URL: https://issues.apache.org/jira/browse/HELIX-537
> Project: Apache Helix
> Issue Type: Bug
> Components: helix-core
>Affects Versions: 0.6.3
>Reporter: Antony T Curtis
>Priority: Blocker
>
> There should be a shutdown method to terminate the Timer and Executor which
> the org.apache.helix.task.TaskStateModel class creates.
> ie.
> {noformat}
> public boolean shutdown(long timeout, TimeUnit unit)
> throws InterruptedException
> {
> reset();
> _taskExecutor.shutdown();
> _timer.cancel();
> return _taskExecutor.awaitTermination(timeout, unit);
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HELIX-543) Single partition unnecessarily moved
[ https://issues.apache.org/jira/browse/HELIX-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207834#comment-14207834 ] Hudson commented on HELIX-543: -- UNSTABLE: Integrated in helix #1303 (See [https://builds.apache.org/job/helix/1303/]) HELIX-543 RB-27808 Avoid moving partitions unnecessarily when auto-rebalancing (g.kishore: rev dc9f129b67f8cacdf0cd22288f166b56fc5654a0) * helix-core/src/main/java/org/apache/helix/controller/strategy/AutoRebalanceStrategy.java * helix-agent/helix-agent-0.7.2-SNAPSHOT.ivy * helix-core/src/test/java/org/apache/helix/integration/SinglePartitionLeaderStandByTest.java * helix-core/src/test/java/org/apache/helix/controller/strategy/TestAutoRebalanceStrategy.java > Single partition unnecessarily moved > > > Key: HELIX-543 > URL: https://issues.apache.org/jira/browse/HELIX-543 > Project: Apache Helix > Issue Type: Bug > Components: helix-core >Affects Versions: 0.7.1, 0.6.4 >Reporter: Tom Widmer >Assignee: kishore gopalakrishna >Priority: Minor > > (Copied from mailing list) > I have some resources that I use with the OnlineOffine state but which only > have a single partition at the moment (essentially, Helix is just giving me a > simple leader election to decide who controls the resource - I don’t care > which participant has it, as long as only one does). However, with full auto > rebalance, I find that the ‘first’ instance (alphabetically I think) always > gets the resource when it’s up. So if I take down the first node so the > partition transfers to the 2nd node, then bring back up the 1st node, the > resource transfers back unnecessarily. > Note that this issue also affects multi-partition resources, it’s just a bit > less noticeable (it means that with 3 nodes and 4 partitions, say, the > partitions are always allocated 2, 1, 1, so if you have node 1 down and hence > 0, 2, 2, and then bring up node 1, it unnecessarily moves 2 partitions to > make 2, 1, 1 rather than the minimum move to achieve ‘balance’ which would be > to move 1 partition from instance 2 or 3 back to instance 1. > I can see the code in question in > AutoRebalanceStrategy.typedComputePartitionAssignment, where the > distRemainder is allocated to the first nodes alphabetically, so that the > capacity of all nodes is not equal. > The proposed solution is to sort the nodes by the number of partitions they > already have assigned, which should mean that those nodes are assigned the > higher capacity and the problem goes away. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-549) Discarding Throwable exceptions makes threads unkillable.
[ https://issues.apache.org/jira/browse/HELIX-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217415#comment-14217415 ] Hudson commented on HELIX-549: -- UNSTABLE: Integrated in helix #1304 (See [https://builds.apache.org/job/helix/1304/]) [HELIX-549] Rethrow ThreadDeath instead of discarding. (kanak.b: rev 122ebf5d2ebd13655480f43d50ad63ba2878bec2) * helix-core/src/main/java/org/apache/helix/task/TaskRunner.java * helix-core/src/main/java/org/apache/helix/manager/zk/ZkCacheEventThread.java * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java > Discarding Throwable exceptions makes threads unkillable. > - > > Key: HELIX-549 > URL: https://issues.apache.org/jira/browse/HELIX-549 > Project: Apache Helix > Issue Type: Bug >Affects Versions: 0.6.3 >Reporter: Antony T Curtis >Priority: Blocker > > Threads in loops which catch and discard Throwable end up discarding > ThreadDeath exceptions. This causes Thread.stop() to be effectively ignored. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-552) StateModelFactory#_stateModelMap should use both resourceName and partitionKey to map a state model
[ https://issues.apache.org/jira/browse/HELIX-552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218747#comment-14218747 ] Hudson commented on HELIX-552: -- UNSTABLE: Integrated in helix #1305 (See [https://builds.apache.org/job/helix/1305/]) [HELIX-552] StateModelFactory#_stateModelMap should use both resourceName and partitionKey to map a state model, rb=28211 (zzhang: rev 8e58aa5ad7133284876b9bcbb46f18e03855938e) * helix-core/src/test/java/org/apache/helix/integration/TestPartitionLevelTransitionConstraint.java * helix-provisioning/src/main/java/org/apache/helix/provisioning/participant/StatelessServiceStateModelFactory.java * helix-core/src/main/java/org/apache/helix/messaging/handling/HelixStateTransitionHandler.java * helix-examples/src/main/java/org/apache/helix/examples/BootstrapHandler.java * helix-examples/src/main/java/org/apache/helix/examples/MasterSlaveStateModelFactory.java * recipes/rabbitmq-consumer-group/src/main/java/org/apache/helix/recipes/rabbitmq/ConsumerTransitionHandlerFactory.java * helix-core/src/main/java/org/apache/helix/PropertyKey.java * helix-examples/src/main/java/org/apache/helix/examples/OnlineOfflineStateModelFactory.java * helix-core/src/test/java/org/apache/helix/mock/participant/DummyProcess.java * helix-core/src/main/java/org/apache/helix/participant/MultiClusterControllerTransitionHandlerFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestCorrectnessOnConnectivityLoss.java * helix-examples/src/main/java/org/apache/helix/examples/DummyParticipant.java * helix-core/src/main/java/org/apache/helix/task/TaskStateModelFactory.java * helix-examples/src/main/java/org/apache/helix/examples/LeaderStandbyStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestEntropyFreeNodeBounce.java * helix-core/src/test/java/org/apache/helix/integration/TestHelixConnection.java * helix-core/src/test/java/org/apache/helix/integration/manager/TestStateModelLeak.java * helix-core/src/main/java/org/apache/helix/participant/HelixStateMachineEngine.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockBootstrapModelFactory.java * helix-core/src/main/java/org/apache/helix/api/StateTransitionHandlerFactory.java * recipes/distributed-lock-manager/src/main/java/org/apache/helix/lockmanager/LockFactory.java * helix-core/src/main/java/org/apache/helix/participant/GenericLeaderStandbyStateModelFactory.java * helix-examples/src/main/java/org/apache/helix/examples/LogicalModelExample.java * recipes/rsync-replicated-file-system/src/main/java/org/apache/helix/filestore/FileStoreStateModelFactory.java * helix-agent/src/main/java/org/apache/helix/agent/AgentStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestResourceWithSamePartitionKey.java * helix-core/src/test/java/org/apache/helix/integration/TestMessageThrottle2.java * helix-core/src/test/java/org/apache/helix/participant/TestMultiClusterControllerStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestZkReconnect.java * recipes/task-execution/src/main/java/org/apache/helix/taskexecution/TaskStateModelFactory.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/ScheduledTaskStateModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestStateTransitionTimeout.java * helix-ipc/src/test/java/org/apache/helix/ipc/TestNettyHelixIPCService.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockMSModelFactory.java * recipes/user-defined-rebalancer/src/main/java/org/apache/helix/userdefinedrebalancer/LockFactory.java * helix-core/src/test/java/org/apache/helix/TestHelixTaskHandler.java * helix-core/src/test/java/org/apache/helix/TestHelixTaskExecutor.java * helix-core/src/main/java/org/apache/helix/participant/statemachine/ScheduledTaskStateModel.java * helix-core/src/test/java/org/apache/helix/mock/participant/MockSchemataModelFactory.java * helix-core/src/test/java/org/apache/helix/integration/TestPreferenceListAsQueue.java > StateModelFactory#_stateModelMap should use both resourceName and > partitionKey to map a state model > --- > > Key: HELIX-552 > URL: https://issues.apache.org/jira/browse/HELIX-552 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-550) ZKHelixManager does not shutdown GenericHelixController threads.
[ https://issues.apache.org/jira/browse/HELIX-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221804#comment-14221804 ] Hudson commented on HELIX-550: -- UNSTABLE: Integrated in helix #1306 (See [https://builds.apache.org/job/helix/1306/]) [HELIX-550] Shutdown GenericHelixController on disconnect (kanak.b: rev bfb4a3d34228f5c3806b1eee9e98f401386e66a9) * helix-core/src/main/java/org/apache/helix/manager/zk/ZkHelixController.java * helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java > ZKHelixManager does not shutdown GenericHelixController threads. > > > Key: HELIX-550 > URL: https://issues.apache.org/jira/browse/HELIX-550 > Project: Apache Helix > Issue Type: Bug >Reporter: Antony T Curtis >Priority: Critical > > ZKHelixManager does not shutdown GenericHelixController threads. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-555) ClusterStateVerifier leaks ZkClients.
[ https://issues.apache.org/jira/browse/HELIX-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237408#comment-14237408 ] Hudson commented on HELIX-555: -- UNSTABLE: Integrated in helix #1308 (See [https://builds.apache.org/job/helix/1308/]) [HELIX-555] Allow ClusterStateVerifier classes to take ZkClient, master port (kanak.b: rev 48cd91d76e45cbe8c6f8cbdc5659038ff50900b2) * helix-core/src/main/java/org/apache/helix/tools/ClusterStateVerifier.java > ClusterStateVerifier leaks ZkClients. > - > > Key: HELIX-555 > URL: https://issues.apache.org/jira/browse/HELIX-555 > Project: Apache Helix > Issue Type: Bug >Affects Versions: 0.6.3 >Reporter: Antony T Curtis >Priority: Blocker > > The classes in ClusterStateVerifier tend to leak ZkClients because there is > no way to provide an already constructed client to the class. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-569) Update website docs to correctly pass the rebalance mode to addResource in helix-admin.sh
[ https://issues.apache.org/jira/browse/HELIX-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327018#comment-14327018 ] Hudson commented on HELIX-569: -- UNSTABLE: Integrated in helix #1309 (See [https://builds.apache.org/job/helix/1309/]) [HELIX-569] - Update docs to correctly pass rebalance mode during helix-admin.sh resource creation (adam: rev 2525ecd8f37892201fc427450b85c342db55070c) * website/0.6.4/src/site/markdown/recipes/lock_manager.md * website/0.6.2-incubating/src/site/markdown/recipes/lock_manager.md * website/0.6.1-incubating/src/site/markdown/recipes/lock_manager.md * website/0.6.3/src/site/markdown/recipes/lock_manager.md * website/0.6.1-incubating/src/site/markdown/tutorial_admin.md * recipes/distributed-lock-manager/README.md * website/0.7.0-incubating/src/site/markdown/recipes/lock_manager.md * website/0.7.1/src/site/markdown/recipes/lock_manager.md > Update website docs to correctly pass the rebalance mode to addResource in > helix-admin.sh > - > > Key: HELIX-569 > URL: https://issues.apache.org/jira/browse/HELIX-569 > Project: Apache Helix > Issue Type: Bug >Reporter: Adam McElwee >Priority: Trivial > Fix For: 0.6.1-incubating, 0.6.2-incubating, 0.7.0-incubating, > 0.7.1, 0.6.3, 0.6.4 > > Attachments: fix-rebalance-mode-arg.patch > > > I stumbled upon this the other day in #apachehelix irc. I couldn't get the > distributed locks example to work in full auto rebalance mode, and it turns > out the docs just needed an update. Patch incoming. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-554) Fix TestEntropyFreeNodeBounce in master
[ https://issues.apache.org/jira/browse/HELIX-554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14385643#comment-14385643 ] Hudson commented on HELIX-554: -- SUCCESS: Integrated in helix #1322 (See [https://builds.apache.org/job/helix/1322/]) [HELIX-554] Fix TestEntropyFreeNodeBounce (kanak.b: rev 036ce2118921d2ee39c30dbf64a40001481c7133) * helix-core/src/test/java/org/apache/helix/integration/TestEntropyFreeNodeBounce.java > Fix TestEntropyFreeNodeBounce in master > --- > > Key: HELIX-554 > URL: https://issues.apache.org/jira/browse/HELIX-554 > Project: Apache Helix > Issue Type: Bug >Reporter: Zhen Zhang >Assignee: Kanak Biscuitwala > Fix For: 0.7.2 > > > Currently TestEntropyFreeNodeBounce is failing in master because of this > change: HELIX-543 RB-27808 > https://git-wip-us.apache.org/repos/asf?p=helix.git;a=commit;h=dc9f129b67f8cacdf0cd22288f166b56fc5654a0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HELIX-584) SimpleDateFormat should not be used as singleton due to its race conditions
[ https://issues.apache.org/jira/browse/HELIX-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14513592#comment-14513592 ] Hudson commented on HELIX-584: -- SUCCESS: Integrated in helix #1324 (See [https://builds.apache.org/job/helix/1324/]) [HELIX-584] SimpleDateFormat should not be used as singleton due to its race conditions. (lxia: rev a29ac9fb35365d1fe8cf12ef95c58643a5fea36b) * helix-core/src/main/java/org/apache/helix/task/WorkflowConfig.java * helix-core/src/main/java/org/apache/helix/task/TaskDriver.java * helix-core/src/main/java/org/apache/helix/task/TaskUtil.java > SimpleDateFormat should not be used as singleton due to its race conditions > --- > > Key: HELIX-584 > URL: https://issues.apache.org/jira/browse/HELIX-584 > Project: Apache Helix > Issue Type: Bug >Reporter: Lei Xia >Assignee: Lei Xia > > SimpleDateFormat is used in workflowConfig as a singleton. But since it is > not thread-safe (refer here: > http://www.hpenterprisesecurity.com/vulncat/en/vulncat/java/race_condition_format_flaw.html), > it will mess up the output date format sometime due to race condition. > An example trace stack for such failure: > Message: > For input string: "2003.E2003E22" > Full Stacktrace: > java.lang.NumberFormatException: For input string: "2003.E2003E22" > at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222) > at java.lang.Double.parseDouble(Double.java:510) > at java.text.DigitList.getDouble(DigitList.java:151) > at java.text.DecimalFormat.parse(DecimalFormat.java:1302) > at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:1935) > at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1311) > at java.text.DateFormat.parse(DateFormat.java:335) > at > org.apache.helix.task.TaskUtil.parseScheduleFromConfigMap(TaskUtil.java:365) > at > org.apache.helix.task.WorkflowConfig$Builder.fromMap(WorkflowConfig.java:173) > at org.apache.helix.task.TaskUtil.getWorkflowCfg(TaskUtil.java:113) > at org.apache.helix.task.TaskUtil.getWorkflowCfg(TaskUtil.java:126) > at > org.apache.helix.integration.task.TestUtil.pollForJobState(TestUtil.java:61) > at > org.apache.helix.integration.task.TestTaskRebalancerStopResume.stopDeleteJobAndResumeRecurrentQueue(TestTaskRebalancerStopResume.java:420) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:76) > at org.testng.internal.Invoker.invokeMethod(Invoker.java:673) > at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:846) > at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1170) > at > org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125) > at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109) > at org.testng.TestRunner.runWorkers(TestRunner.java:1147) > at org.testng.TestRunner.privateRun(TestRunner.java:749) > at org.testng.TestRunner.run(TestRunner.java:600) > at org.testng.SuiteRunner.runTest(SuiteRunner.java:317) > at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:312) > at org.testng.SuiteRunner.privateRun(SuiteRunner.java:274) > at org.testng.SuiteRunner.run(SuiteRunner.java:223) > at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) > at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) > at org.testng.TestNG.runSuitesSequentially(TestNG.java:1039) > at org.testng.TestNG.runSuitesLocally(TestNG.java:964) > at org.testng.TestNG.run(TestNG.java:900) > at > org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:178) > at > org.apache.maven.surefire.testng.TestNGXmlTestSuite.execute(TestNGXmlTestSuite.java:92) > at > org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:96) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray2(ReflectionUtils.java:208) > at > org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:158) > at > org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:86) > at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) > at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:
