Re: Add performant IPC (Helix actors)

2014-07-11 Thread kishore g
Good point Vlad, I was thinking of defining the right abstraction and possibly provide one implementation based. I think the synchronous and asynchronous messaging should be covered as part of this. Also I think Finagle and likes of it cater more towards the client server communication but what we

Review Request 23426: [HELIX-471] Unregister ResourceMonitor on drop

2014-07-11 Thread Kanak Biscuitwala
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23426/ --- Review request for helix, Zhen Zhang and Kishore Gopalakrishna. Bugs: HELIX-471

[jira] [Created] (HELIX-471) ResourceMonitor never unregistered even if the resource is dropped

2014-07-11 Thread Kanak Biscuitwala (JIRA)
Kanak Biscuitwala created HELIX-471: --- Summary: ResourceMonitor never unregistered even if the resource is dropped Key: HELIX-471 URL: https://issues.apache.org/jira/browse/HELIX-471 Project: Apache

[jira] [Commented] (HELIX-380) Incompatibility issue with HELIX_PROPERTYSTORE

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059439#comment-14059439 ] Hudson commented on HELIX-380: -- FAILURE: Integrated in helix #1259 (See [https://builds.apach

helix - Build # 1259 - Still Failing

2014-07-11 Thread Apache Jenkins Server
The Apache Jenkins build system has built helix (build #1259) Status: Still Failing Check console output at https://builds.apache.org/job/helix/1259/ to view the results.

helix - Build # 1259 - Still Failing

2014-07-11 Thread Apache Jenkins Server
The Apache Jenkins build system has built helix (build #1259) Status: Still Failing Check console output at https://builds.apache.org/job/helix/1259/ to view the results.

[jira] [Commented] (HELIX-380) Incompatibility issue with HELIX_PROPERTYSTORE

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059313#comment-14059313 ] Hudson commented on HELIX-380: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-465) ZkCopy skips paths already exist in destination namespace

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059319#comment-14059319 ] Hudson commented on HELIX-465: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-463) Add gauges for participant and controller message queue sizes

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059317#comment-14059317 ] Hudson commented on HELIX-463: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-443) Race condition in Helix register/unregister MessageHandlerFactory

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059310#comment-14059310 ] Hudson commented on HELIX-443: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-453) On session expiry/recovery, not all message types are re-registered

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059315#comment-14059315 ] Hudson commented on HELIX-453: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-466) Speed up zkcopy by using asyn read/write

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059318#comment-14059318 ] Hudson commented on HELIX-466: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-464) rabbitmq recipe is broken

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059316#comment-14059316 ] Hudson commented on HELIX-464: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-395) Remove old Helix alert/stat modules

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059312#comment-14059312 ] Hudson commented on HELIX-395: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-130) ZkDumper should provide a copy option

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059314#comment-14059314 ] Hudson commented on HELIX-130: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

[jira] [Commented] (HELIX-445) NPE in ZkPathDataDumpTask

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059311#comment-14059311 ] Hudson commented on HELIX-445: -- FAILURE: Integrated in helix #1258 (See [https://builds.apach

helix - Build # 1258 - Still Failing

2014-07-11 Thread Apache Jenkins Server
The Apache Jenkins build system has built helix (build #1258) Status: Still Failing Check console output at https://builds.apache.org/job/helix/1258/ to view the results.

Re: Re-define: What is Helix

2014-07-11 Thread Greg Brandt
>From talking w/ Kishore earlier, think the key thing to convey to users is the level of control they get. "Cluster manager/management" seems like something relatively out of the user's control, like some external service that contains their services. But "framework" or "toolkit" conveys more contr

Re: Re-define: What is Helix

2014-07-11 Thread Zhen Zhang
How about "Distributed state coordinator"? From: kishore g mailto:g.kish...@gmail.com>> Reply-To: "u...@helix.apache.org" mailto:u...@helix.apache.org>> Date: Friday, July 11, 2014 1:07 PM To: "u...@helix.apache.org" mailto:u...@helix.a

Re: Re-define: What is Helix

2014-07-11 Thread kishore g
Throwing in another option "Toolkit for building distributed systems". On Fri, Jul 11, 2014 at 11:30 AM, Kanak Biscuitwala wrote: > SolrCloud's Helix clone throws around the word "orchestrate". I have found > it to be a useful term when describing Helix to others as well. > > > Date: Fri, 11 J

Re: Add performant IPC (Helix actors)

2014-07-11 Thread Greg Brandt
Vlad, I'm not sure that the goal here is to cover all possible use cases. This is intended as basically a replacement for the current Helix cluster messaging service, which doesn't rely on ZooKeeper. I would argue that Helix is already that general framework for discovering the service endpoint, a

RE: Re-define: What is Helix

2014-07-11 Thread Kanak Biscuitwala
SolrCloud's Helix clone throws around the word "orchestrate". I have found it to be a useful term when describing Helix to others as well. > Date: Fri, 11 Jul 2014 11:25:27 -0700 > Subject: Re: Re-define: What is Helix > From: osgig...@gmail.com > To: u...@helix.apache.org > CC: dev@helix.apache.

Re: Re-define: What is Helix

2014-07-11 Thread Sandeep Nayak
I read through the response on the stackoverflow and from what I know the crux of the Helix framework appears to be 'Automation of Declarative State Management for Clustered Resources' ... now isn't that a mouth-full :-) I think any other capability with scaling etc is add-on to the core competenc

Add performant IPC (Helix actors)

2014-07-11 Thread Greg Brandt
(copied from HELIX-470) Helix is missing a high-performance way to exchange messages among resource partitions, with a user-friendly API. Currently, the Helix messaging service relies on creating many nodes in ZooKeeper, which can lead to ZooKeeper outages if messages are sent too frequently. In

[jira] [Created] (HELIX-470) Add performant IPC (Helix actors)

2014-07-11 Thread Greg Brandt (JIRA)
Greg Brandt created HELIX-470: - Summary: Add performant IPC (Helix actors) Key: HELIX-470 URL: https://issues.apache.org/jira/browse/HELIX-470 Project: Apache Helix Issue Type: Improvement

Re: Re-define: What is Helix

2014-07-11 Thread Shirshanka Das
Think about analogies to netty for network programming in Java  _ From: kishore g Sent: Friday, July 11, 2014 10:46 AM Subject: Re-define: What is Helix To: , Hi,This is something that has bee

[jira] [Commented] (HELIX-94) Add the ability to enable and disable a resource

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059090#comment-14059090 ] Hudson commented on HELIX-94: - FAILURE: Integrated in helix #1257 (See [https://builds.apache.o

[jira] [Commented] (HELIX-446) Remove ZkPropertyTransfer and restlet dependency from helix-core

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059087#comment-14059087 ] Hudson commented on HELIX-446: -- FAILURE: Integrated in helix #1257 (See [https://builds.apach

[jira] [Commented] (HELIX-455) Add REST API for submitting jobs

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059088#comment-14059088 ] Hudson commented on HELIX-455: -- FAILURE: Integrated in helix #1257 (See [https://builds.apach

[jira] [Commented] (HELIX-444) add per-participant partition count gauges to helix

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059086#comment-14059086 ] Hudson commented on HELIX-444: -- FAILURE: Integrated in helix #1257 (See [https://builds.apach

[jira] [Commented] (HELIX-430) Restlet 2.2.0 causes failures

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059085#comment-14059085 ] Hudson commented on HELIX-430: -- FAILURE: Integrated in helix #1257 (See [https://builds.apach

[jira] [Commented] (HELIX-461) Add a partitions without top state metric

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HELIX-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059089#comment-14059089 ] Hudson commented on HELIX-461: -- FAILURE: Integrated in helix #1257 (See [https://builds.apach

Re-define: What is Helix

2014-07-11 Thread kishore g
Hi, This is something that has been bothering most of us. Should we call Helix *"cluster management framework"*? Its a framework alright, but is it cluster manager?- I am not sure. Cluster management is a broad term and can mean different things to different people. But the most common understandi

helix - Build # 1257 - Failure

2014-07-11 Thread Apache Jenkins Server
The Apache Jenkins build system has built helix (build #1257) Status: Failure Check console output at https://builds.apache.org/job/helix/1257/ to view the results.