[jira] [Commented] (HELIX-524) add getProgress() to Task interface

2014-10-10 Thread Hongbo Zeng (JIRA)

[ 
https://issues.apache.org/jira/browse/HELIX-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167742#comment-14167742
 ] 

Hongbo Zeng commented on HELIX-524:
---

I was thinking about the TaskRunner gets the progress from a task and push the 
update somewhere (like Kafka). Anyways, this sounds a better plan, I will put 
something together for review.

> add getProgress() to Task interface
> ---
>
> Key: HELIX-524
> URL: https://issues.apache.org/jira/browse/HELIX-524
> Project: Apache Helix
>  Issue Type: Improvement
>  Components: helix-core
>Affects Versions: 0.6.4
>Reporter: Hongbo Zeng
> Fix For: 0.6.5
>
>
> Add a getProgress to the Task interface, this is very helpful for long 
> running tasks, from which we know the status of a task and see if it's 
> blocked. The return value is a double, ranging from 0 to 1.0, 1.0 indicates a 
> task is finished



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Writing custom rebalancer

2014-10-10 Thread kishore g
Hi,

Even though we have couple of ways of writing custom rebalancer (one on
participant side and another on the controller side), I dont think its
trivial for some one to write them without understanding all the internal
details of Helix.

I am starting this thread to see if others have any thoughts on making it
easier for some to get started and write their own rebalancer as part of
the quick start.

thanks,
Kishore G


[jira] [Commented] (HELIX-524) add getProgress() to Task interface

2014-10-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/HELIX-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167167#comment-14167167
 ] 

ASF GitHub Bot commented on HELIX-524:
--

Github user kanakb commented on the pull request:

https://github.com/apache/helix/pull/6#issuecomment-58689390
  
Kishore from JIRA comments:

```
Yes, thats the idea. With helix-ipc this will be possible rt? This can be
extended to write rebalancers that talk to nodes to get the high water mark
to decide new master. what do you think?
```

Jason from JIRA comments:

```
Yes. Helix-IPC will do the job. We can also extend the idea to get high
water mark, etc. Helix task frame exposes Task interface, so users are not
implementing StateModel directly. How can we make this available to Task
also?
```


> add getProgress() to Task interface
> ---
>
> Key: HELIX-524
> URL: https://issues.apache.org/jira/browse/HELIX-524
> Project: Apache Helix
>  Issue Type: Improvement
>  Components: helix-core
>Affects Versions: 0.6.4
>Reporter: Hongbo Zeng
> Fix For: 0.6.5
>
>
> Add a getProgress to the Task interface, this is very helpful for long 
> running tasks, from which we know the status of a task and see if it's 
> blocked. The return value is a double, ranging from 0 to 1.0, 1.0 indicates a 
> task is finished



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] helix pull request: [HELIX-524] Add a getProgress to the Task inte...

2014-10-10 Thread kanakb
Github user kanakb commented on the pull request:

https://github.com/apache/helix/pull/6#issuecomment-58689390
  
Kishore from JIRA comments:

```
Yes, thats the idea. With helix-ipc this will be possible rt? This can be
extended to write rebalancers that talk to nodes to get the high water mark
to decide new master. what do you think?
```

Jason from JIRA comments:

```
Yes. Helix-IPC will do the job. We can also extend the idea to get high
water mark, etc. Helix task frame exposes Task interface, so users are not
implementing StateModel directly. How can we make this available to Task
also?
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---