[GitHub] helix pull request: [HELIX-524] Add a getProgress to the Task inte...
Github user kanakb commented on the pull request: https://github.com/apache/helix/pull/6#issuecomment-58689390 Kishore from JIRA comments: ``` Yes, thats the idea. With helix-ipc this will be possible rt? This can be extended to write rebalancers that talk to nodes to get the high water mark to decide new master. what do you think? ``` Jason from JIRA comments: ``` Yes. Helix-IPC will do the job. We can also extend the idea to get high water mark, etc. Helix task frame exposes Task interface, so users are not implementing StateModel directly. How can we make this available to Task also? ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (HELIX-524) add getProgress() to Task interface
[ https://issues.apache.org/jira/browse/HELIX-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167167#comment-14167167 ] ASF GitHub Bot commented on HELIX-524: -- Github user kanakb commented on the pull request: https://github.com/apache/helix/pull/6#issuecomment-58689390 Kishore from JIRA comments: ``` Yes, thats the idea. With helix-ipc this will be possible rt? This can be extended to write rebalancers that talk to nodes to get the high water mark to decide new master. what do you think? ``` Jason from JIRA comments: ``` Yes. Helix-IPC will do the job. We can also extend the idea to get high water mark, etc. Helix task frame exposes Task interface, so users are not implementing StateModel directly. How can we make this available to Task also? ``` add getProgress() to Task interface --- Key: HELIX-524 URL: https://issues.apache.org/jira/browse/HELIX-524 Project: Apache Helix Issue Type: Improvement Components: helix-core Affects Versions: 0.6.4 Reporter: Hongbo Zeng Fix For: 0.6.5 Add a getProgress to the Task interface, this is very helpful for long running tasks, from which we know the status of a task and see if it's blocked. The return value is a double, ranging from 0 to 1.0, 1.0 indicates a task is finished -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Writing custom rebalancer
Hi, Even though we have couple of ways of writing custom rebalancer (one on participant side and another on the controller side), I dont think its trivial for some one to write them without understanding all the internal details of Helix. I am starting this thread to see if others have any thoughts on making it easier for some to get started and write their own rebalancer as part of the quick start. thanks, Kishore G
[jira] [Commented] (HELIX-524) add getProgress() to Task interface
[ https://issues.apache.org/jira/browse/HELIX-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167742#comment-14167742 ] Hongbo Zeng commented on HELIX-524: --- I was thinking about the TaskRunner gets the progress from a task and push the update somewhere (like Kafka). Anyways, this sounds a better plan, I will put something together for review. add getProgress() to Task interface --- Key: HELIX-524 URL: https://issues.apache.org/jira/browse/HELIX-524 Project: Apache Helix Issue Type: Improvement Components: helix-core Affects Versions: 0.6.4 Reporter: Hongbo Zeng Fix For: 0.6.5 Add a getProgress to the Task interface, this is very helpful for long running tasks, from which we know the status of a task and see if it's blocked. The return value is a double, ranging from 0 to 1.0, 1.0 indicates a task is finished -- This message was sent by Atlassian JIRA (v6.3.4#6332)
