[GitHub] twill issue #31: Avoid packaging resources jar in the ApplicationMaster

2017-02-02 Thread chtyim
Github user chtyim commented on the issue: https://github.com/apache/twill/pull/31 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

Re: Writing Long Running Applications in Twill

2017-02-02 Thread Terence Yim
Forwarding to the dev@ mailing list to continue the discussion. On Thu, Feb 2, 2017 at 11:11 PM, Terence Yim wrote: > Hi, > > Codes that are written the TwillRunnable are the one that get shipped and > run in Yarn containers. Termination of the client process won't terminate > the running applic

Re: Implementing a Distributed Periodic Query Service in Twill

2017-02-02 Thread Terence Yim
Hi, Twill itself doesn't provide native support for pub/sub message. However using Apache Kafka for your use case seems like a reasonable choice. Terence Sent from my iPhone > On Feb 2, 2017, at 2:45 PM, Meier, Caleb wrote: > > Hello, > > I’m looking into writing a periodic query service in

[jira] [Commented] (TWILL-181) Control the maximum number of retries for failed application starts

2017-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/TWILL-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850979#comment-15850979 ] ASF GitHub Bot commented on TWILL-181: -- Github user serranom commented on the issue:

[GitHub] twill issue #23: (TWILL-181) allow setting the maximum number of retries per...

2017-02-02 Thread serranom
Github user serranom commented on the issue: https://github.com/apache/twill/pull/23 I found that there is still a race condition in ApplicationMasterService.launchRunnable. If the number of instances is increased right after the original request is fullfilled, the current logic can

[GitHub] twill pull request #31: Avoid packaging resources jar in the ApplicationMast...

2017-02-02 Thread anwar6953
GitHub user anwar6953 opened a pull request: https://github.com/apache/twill/pull/31 Avoid packaging resources jar in the ApplicationMaster Avoid packaging resources jar in the ApplicationMaster, so that the logback.xml in it doesn't affect the AM. Otherwise, the stdout of the A

Implementing a Distributed Periodic Query Service in Twill

2017-02-02 Thread Meier, Caleb
Hello, I’m looking into writing a periodic query service in Twill. Users can register a query and specify a duration of time, which determines how long the service waits between executing each query. I want to implement a Coordinator (which wraps a ScheduledServiceExecutor) to periodically ge

[jira] [Commented] (TWILL-181) Control the maximum number of retries for failed application starts

2017-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/TWILL-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850457#comment-15850457 ] ASF GitHub Bot commented on TWILL-181: -- Github user serranom commented on the issue:

[GitHub] twill issue #23: (TWILL-181) allow setting the maximum number of retries per...

2017-02-02 Thread serranom
Github user serranom commented on the issue: https://github.com/apache/twill/pull/23 ugh. I'll take a look, I may have messed up the merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[jira] [Commented] (TWILL-181) Control the maximum number of retries for failed application starts

2017-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/TWILL-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850080#comment-15850080 ] ASF GitHub Bot commented on TWILL-181: -- Github user serranom commented on the issue:

[GitHub] twill issue #23: (TWILL-181) allow setting the maximum number of retries per...

2017-02-02 Thread serranom
Github user serranom commented on the issue: https://github.com/apache/twill/pull/23 I think this is set now. I've updated the PR with instance-based maxRetries changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I