[GitHub] samza pull request #263: SAMZA-1384: Race condition with async commit affect...

2017-08-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/263 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[Discuss] Samza 0.13.1 release

2017-08-10 Thread Fred Ji
Hi all, There have been some new featuresand critical bug fixes added to master since 0.13.0 release, which makes SamzaStandalone features more stable. It is now good enough to warrant a new minorrelease. We will continue to test for stability and performance in the next fewweeks. Here are the m

Re: Using Amazon Kinesis as Samza Backend

2017-08-10 Thread Yi Pan
Hi, Christopher, I am glad that you are interested in the Kinesis integration to Samza! Yes, Renato's implementation is so far the most complete one. However, I think that it might not handle dynamic shard split/merge cases. Aditya Toomula in our team is currently working on a complete proposal to

[GitHub] samza pull request #266: SAMZA-1387: Unable to Start Samza App Because Regex...

2017-08-10 Thread jmakes
GitHub user jmakes opened a pull request: https://github.com/apache/samza/pull/266 SAMZA-1387: Unable to Start Samza App Because Regex Check You can merge this pull request into a Git repository by running: $ git pull https://github.com/jmakes/samza samza-1387 Alternatively y

[GitHub] samza pull request #267: Zk lock example

2017-08-10 Thread sborya
GitHub user sborya opened a pull request: https://github.com/apache/samza/pull/267 Zk lock example This is a suggestion on ZkLock implementation. PR is not ready for final review. @navina @PawasChhokra You can merge this pull request into a Git repository by running:

Re: [Discuss] Samza 0.13.1 release

2017-08-10 Thread Jacob Maes
Hey Fred, The email seems to have some whitespace issues. Can you try sending it again? Also, I'd like to include the patch for https://issues.apache.org/ jira/browse/SAMZA-1387 in the release. The PR is up for review now. Please take a look and let me know what you think. -Jake On Thu, Aug 10,

[GitHub] samza pull request #268: Fix ZkLatch await(timeout, TimeUnit) api.

2017-08-10 Thread shanthoosh
GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/268 Fix ZkLatch await(timeout, TimeUnit) api. Use passed in timeUnit value for zkClient.waitUnitExists method rather than hardcoding with `TimeUnit.MILLISECONDS`. You can merge this pull request int

Re: [Discuss] Samza 0.13.1 release

2017-08-10 Thread Fred Haifeng Ji
The format was messed up when sent from my yahoo mail to dev@samza.apache.org. I am resending it from my gmail account. Sorry for inconvenience! Hi all, There have been some new features and critical bug fixes added to master since 0.13.0 release, which makes Samza Standalone features more stable

Re: [Discuss] Samza 0.13.1 release

2017-08-10 Thread Jagadish Venkatraman
+1 for the release. thanks for the summary and for driving this Fred! On Thu, Aug 10, 2017 at 5:15 PM Fred Haifeng Ji wrote: > The format was messed up when sent from my yahoo mail to > dev@samza.apache.org. I am resending it from my gmail account. Sorry for > inconvenience! > > Hi all, > > Ther

Re: Custom ordering when using async

2017-08-10 Thread Jagadish Venkatraman
Hi XiaoChuan, Are you setting task.max.concurrency > 1 that allows multiple messages in-flight? (The "keyed executor pool" is only meaningful with that scenario) Also, Have you tried increasing your *job.container.thread.pool.size *config and setting it to the number of tasks in the container? Gi