Samza 0.10 released

2016-01-04 Thread Yi Pan
Hi, all, In case you missed the announcement of Samza 0.10 release before the Christmas, please check it out here: https://blogs.apache.org/samza/ and help to spread out the word on twitter. And happy new year to everyone! Thanks! -Yi

Re: Review Request 41663: SAMZA-843 : Slow start of Samza jobs with large number of containers

2016-01-04 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41663/ --- (Updated Jan. 4, 2016, 8:14 p.m.) Review request for samza, Boris Shkolnik,

Re: Review Request 41663: SAMZA-843 : Slow start of Samza jobs with large number of containers

2016-01-04 Thread Boris Shkolnik
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41663/#review112678 ---

Re: Review Request 41663: SAMZA-843 : Slow start of Samza jobs with large number of containers

2016-01-04 Thread Navina Ramesh
> On Jan. 4, 2016, 11:11 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-core/src/main/scala/org/apache/samza/coordinator/JobCoordinator.scala, > > line 204 > > > > > > I am a bit confused here. If the

Re: Review Request 41874: SAMZA-837: Support Gradle 2.9

2016-01-04 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41874/#review112705 --- Ship it! Ship It! - Jake Maes On Jan. 4, 2016, 9:59 a.m.,

Re: Review Request 41874: SAMZA-837: Support Gradle 2.9

2016-01-04 Thread Boris Shkolnik
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41874/#review112707 --- Ship it! Ship It! - Boris Shkolnik On Jan. 4, 2016, 9:59 a.m.,

Re: Review Request 41663: SAMZA-843 : Slow start of Samza jobs with large number of containers

2016-01-04 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41663/ --- (Updated Jan. 5, 2016, 12:29 a.m.) Review request for samza, Boris Shkolnik,

Re: Review Request 41663: SAMZA-843 : Slow start of Samza jobs with large number of containers

2016-01-04 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41663/#review112677 ---

Re: Review Request 41663: SAMZA-843 : Slow start of Samza jobs with large number of containers

2016-01-04 Thread Yi Pan (Data Infrastructure)
> On Jan. 4, 2016, 11:11 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-core/src/main/scala/org/apache/samza/coordinator/JobCoordinator.scala, > > line 204 > > > > > > I am a bit confused here. If the

Review Request 41912: SAMZA-850: Yarn Job Validation Tool

2016-01-04 Thread Xinyu Liu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41912/ --- Review request for samza, Boris Shkolnik, Navina Ramesh, and Yi Pan (Data

Re: Review Request 41663: SAMZA-843 : Slow start of Samza jobs with large number of containers

2016-01-04 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41663/ --- (Updated Jan. 5, 2016, 1:45 a.m.) Review request for samza, Boris Shkolnik,

Review Request 41884: SAMZA-802: KafkaSystemAdmin needs to handle empty topic offsets

2016-01-04 Thread Aleksandar Pejakovic
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41884/ --- Review request for samza. Repository: samza Description --- Quick fix

RocksDB LOG file rotation

2016-01-04 Thread Edi Bice
I noticed that the LOG files in each RocksDB kv store grow indefinitely. I could set them up via logrotate but it would be cumbersome and against the grain. Tried to figure out if RocksDB has a configuration file and I don't have a definite answer yet (the one mention is for version 4.3). RocksDB

Re: Review Request 40313: SAMZA-785

2016-01-04 Thread VENKATA KRISHNA NANNAPANENI
> On Nov. 18, 2015, 9:31 p.m., Navina Ramesh wrote: > > Sorry, I hope this is not too late. It does throw an exception if it can't find the serde. - VENKATA KRISHNA --- This is an automatically generated e-mail. To reply, visit:

Re: Review Request 40313: SAMZA-785

2016-01-04 Thread VENKATA KRISHNA NANNAPANENI
> On Nov. 18, 2015, 9:31 p.m., Navina Ramesh wrote: > > samza-log4j/src/main/java/org/apache/samza/logging/log4j/StreamAppender.java, > > line 242 > > > > > > What happens if serdeName is not defined at stream or

Re: Batch processing stream-stream joins

2016-01-04 Thread Yi Pan
Hi, Rick, Please refer to the whole discussion on SAMZA-552, which exactly targets the issues that you are considering. We have been working on the design and proto-type since last year. The work was paused for the last few months due to other priorities. We are planning to resume the work this