Review Request 33674: Fix SAMZA-660 - Default serdes do not work for changelog streams.

2015-04-29 Thread Tommy Becker
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33674/ --- Review request for samza. Repository: samza Description --- Fix

Re: Review Request 33674: Fix SAMZA-660 - Default serdes do not work for changelog streams.

2015-04-29 Thread Yan Fang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33674/#review81978 ---

Re: Samza serializers jar for 0.9.0 ?

2015-04-29 Thread Chinmay Soman
Oh never mind - I forgot it being merged into core. Sorry for the noise. On Wed, Apr 29, 2015 at 12:03 PM, Chinmay Soman chinmay.cere...@gmail.com wrote: I don't see the serializers jar being published in Maven. Yan - know anything about this ? -- Thanks and regards Chinmay Soman --

Re: Review Request 32147: SAMZA-465

2015-04-29 Thread Yan Fang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32147/#review81995 ---

Re: Review Request 33453: SAMZA-557 Reuse local state in SamzaContainer on clean shutdown

2015-04-29 Thread Navina Ramesh
On April 28, 2015, 5:43 p.m., Yi Pan (Data Infrastructure) wrote: samza-core/src/main/scala/org/apache/samza/container/SamzaContainer.scala, line 457 https://reviews.apache.org/r/33453/diff/2/?file=939981#file939981line457 Question: shouldn't the base dir to be determined by

Re: Review Request 33674: Fix SAMZA-660 - Default serdes do not work for changelog streams.

2015-04-29 Thread Tommy Becker
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33674/ --- (Updated April 29, 2015, 2:28 p.m.) Review request for samza. Changes

Samza serializers jar for 0.9.0 ?

2015-04-29 Thread Chinmay Soman
I don't see the serializers jar being published in Maven. Yan - know anything about this ? -- Thanks and regards Chinmay Soman

Re: Review Request 32147: SAMZA-465

2015-04-29 Thread Naveen Somasundaram
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32147/#review82006 ---

Re: Review Request 32147: SAMZA-465

2015-04-29 Thread Naveen Somasundaram
On April 29, 2015, 7:30 p.m., Yan Fang wrote: samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamMessage.java, line 436 https://reviews.apache.org/r/32147/diff/7/?file=922533#file922533line436 typo, SetChangelogMapping? I'll fix this when I update the

Re: Review Request 32147: SAMZA-465

2015-04-29 Thread Naveen Somasundaram
On April 29, 2015, 7:30 p.m., Yan Fang wrote: samza-core/src/main/java/org/apache/samza/checkpoint/CheckpointManager.java, line 98 https://reviews.apache.org/r/32147/diff/7/?file=922532#file922532line98 why do we need to bootstrap everytime we call this method? We need to

Re: Review Request 32147: SAMZA-465

2015-04-29 Thread Naveen Somasundaram
- Naveen --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32147/#review81995 --- On April 10, 2015, 3:13 a.m., Naveen Somasundaram

Re: Review Request 32147: SAMZA-465

2015-04-29 Thread Naveen Somasundaram
On April 29, 2015, 7:30 p.m., Yan Fang wrote: samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamSystemConsumer.java, line 149 https://reviews.apache.org/r/32147/diff/7/?file=922534#file922534line149 Will this bootstrappedStreamSet overflow or take a

Re: Review Request 32147: SAMZA-465

2015-04-29 Thread Naveen Somasundaram
On April 29, 2015, 7:30 p.m., Yan Fang wrote: samza-core/src/main/java/org/apache/samza/storage/ChangelogPartitionManager.java, lines 60-68 https://reviews.apache.org/r/32147/diff/7/?file=922539#file922539line60 actually, we do not need the consumer after boostrapping, right? Do

Re: What next for streaming SQL?

2015-04-29 Thread Julian Hyde
Can you give an example of the SQL syntax you are using for tumbling windows? Does it use GROUP BY and FLOOR, as in https://github.com/apache/incubator-calcite/blob/master/doc/STREAM.md#tumbling-windows https://github.com/apache/incubator-calcite/blob/master/doc/STREAM.md#tumbling-windows?

Re: Errors and hung job on broker shutdown

2015-04-29 Thread Guozhang Wang
Roger, I believe Samza 0.9.0 already uses the Java producer. Java producer's close() call will try to flush all buffered data to the brokers before completing the call. However, if some buffered data's destination partition leader is not known, the producer will block on refreshing the metadata