Kafka broker error from samza producer

Hey Everyone, I'm getting an: "kafka.message.InvalidMessageException: Message found with corrupt size (0)" in my kafka server.log here is the full stack trace: https://gist.github.com/jshaw86/516cf47b6fd7559e7dc1. It indicates that the error is caused by a bad produce call from the samza produce

Re: Samza and sliding window

Thanks Yi. I got the pastebin link. I am looking at it. Shekar On Jul 22, 2015 5:09 PM, "Yi Pan" wrote: > Hmm... did you get my pastebin post? If not, I can send the diff directly > to your gmail account. > > On Wed, Jul 22, 2015 at 11:23 AM, Shekar Tippur wrote: > > > Yi, > > > > I am not sure

Re: Samza and sliding window

Hmm... did you get my pastebin post? If not, I can send the diff directly to your gmail account. On Wed, Jul 22, 2015 at 11:23 AM, Shekar Tippur wrote: > Yi, > > I am not sure if attachments gets filtered when sent to the group. I have > seen this earlier as well. > > - Shekar >

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36006/#review92625 --- samza-core/src/main/java/org/apache/samza/autoScaling/deployer/Conf

Re: Samza and sliding window

Hi, Shekar, Here it is: http://pastebin.com/fKGpHwW6 -Yi On Wed, Jul 22, 2015 at 8:05 AM, Shekar Tippur wrote: > Yi, > > I am not sure I see an attachment. Is it possible to paste that on > pastebin? > > Shekar > On Jul 21, 2015 4:27 PM, "Yi Pan" wrote: > > > Hi, Shekar, > > > > I have stri

Re: Review Request 36471: Autoscaling for samza (work in progress)

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36471/ --- (Updated July 22, 2015, 7:06 p.m.) Review request for samza and Navina Ramesh.

Re: Review Request 36006: Writing a tool to read from the coordinator stream and react to config changes accordingly.

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36006/#review92616 --- build.gradle (line 150)

Re: Samza and sliding window

Yi, I am not sure if attachments gets filtered when sent to the group. I have seen this earlier as well. - Shekar

Re: question on commit on changelog

Hi Chen Song, There are two different concepts: *checkpoint* and *changelog*. Checkpoint is for the offset of the messages, while the changelog is for the kv-store. The code snippet you show is for the checkpoint , not for the changelog. {quote} 1. When implementing our Samza task, does each call

Re: Review Request 36473: SAMZA-733 Add metrics to Elasticsearch System Producer

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36473/ --- (Updated July 22, 2015, 5 p.m.) Review request for samza. Repository: samza

Re: Review Request 36473: SAMZA-733 Add metrics to Elasticsearch System Producer

> On July 21, 2015, 5:42 p.m., Yan Fang wrote: > > samza-core/src/main/scala/org/apache/samza/metrics/MetricsHelper.scala, > > lines 36-37 > > > > > > though it works, prefer to use the "def" here, not only because i

question on commit on changelog

We are trying to understand the order of commits when processing each message in a Samza job. T1: input offset commit T2: changelog commit T3: output commit By looking at the code snippet in https://github.com/apache/samza/blob/master/samza-core/src/main/scala/org/apache/samza/container/TaskInsta

Re: Samza and sliding window

Yi, I am not sure I see an attachment. Is it possible to paste that on pastebin? Shekar On Jul 21, 2015 4:27 PM, "Yi Pan" wrote: > Hi, Shekar, > > I have strip down your use case just to the KV-store operation and have > verified that it works fine. Please see the attached diff file. > > If yo

Re: Review Request 36692: SAMZA-717 Expose the TaskNameGrouper API

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36692/#review92594 --- samza-api/src/main/java/org/apache/samza/job/model/ContainerModel.j

Review Request 36692: SAMZA-717 Expose the TaskNameGrouper API

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36692/ --- Review request for samza. Repository: samza Description --- TaskNameGrou