All,
I think it's great that the ProcessorContext offers the partition and offset
of the current record being processed; however, it offers no way for me to
actually use the information. I would like to be able to rewind to a particular
offset on a partition if I needed to. The consumer is
rsions than the
broker. Do you have a stacktrace of when the exception is thrown?
Ismael
On Fri, Apr 15, 2016 at 2:39 PM, Michael D. Coon <mdco...@yahoo.com.invalid>
wrote:
> We are seeing odd behavior that we need to understand. We are getting
> IncompatibleClassChangeErrors and I k
We are seeing odd behavior that we need to understand. We are getting
IncompatibleClassChangeErrors and I know that's related to a Scala version
mismatch. What's not clear, however, is where or why the mismatch is occurring.
We know up front that there were occasions where we ran apps that had
nt behavior than the above described?
Guozhang
On Fri, Apr 8, 2016 at 12:23 PM, Michael D. Coon <mdco...@yahoo.com.invalid>
wrote:
> All,
> I'm seeing my processor's "close" method being called AFTER my
> downstream producer has been closed. I had assumed that on close I woul
All,
I'm seeing my processor's "close" method being called AFTER my downstream
producer has been closed. I had assumed that on close I would be able to flush
whatever I had been buffering up to send to kafka topic. In other words, we've
seen significant performance differences in building
to know what the
corresponds to.
On Thursday, April 7, 2016 7:35 AM, Michael D. Coon
<mdco...@yahoo.com.INVALID> wrote:
Guozhang,
Thanks for the advice; however, "max.poll.records" doesn't seem to be
supported since it's not affecting how many records are coming back from
configs
Guozhang
On Wed, Apr 6, 2016 at 6:26 AM, Michael D. Coon <mdco...@yahoo.com.invalid>
wrote:
All,
I'm getting CommitFailedExceptions on a small prototype I built using
kafkaStreams. I'm not using the DSL, but the TopologyBuilder with several
processors chained together with
All,
I'm getting CommitFailedExceptions on a small prototype I built using
kafkaStreams. I'm not using the DSL, but the TopologyBuilder with several
processors chained together with a sink in between a few of them. When I try
committing through the ProcessorContext, I see exceptions being
I'm evaluating whether the KafkaStreams API will be something we can use on my
current project. Namely, we want to be able to distribute the consumers on a
Mesos/YARN cluster. It's not entirely clear to me in the code what is deciding
which partitions get assigned at runtime and whether this is
