)
>
> I wish to revive the discussion around micro batching in Kafka streams.
> Some past discussions are here <http://markmail.org/thread/zdxkvwt6ppq2xhv2>
> & here <http://markmail.org/thread/un7dmn7pyk7eibxz>.
>
> I am exploring ways to do at-least-once pr
Kafka version: 0.10.2.1 (can upgrade if needed)
I wish to revive the discussion around micro batching in Kafka streams.
Some past discussions are here <http://markmail.org/thread/zdxkvwt6ppq2xhv2>
& here <http://markmail.org/thread/un7dmn7pyk7eibxz>.
I am exploring ways to
p 5, 2016 at 9:10 PM, Ara Ebrahimi
mailto:ara.ebrah...@argyledata.com><
mailto:ara.ebrah...@argyledata.com><
mailto:ara.ebrah...@argyledata.com>>
wrote:
Hi,
What’s the best way to do micro-batching in Kafka Streams? Any plans for a
built-in mechanism? Perhaps StateStore could act as the buffe
r workings of
> the stream processing tool.
>
> Orthogonally to that, you have features/operations such as windowing,
> triggers, etc. that -- unlike micro-batching -- allow you as the user of
> the stream processing tool to define which exact computation logic you
> need. Whethe
ng is or is not computed via
micro-batching behind the scenes should (at least in an ideal world) be of
no concern to the user.
-Michael
On Mon, Sep 5, 2016 at 9:10 PM, Ara Ebrahimi
mailto:ara.ebrah...@argyledata.com><
mailto:ara.ebrah...@argyledata.com>>
wrote:
Hi,
What’s the best w
h as windowing,
> triggers, etc. that -- unlike micro-batching -- allow you as the user of
> the stream processing tool to define which exact computation logic you
> need. Whether or not, say, windowing is or is not computed via
> micro-batching behind the scenes should (at least
gt;>
wrote:
Hi,
What’s the best way to do micro-batching in Kafka Streams? Any plans for a
built-in mechanism? Perhaps StateStore could act as the buffer? What
exactly are ProcessorContext.schedule()/punctuate() for? They don’t seem
to be used anywhere?
http://hortonworks.com/blog/apache-stor
scenes should (at least in an ideal world) be of
> no concern to the user.
>
> -Michael
>
>
>
>
>
> On Mon, Sep 5, 2016 at 9:10 PM, Ara Ebrahimi
> wrote:
>
>> Hi,
>>
>> What’s the best way to do micro-batching in Kafka Streams? Any plans for
ching behind the scenes should (at least in an ideal world) be of
> no concern to the user.
>
> -Michael
>
>
>
>
>
> On Mon, Sep 5, 2016 at 9:10 PM, Ara Ebrahimi
> wrote:
>
> > Hi,
> >
> > What’s the best way to do micro-batching in Kafka
omputation logic you
need. Whether or not, say, windowing is or is not computed via
micro-batching behind the scenes should (at least in an ideal world) be of
no concern to the user.
-Michael
On Mon, Sep 5, 2016 at 9:10 PM, Ara Ebrahimi
wrote:
> Hi,
>
> What’s the best way to d
e.org/confluence/display/KAFKA/KIP-
> > 63%3A+Unify+store+and+downstream+caching+in+streams
> >
> >
> > Let me know if these references are helpful to you.
> >
> > Guozhang
> >
> >
> >
> >
> >
> >
> > On Mon, Sep 5
63%3A+Unify+store+and+downstream+caching+in+streams
>
>
> Let me know if these references are helpful to you.
>
> Guozhang
>
>
>
>
>
>
> On Mon, Sep 5, 2016 at 12:10 PM, Ara Ebrahimi >
> wrote:
>
> > Hi,
> >
> > What’s t
l to you.
>
> Guozhang
>
>
>
>
>
>
> On Mon, Sep 5, 2016 at 12:10 PM, Ara Ebrahimi
> wrote:
>
>> Hi,
>>
>> What’s the best way to do micro-batching in Kafka Streams? Any plans for a
>> built-in mechanism? Perhaps StateStore could act as the bu
eams
Let me know if these references are helpful to you.
Guozhang
On Mon, Sep 5, 2016 at 12:10 PM, Ara Ebrahimi
wrote:
> Hi,
>
> What’s the best way to do micro-batching in Kafka Streams? Any plans for a
> built-in mechanism? Perhaps StateStore could act as the buff
Hi,
What’s the best way to do micro-batching in Kafka Streams? Any plans for a
built-in mechanism? Perhaps StateStore could act as the buffer? What exactly
are ProcessorContext.schedule()/punctuate() for? They don’t seem to be used
anywhere?
http://hortonworks.com/blog/apache-storm-design
15 matches
Mail list logo
