specific offset. The
offset is only unique per partition. You could modify the offsets in
the Zookeeper state but you really have to know what you're doing
then.
Best regards,
Max
On Thu, Dec 3, 2015 at 4:01 PM, Vladimir Stoyak <vsto...@yahoo.com> wrote:
> I see that Flink 0.10.1 now
I see that Flink 0.10.1 now supports Keyed Schemas which allows us to rely on
Kafka topics set to "compact" retention for data persistence.
In our topology we wanted to set some topics with Log Compactions enabled and
read topic from the beginning when the topology starts or component recovers.
Gave it a try, but does not seem to help. Is it working for you?
Thanks
Sent from my iPhone
> On Dec 3, 2015, at 6:11 PM, Vladimir Stoyak <vsto...@yahoo.com> wrote:
>
> As far as I know "auto.offset.reset" what to do if offset it not available or
>
We, were also trying to address session windowing but took slightly different
approach as to what window we place the event into.
We did not want "triggering event" to be purged as part of the window it
triggered, but instead to create a new window for it and have the old window to
fire and
Not that I necessarily need that for this particular example, but is there a
Global State available?
IE, how can I make a state available across all parallel instances of an
operator?
On Tuesday, November 17, 2015 1:49 PM, Vladimir Stoyak <vsto...@yahoo.com>
wrote:
P
I know I can use broadcast, but was wondering if there is a better way
DataStream control_stream = env.addSource(new
FlinkKafkaConsumer082(control_topic, new
AvroDeserializationSchema(Model.class), properties)).broadcast();
On Tuesday, November 17, 2015 2:45 PM, Vladimir Stoyak <v
ll keyBy() before both inputs to make sure that the records are
properly routed...
Greetings,Stephan
On Tue, Nov 17, 2015 at 12:29 PM, Vladimir Stoyak <vsto...@yahoo.com> wrote:
Got stuck a bit with CoFlatMapFunction. It seems to work fine if I place it on
the DataStream before window but fa