Re: Kafka offset management

Hi Raghu, Thanks for the checkpointing info. I'll have to think about this more, but I'm wondering if there's some custom work I can do to have the output of the final stage perform some offset commits back to Kafka. There was another thread here I commented in about giving Write transforms an

Re: Kafka offset management

Gwilym, I think your understanding is correct, with one caveat as noted below. As Jingsong suggested committing offsets in ' KafkaCheckpointMark.finalizeCheckpoint()

Re: Beam Slack channel

Done, you should have received an invite. Welcome ! Regards JB On 06/30/2017 12:02 PM, AndrasNagy wrote: Hi, I also would like to join the slack chanel :) Shall I ask for the Dev Slack separately or there is only a single one? Andras 2017-06-29 12:17 GMT+02:00 James

Re: Beam Slack channel

Hi, I also would like to join the slack chanel :) Shall I ask for the Dev Slack separately or there is only a single one? Andras 2017-06-29 12:17 GMT+02:00 James : > Invite sent. > > On Thu, 29 Jun 2017 at 6:07 PM Tolsa, Camille < > camille.tolsa-...@veolia.com> wrote: >

Re: Recommended Flink Version

I just tried it with the Beam Quickstart form the website and a fresh Flink 1.2.1 download. This is the command I used for building the Quickstart: mvn package -DskipTests -Pflink-runner (The important bit here is -Pflink-runner which brings in the Flink Runner and its dependencies) For