Jenkins build is unstable: beam_SeedJob #372

2017-08-02 Thread Apache Jenkins Server
See

Snapshot and in-place-update for Beam.

2017-08-02 Thread Reuven Lax
In June, I sent out a proposal for a mechanism to drain running Beam pipelines, as part of an effort to formalize production operations for pipelines. I promised to also send out a proposal for snapshotting and

Re: [VOTE] Release 2.1.0, release candidate #2

2017-08-02 Thread Jean-Baptiste Onofré
Hi, Thanks Eugene for the sumup. BEAM-2708 is now fixed. The last blocking issue for RC3 is BEAM-2671. I spent time today on this one, investigating the different issues. Agree that help from Aviem and Kenn would help for sure. Aviem already started to kindly take a look on the Jira today.

Exactly-once Kafka sink

2017-08-02 Thread Raghu Angadi
Kafka 0.11 added support for transactions[1], which allows end-to-end exactly-once semantics. Beam's KafkaIO users can benefit from these while using runners that support exactly-once processing. I have an implementation of EOS support for Kafka sink : https://github.com/apache/beam/pull/3612 It