[GitHub] incubator-beam pull request #1312: [BEAM-223] Use Avro serializer for Kafka ...

2016-11-08 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/1312 [BEAM-223] Use Avro serializer for Kafka checkpoint mark This is more portable. It would also make it extendable even across job updates in future. +R: @dhalperi, @amitsela

[GitHub] incubator-beam pull request #1133: [BEAM-777] KafkaIOTest : reader.start() c...

2016-10-18 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/1133 [BEAM-777] KafkaIOTest : reader.start() can return false KafkaIOTest expected reader.start() to always return true. It could return false as well (though most of the time it would succeed

[GitHub] incubator-beam pull request #1071: KafkaIO reader should set consumedOffset ...

2016-10-07 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/1071 KafkaIO reader should set consumedOffset even before reading the first record R+: @amitsela --- Be sure to do all of the following to help us incorporate your contribution

[GitHub] incubator-beam pull request #904: [BEAM-587] take advantage of setup/teardow...

2016-08-29 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/904 [BEAM-587] take advantage of setup/teardown for KafkaWriter Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[GitHub] incubator-beam pull request #606: remove an obsolete comment in KafkaIOTest....

2016-07-07 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/606 remove an obsolete comment in KafkaIOTest.java Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] incubator-beam pull request #568: [BEAM-395] KafkaIO tests should be marked ...

2016-06-30 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/568 [BEAM-395] KafkaIO tests should be marked 'NeedsRunner' KafkaIO Tests are currently marked as 'RunnableOnService', which implies the tests can run on any beam

[GitHub] incubator-beam pull request #425: [BEAM-326] a small update to KafkaIO javad...

2016-06-07 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/425 [BEAM-326] a small update to KafkaIO javadoc Update code sample for KafkaIO.write() to be consistent with another code sample below it. R: @dhalperi You can merge this pull request

[GitHub] incubator-beam pull request: [BEAM-todo] Option to configure remot...

2016-05-09 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/314 [BEAM-todo] Option to configure remote Dataflow windmill service endpoint Add two options to DataflowPipelineDebugOptions to configure Dataflow remove windmill service. This lets Dataflow

[GitHub] incubator-beam pull request: - after shutting down consumer poll t...

2016-05-04 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/290 - after shutting down consumer poll thread (and offset updater thread), wait for them to actually exit. Be sure to do all of the following to help us incorporate your contribution

[GitHub] incubator-beam pull request: [BEAM-todo] Kafka sink

2016-05-02 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/271 [BEAM-todo] Kafka sink [will update soon] You can merge this pull request into a Git repository by running: $ git pull https://github.com/rangadi/incubator-beam kafka-sink

[GitHub] incubator-beam pull request: [BEAM-220] fix flaky KafkaIO test

2016-04-25 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/237 [BEAM-220] fix flaky KafkaIO test Fix a flaky KafkaIO test. KafkaIO reader reads from Kafka in a separate thread. As a result, `start()` or `advance()` might not read a record with