[jira] [Commented] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556360#comment-15556360 ] Amit Sela commented on BEAM-704: A read from Kafka requires to specify topic/s and either specific

[GitHub] incubator-beam pull request #1067: Move native sources/sinks out of iobase.

GitHub user robertwb opened a pull request: https://github.com/apache/incubator-beam/pull/1067 Move native sources/sinks out of iobase. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556345#comment-15556345 ] Ahmet Altay commented on BEAM-721: -- This failure happens in only some of the Travis/Mac runs. For some

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

GitHub user pabloem opened a pull request: https://github.com/apache/incubator-beam/pull/1068 [BEAM-721] Testing tox intermittent failures on Mac Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ x ] Make sure the PR

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556420#comment-15556420 ] ASF GitHub Bot commented on BEAM-721: - GitHub user pabloem opened a pull request:

[1/2] incubator-beam git commit: Improve compile-time type checking

Repository: incubator-beam Updated Branches: refs/heads/master 03b89c065 -> 2492604e4 Improve compile-time type checking * Enables -Xlint:rawtypes except for Spark and Flink runners and the microbenchmarks module * Fixed some warnings in tests * Fixed checkstyle warnings Project:

[2/2] incubator-beam git commit: Closes #1028

Closes #1028 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2492604e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2492604e Diff:

[GitHub] incubator-beam pull request #1028: Removes a bunch of rawtypes warnings

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1028 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Assigned] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi reassigned BEAM-704: - Assignee: Raghu Angadi > KafkaIO should handle "latest offset" evenly, and persist it as part of

[jira] [Commented] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1737#comment-1737 ] Raghu Angadi commented on BEAM-704: --- [~dhalp...@google.com] expanded a bit more on this. The issue you

[jira] [Commented] (BEAM-730) Remove Reshuffle transform in favor of Redistribute.byKey()

[ https://issues.apache.org/jira/browse/BEAM-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1815#comment-1815 ] Robert Bradshaw commented on BEAM-730: -- Naming bikeshed: our combiners use perKey (and perElement)

[jira] [Created] (BEAM-728) Javadoc should clearly separate facts from runner requirements

Frances Perry created BEAM-728: -- Summary: Javadoc should clearly separate facts from runner requirements Key: BEAM-728 URL: https://issues.apache.org/jira/browse/BEAM-728 Project: Beam Issue

Jenkins build is still unstable: beam_PostCommit_MavenVerify » Apache Beam :: Examples :: Java #1476

See

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1476

See

[jira] [Created] (BEAM-730) Remove Reshuffle transform in favor of Redistribute.byKey()

Eugene Kirpichov created BEAM-730: - Summary: Remove Reshuffle transform in favor of Redistribute.byKey() Key: BEAM-730 URL: https://issues.apache.org/jira/browse/BEAM-730 Project: Beam

[jira] [Comment Edited] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1572#comment-1572 ] Raghu Angadi edited comment on BEAM-704 at 10/7/16 4:41 PM: {quote} I'd also

[jira] [Commented] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1572#comment-1572 ] Raghu Angadi commented on BEAM-704: --- .q I'd also suggest we persist the latest offset as part of the

[jira] [Created] (BEAM-729) Does sdks/java/io/google-cloud-platform/pom.xml need javadoc plugin?

Eugene Kirpichov created BEAM-729: - Summary: Does sdks/java/io/google-cloud-platform/pom.xml need javadoc plugin? Key: BEAM-729 URL: https://issues.apache.org/jira/browse/BEAM-729 Project: Beam

[jira] [Created] (BEAM-731) Replace DirectRunner with InProcessRunner

Ahmet Altay created BEAM-731: Summary: Replace DirectRunner with InProcessRunner Key: BEAM-731 URL: https://issues.apache.org/jira/browse/BEAM-731 Project: Beam Issue Type: Bug

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1477

See

[jira] [Updated] (BEAM-730) Remove Reshuffle transform in favor of Redistribute.byKey()

[ https://issues.apache.org/jira/browse/BEAM-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-730: - Assignee: Eugene Kirpichov > Remove Reshuffle transform in favor of Redistribute.byKey() >

Jenkins build is still unstable: beam_PostCommit_MavenVerify » Apache Beam :: Examples :: Java #1477

See

[GitHub] incubator-beam pull request #1066: Revert "Place fired timers in the Global ...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1066 Revert "Place fired timers in the Global Window" Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-730) Remove Reshuffle transform in favor of Redistribute.byKey()

[ https://issues.apache.org/jira/browse/BEAM-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1847#comment-1847 ] Daniel Halperin commented on BEAM-730: -- Counterpoint: Redistribute byKey is closely related, as it

[jira] [Commented] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556749#comment-15556749 ] Raghu Angadi commented on BEAM-704: --- https://github.com/apache/incubator-beam/pull/1071 : sets offset on

[GitHub] incubator-beam pull request #1070: [BEAM-733] Prohibit windowed side inputs ...

GitHub user robertwb opened a pull request: https://github.com/apache/incubator-beam/pull/1070 [BEAM-733] Prohibit windowed side inputs until they are implemented correctly. Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[jira] [Commented] (BEAM-733) Windowed side-inputs not supported in Python

[ https://issues.apache.org/jira/browse/BEAM-733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556611#comment-15556611 ] ASF GitHub Bot commented on BEAM-733: - GitHub user robertwb opened a pull request:

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556635#comment-15556635 ] ASF GitHub Bot commented on BEAM-721: - Github user pabloem closed the pull request at:

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556639#comment-15556639 ] ASF GitHub Bot commented on BEAM-721: - GitHub user pabloem reopened a pull request:

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556640#comment-15556640 ] ASF GitHub Bot commented on BEAM-721: - Github user pabloem closed the pull request at:

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556641#comment-15556641 ] ASF GitHub Bot commented on BEAM-721: - GitHub user pabloem reopened a pull request:

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556638#comment-15556638 ] ASF GitHub Bot commented on BEAM-721: - Github user pabloem closed the pull request at:

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556636#comment-15556636 ] ASF GitHub Bot commented on BEAM-721: - GitHub user pabloem reopened a pull request:

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

Github user pabloem closed the pull request at: https://github.com/apache/incubator-beam/pull/1068 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1478

See

Jenkins build is still unstable: beam_PostCommit_MavenVerify » Apache Beam :: Examples :: Java #1478

See

[jira] [Commented] (BEAM-724) NullPointerException in Snapshot State

[ https://issues.apache.org/jira/browse/BEAM-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556489#comment-15556489 ] ASF GitHub Bot commented on BEAM-724: - Github user sumitchawla closed the pull request at:

[GitHub] incubator-beam pull request #1061: BEAM-724 - Null pointer fix

Github user sumitchawla closed the pull request at: https://github.com/apache/incubator-beam/pull/1061 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-732) Placing Timers into the global window causes tests to Flake

[ https://issues.apache.org/jira/browse/BEAM-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556509#comment-15556509 ] ASF GitHub Bot commented on BEAM-732: - GitHub user tgroh opened a pull request:

[jira] [Created] (BEAM-732) Placing Timers into the global window causes tests to Flake

Thomas Groh created BEAM-732: Summary: Placing Timers into the global window causes tests to Flake Key: BEAM-732 URL: https://issues.apache.org/jira/browse/BEAM-732 Project: Beam Issue Type:

[GitHub] incubator-beam pull request #1069: [BEAM-732] Only remove Elements that were...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1069 [BEAM-732] Only remove Elements that were pending from Pending Elements Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[GitHub] incubator-beam pull request #1058: Fixes a bug in avroio_test.py

Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/1058 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

GitHub user pabloem reopened a pull request: https://github.com/apache/incubator-beam/pull/1068 [BEAM-721] Testing tox intermittent failures on Mac Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ x ] Make sure the PR

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

GitHub user pabloem reopened a pull request: https://github.com/apache/incubator-beam/pull/1068 [BEAM-721] Testing tox intermittent failures on Mac Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ x ] Make sure the PR

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

Github user pabloem closed the pull request at: https://github.com/apache/incubator-beam/pull/1068 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

Github user pabloem closed the pull request at: https://github.com/apache/incubator-beam/pull/1068 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

GitHub user pabloem reopened a pull request: https://github.com/apache/incubator-beam/pull/1068 [BEAM-721] Testing tox intermittent failures on Mac Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ x ] Make sure the PR

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556634#comment-15556634 ] ASF GitHub Bot commented on BEAM-721: - GitHub user pabloem reopened a pull request:

[jira] [Commented] (BEAM-721) Travis CI fails to run Python tox tests on Mac

[ https://issues.apache.org/jira/browse/BEAM-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556633#comment-15556633 ] ASF GitHub Bot commented on BEAM-721: - Github user pabloem closed the pull request at:

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

Github user pabloem closed the pull request at: https://github.com/apache/incubator-beam/pull/1068 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1068: [BEAM-721] Testing tox intermittent failu...

GitHub user pabloem reopened a pull request: https://github.com/apache/incubator-beam/pull/1068 [BEAM-721] Testing tox intermittent failures on Mac Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ x ] Make sure the PR

[GitHub] incubator-beam pull request #1071: KafkaIO reader should set consumedOffset ...

GitHub user rangadi opened a pull request: https://github.com/apache/incubator-beam/pull/1071 KafkaIO reader should set consumedOffset even before reading the first record R+: @amitsela --- Be sure to do all of the following to help us incorporate your contribution

[jira] [Created] (BEAM-733) Windowed side-inputs not supported in Python

Robert Bradshaw created BEAM-733: Summary: Windowed side-inputs not supported in Python Key: BEAM-733 URL: https://issues.apache.org/jira/browse/BEAM-733 Project: Beam Issue Type: Bug

[2/2] incubator-beam git commit: Closes #1065

Closes #1065 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4c1ad11d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4c1ad11d Diff:

[GitHub] incubator-beam pull request #1065: Use absolute path for import

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1065 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1066: Revert "Place fired timers in the Global ...

Github user tgroh closed the pull request at: https://github.com/apache/incubator-beam/pull/1066 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556812#comment-15556812 ] Raghu Angadi commented on BEAM-704: --- > Beam does not ask the reader for checkpoint I meant say 'does not

Jenkins build is still unstable: beam_PostCommit_MavenVerify » Apache Beam :: Examples :: Java #1474

See

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1474

See

[GitHub] incubator-beam pull request #1065: Use absolute path for import

GitHub user mariapython opened a pull request: https://github.com/apache/incubator-beam/pull/1065 Use absolute path for import You can merge this pull request into a Git repository by running: $ git pull https://github.com/mariapython/incubator-beam python-sdk Alternatively

Jenkins build is still unstable: beam_PostCommit_MavenVerify » Apache Beam :: Examples :: Java #1475

See

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1475

See

[1/2] incubator-beam git commit: Making sure that GcsBufferedReader implements the iterator protocol

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 4c1ad11d1 -> 7d0758b64 Making sure that GcsBufferedReader implements the iterator protocol Adding raise StopIteration to GcsBufferedReader.next Adding unit tests, and __next__ for Python 3 Fixing some lint issues in unit

[2/2] incubator-beam git commit: Closes #1035

Closes #1035 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7d0758b6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7d0758b6 Diff:

[jira] [Updated] (BEAM-727) KafkaIO should support dynamic addition of Kafka partitions to assigned topics.

[ https://issues.apache.org/jira/browse/BEAM-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-727: --- Assignee: (was: James Malone) > KafkaIO should support dynamic addition of Kafka partitions to assigned >

[jira] [Updated] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

[ https://issues.apache.org/jira/browse/BEAM-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-704: --- Assignee: (was: James Malone) > KafkaIO should handle "latest offset" evenly, and persist it as part of the

[jira] [Created] (BEAM-727) KafkaIO should support dynamic addition of Kafka partitions to assigned topics.

Amit Sela created BEAM-727: -- Summary: KafkaIO should support dynamic addition of Kafka partitions to assigned topics. Key: BEAM-727 URL: https://issues.apache.org/jira/browse/BEAM-727 Project: Beam