[GitHub] incubator-beam pull request #556: Disable Java specific Travis tests for pyt...

GitHub user aaltay opened a pull request: https://github.com/apache/incubator-beam/pull/556 Disable Java specific Travis tests for python-sdk branch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] incubator-beam pull request #545: Enables more lint rules for Python SDK

Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/545 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Enables more linting rules.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk cb1842c5b -> 887bef19d Enables more linting rules. - Fixes some import related warnings and enabled related pylint rules. - Use pep8 for blank line related style check. pylint does not check for pep8 related to pep8. And

[GitHub] incubator-beam pull request #555: Replacing BigQuery direct calls with BigQu...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/555 Replacing BigQuery direct calls with BigQueryServices abstraction You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[jira] [Commented] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353970#comment-15353970 ] Daniel Halperin commented on BEAM-365: -- This is fixed now "the right way" -- by adding sharding support

[jira] [Closed] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-365. Resolution: Fixed Fix Version/s: 0.2.0-incubating > TextIO withoutSharding causes Flink to

[jira] [Resolved] (BEAM-159) Support fixed number of shards in sinks

[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-159. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Support fixed number of shards in

[jira] [Commented] (BEAM-159) Support fixed number of shards in sinks

[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353963#comment-15353963 ] ASF GitHub Bot commented on BEAM-159: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #534: [BEAM-159][BEAM-92][BEAM-365] Write: add s...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/534 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Write: add support for setting a fixed number of shards

Repository: incubator-beam Updated Branches: refs/heads/master d5d303566 -> daafc86f3 Write: add support for setting a fixed number of shards And remove special support in Dataflow and Direct runners for it. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: Closes #534

Closes #534 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/daafc86f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/daafc86f Diff:

[jira] [Resolved] (BEAM-363) CompressedSource splits when it shouldn't

[ https://issues.apache.org/jira/browse/BEAM-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-363. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > CompressedSource splits when it

[GitHub] incubator-beam pull request #554: Use the ParDo Application to Cache DoFns

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/554 Use the ParDo Application to Cache DoFns Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] incubator-beam pull request #525: [BEAM-362] Move some more easy stuff from ...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/525 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/3] incubator-beam git commit: Move remnants of Dataflow runner from SDK to its module

Move remnants of Dataflow runner from SDK to its module Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/175d7acb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/175d7acb Diff:

[3/3] incubator-beam git commit: [BEAM-362] Move some more easy stuff from SDK to appropriate modules

[BEAM-362] Move some more easy stuff from SDK to appropriate modules This closes #525. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d5d30356 Tree:

[1/3] incubator-beam git commit: Move some more easy stuff to runners-core

Repository: incubator-beam Updated Branches: refs/heads/master f1be6f1cc -> d5d303566 Move some more easy stuff to runners-core Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a5a3c55d Tree:

[GitHub] incubator-beam pull request #553: Add initial microbenchmark for DoFnReflect...

GitHub user bjchambers opened a pull request: https://github.com/apache/incubator-beam/pull/553 Add initial microbenchmark for DoFnReflector Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [*] Make sure the PR title is

[jira] [Commented] (BEAM-363) CompressedSource splits when it shouldn't

[ https://issues.apache.org/jira/browse/BEAM-363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353825#comment-15353825 ] Pei He commented on BEAM-363: - This is fixed? > CompressedSource splits when it shouldn't >

[jira] [Commented] (BEAM-285) Make MinLongFn and MaxLongFn mimic SumLongFn and use BinaryCombineLongFn

[ https://issues.apache.org/jira/browse/BEAM-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353820#comment-15353820 ] ASF GitHub Bot commented on BEAM-285: - GitHub user peihe opened a pull request:

[GitHub] incubator-beam pull request #547: Remove the whitelisting required warning

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/547 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Remove the whitelisting required warning

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 3464a909b -> cb1842c5b Remove the whitelisting required warning Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8e767827 Tree:

[2/2] incubator-beam git commit: Closes #547

Closes #547 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cb1842c5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cb1842c5 Diff:

[GitHub] incubator-beam pull request #549: Increase the MESSAGES_POLLING_ATTEMPTS for...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts

Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f5ae3e0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9f5ae3e0 Diff:

[1/2] incubator-beam git commit: Closes #549

Repository: incubator-beam Updated Branches: refs/heads/master d194d7a37 -> f1be6f1cc Closes #549 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f1be6f1c Tree:

[GitHub] incubator-beam pull request #551: Add Surefire Max Heap Size argument

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/551 Add Surefire Max Heap Size argument Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Created] (BEAM-384) Streaming BigQueryIO should support user-provided IDs

Daniel Mills created BEAM-384: - Summary: Streaming BigQueryIO should support user-provided IDs Key: BEAM-384 URL: https://issues.apache.org/jira/browse/BEAM-384 Project: Beam Issue Type:

[GitHub] incubator-beam pull request #548: pom.xml: upgrade to dataflow version v1b3-...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/548 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: pom.xml: upgrade to dataflow version v1b3-rev30-1.22.0

Repository: incubator-beam Updated Branches: refs/heads/master b48728101 -> d194d7a37 pom.xml: upgrade to dataflow version v1b3-rev30-1.22.0 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ea68ae24 Tree:

[jira] [Created] (BEAM-383) BigQueryIO: update sink to shard into multiple write jobs

Daniel Halperin created BEAM-383: Summary: BigQueryIO: update sink to shard into multiple write jobs Key: BEAM-383 URL: https://issues.apache.org/jira/browse/BEAM-383 Project: Beam Issue

[GitHub] incubator-beam pull request #550: Copy and use UnboundedReadFromBoundedSourc...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/550 Copy and use UnboundedReadFromBoundedSource in dataflow runner and remove the injector pipeline from StreamingWordExtract You can merge this pull request into a Git repository by running:

Jenkins build is back to stable : beam_PostCommit_MavenVerify #752

See

Jenkins build is back to stable : beam_PostCommit_MavenVerify » Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform #752

See

[GitHub] incubator-beam pull request #546: Fix NPE in UnboundedReadFromBoundedSource

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/546 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Fix NPE in UnboundedReadFromBoundedSource

Repository: incubator-beam Updated Branches: refs/heads/master be98b757b -> b48728101 Fix NPE in UnboundedReadFromBoundedSource Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/45ce4979 Tree:

[2/2] incubator-beam git commit: Closes #546

Closes #546 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4872810 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b4872810 Diff:

[GitHub] incubator-beam pull request #549: Increase the MESSAGES_POLLING_ATTEMPTS for...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/549 Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[GitHub] incubator-beam pull request #548: pom.xml: upgrade to dataflow version v1b3-...

GitHub user joshualitt opened a pull request: https://github.com/apache/incubator-beam/pull/548 pom.xml: upgrade to dataflow version v1b3-rev30-1.22.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/joshualitt/incubator-beam

Jenkins build became unstable: beam_PostCommit_MavenVerify » Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform #750

See

Jenkins build is still unstable: beam_PostCommit_MavenVerify » Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform #751

See

[GitHub] incubator-beam pull request #547: Remove the whitelisting required warning

GitHub user aaltay opened a pull request: https://github.com/apache/incubator-beam/pull/547 Remove the whitelisting required warning Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-310) Exercise splitIntoBundles/generateInitialSplits in the Direct Runner

[ https://issues.apache.org/jira/browse/BEAM-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353334#comment-15353334 ] Daniel Halperin commented on BEAM-310: -- Note that we should also exercise splitAtFraction. > Exercise

[GitHub] incubator-beam pull request #544: Explicitly set UseDummyRunner in IO, Exten...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/544 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Explicitly set UseDummyRunner in IO, Extensions

Repository: incubator-beam Updated Branches: refs/heads/master 7d767056a -> be98b757b Explicitly set UseDummyRunner in IO, Extensions This mitigates test failures due to forkCount=0 in travis. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: Closes #544

Closes #544 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/be98b757 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/be98b757 Diff:

[jira] [Commented] (BEAM-380) Remove Spark runner dependency on beam-examlpes-java

[ https://issues.apache.org/jira/browse/BEAM-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352517#comment-15352517 ] ASF GitHub Bot commented on BEAM-380: - GitHub user amitsela reopened a pull request:

[GitHub] incubator-beam pull request #539: [BEAM-380] Remove Spark runner dependency ...

Github user amitsela closed the pull request at: https://github.com/apache/incubator-beam/pull/539 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #539: [BEAM-380] Remove Spark runner dependency ...

GitHub user amitsela reopened a pull request: https://github.com/apache/incubator-beam/pull/539 [BEAM-380] Remove Spark runner dependency on beam-examlpes-java Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[jira] [Assigned] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-372: Assignee: Daniel Halperin > CoderProperties: Test that the coder doesn't consume more bytes

[jira] [Updated] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-372: - Assignee: Chandni Singh (was: Daniel Halperin) > CoderProperties: Test that the coder doesn't

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352469#comment-15352469 ] Chandni Singh commented on BEAM-372: Can you please assign it to me? > CoderProperties: Test that the

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352464#comment-15352464 ] Daniel Halperin commented on BEAM-372: -- Sounds good to me! > CoderProperties: Test that the coder

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352461#comment-15352461 ] Chandni Singh commented on BEAM-372: Can I work on this JIRA? > CoderProperties: Test that the coder