[incubator-beam] Git Push Summary

Repository: incubator-beam Updated Tags: refs/tags/v0.2.0-incubating-RC2 [created] bf6d9af75

incubator-beam git commit: [maven-release-plugin] rollback changes from release preparation of v0.2.0-incubating-RC2

Repository: incubator-beam Updated Branches: refs/heads/release-0.2.0-incubating 7ec5e16c6 -> 6901ff648 [maven-release-plugin] rollback changes from release preparation of v0.2.0-incubating-RC2 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/2] incubator-beam git commit: jms: fix artifact ID in pom.xml

Repository: incubator-beam Updated Branches: refs/heads/master af396bf8e -> ff873f4eb jms: fix artifact ID in pom.xml Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4e651b4 Tree:

[GitHub] incubator-beam pull request #750: [BEAM-79] Merge branch 'master' into gearp...

GitHub user manuzhang opened a pull request: https://github.com/apache/incubator-beam/pull/750 [BEAM-79] Merge branch 'master' into gearpump_runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Commented] (BEAM-79) Gearpump runner

[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397251#comment-15397251 ] ASF GitHub Bot commented on BEAM-79: GitHub user manuzhang opened a pull request:

[2/2] incubator-beam git commit: Closes #749

Closes #749 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ff873f4e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ff873f4e Diff:

[GitHub] incubator-beam pull request #749: jms: fix artifact ID in pom.xml

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/749 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: jms: fix artifact ID in pom.xml

Repository: incubator-beam Updated Branches: refs/heads/release-0.2.0-incubating a6633756e -> 7ec5e16c6 jms: fix artifact ID in pom.xml Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/448dcaea Tree:

[2/2] incubator-beam git commit: [maven-release-plugin] prepare release v0.2.0-incubating-RC2

[maven-release-plugin] prepare release v0.2.0-incubating-RC2 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7ec5e16c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7ec5e16c Diff:

[jira] [Closed] (BEAM-491) Reuse context and disable UI in the Spark runner tests

[ https://issues.apache.org/jira/browse/BEAM-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-491. -- Resolution: Fixed Closed by https://github.com/apache/incubator-beam/pull/736 > Reuse context and disable UI in

[jira] [Updated] (BEAM-349) Spark runner should provide a default BoM

[ https://issues.apache.org/jira/browse/BEAM-349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-349: -- Fix Version/s: (was: 0.2.0-incubating) > Spark runner should provide a default BoM >

[2/2] incubator-beam git commit: Use AutoValue for StepTransformResult

Use AutoValue for StepTransformResult This closes #746 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a46081eb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a46081eb Diff:

[jira] [Commented] (BEAM-156) Implement Quiescence Signalling in the InProcessPipelineRunner

[ https://issues.apache.org/jira/browse/BEAM-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397653#comment-15397653 ] ASF GitHub Bot commented on BEAM-156: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #746: Use AutoValue for StepTransformResult

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/746 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #749: jms: fix artifact ID in pom.xml

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/749 jms: fix artifact ID in pom.xml You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/incubator-beam jms-fixup Alternatively you

[2/2] incubator-beam git commit: Remove unneccessary method in ReadEvaluatorFactories

Remove unneccessary method in ReadEvaluatorFactories This closes #747 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9c447510 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9c447510 Diff:

[1/2] incubator-beam git commit: Remove unneccessary method in ReadEvaluatorFactories

Repository: incubator-beam Updated Branches: refs/heads/master a46081eb5 -> 9c447510a Remove unneccessary method in ReadEvaluatorFactories The getTransformEvaluator() method's only call is poll on the result of getTransformEvaluatorQueue (which is only ever called by getTransformEvaluator).

[2/2] incubator-beam git commit: Closes #726

Closes #726 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/53ab635c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/53ab635c Diff:

[1/2] incubator-beam git commit: Make TextFileReader observable

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 26ff65795 -> 53ab635c7 Make TextFileReader observable This allows future implementation of size tracking for elements in side input sources. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[3/3] incubator-beam git commit: Closes #741

Closes #741 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4716d9d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b4716d9d Diff:

[1/3] incubator-beam git commit: Better top implementation.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 53ab635c7 -> b4716d9dc Better top implementation. When selecting the top k of n, it is common that k << n. Using a heap is O(n log k) while select algorithms can achieve O(n + k log k). This also avoids the ugliness that

[1/2] incubator-beam git commit: Optimize Map and Flatmap when there are no side inputs.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk b4716d9dc -> 351c3831d Optimize Map and Flatmap when there are no side inputs. varargs and kwargs are expensive, even when they're empty. This is especially true for otherwise one-argument Python calls which are special cased

[GitHub] incubator-beam pull request #748: Optimize Map and Flatmap when there are no...

Github user robertwb closed the pull request at: https://github.com/apache/incubator-beam/pull/748 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #741: Top improvements

Github user robertwb closed the pull request at: https://github.com/apache/incubator-beam/pull/741 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Resolved] (BEAM-256) Add lifecycle event verifiers for Beam pipelines.

[ https://issues.apache.org/jira/browse/BEAM-256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kuster resolved BEAM-256. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Add lifecycle event verifiers for Beam

[2/2] incubator-beam git commit: Closes #748

Closes #748 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/351c3831 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/351c3831 Diff:

[jira] [Assigned] (BEAM-496) Remove the notion of a Fake subscription from PubsubIO

[ https://issues.apache.org/jira/browse/BEAM-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-496: -- Assignee: Daniel Halperin (was: Davor Bonaci) > Remove the notion of a Fake subscription from PubsubIO

[GitHub] incubator-beam pull request #753: [BEAM-436] Re-enable RunnableOnService tes...

GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/753 [BEAM-436] Re-enable RunnableOnService tests which need tempRoot Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[1/4] incubator-beam-site git commit: Merged in pull#25 and regenerated html.

Repository: incubator-beam-site Updated Branches: refs/heads/asf-site 5d7ef1d64 -> ea05f978a http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/ea05f978/docs/index.md -- diff --git a/docs/index.md b/docs/index.md

[2/4] incubator-beam-site git commit: Merged in pull#25 and regenerated html.

http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/ea05f978/content/docs/use/beam-overview.html -- diff --git a/content/docs/use/beam-overview.html b/content/docs/use/beam-overview.html new file mode 100644 index

[jira] [Created] (BEAM-496) Remove the notion of a Fake subscription from PubsubIO

Luke Cwik created BEAM-496: -- Summary: Remove the notion of a Fake subscription from PubsubIO Key: BEAM-496 URL: https://issues.apache.org/jira/browse/BEAM-496 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-497) Modify offset range tracker to use first response as start offset

Chamikara Jayalath created BEAM-497: --- Summary: Modify offset range tracker to use first response as start offset Key: BEAM-497 URL: https://issues.apache.org/jira/browse/BEAM-497 Project: Beam

[GitHub] incubator-beam-site pull request #25: Creates preliminary landing pages for ...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam-site/pull/25 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[4/4] incubator-beam-site git commit: Merged in pull#25 and regenerated html.

Merged in pull#25 and regenerated html. This closes #25. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/ea05f978 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/ea05f978

[3/4] incubator-beam-site git commit: Merged in pull#25 and regenerated html.

http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/ea05f978/content/docs/index.html -- diff --git a/content/docs/index.html b/content/docs/index.html index 7327bed..71fe449 100644 --- a/content/docs/index.html +++

[1/2] incubator-beam git commit: Increased the GCS buffer size from 1MB to 8MB and introduced a 128kB buffer for the pipe.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 351c3831d -> c155ef0eb Increased the GCS buffer size from 1MB to 8MB and introduced a 128kB buffer for the pipe. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request #752: Beam Python GCSIO write performance improv...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/752 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Closes #752

Closes #752 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c155ef0e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c155ef0e Diff:

[2/2] incubator-beam git commit: [BEAM-443] Add waitToFinish() and cancel() in PipelineResult.

[BEAM-443] Add waitToFinish() and cancel() in PipelineResult. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1b4b7c76 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1b4b7c76 Diff:

[jira] [Commented] (BEAM-443) PipelineResult needs waitToFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398635#comment-15398635 ] ASF GitHub Bot commented on BEAM-443: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: Closes #642

Repository: incubator-beam Updated Branches: refs/heads/master 1df6f5f97 -> 119da4a82 Closes #642 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/119da4a8 Tree:

[GitHub] incubator-beam pull request #642: [BEAM-443] Promote waitToFinish() and canc...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/642 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #710

This closes #710 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/36720a62 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/36720a62 Diff:

[1/2] incubator-beam git commit: Move local Flink integration tests to a profile

Repository: incubator-beam Updated Branches: refs/heads/master 119da4a82 -> 36720a62d Move local Flink integration tests to a profile These tests can now be activated on the commandline with -P local-runnable-on-service-tests and are activated directly by Jenkins. Project:

[GitHub] incubator-beam pull request #710: [BEAM-479] Move local Flink integration te...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/710 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-479) Move RunnableOnService test executions to postcommit

[ https://issues.apache.org/jira/browse/BEAM-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398678#comment-15398678 ] ASF GitHub Bot commented on BEAM-479: - Github user asfgit closed the pull request at:

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #852

See

[GitHub] incubator-beam pull request #755: Added Bigtable Read DisplayData

GitHub user ianzhou1 opened a pull request: https://github.com/apache/incubator-beam/pull/755 Added Bigtable Read DisplayData Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[GitHub] incubator-beam pull request #756: Replace ParDo with MapElements and FlatMap...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/756 Replace ParDo with MapElements and FlatMapElements where possible Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[jira] [Commented] (BEAM-498) Make DoFnWithContext the new DoFn

[ https://issues.apache.org/jira/browse/BEAM-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398675#comment-15398675 ] ASF GitHub Bot commented on BEAM-498: - GitHub user kennknowles opened a pull request:

[GitHub] incubator-beam pull request #754: [BEAM-156] Use Quiescence to Drive the Dir...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/754 [BEAM-156] Use Quiescence to Drive the DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[jira] [Commented] (BEAM-156) Implement Quiescence Signalling in the InProcessPipelineRunner

[ https://issues.apache.org/jira/browse/BEAM-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398500#comment-15398500 ] ASF GitHub Bot commented on BEAM-156: - GitHub user tgroh opened a pull request:

[2/2] incubator-beam-site git commit: This closes #28

This closes #28 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/a64faf28 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/a64faf28 Diff:

[1/2] incubator-beam-site git commit: Adding Travis CI YAML config

Repository: incubator-beam-site Updated Branches: refs/heads/asf-site ea05f978a -> a64faf285 Adding Travis CI YAML config Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/8d9a8eb0 Tree:

[GitHub] incubator-beam-site pull request #28: Adding Travis CI YAML config

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam-site/pull/28 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Implement Aggregators directly for direct-java

Repository: incubator-beam Updated Branches: refs/heads/master 9c447510a -> 1df6f5f97 Implement Aggregators directly for direct-java Previously, we relied on conversion to Counter rather than just running the specified CombineFn. This aligns the direct runner more closely with the model.

[2/2] incubator-beam git commit: Implement aggregators directly in the direct runner

Implement aggregators directly in the direct runner This closes #735 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1df6f5f9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1df6f5f9 Diff:

[GitHub] incubator-beam pull request #735: Implement Aggregators directly in the Dire...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/735 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (BEAM-498) Make DoFnWithContext the new DoFn

Kenneth Knowles created BEAM-498: Summary: Make DoFnWithContext the new DoFn Key: BEAM-498 URL: https://issues.apache.org/jira/browse/BEAM-498 Project: Beam Issue Type: New Feature

[jira] [Closed] (BEAM-487) Add disclaimer to GitHub README.md

[ https://issues.apache.org/jira/browse/BEAM-487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-487. Assignee: Daniel Halperin (was: Jean-Baptiste Onofré) > Add disclaimer to GitHub README.md >

[jira] [Closed] (BEAM-488) Remove KEYS file

[ https://issues.apache.org/jira/browse/BEAM-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-488. Assignee: Daniel Halperin (was: Jean-Baptiste Onofré) > Remove KEYS file > > >

[jira] [Closed] (BEAM-486) Cleanup NOTICE file

[ https://issues.apache.org/jira/browse/BEAM-486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-486. Assignee: Daniel Halperin (was: Jean-Baptiste Onofré) > Cleanup NOTICE file > --- >

[GitHub] incubator-beam pull request #752: Beam Python GCSIO write performance improv...

GitHub user mdvorsky opened a pull request: https://github.com/apache/incubator-beam/pull/752 Beam Python GCSIO write performance improvements. Increased the GCS buffer size from 1MB to 8MB and introduced a 128kB buffer for the pipe. Increasing the GCS buffer even more

[GitHub] incubator-beam pull request #726: Make TextFileReader observable

Github user charlesccychen closed the pull request at: https://github.com/apache/incubator-beam/pull/726 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] incubator-beam pull request #751: Fix hashing and comparison for compression...

GitHub user silviulica opened a pull request: https://github.com/apache/incubator-beam/pull/751 Fix hashing and comparison for compression types R: @robertwb Please take a look Robert. Thanks! You can merge this pull request into a Git repository by running: $ git pull

[GitHub] incubator-beam pull request #747: Remove unneccessary method in ReadEvaluato...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/747 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the