[GitHub] incubator-beam pull request: [BEAM-22] Enforce non-null preconditi...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/153 [BEAM-22] Enforce non-null preconditions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted

[GitHub] incubator-beam pull request: [BEAM-186] Fix pubsub injector for st...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/156 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #156

This closes #156 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2ca54742 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2ca54742 Diff:

[jira] [Commented] (BEAM-186) The streaming WindowedWordCount example is broken on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233262#comment-15233262 ] ASF GitHub Bot commented on BEAM-186: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: [BEAM-186] Fix pubsub injector for streaming examples

Repository: incubator-beam Updated Branches: refs/heads/master a32a26208 -> 2ca54742b [BEAM-186] Fix pubsub injector for streaming examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1ff8948c Tree:

[GitHub] incubator-beam pull request: [BEAM-151] Remove DataflowPipelineRun...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/154 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #63

See

[GitHub] incubator-beam pull request: [BEAM-115] Move expansion of Window.B...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/147 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Move expansion of Window.Bound into DirectPipelineRunner

Repository: incubator-beam Updated Branches: refs/heads/master a43f9b820 -> a32a26208 Move expansion of Window.Bound into DirectPipelineRunner In the Beam model, windowing is a primitive concept. The expansion provided by the SDK is not implementable except via access to privileged methods

[jira] [Created] (BEAM-186) The streaming WindowedWordCount example is broken on Dataflow

Henning Korsholm Rohde created BEAM-186: --- Summary: The streaming WindowedWordCount example is broken on Dataflow Key: BEAM-186 URL: https://issues.apache.org/jira/browse/BEAM-186 Project: Beam

[2/2] incubator-beam git commit: This closes #147

This closes #147 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a32a2620 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a32a2620 Diff:

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #61

See

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #61

See

[GitHub] incubator-beam pull request: [BEAM-151] Remove DataflowPipelineRun...

GitHub user lukecwik opened a pull request: https://github.com/apache/incubator-beam/pull/154 [BEAM-151] Remove DataflowPipelineRunner refs in TestPipeline/PAssert Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x]

[4/4] incubator-beam git commit: Closes #154

Closes #154 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6ab4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6ab4 Diff:

[3/4] incubator-beam git commit: [BEAM-151] Remove dependence on DataflowPipelineRunner in PAssert/TestPipeline

[BEAM-151] Remove dependence on DataflowPipelineRunner in PAssert/TestPipeline Added the ability for TestDataflowPipelineRunner to throw an AssertionError when the pipeline fails using the first job error message. This allows for moving Dataflow to a new package. Project:

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233272#comment-15233272 ] ASF GitHub Bot commented on BEAM-151: - Github user asfgit closed the pull request at:

[1/4] incubator-beam git commit: [BEAM-151] Remove unused reference on Dataflow client from test

Repository: incubator-beam Updated Branches: refs/heads/master 2ca54742b -> 6ab4c [BEAM-151] Remove unused reference on Dataflow client from test Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Commented] (BEAM-115) Beam Runner API

[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233182#comment-15233182 ] ASF GitHub Bot commented on BEAM-115: - Github user asfgit closed the pull request at:

Jenkins build is unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #64

See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #62

See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #65

See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #65

See

[GitHub] incubator-beam pull request: [BEAM-151] Move maven archetypes buil...

GitHub user lukecwik opened a pull request: https://github.com/apache/incubator-beam/pull/158 [BEAM-151] Move maven archetypes build order to be after runners Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[jira] [Commented] (BEAM-151) Create Dataflow Runner Package

[ https://issues.apache.org/jira/browse/BEAM-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233285#comment-15233285 ] ASF GitHub Bot commented on BEAM-151: - GitHub user lukecwik opened a pull request:

[4/4] incubator-beam-site git commit: [BEAM-172] Public meetings page

[BEAM-172] Public meetings page This closes #10 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/38d8256d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/38d8256d Diff:

[1/4] incubator-beam-site git commit: Addition of public meetings page

Repository: incubator-beam-site Updated Branches: refs/heads/asf-site ece351589 -> 38d8256d8 Addition of public meetings page Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/970a4fd3 Tree:

[GitHub] incubator-beam pull request: [BEAM-121] Additional APIs for regist...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/145 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[4/5] incubator-beam git commit: Rename DataflowAssert to PAssert

Rename DataflowAssert to PAssert Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d73ceab8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d73ceab8 Diff:

[3/5] incubator-beam git commit: Rename DataflowAssert to PAssert

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d73ceab8/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/DataflowAssert.java -- diff --git

[1/5] incubator-beam git commit: Rename DataflowAssert to PAssert

Repository: incubator-beam Updated Branches: refs/heads/master 5f24cef20 -> 529bcdf56 http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d73ceab8/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/PartitionTest.java

[5/5] incubator-beam git commit: This closes #146

This closes #146 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/529bcdf5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/529bcdf5 Diff:

[2/5] incubator-beam git commit: Rename DataflowAssert to PAssert

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d73ceab8/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableIOTest.java -- diff --git

[GitHub] incubator-beam pull request: [BEAM-155] Rename DataflowAssert to P...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/146 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/3] incubator-beam git commit: Use a weakValues LoadingCache for serial TransformExecutorServices

Repository: incubator-beam Updated Branches: refs/heads/master 529bcdf56 -> 5d78420bf Use a weakValues LoadingCache for serial TransformExecutorServices This allows the garbage collector to clean up references to TransformExecutorServices which are not currently in use. Project:

[3/3] incubator-beam git commit: [BEAM-22] This closes #143

[BEAM-22] This closes #143 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5d78420b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5d78420b Diff:

[GitHub] incubator-beam pull request: [BEAM-22] Use a weakValues LoadingCac...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/143 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232974#comment-15232974 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[2/3] incubator-beam git commit: [BEAM-151] Clean up reference to DataflowWorkerHarnessOptions

[BEAM-151] Clean up reference to DataflowWorkerHarnessOptions This prevents moving DataflowWorkerHarnessOptions to Dataflow Runner maven module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/02ee7457

[GitHub] incubator-beam pull request: [BEAM-151] Clean up reference to Data...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/78 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/3] incubator-beam git commit: [BEAM-151] Update Dataflow worker container label

Repository: incubator-beam Updated Branches: refs/heads/master 5d78420bf -> a43f9b820 [BEAM-151] Update Dataflow worker container label This new worker container label includes the change required to decouple the worker from depending on the deleted code in PipelineOptionsFactory. Project:

Jenkins build is unstable: beam_RunnableOnService_GoogleCloudDataflow #60

See

[jira] [Created] (BEAM-185) XmlSink output file pattern missing "." in extension

Scott Wegner created BEAM-185: - Summary: XmlSink output file pattern missing "." in extension Key: BEAM-185 URL: https://issues.apache.org/jira/browse/BEAM-185 Project: Beam Issue Type: Bug

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #66

See

[jira] [Created] (BEAM-184) Using Merging Windows and/or Triggers without a downstream aggregation should fail

Ben Chambers created BEAM-184: - Summary: Using Merging Windows and/or Triggers without a downstream aggregation should fail Key: BEAM-184 URL: https://issues.apache.org/jira/browse/BEAM-184 Project: Beam

[GitHub] incubator-beam pull request: FileBasedSource: throw IOException in...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/155 FileBasedSource: throw IOException instead of Exception where possible - Replace "throws Exception" with "throws IOException" from APIs that already only throw IOException. -

[jira] [Commented] (BEAM-186) The streaming WindowedWordCount example is broken on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233186#comment-15233186 ] ASF GitHub Bot commented on BEAM-186: - GitHub user herohde opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-186] Fix pubsub injector for st...

GitHub user herohde opened a pull request: https://github.com/apache/incubator-beam/pull/156 [BEAM-186] Fix pubsub injector for streaming examples You can merge this pull request into a Git repository by running: $ git pull https://github.com/herohde/incubator-beam master

Re: [jira] [Created] (BEAM-178) stdout vs logging in DataflowPipelineRunner?

I think this was because we wanted to make sure the user would get at least the fact that they submitted a pipeline even if they haven't setup logging correctly. On Wed, Apr 6, 2016 at 2:19 PM, Daniel Halperin (JIRA) wrote: > Daniel Halperin created BEAM-178: >

[GitHub] incubator-beam pull request: [BEAM-22] Add WindowIntoEvaluatorFact...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/149 [BEAM-22] Add WindowIntoEvaluatorFactory Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted

[2/2] incubator-beam git commit: This merges #149

This merges #149 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5f24cef2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5f24cef2 Diff:

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232529#comment-15232529 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request:

Build failed in Jenkins: beam_RunnableOnService_GoogleCloudDataflow #55

See Changes: [bchambers] Additional APIs for registering DisplayData -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

Build failed in Jenkins: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #55

See Changes: [bchambers] Additional APIs for registering DisplayData -- [INFO]

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232676#comment-15232676 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-22] Add WindowIntoEvaluatorFact...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/149 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #131

This closes #131 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6348a1fe Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6348a1fe Diff:

[1/2] incubator-beam git commit: Add PTransformOverrideFactory

Repository: incubator-beam Updated Branches: refs/heads/master 245cffa5e -> 6348a1fe2 Add PTransformOverrideFactory This constructs an appropriate custom PTransform override for the runner it is meant to be used in, which is applied in place of the original PTransform. Project:

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232523#comment-15232523 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-22] Add PTransformOverride clas...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/131 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Jenkins build is unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #56

See

[jira] [Commented] (BEAM-155) Support asserting the contents of windows and panes in PAssert

[ https://issues.apache.org/jira/browse/BEAM-155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232713#comment-15232713 ] ASF GitHub Bot commented on BEAM-155: - GitHub user tgroh opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-155] Make PassThroughWindowFn a...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/150 [BEAM-155] Make PassThroughWindowFn and NeverTrigger available Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the

[1/2] incubator-beam-site git commit: Fix for missing links

Repository: incubator-beam-site Updated Branches: refs/heads/asf-site 38d8256d8 -> 0ae64c654 Fix for missing links Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/4d374e87 Tree:

[2/2] incubator-beam-site git commit: [BEAM-172] Link fixes

[BEAM-172] Link fixes This closes #11 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/0ae64c65 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/0ae64c65 Diff:

[GitHub] incubator-beam pull request: Exclude more IDE files from Spark run...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/152 Exclude more IDE files from Spark runner RAT check It also seems that some of the prior rules were overly broad, excluding `*.filename` when they only should be excluding dotfiles. You