Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #226

2016-04-26 Thread Apache Jenkins Server
See

Re: Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #225

2016-04-26 Thread Dan Halperin
This should be fixed now by a configuration change -- we recently made a package rename, and the config of this Jenkins build was not updated. On Tue, Apr 26, 2016 at 6:32 PM, Dan Halperin wrote: > Looking > > On Tue, Apr 26, 2016 at 6:21 PM, Apache Jenkins Server < >

Re: Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #225

2016-04-26 Thread Dan Halperin
Looking On Tue, Apr 26, 2016 at 6:21 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GoogleCloudDataflow/changes > > > >

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #225

2016-04-26 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #224

2016-04-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-77) Reorganize Directory structure

2016-04-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259301#comment-15259301 ] ASF GitHub Bot commented on BEAM-77: Github user asfgit closed the pull request at:

[20/21] incubator-beam git commit: Fix a few underlying checkstyle issues in java8 examples

2016-04-26 Thread dhalperi
Fix a few underlying checkstyle issues in java8 examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9e19efdf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9e19efdf Diff:

[07/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslatorTest.java -- diff --git

[08/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/DataflowPipelineRegistrarTest.java -- diff --git

[11/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/sdk/runners/DataflowPipelineRunner.java -- diff --git

[17/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
Reorganize Java packages in the sources of the Google Cloud Dataflow runner Packages are moving from org.apache.beam.sdk to org.apache.beam.runners.dataflow. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[16/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowPipelineRunner.java -- diff --git

[05/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/sdk/runners/DataflowPipelineJobTest.java -- diff --git

[02/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/sdk/util/PackageUtilTest.java -- diff --git

[12/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/sdk/runners/DataflowPipelineJob.java -- diff --git

[19/21] incubator-beam git commit: Increase visibility in PAssert and ZipFiles utilities

2016-04-26 Thread dhalperi
Increase visibility in PAssert and ZipFiles utilities This is needed for package reorganization in runners/google-cloud-dataflow. Those classes will have to move away from org.apache.beam.sdk.* packages. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[14/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/options/DataflowPipelineDebugOptions.java -- diff --git

[18/21] incubator-beam git commit: Update pom.xml for java8tests

2016-04-26 Thread dhalperi
Update pom.xml for java8tests Java8tests module doesn't have sources, only tests. Hence, all dependencies should have scope of test. If not, dependency analysis correctly finds unused dependencies. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[13/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/util/PackageUtil.java -- diff --git

[03/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/sdk/runners/DataflowPipelineTranslatorTest.java -- diff --git

[GitHub] incubator-beam pull request: [BEAM-77] Reorganize Java packages in...

2016-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/239 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[15/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowPipelineRunnerHooks.java -- diff --git

[10/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/sdk/runners/DataflowPipelineRunnerHooks.java -- diff --git

[09/21] incubator-beam git commit: Reorganize Java packages in the sources of the Google Cloud Dataflow runner

2016-04-26 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/02190985/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/sdk/testing/TestDataflowPipelineRunner.java -- diff --git

[jira] [Commented] (BEAM-222) TestCounterSource does not implement checkpointing contract

2016-04-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259237#comment-15259237 ] ASF GitHub Bot commented on BEAM-222: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: TestCountingSource: Don't advance beyond last valid value

2016-04-26 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 7bd2d365a -> 5e3d7ad20 TestCountingSource: Don't advance beyond last valid value Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ad592442

[GitHub] incubator-beam pull request: [BEAM-222] Don't advance beyond last ...

2016-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/248 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Closes #248

2016-04-26 Thread dhalperi
Closes #248 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5e3d7ad2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5e3d7ad2 Diff:

[GitHub] incubator-beam pull request: [BEAM-22] Return a map of CommittedBu...

2016-04-26 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/249 [BEAM-22] Return a map of CommittedBundle to Consumers from handleResult Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Commented] (BEAM-222) TestCounterSource does not implement checkpointing contract

2016-04-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259187#comment-15259187 ] ASF GitHub Bot commented on BEAM-222: - GitHub user mshields822 opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-222] Don't advance beyond last ...

2016-04-26 Thread mshields822
GitHub user mshields822 opened a pull request: https://github.com/apache/incubator-beam/pull/248 [BEAM-222] Don't advance beyond last valid value Turns out there was a bug with allowing 'advanced beyond last element' to be a valid counter state. Only an internal reload test

[GitHub] incubator-beam pull request: Import blacklist

2016-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/245 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-199) Improve fluent interface for manipulating DisplayData.Items

2016-04-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259167#comment-15259167 ] ASF GitHub Bot commented on BEAM-199: - GitHub user swegner opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-199] Update DisplayData APIs to...

2016-04-26 Thread swegner
GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/247 [BEAM-199] Update DisplayData APIs to make overrides more understandable Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[GitHub] incubator-beam pull request: Import blacklist

2016-04-26 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/245 Import blacklist Use checkstyle to catch the illegal import of repackaged Guava. Caught one invalid use case. You can merge this pull request into a Git repository by running:

[2/3] incubator-beam git commit: Reference correct Lists import

2016-04-26 Thread dhalperi
Reference correct Lists import Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0d6c53ae Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0d6c53ae Diff:

[GitHub] incubator-beam pull request: Minor fixes

2016-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/244 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[3/3] incubator-beam git commit: Closes #244

2016-04-26 Thread dhalperi
Closes #244 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8a2a1ced Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8a2a1ced Diff:

[1/3] incubator-beam git commit: [BEAM-77] Move bigtable in IO

2016-04-26 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 9746f0d1d -> aa43ec0b0 http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d138ae54/sdks/java/io/google-cloud-platform/pom.xml -- diff --git

[GitHub] incubator-beam pull request: [BEAM-77] Create IO module and move b...

2016-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/97 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request: Minor fixes

2016-04-26 Thread swegner
GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/244 Minor fixes Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-]

[jira] [Commented] (BEAM-189) The Spark runner uses valueInEmptyWindow which causes values to be dropped

2016-04-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258880#comment-15258880 ] Kenneth Knowles commented on BEAM-189: -- Follow-up to remove the problematic method entirely is

[GitHub] incubator-beam pull request: [BEAM-22] Output InProcessGroupByKeyO...

2016-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/242 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Output InProcessGroupByKeyOnly elements in the Global Window

2016-04-26 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 7dc1a4047 -> 9746f0d1d Output InProcessGroupByKeyOnly elements in the Global Window This ensures that the values are not dropped if they are exploded (for example, in the Watermark Manager). Project:

[jira] [Created] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2016-04-26 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-230: Summary: Remove WindowedValue#valueInEmptyWindows Key: BEAM-230 URL: https://issues.apache.org/jira/browse/BEAM-230 Project: Beam Issue Type: Bug

[GitHub] incubator-beam pull request: [BEAM-22] Output InProcessGroupByKeyO...

2016-04-26 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/242 [BEAM-22] Output InProcessGroupByKeyOnly elements in the Global Window Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] incubator-beam pull request: [BEAM-151] Move over some more Datafl...

2016-04-26 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/incubator-beam/pull/243 [BEAM-151] Move over some more Dataflow specific classes. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the

[jira] [Commented] (BEAM-117) Implement the API for Static Display Metadata

2016-04-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258481#comment-15258481 ] ASF GitHub Bot commented on BEAM-117: - Github user asfgit closed the pull request at:

[4/4] incubator-beam git commit: This closes #241

2016-04-26 Thread bchambers
This closes #241 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7dc1a404 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7dc1a404 Diff:

[3/4] incubator-beam git commit: Rename DisplayDataMatchers.includes to includesDisplayData to clarify usage

2016-04-26 Thread bchambers
Rename DisplayDataMatchers.includes to includesDisplayData to clarify usage Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/582befdc Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/582befdc

[2/4] incubator-beam git commit: Normalize comments to refer to 'display data' rather than 'display metadata'

2016-04-26 Thread bchambers
Normalize comments to refer to 'display data' rather than 'display metadata' Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9d45a4a1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9d45a4a1

[1/4] incubator-beam git commit: Add super.populateDisplayData() to standard implementations. The current super implementation is a no-op, but this is the recommended way to implement the pattern

2016-04-26 Thread bchambers
Repository: incubator-beam Updated Branches: refs/heads/master d299e2c25 -> 7dc1a4047 Add super.populateDisplayData() to standard implementations. The current super implementation is a no-op, but this is the recommended way to implement the pattern Project:

[jira] [Commented] (BEAM-168) IntervalBoundedExponentialBackOff change broke Beam-on-Dataflow

2016-04-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258369#comment-15258369 ] Daniel Halperin commented on BEAM-168: -- Like to keep this open until I can remove the deprecated code.

[jira] [Commented] (BEAM-185) XmlSink output file pattern missing "." in extension

2016-04-26 Thread Scott Wegner (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258349#comment-15258349 ] Scott Wegner commented on BEAM-185: --- You're right. I looked into this more, and the usage of this is fixed

[jira] [Closed] (BEAM-185) XmlSink output file pattern missing "." in extension

2016-04-26 Thread Scott Wegner (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-185. - Resolution: Won't Fix > XmlSink output file pattern missing "." in extension >

[GitHub] incubator-beam pull request: Add DirtyBit to represent whether Cou...

2016-04-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/219 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Add DirtyBit to represent whether Counters have been committed.

2016-04-26 Thread bchambers
Repository: incubator-beam Updated Branches: refs/heads/master c59ca3868 -> d299e2c25 Add DirtyBit to represent whether Counters have been committed. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: This closes #219

2016-04-26 Thread bchambers
This closes #219 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d299e2c2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d299e2c2 Diff:

[jira] [Commented] (BEAM-117) Implement the API for Static Display Metadata

2016-04-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258326#comment-15258326 ] ASF GitHub Bot commented on BEAM-117: - GitHub user swegner opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-117] Minor updates for DisplayD...

2016-04-26 Thread swegner
GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/241 [BEAM-117] Minor updates for DisplayData usage Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Updated] (BEAM-229) Add support for additional Spark configuration via PipelineOptions

2016-04-26 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-229: --- Component/s: runner-spark > Add support for additional Spark configuration via PipelineOptions >

[jira] [Created] (BEAM-229) Add support for additional Spark configuration via PipelineOptions

2016-04-26 Thread Amit Sela (JIRA)
Amit Sela created BEAM-229: -- Summary: Add support for additional Spark configuration via PipelineOptions Key: BEAM-229 URL: https://issues.apache.org/jira/browse/BEAM-229 Project: Beam Issue Type:

[jira] [Commented] (BEAM-129) Support pubsub IO

2016-04-26 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257826#comment-15257826 ] Maximilian Michels commented on BEAM-129: - Great, getting excited :) > Support pubsub IO >

[jira] [Commented] (BEAM-228) Create a merge bot for Beam

2016-04-26 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257611#comment-15257611 ] Jean-Baptiste Onofré commented on BEAM-228: --- We are waiting for legal statement about this.