[GitHub] incubator-beam pull request: Add CounterNameAndMetadata to support...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/102 Add CounterNameAndMetadata to support structured counter name You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219376#comment-15219376 ] Daniel Halperin commented on BEAM-68: - Okay, I think I'm partially wrong. KV ->

[jira] [Comment Edited] (BEAM-68) Support for limiting parallelism of a step

[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219353#comment-15219353 ] Daniel Halperin edited comment on BEAM-68 at 3/31/16 5:08 AM: -- Eugene: I

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219353#comment-15219353 ] Daniel Halperin commented on BEAM-68: - Eugene: I disagree with the premise that even the group by key

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #8

See

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #8

See

[jira] [Closed] (BEAM-152) Convert contrib guide to website page

[ https://issues.apache.org/jira/browse/BEAM-152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Malone closed BEAM-152. - Resolution: Fixed > Convert contrib guide to website page > - > >

[jira] [Commented] (BEAM-85) DataflowAssert (BeamAssert ;) needs sanity check that it's used correctly

[ https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219303#comment-15219303 ] ASF GitHub Bot commented on BEAM-85: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-85] Manually fix some broken us...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/93 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: This closes #93

This closes #93 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0c47cad4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0c47cad4 Diff:

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219143#comment-15219143 ] Davor Bonaci commented on BEAM-68: -- The uses cases are different for sure. However, it is unclear whether

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #7

See

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #7

See

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219126#comment-15219126 ] Eugene Kirpichov commented on BEAM-68: -- I think the two use cases are quite different and need different

[jira] [Resolved] (BEAM-94) CountingInput should be able to limit the rate at which output is produced

[ https://issues.apache.org/jira/browse/BEAM-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-94. - Resolution: Fixed https://github.com/apache/incubator-beam/pull/17 > CountingInput should be able to limit

[jira] [Commented] (BEAM-94) CountingInput should be able to limit the rate at which output is produced

[ https://issues.apache.org/jira/browse/BEAM-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219068#comment-15219068 ] ASF GitHub Bot commented on BEAM-94: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-94] Add UnboundedCountingInput#...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/17 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: Closes #17

Repository: incubator-beam Updated Branches: refs/heads/master ffb7002b8 -> 9793fa2c8 Closes #17 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9793fa2c Tree:

[18/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableIO.java -- diff --git

[12/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcpCredentialFactory.java -- diff --git

[22/23] incubator-beam git commit: Update LICENSE header across all files

Update LICENSE header across all files Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d59c8012 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d59c8012 Diff:

[GitHub] incubator-beam pull request: Update LICENSE header across all file...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/100 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[04/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryTableRowIteratorTest.java -- diff --git

[14/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/View.java -- diff --git

[21/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java -- diff --git

[20/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java8/src/test/java/com/google/cloud/dataflow/examples/MinimalWordCountJava8Test.java -- diff --git

[11/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/ReshuffleTrigger.java -- diff --git

[15/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineOptions.java -- diff --git

[06/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/DataflowJUnitTestRunner.java -- diff --git

[07/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/PipelineOptionsValidatorTest.java -- diff --git

[16/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ForwardingPTransform.java -- diff --git

[05/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/RemoveDuplicatesTest.java -- diff --git

[08/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringDelegateCoderTest.java -- diff --git

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #6

See

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #6

See

[13/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/TriggerBuilder.java -- diff --git

[10/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ElementByteSizeObserver.java -- diff --git

[02/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/ExamplePubsubTopicOptions.java -- diff --git

[09/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValue.java -- diff --git

[03/23] incubator-beam git commit: Update LICENSE header across all files

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/TriggerTester.java -- diff --git

[01/23] incubator-beam git commit: Update checkstyle.xml to require Apache copyright header in each file

Repository: incubator-beam Updated Branches: refs/heads/master c6aac3b26 -> ffb7002b8 Update checkstyle.xml to require Apache copyright header in each file Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request: Add basic integration/e2e tests.

GitHub user jasonkuster opened a pull request: https://github.com/apache/incubator-beam/pull/101 Add basic integration/e2e tests. This contribution adds the failsafe plugin in the examples directory and adds a WordCount test which for now runs using the DataflowPipelineRunner. You

[GitHub] incubator-beam pull request: Re-interrupt current thread when igno...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/45 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: This closes #45

This closes #45 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c6aac3b2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c6aac3b2 Diff:

[1/2] incubator-beam git commit: Re-interrupt current thread when ignoring InterruptedException

Repository: incubator-beam Updated Branches: refs/heads/master 78abd964a -> c6aac3b26 Re-interrupt current thread when ignoring InterruptedException Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #5

See

[GitHub] incubator-beam pull request: Update LICENSE header across all file...

GitHub user davorbonaci opened a pull request: https://github.com/apache/incubator-beam/pull/100 Update LICENSE header across all files R: @jbonofre You can merge this pull request into a Git repository by running: $ git pull https://github.com/davorbonaci/beam header

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218969#comment-15218969 ] ASF GitHub Bot commented on BEAM-77: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-77] Move Java-specific checksty...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/98 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: [BEAM-77] Move Java-specific checkstyle.xml into 'sdks/java' directory

Repository: incubator-beam Updated Branches: refs/heads/master 636ad413a -> 78abd964a [BEAM-77] Move Java-specific checkstyle.xml into 'sdks/java' directory Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: Closes #98

Closes #98 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/78abd964 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/78abd964 Diff:

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #4

See

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #4

See

[GitHub] incubator-beam pull request: [BEAM-160] Import NexMark integration...

GitHub user mshields822 opened a pull request: https://github.com/apache/incubator-beam/pull/99 [BEAM-160] Import NexMark integration tests. BUILDS ON https://github.com/apache/incubator-beam/pull/85 This is an initial import of the 'NexMark' integration tests. All

[GitHub] incubator-beam pull request: [BEAM-77] Move Java-specific checksty...

GitHub user davorbonaci opened a pull request: https://github.com/apache/incubator-beam/pull/98 [BEAM-77] Move Java-specific checkstyle.xml into 'sdks/java' directory R: @dhalperi CC: @jbonofre You can merge this pull request into a Git repository by running: $ git pull

[jira] [Resolved] (BEAM-159) Support fixed number of shards in custom sinks

[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-159. -- Resolution: Duplicate > Support fixed number of shards in custom sinks >

[jira] [Commented] (BEAM-159) Support fixed number of shards in custom sinks

[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218769#comment-15218769 ] Daniel Halperin commented on BEAM-159: -- https://issues.apache.org/jira/browse/BEAM-68 > Support fixed

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218739#comment-15218739 ] ASF GitHub Bot commented on BEAM-77: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-77] Using wrap modules for sdks...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/90 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: [BEAM-77] Using wrap modules for sdks and examples

Repository: incubator-beam Updated Branches: refs/heads/master 17863c851 -> 636ad413a [BEAM-77] Using wrap modules for sdks and examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c6c28365 Tree:

[jira] [Created] (BEAM-160) Port 'NexMark Queries' to Beam for use as integration test

Mark Shields created BEAM-160: - Summary: Port 'NexMark Queries' to Beam for use as integration test Key: BEAM-160 URL: https://issues.apache.org/jira/browse/BEAM-160 Project: Beam Issue Type:

Jenkins build is back to stable : beam_MavenVerify #51

See

[jira] [Created] (BEAM-159) Support fixed number of shards in custom sinks

Eugene Kirpichov created BEAM-159: - Summary: Support fixed number of shards in custom sinks Key: BEAM-159 URL: https://issues.apache.org/jira/browse/BEAM-159 Project: Beam Issue Type:

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218464#comment-15218464 ] ASF GitHub Bot commented on BEAM-77: GitHub user jbonofre opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-77] Create IO module and move b...

GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/97 [BEAM-77] Create IO module and move bigtable there [BEAM-77] Create io module and move bigtable there Be sure to do all of the following to help us incorporate your contribution

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218462#comment-15218462 ] ASF GitHub Bot commented on BEAM-77: Github user jbonofre closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-77] IOs module creation, and re...

Github user jbonofre closed the pull request at: https://github.com/apache/incubator-beam/pull/95 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request: [BEAM-77] Move hadoop contrib as hdfs...

GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/96 [BEAM-77] Move hadoop contrib as hdfs IO [BEAM-77] Move hadoop into io module as hdfs Be sure to do all of the following to help us incorporate your contribution quickly and

[jira] [Updated] (BEAM-154) Provide Maven BOM

[ https://issues.apache.org/jira/browse/BEAM-154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-154: -- Component/s: sdk-java-core > Provide Maven BOM > - > > Key: BEAM-154 >

[jira] [Commented] (BEAM-134) Investigate use of AutoValue

[ https://issues.apache.org/jira/browse/BEAM-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218445#comment-15218445 ] Davor Bonaci commented on BEAM-134: --- A quick doc showing how the code changes for one of the high-value

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDK :: Java All #3

See

[jira] [Commented] (BEAM-127) Support for Unbounded sinks in Streaming

[ https://issues.apache.org/jira/browse/BEAM-127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217812#comment-15217812 ] Kostas Kloudas commented on BEAM-127: - Hi [~mxm], I suppose you mean sinks right? > Support for

[jira] [Commented] (BEAM-136) PipelineOptionsFactory should detect all runners

[ https://issues.apache.org/jira/browse/BEAM-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217763#comment-15217763 ] Maximilian Michels commented on BEAM-136: - Thanks. Seems like we're already set up then. The user

[jira] [Created] (BEAM-158) Add support for bounded sources in streaming mode

Maximilian Michels created BEAM-158: --- Summary: Add support for bounded sources in streaming mode Key: BEAM-158 URL: https://issues.apache.org/jira/browse/BEAM-158 Project: Beam Issue Type:

[GitHub] incubator-beam pull request: [flink] improve lifecycle handling of...

GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/94 [flink] improve lifecycle handling of GroupAlsoByWindowWrapper Could someone have a look if these minor changes are good to merge? @davorbonaci @kennknowles Note, that there are two

[GitHub] incubator-beam pull request: [BEAM-80] Manually fix some broken us...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/93 [BEAM-80] Manually fix some broken uses of DataflowAssert You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/incubator-beam

[jira] [Created] (BEAM-157) CombineTest.testGlobalCombineWithDefaultsAndTriggers is broken

Daniel Halperin created BEAM-157: Summary: CombineTest.testGlobalCombineWithDefaultsAndTriggers is broken Key: BEAM-157 URL: https://issues.apache.org/jira/browse/BEAM-157 Project: Beam