[jira] [Commented] (BEAM-3011) Pin Runner harness container image in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198142#comment-16198142 ] Valentyn Tymofieiev commented on BEAM-3011: --- https://github.com/apache/beam/pull/3966 that fixes

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #4133

See

[GitHub] beam pull request #3968: Only fail nightly release at end, for more detailed...

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3968 Only fail nightly release at end, for more detailed signal Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[jira] [Resolved] (BEAM-3037) Java DirectRunner jar includes non-relocated runner api protos

[ https://issues.apache.org/jira/browse/BEAM-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-3037. --- Resolution: Fixed > Java DirectRunner jar includes non-relocated runner api protos >

[jira] [Updated] (BEAM-3037) Java DirectRunner jar includes non-relocated runner api protos

[ https://issues.apache.org/jira/browse/BEAM-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3037: -- Fix Version/s: 2.2.0 > Java DirectRunner jar includes non-relocated runner api protos >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4132

See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #3257

See

Build failed in Jenkins: beam_PerformanceTests_Python #428

See Changes: [klk] Allow precommits to coexist with phrase triggering [klk] Restore Python precommit [klk] Enable phrase triggering of Java PreCommit [klk] Enable phrase triggering of Go PreCommit

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4992

See -- [...truncated 326.13 KB...] 2017-10-10T00:04:05.638 [INFO] Downloading:

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3320

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4990

See Changes: [relax] [maven-release-plugin] prepare for next development iteration -- [...truncated 1.66 MB...] 2017-10-09T23:37:58.834 [INFO]

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4991

See Changes: [relax] Bump Python version for next release. -- [...truncated 1.25 MB...] 2017-10-09T23:30:15.426 [INFO] Downloaded:

[jira] [Commented] (BEAM-2899) Universal Local Runner

[ https://issues.apache.org/jira/browse/BEAM-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197852#comment-16197852 ] ASF GitHub Bot commented on BEAM-2899: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #3967: [BEAM-2899] Move the Job Server into a Submodule

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3967 [BEAM-2899] Move the Job Server into a Submodule Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3966: Pin runner harness minimal

GitHub user tvalentyn opened a pull request: https://github.com/apache/beam/pull/3966 Pin runner harness minimal Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Created] (BEAM-3038) Add support for Azure Data Lake Storage as a Apache Beam FileSystem

Romit Girdhar created BEAM-3038: --- Summary: Add support for Azure Data Lake Storage as a Apache Beam FileSystem Key: BEAM-3038 URL: https://issues.apache.org/jira/browse/BEAM-3038 Project: Beam

Build failed in Jenkins: beam_PostCommit_Python_Verify #3319

See Changes: [klk] Relocate sdks.common.v1 and portability.v1 in Java direct runner -- [...truncated 927.00 KB...] "@type": "OutputReference",

beam git commit: Update container version.

Repository: beam Updated Branches: refs/heads/release-2.2.0 bfa8136d7 -> 0a4774d88 Update container version. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0a4774d8 Tree:

beam git commit: Bump Python version for next release.

Repository: beam Updated Branches: refs/heads/master 1d675b03f -> 9f69997ba Bump Python version for next release. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9f69997b Tree:

beam git commit: Update python version.

Repository: beam Updated Branches: refs/heads/release-2.2.0 db0d47b03 -> bfa8136d7 Update python version. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bfa8136d Tree:

[beam] Git Push Summary

Repository: beam Updated Branches: refs/heads/release-2.2.0 [created] db0d47b03

beam git commit: [maven-release-plugin] prepare for next development iteration

Repository: beam Updated Branches: refs/heads/master db0d47b03 -> 1d675b03f [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1d675b03 Tree:

[jira] [Commented] (BEAM-2600) Python SDK harness container

[ https://issues.apache.org/jira/browse/BEAM-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197818#comment-16197818 ] ASF GitHub Bot commented on BEAM-2600: -- GitHub user herohde opened a pull request:

beam git commit: [maven-release-plugin] prepare branch release-2.2.0

Repository: beam Updated Branches: refs/heads/master f446853ee -> db0d47b03 [maven-release-plugin] prepare branch release-2.2.0 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/db0d47b0 Tree:

[GitHub] beam pull request #3965: [BEAM-2600] Add minimal python SDK harness containe...

GitHub user herohde opened a pull request: https://github.com/apache/beam/pull/3965 [BEAM-2600] Add minimal python SDK harness container The container image does not support requirements files, main sessions, etc yet. You can merge this pull request into a Git repository by

[jira] [Commented] (BEAM-3037) Java DirectRunner jar includes non-relocated runner api protos

[ https://issues.apache.org/jira/browse/BEAM-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197800#comment-16197800 ] ASF GitHub Bot commented on BEAM-3037: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3964: [BEAM-3037] Relocate sdks.common.v1 and portability...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3964 ---

[2/2] beam git commit: This closes #3964: [BEAM-3037] Relocate sdks.common.v1 and portability.v1 in Java direct runner

This closes #3964: [BEAM-3037] Relocate sdks.common.v1 and portability.v1 in Java direct runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f446853e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f446853e Diff:

[1/2] beam git commit: Relocate sdks.common.v1 and portability.v1 in Java direct runner

Repository: beam Updated Branches: refs/heads/master 75bab74eb -> f446853ee Relocate sdks.common.v1 and portability.v1 in Java direct runner Currently these two namespaces are mistakenly left as-is, even though they link to other relocated proto libraries that make them incompatible when used

[jira] [Resolved] (BEAM-3028) DatastoreIO integration tests failing on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-3028. -- Resolution: Fixed > DatastoreIO integration tests failing on Dataflow >

[jira] [Commented] (BEAM-3028) DatastoreIO integration tests failing on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197796#comment-16197796 ] Chamikara Jayalath commented on BEAM-3028: -- Fix is in. Seems like post commits are failing

svn commit: r22188 - /dev/beam/KEYS

Author: kenn Date: Mon Oct 9 22:05:43 2017 New Revision: 22188 Log: Add public key for Reuven Lax Modified: dev/beam/KEYS Modified: dev/beam/KEYS == --- dev/beam/KEYS (original) +++ dev/beam/KEYS Mon Oct 9

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4986

See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #4130

See Changes: [klk] Fix typo in nightly release script [kirpichov] Fixes TextIO and AvroIO tests of watchForNewFiles [kirpichov] Add @FunctionalInterface annotation to several

[jira] [Commented] (BEAM-3028) DatastoreIO integration tests failing on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197693#comment-16197693 ] ASF GitHub Bot commented on BEAM-3028: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3962: [BEAM-3028] Fixes a bug in DatastoreIO query splitt...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3962 ---

[2/2] beam git commit: This closes #3962

This closes #3962 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/75bab74e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/75bab74e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/75bab74e Branch:

[1/2] beam git commit: Fixes a bug in query splitting.

Repository: beam Updated Branches: refs/heads/master 296f7fa96 -> 75bab74eb Fixes a bug in query splitting. We were returning original query instead of the sub-queries resulting in data duplication when reading. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #3956: Restore Python precommit; enable phrase triggering ...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3956 ---

[6/6] beam git commit: This closes #3956: Restore Python precommit; enable phrase triggering for precommits in general

This closes #3956: Restore Python precommit; enable phrase triggering for precommits in general Add runners/direct-java to Java precommit Enable phrase triggering of Go PreCommit Enable phrase triggering of Java PreCommit Restore Python precommit Allow precommits to coexist with phrase

[2/6] beam git commit: Allow precommits to coexist with phrase triggering

Allow precommits to coexist with phrase triggering Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6416deb0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6416deb0 Diff:

[4/6] beam git commit: Restore Python precommit

Restore Python precommit Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b47c372b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b47c372b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b47c372b Branch:

[5/6] beam git commit: Add runners/direct-java to Java precommit

Add runners/direct-java to Java precommit Previously `-pl sdks/java/core -am -amd` was our Maven shorthand for getting "everything" into the Maven reactor. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cdefb111 Tree:

[1/6] beam git commit: Enable phrase triggering of Go PreCommit

Repository: beam Updated Branches: refs/heads/master 61777b433 -> 296f7fa96 Enable phrase triggering of Go PreCommit Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/687828f0 Tree:

[3/6] beam git commit: Enable phrase triggering of Java PreCommit

Enable phrase triggering of Java PreCommit Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/834494a9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/834494a9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/834494a9

[GitHub] beam pull request #3914: [BEAM-2996] Ensure metric names are not null or emp...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3914 ---

[1/2] beam git commit: Ensure metric names are not null or empty

Repository: beam Updated Branches: refs/heads/master 63de41ac2 -> 61777b433 Ensure metric names are not null or empty Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b6c838e1 Tree:

[2/2] beam git commit: This closes #3914: [BEAM-2996] Ensure metric names are not null or empty

This closes #3914: [BEAM-2996] Ensure metric names are not null or empty Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/61777b43 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/61777b43 Diff:

[jira] [Commented] (BEAM-3037) Java DirectRunner jar includes non-relocated runner api protos

[ https://issues.apache.org/jira/browse/BEAM-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197622#comment-16197622 ] ASF GitHub Bot commented on BEAM-3037: -- GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #3964: [BEAM-3037] Relocate sdks.common.v1 and portability...

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3964 [BEAM-3037] Relocate sdks.common.v1 and portability.v1 in Java direct runner Currently these two namespaces are mistakenly left as-is, even though they link to other relocated proto

[jira] [Created] (BEAM-3037) Java DirectRunner jar includes non-relocated runner api protos

Kenneth Knowles created BEAM-3037: - Summary: Java DirectRunner jar includes non-relocated runner api protos Key: BEAM-3037 URL: https://issues.apache.org/jira/browse/BEAM-3037 Project: Beam

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4984

See

[GitHub] beam pull request #3934: Add @FunctionalInterface annotation to several Jdbc...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3934 ---

[1/2] beam git commit: Add @FunctionalInterface annotation to several interfaces

Repository: beam Updated Branches: refs/heads/master 5130cab4a -> 63de41ac2 Add @FunctionalInterface annotation to several interfaces By adding the @FunctionalInterface to RowMapper, StatementPreperator and PreparedStatementSetter it's possible to write a JdbcIO source in a more concise and

[jira] [Commented] (BEAM-3030) watchForNewFiles() can emit a file multiple times if it's growing

[ https://issues.apache.org/jira/browse/BEAM-3030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197478#comment-16197478 ] ASF GitHub Bot commented on BEAM-3030: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: Fixes TextIO and AvroIO tests of watchForNewFiles

Repository: beam Updated Branches: refs/heads/master ec1782c18 -> 5130cab4a Fixes TextIO and AvroIO tests of watchForNewFiles * AvroIO: Need to specify a trigger to make sure that files are really generated continuously and testing of watchForNewFiles is non-vacuous. * TextIO: files were

[2/2] beam git commit: This closes #3957: Fixes TextIO and AvroIO tests of watchForNewFiles

This closes #3957: Fixes TextIO and AvroIO tests of watchForNewFiles Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5130cab4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5130cab4 Diff:

beam git commit: Fix typo in nightly release script

Repository: beam Updated Branches: refs/heads/master eac561f59 -> ec1782c18 Fix typo in nightly release script Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ec1782c1 Tree:

[GitHub] beam pull request #3963: Extend nightly build timeout to 4 hours

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3963 ---

[1/2] beam git commit: Extend nightly build timeout to 4 hours

Repository: beam Updated Branches: refs/heads/master ec5e72403 -> eac561f59 Extend nightly build timeout to 4 hours Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/742a0823 Tree:

[2/2] beam git commit: This closes #3963: Extend nightly build timeout to 4 hours

This closes #3963: Extend nightly build timeout to 4 hours Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/eac561f5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/eac561f5 Diff:

[GitHub] beam pull request #3963: Extend nightly build timeout to 4 hours

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3963 Extend nightly build timeout to 4 hours Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4981

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4980

See

[jira] [Closed] (BEAM-3027) Output type of SourceID-stripper is not correctly set

[ https://issues.apache.org/jira/browse/BEAM-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-3027. -- Resolution: Fixed > Output type of SourceID-stripper is not correctly set >

[jira] [Commented] (BEAM-3027) Output type of SourceID-stripper is not correctly set

[ https://issues.apache.org/jira/browse/BEAM-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196917#comment-16196917 ] ASF GitHub Bot commented on BEAM-3027: -- Github user aljoscha closed the pull request at:

[GitHub] beam pull request #3953: [BEAM-3027] Correctly set output type on SourceId-s...

Github user aljoscha closed the pull request at: https://github.com/apache/beam/pull/3953 ---

[1/2] beam git commit: [BEAM-3027] Correctly set output type on SourceId-stripper

Repository: beam Updated Branches: refs/heads/master b44056fc6 -> ec5e72403 [BEAM-3027] Correctly set output type on SourceId-stripper Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ca20e69c Tree:

[2/2] beam git commit: This closes #3953

This closes #3953 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ec5e7240 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ec5e7240 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ec5e7240 Branch:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4979

See

Jenkins build is back to normal : beam_PerformanceTests_Python #425

See