[beam] 01/01: BEAM-3910: Add float support for the Go SDK.

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit c75a1d919ba11826a1fd89851569dace7ba0f95d
Merge: 6df71d2 0d12851
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Apr 6 14:38:17 2018 -0400

BEAM-3910: Add float support for the Go SDK.

 sdks/go/pkg/beam/coder.go  |   7 +
 sdks/go/pkg/beam/core/runtime/coderx/float.go  |  75 ++
 sdks/go/pkg/beam/core/runtime/coderx/float_test.go |  50 +++
 sdks/go/pkg/beam/core/runtime/graphx/serialize.go  |   8 +
 sdks/go/pkg/beam/core/runtime/graphx/v1/v1.pb.go   | 165 +++--
 sdks/go/pkg/beam/core/runtime/graphx/v1/v1.proto   |   2 +
 6 files changed, 228 insertions(+), 79 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (c75a1d9 -> 16232c2)

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from c75a1d9  BEAM-3910: Add float support for the Go SDK.
 add dea8f6e  Add hooks to the Go SDK.
 new 16232c2  [BEAM-3355] Diagnostic interfaces

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/core/runtime/harness/harness.go |  25 +--
 sdks/go/pkg/beam/core/runtime/harness/session.go |  97 +++-
 sdks/go/pkg/beam/core/util/hooks/hooks.go| 186 +++
 sdks/go/pkg/beam/runners/dataflow/dataflow.go|  40 -
 sdks/go/pkg/beam/runners/dataflow/messages.go|   6 +-
 sdks/go/pkg/beam/runners/session/session.go  |   6 +-
 sdks/go/pkg/beam/util/grpcx/hook.go  |  86 +++
 sdks/go/pkg/beam/x/hooks/perf/perf.go| 170 +
 8 files changed, 550 insertions(+), 66 deletions(-)
 create mode 100644 sdks/go/pkg/beam/core/util/hooks/hooks.go
 create mode 100644 sdks/go/pkg/beam/util/grpcx/hook.go
 create mode 100644 sdks/go/pkg/beam/x/hooks/perf/perf.go

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3355] Diagnostic interfaces

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 16232c2a8964e294662bbfa30a12aff1a17cf8fa
Merge: c75a1d9 dea8f6e
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Apr 6 14:38:53 2018 -0400

[BEAM-3355] Diagnostic interfaces

 sdks/go/pkg/beam/core/runtime/harness/harness.go |  25 +--
 sdks/go/pkg/beam/core/runtime/harness/session.go |  97 +++-
 sdks/go/pkg/beam/core/util/hooks/hooks.go| 186 +++
 sdks/go/pkg/beam/runners/dataflow/dataflow.go|  40 -
 sdks/go/pkg/beam/runners/dataflow/messages.go|   6 +-
 sdks/go/pkg/beam/runners/session/session.go  |   6 +-
 sdks/go/pkg/beam/util/grpcx/hook.go  |  86 +++
 sdks/go/pkg/beam/x/hooks/perf/perf.go| 170 +
 8 files changed, 550 insertions(+), 66 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (6df71d2 -> c75a1d9)

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 6df71d2  Add diagnostics for sinks.
 add 0d12851  Add float support for the SDK.
 new c75a1d9  BEAM-3910: Add float support for the Go SDK.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/coder.go  |   7 +
 sdks/go/pkg/beam/core/runtime/coderx/float.go  |  75 ++
 .../coderx/{varint_test.go => float_test.go}   |  48 +-
 sdks/go/pkg/beam/core/runtime/graphx/serialize.go  |   8 +
 sdks/go/pkg/beam/core/runtime/graphx/v1/v1.pb.go   | 165 +++--
 sdks/go/pkg/beam/core/runtime/graphx/v1/v1.proto   |   2 +
 6 files changed, 185 insertions(+), 120 deletions(-)
 create mode 100644 sdks/go/pkg/beam/core/runtime/coderx/float.go
 copy sdks/go/pkg/beam/core/runtime/coderx/{varint_test.go => float_test.go} 
(62%)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (ddd0c5c -> 6df71d2)

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from ddd0c5c  [BEAM-3250] Add JUnit test reporting to Jenkins.
 add 071718a  Add diagnostics for sinks.
 new 6df71d2  Add diagnostics for sinks.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/core/runtime/exec/datasink.go   | 13 +++--
 sdks/go/pkg/beam/core/runtime/exec/datasource.go |  2 +-
 2 files changed, 12 insertions(+), 3 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Add diagnostics for sinks.

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 6df71d2cf257120d424098d5cc84369561fdd788
Merge: ddd0c5c 071718a
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Apr 6 14:37:16 2018 -0400

Add diagnostics for sinks.

 sdks/go/pkg/beam/core/runtime/exec/datasink.go   | 13 +++--
 sdks/go/pkg/beam/core/runtime/exec/datasource.go |  2 +-
 2 files changed, 12 insertions(+), 3 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (5056fd9 -> e720166)

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 5056fd9  Merge pull request #5032 from udim/gradle-python
 add a526bec  [BEAM-3250] Migrate Dataflow ValidatesRunner test to Gradle
 add d6776a1  CR: use 4 forks in Dataflow test
 new e720166  [BEAM-3250] Migrate Dataflow ValidatesRunner test to Gradle

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 ...PostCommit_Java_ValidatesRunner_Dataflow.groovy | 26 +++--
 runners/google-cloud-dataflow-java/build.gradle| 66 ++
 2 files changed, 75 insertions(+), 17 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3250] Migrate Dataflow ValidatesRunner test to Gradle

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit e7201665ea7156bdac22487ebc1c283d24f25a43
Merge: 5056fd9 d6776a1
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Apr 6 07:46:16 2018 -0400

[BEAM-3250] Migrate Dataflow ValidatesRunner test to Gradle

 ...PostCommit_Java_ValidatesRunner_Dataflow.groovy | 26 +++--
 runners/google-cloud-dataflow-java/build.gradle| 66 ++
 2 files changed, 75 insertions(+), 17 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3250] Migrate Spark ValidatesRunner tests to Gradle

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 77207c3deec8648cde741b6984c6fbfbbe063008
Merge: e720166 17e2657
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Apr 6 07:53:20 2018 -0400

[BEAM-3250] Migrate Spark ValidatesRunner tests to Gradle

 ...am_PostCommit_Java_ValidatesRunner_Spark.groovy | 26 +--
 build_rules.gradle |  4 +-
 runners/spark/build.gradle | 83 +++---
 3 files changed, 97 insertions(+), 16 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (e720166 -> 77207c3)

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from e720166  [BEAM-3250] Migrate Dataflow ValidatesRunner test to Gradle
 add 17e2657  [BEAM-3250] Migrate Spark ValidatesRunner tests to Gradle
 new 77207c3  [BEAM-3250] Migrate Spark ValidatesRunner tests to Gradle

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 ...am_PostCommit_Java_ValidatesRunner_Spark.groovy | 26 +--
 build_rules.gradle |  4 +-
 runners/spark/build.gradle | 83 +++---
 3 files changed, 97 insertions(+), 16 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (fb6ba3b -> cf1ff44)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from fb6ba3b  [BEAM-3255] Updates to support the release process via Gradle
 add 5df4dc1  [BEAM-4014] Replace the Java maven based PostCommit with a 
Gradle based version.
 new cf1ff44  [BEAM-4014] Replace the Java maven based PostCommit with a 
Gradle based version.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 ...=> job_beam_PostCommit_Java_GradleBuild.groovy} | 26 +
 .../job_beam_PostCommit_Java_MavenInstall.groovy   | 65 --
 .../job_beam_PreCommit_Java_GradleBuild.groovy |  2 +-
 build.gradle   |  7 ++-
 runners/google-cloud-dataflow-java/build.gradle| 52 -
 sdks/java/io/google-cloud-platform/build.gradle| 36 +---
 6 files changed, 103 insertions(+), 85 deletions(-)
 copy 
.test-infra/jenkins/{job_beam_PostCommit_Java_ValidatesRunner_Spark.groovy => 
job_beam_PostCommit_Java_GradleBuild.groovy} (74%)
 delete mode 100644 
.test-infra/jenkins/job_beam_PostCommit_Java_MavenInstall.groovy

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-4014] Replace the Java maven based PostCommit with a Gradle based version.

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit cf1ff444dd5b569557f924c3af34a769095faee7
Merge: fb6ba3b 5df4dc1
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 12:34:44 2018 -0400

[BEAM-4014] Replace the Java maven based PostCommit with a Gradle based 
version.

 ...=> job_beam_PostCommit_Java_GradleBuild.groovy} | 58 --
 .../job_beam_PreCommit_Java_GradleBuild.groovy |  2 +-
 build.gradle   |  7 ++-
 runners/google-cloud-dataflow-java/build.gradle| 52 ++-
 sdks/java/io/google-cloud-platform/build.gradle| 36 +++---
 5 files changed, 118 insertions(+), 37 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3255] Updates to support the release process via Gradle

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit fb6ba3bfd43605a0f4944828b5f19e75840fa7aa
Merge: c2d6744 bf93d94
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 12:17:05 2018 -0400

[BEAM-3255] Updates to support the release process via Gradle

 ...job_beam_PostCommit_Java_JDKVersionsTest.groovy |  60 
 ...eam_PostCommit_Java_ValidatesRunner_Apex.groovy |   2 +-
 ...PostCommit_Java_ValidatesRunner_Dataflow.groovy |   2 +-
 ...am_PostCommit_Java_ValidatesRunner_Flink.groovy |   2 +-
 ...PostCommit_Java_ValidatesRunner_Gearpump.groovy |   2 +-
 ...am_PostCommit_Java_ValidatesRunner_Spark.groovy |   2 +-
 .../job_beam_PreCommit_Python_GradleBuild.groovy   |   2 +-
 build.gradle   |  14 +-
 build_rules.gradle | 320 +
 examples/java/build.gradle |  35 +--
 gradle.properties  |   3 +
 model/fn-execution/build.gradle|   5 +-
 model/job-management/build.gradle  |   5 +-
 model/pipeline/build.gradle|   3 +-
 release/build.gradle   |  10 +-
 runners/apex/build.gradle  |  26 +-
 runners/core-construction-java/build.gradle|  11 +-
 runners/core-java/build.gradle |  13 +-
 runners/direct-java/build.gradle   |  54 ++--
 runners/flink/build.gradle |  26 +-
 runners/gcp/gcemd/build.gradle |   6 +-
 runners/gcp/gcsproxy/build.gradle  |   6 +-
 runners/gearpump/build.gradle  |  16 +-
 runners/google-cloud-dataflow-java/build.gradle|  33 ++-
 runners/java-fn-execution/build.gradle |  18 +-
 runners/local-artifact-service-java/build.gradle   |  14 +-
 runners/local-java/build.gradle|   4 +-
 runners/reference/java/build.gradle|   9 +-
 runners/reference/job-server/build.gradle  |  12 +-
 runners/spark/build.gradle |  30 +-
 sdks/go/container/build.gradle |   6 +-
 sdks/go/examples/build.gradle  |   6 +-
 sdks/java/build-tools/build.gradle |   2 +-
 sdks/java/container/build.gradle   |   8 +-
 sdks/java/core/build.gradle|   9 +-
 .../google-cloud-platform-core/build.gradle|   8 +-
 sdks/java/extensions/jackson/build.gradle  |   7 +-
 sdks/java/extensions/join-library/build.gradle |   6 +-
 sdks/java/extensions/protobuf/build.gradle |   7 +-
 sdks/java/extensions/sketching/build.gradle|   8 +-
 sdks/java/extensions/sorter/build.gradle   |   6 +-
 sdks/java/extensions/sql/build.gradle  |  11 +-
 sdks/java/fn-execution/build.gradle|  11 +-
 sdks/java/harness/build.gradle |  19 +-
 sdks/java/io/amazon-web-services/build.gradle  |   5 +-
 sdks/java/io/amqp/build.gradle |   7 +-
 sdks/java/io/cassandra/build.gradle|  11 +-
 sdks/java/io/common/build.gradle   |   5 +-
 .../elasticsearch-tests-2/build.gradle |  17 +-
 .../elasticsearch-tests-5/build.gradle |  17 +-
 .../elasticsearch-tests-common/build.gradle|  13 +-
 sdks/java/io/elasticsearch/build.gradle|   7 +-
 sdks/java/io/file-based-io-tests/build.gradle  |  15 +-
 sdks/java/io/google-cloud-platform/build.gradle|  17 +-
 sdks/java/io/hadoop-common/build.gradle|   5 +-
 sdks/java/io/hadoop-file-system/build.gradle   |   9 +-
 sdks/java/io/hadoop-input-format/build.gradle  |  19 +-
 sdks/java/io/hbase/build.gradle|  11 +-
 sdks/java/io/hcatalog/build.gradle |   9 +-
 sdks/java/io/jdbc/build.gradle |  15 +-
 sdks/java/io/jms/build.gradle  |   8 +-
 sdks/java/io/kafka/build.gradle|   9 +-
 sdks/java/io/kinesis/build.gradle  |   7 +-
 sdks/java/io/mongodb/build.gradle  |  13 +-
 sdks/java/io/mqtt/build.gradle |   7 +-
 sdks/java/io/redis/build.gradle|   7 +-
 sdks/java/io/solr/build.gradle |   9 +-
 sdks/java/io/tika/build.gradle |   9 +-
 sdks/java/io/xml/build.gradle  |   9 +-
 sdks/java/maven-archetypes/examples/build.gradle   |  14 +-
 sdks/java/maven-archetypes/starter/build.gradle|   8 +-
 sdks/java/nexmark/build.gradle |  12 +-
 sdks/python/container/build.gradle |   6 +-
 settings.gradle| 195 -
 74 files changed, 809 insertions(+), 545 del

[beam] branch master updated (c2d6744 -> fb6ba3b)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from c2d6744  Merge pull request #4964: [BEAM-3437] Introduce Schema class, 
and use it in BeamSQL
 add 15e4978  Attempt to produce release artifacts.
 add 44fc04b  Sign the published artifacts.
 add f905ace  Rename a few of the projects so that the artifact names are 
correctly setup when generating the maven pom.xml
 add 6637321  Add Apache header into generated POM
 add 5ad1271  Rewrite even more names.
 add bd04396  fixup! fix a few names
 add be21601  Finish renaming the projects so that they produce valid maven 
artifact names.
 add 741508c  Merge branch 'gradle' into gradle
 add 5669cad  Add Apache header into generated POM
 add 2bc9321  Gate signing/publishing configuration on 'release', 
'publishing' project properties.
 add e93edea  Use correct project description in generated pom
 add 6847038  Add license to generated poms
 add 5f94c3d  Add scm information to generated pom
 add bfacd24  Add JIRA information to generated pom
 add 04e3e1b  Add mailing list information to generated pom
 add 950ae5a  Add developer info to generated pom files
 add 6f9e602  Add top-level metadata to generate poms
 add 6415891  Add metadata to generated pom files
 add 1100e64  Add exclusion rules that are defined on the configuration and 
the dependency to the generated pom dependencies.
 add fb31224  Only apply maven-publish / signing plugins if actually needed.
 add 88d8a50  Fix relocated paths after renaming modules.
 add c46df91  Fix Apache license header in generated POM.
 add 5452136  fixup: tabs -> spaces
 add 84da336  Fix Apache license header in generated POM.
 add 4935485  only sign when releasing, to avoid gpg erors
 add ba3bcb9  update based on comments
 add 8bb7d62  only sign when releasing, to avoid gpg errors
 add ef06f0f  Publish shaded jars when signing
 add 8c36ecd  Mirate back to using compile as the dependency type since our 
archetypes don't declare what they use.
 add 196d726  Also publish the beam-sdks-java-harness package.
 add 4024a8f  Move signing configuration under same block that controls 
whether publishing occurs.
 add 1a846eb  Merge remote-tracking branch 'upstream/master' into gradle
 add 441d25b  Merge pull request #8 from swegner/merge-master
 add 8ec2bf0  Add proper descriptions to generated pom files.
 add 17a3c7f  Add proper descriptions to generated pom files.
 add 2e56a09  Minor description clean-ups.
 add 6052e15  Merge remote-tracking branch 'upstream/master' into 
merge-master
 add 5301662  Merge pull request #10 from swegner/merge-master
 add ee69b4c  fixup: Update project name to new convention
 add c73672d  Address some comments on PR/5048 (#19)
 add bf93d94  Move generated pom configuration into build_rules.gradle.
 new fb6ba3b  [BEAM-3255] Updates to support the release process via Gradle

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 ...job_beam_PostCommit_Java_JDKVersionsTest.groovy |  60 
 ...eam_PostCommit_Java_ValidatesRunner_Apex.groovy |   2 +-
 ...PostCommit_Java_ValidatesRunner_Dataflow.groovy |   2 +-
 ...am_PostCommit_Java_ValidatesRunner_Flink.groovy |   2 +-
 ...PostCommit_Java_ValidatesRunner_Gearpump.groovy |   2 +-
 ...am_PostCommit_Java_ValidatesRunner_Spark.groovy |   2 +-
 .../job_beam_PreCommit_Python_GradleBuild.groovy   |   2 +-
 build.gradle   |  14 +-
 build_rules.gradle | 320 +
 examples/java/build.gradle |  35 +--
 gradle.properties  |   3 +
 model/fn-execution/build.gradle|   5 +-
 model/job-management/build.gradle  |   5 +-
 model/pipeline/build.gradle|   3 +-
 release/build.gradle   |  10 +-
 runners/apex/build.gradle  |  26 +-
 runners/core-construction-java/build.gradle|  11 +-
 runners/core-java/build.gradle |  13 +-
 runners/direct-java/build.gradle   |  54 ++--
 runners/flink/build.gradle |  26 +-
 runners/gcp/gcemd/build.gradle |   6 +-
 runners/gcp/gcsproxy/build.gradle  |   6 +-
 runners/gearpump/build.gradle  |  16 +-
 runners/google-cloud-dataflow-java/build.gradle|  33 ++-
 runners/java-fn-execution/build.gradle |  18 +-
 runners/local-artifact-service-java/build.gradle   |  14

[beam] 01/01: Disable Gradle agent for Jenkins build jobs.

2018-04-10 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit c39d2a283bb4e492c0b1e37e6f3d3f5e8838f1bb
Merge: 200eec6 dfdc6c0
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Apr 10 18:28:20 2018 -0400

Disable Gradle agent for Jenkins build jobs.

 .test-infra/jenkins/common_job_properties.groovy | 18 ++
 .../job_beam_PostCommit_Java_GradleBuild.groovy  | 17 +++--
 ..._beam_PostCommit_Java_ValidatesRunner_Apex.groovy | 13 +
 ...m_PostCommit_Java_ValidatesRunner_Dataflow.groovy | 13 +
 ...beam_PostCommit_Java_ValidatesRunner_Flink.groovy | 13 +
 ...m_PostCommit_Java_ValidatesRunner_Gearpump.groovy | 13 +
 ...beam_PostCommit_Java_ValidatesRunner_Spark.groovy | 13 +
 .../job_beam_PostRelease_NightlySnapshot.groovy  |  1 +
 .../jenkins/job_beam_PreCommit_Go_GradleBuild.groovy | 15 ++-
 .../job_beam_PreCommit_Java_GradleBuild.groovy   | 20 
 .../job_beam_PreCommit_Python_GradleBuild.groovy | 15 ++-
 .../job_beam_Release_Gradle_NightlySnapshot.groovy   | 17 +++--
 12 files changed, 42 insertions(+), 126 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (200eec6 -> c39d2a2)

2018-04-10 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 200eec6  Merge pull request #5067: Make EmptyInputProvider Javadoc 
more accurate
 add 55cafb9  Disable Gradle agent for Jenkins build jobs.
 add 56ba4f1  fixup! Add common Gradle switches to remaining jobs
 add a5ebf91  fixup! Execute switches on the passed-in context object
 add dfdc6c0  fixup! Fix stale variable in java precommits
 new c39d2a2  Disable Gradle agent for Jenkins build jobs.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .test-infra/jenkins/common_job_properties.groovy | 18 ++
 .../job_beam_PostCommit_Java_GradleBuild.groovy  | 17 +++--
 ..._beam_PostCommit_Java_ValidatesRunner_Apex.groovy | 13 +
 ...m_PostCommit_Java_ValidatesRunner_Dataflow.groovy | 13 +
 ...beam_PostCommit_Java_ValidatesRunner_Flink.groovy | 13 +
 ...m_PostCommit_Java_ValidatesRunner_Gearpump.groovy | 13 +
 ...beam_PostCommit_Java_ValidatesRunner_Spark.groovy | 13 +
 .../job_beam_PostRelease_NightlySnapshot.groovy  |  1 +
 .../jenkins/job_beam_PreCommit_Go_GradleBuild.groovy | 15 ++-
 .../job_beam_PreCommit_Java_GradleBuild.groovy   | 20 
 .../job_beam_PreCommit_Python_GradleBuild.groovy | 15 ++-
 .../job_beam_Release_Gradle_NightlySnapshot.groovy   | 17 +++--
 12 files changed, 42 insertions(+), 126 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (658915a -> df55ba8)

2018-04-04 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 658915a  Merge pull request #4893 from iemejia/BEAM-3875-spark-2.3
 add b97ccd1  [BEAM-3993] read gitignore and add it in rat exclusions
 add 57c200e  [BEAM-3993] Remove duplicate definitions between .gitignore 
and build.gradle
 add 57b15ca  Merge pull request #1 from lukecwik/pr5002
 new df55ba8  [BEAM-3993] read gitignore and add it in rat exclusions

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .gitignore   |  5 +++-
 build.gradle | 87 +---
 2 files changed, 22 insertions(+), 70 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3993] read gitignore and add it in rat exclusions

2018-04-04 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit df55ba8cb7031b67533a09cf5de18782638a4df7
Merge: 658915a 57b15ca
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Apr 4 08:19:21 2018 -0700

[BEAM-3993] read gitignore and add it in rat exclusions

 .gitignore   |  5 +++-
 build.gradle | 87 +---
 2 files changed, 22 insertions(+), 70 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated: BEAM-3256 Add archetype testing/generation to existing GradleBuild PreCommit

2018-04-04 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new b8e0724  BEAM-3256 Add archetype testing/generation to existing 
GradleBuild PreCommit
b8e0724 is described below

commit b8e0724650cec19023b5493d1c007e497652c08c
Author: yifanzou <yifan...@yifanzou-macbookpro.roam.corp.google.com>
AuthorDate: Tue Apr 3 16:49:33 2018 -0700

BEAM-3256 Add archetype testing/generation to existing GradleBuild PreCommit
---
 .../jenkins/job_beam_PreCommit_Java_GradleBuild.groovy|  2 ++
 build.gradle  |  2 ++
 sdks/java/maven-archetypes/examples/build.gradle  | 11 +++
 sdks/java/maven-archetypes/starter/build.gradle   | 11 +++
 4 files changed, 26 insertions(+)

diff --git a/.test-infra/jenkins/job_beam_PreCommit_Java_GradleBuild.groovy 
b/.test-infra/jenkins/job_beam_PreCommit_Java_GradleBuild.groovy
index df41635..c5edbf1 100644
--- a/.test-infra/jenkins/job_beam_PreCommit_Java_GradleBuild.groovy
+++ b/.test-infra/jenkins/job_beam_PreCommit_Java_GradleBuild.groovy
@@ -44,6 +44,8 @@ job('beam_PreCommit_Java_GradleBuild') {
 '--continue',
 // Until we verify the build cache is working appropriately, force 
rerunning all tasks
 '--rerun-tasks',
+// Specify maven home on Jenkins
+'-Pmaven_home=/home/jenkins/tools/maven/apache-maven-3.5.2'
   ]
 
   def gradle_command_line = './gradlew ' + gradle_switches.join(' ') + ' 
:javaPreCommit'
diff --git a/build.gradle b/build.gradle
index e924202..602f8e1 100644
--- a/build.gradle
+++ b/build.gradle
@@ -117,6 +117,8 @@ task javaPreCommit() {
   dependsOn ":rat"
   dependsOn ":sdks:java:core:buildNeeded"
   dependsOn ":sdks:java:core:buildDependents"
+  dependsOn 
":sdks:java:maven-archetypes:examples:generateAndBuildArchetypeTest"
+  dependsOn ":sdks:java:maven-archetypes:starter:generateAndBuildArchetypeTest"
   dependsOn ":examples:java:preCommit"
 }
 
diff --git a/sdks/java/maven-archetypes/examples/build.gradle 
b/sdks/java/maven-archetypes/examples/build.gradle
index c701303..a786939 100644
--- a/sdks/java/maven-archetypes/examples/build.gradle
+++ b/sdks/java/maven-archetypes/examples/build.gradle
@@ -55,6 +55,17 @@ task generateSources(type: Exec) {
   commandLine './generate-sources.sh'
 }
 
+// Add archetype testing/generation to existing GradleBuild PreCommit
+// https://issues.apache.org/jira/browse/BEAM-3256
+task generateAndBuildArchetypeTest(type: Exec) {
+  if (project.hasProperty("maven_home")) {
+commandLine "${maven_home}/bin/mvn", 'clean', 'install'
+environment "MAVEN_HOME", "${maven_home}"
+  } else {
+commandLine 'mvn', 'clean', 'install'
+  }
+}
+
 sourceSets {
  main {
   output.dir('src', builtBy: 'generateSources')
diff --git a/sdks/java/maven-archetypes/starter/build.gradle 
b/sdks/java/maven-archetypes/starter/build.gradle
index a7a5bd5..3a4332a 100644
--- a/sdks/java/maven-archetypes/starter/build.gradle
+++ b/sdks/java/maven-archetypes/starter/build.gradle
@@ -21,6 +21,17 @@ applyJavaNature(artifactId: 
"beam-sdks-java-maven-archetypes-starter")
 
 description = "Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter"
 
+// Add archetype testing/generation to existing GradleBuild PreCommit
+// https://issues.apache.org/jira/browse/BEAM-3256
+task generateAndBuildArchetypeTest(type: Exec) {
+  if (project.hasProperty("maven_home")) {
+commandLine "${maven_home}/bin/mvn", 'clean', 'install'
+environment "MAVEN_HOME", "${maven_home}"
+  } else {
+commandLine 'mvn', 'clean', 'install'
+  }
+}
+
 dependencies {
   shadow project(path: ":runners:direct-java", configuration: "shadow")
   shadow project(path: ":sdks:java:core", configuration: "shadow")

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 02/03: Replace Maven based Flink ValidatesRunner postcommit with Gradle based one.

2018-04-04 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 4479148a209a2b8226ab43cfae9ce2f413f08064
Author: Luke Cwik <lc...@google.com>
AuthorDate: Wed Apr 4 08:40:55 2018 -0700

Replace Maven based Flink ValidatesRunner postcommit with Gradle based one.
---
 ...am_PostCommit_Java_ValidatesRunner_Flink.groovy | 25 +++---
 ...t_Java_ValidatesRunner_Flink_GradleBuild.groovy | 56 --
 2 files changed, 19 insertions(+), 62 deletions(-)

diff --git 
a/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink.groovy 
b/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink.groovy
index a0a957a..b9faeea6 100644
--- a/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink.groovy
+++ b/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink.groovy
@@ -19,15 +19,20 @@
 import common_job_properties
 
 // This job runs the suite of ValidatesRunner tests against the Flink runner.
-mavenJob('beam_PostCommit_Java_ValidatesRunner_Flink') {
+job('beam_PostCommit_Java_ValidatesRunner_Flink') {
   description('Runs the ValidatesRunner suite on the Flink runner.')
-  previousNames('beam_PostCommit_Java_RunnableOnService_Flink')
 
   // Set common parameters.
   common_job_properties.setTopLevelMainJobProperties(delegate)
 
-  // Set maven parameters.
-  common_job_properties.setMavenConfig(delegate)
+  def gradle_switches = [
+// Gradle log verbosity enough to diagnose basic build issues
+"--info",
+// Continue the build even if there is a failure to show as many potential 
failures as possible.
+'--continue',
+// Until we verify the build cache is working appropriately, force 
rerunning all tasks
+'--rerun-tasks',
+  ]
 
   // Sets that this is a PostCommit job.
   common_job_properties.setPostCommit(delegate)
@@ -38,6 +43,14 @@ mavenJob('beam_PostCommit_Java_ValidatesRunner_Flink') {
 'Apache Flink Runner ValidatesRunner Tests',
 'Run Flink ValidatesRunner')
 
-  // Maven goals for this job.
-  goals('-B -e clean verify -am -pl runners/flink 
-Plocal-validates-runner-tests')
+  // Gradle goals for this job.
+  steps {
+gradle {
+  rootBuildScriptDir(common_job_properties.checkoutDir)
+  tasks(':runners:flink:validatesRunner')
+  for (String gradle_switch : gradle_switches) {
+switches(gradle_switch)
+  }
+}
+  }
 }
diff --git 
a/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink_GradleBuild.groovy
 
b/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink_GradleBuild.groovy
deleted file mode 100644
index b9bd941..000
--- 
a/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink_GradleBuild.groovy
+++ /dev/null
@@ -1,56 +0,0 @@
-/*
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements.  See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership.  The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License.  You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-import common_job_properties
-
-// This job runs the suite of ValidatesRunner tests against the Flink runner.
-job('beam_PostCommit_Java_ValidatesRunner_Flink') {
-  description('Runs the ValidatesRunner suite on the Flink runner.')
-
-  // Set common parameters.
-  common_job_properties.setTopLevelMainJobProperties(delegate)
-
-  def gradle_switches = [
-// Gradle log verbosity enough to diagnose basic build issues
-"--info",
-// Continue the build even if there is a failure to show as many potential 
failures as possible.
-'--continue',
-// Until we verify the build cache is working appropriately, force 
rerunning all tasks
-'--rerun-tasks',
-  ]
-
-  // Sets that this is a PostCommit job.
-  common_job_properties.setPostCommit(delegate)
-
-  // Allows triggering this build against pull requests.
-  common_job_properties.enablePhraseTriggeringFromPullRequest(
-delegate,
-'Apache Flink Runner ValidatesRunner Gradle Tests',
-'Run Flink ValidatesRunner Gradle')
-
-  // Gradle goals for this job.
-  steps {
-gradle {
-  rootBuildScriptDir(common_job_properties.checkoutDir)
-  tasks(':runners:flink:validatesRunner')
-  for (String gradle_switch : gradle_switches) {
-switches(gradle_switch)

[beam] branch master updated (b8e0724 -> e3577ab)

2018-04-04 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from b8e0724  BEAM-3256 Add archetype testing/generation to existing 
GradleBuild PreCommit
 new 922b00c  [BEAM-3250] Creating a gradle Jenkins config for Flink 
PostCommit.
 new 4479148  Replace Maven based Flink ValidatesRunner postcommit with 
Gradle based one.
 new e3577ab  [BEAM-3250] Creating a Gradle Jenkins config for Flink 
PostCommit.

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 ...am_PostCommit_Java_ValidatesRunner_Flink.groovy | 25 --
 1 file changed, 19 insertions(+), 6 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 03/03: [BEAM-3250] Creating a Gradle Jenkins config for Flink PostCommit.

2018-04-04 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit e3577abc644710d929de870531a54c9a088be61f
Merge: b8e0724 4479148
Author: Luke Cwik <lc...@google.com>
AuthorDate: Wed Apr 4 09:02:30 2018 -0700

[BEAM-3250] Creating a Gradle Jenkins config for Flink PostCommit.

This closes #5012

 ...am_PostCommit_Java_ValidatesRunner_Flink.groovy | 25 --
 1 file changed, 19 insertions(+), 6 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/03: [BEAM-3250] Creating a gradle Jenkins config for Flink PostCommit.

2018-04-04 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 922b00c8343ba5e5475be17bd69d8c2d36631d3d
Author: Daniel Oliveira <daniel.o.program...@gmail.com>
AuthorDate: Tue Apr 3 16:20:42 2018 -0700

[BEAM-3250] Creating a gradle Jenkins config for Flink PostCommit.

Started with the Flink PostCommit first because a gradle config for it
was already written. This is my attempt at creating a simple gradle
config before moving onto the more complex PostCommits.
---
 ...t_Java_ValidatesRunner_Flink_GradleBuild.groovy | 56 ++
 1 file changed, 56 insertions(+)

diff --git 
a/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink_GradleBuild.groovy
 
b/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink_GradleBuild.groovy
new file mode 100644
index 000..b9bd941
--- /dev/null
+++ 
b/.test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Flink_GradleBuild.groovy
@@ -0,0 +1,56 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+import common_job_properties
+
+// This job runs the suite of ValidatesRunner tests against the Flink runner.
+job('beam_PostCommit_Java_ValidatesRunner_Flink') {
+  description('Runs the ValidatesRunner suite on the Flink runner.')
+
+  // Set common parameters.
+  common_job_properties.setTopLevelMainJobProperties(delegate)
+
+  def gradle_switches = [
+// Gradle log verbosity enough to diagnose basic build issues
+"--info",
+// Continue the build even if there is a failure to show as many potential 
failures as possible.
+'--continue',
+// Until we verify the build cache is working appropriately, force 
rerunning all tasks
+'--rerun-tasks',
+  ]
+
+  // Sets that this is a PostCommit job.
+  common_job_properties.setPostCommit(delegate)
+
+  // Allows triggering this build against pull requests.
+  common_job_properties.enablePhraseTriggeringFromPullRequest(
+delegate,
+'Apache Flink Runner ValidatesRunner Gradle Tests',
+'Run Flink ValidatesRunner Gradle')
+
+  // Gradle goals for this job.
+  steps {
+gradle {
+  rootBuildScriptDir(common_job_properties.checkoutDir)
+  tasks(':runners:flink:validatesRunner')
+  for (String gradle_switch : gradle_switches) {
+switches(gradle_switch)
+  }
+}
+  }
+}

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (5c5c54e -> 262932d)

2018-04-11 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 5c5c54e  Merge pull request #4956 from timrobertson100/BEAM-3201
 add 8242f5c  [BEAM-4035] Fix spark validatesrunner
 add 2d27220  Change ver of zookeeper instead of removing mavenLocal
 new 262932d  [BEAM-4035] Fix spark validatesrunner

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/spark/build.gradle | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-4035] Fix spark validatesrunner

2018-04-11 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 262932d6261e777c64267cab13878ffc43c432f3
Merge: 5c5c54e 2d27220
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Apr 11 09:08:07 2018 -0400

[BEAM-4035] Fix spark validatesrunner

 runners/spark/build.gradle | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (c78b96a -> 6dafb81)

2018-04-11 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from c78b96a  Merge pull request #3961: [BEAM-2871] Add advanced examples 
of running external libraries on workers
 add b7be877  [BEAM-3249, BEAM-4014] Automatically propagate shading 
configuration to test-jar
 new 6dafb81  [BEAM-3249, BEAM-4014] Automatically propagate shading 
configuration to test-jar

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build_rules.gradle  | 101 +---
 examples/java/build.gradle  |  25 +-
 runners/core-construction-java/build.gradle |  22 --
 runners/core-java/build.gradle  |  22 --
 runners/direct-java/build.gradle|  62 ---
 runners/spark/build.gradle  |   1 -
 sdks/java/core/build.gradle |  55 +++--
 sdks/java/io/google-cloud-platform/build.gradle |  34 +++-
 8 files changed, 111 insertions(+), 211 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3249, BEAM-4014] Automatically propagate shading configuration to test-jar

2018-04-11 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 6dafb81662f3a84b0c933c63dea1965ed8c9e694
Merge: c78b96a b7be877
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Apr 11 12:09:45 2018 -0400

[BEAM-3249, BEAM-4014] Automatically propagate shading configuration to 
test-jar

 build_rules.gradle  | 101 +---
 examples/java/build.gradle  |  25 +-
 runners/core-construction-java/build.gradle |  22 --
 runners/core-java/build.gradle  |  22 --
 runners/direct-java/build.gradle|  62 ---
 runners/spark/build.gradle  |   1 -
 sdks/java/core/build.gradle |  55 +++--
 sdks/java/io/google-cloud-platform/build.gradle |  34 +++-
 8 files changed, 111 insertions(+), 211 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (6dafb81 -> 73e826c)

2018-04-11 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 6dafb81  [BEAM-3249, BEAM-4014] Automatically propagate shading 
configuration to test-jar
 add 27e488a  [BEAM-3249] Add support for translating 'provided' scope 
dependencies to the generated pom.
 new 73e826c  [BEAM-3249] Add support for translating 'provided' scope 
dependencies to the generated pom.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build_rules.gradle | 55 --
 1 file changed, 29 insertions(+), 26 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3249] Add support for translating 'provided' scope dependencies to the generated pom.

2018-04-11 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 73e826ca737b9ef981884b1867e6cbf0b4d72c78
Merge: 6dafb81 27e488a
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Apr 11 13:19:22 2018 -0400

[BEAM-3249] Add support for translating 'provided' scope dependencies to 
the generated pom.

 build_rules.gradle | 55 --
 1 file changed, 29 insertions(+), 26 deletions(-)


-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-4014] Fix project evaluation order for postcommit.

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 4847a7698ad003642cae75f2c0410c8c90012d42
Merge: 1feddb3 c9ba121
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 15:41:21 2018 -0400

[BEAM-4014] Fix project evaluation order for postcommit.

 runners/google-cloud-dataflow-java/build.gradle | 1 +
 1 file changed, 1 insertion(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3249] Minor spark runner test execution improvements.

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 1feddb3d2fa46bc18462ff01aa0afc3eaf5c759e
Merge: c22e1b4 47ffc142
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 15:36:18 2018 -0400

[BEAM-3249] Minor spark runner test execution improvements.

 runners/spark/build.gradle | 7 +++
 1 file changed, 7 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (a79d1b4 -> d457df7)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from a79d1b4  [BEAM-3255] Move from maven to gradle with nightly builds
 add 1a7b9d6  [BEAM-4014] Remove previous names because this renames the 
existing job which is a different type of job.
 new d457df7  [BEAM-4014] Remove previous names because this renames the 
existing job which is a different type of job.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .test-infra/jenkins/job_beam_PostCommit_Java_GradleBuild.groovy | 2 --
 1 file changed, 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-4014] Remove previous names because this renames the existing job which is a different type of job.

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit d457df7cdb03987a7d4a0c8fa93d6fea4545c5b6
Merge: a79d1b4 1a7b9d6
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 13:58:28 2018 -0400

[BEAM-4014] Remove previous names because this renames the existing job 
which is a different type of job.

 .test-infra/jenkins/job_beam_PostCommit_Java_GradleBuild.groovy | 2 --
 1 file changed, 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (1feddb3 -> 4847a76)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 1feddb3  [BEAM-3249] Minor spark runner test execution improvements.
 add c9ba121  [BEAM-4014] Fix project evaluation order.
 new 4847a76  [BEAM-4014] Fix project evaluation order for postcommit.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/google-cloud-dataflow-java/build.gradle | 1 +
 1 file changed, 1 insertion(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (d457df7 -> c22e1b4)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from d457df7  [BEAM-4014] Remove previous names because this renames the 
existing job which is a different type of job.
 add cca7a20  [BEAM-3706] Removing SideInputs and Parameters from 
CombinePayload.
 add cca63ee  [BEAM-3706] Removing side inputs from Combine translation 
logic.
 add 079b1a4  [BEAM-3706] Attempting to fix a findbug issue.
 add e025bff  [BEAM-3706] Cleaning up side input code in Flink runner.
 add 945c3ef  [BEAM-3706] Fixing issue in direct runner with side input 
combines.
 new c22e1b4  [BEAM-3706] Removing side inputs from CombinePayload proto.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../pipeline/src/main/proto/beam_runner_api.proto  |   9 --
 .../core/construction/CombineTranslation.java  | 132 +++--
 .../core/construction/PTransformTranslation.java   |   8 +-
 .../core/construction/CombineTranslationTest.java  |  46 ++-
 .../beam/runners/direct/MultiStepCombine.java  |  15 ++-
 .../flink/FlinkBatchTransformTranslators.java  |  30 +
 .../flink/FlinkStreamingTransformTranslators.java  | 127 
 .../functions/FlinkPartialReduceFunction.java  |   1 +
 .../translation/functions/FlinkReduceFunction.java |   1 +
 9 files changed, 131 insertions(+), 238 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3706] Removing side inputs from CombinePayload proto.

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit c22e1b4fcea61e374aa00cc780e71c7af50978f6
Merge: d457df7 945c3ef
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 14:37:23 2018 -0400

[BEAM-3706] Removing side inputs from CombinePayload proto.

 .../pipeline/src/main/proto/beam_runner_api.proto  |   9 --
 .../core/construction/CombineTranslation.java  | 132 +++--
 .../core/construction/PTransformTranslation.java   |   8 +-
 .../core/construction/CombineTranslationTest.java  |  46 ++-
 .../beam/runners/direct/MultiStepCombine.java  |  15 ++-
 .../flink/FlinkBatchTransformTranslators.java  |  30 +
 .../flink/FlinkStreamingTransformTranslators.java  | 127 
 .../functions/FlinkPartialReduceFunction.java  |   1 +
 .../translation/functions/FlinkReduceFunction.java |   1 +
 9 files changed, 131 insertions(+), 238 deletions(-)


-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (4847a76 -> 2df950b)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 4847a76  [BEAM-4014] Fix project evaluation order for postcommit.
 add 4d47700  Fix bad Gradle Go examples directory
 new 2df950b  Fix bad Gradle Go examples directory

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/CONTAINERS.md | 6 +++---
 settings.gradle| 2 +-
 2 files changed, 4 insertions(+), 4 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Fix bad Gradle Go examples directory

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 2df950b6c5ec446452fd395f1446ebbac0295b38
Merge: 4847a76 4d47700
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 15:57:03 2018 -0400

Fix bad Gradle Go examples directory

 sdks/CONTAINERS.md | 6 +++---
 settings.gradle| 2 +-
 2 files changed, 4 insertions(+), 4 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Removing some null guards that are not needed

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 93dac3b599cf68278b901a13fbd5316598bc9781
Merge: 2df950b 1c3585c
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 16:57:25 2018 -0400

Removing some null guards that are not needed

 .../examples/complete/game/injector/Injector.java  |  6 ++---
 .../beam/runners/core/MergingActiveWindowSet.java  |  2 +-
 .../wrappers/streaming/DoFnOperator.java   | 30 ++
 .../beam/sdk/io/gcp/spanner/OrderedCode.java   | 14 +-
 4 files changed, 23 insertions(+), 29 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (2df950b -> 93dac3b)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 2df950b  Fix bad Gradle Go examples directory
 add 1c3585c  Removing some null guards that are not needed
 new 93dac3b  Removing some null guards that are not needed

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../examples/complete/game/injector/Injector.java  |  6 ++---
 .../beam/runners/core/MergingActiveWindowSet.java  |  2 +-
 .../wrappers/streaming/DoFnOperator.java   | 30 ++
 .../beam/sdk/io/gcp/spanner/OrderedCode.java   | 14 +-
 4 files changed, 23 insertions(+), 29 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-4014] Fix class path for examplesJavaIntegrationTest, also fix conversion error from DateTime that independently broke PostCommit.

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 806f359f7505291aa9336498d4b8e79e703e0d7f
Merge: 93dac3b 3104b02
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 9 17:33:32 2018 -0400

[BEAM-4014] Fix class path for examplesJavaIntegrationTest, also fix 
conversion error from DateTime that independently broke PostCommit.

 runners/google-cloud-dataflow-java/build.gradle   | 2 +-
 .../java/org/apache/beam/sdk/io/gcp/bigtable/BigtableWriteIT.java | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (93dac3b -> 806f359)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 93dac3b  Removing some null guards that are not needed
 add 3104b02  [BEAM-4014] Fix class path for examplesJavaIntegrationTest, 
also fix conversion error from DateTime that independently broke PostCommit.
 new 806f359  [BEAM-4014] Fix class path for examplesJavaIntegrationTest, 
also fix conversion error from DateTime that independently broke PostCommit.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/google-cloud-dataflow-java/build.gradle   | 2 +-
 .../java/org/apache/beam/sdk/io/gcp/bigtable/BigtableWriteIT.java | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (c22e1b4 -> 1feddb3)

2018-04-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from c22e1b4  [BEAM-3706] Removing side inputs from CombinePayload proto.
 add c397eb0  Get Spark validates runner streaming integration tests to use 
the validates runner classpath.
 add 47ffc142 Speed up Spark post commit test run speed by running 4 tests 
concurrently.
 new 1feddb3  [BEAM-3249] Minor spark runner test execution improvements.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/spark/build.gradle | 7 +++
 1 file changed, 7 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Put String literals first when comparing using String.equals

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit e58c693f76baf829160b8fd5b7a08be08a620c36
Merge: 77207c3 e004f2e
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Apr 6 11:26:23 2018 -0400

Put String literals first when comparing using String.equals

 .../src/main/java/org/apache/beam/examples/complete/TfIdf.java |  8 
 .../java/org/apache/beam/examples/cookbook/TriggerExample.java |  2 +-
 .../java/org/apache/beam/runners/apex/ApexYarnLauncher.java|  2 +-
 .../runners/apex/translation/SideInputTranslationTest.java |  2 +-
 .../beam/runners/flink/FlinkPipelineExecutionEnvironment.java  | 10 +-
 .../apache/beam/runners/flink/streaming/DoFnOperatorTest.java  |  4 ++--
 .../java/org/apache/beam/runners/dataflow/DataflowMetrics.java |  2 +-
 .../java/org/apache/beam/runners/dataflow/DataflowRunner.java  |  2 +-
 .../org/apache/beam/runners/dataflow/TestDataflowRunner.java   |  3 +--
 .../beam/runners/dataflow/DataflowPipelineTranslatorTest.java  |  2 +-
 .../beam/runners/fnexecution/control/SdkHarnessClientTest.java |  4 ++--
 .../apache/beam/runners/spark/SparkNativePipelineVisitor.java  |  2 +-
 .../core/src/main/java/org/apache/beam/sdk/util/ClassPath.java |  6 +++---
 .../core/src/main/java/org/apache/beam/sdk/util/ZipFiles.java  |  2 +-
 .../src/main/java/org/apache/beam/sdk/values/TupleTag.java |  2 +-
 .../test/java/org/apache/beam/sdk/transforms/DistinctTest.java |  2 +-
 .../test/java/org/apache/beam/sdk/transforms/ParDoTest.java|  4 ++--
 .../beam/sdk/transforms/reflect/DoFnSignaturesTestUtils.java   |  2 +-
 .../beam/sdk/extensions/gcp/storage/GcsPathValidator.java  |  2 +-
 .../org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java |  4 ++--
 .../org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java |  6 +++---
 .../apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java  |  2 +-
 .../java/org/apache/beam/sdk/io/gcp/pubsub/PubsubClient.java   |  4 ++--
 .../org/apache/beam/sdk/io/gcp/spanner/ReadSpannerSchema.java  |  2 +-
 .../org/apache/beam/sdk/io/gcp/bigquery/FakeJobService.java|  8 
 .../jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/JdbcIO.java |  2 +-
 .../src/test/java/org/apache/beam/sdk/io/jdbc/JdbcIOTest.java  |  2 +-
 .../src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java|  2 +-
 .../org/apache/beam/sdk/io/kinesis/ShardReadersPoolTest.java   |  2 +-
 29 files changed, 48 insertions(+), 49 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (77207c3 -> e58c693)

2018-04-06 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 77207c3  [BEAM-3250] Migrate Spark ValidatesRunner tests to Gradle
 add e004f2e  Put String literals first when comparing using String.equals
 new e58c693  Put String literals first when comparing using String.equals

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../src/main/java/org/apache/beam/examples/complete/TfIdf.java |  8 
 .../java/org/apache/beam/examples/cookbook/TriggerExample.java |  2 +-
 .../java/org/apache/beam/runners/apex/ApexYarnLauncher.java|  2 +-
 .../runners/apex/translation/SideInputTranslationTest.java |  2 +-
 .../beam/runners/flink/FlinkPipelineExecutionEnvironment.java  | 10 +-
 .../apache/beam/runners/flink/streaming/DoFnOperatorTest.java  |  4 ++--
 .../java/org/apache/beam/runners/dataflow/DataflowMetrics.java |  2 +-
 .../java/org/apache/beam/runners/dataflow/DataflowRunner.java  |  2 +-
 .../org/apache/beam/runners/dataflow/TestDataflowRunner.java   |  3 +--
 .../beam/runners/dataflow/DataflowPipelineTranslatorTest.java  |  2 +-
 .../beam/runners/fnexecution/control/SdkHarnessClientTest.java |  4 ++--
 .../apache/beam/runners/spark/SparkNativePipelineVisitor.java  |  2 +-
 .../core/src/main/java/org/apache/beam/sdk/util/ClassPath.java |  6 +++---
 .../core/src/main/java/org/apache/beam/sdk/util/ZipFiles.java  |  2 +-
 .../src/main/java/org/apache/beam/sdk/values/TupleTag.java |  2 +-
 .../test/java/org/apache/beam/sdk/transforms/DistinctTest.java |  2 +-
 .../test/java/org/apache/beam/sdk/transforms/ParDoTest.java|  4 ++--
 .../beam/sdk/transforms/reflect/DoFnSignaturesTestUtils.java   |  2 +-
 .../beam/sdk/extensions/gcp/storage/GcsPathValidator.java  |  2 +-
 .../org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java |  4 ++--
 .../org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java |  6 +++---
 .../apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java  |  2 +-
 .../java/org/apache/beam/sdk/io/gcp/pubsub/PubsubClient.java   |  4 ++--
 .../org/apache/beam/sdk/io/gcp/spanner/ReadSpannerSchema.java  |  2 +-
 .../org/apache/beam/sdk/io/gcp/bigquery/FakeJobService.java|  8 
 .../jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/JdbcIO.java |  2 +-
 .../src/test/java/org/apache/beam/sdk/io/jdbc/JdbcIOTest.java  |  2 +-
 .../src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java|  2 +-
 .../org/apache/beam/sdk/io/kinesis/ShardReadersPoolTest.java   |  2 +-
 29 files changed, 48 insertions(+), 49 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (f821de8 -> f75d0f4)

2018-04-10 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from f821de8  Merge pull request #5083 from pabloem/no-data-race
 add d582ce3  Decrease flink ValidatesRunner maxParallelForks from 4 to 2 
in order to avoid OOM errors
 new f75d0f4  Decrease parallelism of Flink ValidatesRunner tests to reduce 
flakiness

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/flink/build.gradle | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Decrease parallelism of Flink ValidatesRunner tests to reduce flakiness

2018-04-10 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit f75d0f43f2e4f75b0439643f6742dda30c0b52dc
Merge: f821de8 d582ce3
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Apr 10 21:35:55 2018 -0400

Decrease parallelism of Flink ValidatesRunner tests to reduce flakiness

 runners/flink/build.gradle | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3913] Allow Fusion to Continue with unknown PTransforms

2018-03-27 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 5eeafc6c1d1a38c7ee4afb47f08b7405f5b230a2
Merge: 755963e 800e87f
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Mar 27 15:41:54 2018 -0700

[BEAM-3913] Allow Fusion to Continue with unknown PTransforms

 .../graph/GreedyPCollectionFusers.java | 28 +++---
 .../graph/GreedyPipelineFuserTest.java | 43 ++
 2 files changed, 66 insertions(+), 5 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (755963e -> 5eeafc6)

2018-03-27 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 755963e  Merge pull request #4954: Fix documentation around pipeline 
creation.
 add 494525d  Allow Fusion to Continue with unknown PTransforms
 add 083e823  fixup! Allow Fusion to Continue with unknown PTransforms
 add 800e87f  fixup! fixup! Allow Fusion to Continue with unknown 
PTransforms
 new 5eeafc6  [BEAM-3913] Allow Fusion to Continue with unknown PTransforms

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../graph/GreedyPCollectionFusers.java | 28 +++---
 .../graph/GreedyPipelineFuserTest.java | 43 ++
 2 files changed, 66 insertions(+), 5 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Cleanups in GroupAlsoByWindowEvaluatorFactory

2018-03-27 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit b582174cb08ba335d1a82e966b148d49f86f854d
Merge: 8d854d4 9639ca8
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Mar 27 15:44:07 2018 -0700

Cleanups in GroupAlsoByWindowEvaluatorFactory

 .../direct/GroupAlsoByWindowEvaluatorFactory.java| 20 
 1 file changed, 8 insertions(+), 12 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (8d854d4 -> b582174)

2018-03-27 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 8d854d4  [BEAM-3744] Expand Pubsub read API for Python. (#4901)
 add 9639ca8  Cleanups in GroupAlsoByWindowEvaluatorFactory
 new b582174  Cleanups in GroupAlsoByWindowEvaluatorFactory

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../direct/GroupAlsoByWindowEvaluatorFactory.java| 20 
 1 file changed, 8 insertions(+), 12 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (f47074c -> 25e4a5b)

2018-03-27 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from f47074c  Merge pull request #4962 from charlesccychen/revert-4781
 add c783e6a  Migrate container instructions and builds to Gradle
 add ed58436  CR: added comments to container helper function
 add b5126db  CR: make containerImageName take named parameters
 new 25e4a5b  [BEAM-3951] Migrate container instructions and builds to 
Gradle

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build_rules.gradle  |  35 +
 runners/gcp/gcemd/build.gradle  |   8 ++
 runners/gcp/gcsproxy/build.gradle   |   8 ++
 sdks/CONTAINERS.md  | 141 +++-
 sdks/go/build.gradle|  33 +
 sdks/go/container/build.gradle  |   8 +-
 sdks/go/{ => examples}/build.gradle |  26 ---
 sdks/java/container/build.gradle|   8 +-
 sdks/python/container/build.gradle  |   8 +-
 settings.gradle |   1 +
 10 files changed, 148 insertions(+), 128 deletions(-)
 copy sdks/go/{ => examples}/build.gradle (80%)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3951] Migrate container instructions and builds to Gradle

2018-03-27 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 25e4a5b4c9ac91139c3aec608fa7416b9fe0c0da
Merge: f47074c b5126db
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Mar 27 18:48:26 2018 -0700

[BEAM-3951] Migrate container instructions and builds to Gradle

 build_rules.gradle  |  35 +
 runners/gcp/gcemd/build.gradle  |   8 ++
 runners/gcp/gcsproxy/build.gradle   |   8 ++
 sdks/CONTAINERS.md  | 141 +++-
 sdks/go/build.gradle|  33 +
 sdks/go/container/build.gradle  |   8 +-
 sdks/go/{ => examples}/build.gradle |  26 ---
 sdks/java/container/build.gradle|   8 +-
 sdks/python/container/build.gradle  |   8 +-
 settings.gradle |   1 +
 10 files changed, 148 insertions(+), 128 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (95a524e -> eb0bbe9)

2018-03-30 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 95a524e  Fix golint issues
 add 81a4862  [BEAM-3249] Allow for re-use of dependencies within other 
projects by placing them within build_rules.gradle
 new eb0bbe9  [BEAM-3249] Allow for re-use of dependencies within other 
projects by placing them within build_rules.gradle

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build.gradle   | 138 -
 build_rules.gradle | 147 +
 2 files changed, 147 insertions(+), 138 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3249] Allow for re-use of dependencies within other projects by placing them within build_rules.gradle

2018-03-30 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit eb0bbe96ea44a99f5a89f0f4ce94910ed59b1132
Merge: 95a524e 81a4862
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Mar 30 16:20:33 2018 -0700

[BEAM-3249] Allow for re-use of dependencies within other projects by 
placing them within build_rules.gradle

 build.gradle   | 138 -
 build_rules.gradle | 147 +
 2 files changed, 147 insertions(+), 138 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3104] Set up state interfaces, wire into SDK harness client.

2018-03-28 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 397688a62b1f9f0f9840a43ed4ad1a59ba77b981
Merge: 5973c4d cec7c03
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Mar 28 17:48:57 2018 -0700

[BEAM-3104] Set up state interfaces, wire into SDK harness client.

 .../fnexecution/control/SdkHarnessClient.java  | 208 ++
 .../fnexecution/state/GrpcStateService.java|  25 ++-
 .../runners/fnexecution/state/StateDelegator.java  |  19 +-
 .../fnexecution/control/SdkHarnessClientTest.java  | 235 ++---
 4 files changed, 405 insertions(+), 82 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (5973c4d -> 397688a)

2018-03-28 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 5973c4d  [BEAM-3326] Address additional comments from PR/4963.
 add cec7c03  [BEAM-3104] Set up state interfaces, wire into SDK harness 
client.
 new 397688a  [BEAM-3104] Set up state interfaces, wire into SDK harness 
client.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../fnexecution/control/SdkHarnessClient.java  | 208 ++
 .../fnexecution/state/GrpcStateService.java|  25 ++-
 .../runners/fnexecution/state/StateDelegator.java  |  19 +-
 .../fnexecution/control/SdkHarnessClientTest.java  | 235 ++---
 4 files changed, 405 insertions(+), 82 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3326] Address additional comments from PR/4963.

2018-03-28 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 5973c4dd10495e010e1fea687cb43b5d06736ed7
Merge: 8587839 202030b
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Mar 28 15:53:40 2018 -0700

[BEAM-3326] Address additional comments from PR/4963.

 .../apache/beam/runners/fnexecution/control/SdkHarnessClient.java  | 7 ---
 .../org/apache/beam/runners/fnexecution/data/FnDataService.java| 6 +++---
 2 files changed, 7 insertions(+), 6 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (8587839 -> 5973c4d)

2018-03-28 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 8587839  Merge pull request #4851: [BEAM-3819] Add 
withRequestRecordsLimit() option to KinesisIO
 add 202030b  [BEAM-3326] Address additional comments from PR/4963.
 new 5973c4d  [BEAM-3326] Address additional comments from PR/4963.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../apache/beam/runners/fnexecution/control/SdkHarnessClient.java  | 7 ---
 .../org/apache/beam/runners/fnexecution/data/FnDataService.java| 6 +++---
 2 files changed, 7 insertions(+), 6 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (397688a -> 42c29e7)

2018-03-29 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 397688a  [BEAM-3104] Set up state interfaces, wire into SDK harness 
client.
 add 3af13e9  Remove include directives for proto well-known-types.
 new 42c29e7  Remove include directives for proto well-known-types.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/model/gen.go | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Remove include directives for proto well-known-types.

2018-03-29 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 42c29e7d70947e2ef0a2a7b40184bac977087fd7
Merge: 397688a 3af13e9
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Thu Mar 29 09:47:07 2018 -0700

Remove include directives for proto well-known-types.

 sdks/go/pkg/beam/model/gen.go | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (a52df7b -> b53aa9c)

2018-04-02 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from a52df7b  Merge pull request #4986 from udim/postcommit-fix
 add 4570ec5  [BEAM-3989] Delete Maven pipeline jobs consistently failing
 new b53aa9c  [BEAM-3989] Delete Maven pipeline jobs consistently failing

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .test-infra/jenkins/common_job_properties.groovy   | 102 -
 .test-infra/jenkins/job_beam_Java_Build.groovy |  74 ---
 .../jenkins/job_beam_Java_CodeHealth.groovy|  39 
 .../jenkins/job_beam_Java_IntegrationTest.groovy   |  63 -
 .test-infra/jenkins/job_beam_Java_UnitTest.groovy  |  40 
 .../jenkins/job_beam_Python_UnitTest.groovy|  40 
 6 files changed, 358 deletions(-)
 delete mode 100644 .test-infra/jenkins/job_beam_Java_Build.groovy
 delete mode 100644 .test-infra/jenkins/job_beam_Java_CodeHealth.groovy
 delete mode 100644 .test-infra/jenkins/job_beam_Java_IntegrationTest.groovy
 delete mode 100644 .test-infra/jenkins/job_beam_Java_UnitTest.groovy
 delete mode 100644 .test-infra/jenkins/job_beam_Python_UnitTest.groovy

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3989] Delete Maven pipeline jobs consistently failing

2018-04-02 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit b53aa9ca54cd2492c584ab873ab6c4c50030dd92
Merge: a52df7b 4570ec5
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Apr 2 22:10:06 2018 -0700

[BEAM-3989] Delete Maven pipeline jobs consistently failing

 .test-infra/jenkins/common_job_properties.groovy   | 102 -
 .test-infra/jenkins/job_beam_Java_Build.groovy |  74 ---
 .../jenkins/job_beam_Java_CodeHealth.groovy|  39 
 .../jenkins/job_beam_Java_IntegrationTest.groovy   |  63 -
 .test-infra/jenkins/job_beam_Java_UnitTest.groovy  |  40 
 .../jenkins/job_beam_Python_UnitTest.groovy|  40 
 6 files changed, 358 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (def98a0 -> 8797cfc)

2018-04-03 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from def98a0  Merge pull request #4980: Support multiple SDKHarness in 
RunnerHarness
 add c82fc4e  [BEAM-3987] Use gradle and not maven in 
sdks/python/container/run_validatescontainer.sh
 new 8797cfc  [BEAM-3987] Use gradle and not maven in 
sdks/python/container/run_validatescontainer.sh

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/python/container/run_validatescontainer.sh | 18 +++---
 1 file changed, 3 insertions(+), 15 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3987] Use gradle and not maven in sdks/python/container/run_validatescontainer.sh

2018-04-03 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 8797cfc55c6e7176c9c5b22c641b159772c6d8a4
Merge: def98a0 c82fc4e
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Apr 3 10:38:04 2018 -0700

[BEAM-3987] Use gradle and not maven in 
sdks/python/container/run_validatescontainer.sh

 sdks/python/container/run_validatescontainer.sh | 18 +++---
 1 file changed, 3 insertions(+), 15 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (f5fc543 -> f0c9ff8)

2018-04-03 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from f5fc543  [BEAM-3249] Add missing gradle artifact ids
 add a25157b  [BEAM-3989] Delete unused pipeline jobs
 new f0c9ff8  [BEAM-3989] Delete unused pipeline jobs

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .test-infra/jenkins/PreCommit_Pipeline.groovy  | 129 -
 .../jenkins/job_beam_PreCommit_Pipeline.groovy |  84 --
 2 files changed, 213 deletions(-)
 delete mode 100644 .test-infra/jenkins/PreCommit_Pipeline.groovy
 delete mode 100644 .test-infra/jenkins/job_beam_PreCommit_Pipeline.groovy

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3989] Delete unused pipeline jobs

2018-04-03 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit f0c9ff8379c90b922e5fc6a89ed3bdde9337392c
Merge: f5fc543 a25157b
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Apr 3 13:58:26 2018 -0700

[BEAM-3989] Delete unused pipeline jobs

 .test-infra/jenkins/PreCommit_Pipeline.groovy  | 129 -
 .../jenkins/job_beam_PreCommit_Pipeline.groovy |  84 --
 2 files changed, 213 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (8797cfc -> f5fc543)

2018-04-03 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 8797cfc  [BEAM-3987] Use gradle and not maven in 
sdks/python/container/run_validatescontainer.sh
 add 627d0fc  [BEAM-3249] Add missing gradle artifact ids
 new f5fc543  [BEAM-3249] Add missing gradle artifact ids

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/core-java/build.gradle   | 2 +-
 runners/local-artifact-service-java/build.gradle | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3249] Add missing gradle artifact ids

2018-04-03 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit f5fc543a211fc802135c978e4e42914c28240446
Merge: 8797cfc 627d0fc
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Tue Apr 3 13:56:46 2018 -0700

[BEAM-3249] Add missing gradle artifact ids

 runners/core-java/build.gradle   | 2 +-
 runners/local-artifact-service-java/build.gradle | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Fix golint issues

2018-03-30 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 95a524e52606de1467b5d8b2cc99263b8a111a8d
Merge: 6b32a9e 706c9e0
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Mar 30 13:03:38 2018 -0700

Fix golint issues

 sdks/go/pkg/beam/core/runtime/exec/translate.go | 2 +-
 sdks/go/pkg/beam/core/runtime/graphx/coder.go   | 2 +-
 sdks/go/pkg/beam/core/runtime/graphx/translate.go   | 1 +
 sdks/go/pkg/beam/runners/dataflow/dataflow.go   | 2 +-
 sdks/go/pkg/beam/runners/universal/runnerlib/compile.go | 2 +-
 sdks/go/pkg/beam/runners/universal/universal.go | 1 +
 sdks/go/pkg/beam/validate.go| 2 +-
 7 files changed, 7 insertions(+), 5 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (6b32a9e -> 95a524e)

2018-03-30 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 6b32a9e  Merge pull request #4873 Add PipelineRunner.run_async for 
non-blocking execution.
 add 706c9e0  Fix golint issues
 new 95a524e  Fix golint issues

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/core/runtime/exec/translate.go | 2 +-
 sdks/go/pkg/beam/core/runtime/graphx/coder.go   | 2 +-
 sdks/go/pkg/beam/core/runtime/graphx/translate.go   | 1 +
 sdks/go/pkg/beam/runners/dataflow/dataflow.go   | 2 +-
 sdks/go/pkg/beam/runners/universal/runnerlib/compile.go | 2 +-
 sdks/go/pkg/beam/runners/universal/universal.go | 1 +
 sdks/go/pkg/beam/validate.go| 2 +-
 7 files changed, 7 insertions(+), 5 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (25e4a5b -> 4fa0792)

2018-03-28 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 25e4a5b  [BEAM-3951] Migrate container instructions and builds to 
Gradle
 add 1bce8a9  [BEAM-3326] Abstract away closing the inbound receiver, 
waiting for the bundle to finish, waiting for outbound to complete within the 
ActiveBundle.
 new 4fa0792  [BEAM-3326] Abstract away closing the inbound receiver, 
waiting for the bundle to finish, waiting for outbound to complete within the 
ActiveBundle.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../fnexecution/control/SdkHarnessClient.java  | 104 ++--
 .../fnexecution/control/RemoteExecutionTest.java   |  17 +-
 .../fnexecution/control/SdkHarnessClientTest.java  | 174 ++---
 3 files changed, 245 insertions(+), 50 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3326] Abstract away closing the inbound receiver, waiting for the bundle to finish, waiting for outbound to complete within the ActiveBundle.

2018-03-28 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 4fa079211d4538310236febcb2979daef63b636b
Merge: 25e4a5b 1bce8a9
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Mar 28 08:44:27 2018 -0700

[BEAM-3326] Abstract away closing the inbound receiver, waiting for the 
bundle to finish, waiting for outbound to complete within the ActiveBundle.

 .../fnexecution/control/SdkHarnessClient.java  | 104 ++--
 .../fnexecution/control/RemoteExecutionTest.java   |  17 +-
 .../fnexecution/control/SdkHarnessClientTest.java  | 174 ++---
 3 files changed, 245 insertions(+), 50 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Fix minor checkstyle/findbugs errors caused by d78ea30

2018-03-18 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 734b602b6bd517f9d6c1726c47dabf5200f9337d
Merge: 52153b3 8161abc
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Sun Mar 18 11:33:49 2018 -0700

Fix minor checkstyle/findbugs errors caused by d78ea30

 .../runners/core/construction/graph/Networks.java  | 77 +++---
 1 file changed, 39 insertions(+), 38 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (52153b3 -> 734b602)

2018-03-18 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 52153b3  [BEAM-3249, BEAM-3457] Make Apache Rat a dependency of the 
Java and Gradle precommits.
 add 8161abc  Fix minor checkstyle/findbugs errors
 new 734b602  Fix minor checkstyle/findbugs errors caused by d78ea30

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../runners/core/construction/graph/Networks.java  | 77 +++---
 1 file changed, 39 insertions(+), 38 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (cb13361 -> 52153b3)

2018-03-18 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from cb13361  Merge pull request #4880: Remove Future#set(null) in 
fn-execution
 add a4d846c  [BEAM-3249, BEAM-3457] Make Apache Rat a dependency of the 
Java and Gradle precommits.
 add cb1dc0c  [BEAM-3457] Exclude generated and data files part of the Go 
SDK.
 new 52153b3  [BEAM-3249, BEAM-3457] Make Apache Rat a dependency of the 
Java and Gradle precommits.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build.gradle | 19 ---
 1 file changed, 8 insertions(+), 11 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3249, BEAM-3457] Make Apache Rat a dependency of the Java and Gradle precommits.

2018-03-18 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 52153b3299051566fef179d869e6c6923a6c23b4
Merge: cb13361 cb1dc0c
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Sun Mar 18 10:22:22 2018 -0700

[BEAM-3249, BEAM-3457] Make Apache Rat a dependency of the Java and Gradle 
precommits.

 build.gradle | 19 ---
 1 file changed, 8 insertions(+), 11 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3571] Correct the Go SDK's EventTime encoding

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 06210cb4bf7e18f93b21c794c2273a7d3bc2fdbf
Merge: 757b7b3 63cb46c
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Mar 16 12:45:22 2018 -0700

[BEAM-3571] Correct the Go SDK's EventTime encoding

 sdks/go/pkg/beam/core/graph/coder/time.go  | 16 +
 sdks/go/pkg/beam/core/graph/coder/time_test.go | 49 ++
 2 files changed, 59 insertions(+), 6 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (757b7b3 -> 06210cb)

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 757b7b3  Merge pull request #4754: Convert an ExecutableStage to a 
ProcessBundleDescriptor
 add e27ddc0  Correct EventTime encoding. time.(Time).Unix() returns 
seconds not millis.
 add 63cb46c  [BEAM-3571] Correct the Go SDK's EventTime encoding
 new 06210cb  [BEAM-3571] Correct the Go SDK's EventTime encoding

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/core/graph/coder/time.go  | 16 +
 sdks/go/pkg/beam/core/graph/coder/time_test.go | 49 ++
 2 files changed, 59 insertions(+), 6 deletions(-)
 create mode 100644 sdks/go/pkg/beam/core/graph/coder/time_test.go

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Fixing counter string name.

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 984f70df7858b99723a911f01faa4d149cc3ce06
Merge: 06210cb 0155d18
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Mar 16 12:55:52 2018 -0700

Fixing counter string name.

 sdks/python/apache_beam/utils/counters.py | 3 +++
 1 file changed, 3 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (06210cb -> 984f70d)

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 06210cb  [BEAM-3571] Correct the Go SDK's EventTime encoding
 add 0155d18  Fixing counter string name.
 new 984f70d  Fixing counter string name.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/python/apache_beam/utils/counters.py | 3 +++
 1 file changed, 3 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (984f70d -> 468d924)

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 984f70d  Fixing counter string name.
 add 734ca7d  Fix missing license header in test.
 new 468d924  Fix missing license header in test.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/core/graph/coder/time_test.go | 15 +++
 1 file changed, 15 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Fix missing license header in test.

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 468d924c4ddb11d440de5f14375888c3045113f7
Merge: 984f70d 734ca7d
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Mar 16 13:51:21 2018 -0700

Fix missing license header in test.

 sdks/go/pkg/beam/core/graph/coder/time_test.go | 15 +++
 1 file changed, 15 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (f8ccbe5 -> 605781c)

2018-03-20 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from f8ccbe5  Merge pull request #4840 [BEAM-3817] Switch Go SDK BQ write 
to not use side input
 add 02fe391  [BEAM-3893] Add fallback to unauthenticated access for GCS IO
 new 605781c  [BEAM-3893] Add fallback to unauthenticated access for Go GCS 
IO

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/io/textio/gcs/gcs.go  | 11 +--
 sdks/go/pkg/beam/provision/provision.go|  2 +-
 sdks/go/pkg/beam/runners/dataflow/translate.go |  2 +-
 sdks/go/pkg/beam/util/gcsx/gcs.go  | 11 +++
 4 files changed, 22 insertions(+), 4 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3873] Current version of commons-compress is DOS vulnerable CVE-2018-1324

2018-03-21 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 2626fb54d94e4f60fc51cacc8fa3e745354ac3ad
Merge: 165dba5 e0fa1f0
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Wed Mar 21 14:44:36 2018 -0700

[BEAM-3873] Current version of commons-compress is DOS vulnerable 
CVE-2018-1324

 build.gradle |  4 ++--
 pom.xml  | 20 +++-
 runners/java-fn-execution/pom.xml|  5 -
 .../apache/beam/sdk/io/gcp/testing/package-info.java |  0
 4 files changed, 5 insertions(+), 24 deletions(-)


-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (165dba5 -> 2626fb5)

2018-03-21 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 165dba5  Merge pull request #4910: Add Side Inputs to ExecutableStage
 add b274c91  Remove testing package-info from main package for GCP IO
 add 2213adc  Update maven failsafe/surefire plugin to version 2.21.0
 add e577d64  [BEAM-3873] Update commons-compress to version 1.16.1 (fix 
CVE-2018-1324)
 add e0fa1f0  Remove maven warnings
 new 2626fb5  [BEAM-3873] Current version of commons-compress is DOS 
vulnerable CVE-2018-1324

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build.gradle |  4 ++--
 pom.xml  | 20 +++-
 runners/java-fn-execution/pom.xml|  5 -
 .../apache/beam/sdk/io/gcp/testing/package-info.java |  0
 4 files changed, 5 insertions(+), 24 deletions(-)
 rename sdks/java/io/google-cloud-platform/src/{main => 
test}/java/org/apache/beam/sdk/io/gcp/testing/package-info.java (100%)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Remove "i == numSplits" condition, which can never be reached as i is < numSplits

2018-03-22 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 55837fde1392f7d1aa2f6e44f9436b66a62d3944
Merge: e49ed3c cabe9d0
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Thu Mar 22 10:24:03 2018 -0700

Remove "i == numSplits" condition, which can never be reached as i is < 
numSplits

 .../java/org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (e49ed3c -> 55837fd)

2018-03-22 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from e49ed3c  Improve test util for PubSub exist check (#4922)
 add cabe9d0  Remove "i == numSplits" condition, which can never be reached 
as i is always less than numSplits
 new 55837fd  Remove "i == numSplits" condition, which can never be reached 
as i is < numSplits

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../java/org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (a17478c -> c707bc2)

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from a17478c  [BEAM-3866] Remove WindowedValue on PCollections for Go SDK
 add 50c029e  Add a generic interface for the state service.
 add 612dd75  Write unit tests for GrpcStateService.
 new c707bc2  [BEAM-3676] Add Portable State Service

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../fnexecution/state/GrpcStateService.java| 119 +++
 .../runners/fnexecution/state/StateDelegator.java} |  32 ++---
 .../StateRequestHandler.java}  |  23 +++-
 .../runners/fnexecution/state}/package-info.java   |   6 +-
 .../fnexecution/state/GrpcStateServiceTest.java| 129 +
 5 files changed, 279 insertions(+), 30 deletions(-)
 create mode 100644 
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/state/GrpcStateService.java
 copy 
runners/{core-java/src/main/java/org/apache/beam/runners/core/triggers/FinishedTriggers.java
 => 
java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/state/StateDelegator.java}
 (54%)
 copy 
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/{control/InstructionRequestHandler.java
 => state/StateRequestHandler.java} (52%)
 copy {sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries => 
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/state}/package-info.java
 (91%)
 create mode 100644 
runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/state/GrpcStateServiceTest.java

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3676] Add Portable State Service

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit c707bc218751e90d4b98c5fd14f8157ac9abdf63
Merge: a17478c 612dd75
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Mar 19 12:57:31 2018 -0700

[BEAM-3676] Add Portable State Service

 .../fnexecution/state/GrpcStateService.java| 119 +++
 .../runners/fnexecution/state/StateDelegator.java  |  34 ++
 .../fnexecution/state/StateRequestHandler.java |  40 +++
 .../runners/fnexecution/state/package-info.java|  20 
 .../fnexecution/state/GrpcStateServiceTest.java| 129 +
 5 files changed, 342 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam-site] branch asf-site updated (04bf78e -> 98818ae)

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.


from 04bf78e  [BEAM-3852] Update slack channel link and slack invite for 
new channel.
 add ebafac1  Update instructions on cryptographic hashes.
 new 98818ae  Update instructions on cryptographic hashes.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 src/contribute/release-guide.md | 6 ++
 1 file changed, 2 insertions(+), 4 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam-site] 01/01: Update instructions on cryptographic hashes.

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 98818ae70b733b83702447082de431c90d34ec80
Merge: 04bf78e ebafac1
Author: Luke Cwik <lc...@google.com>
AuthorDate: Mon Mar 19 10:15:51 2018 -0700

Update instructions on cryptographic hashes.

This closes #402.

 src/contribute/release-guide.md | 6 ++
 1 file changed, 2 insertions(+), 4 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (02331f8 -> a17478c)

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 02331f8  Merge pull request #4838 from mariapython/side
 add 0a7f1ff  Remove WindowedValue on PCollections for Go SDK
 add 56e3b05  CR: Fix comments to remove old windowing
 new a17478c  [BEAM-3866] Remove WindowedValue on PCollections for Go SDK

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/core/graph/bind.go| 69 +-
 sdks/go/pkg/beam/core/graph/bind_test.go   | 82 +++---
 sdks/go/pkg/beam/core/graph/coder/coder.go | 28 
 sdks/go/pkg/beam/core/graph/edge.go| 49 +++--
 sdks/go/pkg/beam/core/graph/node.go|  8 +--
 sdks/go/pkg/beam/core/runtime/exec/coder.go|  8 +--
 sdks/go/pkg/beam/core/runtime/exec/combine_test.go |  2 +-
 sdks/go/pkg/beam/core/runtime/exec/datasink.go |  6 +-
 sdks/go/pkg/beam/core/runtime/exec/datasource.go   | 14 ++--
 sdks/go/pkg/beam/core/runtime/exec/pardo_test.go   | 10 +--
 sdks/go/pkg/beam/core/runtime/exec/translate.go| 56 ++-
 sdks/go/pkg/beam/core/runtime/graphx/coder_test.go | 12 ++--
 sdks/go/pkg/beam/core/runtime/graphx/cogbk.go  | 18 +++--
 .../pkg/beam/core/runtime/graphx/translate_test.go |  4 +-
 sdks/go/pkg/beam/core/typex/class.go   |  2 +-
 sdks/go/pkg/beam/core/typex/fulltype.go| 35 +
 sdks/go/pkg/beam/core/typex/fulltype_test.go   | 56 +++
 sdks/go/pkg/beam/io/bigqueryio/bigquery.go |  3 +-
 sdks/go/pkg/beam/partition.go  |  3 +-
 sdks/go/pkg/beam/pcollection.go| 14 ++--
 sdks/go/pkg/beam/runners/dataflow/translate.go | 22 +++---
 sdks/go/pkg/beam/runners/direct/direct.go  |  4 +-
 sdks/go/pkg/beam/runners/direct/gbk.go |  3 +-
 sdks/go/pkg/beam/testing/passert/passert.go|  6 +-
 sdks/go/pkg/beam/transforms/filter/filter.go   |  9 +--
 sdks/go/pkg/beam/validate.go   |  6 +-
 sdks/go/pkg/beam/x/debug/head.go   |  2 +-
 sdks/go/pkg/beam/x/debug/print.go  |  4 +-
 28 files changed, 272 insertions(+), 263 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3866] Remove WindowedValue on PCollections for Go SDK

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit a17478c2ee11b1d7a8eba58da5ce385d73c6dbbc
Merge: 02331f8 56e3b05
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Mar 19 10:46:19 2018 -0700

[BEAM-3866] Remove WindowedValue on PCollections for Go SDK

 sdks/go/pkg/beam/core/graph/bind.go| 69 +-
 sdks/go/pkg/beam/core/graph/bind_test.go   | 82 +++---
 sdks/go/pkg/beam/core/graph/coder/coder.go | 28 
 sdks/go/pkg/beam/core/graph/edge.go| 49 +++--
 sdks/go/pkg/beam/core/graph/node.go|  8 +--
 sdks/go/pkg/beam/core/runtime/exec/coder.go|  8 +--
 sdks/go/pkg/beam/core/runtime/exec/combine_test.go |  2 +-
 sdks/go/pkg/beam/core/runtime/exec/datasink.go |  6 +-
 sdks/go/pkg/beam/core/runtime/exec/datasource.go   | 14 ++--
 sdks/go/pkg/beam/core/runtime/exec/pardo_test.go   | 10 +--
 sdks/go/pkg/beam/core/runtime/exec/translate.go| 56 ++-
 sdks/go/pkg/beam/core/runtime/graphx/coder_test.go | 12 ++--
 sdks/go/pkg/beam/core/runtime/graphx/cogbk.go  | 18 +++--
 .../pkg/beam/core/runtime/graphx/translate_test.go |  4 +-
 sdks/go/pkg/beam/core/typex/class.go   |  2 +-
 sdks/go/pkg/beam/core/typex/fulltype.go| 35 +
 sdks/go/pkg/beam/core/typex/fulltype_test.go   | 56 +++
 sdks/go/pkg/beam/io/bigqueryio/bigquery.go |  3 +-
 sdks/go/pkg/beam/partition.go  |  3 +-
 sdks/go/pkg/beam/pcollection.go| 14 ++--
 sdks/go/pkg/beam/runners/dataflow/translate.go | 22 +++---
 sdks/go/pkg/beam/runners/direct/direct.go  |  4 +-
 sdks/go/pkg/beam/runners/direct/gbk.go |  3 +-
 sdks/go/pkg/beam/testing/passert/passert.go|  6 +-
 sdks/go/pkg/beam/transforms/filter/filter.go   |  9 +--
 sdks/go/pkg/beam/validate.go   |  6 +-
 sdks/go/pkg/beam/x/debug/head.go   |  2 +-
 sdks/go/pkg/beam/x/debug/print.go  |  4 +-
 28 files changed, 272 insertions(+), 263 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3249] Publish java artifacts using gradle

2018-03-18 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit d8cb0e6098370dc5059834ea82c5f6fa22f6a91b
Merge: 0440f75 7e2dafd
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Sun Mar 18 14:02:47 2018 -0700

 [BEAM-3249] Publish java artifacts using gradle

 build.gradle   |  8 +
 build_rules.gradle | 35 ++
 examples/java/build.gradle |  2 +-
 model/fn-execution/build.gradle|  2 +-
 model/job-management/build.gradle  |  2 +-
 model/pipeline/build.gradle|  2 +-
 runners/java-fn-execution/build.gradle |  2 +-
 runners/local-java/build.gradle|  2 +-
 runners/reference/java/build.gradle|  2 +-
 runners/reference/job-server/build.gradle  |  2 +-
 runners/spark/build.gradle |  2 +-
 sdks/java/build-tools/build.gradle |  2 +-
 sdks/java/core/build.gradle|  2 +-
 .../google-cloud-platform-core/build.gradle|  2 +-
 sdks/java/extensions/jackson/build.gradle  |  2 +-
 sdks/java/extensions/join-library/build.gradle |  2 +-
 sdks/java/extensions/protobuf/build.gradle |  2 +-
 sdks/java/extensions/sketching/build.gradle|  2 +-
 sdks/java/extensions/sorter/build.gradle   |  2 +-
 sdks/java/extensions/sql/build.gradle  |  2 +-
 sdks/java/fn-execution/build.gradle|  2 +-
 sdks/java/harness/build.gradle |  2 +-
 sdks/java/io/amazon-web-services/build.gradle  |  2 +-
 sdks/java/io/amqp/build.gradle |  2 +-
 sdks/java/io/cassandra/build.gradle|  2 +-
 sdks/java/io/common/build.gradle   |  2 +-
 .../elasticsearch-tests-2/build.gradle |  2 +-
 .../elasticsearch-tests-5/build.gradle |  2 +-
 .../elasticsearch-tests-common/build.gradle|  2 +-
 sdks/java/io/elasticsearch/build.gradle|  2 +-
 sdks/java/io/file-based-io-tests/build.gradle  |  2 +-
 sdks/java/io/google-cloud-platform/build.gradle|  2 +-
 sdks/java/io/hadoop-common/build.gradle|  2 +-
 sdks/java/io/hadoop-file-system/build.gradle   |  2 +-
 sdks/java/io/hadoop-input-format/build.gradle  |  2 +-
 sdks/java/io/hbase/build.gradle|  2 +-
 sdks/java/io/hcatalog/build.gradle |  2 +-
 sdks/java/io/jdbc/build.gradle |  2 +-
 sdks/java/io/jms/build.gradle  |  2 +-
 sdks/java/io/kafka/build.gradle|  2 +-
 sdks/java/io/kinesis/build.gradle  |  2 +-
 sdks/java/io/mongodb/build.gradle  |  2 +-
 sdks/java/io/mqtt/build.gradle |  2 +-
 sdks/java/io/redis/build.gradle|  2 +-
 sdks/java/io/solr/build.gradle |  2 +-
 sdks/java/io/tika/build.gradle |  2 +-
 sdks/java/io/xml/build.gradle  |  2 +-
 sdks/java/maven-archetypes/examples/build.gradle   | 42 +-
 sdks/java/maven-archetypes/starter/build.gradle|  2 +-
 sdks/java/nexmark/build.gradle |  2 +-
 50 files changed, 131 insertions(+), 48 deletions(-)


-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (0440f75 -> d8cb0e6)

2018-03-18 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 0440f75  Merge pull request #4886 from 
cclauss/exception-message-is-history
 add 7e2dafd  [BEAM-3249] Publish java artifacts using gradle
 new d8cb0e6   [BEAM-3249] Publish java artifacts using gradle

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build.gradle   |  8 +
 build_rules.gradle | 35 ++
 examples/java/build.gradle |  2 +-
 model/fn-execution/build.gradle|  2 +-
 model/job-management/build.gradle  |  2 +-
 model/pipeline/build.gradle|  2 +-
 runners/java-fn-execution/build.gradle |  2 +-
 runners/local-java/build.gradle|  2 +-
 runners/reference/java/build.gradle|  2 +-
 runners/reference/job-server/build.gradle  |  2 +-
 runners/spark/build.gradle |  2 +-
 sdks/java/build-tools/build.gradle |  2 +-
 sdks/java/core/build.gradle|  2 +-
 .../google-cloud-platform-core/build.gradle|  2 +-
 sdks/java/extensions/jackson/build.gradle  |  2 +-
 sdks/java/extensions/join-library/build.gradle |  2 +-
 sdks/java/extensions/protobuf/build.gradle |  2 +-
 sdks/java/extensions/sketching/build.gradle|  2 +-
 sdks/java/extensions/sorter/build.gradle   |  2 +-
 sdks/java/extensions/sql/build.gradle  |  2 +-
 sdks/java/fn-execution/build.gradle|  2 +-
 sdks/java/harness/build.gradle |  2 +-
 sdks/java/io/amazon-web-services/build.gradle  |  2 +-
 sdks/java/io/amqp/build.gradle |  2 +-
 sdks/java/io/cassandra/build.gradle|  2 +-
 sdks/java/io/common/build.gradle   |  2 +-
 .../elasticsearch-tests-2/build.gradle |  2 +-
 .../elasticsearch-tests-5/build.gradle |  2 +-
 .../elasticsearch-tests-common/build.gradle|  2 +-
 sdks/java/io/elasticsearch/build.gradle|  2 +-
 sdks/java/io/file-based-io-tests/build.gradle  |  2 +-
 sdks/java/io/google-cloud-platform/build.gradle|  2 +-
 sdks/java/io/hadoop-common/build.gradle|  2 +-
 sdks/java/io/hadoop-file-system/build.gradle   |  2 +-
 sdks/java/io/hadoop-input-format/build.gradle  |  2 +-
 sdks/java/io/hbase/build.gradle|  2 +-
 sdks/java/io/hcatalog/build.gradle |  2 +-
 sdks/java/io/jdbc/build.gradle |  2 +-
 sdks/java/io/jms/build.gradle  |  2 +-
 sdks/java/io/kafka/build.gradle|  2 +-
 sdks/java/io/kinesis/build.gradle  |  2 +-
 sdks/java/io/mongodb/build.gradle  |  2 +-
 sdks/java/io/mqtt/build.gradle |  2 +-
 sdks/java/io/redis/build.gradle|  2 +-
 sdks/java/io/solr/build.gradle |  2 +-
 sdks/java/io/tika/build.gradle |  2 +-
 sdks/java/io/xml/build.gradle  |  2 +-
 sdks/java/maven-archetypes/examples/build.gradle   | 42 +-
 sdks/java/maven-archetypes/starter/build.gradle|  2 +-
 sdks/java/nexmark/build.gradle |  2 +-
 50 files changed, 131 insertions(+), 48 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (8139899 -> ceb027a)

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 8139899  Merge pull request #4763 [BEAM-3759] Add support for PaneInfo 
in WindowedValues
 add 1de3e3e  Use InstructionRequestHandler in RemoteEnvironment
 new ceb027a  [BEAM-3847] Use InstructionRequestHandler in RemoteEnvironment

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../fnexecution/environment/RemoteEnvironment.java | 18 +++---
 1 file changed, 7 insertions(+), 11 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: [BEAM-3847] Use InstructionRequestHandler in RemoteEnvironment

2018-03-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit ceb027a8656833391e295a60dee549cc7e39677f
Merge: 8139899 1de3e3e
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Mon Mar 19 14:03:19 2018 -0700

[BEAM-3847] Use InstructionRequestHandler in RemoteEnvironment

 .../fnexecution/environment/RemoteEnvironment.java | 18 +++---
 1 file changed, 7 insertions(+), 11 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] 01/01: Add Network Utility Methods

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit c6f1d3d6275c6e4acf02025ecf3e8135b5bb0ebc
Merge: 8f32183 f3a9f91
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Fri Mar 16 16:28:43 2018 -0700

Add Network Utility Methods

 .../runners/core/construction/graph/Networks.java  | 249 +
 .../core/construction/graph/NetworksTest.java  | 239 
 2 files changed, 488 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


[beam] branch master updated (8f32183 -> c6f1d3d)

2018-03-16 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 8f32183  Merge pull request #4604 from angoenka/progress_report_error
 add d78ea30  Add Network Utility Methods
 add f3a9f91  fixup! Add Network Utility Methods
 new c6f1d3d  Add Network Utility Methods

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../runners/core/construction/graph/Networks.java  | 249 +
 .../core/construction/graph/NetworksTest.java  | 239 
 2 files changed, 488 insertions(+)
 create mode 100644 
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/graph/Networks.java
 create mode 100644 
runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/graph/NetworksTest.java

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.


<    5   6   7   8   9   10   11   12   13   14   >