[beam] 01/01: Merge pull request #7073: Don't redundantly execute pre-commits as part of Jenkins post-commits
This is an automated email from the ASF dual-hosted git repository. scott pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 3cd4d8f51d017bb0b0793e42ba7ffa39d325bfa4 Merge: f82d940 8f6502e Author: Scott Wegner AuthorDate: Wed Nov 21 21:25:23 2018 -0800 Merge pull request #7073: Don't redundantly execute pre-commits as part of Jenkins post-commits .test-infra/jenkins/job_PostCommit_Python_Verify.groovy | 6 -- build.gradle| 2 -- sdks/python/build.gradle| 1 - 3 files changed, 9 deletions(-)
[beam] branch master updated (f82d940 -> 3cd4d8f)
This is an automated email from the ASF dual-hosted git repository. scott pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from f82d940 [BEAM-6058] Use vendored gRPC 1.13.1 dependency. (#7105) add 8f6502e Don't redundantly execute pre-commits as part of Jenkins post-commits new 3cd4d8f Merge pull request #7073: Don't redundantly execute pre-commits as part of Jenkins post-commits The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .test-infra/jenkins/job_PostCommit_Python_Verify.groovy | 6 -- build.gradle| 2 -- sdks/python/build.gradle| 1 - 3 files changed, 9 deletions(-)
[beam] 01/01: Merge pull request #7119 from chamikaramj/revert_pr_6683_branch_2
This is an automated email from the ASF dual-hosted git repository. ccy pushed a commit to branch release-2.9.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit ac2edbe9d4999b0b1b17848d6238fefc3d444f8d Merge: 54fe812 dd4f97c Author: Charles Chen AuthorDate: Wed Nov 21 18:02:42 2018 -0800 Merge pull request #7119 from chamikaramj/revert_pr_6683_branch_2 [BEAM-6085] Revert "[BEAM-5442] Revert #6675 "Revert PRs #6557 #6589 #6600"" .../python/apache_beam/options/pipeline_options.py | 32 +- .../apache_beam/options/pipeline_options_test.py | 23 ++-- .../runners/worker/sdk_worker_main_test.py | 4 +-- 3 files changed, 6 insertions(+), 53 deletions(-)
[beam] branch release-2.9.0 updated (54fe812 -> ac2edbe)
This is an automated email from the ASF dual-hosted git repository. ccy pushed a change to branch release-2.9.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 54fe812 Merge pull request #7111: Cherry-pick PR #7109 [BEAM-3608, BEAM-5819] Pass through parameters needed for publishingfor Guava and disable publishing for vendored dependencies when performing a normal release. add dd4f97c Revert "[BEAM-5442] Revert #6675 "Revert PRs #6557 #6589 #6600"" new ac2edbe Merge pull request #7119 from chamikaramj/revert_pr_6683_branch_2 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../python/apache_beam/options/pipeline_options.py | 32 +- .../apache_beam/options/pipeline_options_test.py | 23 ++-- .../runners/worker/sdk_worker_main_test.py | 4 +-- 3 files changed, 6 insertions(+), 53 deletions(-)
[beam] 01/01: Merge pull request #7111: Cherry-pick PR #7109 [BEAM-3608, BEAM-5819] Pass through parameters needed for publishingfor Guava and disable publishing for vendored dependencies when perform
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a commit to branch release-2.9.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 54fe812844a285e210918b7d75625fef8fa97c8e Merge: 21774b1 93f81a2 Author: Chamikara Jayalath AuthorDate: Wed Nov 21 16:33:12 2018 -0800 Merge pull request #7111: Cherry-pick PR #7109 [BEAM-3608, BEAM-5819] Pass through parameters needed for publishingfor Guava and disable publishing for vendored dependencies when performing a normal release. .../src/main/groovy/org/apache/beam/gradle/VendorJavaPlugin.groovy| 4 ++-- vendor/guava-20_0/build.gradle| 4 +++- 2 files changed, 5 insertions(+), 3 deletions(-)
[beam] branch release-2.9.0 updated (21774b1 -> 54fe812)
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch release-2.9.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 21774b1 Merge pull request #7112 from aaltay/release-2.9.0 add 93f81a2 [BEAM-3608, BEAM-5819] Pass through parameters needed for publishing for Guava and disable publishing for vendored dependencies when performing a normal release. new 54fe812 Merge pull request #7111: Cherry-pick PR #7109 [BEAM-3608, BEAM-5819] Pass through parameters needed for publishingfor Guava and disable publishing for vendored dependencies when performing a normal release. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../src/main/groovy/org/apache/beam/gradle/VendorJavaPlugin.groovy| 4 ++-- vendor/guava-20_0/build.gradle| 4 +++- 2 files changed, 5 insertions(+), 3 deletions(-)
[beam] branch release-2.9.0 updated (efa948e -> 21774b1)
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to branch release-2.9.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from efa948e Create release branch for version 2.9.0. add 8acfdd6 Merge pull request #7107 from aaltay/rf new 21774b1 Merge pull request #7112 from aaltay/release-2.9.0 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/python/apache_beam/testing/synthetic_pipeline.py | 2 +- sdks/python/apache_beam/testing/synthetic_pipeline_test.py | 2 +- sdks/python/apache_beam/testing/test_utils.py | 7 ++- sdks/python/tox.ini| 2 +- 4 files changed, 5 insertions(+), 8 deletions(-)
[beam] 01/01: Merge pull request #7112 from aaltay/release-2.9.0
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch release-2.9.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 21774b1e3f3d5c041cedfe49d9e36877e1bd8297 Merge: efa948e 8acfdd6 Author: Ahmet Altay AuthorDate: Wed Nov 21 14:48:15 2018 -0800 Merge pull request #7112 from aaltay/release-2.9.0 [BEAM-6106] Cherry pick #7107 to release branch sdks/python/apache_beam/testing/synthetic_pipeline.py | 2 +- sdks/python/apache_beam/testing/synthetic_pipeline_test.py | 2 +- sdks/python/apache_beam/testing/test_utils.py | 7 ++- sdks/python/tox.ini| 2 +- 4 files changed, 5 insertions(+), 8 deletions(-)
[beam] branch master updated: [BEAM-6058] Use vendored gRPC 1.13.1 dependency. (#7105)
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new f82d940 [BEAM-6058] Use vendored gRPC 1.13.1 dependency. (#7105)
f82d940 is described below
commit f82d9404a6da3012b9b7d881507973fc0e0f4dff
Author: Lukasz Cwik
AuthorDate: Wed Nov 21 14:21:03 2018 -0800
[BEAM-6058] Use vendored gRPC 1.13.1 dependency. (#7105)
---
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 8 ++---
runners/core-construction-java/build.gradle| 2 +-
runners/direct-java/build.gradle | 2 +-
runners/flink/build.gradle | 2 +-
runners/google-cloud-dataflow-java/build.gradle| 2 +-
.../google-cloud-dataflow-java/worker/build.gradle | 2 +-
.../worker/legacy-worker/build.gradle | 2 +-
runners/java-fn-execution/build.gradle | 2 +-
runners/reference/java/build.gradle| 2 +-
sdks/java/fn-execution/build.gradle| 2 +-
sdks/java/harness/build.gradle | 4 +--
settings.gradle| 3 --
vendor/grpc-v1_13_1/build.gradle | 36 --
13 files changed, 15 insertions(+), 54 deletions(-)
diff --git
a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
index 9c3fec6..8d96480 100644
--- a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+++ b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
@@ -434,6 +434,8 @@ class BeamModulePlugin implements Plugin {
spark_network_common:
"org.apache.spark:spark-network-common_2.11:$spark_version",
spark_streaming :
"org.apache.spark:spark-streaming_2.11:$spark_version",
stax2_api :
"org.codehaus.woodstox:stax2-api:3.1.4",
+vendored_grpc_1_13_1:
"org.apache.beam:beam-vendor-grpc-1_13_1:0.1",
+vendored_guava_20_0 :
"org.apache.beam:beam-vendor-guava-20_0:0.1",
woodstox_core_asl :
"org.codehaus.woodstox:woodstox-core-asl:4.4.1",
quickcheck_core :
"com.pholser:junit-quickcheck-core:$quickcheck_version",
],
@@ -1357,7 +1359,7 @@ artifactId=${project.name}
project.ext.applyJavaNature(enableFindbugs: false, shadowClosure:
GrpcVendoring.shadowClosure() << {
// We perform all the code relocations but don't include
// any of the actual dependencies since they will be supplied
-// by beam-vendor-grpc-v1_13_1
+// by org.apache.beam:beam-vendor-grpc-v1_13_1:0.1
dependencies {
exclude(dependency(".*:.*"))
}
@@ -1394,9 +1396,7 @@ artifactId=${project.name}
}
}
- project.dependencies GrpcVendoring.dependenciesClosure() << {
-shadow it.project(path: ":beam-vendor-grpc-v1_13_1", configuration:
"shadow")
- }
+ project.dependencies GrpcVendoring.dependenciesClosure() << { shadow
'org.apache.beam:beam-vendor-grpc-1_13_1:0.1' }
project.task('validateShadedJarDoesntExportVendoredDependencies',
dependsOn: 'shadowJar') {
ext.outFile = project.file("${project.reportsDir}/${name}.out")
diff --git a/runners/core-construction-java/build.gradle
b/runners/core-construction-java/build.gradle
index a079f95..ed7d585 100644
--- a/runners/core-construction-java/build.gradle
+++ b/runners/core-construction-java/build.gradle
@@ -37,7 +37,7 @@ dependencies {
shadow project(path: ":beam-model-pipeline", configuration: "shadow")
shadow project(path: ":beam-model-job-management", configuration: "shadow")
shadow project(path: ":beam-sdks-java-core", configuration: "shadow")
- shadow project(path: ":beam-vendor-grpc-v1_13_1", configuration: "shadow")
+ shadow library.java.vendored_grpc_1_13_1
shadow library.java.jackson_core
shadow library.java.jackson_databind
shadow library.java.joda_time
diff --git a/runners/direct-java/build.gradle b/runners/direct-java/build.gradle
index 592adf7..5fe6411 100644
--- a/runners/direct-java/build.gradle
+++ b/runners/direct-java/build.gradle
@@ -64,7 +64,7 @@ dependencies {
compile project(path: it, configuration: "shadow")
}
shadow project(path: ":beam-sdks-java-core", configuration: "shadow")
- shadow project(path: ":beam-vendor-grpc-v1_13_1", configuration: "shadow")
+ shadow library.java.vendored_grpc_1_13_1
shadow library.java.joda_time
shadow library.java.slf4j_api
shadow library.java.args4j
diff --git a/runners/flink/build.gradle b/runners/flink/build.gradle
index d1e731a..87c827d 100644
--- a/runners/flink/build.gradle
+++
[beam] branch master updated (f228abf -> 954c198)
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from f228abf [BEAM-3608, BEAM-5819] Pass through parameters needed for publishing for Guava and disable publishing for vendored dependencies when performing a normal release. (#7109) add 85b1a1e Revert "[BEAM-5320] Finish Python 3 porting for testing module (#7029)" new 954c198 Merge pull request #7107 from aaltay/rf The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/python/apache_beam/testing/synthetic_pipeline.py | 2 +- sdks/python/apache_beam/testing/synthetic_pipeline_test.py | 2 +- sdks/python/apache_beam/testing/test_utils.py | 7 ++- sdks/python/tox.ini| 2 +- 4 files changed, 5 insertions(+), 8 deletions(-)
[beam] 01/01: Merge pull request #7107 from aaltay/rf
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 954c198056c943206552cd8e4a32234a4e53d94a Merge: f228abf 85b1a1e Author: Ahmet Altay AuthorDate: Wed Nov 21 13:53:42 2018 -0800 Merge pull request #7107 from aaltay/rf [BEAM-6106] Revert "[BEAM-5320] Finish Python 3 porting for testing module (#7029)" sdks/python/apache_beam/testing/synthetic_pipeline.py | 2 +- sdks/python/apache_beam/testing/synthetic_pipeline_test.py | 2 +- sdks/python/apache_beam/testing/test_utils.py | 7 ++- sdks/python/tox.ini| 2 +- 4 files changed, 5 insertions(+), 8 deletions(-)
[beam] branch master updated: typo fix in experiments flag name in the log (#7076)
This is an automated email from the ASF dual-hosted git repository.
altay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 6d8fa45 typo fix in experiments flag name in the log (#7076)
6d8fa45 is described below
commit 6d8fa455d4b478335167235f56620744d9e22784
Author: Ahmet Altay
AuthorDate: Wed Nov 21 13:22:35 2018 -0800
typo fix in experiments flag name in the log (#7076)
* typo fix in experiments flag name in the log
---
.../dataflow/worker/DataflowWorkerHarnessHelper.java| 13 -
1 file changed, 8 insertions(+), 5 deletions(-)
diff --git
a/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/DataflowWorkerHarnessHelper.java
b/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/DataflowWorkerHarnessHelper.java
index aeeec33..75662f4 100644
---
a/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/DataflowWorkerHarnessHelper.java
+++
b/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/DataflowWorkerHarnessHelper.java
@@ -57,16 +57,19 @@ public final class DataflowWorkerHarnessHelper {
ExperimentContext ec = ExperimentContext.parseFrom(pipelineOptions);
+String experimentName =
Experiment.DisableConscryptSecurityProvider.getName();
if (!ec.isEnabled(Experiment.DisableConscryptSecurityProvider)) {
/* Enable fast SSL provider. */
LOG.info(
"Dataflow runner uses conscrypt by default for SSL. To disable this
feature, "
- + "pass pipeline option
--experiment=disable_conscrypt_security_provider");
+ + "pass pipeline option --experiments={}",
+ experimentName);
Security.insertProviderAt(new OpenSSLProvider(), 1);
} else {
LOG.info(
- "Experiment disable_conscrypt_security_provider specified, disabling
conscrypt "
- + "SSL. Note this is the default Java behavior, but may have
reduced performance.");
+ "Experiment {} specified, disabling conscrypt SSL. Note this is the
default "
+ + "Java behavior, but may have reduced performance.",
+ experimentName);
}
return pipelineOptions;
}
@@ -113,13 +116,13 @@ public final class DataflowWorkerHarnessHelper {
public static @Nullable RunnerApi.Pipeline getPipelineFromEnv() throws
IOException {
String pipelinePath = System.getenv(PIPELINE_PATH);
if (pipelinePath == null) {
- LOG.warn("Missing pipeline environment variable '%s'", PIPELINE_PATH);
+ LOG.warn("Missing pipeline environment variable '{}'", PIPELINE_PATH);
return null;
}
File pipelineFile = new File(System.getenv(PIPELINE_PATH));
if (!pipelineFile.exists()) {
- LOG.warn("Pipeline path '%s' does not exist", pipelineFile);
+ LOG.warn("Pipeline path '{}' does not exist", pipelineFile);
return null;
}
svn commit: r31026 - /release/beam/KEYS
Author: altay Date: Wed Nov 21 20:41:34 2018 New Revision: 31026 Log: Add Chamikara's key Modified: release/beam/KEYS Modified: release/beam/KEYS == --- release/beam/KEYS (original) +++ release/beam/KEYS Wed Nov 21 20:41:34 2018 @@ -650,3 +650,52 @@ Ds4LpA553K0YDR4KMd8M6X5epaMskoUl6DfNtidy 3tE2McrB55BWexQAjNWkm11bHX7UtsTlR9TYF8V8o68C+22uVnC54roF =2Usa -END PGP PUBLIC KEY BLOCK- +pub rsa3072 2018-11-20 [SC] + B564A760E0CB6A478C07ED01EEAC70DF3D0BC23B +uid [ultimate] Chamikara Jayalath (Key used to sign releases) +sig 3EEAC70DF3D0BC23B 2018-11-20 Chamikara Jayalath (Key used to sign releases) +sub rsa3072 2018-11-20 [E] +sig EEAC70DF3D0BC23B 2018-11-20 Chamikara Jayalath (Key used to sign releases) + +-BEGIN PGP PUBLIC KEY BLOCK- + +mQGNBFvzYbYBDADBXRUXkpIFDdWd/HzcwKUNJAy8Sfia/VLOq7WhPMqnBmRS9Yw3 +sTT4BjRF1gMSujh2/EejB9BOnx/E1fLYEDleGnRwDdC279KgRbnSpY+QdAqovd1l +EkSkTy43JGcdf9hwrEfxetxkCfL8J4CC6jJ6lS4BMHHaQsIk8KTDAa9/qM/xGRdX +uJfZp015dlxcJfsyu8BgHtuC/0BGCC6gaPThaPG6rOne8qaNuM5J7LoJgV8oyMwx +NpEe6lqbe0oWoJlH2aLReLp0Rvz4kMyISQGi7vqjChNu7/uWE2Oupw5vfK4TL+NB +Hv6Ra/YwCPyOcoIauPR0db0BdLWkEpshatYFy3rJ4q1l9gJX2xHqX46ZABTc02u1 +USNeWOQnlx7mnUC8ylrSXh9KAMi2vW1BOvXKwAITiPcHVO7cLFqD0S1OEgoLjH1w +Qa27cZ7jeUZMWQ3/ULnZmlxO06kj3gBGEVcUnYP1DVolW5LfFlgFAU28VUiav1+5 +f981nrdf8tsngtkAEQEAAbRFQ2hhbWlrYXJhIEpheWFsYXRoIChLZXkgdXNlZCB0 +byBzaWduIHJlbGVhc2VzKSA8Y2hhbWlrYXJhQGFwYWNoZS5vcmc+iQHOBBMBCgA4 +FiEEtWSnYODLakeMB+0B7qxw3z0LwjsFAlvzYbYCGwMFCwkIBwIGFQoJCAsCBBYC +AwECHgECF4AACgkQ7qxw3z0Lwjvc4wwAuQkiqQjTlLmCfIoH2LN8dbABmJrQyoZI +pzVIo21N3vetuJU5CIc86J7IOKqm79Pci7VF61/GD1wqWQ9MtYqUcYng1LW0nPlj +l8ndyY909mufJhEHZFVjGD+AdY1oyGqhlx/nfTTPxORJE4yIkScFmf8Pcal7OASz +eOJPHdfITRnFDFIQJlJ//tr/QBJqSzN47IXM9LqFgpOleRpHAv4zUFuDwV3pcTWX +PbnRNLfRrJOnvXyFAfBkM4xFHRYkdKUjy5Vn82XOW7Z8BTAJAbAVo12EfNjaLEwv +JFOXyvyQ1p5Q8+YSuvVRZIbts2AzQLAa7vPNch189aP3dOl5icCahCG3xTdgiMhC +mv9bBt0NKT+BMopdRSZcTOZCGvxcPNxujh9QdAZgLYNv3PmajcqridllJsImF7b8 +1htJNSmbAxC1nO3dBVZKnzLH0wcPpxCK7woom5859yZF9nMkQK7Z8FrNMQoYhlTP +ue6ilMP8CeMMl8Iu1oVIVPSXG4xbUSu1uQGNBFvzYbYBDACmzfMrwV549WQJHdri +zDrtTmxW9OBUqcZ2P/e3m4wUadTXnkhoyg79fJkZaTEN9w8Gy4rcYLco0SELylsf +xNe1tFFOM5sDzysBlr+WVvkZKbSRwCu+5dLWH7sVz9cQGfmU+emPPdYNJm8rnVmN +nK5oWaAGoLXQx+BGIaNhipITPy1rIm9KHzS9sEKKOUMPdIkfwluyc5acIYLg9TG/ +TSxsYENAE3ykE/oriJ/UwhsVK5iw3rUhjOtuiXLvnX0XAdbpJOdT2RCEDh6WbsOH +trFZjw7uJE9TEo+WIMybdNDhISbkGKE2sN8zxADElUQ2pEh03nzsheqL9CUoWAS1 +ZqdjInBzc0hQUcFJglZjRYYYjox4Jyw/s8i/74jFcyevbRTvy4rJso6BH8leUQPm +tfxDsdZiY37KJOvNBZDKivlOTNbSPznj0yno+HCACpKcXjq+OmDP3KnwpTBn2aUR +46Btj5bSnqzWwxIl9ZGmG29gynnzyFa03/AxVTIcY/RLaMsAEQEAAYkBtgQYAQoA +IBYhBLVkp2Dgy2pHjAftAe6scN89C8I7BQJb82G2AhsMAAoJEO6scN89C8I7mowL +/2wNHxSQzNilYGPoevIRdNJ01H7QPP6KtbQFaLNs9kAkcJm80OLhullrnhYL3pwZ +ng3O0qdPzOb1qJcrHFOA/6+5UbvVFl//W0oCbxUoGj/yddxNJm3yVVVgeFn1AQLz +iaOa+cvOcefFAurZkAgBHmyAx4PGSNKEwoFI5lCa1oLLCnJkF9deC2i4soZW0TNw +Y0I39DqxdFUM3UtYDkKPbz5UDE5RVT9q6W/DZkA/CL2lPv1sS9ojaAY2T765SV49 +oJT8k91yhI4FEx+ah0vRZTm8Njj/gZfR7GS5V7wMO/eV0bpViM6d01+EpgWgt7vm +o3bin6JVDt0ClKKqLtv7OOqGt/iA48/NxL8MGp435060ixETt0lnPp/McFAEzDws +Phk187YqxAVreGGQm8FNIX1oN1CZq8C3oLAy+lV/LqiFdwLTEH9HPTxbyGW1pTnY +/9i3hxN5/cmDeX+osSOs2d02oAOUN+P2doFtOWcnNXslUILyS8lfRGKMxrNDHKCL +Ag== +=FiUj +-END PGP PUBLIC KEY BLOCK-
[beam] 01/01: Create release branch for version 2.9.0.
This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a commit to branch release-2.9.0
in repository https://gitbox.apache.org/repos/asf/beam.git
commit efa948ec746234d893c0fd8480e5480daa6aaf24
Author: Chamikara Jayalath
AuthorDate: Wed Nov 21 11:27:36 2018 -0800
Create release branch for version 2.9.0.
---
runners/google-cloud-dataflow-java/build.gradle | 2 +-
sdks/python/apache_beam/version.py | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/runners/google-cloud-dataflow-java/build.gradle
b/runners/google-cloud-dataflow-java/build.gradle
index a5c7bc8..80164df 100644
--- a/runners/google-cloud-dataflow-java/build.gradle
+++ b/runners/google-cloud-dataflow-java/build.gradle
@@ -39,7 +39,7 @@ processResources {
filter org.apache.tools.ant.filters.ReplaceTokens, tokens: [
'dataflow.legacy_environment_major_version' : '7',
'dataflow.fnapi_environment_major_version' : '7',
-'dataflow.container_version' : 'beam-master-20181116'
+'dataflow.container_version' : 'beam-2.9.0'
]
}
diff --git a/sdks/python/apache_beam/version.py
b/sdks/python/apache_beam/version.py
index c2ae126..4f1e090 100644
--- a/sdks/python/apache_beam/version.py
+++ b/sdks/python/apache_beam/version.py
@@ -18,4 +18,4 @@
"""Apache Beam SDK version information and utilities."""
-__version__ = '2.9.0.dev'
+__version__ = '2.9.0'
[beam] branch release-2.9.0 created (now efa948e)
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch release-2.9.0 in repository https://gitbox.apache.org/repos/asf/beam.git. at efa948e Create release branch for version 2.9.0. This branch includes the following new commits: new efa948e Create release branch for version 2.9.0. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[beam] branch master updated: Moving to 2.10.0-SNAPSHOT on master branch.
This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 7a23acf Moving to 2.10.0-SNAPSHOT on master branch.
7a23acf is described below
commit 7a23acf6b3a15795b093a0cc02e957e901d75a67
Author: Chamikara Jayalath
AuthorDate: Wed Nov 21 11:26:50 2018 -0800
Moving to 2.10.0-SNAPSHOT on master branch.
---
buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +-
gradle.properties | 2 +-
sdks/python/apache_beam/version.py | 2 +-
3 files changed, 3 insertions(+), 3 deletions(-)
diff --git
a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
index 20d7172..9c3fec6 100644
--- a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+++ b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
@@ -265,7 +265,7 @@ class BeamModulePlugin implements Plugin {
// Automatically use the official release version if we are performing a
release
// otherwise append '-SNAPSHOT'
-project.version = '2.9.0'
+project.version = '2.10.0'
if (!isRelease(project)) {
project.version += '-SNAPSHOT'
}
diff --git a/gradle.properties b/gradle.properties
index c62305e..1dcfd01 100644
--- a/gradle.properties
+++ b/gradle.properties
@@ -23,4 +23,4 @@ offlineRepositoryRoot=offline-repository
signing.gnupg.executable=gpg
signing.gnupg.useLegacyGpg=true
-version=2.9.0-SNAPSHOT
+version=2.10.0-SNAPSHOT
diff --git a/sdks/python/apache_beam/version.py
b/sdks/python/apache_beam/version.py
index c2ae126..57512fe 100644
--- a/sdks/python/apache_beam/version.py
+++ b/sdks/python/apache_beam/version.py
@@ -18,4 +18,4 @@
"""Apache Beam SDK version information and utilities."""
-__version__ = '2.9.0.dev'
+__version__ = '2.10.0.dev'
[beam] 01/01: Merge pull request #7099: [BEAM-6104] Use a very large stack for compiling Beam
This is an automated email from the ASF dual-hosted git repository. kenn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 61e6df9761a1f9a7bfb178d7759845d79f399cc8 Merge: 49e57be 57ede6c Author: Kenn Knowles AuthorDate: Wed Nov 21 12:09:54 2018 -0700 Merge pull request #7099: [BEAM-6104] Use a very large stack for compiling Beam gradle.properties | 1 + 1 file changed, 1 insertion(+)
[beam] branch master updated (49e57be -> 61e6df9)
This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 49e57be Merge pull request #7103: Kryo: Annotate kryo as Experimental. add 57ede6c [BEAM-6104] Use a very large stack for compiling Beam new 61e6df9 Merge pull request #7099: [BEAM-6104] Use a very large stack for compiling Beam The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: gradle.properties | 1 + 1 file changed, 1 insertion(+)
[beam] 01/01: Merge pull request #7103: Kryo: Annotate kryo as Experimental.
This is an automated email from the ASF dual-hosted git repository. dmvk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 49e57be52b519809ecff3d5660ee75e362917974 Merge: 50e4e0d 89cad9c Author: David Moravek AuthorDate: Wed Nov 21 17:44:08 2018 +0100 Merge pull request #7103: Kryo: Annotate kryo as Experimental. .../src/main/java/org/apache/beam/sdk/extensions/kryo/KryoCoder.java| 2 ++ .../java/org/apache/beam/sdk/extensions/kryo/KryoCoderProvider.java | 2 ++ .../src/main/java/org/apache/beam/sdk/extensions/kryo/KryoOptions.java | 2 ++ .../main/java/org/apache/beam/sdk/extensions/kryo/KryoRegistrar.java| 2 ++ 4 files changed, 8 insertions(+)
[beam] branch master updated (50e4e0d -> 49e57be)
This is an automated email from the ASF dual-hosted git repository. dmvk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 50e4e0d Merge pull request #7093: [BEAM-6099] RedisIO support for PFADD operation add 89cad9c Kryo: Annotate kryo as Experimental. new 49e57be Merge pull request #7103: Kryo: Annotate kryo as Experimental. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../src/main/java/org/apache/beam/sdk/extensions/kryo/KryoCoder.java| 2 ++ .../java/org/apache/beam/sdk/extensions/kryo/KryoCoderProvider.java | 2 ++ .../src/main/java/org/apache/beam/sdk/extensions/kryo/KryoOptions.java | 2 ++ .../main/java/org/apache/beam/sdk/extensions/kryo/KryoRegistrar.java| 2 ++ 4 files changed, 8 insertions(+)
[beam] 01/01: Merge pull request #7093: [BEAM-6099] RedisIO support for PFADD operation
This is an automated email from the ASF dual-hosted git repository. aromanenko pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 50e4e0d93f0b79d0963a0c61d7bc0dcf1ee349bc Merge: 2dc3ffe bf70df5 Author: Alexey Romanenko <33895511+aromanenko-...@users.noreply.github.com> AuthorDate: Wed Nov 21 17:35:23 2018 +0100 Merge pull request #7093: [BEAM-6099] RedisIO support for PFADD operation .../java/org/apache/beam/sdk/io/redis/RedisIO.java | 14 ++- .../org/apache/beam/sdk/io/redis/RedisIOTest.java | 28 ++ 2 files changed, 41 insertions(+), 1 deletion(-)
[beam] branch master updated (2dc3ffe -> 50e4e0d)
This is an automated email from the ASF dual-hosted git repository. aromanenko pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 2dc3ffe Merge pull request #7033 from Ensure global top is non-empty. add bf70df5 [BEAM-6099] Add PFADD instruction to RedisIO new 50e4e0d Merge pull request #7093: [BEAM-6099] RedisIO support for PFADD operation The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../java/org/apache/beam/sdk/io/redis/RedisIO.java | 14 ++- .../org/apache/beam/sdk/io/redis/RedisIOTest.java | 28 ++ 2 files changed, 41 insertions(+), 1 deletion(-)
[beam] branch master updated (8fc0667 -> 2dc3ffe)
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 8fc0667 Merge pull request #7100: [Website] table stream joins to Euphoria roadmap add 6c7a63f Ensure global top is non-empty. add 2dc3ffe Merge pull request #7033 from Ensure global top is non-empty. No new revisions were added by this update. Summary of changes: sdks/python/apache_beam/transforms/combiners.py | 8 ++-- sdks/python/apache_beam/transforms/combiners_test.py | 5 + 2 files changed, 11 insertions(+), 2 deletions(-)
[beam] branch asf-site updated: Publishing website 2018/11/21 11:19:22 at commit 8fc0667
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 0ccdf74 Publishing website 2018/11/21 11:19:22 at commit 8fc0667 0ccdf74 is described below commit 0ccdf74f118505b6543a2d8727cc2787bbe02275 Author: jenkins AuthorDate: Wed Nov 21 11:19:23 2018 + Publishing website 2018/11/21 11:19:22 at commit 8fc0667 --- website/generated-content/roadmap/euphoria/index.html | 5 + 1 file changed, 5 insertions(+) diff --git a/website/generated-content/roadmap/euphoria/index.html b/website/generated-content/roadmap/euphoria/index.html index cb13f83..98c62d7 100644 --- a/website/generated-content/roadmap/euphoria/index.html +++ b/website/generated-content/roadmap/euphoria/index.html @@ -211,6 +211,7 @@ Pipeline sampling Fluent API Side Outputs + Table-stream joins @@ -258,6 +259,10 @@ previous pipeline runs. We want to provide a convenient and portable way to gath An convenient API for multiple outputs. +Table-stream joins + +Introduce API for converting streams to tables (KStream - KTable approach) and various types of (windowed and unwindowed) joins on them. +
[beam] branch master updated (469c90a -> 8fc0667)
This is an automated email from the ASF dual-hosted git repository. dmvk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 469c90a Merge pull request #7039: [Website] Euphoria roadmap. add 045e1fe [Website] table stream joins to Euphoria roadmap add 8fc0667 Merge pull request #7100: [Website] table stream joins to Euphoria roadmap No new revisions were added by this update. Summary of changes: website/src/roadmap/euphoria.md | 4 1 file changed, 4 insertions(+)
[beam] branch asf-site updated: Publishing website 2018/11/21 09:48:18 at commit 469c90a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new d92f580 Publishing website 2018/11/21 09:48:18 at commit 469c90a d92f580 is described below commit d92f580594ea665d3838e326b827d8f4bcb9a5a6 Author: jenkins AuthorDate: Wed Nov 21 09:48:19 2018 + Publishing website 2018/11/21 09:48:18 at commit 469c90a --- .../generated-content/roadmap/euphoria/index.html | 28 +++--- 1 file changed, 25 insertions(+), 3 deletions(-) diff --git a/website/generated-content/roadmap/euphoria/index.html b/website/generated-content/roadmap/euphoria/index.html index 1f28ad0..cb13f83 100644 --- a/website/generated-content/roadmap/euphoria/index.html +++ b/website/generated-content/roadmap/euphoria/index.html @@ -206,6 +206,12 @@ + + “Salted” join implementation + Pipeline sampling + Fluent API + Side Outputs + @@ -229,13 +235,29 @@ limitations under the License. Easy to use Java 8 DSL for the Beam Java SDK. Provides a high-level abstraction of Beam transformations, which is both easy to read and write. Can be used as a complement to existing Beam pipelines (convertible back and forth). You can have a glimpse of the API at WordCount example. -This roadmap is in progress. In the meantime, here are some resources: - JIRA: https://issues.apache.org/jira/browse/BEAM-4366?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-euphoria;>dsl-euphoria / https://issues.apache.org/jira/browse/BEAM-3900;>BEAM-3900 - Contact: mailto:david.mora...@gmail.com;>David Moravek + Contact: mailto:d...@apache.org;>David Moravek +“Salted” join implementation + +Implementation of a join, that can handle large scale join of highly skewed data sets. This implementation breaks +the large keys into multiple splits, using key distribution approximated by count min sketch data structure. + +Pipeline sampling + +In order to pick the right translation for the operator without user interference, we can leverage knowledge from +previous pipeline runs. We want to provide a convenient and portable way to gather this knowledge. + +Fluent API + +Implementation of an easy to use Fluent API on top of Euphoria DSL. + +Side Outputs + +An convenient API for multiple outputs. +
[beam] 01/01: Merge pull request #7039: [Website] Euphoria roadmap.
This is an automated email from the ASF dual-hosted git repository. dmvk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 469c90a2a9aa47e3424297e044cf9205eafb8c4e Merge: 4f24e27 66e5b5d Author: David Moravek AuthorDate: Wed Nov 21 10:46:46 2018 +0100 Merge pull request #7039: [Website] Euphoria roadmap. website/src/roadmap/euphoria.md | 22 +++--- 1 file changed, 19 insertions(+), 3 deletions(-)
[beam] branch master updated (4f24e27 -> 469c90a)
This is an automated email from the ASF dual-hosted git repository. dmvk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 4f24e27 Merge pull request #7097: [BEAM-6103] Adds support for setting a HTTP write timeout for BigQueryIO add 66e5b5d [Website] Euphoria roadmap. new 469c90a Merge pull request #7039: [Website] Euphoria roadmap. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: website/src/roadmap/euphoria.md | 22 +++--- 1 file changed, 19 insertions(+), 3 deletions(-)
