[beam] 01/01: Merge pull request #6856 from reuvenlax/sql_use_group
This is an automated email from the ASF dual-hosted git repository. anton pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit d8a5faa4fe91d910517fb091fade0a2ad4b40c5f Merge: 401d663 be6942e Author: Anton Kedin <33067037+ake...@users.noreply.github.com> AuthorDate: Sat Oct 27 01:40:09 2018 -0400 Merge pull request #6856 from reuvenlax/sql_use_group [BEAM-4461] Switch SQL over to use the new Beam Group transform. .../apache/beam/sdk/schemas/transforms/Group.java | 142 +++ .../sql/impl/rel/BeamAggregationRel.java | 129 +++--- .../sql/impl/transform/MultipleAggregationsFn.java | 175 --- .../impl/transform/agg/AggregationArgsAdapter.java | 171 -- .../transform/agg/AggregationCombineFnAdapter.java | 193 - 5 files changed, 308 insertions(+), 502 deletions(-)
[beam] branch master updated (401d663 -> d8a5faa)
This is an automated email from the ASF dual-hosted git repository. anton pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 401d663 Merge pull request #6853: [SQL] Test NULL in Pubsub JSON format add be6942e Switch SQL over to use the new Beam Group transform. new d8a5faa Merge pull request #6856 from reuvenlax/sql_use_group The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../apache/beam/sdk/schemas/transforms/Group.java | 142 +++ .../sql/impl/rel/BeamAggregationRel.java | 129 +++--- .../sql/impl/transform/MultipleAggregationsFn.java | 175 --- .../impl/transform/agg/AggregationArgsAdapter.java | 171 -- .../transform/agg/AggregationCombineFnAdapter.java | 193 - 5 files changed, 308 insertions(+), 502 deletions(-) delete mode 100644 sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/transform/MultipleAggregationsFn.java delete mode 100644 sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/transform/agg/AggregationArgsAdapter.java
[beam] branch master updated (53d62ea -> 401d663)
This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 53d62ea Merge pull request #6840: Add an OWNERS file for .test-infra/metrics add aaa0c85 Test NULL in Pubsub JSON format for SQL read. add 401d663 Merge pull request #6853: [SQL] Test NULL in Pubsub JSON format No new revisions were added by this update. Summary of changes: .../meta/provider/pubsub/PubsubMessageToRowTest.java| 17 + 1 file changed, 13 insertions(+), 4 deletions(-)
[beam] branch master updated (a7c3078 -> 53d62ea)
This is an automated email from the ASF dual-hosted git repository. scott pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from a7c3078 Merge pull request #6855: Revert #6752 #6798 #6807 #6837 to fix Dataflow test breakage add 71c9c69 Add an OWNERS file for .test-infra/metrics add 53d62ea Merge pull request #6840: Add an OWNERS file for .test-infra/metrics No new revisions were added by this update. Summary of changes: {sdks/java/build-tools => .test-infra/metrics}/OWNERS | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) copy {sdks/java/build-tools => .test-infra/metrics}/OWNERS (83%)
[beam] branch master updated (52721a1 -> a7c3078)
This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 52721a1 Merge pull request #6801 from charlesccychen/multi-snappy add 8632186 Revert "Merge pull request #6837 [BEAM-5853] Fix in RemoteGrpcPortWriteOperation" add e17731e Revert "Merge pull request #6807: [BEAM-5833] Fix java-harness build by adding flush() to BeamFnDataWriteRunnerTest" add a96f111 Revert "Merge pull request #6798: [BEAM-5833] Fix checkstyle breakage" add ddd775d Revert "Merge pull request #6752 [BEAM-5791] Dataflow harness data plane pushback." add a7c3078 Merge pull request #6855: Revert #6752 #6798 #6807 #6837 to fix Dataflow test breakage No new revisions were added by this update. Summary of changes: .../worker/fn/control/BeamFnMapTaskExecutor.java | 43 +++- .../fn/data/RemoteGrpcPortWriteOperation.java | 110 + .../dataflow/worker/FnApiWindowMappingFnTest.java | 3 - .../fn/control/BeamFnMapTaskExecutorTest.java | 2 - .../SingularProcessBundleProgressTrackerTest.java | 2 - .../fn/data/RemoteGrpcPortWriteOperationTest.java | 83 +--- .../data/BeamFnDataBufferingOutboundObserver.java | 9 +- .../beam/sdk/fn/data/CloseableFnDataReceiver.java | 11 --- .../beam/fn/harness/BeamFnDataWriteRunnerTest.java | 10 -- 9 files changed, 17 insertions(+), 256 deletions(-)
[beam] branch master updated (6a4fc93 -> 52721a1)
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 6a4fc93 Merge pull request #6849: [BEAM-5815] Replace precommit dashboard image with an actual image add e508508 Support multiple versions of snappy for tfrecordio add 52721a1 Merge pull request #6801 from charlesccychen/multi-snappy No new revisions were added by this update. Summary of changes: sdks/python/apache_beam/io/tfrecordio.py | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-)
[beam] branch asf-site updated: Publishing website 2018/10/26 20:15:52 at commit 6a4fc93
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 9085700 Publishing website 2018/10/26 20:15:52 at commit 6a4fc93 9085700 is described below commit 908570054018845d4df04e75d3af6c996f6f4cac Author: jenkins AuthorDate: Fri Oct 26 20:15:52 2018 + Publishing website 2018/10/26 20:15:52 at commit 6a4fc93 --- .../images/precommit_dashboard.png | Bin 1425 -> 215945 bytes 1 file changed, 0 insertions(+), 0 deletions(-) diff --git a/website/generated-content/images/precommit_dashboard.png b/website/generated-content/images/precommit_dashboard.png index 49e4065..f79e44c 100644 Binary files a/website/generated-content/images/precommit_dashboard.png and b/website/generated-content/images/precommit_dashboard.png differ
[beam] 01/01: Merge pull request #6849: [BEAM-5815] Replace precommit dashboard image with an actual image
This is an automated email from the ASF dual-hosted git repository. scott pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 6a4fc93b784b742c59e7b6239734e22d5a04bd2a Merge: 290fec4 a17022a Author: Scott Wegner AuthorDate: Fri Oct 26 13:15:04 2018 -0700 Merge pull request #6849: [BEAM-5815] Replace precommit dashboard image with an actual image website/src/images/precommit_dashboard.png | Bin 1425 -> 215945 bytes 1 file changed, 0 insertions(+), 0 deletions(-)
[beam] branch master updated (290fec4 -> 6a4fc93)
This is an automated email from the ASF dual-hosted git repository. scott pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 290fec4 Merge pull request #6851 from amaliujia/rui_wang-spotless add a17022a Replace precommit dashboard image with an actual image new 6a4fc93 Merge pull request #6849: [BEAM-5815] Replace precommit dashboard image with an actual image The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: website/src/images/precommit_dashboard.png | Bin 1425 -> 215945 bytes 1 file changed, 0 insertions(+), 0 deletions(-)
[beam] branch master updated (0c39444 -> 290fec4)
This is an automated email from the ASF dual-hosted git repository. goenka pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0c39444 Migrate to using the full Gradle distribution rather than binary-only. (#6848) add 3c9578b apply spotless new 290fec4 Merge pull request #6851 from amaliujia/rui_wang-spotless The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .test-infra/metrics/src/test/groovy/ProberTests.groovy | 2 -- 1 file changed, 2 deletions(-)
[beam] 01/01: Merge pull request #6851 from amaliujia/rui_wang-spotless
This is an automated email from the ASF dual-hosted git repository. goenka pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 290fec41fff5f075f00136ad39d0b17967a1b9fb Merge: 0c39444 3c9578b Author: Ankur AuthorDate: Fri Oct 26 13:09:38 2018 -0700 Merge pull request #6851 from amaliujia/rui_wang-spotless apply spotless .test-infra/metrics/src/test/groovy/ProberTests.groovy | 2 -- 1 file changed, 2 deletions(-)
[beam] branch master updated (9f161d9 -> 0c39444)
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 9f161d9 Update web site links for the 2.8.0 release (#6745) add 0c39444 Migrate to using the full Gradle distribution rather than binary-only. (#6848) No new revisions were added by this update. Summary of changes: gradle/wrapper/gradle-wrapper.jar| Bin 54413 -> 56177 bytes gradle/wrapper/gradle-wrapper.properties | 2 +- 2 files changed, 1 insertion(+), 1 deletion(-)
[beam] branch asf-site updated: Publishing website 2018/10/26 18:41:38 at commit 9f161d9
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 083bc96 Publishing website 2018/10/26 18:41:38 at commit 9f161d9 083bc96 is described below commit 083bc96f84efdd1dd1dda81205ab08406ebfd497 Author: jenkins AuthorDate: Fri Oct 26 18:41:38 2018 + Publishing website 2018/10/26 18:41:38 at commit 9f161d9 --- website/generated-content/.htaccess| 2 +- .../blog/2016/10/20/test-stream.html | 2 +- .../blog/2017/08/16/splittable-do-fn.html | 10 +++ .../08/20/review-input-streaming-connectors.html | 22 +++ .../contribute/ptransform-style-guide/index.html | 4 +-- .../contribute/release-guide/index.html| 2 +- .../dsls/sql/aggregate-functions/index.html| 4 +-- .../dsls/sql/create-external-table/index.html | 4 +-- .../documentation/dsls/sql/data-types/index.html | 4 +-- .../documentation/dsls/sql/joins/index.html| 4 +-- .../documentation/dsls/sql/lexical/index.html | 4 +-- .../documentation/dsls/sql/overview/index.html | 8 +++--- .../dsls/sql/scalar-functions/index.html | 4 +-- .../documentation/dsls/sql/select/index.html | 4 +-- .../documentation/dsls/sql/set/index.html | 4 +-- .../documentation/dsls/sql/shell/index.html| 4 +-- .../dsls/sql/user-defined-functions/index.html | 4 +-- .../documentation/dsls/sql/walkthrough/index.html | 10 +++ .../dsls/sql/windowing-and-triggering/index.html | 4 +-- .../io/built-in/google-bigquery/index.html | 14 +- .../pipelines/test-your-pipeline/index.html| 4 +-- .../documentation/programming-guide/index.html | 16 +-- .../documentation/runners/dataflow/index.html | 6 ++-- .../documentation/runners/direct/index.html| 14 +- .../documentation/runners/flink/index.html | 4 +-- .../documentation/runners/gearpump/index.html | 4 +-- .../documentation/runners/jstorm/index.html| 2 +- .../documentation/runners/mapreduce/index.html | 2 +- .../documentation/runners/samza/index.html | 2 +- .../documentation/runners/spark/index.html | 2 +- .../sdks/feature-comparison/index.html | 4 +-- .../documentation/sdks/go/index.html | 4 +-- .../documentation/sdks/java-extensions/index.html | 4 +-- .../documentation/sdks/java-thirdparty/index.html | 4 +-- .../documentation/sdks/java/euphoria/index.html| 6 ++-- .../documentation/sdks/java/index.html | 4 +-- .../sdks/java/testing/nexmark/index.html | 8 +++--- .../documentation/sdks/python-custom-io/index.html | 4 +-- .../sdks/python-pipeline-dependencies/index.html | 4 +-- .../documentation/sdks/python-streaming/index.html | 4 +-- .../sdks/python-type-safety/index.html | 4 +-- .../documentation/sdks/python/index.html | 4 +-- website/generated-content/feed.xml | 32 +++--- .../get-started/downloads/index.html | 18 .../get-started/quickstart-java/index.html | 4 +-- .../get-started/wordcount-example/index.html | 4 +-- website/generated-content/index.html | 4 +-- 47 files changed, 149 insertions(+), 141 deletions(-) diff --git a/website/generated-content/.htaccess b/website/generated-content/.htaccess index 2462791..5f00051 100644 --- a/website/generated-content/.htaccess +++ b/website/generated-content/.htaccess @@ -21,4 +21,4 @@ RewriteRule ^(.*)$ https://beam.apache.org/$1 [L,R=301] # The following redirect maintains the previously supported URLs. RedirectMatch permanent "/documentation/sdks/(javadoc|pydoc)(.*)" "https://beam.apache.org/releases/$1$2; # Keep this updated to point to the current release. -RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.7.0$2; +RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.8.0$2; diff --git a/website/generated-content/blog/2016/10/20/test-stream.html b/website/generated-content/blog/2016/10/20/test-stream.html index 34da27a..468ca75 100644 --- a/website/generated-content/blog/2016/10/20/test-stream.html +++ b/website/generated-content/blog/2016/10/20/test-stream.html @@ -219,7 +219,7 @@ be controlled within a test. Writing Deterministic Tests to Emulate Nondeterminism The Beam testing infrastructure provides the -https://beam.apache.org/releases/javadoc/2.7.0/org/apache/beam/sdk/testing/PAssert.html;>PAssert +https://beam.apache.org/releases/javadoc/2.8.0/org/apache/beam/sdk/testing/PAssert.html;>PAssert methods, which assert properties about the contents of a PCollection from within a pipeline. We have expanded this infrastructure to
[beam] branch master updated: Update web site links for the 2.8.0 release (#6745)
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 9f161d9 Update web site links for the 2.8.0 release (#6745) 9f161d9 is described below commit 9f161d9fc5b4766b4057e10dda2364cfac73ede0 Author: Ahmet Altay AuthorDate: Fri Oct 26 11:40:50 2018 -0700 Update web site links for the 2.8.0 release (#6745) * Update web site links for the 2.8.0 release --- .../src/main/scripts/build_release_candidate.sh| 24 +- website/.gitignore | 1 + website/_config.yml| 2 +- website/src/.htaccess | 2 +- website/src/contribute/release-guide.md| 2 +- website/src/get-started/downloads.md | 7 +++ 6 files changed, 21 insertions(+), 17 deletions(-) diff --git a/release/src/main/scripts/build_release_candidate.sh b/release/src/main/scripts/build_release_candidate.sh index 37941d7..9319409 100755 --- a/release/src/main/scripts/build_release_candidate.sh +++ b/release/src/main/scripts/build_release_candidate.sh @@ -89,6 +89,7 @@ if [[ $confirmation = "y" ]]; then git clone ${GIT_REPO_URL} cd ${BEAM_ROOT_DIR} git checkout ${RELEASE_BRANCH} + RELEASE_COMMIT=$(git rev-parse --verify ${RELEASE_BRANCH}) echo "-Building Java Artifacts with Gradle-" git config credential.helper store @@ -103,7 +104,7 @@ if [[ $confirmation = "y" ]]; then echo "-Staging Java Artifacts into Maven---" ./gradlew publish -PisRelease --no-parallel --no-daemon - echo "Please review all artifacts in https://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.beam%22; + echo "Please review all artifacts in staging URL. e.g. https://repository.apache.org/content/repositories/orgapachebeam-/; rm -rf ~/${LOCAL_CLONE_DIR} fi @@ -215,6 +216,7 @@ if [[ $confirmation = "y" ]]; then git checkout ${RELEASE_BRANCH} cd sdks/python && tox -e docs GENERATED_PYDOC=~/${LOCAL_WEBSITE_UPDATE_DIR}/${LOCAL_PYTHON_DOC}/${BEAM_ROOT_DIR}/sdks/python/target/docs/_build + rm -rf ${GENERATED_PYDOC}/.doctrees echo "--Building Java Doc--" cd ~/${LOCAL_WEBSITE_UPDATE_DIR}/${LOCAL_JAVA_DOC} @@ -224,27 +226,21 @@ if [[ $confirmation = "y" ]]; then ./gradlew :beam-sdks-java-javadoc:aggregateJavadoc GENERATE_JAVADOC=~/${LOCAL_WEBSITE_UPDATE_DIR}/${LOCAL_JAVA_DOC}/${BEAM_ROOT_DIR}/sdks/java/javadoc/build/docs/javadoc/ - echo "--Updating Beam Website-" + echo "--Updating Release Docs-" cd ~/${LOCAL_WEBSITE_UPDATE_DIR}/${LOCAL_WEBSITE_REPO} git clone ${GIT_BEAM_WEBSITE} cd ${WEBSITE_ROOT_DIR} - git checkout -b updates_release_${RELEASE} - - echo "..Updating release version in _config.yml..." - sed -i -e "s/release_latest: [0-9].[0-9].[0-9]/release_latest: ${RELEASE}/g" _config.yml + git checkout release-docs + git checkout -b updates_release_${RELEASE} release-docs echo "..Copying generated javadoc into beam-site.." - cp -r ${GENERATE_JAVADOC} src/documentation/sdks/javadoc/${RELEASE} - echo "Updating javadoc current.md with latest release version number" - sed -i -e "s/[0-9].[0-9].[0-9]/${RELEASE}/g" src/documentation/sdks/javadoc/current.md + cp -r ${GENERATE_JAVADOC} javadoc/${RELEASE} echo "Copying generated pydoc into beam-site.." - cp -r ${GENERATED_PYDOC} src/documentation/sdks/pydoc/${RELEASE} - echo ".Updating pydoc current.md with latest release version number.." - sed -i -e "s/[0-9].[0-9].[0-9]/${RELEASE}/g" src/documentation/sdks/pydoc/current.md + cp -r ${GENERATED_PYDOC} pydoc/${RELEASE} git add -A - git commit -m "Update beam-site for release ${RELEASE}" + git commit -m "Update beam-site for release ${RELEASE}\n\nContent generated based on commit ${RELEASE_COMMIT}" git push ${USER_REMOTE_URL} if [[ -z `which hub` ]]; then @@ -261,7 +257,7 @@ if [[ $confirmation = "y" ]]; then fi fi if [[ -z `which hub` ]]; then -hub pull-request -m "Publish ${RELEASE} release" -h ${USER_GITHUB_ID}:updates_release_${RELEASE} -b apache:asf-site +hub pull-request -m "Publish ${RELEASE} release" -h ${USER_GITHUB_ID}:updates_release_${RELEASE} -b apache:release-docs else echo "Without hub, you need to create PR manually." fi diff --git a/website/.gitignore b/website/.gitignore index 072e28b..76451ba 100644 --- a/website/.gitignore +++ b/website/.gitignore @@ -1,4 +1,5 @@ _site +.doctrees .sass-cache .jekyll-metadata vendor/ diff --git a/website/_config.yml b/website/_config.yml index d5827ba..6297647 100644 --- a/website/_config.yml +++ b/website/_config.yml @@ -56,7
[beam] branch asf-site updated: Publishing website 2018/10/26 18:26:17 at commit c7adb01
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new e1ef435 Publishing website 2018/10/26 18:26:17 at commit c7adb01 e1ef435 is described below commit e1ef435c15dee9f207255287cdcefdee588aea09 Author: jenkins AuthorDate: Fri Oct 26 18:26:18 2018 + Publishing website 2018/10/26 18:26:17 at commit c7adb01 --- .../contribute/precommit-triage-guide/index.html | 30 ++-- .../images/precommit_dashboard.png | 31 + .../images/precommit_durations.png | Bin 45673 -> 0 bytes 3 files changed, 39 insertions(+), 22 deletions(-) diff --git a/website/generated-content/contribute/precommit-triage-guide/index.html b/website/generated-content/contribute/precommit-triage-guide/index.html index ddbba37..4404e67 100644 --- a/website/generated-content/contribute/precommit-triage-guide/index.html +++ b/website/generated-content/contribute/precommit-triage-guide/index.html @@ -210,7 +210,7 @@ What are fast pre-commits? Determining Slowness - Notebook + Pre-commit Dashboard Triage Process @@ -270,31 +270,17 @@ the Jenkins queue + the actual time it spends running. Pre-commit jobs are timing out after 30 minutes. This can be determined from the console log of a job. Pre-commits aren’t timing out, but the total wait time for pre-commit results -is 30m. This can be determined using a Jupyter notebook. +is 30m. -Notebook +Pre-commit Dashboard -The Beam repo contains a https://github.com/apache/beam/tree/master/.test-infra/jupyter;>Jupyter -notebook named -precommit_job_times.ipynb that can be used to gather and visualize statistics -about pre-commit running times. +The Beam Community Metrics site contains a http://104.154.241.245/d/_TNndF2iz/pre-commit-tests;>Pre-Commit +Tests dashboard showing +job timing trends. You can modify the time window (defaults to 7 days) or filter +down to a specific test suite by clicking on it. -Run the notebook. It should output a table with running times. The numbers in -the column totalDurationMinutes_all and the rows with a job_name like 4 -weeks 95th contain the target numbers for determining slowness. -If any of these numbers are above 30, triaging is required. - -Example -Here’s an example table of running times: - - - -(Note that this example was created when pre-commits did not have 30m timeouts.) - -In this example, Go pre-commits are taking approximately 14 minutes, which is -fast. Java and Python pre-commits are taking 78 and 32 minutes respectively, -which is slow. Both Java and Python pre-commits require triage. + Triage Process diff --git a/website/generated-content/images/precommit_dashboard.png b/website/generated-content/images/precommit_dashboard.png new file mode 100644 index 000..49e4065 --- /dev/null +++ b/website/generated-content/images/precommit_dashboard.png @@ -0,0 +1,31 @@ + + + + + + Sign in - Google Accounts + https://www.google.com/accounts/AccountChooser?hd=google.comcontinue=https%3A%2F%2Fappengine.google.com%2F_ah%2Fconflogin%3Fcontinue%3Dhttps%3A%2F%2Fscreenshot.googleplex.com%2Fu5CALdM0vvL.pngservice=ah;> + + + https://www.google.com/accounts/AccountChooser?hd=google.comcontinue=https%3A%2F%2Fappengine.google.com%2F_ah%2Fconflogin%3Fcontinue%3Dhttps%3A%2F%2Fscreenshot.googleplex.com%2Fu5CALdM0vvL.pngservice=ah; method="get"> + + You should turn on Javascript support. + + + + +window.onload = function() { + var redirectUrl = 'https:\x2F\x2Fwww.google.com\x2Faccounts\x2FAccountChooser?hd=google.com\x26continue=https%3A%2F%2Fappengine.google.com%2F_ah%2Fconflogin%3Fcontinue%3Dhttps%3A%2F%2Fscreenshot.googleplex.com%2Fu5CALdM0vvL.png\x26service=ah'; + var domain = 'google.com'; + var hash = window.location.hash; + if (hash) { + var match = hash.match(/[#&]Email=([^&]+)/); + if (match) { + redirectUrl += "&Email=" + match[1] + "@" + domain; + } + } + window.location.replace(redirectUrl); +}; + + + diff --git a/website/generated-content/images/precommit_durations.png b/website/generated-content/images/precommit_durations.png deleted file mode 100644 index c659677..000 Binary files a/website/generated-content/images/precommit_durations.png and /dev/null differ
[beam] branch master updated (c7adb01 -> 2307556)
This is an automated email from the ASF dual-hosted git repository. scott pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from c7adb01 Merge pull request #6842: [BEAM-5815] Update precommit triage guide for new dashboard add f532ccc Move production deployment documentation to the wiki new 2307556 Merge pull request #6839: Move production deployment documentation to the wiki The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .test-infra/metrics/README.md | 101 +++--- 1 file changed, 5 insertions(+), 96 deletions(-)
[beam] 01/01: Merge pull request #6839: Move production deployment documentation to the wiki
This is an automated email from the ASF dual-hosted git repository. scott pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 23075567fb559005c11519fca6bc8453a74e86b5 Merge: c7adb01 f532ccc Author: Scott Wegner AuthorDate: Fri Oct 26 11:25:54 2018 -0700 Merge pull request #6839: Move production deployment documentation to the wiki .test-infra/metrics/README.md | 101 +++--- 1 file changed, 5 insertions(+), 96 deletions(-)
[beam] 01/01: Merge pull request #6842: [BEAM-5815] Update precommit triage guide for new dashboard
This is an automated email from the ASF dual-hosted git repository. scott pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit c7adb012df6d0b6e21737e7bec1d1ea1cb14039d Merge: 2e55786 cb16606 Author: Scott Wegner AuthorDate: Fri Oct 26 11:25:30 2018 -0700 Merge pull request #6842: [BEAM-5815] Update precommit triage guide for new dashboard website/src/contribute/precommit-triage-guide.md | 28 +--- website/src/images/precommit_dashboard.png | 31 +++ website/src/images/precommit_durations.png | Bin 45673 -> 0 bytes 3 files changed, 38 insertions(+), 21 deletions(-)
[beam] branch master updated (2e55786 -> c7adb01)
This is an automated email from the ASF dual-hosted git repository. scott pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 2e55786 Merge pull request #6817 from HuangLED/IT add cb16606 [BEAM-5815] Update precommit triage guide for new dashboard new c7adb01 Merge pull request #6842: [BEAM-5815] Update precommit triage guide for new dashboard The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: website/src/contribute/precommit-triage-guide.md | 28 +--- website/src/images/precommit_dashboard.png | 31 +++ website/src/images/precommit_durations.png | Bin 45673 -> 0 bytes 3 files changed, 38 insertions(+), 21 deletions(-) create mode 100644 website/src/images/precommit_dashboard.png delete mode 100644 website/src/images/precommit_durations.png
svn commit: r30429 - in /release/beam: ./ 2.8.0/ 2.8.0/python/
Author: altay Date: Fri Oct 26 18:18:14 2018 New Revision: 30429 Log: Add 2.8.0 release Added: release/beam/2.8.0/ release/beam/2.8.0/apache-beam-2.8.0-source-release.zip (with props) release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.asc release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.sha512 release/beam/2.8.0/python/ release/beam/2.8.0/python/apache-beam-2.8.0.zip (with props) release/beam/2.8.0/python/apache-beam-2.8.0.zip.asc release/beam/2.8.0/python/apache-beam-2.8.0.zip.sha512 release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (with props) release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512 release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl (with props) release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.asc release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.sha512 release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_x86_64.whl (with props) release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_x86_64.whl.asc release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_x86_64.whl.sha512 release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_i686.whl (with props) release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_i686.whl.asc release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_i686.whl.sha512 release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_x86_64.whl (with props) release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_x86_64.whl.asc release/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_x86_64.whl.sha512 Modified: release/beam/latest Added: release/beam/2.8.0/apache-beam-2.8.0-source-release.zip == Binary file - no diff available. Propchange: release/beam/2.8.0/apache-beam-2.8.0-source-release.zip -- svn:mime-type = application/octet-stream Added: release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.asc == --- release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.asc (added) +++ release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.asc Fri Oct 26 18:18:14 2018 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEZLhKWtkfnCD16dmn1i5xQWCW+gAFAlvI3OUACgkQ1i5xQWCW ++gAYow/+OzGUxrxmZR1ADXrRW5nsiSnqZTZ8Ieis/TbJDcWPDOUt35OLarGq9+/K +IDO0BP2DADm8CIzEqNl2R1dAHN9WM+es+xUxzvQ4sdv9lPBFxEm7McB5SHhXb/ss +x6XrgR3t05dRMuWtvOv0fSSSPvJfPezglNDp8SR+DBSuHDM135soIBYYSiSupLSb ++8kcATiuwJ+hbw+P+0iDUTa/m6oGS2ovYmuyTwD5w+aQ18FALbEVj3veYP3EZ2eQ +brw6Adw6YHjAqixN3LimzrTaHFX2aGz2C8RA9jvRcSfAi7C5/w4WAKrDFsfJ5Kjy +KFRCNfg9utQjhpHsIGCNNA1zIybRhxfyw/11Zqe32ERMvZtqy+iTFW2XWLngxdGt +JJNb1L4RlfSmA6zocqSQ4cdWiGG0LAp2JunvUDVwP1K7Ik/arkkaZ/V3LzyJ5CMU +w6sXx/BotD7RJiO0p7svIJCQYfH/ITbtIeAx4VNWu1JbNw13V0b5cmKWPgXlbAwR +I+zOMWV5GKDP42Wxvmvhzf7jUJANeXupyyP+l6g8B+dbeRDGZqGyba3cxcxj47cd +XW5ictq8Vi7Xv7rpstws5BNmWpVJiYBXeZlQlxBUyHqSkvWiNtBGXU4Kva8jF6du +0/N3R7U+ExucjbmVCFvZuSMH22+Meui3r0XTP2SqSVotdTuK4RA= +=PzTC +-END PGP SIGNATURE- Added: release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.sha512 == --- release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.sha512 (added) +++ release/beam/2.8.0/apache-beam-2.8.0-source-release.zip.sha512 Fri Oct 26 18:18:14 2018 @@ -0,0 +1 @@ +f333c1a4cddb6622e8ba8e00db6000b278d0dbe71c5e0fdf523df7c4b253afa9c6abef394674c8e42839443374f01296b6250d5c7b75c9d1265075e93ca54729 apache-beam-2.8.0-source-release.zip Added: release/beam/2.8.0/python/apache-beam-2.8.0.zip == Binary file - no diff available. Propchange: release/beam/2.8.0/python/apache-beam-2.8.0.zip -- svn:mime-type = application/octet-stream Added: release/beam/2.8.0/python/apache-beam-2.8.0.zip.asc == --- release/beam/2.8.0/python/apache-beam-2.8.0.zip.asc (added) +++ release/beam/2.8.0/python/apache-beam-2.8.0.zip.asc Fri Oct 26 18:18:14 2018 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEZLhKWtkfnCD16dmn1i5xQWCW+gAFAlvI8U4ACgkQ1i5xQWCW
svn commit: r30428 - /dev/beam/2.8.0/python/
Author: altay Date: Fri Oct 26 18:16:28 2018 New Revision: 30428 Log: Add hashes and signatures for whl files. Added: dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512 dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.asc dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.sha512 dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_x86_64.whl.asc dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_x86_64.whl.sha512 dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_i686.whl.asc dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_i686.whl.sha512 dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_x86_64.whl.asc dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27mu-manylinux1_x86_64.whl.sha512 Added: dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc == --- dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc (added) +++ dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc Fri Oct 26 18:16:28 2018 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEZLhKWtkfnCD16dmn1i5xQWCW+gAFAlvTWdcACgkQ1i5xQWCW ++gAiSBAAqHpuR/eVXJJyKt5LKhl9/cYRlGvKOnXM888LfqKaP3Bh5ABtrPDuRtnp +ZCfJwygHnvNv9G+OpngvXSgv4zsSlL8NP+ZRzK0fR4+o/svf5VI1a699htzLluOL +3qRuyz72Nz7ywpmQvuLNn5VQfC8gpHt0Iy9Cg4JLyCX90gt+nFvWCySGKePQ0pk3 +BJ0WRJZZzxAqPqjHRLag+JLZPD9zFWudxfmqRpMVaEE1WlsUNsAB4jvJjEmgo5uV +qbL8bGUkm5JcI1EQtdyIc5LFUFY+XOlz5D8357scdKh5fb3LLPaNWrPeEUiOV7Hh +/ZYh6VFvTOIbHTpgRx4kqpfbSOra0h6x5gL8Y17LdJnBziTyG0lyNz6HfZtPo4DS +AcaY7h27MUw1rss8Lgo8RH/mvdaXA7MwdSnb1lnoGaZinR1YhnPha9He2JJ9GA8/ +4HLIg0aEGVUSA824ff4RhY5dgA+k4clARWkPpliP0dg6TpgigJbbBwdhfVkYyShT +G742X0OFOvDxoOBMFPR9/yRldHrWuEsh/T2rgzSLy5BS881teRrQcH6MzAB/0dTV +xLdMw8zAlETxyOC8ZnOJ6Ip29uKROpLiPjDTey6wzzIAVucA2t6qLDF6N/Gbz0mT +VGOSv+oax/rxPgEQfrxdf29OhZqmgrSQltKEuzAhBaB4CDWwipM= +=CosU +-END PGP SIGNATURE- Added: dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512 == --- dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512 (added) +++ dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512 Fri Oct 26 18:16:28 2018 @@ -0,0 +1 @@ +27ad841f430b0ba39621d168bc31bfc590f16e86a763b93ca0bc5f0d9ae731001562c772091fc00769e3784e430b507906ca75c418c2cd22ed35df5066d4ad1b apache_beam-2.8.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl Added: dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.asc == --- dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.asc (added) +++ dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.asc Fri Oct 26 18:16:28 2018 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEZLhKWtkfnCD16dmn1i5xQWCW+gAFAlvTWeIACgkQ1i5xQWCW ++gBDZxAAkaIecoKI6I8C7Fa1IkEX/pyJsRjzN7vF4+nf3U/Zu8aIzeiqWkzk6lwp +AuRyZhKgNGsE7hqK3fLi3rCbMM7gOS8YZ8I6MdeHP8g9AJT1Yma1rEWnDC4M36PO +fCbD3WWAFuvlS8UvjqFtviW9vNPk7kASbBKswlRUZ3o2dRcW6fI09U/IbQplk+3q +B4waC9hUqp3OYubj/yBRoWeOopNfBbu8dtYSmC0jOvDZkl4vb725lDdL+d6P351m +eTQLy8nBDTf04ivkW/H0ENcCQp3uPTANutiygu5uwK93vmS1uQ7i3J+unm55Lcf6 +bzSkQ3xffbu23WbZALk3ZtWLfBIuaKPCjIsDqqb9WLjvb+8NY2W66PaX/5wrJp5Y +Q8pqzVeow81DW8wA0YUUJ02VuTxOuJ60kcesoo29U2NeGSi4tuiv7/NfVzdZ7/d8 +Po6/RDerRZnQ2qrlc+lTpu/893kzc4qMbxCvmF/WfjxKkgnvYWwVLe5X5CbqJ6RE +U3GDXEdHwKW2WDM2Ddh1t+P9EDGGyhR0GyCIE+pE487sR7raeuCsvEaU60g1mgg8 +MEQWknrobhhltRkeVCQqeYOto4QqSldZXdmfu+0O2FzDtoe2K4uOkBVBFMbEScoh +ZK7DWKcqj0LUVtGS4dczenFRu9knJvn1xOQA5M8eRNbYrkPtL8A= +=Rxcn +-END PGP SIGNATURE- Added: dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.sha512 == --- dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.sha512 (added) +++ dev/beam/2.8.0/python/apache_beam-2.8.0-cp27-cp27m-manylinux1_i686.whl.sha512
[beam] branch master updated (eb3b575 -> 2e55786)
This is an automated email from the ASF dual-hosted git repository. ccy pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from eb3b575 Merge pull request #6725: [BEAM-5716] Reorganize testing modules add f684e83 Migrate existing streaming integration test to using customized dataflow worker jar. add 2e55786 Merge pull request #6817 from HuangLED/IT No new revisions were added by this update. Summary of changes: sdks/python/build.gradle | 12 +++- sdks/python/scripts/run_postcommit.sh | 19 +-- 2 files changed, 28 insertions(+), 3 deletions(-)
[beam] annotated tag v2.8.0 updated (5d3c645 -> ac9a599)
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to annotated tag v2.8.0 in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag v2.8.0 was modified! *** from 5d3c645 (commit) to ac9a599 (tag) tagging 37bdc1a6a33ef695c1b74eced3dcb39f805481b5 (tag) length 186 bytes by Ahmet Altay on Fri Oct 26 10:47:16 2018 -0700 - Log - Tag 2.8.0 release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEZLhKWtkfnCD16dmn1i5xQWCW+gAFAlvTUy8ACgkQ1i5xQWCW +gAUsA//ZT9/juIo+p4Gh3vjSVii6Q58/ocWArU6PANjGmaK22aettoRDxns867E w/Qs4H39hHAxWyW7EcoUWN0d2g5em/qKt3nq91+NY59/5zCK1Ezy2fKW0RHQ9rRp wjyQDED3hBlJXKaJyGHpWR7ZMijv9lio4lhnM0zRQZKLFEySXkkpFHVjKRjvdjHc JBXMXWjh+mpdWL9hnKG4jLMMcwzweeRZX2aayW6s9ZwVVQIHZsdsYAmtZmcLmK1O ZAAr4VSRYpiXIL5ye8dzGLde1tegG/P+2Op96DWzdT1cZfkl0tuQuzKJb+paWfyL tAPSROK7d8Q9ZC71wYLGSIGW2yPRbj2HgI8z4CDTV00TUhCxDriH6hLQhXxo+FaG kbM9BQMCNMW40gLc8/QNGsnWg46fAPt0ZKCb2adIZLVFBH3aa+Qfgzhb1MXWPegm mXyh+T9wWb8QF2BiBmImYIQ33dVLxAv3tPWvCFq8Ce7wcKhyRD8t3nQlkCajUyxX YyE9S7ZsAZ3G8ebI1C8yD3TMeUabA5dJ+H03HiVR+NGIJqF3a3EC5OqM7c+kA+nj TozZ8gQbtwVIa/p7aue87SnC8muj5u/F97W+TC2fNxCDcT85DNu86H1cUI8gxK0Z DchtbJ9bJ4k89KQp46skYkBNQuQ1CQUGLsQ5QJ7h2wk/HznrYT8= =W66R -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
svn commit: r30426 - in /dev/beam: 2.3.0/ 2.4.0/ 2.5.0/ 2.6.0/ 2.7.0/ latest
Author: altay Date: Fri Oct 26 17:30:50 2018 New Revision: 30426 Log: Delete old releases from dev repo Removed: dev/beam/2.3.0/ dev/beam/2.4.0/ dev/beam/2.5.0/ dev/beam/2.6.0/ dev/beam/2.7.0/ Modified: dev/beam/latest Modified: dev/beam/latest == --- dev/beam/latest (original) +++ dev/beam/latest Fri Oct 26 17:30:50 2018 @@ -1 +1 @@ -link 2.5.0 \ No newline at end of file +link 2.8.0/ \ No newline at end of file
[beam] branch asf-site updated: Publishing website 2018/10/26 12:54:22 at commit eb3b575
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new f8b5e25 Publishing website 2018/10/26 12:54:22 at commit eb3b575 f8b5e25 is described below commit f8b5e2503df99191457477976728f9c56a0a178e Author: jenkins AuthorDate: Fri Oct 26 12:54:23 2018 + Publishing website 2018/10/26 12:54:22 at commit eb3b575 --- .../documentation/dsls/sql/aggregate-functions/index.html | 2 +- .../documentation/dsls/sql/create-external-table/index.html | 2 +- .../documentation/dsls/sql/data-types/index.html | 2 +- website/generated-content/documentation/dsls/sql/joins/index.html | 2 +- .../generated-content/documentation/dsls/sql/lexical/index.html | 2 +- .../generated-content/documentation/dsls/sql/overview/index.html | 2 +- .../documentation/dsls/sql/scalar-functions/index.html| 2 +- .../generated-content/documentation/dsls/sql/select/index.html| 2 +- website/generated-content/documentation/dsls/sql/set/index.html | 2 +- website/generated-content/documentation/dsls/sql/shell/index.html | 2 +- .../documentation/dsls/sql/user-defined-functions/index.html | 2 +- .../documentation/dsls/sql/walkthrough/index.html | 2 +- .../documentation/dsls/sql/windowing-and-triggering/index.html| 2 +- .../documentation/sdks/feature-comparison/index.html | 2 +- website/generated-content/documentation/sdks/go/index.html| 2 +- .../documentation/sdks/java-extensions/index.html | 2 +- .../documentation/sdks/java-thirdparty/index.html | 2 +- .../generated-content/documentation/sdks/java/euphoria/index.html | 2 +- website/generated-content/documentation/sdks/java/index.html | 4 ++-- .../documentation/sdks/java/{ => testing}/nexmark/index.html | 8 .../documentation/sdks/python-custom-io/index.html| 2 +- .../documentation/sdks/python-pipeline-dependencies/index.html| 2 +- .../documentation/sdks/python-streaming/index.html| 2 +- .../documentation/sdks/python-type-safety/index.html | 2 +- website/generated-content/documentation/sdks/python/index.html| 2 +- 25 files changed, 29 insertions(+), 29 deletions(-) diff --git a/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html b/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html index 2400201..2fd1aea 100644 --- a/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html +++ b/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html @@ -157,7 +157,7 @@ Java SDK extensions Java 3rd party extensions -Nexmark benchmark suite +Nexmark benchmark suite diff --git a/website/generated-content/documentation/dsls/sql/create-external-table/index.html b/website/generated-content/documentation/dsls/sql/create-external-table/index.html index 6113ff4..b8e27c2 100644 --- a/website/generated-content/documentation/dsls/sql/create-external-table/index.html +++ b/website/generated-content/documentation/dsls/sql/create-external-table/index.html @@ -157,7 +157,7 @@ Java SDK extensions Java 3rd party extensions -Nexmark benchmark suite +Nexmark benchmark suite diff --git a/website/generated-content/documentation/dsls/sql/data-types/index.html b/website/generated-content/documentation/dsls/sql/data-types/index.html index bb387bc..5ad432a 100644 --- a/website/generated-content/documentation/dsls/sql/data-types/index.html +++ b/website/generated-content/documentation/dsls/sql/data-types/index.html @@ -157,7 +157,7 @@ Java SDK extensions Java 3rd party extensions -Nexmark benchmark suite +Nexmark benchmark suite diff --git a/website/generated-content/documentation/dsls/sql/joins/index.html b/website/generated-content/documentation/dsls/sql/joins/index.html index 43a19bc..acaf88c 100644 --- a/website/generated-content/documentation/dsls/sql/joins/index.html +++ b/website/generated-content/documentation/dsls/sql/joins/index.html @@ -157,7 +157,7 @@ Java SDK extensions Java 3rd party extensions -Nexmark benchmark suite +Nexmark benchmark suite diff --git a/website/generated-content/documentation/dsls/sql/lexical/index.html b/website/generated-content/documentation/dsls/sql/lexical/index.html index b2dda41..962cb52 100644 --- a/website/generated-content/documentation/dsls/sql/lexical/index.html +++ b/website/generated-content/documentation/dsls/sql/lexical/index.html @@ -157,7 +157,7 @@ Java SDK extensions Java 3rd party extensions -Nexmark benchmark suite +Nexmark benchmark suite diff --git
[beam] branch master updated (fbc76dd -> eb3b575)
This is an automated email from the ASF dual-hosted git repository. lgajowy pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from fbc76dd Merge pull request #6813 [BEAM-2717] Emit coders in generated protos. add 0074138 [BEAM-5716] Move nexmark to "testing" directory in java sdk add 6674c9d [BEAM-5716] Move load-tests code to "testing" directory in java sdk add 0628951 [BEAM-5716] Create module for testing utils add 69730fc [BEAM-5716] Extract MetricReader class, test it and use in Nexmark code add 7374eb6 [BEAM-5355] Use MetricsReader in GroupByKeyLoadTest new eb3b575 Merge pull request #6725: [BEAM-5716] Reorganize testing modules The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/java/{nexmark => testing}/OWNERS | 1 + sdks/java/{ => testing}/load-tests/OWNERS | 0 sdks/java/{ => testing}/load-tests/build.gradle| 1 + .../beam/sdk/loadtests/GroupByKeyLoadTest.java | 41 +- .../apache/beam/sdk/loadtests/package-info.java| 0 sdks/java/{ => testing}/nexmark/OWNERS | 0 sdks/java/{ => testing}/nexmark/build.gradle | 1 + .../java/org/apache/beam/sdk/nexmark/Main.java | 0 .../java/org/apache/beam/sdk/nexmark/Monitor.java | 0 .../beam/sdk/nexmark/NexmarkConfiguration.java | 0 .../apache/beam/sdk/nexmark/NexmarkLauncher.java | 159 +++-- .../apache/beam/sdk/nexmark/NexmarkOptions.java| 0 .../org/apache/beam/sdk/nexmark/NexmarkPerf.java | 0 .../org/apache/beam/sdk/nexmark/NexmarkSuite.java | 0 .../org/apache/beam/sdk/nexmark/NexmarkUtils.java | 0 .../org/apache/beam/sdk/nexmark/PubsubHelper.java | 0 .../org/apache/beam/sdk/nexmark/model/Auction.java | 0 .../apache/beam/sdk/nexmark/model/AuctionBid.java | 0 .../beam/sdk/nexmark/model/AuctionCount.java | 0 .../beam/sdk/nexmark/model/AuctionPrice.java | 0 .../org/apache/beam/sdk/nexmark/model/Bid.java | 0 .../beam/sdk/nexmark/model/BidsPerSession.java | 0 .../beam/sdk/nexmark/model/CategoryPrice.java | 0 .../org/apache/beam/sdk/nexmark/model/Done.java| 0 .../org/apache/beam/sdk/nexmark/model/Event.java | 0 .../beam/sdk/nexmark/model/IdNameReserve.java | 0 .../apache/beam/sdk/nexmark/model/KnownSize.java | 0 .../beam/sdk/nexmark/model/NameCityStateId.java| 0 .../org/apache/beam/sdk/nexmark/model/Person.java | 0 .../apache/beam/sdk/nexmark/model/SellerPrice.java | 0 .../beam/sdk/nexmark/model/package-info.java | 0 .../apache/beam/sdk/nexmark/model/sql/RowSize.java | 0 .../beam/sdk/nexmark/model/sql/SelectEvent.java| 0 .../nexmark/model/sql/adapter/package-info.java| 0 .../beam/sdk/nexmark/model/sql/package-info.java | 0 .../org/apache/beam/sdk/nexmark/package-info.java | 0 .../sdk/nexmark/queries/AbstractSimulator.java | 0 .../beam/sdk/nexmark/queries/AuctionOrBid.java | 0 .../beam/sdk/nexmark/queries/NexmarkQuery.java | 0 .../sdk/nexmark/queries/NexmarkQueryModel.java | 0 .../apache/beam/sdk/nexmark/queries/Query0.java| 0 .../beam/sdk/nexmark/queries/Query0Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query1.java| 0 .../apache/beam/sdk/nexmark/queries/Query10.java | 0 .../apache/beam/sdk/nexmark/queries/Query11.java | 0 .../apache/beam/sdk/nexmark/queries/Query12.java | 0 .../beam/sdk/nexmark/queries/Query1Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query2.java| 0 .../beam/sdk/nexmark/queries/Query2Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query3.java| 0 .../beam/sdk/nexmark/queries/Query3Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query4.java| 0 .../beam/sdk/nexmark/queries/Query4Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query5.java| 0 .../beam/sdk/nexmark/queries/Query5Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query6.java| 0 .../beam/sdk/nexmark/queries/Query6Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query7.java| 0 .../beam/sdk/nexmark/queries/Query7Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query8.java| 0 .../beam/sdk/nexmark/queries/Query8Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query9.java| 0 .../beam/sdk/nexmark/queries/Query9Model.java | 0 .../beam/sdk/nexmark/queries/WinningBids.java | 0 .../sdk/nexmark/queries/WinningBidsSimulator.java | 0 .../beam/sdk/nexmark/queries/package-info.java | 0 .../sdk/nexmark/queries/sql/NexmarkSqlQuery.java | 0 .../beam/sdk/nexmark/queries/sql/SqlQuery0.java| 0
[beam] 01/01: Merge pull request #6725: [BEAM-5716] Reorganize testing modules
This is an automated email from the ASF dual-hosted git repository. lgajowy pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit eb3b57554d9dc4057ad79bdd56c4239bd4204656 Merge: fbc76dd 7374eb6 Author: Łukasz Gajowy AuthorDate: Fri Oct 26 14:53:33 2018 +0200 Merge pull request #6725: [BEAM-5716] Reorganize testing modules [BEAM-5716] Reorganize testing modules sdks/java/{nexmark => testing}/OWNERS | 1 + sdks/java/{ => testing}/load-tests/OWNERS | 0 sdks/java/{ => testing}/load-tests/build.gradle| 1 + .../beam/sdk/loadtests/GroupByKeyLoadTest.java | 41 +- .../apache/beam/sdk/loadtests/package-info.java| 0 sdks/java/{ => testing}/nexmark/OWNERS | 0 sdks/java/{ => testing}/nexmark/build.gradle | 1 + .../java/org/apache/beam/sdk/nexmark/Main.java | 0 .../java/org/apache/beam/sdk/nexmark/Monitor.java | 0 .../beam/sdk/nexmark/NexmarkConfiguration.java | 0 .../apache/beam/sdk/nexmark/NexmarkLauncher.java | 159 +++-- .../apache/beam/sdk/nexmark/NexmarkOptions.java| 0 .../org/apache/beam/sdk/nexmark/NexmarkPerf.java | 0 .../org/apache/beam/sdk/nexmark/NexmarkSuite.java | 0 .../org/apache/beam/sdk/nexmark/NexmarkUtils.java | 0 .../org/apache/beam/sdk/nexmark/PubsubHelper.java | 0 .../org/apache/beam/sdk/nexmark/model/Auction.java | 0 .../apache/beam/sdk/nexmark/model/AuctionBid.java | 0 .../beam/sdk/nexmark/model/AuctionCount.java | 0 .../beam/sdk/nexmark/model/AuctionPrice.java | 0 .../org/apache/beam/sdk/nexmark/model/Bid.java | 0 .../beam/sdk/nexmark/model/BidsPerSession.java | 0 .../beam/sdk/nexmark/model/CategoryPrice.java | 0 .../org/apache/beam/sdk/nexmark/model/Done.java| 0 .../org/apache/beam/sdk/nexmark/model/Event.java | 0 .../beam/sdk/nexmark/model/IdNameReserve.java | 0 .../apache/beam/sdk/nexmark/model/KnownSize.java | 0 .../beam/sdk/nexmark/model/NameCityStateId.java| 0 .../org/apache/beam/sdk/nexmark/model/Person.java | 0 .../apache/beam/sdk/nexmark/model/SellerPrice.java | 0 .../beam/sdk/nexmark/model/package-info.java | 0 .../apache/beam/sdk/nexmark/model/sql/RowSize.java | 0 .../beam/sdk/nexmark/model/sql/SelectEvent.java| 0 .../nexmark/model/sql/adapter/package-info.java| 0 .../beam/sdk/nexmark/model/sql/package-info.java | 0 .../org/apache/beam/sdk/nexmark/package-info.java | 0 .../sdk/nexmark/queries/AbstractSimulator.java | 0 .../beam/sdk/nexmark/queries/AuctionOrBid.java | 0 .../beam/sdk/nexmark/queries/NexmarkQuery.java | 0 .../sdk/nexmark/queries/NexmarkQueryModel.java | 0 .../apache/beam/sdk/nexmark/queries/Query0.java| 0 .../beam/sdk/nexmark/queries/Query0Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query1.java| 0 .../apache/beam/sdk/nexmark/queries/Query10.java | 0 .../apache/beam/sdk/nexmark/queries/Query11.java | 0 .../apache/beam/sdk/nexmark/queries/Query12.java | 0 .../beam/sdk/nexmark/queries/Query1Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query2.java| 0 .../beam/sdk/nexmark/queries/Query2Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query3.java| 0 .../beam/sdk/nexmark/queries/Query3Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query4.java| 0 .../beam/sdk/nexmark/queries/Query4Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query5.java| 0 .../beam/sdk/nexmark/queries/Query5Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query6.java| 0 .../beam/sdk/nexmark/queries/Query6Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query7.java| 0 .../beam/sdk/nexmark/queries/Query7Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query8.java| 0 .../beam/sdk/nexmark/queries/Query8Model.java | 0 .../apache/beam/sdk/nexmark/queries/Query9.java| 0 .../beam/sdk/nexmark/queries/Query9Model.java | 0 .../beam/sdk/nexmark/queries/WinningBids.java | 0 .../sdk/nexmark/queries/WinningBidsSimulator.java | 0 .../beam/sdk/nexmark/queries/package-info.java | 0 .../sdk/nexmark/queries/sql/NexmarkSqlQuery.java | 0 .../beam/sdk/nexmark/queries/sql/SqlQuery0.java| 0 .../beam/sdk/nexmark/queries/sql/SqlQuery1.java| 0 .../beam/sdk/nexmark/queries/sql/SqlQuery2.java| 0 .../beam/sdk/nexmark/queries/sql/SqlQuery3.java| 0 .../beam/sdk/nexmark/queries/sql/SqlQuery5.java| 0 .../beam/sdk/nexmark/queries/sql/SqlQuery7.java| 0 .../beam/sdk/nexmark/queries/sql/package-info.java | 0 .../sdk/nexmark/sources/BoundedEventSource.java| 0 .../sdk/nexmark/sources/UnboundedEventSource.java | 0 .../sdk/nexmark/sources/generator/Generator.java | 0 .../sources/generator/GeneratorCheckpoint.java | 0
[beam] branch master updated (a41b4d1 -> fbc76dd)
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from a41b4d1 Merge pull request #6830 Allow streaming update for Python on Dataflow. add d9b35a9 [BEAM-2717] Emit coders in generated protos. new fbc76dd Merge pull request #6813 [BEAM-2717] Emit coders in generated protos. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/python/apache_beam/pipeline.py| 35 -- sdks/python/apache_beam/pipeline_test.py | 3 +- sdks/python/apache_beam/pvalue.py | 2 +- .../runners/dataflow/dataflow_runner.py| 8 - .../runners/interactive/interactive_runner.py | 4 +-- .../runners/interactive/pipeline_analyzer.py | 3 +- .../runners/interactive/pipeline_analyzer_test.py | 4 +-- .../python/apache_beam/runners/pipeline_context.py | 15 +- .../runners/portability/fn_api_runner.py | 21 + sdks/python/apache_beam/transforms/core.py | 13 sdks/python/apache_beam/transforms/ptransform.py | 3 ++ 11 files changed, 78 insertions(+), 33 deletions(-)
[beam] 01/01: Merge pull request #6830 Allow streaming update for Python on Dataflow.
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit a41b4d139cd092aeb5c03b795d08f7e5c4e362e5 Merge: a9c f1882cc Author: Robert Bradshaw AuthorDate: Fri Oct 26 11:32:51 2018 +0200 Merge pull request #6830 Allow streaming update for Python on Dataflow. Allow streaming update for Python on Dataflow. .../python/apache_beam/options/pipeline_options.py | 21 +--- .../options/pipeline_options_validator.py | 4 .../runners/dataflow/internal/apiclient.py | 23 ++ 3 files changed, 41 insertions(+), 7 deletions(-)
[beam] 01/01: Merge pull request #6813 [BEAM-2717] Emit coders in generated protos.
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit fbc76ddd92ae5d7e66b4333e7f3ee36fe20459c5 Merge: a41b4d1 d9b35a9 Author: Robert Bradshaw AuthorDate: Fri Oct 26 11:33:19 2018 +0200 Merge pull request #6813 [BEAM-2717] Emit coders in generated protos. [BEAM-2717] Emit coders in generated protos. sdks/python/apache_beam/pipeline.py| 35 -- sdks/python/apache_beam/pipeline_test.py | 3 +- sdks/python/apache_beam/pvalue.py | 2 +- .../runners/dataflow/dataflow_runner.py| 8 - .../runners/interactive/interactive_runner.py | 4 +-- .../runners/interactive/pipeline_analyzer.py | 3 +- .../runners/interactive/pipeline_analyzer_test.py | 4 +-- .../python/apache_beam/runners/pipeline_context.py | 15 +- .../runners/portability/fn_api_runner.py | 21 + sdks/python/apache_beam/transforms/core.py | 13 sdks/python/apache_beam/transforms/ptransform.py | 3 ++ 11 files changed, 78 insertions(+), 33 deletions(-)
[beam] branch master updated (a9aaaac -> a41b4d1)
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from a9c Merge pull request #6837 [BEAM-5853] Fix in RemoteGrpcPortWriteOperation add f1882cc Allow streaming update for Python on Dataflow. new a41b4d1 Merge pull request #6830 Allow streaming update for Python on Dataflow. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../python/apache_beam/options/pipeline_options.py | 21 +--- .../options/pipeline_options_validator.py | 4 .../runners/dataflow/internal/apiclient.py | 23 ++ 3 files changed, 41 insertions(+), 7 deletions(-)
[beam] branch master updated (0f9ef7c -> a9aaaac)
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0f9ef7c [BEAM-5837] Add dashboard for monitoring input data staleness (#6820) add e4ff907 Possible fix new a9c Merge pull request #6837 [BEAM-5853] Fix in RemoteGrpcPortWriteOperation The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../dataflow/worker/fn/data/RemoteGrpcPortWriteOperation.java| 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-)
[beam] 01/01: Merge pull request #6837 [BEAM-5853] Fix in RemoteGrpcPortWriteOperation
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit a9ce38c968c43bedbab614fa854cf857ddb7 Merge: 0f9ef7c e4ff907 Author: Robert Bradshaw AuthorDate: Fri Oct 26 09:22:52 2018 +0200 Merge pull request #6837 [BEAM-5853] Fix in RemoteGrpcPortWriteOperation [BEAM-5853] Possible fix in RemoteGrpcPortWriteOperation .../dataflow/worker/fn/data/RemoteGrpcPortWriteOperation.java| 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-)