See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/573/display/redirect?page=changes>
Changes: [ilya.kozyrev] Add java executor to compile java code in created file system [zyichi] Use daemon thread to report lull operation and move code to [noreply] Merge pull request #15722 from [BEAM-13022] [Playground] Run code on the [noreply] [BEAM-12922] Test MapState putIfAbsent with no read (#15704) ------------------------------------------ [...truncated 30.25 KB...] File "SimpleCharStream.java" does not exist. Will create one. Parser generated with 0 errors and 1 warnings. > Task :sdks:java:extensions:sql:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:processResources > Task :model:fn-execution:extractIncludeProto > Task :model:pipeline:shadowJar FROM-CACHE > Task :model:job-management:extractIncludeProto > Task :model:fn-execution:generateProto FROM-CACHE > Task :model:job-management:generateProto FROM-CACHE > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:job-management:shadowJar FROM-CACHE > Task :model:fn-execution:shadowJar FROM-CACHE > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE go: downloading github.com/golang/protobuf v1.5.2 go: downloading google.golang.org/grpc v1.39.0 go: downloading google.golang.org/protobuf v1.27.1 > Task :sdks:java:testing:test-utils:compileJava FROM-CACHE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :runners:local-java:compileJava FROM-CACHE > Task :runners:local-java:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:jar > Task :runners:local-java:jar > Task :sdks:java:extensions:arrow:compileJava FROM-CACHE > Task :sdks:java:extensions:arrow:classes UP-TO-DATE > Task :sdks:java:io:mongodb:compileJava FROM-CACHE > Task :sdks:java:io:mongodb:classes UP-TO-DATE > Task :sdks:java:extensions:arrow:jar > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/java/container > Task :sdks:java:io:mongodb:jar > Task :sdks:java:extensions:join-library:compileJava FROM-CACHE > Task :sdks:java:extensions:join-library:classes UP-TO-DATE > Task :sdks:java:extensions:join-library:jar > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE > Task :sdks:java:io:hadoop-common:classes UP-TO-DATE > Task :sdks:java:io:hadoop-common:jar > Task :sdks:java:fn-execution:jar > Task :sdks:java:extensions:protobuf:extractIncludeProto > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE go: downloading google.golang.org/genproto v0.0.0-20210728212813-7823e685a01f go: downloading golang.org/x/net v0.0.0-20210423184538-5f58ad60dda6 go: downloading golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:io:parquet:compileJava FROM-CACHE > Task :sdks:java:io:parquet:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar > Task :sdks:java:io:parquet:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :runners:core-construction-java:jar go: downloading golang.org/x/text v0.3.6 > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :sdks:java:extensions:sql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:classes > Task :runners:google-cloud-dataflow-java:jar > Task :sdks:java:extensions:sql:jar > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:testing:nexmark:compileJava FROM-CACHE > Task :sdks:java:testing:nexmark:classes > Task :sdks:java:testing:nexmark:jar > Task :sdks:java:container:generateLicenseReport > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 1.824024 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] ef522f511df8: Preparing aa3c4db5aeb7: Preparing 25fe81ebbdd7: Preparing 7a13e746fea1: Preparing 5b32da66985c: Preparing 85184dd46207: Preparing 20f56d0fec3b: Preparing ab76a62eaa08: Preparing b05ebd52695a: Preparing 059d4d16d501: Preparing 1074b8219d8e: Preparing c67156371b8f: Preparing e78e67fa1c92: Preparing 94c94d3b2e6b: Preparing 36e0782f1159: Preparing ba6e5ff31f23: Preparing 9f9f651e9303: Preparing 0b3c02b5d746: Preparing 62a747bf1719: Preparing 1074b8219d8e: Waiting c67156371b8f: Waiting e78e67fa1c92: Waiting 94c94d3b2e6b: Waiting 36e0782f1159: Waiting ba6e5ff31f23: Waiting 9f9f651e9303: Waiting 0b3c02b5d746: Waiting 62a747bf1719: Waiting 85184dd46207: Waiting 20f56d0fec3b: Waiting ab76a62eaa08: Waiting b05ebd52695a: Waiting 059d4d16d501: Waiting 25fe81ebbdd7: Retrying in 5 seconds aa3c4db5aeb7: Retrying in 5 seconds 5b32da66985c: Retrying in 5 seconds 25fe81ebbdd7: Retrying in 4 seconds aa3c4db5aeb7: Retrying in 4 seconds 5b32da66985c: Retrying in 4 seconds 25fe81ebbdd7: Retrying in 3 seconds aa3c4db5aeb7: Retrying in 3 seconds 5b32da66985c: Retrying in 3 seconds 25fe81ebbdd7: Retrying in 2 seconds aa3c4db5aeb7: Retrying in 2 seconds 5b32da66985c: Retrying in 2 seconds 25fe81ebbdd7: Retrying in 1 second aa3c4db5aeb7: Retrying in 1 second 5b32da66985c: Retrying in 1 second error parsing HTTP 408 response body: invalid character '<' looking for beginning of value: "<!DOCTYPE html>\n<html lang=en>\n <meta charset=utf-8>\n <meta name=viewport content=\"initial-scale=1, minimum-scale=1, width=device-width\">\n <title>Error 408 (Request Timeout)!!1</title>\n <style>\n *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}\n </style>\n <a href=//www.google.com/><span id=logo aria-label=Google></span></a>\n <p><b>408.</b> <ins>That’s an error.</ins>\n <p>Your client has taken too long to issue its request. <ins>That’s all we know.</ins>\n" > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 267 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerContainer'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 56m 0s 126 actionable tasks: 87 executed, 37 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/lqmedlgh6lj26 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
