See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1278/display/redirect?page=changes>
Changes: [danthev] Switch hintNumWorkers to ValueProvider, switch firstInstant to side [noreply] [BEAM-13000] Disable Reshuffle Translation in Samza Portable Mode ------------------------------------------ [...truncated 35.46 KB...] New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... > Task :sdks:java:harness:jar > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:container:pullLicenses done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 209 dependencies using 16 threads. > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 1.830565 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.> > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:extensions:ml:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:pullLicenses Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:io:google-cloud-platform:compileJava > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] c53a5a7585e8: Preparing 34d493c8f58c: Preparing fa41064f1e4d: Preparing fe146e8551b5: Preparing 2ed74b8aaa7a: Preparing eb8fc49986d1: Preparing aaa5d39d23a2: Preparing ec5589f7beba: Preparing 90562c044e24: Preparing 588fb05d158d: Preparing c53a5a7585e8: Waiting 0f3109d04158: Preparing fa41064f1e4d: Waiting d642bac47489: Preparing ab19b46e9384: Preparing 080ef0ba5cc0: Preparing fe146e8551b5: Waiting d08e6b97bf21: Preparing 2ed74b8aaa7a: Waiting 3054497613e6: Preparing d35dc7f4c79e: Preparing dabfe5b2ea81: Preparing 5e6a409f30b6: Preparing eb8fc49986d1: Waiting aaa5d39d23a2: Waiting d642bac47489: Waiting 5e6a409f30b6: Waiting ec5589f7beba: Waiting d08e6b97bf21: Waiting ab19b46e9384: Waiting 3054497613e6: Waiting d35dc7f4c79e: Waiting 080ef0ba5cc0: Waiting 90562c044e24: Waiting dabfe5b2ea81: Waiting 0f3109d04158: Waiting 34d493c8f58c: Pushed 0f3109d04158: Pushed d08e6b97bf21: Layer already exists 3054497613e6: Layer already exists d35dc7f4c79e: Layer already exists dabfe5b2ea81: Layer already exists 5e6a409f30b6: Layer already exists d642bac47489: Pushed fa41064f1e4d: Pushed 2ed74b8aaa7a: Pushed c53a5a7585e8: Pushed eb8fc49986d1: Pushed fe146e8551b5: Pushed 90562c044e24: Pushed ab19b46e9384: Layer already exists ec5589f7beba: Pushed 080ef0ba5cc0: Layer already exists aaa5d39d23a2: Pushed 588fb05d158d: Pushed 20211005060116: digest: sha256:35cdcb6849e0e341d80420f5c1841e44f3276b61295d465dc673c44a051727e1 size: 4311 > Task :sdks:java:io:google-cloud-platform:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:classes > Task :sdks:java:io:google-cloud-platform:jar > Task :examples:java:compileJava > Task :runners:google-cloud-dataflow-java:compileJava > Task :examples:java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:classes > Task :examples:java:jar > Task :examples:java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:testClasses > Task :examples:java:testJar > Task :runners:google-cloud-dataflow-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1005060623-892c50c9 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1005060623-892c50c9 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1633413978079.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1005060623-892c50c9 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1005060623-892c50c9 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1633413978079.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** org.apache.beam.examples.complete.TrafficMaxLaneFlowIT > testE2ETrafficMaxLaneFlow FAILED java.lang.RuntimeException at TrafficMaxLaneFlowIT.java:74 8 tests completed, 1 failed > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211005060116 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:35cdcb6849e0e341d80420f5c1841e44f3276b61295d465dc673c44a051727e1 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211005060116] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 39m 43s 104 actionable tasks: 75 executed, 27 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/ysvld7r2bapw2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
