See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1754/display/redirect?page=changes>
Changes: [noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided (#16675) [noreply] [BEAM-12240] Add Java 17 support (#16568) [noreply] [BEAM-13760] Add random component to default python dataflow job name ------------------------------------------ [...truncated 37.71 KB...] > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:extensions:ml:jar > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 6.983316 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.> > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :examples:java:jar > Task :sdks:java:container:pullLicenses Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] fc7db1e3aa57: Preparing 486c78e8d7a5: Preparing be748fabe6e0: Preparing 2efa7440d2a1: Preparing 318904acc85c: Preparing e1278c3b10c6: Preparing 47a93afdeeb2: Preparing d36c017ce5db: Preparing 5c0d24b3a320: Preparing 757d0ffe8243: Preparing 4084b8140a23: Preparing 93f8a06cbeba: Preparing 4bf8e377f1a3: Preparing 0fbc35d51f85: Preparing 6be21046fcff: Preparing 1e5fdc3d671c: Preparing 613ab28cf833: Preparing bed676ceab7a: Preparing 6398d5cccd2c: Preparing 0b0f2f2f5279: Preparing 93f8a06cbeba: Waiting 4bf8e377f1a3: Waiting 5c0d24b3a320: Waiting 757d0ffe8243: Waiting 0fbc35d51f85: Waiting 47a93afdeeb2: Waiting bed676ceab7a: Waiting 6398d5cccd2c: Waiting 4084b8140a23: Waiting 6be21046fcff: Waiting 0b0f2f2f5279: Waiting 613ab28cf833: Waiting e1278c3b10c6: Waiting d36c017ce5db: Waiting 318904acc85c: Pushed be748fabe6e0: Pushed 486c78e8d7a5: Pushed fc7db1e3aa57: Pushed e1278c3b10c6: Pushed d36c017ce5db: Pushed 2efa7440d2a1: Pushed 757d0ffe8243: Pushed 47a93afdeeb2: Pushed 5c0d24b3a320: Pushed 0fbc35d51f85: Layer already exists 93f8a06cbeba: Pushed 6be21046fcff: Layer already exists 1e5fdc3d671c: Layer already exists 613ab28cf833: Layer already exists bed676ceab7a: Layer already exists 6398d5cccd2c: Layer already exists 0b0f2f2f5279: Layer already exists 4bf8e377f1a3: Pushed 4084b8140a23: Pushed 20220201060100: digest: sha256:c600b0e29088b49676bdea9e63270905c1e9502c4a154eaeb0ba8e439caec2a4 size: 4520 > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0201060446-372117a The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0201060446-372117a ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1643695480775.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0201060446-372117a The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0201060446-372117a The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1643695480775.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0201060446-ae8d109a The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0201060446-ae8d109a ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1643695480871.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0201060446-ae8d109a The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0201060446-ae8d109a The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1643695480871.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220201060100 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c600b0e29088b49676bdea9e63270905c1e9502c4a154eaeb0ba8e439caec2a4 Deleted: sha256:05c3b98dfddd621e6e7ab30f7519881e95f6972f09f9d8e0040e8b07584621d5 Deleted: sha256:c1b6bcb4417ffd482050e03d8ffef3eb90c4989f56563a3fdb18a4cbac40761d Deleted: sha256:4ecd514060953cf4a2f330e299de918bd3e8f497c896efaa2e475bc95422be39 Deleted: sha256:d2fd6b47d9b5fec9bfe79741e3c0ac4a6ae8960363df32a08f1f15653b41e36b Deleted: sha256:fb5181295272c648150880eb38d3a49b166606b6736a0fdbdb95f19a68fea626 Deleted: sha256:039e1638fedc2efa22b54bbd7138de24ffdafd8cd6c10711bef5a094112b1fc2 Deleted: sha256:522a31b9ae8231694ac21dfd307731e749f330112a0fd5cc4099c84fe277f1e4 Deleted: sha256:fd297e2ac7e6317e4645acd4452d5bf55ce18631f500210600ce574c98513bed Deleted: sha256:49f3b8f0318404f1e43c12116b39bfbbdb4b4f2f1870c47a876f8187b276a345 Deleted: sha256:80242cd15775af31eda8be1540f3f3733135892fab8f81e67e7426a46bb38eab Deleted: sha256:781f5c0b9e81c4cb3638766926446f2ffd71fa4e5fc5c3495e2e1fb17b769a71 Deleted: sha256:d3b649b5d336faf2a7831925012ec267bdb4fc1b663e7bb7670280134a8bd732 Deleted: sha256:13e436b9fdc3d4bb857901dc9b38f30bdf116f47f0bac4153a9808f467278dbd Deleted: sha256:79d215912c8a7cb9f366373f9d5c81d31d3b50d5a77f0af9b357ec54ff095268 Deleted: sha256:c1016965c17a30aa24511ebcb4d0a7f80cdda3f95c00bfb2a07f5607b6520dbc Deleted: sha256:4264dd820d5903332398f33b68148316652f21ed891db7cbaa9ee659fd247faa Deleted: sha256:a2aa73481fd89a44d74787ab303920abe6e1c3492edee1a8879e5bfd977e17f3 Deleted: sha256:834cf241e094b18138af0d90d3ea014e3f16cecf5ee98a6a6a59fdc6ee890efb Deleted: sha256:37534d0f6006440a7c47cb6647059317eb4216dc9f1e5f0d34b426cbae1ec613 Deleted: sha256:c6d52f3b379c630150ad1cfee7bd7a5a329d4a3f0049e32f844256c0682ed06b Deleted: sha256:7e7a9520efc70d7178286ee8f6311e19a2e3b6ab5ed83fffb23633ec539f6e5b Deleted: sha256:df4c2c7566ec0f8c4524c6d59c36df84c9916baf935782626da254a0e869684b Deleted: sha256:6979481109c44f736437fb8892a09ed2441e860eb869c0678b7f48d39ef389d4 Deleted: sha256:6c2073a209785b0455fa4a437b35718c1872f011621602534be137c7ce48573f Deleted: sha256:98fa13e9d10de784b974f290ae171ad8e080db135f53a341ccac8bf284b523b8 Deleted: sha256:c476515e67262d946b568d8206c7e0f6d48f93b7de9f588f3d33266a898ccd61 Deleted: sha256:83b97b1ee5a9bde28179e9d07c38735374302682c21b97d63bda41df7ba98657 Deleted: sha256:2ec16c2e019db1457b16ff14a9a08adfeea42177b15ace21c915cce409e8dac8 Deleted: sha256:45e708c894ab6dcac7bfa837a441a9421306624b72d2fca6e2056c1307768c38 Deleted: sha256:a0c053e7bec49514496ca9efea79f4e25364b48f98b9cef60faf957ff18c6304 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220201060100] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c600b0e29088b49676bdea9e63270905c1e9502c4a154eaeb0ba8e439caec2a4] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220201060100] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c600b0e29088b49676bdea9e63270905c1e9502c4a154eaeb0ba8e439caec2a4])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56990f4a864bfb030bfa114c24b3332f6e2d43ba80ee6793517b08e0919764ea Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56990f4a864bfb030bfa114c24b3332f6e2d43ba80ee6793517b08e0919764ea Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56990f4a864bfb030bfa114c24b3332f6e2d43ba80ee6793517b08e0919764ea]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c600b0e29088b49676bdea9e63270905c1e9502c4a154eaeb0ba8e439caec2a4 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c600b0e29088b49676bdea9e63270905c1e9502c4a154eaeb0ba8e439caec2a4 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Tue, 01 Feb 2022 06:35:54 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:c600b0e29088b49676bdea9e63270905c1e9502c4a154eaeb0ba8e439caec2a4': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 297 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 35m 28s 112 actionable tasks: 73 executed, 35 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/qcqa76x7tw6p2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
