See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/133/display/redirect?page=changes>
Changes: [ajamato] [BEAM-11994] Refactor BigQueryTornadoes to make more options [zyichi] [BEAM-12221] Add experimental pipeline option to control the execution [Kenneth Knowles] Add View.toList pipeline to translator tests [Kenneth Knowles] Temporarily disable FnApiDoFnRunnerTest.testUsingMetrics [Kenneth Knowles] Resolve beam_fn_api experiment for side inputs, using portable expansion [noreply] [BEAM-12232] Expose public factory methods in SparkJobServerDriver [Kyle Weaver] [BEAM-12009] Enable Calc splitting rule by default. [noreply] [BEAM-12016] Initial implementation for add_suffix, add_prefix (#14623) ------------------------------------------ [...truncated 61.55 KB...] Using cached six-1.15.0-py2.py3-none-any.whl (10 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto] Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug] Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net] Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2] Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync] > Task :sdks:java:container:pullLicenses Successfully installed beautifulsoup4-4.9.3 future-0.18.2 pyyaml-5.3.1 six-1.15.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 207 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 6.82245 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Unable to watch the file system for changes. The inotify watches limit is too low. Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 2a865320966b: Preparing e99783212c10: Preparing edd89ac33348: Preparing 4f46b45accb7: Preparing d5358fb2d316: Preparing 6327c1eab8c8: Preparing cdfe957be884: Preparing 5e2d7800b5e1: Preparing 67ebaae180dd: Preparing 1a599263b4d7: Preparing 3614603af2de: Preparing d8460eb1eb77: Preparing 30b0cc543ee7: Preparing 26863b4714ee: Preparing 5d5962699bd5: Preparing a42439ce9650: Preparing 26270c5e25fa: Preparing e2c6ff462357: Preparing 26863b4714ee: Waiting 67ebaae180dd: Waiting d8460eb1eb77: Waiting 6327c1eab8c8: Waiting cdfe957be884: Waiting 1a599263b4d7: Waiting 30b0cc543ee7: Waiting 3614603af2de: Waiting 5e2d7800b5e1: Waiting a42439ce9650: Waiting 26270c5e25fa: Waiting e2c6ff462357: Waiting 5d5962699bd5: Waiting 4f46b45accb7: Pushed 2a865320966b: Pushed e99783212c10: Pushed d5358fb2d316: Pushed 5e2d7800b5e1: Pushed edd89ac33348: Pushed cdfe957be884: Pushed d8460eb1eb77: Layer already exists 30b0cc543ee7: Layer already exists 26863b4714ee: Layer already exists 5d5962699bd5: Layer already exists a42439ce9650: Layer already exists 26270c5e25fa: Layer already exists e2c6ff462357: Layer already exists 1a599263b4d7: Pushed 3614603af2de: Pushed 6327c1eab8c8: Pushed 67ebaae180dd: Pushed 20210428000057: digest: sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b size: 4099 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExportUsingQuery FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:70 Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED java.lang.IllegalArgumentException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:70 Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:70 Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70 *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000907-efa2650c The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000907-efa2650c ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1619568543559.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000907-efa2650c The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000907-efa2650c The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1619568543559.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000937-331ac828 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000937-331ac828 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1619568576948.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000937-331ac828 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000937-331ac828 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1619568576948.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** 8 tests completed, 4 failed > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > FAILED > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428000057 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b Deleted: sha256:069b4c62fd63cf1f9eb248883c4c79ffb1807e30c9e26103fcbe071fc18889cb Deleted: sha256:272f90cac86d1330eb2ddd785a9a3fc3651c2c548b7e138591e6380743b26059 Deleted: sha256:b4262e197498f24706e80feb872187e8522f32898b0164628176d6a4e687fd92 Deleted: sha256:b151c782897f51d69de7281648dce74e6b56cb66075e50303a5ca1e385dc21c4 Deleted: sha256:b240d3de267a56ff384ef260bb475a5d45d8e517e5a95fbf5fe67d73c3093023 Deleted: sha256:886f4ce339bb4277d402d2c73c3aedef030ecfdaa21999de3e111e82a6d4444b Deleted: sha256:b3096da350d2cb3a21d9fe2be71efee3f74d6ee1f8ca885fdfac727adac6c9d6 Deleted: sha256:0fb4d0af77404c306fb69affaa2aa6f0da24dd13e947651e6c11793c429a5e54 Deleted: sha256:1e194a2ef4942796686e963c45edad37d06a09cd01ca3b03345a7b5dd6f1ef9c Deleted: sha256:cfabde9f009853997b26944b6db405aa7d4da607e04537476b0625fe61217f0c Deleted: sha256:0842a77f073cc637b10182873a49c5a6c88f88fd21b4a3af9f970a252ed3287d Deleted: sha256:cfb03343bc7ce152499723ff1f3e8070a96eb863c5e881781e7a8f39155854e8 Deleted: sha256:2ec1632359f48f6e02d7e83c9ef704ac88d8cc39104992eb7d63ba544086eee5 Deleted: sha256:a012c69e546348241dc475e8325ebc21ac1ffdf70ed4845ed87cd3bffcf3d538 Deleted: sha256:9b65aac8ca73a89af0a77ff0b9f1c441e7690fc507c25ae8f0e59e9c181003b8 Deleted: sha256:a82075d055ed4a656ca2660dc6700df312669a64a58642e2db45052c0f4cabf3 Deleted: sha256:3311b2d0ca4f4e31e68035d1028137c5f9eed6d11656734776450da746e51cea Deleted: sha256:a068cab432e8d03555afc6e4203496c0b906c9313f45ddbf0b52dc97fe25adb6 Deleted: sha256:ef6de77dd5077f7a6ac50933aacb3f316e860da52201b728226ff05f1c9a70e0 Deleted: sha256:30103963436b286e6dc7fa6144c543c2c3ccbc315dc167048ce74d2902cc5997 Deleted: sha256:74f0aa2ab3a9acc2d91774c91ead9acb540217233d4cba8fb13d7c0161e6130e Deleted: sha256:d90ac23683b6d53d032f884e9ac61bf5678defcb0ab2c2470fa28b4a7fc4e078 Deleted: sha256:6bc309457ebba15b6c12464239a0148a3a0c4a4592f52aad134568b7d07408cd Deleted: sha256:aa3a364320d3599799b72a97125473621567cded816a9d5e8ad4888d3c17c222 Deleted: sha256:a838a522fceb20e7eae17a00f2aa18f635e79258cf087e8e1f94c3e50648b27c Deleted: sha256:a90fcf8f25e2ae224a0d1c37fea7fb99daf3343fafb98e007da41c07674fbfb9 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b Associated tags: - 20210428000057 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428000057 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428000057]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 23m 3s 125 actionable tasks: 86 executed, 37 from cache, 2 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/tvteqdwdhnt26 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
