See <https://ci-beam.apache.org/job/beam_PostCommit_Java/7305/display/redirect?page=changes>
Changes: [heejong] [BEAM-11592] Adding cross-language test using third-party Python [daniel.o.programmer] [BEAM-11647] Avoid flake by splitting Go Precommit into 2 phases [sychen] Fix auto-sharding parameter for BigQuery sink with FILE LOADS [noreply] [BEAM-11613] Updates Dataflow pipelines to always use SDK Harness [noreply] [BEAM-11925] Ensure that output expression is partitioned in doctest [tysonjh] [BEAM-11377] Fix credentials regression. ------------------------------------------ [...truncated 105.83 KB...] > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285IT > Task :sdks:java:io:hcatalog:hadoopVersionsTest > Task :sdks:java:io:kafka:kafkaVersion100BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285Test > Task :sdks:java:io:kafka:kafkaVersion100Test > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:io:kafka:kafkaVersion111BatchIT > Task :sdks:java:container:resolveBuildDependencies Unable to watch the file system for changes. The inotify watches limit is too low. Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292ElasticIT > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:io:kafka:kafkaVersion111Test > Task :sdks:java:container:java8:docker > Task :runners:spark:hadoopVersion292Test > Task :sdks:java:io:kafka:kafkaVersion201BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292IT > Task :sdks:java:io:kafka:kafkaVersion201Test > Task > :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest org.apache.beam.examples.cookbook.MapClassIntegrationIT > testDataflowMapState FAILED java.lang.RuntimeException at MapClassIntegrationIT.java:69 > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292Test > Task > :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0311001550-86c2a44d The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311001550-86c2a44d ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1615421749252.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0311001550-86c2a44d The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311001550-86c2a44d The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1615421749252.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task :sdks:java:io:kafka:kafkaVersion211BatchIT > Task :sdks:java:io:google-cloud-platform:integrationTestKms > Task :sdks:java:io:kafka:kafkaVersion211Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321ElasticIT > Task :sdks:java:io:kafka:kafkaVersion222BatchIT > Task :runners:spark:hadoopVersion321Test > Task :sdks:java:io:kafka:kafkaVersion222Test > Task > :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest *********************************************************** *********************************************************** *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0311001818-c9b74652 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311001818-c9b74652 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:beam_examples.testpipeline_jenkins_0311001818_c9b74652 Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321IT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321Test > Task :sdks:java:io:kafka:kafkaVersion231BatchIT > Task :sdks:java:io:google-cloud-platform:postCommit > Task :sdks:java:io:kafka:kafkaVersion231Test > Task :sdks:java:io:hadoop-format:hadoopVersionsTest > Task :runners:spark:hadoopVersionsTest > Task :javaHadoopVersionsTest > Task :sdks:java:io:kafka:kafkaVersion241BatchIT > Task :sdks:java:io:kafka:kafkaVersion241Test > Task :sdks:java:extensions:zetasketch:postCommit > Task :sdks:java:io:kafka:kafkaVersion251BatchIT > Task :sdks:java:io:kafka:kafkaVersion251Test > Task :sdks:java:io:kafka:kafkaVersionsCompatibilityTest > Task > :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0311002603-b397425e The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311002603-b397425e ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1615422363326.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0311002603-b397425e The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311002603-b397425e The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1615422363326.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** 11 tests completed, 1 failed > Task > :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest > FAILED > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerIntegrationTest > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerKmsIntegrationTest > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 8d40b049ac2e: Preparing e70f991a157d: Preparing 791fa9a3727b: Preparing 4a6278433a16: Preparing 65878a44b164: Preparing 08d2c15b4d98: Preparing ea1d97905340: Preparing 27c8f7122f8e: Preparing 187167606aa3: Preparing 946239ea4179: Preparing 146defbfae74: Preparing 9534dfec042a: Preparing fb0b25718816: Preparing 08d2c15b4d98: Waiting e551c18d1724: Preparing da654bc8bc80: Preparing 4ef81dc52d99: Preparing 909e93c71745: Preparing 946239ea4179: Waiting 7f03bfe4d6dc: Preparing 7f03bfe4d6dc: Waiting 187167606aa3: Waiting ea1d97905340: Waiting e551c18d1724: Waiting da654bc8bc80: Waiting 4ef81dc52d99: Waiting fb0b25718816: Waiting 65878a44b164: Pushed 8d40b049ac2e: Pushed 4a6278433a16: Pushed e70f991a157d: Pushed 791fa9a3727b: Pushed 27c8f7122f8e: Pushed 946239ea4179: Pushed 9534dfec042a: Layer already exists fb0b25718816: Layer already exists e551c18d1724: Layer already exists da654bc8bc80: Layer already exists 4ef81dc52d99: Layer already exists 909e93c71745: Layer already exists ea1d97905340: Pushed 7f03bfe4d6dc: Layer already exists 08d2c15b4d98: Pushed 146defbfae74: Pushed 187167606aa3: Pushed 20210311000044: digest: sha256:8d43bae96b74ab31149f811baaee6747c92f52b81acf43037cc5e233cfed51b7 size: 4098 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0311014328-63d7ba03 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311014328-63d7ba03 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1615427004245.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0311014328-63d7ba03 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311014328-63d7ba03 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1615427004245.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0311021021-93e97aae The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311021021-93e97aae ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1615428620500.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0311021021-93e97aae The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0311021021-93e97aae The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1615428620500.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210311000044 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8d43bae96b74ab31149f811baaee6747c92f52b81acf43037cc5e233cfed51b7 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8d43bae96b74ab31149f811baaee6747c92f52b81acf43037cc5e233cfed51b7 Associated tags: - 20210311000044 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210311000044 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210311000044]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8d43bae96b74ab31149f811baaee6747c92f52b81acf43037cc5e233cfed51b7]. > Task :runners:google-cloud-dataflow-java:postCommitRunnerV2 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaLegacyWorkerIntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 21m 40s 249 actionable tasks: 179 executed, 68 from cache, 2 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/irezcctffxx6y Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
