See <https://ci-beam.apache.org/job/beam_PostCommit_Java/7325/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-10943] Add builtin functions in the Calcite planner. [chamikaramj] Removes non-interactive from SVN commands [Ismaël Mejía] [BEAM-11972] Close all opened channels/readers on ParquetIO [emilyye] add environment caching to custom container instructions [chamikaramj] Limits Dataflow GCR container image overriding to external Apache Beam [noreply] [BEAM-5628] remove vcfio.py and concerning resources (#14185) ------------------------------------------ [...truncated 98.40 KB...] > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar > FROM-CACHE > Task > :runners:google-cloud-dataflow-java:coreSDKJavaLegacyWorkerIntegrationTest > NO-SOURCE > Task > :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest > FROM-CACHE > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerIntegrationTest > FROM-CACHE > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerKmsIntegrationTest > FROM-CACHE > Task :runners:google-cloud-dataflow-java:postCommit UP-TO-DATE > Task :sdks:java:io:debezium:integrationTest > Task :sdks:java:io:google-cloud-platform:integrationTest > Task :sdks:java:extensions:zetasketch:integrationTest > Task :sdks:java:extensions:ml:postCommit > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:io:parquet:hadoopVersion285Test > Task :sdks:java:io:kafka:kafkaVersion01103Test > Task :sdks:java:io:hadoop-file-system:hadoopVersion285Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO2101IT > Task :sdks:java:io:parquet:hadoopVersion292Test > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:java:io:hadoop-format:runHadoopFormatIO2101Test > Task :sdks:java:io:kafka:kafkaVersion100BatchIT > Task :sdks:java:io:hadoop-file-system:hadoopVersion292Test > Task :sdks:java:io:parquet:hadoopVersion321Test > Task :sdks:java:io:kafka:kafkaVersion100Test > Task :sdks:java:io:parquet:hadoopVersionsTest > Task :sdks:java:io:hadoop-file-system:hadoopVersion321Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285ElasticIT > Task :sdks:java:io:kafka:kafkaVersion111BatchIT > Task :sdks:java:io:hadoop-file-system:hadoopVersionsTest > Task :sdks:java:io:kafka:kafkaVersion111Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285IT > Task :sdks:java:io:kafka:kafkaVersion201BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285Test > Task :sdks:java:io:kafka:kafkaVersion201Test > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] > Task :sdks:java:io:kafka:kafkaVersion211BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292ElasticIT > Task :sdks:java:io:kafka:kafkaVersion211Test > Task :sdks:java:io:google-cloud-platform:integrationTestKms > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292IT > Task :sdks:java:io:kafka:kafkaVersion222BatchIT > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292Test > Task :sdks:java:io:kafka:kafkaVersion222Test > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker Sending build context to Docker daemon 185.8MB Step 1/17 : ARG java_version Step 2/17 : FROM openjdk:${java_version} ---> d6776a9d05ba Step 3/17 : MAINTAINER "Apache Beam <[email protected]>" ---> Running in 2d263b5cea6a Removing intermediate container 2d263b5cea6a ---> 75a88bca1ad3 Step 4/17 : ARG pull_licenses ---> Running in 9802a339d0c9 Removing intermediate container 9802a339d0c9 ---> 5e1f50197bf7 Step 5/17 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> c1b53a0cecd6 Step 6/17 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> 919aa20fe2ab Step 7/17 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ ---> ee63e59515ae Step 8/17 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> dd663dbd8e5a Step 9/17 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> 6156dba4be32 Step 10/17 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 19ebc05c6d2f Step 11/17 : COPY target/LICENSE /opt/apache/beam/ ---> 646ab6dc5746 Step 12/17 : COPY target/NOTICE /opt/apache/beam/ ---> db066d5efcc4 Step 13/17 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> 9ad9901b65ab Step 14/17 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 3459ea5a57a3 Step 15/17 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 33b33a9bb9c8 Removing intermediate container 33b33a9bb9c8 ---> 715807c74b9c Step 16/17 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in da1170bfa442 Removing intermediate container da1170bfa442 ---> bbf4c95135e8 Step 17/17 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in a290dd81b8e2 Removing intermediate container a290dd81b8e2 ---> 0a011627fb45 Successfully built 0a011627fb45 Successfully tagged apache/beam_java8_sdk:2.30.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :sdks:java:io:kafka:kafkaVersion231BatchIT > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer 5faad05f1bc3: Pushed 20210316000100: digest: sha256:cfdb3a0e7c1b98b10b90c20831991931263791837b0931fc5079057d834e0980 size: 4098 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :sdks:java:io:kafka:kafkaVersion231Test > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321ElasticIT > Task :sdks:java:io:google-cloud-platform:postCommit > Task :sdks:java:io:kafka:kafkaVersion241BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321IT > Task :sdks:java:io:kafka:kafkaVersion241Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321Test > Task :sdks:java:io:kafka:kafkaVersion251BatchIT > Task :sdks:java:io:kafka:kafkaVersion251Test > Task :sdks:java:io:hadoop-format:hadoopVersionsTest > Task :javaHadoopVersionsTest > Task :sdks:java:io:kafka:kafkaVersionsCompatibilityTest > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0316001248-4d1af016 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316001248-4d1af016 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1615853562039.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0316001248-4d1af016 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316001248-4d1af016 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1615853562039.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task :sdks:java:extensions:zetasketch:postCommit > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0316004317-b429e8cb The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316004317-b429e8cb ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1615855396563.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0316004317-b429e8cb The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0316004317-b429e8cb The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1615855396563.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED java.lang.AssertionError at PubsubReadIT.java:90 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED java.lang.AssertionError at PubsubReadIT.java:62 36 tests completed, 2 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfdb3a0e7c1b98b10b90c20831991931263791837b0931fc5079057d834e0980 Associated tags: - 20210316000100 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210316000100 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210316000100]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfdb3a0e7c1b98b10b90c20831991931263791837b0931fc5079057d834e0980]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2h 0m 27s 252 actionable tasks: 164 executed, 86 from cache, 2 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/pr2lanhjmysjy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
