See <https://ci-beam.apache.org/job/beam_PostCommit_Java/7324/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-8787] Don't recommend './gradlew check' to new contributors. [Kyle Weaver] [BEAM-8787] Add instructions for cloning the Beam repo. [Kyle Weaver] [BEAM-8787] cd into the newly created beam repo. [noreply] [BEAM-11963] Fix KafkaTableProviderIT (#14205) [noreply] [BEAM-9547] Implement count() on deferred DataFrame, Series (#14178) [Brian Hulette] Update partitioning ordering [Brian Hulette] Update PartitioningSession [Brian Hulette] Explicitly define the requires/preserves semantics [Brian Hulette] Reverse comparison detecting when elementwise expressions need Index [Brian Hulette] Bulk update preserves= [Brian Hulette] nunique update [Brian Hulette] TODO updates [Brian Hulette] Strong preservation assertion for PartitioningSession [Brian Hulette] Update stage fusion logic [Brian Hulette] Actually run index partitioning checks [Brian Hulette] Fix Index[i,j] subpartitioing [Brian Hulette] Fix output_partitioning, add tests [Brian Hulette] fix callable, add test [chamikaramj] Few small updates to the release guide [Brian Hulette] Bulk rename Nothing() to Arbitrary() [Brian Hulette] Allow preserves=Arbitrary, bulk replace preserves=Index() with [Brian Hulette] Fix pd.concat(keys=) partitioning ------------------------------------------ [...truncated 99.02 KB...] > Task :sdks:java:io:kinesis:integrationTest > Task :sdks:java:extensions:ml:integrationTest > Task :sdks:java:io:google-cloud-platform:integrationTest > Task :sdks:java:io:debezium:integrationTest > Task :runners:spark:2:hadoopVersion292Test FROM-CACHE > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] > Task :runners:spark:2:hadoopVersion321Test FROM-CACHE > Task :runners:spark:2:hadoopVersionsTest UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes > UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar > FROM-CACHE > Task > :runners:google-cloud-dataflow-java:coreSDKJavaLegacyWorkerIntegrationTest > NO-SOURCE > Task > :runners:google-cloud-dataflow-java:examplesJavaLegacyWorkerIntegrationTest > FROM-CACHE > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerIntegrationTest > FROM-CACHE > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformLegacyWorkerKmsIntegrationTest > FROM-CACHE > Task :runners:google-cloud-dataflow-java:postCommit UP-TO-DATE > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE > Task :sdks:java:io:hadoop-format:runHadoopFormatIO2101ElasticIT > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :sdks:java:extensions:zetasketch:integrationTest > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:extensions:ml:postCommit > Task :sdks:java:io:kafka:kafkaVersion01103Test > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:java:io:hadoop-file-system:hadoopVersion285Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO2101IT > Task :sdks:java:io:kafka:kafkaVersion100BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO2101Test > Task :sdks:java:io:hadoop-file-system:hadoopVersion292Test > Task :sdks:java:io:kafka:kafkaVersion100Test > Task :sdks:java:io:kafka:kafkaVersion111BatchIT > Task :sdks:java:io:hadoop-file-system:hadoopVersion321Test > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285ElasticIT > Task :sdks:java:io:kafka:kafkaVersion111Test > Task :sdks:java:io:hadoop-file-system:hadoopVersionsTest > Task :sdks:java:io:kafka:kafkaVersion201BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285IT > Task :sdks:java:io:kafka:kafkaVersion201Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO285Test > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:java:io:google-cloud-platform:integrationTestKms > Task :sdks:java:io:kafka:kafkaVersion211BatchIT > Task :sdks:go:installDependencies > Task :sdks:java:io:kafka:kafkaVersion211Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292ElasticIT > Task :sdks:java:io:kafka:kafkaVersion222BatchIT > Task :sdks:java:io:kafka:kafkaVersion222Test > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292IT > Task :sdks:java:io:kafka:kafkaVersion231BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO292Test > Task :sdks:java:io:google-cloud-platform:postCommit > Task :sdks:java:io:kafka:kafkaVersion231Test > Task :sdks:java:io:kafka:kafkaVersion241BatchIT > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321ElasticIT > Task :sdks:java:io:kafka:kafkaVersion241Test > Task :sdks:java:io:kafka:kafkaVersion251BatchIT > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321IT > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:io:kafka:kafkaVersion251Test > Task :sdks:java:container:buildLinuxAmd64 Unable to watch the file system for changes. The inotify watches limit is too low. > Task :sdks:java:container:goBuild > Task :sdks:java:io:kafka:kafkaVersionsCompatibilityTest > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker Removing intermediate container f2d5a92ca0ef ---> 57e9743c6877 Step 4/17 : ARG pull_licenses ---> Running in 4d05078ea480 Removing intermediate container 4d05078ea480 ---> 0bb0efb3dc00 Step 5/17 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> d69925cb8940 Step 6/17 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> 0c3f6a48edfe Step 7/17 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ ---> 74aa717903b9 Step 8/17 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> 862d95659691 Step 9/17 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> 558fcdeb346c Step 10/17 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> faf07dd770b2 Step 11/17 : COPY target/LICENSE /opt/apache/beam/ ---> 4a934aee2453 Step 12/17 : COPY target/NOTICE /opt/apache/beam/ ---> 4b35d89f8733 Step 13/17 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> 175d255cceac Step 14/17 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> cf484a5d8f58 Step 15/17 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in b0a29e8d7a59 Removing intermediate container b0a29e8d7a59 ---> b5b4f22cb92a Step 16/17 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 9208853f8afe Removing intermediate container 9208853f8afe ---> 19b4cf3135f0 Step 17/17 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 0edb74195381 Removing intermediate container 0edb74195381 ---> 077b0a5c9bc3 Successfully built 077b0a5c9bc3 Successfully tagged apache/beam_java8_sdk:2.30.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :sdks:java:io:hadoop-format:runHadoopFormatIO321Test > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > Task :sdks:java:io:hadoop-format:hadoopVersionsTest > Task :javaHadoopVersionsTest > Task :sdks:java:extensions:zetasketch:postCommit > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0315181520-7c55c00e The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0315181520-7c55c00e ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1615832115434.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0315181520-7c55c00e The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0315181520-7c55c00e The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1615832115434.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0315184336-c62946db The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0315184336-c62946db ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1615833816284.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0315184336-c62946db The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0315184336-c62946db The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1615833816284.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED java.lang.AssertionError at PubsubReadIT.java:90 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED java.lang.AssertionError at PubsubReadIT.java:62 36 tests completed, 2 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bac310d37ceb845ed155e7cbd686a5adedb4c155e4dab5a3df2d13742325d5ad Associated tags: - 20210315180030 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210315180030 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210315180030]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bac310d37ceb845ed155e7cbd686a5adedb4c155e4dab5a3df2d13742325d5ad]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2h 0m 59s 251 actionable tasks: 159 executed, 90 from cache, 2 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/5uujr3r42gco2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
