See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1393/display/redirect?page=changes>
Changes: [Andrew Pilloud] [BEAM-13118] Use branch for nightly "tag", tags are immutable [dmitrii_kuzin] [BEAM-12730] Python. Custom delimiter add corner case [noreply] Merge pull request #15832 from [BEAM-13149] Changing readWithPartitions [noreply] Minor: add resource key to presentation materials link (#15867) ------------------------------------------ [...truncated 31.74 KB...] > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar go: downloading github.com/golang/protobuf v1.5.2 go: downloading google.golang.org/grpc v1.39.0 go: downloading google.golang.org/protobuf v1.27.1 go: downloading google.golang.org/genproto v0.0.0-20210728212813-7823e685a01f go: downloading golang.org/x/net v0.0.0-20210423184538-5f58ad60dda6 go: downloading golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c go: downloading golang.org/x/text v0.3.6 > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/java/container > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:extensions:ml:jar > Task :sdks:java:io:kafka:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:jar > Task :sdks:java:container:generateLicenseReport > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:container:pullLicenses Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.582564 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 962f5596148a: Preparing d2f2f554d8af: Preparing 0a2c3d749355: Preparing 087a33486175: Preparing 4eaa3e60eba1: Preparing 02a8a74635f0: Preparing 5f1c325f178c: Preparing 142a608e794e: Preparing b1757b25cdab: Preparing 075433df8fa9: Preparing 7b1c3766c904: Preparing bd40975f7612: Preparing ebf469e844a6: Preparing 94c94d3b2e6b: Preparing 36e0782f1159: Preparing ba6e5ff31f23: Preparing 9f9f651e9303: Preparing 0b3c02b5d746: Preparing 62a747bf1719: Preparing 02a8a74635f0: Waiting 5f1c325f178c: Waiting 142a608e794e: Waiting b1757b25cdab: Waiting 075433df8fa9: Waiting 7b1c3766c904: Waiting bd40975f7612: Waiting ebf469e844a6: Waiting 94c94d3b2e6b: Waiting 36e0782f1159: Waiting ba6e5ff31f23: Waiting 9f9f651e9303: Waiting 0b3c02b5d746: Waiting 62a747bf1719: Waiting 4eaa3e60eba1: Pushed d2f2f554d8af: Pushed 0a2c3d749355: Pushed 962f5596148a: Pushed 087a33486175: Pushed 02a8a74635f0: Pushed 142a608e794e: Pushed b1757b25cdab: Pushed ebf469e844a6: Layer already exists 94c94d3b2e6b: Layer already exists 36e0782f1159: Layer already exists ba6e5ff31f23: Layer already exists 9f9f651e9303: Layer already exists 0b3c02b5d746: Layer already exists 62a747bf1719: Layer already exists 7b1c3766c904: Pushed bd40975f7612: Pushed 5f1c325f178c: Pushed 075433df8fa9: Pushed 20211103000120: digest: sha256:cbf5ad24889ceab17b6aa4dfd01d671921eb9fc91109a3079f90f4fe79de4137 size: 4311 > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1103000451-45009995 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1103000451-45009995 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1635897879044.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1103000451-45009995 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1103000451-45009995 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1635897879044.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT > testTableIO FAILED java.lang.RuntimeException at BigQuerySamplesIT.java:125 *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1103003353-f9b65f22 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1103003353-f9b65f22 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1635899632583.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1103003353-f9b65f22 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1103003353-f9b65f22 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1635899632583.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** 8 tests completed, 1 failed > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211103000120 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbf5ad24889ceab17b6aa4dfd01d671921eb9fc91109a3079f90f4fe79de4137 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211103000120] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbf5ad24889ceab17b6aa4dfd01d671921eb9fc91109a3079f90f4fe79de4137] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211103000120] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbf5ad24889ceab17b6aa4dfd01d671921eb9fc91109a3079f90f4fe79de4137])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbf5ad24889ceab17b6aa4dfd01d671921eb9fc91109a3079f90f4fe79de4137 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbf5ad24889ceab17b6aa4dfd01d671921eb9fc91109a3079f90f4fe79de4137 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbf5ad24889ceab17b6aa4dfd01d671921eb9fc91109a3079f90f4fe79de4137]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 39m 34s 104 actionable tasks: 71 executed, 31 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/xalgki62hw5io Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
