See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/824/display/redirect?page=changes>
Changes: [noreply] Fixing BigQueryIO request too big corner case for streaming inserts ------------------------------------------ [...truncated 45.05 KB...] Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:extensions:ml:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:pullLicenses done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.860578 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:io:google-cloud-platform:compileJava > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 28e4f5b7aa01: Preparing 4aab73dfe1c8: Preparing 2e2f2fb84434: Preparing e2be66b6d8d0: Preparing 7e1f979aa670: Preparing d98a8622359a: Preparing 580239471d28: Preparing 9dd6f25e0e7d: Preparing cb5bdd2af2d4: Preparing 2186bf25fcf0: Preparing af33abcf7fe7: Preparing 1da2ec137419: Preparing ebf469e844a6: Preparing 94c94d3b2e6b: Preparing 36e0782f1159: Preparing ba6e5ff31f23: Preparing 9f9f651e9303: Preparing 0b3c02b5d746: Preparing 62a747bf1719: Preparing 2186bf25fcf0: Waiting 62a747bf1719: Waiting d98a8622359a: Waiting 36e0782f1159: Waiting 580239471d28: Waiting ba6e5ff31f23: Waiting 9dd6f25e0e7d: Waiting 9f9f651e9303: Waiting cb5bdd2af2d4: Waiting 94c94d3b2e6b: Waiting 0b3c02b5d746: Waiting 1da2ec137419: Waiting af33abcf7fe7: Waiting ebf469e844a6: Waiting 4aab73dfe1c8: Pushed 2e2f2fb84434: Pushed 7e1f979aa670: Pushed d98a8622359a: Pushed 28e4f5b7aa01: Pushed 9dd6f25e0e7d: Pushed e2be66b6d8d0: Pushed cb5bdd2af2d4: Pushed ebf469e844a6: Layer already exists 94c94d3b2e6b: Layer already exists 36e0782f1159: Layer already exists ba6e5ff31f23: Layer already exists af33abcf7fe7: Pushed 9f9f651e9303: Layer already exists 62a747bf1719: Layer already exists 0b3c02b5d746: Layer already exists 1da2ec137419: Pushed 580239471d28: Pushed 2186bf25fcf0: Pushed 20211025060110: digest: sha256:16839538b9eeb6ca010f776e16bd69660e0f8a0c59f76a06e00d42f6a5c1fd73 size: 4311 > Task :sdks:java:io:google-cloud-platform:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:classes > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:google-cloud-dataflow-java:compileJava > Task :examples:java:compileJava > Task :sdks:java:io:google-cloud-platform:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:io:google-cloud-platform:testJar > Task :examples:java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:classes > Task :examples:java:jar > Task :examples:java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:testClasses > Task :examples:java:testJar > Task :runners:google-cloud-dataflow-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1025060630-bdd80ee3 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1025060630-bdd80ee3 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1635141984552.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1025060630-bdd80ee3 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1025060630-bdd80ee3 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1635141984552.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1025062946-a22e064b The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1025062946-a22e064b ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1635143386527.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1025062946-a22e064b The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1025062946-a22e064b The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1635143386527.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:258 38 tests completed, 1 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211025060110 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211025060110] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:16839538b9eeb6ca010f776e16bd69660e0f8a0c59f76a06e00d42f6a5c1fd73] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211025060110] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:16839538b9eeb6ca010f776e16bd69660e0f8a0c59f76a06e00d42f6a5c1fd73])]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 43m 47s 129 actionable tasks: 92 executed, 35 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/xdunfrx6pf6vk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
