See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/723/display/redirect?page=changes>
Changes: [kileysok] Update windmill state map to resolve *IfAbsent methods immediately [piotr.szczepanik] [BEAM-12356] Fixed last non-cached usage of DatasetService in BigQuery [noreply] [BEAM-12977] Translates Reshuffle in Portable Mode with Samza native [noreply] [BEAM-12982] Help users debug which JvmInitializer is running and when. ------------------------------------------ [...truncated 42.68 KB...] > Task :sdks:java:extensions:protobuf:testClasses > Task :sdks:java:extensions:protobuf:testJar > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:extensions:ml:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :examples:java:jar > Task :runners:direct-java:shadowJar > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:io:google-cloud-platform:testJar > Task :sdks:java:container:generateLicenseReport > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 209 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.047418 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/java/container google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 1fb9342645cf: Preparing d390a265fe69: Preparing fd1f07861500: Preparing 9866d3925317: Preparing afa2ef589269: Preparing 4da9b610a22b: Preparing 56c6658ace39: Preparing ae82bbd705d6: Preparing ab9440921c27: Preparing 706dca7d0f58: Preparing e1fe7ee532b4: Preparing dc5f213d5321: Preparing ab19b46e9384: Preparing 080ef0ba5cc0: Preparing d08e6b97bf21: Preparing 3054497613e6: Preparing d35dc7f4c79e: Preparing dabfe5b2ea81: Preparing 5e6a409f30b6: Preparing 4da9b610a22b: Waiting 56c6658ace39: Waiting ae82bbd705d6: Waiting ab9440921c27: Waiting 706dca7d0f58: Waiting e1fe7ee532b4: Waiting dc5f213d5321: Waiting ab19b46e9384: Waiting 080ef0ba5cc0: Waiting d08e6b97bf21: Waiting 3054497613e6: Waiting d35dc7f4c79e: Waiting dabfe5b2ea81: Waiting 5e6a409f30b6: Waiting afa2ef589269: Pushed d390a265fe69: Pushed fd1f07861500: Pushed 4da9b610a22b: Pushed 1fb9342645cf: Pushed 9866d3925317: Pushed ae82bbd705d6: Pushed ab9440921c27: Pushed ab19b46e9384: Layer already exists 080ef0ba5cc0: Layer already exists d08e6b97bf21: Layer already exists 3054497613e6: Layer already exists d35dc7f4c79e: Layer already exists dabfe5b2ea81: Layer already exists 5e6a409f30b6: Layer already exists dc5f213d5321: Pushed e1fe7ee532b4: Pushed 56c6658ace39: Pushed 706dca7d0f58: Pushed 20210930000110: digest: sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629 size: 4311 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0930000654-924d1121 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930000654-924d1121 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1632960409344.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0930000654-924d1121 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930000654-924d1121 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1632960409344.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0930003228-59846d34 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930003228-59846d34 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1632961947541.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0930003228-59846d34 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930003228-59846d34 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1632961947541.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords FAILED com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryNestedRecordsIT.java:102 38 tests completed, 1 failed, 2 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210930000110 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629 Deleted: sha256:fd94a1f52e433c3c74025e3144cb91d632e40d83f839d60811c8511b50c2731d Deleted: sha256:f62650920966d02947bf2a8de0e2217d8c35c97ba43b2a0b64040768939e7eed Deleted: sha256:ed22e067ed3497bb1408f81da2fba76b3e8a38e435e6f3be1a3dd25a12ee15ef Deleted: sha256:3a698c7c89d58b916165990dc493580ad0472a6c116e8a39c80470f478ee56c9 Deleted: sha256:5f516a866b09c52c6223dabddeb7bda45845af052f29a61882cdf2054d9fb3bc Deleted: sha256:f7a6eb0028be331f4b24912e726b2b867617625729ffb0bcb1ead7228315ba2e Deleted: sha256:469df1c9a6d961c2cb9dc9422d38ddc886cd113d41830ba3aaf593338cbeffb0 Deleted: sha256:1fd04e77f237a4de4c2d9c6b2aef466675fa5a843dc8f5dc37d499f23cb355e7 Deleted: sha256:92a34f8136471882be707c3ab64c46647ca8ec93935fa8f7f81a401c2f38f481 Deleted: sha256:1097389a73433b457ef1399087e706fa4440130e703aa25d8c386e7df2b094db Deleted: sha256:3656adb52bfeaec3d901c0ee2432ef4b07ad5e7884664831d793ada743f8ab00 Deleted: sha256:d7958c2be144cff5f41b03b81f161c0bf81ab494f7fc18e8d83169d4f1418f25 Deleted: sha256:a0951216699f92453a1dc3f5e8eaf98d82373b888f0e1b6b78e985cb3587a5f8 Deleted: sha256:f1a84a298b9931abde4eaf03ef51fab362c3b66d39b19ee3ea254959c0b0ea98 Deleted: sha256:57b756fadf9b7da1f93cad448dab59ec121e9451f163409e6521b2d99a18512d Deleted: sha256:c9e4982bf8d39bc7385b960d3db46610390a3b6c5ab432d0bd2a0ca82ae05153 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210930000110] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210930000110] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 51m 5s 129 actionable tasks: 88 executed, 39 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/4t62zlhte3cku Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
