See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/886/display/redirect?page=changes>
Changes: [Andrew Pilloud] [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation [noreply] [BEAM-11097] Create hook to enable cross-bundle side input caching [noreply] Merge pull request #15804 from [BEAM-13109][Playground] Add processing ------------------------------------------ [...truncated 45.38 KB...] > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:extensions:ml:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:jar > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:io:google-cloud-platform:testJar > Task :sdks:java:container:pullLicenses done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 209 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.141511 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 9105c34d4d2c: Preparing 295e806b2afa: Preparing 0f4c5a63099a: Preparing c81f0bd0cf90: Preparing 539d52c61a7b: Preparing c4a699d774cd: Preparing 3ce8e1d40158: Preparing 732bbef4ecb8: Preparing 61a85870fb24: Preparing 8fc62933c354: Preparing 3a1e3cece8af: Preparing 3eee6a2d2179: Preparing ebf469e844a6: Preparing 94c94d3b2e6b: Preparing c4a699d774cd: Waiting 36e0782f1159: Preparing ba6e5ff31f23: Preparing 3eee6a2d2179: Waiting 9f9f651e9303: Preparing 0b3c02b5d746: Preparing 8fc62933c354: Waiting 62a747bf1719: Preparing 61a85870fb24: Waiting 36e0782f1159: Waiting 3ce8e1d40158: Waiting 732bbef4ecb8: Waiting ba6e5ff31f23: Waiting 62a747bf1719: Waiting 0b3c02b5d746: Waiting 9f9f651e9303: Waiting 94c94d3b2e6b: Waiting 539d52c61a7b: Pushed 0f4c5a63099a: Pushed c81f0bd0cf90: Pushed 9105c34d4d2c: Pushed c4a699d774cd: Pushed 61a85870fb24: Pushed 732bbef4ecb8: Pushed 3ce8e1d40158: Pushed ebf469e844a6: Layer already exists 94c94d3b2e6b: Layer already exists 3a1e3cece8af: Pushed 36e0782f1159: Layer already exists 3eee6a2d2179: Pushed ba6e5ff31f23: Layer already exists 9f9f651e9303: Layer already exists 0b3c02b5d746: Layer already exists 62a747bf1719: Layer already exists 295e806b2afa: Pushed 8fc62933c354: Pushed 20211109180049: digest: sha256:bcd9a1330e020634634d824d7fa0f0d3354eb912cab894cad38b046db1362e6a size: 4311 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1109180620-cffe9c24 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1109180620-cffe9c24 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1636481173088.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1109180620-cffe9c24 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1109180620-cffe9c24 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1636481173088.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1109183043-c887e85e The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1109183043-c887e85e ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1636482643240.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1109183043-c887e85e The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1109183043-c887e85e The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1636482643240.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:258 org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > testNewTypesQueryWithReshuffle FAILED java.lang.RuntimeException at BigQueryToTableIT.java:116 38 tests completed, 2 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211109180049 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcd9a1330e020634634d824d7fa0f0d3354eb912cab894cad38b046db1362e6a Deleted: sha256:846db938c761377ae3c45b71deda30e0f67d124b621f46bcbc9d04e32ea2a6e7 Deleted: sha256:ef937c6dc9b2a47b9e380da61665e72ecf81fd92c126186895fd9931241c85a7 Deleted: sha256:47d3478fb617d9e9adad7e5f832744c456bba659ac1d37f86dacdeef34c1b279 Deleted: sha256:3abb18a186da6c42347d21740f4beedf9a8b084ee875142a35ca5f2f4b6ff42d Deleted: sha256:cd15baf7c282530a688932872260381c632cbc3179b86b05f357b835a4fa3e48 Deleted: sha256:9217fc14ffbff5c7e63901c1d9cb736ec7ac898830cdd33e38e2e22ad3a47958 Deleted: sha256:10934261824d26e876a0f5142a77989db40cc28f7728531bfdbd8d5315b9dbda Deleted: sha256:f64c8fbb1f97898e3dc15b1b1a7d28786b2c667f8ba2bf74ecad86c38d61bf4b Deleted: sha256:ffac5caad2e2190fd8d3fe14ffbb5b666e63d9102ef4f1046dc5022a126d8eca Deleted: sha256:e514241935d4c3ec248fb70acd5f74794fe76006540b7b7f2406780a59790072 Deleted: sha256:5d6ff17e8d5ee3a609389c4175a5634269967cc727a40fcf9f9aa3177c6285dc Deleted: sha256:a24805920c6d9ca63ccd53b994d9599a97540f10ee73955946eb39a79659ffe2 Deleted: sha256:7b748f8d55084dd38715d4a1cce176f794b16686525b8a24268d5450f23411bd Deleted: sha256:769eb4c177c2a07eb4cb36d4d78e6009000c94725019a881ff7776dae8d68e56 Deleted: sha256:f3b953080d909a73b865640c92368058042c4c1cfad0d15c46d531e205bed1e1 Deleted: sha256:3cace800545d4457b382901cfd150f968f13e9b0cfccece4bd6494c6278011ea Deleted: sha256:48346c3c6bb622e9c705a69c00abb5d8c5088e7c9d339b52e21cd7f0d88c456a Deleted: sha256:ffbcdb877302e1deca4bfad54390220a3bade9ab1a5924a5b000c9be70bad92f Deleted: sha256:57dd4e6c1762cde513bbcd2c9dd530adff275bbab84b96685cf3e62b1ccc50fd Deleted: sha256:b2d6f53be65617f3e96f99f0e035eec699246e3de2bd22f47ab94fa9429cb9dc Deleted: sha256:e53fbb20c548ac0d199d87763cd043eda7688c1c43808e4c6c5f7ccd1b093a9a Deleted: sha256:3777b76f4adff76a89b0be0e5e69fa7d1e2780bd67654298dff177e9e80aec99 Deleted: sha256:1c582b767777c4aefbc9dbec1a52ccc6e047863a94d69951d781b79d86aba2ba Deleted: sha256:01b030c1e18fc7792879be11dfb3d50fbabeab58acda9cafaeab30db6733ca50 Deleted: sha256:00e19b4ba1b7665fcf08d512f22c587272491df0318c22306bf8379e163922dc Deleted: sha256:301b398a01fd6f1ae38dbabf4b2607e91ec9931e5d43262889c78deb038a65bf Deleted: sha256:007c8e28c688af9cf349a6d31f29e2dde7c20943a513b0874e8e623095800495 Deleted: sha256:9acb2ebec67d4365d968e16a6ec08ba28f1438e944eeaf794d5b864ed0cdabc9 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211109180049] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcd9a1330e020634634d824d7fa0f0d3354eb912cab894cad38b046db1362e6a] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211109180049] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcd9a1330e020634634d824d7fa0f0d3354eb912cab894cad38b046db1362e6a])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcd9a1330e020634634d824d7fa0f0d3354eb912cab894cad38b046db1362e6a Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcd9a1330e020634634d824d7fa0f0d3354eb912cab894cad38b046db1362e6a Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bcd9a1330e020634634d824d7fa0f0d3354eb912cab894cad38b046db1362e6a]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 51m 14s 129 actionable tasks: 87 executed, 40 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/f2cx2blxiw2ck Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
