See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1226/display/redirect?page=changes>
Changes: [mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare [noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing ------------------------------------------ [...truncated 53.75 KB...] Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> Collecting pip Using cached pip-22.0.2-py3-none-any.whl (2.1 MB) Collecting setuptools Using cached setuptools-60.7.0-py3-none-any.whl (1.0 MB) Collecting wheel Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Installing collected packages: pip, setuptools, wheel Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed pip-22.0.2 setuptools-60.7.0 wheel-0.37.1 Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses> INFO:root:Pulling license for 217 dependencies using 16 threads. INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5 > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/java/container > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 58.054952 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 9edafa9043e9: Preparing bf2a2bf904ed: Preparing 557b805db4d5: Preparing 816c1edfcbf8: Preparing 08813a726c2c: Preparing dee4b16760e4: Preparing 807127451029: Preparing 3ecd8f04af0a: Preparing 55fc9a260ce7: Preparing ca540e6e3e96: Preparing 976cb172f863: Preparing f31bdb82e240: Preparing 228642b6dcc0: Preparing 0fbc35d51f85: Preparing 6be21046fcff: Preparing 807127451029: Waiting 3ecd8f04af0a: Waiting 55fc9a260ce7: Waiting f31bdb82e240: Waiting 228642b6dcc0: Waiting ca540e6e3e96: Waiting dee4b16760e4: Waiting 976cb172f863: Waiting 0fbc35d51f85: Waiting 1e5fdc3d671c: Preparing 613ab28cf833: Preparing bed676ceab7a: Preparing 6398d5cccd2c: Preparing 0b0f2f2f5279: Preparing 6be21046fcff: Waiting 6398d5cccd2c: Waiting 1e5fdc3d671c: Waiting 0b0f2f2f5279: Waiting 613ab28cf833: Waiting bed676ceab7a: Waiting 557b805db4d5: Pushed 08813a726c2c: Pushed bf2a2bf904ed: Pushed dee4b16760e4: Pushed 3ecd8f04af0a: Pushed 9edafa9043e9: Pushed 816c1edfcbf8: Pushed ca540e6e3e96: Pushed f31bdb82e240: Pushed 0fbc35d51f85: Layer already exists 807127451029: Pushed 55fc9a260ce7: Pushed 1e5fdc3d671c: Layer already exists 613ab28cf833: Layer already exists 6be21046fcff: Layer already exists bed676ceab7a: Layer already exists 0b0f2f2f5279: Layer already exists 6398d5cccd2c: Layer already exists 228642b6dcc0: Pushed 976cb172f863: Pushed 20220202180048: digest: sha256:066392400aa69022042ca9b76efd09a85d4e022cbf3ecc69c0187d21a8461902 size: 4520 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0202180342-bc7b2b00 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0202180342-bc7b2b00 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1643825017587.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0202180342-bc7b2b00 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0202180342-bc7b2b00 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1643825017587.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0202180342-e29c377d The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0202180342-e29c377d ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1643825017569.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0202180342-e29c377d The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0202180342-e29c377d The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1643825017569.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:264 38 tests completed, 1 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220202180048 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:066392400aa69022042ca9b76efd09a85d4e022cbf3ecc69c0187d21a8461902 Deleted: sha256:f1ae2d2249f4494a0588bcaef5c491b0146b7bceb56b8b908a9f85e46bf5165b Deleted: sha256:6b4f90f1c357ac218d0af7fc227cda5645de85ccaa3b73353b8125d9c4d70bb9 Deleted: sha256:f7e26dc5a585a299a13427670d81922aa0ea5afccac6d4c10bd70befaeb1810f Deleted: sha256:941eb2cfea631359ce0fe42519b269473ab085b62d391632c187510835dfc842 Deleted: sha256:b2835bd3876a3b06b7c24407f441356fb48122ae1b2abec84e7b96e37d2f200a Deleted: sha256:ccf299bc0b6d7fc7bc392eb99ce16d0478163164abd6922cb843680ecf80e0ba Deleted: sha256:a45863c9ffec79679e68eef3087add0c54c54c1e7302b58b983f9f80ac85ac1e Deleted: sha256:8e32f1337a8cb78e6e73676d55550dbb9028c7842205ff30dc341d01d7221091 Deleted: sha256:d464e401763e6726ec18402f32bf81582594338e2ee29b9a23d0849ddb6abd92 Deleted: sha256:cd7995e797bb5522fa714200c6756794d0c73bde9da0f065916f1b70728d07dd Deleted: sha256:92b84570a105b3d285b52607ea695d8a263891ee3fc273849ab0d3484f39edf6 Deleted: sha256:561d4b541d2de0f9f6c74a100f60ff8cfdfd93040ff2bd0d61f4116afe334246 Deleted: sha256:0920c633bb160cc65e35385a7a0ec694578c2c2c60f6b7091cc794506352a7f4 Deleted: sha256:614033cf602664ccfa21305727735b9a89358de9b1b6394ed4bb4b52679beb86 Deleted: sha256:2b29813f2471a20da62e226cbf4f1e477377306d188629311224d6aeca0eeeaa Deleted: sha256:0ab4c959932a3659056c4abfb76ce14d13009ef1f190e7a767d36a9d7600b814 Deleted: sha256:1b2886a131386d31efdc0c3a8045f5330170dc9e749cfa9bee14ac019d3d7805 Deleted: sha256:baadd701e6209628fbd82104a1207a307aa658892921d9ac34eb51b19b767f87 Deleted: sha256:e27eeee04f8add519984f0c14050f02e8466c5b62b1acb8e8e4e50664de69467 Deleted: sha256:26f5c7a96984ebc2e8dc136a0e7b96d39590a1930d966dd59ced7cd90dd3d013 Deleted: sha256:317afcc5c1e10e6e0961be2b6e2935f5df252e8721c3cb98841907d84bf3e090 Deleted: sha256:75747aaf6600d46e83d4fe1341a492c3ffe4a9a6c8026683e21098ace33210be Deleted: sha256:b7b6a786ae9837208e25183bd2bc4583a7f86d70fca27b97ce1ed3d8bfc85fe4 Deleted: sha256:07b8be993ea7eba4e6c1448d97faa1c31d55c5197675c83c0bed62f517e61231 Deleted: sha256:ec957ae22ffede3b116d1fdc778079bc0164cb1e2186e29be3363c87bb963acf Deleted: sha256:cb343e1ef3b08f30c0722bc38d6a4a0c0209b7e8b423320221435d56290f905b Deleted: sha256:39396907b0976a3f0bd994298cfd40d55e4eee3ca90a03b2938a6df6632f48d6 Deleted: sha256:8224ba3e8c1aed4fc1fe0b764ef24d62b758cc8863a0b5893645db4cf5f025e9 Deleted: sha256:6d93b37b83fb42399cc45b7c33ab769d81518ee68338526462de935b9f2f667f Deleted: sha256:a6374c4e04c6a11cca80453d45ceb45952c969d4ee89725d55bf68d9b71f7b59 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220202180048] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:066392400aa69022042ca9b76efd09a85d4e022cbf3ecc69c0187d21a8461902] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220202180048] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:066392400aa69022042ca9b76efd09a85d4e022cbf3ecc69c0187d21a8461902])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:066392400aa69022042ca9b76efd09a85d4e022cbf3ecc69c0187d21a8461902 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:066392400aa69022042ca9b76efd09a85d4e022cbf3ecc69c0187d21a8461902 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:066392400aa69022042ca9b76efd09a85d4e022cbf3ecc69c0187d21a8461902]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1h 33m 13s 141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/lfajfof4tzrt2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
