See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1509/display/redirect?page=changes>
Changes: [Robert Bradshaw] Require explicit designation of proxy partitioning specification. [Robert Bradshaw] Elementwise transforms preserve all partitionings. [iyi] Add test case for untriggered expansion with temp tables. [zyichi] Fix small typo in ProcessBundleHandlerTest.java [noreply] Merge pull request #16079 from [BEAM-13241] [Playground] Frontend [noreply] Ricardo Case Study (#16087) [noreply] Merge pull request #16086 from [BEAM-13258][Playground] Get and store [noreply] [BEAM-11936] Fix errorprone UnusedVariable in Runners (#16035) [noreply] [BEAM-8123] Add cloudpickle as optional library (#15472) [noreply] [BEAM-12572] Beam python examples continuously exercised on at least 2 ------------------------------------------ [...truncated 44.40 KB...] + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :examples:java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:classes > Task :sdks:java:container:java8:docker ---> 21272647469b Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ > Task :examples:java:jar > Task :sdks:java:container:java8:docker ---> 25bf1ec29be4 Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> b95aac4bd687 Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> e65ac103bfcf Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> d73b008ffd5b Step 11/18 : COPY target/LICENSE /opt/apache/beam/ ---> 7584979be523 Step 12/18 : COPY target/NOTICE /opt/apache/beam/ ---> ca78def0dc5d Step 13/18 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ > Task :examples:java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:container:java8:docker ---> d203bb0cee99 Step 14/18 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 2be752f9fe42 Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 79d59c83a41f Removing intermediate container 79d59c83a41f ---> 0eded8460fe6 Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in f0e389633ad8 Removing intermediate container f0e389633ad8 ---> 4516d08afa8b Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> b4a84de025b4 Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in d9936f7f6609 Removing intermediate container d9936f7f6609 ---> d04256416ad7 Successfully built d04256416ad7 Successfully tagged apache/beam_java8_sdk:2.36.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] ac71d58b025a: Preparing e3d894b97923: Preparing e564246dc674: Preparing fe973c71960e: Preparing 18c093bb9192: Preparing 1ddf2a4f235b: Preparing 40d2ac5313be: Preparing 5915002e238f: Preparing 03bc560550d7: Preparing c39937586b4f: Preparing e6ab52f071f1: Preparing ba62b932ce2f: Preparing 51244409158f: Preparing 153f9e5be619: Preparing ab9d251e27cb: Preparing 8a5844586fdb: Preparing a4aba4e59b40: Preparing 5499f2905579: Preparing a36ba9e322f7: Preparing 1ddf2a4f235b: Waiting 40d2ac5313be: Waiting 5915002e238f: Waiting 03bc560550d7: Waiting c39937586b4f: Waiting e6ab52f071f1: Waiting ba62b932ce2f: Waiting 51244409158f: Waiting 153f9e5be619: Waiting ab9d251e27cb: Waiting 8a5844586fdb: Waiting a4aba4e59b40: Waiting 5499f2905579: Waiting a36ba9e322f7: Waiting e3d894b97923: Pushed e564246dc674: Pushed 18c093bb9192: Pushed ac71d58b025a: Pushed 1ddf2a4f235b: Pushed fe973c71960e: Pushed 5915002e238f: Pushed 03bc560550d7: Pushed 51244409158f: Layer already exists e6ab52f071f1: Pushed 153f9e5be619: Layer already exists ba62b932ce2f: Pushed a4aba4e59b40: Layer already exists ab9d251e27cb: Layer already exists 5499f2905579: Layer already exists a36ba9e322f7: Layer already exists 8a5844586fdb: Layer already exists 40d2ac5313be: Pushed c39937586b4f: Pushed 20211202000049: digest: sha256:3eb526dfac729946079622f590f9e7abbe8f368379f72b694cdc916b51e40f8a size: 4311 > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1202000440-f9eb47ec The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1202000440-f9eb47ec ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1638403473327.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1202000440-f9eb47ec The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1202000440-f9eb47ec The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1638403473327.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT > testTableIO FAILED java.lang.RuntimeException at BigQuerySamplesIT.java:121 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.complete.TrafficMaxLaneFlowIT > testE2ETrafficMaxLaneFlow FAILED java.lang.RuntimeException at TrafficMaxLaneFlowIT.java:74 8 tests completed, 5 failed > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211202000049 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3eb526dfac729946079622f590f9e7abbe8f368379f72b694cdc916b51e40f8a Deleted: sha256:d04256416ad742f62562a5d8de6e3422a1a3928058bcde8e007f9f23d5ddfc2f Deleted: sha256:b4a84de025b461c6edc880f60a38292eed0b3da7d2a4166fb5bcbfd8161c69c6 Deleted: sha256:6b85afe47fcb7b3e5701b207214e03022999e7130c6e4798fef167470c98ab96 Deleted: sha256:4516d08afa8b714e2f730c565b8c9f2fc1453ef92b226d66f00b005e11c54789 Deleted: sha256:0eded8460fe6273e45fec39b893ec83c792f5833b787b38a20717631aca9532b Deleted: sha256:e0ac77ded1bdad69769211cd30a28e0668d31a3024b36c505c212dc5566736e6 Deleted: sha256:2be752f9fe429f4cfaf6fc0a00ba0f1e8309dbea0d5208b7abfdd5a5885d92a6 Deleted: sha256:bae5b24e64b80b3a6ef74e72b65aacb2bb90d4d2b53ef15f62f9ca5c97d7031c Deleted: sha256:d203bb0cee99697cc81e027ec628c066a79a6a34a96c61c9701e926bf57c6655 Deleted: sha256:8a69eaf2a2bf58f6545b886f76dfc551a206f9e8d7f2cdaec9bc6768222b2608 Deleted: sha256:ca78def0dc5dc665d43fca1319d3e9fa07e77ee00e557fd75dbe9b67de6fcedf Deleted: sha256:2db05c8bb4754be815b63483dcf85d5400ce3c586ed9f9162eb02dcde777cdc0 Deleted: sha256:7584979be5235756cb9a9d05d58c1de1a9d6a6d5729410a5d412292dce56678e Deleted: sha256:878d113e072c79fb80cd6be3db1c199edfb39f51440b767b7b04b1c8531a6dbe Deleted: sha256:d73b008ffd5b92467a9220c1873def44b4263828b12d0fee4f290c26a7c79df1 Deleted: sha256:101b0ebf5230c50f88bf272de9bbb72aea1d2b35f3de65c3ebfc69e372189533 Deleted: sha256:e65ac103bfcfc2fde001268ccc6a8569c5a5476867c83683401f371be352d9ad Deleted: sha256:acbd05bcdf1ccda9222ac9fb29d426eb2a394bf866a073d4bac379a6896eff48 Deleted: sha256:b95aac4bd687dc5817c11da24bbda7cbff5d244c02aa3265128015860b95cb27 Deleted: sha256:14233836eb218e9630e12ab95a4dbbd16d627af92810fde289bd4f2fc7966b61 Deleted: sha256:25bf1ec29be4d0a3a5cf9413da85eb5207f1f9683fd97b322d145aa7bb4b85c0 Deleted: sha256:4ec600cc50a81dfe96a2ca97753ad6aedcab62a17740c4089df3fb9d0f423284 Deleted: sha256:21272647469b5925505338721afe21f06824f749acceecdcf2f694eceece82f8 Deleted: sha256:8e66d57de1a16ae910a8f80d8efd865ccef6cea9ad697fb48aa658d59a703444 Deleted: sha256:4e3ba51c6644fb81520d5d6c6689187bbc17af576a2083269b2b5602bdd25d81 Deleted: sha256:a35d63fe6a50d710a2240fc361611693875c24ebef097b028e5347039316d441 Deleted: sha256:76ae16acbed698d762b591bb5f4d50c35fde948b90cff49c0d8847d558769964 Deleted: sha256:5cb96c8e7d586b6677e14196de53f31abec3bbee7e4ec4d85b6936f2df05c284 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211202000049] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 278 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 44m 37s 104 actionable tasks: 74 executed, 28 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/daeg4smvhgis2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
