See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/1511/display/redirect?page=changes>
Changes: [Daniel Oliveira] [BEAM-13321] Pass TempLocation as pipeline option to Dataflow Go for [noreply] [BEAM-12976] Pipeline visitor to discover pushdown opportunities. ------------------------------------------ [...truncated 37.29 KB...] > Task :runners:direct-java:shadowJar > Task :sdks:java:io:google-cloud-platform:compileJava > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/java/container github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :sdks:java:io:google-cloud-platform:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:classes > Task :sdks:java:io:google-cloud-platform:jar > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java11:copyGolangLicenses > Task :sdks:java:container:java11:dockerPrepare > Task :runners:google-cloud-dataflow-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:classes > Task :examples:java:jar > Task :sdks:java:container:java11:docker ---> Running in 35fa357c09c3 Removing intermediate container 35fa357c09c3 ---> 338135930287 Step 4/18 : ARG pull_licenses ---> Running in bf53d697d13f Removing intermediate container bf53d697d13f ---> a65f248e7f2f Step 5/18 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> 294fa9b28c06 Step 6/18 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> 7eadefa6e3e7 Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ > Task :examples:java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :examples:java:testClasses > Task :sdks:java:container:java11:docker ---> c27f0b9238f1 Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> ac64b4f02d32 Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> b5059625196a Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/ > Task :examples:java:testJar > Task :sdks:java:container:java11:docker ---> 13cb0c495001 Step 11/18 : COPY target/LICENSE /opt/apache/beam/ ---> 61979f6f3839 Step 12/18 : COPY target/NOTICE /opt/apache/beam/ ---> 01c64d85192f Step 13/18 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> f83e2ecee967 Step 14/18 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 9c3840352cfa Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in a39a98c772c5 Removing intermediate container a39a98c772c5 ---> 317ba53f93fe Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 79c4d5204eb5 Removing intermediate container 79c4d5204eb5 ---> ef291cc44ce4 Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> 761c5699f13a Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 1f9bab30d1ca Removing intermediate container 1f9bab30d1ca ---> bcc44c63f461 Successfully built bcc44c63f461 Successfully tagged apache/beam_java11_sdk:2.36.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] ac474aff1bce: Preparing 801833098e7e: Preparing f93b59bbd555: Preparing 57703398e9d1: Preparing b379bc023de2: Preparing b1cb35be1b2e: Preparing 05a0b2ad2c51: Preparing 3b3a67de5d96: Preparing a9f366a135d1: Preparing 4b9abcda929d: Preparing 4f35378afec1: Preparing 1102a7cf5cb8: Preparing 5c81f9330d99: Preparing 927f9fcef4cf: Preparing a81f1846a0d2: Preparing 3b441d7cb46b: Preparing d3710de04cb3: Preparing 91f7336bbfff: Preparing e2e8c39e0f77: Preparing b1cb35be1b2e: Waiting 05a0b2ad2c51: Waiting 4f35378afec1: Waiting 1102a7cf5cb8: Waiting 3b3a67de5d96: Waiting a9f366a135d1: Waiting 5c81f9330d99: Waiting 4b9abcda929d: Waiting 927f9fcef4cf: Waiting 91f7336bbfff: Waiting e2e8c39e0f77: Waiting a81f1846a0d2: Waiting 3b441d7cb46b: Waiting d3710de04cb3: Waiting b379bc023de2: Pushed 801833098e7e: Pushed f93b59bbd555: Pushed 57703398e9d1: Pushed ac474aff1bce: Pushed b1cb35be1b2e: Pushed a9f366a135d1: Pushed 3b3a67de5d96: Pushed 5c81f9330d99: Layer already exists 927f9fcef4cf: Layer already exists a81f1846a0d2: Layer already exists 3b441d7cb46b: Layer already exists d3710de04cb3: Layer already exists 4f35378afec1: Pushed 91f7336bbfff: Layer already exists e2e8c39e0f77: Layer already exists 1102a7cf5cb8: Pushed 05a0b2ad2c51: Pushed 4b9abcda929d: Pushed 20211214060031: digest: sha256:5a342af3a433dee306976b5c89251ed00f76c2b5afb0dda1801abe3f69bb90f7 size: 4311 > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1214060446-67a3e8df The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1214060446-67a3e8df ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1639461878686.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1214060446-67a3e8df The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1214060446-67a3e8df The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1639461878686.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT > testTableIO FAILED java.lang.RuntimeException at BigQuerySamplesIT.java:125 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.complete.TrafficMaxLaneFlowIT > testE2ETrafficMaxLaneFlow FAILED java.lang.RuntimeException at TrafficMaxLaneFlowIT.java:72 8 tests completed, 4 failed > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214060031 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a342af3a433dee306976b5c89251ed00f76c2b5afb0dda1801abe3f69bb90f7 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214060031] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 278 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 43m 31s 84 actionable tasks: 66 executed, 16 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/qugqry2mxol3u Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
