See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1921/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage. [Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO. [Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow, [Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name. [noreply] [BEAM-13893] improved coverage of jobopts package (#17003) [noreply] Merge pull request #16977 from [BEAM-12164] Added integration test for ------------------------------------------ [...truncated 36.88 KB...] > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:container:pullLicenses INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5 > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:extensions:ml:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :examples:java:jar > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 30.973294 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :runners:google-cloud-dataflow-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 70d7294495ac: Preparing c6c603551757: Preparing 2be04e20a0c1: Preparing a6f75c48ed33: Preparing b8973b334fd7: Preparing 3c9648ff845f: Preparing 1d23fab0fd9a: Preparing 733879e640d2: Preparing 7f923579f416: Preparing 3fb78a97e849: Preparing e91df662618b: Preparing 3c9648ff845f: Waiting a346856793da: Preparing 37c15234e195: Preparing 9d8709c53aef: Preparing 3fb78a97e849: Waiting 8e05d451d71e: Preparing 1d23fab0fd9a: Waiting d1609e012401: Preparing 733879e640d2: Waiting e3f84a8cee1f: Preparing 48144a6f44ae: Preparing 7f923579f416: Waiting 26d5108b2cba: Preparing 89fda00479fc: Preparing 9d8709c53aef: Waiting e91df662618b: Waiting a346856793da: Waiting 89fda00479fc: Waiting 8e05d451d71e: Waiting 37c15234e195: Waiting e3f84a8cee1f: Waiting 48144a6f44ae: Waiting d1609e012401: Waiting 26d5108b2cba: Waiting c6c603551757: Pushed 2be04e20a0c1: Pushed b8973b334fd7: Pushed 70d7294495ac: Pushed 3c9648ff845f: Pushed 733879e640d2: Pushed a6f75c48ed33: Pushed 1d23fab0fd9a: Pushed 3fb78a97e849: Pushed 7f923579f416: Pushed 9d8709c53aef: Layer already exists 8e05d451d71e: Layer already exists d1609e012401: Layer already exists e3f84a8cee1f: Layer already exists 48144a6f44ae: Layer already exists 26d5108b2cba: Layer already exists 89fda00479fc: Layer already exists a346856793da: Pushed 37c15234e195: Pushed e91df662618b: Pushed 20220318060111: digest: sha256:a21bce5e4db09f047d92067408b883060c2844fb52305e3324d386b743e4c87e size: 4520 > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest org.apache.beam.examples.cookbook.FilterExamplesIT > testE2EFilterExamples FAILED java.lang.RuntimeException at FilterExamplesIT.java:73 org.apache.beam.examples.cookbook.DistinctExampleIT > testE2EDistinctExample FAILED java.lang.RuntimeException at DistinctExampleIT.java:81 *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0318060509-363b534d The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0318060509-363b534d *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0318060509-363b534d The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0318060509-363b534d *********************************************************** *********************************************************** org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.cookbook.CombinePerKeyExamplesIT > testE2ECombinePerKey FAILED java.lang.RuntimeException at CombinePerKeyExamplesIT.java:73 org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT > testTableIO FAILED java.lang.RuntimeException at BigQuerySamplesIT.java:108 *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0318060510-b90edea The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0318060510-b90edea *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0318060510-b90edea The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0318060510-b90edea *********************************************************** *********************************************************** org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.cookbook.MaxPerKeyExamplesIT > testE2EMaxPerKeyExamples FAILED java.lang.RuntimeException at MaxPerKeyExamplesIT.java:75 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.cookbook.JoinExamplesIT > testE2EJoinExamples FAILED java.lang.RuntimeException at JoinExamplesIT.java:63 13 tests completed, 9 failed > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Error: No such image: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318060111 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318060111] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 294 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 43m 32s 112 actionable tasks: 74 executed, 34 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/c3m5mvs4kvzai Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
