See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/667/display/redirect?page=changes>
Changes: [Ismaël Mejía] [BEAM-9283] Disable caching ValidatesRunner tests tasks [Kenneth Knowles] Enable dual job submission for Dataflow [zyichi] [BEAM-12045] Install google cloud profiler agent in java sdk container [edre] Fix worker_pool plumbing to use a mutable List. [noreply] [BEAM-12237] Fix logging in Samza Runner (#14657) [Valentyn Tymofieiev] [BEAM-2085] Add resource hints support in Java SDK. [Valentyn Tymofieiev] Translate Resource Hints into v1beta3 API in DF Runner and add test [Valentyn Tymofieiev] Support passing resource hints through pipeline options. [Valentyn Tymofieiev] Add resource hints supported by Dataflow. ------------------------------------------ [...truncated 56.78 KB...] INFO:root:pull_licenses_java.py succeed. It took 6.776798 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] > Task :runners:google-cloud-dataflow-java:compileJava > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :runners:google-cloud-dataflow-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:google-cloud-dataflow-java:classes > Task :release:go-licenses:java:dockerRun + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/java/container > Task :runners:google-cloud-dataflow-java:jar > Task :release:go-licenses:java:dockerRun golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Unable to watch the file system for changes. The inotify watches limit is too low. Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 4ad91a0c43fe: Preparing ce2913d4dce2: Preparing b67fae50b951: Preparing f0e02916bce6: Preparing c0f8b53cd83d: Preparing 84f37f416034: Preparing df3f110afe2d: Preparing fd7f74fecdf2: Preparing 6d51d7624fd3: Preparing 75fe71f2e746: Preparing 602373019d0b: Preparing 8533dd5e0b71: Preparing d8460eb1eb77: Preparing df3f110afe2d: Waiting 8533dd5e0b71: Waiting 30b0cc543ee7: Preparing 84f37f416034: Waiting 602373019d0b: Waiting d8460eb1eb77: Waiting 30b0cc543ee7: Waiting 26863b4714ee: Preparing 5d5962699bd5: Preparing 26863b4714ee: Waiting a42439ce9650: Preparing 5d5962699bd5: Waiting fd7f74fecdf2: Waiting 26270c5e25fa: Preparing 6d51d7624fd3: Waiting e2c6ff462357: Preparing 26270c5e25fa: Waiting e2c6ff462357: Waiting b67fae50b951: Pushed c0f8b53cd83d: Pushed ce2913d4dce2: Pushed 4ad91a0c43fe: Pushed 84f37f416034: Pushed f0e02916bce6: Pushed fd7f74fecdf2: Pushed 6d51d7624fd3: Pushed d8460eb1eb77: Layer already exists 30b0cc543ee7: Layer already exists 602373019d0b: Pushed 26863b4714ee: Layer already exists 5d5962699bd5: Layer already exists a42439ce9650: Layer already exists 26270c5e25fa: Layer already exists e2c6ff462357: Layer already exists 8533dd5e0b71: Pushed df3f110afe2d: Pushed 75fe71f2e746: Pushed 20210428060119: digest: sha256:7bb2a8fdb5b77b9f43a7e9425dc94a6fd42d6425478d08f92e25856cefe14a47 size: 4310 > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExportUsingQuery FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:70 Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED java.lang.IllegalArgumentException at BigQueryTornadoesIT.java:68 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:70 Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70 org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED java.lang.RuntimeException at BigQueryTornadoesIT.java:70 Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70 *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061046-d52d0afc The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061046-d52d0afc ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1619590241603.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061046-d52d0afc The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061046-d52d0afc The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1619590241603.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061116-17b9373d The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061116-17b9373d ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1619590276509.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061116-17b9373d The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061116-17b9373d The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1619590276509.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** 8 tests completed, 4 failed > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428060119 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7bb2a8fdb5b77b9f43a7e9425dc94a6fd42d6425478d08f92e25856cefe14a47 Deleted: sha256:192e1588ca9593045742ef9f74dcc239a601e9dca6e5a2fe873ca8eece4a3cfa Deleted: sha256:47f0462e5b5c38acf49ab3979345ba2ec07ff24ea2009359be724154c0074931 Deleted: sha256:db4d21afdcb761a1843f01c663f8ec8a1943cd8f64d23bbe36dbcd577cdc0a71 Deleted: sha256:d2088eee860355715d1b0adabbf7cf0bbbbecde6514ddf927bf1bdb5180e34f2 Deleted: sha256:bfb193e5b6655629cbab664d8fc124b032c83ef1a6494500738ab82d44abadf0 Deleted: sha256:5dfb41e81b178a692dde5c459cdc0289536e2f915379a321fe3a83d82bc8f577 Deleted: sha256:c6a0d5422e68f1449edfb197e0dca021fa4478c5140fac32fe180ff876de07e2 Deleted: sha256:5d04f88718162e2d90ad6f4c5d7888eb3f0d9d1e2ea2fd062e6574089d35530b Deleted: sha256:52001c8e2487c743699d5525cf6c70d66654b1e0670014ee34bc140f04dd1f5d Deleted: sha256:981f3c2e56a66d9bfb650d1e1307c688d2a43430c3957cc3d72adfb6668c1c90 Deleted: sha256:68569d99655342880f417b26a3d7094b17228ff9b18c4f1f843daa03a210bbaa Deleted: sha256:0749948c605793c8d5bbdf8a5511c2c34bdee267fbc313a226de35b8811fc0d0 Deleted: sha256:2ebadd49b105792031b3e424f072b19bccd4735749abe998c7a8c61a27612acb Deleted: sha256:c5d3f97b9192f3e6e95807ecce4b39beeb810aa86de571b768d724d281926dc2 Deleted: sha256:564369657e2782cb8da6697f5878e97978919c46c641bbe7d43fb3b1ceef46e6 Deleted: sha256:54c420d9f1c0f1946d7af7b2d5d01858658731bf7e2b021f76c99198fea9cbca Deleted: sha256:1d4ddafa7b1106ffded7aa1b23fa08ce8e09abf71fa5fe0a0e9bbc4831b3a64f Deleted: sha256:58c4ff3040402a39f12e18ca01a666bd2fefc6db55e627d4185b70466484c2ab Deleted: sha256:6e0d218d7443f77d7d7d403a4e5543ff9597ca8fd3c14c9b2615a4ebf2dd3b7a Deleted: sha256:af72895402d83a95a9d90149102cc139e2d2cdd1b7888a14f4c7c598f0b0b19c Deleted: sha256:5d18cc55eb72dcdf0717b86c8823bae1ea16d6016dcb344989c94b328947852e Deleted: sha256:6eb29b0a1dab427f350e351aba2df0a69320ba8ba77b7db54595f410aa28fab7 Deleted: sha256:b6a59066aed9ed9dfc1bb17c4ef600bc5bb14bd3475bc11954715dd9e0a2e146 Deleted: sha256:9f57b169797fa617d55c65f6e2c5f454044e95dc5ca399bb434acf5fd149c946 Deleted: sha256:ba746e746431fc0a4ef6a9df8f55804dedb9ff7f5e9430ca7583f88aabcd7277 Deleted: sha256:61b6d568f527f65131b06b1f42aff2964c73ea6aedbaa93835e3ccbc24978f5f Deleted: sha256:ff8cd387d43aa4b6e2ce14243df8dea73be948508f8a223c44c733916a524bc0 Deleted: sha256:09583dfe6b46fae9b2c5026cb6166c84d47be9473b02b77f93d0d29cde7313b4 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7bb2a8fdb5b77b9f43a7e9425dc94a6fd42d6425478d08f92e25856cefe14a47 Associated tags: - 20210428060119 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428060119 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428060119]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7bb2a8fdb5b77b9f43a7e9425dc94a6fd42d6425478d08f92e25856cefe14a47]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 29m 50s 107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/5eilgs4m6jfl6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
