See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/519/display/redirect?page=changes>
Changes: [heejong] [BEAM-12716] Update XLang Kafka taxi example to use BigQuery sink [heejong] add comment ------------------------------------------ [...truncated 59.36 KB...] Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:container:pullLicenses Successfully installed beautifulsoup4-4.9.3 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:extensions:ml:jar > Task :sdks:java:io:kafka:jar > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:container:pullLicenses Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 207 dependencies using 16 threads. > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:jar > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 2.050099 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE > Task :sdks:java:io:google-cloud-platform:testJar > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/java/container github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 96a173ff1d77: Preparing 85e7f17d0ea6: Preparing 608617a3af99: Preparing 1ee95d3421f0: Preparing cb68ab209356: Preparing c68151717527: Preparing 8df2649d7b48: Preparing 82247980b0d2: Preparing af544f5c46c1: Preparing 0b77f60ddc44: Preparing e2081afba606: Preparing 31a5d4431766: Preparing ea822a1a4f9d: Preparing fe6a347f93b5: Preparing f3d5b8f65132: Preparing ad83f0aa5c0a: Preparing 5a9a65095453: Preparing 4b0edb23340c: Preparing 8df2649d7b48: Waiting afa3e488a0ee: Preparing c68151717527: Waiting 31a5d4431766: Waiting af544f5c46c1: Waiting ea822a1a4f9d: Waiting fe6a347f93b5: Waiting 0b77f60ddc44: Waiting e2081afba606: Waiting 5a9a65095453: Waiting ad83f0aa5c0a: Waiting f3d5b8f65132: Waiting 4b0edb23340c: Waiting afa3e488a0ee: Waiting cb68ab209356: Pushed 85e7f17d0ea6: Pushed 608617a3af99: Pushed 96a173ff1d77: Pushed 1ee95d3421f0: Pushed c68151717527: Pushed 82247980b0d2: Pushed af544f5c46c1: Pushed ea822a1a4f9d: Layer already exists fe6a347f93b5: Layer already exists f3d5b8f65132: Layer already exists ad83f0aa5c0a: Layer already exists e2081afba606: Pushed 5a9a65095453: Layer already exists afa3e488a0ee: Layer already exists 31a5d4431766: Pushed 4b0edb23340c: Layer already exists 8df2649d7b48: Pushed 0b77f60ddc44: Pushed 20210810060101: digest: sha256:7abbb4faa5602752927bc536cee63ff5ce480706bc0433640664efe52a2df5e4 size: 4310 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0810060901-6cadc69d The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0810060901-6cadc69d ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1628575737247.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0810060901-6cadc69d The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0810060901-6cadc69d The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1628575737247.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0810064019-dbc32f8d The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0810064019-dbc32f8d ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1628577618590.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0810064019-dbc32f8d The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0810064019-dbc32f8d The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1628577618590.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED java.lang.AssertionError at PubsubReadIT.java:88 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED java.lang.AssertionError at PubsubReadIT.java:60 37 tests completed, 2 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810060101 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7abbb4faa5602752927bc536cee63ff5ce480706bc0433640664efe52a2df5e4 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810060101] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7abbb4faa5602752927bc536cee63ff5ce480706bc0433640664efe52a2df5e4] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810060101] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7abbb4faa5602752927bc536cee63ff5ce480706bc0433640664efe52a2df5e4])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7abbb4faa5602752927bc536cee63ff5ce480706bc0433640664efe52a2df5e4 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7abbb4faa5602752927bc536cee63ff5ce480706bc0433640664efe52a2df5e4 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7abbb4faa5602752927bc536cee63ff5ce480706bc0433640664efe52a2df5e4]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2h 26m 42s 135 actionable tasks: 93 executed, 40 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/7kz3seq6zthp2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
