See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/180/display/redirect?page=changes>
Changes: [yoshiki.obata] [BEAM-7372] cleanup py2 codepath from apache_beam/ml, options and [Kenneth Knowles] Remove use of beam_fn_api experiment from Dataflow tests ------------------------------------------ [...truncated 62.48 KB...] Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.9.3 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 5.634007 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto] Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug] Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net] Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2] Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync] Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 56743649d26c: Preparing f545754e8e58: Preparing 82f9ab64630d: Preparing 682a7c668516: Preparing f7d61ea9dc9a: Preparing 3be9c813555f: Preparing 1eb8794789a8: Preparing c3ed5a629404: Preparing 81ea6f3549c4: Preparing ff3a0cc8cfc5: Preparing 7d7812ee22fd: Preparing 9429731beebf: Preparing d8460eb1eb77: Preparing 30b0cc543ee7: Preparing 26863b4714ee: Preparing 5d5962699bd5: Preparing a42439ce9650: Preparing 26270c5e25fa: Preparing e2c6ff462357: Preparing 7d7812ee22fd: Waiting a42439ce9650: Waiting 5d5962699bd5: Waiting 26270c5e25fa: Waiting 30b0cc543ee7: Waiting e2c6ff462357: Waiting 9429731beebf: Waiting 26863b4714ee: Waiting c3ed5a629404: Waiting 81ea6f3549c4: Waiting d8460eb1eb77: Waiting ff3a0cc8cfc5: Waiting 3be9c813555f: Waiting 1eb8794789a8: Waiting f7d61ea9dc9a: Pushed f545754e8e58: Pushed 82f9ab64630d: Pushed 3be9c813555f: Pushed 56743649d26c: Pushed 682a7c668516: Pushed c3ed5a629404: Pushed 81ea6f3549c4: Pushed d8460eb1eb77: Layer already exists 30b0cc543ee7: Layer already exists 7d7812ee22fd: Pushed 26863b4714ee: Layer already exists a42439ce9650: Layer already exists 5d5962699bd5: Layer already exists 26270c5e25fa: Layer already exists e2c6ff462357: Layer already exists 9429731beebf: Pushed 1eb8794789a8: Pushed ff3a0cc8cfc5: Pushed 20210511180056: digest: sha256:04dfad5bc449bdb3c6106170f457c921a109558749bdfe3d690008d701d5c70d size: 4310 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0511180825-7beb6890 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0511180825-7beb6890 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1620756500721.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0511180825-7beb6890 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0511180825-7beb6890 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1620756500721.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0511183244-87fc3aac The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0511183244-87fc3aac ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1620757964317.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0511183244-87fc3aac The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0511183244-87fc3aac The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1620757964317.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT > classMethod FAILED java.lang.RuntimeException at BigQueryToTableIT.java:261 Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryToTableIT.java:261 org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED java.lang.AssertionError at PubsubReadIT.java:88 org.apache.beam.sdk.io.gcp.healthcare.FhirIOPatchIT > testFhirIOPatch_ifMatch[R4] FAILED java.lang.ExceptionInInitializerError at FhirIOPatchIT.java:89 Caused by: java.lang.NullPointerException at FhirIOPatchIT.java:89 org.apache.beam.sdk.io.gcp.healthcare.FhirIOPatchIT > testFhirIOPatch[R4] FAILED java.lang.NoClassDefFoundError at FhirIOPatchIT.java:89 35 tests completed, 4 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210511180056 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04dfad5bc449bdb3c6106170f457c921a109558749bdfe3d690008d701d5c70d Deleted: sha256:98937a2e3e0e969dab1ba95e4977bd78fde6aa0d73fc353b057e272f15aea426 Deleted: sha256:97d47ab34bc8923e9c93577ea8dbfb682def4acdc06da98145d2ff58cf415fd3 Deleted: sha256:01d0c379726af690a2bd398206b0dd3e705a41a6887c0128129a880cf94c7e22 Deleted: sha256:90a647a1a296b8f7bd1532ab14b3429f0bee505aa569d97b2edb8a611bb44226 Deleted: sha256:459c9378229b96786fc21c1c76db67d90ae622e4d97c50a5c0eea12daf221469 Deleted: sha256:a89fcc416103d419ec8b7bc6884f5b6ac6a509023205af2f95c25f6bfb35c1d7 Deleted: sha256:687706e21bf4048ca15d44f2024308771934a129c1e3ad1323b453d385cc804d Deleted: sha256:75aeb91f58ecdcad8b13cfd412a593861f32b648451df63888631b2e61abdd69 Deleted: sha256:207bdec1fe2fe2e4f9c287a2a17639aaed93f7182fa3290321398efc45ecfb97 Deleted: sha256:6569c049516a7384da7aa49d0789d869dbfd8c8d8ee9c2fc40f1e48a769f858b Deleted: sha256:db63fb2c7307745d729ff3d5ec0c197245c7bc934a36e94e9fae77ee54f961e1 Deleted: sha256:891fe16f80eac3bfe776c4284d2fcd1082cab9713a4ccfffd6553d79a6db4239 Deleted: sha256:b2cb92619b0fbe05e89c8e3331c8c73cb3093a84abb8a82a65145f027416af0f Deleted: sha256:419a9fa03dd87b7585f6ab0e58c7abcfe332f9d3dfabece61ba5c2d94d882d48 Deleted: sha256:37b87a4d0dc89b19392502ec2734a18056404b46858c7f84dc9a59de27b7beb4 Deleted: sha256:dcfe03f6776ffaa57026b33ff516040748561c566edd0a8e355559e50900392e Deleted: sha256:72bcc2d5dd4110a93d592c55541ccff6e46d2424ec016b9a8719c1632e3dfb5e Deleted: sha256:39c19e9222d6eaf1f8d4ee311f5f4f0d7f726e705c892e5c0aaa515c3862107b Deleted: sha256:8947247592315f0ff44315ec133fa40e9ab94029a17af8b552387215754a80b6 Deleted: sha256:af093f3373d28514b6bf0e484e3d5a4d612f34e54aae717c20cde7ab1ed909cc Deleted: sha256:5e9df4d28dafceb628722a89d7d67b9682df601ff0704c3aad69726231e8af5b Deleted: sha256:214c4ce183e98ed97ae51da224db12b81503898ce0ce09e4c7913720d8aba50d Deleted: sha256:dd73901e7ee12140f40df02b134a788f5aee9cf46fb45b8634d2059993b3234b Deleted: sha256:e41ffe79a04242db86aa97ae77d0cd97f3dfc428de46d6148228ba2a99b6baa5 Deleted: sha256:b1fd30b67ef21bc9898befaed01825f41d0c1594a75dc1237789713fd603d831 Deleted: sha256:4d0b8b7ac8529c320124528e259bc914528221913ae610d0214e27cd59061a78 Deleted: sha256:67eb85bd8efde6196ceded4b25629c11ce4576340411918ad90778bfe2bb8b4a Deleted: sha256:b68334814bdc850062dec386d3aad250985a307a51b90b1a3d41cf009074a487 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04dfad5bc449bdb3c6106170f457c921a109558749bdfe3d690008d701d5c70d Associated tags: - 20210511180056 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210511180056 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210511180056]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04dfad5bc449bdb3c6106170f457c921a109558749bdfe3d690008d701d5c70d]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 27m 38s 126 actionable tasks: 87 executed, 37 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/rjiaimqke4ype Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
