See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/173/display/redirect?page=changes>
Changes: [Pablo Estrada] [BEAM-11271] WgetDataset instead of getTable for query location [noreply] [BEAM-11841] Optimize byte size calculation of lazy iterables (#14610) [noreply] [BEAM-9920][BEAM-11418] Go Xlang artifact staging to GCP w/ Dataflow [noreply] Fix silent failures in Python SDK worker if pickled main session is [noreply] [BEAM-12258] Filter lists so testSQLLimit doesn't fail to parse "[]" [noreply] [BEAM-12250] Double Py Dataflow VR timeouts (#14754) ------------------------------------------ [...truncated 61.78 KB...] > Task :sdks:java:container:pullLicenses done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.9.3-py3-none-any.whl (115 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.9.3 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 3.11136 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto] Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug] Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net] Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2] Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync] Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 4e61813c4e93: Preparing c6d28fbccb13: Preparing 4c33951c526a: Preparing 4fbe3f547638: Preparing fa42ee881a2e: Preparing b153f4092c65: Preparing 4e5b9e23ecce: Preparing ec540e56f907: Preparing fbcb273d14a6: Preparing 9461d518d7f5: Preparing dda64e1afc03: Preparing 6dac86d0ad6f: Preparing d8460eb1eb77: Preparing 30b0cc543ee7: Preparing 26863b4714ee: Preparing 5d5962699bd5: Preparing a42439ce9650: Preparing 26270c5e25fa: Preparing e2c6ff462357: Preparing b153f4092c65: Waiting fbcb273d14a6: Waiting 4e5b9e23ecce: Waiting ec540e56f907: Waiting 5d5962699bd5: Waiting 9461d518d7f5: Waiting 6dac86d0ad6f: Waiting d8460eb1eb77: Waiting a42439ce9650: Waiting 30b0cc543ee7: Waiting 26863b4714ee: Waiting 26270c5e25fa: Waiting e2c6ff462357: Waiting 4c33951c526a: Pushed fa42ee881a2e: Pushed c6d28fbccb13: Pushed 4e61813c4e93: Pushed 4fbe3f547638: Pushed b153f4092c65: Pushed ec540e56f907: Pushed fbcb273d14a6: Pushed d8460eb1eb77: Layer already exists 30b0cc543ee7: Layer already exists 26863b4714ee: Layer already exists dda64e1afc03: Pushed 5d5962699bd5: Layer already exists 26270c5e25fa: Layer already exists a42439ce9650: Layer already exists e2c6ff462357: Layer already exists 6dac86d0ad6f: Pushed 4e5b9e23ecce: Pushed 9461d518d7f5: Pushed 20210508000053: digest: sha256:65405da4dcd46051eb4c2fb6eeb5fefd4fb7fb262afc718a7dfb93340da1ed2d size: 4310 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0508000841-c7acb691 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0508000841-c7acb691 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1620432516991.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0508000841-c7acb691 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0508000841-c7acb691 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1620432516991.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0508003130-f5671899 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0508003130-f5671899 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1620433890033.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0508003130-f5671899 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0508003130-f5671899 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1620433890033.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.healthcare.FhirIOPatchIT > testFhirIOPatch_ifMatch[R4] FAILED java.lang.ExceptionInInitializerError at FhirIOPatchIT.java:89 Caused by: java.lang.NullPointerException at FhirIOPatchIT.java:89 org.apache.beam.sdk.io.gcp.healthcare.FhirIOPatchIT > testFhirIOPatch[R4] FAILED java.lang.NoClassDefFoundError at FhirIOPatchIT.java:89 38 tests completed, 2 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210508000053 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:65405da4dcd46051eb4c2fb6eeb5fefd4fb7fb262afc718a7dfb93340da1ed2d Deleted: sha256:774d401787146690518e246109265758e0256e9004a0c2e55f191634a79ff9a0 Deleted: sha256:33caa521239efae2f42f61402231e88de1e8a97a4513480c96f1236bd41adb42 Deleted: sha256:96c62ee77c2d0eabfc52cd63950cfc451a7bc879396ed500b1d7937630d695bb Deleted: sha256:fd475c2f1e58196514d8182f3042a1bf2359508fccb52b3039155d820ddc5538 Deleted: sha256:8357987e6b2aaf65f14d5bfff1e65d78b9314d65e70ce6eb4c5d7cee7f8fc690 Deleted: sha256:b774d6ec4c8b0128c136e40387726712e3a4bd307f0de373f5cf078169d11162 Deleted: sha256:84316f3e4525e7df659a36e980c27a7cf3088994efa30a2663f82ab2addcfd9c Deleted: sha256:1ad1c8d3f49d773935864931567ef2dd7f74da89554c98b5f6ed5ad15a515ad1 Deleted: sha256:cb7699bcae1133d4340f4fd125ed18dbf08b3b324c00c5876363b3ca08d6469e Deleted: sha256:5a1dae1a0355d91b805272552bc68343b37a2c480d28bd282551f23c0cd78574 Deleted: sha256:9540d506f017a84172be0938ce11f603d87ef03c7864c951f99f7bac13a661e5 Deleted: sha256:df44bd8c7fdc1bcb2a2096fb294c0d248b96d1e4fb4c9f209095ffc172daddd7 Deleted: sha256:d194028225b97f1e81c46480ed3a88bdd4a5d5caf878cd072c22309babf74839 Deleted: sha256:f0e3023f525fae8c6fd6e8fc04caaaef7a0eb42596187fc27fb5c304bdeeb856 Deleted: sha256:438973e2be41374b4341d7a0b3971b3fb4873c8a1287de9ea6b28ec3da3416ab Deleted: sha256:d24d1db83909af841a1b9117447c405144307cafdeb0b06bb20215e03ca57b56 Deleted: sha256:3b9fa4d4f499dd975ee76b3fae35e5f845a9cee28f80eea6841e16b9fcc412cf Deleted: sha256:f93a6395b4cacba05349607e96ccf159eeed76527f3276aee598e89eb8eecce1 Deleted: sha256:17ca67799f27940f23e1de9e5fa892e675abe9142310f4d1d71ef286ca6e92d2 Deleted: sha256:20beda9fbe1e993533ccb75428f02805c3d29a6cdff7cf0408eb4f02f6790cd6 Deleted: sha256:8376ea34abf8075c3714cfab188c08c71c4258f9ac3a50223833c31ba597412a Deleted: sha256:ae2e4d71ef34c67b608311ac08088e812fd250b0eaf029dae4906551d293bfcb Deleted: sha256:e602a0748149c0b6bbf6b2e5d8291dd2d8e3f960dc103ddabd1d839096683405 Deleted: sha256:5ad342c964deaa9c0d726da9287999ed4d08c428ed2563af1fdac460a7bc7924 Deleted: sha256:15eaa68216e1bef51802b7dfad4aeb56c3721ce4eb8d153474afd14dfa0b3bb6 Deleted: sha256:caeac146bdf8c055ab5d73ca821291a517b8f1e49156721b4e09038a1e88b9f8 Deleted: sha256:390e9436f086ccecbb2245867ab0d6dc58b0efb49e86455666c3eb1671b14764 Deleted: sha256:3c5e52b80f3c6bb209345dc330302a4ecec7ee0351bc3b1b8d2e2706d40e0be6 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:65405da4dcd46051eb4c2fb6eeb5fefd4fb7fb262afc718a7dfb93340da1ed2d Associated tags: - 20210508000053 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210508000053 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210508000053]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:65405da4dcd46051eb4c2fb6eeb5fefd4fb7fb262afc718a7dfb93340da1ed2d]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 34m 55s 126 actionable tasks: 87 executed, 37 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/fn7s5unim33xy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
