See <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/776/display/redirect?page=changes>
Changes: [Boyuan Zhang] [BEAM-12353] Sickbay new added failing test for Dataflow runner v2. [noreply] [BEAM-12361] Ensure that Reshuffle.AssignToShard numBuckets is respected [noreply] Run Jenkins jobs for Nexmark Dataflow V2 Java 8 and 11 (#14774) [noreply] [BEAM-7372][BEAM-9372] Cleanup py2 and py35 codepath from runners worker ------------------------------------------ [...truncated 57.58 KB...] Resolving cached github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, [email protected]:cpuguy83/go-md2man.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving github.com/spf13/afero: commit='bb8f1927f2a9d3ab41c9340aa034f6b803f4359c', urls=[https://github.com/spf13/afero.git, [email protected]:spf13/afero.git] Resolving github.com/spf13/cast: commit='acbeb36b902d72a7a4c18e8f3241075e7ab763e4', urls=[https://github.com/spf13/cast.git, [email protected]:spf13/cast.git] Resolving github.com/spf13/cobra: commit='93959269ad99e80983c9ba742a7e01203a4c0e4f', urls=[https://github.com/spf13/cobra.git, [email protected]:spf13/cobra.git] Resolving github.com/spf13/jwalterweatherman: commit='7c0cea34c8ece3fbeb2b27ab9b59511d360fb394', urls=[https://github.com/spf13/jwalterweatherman.git, [email protected]:spf13/jwalterweatherman.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving github.com/spf13/viper: commit='aafc9e6bc7b7bb53ddaa75a5ef49a17d6e654be5', urls=[https://github.com/spf13/viper.git, [email protected]:spf13/viper.git] Resolving github.com/stathat/go: commit='74669b9f388d9d788c97399a0824adbfee78400e', urls=[https://github.com/stathat/go.git, [email protected]:stathat/go.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving github.com/xordataexchange/crypt: commit='b2862e3d0a775f18c7cfe02273500ae307b61218', urls=[https://github.com/xordataexchange/crypt.git, [email protected]:xordataexchange/crypt.git] > Task :runners:google-cloud-dataflow-java:testJar > Task :sdks:java:container:pullLicenses done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.9.3-py3-none-any.whl (115 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.9.3 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 207 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.613473 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE > Task :sdks:go:resolveBuildDependencies Resolving go.opencensus.io: commit='3fb168f674736c026e623310bfccb0691e6dec8a', urls=[https://github.com/census-instrumentation/opencensus-go] Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto] Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug] Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net] Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2] Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync] Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 99d44aef9017: Preparing 88975377d540: Preparing dc857910890a: Preparing 812ea4e455c6: Preparing 4e56b022de69: Preparing c50e85049dad: Preparing e3a73cf5d6b9: Preparing 4abf984588a4: Preparing d7c1ac6d57f2: Preparing 389f44f2226a: Preparing 1e60c3c361c0: Preparing 4d64866b8bab: Preparing bd87f5884754: Preparing 4a64f1e3a7a1: Preparing 3fc095fab4a2: Preparing 685934357c89: Preparing ccb9b68523fd: Preparing 00bcea93703b: Preparing 688e187d6c79: Preparing 389f44f2226a: Waiting 1e60c3c361c0: Waiting 4a64f1e3a7a1: Waiting c50e85049dad: Waiting 3fc095fab4a2: Waiting 4abf984588a4: Waiting e3a73cf5d6b9: Waiting 685934357c89: Waiting ccb9b68523fd: Waiting 688e187d6c79: Waiting 00bcea93703b: Waiting bd87f5884754: Waiting 4d64866b8bab: Waiting 4e56b022de69: Pushed dc857910890a: Pushed 88975377d540: Pushed 99d44aef9017: Pushed 812ea4e455c6: Pushed c50e85049dad: Pushed 4abf984588a4: Pushed d7c1ac6d57f2: Pushed bd87f5884754: Layer already exists 4a64f1e3a7a1: Layer already exists 3fc095fab4a2: Layer already exists 1e60c3c361c0: Pushed 685934357c89: Layer already exists ccb9b68523fd: Layer already exists 00bcea93703b: Layer already exists 688e187d6c79: Layer already exists e3a73cf5d6b9: Pushed 4d64866b8bab: Pushed 389f44f2226a: Pushed 20210519005907: digest: sha256:12ffb782b38bd291529c7675232b38fc1e43f56bd505f801f5c1a24249dc0f89 size: 4310 > Task :runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming org.apache.beam.sdk.transforms.ParDoTest$StateTests > testCombiningState FAILED java.lang.RuntimeException at ParDoTest.java:2672 org.apache.beam.sdk.testing.PAssertTest > testPAssertThatListSatisfiesMultipleMatchers FAILED java.lang.RuntimeException at PAssertTest.java:707 org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testWindowedCombineGloballyAsSingletonView FAILED java.lang.RuntimeException at CombineTest.java:1399 org.apache.beam.sdk.transforms.ParDoTest$KeyTests > testKeyInOnTimer FAILED java.lang.RuntimeException at ParDoTest.java:5410 org.apache.beam.sdk.transforms.ViewTest > testEmptyMultimapSideInputWithNonDeterministicKeyCoder FAILED java.lang.RuntimeException at ViewTest.java:906 org.apache.beam.sdk.transforms.ParDoTest$BasicTests > testParDo FAILED java.lang.RuntimeException at ParDoTest.java:383 org.apache.beam.sdk.transforms.GroupByKeyTest > org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKeyWithBadEqualsHashCode FAILED java.lang.RuntimeException at GroupByKeyTest.java:453 238 tests completed, 7 failed, 2 skipped > Task :runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210519005907 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:12ffb782b38bd291529c7675232b38fc1e43f56bd505f801f5c1a24249dc0f89 Deleted: sha256:6a9c1f4fee95535b5f19aa1659da29317ec91450117421f3756e1d6465ec5f4f Deleted: sha256:0b30bf83c2eb20f589458e0017b264a2bfdc407a143b147cc7e2a98c624601a0 Deleted: sha256:b00298993d648e1cdcf077f2df184f2bc3b14ba8a6001a886ab893eb9e774cf5 Deleted: sha256:e3efab1e79d62a8a29fe04ca6ec08ea0575dcfbe280e2fa5c7f5fabfa3e12728 Deleted: sha256:245be8d7718618b20be76d5284083b18018fde037a03440bebb663aad8982104 Deleted: sha256:05f621ad4a66646ee56442b255a189221bb3319e3d1d294478d7b20ecd809a67 Deleted: sha256:02c18b16f453a584d7701b9f08d6bf711718c7ab66144c2ac8c501b799e38526 Deleted: sha256:ddd0b76b3a251958a93a712d1e01fa9e0728bae36d6578189e50eb6ab3b37975 Deleted: sha256:94960f0da373f0b4425c379ee7d987ce9b7275e4dc3e9ccf53445811c20f8c52 Deleted: sha256:8d1fb35608d714b23e8f47f05d5a891880905246351dd92209a9b4c75efa4ca7 Deleted: sha256:df4468872686a0f47f69aaf343835f2dc3b13e1159b0e29ddf05650402d34f91 Deleted: sha256:c50770526c9cdd91d196adfdfa840fdeb2c6074820ed95141dbaaf87cb330179 Deleted: sha256:d83bb1b3850bab6e215c5a3267f2cab6f32d924d80cc3fb8d1eb73325d490ab8 Deleted: sha256:40c5bef01822622e930b0b36696f1dd68b84634951507ec8bea72dd6bc8ff033 Deleted: sha256:ad1ccf84628aa5d67073e67853aaf38aa34c3c68050e6a4f040c1be92d613595 Deleted: sha256:d7207846fe0c7a119452b1ec800d665b13d94475d5d505d5b53b0a7a53f8c683 Deleted: sha256:f5bf355491550e97f57fb603b4e5645617a96226e6c9633e8f038e773e0c79af Deleted: sha256:0398fcb55382a3803a0137dc8a0833b8c2efa57b2a98d72e17600d2af1f8d517 Deleted: sha256:9888847649a3b75e0eb765f3d66f8f41406c56e4b04c77436842477f9642db49 Deleted: sha256:c74e5cf07c682c1496aefa1a87b663bda369a4cbda8a27becd470d49241bf29d Deleted: sha256:718576a213ce09d135a4d3b6725e4f653bf6aba552eb09ee8eae1f46a749f964 Deleted: sha256:8f141c1d31c64771e145714208e18bdc339902afc10047b55b20af22b7c9e6e2 Deleted: sha256:da1a104c98c85c40e2a6f6c30d36dc074fbaf631757f760bc91bdeb917680fe6 Deleted: sha256:5273be11018099c1aa1992e6b82549217c3e3c66f586f881f4185a7fe3afaf97 Deleted: sha256:15e94c0055b807fdcb3f2545c17b1c3806530aba6e6b5a68444f5e48484a6503 Deleted: sha256:bf00ca24638b2aea691fb565b072019c10a9d79c3c285606c3a70bad1ddefed8 Deleted: sha256:bc7818c1c912f1158e12c3ffa0605a28c71bbbb4588057e0fea42ac571d08faf Deleted: sha256:4b01c52d4563709f1f4efce914b5f2619e4fbea985171eb59f7e2fa255bc99b6 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:12ffb782b38bd291529c7675232b38fc1e43f56bd505f801f5c1a24249dc0f89 Associated tags: - 20210519005907 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210519005907 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210519005907]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:12ffb782b38bd291529c7675232b38fc1e43f56bd505f801f5c1a24249dc0f89]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerV2TestStreaming/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6h 9m 56s 121 actionable tasks: 83 executed, 36 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/xmhxg6q7sjos2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
