See <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/1143/display/redirect?page=changes>
Changes: [baeminbo] [BEAM-12751] Set clientRequestId for Dataflow python job creation [Daniel Oliveira] [GoSDK Infra] Bugfix: Parallelism ignored when using endpoint flag. ------------------------------------------ [...truncated 36.76 KB...] > Task :sdks:java:extensions:protobuf:jar > Task :sdks:java:io:common:compileTestJava FROM-CACHE > Task :sdks:java:io:common:testClasses UP-TO-DATE > Task :sdks:java:io:common:testJar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:java:testing:test-utils:compileJava FROM-CACHE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:jar > Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE > Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE > Task :sdks:java:testing:test-utils:testJar > Task :sdks:java:core:compileTestJava FROM-CACHE > Task :sdks:java:core:testClasses > Task :sdks:java:core:shadowTestJar FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava > FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:testJar > Task :runners:core-construction-java:compileTestJava FROM-CACHE > Task :runners:core-construction-java:testClasses UP-TO-DATE > Task :runners:core-construction-java:testJar > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:extensions:protobuf:extractIncludeTestProto > Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE > Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE > Task :sdks:java:extensions:protobuf:testClasses > Task :sdks:java:extensions:protobuf:testJar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:io:google-cloud-platform:testJar > Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE > Task :runners:google-cloud-dataflow-java:testJar > Task :sdks:java:container:generateLicenseReport > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.9.3-py3-none-any.whl (115 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.9.3 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 207 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.215153 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 63715e69a507: Preparing 4fca9a280c79: Preparing 35847c109e5a: Preparing be6a1590cadb: Preparing fcdf9290b215: Preparing ea2a4065aa5d: Preparing c01dca04eeae: Preparing 098de3344711: Preparing 77589ef2c759: Preparing effc5d4353e9: Preparing 0aa5f768d4c7: Preparing 3d9fcc5f955d: Preparing cf8ce6105788: Preparing 8ff94addd2f4: Preparing 062f9311b72d: Preparing 9889ce9dc2b0: Preparing 21b17a30443e: Preparing 05103deb4558: Preparing a881cfa23a78: Preparing cf8ce6105788: Waiting 0aa5f768d4c7: Waiting c01dca04eeae: Waiting 098de3344711: Waiting 062f9311b72d: Waiting 9889ce9dc2b0: Waiting 21b17a30443e: Waiting 3d9fcc5f955d: Waiting 05103deb4558: Waiting ea2a4065aa5d: Waiting 77589ef2c759: Waiting effc5d4353e9: Waiting a881cfa23a78: Waiting 35847c109e5a: Pushed fcdf9290b215: Pushed 4fca9a280c79: Pushed ea2a4065aa5d: Pushed 63715e69a507: Pushed 098de3344711: Pushed be6a1590cadb: Pushed 77589ef2c759: Pushed cf8ce6105788: Layer already exists 8ff94addd2f4: Layer already exists 062f9311b72d: Layer already exists 9889ce9dc2b0: Layer already exists 21b17a30443e: Layer already exists 05103deb4558: Layer already exists a881cfa23a78: Layer already exists 0aa5f768d4c7: Pushed 3d9fcc5f955d: Pushed c01dca04eeae: Pushed effc5d4353e9: Pushed 20210827060113: digest: sha256:70b03478055285a7fa12ced846c83ec526dc755fe56ee4e030c0f19459d38a87 size: 4311 > Task :runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testWindowedCombineGloballyAsSingletonView FAILED java.lang.RuntimeException at CombineTest.java:1399 org.apache.beam.sdk.transforms.ParDoTest$TimerTests > testTwoTimersSettingEachOtherWithCreateAsInputBounded FAILED java.lang.RuntimeException at ParDoTest.java:4504 241 tests completed, 2 failed, 3 skipped > Task :runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210827060113 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70b03478055285a7fa12ced846c83ec526dc755fe56ee4e030c0f19459d38a87 Deleted: sha256:acd9b3b909e3ca5e3d2b4b5a60706c68aff7e6a7cbbd02714b34c4e2aea402ed Deleted: sha256:8e32d9deab1ee9a460d320406e36c0003c85e955f15ac884d072365a8b5c1d75 Deleted: sha256:61c187939ef1508bbfc8474edd892e87033d09f8714e4dba81a10d8a51a57c15 Deleted: sha256:5f68003522ad4e958b879c67f905ab90df29b5bfef5b3fe077c04169ac753db0 Deleted: sha256:625417057ecb154981b6caf0bf667ae919de5fcd94e8e85ff40ece5ce9384eb3 Deleted: sha256:3c1cb1b40ff65cf9859e0b89ec63ea122b6c42933b81762168aa76c748ad15d6 Deleted: sha256:4ecd23d5d611015322267712b0cc4a7ed777831dd8d3b2e83b0c85a1e10bde1d Deleted: sha256:a905e0f6ba719752877f05e5cef8bec65a6ddbe164c33cd41ab071add236f2ad Deleted: sha256:a21408601a39698220f99fcade1ce483a423a048c83824a933bd9ca48c35a1ad Deleted: sha256:13ed1d7febf2fac8cc97b41eece1e82e66a42ba1be4cfc7582db488c4146ef53 Deleted: sha256:52023a6b15ee2eb2a3c6498bab802c055c62c4d0c688a1d3747c8eab7ba17262 Deleted: sha256:ddfc0b29121bd073a63d3548e6004d72251b261264eecd6103389a22136bbe6a Deleted: sha256:73a9bd958468e504997e4ca7bd5e2d81ad66439b18bbf9803dec06f9356b384f Deleted: sha256:415ea62e9ab4c577919e3d6269398fd4bc7a40f5abb4ce5f60d644238605e2d3 Deleted: sha256:e6a400d3b2eb3ae9bb546df51ba448c8b8869b88ec6fd1022b7ec59a8147acc1 Deleted: sha256:63dd1ec1e16a336871c3c2ea5bdcae1e3c668ccdda2787e0cf9e1ae6e8b0cc97 Deleted: sha256:a489d109481b7200a97a0f78db1a093683f0ceb25b7077ef081a253d39eac9c3 Deleted: sha256:36aba34359ef6c1a67a8bd3e89653e7f386e3176c2cec50ec57bdb5d9a67ef4f Deleted: sha256:8f26c8cde005f1d661ffdf6de625ec783caa40f0313dd508490490b8cf40d7eb Deleted: sha256:78e31208cd4b95556cb66171dfa2588c241299e89f7cb0395112197d11f343f5 Deleted: sha256:966846a7c676aa7ece45bc3f50b2f46ec002e94750f3b854693e1683dded6079 Deleted: sha256:8569765756d99da554eab2541290cfd1ec244b99a6bd7140913c53043f720af4 Deleted: sha256:93c47862bff54cf5159bc85406140fbdc94dfd9469f8d4f876eeaddac56f6266 Deleted: sha256:7645cb78617dd823adf73769c90b0dcfe24cc68565a67d731e36868e7a4ac6a1 Deleted: sha256:ff78a5a07951b4b51bf1842acbce399c898693552981271ce02aca33f875f903 Deleted: sha256:26a19950eb557b2f1063c6e992d82cf0835f7c4c2da39ca76b8934a58bfdcc86 Deleted: sha256:47a196e7c3a4fadba8a545afeaefcaecb924a6f83ce7e85b27dece79be3bc37b Deleted: sha256:ab2afbd480f2e90c37b5ebe52e024843437e2b1f78115a698cb4f23bd5589815 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210827060113] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70b03478055285a7fa12ced846c83ec526dc755fe56ee4e030c0f19459d38a87] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210827060113] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70b03478055285a7fa12ced846c83ec526dc755fe56ee4e030c0f19459d38a87])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70b03478055285a7fa12ced846c83ec526dc755fe56ee4e030c0f19459d38a87 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70b03478055285a7fa12ced846c83ec526dc755fe56ee4e030c0f19459d38a87 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70b03478055285a7fa12ced846c83ec526dc755fe56ee4e030c0f19459d38a87]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerV2TestStreaming/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 5h 32m 59s 124 actionable tasks: 83 executed, 39 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/pedf2tnbs7beg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
