See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/863/display/redirect?page=changes>
Changes: [noreply] Add missing parentheses for Python test example [noreply] Update test input and imports [25622840+adude3141] [BEAM-13157] support hadoop configuration on ParquetIO.Parse [Pablo Estrada] JdbcIO has a single WriteFn underlying all implementations [dpcollins] Performance improvement to PubSubLiteIO to not use a streaming committer [hlagosperez] Use BigQuieryIO.loadProjectId in WriteRename class to create [Luke Cwik] [BEAM-13015] Use a network based channel instead of an inmemory one [Pablo Estrada] Addressing comments [noreply] Merge pull request #15839 from [BEAM-13041][Playground] Prepare files [noreply] [BEAM-13001] updated CHANGES.md to include msec counter for Go (#15872) [noreply] Add window mapping to CHANGES.md (#15871) [noreply] Merge pull request #15784 from [BEAM-8135] - Removing [noreply] [BEAM-13119] Subdirectory prefix tag for Go SDK (#15881) [noreply] Merge pull request #15852 from [BEAM-13102] [Playground] update [Kyle Weaver] Fix typo: s/spark/twister2 ------------------------------------------ [...truncated 50.62 KB...] > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:pullLicenses Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.189224 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:io:google-cloud-platform:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:io:google-cloud-platform:testJar > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 87d2fc7bb00d: Preparing 40fcbcb20466: Preparing b55a16268284: Preparing 523f9d928c6b: Preparing c0f6337d24f0: Preparing c2370d5203e3: Preparing 2e9505cbbac4: Preparing bb17feee6d7b: Preparing b1924e800f13: Preparing 16ad385221c5: Preparing 8373df606869: Preparing 4c3f60340ef2: Preparing ebf469e844a6: Preparing 94c94d3b2e6b: Preparing 36e0782f1159: Preparing 2e9505cbbac4: Waiting 16ad385221c5: Waiting ba6e5ff31f23: Preparing 9f9f651e9303: Preparing 0b3c02b5d746: Preparing bb17feee6d7b: Waiting b1924e800f13: Waiting 62a747bf1719: Preparing c2370d5203e3: Waiting 8373df606869: Waiting 94c94d3b2e6b: Waiting 9f9f651e9303: Waiting 4c3f60340ef2: Waiting 36e0782f1159: Waiting ba6e5ff31f23: Waiting 62a747bf1719: Waiting 0b3c02b5d746: Waiting ebf469e844a6: Waiting 40fcbcb20466: Pushed c0f6337d24f0: Pushed b55a16268284: Pushed 87d2fc7bb00d: Pushed c2370d5203e3: Pushed 523f9d928c6b: Pushed bb17feee6d7b: Pushed b1924e800f13: Pushed 8373df606869: Pushed ebf469e844a6: Layer already exists 94c94d3b2e6b: Layer already exists 36e0782f1159: Layer already exists ba6e5ff31f23: Layer already exists 9f9f651e9303: Layer already exists 0b3c02b5d746: Layer already exists 62a747bf1719: Layer already exists 4c3f60340ef2: Pushed 2e9505cbbac4: Pushed 16ad385221c5: Pushed 20211104000045: digest: sha256:22a1dc3ac85b495b94526b7fdd397f80076c81b164925837fc9694c83bce4b05 size: 4311 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1104000437-8bb5e274 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104000437-8bb5e274 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1635984265996.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1104000437-8bb5e274 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104000437-8bb5e274 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1635984265996.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1104002830-e10dac34 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104002830-e10dac34 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1635985709737.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1104002830-e10dac34 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1104002830-e10dac34 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1635985709737.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:258 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED java.util.concurrent.ExecutionException at SpannerReadIT.java:126 Caused by: com.google.cloud.spanner.SpannerException at SpannerReadIT.java:116 Caused by: io.grpc.StatusRuntimeException at Status.java:535 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED java.util.concurrent.ExecutionException at SpannerReadIT.java:126 Caused by: com.google.cloud.spanner.SpannerException at SpannerReadIT.java:116 Caused by: io.grpc.StatusRuntimeException at Status.java:535 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED java.util.concurrent.ExecutionException at SpannerReadIT.java:126 Caused by: com.google.cloud.spanner.SpannerException at SpannerReadIT.java:116 Caused by: io.grpc.StatusRuntimeException at Status.java:535 38 tests completed, 4 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211104000045 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22a1dc3ac85b495b94526b7fdd397f80076c81b164925837fc9694c83bce4b05 Deleted: sha256:f4dd41a1a7ac8783aff549929ee85d91523713f1ac958f5ccb9be042e48d2e0e Deleted: sha256:e4aecd6bdcec56b2401a1b36a0b34f58b68e23d61b53b23da129cce606c49c35 Deleted: sha256:3d75253a3024bdd1552b514c4dd7e204b79b642ea4c7dea5faced6277e14d800 Deleted: sha256:5fafcf0ab8d36128fd130e1e1db6771a97fbc269d629749952c5a966af52d046 Deleted: sha256:a658c6c5b4e5da59a8228aed9db5e6f6eda56b00d0025e20903f4ba7456473d1 Deleted: sha256:8c9d943eea305e8b98273162b695c260cb51ebec5370f958c0161b3e23a949f0 Deleted: sha256:bc7f9be56ac16577ad012f797142e428df9cba8b1a1b41f4a14769dd545a6c9f Deleted: sha256:5f8b93aaf5aedb7c047d09b0165139cb0876bf394146872c14f0c950be84859c Deleted: sha256:11705e4af27fee35075f6c25660384024a6c854d55ed3958b9f50853f521c39c Deleted: sha256:e83972fc67a1fde7bb7dac5bda93b2200d0c7914264665499bf23a7622a326e1 Deleted: sha256:943fa1cc93e91bd381f62b7762c4ea8bdfbc958edecfa94b4f3801a31b12800e Deleted: sha256:d30b93d6c03ec878ecaa9c7367e2db909a1bfa4b53fd4173b5a1d8f6882a422e Deleted: sha256:642d53db037ff23e95963ae1e9c107f8874e883f945b18f1f13d137e2f9352c7 Deleted: sha256:7edfc1e631f22196194f31fcebcb6554084e7e9ba1470c16bc8715061380117a Deleted: sha256:fa42876c5c524a91aac71102aebd07fa30641e20e06aa56e39cf275ab0356e38 Deleted: sha256:fe200cdf0b993eecfa1be7bd1ad9a762f94b484bc4bd6770daf6e3b52b589855 Deleted: sha256:2dd6d472c71e0a7211fd1b12b68fb1a2db9c85f038e6036cb9fbdcd2ae956fbd Deleted: sha256:f616a1a01ce85b57f108d85ae1cfac115450e10c5019eff1bca32da237fa63db Deleted: sha256:a5c57b2bca396d27ec423c7be22959f323478df02de5ac2304d6ada2ce3ea8ee Deleted: sha256:b773c4e8104bfcfcb1a2e9226dbd9aaeef7af58bc8da03caf7528093967018f9 Deleted: sha256:8ea884f64b98e0b0f7e57e627220f3e167e129115fd643375e86f077dc7cea2d Deleted: sha256:fa2b2eec56180d93bca33a8897fe567e1317b05309a9876f221a15297550f116 Deleted: sha256:f948c4596caac2e3971a169939c306d7788bba8ea34a85caba0dce961a126987 Deleted: sha256:c425a7b584553312e429804f6e2f51519af0763cd290d7ee5ba2c660884ad0b9 Deleted: sha256:a695cae04d6cb3b34c6d1771038cc0658a42d1b153bc88e5f20cb5176cd171b6 Deleted: sha256:7f56b898f442219c62ea2dfbe9e571e2957aeae63be7067704def130d82a03c9 Deleted: sha256:510c3523fc568e0a76aa6ae4a97300102b26a893640887af3f3e872477d39e94 Deleted: sha256:6d9fad5591f370150b2dc40d7f454505d5273c70700cc69d9728a4ce02ba88a1 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211104000045] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22a1dc3ac85b495b94526b7fdd397f80076c81b164925837fc9694c83bce4b05] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211104000045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22a1dc3ac85b495b94526b7fdd397f80076c81b164925837fc9694c83bce4b05])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22a1dc3ac85b495b94526b7fdd397f80076c81b164925837fc9694c83bce4b05 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22a1dc3ac85b495b94526b7fdd397f80076c81b164925837fc9694c83bce4b05 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22a1dc3ac85b495b94526b7fdd397f80076c81b164925837fc9694c83bce4b05]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 48m 2s 129 actionable tasks: 90 executed, 37 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/oigjsnrb6jkw4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
