See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1471/display/redirect?page=changes>
Changes:
[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache
Parquet
[noreply] Update python beam-master container image. (#17313)
------------------------------------------
[...truncated 54.25 KB...]
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.0.4 setuptools-62.0.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.11.0-py3-none-any.whl (71 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.2 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 225 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ export GO111MODULE=off
+ GO111MODULE=off
+ go get github.com/apache/beam/sdks/java/container
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 29.006127 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
8b9f936fb643: Preparing
8289e1411377: Preparing
ca546574231d: Preparing
2216c8e543b2: Preparing
da08585ece73: Preparing
2aa7db7cd5aa: Preparing
77581bd4e9b8: Preparing
b2697c37ced2: Preparing
8bb685b5e467: Preparing
d688a7e71ad5: Preparing
31e83f0f5f86: Preparing
fce2af80fd36: Preparing
823f20c41096: Preparing
963e3993e6d3: Preparing
f6041b7cf19b: Preparing
7494d840ea88: Preparing
357cc1947e95: Preparing
b0dc1a441986: Preparing
7a7698da17f2: Preparing
d59769727d80: Preparing
348622fdcc61: Preparing
4ac8bc2cd0be: Preparing
2aa7db7cd5aa: Waiting
823f20c41096: Waiting
963e3993e6d3: Waiting
7a7698da17f2: Waiting
f6041b7cf19b: Waiting
77581bd4e9b8: Waiting
d59769727d80: Waiting
4ac8bc2cd0be: Waiting
31e83f0f5f86: Waiting
d688a7e71ad5: Waiting
fce2af80fd36: Waiting
b2697c37ced2: Waiting
348622fdcc61: Waiting
7494d840ea88: Waiting
b0dc1a441986: Waiting
357cc1947e95: Waiting
2216c8e543b2: Pushed
da08585ece73: Pushed
8289e1411377: Pushed
ca546574231d: Pushed
8b9f936fb643: Pushed
77581bd4e9b8: Pushed
b2697c37ced2: Pushed
d688a7e71ad5: Pushed
8bb685b5e467: Pushed
fce2af80fd36: Pushed
2aa7db7cd5aa: Pushed
31e83f0f5f86: Pushed
7494d840ea88: Layer already exists
357cc1947e95: Layer already exists
b0dc1a441986: Layer already exists
7a7698da17f2: Layer already exists
d59769727d80: Layer already exists
348622fdcc61: Layer already exists
4ac8bc2cd0be: Layer already exists
f6041b7cf19b: Pushed
963e3993e6d3: Pushed
823f20c41096: Pushed
20220408095737: digest:
sha256:0c08dbf36e955bb67c61d275fd3ac717ebae26a1bc06af9e2b74655c8b3517a5 size:
4935
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408100001-5111d977
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408100001-5111d977
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408100001-5111d977
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408100001-5111d977
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408100001-966fcbe0
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408100001-966fcbe0
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408100001-966fcbe0
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408100001-966fcbe0
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageWriteIT >
testBigQueryStorageWrite30MProto FAILED
java.lang.RuntimeException at BigQueryIOStorageWriteIT.java:101
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamIT >
testReadSpannerChangeStream FAILED
java.lang.IllegalArgumentException at SpannerChangeStreamIT.java:139
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamTransactionBoundariesIT
> testTransactionBoundaries FAILED
java.lang.IllegalArgumentException at
SpannerChangeStreamTransactionBoundariesIT.java:145
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:264
49 tests completed, 4 failed, 3 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408095737
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c08dbf36e955bb67c61d275fd3ac717ebae26a1bc06af9e2b74655c8b3517a5
Deleted: sha256:4b5b2c8e2615d1dec66393aac163f3abe7e241ff9c5c5355cd2053251e4b57c1
Deleted: sha256:542d7a691cbe8c3c6cf9a5eba79ab12cadf46f067c0f731fccd73928ddbb3870
Deleted: sha256:166349170ad30626bbe2acebf6976180e77daf27eeb92cead76a925c5490a21f
Deleted: sha256:6b7fdab9ee5bbeb0c6548bc7a1c4b750ebd5e8de01864437daa3f896d3d4be42
Deleted: sha256:41cba2169633f6a4b9c04d0ccb9af7646e6fd4146ffdcdc287781bdabf78ad8f
Deleted: sha256:d9b3460ad7e302e615636bd0da58b9ec7e23cf26d0c76eb4ca7e41e71e7ddf63
Deleted: sha256:94f6501aec608276f76d6350f49231621b1d6f9cc11ed484dadafce0c6afac5c
Deleted: sha256:28fc95301e7df2d7ad87820339614586352f301d98f9739bebf05b4d51657eaf
Deleted: sha256:b09593fe4a8bb402b067e1cb818c2e4fa448a3c17c533dbff779437aac4f2af1
Deleted: sha256:683f713f24f73a01c2cd5213000d9edeecc9c11a42dbf1cf9b0c195c70ea4c36
Deleted: sha256:e59e02ea2af6307c5efbc9ebe073362926bd3d476cf1f5aab13982a0f72697f3
Deleted: sha256:4d7a366c350c3c7a56cec41a8f972ac7f3520db04ce1913a84de9f022f27fb23
Deleted: sha256:49317f3170a297b334fa925fb15ec2b96ba6698d2493729bbe12d1ea0ddf5cf9
Deleted: sha256:da5e0d6c277795b55fea6e42b69e15d0db8d6485823b3d6a5c2aad5022cf1ee6
Deleted: sha256:794c61f1f334cacb229fba99f6bdb4ccbacd7cf2fc06d77788ebfc1b6e147012
Deleted: sha256:1a04864bb0811daa3ed5dadc7f90b18a8547c02eca06440766feba38bfdd9825
Deleted: sha256:25ae60ea686dfa380fd6ba43fe08127961c14b62277dcf69d00c670ba02139ed
Deleted: sha256:1acd8f402638850391fb14f2e60407c6d7fb065fc606d1fb6bf5253b0c9753fa
Deleted: sha256:9242c844eea2ba44d7855a5791da44fbbd48d2837670b928a11760ad6d5d7acd
Deleted: sha256:6f729935c4a20941a1b6e526bb3e6b06befb2454bc738fd2718eba33e13bc7df
Deleted: sha256:a3193b175366a2a950661c9eb23921dc0d59e3774863c88cfa37122354953c03
Deleted: sha256:78b250a26192ecf5847e7676bb5fdbbfecbfb77d34ec838f84b8606b561bdb0a
Deleted: sha256:2ac8e12f858b7508f5a07876b20217af643af6a86dc3422967ba5fcc9717adcf
Deleted: sha256:b6bfc532ee0090da1160bfbeb43995bd199516ce03427ee2e19d119336152653
Deleted: sha256:ad8252d8867dedd3b8d845cb665a4b70a06b82d3d8ee7c355a7880f35a4bf6ab
Deleted: sha256:d3788848ea853a3f974d8113ae60ca20054a565da4731a4381685d8427c9df08
Deleted: sha256:23a230a4dff73a358e34cee56d02fabaf8382c00148965e9d98c52f25eb58af6
Deleted: sha256:3618329341051481ff9cf49bf83e3a1458690a6a241b7c42db07c0ec895a46a7
Deleted: sha256:8bb7df33e48def8a6a26c35688b56e40b8b991331653caab6bea6b267d027151
Deleted: sha256:102ed2d17cb1fa1758318083c40ab4e805e271ec19537d674a22a3e3d774d6a0
Deleted: sha256:ec3215359a8f867087246e992ad0e0443c0195b157b4c001059ca38f57dd866d
Deleted: sha256:70a065f5aee60eb78b2b7e0cdb4f9ca999084266cdafe74f8f5e06ccbebaf1b1
Deleted: sha256:2f225f7ed8cae26c7972526f0c91188d37d40ce15ddaff060458a06fe216df97
Deleted: sha256:10cba2416e080e9ab998fa1527fbf36230c1e4e95b37be932c663b90e886e75b
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408095737]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c08dbf36e955bb67c61d275fd3ac717ebae26a1bc06af9e2b74655c8b3517a5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408095737]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c08dbf36e955bb67c61d275fd3ac717ebae26a1bc06af9e2b74655c8b3517a5])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c08dbf36e955bb67c61d275fd3ac717ebae26a1bc06af9e2b74655c8b3517a5
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c08dbf36e955bb67c61d275fd3ac717ebae26a1bc06af9e2b74655c8b3517a5
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c08dbf36e955bb67c61d275fd3ac717ebae26a1bc06af9e2b74655c8b3517a5].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 34m 46s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/bfvnuv65ghtqm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
