See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/8/display/redirect?page=changes>
Changes:
[jrmccluskey] Fix staticcheck errors in transforms directory
[jrmccluskey] Remove unnecessary fmt.Sprintf() in partition.go
[jrmccluskey] Replace bytes.Compare() with bytes.Equal() in test cases
[jrmccluskey] Replace string(buf.Bytes()) with buf.String() in coder_test.go
[jrmccluskey] Remove unnecessary blank identifier assignment in harness.go
[jrmccluskey] fix capitalized error strings in expansionx
[jrmccluskey] Clean up string cast of bytes in vet.go and corresponding tests
[jrmccluskey] Remove unnecessary fmt call in universal.go
[noreply] [BEAM-13664] Fix Primitives hashing benchmark (#16523)
------------------------------------------
[...truncated 73.33 KB...]
File "/usr/lib/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/usr/lib/python3.6/urllib/request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for slf4j-api-1.7.30:
http://www.opensource.org/licenses/mit-license.php. Retrying...
> Task :sdks:python:installGcpTest
Collecting fastavro<2,>=0.21.4
Using cached
fastavro-1.4.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3
MB)
Requirement already satisfied: grpcio<2,>=1.29.0 in
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages>
(from apache-beam==2.37.0.dev0) (1.43.0)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2<0.20.0,>=0.8
Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting numpy<1.22.0,>=1.14.3
Using cached numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached
pymongo-3.12.3-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (506
kB)
Collecting oauth2client<5,>=2.0.1
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Requirement already satisfied: protobuf<4,>=3.12.2 in
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages>
(from apache-beam==2.37.0.dev0) (3.19.3)
Collecting proto-plus<2,>=1.7.1
Using cached proto_plus-1.19.8-py3-none-any.whl (45 kB)
Collecting pyarrow<7.0.0,>=0.15.1
Using cached
pyarrow-6.0.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6
MB)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pytz>=2018.3
Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting requests<3.0.0,>=2.24.0
Using cached requests-2.27.1-py2.py3-none-any.whl (63 kB)
Collecting typing-extensions>=3.7.0
Using cached typing_extensions-4.0.1-py3-none-any.whl (22 kB)
Collecting dataclasses
Using cached dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting freezegun>=0.3.12
Using cached freezegun-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting pandas<2.0.0
Using cached pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5 MB)
Collecting parameterized<0.8.0,>=0.7.1
Using cached parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pyhamcrest!=1.10.0,<2.0.0,>=1.9
Using cached PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting pyyaml<7.0.0,>=3.12
Using cached
PyYAML-6.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(603 kB)
Collecting requests_mock<2.0,>=1.7
Using cached requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting pytest<5.0,>=4.4.0
Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB)
Collecting pytest-xdist<2,>=1.29.0
Using cached pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting pytest-timeout<2,>=1.3.3
Using cached pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting sqlalchemy<2.0,>=1.3
Using cached
SQLAlchemy-1.4.29-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(1.6 MB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached
psycopg2_binary-2.9.3-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(3.0 MB)
Collecting testcontainers<4.0.0,>=3.0.3
Using cached testcontainers-3.4.2-py2.py3-none-any.whl (31 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.9.0-py2.py3-none-any.whl (356 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.21.1-py2.py3-none-any.whl (178 kB)
Collecting boto3>=1.9
Downloading boto3-1.20.37-py3-none-any.whl (131 kB)
Collecting cachetools<5,>=3.1.0
Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.3.3-py2.py3-none-any.whl (155 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.3-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<3,>=2.1.0
Using cached google_cloud_pubsub-2.9.0-py2.py3-none-any.whl (219 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0
Using cached google_cloud_pubsublite-1.3.0-py2.py3-none-any.whl (255 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.32.0-py2.py3-none-any.whl (205 kB)
Collecting google-cloud-bigquery-storage>=2.6.3
Using cached google_cloud_bigquery_storage-2.11.0-py2.py3-none-any.whl (172
kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 66.306765 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:python:installGcpTest
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.0-py2.py3-none-any.whl (267 kB)
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:py36:docker
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 32869
Launching Python expansion service @ 40659
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
combineGloballyTest FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
partitionTest FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
coGroupByKeyTest FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
groupByKeyTest FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
combinePerKeyTest FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest
FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
singleInputOutputTest FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
multiInputOutputWithSideInputTest FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:123
8 tests completed, 8 failed
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 6560.
Stopping expansion service pid: 6567.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220115060222
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ea6b3af11434c0970933888b311fb465d491b34cc909bdc010eb76ed17555a0
Deleted: sha256:65b0b4df02b5cb5a6c3edbf54c28ccaaadc8cc925e940e5b87821eee7c2e3c31
Deleted: sha256:98ab20efe00b52169c690e5a1aa7edda6063d0d51e3d4d8f40dc8336b8bc51ca
Deleted: sha256:e85a404bc0a58624725e6464166fd229785e18d0ec841aae2351098528f4d536
Deleted: sha256:f5c334bebc3efb94695019d32142fe15cf1a3547b4486bfe659da9d697193321
Deleted: sha256:02c609abdc55edb70483e73543f652200f46d48ca2b9026ea436a878e1db1da6
Deleted: sha256:916752064dc64c658bff7d41ceb36b61cb38131a87fbf3dc6d8a99ef321fc241
Deleted: sha256:640f746bc491994dbfb82931c594bb3e7dcb3f0c4a03d8cc20a9261645784337
Deleted: sha256:5f892b92d54d88c82acabf6cc18146918efdabf8a16287f3a24dfb5c5e50e839
Deleted: sha256:0f3cc1b5d9f1c8047c9969d468e61fa16198aecbdc01e871ff4e0e4a35b669da
Deleted: sha256:1f39572d1eec5a82ac499151700892e4e3992e08c53bd681833405ab290913a8
Deleted: sha256:01a3ce994d6a1550cfc24019ef15c6ff8b9ee52052d77052f7d57bb68406d601
Deleted: sha256:a77d038a7270e9309f68a44eafbfd6cc479814ee0958085e7e7998583e3b5744
Deleted: sha256:82c7c16f21500a0b41e661e9300b3066b1c3645cd8c7b08cfad2e2d1b076ea87
Deleted: sha256:35169bf1d39470ce96369331cbe360ee0e857634c52b907c6840ab778dc8dbe8
Deleted: sha256:65e0c8c33fafb995c6d4557d06c6ab77e7782a5b97f6a7417ad9136798fa1bfb
Deleted: sha256:34a87c668085f147dc2d6a37ee29c6706452eca98e45f84bc5b2106c57bd8bd9
Deleted: sha256:c85bbee26b808777c64955e2741be0de85cda939a919814f7fe726213a338f30
Deleted: sha256:dbbf91d3f38cdb8f00a01dfbd96e6c88580d403bee14aa2e18f9a1f950d860f4
Deleted: sha256:ec478ccb8b6a78a7c3fe782ea65ae27adc8e953bdf356aace784510de88f6136
Deleted: sha256:7b1bae262eb04f876056552e00e2f2e1b5aafa727f1dc9c9526f37fc69a24b47
Deleted: sha256:98d4173eabbfb57672f274b1ccf91f750875f8a1f8698881b80bd0e6c82beed2
Deleted: sha256:7845db5be9be5bd7803a455f8b44cdb78f3efa03dc2d056999c24b0f429427e9
Deleted: sha256:8395ad805e83698451e4fb14a15cf9d90fc3da40a4214f36eea8b4804d47fa67
Deleted: sha256:1c671acba5b9e135ab0e93bf931fba05693ffc7919fed1678826450b10728644
Deleted: sha256:ed85bcb5745e73aa3d626843482cd68f80d772710a5196c6198a2929509db1f4
Deleted: sha256:210dfaaa46ef08bc8f84d43e7ab24749b8a5163a2d54af7ad9ff60917a6a4c4f
Deleted: sha256:e78027b9095b3707ba3c51f777467c9542c21a6d2c5cfe2654cee16625da1215
Deleted: sha256:e71bde098a8ffe147cb51bf26f06f9df43c269efac7cf3688bc335bf37e86779
Deleted: sha256:997ea90506626770eb126f420395cfbbe5e26a6474fc7f0545bcb42fb90a37c6
Deleted: sha256:1a5ae7a824aee88f248b17525cea8bd2ef59d2b85d7ebf217caf836ce0de2704
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220115060222]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ea6b3af11434c0970933888b311fb465d491b34cc909bdc010eb76ed17555a0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220115060222]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ea6b3af11434c0970933888b311fb465d491b34cc909bdc010eb76ed17555a0])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ea6b3af11434c0970933888b311fb465d491b34cc909bdc010eb76ed17555a0
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ea6b3af11434c0970933888b311fb465d491b34cc909bdc010eb76ed17555a0
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ea6b3af11434c0970933888b311fb465d491b34cc909bdc010eb76ed17555a0].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 35m 34s
176 actionable tasks: 115 executed, 55 from cache, 6 up-to-date
Publishing build scan...
https://scans.gradle.com/s/4sgmjn7msd3x6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
