See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/29/display/redirect?page=changes>
Changes:
[daria.malkova] Support SCIO SDK via sbt projects
[samuelw] [BEAM-11648] Share thread pool across RetryManager instances.
[Pablo Estrada] Exclude per-key order tests on Twister2 runner
[Heejong Lee] Fix Java SDK container image name for load-tests and nexmark
[noreply] Merge pull request #16493 from [BEAM-13632][Playground] Save catalog
[noreply] Exclude jul-to-slf4j from Spark runner in quickstart POM templates
[noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned
[noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666)
[noreply] [BEAM-13777] Accept cache capacity as input parameter instead of
default
[noreply] [BEAM-13051][A] Enable pylint warnings
[noreply] [BEAM-13779] Fix pr labeling (#16665)
[noreply] Merge pull request #16581 from [BEAM-12164]: Add
[noreply] Fix labeler trigger (#16674)
[noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency
[noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710),
[noreply] [BEAM-13740] Correctly install go before running tests (#16673)
[noreply] [BEAM-12830] Update local Docker env Go version. (#16670)
[noreply] [BEAM-13051][B] Enable pylint warnings
[noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided
(#16675)
------------------------------------------
[...truncated 60.04 KB...]
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting packaging>=14
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting importlib-metadata<3,>=0.12
Using cached importlib_metadata-2.1.3-py2.py3-none-any.whl (10 kB)
Collecting filelock>=3.0.0
Using cached filelock-3.4.1-py3-none-any.whl (9.9 kB)
Collecting six>=1.14.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.13.0-py2.py3-none-any.whl (6.5 MB)
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:testClasses
> Task :sdks:java:extensions:protobuf:testJar
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :sdks:python:setupVirtualenv
Collecting grpcio>=1.37.0
Using cached
grpcio-1.43.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.1 MB)
> Task :sdks:java:container:generateLicenseReport
> Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar
> FROM-CACHE
> Task :sdks:java:container:pullLicenses
Uninstalling pip-18.1:
Successfully uninstalled pip-18.1
Found existing installation: setuptools 40.6.2
Uninstalling setuptools-40.6.2:
Successfully uninstalled setuptools-40.6.2
Successfully installed pip-21.3.1 setuptools-59.6.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp36-cp36m-manylinux1_x86_64.whl (640 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, tenacity, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.1 tenacity-5.1.5
Executing
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/java/container/build/virtualenv/bin/python>
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
> Task :sdks:python:sdist
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/setuptools/dist.py>:493:
UserWarning: Normalizing '2.37.0.dev' to '2.37.0.dev0'
warnings.warn(tmpl.format(**locals()))
INFO:gen_protos:Regenerating Python proto definitions (no output files).
INFO:gen_protos:Found protoc_gen_mypy at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/build/gradleenv/1922375555/bin/protoc-gen-mypy>
beam_interactive_api.proto:36:1: warning: Import
google/protobuf/timestamp.proto is unused.
Writing mypy to external_transforms_pb2.pyi
Writing mypy to beam_runner_api_pb2.pyi
Writing mypy to standard_window_fns_pb2.pyi
Writing mypy to metrics_pb2.pyi
Writing mypy to endpoints_pb2.pyi
Writing mypy to schema_pb2.pyi
Writing mypy to beam_artifact_api_pb2.pyi
Writing mypy to beam_expansion_api_pb2.pyi
Writing mypy to beam_job_api_pb2.pyi
Writing mypy to beam_provision_api_pb2.pyi
Writing mypy to beam_fn_api_pb2.pyi
Writing mypy to beam_interactive_api_pb2.pyi
INFO:gen_protos:Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py>
INFO:gen_protos:Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py>
INFO:gen_protos:Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py>
INFO:gen_protos:Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2_urns.py>
INFO:gen_protos:Writing urn stubs:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py>
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
> Task :sdks:python:container:py36:copyDockerfileDependencies
> Task :sdks:java:container:pullLicenses
INFO:root:Pulling license for 217 dependencies using 16 threads.
> Task :runners:google-cloud-dataflow-java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:google-cloud-dataflow-java:testClasses
> Task :runners:google-cloud-dataflow-java:testJar
> Task :sdks:python:installGcpTest
Processing ./build/apache-beam.tar.gz
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp36-cp36m-linux_x86_64.whl
Collecting orjson<4.0
Using cached orjson-3.6.1-cp36-cp36m-manylinux_2_24_x86_64.whl (233 kB)
Collecting dill<0.3.2,>=0.3.1.1
Using cached dill-0.3.1.1-py3-none-any.whl
Collecting cloudpickle<3,>=2.0.0
Using cached cloudpickle-2.0.0-py3-none-any.whl (25 kB)
Collecting fastavro<2,>=0.23.6
Using cached
fastavro-1.4.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3
MB)
Requirement already satisfied: grpcio<2,>=1.29.0 in
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages>
(from apache-beam==2.37.0.dev0) (1.43.0)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2<0.20.0,>=0.8
Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting numpy<1.22.0,>=1.14.3
Using cached numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB)
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 8.491923 seconds with 16
threads.
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:py36:docker
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest
> test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:287
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest
> test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:322
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest
> test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:340
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest
> test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:409
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest
> test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:374
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest >
test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:391
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest
> test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:357
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest
> test FAILED
java.lang.RuntimeException at ValidateRunnerXlangTest.java:304
8 tests completed, 8 failed
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220201004853]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:65ad0ab654b694eb9c5a0787b958e50fa4a51dfbcae57a7fbd62de6e15017935]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220201004853]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:65ad0ab654b694eb9c5a0787b958e50fa4a51dfbcae57a7fbd62de6e15017935])].
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:65ad0ab654b694eb9c5a0787b958e50fa4a51dfbcae57a7fbd62de6e15017935
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:65ad0ab654b694eb9c5a0787b958e50fa4a51dfbcae57a7fbd62de6e15017935].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220201004853]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:54008a629933e56dc469e243adc219f1948cf22a3df60147a9dfc0c6a7f91616]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220201004853]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:54008a629933e56dc469e243adc219f1948cf22a3df60147a9dfc0c6a7f91616])].
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:54008a629933e56dc469e243adc219f1948cf22a3df60147a9dfc0c6a7f91616
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:54008a629933e56dc469e243adc219f1948cf22a3df60147a9dfc0c6a7f91616].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 17m
167 actionable tasks: 112 executed, 49 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/t233hjom42kr2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
