See 
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1111/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] add shuffle to logos

[Moritz Mack] Fix Spark 3 job-server jar path for Python test suites (closes 
#23935,

[noreply] Bump actions/setup-java from 3.5.1 to 3.6.0 (#23797)

[noreply] [CdapIO] Add integration tests for SparkReceiverIO (#23305)


------------------------------------------
[...truncated 1.01 MB...]
overrides==6.5.0
packaging==21.3
pandas==1.4.4
parameterized==0.8.1
pbr==5.11.0
pip==22.3
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.4
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.1.3
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.5
PyYAML==6.0
regex==2022.9.13
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.5.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.37.1
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container 99235c245636
 ---> 2aefbd9109cb
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
 ---> 1842333a6d94
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
 ---> 6ac87b2ba1c0
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
 ---> 56e2e4b09b08
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 77c4485b904e
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in fc99e4e5eea9
Removing intermediate container fc99e4e5eea9
 ---> 229a4201cc85
Step 22/32 : FROM beam as third_party_licenses
 ---> 229a4201cc85
Step 23/32 : ARG pull_licenses
 ---> Running in 24bf0b236423
Removing intermediate container 24bf0b236423
 ---> 9a0511995e5f
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> 31fe7e305918
Step 25/32 : COPY target/LICENSE target/go-licenses/* 
/opt/apache/beam/third_party_licenses/golang/
 ---> 14972689c791
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 4e61fda031b7
Removing intermediate container 4e61fda031b7
 ---> 2ac710c55a0a
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> d44b2e26e5e1
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 
'pip-licenses<4.0.0' pyyaml tenacity &&       python 
/tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 8cf508bad8ea
Collecting pip-licenses<4.0.0
  Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in 
/usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in 
/usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in 
/usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 
sha256=16e1e99e87386e2fcdfd9894bc089007886ff8fbe5470376eebeb6ba96347e1a
  Stored in directory: 
/root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
WARNING: Running pip as the 'root' user can result in broken permissions 
and conflicting behaviour with the system package manager. It is recommended to 
use a virtual environment instead: https://pip.pypa.io/warnings/venv
INFO:root:Successfully pulled licenses for 135 dependencies
Skip pulling license for  bs4
Removing intermediate container 8cf508bad8ea
 ---> ed9056b6db36
Step 29/32 : FROM beam
 ---> 229a4201cc85
Step 30/32 : ARG pull_licenses
 ---> Running in 45604a37ebd3
Removing intermediate container 45604a37ebd3
 ---> a29dc9332d22
Step 31/32 : COPY --from=third_party_licenses 
/opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
 ---> b65ecd25c263
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then       rm -rf 
/opt/apache/beam/third_party_licenses ;     fi
 ---> Running in 9315b0c75df7
Removing intermediate container 9315b0c75df7
 ---> 00908a962cc2
Successfully built 00908a962cc2
Successfully tagged apache/beam_python3.10_sdk:2.44.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python]
5e780790b3a0: Preparing
cc38f12b3c7e: Preparing
480da3f00b7b: Preparing
49e8e97a4499: Preparing
d7806c6b6365: Preparing
a02d84bc8453: Preparing
55ff800cf5fe: Preparing
ede9171a6674: Preparing
67594f72ced7: Preparing
1b3cb4ba40c2: Preparing
82bd0a754979: Preparing
4099e7288bdb: Preparing
93a7606f3951: Preparing
9be3c99e1c1a: Preparing
f5d161bba139: Preparing
1569e0d95ce6: Preparing
d9e08da15d0c: Preparing
6b183c62e3d7: Preparing
882fd36bfd35: Preparing
d1dec9917839: Preparing
d38adf39e1dd: Preparing
4ed121b04368: Preparing
d9d07d703dd5: Preparing
f5d161bba139: Waiting
a02d84bc8453: Waiting
1569e0d95ce6: Waiting
55ff800cf5fe: Waiting
d9e08da15d0c: Waiting
ede9171a6674: Waiting
d38adf39e1dd: Waiting
4ed121b04368: Waiting
93a7606f3951: Waiting
6b183c62e3d7: Waiting
d1dec9917839: Waiting
67594f72ced7: Waiting
882fd36bfd35: Waiting
4099e7288bdb: Waiting
1b3cb4ba40c2: Waiting
9be3c99e1c1a: Waiting
82bd0a754979: Waiting
480da3f00b7b: Pushed
d7806c6b6365: Pushed
5e780790b3a0: Pushed
49e8e97a4499: Pushed
ede9171a6674: Pushed
55ff800cf5fe: Pushed
cc38f12b3c7e: Pushed
67594f72ced7: Pushed
93a7606f3951: Pushed
9be3c99e1c1a: Pushed
f5d161bba139: Layer already exists
1569e0d95ce6: Layer already exists
82bd0a754979: Pushed
d9e08da15d0c: Layer already exists
882fd36bfd35: Layer already exists
6b183c62e3d7: Layer already exists
d1dec9917839: Layer already exists
d38adf39e1dd: Layer already exists
4ed121b04368: Layer already exists
d9d07d703dd5: Layer already exists
a02d84bc8453: Pushed
1b3cb4ba40c2: Pushed
4099e7288bdb: Pushed
name unknown: Failed to get blob sizes.

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer 
> FAILED

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 44779
Launching Python expansion service @ 34389

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 683648.
Stopping expansion service pid: 683649.

FAILURE: Build failed with an exception.

* Where:
Build file 
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
 line: 330

* What went wrong:
Execution failed for task 
':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'.
> Process 'command 'gcloud'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during 
this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 13m 58s
126 actionable tasks: 22 executed, 104 up-to-date

Publishing build scan...
https://gradle.com/s/sw5lxal5gsto2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to