See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/808/display/redirect?page=changes>
Changes:
[cushon] Downgrade bytebuddy version to 1.11.0
[noreply] fixed column width in tables in Getting started from Spark guide
[noreply] Testing authentication for Playground (#22782)
[noreply] [BEAM-12776, fixes #21095] Limit parallel closes from the prior
element
[noreply] [BEAM-13015, #21250] Reuse buffers when possible when writing on
------------------------------------------
[...truncated 572.40 KB...]
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting six>=1.14.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB)
Collecting protobuf<4.0dev,>=3.5.0.post1
Using cached
protobuf-3.20.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting grpcio>=1.37.0
Using cached
grpcio-1.47.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.5 MB)
Collecting pyparsing!=3.0.5,>=2.0.2
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB)
Collecting platformdirs<3,>=2
Using cached platformdirs-2.5.2-py3-none-any.whl (14 kB)
Installing collected packages: distlib, wheel, toml, six, setuptools,
pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging,
mypy-protobuf, grpcio, tox, grpcio-tools
Attempting uninstall: setuptools
Found existing installation: setuptools 58.1.0
Uninstalling setuptools-58.1.0:
Successfully uninstalled setuptools-58.1.0
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go
boot_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due
to the following reasons:
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:downloadCloudProfilerAgent' without
declaring an explicit or implicit dependency. This can lead to incorrect
results being produced, depending on what order the tasks are executed. Please
refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:pullLicenses' without declaring an
explicit or implicit dependency. This can lead to incorrect results being
produced, depending on what order the tasks are executed. Please refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
> Task :sdks:python:setupVirtualenv
Successfully installed distlib-0.3.1 filelock-3.8.0 grpcio-1.47.0
grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.2
pluggy-1.0.0 protobuf-3.20.1 py-1.11.0 pyparsing-3.0.9 setuptools-65.1.0
six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.37.1
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:sdist
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/setuptools/dist.py>:530:
UserWarning: Normalizing '2.42.0.dev' to '2.42.0.dev0'
warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
> Task :sdks:python:container:py39:copyDockerfileDependencies
> Task :sdks:python:container:py39:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :sdks:python:installGcpTest
Collecting
google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
Using cached google_api_core-2.8.2-py3-none-any.whl (114 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.3.3-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: packaging<22.0dev,>=14.3 in
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages>
(from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.42.0.dev0) (21.3)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.4-py2.py3-none-any.whl (26 kB)
Collecting grpcio-status>=1.16.0
Using cached grpcio_status-1.47.0-py3-none-any.whl (10.0 kB)
Collecting overrides<7.0.0,>=6.0.1
Using cached overrides-6.2.0-py3-none-any.whl (17 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied:
pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages>
(from httplib2<0.21.0,>=0.8->apache-beam==2.42.0.dev0) (3.0.9)
Collecting pbr>=0.11
Using cached pbr-5.10.0-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: py>=1.8.2 in
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages>
(from pytest<8.0,>=7.1.2->apache-beam==2.42.0.dev0) (1.11.0)
Collecting iniconfig
Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.1.0-py2.py3-none-any.whl (58 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages>
(from pytest<8.0,>=7.1.2->apache-beam==2.42.0.dev0) (1.0.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer<3,>=2
Using cached charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.11-py2.py3-none-any.whl (139 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached
scipy-1.9.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (43.9 MB)
Collecting greenlet!=0.4.17
Using cached
greenlet-1.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (153 kB)
Collecting wrapt
Using cached
wrapt-1.14.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(77 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.0-py3-none-any.whl (147 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
Collecting google-crc32c<2.0dev,>=1.0
Using cached
google_crc32c-1.3.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(36 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.42.0.dev0-py3-none-any.whl size=2840701
sha256=c676d57b3674b7f81d6740e55d069789f48645e3aab1a88e699ce9f5b24df8b8
Stored in directory:
/home/jenkins/.cache/pip/wheels/b3/2e/36/00b0acddc744f40b08857546a6cbbbe4613653a283706724c3
Successfully built apache-beam
Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt,
crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli,
threadpoolctl, tenacity, rsa, regex, pyyaml, python-dateutil, pymysql, pymongo,
pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr,
overrides, orjson, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2,
greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro,
execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs,
sqlalchemy, scipy, requests, pytest, pyarrow, pandas, oauth2client, mock,
grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun,
deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib,
requests_mock, pytest-timeout, pytest-forked, hdfs, grpc-google-iam-v1,
google-auth-httplib2, google-apitools, google-api-core, docker, cryptography,
azure-core, testcontainers, pytest-xdist, msrest, google-cloud-core, boto3,
apache-beam, google-cloud-vision, google-cloud-videointelligence,
google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub,
google-cloud-language, google-cloud-dlp, google-cloud-datastore,
google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery,
azure-storage-blob, google-cloud-pubsublite
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
63b1e4b9bab1: Preparing
047940fcb155: Preparing
723d3ea5ca8d: Preparing
dab98ee1153e: Preparing
7ceae7fab03a: Preparing
2f1b4a1893f7: Preparing
606c862aacb4: Preparing
1e24a004a232: Preparing
81022fd125c4: Preparing
0930c52f7ad8: Preparing
c98cfbe6e0d9: Preparing
3a50686c40e8: Preparing
0c417839065f: Preparing
c8a464148388: Preparing
bd44cc83c976: Preparing
6b5aaff44254: Preparing
53a0b163e995: Preparing
b626401ef603: Preparing
9b55156abf26: Preparing
293d5db30c9f: Preparing
03127cdb479b: Preparing
9c742cd6c7a5: Preparing
81022fd125c4: Waiting
bd44cc83c976: Waiting
6b5aaff44254: Waiting
0930c52f7ad8: Waiting
c98cfbe6e0d9: Waiting
2f1b4a1893f7: Waiting
03127cdb479b: Waiting
3a50686c40e8: Waiting
606c862aacb4: Waiting
1e24a004a232: Waiting
53a0b163e995: Waiting
9b55156abf26: Waiting
9c742cd6c7a5: Waiting
0c417839065f: Waiting
b626401ef603: Waiting
293d5db30c9f: Waiting
723d3ea5ca8d: Pushed
047940fcb155: Pushed
7ceae7fab03a: Pushed
dab98ee1153e: Pushed
63b1e4b9bab1: Pushed
1e24a004a232: Pushed
606c862aacb4: Pushed
81022fd125c4: Pushed
2f1b4a1893f7: Pushed
0930c52f7ad8: Pushed
3a50686c40e8: Pushed
6b5aaff44254: Layer already exists
53a0b163e995: Layer already exists
b626401ef603: Layer already exists
c98cfbe6e0d9: Pushed
9b55156abf26: Layer already exists
293d5db30c9f: Layer already exists
03127cdb479b: Layer already exists
9c742cd6c7a5: Layer already exists
bd44cc83c976: Pushed
c8a464148388: Pushed
0c417839065f: Pushed
20220818232322: digest:
sha256:a3f59faad256be5782b5f047cd0d334e1f1f6f96cabda24983dc03eb6e7475db size:
4935
> Task :sdks:python:container:py39:docker
Err:1 http://deb.debian.org/debian bullseye InRelease
Could not connect to debian.map.fastlydns.net:80 (199.232.30.132), connection
timed out Unable to connect to deb.debian.org:http:
Err:2 http://deb.debian.org/debian-security bullseye-security InRelease
Unable to connect to deb.debian.org:http:
Err:3 http://deb.debian.org/debian bullseye-updates InRelease
Unable to connect to deb.debian.org:http:
Reading package lists...
[91mW: Failed to fetch http://deb.debian.org/debian/dists/bullseye/InRelease
Could not connect to debian.map.fastlydns.net:80 (199.232.30.132), connection
timed out Unable to connect to deb.debian.org:http:
W: Failed to fetch
http://deb.debian.org/debian-security/dists/bullseye-security/InRelease Unable
to connect to deb.debian.org:http:
W: Failed to fetch
http://deb.debian.org/debian/dists/bullseye-updates/InRelease Unable to
connect to deb.debian.org:http:
W: Some index files failed to download. They have been ignored, or old ones
used instead.
[0mReading package lists...
Building dependency tree...
Reading state information...
[91mE: Unable to locate package libsnappy-dev
E: Unable to locate package ccache
[0mThe command '/bin/sh -c apt-get update && apt-get install -y
libsnappy-dev libyaml-dev ccache && rm -rf
/var/lib/apt/lists/*' returned a non-zero code: 100
> Task :sdks:python:container:py39:docker FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 100
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1m 16s
123 actionable tasks: 19 executed, 104 up-to-date
Publishing build scan...
https://gradle.com/s/2kwc5xaonbdva
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
