See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1464/display/redirect>
Changes:
------------------------------------------
[...truncated 71.60 KB...]
+ chmod -R a+w /output/licenses
> Task :sdks:python:installGcpTest
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.2.1-py2.py3-none-any.whl (52 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.1.1-py2.py3-none-any.whl (146 kB)
Collecting mypy-extensions>=0.3.0
Using cached mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.36.0.dev0-py3-none-any.whl size=2613998
sha256=56e7975a319ca91677defd786cb919e45b25c9f70794184c9df4bb1cb4b55748
Stored in directory:
/home/jenkins/.cache/pip/wheels/ac/28/6e/20a1cb68f78721e12815f377be5bd7dc86dac3332b84355793
Successfully built apache-beam
Installing collected packages: pyasn1, urllib3, rsa, pyparsing, pyasn1-modules,
idna, charset-normalizer, certifi, cachetools, wcwidth, typing-extensions,
requests, pytz, python-dateutil, pycparser, pluggy, oauthlib, mypy-extensions,
more-itertools, jmespath, googleapis-common-protos, google-auth, attrs,
atomicwrites, websocket-client, typing-inspect, requests-oauthlib, pyyaml,
pytest, numpy, isodate, httplib2, grpcio-gcp, google-crc32c, google-api-core,
docopt, dataclasses, cffi, botocore, wrapt, s3transfer, pytest-forked, pymongo,
pydot, pyarrow, proto-plus, pbr, orjson, oauth2client, msrest, libcst, hdfs,
grpc-google-iam-v1, greenlet, google-resumable-media, google-cloud-core,
fasteners, fastavro, execnet, docker, dill, deprecation, cryptography, crcmod,
azure-core, testcontainers, tenacity, sqlalchemy, requests-mock, pytest-xdist,
pytest-timeout, pyhamcrest, psycopg2-binary, parameterized, pandas, mock,
google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner,
google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language,
google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable,
google-cloud-bigquery-storage, google-cloud-bigquery, google-apitools,
freezegun, boto3, azure-storage-blob, apache-beam
Attempting uninstall: pyparsing
Found existing installation: pyparsing 3.0.6
Uninstalling pyparsing-3.0.6:
Successfully uninstalled pyparsing-3.0.6
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
> Task :release:go-licenses:java:dockerRun
+ tee /output/licenses/list.csv
+ go-licenses csv github.com/apache/beam/sdks/java/container
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :sdks:python:container:py36:docker
Removing intermediate container e66c0422b221
---> 4ad82648da0d
Step 5/31 : COPY target/base_image_requirements.txt
/tmp/base_image_requirements.txt
---> a772a49dbbc4
Step 6/31 : RUN pip install --no-deps -r /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._default_implementation_type == 'cpp'; print ('Verified fast
protobuf used.')" && rm -rf /root/.cache/pip && rm -rf
/tmp/base_image_requirements.txt
---> Running in 7661ea9ce80f
> Task :sdks:java:container:java8:docker
---> 3cc4e282b67a
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 5af0915856e0
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
---> e51262c051e2
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> bad22ffde642
Step 13/18 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> 8f40a3e7a3bc
Step 14/18 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 112e1d8c16fb
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
> Task :sdks:python:container:py36:docker
Collecting absl-py==0.15.0
Downloading absl_py-0.15.0-py3-none-any.whl (132 kB)
Collecting astunparse==1.6.3
Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting atomicwrites==1.4.0
Downloading atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting attrs==21.2.0
Downloading attrs-21.2.0-py2.py3-none-any.whl (53 kB)
Collecting beautifulsoup4==4.10.0
Downloading beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting bs4==0.0.1
Downloading bs4-0.0.1.tar.gz (1.1 kB)
Collecting cached-property==1.5.2
Downloading cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Collecting cachetools==4.2.4
Downloading cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting certifi==2021.10.8
Downloading certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer==2.0.7
Downloading charset_normalizer-2.0.7-py3-none-any.whl (38 kB)
Collecting clang==5.0
Downloading clang-5.0.tar.gz (30 kB)
Collecting click==8.0.3
Downloading click-8.0.3-py3-none-any.whl (97 kB)
Collecting crcmod==1.7
Downloading crcmod-1.7.tar.gz (89 kB)
Collecting Cython==0.29.24
Downloading Cython-0.29.24-cp36-cp36m-manylinux1_x86_64.whl (2.0 MB)
Collecting dataclasses==0.8
Downloading dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting deprecation==2.1.0
Downloading deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting dill==0.3.1.1
Downloading dill-0.3.1.1.tar.gz (151 kB)
Collecting docker==5.0.3
Downloading docker-5.0.3-py2.py3-none-any.whl (146 kB)
Collecting docopt==0.6.2
Downloading docopt-0.6.2.tar.gz (25 kB)
Collecting execnet==1.9.0
Downloading execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting fastavro==1.4.7
Downloading
fastavro-1.4.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3
MB)
Collecting fasteners==0.16.3
Downloading fasteners-0.16.3-py2.py3-none-any.whl (28 kB)
Collecting flatbuffers==1.12
Downloading flatbuffers-1.12-py2.py3-none-any.whl (15 kB)
Collecting freezegun==1.1.0
Downloading freezegun-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting future==0.18.2
Downloading future-0.18.2.tar.gz (829 kB)
Collecting gast==0.4.0
Downloading gast-0.4.0-py3-none-any.whl (9.8 kB)
> Task :sdks:java:container:java8:docker
---> Running in fbb9ad6d985b
Removing intermediate container fbb9ad6d985b
---> 7eeeb37dd51f
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 051ae072e6d6
Removing intermediate container 051ae072e6d6
---> d993285e9f60
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> cc48ec820b53
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 0f5a205ddb76
Removing intermediate container 0f5a205ddb76
---> 2d019db3073f
Successfully built 2d019db3073f
Successfully tagged apache/beam_java8_sdk:2.36.0.dev
> Task :sdks:python:container:py36:docker
Collecting google-api-core==1.31.4
Downloading google_api_core-1.31.4-py2.py3-none-any.whl (93 kB)
Collecting google-api-python-client==2.31.0
Downloading google_api_python_client-2.31.0-py2.py3-none-any.whl (7.8 MB)
Collecting google-apitools==0.5.31
Downloading google-apitools-0.5.31.tar.gz (173 kB)
Collecting google-auth==1.35.0
Downloading google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-auth-httplib2==0.1.0
Downloading google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-auth-oauthlib==0.4.6
Downloading google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting google-cloud-bigquery==2.30.1
Downloading google_cloud_bigquery-2.30.1-py2.py3-none-any.whl (203 kB)
Collecting google-cloud-bigquery-storage==2.10.1
Downloading google_cloud_bigquery_storage-2.10.1-py2.py3-none-any.whl (171 kB)
Collecting google-cloud-bigtable==1.7.0
Downloading google_cloud_bigtable-1.7.0-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-core==1.7.2
Downloading google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-datastore==1.15.3
Downloading google_cloud_datastore-1.15.3-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-dlp==3.3.1
Downloading google_cloud_dlp-3.3.1-py2.py3-none-any.whl (110 kB)
Collecting google-cloud-language==1.3.0
Downloading google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-profiler==3.0.6
Downloading google-cloud-profiler-3.0.6.tar.gz (33 kB)
Collecting google-cloud-pubsub==1.7.0
Downloading google_cloud_pubsub-1.7.0-py2.py3-none-any.whl (144 kB)
Collecting google-cloud-recommendations-ai==0.2.0
Downloading google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180
kB)
Collecting google-cloud-spanner==1.19.1
Downloading google_cloud_spanner-1.19.1-py2.py3-none-any.whl (255 kB)
Collecting google-cloud-videointelligence==1.16.1
Downloading google_cloud_videointelligence-1.16.1-py2.py3-none-any.whl (183
kB)
Collecting google-cloud-vision==1.0.0
Downloading google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB)
Collecting google-crc32c==1.3.0
Downloading
google_crc32c-1.3.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(37 kB)
Collecting google-pasta==0.2.0
Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting google-python-cloud-debugger==2.18
Downloading
google_python_cloud_debugger-2.18-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl
(769 kB)
Collecting google-resumable-media==2.1.0
Downloading google_resumable_media-2.1.0-py2.py3-none-any.whl (75 kB)
Collecting googleapis-common-protos==1.53.0
Downloading googleapis_common_protos-1.53.0-py2.py3-none-any.whl (198 kB)
Collecting greenlet==1.1.2
Downloading
greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147
kB)
Collecting grpc-google-iam-v1==0.12.3
Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB)
Collecting grpcio==1.42.0
Downloading
grpcio-1.42.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.0 MB)
Collecting grpcio-gcp==0.2.2
Downloading grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting guppy3==3.1.2
Downloading
guppy3-3.1.2-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(606 kB)
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211120180116]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 279
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41m 16s
132 actionable tasks: 94 executed, 34 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/6vd72xx42cvia
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]