See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/2997/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.106
[noreply] [BEAM-13147] Fix nullability issues in aws (SDK v1 + v2) for AwsModule
[noreply] [BEAM-3293] Add encoding of map/multimap side inputs into proto
(#15960)
[noreply] [BEAM-13052] Implement ProtoPlusCoder and add it to the default
options
------------------------------------------
[...truncated 480.31 KB...]
[0m[91m adding 'apache_beam/utils/shared_test.py'
[0m[91m adding 'apache_beam/utils/subprocess_server.py'
[0m[91m adding 'apache_beam/utils/subprocess_server_test.py'
[0m[91m adding 'apache_beam/utils/thread_pool_executor.py'
[0m[91m adding 'apache_beam/utils/thread_pool_executor_test.py'
[0m[91m adding 'apache_beam/utils/timestamp.py'
[0m[91m adding 'apache_beam/utils/timestamp_test.py'
[0m[91m adding 'apache_beam/utils/urns.py'
[0m[91m adding
'apache_beam/utils/windowed_value.cpython-36m-x86_64-linux-gnu.so'
[0m[91m adding 'apache_beam/utils/windowed_value.pxd'
[0m[91m adding 'apache_beam/utils/windowed_value.py'
[0m[91m adding 'apache_beam/utils/windowed_value_test.py'
[0m[91m adding 'apache_beam-2.35.0.dev0.dist-info/METADATA'
[0m[91m adding 'apache_beam-2.35.0.dev0.dist-info/WHEEL'
[0m[91m adding 'apache_beam-2.35.0.dev0.dist-info/top_level.txt'
[0m[91m adding 'apache_beam-2.35.0.dev0.dist-info/RECORD'
[0m[91m removing build/bdist.linux-x86_64/wheel
[0m Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9930709
sha256=03d608b035658d5c1ab19a8a5599fa25bad23f772451d5e4373c5060d07ebd9e
Stored in directory:
/root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect,
google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory
/usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory
/usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory
/usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSuccessfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.4
google-cloud-bigquery-storage-2.10.0 libcst-0.3.21 mypy-extensions-0.4.3
typing-inspect-0.7.1
[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0mRemoving intermediate container b59b51fc22e2
---> 378db15a29dc
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> 432f79de087f
Step 16/27 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> abcfe4f91ed6
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 32b95489b761
Removing intermediate container 32b95489b761
---> 2a89845bd3e0
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 0d30f2647ea9
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install
'pip-licenses<3.0.0;python_version>="3.5"' && pip install
'pip-licenses==1.18.0;python_version<="2.7"' && python
/tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses
&& rm -rf /root/.cache/pip ; else rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in ee6dce7f3c68
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924
sha256=869ac52d86cab21e76ef928bbe6ce947bea73d22b41312cd23deafce22df5f42
Stored in directory:
/root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your
environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 116 dependencies
[0mSkip pulling license for bs4
Found existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container ee6dce7f3c68
---> 2e9c0b424cdc
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in 3226cf0a013f
Removing intermediate container 3226cf0a013f
---> 2d62e29ed885
Step 21/27 : RUN pip freeze --all
---> Running in 5dd81e7a5b6d
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
gast==0.4.0
google-api-core==1.31.4
google-api-python-client==2.30.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.10.0
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.2
joblib==1.1.0
keras==2.7.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.11.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.7
protobuf==3.19.0
protorpc==0.12.0
PTable==0.9.2
py==1.11.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.11.10
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.3.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container 5dd81e7a5b6d
---> b1c4670f4a0c
Step 22/27 : RUN pip check
---> Running in d73ab8416258
No broken requirements found.
Removing intermediate container d73ab8416258
---> e87162e1ff4e
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> fec9d43f9deb
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> 4c8e7ad6d2d0
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 0c18578073bd
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 137c61d34533
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 68e6809942d3
Removing intermediate container 68e6809942d3
---> 128bf2539f1d
Successfully built 128bf2539f1d
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:2:compileJava'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 1s
203 actionable tasks: 145 executed, 51 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/6rhcg32ltt7vu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
