See <https://ci-beam.apache.org/job/beam_Dependency_Check/348/display/redirect?page=changes>
Changes: [noreply] Add missing parentheses for Python test example [noreply] Update test input and imports [heejong] [BEAM-13021] Deduplicate Python artifact not only by hash but also by [heejong] add test [heejong] rename variables [stranniknm] [BEAM-13105] playground - add shorcut hint tooltip [mmack] [BEAM-11440] Add integration test for KinesisIO using Localstack on [mmack] Bump localstack container version for more robust version with respect [mmack] Bump localstack container version for DynamoDBIOTest to version used in [mmack] Apply format [mmack] Apply format [mmack] Use vendored guava deps [Andrew Pilloud] [BEAM-13118] Use branch for nightly "tag", tags are immutable [aydar.zaynutdinov] [BEAM-13145][Playground] [avilovpavel6] Added cleanup os env before and after tests [25622840+adude3141] [BEAM-13157] support hadoop configuration on ParquetIO.Parse [noreply] [BEAM-11936] Fix errorprone warnings (#15821) [Luke Cwik] [BEAM-3811] Code clean-up of the CancelleableQueue to not throw [noreply] [BEAM-13001] fixes Golint issues (#15859) [Pablo Estrada] JdbcIO has a single WriteFn underlying all implementations [noreply] Merge pull request #15840 from [Playground][BEAM-13146][Bugfix] [dmitrii_kuzin] [BEAM-12730] Python. Custom delimiter add corner case [Alexey Romanenko] [BEAM-12070] ParquetIO: use splittable reading by default [noreply] [BEAM-13001] fixes nil reference error in Extractor.ExtractFrom (#15865) [noreply] Merge pull request #15842 from [BEAM-13125][Playground] Update [noreply] Merge pull request #15838 from [BEAM-13127] [Playground] Implement TCP [noreply] Merge pull request #15832 from [BEAM-13149] Changing readWithPartitions [noreply] Minor: add resource key to presentation materials link (#15867) [dpcollins] Performance improvement to PubSubLiteIO to not use a streaming committer [noreply] Merge pull request #15854 from [BEAM-13046][Playground] protobuf [noreply] [BEAM-12550] Parallelizable skew Implementation (#15809) [noreply] Merge pull request #15782 from [BEAM-13034] [Playground] add semantics [hlagosperez] Use BigQuieryIO.loadProjectId in WriteRename class to create [noreply] [BEAM-13099] Use vendored Calcite 1.28.0 in SQL extensions (#15836) [Luke Cwik] [BEAM-13015] Use a network based channel instead of an inmemory one [Pablo Estrada] Addressing comments [noreply] Merge pull request #15839 from [BEAM-13041][Playground] Prepare files [noreply] [BEAM-13001] updated CHANGES.md to include msec counter for Go (#15872) [noreply] Add window mapping to CHANGES.md (#15871) [noreply] Merge pull request #15784 from [BEAM-8135] - Removing [noreply] [BEAM-13119] Subdirectory prefix tag for Go SDK (#15881) [heejong] rearrange comparison order [noreply] Merge pull request #15852 from [BEAM-13102] [Playground] update [Kyle Weaver] Fix typo: s/spark/twister2 [Luke Cwik] [BEAM-13164] Address most of a race condition between instantiation and [Robert Bradshaw] Defer filesToStage construction until after full jar resolution. [heejong] s/pathes/paths/ [noreply] Merge pull request #15835: [BEAM-11205] Google Libraries BOM 24.0.0 and [noreply] Merge pull request #15810: [BEAM-2791] Support low-latency StorageApi [noreply] [BEAM-13081] Fixes a compatible issue of decoding null-value bitmap [noreply] [adhoc] Speedup slow tests for AWS IO modules (#15899) [noreply] [BEAM-12566] Implement set_axis for DataFrame and Series (#15773) [noreply] [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910) [noreply] [BEAM-11217] Metrics Query filtering for DoFn metrics. (#15887) [noreply] [Go SDK] Go SDK Exits Experimental (#15894) [joseinigo] [BEAM-13080] Fix number of default keys [relax] remove log statement [joseinigo] [BEAM-13080] Fix number of default keys ------------------------------------------ [...truncated 69.74 KB...] 5 actionable tasks: 5 executed Publishing build scan... https://gradle.com/s/o5htbp4rmkgpa Build step 'Invoke Gradle script' changed build result to SUCCESS [beam_Dependency_Check] $ /bin/bash -xe /tmp/jenkins4403059770075433394.sh + cd src + bash .test-infra/jenkins/dependency_check/generate_report.sh REPORT_DESCRIPTION=" <h4> A dependency update is high priority if it satisfies one of following criteria: </h4> <ul> <li> It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; </li> </ul> <ul> <li> It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; </li> </ul> <ul> <li> The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. </li> </ul> <h4> In Beam, we make a best-effort attempt at keeping all dependencies up-to-date. In the future, issues will be filed and tracked for these automatically, but in the meantime you can search for existing issues or open a new one. </h4> <h4> For more information: <a href=\"https://beam.apache.org/contribute/dependencies/\";> Beam Dependency Guide </a></h4>" # Virtualenv for the rest of the script to run setup virtualenv dependency/check Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python> Installing setuptools, pip, wheel... done. . dependency/check/bin/activate # This file must be used with "source bin/activate" *from bash* # you cannot run it directly deactivate () { unset -f pydoc >/dev/null 2>&1 # reset old environment variables # ! [ -z ${VAR+_} ] returns true if VAR is declared at all if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then PATH="$_OLD_VIRTUAL_PATH" export PATH unset _OLD_VIRTUAL_PATH fi if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME" export PYTHONHOME unset _OLD_VIRTUAL_PYTHONHOME fi # This should detect bash and zsh, which have a hash command that must # be called to get it to forget past commands. Without forgetting # past commands the $PATH changes we made may not be respected if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then hash -r 2>/dev/null fi if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then PS1="$_OLD_VIRTUAL_PS1" export PS1 unset _OLD_VIRTUAL_PS1 fi unset VIRTUAL_ENV if [ ! "${1-}" = "nondestructive" ] ; then # Self destruct! unset -f deactivate fi } # unset irrelevant variables deactivate nondestructive VIRTUAL_ENV="<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check";> export VIRTUAL_ENV _OLD_VIRTUAL_PATH="$PATH" PATH="$VIRTUAL_ENV/bin:$PATH" export PATH # unset PYTHONHOME if set if ! [ -z "${PYTHONHOME+_}" ] ; then _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME" unset PYTHONHOME fi if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then _OLD_VIRTUAL_PS1="${PS1-}" if [ "x" != x ] ; then PS1="${PS1-}" else PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}" fi export PS1 fi basename "$VIRTUAL_ENV" # Make sure to unalias pydoc if it's already there alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true pydoc () { python -m pydoc "$@" } # This should detect bash and zsh, which have a hash command that must # be called to get it to forget past commands. Without forgetting # past commands the $PATH changes we made may not be respected if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then hash -r 2>/dev/null fi pip install --upgrade google-cloud-bigquery DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting google-cloud-bigquery Using cached google_cloud_bigquery-1.28.0-py2.py3-none-any.whl (187 kB) Collecting google-api-core<2.0dev,>=1.21.0 Using cached google_api_core-1.23.0-py2.py3-none-any.whl (91 kB) Collecting google-resumable-media<2.0dev,>=0.6.0 Using cached google_resumable_media-1.1.0-py2.py3-none-any.whl (75 kB) Collecting six<2.0.0dev,>=1.13.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting google-cloud-core<2.0dev,>=1.4.1 Using cached google_cloud_core-1.4.4-py2.py3-none-any.whl (27 kB) Collecting googleapis-common-protos<2.0dev,>=1.6.0 Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB) Requirement already satisfied: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery) (50.3.2) Collecting protobuf>=3.12.0 Using cached protobuf-3.19.1-py2.py3-none-any.whl (162 kB) Collecting requests<3.0.0dev,>=2.18.0 Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB) Collecting pytz Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB) Collecting google-auth<2.0dev,>=1.21.1 Using cached google_auth-1.23.0-py2.py3-none-any.whl (114 kB) Collecting pyasn1-modules>=0.2.1 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting cachetools<5.0,>=2.0.0 Using cached cachetools-4.2.4-py3-none-any.whl (10 kB) Collecting rsa<5,>=3.1.4 Using cached rsa-4.7.2-py3-none-any.whl (34 kB) Collecting google-crc32c<2.0dev,>=1.0 Using cached google_crc32c-1.0.0-cp35-cp35m-manylinux2010_x86_64.whl (39 kB) Collecting cffi>=1.0.0 Using cached cffi-1.15.0.tar.gz (484 kB) Collecting pycparser Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting pyasn1<0.5.0,>=0.4.6 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB) Collecting idna<3,>=2.5 Using cached idna-2.10-py2.py3-none-any.whl (58 kB) Collecting chardet<5,>=3.0.2 Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB) Building wheels for collected packages: cffi Building wheel for cffi (setup.py): started Building wheel for cffi (setup.py): finished with status 'error' ERROR: Command errored out with exit status 1: command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-wska2ool cwd: /tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/ Complete output (34 lines): running bdist_wheel running build running build_py creating build creating build/lib.linux-x86_64-3.5 creating build/lib.linux-x86_64-3.5/cffi copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi running build_ext building '_cffi_backend' extension creating build/temp.linux-x86_64-3.5 creating build/temp.linux-x86_64-3.5/c x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory compilation terminated. error: command 'x86_64-linux-gnu-gcc' failed with exit status 1 ---------------------------------------- ERROR: Failed building wheel for cffi Running setup.py clean for cffi Failed to build cffi Installing collected packages: pyasn1, urllib3, six, rsa, pycparser, pyasn1-modules, protobuf, idna, chardet, certifi, cachetools, requests, pytz, googleapis-common-protos, google-auth, cffi, google-crc32c, google-api-core, google-resumable-media, google-cloud-core, google-cloud-bigquery Running setup.py install for cffi: started Running setup.py install for cffi: finished with status 'error' ERROR: Command errored out with exit status 1: command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-kksjx880/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi> cwd: /tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/ Complete output (34 lines): running install running build running build_py creating build creating build/lib.linux-x86_64-3.5 creating build/lib.linux-x86_64-3.5/cffi copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi running build_ext building '_cffi_backend' extension creating build/temp.linux-x86_64-3.5 creating build/temp.linux-x86_64-3.5/c x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory compilation terminated. error: command 'x86_64-linux-gnu-gcc' failed with exit status 1 ---------------------------------------- ERROR: Command errored out with exit status 1: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-kksjx880/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi> Check the logs for full command output. Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
