See
<https://builds.apache.org/job/beam_Dependency_Check/258/display/redirect?page=changes>
Changes:
[chamikara] Logs BQ insert failures
[crites] Clean up of TestStreamTranscriptTests. Remvoes check for final field in
[crites] Adds clearing of pane info state when windows get merged away.
[relax] switch cogbk to use Beam transform
[relax] finish join
[jfarr1] [BEAM-8374] Add alternate SnsIO PublishResult coders
[kcweaver] [BEAM-9503] Insert missing comma in process worker script.
[robertwb] [BEAM-9433] Create expansion service artifact for common Java IOs.
[ankurgoenka] [BEAM-9504] Sickbay streaming test for batch VR
[apilloud] [BEAM-8057] Reject Infinite or NaN literals at parse time
[apilloud] [BEAM-7832] Translate ZetaSQL joins without condition
[robertwb] Log in a daemon thread.
[thw] [BEAM-8815] Skip removal of manifest when no artifacts were staged.
[relax] support side-input joins
[relax] support side-input joins
[relax] spotless
[kawaigin] [BEAM-8335] Refactor IPythonLogHandler
[kcweaver] [BEAM-8866] Use unique temp dir for output of portable word count
tests.
[apilloud] [BEAM-8070] Preserve type for empty array
[relax] make FieldAccessDescriptor always be field-insertion order
[davidyan] [BEAM-9510] Fixing version incompatibities in
[github] Merge pull request #10991 [BEAM-3301] Refactor DoFn validation & allow
[davidyan] Bring the dep versions up to par with
[valentyn] Install typing only on 3.5.2 or earlier versions of Python.
[github] Update dataflow py container ver to 20200317 (#11145)
[kawaigin] [BEAM-7923] Include side effects in p.run
[lcwik] [BEAM-9430] Migrate from ProcessContext#updateWatermark to
[github] [BEAM-9498] Include descriptor and type of unsupported fields in
RowJson
[github] Merge pull request #11149 from [BEAM-9533] Adding tox cloud tests
[github] Flink 1.10 yarn deployment fix (#11146)
[github] [BEAM-9539] Fix copy-pasted comment in load-tests' build.gradle
(#11155)
[lcwik] [BEAM-9540] Rename beam:source:runner:0.1/beam:sink:runner:0.1 to
[github] [BEAM-9526] Add missing unmarshalling in top.LargestPerKey. (#11143)
[robertwb] [BEAM-9535] Remove unused ParDoPayload.Parameters.
[github] Merge pull request #11147 from [BEAM-7923] Support dict and iterable
[coheigea] BEAM-8924 - Update Apache Tika to 1.24
[robertwb] [BEAM-9339] Declare capabilities in the Java SDK.
[kawaigin] [BEAM-7923] Change Transform Label Prefix Syntax
[github] Specify return types of window start/end functions explicitly (#11152)
[apilloud] [BEAM-9511] Uncollect takes arbitrary expressions
[lcwik] [BEAM-9339, BEAM-2939] Drop splittable field from proto, add splittable
[apilloud] [BEAM-9515] Add test
[lcwik] [BEAM-4374] Define the protos for a "short" id mechanism for metrics
[robertwb] [BEAM-9339] Add additional Java capabilities.
[kcweaver] [BEAM-9553] Use latest Flink job server image as default.
[jfarr1] [BEAM-9470] fix flaky unit test in :sdks:java:io:kinesis
[relax] fix side-input joins
[relax] fix bug
[github] Merge pull request #11158 from [BEAM-9533] Fixing tox.ini variants
[relax] remove obsolete test
[alex] [BEAM-9035] BIP-1: Typed options for Row Schema and Field
[iemejia] [BEAM-9279] Refactor HBase to disminish relying on Serializable
wrappers
[iemejia] [BEAM-9279] Make HBase.ReadAll based on Reads instead of HBaseQuery
[github] [BEAM-9551] Environment PB Pointer cleanup (#11164)
[relax] add javadoc
[iemejia] Move CHANGES template related items into template section
[lcwik] fixup! Address PR comments.
[github] Merge pull request #11166 from [BEAM-7923] Emit info when capture
[github] fix typo at Python Package name (#11098)
[github] [BEAM-9552] Bump TestPubsub subscription creation ACK deadline to 60s
[daniel.o.programmer] [BEAM-3301] Perform SDF validation (missing
RestrictionTrackers).
[kawaigin] Remove the excessive logging from capturable sources property.
[ehudm] [BEAM-8280] Enable type hint annotations
[github] Merge pull request #11128 from [BEAM-9524] Fix for ib.show() executing
[lcwik] [BEAM-9430] Update CHANGES.md to reflect removal of
[boyuanz] Add Timer to Elements proto representation.
[daniel.o.programmer] [BEAM-3301] Bugfix in DoFn validation.
[robertwb] [BEAM-9558] Add an explicit end field to the data channel protos.
[robertwb] [BEAM-9558] Regenerate go protos.
[robertwb] [BEAM-9558] Produce and respect data channel end bit in runners and
[github] Merge pull request #11153 from [BEAM-9537] Adding a new module for
[relax] add unit tests
[relax] update sql transform
------------------------------------------
[...truncated 33.45 KB...]
- org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.6]
http://www.powermock.org
- org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.6]
http://www.powermock.org
- org.scala-lang:scala-library [2.11.8 -> 2.13.1]
https://www.scala-lang.org/
- org.scala-lang:scala-library [2.12.7 -> 2.13.1]
https://www.scala-lang.org/
- org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.8]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.4.RELEASE]
https://github.com/spring-projects/spring-framework
- org.testcontainers:clickhouse [1.10.5 -> 1.13.0]
https://testcontainers.org
- org.testcontainers:localstack [1.11.2 -> 1.13.0]
https://testcontainers.org
- org.testcontainers:testcontainers [1.11.3 -> 1.13.0]
https://testcontainers.org
- org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.3]
https://github.com/xerial/snappy-java
- redis.clients:jedis [3.0.1 -> 3.2.0]
https://github.com/xetorthio/jedis
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
https://github.com/ClickHouse/clickhouse-jdbc
- software.amazon.awssdk:apache-client [2.10.61 -> 2.10.91]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:auth [2.10.61 -> 2.10.91]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:cloudwatch [2.10.61 -> 2.10.91]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:dynamodb [2.10.61 -> 2.10.91]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sdk-core [2.10.61 -> 2.10.91]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sns [2.10.61 -> 2.10.91]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sqs [2.10.61 -> 2.10.91]
https://aws.amazon.com/sdkforjava
- sqlline:sqlline [1.4.0 -> 1.9.0]
https://github.com/julianhyde/sqlline
Gradle updates:
- Gradle: [5.2.1 -> 6.2.2 -> 6.3-rc-4]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates
# Virtualenv for the rest of the script to run setup
rm -rf sdks/
virtualenv sdks/python
Using base prefix '/usr'
New python executable in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin/python3>
Also creating executable in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin/python>
Installing setuptools, pip, wheel...
done.
. sdks/python/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly
deactivate () {
unset -f pydoc >/dev/null 2>&1
# reset old environment variables
# ! [ -z ${VAR+_} ] returns true if VAR is declared at all
if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
PATH="$_OLD_VIRTUAL_PATH"
export PATH
unset _OLD_VIRTUAL_PATH
fi
if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
export PYTHONHOME
unset _OLD_VIRTUAL_PYTHONHOME
fi
# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands. Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
hash -r 2>/dev/null
fi
if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
PS1="$_OLD_VIRTUAL_PS1"
export PS1
unset _OLD_VIRTUAL_PS1
fi
unset VIRTUAL_ENV
if [ ! "${1-}" = "nondestructive" ] ; then
# Self destruct!
unset -f deactivate
fi
}
# unset irrelevant variables
deactivate nondestructive
VIRTUAL_ENV="<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python";>
export VIRTUAL_ENV
_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH
# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
_OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
unset PYTHONHOME
fi
if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
_OLD_VIRTUAL_PS1="${PS1-}"
if [ "x" != x ] ; then
PS1="${PS1-}"
else
PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
fi
export PS1
fi
basename "$VIRTUAL_ENV"
# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true
pydoc () {
python -m pydoc "$@"
}
# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands. Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
hash -r 2>/dev/null
fi
pip install -e .[gcp,test,docs]
Obtaining
file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
ERROR: Command errored out with exit status 1:
command:
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin/python3>
-c 'import sys, setuptools, tokenize; sys.argv[0] =
'"'"'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py'"'"';>
__file__='"'"'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py'"'"';f=getattr(tokenize,>
'"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
'"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
cwd:
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/>
Complete output (67 lines):
running egg_info
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/lib/python3.5/site-packages/setuptools/dist.py>:454:
UserWarning: Normalizing '2.21.0.dev' to '2.21.0.dev0'
warnings.warn(tmpl.format(**locals()))
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py>:241:
UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/.eggs/grpcio-wheels>
Collecting grpcio-tools<=1.14.2,>=1.3.5
Using cached grpcio_tools-1.14.2-cp35-cp35m-manylinux1_x86_64.whl (22.2
MB)
Processing
/home/jenkins/.cache/pip/wheels/bf/c9/a3/c538d90ef17cf7823fa51fc701a7a7a910a80f6a405bf15b1a/future-0.16.0-cp35-none-any.whl
Collecting mypy-protobuf==1.18
Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
Collecting protobuf>=3.5.0.post1
Using cached protobuf-3.11.3-cp35-cp35m-manylinux1_x86_64.whl (1.3 MB)
Collecting grpcio>=1.14.2
Using cached grpcio-1.27.2-cp35-cp35m-manylinux2010_x86_64.whl (2.7 MB)
Collecting six>=1.9
Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
Collecting setuptools
Using cached setuptools-46.1.1-py3-none-any.whl (582 kB)
Installing collected packages: six, setuptools, protobuf, grpcio,
grpcio-tools, future, mypy-protobuf
Successfully installed future-0.16.0 grpcio-1.27.2 grpcio-tools-1.14.2
mypy-protobuf-1.18 protobuf-3.11.3 setuptools-46.1.1 six-1.14.0
WARNING:root:Installing grpcio-tools took 6.86 seconds.
INFO:gen_protos:Regenerating Python proto definitions (no output files).
Process Process-1:
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py";,>
line 292, in generate_proto_files
from grpc_tools import protoc
ImportError: No module named 'grpc_tools'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.5/multiprocessing/process.py", line 249, in
_bootstrap
self.run()
File "/usr/lib/python3.5/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py";,>
line 378, in _install_grpcio_tools_and_generate_proto_files
generate_proto_files(force=force)
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py";,>
line 315, in generate_proto_files
protoc_gen_mypy = _find_protoc_gen_mypy()
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py";,>
line 233, in _find_protoc_gen_mypy
(fname, ', '.join(search_paths)))
RuntimeError: Could not find protoc-gen-mypy in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin,>
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin,>
/home/jenkins/tools/java/latest1.8/bin, /usr/local/sbin, /usr/local/bin,
/usr/sbin, /usr/bin, /sbin, /bin, /usr/games, /usr/local/games
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py";,>
line 292, in generate_proto_files
from grpc_tools import protoc
ImportError: No module named 'grpc_tools'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py";,>
line 315, in <module>
'mypy': generate_protos_first(mypy),
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/lib/python3.5/site-packages/setuptools/__init__.py";,>
line 144, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.5/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.5/distutils/dist.py", line 955, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.5/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py";,>
line 239, in run
gen_protos.generate_proto_files()
File
"<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py";,>
line 310, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check
the logs for full command output.
> Task :sdks:python:dependencyUpdates FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'>
line: 94
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 40s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/tm5vhuvfh2azc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
