See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/4361/display/redirect?page=changes>
Changes:
[Pablo Estrada] Informative error for BigDecimal conversion in JdbcIO.
[Udi Meiri] Moving to 2.34.0-SNAPSHOT on master branch.
[noreply] Add 2.34.0 section to CHANGES.md
------------------------------------------
[...truncated 1.25 MB...]
state_thread.is_alive()):
time.sleep(1)
else:
self._observe_state(message_thread)
if self._runtime_exception:
> raise self._runtime_exception
E RuntimeError: Pipeline
BeamApp-jenkins-0826011310-c28e508b_0d0fc446-57d6-4e16-aef1-ef86930430c9 failed
in state FAILED: java.lang.RuntimeException: Error received from SDK harness
for instruction 4: Traceback (most recent call last):
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 284, in _execute
E response = task()
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 357, in <lambda>
E lambda: self.create_worker().do_instruction(request), request)
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 602, in do_instruction
E return getattr(self, request_type)(
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 633, in process_bundle
E bundle_processor = self.bundle_processor_cache.get(
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 458, in get
E processor = bundle_processor.BundleProcessor(
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 864, in __init__
E self.ops =
self.create_execution_tree(self.process_bundle_descriptor)
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 917, in create_execution_tree
E return collections.OrderedDict([(
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 920, in <listcomp>
E get_operation(transform_id))) for transform_id in sorted(
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
E result = cache[args] = func(*args)
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
E transform_consumers = {
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
E tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
E tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
E result = cache[args] = func(*args)
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
E transform_consumers = {
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
E tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
E tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
E result = cache[args] = func(*args)
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
E transform_consumers = {
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
E tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
E tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
E result = cache[args] = func(*args)
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 904, in get_operation
E return transform_factory.create_operation(
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1199, in create_operation
E operation = creator(self, transform_id, transform_proto, payload,
consumers)
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1563, in create_par_do
E return _create_pardo_operation(
E File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1656, in _create_pardo_operation
E operation_cls(
E File "apache_beam/runners/worker/operations.py", line 597, in
apache_beam.runners.worker.operations.DoOperation.__init__
E AttributeError: 'apache_beam.runners.worker.operations.DoOperation'
object has no attribute '_pushdown_fields'
apache_beam/runners/portability/portable_runner.py:600: RuntimeError
----------------------------- Captured stderr call -----------------------------
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.8 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.8 interpreter.
ERROR:root:java.lang.RuntimeException: Error received from SDK harness for
instruction 4: Traceback (most recent call last):
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 284, in _execute
response = task()
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 357, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 602, in do_instruction
return getattr(self, request_type)(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 633, in process_bundle
bundle_processor = self.bundle_processor_cache.get(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 458, in get
processor = bundle_processor.BundleProcessor(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 864, in __init__
self.ops = self.create_execution_tree(self.process_bundle_descriptor)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 917, in create_execution_tree
return collections.OrderedDict([(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 920, in <listcomp>
get_operation(transform_id))) for transform_id in sorted(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
transform_consumers = {
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
transform_consumers = {
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
transform_consumers = {
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 904, in get_operation
return transform_factory.create_operation(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1199, in create_operation
operation = creator(self, transform_id, transform_proto, payload, consumers)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1563, in create_par_do
return _create_pardo_operation(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1656, in _create_pardo_operation
operation_cls(
File "apache_beam/runners/worker/operations.py", line 597, in
apache_beam.runners.worker.operations.DoOperation.__init__
AttributeError: 'apache_beam.runners.worker.operations.DoOperation' object has
no attribute '_pushdown_fields'
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.8 interpreter.
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.RuntimeException: Error received
from SDK harness for instruction 4: Traceback (most recent call last):
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 284, in _execute
response = task()
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 357, in <lambda>
lambda:
self.create_worker().do_instruction(request), request)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 602, in do_instruction
return getattr(self, request_type)(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 633, in process_bundle
bundle_processor =
self.bundle_processor_cache.get(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 458, in get
processor =
bundle_processor.BundleProcessor(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 864, in __init__
self.ops =
self.create_execution_tree(self.process_bundle_descriptor)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 917, in create_execution_tree
return collections.OrderedDict([(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 920, in <listcomp>
get_operation(transform_id))) for
transform_id in sorted(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
transform_consumers = {
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
tag: [get_operation(op) for op in
pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
tag: [get_operation(op) for op in
pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
transform_consumers = {
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
tag: [get_operation(op) for op in
pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
tag: [get_operation(op) for op in
pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 899, in get_operation
transform_consumers = {
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <dictcomp>
tag: [get_operation(op) for op in
pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 900, in <listcomp>
tag: [get_operation(op) for op in
pcoll_consumers[pcoll_id]]
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 807, in wrapper
result = cache[args] = func(*args)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 904, in get_operation
return
transform_factory.create_operation(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1199, in create_operation
operation = creator(self,
transform_id, transform_proto, payload, consumers)
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1563, in create_par_do
return _create_pardo_operation(
File
"/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1656, in _create_pardo_operation
operation_cls(
File
"apache_beam/runners/worker/operations.py", line 597, in
apache_beam.runners.worker.operations.DoOperation.__init__
AttributeError:
'apache_beam.runners.worker.operations.DoOperation' object has no attribute
'_pushdown_fields'
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========== 9 failed, 4975 deselected, 1 warnings in 130.43 seconds ============
> Task
> :runners:flink:1.13:job-server:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :runners:flink:1.13:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 12943.
Stopping expansion service pid: 12946.
> Task :runners:flink:1.13:job-server:flinkJobServerCleanup
Stopping job server pid: 20261.
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.13:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/runners/flink/1.13/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.13:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.13:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.13:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 22m 6s
176 actionable tasks: 29 executed, 147 up-to-date
Publishing build scan...
https://gradle.com/s/u7ak5bzebnnci
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
