See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2311/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
2022/02/17 12:13:55 2022-02-17 12:13:55. (8): ==================== <function
expand_gbk at 0x7efbb141d598> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (9): ==================== <function
sink_flattens at 0x7efbb141d6a8> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (10): ==================== <function
greedily_fuse at 0x7efbb141d730> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (11): ==================== <function
read_to_impulse at 0x7efbb141d7b8> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (12): ==================== <function
impulse_to_input at 0x7efbb141d840> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (13): ==================== <function
sort_stages at 0x7efbb141da60> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (14): ==================== <function
setup_timer_mapping at 0x7efbb141d9d8> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (15): ==================== <function
populate_data_channel_coders at 0x7efbb141dae8> ====================
2022/02/17 12:13:55 2022-02-17 12:13:55. (16): starting control server on port
32887
2022/02/17 12:13:55 2022-02-17 12:13:55. (17): starting data server on port
35967
2022/02/17 12:13:55 2022-02-17 12:13:55. (18): starting state server on port
44385
2022/02/17 12:13:55 2022-02-17 12:13:55. (19): starting logging server on port
40243
2022/02/17 12:13:55 2022-02-17 12:13:55. (20): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7efbb02959b0> for environment llRquUdzYFbeam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.38.0.dev')
2022/02/17 12:13:55 2022-02-17 12:13:55. (21): Attempting to pull image
apache/beam_java8_sdk:2.38.0.dev
2022/02/17 12:13:55 2022-02-17 12:13:55. (22): Unable to pull image
apache/beam_java8_sdk:2.38.0.dev, defaulting to local image if it exists
2022/02/17 12:13:57 2022-02-17 12:13:57. (23): Waiting for docker to start up.
Current status is running
2022/02/17 12:13:57 2022-02-17 12:13:57. (24): Docker container is running.
container_id =
b'd5457b73d12159416e1c326b6d5e44a32696466eb59cef822c2bdbe65913c367', worker_id
= worker_7
2022/02/17 12:13:58 2022-02-17 12:13:58. (25): Running
((((llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--Impulse)+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--ParDo-OutputSingleSource--ParM))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(llRquUdzYFExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
2022/02/17 12:14:01 2022-02-17 12:14:01. (26): Running
((((((llRquUdzYFExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-ParDo-Read--ParMultiDo-Read-))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Consume-ParDo-Anonymous--Pa))+(llRquUdzYFExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Write))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-View-AsIterable-MapElements))+(llRquUdzYFExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/MapElements/Map/ParMultiDo(Anonymous).output/Write)
2022/02/17 12:14:02 2022-02-17 12:14:02. (27): Running
(((((llRquUdzYFExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Read)+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Identity-ParMultiDo-Anonymo))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Pair))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh2))+(External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write)
2022/02/17 12:14:02 2022-02-17 12:14:02. (28): Running
(((((External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read)+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh6))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh8))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh11))+(llRquUdzYFExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Valu))+(llRquUdzYFExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output/Write)
2022/02/17 12:14:02 2022-02-17 12:14:02. (29): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7efbb022dcf8> for environment go (beam:env:docker:v1,
b'\n\x16apache/beam_go_sdk:dev')
2022/02/17 12:14:02 2022-02-17 12:14:02. (30): Attempting to pull image
apache/beam_go_sdk:dev
2022/02/17 12:14:03 2022-02-17 12:14:03. (31): Unable to pull image
apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/02/17 12:14:04 2022-02-17 12:14:04. (32): Waiting for docker to start up.
Current status is running
2022/02/17 12:14:04 2022-02-17 12:14:04. (33): Docker container is running.
container_id =
b'6f565e44687f56f507ecd0c6d6125e57d3c2c5b368bab3ce7b9279f0da9d7b49', worker_id
= worker_9
2022/02/17 12:14:05 2022-02-17 12:14:05. (34): Running ((e2)+(e3))+(n3/Write)
2022/02/17 12:14:05 2022-02-17 12:14:05. (35): Running
((((e4)+(e5))+(n5/Write))+(n7/Write))+(n6/Write)
2022/02/17 12:14:05 2022-02-17 12:14:05. (36): Running (e6)+(e7)
2022/02/17 12:14:07 2022-02-17 12:14:07. (37): Successfully completed job in
12.153988122940063 seconds.
2022/02/17 12:14:07 Job state: DONE
--- PASS: TestJDBCIO_BasicReadWrite (52.03s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
52.054s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:203: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
3.028s
$ cd ../..
$ exit
$ exit
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner
>>> --job_endpoint=localhost:39485 --environment_cache_millis=10000
>>> --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5214 items / 5204 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py ... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ..F.... [100%]
=================================== FAILURES ===================================
_________________ ValidateRunnerXlangTest.test_combine_per_key _________________
self =
<apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest
testMethod=test_combine_per_key>
test_pipeline = None
@pytest.mark.xlang_transforms
def test_combine_per_key(self, test_pipeline=None):
CrossLanguageTestPipelines().run_combine_per_key(
> test_pipeline or self.create_pipeline())
apache_beam/transforms/validate_runner_xlang_test.py:279:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/transforms/validate_runner_xlang_test.py:201: in run_combine_per_key
assert_that(res, equal_to([('a', 3), ('b', 3)]))
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:600: in wait_until_finish
raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:606: in _observe_state
for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:426:
in __next__
return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline
Exc....1:39485","file":"src/core/lib/surface/call.cc","file_line":1074,"grpc_message":"Deadline
Exceeded","grpc_status":4}"
>
def _next(self):
with self._state.condition:
if self._state.code is None:
event_handler = _event_handler(self._state,
self._response_deserializer)
self._state.due.add(cygrpc.OperationType.receive_message)
operating = self._call.operate(
(cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
event_handler)
if not operating:
self._state.due.remove(cygrpc.OperationType.receive_message)
elif self._state.code is grpc.StatusCode.OK:
raise StopIteration()
else:
raise self
def _response_ready():
return (self._state.response is not None or
(cygrpc.OperationType.receive_message
not in self._state.due and
self._state.code is not None))
_common.wait(self._state.condition.wait, _response_ready)
if self._state.response is not None:
response = self._state.response
self._state.response = None
return response
elif cygrpc.OperationType.receive_message not in self._state.due:
if self._state.code is grpc.StatusCode.OK:
raise StopIteration()
elif self._state.code is not None:
> raise self
E grpc._channel._MultiThreadedRendezvous:
<_MultiThreadedRendezvous of RPC that terminated with:
E status = StatusCode.DEADLINE_EXCEEDED
E details = "Deadline Exceeded"
E debug_error_string =
"{"created":"@1645100531.271133303","description":"Error received from peer
ipv4:127.0.0.1:39485","file":"src/core/lib/surface/call.cc","file_line":1074,"grpc_message":"Deadline
Exceeded","grpc_status":4}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:826:
_MultiThreadedRendezvous
----------------------------- Captured stderr call -----------------------------
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.6 interpreter.
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:374 Make sure that locally built Python SDK
docker image has Python 3.6 interpreter.
WARNING root:environments.py:374 Make sure that locally built Python SDK
docker image has Python 3.6 interpreter.
WARNING root:portable_runner.py:570 Make sure that locally built Python SDK
docker image has Python 3.6 interpreter.
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54:
DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint:
disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62:
DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), #
pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml>
-
====== 1 failed, 9 passed, 5204 deselected, 2 warnings in 434.07 seconds =======
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 565, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string =
"{"created":"@1645100531.278086701","description":"Error received from peer
ipv4:127.0.0.1:39485","file":"src/core/lib/surface/call.cc","file_line":1074,"grpc_message":"Deadline
Exceeded","grpc_status":4}"
>
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner
>>> --job_endpoint=localhost:39485 --environment_cache_millis=10000
>>> --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5214 items / 5204 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml>
-
============ 8 passed, 2 skipped, 5204 deselected in 198.01 seconds ============
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner
>>> --job_endpoint=localhost:39485 --environment_cache_millis=10000
>>> --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5214 items / 5205 deselected / 9 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
================= 9 passed, 5205 deselected in 421.68 seconds ==================
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1827445.
Stopping expansion service pid: 1827446.
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1801000
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 43m 24s
233 actionable tasks: 163 executed, 59 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/qpsmwhwraswk6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
