See
<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/1111/display/redirect?page=changes>
Changes:
[Robin Qiu] Test group by and aggregation on DATE and TIME type
[bmichalski] get default GCP region option (Go)
[bmichalski] Remove cmd.String() call to support Go 1.12.
[valentyn] Declare Python 3.8 support in setup.py
[valentyn] Adds a note about Python 3.8 support in CHANGES.md
[kcweaver] [BEAM-10243] Fix and test FieldValueBuilder::withFieldValues.
[Brian Hulette] Add failing value provider option test
[Brian Hulette] fix pipeline options in PortableRunner
[Brian Hulette] Make sdk_worker_main_test assertions more specific
[noreply] Merge pull request #12143 from [BEAM-10291] Adding full thread dump
upon
------------------------------------------
[...truncated 2.56 MB...]
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for
localhost:37513.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for
localhost:36155
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/2)]
WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for
unknown endpoint.
INFO:apache_beam.runners.worker.sdk_worker:No more requests from control plane
INFO:apache_beam.runners.worker.sdk_worker:SDK Harness waiting for in-flight
requests to complete
INFO:apache_beam.runners.worker.data_plane:Closing all cached grpc data
channels.
INFO:apache_beam.runners.worker.sdk_worker:Closing all cached gRPC state
handlers.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.runners.worker.sdk_worker:Done consuming work.
.INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at
localhost:34353
WARNING:root:Make sure that locally built Python SDK docker image has Python
2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.24.0.dev.
If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has
started a component necessary for the execution. Be sure to run the pipeline
using
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
RUNNING
[flink-runner-job-invoker] WARN
org.apache.flink.runtime.webmonitor.WebMonitorUtils - Log file environment
variable 'log.file' is not set.
[flink-runner-job-invoker] WARN
org.apache.flink.runtime.webmonitor.WebMonitorUtils - JobManager log files are
unavailable in the web dashboard. Log file location not found in environment
variable 'log.file' or configuration key 'Key: 'web.log.path' , default: null
(fallback keys: [{key=jobmanager.web.log.path, isDeprecated=true}])'.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel
for localhost:35573.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with
unbounded number of workers.
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for
localhost:46143.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for
localhost:33715
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/2)]
WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for
unknown endpoint.
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data
plane.
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 528, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 706, in _next
raise self
_MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1594255277.859663934","description":"Error received from peer
ipv4:127.0.0.1:33715","file":"src/core/lib/surface/call.cc","file_line":1055,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 545, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 528, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 706, in _next
raise self
_MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1594255277.859663934","description":"Error received from peer
ipv4:127.0.0.1:33715","file":"src/core/lib/surface/call.cc","file_line":1055,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.runners.worker.sdk_worker:No more requests from control plane
INFO:apache_beam.runners.worker.sdk_worker:SDK Harness waiting for in-flight
requests to complete
INFO:apache_beam.runners.worker.data_plane:Closing all cached grpc data
channels.
INFO:apache_beam.runners.worker.sdk_worker:Closing all cached gRPC state
handlers.
.INFO:__main__:removing conf dir: /tmp/flinktest-conf46d5q8
INFO:apache_beam.runners.worker.sdk_worker:Done consuming work.
======================================================================
ERROR: test_external_transforms (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py";,>
line 235, in test_external_transforms
expansion_service=self.get_expansion_service()))
File "apache_beam/pipeline.py", line 555, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 544, in
wait_until_finish
==================== Timed out after 60 seconds. ====================
# Thread: <Thread(wait_until_finish_read, started daemon 140037182179072)>
self._observe_state(message_thread)
File "apache_beam/runners/portability/portable_runner.py", line 553, in
_observe_state
for state_response in self._state_stream:
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 697, in _next
_common.wait(self._state.condition.wait, _response_ready)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
line 138, in wait
# Thread: <Thread(Thread-148, started daemon 140038459086592)>
_wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
# Thread: <_Worker(Thread-56, started daemon 140037173786368)>
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
line 103, in _wait_once
wait_fn(timeout=timeout)
# Thread: <Thread(Thread-142, started daemon 140037198964480)>
File "/usr/lib/python2.7/threading.py", line 359, in wait
_sleep(delay)
File "apache_beam/runners/portability/portable_runner_test.py", line 82, in
handler
raise BaseException(msg)
# Thread: <_MainThread(MainThread, started 140039249061632)>
BaseException: Timed out after 60 seconds.
======================================================================
# Thread: <_Worker(Thread-9, started daemon 140038433908480)>
# Thread: <_Worker(Thread-19, started daemon 140037190571776)>
ERROR: test_sql (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/jenkins-sla==================== Timed out after 60
seconds. ====================
ve/workspace/beam_PreCommit_Python2_PVR_Flink_Cron/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",
line 274, in test_sql
equal_to([(x, '{x}*{x}'.format(x=x), x * x) for x in range(5)]))
# Thread: <Thread(read_grpc_client_inputs, started daemon 140036771133184)>
File "apache_beam/pipeline.py", line 555, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 544, in
wait_until_finish
self._observe_state(message_thread)
File "apache_beam/runners/portability/portable_runner.py", line 553, in
_observe_state
for state_response in self._state_stream:
# Thread: <Thread(Thread-651, started daemon 140036779525888)>
# Thread: <_Worker(Thread-167, started daemon 140036804704000)>
# Thread: <_Worker(Thread-204, started daemon 140037157000960)>
# Thread: <Thread(Thread-650, started daemon 140038459086592)>
# Thread: <Thread(read_state, started daemon 140037760980736)>
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next
return self._next()
# Thread: <Thread(Thread-636, started daemon 140037165393664)>
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 697, in _next
# Thread: <Thread(Thread-648, started daemon 140037777766144)>
_common.wait(self._state.condition.wait, _response_ready)
# Thread: <Thread(run_worker_36-1, started daemon 140037811336960)>
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
line 138, in wait
_wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
# Thread: <_Worker(Thread-203, started daemon 140037182179072)>
File
"<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
line 103, in _wait_once
wait_fn(timeout=timeout)
File "/usr/lib/python2.7/threading.py", line 359, in wait
_sleep(delay)
# Thread: <_Worker(Thread-19, started daemon 140037190571776)>
File "apache_beam/runners/portability/portable_runner_test.py", line 82, in
handler
raise BaseException(msg)
BaseException: Timed out after 60 seconds.
----------------------------------------------------------------------
Ran 86 tests in 502.389s
FAILED (errors=2, skipped=16)
# Thread: <_Worker(Thread-56, started daemon 140037173786368)>
# Thread: <Thread(wait_until_finish_read, started daemon 140037198964480)>
# Thread: <Thread(Thread-627, started daemon 140037207357184)>
# Thread: <_Worker(Thread-346, started daemon 140036796311296)>
# Thread: <Thread(Thread-625, started daemon 140037786158848)>
# Thread: <_MainThread(MainThread, started 140039249061632)>
# Thread: <_Worker(Thread-9, started daemon 140038433908480)>
# Thread: <Thread(Thread-647, started daemon 140037794551552)>
# Thread: <PeriodicThread(Thread-645, started daemon 140038442301184)>
# Thread: <Thread(Thread-646, started daemon 140037802944256)>
# Thread: <PeriodicThread(Thread-621, started daemon 140039040595712)>
# Thread: <Thread(Thread-649, started daemon 140037769373440)>
# Thread: <Thread(Thread-642, started daemon 140036787918592)>
> Task
> :sdks:python:test-suites:portable:py2:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK
> FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 57
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py2:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 57
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py2:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 57
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py2:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31m 13s
103 actionable tasks: 74 executed, 28 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ymoytpug5qtsy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
