See
<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/2297/display/redirect?page=changes>
Changes:
[yoshiki.obata] [BEAM-7672] dynamically setup acceptable wheel specs according
to
[yoshiki.obata] fixup: update error message when parse failed
[yoshiki.obata] fixup: not to abort when wheel spec setup failed
[yoshiki.obata] fixup: not to use m flag at wheel name with python 3.8
[yoshiki.obata] fixup: simplified wheel name setting
[kcweaver] [BEAM-10487] Link release blog posts on the Downloads page
[Boyuan Zhang] Insert TruncateSizedRestriction when pipeline starts to drain.
[Boyuan Zhang] Address latest comments.
[Boyuan Zhang] SpotlessApply
[Boyuan Zhang] Fix java build.
[Boyuan Zhang] spotlessApply
[Boyuan Zhang] Only forward split/progress when the only consumer is splittable.
[kcweaver] [BEAM-8244] Don't run external transform tests with pre_optimize=all.
[Ahmet Altay] Relax to matchers to match display data from the specific tests,
not
[noreply] [BEAM-8454] Increase timeout and also enable thread stuckness
detector.
[noreply] [BEAM-10490] Support read/write ZetaSQL DATE/TIME types from/to
BigQuery
[noreply] [BEAM-10526] Use GrpcCleanupRule to use consistent methodology on
server
[noreply] [BEAM-9968] Guarantee that outstanding split/progress requests are
------------------------------------------
[...truncated 3.23 MB...]
... 12 more
Caused by: java.lang.RuntimeException: Error received from SDK harness for
instruction 5: Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 256, in _execute
response = task()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 313, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 483, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 518, in process_bundle
bundle_processor.process_bundle(instruction_id))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py";,>
line 978, in process_bundle
element.data)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py";,>
line 218, in process_encoded
self.output(decoded_value)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
line 332, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
line 195, in receive
self.consumer.process(windowed_value)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
line 764, in process
delayed_application = self.dofn_runner.process_with_sized_restriction(o)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/common.py";,>
line 990, in process_with_sized_restriction
watermark_estimator_state=estimator_state)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/common.py";,>
line 721, in invoke_process
windowed_value, additional_args, additional_kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/common.py";,>
line 829, in _invoke_process_per_window
self.threadsafe_restriction_tracker.check_done()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/sdf_utils.py";,>
line 115, in check_done
return self._restriction_tracker.check_done()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/io/restriction_trackers.py";,>
line 103, in check_done
self._range.stop))
ValueError: OffsetRestrictionTracker is not done since work in range [0, 3) has
not been claimed.
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:177)
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:157)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:251)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:309)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:292)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:782)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
ERROR:root:java.lang.RuntimeException: Error received from SDK harness for
instruction 5: Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 256, in _execute
response = task()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 313, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 483, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
line 518, in process_bundle
bundle_processor.process_bundle(instruction_id))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py";,>
line 978, in process_bundle
element.data)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py";,>
line 218, in process_encoded
self.output(decoded_value)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
line 332, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
line 195, in receive
self.consumer.process(windowed_value)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
line 764, in process
delayed_application = self.dofn_runner.process_with_sized_restriction(o)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/common.py";,>
line 990, in process_with_sized_restriction
watermark_estimator_state=estimator_state)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/common.py";,>
line 721, in invoke_process
windowed_value, additional_args, additional_kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/common.py";,>
line 829, in _invoke_process_per_window
self.threadsafe_restriction_tracker.check_done()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/sdf_utils.py";,>
line 115, in check_done
return self._restriction_tracker.check_done()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/io/restriction_trackers.py";,>
line 103, in check_done
self._range.stop))
ValueError: OffsetRestrictionTracker is not done since work in range [0, 3) has
not been claimed.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to FAILED
.ssssINFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at
localhost:43217
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.5 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python3.5_sdk:2.24.0.dev.
If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has
started a component necessary for the execution. Be sure to run the pipeline
using
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
RUNNING
[flink-runner-job-invoker] WARN
org.apache.flink.runtime.webmonitor.WebMonitorUtils - Log file environment
variable 'log.file' is not set.
[flink-runner-job-invoker] WARN
org.apache.flink.runtime.webmonitor.WebMonitorUtils - JobManager log files are
unavailable in the web dashboard. Log file location not found in environment
variable 'log.file' or configuration key 'Key: 'web.log.path' , default: null
(fallback keys: [{key=jobmanager.web.log.path, isDeprecated=true}])'.
[[5]{Create, Map(<lambda at fn_runner_test.py:490>), WindowInto(WindowIntoFn),
Map(<lambda at fn_runner_test.py:493>)} (2/2)] WARN
org.apache.flink.metrics.MetricGroup - The operator name [5]{Create,
Map(<lambda at fn_runner_test.py:490>), WindowInto(WindowIntoFn), Map(<lambda
at fn_runner_test.py:493>)} exceeded the 80 characters length limit and was
truncated.
[[5]{Create, Map(<lambda at fn_runner_test.py:490>), WindowInto(WindowIntoFn),
Map(<lambda at fn_runner_test.py:493>)} (1/2)] WARN
org.apache.flink.metrics.MetricGroup - The operator name [5]{Create,
Map(<lambda at fn_runner_test.py:490>), WindowInto(WindowIntoFn), Map(<lambda
at fn_runner_test.py:493>)} exceeded the 80 characters length limit and was
truncated.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel
for localhost:39125.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with
unbounded number of workers.
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for
localhost:35545.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for
localhost:42867
INFO:apache_beam.runners.worker.sdk_worker:No more requests from control plane
INFO:apache_beam.runners.worker.sdk_worker:SDK Harness waiting for in-flight
requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/2)]
WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for
unknown endpoint.INFO:apache_beam.runners.worker.data_plane:Closing all cached
grpc data channels.
INFO:apache_beam.runners.worker.sdk_worker:Closing all cached gRPC state
handlers.
INFO:apache_beam.runners.worker.sdk_worker:Done consuming work.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
.INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at
localhost:35303
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.5 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python3.5_sdk:2.24.0.dev.
If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has
started a component necessary for the execution. Be sure to run the pipeline
using
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
RUNNING
[flink-runner-job-invoker] WARN
org.apache.flink.runtime.webmonitor.WebMonitorUtils - Log file environment
variable 'log.file' is not set.
[flink-runner-job-invoker] WARN
org.apache.flink.runtime.webmonitor.WebMonitorUtils - JobManager log files are
unavailable in the web dashboard. Log file location not found in environment
variable 'log.file' or configuration key 'Key: 'web.log.path' , default: null
(fallback keys: [{key=jobmanager.web.log.path, isDeprecated=true}])'.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel
for localhost:45737.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with
unbounded number of workers.
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for
localhost:45637.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for
localhost:35881
INFO:apache_beam.runners.worker.sdk_worker:No more requests from control plane
INFO:apache_beam.runners.worker.sdk_worker:SDK Harness waiting for in-flight
requests to complete
INFO:apache_beam.runners.worker.data_plane:Closing all cached grpc data
channels.
INFO:apache_beam.runners.worker.sdk_worker:Closing all cached gRPC state
handlers.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/2)]
WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for
unknown endpoint.
INFO:apache_beam.runners.worker.sdk_worker:Done consuming work.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
.INFO:__main__:removing conf dir: /tmp/flinktest-conf7g1riqnn
======================================================================
ERROR: test_sql (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py";,>
line 276, in test_sql
equal_to([(x, '{x}*{x}'.format(x=x), x * x) for x in range(5)]))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 556, in __exit__
self.result.wait_until_finish()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 544, in wait_until_finish
self._observe_state(message_thread)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 553, in _observe_state
for state_response in self._state_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_channel.py";,>
line 416, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_channel.py";,>
line 697, in _next
_common.wait(self._state.condition.wait, _response_ready)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_common.py";,>
line 138, in wait
_wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_common.py";,>
line 103, in _wait_once
wait_fn(timeout=timeout)
File "/usr/lib/python3.5/threading.py", line 297, in wait
gotit = waiter.acquire(True, timeout)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner_test.py";,>
line 82, in handler
raise BaseException(msg)
BaseException: Timed out after 60 seconds.
----------------------------------------------------------------------
Ran 92 tests in 219.046s
FAILED (errors=1, skipped=18)
==================== Timed out after 60 seconds. ====================
# Thread: <Thread(read_grpc_client_inputs, started daemon 139822173771520)>
# Thread: <Thread(Thread-796, started daemon 139822190556928)>
# Thread: <Thread(read_state, started daemon 139822727427840)>
# Thread: <Thread(Thread-777, started daemon 139822156986112)>
# Thread: <_Worker(Thread-18, started daemon 139823636453120)>
# Thread: <_Worker(Thread-202, started daemon 139822165378816)>
# Thread: <_Worker(Thread-200, started daemon 139822685464320)>
# Thread: <Thread(run_worker_37-1, started daemon 139823930140416)>
# Thread: <Thread(Thread-795, started daemon 139822710642432)>
# Thread: <Thread(Thread-794, started daemon 139823611275008)>
# Thread: <Thread(wait_until_finish_read, started daemon 139822719035136)>
# Thread: <_MainThread(MainThread, started 139824491988736)>
# Thread: <Thread(Thread-793, started daemon 139823619667712)>
# Thread: <_Worker(Thread-433, started daemon 139822693857024)>
# Thread: <_Worker(Thread-10, started daemon 139823972087552)>
# Thread: <Thread(Thread-792, started daemon 139823628060416)>
# Thread: <PeriodicThread(Thread-790, started daemon 139824014034688)>
# Thread: <_Worker(Thread-65, started daemon 139822182164224)>
# Thread: <Thread(Thread-785, started daemon 139822677071616)>
# Thread: <Thread(Thread-791, started daemon 139823644845824)>
> Task
> :sdks:python:test-suites:portable:py35:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK
> FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 57
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python35_VR_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 57
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38m 44s
103 actionable tasks: 77 executed, 25 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/7c7eokeaw6cqe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
