See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/3542/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-9956] Remove unbalanced code markup.
[zyichi] Bump up advanceProcessingTime duration in ParDoTest
[tobiasz.kedzierski] [BEAM-10623] Add workflow to run python tests on
Linux/Windows/Mac
[tobiasz.kedzierski] [BEAM-10624] dtype explicit for the numpy arrays
[Steve Niemitz] [BEAM-10523] Add support for custom DatumWriters to AvroIO.Write
[Luke Cwik] [BEAM-10040, BEAM-6804] Increase wait times to reduce flakiness.
[noreply] [BEAM-10752] add use_deprecated_read experiment for testSimpleInsert,
------------------------------------------
[...truncated 3.64 MB...]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:315)
at
org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:209)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:185)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:174)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.lambda$scheduleRelease$1(ReferenceCountingExecutableStageContextFactory.java:128)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannel$AnnotatedConnectException:
Connection refused: localhost/127.0.0.1:37195
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:714)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:688)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
INFO:apache_beam.runners.worker.sdk_worker:No more requests from control plane
INFO:apache_beam.runners.worker.sdk_worker:SDK Harness waiting for in-flight
requests to complete
INFO:apache_beam.runners.worker.data_plane:Closing all cached grpc data
channels.
INFO:apache_beam.runners.worker.sdk_worker:Closing all cached gRPC state
handlers.
INFO:apache_beam.runners.worker.sdk_worker:Done consuming work.
20/08/19 00:09:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
PipelineOptions.filesToStage was not specified. Defaulting to files from the
classpath
20/08/19 00:09:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Will
stage 7 files. (Enable logging at DEBUG level to see which files will be
staged.)
20/08/19 00:09:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
Running job test_windowing_1597795785.72_5682cdf1-aba5-4f37-99d5-8033fcfaa1d9
on Spark master local
20/08/19 00:09:48 WARN
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions:
Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not
consistent with equals. That might cause issues on some runners.
20/08/19 00:09:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
test_windowing_1597795785.72_5682cdf1-aba5-4f37-99d5-8033fcfaa1d9: Pipeline
translated successfully. Computing outputs
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel
for localhost:38731.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with
unbounded number of workers.
20/08/19 00:09:49 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 33-1
20/08/19 00:09:49 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 33-2
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for
localhost:46313.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for
localhost:46001
20/08/19 00:09:49 INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client
connected.
20/08/19 00:09:49 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 33-3
20/08/19 00:09:49 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 33-4
20/08/19 00:09:49 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 33-5
20/08/19 00:09:50 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 33-6
20/08/19 00:09:50 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
test_windowing_1597795785.72_5682cdf1-aba5-4f37-99d5-8033fcfaa1d9 finished.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
.
======================================================================
ERROR: test_pardo_state_with_custom_key_coder (__main__.SparkRunnerTest)
Tests that state requests work correctly when the key coder is an
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/portable_runner_test.py", line 241, in
test_pardo_state_with_custom_key_coder
equal_to(expected))
File "apache_beam/pipeline.py", line 556, in __exit__
self.result.wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 544, in
wait_until_finish
self._observe_state(message_thread)
File "apache_beam/runners/portability/portable_runner.py", line 553, in
_observe_state
==================== Timed out after 60 seconds. ====================
for state_response in self._state_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next
return self._next()
# Thread: <Thread(read_grpc_client_inputs, started daemon 139980122859264)>
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 697, in _next
_common.wait(self._state.condition.wait, _response_ready)
# Thread: <Thread(Thread-457, started daemon 139980148037376)>
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
line 138, in wait
_wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
# Thread: <Thread(Thread-455, started daemon 139981204993792)>
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
line 103, in _wait_once
wait_fn(timeout=timeout)
# Thread: <Thread(run_worker_23-1, started daemon 139982001907456)>
File "/usr/lib/python2.7/threading.py", line 359, in wait
_sleep(delay)
# Thread: <_Worker(Thread-420, started daemon 139980139644672)>
File "apache_beam/runners/portability/portable_runner_test.py", line 82, in
handler
raise BaseException(msg)
# Thread: <Thread(read_state, started daemon 139980676515584)>
BaseException: Timed out after 60 seconds.
# Thread: <Thread(Thread-441, started daemon 139980131251968)>
----------------------------------------------------------------------
# Thread: <Thread(Thread-447, started daemon 139982027085568)>
Ran 46 tests in 237.640s
# Thread: <Thread(Thread-453, started daemon 139981230171904)>
FAILED# Thread: <_MainThread(MainThread, started 139982904727296)>
(errors=1, skipped=14)
# Thread: <PeriodicThread(Thread-451, started daemon 139982043870976)>
# Thread: <_Worker(Thread-10, started daemon 139982018692864)>
# Thread: <Thread(Thread-456, started daemon 139980659730176)>
# Thread: <Thread(wait_until_finish_read, started daemon 139981238564608)>
# Thread: <Thread(Thread-452, started daemon 139981993514752)>
# Thread: <Thread(Thread-454, started daemon 139981221779200)>
Exception in thread read_grpc_client_inputs (most likely raised during
interpreter shutdown):
Traceback (most recent call last):
Exception in thread read_state (most likely raised during interpreter
shutdown):
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
File "/usr/lib/python2.7/threading.py", line 754, in run
File "apache_beam/runners/worker/sdk_worker.py", line 825, in
pull_responsesException in thread read_grpc_client_inputs (most likely raised
during interpreter shutdown):Exception in thread run_worker_33-1 (most likely
raised during interpreter shutdown):
<type 'exceptions.AttributeError'>: 'NoneType' object has no attribute
'exc_info'Exception in thread read_state (most likely raised during interpreter
shutdown):
Exception in thread read_state (most likely raised during interpreter shutdown):
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
Exception in thread Thread-642 (most likely raised during interpreter
shutdown):
Traceback (most recent call last): File "/usr/lib/python2.7/threading.py",
line 754, in run
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
File "/usr/lib/python2.7/threading.py", line 801, in
__bootstrap_innerTraceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in
__bootstrap_innerException in thread run_worker_31-1 (most likely raised during
interpreter shutdown):
Traceback (most recent call last): File
"apache_beam/runners/worker/data_plane.py", line 184, in run
Traceback (most recent call last): File "/usr/lib/python2.7/threading.py",
line 754, in runException in thread Thread-603 (most likely raised during
interpreter shutdown):Exception in thread read_grpc_client_inputs (most likely
raised during interpreter shutdown):
File "apache_beam/runners/worker/sdk_worker.py", line 825, in
pull_responsesException in thread run_worker_32-1 (most likely raised during
interpreter shutdown):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
File "/usr/lib/python2.7/threading.py", line 754, in run
File "apache_beam/runners/worker/data_plane.py", line 541, in <lambda>
<type 'exceptions.AttributeError'>: 'NoneType' object has no attribute
'exc_info'Exception in thread Thread-622 (most likely raised during interpreter
shutdown):
File "apache_beam/runners/worker/sdk_worker.py", line 224, in run File
"/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
File "/usr/lib/python2.7/threading.py", line 754, in run
Traceback (most recent call last):
Traceback (most recent call last):Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner File
"/usr/lib/python2.7/threading.py", line 754, in run File
"apache_beam/runners/worker/data_plane.py", line 536, in _read_inputs File
"/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner File
"/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
File "/usr/lib/python2.7/threading.py", line 754, in run
File "apache_beam/runners/worker/sdk_worker.py", line 224, in run
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next File "apache_beam/runners/worker/sdk_worker.py", line 440,
in shutdown_inactive_bundle_processorsTraceback (most recent call last): File
"/usr/lib/python2.7/threading.py", line 585, in set File
"apache_beam/runners/worker/data_plane.py", line 541, in <lambda>Traceback
(most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 536, in _read_inputs
File "/usr/lib/python2.7/threading.py", line 585, in set
<type 'exceptions.AttributeError'>: 'NoneType' object has no attribute 'time'
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 706, in _next
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
File "/usr/lib/python2.7/threading.py", line 754, in run File
"/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
File "/usr/lib/python2.7/threading.py", line 754, in run
File "/usr/lib/python2.7/threading.py", line 407, in notifyAll
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next File "apache_beam/runners/worker/sdk_worker.py", line 224,
in run File "apache_beam/runners/worker/data_plane.py", line 184, in run
File "apache_beam/runners/worker/data_plane.py", line 184, in run File
"apache_beam/runners/worker/sdk_worker.py", line 825, in pull_responses
File "apache_beam/runners/worker/sdk_worker.py", line 440, in
shutdown_inactive_bundle_processors
<type 'exceptions.AttributeError'>: 'NoneType' object has no attribute 'time'
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 413, in next
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 706, in _next
File "/usr/lib/python2.7/threading.py", line 289, in __exit__
File "/usr/lib/python2.7/threading.py", line 216, in __exit__
File "/usr/lib/python2.7/threading.py", line 203, in release
<type 'exceptions.TypeError'>: 'NoneType' object is not callable
File "apache_beam/runners/worker/data_plane.py", line 541, in <lambda>
File "apache_beam/runners/worker/data_plane.py", line 536, in _read_inputs
File "/usr/lib/python2.7/threading.py", line 585, in set
File "/usr/lib/python2.7/threading.py", line 407, in notifyAll
<type 'exceptions.TypeError'>: 'NoneType' object is not callable
<type 'exceptions.TypeError'>: 'NoneType' object is not callable
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 706, in _next
File "/usr/lib/python2.7/threading.py", line 407, in notifyAll
File "/usr/lib/python2.7/threading.py", line 289, in __exit__ File
"apache_beam/runners/worker/sdk_worker.py", line 440, in
shutdown_inactive_bundle_processors
<type 'exceptions.TypeError'>: 'NoneType' object is not callable<type
'exceptions.AttributeError'>: 'NoneType' object has no attribute 'exc_info'
<type 'exceptions.AttributeError'>: 'NoneType' object has no attribute 'time'
File "/usr/lib/python2.7/threading.py", line 289, in __exit__
File "/usr/lib/python2.7/threading.py", line 216, in __exit__
File "/usr/lib/python2.7/threading.py", line 203, in release
<type 'exceptions.TypeError'>: 'NoneType' object is not callable
File "/usr/lib/python2.7/threading.py", line 216, in __exit__
File "/usr/lib/python2.7/threading.py", line 203, in release
<type 'exceptions.TypeError'>: 'NoneType' object is not callable
> Task
> :sdks:python:test-suites:portable:py2:sparkCompatibilityMatrixBatchLOOPBACK
> FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 173
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py2:sparkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 39s
78 actionable tasks: 64 executed, 14 from cache
Publishing build scan...
https://gradle.com/s/uus43btzgoq7i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
